INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51620 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:16:09,886 - lava_callback - INFO - Received callback for node 69cbf3418df9359ff4897d12 2026-04-02 16:16:09,892 - lava_callback - INFO - Starting async job submit for node 69cbf3418df9359ff4897d12 INFO: 172.20.0.1:57928 - "POST /node/69cbf3418df9359ff4897d12 HTTP/1.0" 202 Accepted 2026-04-02 16:16:09,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:16:09,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf3418df9359ff4897d12 HTTP/1.1" 200 None 2026-04-02 16:16:09,916 - lava_callback - DEBUG - Processing node 69cbf3418df9359ff4897d12: baseline-arm64-clabbe 2026-04-02 16:16:09,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf3418df9359ff4897d12 2026-04-02 16:16:09,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:16:09,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf3418df9359ff4897d12 HTTP/1.1" 200 None 2026-04-02 16:16:09,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:16:09,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 16:16:09,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:16:09,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf3418df9359ff4897d12 HTTP/1.1" 200 None 2026-04-02 16:16:09,975 - lava_callback - ERROR - Error processing callback for node 69cbf3418df9359ff4897d12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60140 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:42:27,697 - lava_callback - INFO - Received callback for node 69cbf9688df9359ff489811e INFO: 172.20.0.1:60154 - "POST /node/69cbf9688df9359ff489811e HTTP/1.0" 202 Accepted 2026-04-02 16:42:27,703 - lava_callback - INFO - Starting async job submit for node 69cbf9688df9359ff489811e 2026-04-02 16:42:27,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:42:27,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf9688df9359ff489811e HTTP/1.1" 200 None 2026-04-02 16:42:27,727 - lava_callback - DEBUG - Processing node 69cbf9688df9359ff489811e: baseline-arm-baylibre 2026-04-02 16:42:27,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf9688df9359ff489811e 2026-04-02 16:42:27,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:42:27,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf9688df9359ff489811e HTTP/1.1" 200 None 2026-04-02 16:42:27,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:42:27,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:42:27,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:42:27,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf9688df9359ff489811e HTTP/1.1" 200 None 2026-04-02 16:42:27,800 - lava_callback - ERROR - Error processing callback for node 69cbf9688df9359ff489811e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38562 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:43:07,684 - lava_callback - INFO - Received callback for node 69cbf9918df9359ff489813f INFO: 172.20.0.1:38570 - "POST /node/69cbf9918df9359ff489813f HTTP/1.0" 202 Accepted 2026-04-02 16:43:07,690 - lava_callback - INFO - Starting async job submit for node 69cbf9918df9359ff489813f 2026-04-02 16:43:07,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:43:07,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf9918df9359ff489813f HTTP/1.1" 200 None 2026-04-02 16:43:07,707 - lava_callback - DEBUG - Processing node 69cbf9918df9359ff489813f: baseline-arm-baylibre 2026-04-02 16:43:07,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf9918df9359ff489813f 2026-04-02 16:43:07,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:43:07,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf9918df9359ff489813f HTTP/1.1" 200 None 2026-04-02 16:43:07,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:43:07,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:43:07,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:43:07,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf9918df9359ff489813f HTTP/1.1" 200 None 2026-04-02 16:43:07,762 - lava_callback - ERROR - Error processing callback for node 69cbf9918df9359ff489813f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34600 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:43:47,870 - lava_callback - INFO - Received callback for node 69cbf9b98df9359ff4898148 INFO: 172.20.0.1:34602 - "POST /node/69cbf9b98df9359ff4898148 HTTP/1.0" 202 Accepted 2026-04-02 16:43:47,876 - lava_callback - INFO - Starting async job submit for node 69cbf9b98df9359ff4898148 2026-04-02 16:43:47,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:43:47,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf9b98df9359ff4898148 HTTP/1.1" 200 None 2026-04-02 16:43:47,892 - lava_callback - DEBUG - Processing node 69cbf9b98df9359ff4898148: baseline-arm-baylibre 2026-04-02 16:43:47,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf9b98df9359ff4898148 2026-04-02 16:43:47,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:43:47,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf9b98df9359ff4898148 HTTP/1.1" 200 None 2026-04-02 16:43:47,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:43:47,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:43:47,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:43:47,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf9b98df9359ff4898148 HTTP/1.1" 200 None 2026-04-02 16:43:47,943 - lava_callback - ERROR - Error processing callback for node 69cbf9b98df9359ff4898148: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44400 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:44:27,759 - lava_callback - INFO - Received callback for node 69cbf9e08df9359ff4898151 INFO: 172.20.0.1:44416 - "POST /node/69cbf9e08df9359ff4898151 HTTP/1.0" 202 Accepted 2026-04-02 16:44:27,765 - lava_callback - INFO - Starting async job submit for node 69cbf9e08df9359ff4898151 2026-04-02 16:44:27,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:44:27,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf9e08df9359ff4898151 HTTP/1.1" 200 None 2026-04-02 16:44:27,789 - lava_callback - DEBUG - Processing node 69cbf9e08df9359ff4898151: baseline-arm-baylibre 2026-04-02 16:44:27,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf9e08df9359ff4898151 2026-04-02 16:44:27,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:44:27,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf9e08df9359ff4898151 HTTP/1.1" 200 None 2026-04-02 16:44:27,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:44:27,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:44:27,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:44:27,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf9e08df9359ff4898151 HTTP/1.1" 200 None 2026-04-02 16:44:27,859 - lava_callback - ERROR - Error processing callback for node 69cbf9e08df9359ff4898151: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42498 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:45:07,827 - lava_callback - INFO - Received callback for node 69cbfa0d8df9359ff4898160 INFO: 172.20.0.1:42508 - "POST /node/69cbfa0d8df9359ff4898160 HTTP/1.0" 202 Accepted 2026-04-02 16:45:07,833 - lava_callback - INFO - Starting async job submit for node 69cbfa0d8df9359ff4898160 2026-04-02 16:45:07,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:45:07,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfa0d8df9359ff4898160 HTTP/1.1" 200 None 2026-04-02 16:45:07,849 - lava_callback - DEBUG - Processing node 69cbfa0d8df9359ff4898160: baseline-arm-baylibre 2026-04-02 16:45:07,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfa0d8df9359ff4898160 2026-04-02 16:45:07,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:45:07,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfa0d8df9359ff4898160 HTTP/1.1" 200 None 2026-04-02 16:45:07,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:45:07,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:45:07,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:45:07,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfa0d8df9359ff4898160 HTTP/1.1" 200 None 2026-04-02 16:45:07,916 - lava_callback - ERROR - Error processing callback for node 69cbfa0d8df9359ff4898160: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39340 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:45:47,839 - lava_callback - INFO - Received callback for node 69cbfa318df9359ff4898168 INFO: 172.20.0.1:39348 - "POST /node/69cbfa318df9359ff4898168 HTTP/1.0" 202 Accepted 2026-04-02 16:45:47,845 - lava_callback - INFO - Starting async job submit for node 69cbfa318df9359ff4898168 2026-04-02 16:45:47,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:45:47,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfa318df9359ff4898168 HTTP/1.1" 200 None 2026-04-02 16:45:47,865 - lava_callback - DEBUG - Processing node 69cbfa318df9359ff4898168: baseline-arm-baylibre 2026-04-02 16:45:47,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfa318df9359ff4898168 2026-04-02 16:45:47,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:45:47,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfa318df9359ff4898168 HTTP/1.1" 200 None 2026-04-02 16:45:47,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:45:47,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:45:47,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:45:47,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfa318df9359ff4898168 HTTP/1.1" 200 None 2026-04-02 16:45:47,922 - lava_callback - ERROR - Error processing callback for node 69cbfa318df9359ff4898168: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36350 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:46:31,299 - lava_callback - INFO - Received callback for node 69cbfa5d8df9359ff4898173 INFO: 172.20.0.1:55836 - "POST /node/69cbfa5d8df9359ff4898173 HTTP/1.0" 202 Accepted 2026-04-02 16:46:31,305 - lava_callback - INFO - Starting async job submit for node 69cbfa5d8df9359ff4898173 2026-04-02 16:46:31,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:46:31,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfa5d8df9359ff4898173 HTTP/1.1" 200 None 2026-04-02 16:46:31,328 - lava_callback - DEBUG - Processing node 69cbfa5d8df9359ff4898173: baseline-arm-clabbe 2026-04-02 16:46:31,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfa5d8df9359ff4898173 2026-04-02 16:46:31,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:46:31,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfa5d8df9359ff4898173 HTTP/1.1" 200 None 2026-04-02 16:46:31,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:46:31,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:46:31,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:46:31,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfa5d8df9359ff4898173 HTTP/1.1" 200 None 2026-04-02 16:46:31,395 - lava_callback - ERROR - Error processing callback for node 69cbfa5d8df9359ff4898173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51024 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:47:11,259 - lava_callback - INFO - Received callback for node 69cbfa848df9359ff4898184 INFO: 172.20.0.1:51798 - "POST /node/69cbfa848df9359ff4898184 HTTP/1.0" 202 Accepted 2026-04-02 16:47:11,264 - lava_callback - INFO - Starting async job submit for node 69cbfa848df9359ff4898184 2026-04-02 16:47:11,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:47:11,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfa848df9359ff4898184 HTTP/1.1" 200 None 2026-04-02 16:47:11,280 - lava_callback - DEBUG - Processing node 69cbfa848df9359ff4898184: baseline-arm-clabbe 2026-04-02 16:47:11,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfa848df9359ff4898184 2026-04-02 16:47:11,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:47:11,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfa848df9359ff4898184 HTTP/1.1" 200 None 2026-04-02 16:47:11,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:47:11,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:47:11,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:47:11,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfa848df9359ff4898184 HTTP/1.1" 200 None 2026-04-02 16:47:11,350 - lava_callback - ERROR - Error processing callback for node 69cbfa848df9359ff4898184: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43238 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:47:51,304 - lava_callback - INFO - Received callback for node 69cbfaac8df9359ff489818d INFO: 172.20.0.1:40682 - "POST /node/69cbfaac8df9359ff489818d HTTP/1.0" 202 Accepted 2026-04-02 16:47:51,319 - lava_callback - INFO - Starting async job submit for node 69cbfaac8df9359ff489818d 2026-04-02 16:47:51,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:47:51,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfaac8df9359ff489818d HTTP/1.1" 200 None 2026-04-02 16:47:51,346 - lava_callback - DEBUG - Processing node 69cbfaac8df9359ff489818d: baseline-arm-clabbe 2026-04-02 16:47:51,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfaac8df9359ff489818d 2026-04-02 16:47:51,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:47:51,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfaac8df9359ff489818d HTTP/1.1" 200 None 2026-04-02 16:47:51,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:47:51,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:47:51,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:47:51,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfaac8df9359ff489818d HTTP/1.1" 200 None 2026-04-02 16:47:51,445 - lava_callback - ERROR - Error processing callback for node 69cbfaac8df9359ff489818d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44888 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:48:31,312 - lava_callback - INFO - Received callback for node 69cbfad48df9359ff4898198 INFO: 172.20.0.1:51490 - "POST /node/69cbfad48df9359ff4898198 HTTP/1.0" 202 Accepted 2026-04-02 16:48:31,321 - lava_callback - INFO - Starting async job submit for node 69cbfad48df9359ff4898198 2026-04-02 16:48:31,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:48:31,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfad48df9359ff4898198 HTTP/1.1" 200 None 2026-04-02 16:48:31,350 - lava_callback - DEBUG - Processing node 69cbfad48df9359ff4898198: baseline-arm-clabbe 2026-04-02 16:48:31,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfad48df9359ff4898198 2026-04-02 16:48:31,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:48:31,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfad48df9359ff4898198 HTTP/1.1" 200 None 2026-04-02 16:48:31,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:48:31,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:48:31,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:48:31,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfad48df9359ff4898198 HTTP/1.1" 200 None 2026-04-02 16:48:31,444 - lava_callback - ERROR - Error processing callback for node 69cbfad48df9359ff4898198: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57616 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:49:11,363 - lava_callback - INFO - Received callback for node 69cbfafc8df9359ff48981a8 INFO: 172.20.0.1:58090 - "POST /node/69cbfafc8df9359ff48981a8 HTTP/1.0" 202 Accepted 2026-04-02 16:49:11,373 - lava_callback - INFO - Starting async job submit for node 69cbfafc8df9359ff48981a8 2026-04-02 16:49:11,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:49:11,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfafc8df9359ff48981a8 HTTP/1.1" 200 None 2026-04-02 16:49:11,404 - lava_callback - DEBUG - Processing node 69cbfafc8df9359ff48981a8: baseline-arm-clabbe 2026-04-02 16:49:11,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfafc8df9359ff48981a8 2026-04-02 16:49:11,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:49:11,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfafc8df9359ff48981a8 HTTP/1.1" 200 None 2026-04-02 16:49:11,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:49:11,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 16:49:11,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:49:11,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfafc8df9359ff48981a8 HTTP/1.1" 200 None 2026-04-02 16:49:11,505 - lava_callback - ERROR - Error processing callback for node 69cbfafc8df9359ff48981a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:50:48,282 - lava_callback - INFO - Received callback for node 69cbfb5c8df9359ff48981b4 INFO: 172.20.0.1:35742 - "POST /node/69cbfb5c8df9359ff48981b4 HTTP/1.0" 202 Accepted 2026-04-02 16:50:48,288 - lava_callback - INFO - Starting async job submit for node 69cbfb5c8df9359ff48981b4 2026-04-02 16:50:48,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:50:48,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfb5c8df9359ff48981b4 HTTP/1.1" 200 None 2026-04-02 16:50:48,307 - lava_callback - DEBUG - Processing node 69cbfb5c8df9359ff48981b4: baseline-arm-baylibre 2026-04-02 16:50:48,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfb5c8df9359ff48981b4 2026-04-02 16:50:48,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:50:48,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfb5c8df9359ff48981b4 HTTP/1.1" 200 None 2026-04-02 16:50:48,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:50:48,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 16:50:48,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:50:48,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfb5c8df9359ff48981b4 HTTP/1.1" 200 None 2026-04-02 16:50:48,401 - lava_callback - ERROR - Error processing callback for node 69cbfb5c8df9359ff48981b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54694 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:51:28,157 - lava_callback - INFO - Received callback for node 69cbfb878df9359ff48981c9 INFO: 172.20.0.1:54704 - "POST /node/69cbfb878df9359ff48981c9 HTTP/1.0" 202 Accepted 2026-04-02 16:51:28,166 - lava_callback - INFO - Starting async job submit for node 69cbfb878df9359ff48981c9 2026-04-02 16:51:28,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:28,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfb878df9359ff48981c9 HTTP/1.1" 200 None 2026-04-02 16:51:28,195 - lava_callback - DEBUG - Processing node 69cbfb878df9359ff48981c9: baseline-arm-baylibre 2026-04-02 16:51:28,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfb878df9359ff48981c9 2026-04-02 16:51:28,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:28,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfb878df9359ff48981c9 HTTP/1.1" 200 None 2026-04-02 16:51:28,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:28,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 16:51:28,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:28,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfb878df9359ff48981c9 HTTP/1.1" 200 None 2026-04-02 16:51:28,265 - lava_callback - ERROR - Error processing callback for node 69cbfb878df9359ff48981c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:51:48,156 - lava_callback - INFO - Received callback for node 69cbfba08df9359ff48981f6 INFO: 172.20.0.1:58820 - "POST /node/69cbfba08df9359ff48981f6 HTTP/1.0" 202 Accepted 2026-04-02 16:51:48,162 - lava_callback - INFO - Starting async job submit for node 69cbfba08df9359ff48981f6 2026-04-02 16:51:48,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:48,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfba08df9359ff48981f6 HTTP/1.1" 200 None 2026-04-02 16:51:48,177 - lava_callback - DEBUG - Processing node 69cbfba08df9359ff48981f6: baseline-arm-baylibre 2026-04-02 16:51:48,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfba08df9359ff48981f6 2026-04-02 16:51:48,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:48,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfba08df9359ff48981f6 HTTP/1.1" 200 None 2026-04-02 16:51:48,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:48,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:51:48,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:48,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfba08df9359ff48981f6 HTTP/1.1" 200 None 2026-04-02 16:51:48,241 - lava_callback - ERROR - Error processing callback for node 69cbfba08df9359ff48981f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:51:48,855 - lava_callback - INFO - Received callback for node 69cbfb9d8df9359ff48981f0 INFO: 172.20.0.1:58830 - "POST /node/69cbfb9d8df9359ff48981f0 HTTP/1.0" 202 Accepted 2026-04-02 16:51:48,861 - lava_callback - INFO - Starting async job submit for node 69cbfb9d8df9359ff48981f0 2026-04-02 16:51:48,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:48,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfb9d8df9359ff48981f0 HTTP/1.1" 200 None 2026-04-02 16:51:48,875 - lava_callback - DEBUG - Processing node 69cbfb9d8df9359ff48981f0: baseline-arm-baylibre 2026-04-02 16:51:48,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfb9d8df9359ff48981f0 2026-04-02 16:51:48,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:48,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfb9d8df9359ff48981f0 HTTP/1.1" 200 None 2026-04-02 16:51:48,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:48,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:51:48,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:48,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfb9d8df9359ff48981f0 HTTP/1.1" 200 None 2026-04-02 16:51:48,934 - lava_callback - ERROR - Error processing callback for node 69cbfb9d8df9359ff48981f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:51:49,544 - lava_callback - INFO - Received callback for node 69cbfb9f8df9359ff48981f3 INFO: 172.20.0.1:58846 - "POST /node/69cbfb9f8df9359ff48981f3 HTTP/1.0" 202 Accepted 2026-04-02 16:51:49,549 - lava_callback - INFO - Starting async job submit for node 69cbfb9f8df9359ff48981f3 2026-04-02 16:51:49,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:49,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfb9f8df9359ff48981f3 HTTP/1.1" 200 None 2026-04-02 16:51:49,565 - lava_callback - DEBUG - Processing node 69cbfb9f8df9359ff48981f3: baseline-arm-baylibre 2026-04-02 16:51:49,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfb9f8df9359ff48981f3 2026-04-02 16:51:49,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:49,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfb9f8df9359ff48981f3 HTTP/1.1" 200 None 2026-04-02 16:51:49,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:49,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:51:49,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:49,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfb9f8df9359ff48981f3 HTTP/1.1" 200 None 2026-04-02 16:51:49,635 - lava_callback - ERROR - Error processing callback for node 69cbfb9f8df9359ff48981f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:51:50,206 - lava_callback - INFO - Received callback for node 69cbfba18df9359ff48981f9 INFO: 172.20.0.1:55042 - "POST /node/69cbfba18df9359ff48981f9 HTTP/1.0" 202 Accepted 2026-04-02 16:51:50,212 - lava_callback - INFO - Starting async job submit for node 69cbfba18df9359ff48981f9 2026-04-02 16:51:50,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:50,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfba18df9359ff48981f9 HTTP/1.1" 200 None 2026-04-02 16:51:50,230 - lava_callback - DEBUG - Processing node 69cbfba18df9359ff48981f9: baseline-arm-baylibre 2026-04-02 16:51:50,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfba18df9359ff48981f9 2026-04-02 16:51:50,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:50,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfba18df9359ff48981f9 HTTP/1.1" 200 None 2026-04-02 16:51:50,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:50,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:51:50,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:51:50,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfba18df9359ff48981f9 HTTP/1.1" 200 None 2026-04-02 16:51:50,281 - lava_callback - ERROR - Error processing callback for node 69cbfba18df9359ff48981f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57836 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:52:08,176 - lava_callback - INFO - Received callback for node 69cbfba58df9359ff4898204 INFO: 172.20.0.1:57850 - "POST /node/69cbfba58df9359ff4898204 HTTP/1.0" 202 Accepted 2026-04-02 16:52:08,182 - lava_callback - INFO - Starting async job submit for node 69cbfba58df9359ff4898204 2026-04-02 16:52:08,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:08,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfba58df9359ff4898204 HTTP/1.1" 200 None 2026-04-02 16:52:08,198 - lava_callback - DEBUG - Processing node 69cbfba58df9359ff4898204: baseline-arm-baylibre 2026-04-02 16:52:08,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfba58df9359ff4898204 2026-04-02 16:52:08,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:08,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfba58df9359ff4898204 HTTP/1.1" 200 None 2026-04-02 16:52:08,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:08,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:52:08,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:08,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfba58df9359ff4898204 HTTP/1.1" 200 None 2026-04-02 16:52:08,265 - lava_callback - ERROR - Error processing callback for node 69cbfba58df9359ff4898204: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:52:11,458 - lava_callback - INFO - Received callback for node 69cbfbb08df9359ff489823d INFO: 172.20.0.1:55316 - "POST /node/69cbfbb08df9359ff489823d HTTP/1.0" 202 Accepted 2026-04-02 16:52:11,464 - lava_callback - INFO - Starting async job submit for node 69cbfbb08df9359ff489823d 2026-04-02 16:52:11,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:11,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb08df9359ff489823d HTTP/1.1" 200 None 2026-04-02 16:52:11,497 - lava_callback - DEBUG - Processing node 69cbfbb08df9359ff489823d: baseline-arm-clabbe 2026-04-02 16:52:11,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfbb08df9359ff489823d 2026-04-02 16:52:11,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:11,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb08df9359ff489823d HTTP/1.1" 200 None 2026-04-02 16:52:11,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:11,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:52:11,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:11,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfbb08df9359ff489823d HTTP/1.1" 200 None 2026-04-02 16:52:11,553 - lava_callback - ERROR - Error processing callback for node 69cbfbb08df9359ff489823d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:52:12,167 - lava_callback - INFO - Received callback for node 69cbfbb38df9359ff4898243 INFO: 172.20.0.1:55332 - "POST /node/69cbfbb38df9359ff4898243 HTTP/1.0" 202 Accepted 2026-04-02 16:52:12,173 - lava_callback - INFO - Starting async job submit for node 69cbfbb38df9359ff4898243 2026-04-02 16:52:12,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:12,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb38df9359ff4898243 HTTP/1.1" 200 None 2026-04-02 16:52:12,189 - lava_callback - DEBUG - Processing node 69cbfbb38df9359ff4898243: baseline-arm-clabbe 2026-04-02 16:52:12,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfbb38df9359ff4898243 2026-04-02 16:52:12,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:12,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb38df9359ff4898243 HTTP/1.1" 200 None 2026-04-02 16:52:12,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:12,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:52:12,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:12,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfbb38df9359ff4898243 HTTP/1.1" 200 None 2026-04-02 16:52:12,254 - lava_callback - ERROR - Error processing callback for node 69cbfbb38df9359ff4898243: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:52:12,844 - lava_callback - INFO - Received callback for node 69cbfbb68df9359ff489824a INFO: 172.20.0.1:55338 - "POST /node/69cbfbb68df9359ff489824a HTTP/1.0" 202 Accepted 2026-04-02 16:52:12,850 - lava_callback - INFO - Starting async job submit for node 69cbfbb68df9359ff489824a 2026-04-02 16:52:12,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:12,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb68df9359ff489824a HTTP/1.1" 200 None 2026-04-02 16:52:12,866 - lava_callback - DEBUG - Processing node 69cbfbb68df9359ff489824a: baseline-arm-clabbe 2026-04-02 16:52:12,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfbb68df9359ff489824a 2026-04-02 16:52:12,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:12,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb68df9359ff489824a HTTP/1.1" 200 None 2026-04-02 16:52:12,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:12,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:52:12,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:12,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfbb68df9359ff489824a HTTP/1.1" 200 None 2026-04-02 16:52:12,951 - lava_callback - ERROR - Error processing callback for node 69cbfbb68df9359ff489824a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:52:13,547 - lava_callback - INFO - Received callback for node 69cbfbb78df9359ff489824d INFO: 172.20.0.1:55340 - "POST /node/69cbfbb78df9359ff489824d HTTP/1.0" 202 Accepted 2026-04-02 16:52:13,553 - lava_callback - INFO - Starting async job submit for node 69cbfbb78df9359ff489824d 2026-04-02 16:52:13,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:13,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb78df9359ff489824d HTTP/1.1" 200 None 2026-04-02 16:52:13,571 - lava_callback - DEBUG - Processing node 69cbfbb78df9359ff489824d: baseline-arm-clabbe 2026-04-02 16:52:13,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfbb78df9359ff489824d 2026-04-02 16:52:13,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:13,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb78df9359ff489824d HTTP/1.1" 200 None 2026-04-02 16:52:13,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:13,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:52:13,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:13,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfbb78df9359ff489824d HTTP/1.1" 200 None 2026-04-02 16:52:13,628 - lava_callback - ERROR - Error processing callback for node 69cbfbb78df9359ff489824d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:52:14,233 - lava_callback - INFO - Received callback for node 69cbfbb88df9359ff4898250 INFO: 172.20.0.1:55350 - "POST /node/69cbfbb88df9359ff4898250 HTTP/1.0" 202 Accepted 2026-04-02 16:52:14,239 - lava_callback - INFO - Starting async job submit for node 69cbfbb88df9359ff4898250 2026-04-02 16:52:14,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:14,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb88df9359ff4898250 HTTP/1.1" 200 None 2026-04-02 16:52:14,255 - lava_callback - DEBUG - Processing node 69cbfbb88df9359ff4898250: baseline-arm-clabbe 2026-04-02 16:52:14,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfbb88df9359ff4898250 2026-04-02 16:52:14,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:14,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbb88df9359ff4898250 HTTP/1.1" 200 None 2026-04-02 16:52:14,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:14,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:52:14,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:14,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfbb88df9359ff4898250 HTTP/1.1" 200 None 2026-04-02 16:52:14,317 - lava_callback - ERROR - Error processing callback for node 69cbfbb88df9359ff4898250: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60994 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:52:31,462 - lava_callback - INFO - Received callback for node 69cbfbbc8df9359ff4898259 INFO: 172.20.0.1:45098 - "POST /node/69cbfbbc8df9359ff4898259 HTTP/1.0" 202 Accepted 2026-04-02 16:52:31,473 - lava_callback - INFO - Starting async job submit for node 69cbfbbc8df9359ff4898259 2026-04-02 16:52:31,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:31,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbbc8df9359ff4898259 HTTP/1.1" 200 None 2026-04-02 16:52:31,492 - lava_callback - DEBUG - Processing node 69cbfbbc8df9359ff4898259: baseline-arm-clabbe 2026-04-02 16:52:31,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfbbc8df9359ff4898259 2026-04-02 16:52:31,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:31,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfbbc8df9359ff4898259 HTTP/1.1" 200 None 2026-04-02 16:52:31,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:31,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 16:52:31,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:52:31,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfbbc8df9359ff4898259 HTTP/1.1" 200 None 2026-04-02 16:52:31,546 - lava_callback - ERROR - Error processing callback for node 69cbfbbc8df9359ff4898259: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41016 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:56:48,480 - lava_callback - INFO - Received callback for node 69cbfcc38df9359ff4898415 INFO: 172.20.0.1:41028 - "POST /node/69cbfcc38df9359ff4898415 HTTP/1.0" 202 Accepted 2026-04-02 16:56:48,486 - lava_callback - INFO - Starting async job submit for node 69cbfcc38df9359ff4898415 2026-04-02 16:56:48,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:48,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcc38df9359ff4898415 HTTP/1.1" 200 None 2026-04-02 16:56:48,507 - lava_callback - DEBUG - Processing node 69cbfcc38df9359ff4898415: baseline-arm64-baylibre 2026-04-02 16:56:48,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfcc38df9359ff4898415 2026-04-02 16:56:48,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:48,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcc38df9359ff4898415 HTTP/1.1" 200 None 2026-04-02 16:56:48,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:48,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:56:48,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:48,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcc38df9359ff4898415 HTTP/1.1" 200 None 2026-04-02 16:56:48,606 - lava_callback - ERROR - Error processing callback for node 69cbfcc38df9359ff4898415: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:56:49,140 - lava_callback - INFO - Received callback for node 69cbfcc48df9359ff4898418 INFO: 172.20.0.1:41044 - "POST /node/69cbfcc48df9359ff4898418 HTTP/1.0" 202 Accepted 2026-04-02 16:56:49,150 - lava_callback - INFO - Starting async job submit for node 69cbfcc48df9359ff4898418 2026-04-02 16:56:49,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:49,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcc48df9359ff4898418 HTTP/1.1" 200 None 2026-04-02 16:56:49,168 - lava_callback - DEBUG - Processing node 69cbfcc48df9359ff4898418: baseline-arm64-baylibre 2026-04-02 16:56:49,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfcc48df9359ff4898418 2026-04-02 16:56:49,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:49,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcc48df9359ff4898418 HTTP/1.1" 200 None 2026-04-02 16:56:49,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:49,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:56:49,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:49,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcc48df9359ff4898418 HTTP/1.1" 200 None 2026-04-02 16:56:49,242 - lava_callback - ERROR - Error processing callback for node 69cbfcc48df9359ff4898418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:56:49,810 - lava_callback - INFO - Received callback for node 69cbfcc68df9359ff489841b INFO: 172.20.0.1:52142 - "POST /node/69cbfcc68df9359ff489841b HTTP/1.0" 202 Accepted 2026-04-02 16:56:49,816 - lava_callback - INFO - Starting async job submit for node 69cbfcc68df9359ff489841b 2026-04-02 16:56:49,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:49,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcc68df9359ff489841b HTTP/1.1" 200 None 2026-04-02 16:56:49,832 - lava_callback - DEBUG - Processing node 69cbfcc68df9359ff489841b: baseline-arm64-baylibre 2026-04-02 16:56:49,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfcc68df9359ff489841b 2026-04-02 16:56:49,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:49,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcc68df9359ff489841b HTTP/1.1" 200 None 2026-04-02 16:56:49,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:49,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:56:49,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:49,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcc68df9359ff489841b HTTP/1.1" 200 None 2026-04-02 16:56:49,900 - lava_callback - ERROR - Error processing callback for node 69cbfcc68df9359ff489841b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:56:50,484 - lava_callback - INFO - Received callback for node 69cbfcc88df9359ff4898422 INFO: 172.20.0.1:52148 - "POST /node/69cbfcc88df9359ff4898422 HTTP/1.0" 202 Accepted 2026-04-02 16:56:50,490 - lava_callback - INFO - Starting async job submit for node 69cbfcc88df9359ff4898422 2026-04-02 16:56:50,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:50,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcc88df9359ff4898422 HTTP/1.1" 200 None 2026-04-02 16:56:50,506 - lava_callback - DEBUG - Processing node 69cbfcc88df9359ff4898422: baseline-arm64-baylibre 2026-04-02 16:56:50,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfcc88df9359ff4898422 2026-04-02 16:56:50,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:50,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcc88df9359ff4898422 HTTP/1.1" 200 None 2026-04-02 16:56:50,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:50,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:56:50,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:50,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcc88df9359ff4898422 HTTP/1.1" 200 None 2026-04-02 16:56:50,572 - lava_callback - ERROR - Error processing callback for node 69cbfcc88df9359ff4898422: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:56:51,151 - lava_callback - INFO - Received callback for node 69cbfcca8df9359ff4898425 INFO: 172.20.0.1:52162 - "POST /node/69cbfcca8df9359ff4898425 HTTP/1.0" 202 Accepted 2026-04-02 16:56:51,157 - lava_callback - INFO - Starting async job submit for node 69cbfcca8df9359ff4898425 2026-04-02 16:56:51,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:51,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcca8df9359ff4898425 HTTP/1.1" 200 None 2026-04-02 16:56:51,173 - lava_callback - DEBUG - Processing node 69cbfcca8df9359ff4898425: baseline-arm64-baylibre 2026-04-02 16:56:51,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfcca8df9359ff4898425 2026-04-02 16:56:51,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:51,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcca8df9359ff4898425 HTTP/1.1" 200 None 2026-04-02 16:56:51,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:51,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:56:51,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:51,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcca8df9359ff4898425 HTTP/1.1" 200 None 2026-04-02 16:56:51,226 - lava_callback - ERROR - Error processing callback for node 69cbfcca8df9359ff4898425: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:56:51,834 - lava_callback - INFO - Received callback for node 69cbfccb8df9359ff4898428 INFO: 172.20.0.1:52166 - "POST /node/69cbfccb8df9359ff4898428 HTTP/1.0" 202 Accepted 2026-04-02 16:56:51,841 - lava_callback - INFO - Starting async job submit for node 69cbfccb8df9359ff4898428 2026-04-02 16:56:51,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:51,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfccb8df9359ff4898428 HTTP/1.1" 200 None 2026-04-02 16:56:51,857 - lava_callback - DEBUG - Processing node 69cbfccb8df9359ff4898428: baseline-arm64-baylibre 2026-04-02 16:56:51,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfccb8df9359ff4898428 2026-04-02 16:56:51,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:51,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfccb8df9359ff4898428 HTTP/1.1" 200 None 2026-04-02 16:56:51,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:51,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:56:51,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:56:51,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfccb8df9359ff4898428 HTTP/1.1" 200 None 2026-04-02 16:56:51,910 - lava_callback - ERROR - Error processing callback for node 69cbfccb8df9359ff4898428: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50174 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:57:11,714 - lava_callback - INFO - Received callback for node 69cbfcdc8df9359ff4898476 INFO: 172.20.0.1:59788 - "POST /node/69cbfcdc8df9359ff4898476 HTTP/1.0" 202 Accepted 2026-04-02 16:57:11,719 - lava_callback - INFO - Starting async job submit for node 69cbfcdc8df9359ff4898476 2026-04-02 16:57:11,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:11,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcdc8df9359ff4898476 HTTP/1.1" 200 None 2026-04-02 16:57:11,742 - lava_callback - DEBUG - Processing node 69cbfcdc8df9359ff4898476: baseline-arm64-clabbe 2026-04-02 16:57:11,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfcdc8df9359ff4898476 2026-04-02 16:57:11,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:11,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcdc8df9359ff4898476 HTTP/1.1" 200 None 2026-04-02 16:57:11,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:11,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:57:11,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:11,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcdc8df9359ff4898476 HTTP/1.1" 200 None 2026-04-02 16:57:11,800 - lava_callback - ERROR - Error processing callback for node 69cbfcdc8df9359ff4898476: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:57:12,390 - lava_callback - INFO - Received callback for node 69cbfcde8df9359ff4898479 INFO: 172.20.0.1:59800 - "POST /node/69cbfcde8df9359ff4898479 HTTP/1.0" 202 Accepted 2026-04-02 16:57:12,396 - lava_callback - INFO - Starting async job submit for node 69cbfcde8df9359ff4898479 2026-04-02 16:57:12,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:12,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcde8df9359ff4898479 HTTP/1.1" 200 None 2026-04-02 16:57:12,414 - lava_callback - DEBUG - Processing node 69cbfcde8df9359ff4898479: baseline-arm64-clabbe 2026-04-02 16:57:12,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfcde8df9359ff4898479 2026-04-02 16:57:12,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:12,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcde8df9359ff4898479 HTTP/1.1" 200 None 2026-04-02 16:57:12,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:12,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:57:12,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:12,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcde8df9359ff4898479 HTTP/1.1" 200 None 2026-04-02 16:57:12,464 - lava_callback - ERROR - Error processing callback for node 69cbfcde8df9359ff4898479: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:57:13,084 - lava_callback - INFO - Received callback for node 69cbfcdf8df9359ff489847c INFO: 172.20.0.1:59814 - "POST /node/69cbfcdf8df9359ff489847c HTTP/1.0" 202 Accepted 2026-04-02 16:57:13,093 - lava_callback - INFO - Starting async job submit for node 69cbfcdf8df9359ff489847c 2026-04-02 16:57:13,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:13,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcdf8df9359ff489847c HTTP/1.1" 200 None 2026-04-02 16:57:13,115 - lava_callback - DEBUG - Processing node 69cbfcdf8df9359ff489847c: baseline-arm64-clabbe 2026-04-02 16:57:13,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfcdf8df9359ff489847c 2026-04-02 16:57:13,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:13,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcdf8df9359ff489847c HTTP/1.1" 200 None 2026-04-02 16:57:13,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:13,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:57:13,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:13,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcdf8df9359ff489847c HTTP/1.1" 200 None 2026-04-02 16:57:13,172 - lava_callback - ERROR - Error processing callback for node 69cbfcdf8df9359ff489847c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:57:13,773 - lava_callback - INFO - Received callback for node 69cbfce08df9359ff489847f INFO: 172.20.0.1:59826 - "POST /node/69cbfce08df9359ff489847f HTTP/1.0" 202 Accepted 2026-04-02 16:57:13,782 - lava_callback - INFO - Starting async job submit for node 69cbfce08df9359ff489847f 2026-04-02 16:57:13,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:13,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfce08df9359ff489847f HTTP/1.1" 200 None 2026-04-02 16:57:13,802 - lava_callback - DEBUG - Processing node 69cbfce08df9359ff489847f: baseline-arm64-clabbe 2026-04-02 16:57:13,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfce08df9359ff489847f 2026-04-02 16:57:13,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:13,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfce08df9359ff489847f HTTP/1.1" 200 None 2026-04-02 16:57:13,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:13,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:57:13,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:13,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfce08df9359ff489847f HTTP/1.1" 200 None 2026-04-02 16:57:13,864 - lava_callback - ERROR - Error processing callback for node 69cbfce08df9359ff489847f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:57:14,464 - lava_callback - INFO - Received callback for node 69cbfce28df9359ff4898488 INFO: 172.20.0.1:59836 - "POST /node/69cbfce28df9359ff4898488 HTTP/1.0" 202 Accepted 2026-04-02 16:57:14,469 - lava_callback - INFO - Starting async job submit for node 69cbfce28df9359ff4898488 2026-04-02 16:57:14,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:14,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfce28df9359ff4898488 HTTP/1.1" 200 None 2026-04-02 16:57:14,485 - lava_callback - DEBUG - Processing node 69cbfce28df9359ff4898488: baseline-arm64-clabbe 2026-04-02 16:57:14,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfce28df9359ff4898488 2026-04-02 16:57:14,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:14,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfce28df9359ff4898488 HTTP/1.1" 200 None 2026-04-02 16:57:14,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:14,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:57:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:14,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfce28df9359ff4898488 HTTP/1.1" 200 None 2026-04-02 16:57:14,549 - lava_callback - ERROR - Error processing callback for node 69cbfce28df9359ff4898488: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 16:57:15,150 - lava_callback - INFO - Received callback for node 69cbfce28df9359ff4898485 INFO: 172.20.0.1:59852 - "POST /node/69cbfce28df9359ff4898485 HTTP/1.0" 202 Accepted 2026-04-02 16:57:15,156 - lava_callback - INFO - Starting async job submit for node 69cbfce28df9359ff4898485 2026-04-02 16:57:15,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:15,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfce28df9359ff4898485 HTTP/1.1" 200 None 2026-04-02 16:57:15,172 - lava_callback - DEBUG - Processing node 69cbfce28df9359ff4898485: baseline-arm64-clabbe 2026-04-02 16:57:15,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfce28df9359ff4898485 INFO: 172.20.0.1:59854 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 16:57:15,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:15,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfce28df9359ff4898485 HTTP/1.1" 200 None 2026-04-02 16:57:15,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:15,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 16:57:15,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:15,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfce28df9359ff4898485 HTTP/1.1" 200 None 2026-04-02 16:57:15,234 - lava_callback - ERROR - Error processing callback for node 69cbfce28df9359ff4898485: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:57:28,469 - lava_callback - INFO - Received callback for node 69cbfceb8df9359ff48984a2 INFO: 172.20.0.1:33640 - "POST /node/69cbfceb8df9359ff48984a2 HTTP/1.0" 202 Accepted 2026-04-02 16:57:28,477 - lava_callback - INFO - Starting async job submit for node 69cbfceb8df9359ff48984a2 2026-04-02 16:57:28,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:28,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfceb8df9359ff48984a2 HTTP/1.1" 200 None 2026-04-02 16:57:28,493 - lava_callback - DEBUG - Processing node 69cbfceb8df9359ff48984a2: baseline-arm-baylibre 2026-04-02 16:57:28,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfceb8df9359ff48984a2 2026-04-02 16:57:28,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:28,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfceb8df9359ff48984a2 HTTP/1.1" 200 None 2026-04-02 16:57:28,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:28,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 16:57:28,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:57:28,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfceb8df9359ff48984a2 HTTP/1.1" 200 None 2026-04-02 16:57:28,553 - lava_callback - ERROR - Error processing callback for node 69cbfceb8df9359ff48984a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51240 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:58:48,586 - lava_callback - INFO - Received callback for node 69cbfd458df9359ff4898555 INFO: 172.20.0.1:51250 - "POST /node/69cbfd458df9359ff4898555 HTTP/1.0" 202 Accepted 2026-04-02 16:58:48,592 - lava_callback - INFO - Starting async job submit for node 69cbfd458df9359ff4898555 2026-04-02 16:58:48,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:58:48,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfd458df9359ff4898555 HTTP/1.1" 200 None 2026-04-02 16:58:48,611 - lava_callback - DEBUG - Processing node 69cbfd458df9359ff4898555: baseline-arm64-baylibre 2026-04-02 16:58:48,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfd458df9359ff4898555 2026-04-02 16:58:48,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:58:48,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfd458df9359ff4898555 HTTP/1.1" 200 None 2026-04-02 16:58:48,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:58:48,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 16:58:48,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:58:48,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfd458df9359ff4898555 HTTP/1.1" 200 None 2026-04-02 16:58:48,677 - lava_callback - ERROR - Error processing callback for node 69cbfd458df9359ff4898555: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49674 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:00:28,694 - lava_callback - INFO - Received callback for node 69cbfd9d8df9359ff4898589 INFO: 172.20.0.1:49690 - "POST /node/69cbfd9d8df9359ff4898589 HTTP/1.0" 202 Accepted 2026-04-02 17:00:28,700 - lava_callback - INFO - Starting async job submit for node 69cbfd9d8df9359ff4898589 2026-04-02 17:00:28,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:00:28,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfd9d8df9359ff4898589 HTTP/1.1" 200 None 2026-04-02 17:00:28,724 - lava_callback - DEBUG - Processing node 69cbfd9d8df9359ff4898589: baseline-arm64-baylibre 2026-04-02 17:00:28,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfd9d8df9359ff4898589 2026-04-02 17:00:28,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:00:28,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfd9d8df9359ff4898589 HTTP/1.1" 200 None 2026-04-02 17:00:28,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:00:28,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:00:28,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:00:28,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfd9d8df9359ff4898589 HTTP/1.1" 200 None 2026-04-02 17:00:28,776 - lava_callback - ERROR - Error processing callback for node 69cbfd9d8df9359ff4898589: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46084 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:01:48,746 - lava_callback - INFO - Received callback for node 69cbfdf98df9359ff48985a8 INFO: 172.20.0.1:46098 - "POST /node/69cbfdf98df9359ff48985a8 HTTP/1.0" 202 Accepted 2026-04-02 17:01:48,752 - lava_callback - INFO - Starting async job submit for node 69cbfdf98df9359ff48985a8 2026-04-02 17:01:48,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:01:48,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfdf98df9359ff48985a8 HTTP/1.1" 200 None 2026-04-02 17:01:48,767 - lava_callback - DEBUG - Processing node 69cbfdf98df9359ff48985a8: baseline-arm64-baylibre 2026-04-02 17:01:48,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfdf98df9359ff48985a8 2026-04-02 17:01:48,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:01:48,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfdf98df9359ff48985a8 HTTP/1.1" 200 None 2026-04-02 17:01:48,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:01:48,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:01:48,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:01:48,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfdf98df9359ff48985a8 HTTP/1.1" 200 None 2026-04-02 17:01:48,819 - lava_callback - ERROR - Error processing callback for node 69cbfdf98df9359ff48985a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50936 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:03:28,820 - lava_callback - INFO - Received callback for node 69cbfe4d8df9359ff48985f4 INFO: 172.20.0.1:50942 - "POST /node/69cbfe4d8df9359ff48985f4 HTTP/1.0" 202 Accepted 2026-04-02 17:03:28,825 - lava_callback - INFO - Starting async job submit for node 69cbfe4d8df9359ff48985f4 2026-04-02 17:03:28,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:03:28,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfe4d8df9359ff48985f4 HTTP/1.1" 200 None 2026-04-02 17:03:28,841 - lava_callback - DEBUG - Processing node 69cbfe4d8df9359ff48985f4: baseline-arm64-baylibre 2026-04-02 17:03:28,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfe4d8df9359ff48985f4 2026-04-02 17:03:28,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:03:28,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfe4d8df9359ff48985f4 HTTP/1.1" 200 None 2026-04-02 17:03:28,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:03:28,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:03:28,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:03:28,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfe4d8df9359ff48985f4 HTTP/1.1" 200 None 2026-04-02 17:03:28,893 - lava_callback - ERROR - Error processing callback for node 69cbfe4d8df9359ff48985f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:04:52,460 - lava_callback - INFO - Received callback for node 69cbfea88df9359ff4898626 INFO: 172.20.0.1:46198 - "POST /node/69cbfea88df9359ff4898626 HTTP/1.0" 202 Accepted 2026-04-02 17:04:52,466 - lava_callback - INFO - Starting async job submit for node 69cbfea88df9359ff4898626 2026-04-02 17:04:52,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:04:52,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfea88df9359ff4898626 HTTP/1.1" 200 None 2026-04-02 17:04:52,482 - lava_callback - DEBUG - Processing node 69cbfea88df9359ff4898626: baseline-arm64-clabbe 2026-04-02 17:04:52,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfea88df9359ff4898626 2026-04-02 17:04:52,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:04:52,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfea88df9359ff4898626 HTTP/1.1" 200 None 2026-04-02 17:04:52,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:04:52,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:04:52,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:04:52,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfea88df9359ff4898626 HTTP/1.1" 200 None 2026-04-02 17:04:52,543 - lava_callback - ERROR - Error processing callback for node 69cbfea88df9359ff4898626: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48166 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:06:12,149 - lava_callback - INFO - Received callback for node 69cbfefe8df9359ff489863a INFO: 172.20.0.1:49602 - "POST /node/69cbfefe8df9359ff489863a HTTP/1.0" 202 Accepted 2026-04-02 17:06:12,155 - lava_callback - INFO - Starting async job submit for node 69cbfefe8df9359ff489863a 2026-04-02 17:06:12,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:06:12,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfefe8df9359ff489863a HTTP/1.1" 200 None 2026-04-02 17:06:12,171 - lava_callback - DEBUG - Processing node 69cbfefe8df9359ff489863a: baseline-arm64-clabbe 2026-04-02 17:06:12,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbfefe8df9359ff489863a 2026-04-02 17:06:12,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:06:12,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfefe8df9359ff489863a HTTP/1.1" 200 None 2026-04-02 17:06:12,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:06:12,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:06:12,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:06:12,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfefe8df9359ff489863a HTTP/1.1" 200 None 2026-04-02 17:06:12,228 - lava_callback - ERROR - Error processing callback for node 69cbfefe8df9359ff489863a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39698 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:07:52,288 - lava_callback - INFO - Received callback for node 69cbff558df9359ff4898646 INFO: 172.20.0.1:34248 - "POST /node/69cbff558df9359ff4898646 HTTP/1.0" 202 Accepted 2026-04-02 17:07:52,294 - lava_callback - INFO - Starting async job submit for node 69cbff558df9359ff4898646 2026-04-02 17:07:52,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:07:52,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbff558df9359ff4898646 HTTP/1.1" 200 None 2026-04-02 17:07:52,318 - lava_callback - DEBUG - Processing node 69cbff558df9359ff4898646: baseline-arm64-clabbe 2026-04-02 17:07:52,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbff558df9359ff4898646 2026-04-02 17:07:52,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:07:52,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbff558df9359ff4898646 HTTP/1.1" 200 None 2026-04-02 17:07:52,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:07:52,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:07:52,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:07:52,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbff558df9359ff4898646 HTTP/1.1" 200 None 2026-04-02 17:07:52,401 - lava_callback - ERROR - Error processing callback for node 69cbff558df9359ff4898646: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:09:52,318 - lava_callback - INFO - Received callback for node 69cbffd08df9359ff4898694 INFO: 172.20.0.1:55732 - "POST /node/69cbffd08df9359ff4898694 HTTP/1.0" 202 Accepted 2026-04-02 17:09:52,324 - lava_callback - INFO - Starting async job submit for node 69cbffd08df9359ff4898694 2026-04-02 17:09:52,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:09:52,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbffd08df9359ff4898694 HTTP/1.1" 200 None 2026-04-02 17:09:52,344 - lava_callback - DEBUG - Processing node 69cbffd08df9359ff4898694: baseline-arm64-clabbe 2026-04-02 17:09:52,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbffd08df9359ff4898694 2026-04-02 17:09:52,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:09:52,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbffd08df9359ff4898694 HTTP/1.1" 200 None 2026-04-02 17:09:52,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:09:52,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:09:52,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:09:52,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbffd08df9359ff4898694 HTTP/1.1" 200 None 2026-04-02 17:09:52,403 - lava_callback - ERROR - Error processing callback for node 69cbffd08df9359ff4898694: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:11:12,370 - lava_callback - INFO - Received callback for node 69cc00248df9359ff48986aa INFO: 172.20.0.1:53310 - "POST /node/69cc00248df9359ff48986aa HTTP/1.0" 202 Accepted 2026-04-02 17:11:12,378 - lava_callback - INFO - Starting async job submit for node 69cc00248df9359ff48986aa 2026-04-02 17:11:12,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:11:12,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc00248df9359ff48986aa HTTP/1.1" 200 None 2026-04-02 17:11:12,401 - lava_callback - DEBUG - Processing node 69cc00248df9359ff48986aa: baseline-arm64-clabbe 2026-04-02 17:11:12,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc00248df9359ff48986aa 2026-04-02 17:11:12,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:11:12,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc00248df9359ff48986aa HTTP/1.1" 200 None 2026-04-02 17:11:12,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:11:12,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:11:12,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:11:12,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc00248df9359ff48986aa HTTP/1.1" 200 None 2026-04-02 17:11:12,474 - lava_callback - ERROR - Error processing callback for node 69cc00248df9359ff48986aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49526 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:12:32,428 - lava_callback - INFO - Received callback for node 69cc007c8df9359ff48986c4 INFO: 172.20.0.1:39656 - "POST /node/69cc007c8df9359ff48986c4 HTTP/1.0" 202 Accepted 2026-04-02 17:12:32,434 - lava_callback - INFO - Starting async job submit for node 69cc007c8df9359ff48986c4 2026-04-02 17:12:32,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:12:32,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc007c8df9359ff48986c4 HTTP/1.1" 200 None 2026-04-02 17:12:32,451 - lava_callback - DEBUG - Processing node 69cc007c8df9359ff48986c4: baseline-arm64-clabbe 2026-04-02 17:12:32,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc007c8df9359ff48986c4 2026-04-02 17:12:32,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:12:32,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc007c8df9359ff48986c4 HTTP/1.1" 200 None 2026-04-02 17:12:32,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:12:32,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 17:12:32,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:12:32,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc007c8df9359ff48986c4 HTTP/1.1" 200 None 2026-04-02 17:12:32,514 - lava_callback - ERROR - Error processing callback for node 69cc007c8df9359ff48986c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:13:49,735 - lava_callback - INFO - Received callback for node 69cc00bd8df9359ff48986de INFO: 172.20.0.1:38656 - "POST /node/69cc00bd8df9359ff48986de HTTP/1.0" 202 Accepted 2026-04-02 17:13:49,741 - lava_callback - INFO - Starting async job submit for node 69cc00bd8df9359ff48986de 2026-04-02 17:13:49,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:13:49,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc00bd8df9359ff48986de HTTP/1.1" 200 None 2026-04-02 17:13:49,757 - lava_callback - DEBUG - Processing node 69cc00bd8df9359ff48986de: baseline-arm-baylibre 2026-04-02 17:13:49,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc00bd8df9359ff48986de 2026-04-02 17:13:49,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:13:49,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc00bd8df9359ff48986de HTTP/1.1" 200 None 2026-04-02 17:13:49,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:13:49,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 17:13:49,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:13:49,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc00bd8df9359ff48986de HTTP/1.1" 200 None 2026-04-02 17:13:49,817 - lava_callback - ERROR - Error processing callback for node 69cc00bd8df9359ff48986de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45576 - "GET /node/69c17eda2b2b51e9ad97a99c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45580 - "GET /node/695404799c6929bd9fb6f351%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34666 - "GET /node/694b14bd6c96ed51d3173e89%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34674 - "GET /node/693afa63fee8383e92b6d138%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45404 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:15:49,789 - lava_callback - INFO - Received callback for node 69cc01368df9359ff4898713 INFO: 172.20.0.1:34374 - "POST /node/69cc01368df9359ff4898713 HTTP/1.0" 202 Accepted 2026-04-02 17:15:49,794 - lava_callback - INFO - Starting async job submit for node 69cc01368df9359ff4898713 2026-04-02 17:15:49,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:15:49,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc01368df9359ff4898713 HTTP/1.1" 200 None 2026-04-02 17:15:49,820 - lava_callback - DEBUG - Processing node 69cc01368df9359ff4898713: baseline-arm-baylibre 2026-04-02 17:15:49,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc01368df9359ff4898713 2026-04-02 17:15:49,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:15:49,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc01368df9359ff4898713 HTTP/1.1" 200 None 2026-04-02 17:15:49,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:15:49,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 17:15:49,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:15:49,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc01368df9359ff4898713 HTTP/1.1" 200 None 2026-04-02 17:15:49,877 - lava_callback - ERROR - Error processing callback for node 69cc01368df9359ff4898713: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34606 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:17:49,621 - lava_callback - INFO - Received callback for node 69cc01ac8df9359ff4898740 INFO: 172.20.0.1:34620 - "POST /node/69cc01ac8df9359ff4898740 HTTP/1.0" 202 Accepted 2026-04-02 17:17:49,626 - lava_callback - INFO - Starting async job submit for node 69cc01ac8df9359ff4898740 2026-04-02 17:17:49,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:17:49,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc01ac8df9359ff4898740 HTTP/1.1" 200 None 2026-04-02 17:17:49,643 - lava_callback - DEBUG - Processing node 69cc01ac8df9359ff4898740: baseline-arm-baylibre 2026-04-02 17:17:49,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc01ac8df9359ff4898740 2026-04-02 17:17:49,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:17:49,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc01ac8df9359ff4898740 HTTP/1.1" 200 None 2026-04-02 17:17:49,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:17:49,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 17:17:49,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:17:49,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc01ac8df9359ff4898740 HTTP/1.1" 200 None 2026-04-02 17:17:49,708 - lava_callback - ERROR - Error processing callback for node 69cc01ac8df9359ff4898740: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET /node/6992681098a8bdb31c39212f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50320 - "GET /node/693b048dfee8383e92b6f8b3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50334 - "GET /node/698956d685773790cd34e747%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41138 - "GET /node/693934756e7b0b7f22e51ee3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41140 - "GET /node/698a188f22b4cc0f227ae590%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40492 - "GET /node/698e28e2952a14bf500e400d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40494 - "GET /node/695328da31522df6df79b698%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41980 - "GET /node/69c48090590270ad7b6d910e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41990 - "GET /node/6910c851699dbc4cda8e2be3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51082 - "GET /node/693a8545e17cfbe560b12ef2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51084 - "GET /node/693afa9afee8383e92b6d218%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50138 - "GET /node/693b0f0efee8383e92b72a14%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50148 - "GET /node/698b6b740a16aea5a0dc7b92%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36314 - "GET /node/69af01d8ce46d8ec186ac70d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36328 - "GET /node/691173d8f15111fc8ce4a8ac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58270 - "GET /node/693b36154b47c3f87266ce28%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58280 - "GET /node/69b13ac5a870a1dc3343c57b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44336 - "GET /node/69c179982b2b51e9ad97a784%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44342 - "GET /node/6986fd596e077e4126a7d862%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42098 - "GET /node/693afa92fee8383e92b6d1f8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42108 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:29:33,223 - lava_callback - INFO - Received callback for node 69cc04748df9359ff48987de INFO: 172.20.0.1:34320 - "POST /node/69cc04748df9359ff48987de HTTP/1.0" 202 Accepted 2026-04-02 17:29:33,228 - lava_callback - INFO - Starting async job submit for node 69cc04748df9359ff48987de 2026-04-02 17:29:33,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:29:33,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc04748df9359ff48987de HTTP/1.1" 200 None 2026-04-02 17:29:33,256 - lava_callback - DEBUG - Processing node 69cc04748df9359ff48987de: baseline-arm-clabbe 2026-04-02 17:29:33,256 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc04748df9359ff48987de 2026-04-02 17:29:33,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:29:33,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc04748df9359ff48987de HTTP/1.1" 200 None 2026-04-02 17:29:33,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:29:33,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 17:29:33,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:29:33,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc04748df9359ff48987de HTTP/1.1" 200 None 2026-04-02 17:29:33,319 - lava_callback - ERROR - Error processing callback for node 69cc04748df9359ff48987de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35306 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:30:13,280 - lava_callback - INFO - Received callback for node 69cc04a18df9359ff48987ee INFO: 172.20.0.1:33398 - "POST /node/69cc04a18df9359ff48987ee HTTP/1.0" 202 Accepted 2026-04-02 17:30:13,286 - lava_callback - INFO - Starting async job submit for node 69cc04a18df9359ff48987ee 2026-04-02 17:30:13,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:30:13,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc04a18df9359ff48987ee HTTP/1.1" 200 None 2026-04-02 17:30:13,303 - lava_callback - DEBUG - Processing node 69cc04a18df9359ff48987ee: baseline-arm-clabbe 2026-04-02 17:30:13,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc04a18df9359ff48987ee 2026-04-02 17:30:13,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:30:13,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc04a18df9359ff48987ee HTTP/1.1" 200 None 2026-04-02 17:30:13,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:30:13,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 17:30:13,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:30:13,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc04a18df9359ff48987ee HTTP/1.1" 200 None 2026-04-02 17:30:13,368 - lava_callback - ERROR - Error processing callback for node 69cc04a18df9359ff48987ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34610 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:31:13,280 - lava_callback - INFO - Received callback for node 69cc04cb8df9359ff48987f8 INFO: 172.20.0.1:48378 - "POST /node/69cc04cb8df9359ff48987f8 HTTP/1.0" 202 Accepted 2026-04-02 17:31:13,286 - lava_callback - INFO - Starting async job submit for node 69cc04cb8df9359ff48987f8 2026-04-02 17:31:13,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:31:13,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc04cb8df9359ff48987f8 HTTP/1.1" 200 None 2026-04-02 17:31:13,302 - lava_callback - DEBUG - Processing node 69cc04cb8df9359ff48987f8: baseline-arm-clabbe 2026-04-02 17:31:13,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc04cb8df9359ff48987f8 2026-04-02 17:31:13,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:31:13,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc04cb8df9359ff48987f8 HTTP/1.1" 200 None 2026-04-02 17:31:13,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:31:13,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 17:31:13,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:31:13,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc04cb8df9359ff48987f8 HTTP/1.1" 200 None 2026-04-02 17:31:13,372 - lava_callback - ERROR - Error processing callback for node 69cc04cb8df9359ff48987f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40040 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:31:53,223 - lava_callback - INFO - Received callback for node 69cc04f78df9359ff4898806 INFO: 172.20.0.1:42640 - "POST /node/69cc04f78df9359ff4898806 HTTP/1.0" 202 Accepted 2026-04-02 17:31:53,229 - lava_callback - INFO - Starting async job submit for node 69cc04f78df9359ff4898806 2026-04-02 17:31:53,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:31:53,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc04f78df9359ff4898806 HTTP/1.1" 200 None 2026-04-02 17:31:53,247 - lava_callback - DEBUG - Processing node 69cc04f78df9359ff4898806: baseline-arm-clabbe 2026-04-02 17:31:53,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc04f78df9359ff4898806 2026-04-02 17:31:53,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:31:53,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc04f78df9359ff4898806 HTTP/1.1" 200 None 2026-04-02 17:31:53,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:31:53,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 17:31:53,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:31:53,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc04f78df9359ff4898806 HTTP/1.1" 200 None 2026-04-02 17:31:53,303 - lava_callback - ERROR - Error processing callback for node 69cc04f78df9359ff4898806: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42646 - "GET /node/6981c884f633e773758fba06%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42654 - "GET /node/698461c83a8748f2820865c2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38918 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:32:33,492 - lava_callback - INFO - Received callback for node 69cc05228df9359ff489880d INFO: 172.20.0.1:56340 - "POST /node/69cc05228df9359ff489880d HTTP/1.0" 202 Accepted 2026-04-02 17:32:33,499 - lava_callback - INFO - Starting async job submit for node 69cc05228df9359ff489880d 2026-04-02 17:32:33,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:32:33,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc05228df9359ff489880d HTTP/1.1" 200 None 2026-04-02 17:32:33,516 - lava_callback - DEBUG - Processing node 69cc05228df9359ff489880d: baseline-arm-clabbe 2026-04-02 17:32:33,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc05228df9359ff489880d 2026-04-02 17:32:33,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:32:33,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc05228df9359ff489880d HTTP/1.1" 200 None 2026-04-02 17:32:33,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:32:33,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ac8944faaf0e7f5e408 HTTP/1.1" 200 None 2026-04-02 17:32:33,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:32:33,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc05228df9359ff489880d HTTP/1.1" 200 None 2026-04-02 17:32:33,589 - lava_callback - ERROR - Error processing callback for node 69cc05228df9359ff489880d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57106 - "GET /node/694bd160c19e09af58d47d6a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43268 - "GET /node/698b1e4a3b3beb19e7619608%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52766 - "GET /node/69a18a8aa41e9451dcf426c8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36286 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:38:30,921 - lava_callback - INFO - Received callback for node 69cc068e8df9359ff4898856 INFO: 172.20.0.1:49270 - "POST /node/69cc068e8df9359ff4898856 HTTP/1.0" 202 Accepted 2026-04-02 17:38:30,930 - lava_callback - INFO - Starting async job submit for node 69cc068e8df9359ff4898856 2026-04-02 17:38:30,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:38:30,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc068e8df9359ff4898856 HTTP/1.1" 200 None 2026-04-02 17:38:30,951 - lava_callback - DEBUG - Processing node 69cc068e8df9359ff4898856: baseline-arm64-baylibre 2026-04-02 17:38:30,951 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc068e8df9359ff4898856 2026-04-02 17:38:30,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:38:30,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc068e8df9359ff4898856 HTTP/1.1" 200 None 2026-04-02 17:38:30,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:38:30,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:38:30,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:38:31,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc068e8df9359ff4898856 HTTP/1.1" 200 None 2026-04-02 17:38:31,014 - lava_callback - ERROR - Error processing callback for node 69cc068e8df9359ff4898856: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54978 - "GET /node/69b92cee0ec88e58bad0e387%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54988 - "GET /node/69a23a5790d011217c9f7f98%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48408 - "GET /node/693b44b94b47c3f87266f5e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48414 - "GET /node/6928eeefa7fbd8958ccef962%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51398 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:40:50,829 - lava_callback - INFO - Received callback for node 69cc070f8df9359ff489886e INFO: 172.20.0.1:35438 - "POST /node/69cc070f8df9359ff489886e HTTP/1.0" 202 Accepted 2026-04-02 17:40:50,835 - lava_callback - INFO - Starting async job submit for node 69cc070f8df9359ff489886e 2026-04-02 17:40:50,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:40:50,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc070f8df9359ff489886e HTTP/1.1" 200 None 2026-04-02 17:40:50,857 - lava_callback - DEBUG - Processing node 69cc070f8df9359ff489886e: baseline-arm64-baylibre 2026-04-02 17:40:50,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc070f8df9359ff489886e 2026-04-02 17:40:50,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:40:50,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc070f8df9359ff489886e HTTP/1.1" 200 None 2026-04-02 17:40:50,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:40:50,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:40:50,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:40:50,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc070f8df9359ff489886e HTTP/1.1" 200 None 2026-04-02 17:40:50,928 - lava_callback - ERROR - Error processing callback for node 69cc070f8df9359ff489886e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:42:10,897 - lava_callback - INFO - Received callback for node 69cc07668df9359ff489887a INFO: 172.20.0.1:36900 - "POST /node/69cc07668df9359ff489887a HTTP/1.0" 202 Accepted 2026-04-02 17:42:10,906 - lava_callback - INFO - Starting async job submit for node 69cc07668df9359ff489887a 2026-04-02 17:42:10,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:42:10,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc07668df9359ff489887a HTTP/1.1" 200 None 2026-04-02 17:42:10,925 - lava_callback - DEBUG - Processing node 69cc07668df9359ff489887a: baseline-arm64-baylibre 2026-04-02 17:42:10,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc07668df9359ff489887a 2026-04-02 17:42:10,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:42:10,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc07668df9359ff489887a HTTP/1.1" 200 None 2026-04-02 17:42:10,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:42:10,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:42:10,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:42:11,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc07668df9359ff489887a HTTP/1.1" 200 None 2026-04-02 17:42:11,003 - lava_callback - ERROR - Error processing callback for node 69cc07668df9359ff489887a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38870 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:43:30,964 - lava_callback - INFO - Received callback for node 69cc07b88df9359ff489888c INFO: 172.20.0.1:43378 - "POST /node/69cc07b88df9359ff489888c HTTP/1.0" 202 Accepted 2026-04-02 17:43:30,970 - lava_callback - INFO - Starting async job submit for node 69cc07b88df9359ff489888c 2026-04-02 17:43:30,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:43:30,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc07b88df9359ff489888c HTTP/1.1" 200 None 2026-04-02 17:43:30,987 - lava_callback - DEBUG - Processing node 69cc07b88df9359ff489888c: baseline-arm64-baylibre 2026-04-02 17:43:30,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc07b88df9359ff489888c 2026-04-02 17:43:30,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:43:31,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc07b88df9359ff489888c HTTP/1.1" 200 None 2026-04-02 17:43:31,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:43:31,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:43:31,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:43:31,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc07b88df9359ff489888c HTTP/1.1" 200 None 2026-04-02 17:43:31,043 - lava_callback - ERROR - Error processing callback for node 69cc07b88df9359ff489888c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41792 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:45:31,099 - lava_callback - INFO - Received callback for node 69cc08388df9359ff48988a7 INFO: 172.20.0.1:48874 - "POST /node/69cc08388df9359ff48988a7 HTTP/1.0" 202 Accepted 2026-04-02 17:45:31,104 - lava_callback - INFO - Starting async job submit for node 69cc08388df9359ff48988a7 2026-04-02 17:45:31,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:45:31,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc08388df9359ff48988a7 HTTP/1.1" 200 None 2026-04-02 17:45:31,125 - lava_callback - DEBUG - Processing node 69cc08388df9359ff48988a7: baseline-arm64-baylibre 2026-04-02 17:45:31,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc08388df9359ff48988a7 2026-04-02 17:45:31,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:45:31,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc08388df9359ff48988a7 HTTP/1.1" 200 None 2026-04-02 17:45:31,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:45:31,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:45:31,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:45:31,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc08388df9359ff48988a7 HTTP/1.1" 200 None 2026-04-02 17:45:31,192 - lava_callback - ERROR - Error processing callback for node 69cc08388df9359ff48988a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42980 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:48:31,260 - lava_callback - INFO - Received callback for node 69cc08e58df9359ff48988c7 INFO: 172.20.0.1:42148 - "POST /node/69cc08e58df9359ff48988c7 HTTP/1.0" 202 Accepted 2026-04-02 17:48:31,266 - lava_callback - INFO - Starting async job submit for node 69cc08e58df9359ff48988c7 2026-04-02 17:48:31,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:48:31,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc08e58df9359ff48988c7 HTTP/1.1" 200 None 2026-04-02 17:48:31,283 - lava_callback - DEBUG - Processing node 69cc08e58df9359ff48988c7: baseline-arm64-baylibre 2026-04-02 17:48:31,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc08e58df9359ff48988c7 2026-04-02 17:48:31,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:48:31,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc08e58df9359ff48988c7 HTTP/1.1" 200 None 2026-04-02 17:48:31,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:48:31,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:48:31,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:48:31,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc08e58df9359ff48988c7 HTTP/1.1" 200 None 2026-04-02 17:48:31,405 - lava_callback - ERROR - Error processing callback for node 69cc08e58df9359ff48988c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57600 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:51:34,103 - lava_callback - INFO - Received callback for node 69cc099b8df9359ff48988df INFO: 172.20.0.1:33188 - "POST /node/69cc099b8df9359ff48988df HTTP/1.0" 202 Accepted 2026-04-02 17:51:34,108 - lava_callback - INFO - Starting async job submit for node 69cc099b8df9359ff48988df 2026-04-02 17:51:34,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:51:34,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc099b8df9359ff48988df HTTP/1.1" 200 None 2026-04-02 17:51:34,148 - lava_callback - DEBUG - Processing node 69cc099b8df9359ff48988df: baseline-arm64-clabbe 2026-04-02 17:51:34,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc099b8df9359ff48988df 2026-04-02 17:51:34,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:51:34,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc099b8df9359ff48988df HTTP/1.1" 200 None 2026-04-02 17:51:34,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:51:34,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:51:34,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:51:34,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc099b8df9359ff48988df HTTP/1.1" 200 None 2026-04-02 17:51:34,205 - lava_callback - ERROR - Error processing callback for node 69cc099b8df9359ff48988df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42158 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:55:14,144 - lava_callback - INFO - Received callback for node 69cc0a708df9359ff48988fb INFO: 172.20.0.1:46312 - "POST /node/69cc0a708df9359ff48988fb HTTP/1.0" 202 Accepted 2026-04-02 17:55:14,149 - lava_callback - INFO - Starting async job submit for node 69cc0a708df9359ff48988fb 2026-04-02 17:55:14,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:55:14,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0a708df9359ff48988fb HTTP/1.1" 200 None 2026-04-02 17:55:14,177 - lava_callback - DEBUG - Processing node 69cc0a708df9359ff48988fb: baseline-arm64-clabbe 2026-04-02 17:55:14,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0a708df9359ff48988fb 2026-04-02 17:55:14,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:55:14,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0a708df9359ff48988fb HTTP/1.1" 200 None 2026-04-02 17:55:14,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:55:14,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:55:14,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:55:14,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0a708df9359ff48988fb HTTP/1.1" 200 None 2026-04-02 17:55:14,231 - lava_callback - ERROR - Error processing callback for node 69cc0a708df9359ff48988fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35868 - "GET /node/69936465cebe99dd8e0644d8%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-02 17:57:54,440 - lava_callback - INFO - Received callback for node 69cc0b1c8df9359ff489891c INFO: 172.20.0.1:33622 - "POST /node/69cc0b1c8df9359ff489891c HTTP/1.0" 202 Accepted 2026-04-02 17:57:54,445 - lava_callback - INFO - Starting async job submit for node 69cc0b1c8df9359ff489891c 2026-04-02 17:57:54,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:57:54,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0b1c8df9359ff489891c HTTP/1.1" 200 None 2026-04-02 17:57:54,470 - lava_callback - DEBUG - Processing node 69cc0b1c8df9359ff489891c: baseline-arm64-clabbe 2026-04-02 17:57:54,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0b1c8df9359ff489891c 2026-04-02 17:57:54,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:57:54,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0b1c8df9359ff489891c HTTP/1.1" 200 None 2026-04-02 17:57:54,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:57:54,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:57:54,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:57:54,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0b1c8df9359ff489891c HTTP/1.1" 200 None 2026-04-02 17:57:54,578 - lava_callback - ERROR - Error processing callback for node 69cc0b1c8df9359ff489891c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK 2026-04-02 17:59:34,469 - lava_callback - INFO - Received callback for node 69cc0b718df9359ff4898926 INFO: 172.20.0.1:38016 - "POST /node/69cc0b718df9359ff4898926 HTTP/1.0" 202 Accepted 2026-04-02 17:59:34,475 - lava_callback - INFO - Starting async job submit for node 69cc0b718df9359ff4898926 2026-04-02 17:59:34,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:59:34,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0b718df9359ff4898926 HTTP/1.1" 200 None 2026-04-02 17:59:34,499 - lava_callback - DEBUG - Processing node 69cc0b718df9359ff4898926: baseline-arm64-clabbe 2026-04-02 17:59:34,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0b718df9359ff4898926 2026-04-02 17:59:34,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:59:34,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0b718df9359ff4898926 HTTP/1.1" 200 None 2026-04-02 17:59:34,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:59:34,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 17:59:34,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 17:59:34,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0b718df9359ff4898926 HTTP/1.1" 200 None 2026-04-02 17:59:34,550 - lava_callback - ERROR - Error processing callback for node 69cc0b718df9359ff4898926: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34834 - "GET /node/698a243a22b4cc0f227af6f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45080 - "GET /node/698a7fe9d9a1cfa777a2305f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34848 - "GET /node/698401cf969566dcb0d2b42d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34850 - "GET /node/693b0947fee8383e92b715fe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34864 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:02:14,497 - lava_callback - INFO - Received callback for node 69cc0c1d8df9359ff489893f INFO: 172.20.0.1:44060 - "POST /node/69cc0c1d8df9359ff489893f HTTP/1.0" 202 Accepted 2026-04-02 18:02:14,503 - lava_callback - INFO - Starting async job submit for node 69cc0c1d8df9359ff489893f 2026-04-02 18:02:14,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:02:14,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0c1d8df9359ff489893f HTTP/1.1" 200 None 2026-04-02 18:02:14,518 - lava_callback - DEBUG - Processing node 69cc0c1d8df9359ff489893f: baseline-arm64-clabbe 2026-04-02 18:02:14,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0c1d8df9359ff489893f 2026-04-02 18:02:14,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:02:14,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0c1d8df9359ff489893f HTTP/1.1" 200 None 2026-04-02 18:02:14,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:02:14,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 18:02:14,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:02:14,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0c1d8df9359ff489893f HTTP/1.1" 200 None 2026-04-02 18:02:14,628 - lava_callback - ERROR - Error processing callback for node 69cc0c1d8df9359ff489893f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48428 - "GET /node/6990b666c45febfe4452361b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48444 - "GET /node/69876b20e31b58f834f19792%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59484 - "GET /node/699372b9cebe99dd8e069add%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60206 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:05:14,647 - lava_callback - INFO - Received callback for node 69cc0cc98df9359ff4898962 INFO: 172.20.0.1:39414 - "POST /node/69cc0cc98df9359ff4898962 HTTP/1.0" 202 Accepted 2026-04-02 18:05:14,653 - lava_callback - INFO - Starting async job submit for node 69cc0cc98df9359ff4898962 2026-04-02 18:05:14,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:05:14,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0cc98df9359ff4898962 HTTP/1.1" 200 None 2026-04-02 18:05:14,669 - lava_callback - DEBUG - Processing node 69cc0cc98df9359ff4898962: baseline-arm64-clabbe 2026-04-02 18:05:14,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0cc98df9359ff4898962 2026-04-02 18:05:14,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:05:14,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0cc98df9359ff4898962 HTTP/1.1" 200 None 2026-04-02 18:05:14,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:05:14,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae1602375b4506df899e HTTP/1.1" 200 None 2026-04-02 18:05:14,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:05:14,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0cc98df9359ff4898962 HTTP/1.1" 200 None 2026-04-02 18:05:14,725 - lava_callback - ERROR - Error processing callback for node 69cc0cc98df9359ff4898962: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39500 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:06:32,488 - lava_callback - INFO - Received callback for node 69cc0d188df9359ff489896b INFO: 172.20.0.1:48500 - "POST /node/69cc0d188df9359ff489896b HTTP/1.0" 202 Accepted 2026-04-02 18:06:32,494 - lava_callback - INFO - Starting async job submit for node 69cc0d188df9359ff489896b 2026-04-02 18:06:32,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:06:32,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0d188df9359ff489896b HTTP/1.1" 200 None 2026-04-02 18:06:32,510 - lava_callback - DEBUG - Processing node 69cc0d188df9359ff489896b: baseline-arm64-baylibre 2026-04-02 18:06:32,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0d188df9359ff489896b 2026-04-02 18:06:32,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:06:32,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0d188df9359ff489896b HTTP/1.1" 200 None 2026-04-02 18:06:32,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:06:32,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:06:32,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:06:32,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0d188df9359ff489896b HTTP/1.1" 200 None 2026-04-02 18:06:32,572 - lava_callback - ERROR - Error processing callback for node 69cc0d188df9359ff489896b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57866 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:07:52,307 - lava_callback - INFO - Received callback for node 69cc0d6f8df9359ff4898974 INFO: 172.20.0.1:42734 - "POST /node/69cc0d6f8df9359ff4898974 HTTP/1.0" 202 Accepted 2026-04-02 18:07:52,312 - lava_callback - INFO - Starting async job submit for node 69cc0d6f8df9359ff4898974 2026-04-02 18:07:52,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:07:52,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0d6f8df9359ff4898974 HTTP/1.1" 200 None 2026-04-02 18:07:52,328 - lava_callback - DEBUG - Processing node 69cc0d6f8df9359ff4898974: baseline-arm64-baylibre 2026-04-02 18:07:52,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0d6f8df9359ff4898974 2026-04-02 18:07:52,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:07:52,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0d6f8df9359ff4898974 HTTP/1.1" 200 None 2026-04-02 18:07:52,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:07:52,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:07:52,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:07:52,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0d6f8df9359ff4898974 HTTP/1.1" 200 None 2026-04-02 18:07:52,387 - lava_callback - ERROR - Error processing callback for node 69cc0d6f8df9359ff4898974: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44716 - "GET /node/693b0309fee8383e92b6f2ac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44718 - "GET /node/69c1dcb40efaf21d93103622%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34628 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:09:32,386 - lava_callback - INFO - Received callback for node 69cc0dc78df9359ff489897f INFO: 172.20.0.1:40390 - "POST /node/69cc0dc78df9359ff489897f HTTP/1.0" 202 Accepted 2026-04-02 18:09:32,392 - lava_callback - INFO - Starting async job submit for node 69cc0dc78df9359ff489897f 2026-04-02 18:09:32,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:09:32,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0dc78df9359ff489897f HTTP/1.1" 200 None 2026-04-02 18:09:32,408 - lava_callback - DEBUG - Processing node 69cc0dc78df9359ff489897f: baseline-arm64-baylibre 2026-04-02 18:09:32,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0dc78df9359ff489897f 2026-04-02 18:09:32,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:09:32,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0dc78df9359ff489897f HTTP/1.1" 200 None 2026-04-02 18:09:32,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:09:32,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:09:32,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:09:32,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0dc78df9359ff489897f HTTP/1.1" 200 None 2026-04-02 18:09:32,458 - lava_callback - ERROR - Error processing callback for node 69cc0dc78df9359ff489897f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39914 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:10:52,484 - lava_callback - INFO - Received callback for node 69cc0e1e8df9359ff489898a INFO: 172.20.0.1:45552 - "POST /node/69cc0e1e8df9359ff489898a HTTP/1.0" 202 Accepted 2026-04-02 18:10:52,490 - lava_callback - INFO - Starting async job submit for node 69cc0e1e8df9359ff489898a 2026-04-02 18:10:52,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:10:52,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0e1e8df9359ff489898a HTTP/1.1" 200 None 2026-04-02 18:10:52,510 - lava_callback - DEBUG - Processing node 69cc0e1e8df9359ff489898a: baseline-arm64-baylibre 2026-04-02 18:10:52,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0e1e8df9359ff489898a 2026-04-02 18:10:52,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:10:52,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0e1e8df9359ff489898a HTTP/1.1" 200 None 2026-04-02 18:10:52,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:10:52,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:10:52,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:10:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0e1e8df9359ff489898a HTTP/1.1" 200 None 2026-04-02 18:10:52,576 - lava_callback - ERROR - Error processing callback for node 69cc0e1e8df9359ff489898a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44230 - "GET /node/693b0371fee8383e92b6f45c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37694 - "GET /node/698ff1e276d4b6342e9db8d0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37710 - "GET /node/693b871741fb4c9509766909%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58392 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:13:35,009 - lava_callback - INFO - Received callback for node 69cc0ebd8df9359ff48989a4 INFO: 172.20.0.1:47930 - "POST /node/69cc0ebd8df9359ff48989a4 HTTP/1.0" 202 Accepted 2026-04-02 18:13:35,015 - lava_callback - INFO - Starting async job submit for node 69cc0ebd8df9359ff48989a4 2026-04-02 18:13:35,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:13:35,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0ebd8df9359ff48989a4 HTTP/1.1" 200 None 2026-04-02 18:13:35,040 - lava_callback - DEBUG - Processing node 69cc0ebd8df9359ff48989a4: baseline-arm64-clabbe 2026-04-02 18:13:35,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0ebd8df9359ff48989a4 2026-04-02 18:13:35,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:13:35,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0ebd8df9359ff48989a4 HTTP/1.1" 200 None 2026-04-02 18:13:35,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:13:35,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:13:35,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:13:35,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0ebd8df9359ff48989a4 HTTP/1.1" 200 None 2026-04-02 18:13:35,267 - lava_callback - ERROR - Error processing callback for node 69cc0ebd8df9359ff48989a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47780 - "GET /node/69a1599e2b7cf147caaf0447%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55610 - "GET /node/693b070efee8383e92b70a8e%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-02 18:16:15,100 - lava_callback - INFO - Received callback for node 69cc0f638df9359ff48989b5 INFO: 172.20.0.1:55626 - "POST /node/69cc0f638df9359ff48989b5 HTTP/1.0" 202 Accepted 2026-04-02 18:16:15,105 - lava_callback - INFO - Starting async job submit for node 69cc0f638df9359ff48989b5 2026-04-02 18:16:15,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:16:15,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0f638df9359ff48989b5 HTTP/1.1" 200 None 2026-04-02 18:16:15,133 - lava_callback - DEBUG - Processing node 69cc0f638df9359ff48989b5: baseline-arm64-clabbe 2026-04-02 18:16:15,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0f638df9359ff48989b5 2026-04-02 18:16:15,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:16:15,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0f638df9359ff48989b5 HTTP/1.1" 200 None 2026-04-02 18:16:15,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:55628 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 18:16:15,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:16:15,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:16:15,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0f638df9359ff48989b5 HTTP/1.1" 200 None 2026-04-02 18:16:15,215 - lava_callback - ERROR - Error processing callback for node 69cc0f638df9359ff48989b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55542 - "GET /node/6993c11d3e9ba4930770d4f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55558 - "GET /node/698e79c5db401c547d570074%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-02 18:17:12,917 - lava_callback - INFO - Received callback for node 69cc0fa08df9359ff48989bc INFO: 172.20.0.1:40828 - "POST /node/69cc0fa08df9359ff48989bc HTTP/1.0" 202 Accepted 2026-04-02 18:17:12,922 - lava_callback - INFO - Starting async job submit for node 69cc0fa08df9359ff48989bc 2026-04-02 18:17:12,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:17:12,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0fa08df9359ff48989bc HTTP/1.1" 200 None 2026-04-02 18:17:12,938 - lava_callback - DEBUG - Processing node 69cc0fa08df9359ff48989bc: baseline-arm-baylibre 2026-04-02 18:17:12,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0fa08df9359ff48989bc 2026-04-02 18:17:12,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:17:12,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0fa08df9359ff48989bc HTTP/1.1" 200 None 2026-04-02 18:17:12,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:17:12,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:17:12,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:17:12,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0fa08df9359ff48989bc HTTP/1.1" 200 None 2026-04-02 18:17:12,990 - lava_callback - ERROR - Error processing callback for node 69cc0fa08df9359ff48989bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:17:52,830 - lava_callback - INFO - Received callback for node 69cc0fc98df9359ff48989c4 INFO: 172.20.0.1:36076 - "POST /node/69cc0fc98df9359ff48989c4 HTTP/1.0" 202 Accepted 2026-04-02 18:17:52,836 - lava_callback - INFO - Starting async job submit for node 69cc0fc98df9359ff48989c4 2026-04-02 18:17:52,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:17:52,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0fc98df9359ff48989c4 HTTP/1.1" 200 None 2026-04-02 18:17:52,851 - lava_callback - DEBUG - Processing node 69cc0fc98df9359ff48989c4: baseline-arm-baylibre 2026-04-02 18:17:52,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc0fc98df9359ff48989c4 2026-04-02 18:17:52,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:17:52,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc0fc98df9359ff48989c4 HTTP/1.1" 200 None 2026-04-02 18:17:52,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:17:52,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:17:52,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:17:52,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc0fc98df9359ff48989c4 HTTP/1.1" 200 None 2026-04-02 18:17:52,902 - lava_callback - ERROR - Error processing callback for node 69cc0fc98df9359ff48989c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET /node/69485feb9214b49387168eba%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36094 - "GET /node/6985c50c71989fb1414980f5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49948 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:18:55,236 - lava_callback - INFO - Received callback for node 69cc100b8df9359ff48989d1 INFO: 172.20.0.1:54406 - "POST /node/69cc100b8df9359ff48989d1 HTTP/1.0" 202 Accepted 2026-04-02 18:18:55,242 - lava_callback - INFO - Starting async job submit for node 69cc100b8df9359ff48989d1 2026-04-02 18:18:55,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:18:55,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc100b8df9359ff48989d1 HTTP/1.1" 200 None 2026-04-02 18:18:55,259 - lava_callback - DEBUG - Processing node 69cc100b8df9359ff48989d1: baseline-arm64-clabbe 2026-04-02 18:18:55,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc100b8df9359ff48989d1 2026-04-02 18:18:55,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:18:55,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc100b8df9359ff48989d1 HTTP/1.1" 200 None 2026-04-02 18:18:55,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:18:55,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:18:55,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:18:55,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc100b8df9359ff48989d1 HTTP/1.1" 200 None 2026-04-02 18:18:55,335 - lava_callback - ERROR - Error processing callback for node 69cc100b8df9359ff48989d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET /node/6983787166dc8a56088a52c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44738 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:20:12,946 - lava_callback - INFO - Received callback for node 69cc10488df9359ff48989dd INFO: 172.20.0.1:56002 - "POST /node/69cc10488df9359ff48989dd HTTP/1.0" 202 Accepted 2026-04-02 18:20:12,952 - lava_callback - INFO - Starting async job submit for node 69cc10488df9359ff48989dd 2026-04-02 18:20:12,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:20:12,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc10488df9359ff48989dd HTTP/1.1" 200 None 2026-04-02 18:20:12,971 - lava_callback - DEBUG - Processing node 69cc10488df9359ff48989dd: baseline-arm-baylibre 2026-04-02 18:20:12,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc10488df9359ff48989dd 2026-04-02 18:20:12,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:20:12,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc10488df9359ff48989dd HTTP/1.1" 200 None 2026-04-02 18:20:12,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:20:13,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:20:13,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:20:13,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc10488df9359ff48989dd HTTP/1.1" 200 None 2026-04-02 18:20:13,033 - lava_callback - ERROR - Error processing callback for node 69cc10488df9359ff48989dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55362 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:20:52,989 - lava_callback - INFO - Received callback for node 69cc10718df9359ff48989f1 INFO: 172.20.0.1:42108 - "POST /node/69cc10718df9359ff48989f1 HTTP/1.0" 202 Accepted 2026-04-02 18:20:52,995 - lava_callback - INFO - Starting async job submit for node 69cc10718df9359ff48989f1 2026-04-02 18:20:52,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:20:53,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc10718df9359ff48989f1 HTTP/1.1" 200 None 2026-04-02 18:20:53,011 - lava_callback - DEBUG - Processing node 69cc10718df9359ff48989f1: baseline-arm-baylibre 2026-04-02 18:20:53,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc10718df9359ff48989f1 2026-04-02 18:20:53,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:20:53,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc10718df9359ff48989f1 HTTP/1.1" 200 None 2026-04-02 18:20:53,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:20:53,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:20:53,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:20:53,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc10718df9359ff48989f1 HTTP/1.1" 200 None 2026-04-02 18:20:53,069 - lava_callback - ERROR - Error processing callback for node 69cc10718df9359ff48989f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41878 - "GET /node/693afc09fee8383e92b6d755%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58522 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:21:33,080 - lava_callback - INFO - Received callback for node 69cc109b8df9359ff48989f8 INFO: 172.20.0.1:45562 - "POST /node/69cc109b8df9359ff48989f8 HTTP/1.0" 202 Accepted 2026-04-02 18:21:33,085 - lava_callback - INFO - Starting async job submit for node 69cc109b8df9359ff48989f8 2026-04-02 18:21:33,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:21:33,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc109b8df9359ff48989f8 HTTP/1.1" 200 None 2026-04-02 18:21:33,102 - lava_callback - DEBUG - Processing node 69cc109b8df9359ff48989f8: baseline-arm-baylibre 2026-04-02 18:21:33,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc109b8df9359ff48989f8 2026-04-02 18:21:33,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:21:33,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc109b8df9359ff48989f8 HTTP/1.1" 200 None 2026-04-02 18:21:33,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:21:33,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:21:33,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:21:33,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc109b8df9359ff48989f8 HTTP/1.1" 200 None 2026-04-02 18:21:33,161 - lava_callback - ERROR - Error processing callback for node 69cc109b8df9359ff48989f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51652 - "GET /node/6937dd8ea4c94886b94bee97%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51668 - "GET /node/69281074b1b5e06bf6c04f4f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45758 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:23:33,201 - lava_callback - INFO - Received callback for node 69cc11148df9359ff4898a20 INFO: 172.20.0.1:43658 - "POST /node/69cc11148df9359ff4898a20 HTTP/1.0" 202 Accepted 2026-04-02 18:23:33,206 - lava_callback - INFO - Starting async job submit for node 69cc11148df9359ff4898a20 2026-04-02 18:23:33,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:23:33,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11148df9359ff4898a20 HTTP/1.1" 200 None 2026-04-02 18:23:33,250 - lava_callback - DEBUG - Processing node 69cc11148df9359ff4898a20: baseline-arm-baylibre 2026-04-02 18:23:33,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc11148df9359ff4898a20 2026-04-02 18:23:33,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:23:33,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11148df9359ff4898a20 HTTP/1.1" 200 None 2026-04-02 18:23:33,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:23:33,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:23:33,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:23:33,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc11148df9359ff4898a20 HTTP/1.1" 200 None 2026-04-02 18:23:33,310 - lava_callback - ERROR - Error processing callback for node 69cc11148df9359ff4898a20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49256 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 18:24:15,498 - lava_callback - INFO - Received callback for node 69cc113e8df9359ff4898a2e INFO: 172.20.0.1:49260 - "POST /node/69cc113e8df9359ff4898a2e HTTP/1.0" 202 Accepted 2026-04-02 18:24:15,504 - lava_callback - INFO - Starting async job submit for node 69cc113e8df9359ff4898a2e 2026-04-02 18:24:15,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:24:15,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc113e8df9359ff4898a2e HTTP/1.1" 200 None 2026-04-02 18:24:15,520 - lava_callback - DEBUG - Processing node 69cc113e8df9359ff4898a2e: baseline-arm-clabbe 2026-04-02 18:24:15,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc113e8df9359ff4898a2e 2026-04-02 18:24:15,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:24:15,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc113e8df9359ff4898a2e HTTP/1.1" 200 None 2026-04-02 18:24:15,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:24:15,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:24:15,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:24:15,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc113e8df9359ff4898a2e HTTP/1.1" 200 None 2026-04-02 18:24:15,579 - lava_callback - ERROR - Error processing callback for node 69cc113e8df9359ff4898a2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41962 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:24:55,519 - lava_callback - INFO - Received callback for node 69cc11688df9359ff4898a3d INFO: 172.20.0.1:36274 - "POST /node/69cc11688df9359ff4898a3d HTTP/1.0" 202 Accepted 2026-04-02 18:24:55,525 - lava_callback - INFO - Starting async job submit for node 69cc11688df9359ff4898a3d 2026-04-02 18:24:55,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:24:55,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11688df9359ff4898a3d HTTP/1.1" 200 None 2026-04-02 18:24:55,541 - lava_callback - DEBUG - Processing node 69cc11688df9359ff4898a3d: baseline-arm-clabbe 2026-04-02 18:24:55,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc11688df9359ff4898a3d 2026-04-02 18:24:55,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:24:55,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11688df9359ff4898a3d HTTP/1.1" 200 None 2026-04-02 18:24:55,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:24:55,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:24:55,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:24:55,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc11688df9359ff4898a3d HTTP/1.1" 200 None 2026-04-02 18:24:55,596 - lava_callback - ERROR - Error processing callback for node 69cc11688df9359ff4898a3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51648 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:25:35,540 - lava_callback - INFO - Received callback for node 69cc11958df9359ff4898a45 INFO: 172.20.0.1:44814 - "POST /node/69cc11958df9359ff4898a45 HTTP/1.0" 202 Accepted 2026-04-02 18:25:35,545 - lava_callback - INFO - Starting async job submit for node 69cc11958df9359ff4898a45 2026-04-02 18:25:35,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:25:35,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11958df9359ff4898a45 HTTP/1.1" 200 None 2026-04-02 18:25:35,594 - lava_callback - DEBUG - Processing node 69cc11958df9359ff4898a45: baseline-arm-clabbe 2026-04-02 18:25:35,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc11958df9359ff4898a45 2026-04-02 18:25:35,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:25:35,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11958df9359ff4898a45 HTTP/1.1" 200 None 2026-04-02 18:25:35,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:25:35,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:25:35,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:25:35,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc11958df9359ff4898a45 HTTP/1.1" 200 None 2026-04-02 18:25:35,688 - lava_callback - ERROR - Error processing callback for node 69cc11958df9359ff4898a45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55312 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 18:26:15,492 - lava_callback - INFO - Received callback for node 69cc11bd8df9359ff4898a52 INFO: 172.20.0.1:55326 - "POST /node/69cc11bd8df9359ff4898a52 HTTP/1.0" 202 Accepted 2026-04-02 18:26:15,497 - lava_callback - INFO - Starting async job submit for node 69cc11bd8df9359ff4898a52 2026-04-02 18:26:15,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:26:15,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11bd8df9359ff4898a52 HTTP/1.1" 200 None 2026-04-02 18:26:15,513 - lava_callback - DEBUG - Processing node 69cc11bd8df9359ff4898a52: baseline-arm-clabbe 2026-04-02 18:26:15,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc11bd8df9359ff4898a52 2026-04-02 18:26:15,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:26:15,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11bd8df9359ff4898a52 HTTP/1.1" 200 None 2026-04-02 18:26:15,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:26:15,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:26:15,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:26:15,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc11bd8df9359ff4898a52 HTTP/1.1" 200 None 2026-04-02 18:26:15,576 - lava_callback - ERROR - Error processing callback for node 69cc11bd8df9359ff4898a52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57148 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:26:55,574 - lava_callback - INFO - Received callback for node 69cc11e68df9359ff4898a59 INFO: 172.20.0.1:39932 - "POST /node/69cc11e68df9359ff4898a59 HTTP/1.0" 202 Accepted 2026-04-02 18:26:55,580 - lava_callback - INFO - Starting async job submit for node 69cc11e68df9359ff4898a59 2026-04-02 18:26:55,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:26:55,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11e68df9359ff4898a59 HTTP/1.1" 200 None 2026-04-02 18:26:55,620 - lava_callback - DEBUG - Processing node 69cc11e68df9359ff4898a59: baseline-arm-clabbe 2026-04-02 18:26:55,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc11e68df9359ff4898a59 2026-04-02 18:26:55,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:26:55,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc11e68df9359ff4898a59 HTTP/1.1" 200 None 2026-04-02 18:26:55,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:26:55,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c6ae0102375b4506df898a HTTP/1.1" 200 None 2026-04-02 18:26:55,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:26:55,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc11e68df9359ff4898a59 HTTP/1.1" 200 None 2026-04-02 18:26:55,671 - lava_callback - ERROR - Error processing callback for node 69cc11e68df9359ff4898a59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56830 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:27:55,577 - lava_callback - INFO - Received callback for node 69cc12208df9359ff4898a6d INFO: 172.20.0.1:49638 - "POST /node/69cc12208df9359ff4898a6d HTTP/1.0" 202 Accepted 2026-04-02 18:27:55,582 - lava_callback - INFO - Starting async job submit for node 69cc12208df9359ff4898a6d 2026-04-02 18:27:55,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:27:55,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc12208df9359ff4898a6d HTTP/1.1" 200 None 2026-04-02 18:27:55,598 - lava_callback - DEBUG - Processing node 69cc12208df9359ff4898a6d: baseline-arm64-clabbe 2026-04-02 18:27:55,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc12208df9359ff4898a6d 2026-04-02 18:27:55,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:27:55,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc12208df9359ff4898a6d HTTP/1.1" 200 None 2026-04-02 18:27:55,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:27:55,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:27:55,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:27:55,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc12208df9359ff4898a6d HTTP/1.1" 200 None 2026-04-02 18:27:55,664 - lava_callback - ERROR - Error processing callback for node 69cc12208df9359ff4898a6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42010 - "GET / HTTP/1.0" 200 OK 2026-04-02 18:30:35,737 - lava_callback - INFO - Received callback for node 69cc12c88df9359ff4898aad INFO: 172.20.0.1:52042 - "POST /node/69cc12c88df9359ff4898aad HTTP/1.0" 202 Accepted 2026-04-02 18:30:35,746 - lava_callback - INFO - Starting async job submit for node 69cc12c88df9359ff4898aad 2026-04-02 18:30:35,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:30:35,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc12c88df9359ff4898aad HTTP/1.1" 200 None 2026-04-02 18:30:35,775 - lava_callback - DEBUG - Processing node 69cc12c88df9359ff4898aad: baseline-arm64-clabbe 2026-04-02 18:30:35,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc12c88df9359ff4898aad 2026-04-02 18:30:35,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:30:35,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc12c88df9359ff4898aad HTTP/1.1" 200 None 2026-04-02 18:30:35,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:30:35,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:30:35,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:30:35,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc12c88df9359ff4898aad HTTP/1.1" 200 None 2026-04-02 18:30:35,866 - lava_callback - ERROR - Error processing callback for node 69cc12c88df9359ff4898aad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46430 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 18:32:15,777 - lava_callback - INFO - Received callback for node 69cc131e8df9359ff4898acd INFO: 172.20.0.1:46436 - "POST /node/69cc131e8df9359ff4898acd HTTP/1.0" 202 Accepted 2026-04-02 18:32:15,783 - lava_callback - INFO - Starting async job submit for node 69cc131e8df9359ff4898acd 2026-04-02 18:32:15,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:32:15,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc131e8df9359ff4898acd HTTP/1.1" 200 None 2026-04-02 18:32:15,805 - lava_callback - DEBUG - Processing node 69cc131e8df9359ff4898acd: baseline-arm64-clabbe 2026-04-02 18:32:15,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc131e8df9359ff4898acd 2026-04-02 18:32:15,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:32:15,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc131e8df9359ff4898acd HTTP/1.1" 200 None 2026-04-02 18:32:15,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:32:15,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c40ad9944faaf0e7f5e41d HTTP/1.1" 200 None 2026-04-02 18:32:15,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 18:32:15,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc131e8df9359ff4898acd HTTP/1.1" 200 None 2026-04-02 18:32:15,882 - lava_callback - ERROR - Error processing callback for node 69cc131e8df9359ff4898acd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50392 - "GET /node/6938c24de767fbc36e03e22f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47440 - "GET /node/6927928397dccbdf516a6cd5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33484 - "GET /node/698771f8e31b58f834f1a7ce%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57026 - "GET /node/6991f73f01ff1e8e0859d29b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48610 - "GET /node/694a583583c67c43d1ed9a5e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48626 - "GET /node/69870f9e6e077e4126a7edd2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39772 - "GET /node/68826b4187dcced189497f16%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39774 - "GET /node/69a4e2387caa0b8e1b59def0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36600 - "GET /node/699370f8cebe99dd8e0691c1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54294 - "GET /node/693a827be17cfbe560b12d2e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54306 - "GET /node/694a5ac383c67c43d1eda104%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET /node/6990356d985e4efca431c63a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41628 - "GET /node/69840be1969566dcb0d2bc39%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35758 - "GET /node/694940f0ebaed71d438084f7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35760 - "GET /node/69a1d5519230c437a22de593%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49066 - "GET /node/693f3e1024745582e399ef26%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49080 - "GET /node/69419328ecc59770562e837a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58440 - "GET /node/698af7c73b3beb19e761766a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58452 - "GET /node/69a1599b2b7cf147caaf0441%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55646 - "GET /node/693a827ae17cfbe560b12d27%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51654 - "GET /node/69903acb985e4efca431da8d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51660 - "GET /node/693b122cfee8383e92b73bb3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55254 - "GET /node/693b0e33fee8383e92b7253a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55258 - "GET /node/6992678e98a8bdb31c39203a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET /node/693b7f4e41fb4c9509764305%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49952 - "GET /node/693a89c7e17cfbe560b13646%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49966 - "GET /node/69710193cda355ebb9b85e4f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41364 - "GET /node/698e229c952a14bf500e3ce2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41368 - "GET /node/693afa6cfee8383e92b6d163%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60226 - "GET /node/69487cd09214b49387169641%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42060 - "GET /node/69846a683a8748f282086ced%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42070 - "GET /node/69118911f15111fc8ce4bc76%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53182 - "GET /node/694bd94cc19e09af58d49c0c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39502 - "GET /node/693773690c55536e7dddace8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58696 - "GET /node/69304265009d5f8c767ee84c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34258 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:07:55,797 - lava_callback - INFO - Received callback for node 69cc1b828df9359ff4898cc1 INFO: 172.20.0.1:44530 - "POST /node/69cc1b828df9359ff4898cc1 HTTP/1.0" 202 Accepted 2026-04-02 19:07:55,803 - lava_callback - INFO - Starting async job submit for node 69cc1b828df9359ff4898cc1 2026-04-02 19:07:55,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:07:55,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1b828df9359ff4898cc1 HTTP/1.1" 200 None 2026-04-02 19:07:55,819 - lava_callback - DEBUG - Processing node 69cc1b828df9359ff4898cc1: baseline-arm-baylibre 2026-04-02 19:07:55,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1b828df9359ff4898cc1 2026-04-02 19:07:55,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:07:55,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1b828df9359ff4898cc1 HTTP/1.1" 200 None 2026-04-02 19:07:55,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:07:55,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:07:55,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:07:55,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1b828df9359ff4898cc1 HTTP/1.1" 200 None 2026-04-02 19:07:55,879 - lava_callback - ERROR - Error processing callback for node 69cc1b828df9359ff4898cc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:08:35,597 - lava_callback - INFO - Received callback for node 69cc1bad8df9359ff4898cd8 INFO: 172.20.0.1:51756 - "POST /node/69cc1bad8df9359ff4898cd8 HTTP/1.0" 202 Accepted 2026-04-02 19:08:35,605 - lava_callback - INFO - Starting async job submit for node 69cc1bad8df9359ff4898cd8 2026-04-02 19:08:35,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:08:35,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1bad8df9359ff4898cd8 HTTP/1.1" 200 None 2026-04-02 19:08:35,632 - lava_callback - DEBUG - Processing node 69cc1bad8df9359ff4898cd8: baseline-arm-baylibre 2026-04-02 19:08:35,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1bad8df9359ff4898cd8 2026-04-02 19:08:35,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:08:35,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1bad8df9359ff4898cd8 HTTP/1.1" 200 None 2026-04-02 19:08:35,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:08:35,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:08:35,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:08:35,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1bad8df9359ff4898cd8 HTTP/1.1" 200 None 2026-04-02 19:08:35,729 - lava_callback - ERROR - Error processing callback for node 69cc1bad8df9359ff4898cd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38216 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:09:55,647 - lava_callback - INFO - Received callback for node 69cc1bff8df9359ff4898cf9 INFO: 172.20.0.1:34598 - "POST /node/69cc1bff8df9359ff4898cf9 HTTP/1.0" 202 Accepted 2026-04-02 19:09:55,653 - lava_callback - INFO - Starting async job submit for node 69cc1bff8df9359ff4898cf9 2026-04-02 19:09:55,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:09:55,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1bff8df9359ff4898cf9 HTTP/1.1" 200 None 2026-04-02 19:09:55,669 - lava_callback - DEBUG - Processing node 69cc1bff8df9359ff4898cf9: baseline-arm-baylibre 2026-04-02 19:09:55,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1bff8df9359ff4898cf9 2026-04-02 19:09:55,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:09:55,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1bff8df9359ff4898cf9 HTTP/1.1" 200 None 2026-04-02 19:09:55,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:09:55,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:09:55,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:09:55,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1bff8df9359ff4898cf9 HTTP/1.1" 200 None 2026-04-02 19:09:55,719 - lava_callback - ERROR - Error processing callback for node 69cc1bff8df9359ff4898cf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48658 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:10:35,648 - lava_callback - INFO - Received callback for node 69cc1c288df9359ff4898d04 INFO: 172.20.0.1:40978 - "POST /node/69cc1c288df9359ff4898d04 HTTP/1.0" 202 Accepted 2026-04-02 19:10:35,654 - lava_callback - INFO - Starting async job submit for node 69cc1c288df9359ff4898d04 2026-04-02 19:10:35,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:10:35,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1c288df9359ff4898d04 HTTP/1.1" 200 None 2026-04-02 19:10:35,670 - lava_callback - DEBUG - Processing node 69cc1c288df9359ff4898d04: baseline-arm-baylibre 2026-04-02 19:10:35,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1c288df9359ff4898d04 2026-04-02 19:10:35,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:10:35,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1c288df9359ff4898d04 HTTP/1.1" 200 None 2026-04-02 19:10:35,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:10:35,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:10:35,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:10:35,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1c288df9359ff4898d04 HTTP/1.1" 200 None 2026-04-02 19:10:35,746 - lava_callback - ERROR - Error processing callback for node 69cc1c288df9359ff4898d04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33738 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 19:11:15,755 - lava_callback - INFO - Received callback for node 69cc1c518df9359ff4898d15 INFO: 172.20.0.1:33752 - "POST /node/69cc1c518df9359ff4898d15 HTTP/1.0" 202 Accepted 2026-04-02 19:11:15,760 - lava_callback - INFO - Starting async job submit for node 69cc1c518df9359ff4898d15 2026-04-02 19:11:15,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:11:15,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1c518df9359ff4898d15 HTTP/1.1" 200 None 2026-04-02 19:11:15,781 - lava_callback - DEBUG - Processing node 69cc1c518df9359ff4898d15: baseline-arm-baylibre 2026-04-02 19:11:15,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1c518df9359ff4898d15 2026-04-02 19:11:15,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:11:15,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1c518df9359ff4898d15 HTTP/1.1" 200 None 2026-04-02 19:11:15,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:11:15,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:11:15,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:11:15,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1c518df9359ff4898d15 HTTP/1.1" 200 None 2026-04-02 19:11:15,833 - lava_callback - ERROR - Error processing callback for node 69cc1c518df9359ff4898d15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41472 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:13:17,606 - lava_callback - INFO - Received callback for node 69cc1cc88df9359ff4898d58 INFO: 172.20.0.1:41480 - "POST /node/69cc1cc88df9359ff4898d58 HTTP/1.0" 202 Accepted 2026-04-02 19:13:17,611 - lava_callback - INFO - Starting async job submit for node 69cc1cc88df9359ff4898d58 2026-04-02 19:13:17,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:13:17,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1cc88df9359ff4898d58 HTTP/1.1" 200 None 2026-04-02 19:13:17,627 - lava_callback - DEBUG - Processing node 69cc1cc88df9359ff4898d58: baseline-arm-clabbe 2026-04-02 19:13:17,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1cc88df9359ff4898d58 2026-04-02 19:13:17,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:13:17,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1cc88df9359ff4898d58 HTTP/1.1" 200 None 2026-04-02 19:13:17,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:13:17,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:13:17,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:13:17,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1cc88df9359ff4898d58 HTTP/1.1" 200 None 2026-04-02 19:13:17,678 - lava_callback - ERROR - Error processing callback for node 69cc1cc88df9359ff4898d58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39082 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:13:57,459 - lava_callback - INFO - Received callback for node 69cc1cf18df9359ff4898d6a INFO: 172.20.0.1:39086 - "POST /node/69cc1cf18df9359ff4898d6a HTTP/1.0" 202 Accepted 2026-04-02 19:13:57,465 - lava_callback - INFO - Starting async job submit for node 69cc1cf18df9359ff4898d6a 2026-04-02 19:13:57,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:13:57,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1cf18df9359ff4898d6a HTTP/1.1" 200 None 2026-04-02 19:13:57,487 - lava_callback - DEBUG - Processing node 69cc1cf18df9359ff4898d6a: baseline-arm-clabbe 2026-04-02 19:13:57,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1cf18df9359ff4898d6a 2026-04-02 19:13:57,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:13:57,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1cf18df9359ff4898d6a HTTP/1.1" 200 None 2026-04-02 19:13:57,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:13:57,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:13:57,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:13:57,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1cf18df9359ff4898d6a HTTP/1.1" 200 None 2026-04-02 19:13:57,549 - lava_callback - ERROR - Error processing callback for node 69cc1cf18df9359ff4898d6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42190 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:14:37,547 - lava_callback - INFO - Received callback for node 69cc1d1a8df9359ff4898d7b INFO: 172.20.0.1:42202 - "POST /node/69cc1d1a8df9359ff4898d7b HTTP/1.0" 202 Accepted 2026-04-02 19:14:37,552 - lava_callback - INFO - Starting async job submit for node 69cc1d1a8df9359ff4898d7b 2026-04-02 19:14:37,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:14:37,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1d1a8df9359ff4898d7b HTTP/1.1" 200 None 2026-04-02 19:14:37,569 - lava_callback - DEBUG - Processing node 69cc1d1a8df9359ff4898d7b: baseline-arm-clabbe 2026-04-02 19:14:37,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1d1a8df9359ff4898d7b 2026-04-02 19:14:37,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:14:37,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1d1a8df9359ff4898d7b HTTP/1.1" 200 None 2026-04-02 19:14:37,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:14:37,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:14:37,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:14:37,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1d1a8df9359ff4898d7b HTTP/1.1" 200 None 2026-04-02 19:14:37,620 - lava_callback - ERROR - Error processing callback for node 69cc1d1a8df9359ff4898d7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33064 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:15:37,665 - lava_callback - INFO - Received callback for node 69cc1d468df9359ff4898d85 INFO: 172.20.0.1:33080 - "POST /node/69cc1d468df9359ff4898d85 HTTP/1.0" 202 Accepted 2026-04-02 19:15:37,674 - lava_callback - INFO - Starting async job submit for node 69cc1d468df9359ff4898d85 2026-04-02 19:15:37,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:15:37,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1d468df9359ff4898d85 HTTP/1.1" 200 None 2026-04-02 19:15:37,690 - lava_callback - DEBUG - Processing node 69cc1d468df9359ff4898d85: baseline-arm-clabbe 2026-04-02 19:15:37,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1d468df9359ff4898d85 2026-04-02 19:15:37,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:15:37,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1d468df9359ff4898d85 HTTP/1.1" 200 None 2026-04-02 19:15:37,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:15:37,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:15:37,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:15:37,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1d468df9359ff4898d85 HTTP/1.1" 200 None 2026-04-02 19:15:37,777 - lava_callback - ERROR - Error processing callback for node 69cc1d468df9359ff4898d85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42662 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:16:17,626 - lava_callback - INFO - Received callback for node 69cc1d708df9359ff4898d9e INFO: 172.20.0.1:42674 - "POST /node/69cc1d708df9359ff4898d9e HTTP/1.0" 202 Accepted 2026-04-02 19:16:17,633 - lava_callback - INFO - Starting async job submit for node 69cc1d708df9359ff4898d9e 2026-04-02 19:16:17,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:16:17,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1d708df9359ff4898d9e HTTP/1.1" 200 None 2026-04-02 19:16:17,650 - lava_callback - DEBUG - Processing node 69cc1d708df9359ff4898d9e: baseline-arm-clabbe 2026-04-02 19:16:17,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc1d708df9359ff4898d9e 2026-04-02 19:16:17,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:16:17,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc1d708df9359ff4898d9e HTTP/1.1" 200 None 2026-04-02 19:16:17,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:16:17,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 19:16:17,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:16:17,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc1d708df9359ff4898d9e HTTP/1.1" 200 None 2026-04-02 19:16:17,719 - lava_callback - ERROR - Error processing callback for node 69cc1d708df9359ff4898d9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54806 - "GET /node/69af01d5ce46d8ec186ac706%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53894 - "GET /node/6992ea2231166481c8dd8b8c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53910 - "GET /node/69861c8a177ca0f097bd152c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44906 - "GET /node/69103bd7f4a91d81a0ec4c57%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38532 - "GET /node/693af5a2fee8383e92b6b495%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38542 - "GET /node/69809e8193b339382199d3a4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33332 - "GET /node/6982ac523507dcddca5905d2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34208 - "GET /node/69c1de680efaf21d931037d4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34222 - "GET /node/69a17547a41e9451dcf4204b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39144 - "GET /node/6985bd9a71989fb14149799f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48682 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:31:16,878 - lava_callback - INFO - Received callback for node 69cc20f48df9359ff4898e3b INFO: 172.20.0.1:48688 - "POST /node/69cc20f48df9359ff4898e3b HTTP/1.0" 202 Accepted 2026-04-02 19:31:16,884 - lava_callback - INFO - Starting async job submit for node 69cc20f48df9359ff4898e3b 2026-04-02 19:31:16,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:31:16,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc20f48df9359ff4898e3b HTTP/1.1" 200 None 2026-04-02 19:31:16,911 - lava_callback - DEBUG - Processing node 69cc20f48df9359ff4898e3b: baseline-arm64-baylibre 2026-04-02 19:31:16,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc20f48df9359ff4898e3b 2026-04-02 19:31:16,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:31:16,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc20f48df9359ff4898e3b HTTP/1.1" 200 None 2026-04-02 19:31:16,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:31:16,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 19:31:16,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:31:16,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc20f48df9359ff4898e3b HTTP/1.1" 200 None 2026-04-02 19:31:16,971 - lava_callback - ERROR - Error processing callback for node 69cc20f48df9359ff4898e3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58674 - "GET /node/6954200d9c6929bd9fb71840%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58688 - "GET /node/69869ca72de8e2dea3666b9b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56556 - "GET /node/6984eb9d3ff18e47df613ad1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60308 - "GET /node/6940d805460bc8e265112bad%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60312 - "GET /node/69934aec523507f3806a52d0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48352 - "GET /node/694af4b46c96ed51d317203c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48358 - "GET /node/693b02f4fee8383e92b6f25c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50540 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:35:17,018 - lava_callback - INFO - Received callback for node 69cc21e68df9359ff4898e5d INFO: 172.20.0.1:50556 - "POST /node/69cc21e68df9359ff4898e5d HTTP/1.0" 202 Accepted 2026-04-02 19:35:17,024 - lava_callback - INFO - Starting async job submit for node 69cc21e68df9359ff4898e5d 2026-04-02 19:35:17,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:35:17,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc21e68df9359ff4898e5d HTTP/1.1" 200 None 2026-04-02 19:35:17,040 - lava_callback - DEBUG - Processing node 69cc21e68df9359ff4898e5d: baseline-arm64-baylibre 2026-04-02 19:35:17,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc21e68df9359ff4898e5d 2026-04-02 19:35:17,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:35:17,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc21e68df9359ff4898e5d HTTP/1.1" 200 None 2026-04-02 19:35:17,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:35:17,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 19:35:17,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:35:17,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc21e68df9359ff4898e5d HTTP/1.1" 200 None 2026-04-02 19:35:17,120 - lava_callback - ERROR - Error processing callback for node 69cc21e68df9359ff4898e5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45424 - "GET /node/6988c13e9fc35f969e1ede69%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45426 - "GET /node/69935660523507f3806a8cb2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50142 - "GET /node/692982fd09677735f68af283%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50154 - "GET /node/6985d54971989fb14149a0c5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59782 - "GET /node/69bd10cb05e4bbd6ba635ac7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59796 - "GET /node/6986fafb6e077e4126a7d3ab%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54364 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:37:18,642 - lava_callback - INFO - Received callback for node 69cc22668df9359ff4898e8d INFO: 172.20.0.1:54368 - "POST /node/69cc22668df9359ff4898e8d HTTP/1.0" 202 Accepted 2026-04-02 19:37:18,648 - lava_callback - INFO - Starting async job submit for node 69cc22668df9359ff4898e8d 2026-04-02 19:37:18,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:37:18,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc22668df9359ff4898e8d HTTP/1.1" 200 None 2026-04-02 19:37:18,664 - lava_callback - DEBUG - Processing node 69cc22668df9359ff4898e8d: baseline-arm64-clabbe 2026-04-02 19:37:18,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc22668df9359ff4898e8d 2026-04-02 19:37:18,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:37:18,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc22668df9359ff4898e8d HTTP/1.1" 200 None 2026-04-02 19:37:18,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:37:18,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 19:37:18,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:37:18,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc22668df9359ff4898e8d HTTP/1.1" 200 None 2026-04-02 19:37:18,717 - lava_callback - ERROR - Error processing callback for node 69cc22668df9359ff4898e8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET /node/6992699198a8bdb31c3923fa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58734 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:39:18,616 - lava_callback - INFO - Received callback for node 69cc22df8df9359ff4898eaf INFO: 172.20.0.1:58738 - "POST /node/69cc22df8df9359ff4898eaf HTTP/1.0" 202 Accepted 2026-04-02 19:39:18,622 - lava_callback - INFO - Starting async job submit for node 69cc22df8df9359ff4898eaf 2026-04-02 19:39:18,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:39:18,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc22df8df9359ff4898eaf HTTP/1.1" 200 None 2026-04-02 19:39:18,638 - lava_callback - DEBUG - Processing node 69cc22df8df9359ff4898eaf: baseline-arm64-clabbe 2026-04-02 19:39:18,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc22df8df9359ff4898eaf 2026-04-02 19:39:18,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:39:18,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc22df8df9359ff4898eaf HTTP/1.1" 200 None 2026-04-02 19:39:18,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:39:18,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 19:39:18,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:39:18,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc22df8df9359ff4898eaf HTTP/1.1" 200 None 2026-04-02 19:39:18,699 - lava_callback - ERROR - Error processing callback for node 69cc22df8df9359ff4898eaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58984 - "GET /node/694b125b6c96ed51d3173e00%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59000 - "GET /node/6983124f409235c29c0de8fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58302 - "GET /node/693af87bfee8383e92b6c5e4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58318 - "GET /node/6982ada93507dcddca5909ea%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-02 19:40:58,704 - lava_callback - INFO - Received callback for node 69cc23398df9359ff4898edd INFO: 172.20.0.1:58330 - "POST /node/69cc23398df9359ff4898edd HTTP/1.0" 202 Accepted 2026-04-02 19:40:58,710 - lava_callback - INFO - Starting async job submit for node 69cc23398df9359ff4898edd 2026-04-02 19:40:58,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:40:58,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc23398df9359ff4898edd HTTP/1.1" 200 None 2026-04-02 19:40:58,726 - lava_callback - DEBUG - Processing node 69cc23398df9359ff4898edd: baseline-arm64-clabbe 2026-04-02 19:40:58,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc23398df9359ff4898edd 2026-04-02 19:40:58,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:40:58,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc23398df9359ff4898edd HTTP/1.1" 200 None 2026-04-02 19:40:58,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:40:58,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 19:40:58,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:40:58,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc23398df9359ff4898edd HTTP/1.1" 200 None 2026-04-02 19:40:58,805 - lava_callback - ERROR - Error processing callback for node 69cc23398df9359ff4898edd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50852 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:42:18,780 - lava_callback - INFO - Received callback for node 69cc23948df9359ff4898f00 INFO: 172.20.0.1:50856 - "POST /node/69cc23948df9359ff4898f00 HTTP/1.0" 202 Accepted 2026-04-02 19:42:18,786 - lava_callback - INFO - Starting async job submit for node 69cc23948df9359ff4898f00 2026-04-02 19:42:18,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:42:18,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc23948df9359ff4898f00 HTTP/1.1" 200 None 2026-04-02 19:42:18,802 - lava_callback - DEBUG - Processing node 69cc23948df9359ff4898f00: baseline-arm64-clabbe 2026-04-02 19:42:18,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc23948df9359ff4898f00 2026-04-02 19:42:18,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:42:18,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc23948df9359ff4898f00 HTTP/1.1" 200 None 2026-04-02 19:42:18,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:42:18,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 19:42:18,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:42:18,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc23948df9359ff4898f00 HTTP/1.1" 200 None 2026-04-02 19:42:18,855 - lava_callback - ERROR - Error processing callback for node 69cc23948df9359ff4898f00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43084 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:43:59,045 - lava_callback - INFO - Received callback for node 69cc23ee8df9359ff4898f2d INFO: 172.20.0.1:43086 - "POST /node/69cc23ee8df9359ff4898f2d HTTP/1.0" 202 Accepted 2026-04-02 19:43:59,051 - lava_callback - INFO - Starting async job submit for node 69cc23ee8df9359ff4898f2d 2026-04-02 19:43:59,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:43:59,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc23ee8df9359ff4898f2d HTTP/1.1" 200 None 2026-04-02 19:43:59,084 - lava_callback - DEBUG - Processing node 69cc23ee8df9359ff4898f2d: baseline-arm64-clabbe 2026-04-02 19:43:59,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc23ee8df9359ff4898f2d 2026-04-02 19:43:59,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:43:59,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc23ee8df9359ff4898f2d HTTP/1.1" 200 None 2026-04-02 19:43:59,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:43:59,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 19:43:59,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:43:59,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc23ee8df9359ff4898f2d HTTP/1.1" 200 None 2026-04-02 19:43:59,156 - lava_callback - ERROR - Error processing callback for node 69cc23ee8df9359ff4898f2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55272 - "GET /node/693b1ba315f407b7629e028d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55276 - "GET /node/697bff14670e2c0d3a09ffc6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56308 - "GET / HTTP/1.0" 200 OK 2026-04-02 19:45:18,885 - lava_callback - INFO - Received callback for node 69cc24478df9359ff4898f5a INFO: 172.20.0.1:56322 - "POST /node/69cc24478df9359ff4898f5a HTTP/1.0" 202 Accepted 2026-04-02 19:45:18,894 - lava_callback - INFO - Starting async job submit for node 69cc24478df9359ff4898f5a 2026-04-02 19:45:18,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:45:18,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc24478df9359ff4898f5a HTTP/1.1" 200 None 2026-04-02 19:45:18,913 - lava_callback - DEBUG - Processing node 69cc24478df9359ff4898f5a: baseline-arm64-clabbe 2026-04-02 19:45:18,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc24478df9359ff4898f5a 2026-04-02 19:45:18,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:45:18,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc24478df9359ff4898f5a HTTP/1.1" 200 None 2026-04-02 19:45:18,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:45:18,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 19:45:18,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 19:45:18,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc24478df9359ff4898f5a HTTP/1.1" 200 None 2026-04-02 19:45:18,978 - lava_callback - ERROR - Error processing callback for node 69cc24478df9359ff4898f5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49482 - "GET /node/698458513a8748f282084e0a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49488 - "GET /node/693b070cfee8383e92b70a6f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41944 - "GET /node/69c096c1ce0c9bc43bcce15c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38152 - "GET /node/6990b02cc45febfe44522a1b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38166 - "GET /node/693ae713fee8383e92b65023%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42560 - "GET /node/693b0818fee8383e92b711a3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42562 - "GET /node/694b04a56c96ed51d317375a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38796 - "GET /node/694a3fd82060d3d847922c2c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38800 - "GET /node/693fe083575bc060ce14e2a6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54012 - "GET /node/693f75210d8ce4018da93f18%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54020 - "GET /node/688caf8a262957198e43e512%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40812 - "GET /node/69870f9f6e077e4126a7eddc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47272 - "GET /node/698601c171989fb14149e057%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33746 - "GET /node/693a81a4e17cfbe560b12c8a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33778 - "GET /node/69c01cabc3d73288b0d07bd0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35122 - "GET /node/69903be6985e4efca431ded5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35128 - "GET /node/698195279daaa1363d8e50ca%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49298 - "GET /node/68826b4187dcced189497f13%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49312 - "GET /node/6988cb119fc35f969e1ef17d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55582 - "GET /node/69c1e3ca0efaf21d931060e5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55588 - "GET /node/699358b5523507f3806a9489%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41186 - "GET /node/6982ada73507dcddca5909de%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41194 - "GET /node/693f98630d8ce4018da98682%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57696 - "GET /node/69870f9e6e077e4126a7edcb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57708 - "GET /node/69b363e0974c91e64560edbf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33382 - "GET /node/693b03abfee8383e92b6f529%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46142 - "GET /node/693afa8cfee8383e92b6d1e5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42782 - "GET /node/69903653985e4efca431cb83%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42792 - "GET /node/69876c13e31b58f834f198df%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36750 - "GET /node/695307b09912bd6bbcea6f4a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36752 - "GET /node/699eb4918c247a4d4f281670%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45722 - "GET /node/693a39e078d7681e6b491a49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56180 - "GET /node/69934aea523507f3806a52b9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51436 - "GET /node/6940c1331e3c24e95681cae4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51446 - "GET /node/6988c2ce9fc35f969e1ee154%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43954 - "GET /node/699358f2523507f3806a955e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50082 - "GET /node/693afa67fee8383e92b6d154%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50088 - "GET /node/69871cd26e077e4126a7f572%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58554 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:39:00,563 - lava_callback - INFO - Received callback for node 69cc30de8df9359ff4898fd6 INFO: 172.20.0.1:52944 - "POST /node/69cc30de8df9359ff4898fd6 HTTP/1.0" 202 Accepted 2026-04-02 20:39:00,568 - lava_callback - INFO - Starting async job submit for node 69cc30de8df9359ff4898fd6 2026-04-02 20:39:00,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:39:00,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc30de8df9359ff4898fd6 HTTP/1.1" 200 None 2026-04-02 20:39:00,585 - lava_callback - DEBUG - Processing node 69cc30de8df9359ff4898fd6: baseline-arm-baylibre 2026-04-02 20:39:00,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc30de8df9359ff4898fd6 2026-04-02 20:39:00,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:39:00,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc30de8df9359ff4898fd6 HTTP/1.1" 200 None 2026-04-02 20:39:00,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:39:00,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:39:00,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:39:00,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc30de8df9359ff4898fd6 HTTP/1.1" 200 None 2026-04-02 20:39:00,667 - lava_callback - ERROR - Error processing callback for node 69cc30de8df9359ff4898fd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51522 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:40:40,588 - lava_callback - INFO - Received callback for node 69cc31338df9359ff4898ff9 INFO: 172.20.0.1:59768 - "POST /node/69cc31338df9359ff4898ff9 HTTP/1.0" 202 Accepted 2026-04-02 20:40:40,594 - lava_callback - INFO - Starting async job submit for node 69cc31338df9359ff4898ff9 2026-04-02 20:40:40,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:40:40,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc31338df9359ff4898ff9 HTTP/1.1" 200 None 2026-04-02 20:40:40,613 - lava_callback - DEBUG - Processing node 69cc31338df9359ff4898ff9: baseline-arm-baylibre 2026-04-02 20:40:40,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc31338df9359ff4898ff9 2026-04-02 20:40:40,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:40:40,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc31338df9359ff4898ff9 HTTP/1.1" 200 None 2026-04-02 20:40:40,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:40:40,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:40:40,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:40:40,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc31338df9359ff4898ff9 HTTP/1.1" 200 None 2026-04-02 20:40:40,684 - lava_callback - ERROR - Error processing callback for node 69cc31338df9359ff4898ff9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49578 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:41:20,619 - lava_callback - INFO - Received callback for node 69cc315e8df9359ff4899008 INFO: 172.20.0.1:50008 - "POST /node/69cc315e8df9359ff4899008 HTTP/1.0" 202 Accepted 2026-04-02 20:41:20,625 - lava_callback - INFO - Starting async job submit for node 69cc315e8df9359ff4899008 2026-04-02 20:41:20,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:41:20,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc315e8df9359ff4899008 HTTP/1.1" 200 None 2026-04-02 20:41:20,641 - lava_callback - DEBUG - Processing node 69cc315e8df9359ff4899008: baseline-arm-baylibre 2026-04-02 20:41:20,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc315e8df9359ff4899008 2026-04-02 20:41:20,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:41:20,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc315e8df9359ff4899008 HTTP/1.1" 200 None 2026-04-02 20:41:20,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:41:20,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:41:20,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:41:20,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc315e8df9359ff4899008 HTTP/1.1" 200 None 2026-04-02 20:41:20,713 - lava_callback - ERROR - Error processing callback for node 69cc315e8df9359ff4899008: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53684 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:42:40,714 - lava_callback - INFO - Received callback for node 69cc31b08df9359ff4899028 INFO: 172.20.0.1:50892 - "POST /node/69cc31b08df9359ff4899028 HTTP/1.0" 202 Accepted 2026-04-02 20:42:40,720 - lava_callback - INFO - Starting async job submit for node 69cc31b08df9359ff4899028 2026-04-02 20:42:40,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:42:40,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc31b08df9359ff4899028 HTTP/1.1" 200 None 2026-04-02 20:42:40,736 - lava_callback - DEBUG - Processing node 69cc31b08df9359ff4899028: baseline-arm-baylibre 2026-04-02 20:42:40,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc31b08df9359ff4899028 2026-04-02 20:42:40,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:42:40,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc31b08df9359ff4899028 HTTP/1.1" 200 None 2026-04-02 20:42:40,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:42:40,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:42:40,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:42:40,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc31b08df9359ff4899028 HTTP/1.1" 200 None 2026-04-02 20:42:40,800 - lava_callback - ERROR - Error processing callback for node 69cc31b08df9359ff4899028: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32940 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:43:20,725 - lava_callback - INFO - Received callback for node 69cc31db8df9359ff489903b INFO: 172.20.0.1:37212 - "POST /node/69cc31db8df9359ff489903b HTTP/1.0" 202 Accepted 2026-04-02 20:43:20,731 - lava_callback - INFO - Starting async job submit for node 69cc31db8df9359ff489903b 2026-04-02 20:43:20,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:43:20,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc31db8df9359ff489903b HTTP/1.1" 200 None 2026-04-02 20:43:20,746 - lava_callback - DEBUG - Processing node 69cc31db8df9359ff489903b: baseline-arm-baylibre 2026-04-02 20:43:20,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc31db8df9359ff489903b 2026-04-02 20:43:20,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:43:20,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc31db8df9359ff489903b HTTP/1.1" 200 None 2026-04-02 20:43:20,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:43:20,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:43:20,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:43:20,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc31db8df9359ff489903b HTTP/1.1" 200 None 2026-04-02 20:43:20,799 - lava_callback - ERROR - Error processing callback for node 69cc31db8df9359ff489903b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49096 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:44:00,785 - lava_callback - INFO - Received callback for node 69cc32058df9359ff4899043 INFO: 172.20.0.1:48794 - "POST /node/69cc32058df9359ff4899043 HTTP/1.0" 202 Accepted 2026-04-02 20:44:00,791 - lava_callback - INFO - Starting async job submit for node 69cc32058df9359ff4899043 2026-04-02 20:44:00,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:44:00,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc32058df9359ff4899043 HTTP/1.1" 200 None 2026-04-02 20:44:00,807 - lava_callback - DEBUG - Processing node 69cc32058df9359ff4899043: baseline-arm-baylibre 2026-04-02 20:44:00,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc32058df9359ff4899043 2026-04-02 20:44:00,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:44:00,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc32058df9359ff4899043 HTTP/1.1" 200 None 2026-04-02 20:44:00,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:44:00,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:44:00,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:44:00,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc32058df9359ff4899043 HTTP/1.1" 200 None 2026-04-02 20:44:00,882 - lava_callback - ERROR - Error processing callback for node 69cc32058df9359ff4899043: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40394 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:44:40,927 - lava_callback - INFO - Received callback for node 69cc32308df9359ff4899055 INFO: 172.20.0.1:59298 - "POST /node/69cc32308df9359ff4899055 HTTP/1.0" 202 Accepted 2026-04-02 20:44:40,932 - lava_callback - INFO - Starting async job submit for node 69cc32308df9359ff4899055 2026-04-02 20:44:40,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:59306 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:44:40,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc32308df9359ff4899055 HTTP/1.1" 200 None 2026-04-02 20:44:40,953 - lava_callback - DEBUG - Processing node 69cc32308df9359ff4899055: baseline-arm-baylibre 2026-04-02 20:44:40,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc32308df9359ff4899055 2026-04-02 20:44:40,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:44:40,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc32308df9359ff4899055 HTTP/1.1" 200 None 2026-04-02 20:44:40,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:44:40,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:44:40,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:44:41,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc32308df9359ff4899055 HTTP/1.1" 200 None 2026-04-02 20:44:41,014 - lava_callback - ERROR - Error processing callback for node 69cc32308df9359ff4899055: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58330 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:45:20,922 - lava_callback - INFO - Received callback for node 69cc325e8df9359ff4899064 INFO: 172.20.0.1:40312 - "POST /node/69cc325e8df9359ff4899064 HTTP/1.0" 202 Accepted 2026-04-02 20:45:20,928 - lava_callback - INFO - Starting async job submit for node 69cc325e8df9359ff4899064 2026-04-02 20:45:20,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:45:20,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc325e8df9359ff4899064 HTTP/1.1" 200 None 2026-04-02 20:45:20,945 - lava_callback - DEBUG - Processing node 69cc325e8df9359ff4899064: baseline-arm-baylibre 2026-04-02 20:45:20,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc325e8df9359ff4899064 2026-04-02 20:45:20,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:45:20,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc325e8df9359ff4899064 HTTP/1.1" 200 None 2026-04-02 20:45:20,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:45:20,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:45:20,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:45:20,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc325e8df9359ff4899064 HTTP/1.1" 200 None 2026-04-02 20:45:21,004 - lava_callback - ERROR - Error processing callback for node 69cc325e8df9359ff4899064: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32888 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:46:20,904 - lava_callback - INFO - Received callback for node 69cc32888df9359ff4899078 INFO: 172.20.0.1:58906 - "POST /node/69cc32888df9359ff4899078 HTTP/1.0" 202 Accepted 2026-04-02 20:46:20,909 - lava_callback - INFO - Starting async job submit for node 69cc32888df9359ff4899078 2026-04-02 20:46:20,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:46:20,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc32888df9359ff4899078 HTTP/1.1" 200 None 2026-04-02 20:46:20,935 - lava_callback - DEBUG - Processing node 69cc32888df9359ff4899078: baseline-arm-baylibre 2026-04-02 20:46:20,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc32888df9359ff4899078 2026-04-02 20:46:20,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:46:20,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc32888df9359ff4899078 HTTP/1.1" 200 None 2026-04-02 20:46:20,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:46:20,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:46:20,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:46:20,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc32888df9359ff4899078 HTTP/1.1" 200 None 2026-04-02 20:46:20,989 - lava_callback - ERROR - Error processing callback for node 69cc32888df9359ff4899078: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60118 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:47:40,991 - lava_callback - INFO - Received callback for node 69cc32e28df9359ff4899096 INFO: 172.20.0.1:60124 - "POST /node/69cc32e28df9359ff4899096 HTTP/1.0" 202 Accepted 2026-04-02 20:47:40,997 - lava_callback - INFO - Starting async job submit for node 69cc32e28df9359ff4899096 2026-04-02 20:47:40,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:47:41,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc32e28df9359ff4899096 HTTP/1.1" 200 None 2026-04-02 20:47:41,013 - lava_callback - DEBUG - Processing node 69cc32e28df9359ff4899096: baseline-arm-baylibre 2026-04-02 20:47:41,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc32e28df9359ff4899096 2026-04-02 20:47:41,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:47:41,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc32e28df9359ff4899096 HTTP/1.1" 200 None 2026-04-02 20:47:41,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:47:41,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:47:41,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:47:41,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc32e28df9359ff4899096 HTTP/1.1" 200 None 2026-04-02 20:47:41,073 - lava_callback - ERROR - Error processing callback for node 69cc32e28df9359ff4899096: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50132 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:48:21,040 - lava_callback - INFO - Received callback for node 69cc330c8df9359ff48990aa INFO: 172.20.0.1:54666 - "POST /node/69cc330c8df9359ff48990aa HTTP/1.0" 202 Accepted 2026-04-02 20:48:21,046 - lava_callback - INFO - Starting async job submit for node 69cc330c8df9359ff48990aa 2026-04-02 20:48:21,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:48:21,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc330c8df9359ff48990aa HTTP/1.1" 200 None 2026-04-02 20:48:21,069 - lava_callback - DEBUG - Processing node 69cc330c8df9359ff48990aa: baseline-arm-baylibre 2026-04-02 20:48:21,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc330c8df9359ff48990aa 2026-04-02 20:48:21,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:48:21,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc330c8df9359ff48990aa HTTP/1.1" 200 None 2026-04-02 20:48:21,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:48:21,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:48:21,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:48:21,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc330c8df9359ff48990aa HTTP/1.1" 200 None 2026-04-02 20:48:21,138 - lava_callback - ERROR - Error processing callback for node 69cc330c8df9359ff48990aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40510 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:50:41,552 - lava_callback - INFO - Received callback for node 69cc338e8df9359ff48990d9 INFO: 172.20.0.1:40516 - "POST /node/69cc338e8df9359ff48990d9 HTTP/1.0" 202 Accepted 2026-04-02 20:50:41,558 - lava_callback - INFO - Starting async job submit for node 69cc338e8df9359ff48990d9 2026-04-02 20:50:41,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:50:41,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc338e8df9359ff48990d9 HTTP/1.1" 200 None 2026-04-02 20:50:41,574 - lava_callback - DEBUG - Processing node 69cc338e8df9359ff48990d9: baseline-arm-clabbe 2026-04-02 20:50:41,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc338e8df9359ff48990d9 2026-04-02 20:50:41,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:50:41,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc338e8df9359ff48990d9 HTTP/1.1" 200 None 2026-04-02 20:50:41,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:50:41,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:50:41,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:50:41,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc338e8df9359ff48990d9 HTTP/1.1" 200 None 2026-04-02 20:50:41,631 - lava_callback - ERROR - Error processing callback for node 69cc338e8df9359ff48990d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54192 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:51:21,555 - lava_callback - INFO - Received callback for node 69cc33ba8df9359ff48990e9 INFO: 172.20.0.1:57030 - "POST /node/69cc33ba8df9359ff48990e9 HTTP/1.0" 202 Accepted 2026-04-02 20:51:21,560 - lava_callback - INFO - Starting async job submit for node 69cc33ba8df9359ff48990e9 2026-04-02 20:51:21,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:51:21,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc33ba8df9359ff48990e9 HTTP/1.1" 200 None 2026-04-02 20:51:21,582 - lava_callback - DEBUG - Processing node 69cc33ba8df9359ff48990e9: baseline-arm-clabbe 2026-04-02 20:51:21,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc33ba8df9359ff48990e9 2026-04-02 20:51:21,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:51:21,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc33ba8df9359ff48990e9 HTTP/1.1" 200 None 2026-04-02 20:51:21,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:51:21,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:51:21,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:51:21,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc33ba8df9359ff48990e9 HTTP/1.1" 200 None 2026-04-02 20:51:21,640 - lava_callback - ERROR - Error processing callback for node 69cc33ba8df9359ff48990e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60758 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:52:01,619 - lava_callback - INFO - Received callback for node 69cc33e68df9359ff48990f4 INFO: 172.20.0.1:58804 - "POST /node/69cc33e68df9359ff48990f4 HTTP/1.0" 202 Accepted 2026-04-02 20:52:01,625 - lava_callback - INFO - Starting async job submit for node 69cc33e68df9359ff48990f4 2026-04-02 20:52:01,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:52:01,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc33e68df9359ff48990f4 HTTP/1.1" 200 None 2026-04-02 20:52:01,641 - lava_callback - DEBUG - Processing node 69cc33e68df9359ff48990f4: baseline-arm-clabbe 2026-04-02 20:52:01,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc33e68df9359ff48990f4 2026-04-02 20:52:01,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:52:01,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc33e68df9359ff48990f4 HTTP/1.1" 200 None 2026-04-02 20:52:01,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:52:01,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:52:01,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:52:01,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc33e68df9359ff48990f4 HTTP/1.1" 200 None 2026-04-02 20:52:01,693 - lava_callback - ERROR - Error processing callback for node 69cc33e68df9359ff48990f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48412 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:52:41,579 - lava_callback - INFO - Received callback for node 69cc34128df9359ff4899104 INFO: 172.20.0.1:48416 - "POST /node/69cc34128df9359ff4899104 HTTP/1.0" 202 Accepted 2026-04-02 20:52:41,585 - lava_callback - INFO - Starting async job submit for node 69cc34128df9359ff4899104 2026-04-02 20:52:41,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:52:41,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34128df9359ff4899104 HTTP/1.1" 200 None 2026-04-02 20:52:41,602 - lava_callback - DEBUG - Processing node 69cc34128df9359ff4899104: baseline-arm-clabbe 2026-04-02 20:52:41,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc34128df9359ff4899104 2026-04-02 20:52:41,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:52:41,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34128df9359ff4899104 HTTP/1.1" 200 None 2026-04-02 20:52:41,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:52:41,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:52:41,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:52:41,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc34128df9359ff4899104 HTTP/1.1" 200 None 2026-04-02 20:52:41,663 - lava_callback - ERROR - Error processing callback for node 69cc34128df9359ff4899104: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36468 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:53:21,695 - lava_callback - INFO - Received callback for node 69cc343c8df9359ff4899114 INFO: 172.20.0.1:42814 - "POST /node/69cc343c8df9359ff4899114 HTTP/1.0" 202 Accepted 2026-04-02 20:53:21,701 - lava_callback - INFO - Starting async job submit for node 69cc343c8df9359ff4899114 2026-04-02 20:53:21,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:53:21,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc343c8df9359ff4899114 HTTP/1.1" 200 None 2026-04-02 20:53:21,716 - lava_callback - DEBUG - Processing node 69cc343c8df9359ff4899114: baseline-arm-clabbe 2026-04-02 20:53:21,717 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc343c8df9359ff4899114 2026-04-02 20:53:21,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:53:21,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc343c8df9359ff4899114 HTTP/1.1" 200 None 2026-04-02 20:53:21,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:53:21,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:53:21,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:53:21,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc343c8df9359ff4899114 HTTP/1.1" 200 None 2026-04-02 20:53:21,777 - lava_callback - ERROR - Error processing callback for node 69cc343c8df9359ff4899114: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38612 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:54:01,634 - lava_callback - INFO - Received callback for node 69cc34678df9359ff489911f INFO: 172.20.0.1:48664 - "POST /node/69cc34678df9359ff489911f HTTP/1.0" 202 Accepted 2026-04-02 20:54:01,641 - lava_callback - INFO - Starting async job submit for node 69cc34678df9359ff489911f 2026-04-02 20:54:01,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:54:01,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34678df9359ff489911f HTTP/1.1" 200 None 2026-04-02 20:54:01,658 - lava_callback - DEBUG - Processing node 69cc34678df9359ff489911f: baseline-arm-clabbe 2026-04-02 20:54:01,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc34678df9359ff489911f 2026-04-02 20:54:01,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:54:01,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34678df9359ff489911f HTTP/1.1" 200 None 2026-04-02 20:54:01,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:54:01,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:54:01,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:54:01,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc34678df9359ff489911f HTTP/1.1" 200 None 2026-04-02 20:54:01,729 - lava_callback - ERROR - Error processing callback for node 69cc34678df9359ff489911f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45782 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:55:01,746 - lava_callback - INFO - Received callback for node 69cc34938df9359ff489912a INFO: 172.20.0.1:43126 - "POST /node/69cc34938df9359ff489912a HTTP/1.0" 202 Accepted 2026-04-02 20:55:01,752 - lava_callback - INFO - Starting async job submit for node 69cc34938df9359ff489912a 2026-04-02 20:55:01,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:55:01,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34938df9359ff489912a HTTP/1.1" 200 None 2026-04-02 20:55:01,768 - lava_callback - DEBUG - Processing node 69cc34938df9359ff489912a: baseline-arm-clabbe 2026-04-02 20:55:01,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc34938df9359ff489912a 2026-04-02 20:55:01,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:55:01,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34938df9359ff489912a HTTP/1.1" 200 None 2026-04-02 20:55:01,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:55:01,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:55:01,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:55:01,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc34938df9359ff489912a HTTP/1.1" 200 None 2026-04-02 20:55:01,826 - lava_callback - ERROR - Error processing callback for node 69cc34938df9359ff489912a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55182 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:55:41,739 - lava_callback - INFO - Received callback for node 69cc34be8df9359ff4899139 INFO: 172.20.0.1:55184 - "POST /node/69cc34be8df9359ff4899139 HTTP/1.0" 202 Accepted 2026-04-02 20:55:41,745 - lava_callback - INFO - Starting async job submit for node 69cc34be8df9359ff4899139 2026-04-02 20:55:41,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:55:41,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34be8df9359ff4899139 HTTP/1.1" 200 None 2026-04-02 20:55:41,761 - lava_callback - DEBUG - Processing node 69cc34be8df9359ff4899139: baseline-arm-clabbe 2026-04-02 20:55:41,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc34be8df9359ff4899139 2026-04-02 20:55:41,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:55:41,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34be8df9359ff4899139 HTTP/1.1" 200 None 2026-04-02 20:55:41,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:55:41,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 20:55:41,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:55:41,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc34be8df9359ff4899139 HTTP/1.1" 200 None 2026-04-02 20:55:41,822 - lava_callback - ERROR - Error processing callback for node 69cc34be8df9359ff4899139: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:56:21,828 - lava_callback - INFO - Received callback for node 69cc34e88df9359ff4899148 INFO: 172.20.0.1:46648 - "POST /node/69cc34e88df9359ff4899148 HTTP/1.0" 202 Accepted 2026-04-02 20:56:21,834 - lava_callback - INFO - Starting async job submit for node 69cc34e88df9359ff4899148 2026-04-02 20:56:21,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:56:21,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34e88df9359ff4899148 HTTP/1.1" 200 None 2026-04-02 20:56:21,854 - lava_callback - DEBUG - Processing node 69cc34e88df9359ff4899148: baseline-arm-clabbe 2026-04-02 20:56:21,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc34e88df9359ff4899148 2026-04-02 20:56:21,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:56:21,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc34e88df9359ff4899148 HTTP/1.1" 200 None 2026-04-02 20:56:21,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:56:21,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:56:21,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:56:21,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc34e88df9359ff4899148 HTTP/1.1" 200 None 2026-04-02 20:56:21,911 - lava_callback - ERROR - Error processing callback for node 69cc34e88df9359ff4899148: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58732 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:57:01,871 - lava_callback - INFO - Received callback for node 69cc350c8df9359ff4899150 INFO: 172.20.0.1:57858 - "POST /node/69cc350c8df9359ff4899150 HTTP/1.0" 202 Accepted 2026-04-02 20:57:01,877 - lava_callback - INFO - Starting async job submit for node 69cc350c8df9359ff4899150 2026-04-02 20:57:01,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:57:01,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc350c8df9359ff4899150 HTTP/1.1" 200 None 2026-04-02 20:57:01,893 - lava_callback - DEBUG - Processing node 69cc350c8df9359ff4899150: baseline-arm-baylibre 2026-04-02 20:57:01,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc350c8df9359ff4899150 2026-04-02 20:57:01,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:57:01,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc350c8df9359ff4899150 HTTP/1.1" 200 None 2026-04-02 20:57:01,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:57:01,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:57:01,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:57:01,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc350c8df9359ff4899150 HTTP/1.1" 200 None 2026-04-02 20:57:01,946 - lava_callback - ERROR - Error processing callback for node 69cc350c8df9359ff4899150: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45038 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:57:41,866 - lava_callback - INFO - Received callback for node 69cc35408df9359ff4899160 INFO: 172.20.0.1:45040 - "POST /node/69cc35408df9359ff4899160 HTTP/1.0" 202 Accepted 2026-04-02 20:57:41,876 - lava_callback - INFO - Starting async job submit for node 69cc35408df9359ff4899160 2026-04-02 20:57:41,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:57:41,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35408df9359ff4899160 HTTP/1.1" 200 None 2026-04-02 20:57:41,895 - lava_callback - DEBUG - Processing node 69cc35408df9359ff4899160: baseline-arm-clabbe 2026-04-02 20:57:41,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc35408df9359ff4899160 2026-04-02 20:57:41,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:57:41,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35408df9359ff4899160 HTTP/1.1" 200 None 2026-04-02 20:57:41,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:57:41,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:57:41,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:57:41,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc35408df9359ff4899160 HTTP/1.1" 200 None 2026-04-02 20:57:41,958 - lava_callback - ERROR - Error processing callback for node 69cc35408df9359ff4899160: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41010 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:58:21,949 - lava_callback - INFO - Received callback for node 69cc35678df9359ff489916e INFO: 172.20.0.1:33968 - "POST /node/69cc35678df9359ff489916e HTTP/1.0" 202 Accepted 2026-04-02 20:58:21,954 - lava_callback - INFO - Starting async job submit for node 69cc35678df9359ff489916e 2026-04-02 20:58:21,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:58:21,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35678df9359ff489916e HTTP/1.1" 200 None 2026-04-02 20:58:21,971 - lava_callback - DEBUG - Processing node 69cc35678df9359ff489916e: baseline-arm-baylibre 2026-04-02 20:58:21,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc35678df9359ff489916e 2026-04-02 20:58:21,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:58:21,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35678df9359ff489916e HTTP/1.1" 200 None 2026-04-02 20:58:21,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:58:21,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:58:22,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:58:22,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc35678df9359ff489916e HTTP/1.1" 200 None 2026-04-02 20:58:22,022 - lava_callback - ERROR - Error processing callback for node 69cc35678df9359ff489916e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49390 - "GET / HTTP/1.0" 200 OK 2026-04-02 20:59:01,566 - lava_callback - INFO - Received callback for node 69cc35928df9359ff489917c INFO: 172.20.0.1:39978 - "POST /node/69cc35928df9359ff489917c HTTP/1.0" 202 Accepted 2026-04-02 20:59:01,572 - lava_callback - INFO - Starting async job submit for node 69cc35928df9359ff489917c 2026-04-02 20:59:01,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:59:01,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35928df9359ff489917c HTTP/1.1" 200 None 2026-04-02 20:59:01,588 - lava_callback - DEBUG - Processing node 69cc35928df9359ff489917c: baseline-arm-baylibre 2026-04-02 20:59:01,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc35928df9359ff489917c 2026-04-02 20:59:01,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:59:01,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35928df9359ff489917c HTTP/1.1" 200 None 2026-04-02 20:59:01,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:59:01,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 20:59:01,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 20:59:01,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc35928df9359ff489917c HTTP/1.1" 200 None 2026-04-02 20:59:01,642 - lava_callback - ERROR - Error processing callback for node 69cc35928df9359ff489917c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51606 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:00:01,634 - lava_callback - INFO - Received callback for node 69cc35bc8df9359ff489918a INFO: 172.20.0.1:58110 - "POST /node/69cc35bc8df9359ff489918a HTTP/1.0" 202 Accepted 2026-04-02 21:00:01,640 - lava_callback - INFO - Starting async job submit for node 69cc35bc8df9359ff489918a 2026-04-02 21:00:01,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:00:01,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35bc8df9359ff489918a HTTP/1.1" 200 None 2026-04-02 21:00:01,657 - lava_callback - DEBUG - Processing node 69cc35bc8df9359ff489918a: baseline-arm-baylibre 2026-04-02 21:00:01,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc35bc8df9359ff489918a 2026-04-02 21:00:01,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:00:01,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35bc8df9359ff489918a HTTP/1.1" 200 None 2026-04-02 21:00:01,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:00:01,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:00:01,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:00:01,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc35bc8df9359ff489918a HTTP/1.1" 200 None 2026-04-02 21:00:01,718 - lava_callback - ERROR - Error processing callback for node 69cc35bc8df9359ff489918a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58250 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:00:41,634 - lava_callback - INFO - Received callback for node 69cc35e88df9359ff4899199 INFO: 172.20.0.1:58262 - "POST /node/69cc35e88df9359ff4899199 HTTP/1.0" 202 Accepted 2026-04-02 21:00:41,639 - lava_callback - INFO - Starting async job submit for node 69cc35e88df9359ff4899199 2026-04-02 21:00:41,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:00:41,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35e88df9359ff4899199 HTTP/1.1" 200 None 2026-04-02 21:00:41,655 - lava_callback - DEBUG - Processing node 69cc35e88df9359ff4899199: baseline-arm-baylibre 2026-04-02 21:00:41,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc35e88df9359ff4899199 2026-04-02 21:00:41,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:00:41,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc35e88df9359ff4899199 HTTP/1.1" 200 None 2026-04-02 21:00:41,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:00:41,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:00:41,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:00:41,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc35e88df9359ff4899199 HTTP/1.1" 200 None 2026-04-02 21:00:41,719 - lava_callback - ERROR - Error processing callback for node 69cc35e88df9359ff4899199: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35512 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:01:21,838 - lava_callback - INFO - Received callback for node 69cc36128df9359ff48991a8 INFO: 172.20.0.1:42444 - "POST /node/69cc36128df9359ff48991a8 HTTP/1.0" 202 Accepted 2026-04-02 21:01:21,843 - lava_callback - INFO - Starting async job submit for node 69cc36128df9359ff48991a8 2026-04-02 21:01:21,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:01:21,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36128df9359ff48991a8 HTTP/1.1" 200 None 2026-04-02 21:01:21,867 - lava_callback - DEBUG - Processing node 69cc36128df9359ff48991a8: baseline-arm-baylibre 2026-04-02 21:01:21,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc36128df9359ff48991a8 2026-04-02 21:01:21,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:01:21,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36128df9359ff48991a8 HTTP/1.1" 200 None 2026-04-02 21:01:21,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:01:21,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:01:21,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:01:21,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc36128df9359ff48991a8 HTTP/1.1" 200 None 2026-04-02 21:01:21,926 - lava_callback - ERROR - Error processing callback for node 69cc36128df9359ff48991a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51750 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:02:01,755 - lava_callback - INFO - Received callback for node 69cc36408df9359ff48991b2 INFO: 172.20.0.1:60982 - "POST /node/69cc36408df9359ff48991b2 HTTP/1.0" 202 Accepted 2026-04-02 21:02:01,761 - lava_callback - INFO - Starting async job submit for node 69cc36408df9359ff48991b2 2026-04-02 21:02:01,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:02:01,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36408df9359ff48991b2 HTTP/1.1" 200 None 2026-04-02 21:02:01,777 - lava_callback - DEBUG - Processing node 69cc36408df9359ff48991b2: baseline-arm-baylibre 2026-04-02 21:02:01,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc36408df9359ff48991b2 2026-04-02 21:02:01,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:02:01,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36408df9359ff48991b2 HTTP/1.1" 200 None 2026-04-02 21:02:01,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:02:01,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:02:01,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:02:01,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc36408df9359ff48991b2 HTTP/1.1" 200 None 2026-04-02 21:02:01,840 - lava_callback - ERROR - Error processing callback for node 69cc36408df9359ff48991b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59182 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:02:42,143 - lava_callback - INFO - Received callback for node 69cc366e8df9359ff48991c5 INFO: 172.20.0.1:59190 - "POST /node/69cc366e8df9359ff48991c5 HTTP/1.0" 202 Accepted 2026-04-02 21:02:42,148 - lava_callback - INFO - Starting async job submit for node 69cc366e8df9359ff48991c5 2026-04-02 21:02:42,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:02:42,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc366e8df9359ff48991c5 HTTP/1.1" 200 None 2026-04-02 21:02:42,165 - lava_callback - DEBUG - Processing node 69cc366e8df9359ff48991c5: baseline-arm-clabbe 2026-04-02 21:02:42,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc366e8df9359ff48991c5 2026-04-02 21:02:42,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:02:42,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc366e8df9359ff48991c5 HTTP/1.1" 200 None 2026-04-02 21:02:42,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:02:42,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:02:42,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:02:42,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc366e8df9359ff48991c5 HTTP/1.1" 200 None 2026-04-02 21:02:42,231 - lava_callback - ERROR - Error processing callback for node 69cc366e8df9359ff48991c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45390 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:03:42,217 - lava_callback - INFO - Received callback for node 69cc36998df9359ff48991cf INFO: 172.20.0.1:45392 - "POST /node/69cc36998df9359ff48991cf HTTP/1.0" 202 Accepted 2026-04-02 21:03:42,222 - lava_callback - INFO - Starting async job submit for node 69cc36998df9359ff48991cf 2026-04-02 21:03:42,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:03:42,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36998df9359ff48991cf HTTP/1.1" 200 None 2026-04-02 21:03:42,238 - lava_callback - DEBUG - Processing node 69cc36998df9359ff48991cf: baseline-arm-clabbe 2026-04-02 21:03:42,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc36998df9359ff48991cf 2026-04-02 21:03:42,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:03:42,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36998df9359ff48991cf HTTP/1.1" 200 None 2026-04-02 21:03:42,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:03:42,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:03:42,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:03:42,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc36998df9359ff48991cf HTTP/1.1" 200 None 2026-04-02 21:03:42,295 - lava_callback - ERROR - Error processing callback for node 69cc36998df9359ff48991cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60466 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:04:22,152 - lava_callback - INFO - Received callback for node 69cc36c38df9359ff48991de INFO: 172.20.0.1:58466 - "POST /node/69cc36c38df9359ff48991de HTTP/1.0" 202 Accepted 2026-04-02 21:04:22,158 - lava_callback - INFO - Starting async job submit for node 69cc36c38df9359ff48991de 2026-04-02 21:04:22,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:04:22,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36c38df9359ff48991de HTTP/1.1" 200 None 2026-04-02 21:04:22,181 - lava_callback - DEBUG - Processing node 69cc36c38df9359ff48991de: baseline-arm-clabbe 2026-04-02 21:04:22,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc36c38df9359ff48991de 2026-04-02 21:04:22,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:04:22,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36c38df9359ff48991de HTTP/1.1" 200 None 2026-04-02 21:04:22,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:04:22,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:04:22,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:04:22,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc36c38df9359ff48991de HTTP/1.1" 200 None 2026-04-02 21:04:22,264 - lava_callback - ERROR - Error processing callback for node 69cc36c38df9359ff48991de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56222 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:05:01,980 - lava_callback - INFO - Received callback for node 69cc36ea8df9359ff48991eb INFO: 172.20.0.1:33478 - "POST /node/69cc36ea8df9359ff48991eb HTTP/1.0" 202 Accepted 2026-04-02 21:05:01,986 - lava_callback - INFO - Starting async job submit for node 69cc36ea8df9359ff48991eb 2026-04-02 21:05:01,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:05:02,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36ea8df9359ff48991eb HTTP/1.1" 200 None 2026-04-02 21:05:02,002 - lava_callback - DEBUG - Processing node 69cc36ea8df9359ff48991eb: baseline-arm-baylibre 2026-04-02 21:05:02,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc36ea8df9359ff48991eb 2026-04-02 21:05:02,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:05:02,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc36ea8df9359ff48991eb HTTP/1.1" 200 None 2026-04-02 21:05:02,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:05:02,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:05:02,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:05:02,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc36ea8df9359ff48991eb HTTP/1.1" 200 None 2026-04-02 21:05:02,069 - lava_callback - ERROR - Error processing callback for node 69cc36ea8df9359ff48991eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53188 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:05:42,258 - lava_callback - INFO - Received callback for node 69cc37188df9359ff48991f6 INFO: 172.20.0.1:53194 - "POST /node/69cc37188df9359ff48991f6 HTTP/1.0" 202 Accepted 2026-04-02 21:05:42,264 - lava_callback - INFO - Starting async job submit for node 69cc37188df9359ff48991f6 2026-04-02 21:05:42,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:05:42,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37188df9359ff48991f6 HTTP/1.1" 200 None 2026-04-02 21:05:42,280 - lava_callback - DEBUG - Processing node 69cc37188df9359ff48991f6: baseline-arm-clabbe 2026-04-02 21:05:42,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc37188df9359ff48991f6 2026-04-02 21:05:42,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:05:42,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37188df9359ff48991f6 HTTP/1.1" 200 None 2026-04-02 21:05:42,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:05:42,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:05:42,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:05:42,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc37188df9359ff48991f6 HTTP/1.1" 200 None 2026-04-02 21:05:42,332 - lava_callback - ERROR - Error processing callback for node 69cc37188df9359ff48991f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33656 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:06:22,270 - lava_callback - INFO - Received callback for node 69cc37428df9359ff4899208 INFO: 172.20.0.1:55012 - "POST /node/69cc37428df9359ff4899208 HTTP/1.0" 202 Accepted 2026-04-02 21:06:22,276 - lava_callback - INFO - Starting async job submit for node 69cc37428df9359ff4899208 2026-04-02 21:06:22,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:06:22,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37428df9359ff4899208 HTTP/1.1" 200 None 2026-04-02 21:06:22,302 - lava_callback - DEBUG - Processing node 69cc37428df9359ff4899208: baseline-arm-clabbe 2026-04-02 21:06:22,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc37428df9359ff4899208 2026-04-02 21:06:22,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:06:22,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37428df9359ff4899208 HTTP/1.1" 200 None 2026-04-02 21:06:22,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:06:22,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:06:22,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:06:22,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc37428df9359ff4899208 HTTP/1.1" 200 None 2026-04-02 21:06:22,353 - lava_callback - ERROR - Error processing callback for node 69cc37428df9359ff4899208: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57804 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:07:02,373 - lava_callback - INFO - Received callback for node 69cc376c8df9359ff4899210 INFO: 172.20.0.1:36268 - "POST /node/69cc376c8df9359ff4899210 HTTP/1.0" 202 Accepted 2026-04-02 21:07:02,379 - lava_callback - INFO - Starting async job submit for node 69cc376c8df9359ff4899210 2026-04-02 21:07:02,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:07:02,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc376c8df9359ff4899210 HTTP/1.1" 200 None 2026-04-02 21:07:02,398 - lava_callback - DEBUG - Processing node 69cc376c8df9359ff4899210: baseline-arm-clabbe 2026-04-02 21:07:02,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc376c8df9359ff4899210 2026-04-02 21:07:02,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:07:02,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc376c8df9359ff4899210 HTTP/1.1" 200 None 2026-04-02 21:07:02,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:07:02,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:07:02,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:07:02,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc376c8df9359ff4899210 HTTP/1.1" 200 None 2026-04-02 21:07:02,478 - lava_callback - ERROR - Error processing callback for node 69cc376c8df9359ff4899210: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52130 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:07:42,330 - lava_callback - INFO - Received callback for node 69cc37988df9359ff489921d INFO: 172.20.0.1:52144 - "POST /node/69cc37988df9359ff489921d HTTP/1.0" 202 Accepted 2026-04-02 21:07:42,336 - lava_callback - INFO - Starting async job submit for node 69cc37988df9359ff489921d 2026-04-02 21:07:42,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:07:42,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37988df9359ff489921d HTTP/1.1" 200 None 2026-04-02 21:07:42,351 - lava_callback - DEBUG - Processing node 69cc37988df9359ff489921d: baseline-arm-clabbe 2026-04-02 21:07:42,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc37988df9359ff489921d 2026-04-02 21:07:42,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:07:42,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37988df9359ff489921d HTTP/1.1" 200 None 2026-04-02 21:07:42,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:07:42,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:07:42,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:07:42,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc37988df9359ff489921d HTTP/1.1" 200 None 2026-04-02 21:07:42,416 - lava_callback - ERROR - Error processing callback for node 69cc37988df9359ff489921d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:08:42,405 - lava_callback - INFO - Received callback for node 69cc37c48df9359ff489922b INFO: 172.20.0.1:41848 - "POST /node/69cc37c48df9359ff489922b HTTP/1.0" 202 Accepted 2026-04-02 21:08:42,411 - lava_callback - INFO - Starting async job submit for node 69cc37c48df9359ff489922b 2026-04-02 21:08:42,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:08:42,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37c48df9359ff489922b HTTP/1.1" 200 None 2026-04-02 21:08:42,433 - lava_callback - DEBUG - Processing node 69cc37c48df9359ff489922b: baseline-arm-clabbe 2026-04-02 21:08:42,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc37c48df9359ff489922b 2026-04-02 21:08:42,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:08:42,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37c48df9359ff489922b HTTP/1.1" 200 None 2026-04-02 21:08:42,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:08:42,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:08:42,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:08:42,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc37c48df9359ff489922b HTTP/1.1" 200 None 2026-04-02 21:08:42,523 - lava_callback - ERROR - Error processing callback for node 69cc37c48df9359ff489922b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37518 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:09:22,385 - lava_callback - INFO - Received callback for node 69cc37ee8df9359ff4899239 INFO: 172.20.0.1:55760 - "POST /node/69cc37ee8df9359ff4899239 HTTP/1.0" 202 Accepted 2026-04-02 21:09:22,390 - lava_callback - INFO - Starting async job submit for node 69cc37ee8df9359ff4899239 2026-04-02 21:09:22,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:09:22,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37ee8df9359ff4899239 HTTP/1.1" 200 None 2026-04-02 21:09:22,413 - lava_callback - DEBUG - Processing node 69cc37ee8df9359ff4899239: baseline-arm-clabbe 2026-04-02 21:09:22,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc37ee8df9359ff4899239 2026-04-02 21:09:22,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:09:22,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc37ee8df9359ff4899239 HTTP/1.1" 200 None 2026-04-02 21:09:22,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:09:22,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:09:22,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:09:22,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc37ee8df9359ff4899239 HTTP/1.1" 200 None 2026-04-02 21:09:22,491 - lava_callback - ERROR - Error processing callback for node 69cc37ee8df9359ff4899239: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33496 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:10:02,485 - lava_callback - INFO - Received callback for node 69cc38198df9359ff4899246 INFO: 172.20.0.1:51194 - "POST /node/69cc38198df9359ff4899246 HTTP/1.0" 202 Accepted 2026-04-02 21:10:02,491 - lava_callback - INFO - Starting async job submit for node 69cc38198df9359ff4899246 2026-04-02 21:10:02,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:10:02,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc38198df9359ff4899246 HTTP/1.1" 200 None 2026-04-02 21:10:02,534 - lava_callback - DEBUG - Processing node 69cc38198df9359ff4899246: baseline-arm-clabbe 2026-04-02 21:10:02,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc38198df9359ff4899246 2026-04-02 21:10:02,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:10:02,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc38198df9359ff4899246 HTTP/1.1" 200 None 2026-04-02 21:10:02,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:10:02,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 21:10:02,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:10:02,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc38198df9359ff4899246 HTTP/1.1" 200 None 2026-04-02 21:10:02,611 - lava_callback - ERROR - Error processing callback for node 69cc38198df9359ff4899246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52906 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:13:02,337 - lava_callback - INFO - Received callback for node 69cc38dc8df9359ff4899259 INFO: 172.20.0.1:52490 - "POST /node/69cc38dc8df9359ff4899259 HTTP/1.0" 202 Accepted 2026-04-02 21:13:02,343 - lava_callback - INFO - Starting async job submit for node 69cc38dc8df9359ff4899259 2026-04-02 21:13:02,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:13:02,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc38dc8df9359ff4899259 HTTP/1.1" 200 None 2026-04-02 21:13:02,368 - lava_callback - DEBUG - Processing node 69cc38dc8df9359ff4899259: baseline-arm64-baylibre 2026-04-02 21:13:02,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc38dc8df9359ff4899259 2026-04-02 21:13:02,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:13:02,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc38dc8df9359ff4899259 HTTP/1.1" 200 None 2026-04-02 21:13:02,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:13:02,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:13:02,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:13:02,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc38dc8df9359ff4899259 HTTP/1.1" 200 None 2026-04-02 21:13:02,420 - lava_callback - ERROR - Error processing callback for node 69cc38dc8df9359ff4899259: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:16:02,502 - lava_callback - INFO - Received callback for node 69cc39898df9359ff48992c2 INFO: 172.20.0.1:56978 - "POST /node/69cc39898df9359ff48992c2 HTTP/1.0" 202 Accepted 2026-04-02 21:16:02,507 - lava_callback - INFO - Starting async job submit for node 69cc39898df9359ff48992c2 2026-04-02 21:16:02,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:16:02,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc39898df9359ff48992c2 HTTP/1.1" 200 None 2026-04-02 21:16:02,524 - lava_callback - DEBUG - Processing node 69cc39898df9359ff48992c2: baseline-arm64-baylibre 2026-04-02 21:16:02,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc39898df9359ff48992c2 2026-04-02 21:16:02,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:16:02,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc39898df9359ff48992c2 HTTP/1.1" 200 None 2026-04-02 21:16:02,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:16:02,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:16:02,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:16:02,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc39898df9359ff48992c2 HTTP/1.1" 200 None 2026-04-02 21:16:02,575 - lava_callback - ERROR - Error processing callback for node 69cc39898df9359ff48992c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57050 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:19:02,647 - lava_callback - INFO - Received callback for node 69cc3a358df9359ff489934e INFO: 172.20.0.1:60026 - "POST /node/69cc3a358df9359ff489934e HTTP/1.0" 202 Accepted 2026-04-02 21:19:02,653 - lava_callback - INFO - Starting async job submit for node 69cc3a358df9359ff489934e 2026-04-02 21:19:02,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:19:02,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3a358df9359ff489934e HTTP/1.1" 200 None 2026-04-02 21:19:02,669 - lava_callback - DEBUG - Processing node 69cc3a358df9359ff489934e: baseline-arm64-baylibre 2026-04-02 21:19:02,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3a358df9359ff489934e 2026-04-02 21:19:02,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:19:02,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3a358df9359ff489934e HTTP/1.1" 200 None 2026-04-02 21:19:02,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:19:02,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:19:02,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:19:02,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3a358df9359ff489934e HTTP/1.1" 200 None 2026-04-02 21:19:02,724 - lava_callback - ERROR - Error processing callback for node 69cc3a358df9359ff489934e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57696 - "GET /node/694ae53f6c96ed51d31710e9%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-02 21:20:22,771 - lava_callback - INFO - Received callback for node 69cc3a8f8df9359ff4899399 INFO: 172.20.0.1:57698 - "POST /node/69cc3a8f8df9359ff4899399 HTTP/1.0" 202 Accepted 2026-04-02 21:20:22,776 - lava_callback - INFO - Starting async job submit for node 69cc3a8f8df9359ff4899399 2026-04-02 21:20:22,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:20:22,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3a8f8df9359ff4899399 HTTP/1.1" 200 None 2026-04-02 21:20:22,795 - lava_callback - DEBUG - Processing node 69cc3a8f8df9359ff4899399: baseline-arm64-baylibre 2026-04-02 21:20:22,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3a8f8df9359ff4899399 2026-04-02 21:20:22,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:20:22,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3a8f8df9359ff4899399 HTTP/1.1" 200 None 2026-04-02 21:20:22,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:20:22,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:20:22,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:20:22,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3a8f8df9359ff4899399 HTTP/1.1" 200 None 2026-04-02 21:20:22,854 - lava_callback - ERROR - Error processing callback for node 69cc3a8f8df9359ff4899399: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59334 - "GET /node/698e6ea7db401c547d56f602%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60686 - "GET /node/693771f80c55536e7dddab83%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34988 - "GET /node/69937f47cebe99dd8e06d0b0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35004 - "GET /node/693b0413fee8383e92b6f713%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43166 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:23:42,919 - lava_callback - INFO - Received callback for node 69cc3b4a8df9359ff489942a INFO: 172.20.0.1:43172 - "POST /node/69cc3b4a8df9359ff489942a HTTP/1.0" 202 Accepted 2026-04-02 21:23:42,924 - lava_callback - INFO - Starting async job submit for node 69cc3b4a8df9359ff489942a 2026-04-02 21:23:42,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:23:42,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3b4a8df9359ff489942a HTTP/1.1" 200 None 2026-04-02 21:23:42,949 - lava_callback - DEBUG - Processing node 69cc3b4a8df9359ff489942a: baseline-arm64-baylibre 2026-04-02 21:23:42,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3b4a8df9359ff489942a 2026-04-02 21:23:42,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:23:42,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3b4a8df9359ff489942a HTTP/1.1" 200 None 2026-04-02 21:23:42,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:23:42,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:23:42,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:23:43,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3b4a8df9359ff489942a HTTP/1.1" 200 None 2026-04-02 21:23:43,019 - lava_callback - ERROR - Error processing callback for node 69cc3b4a8df9359ff489942a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57584 - "GET /node/69c17ed72b2b51e9ad97a996%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57594 - "GET /node/698b684a0a16aea5a0dc76bd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56628 - "GET /node/69934d15523507f3806a5be8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56630 - "GET /node/69118674f15111fc8ce4ba9d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56650 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:26:23,148 - lava_callback - INFO - Received callback for node 69cc3bfc8df9359ff489949b INFO: 172.20.0.1:50244 - "POST /node/69cc3bfc8df9359ff489949b HTTP/1.0" 202 Accepted 2026-04-02 21:26:23,155 - lava_callback - INFO - Starting async job submit for node 69cc3bfc8df9359ff489949b 2026-04-02 21:26:23,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:26:23,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3bfc8df9359ff489949b HTTP/1.1" 200 None 2026-04-02 21:26:23,171 - lava_callback - DEBUG - Processing node 69cc3bfc8df9359ff489949b: baseline-arm64-baylibre 2026-04-02 21:26:23,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3bfc8df9359ff489949b 2026-04-02 21:26:23,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:26:23,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3bfc8df9359ff489949b HTTP/1.1" 200 None 2026-04-02 21:26:23,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:26:23,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:26:23,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:26:23,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3bfc8df9359ff489949b HTTP/1.1" 200 None 2026-04-02 21:26:23,249 - lava_callback - ERROR - Error processing callback for node 69cc3bfc8df9359ff489949b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41594 - "GET /node/69900cd876d4b6342e9ddb7e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45340 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:28:03,514 - lava_callback - INFO - Received callback for node 69cc3c528df9359ff48994c8 INFO: 172.20.0.1:37822 - "POST /node/69cc3c528df9359ff48994c8 HTTP/1.0" 202 Accepted 2026-04-02 21:28:03,519 - lava_callback - INFO - Starting async job submit for node 69cc3c528df9359ff48994c8 2026-04-02 21:28:03,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:28:03,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3c528df9359ff48994c8 HTTP/1.1" 200 None 2026-04-02 21:28:03,536 - lava_callback - DEBUG - Processing node 69cc3c528df9359ff48994c8: baseline-arm64-baylibre 2026-04-02 21:28:03,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3c528df9359ff48994c8 2026-04-02 21:28:03,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:28:03,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3c528df9359ff48994c8 HTTP/1.1" 200 None 2026-04-02 21:28:03,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:28:03,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:28:03,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:28:03,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3c528df9359ff48994c8 HTTP/1.1" 200 None 2026-04-02 21:28:03,596 - lava_callback - ERROR - Error processing callback for node 69cc3c528df9359ff48994c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37838 - "GET /node/69af2fb9ce46d8ec186ad1bf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:29:43,277 - lava_callback - INFO - Received callback for node 69cc3cb98df9359ff48994f6 INFO: 172.20.0.1:42316 - "POST /node/69cc3cb98df9359ff48994f6 HTTP/1.0" 202 Accepted 2026-04-02 21:29:43,282 - lava_callback - INFO - Starting async job submit for node 69cc3cb98df9359ff48994f6 2026-04-02 21:29:43,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:29:43,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3cb98df9359ff48994f6 HTTP/1.1" 200 None 2026-04-02 21:29:43,298 - lava_callback - DEBUG - Processing node 69cc3cb98df9359ff48994f6: baseline-arm64-clabbe 2026-04-02 21:29:43,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3cb98df9359ff48994f6 2026-04-02 21:29:43,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:29:43,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3cb98df9359ff48994f6 HTTP/1.1" 200 None 2026-04-02 21:29:43,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:29:43,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:29:43,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:29:43,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3cb98df9359ff48994f6 HTTP/1.1" 200 None 2026-04-02 21:29:43,369 - lava_callback - ERROR - Error processing callback for node 69cc3cb98df9359ff48994f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59676 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:31:03,270 - lava_callback - INFO - Received callback for node 69cc3d098df9359ff4899520 INFO: 172.20.0.1:57948 - "POST /node/69cc3d098df9359ff4899520 HTTP/1.0" 202 Accepted 2026-04-02 21:31:03,276 - lava_callback - INFO - Starting async job submit for node 69cc3d098df9359ff4899520 2026-04-02 21:31:03,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:31:03,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3d098df9359ff4899520 HTTP/1.1" 200 None 2026-04-02 21:31:03,303 - lava_callback - DEBUG - Processing node 69cc3d098df9359ff4899520: baseline-arm64-baylibre 2026-04-02 21:31:03,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3d098df9359ff4899520 2026-04-02 21:31:03,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:31:03,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3d098df9359ff4899520 HTTP/1.1" 200 None 2026-04-02 21:31:03,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:31:03,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:31:03,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:31:03,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3d098df9359ff4899520 HTTP/1.1" 200 None 2026-04-02 21:31:03,364 - lava_callback - ERROR - Error processing callback for node 69cc3d098df9359ff4899520: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40996 - "GET /node/69493255ebaed71d4380788b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42960 - "GET /node/69a22a039230c437a22dfe02%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46484 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:32:43,401 - lava_callback - INFO - Received callback for node 69cc3d708df9359ff489955f INFO: 172.20.0.1:46494 - "POST /node/69cc3d708df9359ff489955f HTTP/1.0" 202 Accepted 2026-04-02 21:32:43,407 - lava_callback - INFO - Starting async job submit for node 69cc3d708df9359ff489955f 2026-04-02 21:32:43,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:32:43,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3d708df9359ff489955f HTTP/1.1" 200 None 2026-04-02 21:32:43,423 - lava_callback - DEBUG - Processing node 69cc3d708df9359ff489955f: baseline-arm64-clabbe 2026-04-02 21:32:43,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3d708df9359ff489955f 2026-04-02 21:32:43,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:32:43,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3d708df9359ff489955f HTTP/1.1" 200 None 2026-04-02 21:32:43,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:32:43,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:32:43,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:32:43,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3d708df9359ff489955f HTTP/1.1" 200 None 2026-04-02 21:32:43,482 - lava_callback - ERROR - Error processing callback for node 69cc3d708df9359ff489955f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:34:03,472 - lava_callback - INFO - Received callback for node 69cc3dc48df9359ff489959f INFO: 172.20.0.1:56620 - "POST /node/69cc3dc48df9359ff489959f HTTP/1.0" 202 Accepted 2026-04-02 21:34:03,477 - lava_callback - INFO - Starting async job submit for node 69cc3dc48df9359ff489959f 2026-04-02 21:34:03,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:34:03,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3dc48df9359ff489959f HTTP/1.1" 200 None 2026-04-02 21:34:03,493 - lava_callback - DEBUG - Processing node 69cc3dc48df9359ff489959f: baseline-arm64-baylibre 2026-04-02 21:34:03,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3dc48df9359ff489959f 2026-04-02 21:34:03,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:34:03,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3dc48df9359ff489959f HTTP/1.1" 200 None 2026-04-02 21:34:03,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:34:03,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:34:03,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:34:03,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3dc48df9359ff489959f HTTP/1.1" 200 None 2026-04-02 21:34:03,580 - lava_callback - ERROR - Error processing callback for node 69cc3dc48df9359ff489959f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33136 - "GET /node/69c1e3cb0efaf21d931060e8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43148 - "GET /node/6955c6971e2bfe31c94c4142%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43140 - "GET /node/69a46c73a327b9815668ffb7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:35:43,535 - lava_callback - INFO - Received callback for node 69cc3e258df9359ff48995dd INFO: 172.20.0.1:38642 - "POST /node/69cc3e258df9359ff48995dd HTTP/1.0" 202 Accepted 2026-04-02 21:35:43,545 - lava_callback - INFO - Starting async job submit for node 69cc3e258df9359ff48995dd 2026-04-02 21:35:43,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:35:43,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3e258df9359ff48995dd HTTP/1.1" 200 None 2026-04-02 21:35:43,562 - lava_callback - DEBUG - Processing node 69cc3e258df9359ff48995dd: baseline-arm64-clabbe 2026-04-02 21:35:43,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3e258df9359ff48995dd 2026-04-02 21:35:43,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:35:43,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3e258df9359ff48995dd HTTP/1.1" 200 None 2026-04-02 21:35:43,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:35:43,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:35:43,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:35:43,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3e258df9359ff48995dd HTTP/1.1" 200 None 2026-04-02 21:35:43,627 - lava_callback - ERROR - Error processing callback for node 69cc3e258df9359ff48995dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35406 - "GET /node/693b19cd15f407b7629df7c5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40312 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:37:03,579 - lava_callback - INFO - Received callback for node 69cc3e788df9359ff489961e INFO: 172.20.0.1:58660 - "POST /node/69cc3e788df9359ff489961e HTTP/1.0" 202 Accepted 2026-04-02 21:37:03,585 - lava_callback - INFO - Starting async job submit for node 69cc3e788df9359ff489961e 2026-04-02 21:37:03,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:37:03,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3e788df9359ff489961e HTTP/1.1" 200 None 2026-04-02 21:37:03,604 - lava_callback - DEBUG - Processing node 69cc3e788df9359ff489961e: baseline-arm64-baylibre 2026-04-02 21:37:03,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3e788df9359ff489961e 2026-04-02 21:37:03,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:37:03,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3e788df9359ff489961e HTTP/1.1" 200 None 2026-04-02 21:37:03,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:37:03,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:37:03,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:37:03,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3e788df9359ff489961e HTTP/1.1" 200 None 2026-04-02 21:37:03,662 - lava_callback - ERROR - Error processing callback for node 69cc3e788df9359ff489961e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET /node/693b0948fee8383e92b71605%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57140 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:38:43,656 - lava_callback - INFO - Received callback for node 69cc3ed28df9359ff489964a INFO: 172.20.0.1:57144 - "POST /node/69cc3ed28df9359ff489964a HTTP/1.0" 202 Accepted 2026-04-02 21:38:43,661 - lava_callback - INFO - Starting async job submit for node 69cc3ed28df9359ff489964a 2026-04-02 21:38:43,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:38:43,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3ed28df9359ff489964a HTTP/1.1" 200 None 2026-04-02 21:38:43,678 - lava_callback - DEBUG - Processing node 69cc3ed28df9359ff489964a: baseline-arm64-baylibre 2026-04-02 21:38:43,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3ed28df9359ff489964a 2026-04-02 21:38:43,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:38:43,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3ed28df9359ff489964a HTTP/1.1" 200 None 2026-04-02 21:38:43,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:38:43,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:38:43,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:38:43,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3ed28df9359ff489964a HTTP/1.1" 200 None 2026-04-02 21:38:43,732 - lava_callback - ERROR - Error processing callback for node 69cc3ed28df9359ff489964a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51316 - "GET /node/6985c52b71989fb14149811a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44658 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:40:23,751 - lava_callback - INFO - Received callback for node 69cc3f338df9359ff489967a INFO: 172.20.0.1:40462 - "POST /node/69cc3f338df9359ff489967a HTTP/1.0" 202 Accepted 2026-04-02 21:40:23,756 - lava_callback - INFO - Starting async job submit for node 69cc3f338df9359ff489967a 2026-04-02 21:40:23,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:40:23,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3f338df9359ff489967a HTTP/1.1" 200 None 2026-04-02 21:40:23,772 - lava_callback - DEBUG - Processing node 69cc3f338df9359ff489967a: baseline-arm64-clabbe 2026-04-02 21:40:23,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3f338df9359ff489967a 2026-04-02 21:40:23,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:40:23,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3f338df9359ff489967a HTTP/1.1" 200 None 2026-04-02 21:40:23,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:40:23,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:40:23,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:40:23,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3f338df9359ff489967a HTTP/1.1" 200 None 2026-04-02 21:40:23,829 - lava_callback - ERROR - Error processing callback for node 69cc3f338df9359ff489967a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40708 - "GET /node/698638c3177ca0f097bd2c2c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41474 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:41:43,872 - lava_callback - INFO - Received callback for node 69cc3f868df9359ff48996a4 INFO: 172.20.0.1:41490 - "POST /node/69cc3f868df9359ff48996a4 HTTP/1.0" 202 Accepted 2026-04-02 21:41:43,882 - lava_callback - INFO - Starting async job submit for node 69cc3f868df9359ff48996a4 2026-04-02 21:41:43,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:41:43,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3f868df9359ff48996a4 HTTP/1.1" 200 None 2026-04-02 21:41:43,898 - lava_callback - DEBUG - Processing node 69cc3f868df9359ff48996a4: baseline-arm64-baylibre 2026-04-02 21:41:43,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3f868df9359ff48996a4 2026-04-02 21:41:43,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:41:43,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3f868df9359ff48996a4 HTTP/1.1" 200 None 2026-04-02 21:41:43,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:41:43,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:41:43,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:41:43,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3f868df9359ff48996a4 HTTP/1.1" 200 None 2026-04-02 21:41:43,949 - lava_callback - ERROR - Error processing callback for node 69cc3f868df9359ff48996a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32774 - "GET /node/6938c479e767fbc36e03e49d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32784 - "GET /node/694c1a062f7ca341fdeb2135%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET /node/693a80b2e17cfbe560b12bd9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57784 - "GET /node/6990b0ffc45febfe44522ece%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37126 - "GET /node/6993c11d3e9ba4930770d4f5%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-02 21:43:23,877 - lava_callback - INFO - Received callback for node 69cc3fe78df9359ff48996d2 INFO: 172.20.0.1:59166 - "POST /node/69cc3fe78df9359ff48996d2 HTTP/1.0" 202 Accepted 2026-04-02 21:43:23,883 - lava_callback - INFO - Starting async job submit for node 69cc3fe78df9359ff48996d2 2026-04-02 21:43:23,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:43:23,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3fe78df9359ff48996d2 HTTP/1.1" 200 None 2026-04-02 21:43:23,899 - lava_callback - DEBUG - Processing node 69cc3fe78df9359ff48996d2: baseline-arm64-clabbe 2026-04-02 21:43:23,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc3fe78df9359ff48996d2 2026-04-02 21:43:23,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:43:23,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc3fe78df9359ff48996d2 HTTP/1.1" 200 None 2026-04-02 21:43:23,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:43:23,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:43:23,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:43:23,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc3fe78df9359ff48996d2 HTTP/1.1" 200 None 2026-04-02 21:43:23,956 - lava_callback - ERROR - Error processing callback for node 69cc3fe78df9359ff48996d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35508 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:44:43,911 - lava_callback - INFO - Received callback for node 69cc403f8df9359ff48996f6 INFO: 172.20.0.1:35516 - "POST /node/69cc403f8df9359ff48996f6 HTTP/1.0" 202 Accepted 2026-04-02 21:44:43,918 - lava_callback - INFO - Starting async job submit for node 69cc403f8df9359ff48996f6 2026-04-02 21:44:43,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:44:43,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc403f8df9359ff48996f6 HTTP/1.1" 200 None 2026-04-02 21:44:43,942 - lava_callback - DEBUG - Processing node 69cc403f8df9359ff48996f6: baseline-arm64-clabbe 2026-04-02 21:44:43,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc403f8df9359ff48996f6 2026-04-02 21:44:43,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:44:43,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc403f8df9359ff48996f6 HTTP/1.1" 200 None 2026-04-02 21:44:43,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:44:43,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:44:43,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:44:43,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc403f8df9359ff48996f6 HTTP/1.1" 200 None 2026-04-02 21:44:43,999 - lava_callback - ERROR - Error processing callback for node 69cc403f8df9359ff48996f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43628 - "GET /node/694a5b8583c67c43d1eda203%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43634 - "GET /node/693b07a9fee8383e92b70f3c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45268 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:46:24,015 - lava_callback - INFO - Received callback for node 69cc409f8df9359ff4899733 INFO: 172.20.0.1:58830 - "POST /node/69cc409f8df9359ff4899733 HTTP/1.0" 202 Accepted 2026-04-02 21:46:24,021 - lava_callback - INFO - Starting async job submit for node 69cc409f8df9359ff4899733 2026-04-02 21:46:24,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:46:24,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc409f8df9359ff4899733 HTTP/1.1" 200 None 2026-04-02 21:46:24,036 - lava_callback - DEBUG - Processing node 69cc409f8df9359ff4899733: baseline-arm64-clabbe 2026-04-02 21:46:24,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc409f8df9359ff4899733 2026-04-02 21:46:24,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:46:24,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc409f8df9359ff4899733 HTTP/1.1" 200 None 2026-04-02 21:46:24,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:46:24,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:46:24,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:46:24,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc409f8df9359ff4899733 HTTP/1.1" 200 None 2026-04-02 21:46:24,116 - lava_callback - ERROR - Error processing callback for node 69cc409f8df9359ff4899733: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59930 - "GET /node/693b070bfee8383e92b70a5d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59938 - "GET /node/69876eeae31b58f834f1a3c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50828 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:47:44,067 - lava_callback - INFO - Received callback for node 69cc40f78df9359ff4899782 INFO: 172.20.0.1:50840 - "POST /node/69cc40f78df9359ff4899782 HTTP/1.0" 202 Accepted 2026-04-02 21:47:44,073 - lava_callback - INFO - Starting async job submit for node 69cc40f78df9359ff4899782 2026-04-02 21:47:44,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:47:44,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc40f78df9359ff4899782 HTTP/1.1" 200 None 2026-04-02 21:47:44,095 - lava_callback - DEBUG - Processing node 69cc40f78df9359ff4899782: baseline-arm64-clabbe 2026-04-02 21:47:44,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc40f78df9359ff4899782 2026-04-02 21:47:44,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:47:44,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc40f78df9359ff4899782 HTTP/1.1" 200 None 2026-04-02 21:47:44,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:47:44,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:47:44,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:47:44,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc40f78df9359ff4899782 HTTP/1.1" 200 None 2026-04-02 21:47:44,164 - lava_callback - ERROR - Error processing callback for node 69cc40f78df9359ff4899782: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53146 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:49:24,172 - lava_callback - INFO - Received callback for node 69cc41518df9359ff48997b2 INFO: 172.20.0.1:53814 - "POST /node/69cc41518df9359ff48997b2 HTTP/1.0" 202 Accepted 2026-04-02 21:49:24,178 - lava_callback - INFO - Starting async job submit for node 69cc41518df9359ff48997b2 2026-04-02 21:49:24,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:49:24,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc41518df9359ff48997b2 HTTP/1.1" 200 None 2026-04-02 21:49:24,203 - lava_callback - DEBUG - Processing node 69cc41518df9359ff48997b2: baseline-arm64-clabbe 2026-04-02 21:49:24,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc41518df9359ff48997b2 2026-04-02 21:49:24,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:49:24,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc41518df9359ff48997b2 HTTP/1.1" 200 None 2026-04-02 21:49:24,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:49:24,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:49:24,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:49:24,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc41518df9359ff48997b2 HTTP/1.1" 200 None 2026-04-02 21:49:24,259 - lava_callback - ERROR - Error processing callback for node 69cc41518df9359ff48997b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39534 - "GET /node/69936dcccebe99dd8e0680d1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33806 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:50:44,285 - lava_callback - INFO - Received callback for node 69cc41a88df9359ff48997de INFO: 172.20.0.1:33818 - "POST /node/69cc41a88df9359ff48997de HTTP/1.0" 202 Accepted 2026-04-02 21:50:44,291 - lava_callback - INFO - Starting async job submit for node 69cc41a88df9359ff48997de 2026-04-02 21:50:44,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:50:44,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc41a88df9359ff48997de HTTP/1.1" 200 None 2026-04-02 21:50:44,307 - lava_callback - DEBUG - Processing node 69cc41a88df9359ff48997de: baseline-arm64-clabbe 2026-04-02 21:50:44,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc41a88df9359ff48997de 2026-04-02 21:50:44,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:50:44,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc41a88df9359ff48997de HTTP/1.1" 200 None 2026-04-02 21:50:44,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:50:44,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:50:44,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:50:44,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc41a88df9359ff48997de HTTP/1.1" 200 None 2026-04-02 21:50:44,357 - lava_callback - ERROR - Error processing callback for node 69cc41a88df9359ff48997de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57994 - "GET /node/6939340b6e7b0b7f22e51be5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46938 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:52:24,280 - lava_callback - INFO - Received callback for node 69cc42058df9359ff4899811 INFO: 172.20.0.1:41536 - "POST /node/69cc42058df9359ff4899811 HTTP/1.0" 202 Accepted 2026-04-02 21:52:24,286 - lava_callback - INFO - Starting async job submit for node 69cc42058df9359ff4899811 2026-04-02 21:52:24,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:52:24,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc42058df9359ff4899811 HTTP/1.1" 200 None 2026-04-02 21:52:24,304 - lava_callback - DEBUG - Processing node 69cc42058df9359ff4899811: baseline-arm64-clabbe 2026-04-02 21:52:24,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc42058df9359ff4899811 2026-04-02 21:52:24,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:52:24,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc42058df9359ff4899811 HTTP/1.1" 200 None 2026-04-02 21:52:24,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:52:24,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:52:24,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:52:24,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc42058df9359ff4899811 HTTP/1.1" 200 None 2026-04-02 21:52:24,358 - lava_callback - ERROR - Error processing callback for node 69cc42058df9359ff4899811: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43534 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:53:44,520 - lava_callback - INFO - Received callback for node 69cc425c8df9359ff4899846 INFO: 172.20.0.1:43536 - "POST /node/69cc425c8df9359ff4899846 HTTP/1.0" 202 Accepted 2026-04-02 21:53:44,526 - lava_callback - INFO - Starting async job submit for node 69cc425c8df9359ff4899846 2026-04-02 21:53:44,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:53:44,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc425c8df9359ff4899846 HTTP/1.1" 200 None 2026-04-02 21:53:44,542 - lava_callback - DEBUG - Processing node 69cc425c8df9359ff4899846: baseline-arm64-clabbe 2026-04-02 21:53:44,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc425c8df9359ff4899846 2026-04-02 21:53:44,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:53:44,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc425c8df9359ff4899846 HTTP/1.1" 200 None 2026-04-02 21:53:44,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:53:44,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 21:53:44,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:53:44,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc425c8df9359ff4899846 HTTP/1.1" 200 None 2026-04-02 21:53:44,606 - lava_callback - ERROR - Error processing callback for node 69cc425c8df9359ff4899846: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38012 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:55:04,585 - lava_callback - INFO - Received callback for node 69cc42a98df9359ff489987a INFO: 172.20.0.1:33400 - "POST /node/69cc42a98df9359ff489987a HTTP/1.0" 202 Accepted 2026-04-02 21:55:04,591 - lava_callback - INFO - Starting async job submit for node 69cc42a98df9359ff489987a 2026-04-02 21:55:04,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:55:04,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc42a98df9359ff489987a HTTP/1.1" 200 None 2026-04-02 21:55:04,607 - lava_callback - DEBUG - Processing node 69cc42a98df9359ff489987a: baseline-arm64-baylibre 2026-04-02 21:55:04,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc42a98df9359ff489987a 2026-04-02 21:55:04,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:55:04,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc42a98df9359ff489987a HTTP/1.1" 200 None 2026-04-02 21:55:04,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:55:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:55:04,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:55:04,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc42a98df9359ff489987a HTTP/1.1" 200 None 2026-04-02 21:55:04,659 - lava_callback - ERROR - Error processing callback for node 69cc42a98df9359ff489987a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51528 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:56:24,571 - lava_callback - INFO - Received callback for node 69cc43018df9359ff48998c2 INFO: 172.20.0.1:36296 - "POST /node/69cc43018df9359ff48998c2 HTTP/1.0" 202 Accepted 2026-04-02 21:56:24,577 - lava_callback - INFO - Starting async job submit for node 69cc43018df9359ff48998c2 2026-04-02 21:56:24,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:56:24,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc43018df9359ff48998c2 HTTP/1.1" 200 None 2026-04-02 21:56:24,593 - lava_callback - DEBUG - Processing node 69cc43018df9359ff48998c2: baseline-arm64-baylibre 2026-04-02 21:56:24,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc43018df9359ff48998c2 2026-04-02 21:56:24,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:56:24,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc43018df9359ff48998c2 HTTP/1.1" 200 None 2026-04-02 21:56:24,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:56:24,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:56:24,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:56:24,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc43018df9359ff48998c2 HTTP/1.1" 200 None 2026-04-02 21:56:24,648 - lava_callback - ERROR - Error processing callback for node 69cc43018df9359ff48998c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:58:04,741 - lava_callback - INFO - Received callback for node 69cc43578df9359ff4899901 INFO: 172.20.0.1:52774 - "POST /node/69cc43578df9359ff4899901 HTTP/1.0" 202 Accepted 2026-04-02 21:58:04,747 - lava_callback - INFO - Starting async job submit for node 69cc43578df9359ff4899901 2026-04-02 21:58:04,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:58:04,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc43578df9359ff4899901 HTTP/1.1" 200 None 2026-04-02 21:58:04,766 - lava_callback - DEBUG - Processing node 69cc43578df9359ff4899901: baseline-arm64-baylibre 2026-04-02 21:58:04,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc43578df9359ff4899901 2026-04-02 21:58:04,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:58:04,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc43578df9359ff4899901 HTTP/1.1" 200 None 2026-04-02 21:58:04,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:58:04,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:58:04,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:58:04,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc43578df9359ff4899901 HTTP/1.1" 200 None 2026-04-02 21:58:04,828 - lava_callback - ERROR - Error processing callback for node 69cc43578df9359ff4899901: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55034 - "GET / HTTP/1.0" 200 OK 2026-04-02 21:59:24,762 - lava_callback - INFO - Received callback for node 69cc43af8df9359ff4899941 INFO: 172.20.0.1:60776 - "POST /node/69cc43af8df9359ff4899941 HTTP/1.0" 202 Accepted 2026-04-02 21:59:24,768 - lava_callback - INFO - Starting async job submit for node 69cc43af8df9359ff4899941 2026-04-02 21:59:24,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:59:24,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc43af8df9359ff4899941 HTTP/1.1" 200 None 2026-04-02 21:59:24,786 - lava_callback - DEBUG - Processing node 69cc43af8df9359ff4899941: baseline-arm64-baylibre 2026-04-02 21:59:24,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc43af8df9359ff4899941 2026-04-02 21:59:24,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:59:24,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc43af8df9359ff4899941 HTTP/1.1" 200 None 2026-04-02 21:59:24,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:59:24,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 21:59:24,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 21:59:24,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc43af8df9359ff4899941 HTTP/1.1" 200 None 2026-04-02 21:59:24,864 - lava_callback - ERROR - Error processing callback for node 69cc43af8df9359ff4899941: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35008 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:00:44,852 - lava_callback - INFO - Received callback for node 69cc44068df9359ff489996e INFO: 172.20.0.1:35016 - "POST /node/69cc44068df9359ff489996e HTTP/1.0" 202 Accepted 2026-04-02 22:00:44,857 - lava_callback - INFO - Starting async job submit for node 69cc44068df9359ff489996e 2026-04-02 22:00:44,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:00:44,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc44068df9359ff489996e HTTP/1.1" 200 None 2026-04-02 22:00:44,876 - lava_callback - DEBUG - Processing node 69cc44068df9359ff489996e: baseline-arm64-baylibre 2026-04-02 22:00:44,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc44068df9359ff489996e 2026-04-02 22:00:44,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:00:44,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc44068df9359ff489996e HTTP/1.1" 200 None 2026-04-02 22:00:44,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:00:44,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:00:44,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:00:44,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc44068df9359ff489996e HTTP/1.1" 200 None 2026-04-02 22:00:44,938 - lava_callback - ERROR - Error processing callback for node 69cc44068df9359ff489996e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44774 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:02:24,966 - lava_callback - INFO - Received callback for node 69cc445d8df9359ff4899995 INFO: 172.20.0.1:47392 - "POST /node/69cc445d8df9359ff4899995 HTTP/1.0" 202 Accepted 2026-04-02 22:02:24,971 - lava_callback - INFO - Starting async job submit for node 69cc445d8df9359ff4899995 2026-04-02 22:02:24,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:02:24,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc445d8df9359ff4899995 HTTP/1.1" 200 None 2026-04-02 22:02:24,987 - lava_callback - DEBUG - Processing node 69cc445d8df9359ff4899995: baseline-arm64-baylibre 2026-04-02 22:02:24,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc445d8df9359ff4899995 2026-04-02 22:02:24,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:02:25,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc445d8df9359ff4899995 HTTP/1.1" 200 None 2026-04-02 22:02:25,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:02:25,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:02:25,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:02:25,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc445d8df9359ff4899995 HTTP/1.1" 200 None 2026-04-02 22:02:25,039 - lava_callback - ERROR - Error processing callback for node 69cc445d8df9359ff4899995: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:03:45,020 - lava_callback - INFO - Received callback for node 69cc44b28df9359ff48999bc INFO: 172.20.0.1:47552 - "POST /node/69cc44b28df9359ff48999bc HTTP/1.0" 202 Accepted 2026-04-02 22:03:45,025 - lava_callback - INFO - Starting async job submit for node 69cc44b28df9359ff48999bc 2026-04-02 22:03:45,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:03:45,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc44b28df9359ff48999bc HTTP/1.1" 200 None 2026-04-02 22:03:45,041 - lava_callback - DEBUG - Processing node 69cc44b28df9359ff48999bc: baseline-arm64-baylibre 2026-04-02 22:03:45,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc44b28df9359ff48999bc 2026-04-02 22:03:45,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:03:45,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc44b28df9359ff48999bc HTTP/1.1" 200 None 2026-04-02 22:03:45,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:03:45,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:03:45,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:03:45,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc44b28df9359ff48999bc HTTP/1.1" 200 None 2026-04-02 22:03:45,091 - lava_callback - ERROR - Error processing callback for node 69cc44b28df9359ff48999bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44016 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:05:25,063 - lava_callback - INFO - Received callback for node 69cc45178df9359ff48999fc INFO: 172.20.0.1:55382 - "POST /node/69cc45178df9359ff48999fc HTTP/1.0" 202 Accepted 2026-04-02 22:05:25,069 - lava_callback - INFO - Starting async job submit for node 69cc45178df9359ff48999fc 2026-04-02 22:05:25,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:05:25,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc45178df9359ff48999fc HTTP/1.1" 200 None 2026-04-02 22:05:25,091 - lava_callback - DEBUG - Processing node 69cc45178df9359ff48999fc: baseline-arm64-clabbe 2026-04-02 22:05:25,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc45178df9359ff48999fc 2026-04-02 22:05:25,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:05:25,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc45178df9359ff48999fc HTTP/1.1" 200 None 2026-04-02 22:05:25,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:05:25,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:05:25,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:05:25,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc45178df9359ff48999fc HTTP/1.1" 200 None 2026-04-02 22:05:25,149 - lava_callback - ERROR - Error processing callback for node 69cc45178df9359ff48999fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47998 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:06:45,038 - lava_callback - INFO - Received callback for node 69cc45708df9359ff4899a38 INFO: 172.20.0.1:48006 - "POST /node/69cc45708df9359ff4899a38 HTTP/1.0" 202 Accepted 2026-04-02 22:06:45,044 - lava_callback - INFO - Starting async job submit for node 69cc45708df9359ff4899a38 2026-04-02 22:06:45,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:06:45,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc45708df9359ff4899a38 HTTP/1.1" 200 None 2026-04-02 22:06:45,060 - lava_callback - DEBUG - Processing node 69cc45708df9359ff4899a38: baseline-arm64-clabbe 2026-04-02 22:06:45,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc45708df9359ff4899a38 2026-04-02 22:06:45,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:06:45,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc45708df9359ff4899a38 HTTP/1.1" 200 None 2026-04-02 22:06:45,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:06:45,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:06:45,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:06:45,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc45708df9359ff4899a38 HTTP/1.1" 200 None 2026-04-02 22:06:45,119 - lava_callback - ERROR - Error processing callback for node 69cc45708df9359ff4899a38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33606 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:08:05,245 - lava_callback - INFO - Received callback for node 69cc45bf8df9359ff4899a82 INFO: 172.20.0.1:42154 - "POST /node/69cc45bf8df9359ff4899a82 HTTP/1.0" 202 Accepted 2026-04-02 22:08:05,250 - lava_callback - INFO - Starting async job submit for node 69cc45bf8df9359ff4899a82 2026-04-02 22:08:05,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:08:05,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc45bf8df9359ff4899a82 HTTP/1.1" 200 None 2026-04-02 22:08:05,267 - lava_callback - DEBUG - Processing node 69cc45bf8df9359ff4899a82: baseline-arm64-baylibre 2026-04-02 22:08:05,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc45bf8df9359ff4899a82 2026-04-02 22:08:05,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:08:05,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc45bf8df9359ff4899a82 HTTP/1.1" 200 None 2026-04-02 22:08:05,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:08:05,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:08:05,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:08:05,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc45bf8df9359ff4899a82 HTTP/1.1" 200 None 2026-04-02 22:08:05,328 - lava_callback - ERROR - Error processing callback for node 69cc45bf8df9359ff4899a82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46182 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:09:45,165 - lava_callback - INFO - Received callback for node 69cc46238df9359ff4899aba INFO: 172.20.0.1:46188 - "POST /node/69cc46238df9359ff4899aba HTTP/1.0" 202 Accepted 2026-04-02 22:09:45,170 - lava_callback - INFO - Starting async job submit for node 69cc46238df9359ff4899aba 2026-04-02 22:09:45,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:09:45,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc46238df9359ff4899aba HTTP/1.1" 200 None 2026-04-02 22:09:45,187 - lava_callback - DEBUG - Processing node 69cc46238df9359ff4899aba: baseline-arm64-clabbe 2026-04-02 22:09:45,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc46238df9359ff4899aba 2026-04-02 22:09:45,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:09:45,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc46238df9359ff4899aba HTTP/1.1" 200 None 2026-04-02 22:09:45,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:09:45,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:09:45,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:09:45,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc46238df9359ff4899aba HTTP/1.1" 200 None 2026-04-02 22:09:45,246 - lava_callback - ERROR - Error processing callback for node 69cc46238df9359ff4899aba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34864 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:11:05,425 - lava_callback - INFO - Received callback for node 69cc46708df9359ff4899aef INFO: 172.20.0.1:47650 - "POST /node/69cc46708df9359ff4899aef HTTP/1.0" 202 Accepted 2026-04-02 22:11:05,431 - lava_callback - INFO - Starting async job submit for node 69cc46708df9359ff4899aef 2026-04-02 22:11:05,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:11:05,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc46708df9359ff4899aef HTTP/1.1" 200 None 2026-04-02 22:11:05,465 - lava_callback - DEBUG - Processing node 69cc46708df9359ff4899aef: baseline-arm64-baylibre 2026-04-02 22:11:05,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc46708df9359ff4899aef 2026-04-02 22:11:05,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:11:05,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc46708df9359ff4899aef HTTP/1.1" 200 None 2026-04-02 22:11:05,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:11:05,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:11:05,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:11:05,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc46708df9359ff4899aef HTTP/1.1" 200 None 2026-04-02 22:11:05,538 - lava_callback - ERROR - Error processing callback for node 69cc46708df9359ff4899aef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36592 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:12:25,525 - lava_callback - INFO - Received callback for node 69cc46c78df9359ff4899b0d INFO: 172.20.0.1:39562 - "POST /node/69cc46c78df9359ff4899b0d HTTP/1.0" 202 Accepted 2026-04-02 22:12:25,531 - lava_callback - INFO - Starting async job submit for node 69cc46c78df9359ff4899b0d 2026-04-02 22:12:25,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:12:25,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc46c78df9359ff4899b0d HTTP/1.1" 200 None 2026-04-02 22:12:25,547 - lava_callback - DEBUG - Processing node 69cc46c78df9359ff4899b0d: baseline-arm64-baylibre 2026-04-02 22:12:25,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc46c78df9359ff4899b0d 2026-04-02 22:12:25,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:12:25,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc46c78df9359ff4899b0d HTTP/1.1" 200 None 2026-04-02 22:12:25,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:12:25,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:12:25,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:12:25,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc46c78df9359ff4899b0d HTTP/1.1" 200 None 2026-04-02 22:12:25,601 - lava_callback - ERROR - Error processing callback for node 69cc46c78df9359ff4899b0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54518 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:14:05,298 - lava_callback - INFO - Received callback for node 69cc47288df9359ff4899b38 INFO: 172.20.0.1:58618 - "POST /node/69cc47288df9359ff4899b38 HTTP/1.0" 202 Accepted 2026-04-02 22:14:05,304 - lava_callback - INFO - Starting async job submit for node 69cc47288df9359ff4899b38 2026-04-02 22:14:05,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:14:05,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc47288df9359ff4899b38 HTTP/1.1" 200 None 2026-04-02 22:14:05,344 - lava_callback - DEBUG - Processing node 69cc47288df9359ff4899b38: baseline-arm64-clabbe 2026-04-02 22:14:05,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc47288df9359ff4899b38 2026-04-02 22:14:05,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:14:05,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc47288df9359ff4899b38 HTTP/1.1" 200 None 2026-04-02 22:14:05,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:14:05,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:14:05,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:14:05,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc47288df9359ff4899b38 HTTP/1.1" 200 None 2026-04-02 22:14:05,400 - lava_callback - ERROR - Error processing callback for node 69cc47288df9359ff4899b38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60464 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:15:45,391 - lava_callback - INFO - Received callback for node 69cc477c8df9359ff4899b61 INFO: 172.20.0.1:60474 - "POST /node/69cc477c8df9359ff4899b61 HTTP/1.0" 202 Accepted 2026-04-02 22:15:45,396 - lava_callback - INFO - Starting async job submit for node 69cc477c8df9359ff4899b61 2026-04-02 22:15:45,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:15:45,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc477c8df9359ff4899b61 HTTP/1.1" 200 None 2026-04-02 22:15:45,415 - lava_callback - DEBUG - Processing node 69cc477c8df9359ff4899b61: baseline-arm64-clabbe 2026-04-02 22:15:45,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc477c8df9359ff4899b61 2026-04-02 22:15:45,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:15:45,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc477c8df9359ff4899b61 HTTP/1.1" 200 None 2026-04-02 22:15:45,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:15:45,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:15:45,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:15:45,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc477c8df9359ff4899b61 HTTP/1.1" 200 None 2026-04-02 22:15:45,481 - lava_callback - ERROR - Error processing callback for node 69cc477c8df9359ff4899b61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59436 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:16:45,752 - lava_callback - INFO - Received callback for node 69cc47cb8df9359ff4899b9c INFO: 172.20.0.1:59448 - "POST /node/69cc47cb8df9359ff4899b9c HTTP/1.0" 202 Accepted 2026-04-02 22:16:45,758 - lava_callback - INFO - Starting async job submit for node 69cc47cb8df9359ff4899b9c 2026-04-02 22:16:45,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:16:45,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc47cb8df9359ff4899b9c HTTP/1.1" 200 None 2026-04-02 22:16:45,779 - lava_callback - DEBUG - Processing node 69cc47cb8df9359ff4899b9c: baseline-arm64-baylibre 2026-04-02 22:16:45,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc47cb8df9359ff4899b9c 2026-04-02 22:16:45,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:16:45,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc47cb8df9359ff4899b9c HTTP/1.1" 200 None 2026-04-02 22:16:45,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:16:45,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:16:45,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:16:45,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc47cb8df9359ff4899b9c HTTP/1.1" 200 None 2026-04-02 22:16:45,841 - lava_callback - ERROR - Error processing callback for node 69cc47cb8df9359ff4899b9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50938 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:18:25,491 - lava_callback - INFO - Received callback for node 69cc48238df9359ff4899bba INFO: 172.20.0.1:39256 - "POST /node/69cc48238df9359ff4899bba HTTP/1.0" 202 Accepted 2026-04-02 22:18:25,497 - lava_callback - INFO - Starting async job submit for node 69cc48238df9359ff4899bba 2026-04-02 22:18:25,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:18:25,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc48238df9359ff4899bba HTTP/1.1" 200 None 2026-04-02 22:18:25,513 - lava_callback - DEBUG - Processing node 69cc48238df9359ff4899bba: baseline-arm64-clabbe 2026-04-02 22:18:25,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc48238df9359ff4899bba 2026-04-02 22:18:25,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:18:25,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc48238df9359ff4899bba HTTP/1.1" 200 None 2026-04-02 22:18:25,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:18:25,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:18:25,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:18:25,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc48238df9359ff4899bba HTTP/1.1" 200 None 2026-04-02 22:18:25,568 - lava_callback - ERROR - Error processing callback for node 69cc48238df9359ff4899bba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46782 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:19:45,876 - lava_callback - INFO - Received callback for node 69cc48758df9359ff4899be1 INFO: 172.20.0.1:46790 - "POST /node/69cc48758df9359ff4899be1 HTTP/1.0" 202 Accepted 2026-04-02 22:19:45,882 - lava_callback - INFO - Starting async job submit for node 69cc48758df9359ff4899be1 2026-04-02 22:19:45,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:19:45,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc48758df9359ff4899be1 HTTP/1.1" 200 None 2026-04-02 22:19:45,898 - lava_callback - DEBUG - Processing node 69cc48758df9359ff4899be1: baseline-arm64-baylibre 2026-04-02 22:19:45,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc48758df9359ff4899be1 2026-04-02 22:19:45,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:19:45,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc48758df9359ff4899be1 HTTP/1.1" 200 None 2026-04-02 22:19:45,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:19:45,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:19:45,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:19:45,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc48758df9359ff4899be1 HTTP/1.1" 200 None 2026-04-02 22:19:45,953 - lava_callback - ERROR - Error processing callback for node 69cc48758df9359ff4899be1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38152 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:21:25,630 - lava_callback - INFO - Received callback for node 69cc48d58df9359ff4899c03 INFO: 172.20.0.1:41664 - "POST /node/69cc48d58df9359ff4899c03 HTTP/1.0" 202 Accepted 2026-04-02 22:21:25,636 - lava_callback - INFO - Starting async job submit for node 69cc48d58df9359ff4899c03 2026-04-02 22:21:25,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:21:25,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc48d58df9359ff4899c03 HTTP/1.1" 200 None 2026-04-02 22:21:25,652 - lava_callback - DEBUG - Processing node 69cc48d58df9359ff4899c03: baseline-arm64-clabbe 2026-04-02 22:21:25,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc48d58df9359ff4899c03 2026-04-02 22:21:25,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:21:25,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc48d58df9359ff4899c03 HTTP/1.1" 200 None 2026-04-02 22:21:25,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:21:25,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:21:25,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:21:25,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc48d58df9359ff4899c03 HTTP/1.1" 200 None 2026-04-02 22:21:25,744 - lava_callback - ERROR - Error processing callback for node 69cc48d58df9359ff4899c03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34692 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:22:45,676 - lava_callback - INFO - Received callback for node 69cc49318df9359ff4899c19 INFO: 172.20.0.1:34706 - "POST /node/69cc49318df9359ff4899c19 HTTP/1.0" 202 Accepted 2026-04-02 22:22:45,682 - lava_callback - INFO - Starting async job submit for node 69cc49318df9359ff4899c19 2026-04-02 22:22:45,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:22:45,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc49318df9359ff4899c19 HTTP/1.1" 200 None 2026-04-02 22:22:45,698 - lava_callback - DEBUG - Processing node 69cc49318df9359ff4899c19: baseline-arm64-clabbe 2026-04-02 22:22:45,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc49318df9359ff4899c19 2026-04-02 22:22:45,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:22:45,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc49318df9359ff4899c19 HTTP/1.1" 200 None 2026-04-02 22:22:45,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:22:45,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 22:22:45,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:22:45,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc49318df9359ff4899c19 HTTP/1.1" 200 None 2026-04-02 22:22:45,775 - lava_callback - ERROR - Error processing callback for node 69cc49318df9359ff4899c19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52044 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:44:07,298 - lava_callback - INFO - Received callback for node 69cc4e278df9359ff4899c30 INFO: 172.20.0.1:52060 - "POST /node/69cc4e278df9359ff4899c30 HTTP/1.0" 202 Accepted 2026-04-02 22:44:07,304 - lava_callback - INFO - Starting async job submit for node 69cc4e278df9359ff4899c30 2026-04-02 22:44:07,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:44:07,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4e278df9359ff4899c30 HTTP/1.1" 200 None 2026-04-02 22:44:07,320 - lava_callback - DEBUG - Processing node 69cc4e278df9359ff4899c30: baseline-arm-baylibre 2026-04-02 22:44:07,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4e278df9359ff4899c30 2026-04-02 22:44:07,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:44:07,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4e278df9359ff4899c30 HTTP/1.1" 200 None 2026-04-02 22:44:07,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:44:07,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:44:07,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:44:07,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4e278df9359ff4899c30 HTTP/1.1" 200 None 2026-04-02 22:44:07,371 - lava_callback - ERROR - Error processing callback for node 69cc4e278df9359ff4899c30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56126 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:44:47,180 - lava_callback - INFO - Received callback for node 69cc4e508df9359ff4899c41 INFO: 172.20.0.1:56140 - "POST /node/69cc4e508df9359ff4899c41 HTTP/1.0" 202 Accepted 2026-04-02 22:44:47,185 - lava_callback - INFO - Starting async job submit for node 69cc4e508df9359ff4899c41 2026-04-02 22:44:47,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:44:47,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4e508df9359ff4899c41 HTTP/1.1" 200 None 2026-04-02 22:44:47,203 - lava_callback - DEBUG - Processing node 69cc4e508df9359ff4899c41: baseline-arm-baylibre 2026-04-02 22:44:47,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4e508df9359ff4899c41 2026-04-02 22:44:47,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:44:47,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4e508df9359ff4899c41 HTTP/1.1" 200 None 2026-04-02 22:44:47,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:44:47,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:44:47,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:44:47,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4e508df9359ff4899c41 HTTP/1.1" 200 None 2026-04-02 22:44:47,258 - lava_callback - ERROR - Error processing callback for node 69cc4e508df9359ff4899c41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55652 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:45:27,260 - lava_callback - INFO - Received callback for node 69cc4e7b8df9359ff4899c52 INFO: 172.20.0.1:55656 - "POST /node/69cc4e7b8df9359ff4899c52 HTTP/1.0" 202 Accepted 2026-04-02 22:45:27,266 - lava_callback - INFO - Starting async job submit for node 69cc4e7b8df9359ff4899c52 2026-04-02 22:45:27,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:45:27,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4e7b8df9359ff4899c52 HTTP/1.1" 200 None 2026-04-02 22:45:27,282 - lava_callback - DEBUG - Processing node 69cc4e7b8df9359ff4899c52: baseline-arm-baylibre 2026-04-02 22:45:27,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4e7b8df9359ff4899c52 2026-04-02 22:45:27,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:45:27,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4e7b8df9359ff4899c52 HTTP/1.1" 200 None 2026-04-02 22:45:27,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:45:27,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:45:27,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:45:27,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4e7b8df9359ff4899c52 HTTP/1.1" 200 None 2026-04-02 22:45:27,332 - lava_callback - ERROR - Error processing callback for node 69cc4e7b8df9359ff4899c52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55234 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:46:07,249 - lava_callback - INFO - Received callback for node 69cc4ea48df9359ff4899c5f INFO: 172.20.0.1:55240 - "POST /node/69cc4ea48df9359ff4899c5f HTTP/1.0" 202 Accepted 2026-04-02 22:46:07,254 - lava_callback - INFO - Starting async job submit for node 69cc4ea48df9359ff4899c5f 2026-04-02 22:46:07,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:46:07,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4ea48df9359ff4899c5f HTTP/1.1" 200 None 2026-04-02 22:46:07,277 - lava_callback - DEBUG - Processing node 69cc4ea48df9359ff4899c5f: baseline-arm-baylibre 2026-04-02 22:46:07,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4ea48df9359ff4899c5f 2026-04-02 22:46:07,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:46:07,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4ea48df9359ff4899c5f HTTP/1.1" 200 None 2026-04-02 22:46:07,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:46:07,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:46:07,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:46:07,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4ea48df9359ff4899c5f HTTP/1.1" 200 None 2026-04-02 22:46:07,346 - lava_callback - ERROR - Error processing callback for node 69cc4ea48df9359ff4899c5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38532 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:47:27,377 - lava_callback - INFO - Received callback for node 69cc4eea8df9359ff4899c75 INFO: 172.20.0.1:38538 - "POST /node/69cc4eea8df9359ff4899c75 HTTP/1.0" 202 Accepted 2026-04-02 22:47:27,382 - lava_callback - INFO - Starting async job submit for node 69cc4eea8df9359ff4899c75 2026-04-02 22:47:27,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:47:27,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4eea8df9359ff4899c75 HTTP/1.1" 200 None 2026-04-02 22:47:27,399 - lava_callback - DEBUG - Processing node 69cc4eea8df9359ff4899c75: baseline-arm-baylibre 2026-04-02 22:47:27,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4eea8df9359ff4899c75 2026-04-02 22:47:27,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:47:27,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4eea8df9359ff4899c75 HTTP/1.1" 200 None 2026-04-02 22:47:27,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:47:27,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:47:27,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:47:27,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4eea8df9359ff4899c75 HTTP/1.1" 200 None 2026-04-02 22:47:27,460 - lava_callback - ERROR - Error processing callback for node 69cc4eea8df9359ff4899c75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:48:27,394 - lava_callback - INFO - Received callback for node 69cc4f2f8df9359ff4899c86 INFO: 172.20.0.1:57796 - "POST /node/69cc4f2f8df9359ff4899c86 HTTP/1.0" 202 Accepted 2026-04-02 22:48:27,400 - lava_callback - INFO - Starting async job submit for node 69cc4f2f8df9359ff4899c86 2026-04-02 22:48:27,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:48:27,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4f2f8df9359ff4899c86 HTTP/1.1" 200 None 2026-04-02 22:48:27,425 - lava_callback - DEBUG - Processing node 69cc4f2f8df9359ff4899c86: baseline-arm-baylibre 2026-04-02 22:48:27,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4f2f8df9359ff4899c86 2026-04-02 22:48:27,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:48:27,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4f2f8df9359ff4899c86 HTTP/1.1" 200 None 2026-04-02 22:48:27,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:48:27,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:48:27,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:48:27,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4f2f8df9359ff4899c86 HTTP/1.1" 200 None 2026-04-02 22:48:27,490 - lava_callback - ERROR - Error processing callback for node 69cc4f2f8df9359ff4899c86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51874 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:49:07,478 - lava_callback - INFO - Received callback for node 69cc4f568df9359ff4899c8f INFO: 172.20.0.1:51876 - "POST /node/69cc4f568df9359ff4899c8f HTTP/1.0" 202 Accepted 2026-04-02 22:49:07,484 - lava_callback - INFO - Starting async job submit for node 69cc4f568df9359ff4899c8f 2026-04-02 22:49:07,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:49:07,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4f568df9359ff4899c8f HTTP/1.1" 200 None 2026-04-02 22:49:07,499 - lava_callback - DEBUG - Processing node 69cc4f568df9359ff4899c8f: baseline-arm-baylibre 2026-04-02 22:49:07,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4f568df9359ff4899c8f 2026-04-02 22:49:07,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:49:07,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4f568df9359ff4899c8f HTTP/1.1" 200 None 2026-04-02 22:49:07,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:49:07,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:49:07,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:49:07,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4f568df9359ff4899c8f HTTP/1.1" 200 None 2026-04-02 22:49:07,560 - lava_callback - ERROR - Error processing callback for node 69cc4f568df9359ff4899c8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43200 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:49:47,503 - lava_callback - INFO - Received callback for node 69cc4f818df9359ff4899ca3 INFO: 172.20.0.1:43216 - "POST /node/69cc4f818df9359ff4899ca3 HTTP/1.0" 202 Accepted 2026-04-02 22:49:47,508 - lava_callback - INFO - Starting async job submit for node 69cc4f818df9359ff4899ca3 2026-04-02 22:49:47,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:49:47,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4f818df9359ff4899ca3 HTTP/1.1" 200 None 2026-04-02 22:49:47,525 - lava_callback - DEBUG - Processing node 69cc4f818df9359ff4899ca3: baseline-arm-baylibre 2026-04-02 22:49:47,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4f818df9359ff4899ca3 2026-04-02 22:49:47,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:49:47,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4f818df9359ff4899ca3 HTTP/1.1" 200 None 2026-04-02 22:49:47,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:49:47,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:49:47,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:49:47,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4f818df9359ff4899ca3 HTTP/1.1" 200 None 2026-04-02 22:49:47,588 - lava_callback - ERROR - Error processing callback for node 69cc4f818df9359ff4899ca3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36180 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:50:27,510 - lava_callback - INFO - Received callback for node 69cc4faa8df9359ff4899cb0 INFO: 172.20.0.1:36190 - "POST /node/69cc4faa8df9359ff4899cb0 HTTP/1.0" 202 Accepted 2026-04-02 22:50:27,515 - lava_callback - INFO - Starting async job submit for node 69cc4faa8df9359ff4899cb0 2026-04-02 22:50:27,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:50:27,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4faa8df9359ff4899cb0 HTTP/1.1" 200 None 2026-04-02 22:50:27,538 - lava_callback - DEBUG - Processing node 69cc4faa8df9359ff4899cb0: baseline-arm-baylibre 2026-04-02 22:50:27,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4faa8df9359ff4899cb0 2026-04-02 22:50:27,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:50:27,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4faa8df9359ff4899cb0 HTTP/1.1" 200 None 2026-04-02 22:50:27,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:50:27,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:50:27,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:50:27,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4faa8df9359ff4899cb0 HTTP/1.1" 200 None 2026-04-02 22:50:27,595 - lava_callback - ERROR - Error processing callback for node 69cc4faa8df9359ff4899cb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:51:07,481 - lava_callback - INFO - Received callback for node 69cc4fd78df9359ff4899cbe INFO: 172.20.0.1:53156 - "POST /node/69cc4fd78df9359ff4899cbe HTTP/1.0" 202 Accepted 2026-04-02 22:51:07,487 - lava_callback - INFO - Starting async job submit for node 69cc4fd78df9359ff4899cbe 2026-04-02 22:51:07,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:51:07,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4fd78df9359ff4899cbe HTTP/1.1" 200 None 2026-04-02 22:51:07,513 - lava_callback - DEBUG - Processing node 69cc4fd78df9359ff4899cbe: baseline-arm-baylibre 2026-04-02 22:51:07,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc4fd78df9359ff4899cbe 2026-04-02 22:51:07,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:51:07,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc4fd78df9359ff4899cbe HTTP/1.1" 200 None 2026-04-02 22:51:07,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:51:07,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:51:07,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:51:07,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc4fd78df9359ff4899cbe HTTP/1.1" 200 None 2026-04-02 22:51:07,564 - lava_callback - ERROR - Error processing callback for node 69cc4fd78df9359ff4899cbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36514 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:52:06,960 - lava_callback - INFO - Received callback for node 69cc50048df9359ff4899ccf INFO: 172.20.0.1:36530 - "POST /node/69cc50048df9359ff4899ccf HTTP/1.0" 202 Accepted 2026-04-02 22:52:06,965 - lava_callback - INFO - Starting async job submit for node 69cc50048df9359ff4899ccf 2026-04-02 22:52:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:52:06,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50048df9359ff4899ccf HTTP/1.1" 200 None 2026-04-02 22:52:06,982 - lava_callback - DEBUG - Processing node 69cc50048df9359ff4899ccf: baseline-arm-clabbe 2026-04-02 22:52:06,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc50048df9359ff4899ccf 2026-04-02 22:52:06,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:52:06,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50048df9359ff4899ccf HTTP/1.1" 200 None 2026-04-02 22:52:06,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:52:07,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:52:07,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:52:07,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc50048df9359ff4899ccf HTTP/1.1" 200 None 2026-04-02 22:52:07,032 - lava_callback - ERROR - Error processing callback for node 69cc50048df9359ff4899ccf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38156 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:52:46,937 - lava_callback - INFO - Received callback for node 69cc50308df9359ff4899cfb INFO: 172.20.0.1:38162 - "POST /node/69cc50308df9359ff4899cfb HTTP/1.0" 202 Accepted 2026-04-02 22:52:46,943 - lava_callback - INFO - Starting async job submit for node 69cc50308df9359ff4899cfb 2026-04-02 22:52:46,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:52:46,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50308df9359ff4899cfb HTTP/1.1" 200 None 2026-04-02 22:52:46,958 - lava_callback - DEBUG - Processing node 69cc50308df9359ff4899cfb: baseline-arm-clabbe 2026-04-02 22:52:46,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc50308df9359ff4899cfb 2026-04-02 22:52:46,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:52:46,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50308df9359ff4899cfb HTTP/1.1" 200 None 2026-04-02 22:52:46,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:52:46,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:52:46,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:52:47,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc50308df9359ff4899cfb HTTP/1.1" 200 None 2026-04-02 22:52:47,016 - lava_callback - ERROR - Error processing callback for node 69cc50308df9359ff4899cfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41778 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:53:27,036 - lava_callback - INFO - Received callback for node 69cc505b8df9359ff4899d14 INFO: 172.20.0.1:41786 - "POST /node/69cc505b8df9359ff4899d14 HTTP/1.0" 202 Accepted 2026-04-02 22:53:27,041 - lava_callback - INFO - Starting async job submit for node 69cc505b8df9359ff4899d14 2026-04-02 22:53:27,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:53:27,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc505b8df9359ff4899d14 HTTP/1.1" 200 None 2026-04-02 22:53:27,064 - lava_callback - DEBUG - Processing node 69cc505b8df9359ff4899d14: baseline-arm-clabbe 2026-04-02 22:53:27,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc505b8df9359ff4899d14 2026-04-02 22:53:27,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:53:27,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc505b8df9359ff4899d14 HTTP/1.1" 200 None 2026-04-02 22:53:27,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:53:27,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:53:27,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:53:27,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc505b8df9359ff4899d14 HTTP/1.1" 200 None 2026-04-02 22:53:27,115 - lava_callback - ERROR - Error processing callback for node 69cc505b8df9359ff4899d14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46426 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:54:07,013 - lava_callback - INFO - Received callback for node 69cc50858df9359ff4899d21 INFO: 172.20.0.1:46440 - "POST /node/69cc50858df9359ff4899d21 HTTP/1.0" 202 Accepted 2026-04-02 22:54:07,018 - lava_callback - INFO - Starting async job submit for node 69cc50858df9359ff4899d21 2026-04-02 22:54:07,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:54:07,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50858df9359ff4899d21 HTTP/1.1" 200 None 2026-04-02 22:54:07,034 - lava_callback - DEBUG - Processing node 69cc50858df9359ff4899d21: baseline-arm-clabbe 2026-04-02 22:54:07,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc50858df9359ff4899d21 2026-04-02 22:54:07,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:54:07,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50858df9359ff4899d21 HTTP/1.1" 200 None 2026-04-02 22:54:07,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:54:07,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:54:07,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:54:07,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc50858df9359ff4899d21 HTTP/1.1" 200 None 2026-04-02 22:54:07,095 - lava_callback - ERROR - Error processing callback for node 69cc50858df9359ff4899d21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42836 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:54:47,089 - lava_callback - INFO - Received callback for node 69cc50b38df9359ff4899d2d INFO: 172.20.0.1:42850 - "POST /node/69cc50b38df9359ff4899d2d HTTP/1.0" 202 Accepted 2026-04-02 22:54:47,094 - lava_callback - INFO - Starting async job submit for node 69cc50b38df9359ff4899d2d 2026-04-02 22:54:47,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:54:47,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50b38df9359ff4899d2d HTTP/1.1" 200 None 2026-04-02 22:54:47,111 - lava_callback - DEBUG - Processing node 69cc50b38df9359ff4899d2d: baseline-arm-clabbe 2026-04-02 22:54:47,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc50b38df9359ff4899d2d 2026-04-02 22:54:47,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:54:47,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50b38df9359ff4899d2d HTTP/1.1" 200 None 2026-04-02 22:54:47,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:54:47,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:54:47,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:54:47,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc50b38df9359ff4899d2d HTTP/1.1" 200 None 2026-04-02 22:54:47,168 - lava_callback - ERROR - Error processing callback for node 69cc50b38df9359ff4899d2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46862 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:55:47,177 - lava_callback - INFO - Received callback for node 69cc50dd8df9359ff4899d35 INFO: 172.20.0.1:46874 - "POST /node/69cc50dd8df9359ff4899d35 HTTP/1.0" 202 Accepted 2026-04-02 22:55:47,183 - lava_callback - INFO - Starting async job submit for node 69cc50dd8df9359ff4899d35 2026-04-02 22:55:47,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:55:47,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50dd8df9359ff4899d35 HTTP/1.1" 200 None 2026-04-02 22:55:47,199 - lava_callback - DEBUG - Processing node 69cc50dd8df9359ff4899d35: baseline-arm-clabbe 2026-04-02 22:55:47,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc50dd8df9359ff4899d35 2026-04-02 22:55:47,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:55:47,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc50dd8df9359ff4899d35 HTTP/1.1" 200 None 2026-04-02 22:55:47,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:55:47,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:55:47,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:55:47,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc50dd8df9359ff4899d35 HTTP/1.1" 200 None 2026-04-02 22:55:47,275 - lava_callback - ERROR - Error processing callback for node 69cc50dd8df9359ff4899d35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39784 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:56:27,131 - lava_callback - INFO - Received callback for node 69cc51098df9359ff4899d47 INFO: 172.20.0.1:39792 - "POST /node/69cc51098df9359ff4899d47 HTTP/1.0" 202 Accepted 2026-04-02 22:56:27,136 - lava_callback - INFO - Starting async job submit for node 69cc51098df9359ff4899d47 2026-04-02 22:56:27,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:56:27,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc51098df9359ff4899d47 HTTP/1.1" 200 None 2026-04-02 22:56:27,153 - lava_callback - DEBUG - Processing node 69cc51098df9359ff4899d47: baseline-arm-clabbe 2026-04-02 22:56:27,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc51098df9359ff4899d47 2026-04-02 22:56:27,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:56:27,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc51098df9359ff4899d47 HTTP/1.1" 200 None 2026-04-02 22:56:27,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:56:27,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:56:27,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:56:27,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc51098df9359ff4899d47 HTTP/1.1" 200 None 2026-04-02 22:56:27,210 - lava_callback - ERROR - Error processing callback for node 69cc51098df9359ff4899d47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47810 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:57:07,201 - lava_callback - INFO - Received callback for node 69cc51338df9359ff4899d55 INFO: 172.20.0.1:47812 - "POST /node/69cc51338df9359ff4899d55 HTTP/1.0" 202 Accepted 2026-04-02 22:57:07,206 - lava_callback - INFO - Starting async job submit for node 69cc51338df9359ff4899d55 2026-04-02 22:57:07,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:57:07,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc51338df9359ff4899d55 HTTP/1.1" 200 None 2026-04-02 22:57:07,223 - lava_callback - DEBUG - Processing node 69cc51338df9359ff4899d55: baseline-arm-clabbe 2026-04-02 22:57:07,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc51338df9359ff4899d55 2026-04-02 22:57:07,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:57:07,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc51338df9359ff4899d55 HTTP/1.1" 200 None 2026-04-02 22:57:07,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:57:07,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:57:07,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:57:07,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc51338df9359ff4899d55 HTTP/1.1" 200 None 2026-04-02 22:57:07,279 - lava_callback - ERROR - Error processing callback for node 69cc51338df9359ff4899d55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59168 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:57:47,215 - lava_callback - INFO - Received callback for node 69cc515d8df9359ff4899d94 INFO: 172.20.0.1:59174 - "POST /node/69cc515d8df9359ff4899d94 HTTP/1.0" 202 Accepted 2026-04-02 22:57:47,220 - lava_callback - INFO - Starting async job submit for node 69cc515d8df9359ff4899d94 2026-04-02 22:57:47,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:57:47,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc515d8df9359ff4899d94 HTTP/1.1" 200 None 2026-04-02 22:57:47,266 - lava_callback - DEBUG - Processing node 69cc515d8df9359ff4899d94: baseline-arm-clabbe 2026-04-02 22:57:47,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc515d8df9359ff4899d94 2026-04-02 22:57:47,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:57:47,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc515d8df9359ff4899d94 HTTP/1.1" 200 None 2026-04-02 22:57:47,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:57:47,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:57:47,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:57:47,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc515d8df9359ff4899d94 HTTP/1.1" 200 None 2026-04-02 22:57:47,328 - lava_callback - ERROR - Error processing callback for node 69cc515d8df9359ff4899d94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58770 - "GET / HTTP/1.0" 200 OK 2026-04-02 22:58:27,280 - lava_callback - INFO - Received callback for node 69cc51878df9359ff4899da4 INFO: 172.20.0.1:58776 - "POST /node/69cc51878df9359ff4899da4 HTTP/1.0" 202 Accepted 2026-04-02 22:58:27,288 - lava_callback - INFO - Starting async job submit for node 69cc51878df9359ff4899da4 2026-04-02 22:58:27,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:58:27,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc51878df9359ff4899da4 HTTP/1.1" 200 None 2026-04-02 22:58:27,305 - lava_callback - DEBUG - Processing node 69cc51878df9359ff4899da4: baseline-arm-clabbe 2026-04-02 22:58:27,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc51878df9359ff4899da4 2026-04-02 22:58:27,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:58:27,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc51878df9359ff4899da4 HTTP/1.1" 200 None 2026-04-02 22:58:27,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:58:27,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-02 22:58:27,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 22:58:27,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc51878df9359ff4899da4 HTTP/1.1" 200 None 2026-04-02 22:58:27,368 - lava_callback - ERROR - Error processing callback for node 69cc51878df9359ff4899da4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36766 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:00:28,115 - lava_callback - INFO - Received callback for node 69cc51fe8df9359ff4899dc4 INFO: 172.20.0.1:36776 - "POST /node/69cc51fe8df9359ff4899dc4 HTTP/1.0" 202 Accepted 2026-04-02 23:00:28,120 - lava_callback - INFO - Starting async job submit for node 69cc51fe8df9359ff4899dc4 2026-04-02 23:00:28,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:00:28,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc51fe8df9359ff4899dc4 HTTP/1.1" 200 None 2026-04-02 23:00:28,137 - lava_callback - DEBUG - Processing node 69cc51fe8df9359ff4899dc4: baseline-arm-baylibre 2026-04-02 23:00:28,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc51fe8df9359ff4899dc4 2026-04-02 23:00:28,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:00:28,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc51fe8df9359ff4899dc4 HTTP/1.1" 200 None 2026-04-02 23:00:28,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:00:28,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:00:28,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:00:28,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc51fe8df9359ff4899dc4 HTTP/1.1" 200 None 2026-04-02 23:00:28,199 - lava_callback - ERROR - Error processing callback for node 69cc51fe8df9359ff4899dc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33634 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:01:08,055 - lava_callback - INFO - Received callback for node 69cc52278df9359ff4899dcc INFO: 172.20.0.1:33642 - "POST /node/69cc52278df9359ff4899dcc HTTP/1.0" 202 Accepted 2026-04-02 23:01:08,061 - lava_callback - INFO - Starting async job submit for node 69cc52278df9359ff4899dcc 2026-04-02 23:01:08,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:01:08,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc52278df9359ff4899dcc HTTP/1.1" 200 None 2026-04-02 23:01:08,085 - lava_callback - DEBUG - Processing node 69cc52278df9359ff4899dcc: baseline-arm-baylibre 2026-04-02 23:01:08,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc52278df9359ff4899dcc 2026-04-02 23:01:08,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:01:08,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc52278df9359ff4899dcc HTTP/1.1" 200 None 2026-04-02 23:01:08,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:01:08,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:01:08,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:01:08,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc52278df9359ff4899dcc HTTP/1.1" 200 None 2026-04-02 23:01:08,145 - lava_callback - ERROR - Error processing callback for node 69cc52278df9359ff4899dcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56920 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:01:48,098 - lava_callback - INFO - Received callback for node 69cc52508df9359ff4899dd8 INFO: 172.20.0.1:56924 - "POST /node/69cc52508df9359ff4899dd8 HTTP/1.0" 202 Accepted 2026-04-02 23:01:48,105 - lava_callback - INFO - Starting async job submit for node 69cc52508df9359ff4899dd8 2026-04-02 23:01:48,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:01:48,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc52508df9359ff4899dd8 HTTP/1.1" 200 None 2026-04-02 23:01:48,131 - lava_callback - DEBUG - Processing node 69cc52508df9359ff4899dd8: baseline-arm-baylibre 2026-04-02 23:01:48,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc52508df9359ff4899dd8 2026-04-02 23:01:48,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:01:48,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc52508df9359ff4899dd8 HTTP/1.1" 200 None 2026-04-02 23:01:48,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:01:48,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:01:48,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:01:48,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc52508df9359ff4899dd8 HTTP/1.1" 200 None 2026-04-02 23:01:48,189 - lava_callback - ERROR - Error processing callback for node 69cc52508df9359ff4899dd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45954 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:02:28,074 - lava_callback - INFO - Received callback for node 69cc527b8df9359ff4899de6 INFO: 172.20.0.1:45962 - "POST /node/69cc527b8df9359ff4899de6 HTTP/1.0" 202 Accepted 2026-04-02 23:02:28,083 - lava_callback - INFO - Starting async job submit for node 69cc527b8df9359ff4899de6 2026-04-02 23:02:28,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:02:28,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc527b8df9359ff4899de6 HTTP/1.1" 200 None 2026-04-02 23:02:28,109 - lava_callback - DEBUG - Processing node 69cc527b8df9359ff4899de6: baseline-arm-baylibre 2026-04-02 23:02:28,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc527b8df9359ff4899de6 2026-04-02 23:02:28,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:02:28,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc527b8df9359ff4899de6 HTTP/1.1" 200 None 2026-04-02 23:02:28,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:02:28,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:02:28,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:02:28,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc527b8df9359ff4899de6 HTTP/1.1" 200 None 2026-04-02 23:02:28,168 - lava_callback - ERROR - Error processing callback for node 69cc527b8df9359ff4899de6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:04:08,251 - lava_callback - INFO - Received callback for node 69cc52d58df9359ff4899df3 INFO: 172.20.0.1:42348 - "POST /node/69cc52d58df9359ff4899df3 HTTP/1.0" 202 Accepted 2026-04-02 23:04:08,257 - lava_callback - INFO - Starting async job submit for node 69cc52d58df9359ff4899df3 2026-04-02 23:04:08,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:04:08,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc52d58df9359ff4899df3 HTTP/1.1" 200 None 2026-04-02 23:04:08,273 - lava_callback - DEBUG - Processing node 69cc52d58df9359ff4899df3: baseline-arm-baylibre 2026-04-02 23:04:08,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc52d58df9359ff4899df3 2026-04-02 23:04:08,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:04:08,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc52d58df9359ff4899df3 HTTP/1.1" 200 None 2026-04-02 23:04:08,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:04:08,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:04:08,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:04:08,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc52d58df9359ff4899df3 HTTP/1.1" 200 None 2026-04-02 23:04:08,331 - lava_callback - ERROR - Error processing callback for node 69cc52d58df9359ff4899df3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:06:07,684 - lava_callback - INFO - Received callback for node 69cc53558df9359ff4899e16 INFO: 172.20.0.1:53598 - "POST /node/69cc53558df9359ff4899e16 HTTP/1.0" 202 Accepted 2026-04-02 23:06:07,690 - lava_callback - INFO - Starting async job submit for node 69cc53558df9359ff4899e16 2026-04-02 23:06:07,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:06:07,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc53558df9359ff4899e16 HTTP/1.1" 200 None 2026-04-02 23:06:07,706 - lava_callback - DEBUG - Processing node 69cc53558df9359ff4899e16: baseline-arm-clabbe 2026-04-02 23:06:07,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc53558df9359ff4899e16 2026-04-02 23:06:07,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:06:07,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc53558df9359ff4899e16 HTTP/1.1" 200 None 2026-04-02 23:06:07,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:06:07,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:06:07,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:06:07,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc53558df9359ff4899e16 HTTP/1.1" 200 None 2026-04-02 23:06:07,761 - lava_callback - ERROR - Error processing callback for node 69cc53558df9359ff4899e16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49698 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:06:47,691 - lava_callback - INFO - Received callback for node 69cc537f8df9359ff4899e24 INFO: 172.20.0.1:49706 - "POST /node/69cc537f8df9359ff4899e24 HTTP/1.0" 202 Accepted 2026-04-02 23:06:47,696 - lava_callback - INFO - Starting async job submit for node 69cc537f8df9359ff4899e24 2026-04-02 23:06:47,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:06:47,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc537f8df9359ff4899e24 HTTP/1.1" 200 None 2026-04-02 23:06:47,720 - lava_callback - DEBUG - Processing node 69cc537f8df9359ff4899e24: baseline-arm-clabbe 2026-04-02 23:06:47,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc537f8df9359ff4899e24 2026-04-02 23:06:47,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:06:47,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc537f8df9359ff4899e24 HTTP/1.1" 200 None 2026-04-02 23:06:47,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:06:47,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:06:47,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:06:47,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc537f8df9359ff4899e24 HTTP/1.1" 200 None 2026-04-02 23:06:47,782 - lava_callback - ERROR - Error processing callback for node 69cc537f8df9359ff4899e24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34502 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:07:27,748 - lava_callback - INFO - Received callback for node 69cc53a88df9359ff4899e2e INFO: 172.20.0.1:34514 - "POST /node/69cc53a88df9359ff4899e2e HTTP/1.0" 202 Accepted 2026-04-02 23:07:27,757 - lava_callback - INFO - Starting async job submit for node 69cc53a88df9359ff4899e2e 2026-04-02 23:07:27,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:07:27,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc53a88df9359ff4899e2e HTTP/1.1" 200 None 2026-04-02 23:07:27,773 - lava_callback - DEBUG - Processing node 69cc53a88df9359ff4899e2e: baseline-arm-clabbe 2026-04-02 23:07:27,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc53a88df9359ff4899e2e 2026-04-02 23:07:27,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:07:27,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc53a88df9359ff4899e2e HTTP/1.1" 200 None 2026-04-02 23:07:27,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:07:27,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:07:27,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:07:27,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc53a88df9359ff4899e2e HTTP/1.1" 200 None 2026-04-02 23:07:27,826 - lava_callback - ERROR - Error processing callback for node 69cc53a88df9359ff4899e2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36780 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:08:07,807 - lava_callback - INFO - Received callback for node 69cc53d18df9359ff4899e38 INFO: 172.20.0.1:36788 - "POST /node/69cc53d18df9359ff4899e38 HTTP/1.0" 202 Accepted 2026-04-02 23:08:07,812 - lava_callback - INFO - Starting async job submit for node 69cc53d18df9359ff4899e38 2026-04-02 23:08:07,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:08:07,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc53d18df9359ff4899e38 HTTP/1.1" 200 None 2026-04-02 23:08:07,828 - lava_callback - DEBUG - Processing node 69cc53d18df9359ff4899e38: baseline-arm-clabbe 2026-04-02 23:08:07,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc53d18df9359ff4899e38 2026-04-02 23:08:07,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:08:07,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc53d18df9359ff4899e38 HTTP/1.1" 200 None 2026-04-02 23:08:07,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:08:07,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:08:07,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:08:07,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc53d18df9359ff4899e38 HTTP/1.1" 200 None 2026-04-02 23:08:07,878 - lava_callback - ERROR - Error processing callback for node 69cc53d18df9359ff4899e38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38786 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:08:47,800 - lava_callback - INFO - Received callback for node 69cc53fd8df9359ff4899e46 INFO: 172.20.0.1:38788 - "POST /node/69cc53fd8df9359ff4899e46 HTTP/1.0" 202 Accepted 2026-04-02 23:08:47,806 - lava_callback - INFO - Starting async job submit for node 69cc53fd8df9359ff4899e46 2026-04-02 23:08:47,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:08:47,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc53fd8df9359ff4899e46 HTTP/1.1" 200 None 2026-04-02 23:08:47,821 - lava_callback - DEBUG - Processing node 69cc53fd8df9359ff4899e46: baseline-arm-clabbe 2026-04-02 23:08:47,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc53fd8df9359ff4899e46 2026-04-02 23:08:47,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:08:47,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc53fd8df9359ff4899e46 HTTP/1.1" 200 None 2026-04-02 23:08:47,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:08:47,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:08:47,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:08:47,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc53fd8df9359ff4899e46 HTTP/1.1" 200 None 2026-04-02 23:08:47,897 - lava_callback - ERROR - Error processing callback for node 69cc53fd8df9359ff4899e46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44048 - "GET /node/698bda541e517752bab8b8fb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56232 - "GET /node/69926a0798a8bdb31c3924d8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53862 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:09:47,843 - lava_callback - INFO - Received callback for node 69cc54258df9359ff4899e4f INFO: 172.20.0.1:53874 - "POST /node/69cc54258df9359ff4899e4f HTTP/1.0" 202 Accepted 2026-04-02 23:09:47,848 - lava_callback - INFO - Starting async job submit for node 69cc54258df9359ff4899e4f 2026-04-02 23:09:47,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:09:47,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc54258df9359ff4899e4f HTTP/1.1" 200 None 2026-04-02 23:09:47,864 - lava_callback - DEBUG - Processing node 69cc54258df9359ff4899e4f: baseline-arm-clabbe 2026-04-02 23:09:47,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc54258df9359ff4899e4f 2026-04-02 23:09:47,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:09:47,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc54258df9359ff4899e4f HTTP/1.1" 200 None 2026-04-02 23:09:47,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:09:47,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-02 23:09:47,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:09:47,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc54258df9359ff4899e4f HTTP/1.1" 200 None 2026-04-02 23:09:47,920 - lava_callback - ERROR - Error processing callback for node 69cc54258df9359ff4899e4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET /node/6983a1c866dc8a56088a6827%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57752 - "GET /node/693ae380fee8383e92b64162%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57766 - "GET /node/6992fafe31166481c8dde3dd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET /node/69865457177ca0f097bd4029%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46758 - "GET /node/693b7a1141fb4c9509762775%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46766 - "GET /node/693a80b2e17cfbe560b12bd6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET /node/693b42e64b47c3f87266ed78%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50484 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:19:08,996 - lava_callback - INFO - Received callback for node 69cc56648df9359ff4899f95 INFO: 172.20.0.1:50498 - "POST /node/69cc56648df9359ff4899f95 HTTP/1.0" 202 Accepted 2026-04-02 23:19:09,002 - lava_callback - INFO - Starting async job submit for node 69cc56648df9359ff4899f95 2026-04-02 23:19:09,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:19:09,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc56648df9359ff4899f95 HTTP/1.1" 200 None 2026-04-02 23:19:09,018 - lava_callback - DEBUG - Processing node 69cc56648df9359ff4899f95: baseline-arm64-baylibre 2026-04-02 23:19:09,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc56648df9359ff4899f95 2026-04-02 23:19:09,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:19:09,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc56648df9359ff4899f95 HTTP/1.1" 200 None 2026-04-02 23:19:09,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:19:09,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:19:09,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:19:09,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc56648df9359ff4899f95 HTTP/1.1" 200 None 2026-04-02 23:19:09,085 - lava_callback - ERROR - Error processing callback for node 69cc56648df9359ff4899f95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53798 - "GET /node/68fb3a8a5818c913a1e190d1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59526 - "GET /node/693f76530d8ce4018da94329%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59534 - "GET /node/6988c1e39fc35f969e1edf2b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:22:09,171 - lava_callback - INFO - Received callback for node 69cc57198df9359ff4899ff2 INFO: 172.20.0.1:32844 - "POST /node/69cc57198df9359ff4899ff2 HTTP/1.0" 202 Accepted 2026-04-02 23:22:09,177 - lava_callback - INFO - Starting async job submit for node 69cc57198df9359ff4899ff2 2026-04-02 23:22:09,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:22:09,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc57198df9359ff4899ff2 HTTP/1.1" 200 None 2026-04-02 23:22:09,200 - lava_callback - DEBUG - Processing node 69cc57198df9359ff4899ff2: baseline-arm64-baylibre 2026-04-02 23:22:09,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc57198df9359ff4899ff2 2026-04-02 23:22:09,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:22:09,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc57198df9359ff4899ff2 HTTP/1.1" 200 None 2026-04-02 23:22:09,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:22:09,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:22:09,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:22:09,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc57198df9359ff4899ff2 HTTP/1.1" 200 None 2026-04-02 23:22:09,271 - lava_callback - ERROR - Error processing callback for node 69cc57198df9359ff4899ff2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41432 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:23:49,255 - lava_callback - INFO - Received callback for node 69cc57728df9359ff489a02c INFO: 172.20.0.1:41444 - "POST /node/69cc57728df9359ff489a02c HTTP/1.0" 202 Accepted 2026-04-02 23:23:49,260 - lava_callback - INFO - Starting async job submit for node 69cc57728df9359ff489a02c 2026-04-02 23:23:49,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:23:49,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc57728df9359ff489a02c HTTP/1.1" 200 None 2026-04-02 23:23:49,283 - lava_callback - DEBUG - Processing node 69cc57728df9359ff489a02c: baseline-arm64-baylibre 2026-04-02 23:23:49,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc57728df9359ff489a02c 2026-04-02 23:23:49,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:23:49,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc57728df9359ff489a02c HTTP/1.1" 200 None 2026-04-02 23:23:49,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:23:49,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:23:49,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:23:49,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc57728df9359ff489a02c HTTP/1.1" 200 None 2026-04-02 23:23:49,345 - lava_callback - ERROR - Error processing callback for node 69cc57728df9359ff489a02c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54116 - "GET /node/698bd04d1e517752bab8ad9c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54124 - "GET /node/693e80fb3c8f1be6d3cf1d2b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50042 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:25:09,291 - lava_callback - INFO - Received callback for node 69cc57cc8df9359ff489a065 INFO: 172.20.0.1:50048 - "POST /node/69cc57cc8df9359ff489a065 HTTP/1.0" 202 Accepted 2026-04-02 23:25:09,296 - lava_callback - INFO - Starting async job submit for node 69cc57cc8df9359ff489a065 2026-04-02 23:25:09,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:25:09,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc57cc8df9359ff489a065 HTTP/1.1" 200 None 2026-04-02 23:25:09,312 - lava_callback - DEBUG - Processing node 69cc57cc8df9359ff489a065: baseline-arm64-baylibre 2026-04-02 23:25:09,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc57cc8df9359ff489a065 2026-04-02 23:25:09,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:25:09,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc57cc8df9359ff489a065 HTTP/1.1" 200 None 2026-04-02 23:25:09,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:25:09,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:25:09,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:25:09,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc57cc8df9359ff489a065 HTTP/1.1" 200 None 2026-04-02 23:25:09,367 - lava_callback - ERROR - Error processing callback for node 69cc57cc8df9359ff489a065: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54284 - "GET /node/69b7e1b100b80c8ffdcb8eff%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55400 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:26:49,397 - lava_callback - INFO - Received callback for node 69cc58248df9359ff489a0a0 INFO: 172.20.0.1:55408 - "POST /node/69cc58248df9359ff489a0a0 HTTP/1.0" 202 Accepted 2026-04-02 23:26:49,402 - lava_callback - INFO - Starting async job submit for node 69cc58248df9359ff489a0a0 2026-04-02 23:26:49,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:26:49,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc58248df9359ff489a0a0 HTTP/1.1" 200 None 2026-04-02 23:26:49,418 - lava_callback - DEBUG - Processing node 69cc58248df9359ff489a0a0: baseline-arm64-baylibre 2026-04-02 23:26:49,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc58248df9359ff489a0a0 2026-04-02 23:26:49,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:26:49,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc58248df9359ff489a0a0 HTTP/1.1" 200 None 2026-04-02 23:26:49,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:26:49,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:26:49,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:26:49,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc58248df9359ff489a0a0 HTTP/1.1" 200 None 2026-04-02 23:26:49,472 - lava_callback - ERROR - Error processing callback for node 69cc58248df9359ff489a0a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40662 - "GET /node/69b3684c974c91e64560f0d9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40670 - "GET /node/69a1cc419230c437a22de2f2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET /node/69402da7575bc060ce155cd2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36454 - "GET /node/693fa97d0d8ce4018da9b18a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49470 - "GET /node/6910425ef4a91d81a0ec546b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34268 - "GET /node/69876c14e31b58f834f198f1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51198 - "GET /node/693719c193bfb52307cd3b5d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59856 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:36:49,064 - lava_callback - INFO - Received callback for node 69cc5a828df9359ff489a1e0 INFO: 172.20.0.1:59864 - "POST /node/69cc5a828df9359ff489a1e0 HTTP/1.0" 202 Accepted 2026-04-02 23:36:49,070 - lava_callback - INFO - Starting async job submit for node 69cc5a828df9359ff489a1e0 2026-04-02 23:36:49,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:36:49,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5a828df9359ff489a1e0 HTTP/1.1" 200 None 2026-04-02 23:36:49,087 - lava_callback - DEBUG - Processing node 69cc5a828df9359ff489a1e0: baseline-arm64-clabbe 2026-04-02 23:36:49,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5a828df9359ff489a1e0 2026-04-02 23:36:49,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:36:49,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5a828df9359ff489a1e0 HTTP/1.1" 200 None 2026-04-02 23:36:49,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:36:49,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:36:49,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:36:49,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5a828df9359ff489a1e0 HTTP/1.1" 200 None 2026-04-02 23:36:49,150 - lava_callback - ERROR - Error processing callback for node 69cc5a828df9359ff489a1e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37148 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:38:09,082 - lava_callback - INFO - Received callback for node 69cc5ad68df9359ff489a1fe INFO: 172.20.0.1:37152 - "POST /node/69cc5ad68df9359ff489a1fe HTTP/1.0" 202 Accepted 2026-04-02 23:38:09,088 - lava_callback - INFO - Starting async job submit for node 69cc5ad68df9359ff489a1fe 2026-04-02 23:38:09,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:38:09,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5ad68df9359ff489a1fe HTTP/1.1" 200 None 2026-04-02 23:38:09,105 - lava_callback - DEBUG - Processing node 69cc5ad68df9359ff489a1fe: baseline-arm64-clabbe 2026-04-02 23:38:09,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5ad68df9359ff489a1fe 2026-04-02 23:38:09,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:38:09,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5ad68df9359ff489a1fe HTTP/1.1" 200 None 2026-04-02 23:38:09,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:38:09,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:38:09,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:38:09,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5ad68df9359ff489a1fe HTTP/1.1" 200 None 2026-04-02 23:38:09,166 - lava_callback - ERROR - Error processing callback for node 69cc5ad68df9359ff489a1fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37800 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:39:29,152 - lava_callback - INFO - Received callback for node 69cc5b2a8df9359ff489a21e INFO: 172.20.0.1:37812 - "POST /node/69cc5b2a8df9359ff489a21e HTTP/1.0" 202 Accepted 2026-04-02 23:39:29,157 - lava_callback - INFO - Starting async job submit for node 69cc5b2a8df9359ff489a21e 2026-04-02 23:39:29,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:39:29,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5b2a8df9359ff489a21e HTTP/1.1" 200 None 2026-04-02 23:39:29,173 - lava_callback - DEBUG - Processing node 69cc5b2a8df9359ff489a21e: baseline-arm64-clabbe 2026-04-02 23:39:29,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5b2a8df9359ff489a21e 2026-04-02 23:39:29,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:39:29,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5b2a8df9359ff489a21e HTTP/1.1" 200 None 2026-04-02 23:39:29,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:39:29,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:39:29,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:39:29,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5b2a8df9359ff489a21e HTTP/1.1" 200 None 2026-04-02 23:39:29,243 - lava_callback - ERROR - Error processing callback for node 69cc5b2a8df9359ff489a21e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34204 - "GET /node/6986f7d66e077e4126a7d2b6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36904 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:41:09,173 - lava_callback - INFO - Received callback for node 69cc5b7f8df9359ff489a242 INFO: 172.20.0.1:36920 - "POST /node/69cc5b7f8df9359ff489a242 HTTP/1.0" 202 Accepted 2026-04-02 23:41:09,178 - lava_callback - INFO - Starting async job submit for node 69cc5b7f8df9359ff489a242 2026-04-02 23:41:09,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:41:09,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5b7f8df9359ff489a242 HTTP/1.1" 200 None 2026-04-02 23:41:09,195 - lava_callback - DEBUG - Processing node 69cc5b7f8df9359ff489a242: baseline-arm64-clabbe 2026-04-02 23:41:09,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5b7f8df9359ff489a242 2026-04-02 23:41:09,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:41:09,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5b7f8df9359ff489a242 HTTP/1.1" 200 None 2026-04-02 23:41:09,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:41:09,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:41:09,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:41:09,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5b7f8df9359ff489a242 HTTP/1.1" 200 None 2026-04-02 23:41:09,267 - lava_callback - ERROR - Error processing callback for node 69cc5b7f8df9359ff489a242: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39668 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:42:29,229 - lava_callback - INFO - Received callback for node 69cc5bd48df9359ff489a26f INFO: 172.20.0.1:39678 - "POST /node/69cc5bd48df9359ff489a26f HTTP/1.0" 202 Accepted 2026-04-02 23:42:29,234 - lava_callback - INFO - Starting async job submit for node 69cc5bd48df9359ff489a26f 2026-04-02 23:42:29,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:42:29,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5bd48df9359ff489a26f HTTP/1.1" 200 None 2026-04-02 23:42:29,258 - lava_callback - DEBUG - Processing node 69cc5bd48df9359ff489a26f: baseline-arm64-clabbe 2026-04-02 23:42:29,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5bd48df9359ff489a26f 2026-04-02 23:42:29,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:42:29,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5bd48df9359ff489a26f HTTP/1.1" 200 None 2026-04-02 23:42:29,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:42:29,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:42:29,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:42:29,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5bd48df9359ff489a26f HTTP/1.1" 200 None 2026-04-02 23:42:29,338 - lava_callback - ERROR - Error processing callback for node 69cc5bd48df9359ff489a26f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56872 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:43:49,325 - lava_callback - INFO - Received callback for node 69cc5c2a8df9359ff489a2a1 INFO: 172.20.0.1:56882 - "POST /node/69cc5c2a8df9359ff489a2a1 HTTP/1.0" 202 Accepted 2026-04-02 23:43:49,331 - lava_callback - INFO - Starting async job submit for node 69cc5c2a8df9359ff489a2a1 2026-04-02 23:43:49,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:43:49,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5c2a8df9359ff489a2a1 HTTP/1.1" 200 None 2026-04-02 23:43:49,347 - lava_callback - DEBUG - Processing node 69cc5c2a8df9359ff489a2a1: baseline-arm64-clabbe 2026-04-02 23:43:49,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5c2a8df9359ff489a2a1 2026-04-02 23:43:49,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:43:49,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5c2a8df9359ff489a2a1 HTTP/1.1" 200 None 2026-04-02 23:43:49,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:43:49,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-02 23:43:49,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:43:49,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5c2a8df9359ff489a2a1 HTTP/1.1" 200 None 2026-04-02 23:43:49,418 - lava_callback - ERROR - Error processing callback for node 69cc5c2a8df9359ff489a2a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37974 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:45:10,436 - lava_callback - INFO - Received callback for node 69cc5c738df9359ff489a2d5 INFO: 172.20.0.1:42018 - "POST /node/69cc5c738df9359ff489a2d5 HTTP/1.0" 202 Accepted 2026-04-02 23:45:10,442 - lava_callback - INFO - Starting async job submit for node 69cc5c738df9359ff489a2d5 2026-04-02 23:45:10,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:45:10,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5c738df9359ff489a2d5 HTTP/1.1" 200 None 2026-04-02 23:45:10,458 - lava_callback - DEBUG - Processing node 69cc5c738df9359ff489a2d5: baseline-arm64-baylibre 2026-04-02 23:45:10,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5c738df9359ff489a2d5 2026-04-02 23:45:10,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:45:10,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5c738df9359ff489a2d5 HTTP/1.1" 200 None 2026-04-02 23:45:10,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:45:10,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:45:10,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:45:10,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5c738df9359ff489a2d5 HTTP/1.1" 200 None 2026-04-02 23:45:10,534 - lava_callback - ERROR - Error processing callback for node 69cc5c738df9359ff489a2d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43076 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:46:30,458 - lava_callback - INFO - Received callback for node 69cc5cc98df9359ff489a307 INFO: 172.20.0.1:53842 - "POST /node/69cc5cc98df9359ff489a307 HTTP/1.0" 202 Accepted 2026-04-02 23:46:30,464 - lava_callback - INFO - Starting async job submit for node 69cc5cc98df9359ff489a307 2026-04-02 23:46:30,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:46:30,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5cc98df9359ff489a307 HTTP/1.1" 200 None 2026-04-02 23:46:30,480 - lava_callback - DEBUG - Processing node 69cc5cc98df9359ff489a307: baseline-arm64-baylibre 2026-04-02 23:46:30,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5cc98df9359ff489a307 2026-04-02 23:46:30,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:46:30,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5cc98df9359ff489a307 HTTP/1.1" 200 None 2026-04-02 23:46:30,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:46:30,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:46:30,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:46:30,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5cc98df9359ff489a307 HTTP/1.1" 200 None 2026-04-02 23:46:30,538 - lava_callback - ERROR - Error processing callback for node 69cc5cc98df9359ff489a307: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53798 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:49:30,600 - lava_callback - INFO - Received callback for node 69cc5d848df9359ff489a342 INFO: 172.20.0.1:42512 - "POST /node/69cc5d848df9359ff489a342 HTTP/1.0" 202 Accepted 2026-04-02 23:49:30,606 - lava_callback - INFO - Starting async job submit for node 69cc5d848df9359ff489a342 2026-04-02 23:49:30,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:49:30,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5d848df9359ff489a342 HTTP/1.1" 200 None 2026-04-02 23:49:30,622 - lava_callback - DEBUG - Processing node 69cc5d848df9359ff489a342: baseline-arm64-baylibre 2026-04-02 23:49:30,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5d848df9359ff489a342 2026-04-02 23:49:30,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:49:30,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5d848df9359ff489a342 HTTP/1.1" 200 None 2026-04-02 23:49:30,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:49:30,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:49:30,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:49:30,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5d848df9359ff489a342 HTTP/1.1" 200 None 2026-04-02 23:49:30,681 - lava_callback - ERROR - Error processing callback for node 69cc5d848df9359ff489a342: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48372 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:50:50,744 - lava_callback - INFO - Received callback for node 69cc5dd78df9359ff489a375 INFO: 172.20.0.1:41684 - "POST /node/69cc5dd78df9359ff489a375 HTTP/1.0" 202 Accepted 2026-04-02 23:50:50,750 - lava_callback - INFO - Starting async job submit for node 69cc5dd78df9359ff489a375 2026-04-02 23:50:50,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:50:50,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5dd78df9359ff489a375 HTTP/1.1" 200 None 2026-04-02 23:50:50,767 - lava_callback - DEBUG - Processing node 69cc5dd78df9359ff489a375: baseline-arm64-baylibre 2026-04-02 23:50:50,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5dd78df9359ff489a375 2026-04-02 23:50:50,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:50:50,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5dd78df9359ff489a375 HTTP/1.1" 200 None 2026-04-02 23:50:50,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:50:50,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:50:50,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:50:50,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5dd78df9359ff489a375 HTTP/1.1" 200 None 2026-04-02 23:50:50,820 - lava_callback - ERROR - Error processing callback for node 69cc5dd78df9359ff489a375: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:52:30,769 - lava_callback - INFO - Received callback for node 69cc5e358df9359ff489a3a6 INFO: 172.20.0.1:54448 - "POST /node/69cc5e358df9359ff489a3a6 HTTP/1.0" 202 Accepted 2026-04-02 23:52:30,775 - lava_callback - INFO - Starting async job submit for node 69cc5e358df9359ff489a3a6 2026-04-02 23:52:30,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:52:30,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5e358df9359ff489a3a6 HTTP/1.1" 200 None 2026-04-02 23:52:30,793 - lava_callback - DEBUG - Processing node 69cc5e358df9359ff489a3a6: baseline-arm64-baylibre 2026-04-02 23:52:30,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5e358df9359ff489a3a6 2026-04-02 23:52:30,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:52:30,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5e358df9359ff489a3a6 HTTP/1.1" 200 None 2026-04-02 23:52:30,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:52:30,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:52:30,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:52:30,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5e358df9359ff489a3a6 HTTP/1.1" 200 None 2026-04-02 23:52:30,855 - lava_callback - ERROR - Error processing callback for node 69cc5e358df9359ff489a3a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51682 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:54:09,684 - lava_callback - INFO - Received callback for node 69cc5e948df9359ff489a3d7 INFO: 172.20.0.1:51692 - "POST /node/69cc5e948df9359ff489a3d7 HTTP/1.0" 202 Accepted 2026-04-02 23:54:09,689 - lava_callback - INFO - Starting async job submit for node 69cc5e948df9359ff489a3d7 2026-04-02 23:54:09,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:54:09,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5e948df9359ff489a3d7 HTTP/1.1" 200 None 2026-04-02 23:54:09,705 - lava_callback - DEBUG - Processing node 69cc5e948df9359ff489a3d7: baseline-arm64-clabbe 2026-04-02 23:54:09,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5e948df9359ff489a3d7 2026-04-02 23:54:09,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:54:09,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5e948df9359ff489a3d7 HTTP/1.1" 200 None 2026-04-02 23:54:09,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:54:09,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:54:09,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:54:09,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5e948df9359ff489a3d7 HTTP/1.1" 200 None 2026-04-02 23:54:09,768 - lava_callback - ERROR - Error processing callback for node 69cc5e948df9359ff489a3d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44976 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:55:29,782 - lava_callback - INFO - Received callback for node 69cc5eed8df9359ff489a409 INFO: 172.20.0.1:51046 - "POST /node/69cc5eed8df9359ff489a409 HTTP/1.0" 202 Accepted 2026-04-02 23:55:29,787 - lava_callback - INFO - Starting async job submit for node 69cc5eed8df9359ff489a409 2026-04-02 23:55:29,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:55:29,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5eed8df9359ff489a409 HTTP/1.1" 200 None 2026-04-02 23:55:29,804 - lava_callback - DEBUG - Processing node 69cc5eed8df9359ff489a409: baseline-arm64-clabbe 2026-04-02 23:55:29,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5eed8df9359ff489a409 2026-04-02 23:55:29,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:55:29,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5eed8df9359ff489a409 HTTP/1.1" 200 None 2026-04-02 23:55:29,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:55:29,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:55:29,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:55:29,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5eed8df9359ff489a409 HTTP/1.1" 200 None 2026-04-02 23:55:29,865 - lava_callback - ERROR - Error processing callback for node 69cc5eed8df9359ff489a409: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53764 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:56:51,001 - lava_callback - INFO - Received callback for node 69cc5f3d8df9359ff489a442 INFO: 172.20.0.1:50828 - "POST /node/69cc5f3d8df9359ff489a442 HTTP/1.0" 202 Accepted 2026-04-02 23:56:51,006 - lava_callback - INFO - Starting async job submit for node 69cc5f3d8df9359ff489a442 2026-04-02 23:56:51,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:56:51,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5f3d8df9359ff489a442 HTTP/1.1" 200 None 2026-04-02 23:56:51,027 - lava_callback - DEBUG - Processing node 69cc5f3d8df9359ff489a442: baseline-arm64-baylibre 2026-04-02 23:56:51,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5f3d8df9359ff489a442 2026-04-02 23:56:51,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:56:51,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5f3d8df9359ff489a442 HTTP/1.1" 200 None 2026-04-02 23:56:51,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:56:51,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:56:51,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:56:51,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5f3d8df9359ff489a442 HTTP/1.1" 200 None 2026-04-02 23:56:51,086 - lava_callback - ERROR - Error processing callback for node 69cc5f3d8df9359ff489a442: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38914 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:58:31,097 - lava_callback - INFO - Received callback for node 69cc5f958df9359ff489a473 INFO: 172.20.0.1:39580 - "POST /node/69cc5f958df9359ff489a473 HTTP/1.0" 202 Accepted 2026-04-02 23:58:31,103 - lava_callback - INFO - Starting async job submit for node 69cc5f958df9359ff489a473 2026-04-02 23:58:31,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:58:31,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5f958df9359ff489a473 HTTP/1.1" 200 None 2026-04-02 23:58:31,130 - lava_callback - DEBUG - Processing node 69cc5f958df9359ff489a473: baseline-arm64-baylibre 2026-04-02 23:58:31,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5f958df9359ff489a473 2026-04-02 23:58:31,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:58:31,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5f958df9359ff489a473 HTTP/1.1" 200 None 2026-04-02 23:58:31,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:58:31,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:58:31,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:58:31,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5f958df9359ff489a473 HTTP/1.1" 200 None 2026-04-02 23:58:31,195 - lava_callback - ERROR - Error processing callback for node 69cc5f958df9359ff489a473: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55364 - "GET / HTTP/1.0" 200 OK 2026-04-02 23:59:49,854 - lava_callback - INFO - Received callback for node 69cc5ff18df9359ff489a4b3 INFO: 172.20.0.1:38748 - "POST /node/69cc5ff18df9359ff489a4b3 HTTP/1.0" 202 Accepted 2026-04-02 23:59:49,859 - lava_callback - INFO - Starting async job submit for node 69cc5ff18df9359ff489a4b3 2026-04-02 23:59:49,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:59:49,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5ff18df9359ff489a4b3 HTTP/1.1" 200 None 2026-04-02 23:59:49,875 - lava_callback - DEBUG - Processing node 69cc5ff18df9359ff489a4b3: baseline-arm64-clabbe 2026-04-02 23:59:49,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc5ff18df9359ff489a4b3 2026-04-02 23:59:49,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:59:49,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc5ff18df9359ff489a4b3 HTTP/1.1" 200 None 2026-04-02 23:59:49,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:59:49,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-02 23:59:49,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 23:59:49,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc5ff18df9359ff489a4b3 HTTP/1.1" 200 None 2026-04-02 23:59:49,943 - lava_callback - ERROR - Error processing callback for node 69cc5ff18df9359ff489a4b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK 2026-04-03 00:01:29,956 - lava_callback - INFO - Received callback for node 69cc604e8df9359ff489a4fc INFO: 172.20.0.1:52186 - "POST /node/69cc604e8df9359ff489a4fc HTTP/1.0" 202 Accepted 2026-04-03 00:01:29,963 - lava_callback - INFO - Starting async job submit for node 69cc604e8df9359ff489a4fc 2026-04-03 00:01:29,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:01:29,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc604e8df9359ff489a4fc HTTP/1.1" 200 None 2026-04-03 00:01:29,984 - lava_callback - DEBUG - Processing node 69cc604e8df9359ff489a4fc: baseline-arm64-clabbe 2026-04-03 00:01:29,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc604e8df9359ff489a4fc 2026-04-03 00:01:29,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:01:30,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc604e8df9359ff489a4fc HTTP/1.1" 200 None 2026-04-03 00:01:30,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:01:30,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-03 00:01:30,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:01:30,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc604e8df9359ff489a4fc HTTP/1.1" 200 None 2026-04-03 00:01:30,051 - lava_callback - ERROR - Error processing callback for node 69cc604e8df9359ff489a4fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48706 - "GET / HTTP/1.0" 200 OK 2026-04-03 00:03:10,216 - lava_callback - INFO - Received callback for node 69cc60ae8df9359ff489a547 INFO: 172.20.0.1:50932 - "POST /node/69cc60ae8df9359ff489a547 HTTP/1.0" 202 Accepted 2026-04-03 00:03:10,222 - lava_callback - INFO - Starting async job submit for node 69cc60ae8df9359ff489a547 2026-04-03 00:03:10,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:03:10,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc60ae8df9359ff489a547 HTTP/1.1" 200 None 2026-04-03 00:03:10,239 - lava_callback - DEBUG - Processing node 69cc60ae8df9359ff489a547: baseline-arm64-clabbe 2026-04-03 00:03:10,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc60ae8df9359ff489a547 2026-04-03 00:03:10,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:03:10,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc60ae8df9359ff489a547 HTTP/1.1" 200 None 2026-04-03 00:03:10,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:03:10,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-03 00:03:10,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:03:10,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc60ae8df9359ff489a547 HTTP/1.1" 200 None 2026-04-03 00:03:10,299 - lava_callback - ERROR - Error processing callback for node 69cc60ae8df9359ff489a547: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47250 - "GET / HTTP/1.0" 200 OK 2026-04-03 00:04:50,159 - lava_callback - INFO - Received callback for node 69cc610c8df9359ff489a592 INFO: 172.20.0.1:51788 - "POST /node/69cc610c8df9359ff489a592 HTTP/1.0" 202 Accepted 2026-04-03 00:04:50,165 - lava_callback - INFO - Starting async job submit for node 69cc610c8df9359ff489a592 2026-04-03 00:04:50,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:04:50,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc610c8df9359ff489a592 HTTP/1.1" 200 None 2026-04-03 00:04:50,183 - lava_callback - DEBUG - Processing node 69cc610c8df9359ff489a592: baseline-arm64-clabbe 2026-04-03 00:04:50,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc610c8df9359ff489a592 2026-04-03 00:04:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:04:50,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc610c8df9359ff489a592 HTTP/1.1" 200 None 2026-04-03 00:04:50,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:04:50,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-03 00:04:50,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:04:50,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc610c8df9359ff489a592 HTTP/1.1" 200 None 2026-04-03 00:04:50,235 - lava_callback - ERROR - Error processing callback for node 69cc610c8df9359ff489a592: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40950 - "GET / HTTP/1.0" 200 OK 2026-04-03 00:06:30,156 - lava_callback - INFO - Received callback for node 69cc61708df9359ff489a5e0 INFO: 172.20.0.1:42238 - "POST /node/69cc61708df9359ff489a5e0 HTTP/1.0" 202 Accepted 2026-04-03 00:06:30,161 - lava_callback - INFO - Starting async job submit for node 69cc61708df9359ff489a5e0 2026-04-03 00:06:30,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:06:30,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc61708df9359ff489a5e0 HTTP/1.1" 200 None 2026-04-03 00:06:30,177 - lava_callback - DEBUG - Processing node 69cc61708df9359ff489a5e0: baseline-arm64-clabbe 2026-04-03 00:06:30,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc61708df9359ff489a5e0 2026-04-03 00:06:30,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:06:30,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc61708df9359ff489a5e0 HTTP/1.1" 200 None 2026-04-03 00:06:30,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:06:30,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-03 00:06:30,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:06:30,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc61708df9359ff489a5e0 HTTP/1.1" 200 None 2026-04-03 00:06:30,234 - lava_callback - ERROR - Error processing callback for node 69cc61708df9359ff489a5e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49012 - "GET / HTTP/1.0" 200 OK 2026-04-03 00:07:50,217 - lava_callback - INFO - Received callback for node 69cc61cd8df9359ff489a636 INFO: 172.20.0.1:56546 - "POST /node/69cc61cd8df9359ff489a636 HTTP/1.0" 202 Accepted 2026-04-03 00:07:50,222 - lava_callback - INFO - Starting async job submit for node 69cc61cd8df9359ff489a636 2026-04-03 00:07:50,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:07:50,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc61cd8df9359ff489a636 HTTP/1.1" 200 None 2026-04-03 00:07:50,239 - lava_callback - DEBUG - Processing node 69cc61cd8df9359ff489a636: baseline-arm64-clabbe 2026-04-03 00:07:50,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc61cd8df9359ff489a636 2026-04-03 00:07:50,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:07:50,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc61cd8df9359ff489a636 HTTP/1.1" 200 None 2026-04-03 00:07:50,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:07:50,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-03 00:07:50,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:07:50,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc61cd8df9359ff489a636 HTTP/1.1" 200 None 2026-04-03 00:07:50,296 - lava_callback - ERROR - Error processing callback for node 69cc61cd8df9359ff489a636: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42448 - "GET / HTTP/1.0" 200 OK 2026-04-03 00:09:30,310 - lava_callback - INFO - Received callback for node 69cc62338df9359ff489a692 INFO: 172.20.0.1:59578 - "POST /node/69cc62338df9359ff489a692 HTTP/1.0" 202 Accepted 2026-04-03 00:09:30,315 - lava_callback - INFO - Starting async job submit for node 69cc62338df9359ff489a692 2026-04-03 00:09:30,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:09:30,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc62338df9359ff489a692 HTTP/1.1" 200 None 2026-04-03 00:09:30,332 - lava_callback - DEBUG - Processing node 69cc62338df9359ff489a692: baseline-arm64-clabbe 2026-04-03 00:09:30,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc62338df9359ff489a692 2026-04-03 00:09:30,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:09:30,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc62338df9359ff489a692 HTTP/1.1" 200 None 2026-04-03 00:09:30,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:09:30,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-03 00:09:30,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:09:30,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc62338df9359ff489a692 HTTP/1.1" 200 None 2026-04-03 00:09:30,390 - lava_callback - ERROR - Error processing callback for node 69cc62338df9359ff489a692: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36540 - "GET / HTTP/1.0" 200 OK 2026-04-03 00:11:10,366 - lava_callback - INFO - Received callback for node 69cc62948df9359ff489a6e6 INFO: 172.20.0.1:48168 - "POST /node/69cc62948df9359ff489a6e6 HTTP/1.0" 202 Accepted 2026-04-03 00:11:10,372 - lava_callback - INFO - Starting async job submit for node 69cc62948df9359ff489a6e6 2026-04-03 00:11:10,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:11:10,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc62948df9359ff489a6e6 HTTP/1.1" 200 None 2026-04-03 00:11:10,389 - lava_callback - DEBUG - Processing node 69cc62948df9359ff489a6e6: baseline-arm64-clabbe 2026-04-03 00:11:10,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cc62948df9359ff489a6e6 2026-04-03 00:11:10,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:11:10,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc62948df9359ff489a6e6 HTTP/1.1" 200 None 2026-04-03 00:11:10,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:11:10,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-03 00:11:10,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-03 00:11:10,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc62948df9359ff489a6e6 HTTP/1.1" 200 None 2026-04-03 00:11:10,466 - lava_callback - ERROR - Error processing callback for node 69cc62948df9359ff489a6e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]