Boot log: qemu_arm64-virt-gicv3-uefi
- Kernel Warnings: 0
- Warnings: 0
- Boot result: FAIL
- Kernel Errors: 0
- Errors: 2
1 13:48:57.940642 lava-dispatcher, installed at version: 2023.06
2 13:48:57.940803 start: 0 validate
3 13:48:57.940917 Start time: 2023-08-16 13:48:57.940910+00:00 (UTC)
4 13:48:57.941530 Validating that http://storage.kernelci.org/images/uefi/edk2-stable202005/arm64/QEMU_EFI.fd exists
5 13:48:58.236596 Validating that http://storage.kernelci.org/cip/linux-4.4.y-st-rt/v4.4-st20-2312-g74888f4b13f0/arm64/defconfig+arm64-chromebook/gcc-10/kernel/Image exists
6 13:48:58.380188 Validating that http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz exists
7 13:48:58.523826 Calling: 'docker' 'pull' 'kernelci/qemu'
8 13:48:58.539122 >> Using default tag: latest
9 13:48:59.903417 >> latest: Pulling from kernelci/qemu
10 13:48:59.906453 >> Digest: sha256:a2a8e7f7097e59e729dc1f5ab0cbb3605c4fea8d6e85e9316d3f1b21e17d4ae8
11 13:48:59.906549 >> Status: Image is up to date for kernelci/qemu:latest
12 13:48:59.909440 >> docker.io/kernelci/qemu:latest
13 13:48:59.911107 Returned 0 in 1 seconds
14 13:49:00.011388 Calling: 'docker' 'pull' 'kernelci/qemu'
15 13:49:00.027184 >> Using default tag: latest
16 13:49:01.009721 >> latest: Pulling from kernelci/qemu
17 13:49:01.012711 >> Digest: sha256:a2a8e7f7097e59e729dc1f5ab0cbb3605c4fea8d6e85e9316d3f1b21e17d4ae8
18 13:49:01.012871 >> Status: Image is up to date for kernelci/qemu:latest
19 13:49:01.015661 >> docker.io/kernelci/qemu:latest
20 13:49:01.017364 Returned 0 in 1 seconds
21 13:49:01.135818 Calling: 'docker' 'run' '--rm' '--init' 'kernelci/qemu' 'qemu-system-aarch64' '--version'
22 13:49:01.490970 >> QEMU emulator version 7.2.2 (Debian 1:7.2+dfsg-7~bpo11+1)
23 13:49:01.491346 >> Copyright (c) 2003-2022 Fabrice Bellard and the QEMU Project developers
24 13:49:01.661829 Returned 0 in 0 seconds
25 13:49:01.762482 validate duration: 3.82
27 13:49:01.762821 start: 1 deployimages (timeout 00:03:00) [common]
28 13:49:01.762904 start: 1.1 lava-overlay (timeout 00:03:00) [common]
29 13:49:01.763128 [common] Preparing overlay tarball in /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4
30 13:49:01.763265 makedir: /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin
31 13:49:01.763345 makedir: /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/tests
32 13:49:01.763418 makedir: /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/results
33 13:49:01.763506 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-add-keys
34 13:49:01.763624 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-add-sources
35 13:49:01.763723 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-background-process-start
36 13:49:01.763812 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-background-process-stop
37 13:49:01.763896 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-common-functions
38 13:49:01.763974 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-echo-ipv4
39 13:49:01.764055 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-install-packages
40 13:49:01.764134 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-installed-packages
41 13:49:01.764213 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-os-build
42 13:49:01.764292 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-probe-channel
43 13:49:01.764373 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-probe-ip
44 13:49:01.764449 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-target-ip
45 13:49:01.764525 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-target-mac
46 13:49:01.764601 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-target-storage
47 13:49:01.764683 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-test-case
48 13:49:01.764761 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-test-event
49 13:49:01.764839 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-test-feedback
50 13:49:01.764916 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-test-raise
51 13:49:01.764995 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-test-reference
52 13:49:01.765074 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-test-runner
53 13:49:01.765151 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-test-set
54 13:49:01.765236 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-test-shell
55 13:49:01.765322 Updating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-install-packages (oe)
56 13:49:01.765450 Updating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/bin/lava-installed-packages (oe)
57 13:49:01.765553 Creating /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/environment
58 13:49:01.765638 LAVA metadata
59 13:49:01.765694 - LAVA_JOB_ID=11299529
60 13:49:01.765744 - LAVA_DISPATCHER_IP=192.168.122.1
61 13:49:01.765835 start: 1.1.1 lava-vland-overlay (timeout 00:03:00) [common]
62 13:49:01.765886 skipped lava-vland-overlay
63 13:49:01.765948 end: 1.1.1 lava-vland-overlay (duration 00:00:00) [common]
64 13:49:01.766009 start: 1.1.2 lava-multinode-overlay (timeout 00:03:00) [common]
65 13:49:01.766053 skipped lava-multinode-overlay
66 13:49:01.766110 end: 1.1.2 lava-multinode-overlay (duration 00:00:00) [common]
67 13:49:01.766171 start: 1.1.3 test-definition (timeout 00:03:00) [common]
68 13:49:01.766226 Loading test definitions
69 13:49:01.766296 start: 1.1.3.1 inline-repo-action (timeout 00:03:00) [common]
70 13:49:01.766350 Using /lava-11299529 at stage 0
71 13:49:01.766606 uuid=11299529_1.1.3.1 testdef=None
72 13:49:01.766690 end: 1.1.3.1 inline-repo-action (duration 00:00:00) [common]
73 13:49:01.766763 start: 1.1.3.2 test-overlay (timeout 00:03:00) [common]
74 13:49:01.767216 end: 1.1.3.2 test-overlay (duration 00:00:00) [common]
76 13:49:01.767410 start: 1.1.3.3 test-install-overlay (timeout 00:03:00) [common]
77 13:49:01.767900 end: 1.1.3.3 test-install-overlay (duration 00:00:00) [common]
79 13:49:01.768102 start: 1.1.3.4 test-runscript-overlay (timeout 00:03:00) [common]
80 13:49:01.768540 runner path: /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/0/tests/0_dmesg test_uuid 11299529_1.1.3.1
81 13:49:01.768667 end: 1.1.3.4 test-runscript-overlay (duration 00:00:00) [common]
83 13:49:01.768850 start: 1.1.3.5 inline-repo-action (timeout 00:03:00) [common]
84 13:49:01.768904 Using /lava-11299529 at stage 1
85 13:49:01.769137 uuid=11299529_1.1.3.5 testdef=None
86 13:49:01.769212 end: 1.1.3.5 inline-repo-action (duration 00:00:00) [common]
87 13:49:01.769278 start: 1.1.3.6 test-overlay (timeout 00:03:00) [common]
88 13:49:01.769617 end: 1.1.3.6 test-overlay (duration 00:00:00) [common]
90 13:49:01.769790 start: 1.1.3.7 test-install-overlay (timeout 00:03:00) [common]
91 13:49:01.770263 end: 1.1.3.7 test-install-overlay (duration 00:00:00) [common]
93 13:49:01.770462 start: 1.1.3.8 test-runscript-overlay (timeout 00:03:00) [common]
94 13:49:01.770905 runner path: /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/1/tests/1_bootrr test_uuid 11299529_1.1.3.5
95 13:49:01.771028 end: 1.1.3.8 test-runscript-overlay (duration 00:00:00) [common]
97 13:49:01.771187 Creating lava-test-runner.conf files
98 13:49:01.771235 Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/0 for stage 0
99 13:49:01.771306 - 0_dmesg
100 13:49:01.771368 Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/11299529/lava-overlay-0mdr2vi4/lava-11299529/1 for stage 1
101 13:49:01.771432 - 1_bootrr
102 13:49:01.771502 end: 1.1.3 test-definition (duration 00:00:00) [common]
103 13:49:01.771567 start: 1.1.4 compress-overlay (timeout 00:03:00) [common]
104 13:49:01.777502 end: 1.1.4 compress-overlay (duration 00:00:00) [common]
105 13:49:01.777679 start: 1.1.5 persistent-nfs-overlay (timeout 00:03:00) [common]
106 13:49:01.777761 end: 1.1.5 persistent-nfs-overlay (duration 00:00:00) [common]
107 13:49:01.777832 end: 1.1 lava-overlay (duration 00:00:00) [common]
108 13:49:01.777899 start: 1.2 apply-overlay-guest (timeout 00:03:00) [common]
109 13:49:01.777953 Overlay: /var/lib/lava/dispatcher/tmp/11299529/compress-overlay-0f44c_oo/overlay-1.1.4.tar.gz
110 13:49:04.417652 end: 1.2 apply-overlay-guest (duration 00:00:03) [common]
112 13:49:04.418062 start: 1.3 deploy-device-env (timeout 00:02:57) [common]
113 13:49:04.418127 end: 1.3 deploy-device-env (duration 00:00:00) [common]
114 13:49:04.418184 start: 1.4 download-retry (timeout 00:02:57) [common]
115 13:49:04.418248 start: 1.4.1 http-download (timeout 00:02:57) [common]
116 13:49:04.418401 downloading http://storage.kernelci.org/images/uefi/edk2-stable202005/arm64/QEMU_EFI.fd
117 13:49:04.418455 saving as /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/bios/QEMU_EFI.fd
118 13:49:04.418496 total size: 2097152 (2 MB)
119 13:49:04.418542 No compression specified
120 13:49:04.704656 progress 1 % (0 MB)
121 13:49:04.989948 progress 6 % (0 MB)
122 13:49:05.132406 progress 12 % (0 MB)
123 13:49:05.133421 progress 17 % (0 MB)
124 13:49:05.274563 progress 23 % (0 MB)
125 13:49:05.275397 progress 28 % (0 MB)
126 13:49:05.276518 progress 34 % (0 MB)
127 13:49:05.277347 progress 39 % (0 MB)
128 13:49:05.418571 progress 45 % (0 MB)
129 13:49:05.419836 progress 50 % (1 MB)
130 13:49:05.420913 progress 56 % (1 MB)
131 13:49:05.422039 progress 62 % (1 MB)
132 13:49:05.422899 progress 67 % (1 MB)
133 13:49:05.423962 progress 73 % (1 MB)
134 13:49:05.424819 progress 78 % (1 MB)
135 13:49:05.425946 progress 84 % (1 MB)
136 13:49:05.560072 progress 89 % (1 MB)
137 13:49:05.561931 progress 95 % (1 MB)
138 13:49:05.562797 progress 100 % (2 MB)
139 13:49:05.562992 2 MB downloaded in 1.14 s (1.75 MB/s)
140 13:49:05.563123 end: 1.4.1 http-download (duration 00:00:01) [common]
142 13:49:05.563302 end: 1.4 download-retry (duration 00:00:01) [common]
143 13:49:05.563363 start: 1.5 download-retry (timeout 00:02:56) [common]
144 13:49:05.563417 start: 1.5.1 http-download (timeout 00:02:56) [common]
145 13:49:05.563533 downloading http://storage.kernelci.org/cip/linux-4.4.y-st-rt/v4.4-st20-2312-g74888f4b13f0/arm64/defconfig+arm64-chromebook/gcc-10/kernel/Image
146 13:49:05.563585 saving as /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/kernel/Image
147 13:49:05.563625 total size: 17546752 (16 MB)
148 13:49:05.563664 No compression specified
149 13:49:05.707104 progress 0 % (0 MB)
150 13:49:05.714297 progress 5 % (0 MB)
151 13:49:05.866859 progress 10 % (1 MB)
152 13:49:05.870002 progress 15 % (2 MB)
153 13:49:05.872975 progress 20 % (3 MB)
154 13:49:06.011642 progress 25 % (4 MB)
155 13:49:06.283121 progress 30 % (5 MB)
156 13:49:06.297055 progress 35 % (5 MB)
157 13:49:06.300117 progress 40 % (6 MB)
158 13:49:06.303088 progress 45 % (7 MB)
159 13:49:06.443331 progress 50 % (8 MB)
160 13:49:06.580814 progress 55 % (9 MB)
161 13:49:06.591347 progress 60 % (10 MB)
162 13:49:06.726586 progress 65 % (10 MB)
163 13:49:06.736892 progress 70 % (11 MB)
164 13:49:06.872756 progress 75 % (12 MB)
165 13:49:06.881413 progress 80 % (13 MB)
166 13:49:07.017359 progress 85 % (14 MB)
167 13:49:07.151091 progress 90 % (15 MB)
168 13:49:07.162000 progress 95 % (15 MB)
169 13:49:07.295409 progress 100 % (16 MB)
170 13:49:07.295630 16 MB downloaded in 1.73 s (9.66 MB/s)
171 13:49:07.295775 end: 1.5.1 http-download (duration 00:00:02) [common]
173 13:49:07.295983 end: 1.5 download-retry (duration 00:00:02) [common]
174 13:49:07.296051 start: 1.6 download-retry (timeout 00:02:54) [common]
175 13:49:07.296113 start: 1.6.1 http-download (timeout 00:02:54) [common]
176 13:49:07.296219 Not decompressing ramdisk as can be used compressed.
177 13:49:07.296289 downloading http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz
178 13:49:07.296333 saving as /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/ramdisk/rootfs.cpio.gz
179 13:49:07.296378 total size: 8181372 (7 MB)
180 13:49:07.296423 No compression specified
181 13:49:07.439860 progress 0 % (0 MB)
182 13:49:07.443142 progress 5 % (0 MB)
183 13:49:07.446495 progress 10 % (0 MB)
184 13:49:07.450123 progress 15 % (1 MB)
185 13:49:07.726695 progress 20 % (1 MB)
186 13:49:07.728271 progress 25 % (1 MB)
187 13:49:07.729730 progress 30 % (2 MB)
188 13:49:07.731224 progress 35 % (2 MB)
189 13:49:07.732616 progress 40 % (3 MB)
190 13:49:07.735615 progress 45 % (3 MB)
191 13:49:07.869736 progress 50 % (3 MB)
192 13:49:07.875736 progress 55 % (4 MB)
193 13:49:07.879048 progress 60 % (4 MB)
194 13:49:08.013620 progress 65 % (5 MB)
195 13:49:08.022257 progress 70 % (5 MB)
196 13:49:08.034273 progress 75 % (5 MB)
197 13:49:08.156928 progress 80 % (6 MB)
198 13:49:08.165718 progress 85 % (6 MB)
199 13:49:08.223712 progress 90 % (7 MB)
200 13:49:08.300619 progress 95 % (7 MB)
201 13:49:08.309014 progress 100 % (7 MB)
202 13:49:08.309180 7 MB downloaded in 1.01 s (7.70 MB/s)
203 13:49:08.309329 end: 1.6.1 http-download (duration 00:00:01) [common]
205 13:49:08.309527 end: 1.6 download-retry (duration 00:00:01) [common]
206 13:49:08.309590 end: 1 deployimages (duration 00:00:07) [common]
207 13:49:08.309654 start: 2 boot-image-retry (timeout 00:05:00) [common]
208 13:49:08.309711 start: 2.1 boot-qemu-image (timeout 00:05:00) [common]
209 13:49:08.309771 start: 2.1.1 execute-qemu (timeout 00:05:00) [common]
210 13:49:08.309854 Extending command line for qcow2 test overlay
211 13:49:08.310116 Pulling docker image
212 13:49:08.310177 Calling: 'docker' 'pull' 'kernelci/qemu'
213 13:49:08.325318 >> Using default tag: latest
214 13:49:09.350220 >> latest: Pulling from kernelci/qemu
215 13:49:09.355714 >> Digest: sha256:a2a8e7f7097e59e729dc1f5ab0cbb3605c4fea8d6e85e9316d3f1b21e17d4ae8
216 13:49:09.355802 >> Status: Image is up to date for kernelci/qemu:latest
217 13:49:09.358587 >> docker.io/kernelci/qemu:latest
218 13:49:09.360302 Returned 0 in 1 seconds
219 13:49:09.460548 Calling: 'docker' 'pull' 'kernelci/qemu'
220 13:49:09.478564 >> Using default tag: latest
221 13:49:10.520835 >> latest: Pulling from kernelci/qemu
222 13:49:10.523910 >> Digest: sha256:a2a8e7f7097e59e729dc1f5ab0cbb3605c4fea8d6e85e9316d3f1b21e17d4ae8
223 13:49:10.524032 >> Status: Image is up to date for kernelci/qemu:latest
224 13:49:10.526885 >> docker.io/kernelci/qemu:latest
225 13:49:10.528103 Returned 0 in 1 seconds
226 13:49:10.646378 Boot command: docker run --network=host --cap-add=NET_ADMIN --interactive --tty --rm --init --name=lava-docker-qemu-11299529-2.1.1-4fb20047fx --device=/dev/kvm --device=/dev/net/tun --mount=type=bind,source=/var/lib/lava/dispatcher/tmp,destination=/var/lib/lava/dispatcher/tmp kernelci/qemu qemu-system-aarch64 -cpu max,pauth-impdef=on -machine virt,gic-version=3,mte=on,accel=tcg -nographic -net nic,model=virtio,macaddr=DE:AD:BE:EF:AE:1F -net bridge,br=virbr0 -m 1024 -monitor none -bios /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/bios/QEMU_EFI.fd -kernel /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/kernel/Image -append "console=ttyAMA0,115200 root=/dev/ram0 debug verbose console_msg_format=syslog earlycon deferred_probe_timeout=60" -initrd /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/ramdisk/rootfs.cpio.gz -drive format=qcow2,file=/var/lib/lava/dispatcher/tmp/11299529/apply-overlay-guest-l8e1agnx/lava-guest.qcow2,media=disk,if=virtio,id=lavatest
227 13:49:10.649278 started a shell command
228 13:49:10.649616 end: 2.1.1 execute-qemu (duration 00:00:02) [common]
229 13:49:10.649719 end: 2.1 boot-qemu-image (duration 00:00:02) [common]
230 13:49:10.649808 start: 2.2 auto-login-action (timeout 00:04:58) [common]
231 13:49:10.649895 Setting prompt string to ['Linux version [0-9]']
232 13:49:10.649955 auto-login-action: Wait for prompt ['Linux version [0-9]'] (timeout 00:05:00)
233 13:49:11.624797 [2J[01;01H[=3h[2J[01;01H[0m[35m[40m[0m[37m[40mEFI stub: Booting Linux Kernel...
234 13:49:11.624996
235 13:49:11.632315 EFI stub: Generating empty DTB
236 13:49:11.632405
237 13:49:11.636377 EFI stub: Exiting boot services and installing virtual address map...
238 13:49:11.636457
240 13:54:08.650073 end: 2.2 auto-login-action (duration 00:04:58) [common]
242 13:54:08.650282 boot-image-retry failed: 1 of 1 attempts. 'auto-login-action timed out after 298 seconds'
243 13:54:08.650347 Stopping the qemu container lava-docker-qemu-11299529-2.1.1-4fb20047fx
245 13:54:08.892525 end: 2 boot-image-retry (duration 00:05:01) [common]
247 13:54:08.892852 Cleaning after the job
248 13:54:08.892976 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/bios
249 13:54:08.893423 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/kernel
250 13:54:08.895680 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11299529/deployimages-igegarja/ramdisk
251 13:54:08.896896 Stopping the qemu container lava-docker-qemu-11299529-2.1.1-4fb20047fx
252 13:54:08.913601 start: 5.1 power-off (timeout 00:00:30) [common]
253 13:54:08.913938 end: 5.1 power-off (duration 00:00:00) [common]
254 13:54:08.914049 start: 5.2 read-feedback (timeout 00:10:00) [common]
255 13:54:08.914318 Listened to connection for namespace 'common' for up to 1s
256 13:54:08.914490 Finalising connection for namespace 'common'
258 13:54:09.014825 poweroff
259 13:54:09.015267 Already disconnected
260 13:54:09.015354 poweroff
261 13:54:09.115637 end: 5.2 read-feedback (duration 00:00:00) [common]
262 13:54:09.115831 Root tmp directory removed at /var/lib/lava/dispatcher/tmp/11299529
263 13:54:09.116790 JobError: Your job cannot terminate cleanly.