Boot log: qemu_arm64-virt-gicv2-uefi
- Kernel Warnings: 0
- Warnings: 0
- Boot result: FAIL
- Kernel Errors: 0
- Errors: 2
1 13:48:37.869269 lava-dispatcher, installed at version: 2023.06
2 13:48:37.869613 start: 0 validate
3 13:48:37.869840 Start time: 2023-08-16 13:48:37.869825+00:00 (UTC)
4 13:48:37.871342 Validating that http://storage.kernelci.org/images/uefi/edk2-stable202005/arm64/QEMU_EFI.fd exists
5 13:48:38.168101 Validating that http://storage.kernelci.org/cip/linux-4.4.y-st-rt/v4.4-st20-2312-g74888f4b13f0/arm64/defconfig+arm64-chromebook/gcc-10/kernel/Image exists
6 13:48:38.317570 Validating that http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz exists
7 13:48:38.465345 Calling: 'docker' 'pull' 'kernelci/qemu'
8 13:48:38.496239 >> Using default tag: latest
9 13:48:39.482500 >> latest: Pulling from kernelci/qemu
10 13:48:39.488990 >> Digest: sha256:a2a8e7f7097e59e729dc1f5ab0cbb3605c4fea8d6e85e9316d3f1b21e17d4ae8
11 13:48:39.489175 >> Status: Image is up to date for kernelci/qemu:latest
12 13:48:39.495561 >> docker.io/kernelci/qemu:latest
13 13:48:39.498095 Returned 0 in 1 seconds
14 13:48:39.598447 Calling: 'docker' 'pull' 'kernelci/qemu'
15 13:48:39.629085 >> Using default tag: latest
16 13:48:40.598722 >> latest: Pulling from kernelci/qemu
17 13:48:40.614011 >> Digest: sha256:a2a8e7f7097e59e729dc1f5ab0cbb3605c4fea8d6e85e9316d3f1b21e17d4ae8
18 13:48:40.614291 >> Status: Image is up to date for kernelci/qemu:latest
19 13:48:40.631778 >> docker.io/kernelci/qemu:latest
20 13:48:40.634486 Returned 0 in 1 seconds
21 13:48:40.774679 Calling: 'docker' 'run' '--rm' '--init' 'kernelci/qemu' 'qemu-system-aarch64' '--version'
22 13:48:41.406685 >> QEMU emulator version 7.2.2 (Debian 1:7.2+dfsg-7~bpo11+1)
23 13:48:41.407221 >> Copyright (c) 2003-2022 Fabrice Bellard and the QEMU Project developers
24 13:48:41.666507 Returned 0 in 0 seconds
25 13:48:41.767564 validate duration: 3.90
27 13:48:41.768167 start: 1 deployimages (timeout 00:03:00) [common]
28 13:48:41.768350 start: 1.1 lava-overlay (timeout 00:03:00) [common]
29 13:48:41.768751 [common] Preparing overlay tarball in /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7
30 13:48:41.769016 makedir: /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin
31 13:48:41.769214 makedir: /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/tests
32 13:48:41.769408 makedir: /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/results
33 13:48:41.769618 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-add-keys
34 13:48:41.769888 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-add-sources
35 13:48:41.770123 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-background-process-start
36 13:48:41.770364 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-background-process-stop
37 13:48:41.770589 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-common-functions
38 13:48:41.770811 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-echo-ipv4
39 13:48:41.771036 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-install-packages
40 13:48:41.771258 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-installed-packages
41 13:48:41.771477 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-os-build
42 13:48:41.771698 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-probe-channel
43 13:48:41.771917 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-probe-ip
44 13:48:41.772135 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-target-ip
45 13:48:41.772354 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-target-mac
46 13:48:41.772571 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-target-storage
47 13:48:41.772799 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-test-case
48 13:48:41.773020 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-test-event
49 13:48:41.773242 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-test-feedback
50 13:48:41.773462 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-test-raise
51 13:48:41.773695 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-test-reference
52 13:48:41.773918 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-test-runner
53 13:48:41.774136 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-test-set
54 13:48:41.774413 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-test-shell
55 13:48:41.774645 Updating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-install-packages (oe)
56 13:48:41.774927 Updating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/bin/lava-installed-packages (oe)
57 13:48:41.775155 Creating /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/environment
58 13:48:41.775340 LAVA metadata
59 13:48:41.775483 - LAVA_JOB_ID=11299523
60 13:48:41.775620 - LAVA_DISPATCHER_IP=192.168.122.1
61 13:48:41.775808 start: 1.1.1 lava-vland-overlay (timeout 00:03:00) [common]
62 13:48:41.775947 skipped lava-vland-overlay
63 13:48:41.776100 end: 1.1.1 lava-vland-overlay (duration 00:00:00) [common]
64 13:48:41.776257 start: 1.1.2 lava-multinode-overlay (timeout 00:03:00) [common]
65 13:48:41.776388 skipped lava-multinode-overlay
66 13:48:41.776535 end: 1.1.2 lava-multinode-overlay (duration 00:00:00) [common]
67 13:48:41.776702 start: 1.1.3 test-definition (timeout 00:03:00) [common]
68 13:48:41.776854 Loading test definitions
69 13:48:41.777034 start: 1.1.3.1 inline-repo-action (timeout 00:03:00) [common]
70 13:48:41.777185 Using /lava-11299523 at stage 0
71 13:48:41.777805 uuid=11299523_1.1.3.1 testdef=None
72 13:48:41.777978 end: 1.1.3.1 inline-repo-action (duration 00:00:00) [common]
73 13:48:41.778143 start: 1.1.3.2 test-overlay (timeout 00:03:00) [common]
74 13:48:41.779221 end: 1.1.3.2 test-overlay (duration 00:00:00) [common]
76 13:48:41.779728 start: 1.1.3.3 test-install-overlay (timeout 00:03:00) [common]
77 13:48:41.781035 end: 1.1.3.3 test-install-overlay (duration 00:00:00) [common]
79 13:48:41.781548 start: 1.1.3.4 test-runscript-overlay (timeout 00:03:00) [common]
80 13:48:41.782815 runner path: /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/0/tests/0_dmesg test_uuid 11299523_1.1.3.1
81 13:48:41.783084 end: 1.1.3.4 test-runscript-overlay (duration 00:00:00) [common]
83 13:48:41.783581 start: 1.1.3.5 inline-repo-action (timeout 00:03:00) [common]
84 13:48:41.783723 Using /lava-11299523 at stage 1
85 13:48:41.784294 uuid=11299523_1.1.3.5 testdef=None
86 13:48:41.784459 end: 1.1.3.5 inline-repo-action (duration 00:00:00) [common]
87 13:48:41.784620 start: 1.1.3.6 test-overlay (timeout 00:03:00) [common]
88 13:48:41.785566 end: 1.1.3.6 test-overlay (duration 00:00:00) [common]
90 13:48:41.786049 start: 1.1.3.7 test-install-overlay (timeout 00:03:00) [common]
91 13:48:41.787394 end: 1.1.3.7 test-install-overlay (duration 00:00:00) [common]
93 13:48:41.787901 start: 1.1.3.8 test-runscript-overlay (timeout 00:03:00) [common]
94 13:48:41.789184 runner path: /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/1/tests/1_bootrr test_uuid 11299523_1.1.3.5
95 13:48:41.789445 end: 1.1.3.8 test-runscript-overlay (duration 00:00:00) [common]
97 13:48:41.789913 Creating lava-test-runner.conf files
98 13:48:41.790041 Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/0 for stage 0
99 13:48:41.790221 - 0_dmesg
100 13:48:41.790376 Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/11299523/lava-overlay-nuplzrk7/lava-11299523/1 for stage 1
101 13:48:41.790545 - 1_bootrr
102 13:48:41.790720 end: 1.1.3 test-definition (duration 00:00:00) [common]
103 13:48:41.790882 start: 1.1.4 compress-overlay (timeout 00:03:00) [common]
104 13:48:41.805492 end: 1.1.4 compress-overlay (duration 00:00:00) [common]
105 13:48:41.805817 start: 1.1.5 persistent-nfs-overlay (timeout 00:03:00) [common]
106 13:48:41.805984 end: 1.1.5 persistent-nfs-overlay (duration 00:00:00) [common]
107 13:48:41.806145 end: 1.1 lava-overlay (duration 00:00:00) [common]
108 13:48:41.806318 start: 1.2 apply-overlay-guest (timeout 00:03:00) [common]
109 13:48:41.806465 Overlay: /var/lib/lava/dispatcher/tmp/11299523/compress-overlay-1g6hi5m6/overlay-1.1.4.tar.gz
110 13:48:44.445153 end: 1.2 apply-overlay-guest (duration 00:00:03) [common]
112 13:48:44.446080 start: 1.3 deploy-device-env (timeout 00:02:57) [common]
113 13:48:44.446259 end: 1.3 deploy-device-env (duration 00:00:00) [common]
114 13:48:44.446433 start: 1.4 download-retry (timeout 00:02:57) [common]
115 13:48:44.446623 start: 1.4.1 http-download (timeout 00:02:57) [common]
116 13:48:44.446947 downloading http://storage.kernelci.org/images/uefi/edk2-stable202005/arm64/QEMU_EFI.fd
117 13:48:44.447088 saving as /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/bios/QEMU_EFI.fd
118 13:48:44.447223 total size: 2097152 (2 MB)
119 13:48:44.447364 No compression specified
120 13:48:44.741477 progress 1 % (0 MB)
121 13:48:45.033799 progress 6 % (0 MB)
122 13:48:45.179802 progress 12 % (0 MB)
123 13:48:45.180918 progress 17 % (0 MB)
124 13:48:45.325774 progress 23 % (0 MB)
125 13:48:45.326881 progress 28 % (0 MB)
126 13:48:45.328281 progress 34 % (0 MB)
127 13:48:45.329379 progress 39 % (0 MB)
128 13:48:45.471660 progress 45 % (0 MB)
129 13:48:45.472764 progress 50 % (1 MB)
130 13:48:45.474160 progress 56 % (1 MB)
131 13:48:45.475574 progress 62 % (1 MB)
132 13:48:45.476653 progress 67 % (1 MB)
133 13:48:45.478073 progress 73 % (1 MB)
134 13:48:45.479179 progress 78 % (1 MB)
135 13:48:45.480570 progress 84 % (1 MB)
136 13:48:45.617593 progress 89 % (1 MB)
137 13:48:45.619021 progress 95 % (1 MB)
138 13:48:45.620157 progress 100 % (2 MB)
139 13:48:45.620605 2 MB downloaded in 1.17 s (1.70 MB/s)
140 13:48:45.620880 end: 1.4.1 http-download (duration 00:00:01) [common]
142 13:48:45.621396 end: 1.4 download-retry (duration 00:00:01) [common]
143 13:48:45.621562 start: 1.5 download-retry (timeout 00:02:56) [common]
144 13:48:45.621725 start: 1.5.1 http-download (timeout 00:02:56) [common]
145 13:48:45.621958 downloading http://storage.kernelci.org/cip/linux-4.4.y-st-rt/v4.4-st20-2312-g74888f4b13f0/arm64/defconfig+arm64-chromebook/gcc-10/kernel/Image
146 13:48:45.622094 saving as /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/kernel/Image
147 13:48:45.622236 total size: 17546752 (16 MB)
148 13:48:45.622367 No compression specified
149 13:48:45.770173 progress 0 % (0 MB)
150 13:48:45.778645 progress 5 % (0 MB)
151 13:48:46.065003 progress 10 % (1 MB)
152 13:48:46.073620 progress 15 % (2 MB)
153 13:48:46.082219 progress 20 % (3 MB)
154 13:48:46.090487 progress 25 % (4 MB)
155 13:48:46.216628 progress 30 % (5 MB)
156 13:48:46.508697 progress 35 % (5 MB)
157 13:48:46.517320 progress 40 % (6 MB)
158 13:48:46.525607 progress 45 % (7 MB)
159 13:48:46.652124 progress 50 % (8 MB)
160 13:48:46.945546 progress 55 % (9 MB)
161 13:48:46.954281 progress 60 % (10 MB)
162 13:48:46.962891 progress 65 % (10 MB)
163 13:48:46.971160 progress 70 % (11 MB)
164 13:48:47.098582 progress 75 % (12 MB)
165 13:48:47.240884 progress 80 % (13 MB)
166 13:48:47.254794 progress 85 % (14 MB)
167 13:48:47.391451 progress 90 % (15 MB)
168 13:48:47.533413 progress 95 % (15 MB)
169 13:48:47.546682 progress 100 % (16 MB)
170 13:48:47.547004 16 MB downloaded in 1.92 s (8.69 MB/s)
171 13:48:47.547254 end: 1.5.1 http-download (duration 00:00:02) [common]
173 13:48:47.547767 end: 1.5 download-retry (duration 00:00:02) [common]
174 13:48:47.547931 start: 1.6 download-retry (timeout 00:02:54) [common]
175 13:48:47.548093 start: 1.6.1 http-download (timeout 00:02:54) [common]
176 13:48:47.548296 Not decompressing ramdisk as can be used compressed.
177 13:48:47.548457 downloading http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz
178 13:48:47.548585 saving as /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/ramdisk/rootfs.cpio.gz
179 13:48:47.548710 total size: 8181372 (7 MB)
180 13:48:47.548836 No compression specified
181 13:48:47.697125 progress 0 % (0 MB)
182 13:48:47.701153 progress 5 % (0 MB)
183 13:48:47.705127 progress 10 % (0 MB)
184 13:48:47.709399 progress 15 % (1 MB)
185 13:48:47.846264 progress 20 % (1 MB)
186 13:48:47.850567 progress 25 % (1 MB)
187 13:48:47.854538 progress 30 % (2 MB)
188 13:48:47.991600 progress 35 % (2 MB)
189 13:48:47.995679 progress 40 % (3 MB)
190 13:48:47.999993 progress 45 % (3 MB)
191 13:48:48.136489 progress 50 % (3 MB)
192 13:48:48.142323 progress 55 % (4 MB)
193 13:48:48.147567 progress 60 % (4 MB)
194 13:48:48.151910 progress 65 % (5 MB)
195 13:48:48.286575 progress 70 % (5 MB)
196 13:48:48.292368 progress 75 % (5 MB)
197 13:48:48.296820 progress 80 % (6 MB)
198 13:48:48.431063 progress 85 % (6 MB)
199 13:48:48.436200 progress 90 % (7 MB)
200 13:48:48.441654 progress 95 % (7 MB)
201 13:48:48.574194 progress 100 % (7 MB)
202 13:48:48.574577 7 MB downloaded in 1.03 s (7.61 MB/s)
203 13:48:48.574831 end: 1.6.1 http-download (duration 00:00:01) [common]
205 13:48:48.575335 end: 1.6 download-retry (duration 00:00:01) [common]
206 13:48:48.575506 end: 1 deployimages (duration 00:00:07) [common]
207 13:48:48.575673 start: 2 boot-image-retry (timeout 00:05:00) [common]
208 13:48:48.575838 start: 2.1 boot-qemu-image (timeout 00:05:00) [common]
209 13:48:48.575999 start: 2.1.1 execute-qemu (timeout 00:05:00) [common]
210 13:48:48.576207 Extending command line for qcow2 test overlay
211 13:48:48.576802 Pulling docker image
212 13:48:48.576959 Calling: 'docker' 'pull' 'kernelci/qemu'
213 13:48:48.608668 >> Using default tag: latest
214 13:48:49.608378 >> latest: Pulling from kernelci/qemu
215 13:48:49.615190 >> Digest: sha256:a2a8e7f7097e59e729dc1f5ab0cbb3605c4fea8d6e85e9316d3f1b21e17d4ae8
216 13:48:49.615567 >> Status: Image is up to date for kernelci/qemu:latest
217 13:48:49.621893 >> docker.io/kernelci/qemu:latest
218 13:48:49.624405 Returned 0 in 1 seconds
219 13:48:49.724739 Calling: 'docker' 'pull' 'kernelci/qemu'
220 13:48:49.755474 >> Using default tag: latest
221 13:48:50.736825 >> latest: Pulling from kernelci/qemu
222 13:48:50.748919 >> Digest: sha256:a2a8e7f7097e59e729dc1f5ab0cbb3605c4fea8d6e85e9316d3f1b21e17d4ae8
223 13:48:50.749124 >> Status: Image is up to date for kernelci/qemu:latest
224 13:48:50.761696 >> docker.io/kernelci/qemu:latest
225 13:48:50.764200 Returned 0 in 1 seconds
226 13:48:50.904993 Boot command: docker run --network=host --cap-add=NET_ADMIN --interactive --tty --rm --init --name=lava-docker-qemu-11299523-2.1.1-n1xu6jx6pt --device=/dev/kvm --device=/dev/net/tun --mount=type=bind,source=/var/lib/lava/dispatcher/tmp,destination=/var/lib/lava/dispatcher/tmp kernelci/qemu qemu-system-aarch64 -cpu max,pauth-impdef=on -machine virt,gic-version=2,mte=on,accel=tcg -nographic -net nic,model=virtio,macaddr=DE:AD:BE:EF:45:5C -net bridge,br=virbr0 -m 1024 -monitor none -bios /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/bios/QEMU_EFI.fd -kernel /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/kernel/Image -append "console=ttyAMA0,115200 root=/dev/ram0 debug verbose console_msg_format=syslog earlycon deferred_probe_timeout=60" -initrd /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/ramdisk/rootfs.cpio.gz -drive format=qcow2,file=/var/lib/lava/dispatcher/tmp/11299523/apply-overlay-guest-0r4ktr9x/lava-guest.qcow2,media=disk,if=virtio,id=lavatest
227 13:48:50.911856 started a shell command
228 13:48:50.912782 end: 2.1.1 execute-qemu (duration 00:00:02) [common]
229 13:48:50.913065 end: 2.1 boot-qemu-image (duration 00:00:02) [common]
230 13:48:50.913308 start: 2.2 auto-login-action (timeout 00:04:58) [common]
231 13:48:50.913565 Setting prompt string to ['Linux version [0-9]']
232 13:48:50.913769 auto-login-action: Wait for prompt ['Linux version [0-9]'] (timeout 00:05:00)
233 13:48:54.028028 [2J[01;01H[=3h[2J[01;01H[0m[35m[40m[0m[37m[40mEFI stub: Booting Linux Kernel...
234 13:48:54.028304
235 13:48:54.049460 EFI stub: Generating empty DTB
236 13:48:54.049706
237 13:48:54.060433 EFI stub: Exiting boot services and installing virtual address map...
238 13:48:54.060683
240 13:53:48.913664 end: 2.2 auto-login-action (duration 00:04:58) [common]
242 13:53:48.914102 boot-image-retry failed: 1 of 1 attempts. 'auto-login-action timed out after 298 seconds'
243 13:53:48.914249 Stopping the qemu container lava-docker-qemu-11299523-2.1.1-n1xu6jx6pt
245 13:53:49.177043 end: 2 boot-image-retry (duration 00:05:01) [common]
247 13:53:49.177663 Cleaning after the job
248 13:53:49.177891 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/bios
249 13:53:49.178612 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/kernel
250 13:53:49.181810 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11299523/deployimages-zh8uh9ah/ramdisk
251 13:53:49.183432 Stopping the qemu container lava-docker-qemu-11299523-2.1.1-n1xu6jx6pt
252 13:53:49.210375 start: 5.1 power-off (timeout 00:00:30) [common]
253 13:53:49.210965 end: 5.1 power-off (duration 00:00:00) [common]
254 13:53:49.211161 start: 5.2 read-feedback (timeout 00:10:00) [common]
255 13:53:49.211660 Listened to connection for namespace 'common' for up to 1s
256 13:53:49.211954 Finalising connection for namespace 'common'
258 13:53:49.312430 poweroff
260 13:53:49.313045 Already disconnected
261 13:53:49.413396 end: 5.2 read-feedback (duration 00:00:00) [common]
262 13:53:49.413574 Root tmp directory removed at /var/lib/lava/dispatcher/tmp/11299523
263 13:53:49.415559 JobError: Your job cannot terminate cleanly.