Boot log: qemu_arm64-virt-gicv2-uefi
- Warnings: 0
- Kernel Warnings: 0
- Kernel Errors: 0
- Errors: 2
- Boot result: FAIL
1 01:50:08.907717 lava-dispatcher, installed at version: 2023.08
2 01:50:08.907977 start: 0 validate
3 01:50:08.908155 Start time: 2023-10-11 01:50:08.908144+00:00 (UTC)
4 01:50:08.909264 Validating that http://storage.kernelci.org/images/uefi/edk2-stable202005/arm64/QEMU_EFI.fd exists
5 01:50:09.192418 Validating that http://storage.kernelci.org/cip-gitlab/ci-iwamatsu-linux-4.19.y-cip-rc/v4.19.295-cip103-95-ge42cfc8bb88b7/arm64/defconfig/gcc-10/kernel/Image exists
6 01:50:09.328592 Validating that http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz exists
7 01:50:09.465234 Calling: 'docker' 'pull' 'kernelci/qemu'
8 01:50:09.492168 >> Using default tag: latest
9 01:50:10.455340 >> latest: Pulling from kernelci/qemu
10 01:50:10.461932 >> Digest: sha256:b3fa7d904b2cebc15ac3d3be74e66268bff278fe244a20f5f200f7e1640d8f15
11 01:50:10.462281 >> Status: Image is up to date for kernelci/qemu:latest
12 01:50:10.468633 >> docker.io/kernelci/qemu:latest
13 01:50:10.471299 Returned 0 in 1 seconds
14 01:50:10.571707 Calling: 'docker' 'pull' 'kernelci/qemu'
15 01:50:10.597659 >> Using default tag: latest
16 01:50:11.592553 >> latest: Pulling from kernelci/qemu
17 01:50:11.599146 >> Digest: sha256:b3fa7d904b2cebc15ac3d3be74e66268bff278fe244a20f5f200f7e1640d8f15
18 01:50:11.599327 >> Status: Image is up to date for kernelci/qemu:latest
19 01:50:11.606039 >> docker.io/kernelci/qemu:latest
20 01:50:11.609335 Returned 0 in 1 seconds
21 01:50:11.739377 Calling: 'docker' 'run' '--rm' '--init' 'kernelci/qemu' 'qemu-system-aarch64' '--version'
22 01:50:14.987437 >> QEMU emulator version 7.2.2 (Debian 1:7.2+dfsg-7~bpo11+1)
23 01:50:14.988091 >> Copyright (c) 2003-2022 Fabrice Bellard and the QEMU Project developers
24 01:50:15.307110 Returned 0 in 3 seconds
25 01:50:15.407989 validate duration: 6.50
27 01:50:15.408514 start: 1 deployimages (timeout 00:03:00) [common]
28 01:50:15.408685 start: 1.1 lava-overlay (timeout 00:03:00) [common]
29 01:50:15.408987 [common] Preparing overlay tarball in /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n
30 01:50:15.409164 makedir: /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin
31 01:50:15.409292 makedir: /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/tests
32 01:50:15.409411 makedir: /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/results
33 01:50:15.409553 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-add-keys
34 01:50:15.409738 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-add-sources
35 01:50:15.409917 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-background-process-start
36 01:50:15.410176 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-background-process-stop
37 01:50:15.410327 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-common-functions
38 01:50:15.410481 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-echo-ipv4
39 01:50:15.410635 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-install-packages
40 01:50:15.410785 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-installed-packages
41 01:50:15.410937 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-os-build
42 01:50:15.411088 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-probe-channel
43 01:50:15.411240 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-probe-ip
44 01:50:15.411390 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-target-ip
45 01:50:15.411538 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-target-mac
46 01:50:15.411709 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-target-storage
47 01:50:15.411869 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-test-case
48 01:50:15.412055 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-test-event
49 01:50:15.412258 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-test-feedback
50 01:50:15.412485 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-test-raise
51 01:50:15.412753 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-test-reference
52 01:50:15.412938 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-test-runner
53 01:50:15.413119 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-test-set
54 01:50:15.413340 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-test-shell
55 01:50:15.413536 Updating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-install-packages (oe)
56 01:50:15.413746 Updating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/bin/lava-installed-packages (oe)
57 01:50:15.413906 Creating /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/environment
58 01:50:15.414047 LAVA metadata
59 01:50:15.414155 - LAVA_JOB_ID=11733127
60 01:50:15.414240 - LAVA_DISPATCHER_IP=192.168.122.1
61 01:50:15.414420 start: 1.1.1 lava-vland-overlay (timeout 00:03:00) [common]
62 01:50:15.414504 skipped lava-vland-overlay
63 01:50:15.414662 end: 1.1.1 lava-vland-overlay (duration 00:00:00) [common]
64 01:50:15.414765 start: 1.1.2 lava-multinode-overlay (timeout 00:03:00) [common]
65 01:50:15.414870 skipped lava-multinode-overlay
66 01:50:15.414960 end: 1.1.2 lava-multinode-overlay (duration 00:00:00) [common]
67 01:50:15.415063 start: 1.1.3 test-definition (timeout 00:03:00) [common]
68 01:50:15.415158 Loading test definitions
69 01:50:15.415272 start: 1.1.3.1 inline-repo-action (timeout 00:03:00) [common]
70 01:50:15.415394 Using /lava-11733127 at stage 0
71 01:50:15.415940 uuid=11733127_1.1.3.1 testdef=None
72 01:50:15.416098 end: 1.1.3.1 inline-repo-action (duration 00:00:00) [common]
73 01:50:15.416282 start: 1.1.3.2 test-overlay (timeout 00:03:00) [common]
74 01:50:15.417382 end: 1.1.3.2 test-overlay (duration 00:00:00) [common]
76 01:50:15.417880 start: 1.1.3.3 test-install-overlay (timeout 00:03:00) [common]
77 01:50:15.419168 end: 1.1.3.3 test-install-overlay (duration 00:00:00) [common]
79 01:50:15.419688 start: 1.1.3.4 test-runscript-overlay (timeout 00:03:00) [common]
80 01:50:15.420571 runner path: /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/0/tests/0_dmesg test_uuid 11733127_1.1.3.1
81 01:50:15.420895 end: 1.1.3.4 test-runscript-overlay (duration 00:00:00) [common]
83 01:50:15.421233 start: 1.1.3.5 inline-repo-action (timeout 00:03:00) [common]
84 01:50:15.421351 Using /lava-11733127 at stage 1
85 01:50:15.421768 uuid=11733127_1.1.3.5 testdef=None
86 01:50:15.421894 end: 1.1.3.5 inline-repo-action (duration 00:00:00) [common]
87 01:50:15.422015 start: 1.1.3.6 test-overlay (timeout 00:03:00) [common]
88 01:50:15.422592 end: 1.1.3.6 test-overlay (duration 00:00:00) [common]
90 01:50:15.422868 start: 1.1.3.7 test-install-overlay (timeout 00:03:00) [common]
91 01:50:15.423717 end: 1.1.3.7 test-install-overlay (duration 00:00:00) [common]
93 01:50:15.424133 start: 1.1.3.8 test-runscript-overlay (timeout 00:03:00) [common]
94 01:50:15.425396 runner path: /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/1/tests/1_bootrr test_uuid 11733127_1.1.3.5
95 01:50:15.425684 end: 1.1.3.8 test-runscript-overlay (duration 00:00:00) [common]
97 01:50:15.426163 Creating lava-test-runner.conf files
98 01:50:15.426374 Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/0 for stage 0
99 01:50:15.426578 - 0_dmesg
100 01:50:15.426757 Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/11733127/lava-overlay-iwaqbf3n/lava-11733127/1 for stage 1
101 01:50:15.426960 - 1_bootrr
102 01:50:15.427144 end: 1.1.3 test-definition (duration 00:00:00) [common]
103 01:50:15.427306 start: 1.1.4 compress-overlay (timeout 00:03:00) [common]
104 01:50:15.438682 end: 1.1.4 compress-overlay (duration 00:00:00) [common]
105 01:50:15.439067 start: 1.1.5 persistent-nfs-overlay (timeout 00:03:00) [common]
106 01:50:15.439230 end: 1.1.5 persistent-nfs-overlay (duration 00:00:00) [common]
107 01:50:15.439400 end: 1.1 lava-overlay (duration 00:00:00) [common]
108 01:50:15.439552 start: 1.2 apply-overlay-guest (timeout 00:03:00) [common]
109 01:50:15.439697 Overlay: /var/lib/lava/dispatcher/tmp/11733127/compress-overlay-w0dpecbe/overlay-1.1.4.tar.gz
110 01:50:18.057113 end: 1.2 apply-overlay-guest (duration 00:00:03) [common]
112 01:50:18.058096 start: 1.3 deploy-device-env (timeout 00:02:57) [common]
113 01:50:18.058230 end: 1.3 deploy-device-env (duration 00:00:00) [common]
114 01:50:18.058478 start: 1.4 download-retry (timeout 00:02:57) [common]
115 01:50:18.058608 start: 1.4.1 http-download (timeout 00:02:57) [common]
116 01:50:18.058952 downloading http://storage.kernelci.org/images/uefi/edk2-stable202005/arm64/QEMU_EFI.fd
117 01:50:18.059043 saving as /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/bios/QEMU_EFI.fd
118 01:50:18.059122 total size: 2097152 (2 MB)
119 01:50:18.059203 No compression specified
120 01:50:18.331391 progress 1 % (0 MB)
121 01:50:18.601097 progress 6 % (0 MB)
122 01:50:18.736220 progress 12 % (0 MB)
123 01:50:18.737720 progress 17 % (0 MB)
124 01:50:18.871509 progress 23 % (0 MB)
125 01:50:18.873241 progress 28 % (0 MB)
126 01:50:18.874614 progress 34 % (0 MB)
127 01:50:18.875783 progress 39 % (0 MB)
128 01:50:19.005466 progress 45 % (0 MB)
129 01:50:19.007281 progress 50 % (1 MB)
130 01:50:19.008618 progress 56 % (1 MB)
131 01:50:19.010804 progress 62 % (1 MB)
132 01:50:19.011628 progress 67 % (1 MB)
133 01:50:19.012749 progress 73 % (1 MB)
134 01:50:19.013614 progress 78 % (1 MB)
135 01:50:19.014728 progress 84 % (1 MB)
136 01:50:19.140215 progress 89 % (1 MB)
137 01:50:19.142044 progress 95 % (1 MB)
138 01:50:19.143233 progress 100 % (2 MB)
139 01:50:19.143735 2 MB downloaded in 1.08 s (1.84 MB/s)
140 01:50:19.144067 end: 1.4.1 http-download (duration 00:00:01) [common]
142 01:50:19.144660 end: 1.4 download-retry (duration 00:00:01) [common]
143 01:50:19.144867 start: 1.5 download-retry (timeout 00:02:56) [common]
144 01:50:19.145060 start: 1.5.1 http-download (timeout 00:02:56) [common]
145 01:50:19.145344 downloading http://storage.kernelci.org/cip-gitlab/ci-iwamatsu-linux-4.19.y-cip-rc/v4.19.295-cip103-95-ge42cfc8bb88b7/arm64/defconfig/gcc-10/kernel/Image
146 01:50:19.145512 saving as /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/kernel/Image
147 01:50:19.145667 total size: 19307008 (18 MB)
148 01:50:19.145828 No compression specified
149 01:50:19.283209 progress 0 % (0 MB)
150 01:50:19.291505 progress 5 % (0 MB)
151 01:50:19.299886 progress 10 % (1 MB)
152 01:50:19.425177 progress 15 % (2 MB)
153 01:50:19.568739 progress 20 % (3 MB)
154 01:50:19.575700 progress 25 % (4 MB)
155 01:50:19.581694 progress 30 % (5 MB)
156 01:50:19.711026 progress 35 % (6 MB)
157 01:50:19.860021 progress 40 % (7 MB)
158 01:50:19.986844 progress 45 % (8 MB)
159 01:50:19.993065 progress 50 % (9 MB)
160 01:50:19.999278 progress 55 % (10 MB)
161 01:50:20.128262 progress 60 % (11 MB)
162 01:50:20.137207 progress 65 % (11 MB)
163 01:50:20.398379 progress 70 % (12 MB)
164 01:50:20.404317 progress 75 % (13 MB)
165 01:50:20.410302 progress 80 % (14 MB)
166 01:50:20.537318 progress 85 % (15 MB)
167 01:50:20.805561 progress 90 % (16 MB)
168 01:50:20.812824 progress 95 % (17 MB)
169 01:50:20.819313 progress 100 % (18 MB)
170 01:50:20.819526 18 MB downloaded in 1.67 s (11.00 MB/s)
171 01:50:20.819709 end: 1.5.1 http-download (duration 00:00:02) [common]
173 01:50:20.819999 end: 1.5 download-retry (duration 00:00:02) [common]
174 01:50:20.820104 start: 1.6 download-retry (timeout 00:02:55) [common]
175 01:50:20.820209 start: 1.6.1 http-download (timeout 00:02:55) [common]
176 01:50:20.820352 Not decompressing ramdisk as can be used compressed.
177 01:50:20.820455 downloading http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz
178 01:50:20.820552 saving as /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/ramdisk/rootfs.cpio.gz
179 01:50:20.820640 total size: 8181372 (7 MB)
180 01:50:20.820714 No compression specified
181 01:50:20.956996 progress 0 % (0 MB)
182 01:50:20.960096 progress 5 % (0 MB)
183 01:50:20.963401 progress 10 % (0 MB)
184 01:50:20.967333 progress 15 % (1 MB)
185 01:50:21.094255 progress 20 % (1 MB)
186 01:50:21.097841 progress 25 % (1 MB)
187 01:50:21.101096 progress 30 % (2 MB)
188 01:50:21.227904 progress 35 % (2 MB)
189 01:50:21.231568 progress 40 % (3 MB)
190 01:50:21.235444 progress 45 % (3 MB)
191 01:50:21.239619 progress 50 % (3 MB)
192 01:50:21.365593 progress 55 % (4 MB)
193 01:50:21.369186 progress 60 % (4 MB)
194 01:50:21.373232 progress 65 % (5 MB)
195 01:50:21.498607 progress 70 % (5 MB)
196 01:50:21.502969 progress 75 % (5 MB)
197 01:50:21.506437 progress 80 % (6 MB)
198 01:50:21.511164 progress 85 % (6 MB)
199 01:50:21.635895 progress 90 % (7 MB)
200 01:50:21.640021 progress 95 % (7 MB)
201 01:50:21.644678 progress 100 % (7 MB)
202 01:50:21.644958 7 MB downloaded in 0.82 s (9.47 MB/s)
203 01:50:21.645133 end: 1.6.1 http-download (duration 00:00:01) [common]
205 01:50:21.645427 end: 1.6 download-retry (duration 00:00:01) [common]
206 01:50:21.645542 end: 1 deployimages (duration 00:00:06) [common]
207 01:50:21.645653 start: 2 boot-image-retry (timeout 00:05:00) [common]
208 01:50:21.645763 start: 2.1 boot-qemu-image (timeout 00:05:00) [common]
209 01:50:21.645863 start: 2.1.1 execute-qemu (timeout 00:05:00) [common]
210 01:50:21.645997 Extending command line for qcow2 test overlay
211 01:50:21.646414 Pulling docker image
212 01:50:21.646520 Calling: 'docker' 'pull' 'kernelci/qemu'
213 01:50:21.673651 >> Using default tag: latest
214 01:50:22.611021 >> latest: Pulling from kernelci/qemu
215 01:50:22.617872 >> Digest: sha256:b3fa7d904b2cebc15ac3d3be74e66268bff278fe244a20f5f200f7e1640d8f15
216 01:50:22.618095 >> Status: Image is up to date for kernelci/qemu:latest
217 01:50:22.624509 >> docker.io/kernelci/qemu:latest
218 01:50:22.626669 Returned 0 in 0 seconds
219 01:50:22.727026 Calling: 'docker' 'pull' 'kernelci/qemu'
220 01:50:22.754490 >> Using default tag: latest
221 01:50:23.698940 >> latest: Pulling from kernelci/qemu
222 01:50:23.705816 >> Digest: sha256:b3fa7d904b2cebc15ac3d3be74e66268bff278fe244a20f5f200f7e1640d8f15
223 01:50:23.706210 >> Status: Image is up to date for kernelci/qemu:latest
224 01:50:23.712476 >> docker.io/kernelci/qemu:latest
225 01:50:23.714426 Returned 0 in 0 seconds
226 01:50:23.843696 Boot command: docker run --network=host --cap-add=NET_ADMIN --interactive --tty --rm --init --name=lava-docker-qemu-11733127-2.1.1-kschgor6pd --device=/dev/kvm --device=/dev/net/tun --mount=type=bind,source=/var/lib/lava/dispatcher/tmp,destination=/var/lib/lava/dispatcher/tmp kernelci/qemu qemu-system-aarch64 -cpu max,pauth-impdef=on -machine virt,gic-version=2,mte=on,accel=tcg -nographic -net nic,model=virtio,macaddr=DE:AD:BE:EF:AE:1C -net bridge,br=virbr0 -m 1024 -monitor none -bios /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/bios/QEMU_EFI.fd -kernel /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/kernel/Image -append "console=ttyAMA0,115200 root=/dev/ram0 debug verbose console_msg_format=syslog earlycon deferred_probe_timeout=60" -initrd /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/ramdisk/rootfs.cpio.gz -drive format=qcow2,file=/var/lib/lava/dispatcher/tmp/11733127/apply-overlay-guest-vvss13vh/lava-guest.qcow2,media=disk,if=virtio,id=lavatest
227 01:50:23.848551 started a shell command
228 01:50:23.849254 end: 2.1.1 execute-qemu (duration 00:00:02) [common]
229 01:50:23.849419 end: 2.1 boot-qemu-image (duration 00:00:02) [common]
230 01:50:23.849554 start: 2.2 auto-login-action (timeout 00:04:58) [common]
231 01:50:23.849699 Setting prompt string to ['Linux version [0-9]']
232 01:50:23.849797 auto-login-action: Wait for prompt ['Linux version [0-9]'] (timeout 00:05:00)
233 01:50:26.756790 [2J[01;01H[=3h[2J[01;01H[0m[35m[40m[0m[37m[40mEFI stub: Booting Linux Kernel...
234 01:50:26.757182
235 01:50:26.775759 EFI stub: Generating empty DTB
236 01:50:26.776090
237 01:50:26.788018 EFI stub: Exiting boot services and installing virtual address map...
238 01:50:26.788306
240 01:55:21.849956 end: 2.2 auto-login-action (duration 00:04:58) [common]
242 01:55:21.850321 boot-image-retry failed: 1 of 1 attempts. 'auto-login-action timed out after 298 seconds'
243 01:55:21.850505 Stopping the qemu container lava-docker-qemu-11733127-2.1.1-kschgor6pd
245 01:55:41.347181 end: 2 boot-image-retry (duration 00:05:20) [common]
247 01:55:41.347761 Cleaning after the job
248 01:55:41.347977 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/bios
249 01:55:41.348674 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/kernel
250 01:55:41.351514 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11733127/deployimages-eywi3ami/ramdisk
251 01:55:41.352894 Stopping the qemu container lava-docker-qemu-11733127-2.1.1-kschgor6pd
252 01:55:41.380445 start: 5.1 power-off (timeout 00:00:30) [common]
253 01:55:41.381046 end: 5.1 power-off (duration 00:00:00) [common]
254 01:55:41.381211 start: 5.2 read-feedback (timeout 00:10:00) [common]
255 01:55:41.381657 Listened to connection for namespace 'common' for up to 1s
256 01:55:41.381932 Finalising connection for namespace 'common'
258 01:55:41.482425 poweroff
260 01:55:41.483244 Already disconnected
261 01:55:41.583666 end: 5.2 read-feedback (duration 00:00:00) [common]
262 01:55:41.583931 Root tmp directory removed at /var/lib/lava/dispatcher/tmp/11733127
263 01:55:41.586084 JobError: Your job cannot terminate cleanly.