Boot log: qemu_arm64-virt-gicv3

    1 07:57:43.506800  Action timeout for lava-test-shell exceeds Job timeout
    2 07:57:43.507089  Action timeout for lava-test-retry exceeds Job timeout
    3 07:57:43.554994  lava-dispatcher, installed at version: 2022.08
    4 07:57:43.555140  start: 0 validate
    5 07:57:43.555274  Start time: 2022-11-04 07:57:43.555265+00:00 (UTC)
    6 07:57:43.556144  Validating that http://storage.kernelci.org/cip/linux-5.10.y-cip/v5.10.147-cip18-12-gcb2b164780be/arm64/defconfig/gcc-10/kernel/Image exists
    7 07:57:43.889816  Validating that http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz exists
    8 07:57:44.218900  cmd: ['docker', 'pull', 'kernelci/qemu']
    9 07:57:44.219408  Calling: 'nice' 'docker' 'pull' 'kernelci/qemu'
   10 07:57:44.274663  >> Using default tag: latest

   11 07:57:45.561611  >> latest: Pulling from kernelci/qemu

   12 07:57:45.561828  >> Digest: sha256:8fee6998f00bef4b7bdd5e16e62c13a4bb460abfa7622e9e13c57b892d2ebaad

   13 07:57:45.561932  >> Status: Image is up to date for kernelci/qemu:latest

   14 07:57:45.564034  Returned 0 in 1 seconds
   15 07:57:45.715684  cmd: ['docker', 'run', '--rm', '--init', 'kernelci/qemu', 'qemu-system-aarch64', '--version']
   16 07:57:45.716388  Calling: 'nice' 'docker' 'run' '--rm' '--init' 'kernelci/qemu' 'qemu-system-aarch64' '--version'
   17 07:57:46.289180  >> QEMU emulator version 7.1.0 (Debian 1:7.1+dfsg-2~bpo11+3)

   18 07:57:46.289542  >> Copyright (c) 2003-2022 Fabrice Bellard and the QEMU Project developers

   19 07:57:46.582805  Returned 0 in 0 seconds
   20 07:57:46.684056  validate duration: 3.13
   22 07:57:46.684581  start: 1 deployimages (timeout 00:03:00) [common]
   23 07:57:46.684721  start: 1.1 lava-overlay (timeout 00:03:00) [common]
   24 07:57:46.685001  [common] Preparing overlay tarball in /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least
   25 07:57:46.685194  makedir: /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin
   26 07:57:46.685339  makedir: /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/tests
   27 07:57:46.685481  makedir: /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/results
   28 07:57:46.685630  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-add-keys
   29 07:57:46.685828  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-add-sources
   30 07:57:46.686005  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-background-process-start
   31 07:57:46.686184  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-background-process-stop
   32 07:57:46.686354  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-common-functions
   33 07:57:46.686524  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-echo-ipv4
   34 07:57:46.686701  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-install-packages
   35 07:57:46.686884  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-installed-packages
   36 07:57:46.687057  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-os-build
   37 07:57:46.687231  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-probe-channel
   38 07:57:46.687404  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-probe-ip
   39 07:57:46.687574  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-target-ip
   40 07:57:46.687746  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-target-mac
   41 07:57:46.687916  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-target-storage
   42 07:57:46.688173  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-test-case
   43 07:57:46.688419  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-test-event
   44 07:57:46.688675  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-test-feedback
   45 07:57:46.688872  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-test-raise
   46 07:57:46.689042  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-test-reference
   47 07:57:46.689209  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-test-runner
   48 07:57:46.689377  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-test-set
   49 07:57:46.689545  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-test-shell
   50 07:57:46.689714  Updating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-install-packages (oe)
   51 07:57:46.689927  Updating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/bin/lava-installed-packages (oe)
   52 07:57:46.690097  Creating /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/environment
   53 07:57:46.690242  LAVA metadata
   54 07:57:46.690338  - LAVA_JOB_ID=7844653
   55 07:57:46.690437  - LAVA_DISPATCHER_IP=192.168.122.1
   56 07:57:46.690607  start: 1.1.1 lava-vland-overlay (timeout 00:03:00) [common]
   57 07:57:46.690709  skipped lava-vland-overlay
   58 07:57:46.690834  end: 1.1.1 lava-vland-overlay (duration 00:00:00) [common]
   59 07:57:46.690955  start: 1.1.2 lava-multinode-overlay (timeout 00:03:00) [common]
   60 07:57:46.691044  skipped lava-multinode-overlay
   61 07:57:46.691163  end: 1.1.2 lava-multinode-overlay (duration 00:00:00) [common]
   62 07:57:46.691281  start: 1.1.3 test-definition (timeout 00:03:00) [common]
   63 07:57:46.691389  Loading test definitions
   64 07:57:46.691589  start: 1.1.3.1 git-repo-action (timeout 00:03:00) [common]
   65 07:57:46.691699  Using /lava-7844653 at stage 0
   66 07:57:46.691847  Fetching tests from https://github.com/kernelci/test-definitions
   67 07:57:46.691967  Running '/usr/bin/git clone https://github.com/kernelci/test-definitions /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/0/tests/0_smc'
   68 07:57:49.131432  Running '/usr/bin/git checkout kernelci.org
   69 07:57:49.246547  Tests stored (tmp) in /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/0/tests/0_smc/automated/linux/spectre-meltdown-checker-test/spectre-meltdown-checker-test.yaml
   70 07:57:49.247324  uuid=7844653_1.1.3.1 testdef=None
   71 07:57:49.247507  end: 1.1.3.1 git-repo-action (duration 00:00:03) [common]
   73 07:57:49.247798  start: 1.1.3.2 test-overlay (timeout 00:02:57) [common]
   74 07:57:49.248642  end: 1.1.3.2 test-overlay (duration 00:00:00) [common]
   76 07:57:49.248934  start: 1.1.3.3 test-install-overlay (timeout 00:02:57) [common]
   77 07:57:49.250024  end: 1.1.3.3 test-install-overlay (duration 00:00:00) [common]
   79 07:57:49.250325  start: 1.1.3.4 test-runscript-overlay (timeout 00:02:57) [common]
   80 07:57:49.251356  runner path: /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/0/tests/0_smc test_uuid 7844653_1.1.3.1
   81 07:57:49.251556  end: 1.1.3.4 test-runscript-overlay (duration 00:00:00) [common]
   83 07:57:49.251822  Creating lava-test-runner.conf files
   84 07:57:49.251901  Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/7844653/lava-overlay-i74least/lava-7844653/0 for stage 0
   85 07:57:49.252016  - 0_smc
   86 07:57:49.252141  end: 1.1.3 test-definition (duration 00:00:03) [common]
   87 07:57:49.252247  start: 1.1.4 compress-overlay (timeout 00:02:57) [common]
   88 07:57:58.206113  end: 1.1.4 compress-overlay (duration 00:00:09) [common]
   89 07:57:58.206309  start: 1.1.5 persistent-nfs-overlay (timeout 00:02:48) [common]
   90 07:57:58.206437  end: 1.1.5 persistent-nfs-overlay (duration 00:00:00) [common]
   91 07:57:58.206579  end: 1.1 lava-overlay (duration 00:00:12) [common]
   92 07:57:58.206701  start: 1.2 apply-overlay-guest (timeout 00:02:48) [common]
   93 07:57:58.206802  Overlay: /var/lib/lava/dispatcher/tmp/7844653/compress-overlay-d_p8x24_/overlay-1.1.4.tar.gz
   94 07:58:03.206065  end: 1.2 apply-overlay-guest (duration 00:00:05) [common]
   96 07:58:03.206948  start: 1.3 deploy-device-env (timeout 00:02:43) [common]
   97 07:58:03.207122  end: 1.3 deploy-device-env (duration 00:00:00) [common]
   98 07:58:03.207298  start: 1.4 download-retry (timeout 00:02:43) [common]
   99 07:58:03.207475  start: 1.4.1 http-download (timeout 00:02:43) [common]
  100 07:58:03.207780  downloading http://storage.kernelci.org/cip/linux-5.10.y-cip/v5.10.147-cip18-12-gcb2b164780be/arm64/defconfig/gcc-10/kernel/Image
  101 07:58:03.207950  saving as /var/lib/lava/dispatcher/tmp/7844653/deployimages-hfw_j1sk/kernel/Image
  102 07:58:03.208109  total size: 31707648 (30MB)
  103 07:58:03.208246  No compression specified
  104 07:58:03.687633  progress   0% (0MB)
  105 07:58:04.500068  progress   5% (1MB)
  106 07:58:04.675824  progress  10% (3MB)
  107 07:58:04.978754  progress  15% (4MB)
  108 07:58:05.116388  progress  20% (6MB)
  109 07:58:05.175060  progress  25% (7MB)
  110 07:58:05.298047  progress  30% (9MB)
  111 07:58:05.441480  progress  35% (10MB)
  112 07:58:05.497406  progress  40% (12MB)
  113 07:58:05.625602  progress  45% (13MB)
  114 07:58:05.764714  progress  50% (15MB)
  115 07:58:05.822039  progress  55% (16MB)
  116 07:58:05.945785  progress  60% (18MB)
  117 07:58:06.079972  progress  65% (19MB)
  118 07:58:06.134646  progress  70% (21MB)
  119 07:58:06.258796  progress  75% (22MB)
  120 07:58:06.396676  progress  80% (24MB)
  121 07:58:06.449906  progress  85% (25MB)
  122 07:58:06.572668  progress  90% (27MB)
  123 07:58:06.708419  progress  95% (28MB)
  124 07:58:06.744570  progress 100% (30MB)
  125 07:58:06.745275  30MB downloaded in 3.54s (8.55MB/s)
  126 07:58:06.745667  end: 1.4.1 http-download (duration 00:00:04) [common]
  128 07:58:06.746305  end: 1.4 download-retry (duration 00:00:04) [common]
  129 07:58:06.746542  start: 1.5 download-retry (timeout 00:02:40) [common]
  130 07:58:06.746773  start: 1.5.1 http-download (timeout 00:02:40) [common]
  131 07:58:06.747051  Not decompressing ramdisk as can be used compressed.
  132 07:58:06.747272  downloading http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz
  133 07:58:06.747449  saving as /var/lib/lava/dispatcher/tmp/7844653/deployimages-hfw_j1sk/ramdisk/rootfs.cpio.gz
  134 07:58:06.747612  total size: 8172427 (7MB)
  135 07:58:06.747771  No compression specified
  136 07:58:07.223198  progress   0% (0MB)
  137 07:58:07.701728  progress   5% (0MB)
  138 07:58:07.859295  progress  10% (0MB)
  139 07:58:08.014165  progress  15% (1MB)
  140 07:58:08.026745  progress  20% (1MB)
  141 07:58:08.170561  progress  25% (1MB)
  142 07:58:08.175206  progress  30% (2MB)
  143 07:58:08.180293  progress  35% (2MB)
  144 07:58:08.184543  progress  40% (3MB)
  145 07:58:08.325231  progress  45% (3MB)
  146 07:58:08.330091  progress  50% (3MB)
  147 07:58:08.335226  progress  55% (4MB)
  148 07:58:08.339826  progress  60% (4MB)
  149 07:58:08.497671  progress  65% (5MB)
  150 07:58:08.501669  progress  70% (5MB)
  151 07:58:08.505083  progress  75% (5MB)
  152 07:58:08.508945  progress  80% (6MB)
  153 07:58:08.512903  progress  85% (6MB)
  154 07:58:08.516731  progress  90% (7MB)
  155 07:58:08.520502  progress  95% (7MB)
  156 07:58:08.659327  progress 100% (7MB)
  157 07:58:08.659806  7MB downloaded in 1.91s (4.08MB/s)
  158 07:58:08.660118  end: 1.5.1 http-download (duration 00:00:02) [common]
  160 07:58:08.660687  end: 1.5 download-retry (duration 00:00:02) [common]
  161 07:58:08.660873  end: 1 deployimages (duration 00:00:22) [common]
  162 07:58:08.661063  start: 2 boot-image-retry (timeout 00:05:00) [common]
  163 07:58:08.661252  start: 2.1 boot-qemu-image (timeout 00:05:00) [common]
  164 07:58:08.661435  start: 2.1.1 execute-qemu (timeout 00:05:00) [common]
  165 07:58:08.661664  Extending command line for qcow2 test overlay
  166 07:58:08.662313  Pulling docker image
  167 07:58:08.662486  cmd: ['docker', 'pull', 'kernelci/qemu']
  168 07:58:08.662638  Calling: 'nice' 'docker' 'pull' 'kernelci/qemu'
  169 07:58:08.688870  >> Using default tag: latest

  170 07:58:09.910823  >> Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

  171 07:58:09.915746  Returned 1 in 1 seconds
  172 07:58:09.916235  Unable to run 'nice' '['docker', 'pull', 'kernelci/qemu']'
  174 07:58:09.917179  end: 2.1.1 execute-qemu (duration 00:00:01) [common]
  176 07:58:09.918225  boot-qemu-image failed: 1 of 1 attempts. 'Unable to run 'nice' 'docker' 'pull' 'kernelci/qemu''
  177 07:58:09.918617  Stopping the qemu container lava-docker-qemu-7844653-2.1.1-3gnst3m0jf
  179 07:58:09.952206  end: 2.1 boot-qemu-image (duration 00:00:01) [common]
  181 07:58:09.952578  boot-image-retry failed: 1 of 1 attempts. 'Unable to run 'nice' 'docker' 'pull' 'kernelci/qemu''
  182 07:58:09.952701  Stopping the qemu container lava-docker-qemu-7844653-2.1.1-3gnst3m0jf
  184 07:58:09.982030  end: 2 boot-image-retry (duration 00:00:01) [common]
  186 07:58:09.982493  Cleaning after the job
  187 07:58:09.982660  Cleaning up download directory: /var/lib/lava/dispatcher/tmp/7844653/deployimages-hfw_j1sk/kernel
  188 07:58:09.986628  Cleaning up download directory: /var/lib/lava/dispatcher/tmp/7844653/deployimages-hfw_j1sk/ramdisk
  189 07:58:09.987899  Stopping the qemu container lava-docker-qemu-7844653-2.1.1-3gnst3m0jf
  190 07:58:10.018329  start: 4.1 power-off (timeout 00:00:30) [common]
  191 07:58:10.018772  end: 4.1 power-off (duration 00:00:00) [common]
  192 07:58:10.018922  start: 4.2 read-feedback (timeout 00:10:00) [common]
  193 07:58:10.019047  No connection for namespace common
  194 07:58:10.019175  end: 4.2 read-feedback (duration 00:00:00) [common]
  195 07:58:10.019305  Root tmp directory removed at /var/lib/lava/dispatcher/tmp/7844653
  196 07:58:10.066652  JobError: Your job cannot terminate cleanly.