Boot log: qemu_arm64-virt-gicv3

    1 03:19:29.904925  lava-dispatcher, installed at version: 2022.11
    2 03:19:29.905145  start: 0 validate
    3 03:19:29.905327  Start time: 2023-01-19 03:19:29.905312+00:00 (UTC)
    4 03:19:29.906289  Validating that http://storage.kernelci.org/cip-gitlab/ci-pavel-linux-test/v4.19.269-cip88-rt28-rebase/arm64/defconfig/gcc-10/kernel/Image exists
    5 03:19:30.224431  Validating that http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz exists
    6 03:19:30.541710  cmd: ['docker', 'pull', 'kernelci/qemu']
    7 03:19:30.541879  Calling: 'nice' 'docker' 'pull' 'kernelci/qemu'
    8 03:19:30.569689  >> Using default tag: latest

    9 03:19:31.721790  >> latest: Pulling from kernelci/qemu

   10 03:19:31.722040  >> Digest: sha256:998833304dcec57bc796d4229fb4ff10152544f21845a27b811fbba06720d0be

   11 03:19:31.722174  >> Status: Image is up to date for kernelci/qemu:latest

   12 03:19:31.723743  Returned 0 in 1 seconds
   13 03:19:31.860132  cmd: ['docker', 'run', '--rm', '--init', 'kernelci/qemu', 'qemu-system-aarch64', '--version']
   14 03:19:31.860526  Calling: 'nice' 'docker' 'run' '--rm' '--init' 'kernelci/qemu' 'qemu-system-aarch64' '--version'
   15 03:19:32.371067  >> QEMU emulator version 7.2.0 (Debian 1:7.2+dfsg-1~bpo11+2)

   16 03:19:32.371598  >> Copyright (c) 2003-2022 Fabrice Bellard and the QEMU Project developers

   17 03:19:32.572636  Returned 0 in 0 seconds
   18 03:19:32.674042  validate duration: 2.77
   20 03:19:32.674715  start: 1 deployimages (timeout 00:03:00) [common]
   21 03:19:32.674935  start: 1.1 lava-overlay (timeout 00:03:00) [common]
   22 03:19:32.675363  [common] Preparing overlay tarball in /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl
   23 03:19:32.675638  makedir: /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin
   24 03:19:32.675844  makedir: /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/tests
   25 03:19:32.676042  makedir: /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/results
   26 03:19:32.676257  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-add-keys
   27 03:19:32.676554  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-add-sources
   28 03:19:32.676814  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-background-process-start
   29 03:19:32.677074  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-background-process-stop
   30 03:19:32.677326  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-common-functions
   31 03:19:32.677573  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-echo-ipv4
   32 03:19:32.677826  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-install-packages
   33 03:19:32.678075  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-installed-packages
   34 03:19:32.678320  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-os-build
   35 03:19:32.678567  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-probe-channel
   36 03:19:32.678818  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-probe-ip
   37 03:19:32.679081  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-target-ip
   38 03:19:32.679328  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-target-mac
   39 03:19:32.679577  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-target-storage
   40 03:19:32.679831  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-test-case
   41 03:19:32.680081  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-test-event
   42 03:19:32.680329  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-test-feedback
   43 03:19:32.680581  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-test-raise
   44 03:19:32.680836  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-test-reference
   45 03:19:32.681085  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-test-runner
   46 03:19:32.681333  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-test-set
   47 03:19:32.681584  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-test-shell
   48 03:19:32.681873  Updating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-install-packages (oe)
   49 03:19:32.682201  Updating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/bin/lava-installed-packages (oe)
   50 03:19:32.682462  Creating /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/environment
   51 03:19:32.682665  LAVA metadata
   52 03:19:32.682818  - LAVA_JOB_ID=8789794
   53 03:19:32.682971  - LAVA_DISPATCHER_IP=192.168.122.1
   54 03:19:32.683198  start: 1.1.1 lava-vland-overlay (timeout 00:03:00) [common]
   55 03:19:32.683347  skipped lava-vland-overlay
   56 03:19:32.683520  end: 1.1.1 lava-vland-overlay (duration 00:00:00) [common]
   57 03:19:32.683704  start: 1.1.2 lava-multinode-overlay (timeout 00:03:00) [common]
   58 03:19:32.683844  skipped lava-multinode-overlay
   59 03:19:32.684012  end: 1.1.2 lava-multinode-overlay (duration 00:00:00) [common]
   60 03:19:32.684306  start: 1.1.3 test-definition (timeout 00:03:00) [common]
   61 03:19:32.684476  Loading test definitions
   62 03:19:32.684676  start: 1.1.3.1 inline-repo-action (timeout 00:03:00) [common]
   63 03:19:32.684838  Using /lava-8789794 at stage 0
   64 03:19:32.685624  uuid=8789794_1.1.3.1 testdef=None
   65 03:19:32.686004  end: 1.1.3.1 inline-repo-action (duration 00:00:00) [common]
   66 03:19:32.686241  start: 1.1.3.2 test-overlay (timeout 00:03:00) [common]
   67 03:19:32.687531  end: 1.1.3.2 test-overlay (duration 00:00:00) [common]
   69 03:19:32.688384  start: 1.1.3.3 test-install-overlay (timeout 00:03:00) [common]
   70 03:19:32.690135  end: 1.1.3.3 test-install-overlay (duration 00:00:00) [common]
   72 03:19:32.690685  start: 1.1.3.4 test-runscript-overlay (timeout 00:03:00) [common]
   73 03:19:32.692080  runner path: /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/0/tests/0_dmesg test_uuid 8789794_1.1.3.1
   74 03:19:32.692439  end: 1.1.3.4 test-runscript-overlay (duration 00:00:00) [common]
   76 03:19:32.692974  start: 1.1.3.5 inline-repo-action (timeout 00:03:00) [common]
   77 03:19:32.693138  Using /lava-8789794 at stage 1
   78 03:19:32.693784  uuid=8789794_1.1.3.5 testdef=None
   79 03:19:32.693976  end: 1.1.3.5 inline-repo-action (duration 00:00:00) [common]
   80 03:19:32.694164  start: 1.1.3.6 test-overlay (timeout 00:03:00) [common]
   81 03:19:32.695201  end: 1.1.3.6 test-overlay (duration 00:00:00) [common]
   83 03:19:32.695718  start: 1.1.3.7 test-install-overlay (timeout 00:03:00) [common]
   84 03:19:32.697131  end: 1.1.3.7 test-install-overlay (duration 00:00:00) [common]
   86 03:19:32.697663  start: 1.1.3.8 test-runscript-overlay (timeout 00:03:00) [common]
   87 03:19:32.699043  runner path: /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/1/tests/1_bootrr test_uuid 8789794_1.1.3.5
   88 03:19:32.699348  end: 1.1.3.8 test-runscript-overlay (duration 00:00:00) [common]
   90 03:19:32.699832  Creating lava-test-runner.conf files
   91 03:19:32.699973  Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/0 for stage 0
   92 03:19:32.700160  - 0_dmesg
   93 03:19:32.700329  Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/8789794/lava-overlay-yxucbkjl/lava-8789794/1 for stage 1
   94 03:19:32.700519  - 1_bootrr
   95 03:19:32.700723  end: 1.1.3 test-definition (duration 00:00:00) [common]
   96 03:19:32.700911  start: 1.1.4 compress-overlay (timeout 00:03:00) [common]
   97 03:19:32.713104  end: 1.1.4 compress-overlay (duration 00:00:00) [common]
   98 03:19:32.713336  start: 1.1.5 persistent-nfs-overlay (timeout 00:03:00) [common]
   99 03:19:32.713523  end: 1.1.5 persistent-nfs-overlay (duration 00:00:00) [common]
  100 03:19:32.713712  end: 1.1 lava-overlay (duration 00:00:00) [common]
  101 03:19:32.713903  start: 1.2 apply-overlay-guest (timeout 00:03:00) [common]
  102 03:19:32.714064  Overlay: /var/lib/lava/dispatcher/tmp/8789794/compress-overlay-wtdsuz9_/overlay-1.1.4.tar.gz
  103 03:19:36.298069  end: 1.2 apply-overlay-guest (duration 00:00:04) [common]
  105 03:19:36.298684  start: 1.3 deploy-device-env (timeout 00:02:56) [common]
  106 03:19:36.298796  end: 1.3 deploy-device-env (duration 00:00:00) [common]
  107 03:19:36.298921  start: 1.4 download-retry (timeout 00:02:56) [common]
  108 03:19:36.299042  start: 1.4.1 http-download (timeout 00:02:56) [common]
  109 03:19:36.299241  downloading http://storage.kernelci.org/cip-gitlab/ci-pavel-linux-test/v4.19.269-cip88-rt28-rebase/arm64/defconfig/gcc-10/kernel/Image
  110 03:19:36.299330  saving as /var/lib/lava/dispatcher/tmp/8789794/deployimages-_wjgr4db/kernel/Image
  111 03:19:36.299409  total size: 19565056 (18MB)
  112 03:19:36.299485  No compression specified
  113 03:19:36.774149  progress   0% (0MB)
  114 03:19:37.561640  progress   5% (0MB)
  115 03:19:37.719616  progress  10% (1MB)
  116 03:19:37.727917  progress  15% (2MB)
  117 03:19:37.942419  progress  20% (3MB)
  118 03:19:37.948490  progress  25% (4MB)
  119 03:19:38.099244  progress  30% (5MB)
  120 03:19:38.237701  progress  35% (6MB)
  121 03:19:38.245996  progress  40% (7MB)
  122 03:19:38.568079  progress  45% (8MB)
  123 03:19:38.574203  progress  50% (9MB)
  124 03:19:38.619759  progress  55% (10MB)
  125 03:19:38.736210  progress  60% (11MB)
  126 03:19:38.879673  progress  65% (12MB)
  127 03:19:38.896531  progress  70% (13MB)
  128 03:19:39.048487  progress  75% (14MB)
  129 03:19:39.061350  progress  80% (14MB)
  130 03:19:39.208775  progress  85% (15MB)
  131 03:19:39.351403  progress  90% (16MB)
  132 03:19:39.368929  progress  95% (17MB)
  133 03:19:39.511677  progress 100% (18MB)
  134 03:19:39.512019  18MB downloaded in 3.21s (5.81MB/s)
  135 03:19:39.512259  end: 1.4.1 http-download (duration 00:00:03) [common]
  137 03:19:39.512637  end: 1.4 download-retry (duration 00:00:03) [common]
  138 03:19:39.512790  start: 1.5 download-retry (timeout 00:02:53) [common]
  139 03:19:39.512954  start: 1.5.1 http-download (timeout 00:02:53) [common]
  140 03:19:39.513131  Not decompressing ramdisk as can be used compressed.
  141 03:19:39.513248  downloading http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230114.0/arm64/rootfs.cpio.gz
  142 03:19:39.513358  saving as /var/lib/lava/dispatcher/tmp/8789794/deployimages-_wjgr4db/ramdisk/rootfs.cpio.gz
  143 03:19:39.513460  total size: 8180135 (7MB)
  144 03:19:39.513560  No compression specified
  145 03:19:39.988451  progress   0% (0MB)
  146 03:19:40.463871  progress   5% (0MB)
  147 03:19:40.622603  progress  10% (0MB)
  148 03:19:40.783406  progress  15% (1MB)
  149 03:19:40.788109  progress  20% (1MB)
  150 03:19:40.938256  progress  25% (1MB)
  151 03:19:40.945150  progress  30% (2MB)
  152 03:19:40.951044  progress  35% (2MB)
  153 03:19:40.955412  progress  40% (3MB)
  154 03:19:41.254568  progress  45% (3MB)
  155 03:19:41.259055  progress  50% (3MB)
  156 03:19:41.263924  progress  55% (4MB)
  157 03:19:41.268495  progress  60% (4MB)
  158 03:19:41.302585  progress  65% (5MB)
  159 03:19:41.307221  progress  70% (5MB)
  160 03:19:41.312013  progress  75% (5MB)
  161 03:19:41.412254  progress  80% (6MB)
  162 03:19:41.461398  progress  85% (6MB)
  163 03:19:41.467774  progress  90% (7MB)
  164 03:19:41.832319  progress  95% (7MB)
  165 03:19:43.413116  progress 100% (7MB)
  166 03:19:43.413595  7MB downloaded in 3.90s (2.00MB/s)
  167 03:19:43.413900  end: 1.5.1 http-download (duration 00:00:04) [common]
  169 03:19:43.414507  end: 1.5 download-retry (duration 00:00:04) [common]
  170 03:19:43.414695  end: 1 deployimages (duration 00:00:11) [common]
  171 03:19:43.414897  start: 2 boot-image-retry (timeout 00:05:00) [common]
  172 03:19:43.415144  start: 2.1 boot-qemu-image (timeout 00:05:00) [common]
  173 03:19:43.415358  start: 2.1.1 execute-qemu (timeout 00:05:00) [common]
  174 03:19:43.415614  Extending command line for qcow2 test overlay
  175 03:19:43.416271  Pulling docker image
  176 03:19:43.416445  cmd: ['docker', 'pull', 'kernelci/qemu']
  177 03:19:43.416596  Calling: 'nice' 'docker' 'pull' 'kernelci/qemu'
  178 03:19:43.443813  >> Using default tag: latest

  179 03:19:44.554468  >> Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

  180 03:19:44.556866  Returned 1 in 1 seconds
  181 03:19:44.557073  Unable to run 'nice' '['docker', 'pull', 'kernelci/qemu']'
  183 03:19:44.557465  end: 2.1.1 execute-qemu (duration 00:00:01) [common]
  185 03:19:44.557781  boot-qemu-image failed: 1 of 1 attempts. 'Unable to run 'nice' 'docker' 'pull' 'kernelci/qemu''
  186 03:19:44.557907  Stopping the qemu container lava-docker-qemu-8789794-2.1.1-t10la7qiw6
  188 03:19:44.585311  end: 2.1 boot-qemu-image (duration 00:00:01) [common]
  190 03:19:44.585697  boot-image-retry failed: 1 of 1 attempts. 'Unable to run 'nice' 'docker' 'pull' 'kernelci/qemu''
  191 03:19:44.585834  Stopping the qemu container lava-docker-qemu-8789794-2.1.1-t10la7qiw6
  193 03:19:44.612036  end: 2 boot-image-retry (duration 00:00:01) [common]
  195 03:19:44.612493  Cleaning after the job
  196 03:19:44.612660  Cleaning up download directory: /var/lib/lava/dispatcher/tmp/8789794/deployimages-_wjgr4db/kernel
  197 03:19:44.615350  Cleaning up download directory: /var/lib/lava/dispatcher/tmp/8789794/deployimages-_wjgr4db/ramdisk
  198 03:19:44.616609  Stopping the qemu container lava-docker-qemu-8789794-2.1.1-t10la7qiw6
  199 03:19:44.650969  start: 5.1 power-off (timeout 00:00:30) [common]
  200 03:19:44.651440  end: 5.1 power-off (duration 00:00:00) [common]
  201 03:19:44.651660  start: 5.2 read-feedback (timeout 00:10:00) [common]
  202 03:19:44.651824  No connection for namespace common
  203 03:19:44.651965  end: 5.2 read-feedback (duration 00:00:00) [common]
  204 03:19:44.652079  Root tmp directory removed at /var/lib/lava/dispatcher/tmp/8789794
  205 03:19:44.654642  JobError: Your job cannot terminate cleanly.