01HSWQE430ESS4JBF932HGB5C7: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HSWQESQ9ZQ5PTAPN131N000Z

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-03-26T07:14:58.292Zjob dependencies complete; ready to run (waiting for 40 m 46 s)
22024-03-26T14:37:29.182Zjob assigned to worker 01HSXJVEJXK4D7B2MSK91R238K (queued for 7 h 22 m 30 s)
32024-03-26T14:37:29.351Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-03-26T14:37:29.410Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-03-26T14:37:29.445Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-03-26T14:37:29.489Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-03-26T14:37:29.522Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-03-26T14:37:29.555ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-03-26T14:37:29.589Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-03-26T14:37:29.623ZOxide Helios Version helios-2.0.22550 64-bit
112024-03-26T14:37:29.656ZConfiguring devices.
122024-03-26T14:37:29.689Z##################################################
132024-03-26T14:37:29.723Z#### ############# ##
142024-03-26T14:37:29.756Z### ### ############ ##
152024-03-26T14:37:29.790Z## ### # ## ### ## Oxide Computer Company ##
162024-03-26T14:37:29.823Z## ## ## ### # ### ##
172024-03-26T14:37:29.867Z## # ### #### #### This Station Under ##
182024-03-26T14:37:29.901Z### ### #### # ### Computer Control ##
192024-03-26T14:37:29.934Z#### #### ### ## ##
202024-03-26T14:37:29.968Z##################################################
212024-03-26T14:37:30.002ZHostname: sock
222024-03-26T14:37:30.035ZLoading smf(7) service descriptions:
232024-03-26T14:37:31.128Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-6035e7536a5a7fd4.gz
242024-03-26T14:37:32.952Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-6035e7536a5a7fd4.gz
252024-03-26T14:37:32.952Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-03-26T14:37:51.079Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-03-26T14:37:51.079Zdownloading input: /input/ci-tools/work/end-to-end-tests/commtest-0032f1fcb106ce03.gz
282024-03-26T14:37:52.981Zdownloaded input: /input/ci-tools/work/end-to-end-tests/commtest-0032f1fcb106ce03.gz
292024-03-26T14:37:52.981Zdownloading input: /input/ci-tools/work/end-to-end-tests/dhcp_server-c911c239d2b46f2c.gz
302024-03-26T14:37:54.771Zdownloaded input: /input/ci-tools/work/end-to-end-tests/dhcp_server-c911c239d2b46f2c.gz
312024-03-26T14:37:54.771Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-3332264ed4b0fd4a.gz
322024-03-26T14:38:13.434Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-3332264ed4b0fd4a.gz
332024-03-26T14:38:13.434Zdownloading input: /input/ci-tools/work/caboose-util.gz
342024-03-26T14:38:14.122Zdownloaded input: /input/ci-tools/work/caboose-util.gz
352024-03-26T14:38:14.123Zdownloading input: /input/ci-tools/work/tufaceous.gz
362024-03-26T14:38:16.661Zdownloaded input: /input/ci-tools/work/tufaceous.gz
372024-03-26T14:38:16.685Zdownloading input: /input/ci-tools/work/commtest
382024-03-26T14:39:37.687Zdownloaded input: /input/ci-tools/work/commtest
392024-03-26T14:39:37.712Zdownloading input: /input/package/work/version.txt
402024-03-26T14:39:37.755Zdownloaded input: /input/package/work/version.txt
412024-03-26T14:39:37.783Zdownloading input: /input/package/work/package.tar.gz
422024-03-26T14:39:51.608Zdownloaded input: /input/package/work/package.tar.gz
432024-03-26T14:39:51.632Zdownloading input: /input/package/work/global-zone-packages.tar.gz
442024-03-26T14:40:12.877Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
452024-03-26T14:40:12.877Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
462024-03-26T14:40:18.556Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
472024-03-26T14:40:18.580Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
482024-03-26T14:40:58.836Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
492024-03-26T14:40:58.836Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
502024-03-26T14:41:39.282Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
512024-03-26T14:41:39.282Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
522024-03-26T14:42:01.421Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
532024-03-26T14:42:01.421Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
542024-03-26T14:42:05.984Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
552024-03-26T14:42:05.984Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
562024-03-26T14:42:12.571Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
572024-03-26T14:42:12.571Zdownloading input: /input/package/work/zones/external-dns.tar.gz
582024-03-26T14:42:18.086Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
592024-03-26T14:42:18.086Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
602024-03-26T14:42:23.600Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
612024-03-26T14:42:23.600Zdownloading input: /input/package/work/zones/nexus-single-sled.tar.gz
622024-03-26T14:42:39.762Zdownloaded input: /input/package/work/zones/nexus-single-sled.tar.gz
632024-03-26T14:42:39.762Zdownloading input: /input/package/work/zones/nexus.tar.gz
642024-03-26T14:42:55.979Zdownloaded input: /input/package/work/zones/nexus.tar.gz
652024-03-26T14:42:55.979Zdownloading input: /input/package/work/zones/ntp.tar.gz
662024-03-26T14:42:57.951Zdownloaded input: /input/package/work/zones/ntp.tar.gz
672024-03-26T14:42:57.951Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
682024-03-26T14:43:00.997Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
692024-03-26T14:43:00.997Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
702024-03-26T14:43:04.079Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
712024-03-26T14:43:04.079Zdownloading input: /input/package/work/zones/overlay.tar.gz
722024-03-26T14:43:04.132Zdownloaded input: /input/package/work/zones/overlay.tar.gz
732024-03-26T14:43:04.132Zdownloading input: /input/package/work/zones/oximeter.tar.gz
742024-03-26T14:43:12.635Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
752024-03-26T14:43:12.635Zdownloading input: /input/package/work/zones/probe.tar.gz
762024-03-26T14:43:13.282Zdownloaded input: /input/package/work/zones/probe.tar.gz
772024-03-26T14:43:13.307Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
782024-03-26T14:43:24.760Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
792024-03-26T14:43:24.760Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
802024-03-26T14:44:18.717Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
812024-03-26T14:44:18.742Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
822024-03-26T14:45:03.005Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
832024-03-26T14:45:03.031Zstarting task 0: "setup"
842024-03-26T14:45:03.031Z++ uname -s
852024-03-26T14:45:03.031Z+ kern=SunOS
862024-03-26T14:45:03.031Z+ case "$kern" in
872024-03-26T14:45:03.031Z+ groupadd -g 12345 build
882024-03-26T14:45:03.032Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
892024-03-26T14:45:05.438Z+ zfs create -o mountpoint=/work rpool/work
902024-03-26T14:45:05.468Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
912024-03-26T14:45:05.468Z+ home_fs=zfs
922024-03-26T14:45:05.468Z+ [[ zfs == autofs ]]
932024-03-26T14:45:05.468Z+ mkdir -p /home/build
942024-03-26T14:45:05.469Z+ chown build:build /home/build /work
952024-03-26T14:45:07.047Z+ chmod 0700 /home/build /work
962024-03-26T14:45:07.074Zprocess exited: duration 4045 ms, exit code 0
 
972024-03-26T14:45:07.127Zstarting task 1: "authentication"
982024-03-26T14:45:07.169Zprocess exited: duration 43 ms, exit code 0
 
992024-03-26T14:45:07.220Zstarting task 2: "build"
1002024-03-26T14:45:07.249Z+ trap _exit_trap EXIT
1012024-03-26T14:45:07.249Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1022024-03-26T14:45:07.346Zsecpolicy_fs_linkdir: 0x55 = 0x55
1032024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1042024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1052024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1062024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1072024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+5: 0 = 0x1
1082024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1092024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1102024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1112024-03-26T14:45:07.347Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1122024-03-26T14:45:07.372Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1132024-03-26T14:45:07.372Z+ [[ -d /opt/oxide ]]
1142024-03-26T14:45:07.372Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1152024-03-26T14:45:07.372Z+ pfexec mkdir /opt/oxide
1162024-03-26T14:45:07.372Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1172024-03-26T14:45:07.372Z+ [[ -d /opt/oxide-underneath ]]
1182024-03-26T14:45:07.372Z+ cd /opt/oxide-underneath
1192024-03-26T14:45:07.372Z+ pfexec tar ceEp@/f - .
1202024-03-26T14:45:07.373Z+ cd /opt/oxide
1212024-03-26T14:45:07.373Z+ pfexec tar xveEp@/f -
1222024-03-26T14:45:07.461Zx ., 0 bytes, 0 tape blocks
1232024-03-26T14:45:07.461Zx ./opte, 0 bytes, 0 tape blocks
1242024-03-26T14:45:07.461Zx ./opte/bin, 0 bytes, 0 tape blocks
1252024-03-26T14:45:07.461Zx ./opte/bin/opteadm, 43221608 bytes, 84418 tape blocks
1262024-03-26T14:45:07.487Z+ pfexec rm -rf /opt/oxide-underneath
1272024-03-26T14:45:07.487Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1282024-03-26T14:45:07.487Z+ pfexec mkdir /opt/oxide/work
1292024-03-26T14:45:07.515Z+ pfexec chown build:build /opt/oxide/work
1302024-03-26T14:45:07.515Z+ cd /opt/oxide/work
1312024-03-26T14:45:07.515Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1322024-03-26T14:45:07.515Ztar: blocksize = 10
1332024-03-26T14:45:09.035ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1342024-03-26T14:45:09.035Zx out/mg-ddm-gz.tar, 52915712 bytes, 103351 tape blocks
1352024-03-26T14:45:09.035Zx out/omicron-sled-agent.tar, 116814848 bytes, 228154 tape blocks
1362024-03-26T14:45:09.035Zx out/oxlog.tar, 6244352 bytes, 12196 tape blocks
1372024-03-26T14:45:09.035Zx out/target/test, 75 bytes, 1 tape blocks
1382024-03-26T14:45:09.035Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1392024-03-26T14:45:09.035Zx package-manifest.toml, 26511 bytes, 52 tape blocks
1402024-03-26T14:45:09.035Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1412024-03-26T14:45:09.036Zx target/release/omicron-package, 40096928 bytes, 78315 tape blocks
1422024-03-26T14:45:09.036Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1432024-03-26T14:45:09.036Zx tools/virtual_hardware.sh, 3429 bytes, 7 tape blocks
1442024-03-26T14:45:09.036Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1452024-03-26T14:45:09.036Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1462024-03-26T14:45:09.036Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1472024-03-26T14:45:09.036Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1482024-03-26T14:45:09.036Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1492024-03-26T14:45:09.061Z
1502024-03-26T14:45:09.061Zreal 1.539704370
1512024-03-26T14:45:09.061Zuser 1.377394058
1522024-03-26T14:45:09.061Zsys 0.306316817
1532024-03-26T14:45:09.061Ztrap 0.000065310
1542024-03-26T14:45:09.061Ztflt 0.000000000
1552024-03-26T14:45:09.062Zdflt 0.000000000
1562024-03-26T14:45:09.062Zkflt 0.000000000
1572024-03-26T14:45:09.062Zlock 0.000000000
1582024-03-26T14:45:09.062Zslp 1.351996944
1592024-03-26T14:45:09.062Zlat 0.041683482
1602024-03-26T14:45:09.062Zstop 0.000122061
1612024-03-26T14:45:09.062Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/nexus-single-sled.tar.gz /input/package/work/zones/nexus.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/probe.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1622024-03-26T14:45:10.339Z+ mv out/nexus-single-sled.tar.gz out/nexus.tar.gz
1632024-03-26T14:45:10.363Z+ mkdir tests
1642024-03-26T14:45:10.363Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1652024-03-26T14:45:10.363Z+ ptime -m gunzip
1662024-03-26T14:45:10.363Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-6035e7536a5a7fd4
1672024-03-26T14:45:10.562Z
1682024-03-26T14:45:10.587Zreal 0.206700474
1692024-03-26T14:45:10.588Zuser 0.190347470
1702024-03-26T14:45:10.588Zsys 0.016093389
1712024-03-26T14:45:10.588Ztrap 0.000019130
1722024-03-26T14:45:10.588Ztflt 0.000000000
1732024-03-26T14:45:10.588Zdflt 0.000000000
1742024-03-26T14:45:10.588Zkflt 0.000000000
1752024-03-26T14:45:10.588Zlock 0.000000000
1762024-03-26T14:45:10.588Zslp 0.000019790
1772024-03-26T14:45:10.588Zlat 0.000024920
1782024-03-26T14:45:10.588Zstop 0.000130291
1792024-03-26T14:45:10.588Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-6035e7536a5a7fd4
1802024-03-26T14:45:10.588Z+ chmod a+x tests/bootstrap-6035e7536a5a7fd4
1812024-03-26T14:45:10.588Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1822024-03-26T14:45:10.588Z+ ptime -m gunzip
1832024-03-26T14:45:10.588Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1842024-03-26T14:45:12.831Z
1852024-03-26T14:45:12.863Zreal 2.254158619
1862024-03-26T14:45:12.863Zuser 2.108070731
1872024-03-26T14:45:12.863Zsys 0.145659083
1882024-03-26T14:45:12.864Ztrap 0.000186461
1892024-03-26T14:45:12.864Ztflt 0.000000000
1902024-03-26T14:45:12.864Zdflt 0.000000000
1912024-03-26T14:45:12.864Zkflt 0.000000000
1922024-03-26T14:45:12.864Zlock 0.000000000
1932024-03-26T14:45:12.864Zslp 0.000025660
1942024-03-26T14:45:12.865Zlat 0.000030520
1952024-03-26T14:45:12.865Zstop 0.000128741
1962024-03-26T14:45:12.865Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1972024-03-26T14:45:12.865Z+ chmod a+x tests/bootstrap
1982024-03-26T14:45:12.865Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1992024-03-26T14:45:12.865Z+ ptime -m gunzip
2002024-03-26T14:45:12.865Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-0032f1fcb106ce03
2012024-03-26T14:45:13.047Z
2022024-03-26T14:45:13.072Zreal 0.209726095
2032024-03-26T14:45:13.072Zuser 0.194466591
2042024-03-26T14:45:13.072Zsys 0.015000201
2052024-03-26T14:45:13.072Ztrap 0.000020020
2062024-03-26T14:45:13.072Ztflt 0.000000000
2072024-03-26T14:45:13.072Zdflt 0.000000000
2082024-03-26T14:45:13.072Zkflt 0.000000000
2092024-03-26T14:45:13.072Zlock 0.000000000
2102024-03-26T14:45:13.072Zslp 0.000021730
2112024-03-26T14:45:13.072Zlat 0.000026889
2122024-03-26T14:45:13.072Zstop 0.000129531
2132024-03-26T14:45:13.072Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-0032f1fcb106ce03
2142024-03-26T14:45:13.072Z+ chmod a+x tests/commtest-0032f1fcb106ce03
2152024-03-26T14:45:13.072Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2162024-03-26T14:45:13.073Z+ ptime -m gunzip
2172024-03-26T14:45:13.073Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-c911c239d2b46f2c
2182024-03-26T14:45:13.263Z
2192024-03-26T14:45:13.288Zreal 0.204617614
2202024-03-26T14:45:13.288Zuser 0.190255561
2212024-03-26T14:45:13.288Zsys 0.014118499
2222024-03-26T14:45:13.288Ztrap 0.000015500
2232024-03-26T14:45:13.288Ztflt 0.000000000
2242024-03-26T14:45:13.288Zdflt 0.000000000
2252024-03-26T14:45:13.289Zkflt 0.000000000
2262024-03-26T14:45:13.289Zlock 0.000000000
2272024-03-26T14:45:13.289Zslp 0.000025060
2282024-03-26T14:45:13.289Zlat 0.000024510
2292024-03-26T14:45:13.289Zstop 0.000125151
2302024-03-26T14:45:13.289Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-c911c239d2b46f2c
2312024-03-26T14:45:13.289Z+ chmod a+x tests/dhcp_server-c911c239d2b46f2c
2322024-03-26T14:45:13.289Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2332024-03-26T14:45:13.289Z+ ptime -m gunzip
2342024-03-26T14:45:13.289Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-3332264ed4b0fd4a
2352024-03-26T14:45:15.595Z
2362024-03-26T14:45:15.625Zreal 2.310153348
2372024-03-26T14:45:15.625Zuser 2.165287743
2382024-03-26T14:45:15.626Zsys 0.144480730
2392024-03-26T14:45:15.626Ztrap 0.000160002
2402024-03-26T14:45:15.626Ztflt 0.000000000
2412024-03-26T14:45:15.626Zdflt 0.000000000
2422024-03-26T14:45:15.626Zkflt 0.000000000
2432024-03-26T14:45:15.626Zlock 0.000000000
2442024-03-26T14:45:15.626Zslp 0.000023420
2452024-03-26T14:45:15.627Zlat 0.000022820
2462024-03-26T14:45:15.627Zstop 0.000121631
2472024-03-26T14:45:15.627Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-3332264ed4b0fd4a
2482024-03-26T14:45:15.627Z+ chmod a+x tests/end_to_end_tests-3332264ed4b0fd4a
2492024-03-26T14:45:15.627Z+ bmat address ls
2502024-03-26T14:45:15.627ZNAME CIDR FIRST LAST COUNT
2512024-03-26T14:45:15.627Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2522024-03-26T14:45:15.627Z++ bmat address ls -f extra -Ho first,last,count
2532024-03-26T14:45:15.628Z+ set -- 10.151.2.164 10.151.2.227 64
2542024-03-26T14:45:15.628Z+ EXTRA_IP_START=10.151.2.164
2552024-03-26T14:45:15.628Z+ EXTRA_IP_END=10.151.2.227
2562024-03-26T14:45:15.628Z+ EXTRA_IP_COUNT=64
2572024-03-26T14:45:15.628Z+ (( EXTRA_IP_COUNT >= 32 ))
2582024-03-26T14:45:15.628Z+ EXTRA_IP_BASE=10.151.2
2592024-03-26T14:45:15.628Z+ EXTRA_IP_FOCTET=164
2602024-03-26T14:45:15.629Z+ EXTRA_IP_LOCTET=227
2612024-03-26T14:45:15.629Z+ SERVICE_IP_POOL_START=10.151.2.164
2622024-03-26T14:45:15.629Z+ SERVICE_IP_POOL_END=10.151.2.173
2632024-03-26T14:45:15.629Z+ DNS_IP1=10.151.2.164
2642024-03-26T14:45:15.629Z+ DNS_IP2=10.151.2.165
2652024-03-26T14:45:15.629Z+ UPLINK_IP=10.151.2.174
2662024-03-26T14:45:15.629Z+ IPPOOL_START=10.151.2.175
2672024-03-26T14:45:15.629Z+ IPPOOL_END=10.151.2.227
2682024-03-26T14:45:15.629Z++ ipadm show-addr -po type,addr
2692024-03-26T14:45:15.629Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2702024-03-26T14:45:15.630Z+ GATEWAY_IP=10.151.2.100
2712024-03-26T14:45:15.630Z+ [[ -n 10.151.2.100 ]]
2722024-03-26T14:45:15.630Z+ ping -s 10.151.2.100 56 1
2732024-03-26T14:45:15.630ZPING 10.151.2.100: 56 data bytes
2742024-03-26T14:45:15.655Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
2752024-03-26T14:45:15.655Z
2762024-03-26T14:45:15.656Z----10.151.2.100 PING Statistics----
2772024-03-26T14:45:15.656Z1 packets transmitted, 1 packets received, 0% packet loss
2782024-03-26T14:45:15.656Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2792024-03-26T14:45:15.656Z++ arp -an
2802024-03-26T14:45:15.656Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2812024-03-26T14:45:15.656Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2822024-03-26T14:45:15.656Z+ routeadm -e ipv4-forwarding -u
2832024-03-26T14:45:15.753Z+ PXA_START=10.151.2.164
2842024-03-26T14:45:15.753Z+ PXA_END=10.151.2.227
2852024-03-26T14:45:15.753Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2862024-03-26T14:45:15.785Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2872024-03-26T14:45:15.883Z+ ZPOOL_VDEV_DIR=/scratch
2882024-03-26T14:45:15.883Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2892024-03-26T14:45:15.912Z+++ dirname ./tools/create_virtual_hardware.sh
2902024-03-26T14:45:15.912Z++ cd ./tools
2912024-03-26T14:45:15.912Z++ pwd
2922024-03-26T14:45:15.912Z+ SOURCE_DIR=/opt/oxide/work/tools
2932024-03-26T14:45:15.912Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2942024-03-26T14:45:15.912Z+ SOFTNPU_MODE=zone
2952024-03-26T14:45:15.912Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2962024-03-26T14:45:15.912Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2972024-03-26T14:45:15.912Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2982024-03-26T14:45:15.913Z++ dladm show-phys -p -o LINK
2992024-03-26T14:45:15.913Z++ head -1
3002024-03-26T14:45:15.967Z+ PHYSICAL_LINK=igb0
3012024-03-26T14:45:15.967Z+ echo 'Using igb0 as physical link'
3022024-03-26T14:45:15.994ZUsing igb0 as physical link
3032024-03-26T14:45:15.994Z+ ensure_run_as_root
3042024-03-26T14:45:15.994Z++ id -u
3052024-03-26T14:45:15.994Z+ [[ 0 -ne 0 ]]
3062024-03-26T14:45:15.995Z+ ensure_zpools
3072024-03-26T14:45:15.995Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
3082024-03-26T14:45:15.995Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
3092024-03-26T14:45:15.995Z+ readarray -t ZPOOLS
3102024-03-26T14:45:15.995Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3112024-03-26T14:45:15.995Z++ sed 's/[ ",]//g'
3122024-03-26T14:45:15.995Z+ for ZPOOL in "${ZPOOLS[@]}"
3132024-03-26T14:45:15.995Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
3142024-03-26T14:45:15.995ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
3152024-03-26T14:45:15.995Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3162024-03-26T14:45:15.995Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
3172024-03-26T14:45:15.995Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
3182024-03-26T14:45:16.021Z0+0 records in
3192024-03-26T14:45:16.021Z0+0 records out
3202024-03-26T14:45:16.021Z0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec)
3212024-03-26T14:45:16.021Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
3222024-03-26T14:45:16.022Z+ set +x
3232024-03-26T14:45:16.022ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
3242024-03-26T14:45:16.022Z++ zpool list -o name
3252024-03-26T14:45:16.022Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
3262024-03-26T14:45:16.022Z+ [[ -z '' ]]
3272024-03-26T14:45:16.022Z+ zpool create -o ashift=12 -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3282024-03-26T14:45:16.051Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
3292024-03-26T14:45:16.078Z+ set +x
3302024-03-26T14:45:16.078ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3312024-03-26T14:45:16.078Z+ for ZPOOL in "${ZPOOLS[@]}"
3322024-03-26T14:45:16.079Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3332024-03-26T14:45:16.079ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3342024-03-26T14:45:16.079Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3352024-03-26T14:45:16.079Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3362024-03-26T14:45:16.079Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3372024-03-26T14:45:16.079Z0+0 records in
3382024-03-26T14:45:16.079Z0+0 records out
3392024-03-26T14:45:16.079Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3402024-03-26T14:45:16.079Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3412024-03-26T14:45:16.079Z+ set +x
3422024-03-26T14:45:16.079ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3432024-03-26T14:45:16.079Z++ zpool list -o name
3442024-03-26T14:45:16.079Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3452024-03-26T14:45:16.079Z+ [[ -z '' ]]
3462024-03-26T14:45:16.079Z+ zpool create -o ashift=12 -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3472024-03-26T14:45:16.112Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3482024-03-26T14:45:16.112Z+ set +x
3492024-03-26T14:45:16.112ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3502024-03-26T14:45:16.112Z+ for ZPOOL in "${ZPOOLS[@]}"
3512024-03-26T14:45:16.112Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3522024-03-26T14:45:16.112Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3532024-03-26T14:45:16.112ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3542024-03-26T14:45:16.112Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3552024-03-26T14:45:16.112Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3562024-03-26T14:45:16.112Z0+0 records in
3572024-03-26T14:45:16.112Z0+0 records out
3582024-03-26T14:45:16.112Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3592024-03-26T14:45:16.112Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3602024-03-26T14:45:16.112Z+ set +x
3612024-03-26T14:45:16.112ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3622024-03-26T14:45:16.112Z++ zpool list -o name
3632024-03-26T14:45:16.113Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3642024-03-26T14:45:16.113Z+ [[ -z '' ]]
3652024-03-26T14:45:16.113Z+ zpool create -o ashift=12 -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3662024-03-26T14:45:16.139Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3672024-03-26T14:45:16.139Z+ set +x
3682024-03-26T14:45:16.139ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3692024-03-26T14:45:16.139ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3702024-03-26T14:45:16.139Z+ for ZPOOL in "${ZPOOLS[@]}"
3712024-03-26T14:45:16.139Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3722024-03-26T14:45:16.139Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3732024-03-26T14:45:16.139Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3742024-03-26T14:45:16.139Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3752024-03-26T14:45:16.139Z0+0 records in
3762024-03-26T14:45:16.139Z0+0 records out
3772024-03-26T14:45:16.140Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3782024-03-26T14:45:16.140Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3792024-03-26T14:45:16.140Z+ set +x
3802024-03-26T14:45:16.140ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3812024-03-26T14:45:16.177Z++ zpool list -o name
3822024-03-26T14:45:16.178Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3832024-03-26T14:45:16.178Z+ [[ -z '' ]]
3842024-03-26T14:45:16.178Z+ zpool create -o ashift=12 -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3852024-03-26T14:45:16.205Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3862024-03-26T14:45:16.205Z+ set +x
3872024-03-26T14:45:16.205ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3882024-03-26T14:45:16.205Z+ for ZPOOL in "${ZPOOLS[@]}"
3892024-03-26T14:45:16.205Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3902024-03-26T14:45:16.205ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3912024-03-26T14:45:16.205Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3922024-03-26T14:45:16.205Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3932024-03-26T14:45:16.206Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3942024-03-26T14:45:16.206Z0+0 records in
3952024-03-26T14:45:16.206Z0+0 records out
3962024-03-26T14:45:16.206Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3972024-03-26T14:45:16.206Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3982024-03-26T14:45:16.206Z+ set +x
3992024-03-26T14:45:16.206ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
4002024-03-26T14:45:16.206Z++ zpool list -o name
4012024-03-26T14:45:16.206Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
4022024-03-26T14:45:16.206Z+ [[ -z '' ]]
4032024-03-26T14:45:16.206Z+ zpool create -o ashift=12 -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
4042024-03-26T14:45:16.232Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
4052024-03-26T14:45:16.232Z+ set +x
4062024-03-26T14:45:16.232ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
4072024-03-26T14:45:16.232Z+ for ZPOOL in "${ZPOOLS[@]}"
4082024-03-26T14:45:16.232Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
4092024-03-26T14:45:16.233ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
4102024-03-26T14:45:16.233Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4112024-03-26T14:45:16.233Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
4122024-03-26T14:45:16.233Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
4132024-03-26T14:45:16.233Z0+0 records in
4142024-03-26T14:45:16.233Z0+0 records out
4152024-03-26T14:45:16.233Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4162024-03-26T14:45:16.233Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
4172024-03-26T14:45:16.233Z+ set +x
4182024-03-26T14:45:16.233ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
4192024-03-26T14:45:16.233Z++ zpool list -o name
4202024-03-26T14:45:16.233Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
4212024-03-26T14:45:16.258Z+ [[ -z '' ]]
4222024-03-26T14:45:16.259Z+ zpool create -o ashift=12 -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4232024-03-26T14:45:16.286Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
4242024-03-26T14:45:16.286Z+ set +x
4252024-03-26T14:45:16.287ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
4262024-03-26T14:45:16.287Z+ for ZPOOL in "${ZPOOLS[@]}"
4272024-03-26T14:45:16.287Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
4282024-03-26T14:45:16.287Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4292024-03-26T14:45:16.287Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
4302024-03-26T14:45:16.287ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
4312024-03-26T14:45:16.287Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
4322024-03-26T14:45:16.287Z0+0 records in
4332024-03-26T14:45:16.288Z0+0 records out
4342024-03-26T14:45:16.288Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4352024-03-26T14:45:16.288Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4362024-03-26T14:45:16.288Z+ set +x
4372024-03-26T14:45:16.288ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
4382024-03-26T14:45:16.288Z++ zpool list -o name
4392024-03-26T14:45:16.288Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4402024-03-26T14:45:16.288Z+ [[ -z '' ]]
4412024-03-26T14:45:16.288Z+ zpool create -o ashift=12 -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4422024-03-26T14:45:16.315Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4432024-03-26T14:45:16.315Z+ set +x
4442024-03-26T14:45:16.315ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4452024-03-26T14:45:16.315Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-03-26T14:45:16.315Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4472024-03-26T14:45:16.315ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4482024-03-26T14:45:16.315Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4492024-03-26T14:45:16.315Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4502024-03-26T14:45:16.315Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4512024-03-26T14:45:16.315Z0+0 records in
4522024-03-26T14:45:16.315Z0+0 records out
4532024-03-26T14:45:16.315Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4542024-03-26T14:45:16.315Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4552024-03-26T14:45:16.315Z+ set +x
4562024-03-26T14:45:16.315ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4572024-03-26T14:45:16.315Z++ zpool list -o name
4582024-03-26T14:45:16.347Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4592024-03-26T14:45:16.347Z+ [[ -z '' ]]
4602024-03-26T14:45:16.347Z+ zpool create -o ashift=12 -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4612024-03-26T14:45:16.379Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4622024-03-26T14:45:16.379Z+ set +x
4632024-03-26T14:45:16.379ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4642024-03-26T14:45:16.379Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-03-26T14:45:16.379Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4662024-03-26T14:45:16.379ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4672024-03-26T14:45:16.379Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4682024-03-26T14:45:16.379Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4692024-03-26T14:45:16.379Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4702024-03-26T14:45:16.379Z0+0 records in
4712024-03-26T14:45:16.379Z0+0 records out
4722024-03-26T14:45:16.380Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-03-26T14:45:16.380Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4742024-03-26T14:45:16.380Z+ set +x
4752024-03-26T14:45:16.380ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4762024-03-26T14:45:16.380Z++ zpool list -o name
4772024-03-26T14:45:16.380Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4782024-03-26T14:45:16.380Z+ [[ -z '' ]]
4792024-03-26T14:45:16.380Z+ zpool create -o ashift=12 -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4802024-03-26T14:45:16.406Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4812024-03-26T14:45:16.406Z+ set +x
4822024-03-26T14:45:16.406ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4832024-03-26T14:45:16.406Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4842024-03-26T14:45:16.406Z+ readarray -t ZPOOLS
4852024-03-26T14:45:16.406Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4862024-03-26T14:45:16.406Z++ sed 's/[ ",]//g'
4872024-03-26T14:45:16.406Z+ for ZPOOL in "${ZPOOLS[@]}"
4882024-03-26T14:45:16.406Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4892024-03-26T14:45:16.406ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4902024-03-26T14:45:16.406Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4912024-03-26T14:45:16.406Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4922024-03-26T14:45:16.406Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4932024-03-26T14:45:16.438Z0+0 records in
4942024-03-26T14:45:16.438Z0+0 records out
4952024-03-26T14:45:16.438Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4962024-03-26T14:45:16.438Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4972024-03-26T14:45:16.439Z+ set +x
4982024-03-26T14:45:16.439ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4992024-03-26T14:45:16.439Z++ zpool list -o name
5002024-03-26T14:45:16.439Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
5012024-03-26T14:45:16.439Z+ [[ -z '' ]]
5022024-03-26T14:45:16.439Z+ zpool create -o ashift=12 -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5032024-03-26T14:45:16.477Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
5042024-03-26T14:45:16.477Z+ set +x
5052024-03-26T14:45:16.477ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
5062024-03-26T14:45:16.477Z+ for ZPOOL in "${ZPOOLS[@]}"
5072024-03-26T14:45:16.478Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
5082024-03-26T14:45:16.478ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
5092024-03-26T14:45:16.478Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5102024-03-26T14:45:16.478Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
5112024-03-26T14:45:16.478Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
5122024-03-26T14:45:16.478Z0+0 records in
5132024-03-26T14:45:16.478Z0+0 records out
5142024-03-26T14:45:16.478Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
5152024-03-26T14:45:16.478Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
5162024-03-26T14:45:16.478Z+ set +x
5172024-03-26T14:45:16.478ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
5182024-03-26T14:45:16.478Z++ zpool list -o name
5192024-03-26T14:45:16.478Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
5202024-03-26T14:45:16.478Z+ [[ -z '' ]]
5212024-03-26T14:45:16.478Z+ zpool create -o ashift=12 -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5222024-03-26T14:45:16.511Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
5232024-03-26T14:45:16.511Z+ set +x
5242024-03-26T14:45:16.512ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
5252024-03-26T14:45:16.512Z+ [[ zone == \z\o\n\e ]]
5262024-03-26T14:45:16.512Z+ ensure_simulated_links igb0
5272024-03-26T14:45:16.512Z+ local PHYSICAL_LINK=igb0
5282024-03-26T14:45:16.512Z+ INDICES=("0" "1")
5292024-03-26T14:45:16.512Z+ for I in "${INDICES[@]}"
5302024-03-26T14:45:16.512Z++ get_simnet_name_if_exists net0
5312024-03-26T14:45:16.512Z++ dladm show-simnet -p -o LINK net0
5322024-03-26T14:45:16.512Z++ echo ''
5332024-03-26T14:45:16.512Z+ [[ -z '' ]]
5342024-03-26T14:45:16.512Z+ dladm create-simnet -t net0
5352024-03-26T14:45:16.512Z+ dladm create-simnet -t sc0_0
5362024-03-26T14:45:16.542Z+ dladm modify-simnet -t -p net0 sc0_0
5372024-03-26T14:45:16.542Z+ dladm set-linkprop -p mtu=9000 sc0_0
5382024-03-26T14:45:16.542Z+ success 'Simnet net0/sc0_0 exists'
5392024-03-26T14:45:16.542Z+ set +x
5402024-03-26T14:45:16.542ZSimnet net0/sc0_0 exists
5412024-03-26T14:45:16.542Z+ for I in "${INDICES[@]}"
5422024-03-26T14:45:16.542Z++ get_simnet_name_if_exists net1
5432024-03-26T14:45:16.542Z++ dladm show-simnet -p -o LINK net1
5442024-03-26T14:45:16.542Z++ echo ''
5452024-03-26T14:45:16.542Z+ [[ -z '' ]]
5462024-03-26T14:45:16.542Z+ dladm create-simnet -t net1
5472024-03-26T14:45:16.542Z+ dladm create-simnet -t sc1_0
5482024-03-26T14:45:16.542Z+ dladm modify-simnet -t -p net1 sc1_0
5492024-03-26T14:45:16.542Z+ dladm set-linkprop -p mtu=9000 sc1_0
5502024-03-26T14:45:16.543Z+ success 'Simnet net1/sc1_0 exists'
5512024-03-26T14:45:16.543Z+ set +x
5522024-03-26T14:45:16.543ZSimnet net1/sc1_0 exists
5532024-03-26T14:45:16.568Z++ get_vnic_name_if_exists sc0_1
5542024-03-26T14:45:16.568Z++ dladm show-vnic -p -o LINK sc0_1
5552024-03-26T14:45:16.568Z++ echo ''
5562024-03-26T14:45:16.568Z+ [[ -z '' ]]
5572024-03-26T14:45:16.568Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5582024-03-26T14:45:16.569Z+ [[ -v PROMISC_FILT_OFF ]]
5592024-03-26T14:45:16.569Z+ success 'Vnic sc0_1 exists'
5602024-03-26T14:45:16.569Z+ set +x
5612024-03-26T14:45:16.569ZVnic sc0_1 exists
5622024-03-26T14:45:16.569Z+ warn_if_no_proxy_arp
5632024-03-26T14:45:16.569Z+ [[ -v PXA_START ]]
5642024-03-26T14:45:16.569Z+ [[ -v PXA_END ]]
5652024-03-26T14:45:16.569Z+ ensure_softnpu_zone
5662024-03-26T14:45:16.569Z+ zoneadm list
5672024-03-26T14:45:16.569Z+ grep -q sidecar_softnpu
5682024-03-26T14:45:16.569Z+ [[ -f out/npuzone/npuzone ]]
5692024-03-26T14:45:16.569Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5702024-03-26T14:45:16.594Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5712024-03-26T14:45:25.095Zdownloading softnpu ...done
5722024-03-26T14:45:25.120Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5732024-03-26T14:45:31.830Zdownloading asic_program.so ...done
5742024-03-26T14:45:31.855Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5752024-03-26T14:45:39.655Zdownloading scadm ...done
5762024-03-26T14:45:39.687Zcreating port tfportrear0_0 for sc0_0
5772024-03-26T14:45:39.687Zcreating port tfportqsfp0_0 for sc0_1
5782024-03-26T14:45:39.688Zsoftnpu zone setup
5792024-03-26T14:45:39.688Zconfigure zone
5802024-03-26T14:45:39.721Zinstall zone
5812024-03-26T14:45:40.755Zboot zone
5822024-03-26T14:45:43.862Z[sidecar_softnpu] svcs milestone/network
5832024-03-26T14:45:43.889ZSTATE STIME FMRI
5842024-03-26T14:45:43.889Zonline 14:45:42 svc:/milestone/network:default
5852024-03-26T14:45:43.889Z[sidecar_softnpu] /softnpu/npu start
5862024-03-26T14:45:43.915Z
5872024-03-26T14:45:43.940Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5882024-03-26T14:45:43.940Z+ GATEWAY_IP=10.151.2.100
5892024-03-26T14:45:43.940Z+ echo 'Using 10.151.2.100 as gateway ip'
5902024-03-26T14:45:43.940ZUsing 10.151.2.100 as gateway ip
5912024-03-26T14:45:43.940Z+ [[ ! -v GATEWAY_MAC ]]
5922024-03-26T14:45:43.940Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
5932024-03-26T14:45:43.940Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5942024-03-26T14:45:43.940Z+++ echo 18:c0:4d:0d:a0:2a
5952024-03-26T14:45:43.940Z+ COUNT=1
5962024-03-26T14:45:43.940Z+ [[ 1 -ne 1 ]]
5972024-03-26T14:45:43.940Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
5982024-03-26T14:45:43.940ZUsing 18:c0:4d:0d:a0:2a as gateway mac
5992024-03-26T14:45:43.940Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
6002024-03-26T14:45:43.940Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
6012024-03-26T14:45:43.965Z+ PXA_MAC=a8:e1:de:01:70:1d
6022024-03-26T14:45:43.965Z+ [[ -v PXA_START ]]
6032024-03-26T14:45:43.965Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
6042024-03-26T14:45:43.965Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
6052024-03-26T14:45:43.990Z+ z_scadm dump-state
6062024-03-26T14:45:43.990Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
6072024-03-26T14:45:44.015Zlocal v6:
6082024-03-26T14:45:44.015Zlocal v4:
6092024-03-26T14:45:44.015Zrouter v6:
6102024-03-26T14:45:44.015Zrouter v4_idx:
6112024-03-26T14:45:44.015Zrouter v4_routes:
6122024-03-26T14:45:44.015Zresolver v4:
6132024-03-26T14:45:44.015Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
6142024-03-26T14:45:44.015Zresolver v6:
6152024-03-26T14:45:44.016Znat v4:
6162024-03-26T14:45:44.016Znat_v6:
6172024-03-26T14:45:44.016Zport_mac:
6182024-03-26T14:45:44.016Zproxy arp:
6192024-03-26T14:45:44.016Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
6202024-03-26T14:45:44.016Z+ success 'softnpu zone exists'
6212024-03-26T14:45:44.016Z+ set +x
6222024-03-26T14:45:44.016Zsoftnpu zone exists
6232024-03-26T14:45:44.016Z
6242024-03-26T14:45:44.016Zreal 28.128596587
6252024-03-26T14:45:44.016Zuser 0.705420929
6262024-03-26T14:45:44.016Zsys 1.639829465
6272024-03-26T14:45:44.016Ztrap 0.000080558
6282024-03-26T14:45:44.016Ztflt 0.000098714
6292024-03-26T14:45:44.016Zdflt 0.000881225
6302024-03-26T14:45:44.016Zkflt 0.000000000
6312024-03-26T14:45:44.016Zlock 21:49.979012049
6322024-03-26T14:45:44.016Zslp 1:24.282737871
6332024-03-26T14:45:44.016Zlat 0.077975292
6342024-03-26T14:45:44.016Zstop 0.369414496
6352024-03-26T14:45:44.041Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
6362024-03-26T14:45:44.074Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6372024-03-26T14:45:44.075Z+ SILO_NAME=recovery
6382024-03-26T14:45:44.075Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6392024-03-26T14:45:44.075Z+ EXTERNAL_DNS_DOMAIN=oxide.test
6402024-03-26T14:45:44.075Z+ sed -i~ '
6412024-03-26T14:45:44.075Z /^external_dns_ips/c\
6422024-03-26T14:45:44.075Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6432024-03-26T14:45:44.075Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6442024-03-26T14:45:44.075Z /^first/c\
6452024-03-26T14:45:44.075Zfirst = "10.151.2.164"
6462024-03-26T14:45:44.075Z /^last/c\
6472024-03-26T14:45:44.075Zlast = "10.151.2.173"
6482024-03-26T14:45:44.075Z }
6492024-03-26T14:45:44.075Z /^infra_ip_first/c\
6502024-03-26T14:45:44.075Zinfra_ip_first = "10.151.2.174"
6512024-03-26T14:45:44.075Z /^infra_ip_last/c\
6522024-03-26T14:45:44.075Zinfra_ip_last = "10.151.2.174"
6532024-03-26T14:45:44.075Z /^\[\[rack_network_config.ports/,/^$/ {
6542024-03-26T14:45:44.075Z /^routes/c\
6552024-03-26T14:45:44.076Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
6562024-03-26T14:45:44.076Z /^addresses/c\
6572024-03-26T14:45:44.076Zaddresses = \["10.151.2.174/24"\]
6582024-03-26T14:45:44.076Z }
6592024-03-26T14:45:44.076Z' pkg/config-rss.toml
6602024-03-26T14:45:44.076Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6612024-03-26T14:45:44.076Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6622024-03-26T14:45:44.076Z+++ pkg/config-rss.toml Tue Mar 26 14:45:43 2024
6632024-03-26T14:45:44.076Z@@ -33,7 +33,7 @@
6642024-03-26T14:45:44.076Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6652024-03-26T14:45:44.076Z # must be contained in one of the "internal services" IP Pool ranges listed
6662024-03-26T14:45:44.076Z # below.
6672024-03-26T14:45:44.076Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6682024-03-26T14:45:44.076Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6692024-03-26T14:45:44.076Z
6702024-03-26T14:45:44.076Z # Initial TLS certificates for the external API
6712024-03-26T14:45:44.076Z #
6722024-03-26T14:45:44.076Z@@ -69,8 +69,8 @@
6732024-03-26T14:45:44.076Z #
6742024-03-26T14:45:44.076Z # For more on this and what to put here, see docs/how-to-run.adoc.
6752024-03-26T14:45:44.076Z [[internal_services_ip_pool_ranges]]
6762024-03-26T14:45:44.077Z-first = "192.168.1.20"
6772024-03-26T14:45:44.077Z-last = "192.168.1.29"
6782024-03-26T14:45:44.077Z+first = "10.151.2.164"
6792024-03-26T14:45:44.077Z+last = "10.151.2.173"
6802024-03-26T14:45:44.077Z
6812024-03-26T14:45:44.077Z # TODO - this configuration is subject to change going forward. Ultimately these
6822024-03-26T14:45:44.077Z # parameters should be provided to the control plane via wicket, but we need to
6832024-03-26T14:45:44.077Z@@ -91,8 +91,8 @@
6842024-03-26T14:45:44.077Z # A range of IP addresses used by Boundary Services on the external network. In
6852024-03-26T14:45:44.077Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6862024-03-26T14:45:44.077Z # With softnpu, only one address is used.
6872024-03-26T14:45:44.077Z-infra_ip_first = "192.168.1.30"
6882024-03-26T14:45:44.077Z-infra_ip_last = "192.168.1.30"
6892024-03-26T14:45:44.077Z+infra_ip_first = "10.151.2.174"
6902024-03-26T14:45:44.077Z+infra_ip_last = "10.151.2.174"
6912024-03-26T14:45:44.077Z
6922024-03-26T14:45:44.077Z # Configurations for BGP routers to run on the scrimlets.
6932024-03-26T14:45:44.077Z bgp = []
6942024-03-26T14:45:44.077Z@@ -100,9 +100,9 @@
6952024-03-26T14:45:44.077Z # You can configure multiple uplinks by repeating the following stanza
6962024-03-26T14:45:44.077Z [[rack_network_config.ports]]
6972024-03-26T14:45:44.078Z # Routes associated with this port.
6982024-03-26T14:45:44.078Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6992024-03-26T14:45:44.078Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
7002024-03-26T14:45:44.078Z # Addresses associated with this port.
7012024-03-26T14:45:44.078Z-addresses = ["192.168.1.30/24"]
7022024-03-26T14:45:44.078Z+addresses = ["10.151.2.174/24"]
7032024-03-26T14:45:44.078Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
7042024-03-26T14:45:44.078Z port = "qsfp0"
7052024-03-26T14:45:44.078Z # The speed of this port.
7062024-03-26T14:45:44.078Z+ true
7072024-03-26T14:45:44.078Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
7082024-03-26T14:45:44.078Za pkg/config-rss.toml 7K
7092024-03-26T14:45:44.078Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
7102024-03-26T14:45:44.078Z+ TLS_NAME=recovery.sys.oxide.test
7112024-03-26T14:45:44.078Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
7122024-03-26T14:45:44.601Z.+..+...+.........+.........+.........+............+.............+.....+.+..+....+......+...+.....+.......+........+....+..+...+...+...+....+..+.+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+......+...+....+...+...+.....+.......+.........+......+..+...+....+......+.........+.....+....+.........+.................+......+...+.+...........+...+.+......+........+..........+..+....+...+...+.....+...+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+....+......+..+............+.........................+...+..+...............+......+.......+.....+.+............+...+......+...+.....+.......+.....................+.....+.......+......+........................+............+......+..+...+.........+.........+...............+.+...+..+...+...+...+....+......+.....+.........+.......+...........+.......+...+..+................+.....+.+.....+.+...+......+...+..+.........+....+......+............+..+.....................+.........+.+.....+........................+.......+.....+......+..........+...+........................+..+........................+.+...+...........+.......+...+..+....+...+...........+.+...........+.........+.+..+................+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
7132024-03-26T14:45:45.168Z.....+...+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+...............+......+............+...+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+.+..+.......+.....+.................................+...............+...+.................................+............+.......+......+.....+....+.....+.......+...........+.............+..+.........+..........+.....+.+..+.+.........+..+..........+.....+....+............+...+.........+..+.........+....+......+..+.............+.....+.......+..+.............+.....+...+....+.................+..........+...+..+................+..+......+.+......+..............+....+.........+.....................+..+.......+..+...+.+..+.......+.....+.....................................+.........+..+.........................+...+.........+..+...+.+...........+....+.........+......+......+...+..+..........+.....+...+...+............+..........+..................+..+...+.......+..+.........+....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
7142024-03-26T14:45:45.193Z-----
7152024-03-26T14:45:45.194Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
7162024-03-26T14:45:45.221Za pkg/initial-tls-cert.pem 2K
7172024-03-26T14:45:45.221Za pkg/initial-tls-key.pem 4K
7182024-03-26T14:45:45.221Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
7192024-03-26T14:45:45.221Z+ rmdir pkg
7202024-03-26T14:45:45.221Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
7212024-03-26T14:45:45.221Z+ pfexec mkdir -p /usr/oxide
7222024-03-26T14:45:45.221Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
7232024-03-26T14:45:45.944Z+ pfexec chmod +x /usr/oxide/oxide
7242024-03-26T14:45:45.978Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
7252024-03-26T14:46:04.234Z+ OMICRON_NO_UNINSTALL=1
7262024-03-26T14:46:04.234Z+ ptime -m pfexec ./target/release/omicron-package -t test install
7272024-03-26T14:46:04.260ZLogging to: /opt/oxide/work/out/LOG
7282024-03-26T14:46:04.745Z
7292024-03-26T14:46:04.771Zreal 0.505853079
7302024-03-26T14:46:04.771Zuser 0.109982926
7312024-03-26T14:46:04.771Zsys 2.207090412
7322024-03-26T14:46:04.771Ztrap 0.000014450
7332024-03-26T14:46:04.771Ztflt 0.000025200
7342024-03-26T14:46:04.771Zdflt 0.000630543
7352024-03-26T14:46:04.771Zkflt 0.000012880
7362024-03-26T14:46:04.771Zlock 45.720842404
7372024-03-26T14:46:04.771Zslp 0.707822338
7382024-03-26T14:46:04.772Zlat 0.003131735
7392024-03-26T14:46:04.772Zstop 0.214163344
7402024-03-26T14:46:04.772Z+ retry=0
7412024-03-26T14:46:04.772Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7422024-03-26T14:46:04.772Z+ [[ 0 -gt 30 ]]
7432024-03-26T14:46:04.772Z+ sleep 1
7442024-03-26T14:46:05.759Z+ retry=1
7452024-03-26T14:46:05.759Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7462024-03-26T14:46:05.784Z+ [[ 1 -gt 30 ]]
7472024-03-26T14:46:05.784Z+ sleep 1
7482024-03-26T14:46:06.774Z+ retry=2
7492024-03-26T14:46:06.774Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7502024-03-26T14:46:06.800Z+ [[ 2 -gt 30 ]]
7512024-03-26T14:46:06.800Z+ sleep 1
7522024-03-26T14:46:07.787Z+ retry=3
7532024-03-26T14:46:07.787Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7542024-03-26T14:46:07.813Z+ [[ 3 -gt 30 ]]
7552024-03-26T14:46:07.813Z+ sleep 1
7562024-03-26T14:46:08.801Z+ retry=4
7572024-03-26T14:46:08.801Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7582024-03-26T14:46:33.977Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7592024-03-26T14:46:34.005Zlocal v6:
7602024-03-26T14:46:34.005Zfd05:cb46:98b2:4b49::1
7612024-03-26T14:46:34.005Zfe80::944c:1eff:fe03:45f9
7622024-03-26T14:46:34.005Zlocal v4:
7632024-03-26T14:46:34.006Z10.151.2.174
7642024-03-26T14:46:34.006Zrouter v6:
7652024-03-26T14:46:34.006Zfdb0:18c0:4d0d:a02a::/64 -> fe80::c8c3:d3ff:fe18:d58b (1)
7662024-03-26T14:46:34.006Zfd00:1122:3344:1::/64 -> fe80::c8c3:d3ff:fe18:d58b (1)
7672024-03-26T14:46:34.006Zfd00:1122:3344:2::/64 -> fe80::c8c3:d3ff:fe18:d58b (1)
7682024-03-26T14:46:34.006Zfd00:1122:3344:3::/64 -> fe80::c8c3:d3ff:fe18:d58b (1)
7692024-03-26T14:46:34.006Zfd00:1122:3344:101::/64 -> fe80::c8c3:d3ff:fe18:d58b (1)
7702024-03-26T14:46:34.007Zrouter v4_idx:
7712024-03-26T14:46:34.007Z0.0.0.0/0 -> 0
7722024-03-26T14:46:34.007Zrouter v4_routes:
7732024-03-26T14:46:34.007Z0 -> 10.151.2.100 (2)
7742024-03-26T14:46:34.007Zresolver v4:
7752024-03-26T14:46:34.451Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7762024-03-26T14:46:34.451Z10.151.2.174 -> 8e:df:7b:11:34:3e
7772024-03-26T14:46:34.451Zresolver v6:
7782024-03-26T14:46:34.451Zfe80::944c:1eff:fe03:45f9 -> 96:4c:1e:03:45:f9
7792024-03-26T14:46:34.451Zfe80::c8c3:d3ff:fe18:d58b -> ca:c3:d3:18:d5:8b
7802024-03-26T14:46:34.451Znat v4:
7812024-03-26T14:46:34.451Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:a8:d1
7822024-03-26T14:46:34.451Znat_v6:
7832024-03-26T14:46:34.452Zport_mac:
7842024-03-26T14:46:34.452Z2: a8:40:25:50:24:0f
7852024-03-26T14:46:34.452Z1000: a8:40:25:50:23:ee
7862024-03-26T14:46:34.452Z1: a8:40:25:50:23:ef
7872024-03-26T14:46:34.452Zproxy arp:
7882024-03-26T14:46:34.452Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7892024-03-26T14:46:34.452Z+ retry=0
7902024-03-26T14:46:34.452Z+++ zoneadm list -n
7912024-03-26T14:46:34.452Z+++ grep oxz_ntp
7922024-03-26T14:46:34.452Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
7932024-03-26T14:46:34.452Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7942024-03-26T14:46:34.452Z++ true
7952024-03-26T14:46:34.452Z+ [[ '' != online ]]
7962024-03-26T14:46:34.452Z+ [[ 0 -gt 60 ]]
7972024-03-26T14:46:34.452Z+ sleep 1
7982024-03-26T14:46:35.035Z+ retry=1
7992024-03-26T14:46:35.060Z+++ zoneadm list -n
8002024-03-26T14:46:35.061Z+++ grep oxz_ntp
8012024-03-26T14:46:35.061Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8022024-03-26T14:46:35.086Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8032024-03-26T14:46:35.086Z++ true
8042024-03-26T14:46:35.086Z+ [[ '' != online ]]
8052024-03-26T14:46:35.086Z+ [[ 1 -gt 60 ]]
8062024-03-26T14:46:35.086Z+ sleep 1
8072024-03-26T14:46:36.066Z+ retry=2
8082024-03-26T14:46:36.091Z+++ zoneadm list -n
8092024-03-26T14:46:36.091Z+++ grep oxz_ntp
8102024-03-26T14:46:36.091Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8112024-03-26T14:46:36.116Z+ [[ offline != online ]]
8122024-03-26T14:46:36.116Z+ [[ 2 -gt 60 ]]
8132024-03-26T14:46:36.116Z+ sleep 1
8142024-03-26T14:46:37.088Z+ retry=3
8152024-03-26T14:46:37.113Z+++ zoneadm list -n
8162024-03-26T14:46:37.114Z+++ grep oxz_ntp
8172024-03-26T14:46:37.114Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8182024-03-26T14:46:37.114Z+ [[ offline != online ]]
8192024-03-26T14:46:37.114Z+ [[ 3 -gt 60 ]]
8202024-03-26T14:46:37.114Z+ sleep 1
8212024-03-26T14:46:38.121Z+ retry=4
8222024-03-26T14:46:38.163Z+++ zoneadm list -n
8232024-03-26T14:46:38.164Z+++ grep oxz_ntp
8242024-03-26T14:46:38.164Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8252024-03-26T14:46:38.164Z+ [[ offline != online ]]
8262024-03-26T14:46:38.164Z+ [[ 4 -gt 60 ]]
8272024-03-26T14:46:38.165Z+ sleep 1
8282024-03-26T14:46:39.140Z+ retry=5
8292024-03-26T14:46:39.166Z+++ zoneadm list -n
8302024-03-26T14:46:39.166Z+++ grep oxz_ntp
8312024-03-26T14:46:39.166Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8322024-03-26T14:46:39.166Z+ [[ offline != online ]]
8332024-03-26T14:46:39.166Z+ [[ 5 -gt 60 ]]
8342024-03-26T14:46:39.166Z+ sleep 1
8352024-03-26T14:46:40.156Z+ retry=6
8362024-03-26T14:46:40.181Z+++ zoneadm list -n
8372024-03-26T14:46:40.181Z+++ grep oxz_ntp
8382024-03-26T14:46:40.181Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8392024-03-26T14:46:40.181Z+ [[ offline != online ]]
8402024-03-26T14:46:40.181Z+ [[ 6 -gt 60 ]]
8412024-03-26T14:46:40.181Z+ sleep 1
8422024-03-26T14:46:41.178Z+ retry=7
8432024-03-26T14:46:41.203Z+++ zoneadm list -n
8442024-03-26T14:46:41.203Z+++ grep oxz_ntp
8452024-03-26T14:46:41.203Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8462024-03-26T14:46:41.203Z+ [[ offline != online ]]
8472024-03-26T14:46:41.204Z+ [[ 7 -gt 60 ]]
8482024-03-26T14:46:41.204Z+ sleep 1
8492024-03-26T14:46:42.201Z+ retry=8
8502024-03-26T14:46:42.230Z+++ zoneadm list -n
8512024-03-26T14:46:42.230Z+++ grep oxz_ntp
8522024-03-26T14:46:42.230Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8532024-03-26T14:46:42.230Z+ [[ offline != online ]]
8542024-03-26T14:46:42.230Z+ [[ 8 -gt 60 ]]
8552024-03-26T14:46:42.231Z+ sleep 1
 
8562024-03-26T14:46:42.982Zsock console login: Mar 26 14:46:42 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8572024-03-26T14:46:43.386Z+ retry=9
8582024-03-26T14:46:43.411Z+++ zoneadm list -n
8592024-03-26T14:46:43.411Z+++ grep oxz_ntp
8602024-03-26T14:46:43.411Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8612024-03-26T14:46:43.411Z+ [[ offline != online ]]
8622024-03-26T14:46:43.411Z+ [[ 9 -gt 60 ]]
8632024-03-26T14:46:43.412Z+ sleep 1
8642024-03-26T14:46:44.246Z+ retry=10
8652024-03-26T14:46:44.271Z+++ zoneadm list -n
8662024-03-26T14:46:44.272Z+++ grep oxz_ntp
8672024-03-26T14:46:44.272Z++ pfexec svcs -z oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2 -Hostate oxide/ntp
8682024-03-26T14:46:44.272Z+ [[ online != online ]]
8692024-03-26T14:46:44.272Z+ echo 'Waited for chrony: 10s'
8702024-03-26T14:46:44.272Z+ retry=0
8712024-03-26T14:46:44.272ZWaited for chrony: 10s
8722024-03-26T14:46:44.272Z+ zoneadm list
8732024-03-26T14:46:44.272Z+ grep nexus
8742024-03-26T14:46:44.297Z+ [[ 0 -gt 300 ]]
8752024-03-26T14:46:44.297Z+ sleep 1
8762024-03-26T14:46:45.276Z+ retry=1
8772024-03-26T14:46:45.304Z+ zoneadm list
8782024-03-26T14:46:45.304Z+ grep nexus
8792024-03-26T14:46:45.304Z+ [[ 1 -gt 300 ]]
8802024-03-26T14:46:45.304Z+ sleep 1
8812024-03-26T14:46:46.286Z+ retry=2
8822024-03-26T14:46:46.311Z+ zoneadm list
8832024-03-26T14:46:46.311Z+ grep nexus
8842024-03-26T14:46:46.311Z+ [[ 2 -gt 300 ]]
8852024-03-26T14:46:46.311Z+ sleep 1
8862024-03-26T14:46:47.298Z+ retry=3
8872024-03-26T14:46:47.323Z+ zoneadm list
8882024-03-26T14:46:47.323Z+ grep nexus
8892024-03-26T14:46:47.323Z+ [[ 3 -gt 300 ]]
8902024-03-26T14:46:47.323Z+ sleep 1
8912024-03-26T14:46:48.308Z+ retry=4
8922024-03-26T14:46:48.333Z+ zoneadm list
8932024-03-26T14:46:48.333Z+ grep nexus
8942024-03-26T14:46:48.333Z+ [[ 4 -gt 300 ]]
8952024-03-26T14:46:48.333Z+ sleep 1
8962024-03-26T14:46:49.317Z+ retry=5
8972024-03-26T14:46:49.342Z+ zoneadm list
8982024-03-26T14:46:49.342Z+ grep nexus
8992024-03-26T14:46:49.342Z+ [[ 5 -gt 300 ]]
9002024-03-26T14:46:49.342Z+ sleep 1
9012024-03-26T14:46:50.329Z+ retry=6
9022024-03-26T14:46:50.353Z+ zoneadm list
9032024-03-26T14:46:50.354Z+ grep nexus
9042024-03-26T14:46:50.354Z+ [[ 6 -gt 300 ]]
9052024-03-26T14:46:50.354Z+ sleep 1
9062024-03-26T14:46:51.339Z+ retry=7
9072024-03-26T14:46:51.364Z+ zoneadm list
9082024-03-26T14:46:51.364Z+ grep nexus
9092024-03-26T14:46:51.364Z+ [[ 7 -gt 300 ]]
9102024-03-26T14:46:51.364Z+ sleep 1
9112024-03-26T14:46:52.350Z+ retry=8
9122024-03-26T14:46:52.375Z+ zoneadm list
9132024-03-26T14:46:52.375Z+ grep nexus
9142024-03-26T14:46:52.375Z+ [[ 8 -gt 300 ]]
9152024-03-26T14:46:52.375Z+ sleep 1
9162024-03-26T14:46:53.361Z+ retry=9
9172024-03-26T14:46:53.386Z+ zoneadm list
9182024-03-26T14:46:53.386Z+ grep nexus
9192024-03-26T14:46:53.386Z+ [[ 9 -gt 300 ]]
9202024-03-26T14:46:53.386Z+ sleep 1
9212024-03-26T14:46:54.371Z+ retry=10
9222024-03-26T14:46:54.397Z+ zoneadm list
9232024-03-26T14:46:54.397Z+ grep nexus
9242024-03-26T14:46:54.397Z+ [[ 10 -gt 300 ]]
9252024-03-26T14:46:54.397Z+ sleep 1
9262024-03-26T14:46:55.382Z+ retry=11
9272024-03-26T14:46:55.408Z+ zoneadm list
9282024-03-26T14:46:55.408Z+ grep nexus
9292024-03-26T14:46:55.408Z+ [[ 11 -gt 300 ]]
9302024-03-26T14:46:55.408Z+ sleep 1
9312024-03-26T14:46:56.394Z+ retry=12
9322024-03-26T14:46:56.418Z+ zoneadm list
9332024-03-26T14:46:56.418Z+ grep nexus
9342024-03-26T14:46:56.418Z+ [[ 12 -gt 300 ]]
9352024-03-26T14:46:56.418Z+ sleep 1
9362024-03-26T14:46:57.404Z+ retry=13
9372024-03-26T14:46:57.429Z+ zoneadm list
9382024-03-26T14:46:57.429Z+ grep nexus
9392024-03-26T14:46:57.429Z+ [[ 13 -gt 300 ]]
9402024-03-26T14:46:57.429Z+ sleep 1
9412024-03-26T14:46:58.415Z+ retry=14
9422024-03-26T14:46:58.443Z+ zoneadm list
9432024-03-26T14:46:58.443Z+ grep nexus
9442024-03-26T14:46:58.443Z+ [[ 14 -gt 300 ]]
9452024-03-26T14:46:58.443Z+ sleep 1
9462024-03-26T14:46:59.425Z+ retry=15
9472024-03-26T14:46:59.450Z+ zoneadm list
9482024-03-26T14:46:59.450Z+ grep nexus
9492024-03-26T14:46:59.450Z+ [[ 15 -gt 300 ]]
9502024-03-26T14:46:59.450Z+ sleep 1
9512024-03-26T14:47:00.437Z+ retry=16
9522024-03-26T14:47:00.462Z+ zoneadm list
9532024-03-26T14:47:00.462Z+ grep nexus
9542024-03-26T14:47:00.462Z+ [[ 16 -gt 300 ]]
9552024-03-26T14:47:00.462Z+ sleep 1
9562024-03-26T14:47:01.449Z+ retry=17
9572024-03-26T14:47:01.474Z+ zoneadm list
9582024-03-26T14:47:01.475Z+ grep nexus
9592024-03-26T14:47:01.475Z+ [[ 17 -gt 300 ]]
9602024-03-26T14:47:01.475Z+ sleep 1
9612024-03-26T14:47:02.460Z+ retry=18
9622024-03-26T14:47:02.485Z+ zoneadm list
9632024-03-26T14:47:02.485Z+ grep nexus
9642024-03-26T14:47:02.485Z+ [[ 18 -gt 300 ]]
9652024-03-26T14:47:02.485Z+ sleep 1
9662024-03-26T14:47:03.479Z+ retry=19
9672024-03-26T14:47:03.519Z+ zoneadm list
9682024-03-26T14:47:03.585Z+ grep nexus
9692024-03-26T14:47:03.611Z+ [[ 19 -gt 300 ]]
9702024-03-26T14:47:03.611Z+ sleep 1
9712024-03-26T14:47:04.608Z+ retry=20
9722024-03-26T14:47:04.637Z+ zoneadm list
9732024-03-26T14:47:04.637Z+ grep nexus
9742024-03-26T14:47:04.637Z+ [[ 20 -gt 300 ]]
9752024-03-26T14:47:04.637Z+ sleep 1
9762024-03-26T14:47:05.628Z+ retry=21
9772024-03-26T14:47:05.653Z+ zoneadm list
9782024-03-26T14:47:05.653Z+ grep nexus
9792024-03-26T14:47:05.653Z+ [[ 21 -gt 300 ]]
9802024-03-26T14:47:05.653Z+ sleep 1
9812024-03-26T14:47:06.642Z+ retry=22
9822024-03-26T14:47:06.667Z+ zoneadm list
9832024-03-26T14:47:06.667Z+ grep nexus
9842024-03-26T14:47:06.667Z+ [[ 22 -gt 300 ]]
9852024-03-26T14:47:06.667Z+ sleep 1
9862024-03-26T14:47:07.657Z+ retry=23
9872024-03-26T14:47:07.682Z+ zoneadm list
9882024-03-26T14:47:07.682Z+ grep nexus
9892024-03-26T14:47:07.682Z+ [[ 23 -gt 300 ]]
9902024-03-26T14:47:07.682Z+ sleep 1
9912024-03-26T14:47:08.667Z+ retry=24
9922024-03-26T14:47:08.692Z+ zoneadm list
9932024-03-26T14:47:08.692Z+ grep nexus
9942024-03-26T14:47:08.692Z+ [[ 24 -gt 300 ]]
9952024-03-26T14:47:08.692Z+ sleep 1
9962024-03-26T14:47:09.678Z+ retry=25
9972024-03-26T14:47:09.703Z+ zoneadm list
9982024-03-26T14:47:09.703Z+ grep nexus
9992024-03-26T14:47:09.703Z+ [[ 25 -gt 300 ]]
10002024-03-26T14:47:09.703Z+ sleep 1
10012024-03-26T14:47:10.693Z+ retry=26
10022024-03-26T14:47:10.718Z+ zoneadm list
10032024-03-26T14:47:10.718Z+ grep nexus
10042024-03-26T14:47:10.718Z+ [[ 26 -gt 300 ]]
10052024-03-26T14:47:10.719Z+ sleep 1
10062024-03-26T14:47:11.704Z+ retry=27
10072024-03-26T14:47:11.730Z+ zoneadm list
10082024-03-26T14:47:11.730Z+ grep nexus
10092024-03-26T14:47:11.730Z+ [[ 27 -gt 300 ]]
10102024-03-26T14:47:11.730Z+ sleep 1
10112024-03-26T14:47:12.716Z+ retry=28
10122024-03-26T14:47:12.741Z+ zoneadm list
10132024-03-26T14:47:12.741Z+ grep nexus
10142024-03-26T14:47:12.741Z+ [[ 28 -gt 300 ]]
10152024-03-26T14:47:12.741Z+ sleep 1
10162024-03-26T14:47:13.728Z+ retry=29
10172024-03-26T14:47:13.753Z+ zoneadm list
10182024-03-26T14:47:13.753Z+ grep nexus
10192024-03-26T14:47:13.753Z+ [[ 29 -gt 300 ]]
10202024-03-26T14:47:13.753Z+ sleep 1
10212024-03-26T14:47:14.741Z+ retry=30
10222024-03-26T14:47:14.766Z+ zoneadm list
10232024-03-26T14:47:14.766Z+ grep nexus
10242024-03-26T14:47:14.766Z+ [[ 30 -gt 300 ]]
10252024-03-26T14:47:14.766Z+ sleep 1
10262024-03-26T14:47:15.753Z+ retry=31
10272024-03-26T14:47:15.778Z+ zoneadm list
10282024-03-26T14:47:15.778Z+ grep nexus
10292024-03-26T14:47:15.778Z+ [[ 31 -gt 300 ]]
10302024-03-26T14:47:15.778Z+ sleep 1
10312024-03-26T14:47:17.073Z+ retry=32
10322024-03-26T14:47:17.073Z+ zoneadm list
10332024-03-26T14:47:17.115Z+ grep nexus
10342024-03-26T14:47:17.139Z+ [[ 32 -gt 300 ]]
10352024-03-26T14:47:17.140Z+ sleep 1
10362024-03-26T14:47:18.125Z+ retry=33
10372024-03-26T14:47:18.150Z+ zoneadm list
10382024-03-26T14:47:18.150Z+ grep nexus
10392024-03-26T14:47:18.150Z+ [[ 33 -gt 300 ]]
10402024-03-26T14:47:18.150Z+ sleep 1
10412024-03-26T14:47:19.142Z+ retry=34
10422024-03-26T14:47:19.167Z+ zoneadm list
10432024-03-26T14:47:19.167Z+ grep nexus
10442024-03-26T14:47:19.167Z+ [[ 34 -gt 300 ]]
10452024-03-26T14:47:19.167Z+ sleep 1
10462024-03-26T14:47:20.154Z+ retry=35
10472024-03-26T14:47:20.179Z+ zoneadm list
10482024-03-26T14:47:20.179Z+ grep nexus
10492024-03-26T14:47:20.179Z+ [[ 35 -gt 300 ]]
10502024-03-26T14:47:20.179Z+ sleep 1
10512024-03-26T14:47:21.165Z+ retry=36
10522024-03-26T14:47:21.190Z+ zoneadm list
10532024-03-26T14:47:21.190Z+ grep nexus
10542024-03-26T14:47:21.190Z+ [[ 36 -gt 300 ]]
10552024-03-26T14:47:21.191Z+ sleep 1
10562024-03-26T14:47:22.177Z+ retry=37
10572024-03-26T14:47:22.203Z+ zoneadm list
10582024-03-26T14:47:22.203Z+ grep nexus
10592024-03-26T14:47:22.203Z+ [[ 37 -gt 300 ]]
10602024-03-26T14:47:22.203Z+ sleep 1
10612024-03-26T14:47:23.191Z+ retry=38
10622024-03-26T14:47:23.216Z+ zoneadm list
10632024-03-26T14:47:23.216Z+ grep nexus
10642024-03-26T14:47:23.216Z+ [[ 38 -gt 300 ]]
10652024-03-26T14:47:23.216Z+ sleep 1
10662024-03-26T14:47:24.202Z+ retry=39
10672024-03-26T14:47:24.227Z+ zoneadm list
10682024-03-26T14:47:24.227Z+ grep nexus
10692024-03-26T14:47:24.227Z+ [[ 39 -gt 300 ]]
10702024-03-26T14:47:24.227Z+ sleep 1
10712024-03-26T14:47:25.213Z+ retry=40
10722024-03-26T14:47:25.238Z+ zoneadm list
10732024-03-26T14:47:25.238Z+ grep nexus
10742024-03-26T14:47:25.238Z+ [[ 40 -gt 300 ]]
10752024-03-26T14:47:25.238Z+ sleep 1
10762024-03-26T14:47:26.225Z+ retry=41
10772024-03-26T14:47:26.249Z+ zoneadm list
10782024-03-26T14:47:26.250Z+ grep nexus
10792024-03-26T14:47:26.250Z+ [[ 41 -gt 300 ]]
10802024-03-26T14:47:26.250Z+ sleep 1
10812024-03-26T14:47:27.237Z+ retry=42
10822024-03-26T14:47:27.262Z+ zoneadm list
10832024-03-26T14:47:27.262Z+ grep nexus
10842024-03-26T14:47:27.262Z+ [[ 42 -gt 300 ]]
10852024-03-26T14:47:27.262Z+ sleep 1
10862024-03-26T14:47:28.248Z+ retry=43
10872024-03-26T14:47:28.273Z+ zoneadm list
10882024-03-26T14:47:28.273Z+ grep nexus
10892024-03-26T14:47:28.273Z+ [[ 43 -gt 300 ]]
10902024-03-26T14:47:28.273Z+ sleep 1
10912024-03-26T14:47:29.336Z+ retry=44
10922024-03-26T14:47:33.658Z+ zoneadm list
10932024-03-26T14:47:33.722Z+ grep nexus
10942024-03-26T14:47:33.748Z+ [[ 44 -gt 300 ]]
10952024-03-26T14:47:33.749Z+ sleep 1
10962024-03-26T14:47:34.775Z+ retry=45
10972024-03-26T14:47:34.800Z+ zoneadm list
10982024-03-26T14:47:34.800Z+ grep nexus
10992024-03-26T14:47:34.800Z+ [[ 45 -gt 300 ]]
11002024-03-26T14:47:34.800Z+ sleep 1
11012024-03-26T14:47:35.793Z+ retry=46
11022024-03-26T14:47:35.818Z+ zoneadm list
11032024-03-26T14:47:35.818Z+ grep nexus
11042024-03-26T14:47:35.818Z+ [[ 46 -gt 300 ]]
11052024-03-26T14:47:35.818Z+ sleep 1
11062024-03-26T14:47:36.809Z+ retry=47
11072024-03-26T14:47:36.834Z+ zoneadm list
11082024-03-26T14:47:36.834Z+ grep nexus
11092024-03-26T14:47:36.834Z+ [[ 47 -gt 300 ]]
11102024-03-26T14:47:36.834Z+ sleep 1
11112024-03-26T14:47:37.826Z+ retry=48
11122024-03-26T14:47:37.851Z+ zoneadm list
11132024-03-26T14:47:37.851Z+ grep nexus
11142024-03-26T14:47:37.852Z+ [[ 48 -gt 300 ]]
11152024-03-26T14:47:37.852Z+ sleep 1
11162024-03-26T14:47:38.845Z+ retry=49
11172024-03-26T14:47:38.882Z+ zoneadm list
11182024-03-26T14:47:38.882Z+ grep nexus
11192024-03-26T14:47:38.882Z+ [[ 49 -gt 300 ]]
11202024-03-26T14:47:38.882Z+ sleep 1
11212024-03-26T14:47:39.872Z+ retry=50
11222024-03-26T14:47:39.902Z+ zoneadm list
11232024-03-26T14:47:39.902Z+ grep nexus
11242024-03-26T14:47:39.903Z+ [[ 50 -gt 300 ]]
11252024-03-26T14:47:39.903Z+ sleep 1
11262024-03-26T14:47:40.868Z+ retry=51
11272024-03-26T14:47:40.893Z+ zoneadm list
11282024-03-26T14:47:40.893Z+ grep nexus
11292024-03-26T14:47:40.893Z+ [[ 51 -gt 300 ]]
11302024-03-26T14:47:40.893Z+ sleep 1
11312024-03-26T14:47:41.885Z+ retry=52
11322024-03-26T14:47:41.911Z+ zoneadm list
11332024-03-26T14:47:41.911Z+ grep nexus
11342024-03-26T14:47:41.911Z+ [[ 52 -gt 300 ]]
11352024-03-26T14:47:41.911Z+ sleep 1
11362024-03-26T14:47:42.901Z+ retry=53
11372024-03-26T14:47:42.931Z+ zoneadm list
11382024-03-26T14:47:42.931Z+ grep nexus
11392024-03-26T14:47:42.932Z+ [[ 53 -gt 300 ]]
11402024-03-26T14:47:42.932Z+ sleep 1
11412024-03-26T14:47:43.913Z+ retry=54
11422024-03-26T14:47:43.938Z+ zoneadm list
11432024-03-26T14:47:43.938Z+ grep nexus
11442024-03-26T14:47:43.938Z+ [[ 54 -gt 300 ]]
11452024-03-26T14:47:43.938Z+ sleep 1
11462024-03-26T14:47:44.930Z+ retry=55
11472024-03-26T14:47:44.959Z+ zoneadm list
11482024-03-26T14:47:44.959Z+ grep nexus
11492024-03-26T14:47:44.959Z+ [[ 55 -gt 300 ]]
11502024-03-26T14:47:44.959Z+ sleep 1
11512024-03-26T14:47:45.942Z+ retry=56
11522024-03-26T14:47:45.968Z+ zoneadm list
11532024-03-26T14:47:45.968Z+ grep nexus
11542024-03-26T14:47:45.968Z+ [[ 56 -gt 300 ]]
11552024-03-26T14:47:45.968Z+ sleep 1
11562024-03-26T14:47:46.964Z+ retry=57
11572024-03-26T14:47:46.989Z+ zoneadm list
11582024-03-26T14:47:46.989Z+ grep nexus
11592024-03-26T14:47:46.990Z+ [[ 57 -gt 300 ]]
11602024-03-26T14:47:46.990Z+ sleep 1
11612024-03-26T14:47:51.354Z+ retry=58
11622024-03-26T14:47:51.746Z+ zoneadm list
11632024-03-26T14:47:51.747Z+ grep nexus
11642024-03-26T14:47:51.747Z+ [[ 58 -gt 300 ]]
11652024-03-26T14:47:51.747Z+ sleep 1
11662024-03-26T14:47:52.811Z+ retry=59
11672024-03-26T14:47:52.838Z+ zoneadm list
11682024-03-26T14:47:52.838Z+ grep nexus
11692024-03-26T14:47:52.838Z+ [[ 59 -gt 300 ]]
11702024-03-26T14:47:52.838Z+ sleep 1
11712024-03-26T14:47:53.856Z+ retry=60
11722024-03-26T14:47:53.882Z+ zoneadm list
11732024-03-26T14:47:53.882Z+ grep nexus
11742024-03-26T14:47:53.882Z+ [[ 60 -gt 300 ]]
11752024-03-26T14:47:53.882Z+ sleep 1
11762024-03-26T14:47:54.879Z+ retry=61
11772024-03-26T14:47:54.903Z+ zoneadm list
11782024-03-26T14:47:54.904Z+ grep nexus
11792024-03-26T14:47:54.904Z+ [[ 61 -gt 300 ]]
11802024-03-26T14:47:54.904Z+ sleep 1
11812024-03-26T14:47:55.907Z+ retry=62
11822024-03-26T14:47:55.936Z+ zoneadm list
11832024-03-26T14:47:55.936Z+ grep nexus
11842024-03-26T14:47:55.936Zoxz_nexus_58031502-b197-46d3-8fce-44109cd5528a
11852024-03-26T14:47:55.936Zoxz_nexus_62d49fb8-3f2d-4945-baaf-1358c4bb8e64
11862024-03-26T14:47:55.937Z+ echo 'Waited for nexus: 62s'
11872024-03-26T14:47:55.937ZWaited for nexus: 62s
11882024-03-26T14:47:55.937Z+ export RUST_BACKTRACE=1
11892024-03-26T14:47:55.937Z+ RUST_BACKTRACE=1
11902024-03-26T14:47:55.937Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
11912024-03-26T14:47:55.937Z++ ./tests/bootstrap
11922024-03-26T14:47:58.039ZUsing external DNS server at 10.151.2.164:53
11932024-03-26T14:47:58.065Z2024-03-26 14:47:58.037318971 UTC: attempting to log into API
 
11942024-03-26T14:48:11.759ZMar 26 14:48:11 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
 
11952024-03-26T14:48:13.129Z2024-03-26 14:48:13.122580573 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
11962024-03-26T14:48:13.689ZMar 26 14:48:13 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
11972024-03-26T14:48:13.726ZMar 26 14:48:13 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
11982024-03-26T14:48:13.759ZMar 26 14:48:13 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
11992024-03-26T14:48:14.141Z2024-03-26 14:48:14.124615344 UTC: attempting to log into API
 
12002024-03-26T14:48:14.326ZMar 26 14:48:13 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
12012024-03-26T14:48:29.165Z2024-03-26 14:48:29.153975597 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
12022024-03-26T14:48:30.171Z2024-03-26 14:48:30.154965787 UTC: attempting to log into API
12032024-03-26T14:48:45.199Z2024-03-26 14:48:45.187863208 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
12042024-03-26T14:48:46.211Z2024-03-26 14:48:46.189703979 UTC: attempting to log into API
12052024-03-26T14:48:51.979Z2024-03-26 14:48:51.970226246 UTC: login succeeded
12062024-03-26T14:48:52.015Zwaiting for nexus to come up...
12072024-03-26T14:48:52.082Zcreating IP pool... 10.151.2.175 - 10.151.2.227
12082024-03-26T14:48:52.247Zsetting up quotas...
12092024-03-26T14:48:52.291Zensuring datasets are ready...
12102024-03-26T14:48:53.958Zlet's roll.
12112024-03-26T14:48:53.988Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
12122024-03-26T14:48:53.989ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
12132024-03-26T14:48:53.989ZOXIDE_TOKEN=oxide-token-155fdf3fe7dddac4a65609a8daf08b68959708b0'
12142024-03-26T14:48:53.989Z++ OXIDE_HOST=https://recovery.sys.oxide.test
12152024-03-26T14:48:53.990Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
12162024-03-26T14:48:53.990Z++ OXIDE_TOKEN=oxide-token-155fdf3fe7dddac4a65609a8daf08b68959708b0
12172024-03-26T14:48:53.990Z+ export OXIDE_HOST OXIDE_TOKEN
12182024-03-26T14:48:53.990Z+ retry=0
12192024-03-26T14:48:53.991Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12202024-03-26T14:48:53.991Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12212024-03-26T14:48:53.991Z+ [[ 0 -gt 60 ]]
12222024-03-26T14:48:53.991Z+ sleep 1
12232024-03-26T14:48:54.991Z+ retry=1
12242024-03-26T14:48:54.992Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12252024-03-26T14:48:55.024Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12262024-03-26T14:48:55.024Z+ [[ 1 -gt 60 ]]
12272024-03-26T14:48:55.025Z+ sleep 1
12282024-03-26T14:48:56.004Z+ retry=2
12292024-03-26T14:48:56.004Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12302024-03-26T14:48:56.036Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12312024-03-26T14:48:56.037Z+ [[ 2 -gt 60 ]]
12322024-03-26T14:48:56.037Z+ sleep 1
12332024-03-26T14:48:57.019Z+ retry=3
12342024-03-26T14:48:57.019Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12352024-03-26T14:48:57.050Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12362024-03-26T14:48:57.050Z+ [[ 3 -gt 60 ]]
12372024-03-26T14:48:57.050Z+ sleep 1
12382024-03-26T14:48:58.430Z+ retry=4
12392024-03-26T14:48:58.430Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12402024-03-26T14:48:58.462Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12412024-03-26T14:48:58.462Z+ [[ 4 -gt 60 ]]
12422024-03-26T14:48:58.462Z+ sleep 1
12432024-03-26T14:48:59.044Z+ retry=5
12442024-03-26T14:48:59.044Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12452024-03-26T14:48:59.072Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12462024-03-26T14:48:59.073Z+ [[ 5 -gt 60 ]]
12472024-03-26T14:48:59.073Z+ sleep 1
12482024-03-26T14:49:00.059Z+ retry=6
12492024-03-26T14:49:00.059Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12502024-03-26T14:49:00.083Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12512024-03-26T14:49:00.083Z+ [[ 6 -gt 60 ]]
12522024-03-26T14:49:00.083Z+ sleep 1
12532024-03-26T14:49:01.075Z+ retry=7
12542024-03-26T14:49:01.076Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12552024-03-26T14:49:01.129Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12562024-03-26T14:49:01.130Z+ [[ 7 -gt 60 ]]
12572024-03-26T14:49:01.130Z+ sleep 1
12582024-03-26T14:49:02.093Z+ retry=8
12592024-03-26T14:49:02.093Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12602024-03-26T14:49:02.119Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12612024-03-26T14:49:02.119Z+ [[ 8 -gt 60 ]]
12622024-03-26T14:49:02.119Z+ sleep 1
12632024-03-26T14:49:03.106Z+ retry=9
12642024-03-26T14:49:03.106Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12652024-03-26T14:49:03.135Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12662024-03-26T14:49:03.135Z+ [[ 9 -gt 60 ]]
12672024-03-26T14:49:03.135Z+ sleep 1
12682024-03-26T14:49:04.121Z+ retry=10
12692024-03-26T14:49:04.121Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12702024-03-26T14:49:04.147Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12712024-03-26T14:49:04.147Z+ [[ 10 -gt 60 ]]
12722024-03-26T14:49:04.147Z+ sleep 1
12732024-03-26T14:49:05.136Z+ retry=11
12742024-03-26T14:49:05.136Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12752024-03-26T14:49:05.166Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12762024-03-26T14:49:05.166Z+ [[ 11 -gt 60 ]]
12772024-03-26T14:49:05.166Z+ sleep 1
12782024-03-26T14:49:06.151Z+ retry=12
12792024-03-26T14:49:06.151Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12802024-03-26T14:49:06.176Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12812024-03-26T14:49:06.176Z+ [[ 12 -gt 60 ]]
12822024-03-26T14:49:06.176Z+ sleep 1
12832024-03-26T14:49:07.169Z+ retry=13
12842024-03-26T14:49:07.170Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12852024-03-26T14:49:07.202Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12862024-03-26T14:49:07.202Z+ [[ 13 -gt 60 ]]
12872024-03-26T14:49:07.202Z+ sleep 1
12882024-03-26T14:49:08.190Z+ retry=14
12892024-03-26T14:49:08.190Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12902024-03-26T14:49:08.216Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12912024-03-26T14:49:08.216Z+ [[ 14 -gt 60 ]]
12922024-03-26T14:49:08.216Z+ sleep 1
12932024-03-26T14:49:09.204Z+ retry=15
12942024-03-26T14:49:09.204Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12952024-03-26T14:49:09.238Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12962024-03-26T14:49:09.238Z+ [[ 15 -gt 60 ]]
12972024-03-26T14:49:09.239Z+ sleep 1
12982024-03-26T14:49:10.230Z+ retry=16
12992024-03-26T14:49:10.230Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13002024-03-26T14:49:10.261Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13012024-03-26T14:49:10.261Z+ [[ 16 -gt 60 ]]
13022024-03-26T14:49:10.261Z+ sleep 1
13032024-03-26T14:49:11.237Z+ retry=17
13042024-03-26T14:49:11.237Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13052024-03-26T14:49:11.268Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13062024-03-26T14:49:11.268Z+ [[ 17 -gt 60 ]]
13072024-03-26T14:49:11.268Z+ sleep 1
13082024-03-26T14:49:12.659Z+ retry=18
13092024-03-26T14:49:12.659Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13102024-03-26T14:49:12.686Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13112024-03-26T14:49:12.686Z+ [[ 18 -gt 60 ]]
13122024-03-26T14:49:12.686Z+ sleep 1
13132024-03-26T14:49:13.281Z+ retry=19
13142024-03-26T14:49:13.281Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13152024-03-26T14:49:13.308Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13162024-03-26T14:49:13.308Z+ [[ 19 -gt 60 ]]
13172024-03-26T14:49:13.308Z+ sleep 1
13182024-03-26T14:49:14.293Z+ retry=20
13192024-03-26T14:49:14.293Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13202024-03-26T14:49:14.322Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13212024-03-26T14:49:14.322Z+ [[ 20 -gt 60 ]]
13222024-03-26T14:49:14.322Z+ sleep 1
13232024-03-26T14:49:15.296Z+ retry=21
13242024-03-26T14:49:15.296Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13252024-03-26T14:49:15.322Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13262024-03-26T14:49:15.322Z+ [[ 21 -gt 60 ]]
13272024-03-26T14:49:15.322Z+ sleep 1
13282024-03-26T14:49:16.314Z+ retry=22
13292024-03-26T14:49:16.314Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13302024-03-26T14:49:16.343Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13312024-03-26T14:49:16.343Z+ [[ 22 -gt 60 ]]
13322024-03-26T14:49:16.343Z+ sleep 1
13332024-03-26T14:49:17.328Z+ retry=23
13342024-03-26T14:49:17.328Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13352024-03-26T14:49:17.353Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13362024-03-26T14:49:17.353Z+ [[ 23 -gt 60 ]]
13372024-03-26T14:49:17.353Z+ sleep 1
13382024-03-26T14:49:18.345Z+ retry=24
13392024-03-26T14:49:18.345Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13402024-03-26T14:49:18.372Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13412024-03-26T14:49:18.372Z+ [[ 24 -gt 60 ]]
13422024-03-26T14:49:18.372Z+ sleep 1
13432024-03-26T14:49:19.360Z+ retry=25
13442024-03-26T14:49:19.360Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13452024-03-26T14:49:19.449Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
13462024-03-26T14:49:21.217Z{"status":"ok"}success
13472024-03-26T14:49:21.217ZProject {
13482024-03-26T14:49:21.217Z description: "some images",
13492024-03-26T14:49:21.218Z id: 77977487-5763-48cb-9637-849c15ffe359,
13502024-03-26T14:49:21.243Z name: Name(
13512024-03-26T14:49:21.243Z "images",
13522024-03-26T14:49:21.243Z ),
13532024-03-26T14:49:21.243Z time_created: 2024-03-26T14:49:20.692917Z,
13542024-03-26T14:49:21.243Z time_modified: 2024-03-26T14:49:20.692917Z,
13552024-03-26T14:49:21.243Z}
13562024-03-26T14:49:21.243Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
13572024-03-26T14:54:43.994Zdone!
13582024-03-26T14:54:44.098Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
13592024-03-26T14:54:44.203Zsuccess
13602024-03-26T14:54:44.203ZImage {
13612024-03-26T14:54:44.227Z block_size: ByteCount(
13622024-03-26T14:54:44.227Z 512,
13632024-03-26T14:54:44.227Z ),
13642024-03-26T14:54:44.227Z description: "debian 11 original base image",
13652024-03-26T14:54:44.227Z digest: None,
13662024-03-26T14:54:44.227Z id: abd7cbc6-5f5f-4c44-99df-f2cf846cf779,
13672024-03-26T14:54:44.227Z name: Name(
13682024-03-26T14:54:44.227Z "debian11",
13692024-03-26T14:54:44.227Z ),
13702024-03-26T14:54:44.228Z os: "debian",
13712024-03-26T14:54:44.228Z project_id: None,
13722024-03-26T14:54:44.228Z size: ByteCount(
13732024-03-26T14:54:44.228Z 2147483648,
13742024-03-26T14:54:44.228Z ),
13752024-03-26T14:54:44.228Z time_created: 2024-03-26T14:54:43.964168Z,
13762024-03-26T14:54:44.228Z time_modified: 2024-03-26T14:54:44.187398Z,
13772024-03-26T14:54:44.228Z url: None,
13782024-03-26T14:54:44.228Z version: "11",
13792024-03-26T14:54:44.228Z}
13802024-03-26T14:54:44.228Z+ rm ./tests/bootstrap
13812024-03-26T14:54:44.256Z+ for test_bin in tests/*
13822024-03-26T14:54:44.256Z+ ./tests/bootstrap-6035e7536a5a7fd4
13832024-03-26T14:54:44.291Z
13842024-03-26T14:54:44.291Zrunning 0 tests
13852024-03-26T14:54:44.291Z
13862024-03-26T14:54:44.316Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13872024-03-26T14:54:44.316Z
13882024-03-26T14:54:44.316Z+ for test_bin in tests/*
13892024-03-26T14:54:44.316Z+ ./tests/commtest-0032f1fcb106ce03
13902024-03-26T14:54:44.375Z
13912024-03-26T14:54:44.375Zrunning 0 tests
13922024-03-26T14:54:44.399Z
13932024-03-26T14:54:44.399Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13942024-03-26T14:54:44.399Z
13952024-03-26T14:54:44.399Z+ for test_bin in tests/*
13962024-03-26T14:54:44.399Z+ ./tests/dhcp_server-c911c239d2b46f2c
13972024-03-26T14:54:44.444Z
13982024-03-26T14:54:44.444Zrunning 0 tests
13992024-03-26T14:54:44.469Z
14002024-03-26T14:54:44.469Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
14012024-03-26T14:54:44.469Z
14022024-03-26T14:54:44.470Z+ for test_bin in tests/*
14032024-03-26T14:54:44.470Z+ ./tests/end_to_end_tests-3332264ed4b0fd4a
14042024-03-26T14:54:44.714Z
14052024-03-26T14:54:44.715Zrunning 2 tests
14062024-03-26T14:54:44.981Ztest no_spoof::no_spoof_here ... ok
14072024-03-26T14:55:11.018Ztest instance_launch::instance_launch ... ok
14082024-03-26T14:55:11.019Z
14092024-03-26T14:55:11.019Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 26.30s
14102024-03-26T14:55:11.019Z
14112024-03-26T14:55:11.044Z+ _exit_trap
14122024-03-26T14:55:11.044Z+ local status=0
14132024-03-26T14:55:11.044Z+ [[ 0 -eq 0 ]]
14142024-03-26T14:55:11.044Z+ exit 0
14152024-03-26T14:55:11.084Zprocess exited: duration 603807 ms, exit code 0
 
14162024-03-26T14:55:11.182Zfound 100 output files
14172024-03-26T14:55:11.240Zuploading: /var/svc/log/oxide-sled-agent:default.log (774616 bytes)
14182024-03-26T14:55:13.041Zuploaded: /var/svc/log/oxide-sled-agent:default.log
14192024-03-26T14:55:13.041Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (2430948 bytes)
14202024-03-26T14:55:13.831Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 2430948 -> 2440677
14212024-03-26T14:55:14.900Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
14222024-03-26T14:55:14.900Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52279 bytes)
14232024-03-26T14:55:16.085Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
14242024-03-26T14:55:16.085Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (4877 bytes)
14252024-03-26T14:55:17.183Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
14262024-03-26T14:55:17.183Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (83427 bytes)
14272024-03-26T14:55:18.388Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
14282024-03-26T14:55:18.388Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1204397 bytes)
14292024-03-26T14:55:19.157Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1204397 -> 1225700
14302024-03-26T14:55:20.231Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
14312024-03-26T14:55:20.231Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (678627 bytes)
14322024-03-26T14:55:20.484Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 678627 -> 691085
14332024-03-26T14:55:21.558Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
14342024-03-26T14:55:21.558Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1388 bytes)
14352024-03-26T14:55:22.649Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
14362024-03-26T14:55:22.649Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (255245 bytes)
14372024-03-26T14:55:22.852Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 255245 -> 260290
14382024-03-26T14:55:23.923Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
14392024-03-26T14:55:23.923Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (8222 bytes)
14402024-03-26T14:55:23.992Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 8222 -> 8807
14412024-03-26T14:55:25.063Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
14422024-03-26T14:55:25.063Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5392 bytes)
14432024-03-26T14:55:26.157Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
14442024-03-26T14:55:26.157Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_8d96e3f9-d109-4387-b89c-3d8d2158d142/root/var/svc/log/oxide-clickhouse:default.log (1058346 bytes)
14452024-03-26T14:55:26.960Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_8d96e3f9-d109-4387-b89c-3d8d2158d142/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1058346 -> 1101513
14462024-03-26T14:55:28.035Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_8d96e3f9-d109-4387-b89c-3d8d2158d142/root/var/svc/log/oxide-clickhouse:default.log
14472024-03-26T14:55:28.035Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_8d96e3f9-d109-4387-b89c-3d8d2158d142/root/var/svc/log/oxide-zone-network-setup:default.log (1713 bytes)
14482024-03-26T14:55:29.129Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_8d96e3f9-d109-4387-b89c-3d8d2158d142/root/var/svc/log/oxide-zone-network-setup:default.log
14492024-03-26T14:55:29.129Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_32e388fd-ce17-4654-b3e6-9d8c5c3233b5/root/var/svc/log/oxide-cockroachdb:default.log (4380 bytes)
14502024-03-26T14:55:30.226Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_32e388fd-ce17-4654-b3e6-9d8c5c3233b5/root/var/svc/log/oxide-cockroachdb:default.log
14512024-03-26T14:55:30.250Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_32e388fd-ce17-4654-b3e6-9d8c5c3233b5/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
14522024-03-26T14:55:31.317Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_32e388fd-ce17-4654-b3e6-9d8c5c3233b5/root/var/svc/log/oxide-zone-network-setup:default.log
14532024-03-26T14:55:31.317Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69b3c17a-71ce-4509-822d-1a1b6324ec20/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
14542024-03-26T14:55:32.412Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69b3c17a-71ce-4509-822d-1a1b6324ec20/root/var/svc/log/oxide-crucible-agent:default.log
14552024-03-26T14:55:32.413Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69b3c17a-71ce-4509-822d-1a1b6324ec20/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14562024-03-26T14:55:33.507Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69b3c17a-71ce-4509-822d-1a1b6324ec20/root/var/svc/log/oxide-crucible-downstairs:default.log
14572024-03-26T14:55:33.507Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69b3c17a-71ce-4509-822d-1a1b6324ec20/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
14582024-03-26T14:55:34.603Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69b3c17a-71ce-4509-822d-1a1b6324ec20/root/var/svc/log/oxide-zone-network-setup:default.log
14592024-03-26T14:55:34.627Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7759159c-adc5-4a51-8329-bb65418d9a63/root/var/svc/log/oxide-external_dns:default.log (26871 bytes)
14602024-03-26T14:55:34.716Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7759159c-adc5-4a51-8329-bb65418d9a63/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26871 -> 30649
14612024-03-26T14:55:35.787Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7759159c-adc5-4a51-8329-bb65418d9a63/root/var/svc/log/oxide-external_dns:default.log
14622024-03-26T14:55:35.787Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7759159c-adc5-4a51-8329-bb65418d9a63/root/var/svc/log/oxide-opte-interface-setup:default.log (1188 bytes)
14632024-03-26T14:55:36.881Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7759159c-adc5-4a51-8329-bb65418d9a63/root/var/svc/log/oxide-opte-interface-setup:default.log
14642024-03-26T14:55:36.882Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7759159c-adc5-4a51-8329-bb65418d9a63/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
14652024-03-26T14:55:37.976Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7759159c-adc5-4a51-8329-bb65418d9a63/root/var/svc/log/oxide-zone-network-setup:default.log
14662024-03-26T14:55:37.976Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d0bba901-234a-4871-a321-a6b1c723d712/root/var/svc/log/oxide-internal_dns:default.log (107772 bytes)
14672024-03-26T14:55:38.134Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d0bba901-234a-4871-a321-a6b1c723d712/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107772 -> 111527
14682024-03-26T14:55:39.205Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d0bba901-234a-4871-a321-a6b1c723d712/root/var/svc/log/oxide-internal_dns:default.log
14692024-03-26T14:55:39.205Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d0bba901-234a-4871-a321-a6b1c723d712/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
14702024-03-26T14:55:40.300Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d0bba901-234a-4871-a321-a6b1c723d712/root/var/svc/log/oxide-zone-network-setup:default.log
14712024-03-26T14:55:40.301Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_7a34fc90-f21e-44ea-b5e6-699139bc8a11/root/var/svc/log/oxide-nexus:default.log (1663355 bytes)
14722024-03-26T14:55:41.047Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_7a34fc90-f21e-44ea-b5e6-699139bc8a11/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1663355 -> 1790319
14732024-03-26T14:55:42.121Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_7a34fc90-f21e-44ea-b5e6-699139bc8a11/root/var/svc/log/oxide-nexus:default.log
14742024-03-26T14:55:42.121Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_7a34fc90-f21e-44ea-b5e6-699139bc8a11/root/var/svc/log/oxide-opte-interface-setup:default.log (1166 bytes)
14752024-03-26T14:55:43.218Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_7a34fc90-f21e-44ea-b5e6-699139bc8a11/root/var/svc/log/oxide-opte-interface-setup:default.log
14762024-03-26T14:55:43.218Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_7a34fc90-f21e-44ea-b5e6-699139bc8a11/root/var/svc/log/oxide-zone-network-setup:default.log (1684 bytes)
14772024-03-26T14:55:44.317Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_7a34fc90-f21e-44ea-b5e6-699139bc8a11/root/var/svc/log/oxide-zone-network-setup:default.log
14782024-03-26T14:55:44.317Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/svc/log/oxide-ntp:default.log (846 bytes)
14792024-03-26T14:55:45.413Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/svc/log/oxide-ntp:default.log
14802024-03-26T14:55:45.413Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/svc/log/oxide-opte-interface-setup:default.log (1157 bytes)
14812024-03-26T14:55:46.509Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/svc/log/oxide-opte-interface-setup:default.log
14822024-03-26T14:55:46.510Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/svc/log/oxide-zone-network-setup:default.log (1664 bytes)
14832024-03-26T14:55:47.609Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/svc/log/oxide-zone-network-setup:default.log
14842024-03-26T14:55:47.609Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_69d9ada8-caa7-4e84-b634-5f52535e5c97/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
14852024-03-26T14:55:48.704Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_69d9ada8-caa7-4e84-b634-5f52535e5c97/root/var/svc/log/oxide-cockroachdb:default.log
14862024-03-26T14:55:48.704Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_69d9ada8-caa7-4e84-b634-5f52535e5c97/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
14872024-03-26T14:55:49.801Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_69d9ada8-caa7-4e84-b634-5f52535e5c97/root/var/svc/log/oxide-zone-network-setup:default.log
14882024-03-26T14:55:49.801Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-crucible-agent:default.log (18038 bytes)
14892024-03-26T14:55:50.942Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-crucible-agent:default.log
14902024-03-26T14:55:50.942Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14912024-03-26T14:55:52.037Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-crucible-downstairs:default.log
14922024-03-26T14:55:52.037Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-crucible-downstairs:downstairs-15eb9642-53e7-4197-8bc9-f3c42e3da8e1.log (5693 bytes)
14932024-03-26T14:55:53.135Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-crucible-downstairs:downstairs-15eb9642-53e7-4197-8bc9-f3c42e3da8e1.log
14942024-03-26T14:55:53.135Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-crucible-downstairs:snapshot-15eb9642-53e7-4197-8bc9-f3c42e3da8e1-fa5b47a9-c836-4362-adba-f1c6c82aaa70.log (5296 bytes)
14952024-03-26T14:55:54.232Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-crucible-downstairs:snapshot-15eb9642-53e7-4197-8bc9-f3c42e3da8e1-fa5b47a9-c836-4362-adba-f1c6c82aaa70.log
14962024-03-26T14:55:54.232Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
14972024-03-26T14:55:55.328Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419615f5-4018-4d9a-9748-35ec685b6371/root/var/svc/log/oxide-zone-network-setup:default.log
14982024-03-26T14:55:55.328Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2e9831bc-de16-463b-94fe-4f969ed33c5b/root/var/svc/log/oxide-external_dns:default.log (26866 bytes)
14992024-03-26T14:55:55.441Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2e9831bc-de16-463b-94fe-4f969ed33c5b/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26866 -> 30644
15002024-03-26T14:55:56.513Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2e9831bc-de16-463b-94fe-4f969ed33c5b/root/var/svc/log/oxide-external_dns:default.log
15012024-03-26T14:55:56.513Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2e9831bc-de16-463b-94fe-4f969ed33c5b/root/var/svc/log/oxide-opte-interface-setup:default.log (1188 bytes)
15022024-03-26T14:55:57.607Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2e9831bc-de16-463b-94fe-4f969ed33c5b/root/var/svc/log/oxide-opte-interface-setup:default.log
15032024-03-26T14:55:57.607Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2e9831bc-de16-463b-94fe-4f969ed33c5b/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
15042024-03-26T14:55:58.703Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2e9831bc-de16-463b-94fe-4f969ed33c5b/root/var/svc/log/oxide-zone-network-setup:default.log
15052024-03-26T14:55:58.703Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_54f13337-f935-49ce-8e63-34fca00d513c/root/var/svc/log/oxide-internal_dns:default.log (107366 bytes)
15062024-03-26T14:55:58.863Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_54f13337-f935-49ce-8e63-34fca00d513c/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107366 -> 111122
15072024-03-26T14:55:59.933Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_54f13337-f935-49ce-8e63-34fca00d513c/root/var/svc/log/oxide-internal_dns:default.log
15082024-03-26T14:55:59.934Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_54f13337-f935-49ce-8e63-34fca00d513c/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
15092024-03-26T14:56:01.031Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_54f13337-f935-49ce-8e63-34fca00d513c/root/var/svc/log/oxide-zone-network-setup:default.log
15102024-03-26T14:56:01.031Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_70c7a270-fb41-410d-80e1-f9beed7204f8/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
15112024-03-26T14:56:02.136Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_70c7a270-fb41-410d-80e1-f9beed7204f8/root/var/svc/log/oxide-cockroachdb:default.log
15122024-03-26T14:56:02.136Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_70c7a270-fb41-410d-80e1-f9beed7204f8/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
15132024-03-26T14:56:03.236Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_70c7a270-fb41-410d-80e1-f9beed7204f8/root/var/svc/log/oxide-zone-network-setup:default.log
15142024-03-26T14:56:03.237Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-crucible-agent:default.log (17931 bytes)
15152024-03-26T14:56:04.379Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-crucible-agent:default.log
15162024-03-26T14:56:04.403Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15172024-03-26T14:56:05.478Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-crucible-downstairs:default.log
15182024-03-26T14:56:05.479Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-crucible-downstairs:downstairs-a29caa98-50eb-4fb5-96b7-f51fcd3a53ef.log (3019 bytes)
15192024-03-26T14:56:06.577Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-crucible-downstairs:downstairs-a29caa98-50eb-4fb5-96b7-f51fcd3a53ef.log
15202024-03-26T14:56:06.577Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-crucible-downstairs:downstairs-dbc55938-4211-4fe9-a54d-444fdc0443a2.log (3125 bytes)
15212024-03-26T14:56:07.676Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-crucible-downstairs:downstairs-dbc55938-4211-4fe9-a54d-444fdc0443a2.log
15222024-03-26T14:56:07.676Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
15232024-03-26T14:56:08.775Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_80062a08-851b-4fc7-b5ff-c9ea7cd2d2cb/root/var/svc/log/oxide-zone-network-setup:default.log
15242024-03-26T14:56:08.775Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_318fdf4e-b8a8-4fba-ace6-25fdb356914e/root/var/svc/log/oxide-internal_dns:default.log (107372 bytes)
15252024-03-26T14:56:08.940Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_318fdf4e-b8a8-4fba-ace6-25fdb356914e/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107372 -> 111128
15262024-03-26T14:56:10.014Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_318fdf4e-b8a8-4fba-ace6-25fdb356914e/root/var/svc/log/oxide-internal_dns:default.log
15272024-03-26T14:56:10.014Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_318fdf4e-b8a8-4fba-ace6-25fdb356914e/root/var/svc/log/oxide-zone-network-setup:default.log (1708 bytes)
15282024-03-26T14:56:11.115Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_318fdf4e-b8a8-4fba-ace6-25fdb356914e/root/var/svc/log/oxide-zone-network-setup:default.log
15292024-03-26T14:56:11.115Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_53202972-8d68-4e91-9c9e-e22c12778a6b/root/var/svc/log/oxide-cockroachdb:default.log (4406 bytes)
15302024-03-26T14:56:12.207Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_53202972-8d68-4e91-9c9e-e22c12778a6b/root/var/svc/log/oxide-cockroachdb:default.log
15312024-03-26T14:56:12.232Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_53202972-8d68-4e91-9c9e-e22c12778a6b/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
15322024-03-26T14:56:13.300Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_53202972-8d68-4e91-9c9e-e22c12778a6b/root/var/svc/log/oxide-zone-network-setup:default.log
15332024-03-26T14:56:13.300Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-crucible-agent:default.log (21822 bytes)
15342024-03-26T14:56:14.443Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-crucible-agent:default.log
15352024-03-26T14:56:14.469Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15362024-03-26T14:56:15.533Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-crucible-downstairs:default.log
15372024-03-26T14:56:15.533Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-50ee4387-8b91-4c4b-925f-f3163b34f547.log (5611 bytes)
15382024-03-26T14:56:16.626Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-50ee4387-8b91-4c4b-925f-f3163b34f547.log
15392024-03-26T14:56:16.626Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-cf2f0d07-1560-4e98-b84c-84181703d9cd.log (3124 bytes)
15402024-03-26T14:56:17.721Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-cf2f0d07-1560-4e98-b84c-84181703d9cd.log
15412024-03-26T14:56:17.721Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
15422024-03-26T14:56:18.812Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_cf57c06e-38bf-47a5-ba1e-56afcb01f1c7/root/var/svc/log/oxide-zone-network-setup:default.log
15432024-03-26T14:56:18.812Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_58031502-b197-46d3-8fce-44109cd5528a/root/var/svc/log/oxide-nexus:default.log (4054486 bytes)
15442024-03-26T14:56:20.457Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_58031502-b197-46d3-8fce-44109cd5528a/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 4054486 -> 4490195
15452024-03-26T14:56:21.528Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_58031502-b197-46d3-8fce-44109cd5528a/root/var/svc/log/oxide-nexus:default.log
15462024-03-26T14:56:21.528Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_58031502-b197-46d3-8fce-44109cd5528a/root/var/svc/log/oxide-opte-interface-setup:default.log (1166 bytes)
15472024-03-26T14:56:22.621Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_58031502-b197-46d3-8fce-44109cd5528a/root/var/svc/log/oxide-opte-interface-setup:default.log
15482024-03-26T14:56:22.621Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_58031502-b197-46d3-8fce-44109cd5528a/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
15492024-03-26T14:56:23.712Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_58031502-b197-46d3-8fce-44109cd5528a/root/var/svc/log/oxide-zone-network-setup:default.log
15502024-03-26T14:56:23.712Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b78996ba-104d-4f44-b137-9d00f5e225f0/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
15512024-03-26T14:56:24.806Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b78996ba-104d-4f44-b137-9d00f5e225f0/root/var/svc/log/oxide-cockroachdb:default.log
15522024-03-26T14:56:24.830Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b78996ba-104d-4f44-b137-9d00f5e225f0/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
15532024-03-26T14:56:25.900Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b78996ba-104d-4f44-b137-9d00f5e225f0/root/var/svc/log/oxide-zone-network-setup:default.log
15542024-03-26T14:56:25.900Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-crucible-agent:default.log (22289 bytes)
15552024-03-26T14:56:27.035Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-crucible-agent:default.log
15562024-03-26T14:56:27.035Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15572024-03-26T14:56:28.130Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-crucible-downstairs:default.log
15582024-03-26T14:56:28.130Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-crucible-downstairs:downstairs-26a70174-09fd-48a4-b27a-c0ac9693f786.log (5614 bytes)
15592024-03-26T14:56:29.226Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-crucible-downstairs:downstairs-26a70174-09fd-48a4-b27a-c0ac9693f786.log
15602024-03-26T14:56:29.251Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-crucible-downstairs:downstairs-c6f1fa33-3d87-4b8f-b235-b7c862942ef5.log (3120 bytes)
15612024-03-26T14:56:30.325Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-crucible-downstairs:downstairs-c6f1fa33-3d87-4b8f-b235-b7c862942ef5.log
15622024-03-26T14:56:30.325Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
15632024-03-26T14:56:31.418Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_e3a8831b-aed0-4147-8293-15ccb4d8aadc/root/var/svc/log/oxide-zone-network-setup:default.log
15642024-03-26T14:56:31.418Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_5527a333-d51b-4ca5-9247-be48fcdaf531/root/var/svc/log/oxide-crucible-pantry:default.log (1222878 bytes)
15652024-03-26T14:56:33.164Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_5527a333-d51b-4ca5-9247-be48fcdaf531/root/var/svc/log/oxide-crucible-pantry:default.log
15662024-03-26T14:56:33.164Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_5527a333-d51b-4ca5-9247-be48fcdaf531/root/var/svc/log/oxide-zone-network-setup:default.log (1743 bytes)
15672024-03-26T14:56:34.259Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_5527a333-d51b-4ca5-9247-be48fcdaf531/root/var/svc/log/oxide-zone-network-setup:default.log
15682024-03-26T14:56:34.259Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-agent:default.log (41589 bytes)
15692024-03-26T14:56:35.420Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-agent:default.log
15702024-03-26T14:56:35.445Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15712024-03-26T14:56:36.516Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:default.log
15722024-03-26T14:56:36.541Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-361b1c77-279a-44d5-a604-fb9270e9f314.log (5612 bytes)
15732024-03-26T14:56:37.606Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-361b1c77-279a-44d5-a604-fb9270e9f314.log
15742024-03-26T14:56:37.606Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-7de3ae4f-485a-4841-bc1e-4c3377783ffc.log (5691 bytes)
15752024-03-26T14:56:38.699Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-7de3ae4f-485a-4841-bc1e-4c3377783ffc.log
15762024-03-26T14:56:38.699Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-eaa5337a-c26c-4ef0-919c-3f397903d0d2.log (3020 bytes)
15772024-03-26T14:56:39.791Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-eaa5337a-c26c-4ef0-919c-3f397903d0d2.log
15782024-03-26T14:56:39.819Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:snapshot-7de3ae4f-485a-4841-bc1e-4c3377783ffc-fa5b47a9-c836-4362-adba-f1c6c82aaa70.log (5304 bytes)
15792024-03-26T14:56:40.884Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-crucible-downstairs:snapshot-7de3ae4f-485a-4841-bc1e-4c3377783ffc-fa5b47a9-c836-4362-adba-f1c6c82aaa70.log
15802024-03-26T14:56:40.915Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
15812024-03-26T14:56:41.980Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4730f9c-9c61-4253-8bcc-5c213aeea2d7/root/var/svc/log/oxide-zone-network-setup:default.log
15822024-03-26T14:56:41.980Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_42d5c094-5a72-4dfc-8f7a-db7237db7cee/root/var/svc/log/oxide-crucible-agent:default.log (1325 bytes)
15832024-03-26T14:56:43.076Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_42d5c094-5a72-4dfc-8f7a-db7237db7cee/root/var/svc/log/oxide-crucible-agent:default.log
15842024-03-26T14:56:43.076Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_42d5c094-5a72-4dfc-8f7a-db7237db7cee/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15852024-03-26T14:56:44.169Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_42d5c094-5a72-4dfc-8f7a-db7237db7cee/root/var/svc/log/oxide-crucible-downstairs:default.log
15862024-03-26T14:56:44.194Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_42d5c094-5a72-4dfc-8f7a-db7237db7cee/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
15872024-03-26T14:56:45.263Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_42d5c094-5a72-4dfc-8f7a-db7237db7cee/root/var/svc/log/oxide-zone-network-setup:default.log
15882024-03-26T14:56:45.263Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-crucible-agent:default.log (17612 bytes)
15892024-03-26T14:56:46.400Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-crucible-agent:default.log
15902024-03-26T14:56:46.400Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15912024-03-26T14:56:47.495Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-crucible-downstairs:default.log
15922024-03-26T14:56:47.495Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-crucible-downstairs:downstairs-2aec97d6-6df5-4b49-adb8-fccbda22bcbc.log (5693 bytes)
15932024-03-26T14:56:48.588Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-crucible-downstairs:downstairs-2aec97d6-6df5-4b49-adb8-fccbda22bcbc.log
15942024-03-26T14:56:48.588Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-crucible-downstairs:snapshot-2aec97d6-6df5-4b49-adb8-fccbda22bcbc-fa5b47a9-c836-4362-adba-f1c6c82aaa70.log (5306 bytes)
15952024-03-26T14:56:49.681Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-crucible-downstairs:snapshot-2aec97d6-6df5-4b49-adb8-fccbda22bcbc-fa5b47a9-c836-4362-adba-f1c6c82aaa70.log
15962024-03-26T14:56:49.681Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
15972024-03-26T14:56:50.774Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bde8f88e-7a9c-41f0-8643-224c206d3040/root/var/svc/log/oxide-zone-network-setup:default.log
15982024-03-26T14:56:50.774Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_8ff7e253-6aa5-4d55-ab83-d6e216da910d/root/var/svc/log/oxide-crucible-pantry:default.log (782 bytes)
15992024-03-26T14:56:51.866Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_8ff7e253-6aa5-4d55-ab83-d6e216da910d/root/var/svc/log/oxide-crucible-pantry:default.log
16002024-03-26T14:56:51.866Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_8ff7e253-6aa5-4d55-ab83-d6e216da910d/root/var/svc/log/oxide-zone-network-setup:default.log (1746 bytes)
16012024-03-26T14:56:52.959Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_8ff7e253-6aa5-4d55-ab83-d6e216da910d/root/var/svc/log/oxide-zone-network-setup:default.log
16022024-03-26T14:56:52.984Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_be25a1f7-7f79-4cfa-89aa-ed4a94360cba/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
16032024-03-26T14:56:54.054Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_be25a1f7-7f79-4cfa-89aa-ed4a94360cba/root/var/svc/log/oxide-crucible-pantry:default.log
16042024-03-26T14:56:54.054Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_be25a1f7-7f79-4cfa-89aa-ed4a94360cba/root/var/svc/log/oxide-zone-network-setup:default.log (1746 bytes)
16052024-03-26T14:56:55.147Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_be25a1f7-7f79-4cfa-89aa-ed4a94360cba/root/var/svc/log/oxide-zone-network-setup:default.log
16062024-03-26T14:56:55.147Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_41e6b6cf-9203-465e-a752-a37433392110/root/var/svc/log/oxide-oximeter:default.log (252293 bytes)
16072024-03-26T14:56:55.372Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_41e6b6cf-9203-465e-a752-a37433392110/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 252293 -> 316280
16082024-03-26T14:56:56.441Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_41e6b6cf-9203-465e-a752-a37433392110/root/var/svc/log/oxide-oximeter:default.log
16092024-03-26T14:56:56.441Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_41e6b6cf-9203-465e-a752-a37433392110/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
16102024-03-26T14:56:57.537Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_41e6b6cf-9203-465e-a752-a37433392110/root/var/svc/log/oxide-zone-network-setup:default.log
16112024-03-26T14:56:57.561Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_87a3cbe0-3562-4e8c-a042-0b67bc72fb44/root/var/svc/log/oxide-crucible-agent:default.log (7255 bytes)
16122024-03-26T14:56:58.654Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_87a3cbe0-3562-4e8c-a042-0b67bc72fb44/root/var/svc/log/oxide-crucible-agent:default.log
16132024-03-26T14:56:58.654Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_87a3cbe0-3562-4e8c-a042-0b67bc72fb44/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16142024-03-26T14:56:59.750Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_87a3cbe0-3562-4e8c-a042-0b67bc72fb44/root/var/svc/log/oxide-crucible-downstairs:default.log
16152024-03-26T14:56:59.751Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_87a3cbe0-3562-4e8c-a042-0b67bc72fb44/root/var/svc/log/oxide-crucible-downstairs:downstairs-084cccb6-5102-493b-a4c6-a8261a2ab3d0.log (3020 bytes)
16162024-03-26T14:57:00.847Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_87a3cbe0-3562-4e8c-a042-0b67bc72fb44/root/var/svc/log/oxide-crucible-downstairs:downstairs-084cccb6-5102-493b-a4c6-a8261a2ab3d0.log
16172024-03-26T14:57:00.847Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_87a3cbe0-3562-4e8c-a042-0b67bc72fb44/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
16182024-03-26T14:57:01.941Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_87a3cbe0-3562-4e8c-a042-0b67bc72fb44/root/var/svc/log/oxide-zone-network-setup:default.log
16192024-03-26T14:57:01.941Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_62d49fb8-3f2d-4945-baaf-1358c4bb8e64/root/var/svc/log/oxide-nexus:default.log (35282800 bytes)
16202024-03-26T14:57:16.397Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_62d49fb8-3f2d-4945-baaf-1358c4bb8e64/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 35282800 -> 35680193
16212024-03-26T14:57:17.463Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_62d49fb8-3f2d-4945-baaf-1358c4bb8e64/root/var/svc/log/oxide-nexus:default.log
16222024-03-26T14:57:17.463Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_62d49fb8-3f2d-4945-baaf-1358c4bb8e64/root/var/svc/log/oxide-opte-interface-setup:default.log (1166 bytes)
16232024-03-26T14:57:18.557Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_62d49fb8-3f2d-4945-baaf-1358c4bb8e64/root/var/svc/log/oxide-opte-interface-setup:default.log
16242024-03-26T14:57:18.557Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_62d49fb8-3f2d-4945-baaf-1358c4bb8e64/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
16252024-03-26T14:57:19.652Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_62d49fb8-3f2d-4945-baaf-1358c4bb8e64/root/var/svc/log/oxide-zone-network-setup:default.log
16262024-03-26T14:57:19.652Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/measurements.log (18084 bytes)
16272024-03-26T14:57:19.739Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/measurements.log" changed size mid upload: 18084 -> 22194
16282024-03-26T14:57:20.810Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/measurements.log
16292024-03-26T14:57:20.810Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/statistics.log (10413 bytes)
16302024-03-26T14:57:20.879Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/statistics.log" changed size mid upload: 10413 -> 13689
16312024-03-26T14:57:21.949Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/statistics.log
16322024-03-26T14:57:21.949Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/tracking.log (1849 bytes)
16332024-03-26T14:57:21.995Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/tracking.log" changed size mid upload: 1849 -> 2113
16342024-03-26T14:57:23.064Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_7cefbc7b-eda7-4a8c-a890-76d5faea20c2/root/var/log/chrony/tracking.log