01HTJRGHDKKBHTQVVWF32JZG3E: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HTJRJ6D7764VAF01GTZ43HH9

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-04-03T20:43:06.025Zjob dependencies complete; ready to run (waiting for 46 m 16 s)
22024-04-03T22:09:06.692Zjob assigned to worker 01HTJZTRHA9M007ERQA55SZH4Z (queued for 1 h 26 m 0 s)
32024-04-03T22:09:06.848Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-04-03T22:09:06.912Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-04-03T22:09:07.363Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-04-03T22:09:07.401Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-04-03T22:09:07.435Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-04-03T22:09:07.476ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-04-03T22:09:07.512Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-04-03T22:09:07.569ZOxide Helios Version helios-2.0.22550 64-bit
112024-04-03T22:09:07.602ZConfiguring devices.
122024-04-03T22:09:07.635Z##################################################
132024-04-03T22:09:07.668Z#### ############# ##
142024-04-03T22:09:07.704Z### ### ############ ##
152024-04-03T22:09:07.738Z## ### # ## ### ## Oxide Computer Company ##
162024-04-03T22:09:07.803Z## ## ## ### # ### ##
172024-04-03T22:09:07.848Z## # ### #### #### This Station Under ##
182024-04-03T22:09:07.892Z### ### #### # ### Computer Control ##
192024-04-03T22:09:07.925Z#### #### ### ## ##
202024-04-03T22:09:07.960Z##################################################
212024-04-03T22:09:07.993ZHostname: buskin
222024-04-03T22:09:08.027ZLoading smf(7) service descriptions:
232024-04-03T22:09:08.379Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-f0e27235b98aff2d.gz
242024-04-03T22:09:10.611Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-f0e27235b98aff2d.gz
252024-04-03T22:09:10.612Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-04-03T22:09:32.610Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-04-03T22:09:32.610Zdownloading input: /input/ci-tools/work/end-to-end-tests/commtest-e9ed9b7b4e031b62.gz
282024-04-03T22:09:34.718Zdownloaded input: /input/ci-tools/work/end-to-end-tests/commtest-e9ed9b7b4e031b62.gz
292024-04-03T22:09:34.718Zdownloading input: /input/ci-tools/work/end-to-end-tests/dhcp_server-7b097543f8b345b9.gz
302024-04-03T22:09:37.556Zdownloaded input: /input/ci-tools/work/end-to-end-tests/dhcp_server-7b097543f8b345b9.gz
312024-04-03T22:09:37.556Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-36d1e5a3b387542b.gz
322024-04-03T22:10:00.313Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-36d1e5a3b387542b.gz
332024-04-03T22:10:00.350Zdownloading input: /input/ci-tools/work/caboose-util.gz
342024-04-03T22:10:01.634Zdownloaded input: /input/ci-tools/work/caboose-util.gz
352024-04-03T22:10:01.635Zdownloading input: /input/ci-tools/work/tufaceous.gz
362024-04-03T22:10:04.293Zdownloaded input: /input/ci-tools/work/tufaceous.gz
372024-04-03T22:10:04.293Zdownloading input: /input/ci-tools/work/commtest
382024-04-03T22:11:42.860Zdownloaded input: /input/ci-tools/work/commtest
392024-04-03T22:11:42.886Zdownloading input: /input/package/work/version.txt
402024-04-03T22:11:42.886Zdownloaded input: /input/package/work/version.txt
412024-04-03T22:11:42.886Zdownloading input: /input/package/work/package.tar.gz
422024-04-03T22:11:59.438Zdownloaded input: /input/package/work/package.tar.gz
432024-04-03T22:11:59.468Zdownloading input: /input/package/work/global-zone-packages.tar.gz
442024-04-03T22:12:26.777Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
452024-04-03T22:12:26.777Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
462024-04-03T22:12:36.318Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
472024-04-03T22:12:36.319Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
482024-04-03T22:13:24.136Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
492024-04-03T22:13:24.136Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
502024-04-03T22:14:05.855Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
512024-04-03T22:14:05.855Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
522024-04-03T22:14:30.323Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
532024-04-03T22:14:30.347Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
542024-04-03T22:14:35.448Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
552024-04-03T22:14:35.448Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
562024-04-03T22:14:45.096Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
572024-04-03T22:14:45.538Zdownloading input: /input/package/work/zones/external-dns.tar.gz
582024-04-03T22:14:50.891Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
592024-04-03T22:14:50.892Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
602024-04-03T22:14:58.194Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
612024-04-03T22:14:58.195Zdownloading input: /input/package/work/zones/nexus-single-sled.tar.gz
622024-04-03T22:15:22.323Zdownloaded input: /input/package/work/zones/nexus-single-sled.tar.gz
632024-04-03T22:15:22.323Zdownloading input: /input/package/work/zones/nexus.tar.gz
642024-04-03T22:15:45.926Zdownloaded input: /input/package/work/zones/nexus.tar.gz
652024-04-03T22:15:45.926Zdownloading input: /input/package/work/zones/ntp.tar.gz
662024-04-03T22:15:48.308Zdownloaded input: /input/package/work/zones/ntp.tar.gz
672024-04-03T22:15:48.309Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
682024-04-03T22:15:53.926Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
692024-04-03T22:15:53.926Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
702024-04-03T22:15:57.227Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
712024-04-03T22:15:57.227Zdownloading input: /input/package/work/zones/overlay.tar.gz
722024-04-03T22:15:57.309Zdownloaded input: /input/package/work/zones/overlay.tar.gz
732024-04-03T22:15:57.333Zdownloading input: /input/package/work/zones/oximeter.tar.gz
742024-04-03T22:16:09.466Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
752024-04-03T22:16:09.466Zdownloading input: /input/package/work/zones/probe.tar.gz
762024-04-03T22:16:10.240Zdownloaded input: /input/package/work/zones/probe.tar.gz
772024-04-03T22:16:10.267Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
782024-04-03T22:16:24.947Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
792024-04-03T22:16:24.972Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
802024-04-03T22:17:32.308Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
812024-04-03T22:17:32.308Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
822024-04-03T22:18:17.094Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
832024-04-03T22:18:17.094Zstarting task 0: "setup"
842024-04-03T22:18:17.119Z++ uname -s
852024-04-03T22:18:17.119Z+ kern=SunOS
862024-04-03T22:18:17.119Z+ case "$kern" in
872024-04-03T22:18:17.119Z+ groupadd -g 12345 build
882024-04-03T22:18:17.119Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
892024-04-03T22:18:19.113Z+ zfs create -o mountpoint=/work rpool/work
902024-04-03T22:18:19.140Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
912024-04-03T22:18:19.165Z+ home_fs=zfs
922024-04-03T22:18:19.165Z+ [[ zfs == autofs ]]
932024-04-03T22:18:19.165Z+ mkdir -p /home/build
942024-04-03T22:18:19.165Z+ chown build:build /home/build /work
952024-04-03T22:18:21.148Z+ chmod 0700 /home/build /work
962024-04-03T22:18:21.173Zprocess exited: duration 4057 ms, exit code 0
 
972024-04-03T22:18:21.243Zstarting task 1: "authentication"
982024-04-03T22:18:21.288Zprocess exited: duration 46 ms, exit code 0
 
992024-04-03T22:18:21.341Zstarting task 2: "build"
1002024-04-03T22:18:21.366Z+ trap _exit_trap EXIT
1012024-04-03T22:18:21.366Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1022024-04-03T22:18:21.460Zsecpolicy_fs_linkdir: 0x55 = 0x55
1032024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1042024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1052024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1062024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1072024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+5: 0 = 0x1
1082024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1092024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1102024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1112024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1122024-04-03T22:18:21.460Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1132024-04-03T22:18:21.485Z+ [[ -d /opt/oxide ]]
1142024-04-03T22:18:21.485Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1152024-04-03T22:18:21.485Z+ pfexec mkdir /opt/oxide
1162024-04-03T22:18:21.485Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1172024-04-03T22:18:21.486Z+ [[ -d /opt/oxide-underneath ]]
1182024-04-03T22:18:21.486Z+ cd /opt/oxide-underneath
1192024-04-03T22:18:21.486Z+ pfexec tar ceEp@/f - .
1202024-04-03T22:18:21.486Z+ cd /opt/oxide
1212024-04-03T22:18:21.486Z+ pfexec tar xveEp@/f -
1222024-04-03T22:18:21.569Zx ., 0 bytes, 0 tape blocks
1232024-04-03T22:18:21.570Zx ./opte, 0 bytes, 0 tape blocks
1242024-04-03T22:18:21.570Zx ./opte/bin, 0 bytes, 0 tape blocks
1252024-04-03T22:18:21.570Zx ./opte/bin/opteadm, 43221608 bytes, 84418 tape blocks
1262024-04-03T22:18:21.594Z+ pfexec rm -rf /opt/oxide-underneath
1272024-04-03T22:18:21.595Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1282024-04-03T22:18:21.619Z+ pfexec mkdir /opt/oxide/work
1292024-04-03T22:18:21.619Z+ pfexec chown build:build /opt/oxide/work
1302024-04-03T22:18:21.619Z+ cd /opt/oxide/work
1312024-04-03T22:18:21.619Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1322024-04-03T22:18:23.270ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1332024-04-03T22:18:23.271Zx out/mg-ddm-gz.tar, 75678720 bytes, 147810 tape blocks
1342024-04-03T22:18:23.271Zx out/omicron-sled-agent.tar, 115628032 bytes, 225836 tape blocks
1352024-04-03T22:18:23.271Zx out/oxlog.tar, 6260736 bytes, 12228 tape blocks
1362024-04-03T22:18:23.271Zx out/target/test, 75 bytes, 1 tape blocks
1372024-04-03T22:18:23.271Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1382024-04-03T22:18:23.271Zx package-manifest.toml, 26511 bytes, 52 tape blocks
1392024-04-03T22:18:23.271Zx smf/sled-agent/non-gimlet/config.toml, 3156 bytes, 7 tape blocks
1402024-04-03T22:18:23.271Zx target/release/omicron-package, 40283024 bytes, 78678 tape blocks
1412024-04-03T22:18:23.271Zx tools/create_virtual_hardware.sh, 3183 bytes, 7 tape blocks
1422024-04-03T22:18:23.271Zx tools/virtual_hardware.sh, 3172 bytes, 7 tape blocks
1432024-04-03T22:18:23.271Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1442024-04-03T22:18:23.271Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1452024-04-03T22:18:23.271Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1462024-04-03T22:18:23.271Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1472024-04-03T22:18:23.271Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1482024-04-03T22:18:23.297Z
1492024-04-03T22:18:23.297Zreal 1.665614489
1502024-04-03T22:18:23.297Zuser 1.501821982
1512024-04-03T22:18:23.297Zsys 0.286934017
1522024-04-03T22:18:23.297Ztrap 0.000070871
1532024-04-03T22:18:23.297Ztflt 0.000000000
1542024-04-03T22:18:23.297Zdflt 0.000000000
1552024-04-03T22:18:23.297Zkflt 0.000000000
1562024-04-03T22:18:23.297Zlock 0.000000000
1572024-04-03T22:18:23.297Zslp 1.503328226
1582024-04-03T22:18:23.297Zlat 0.037200316
1592024-04-03T22:18:23.297Zstop 0.000119783
1602024-04-03T22:18:23.298Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/nexus-single-sled.tar.gz /input/package/work/zones/nexus.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/probe.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1612024-04-03T22:18:24.542Z+ mv out/nexus-single-sled.tar.gz out/nexus.tar.gz
1622024-04-03T22:18:24.567Z+ mkdir tests
1632024-04-03T22:18:24.567Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1642024-04-03T22:18:24.567Z+ ptime -m gunzip
1652024-04-03T22:18:24.568Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-f0e27235b98aff2d
1662024-04-03T22:18:24.773Z
1672024-04-03T22:18:24.815Zreal 0.210153258
1682024-04-03T22:18:24.815Zuser 0.195315868
1692024-04-03T22:18:24.815Zsys 0.014585393
1702024-04-03T22:18:24.815Ztrap 0.000015780
1712024-04-03T22:18:24.816Ztflt 0.000000000
1722024-04-03T22:18:24.816Zdflt 0.000000000
1732024-04-03T22:18:24.816Zkflt 0.000000000
1742024-04-03T22:18:24.816Zlock 0.000000000
1752024-04-03T22:18:24.816Zslp 0.000023790
1762024-04-03T22:18:24.816Zlat 0.000024770
1772024-04-03T22:18:24.817Zstop 0.000126443
1782024-04-03T22:18:24.817Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-f0e27235b98aff2d
1792024-04-03T22:18:24.817Z+ chmod a+x tests/bootstrap-f0e27235b98aff2d
1802024-04-03T22:18:24.817Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1812024-04-03T22:18:24.817Z+ ptime -m gunzip
1822024-04-03T22:18:24.817Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1832024-04-03T22:18:27.083Z
1842024-04-03T22:18:27.111Zreal 2.288739872
1852024-04-03T22:18:27.111Zuser 2.162858765
1862024-04-03T22:18:27.111Zsys 0.125499929
1872024-04-03T22:18:27.111Ztrap 0.000152082
1882024-04-03T22:18:27.111Ztflt 0.000000000
1892024-04-03T22:18:27.111Zdflt 0.000000000
1902024-04-03T22:18:27.111Zkflt 0.000000000
1912024-04-03T22:18:27.111Zlock 0.000000000
1922024-04-03T22:18:27.111Zslp 0.000023650
1932024-04-03T22:18:27.111Zlat 0.000017950
1942024-04-03T22:18:27.111Zstop 0.000117033
1952024-04-03T22:18:27.111Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1962024-04-03T22:18:27.111Z+ chmod a+x tests/bootstrap
1972024-04-03T22:18:27.111Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1982024-04-03T22:18:27.111Z+ ptime -m gunzip
1992024-04-03T22:18:27.111Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-e9ed9b7b4e031b62
2002024-04-03T22:18:27.288Z
2012024-04-03T22:18:27.314Zreal 0.206771445
2022024-04-03T22:18:27.314Zuser 0.191568625
2032024-04-03T22:18:27.314Zsys 0.014947102
2042024-04-03T22:18:27.314Ztrap 0.000022190
2052024-04-03T22:18:27.314Ztflt 0.000000000
2062024-04-03T22:18:27.314Zdflt 0.000000000
2072024-04-03T22:18:27.314Zkflt 0.000000000
2082024-04-03T22:18:27.314Zlock 0.000000000
2092024-04-03T22:18:27.314Zslp 0.000022970
2102024-04-03T22:18:27.314Zlat 0.000023691
2112024-04-03T22:18:27.314Zstop 0.000128873
2122024-04-03T22:18:27.314Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-e9ed9b7b4e031b62
2132024-04-03T22:18:27.314Z+ chmod a+x tests/commtest-e9ed9b7b4e031b62
2142024-04-03T22:18:27.314Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2152024-04-03T22:18:27.314Z+ ptime -m gunzip
2162024-04-03T22:18:27.314Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-7b097543f8b345b9
2172024-04-03T22:18:27.508Z
2182024-04-03T22:18:27.548Zreal 0.205928612
2192024-04-03T22:18:27.548Zuser 0.191593177
2202024-04-03T22:18:27.548Zsys 0.014105356
2212024-04-03T22:18:27.548Ztrap 0.000014030
2222024-04-03T22:18:27.548Ztflt 0.000000000
2232024-04-03T22:18:27.548Zdflt 0.000000000
2242024-04-03T22:18:27.549Zkflt 0.000000000
2252024-04-03T22:18:27.549Zlock 0.000000000
2262024-04-03T22:18:27.549Zslp 0.000022590
2272024-04-03T22:18:27.549Zlat 0.000017440
2282024-04-03T22:18:27.549Zstop 0.000118063
2292024-04-03T22:18:27.549Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-7b097543f8b345b9
2302024-04-03T22:18:27.550Z+ chmod a+x tests/dhcp_server-7b097543f8b345b9
2312024-04-03T22:18:27.550Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2322024-04-03T22:18:27.550Z+ ptime -m gunzip
2332024-04-03T22:18:27.550Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-36d1e5a3b387542b
2342024-04-03T22:18:29.875Z
2352024-04-03T22:18:29.900Zreal 2.358419922
2362024-04-03T22:18:29.900Zuser 2.214826226
2372024-04-03T22:18:29.900Zsys 0.143188466
2382024-04-03T22:18:29.900Ztrap 0.000173314
2392024-04-03T22:18:29.900Ztflt 0.000000000
2402024-04-03T22:18:29.900Zdflt 0.000000000
2412024-04-03T22:18:29.900Zkflt 0.000000000
2422024-04-03T22:18:29.900Zlock 0.000000000
2432024-04-03T22:18:29.900Zslp 0.000019890
2442024-04-03T22:18:29.900Zlat 0.000023050
2452024-04-03T22:18:29.900Zstop 0.000133253
2462024-04-03T22:18:29.900Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-36d1e5a3b387542b
2472024-04-03T22:18:29.900Z+ chmod a+x tests/end_to_end_tests-36d1e5a3b387542b
2482024-04-03T22:18:29.900Z+ bmat address ls
2492024-04-03T22:18:29.900ZNAME CIDR FIRST LAST COUNT
2502024-04-03T22:18:29.900Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2512024-04-03T22:18:29.900Z++ bmat address ls -f extra -Ho first,last,count
2522024-04-03T22:18:29.925Z+ set -- 10.151.1.164 10.151.1.227 64
2532024-04-03T22:18:29.925Z+ EXTRA_IP_START=10.151.1.164
2542024-04-03T22:18:29.925Z+ EXTRA_IP_END=10.151.1.227
2552024-04-03T22:18:29.925Z+ EXTRA_IP_COUNT=64
2562024-04-03T22:18:29.925Z+ (( EXTRA_IP_COUNT >= 32 ))
2572024-04-03T22:18:29.925Z+ EXTRA_IP_BASE=10.151.1
2582024-04-03T22:18:29.926Z+ EXTRA_IP_FOCTET=164
2592024-04-03T22:18:29.926Z+ EXTRA_IP_LOCTET=227
2602024-04-03T22:18:29.926Z+ SERVICE_IP_POOL_START=10.151.1.164
2612024-04-03T22:18:29.926Z+ SERVICE_IP_POOL_END=10.151.1.173
2622024-04-03T22:18:29.926Z+ DNS_IP1=10.151.1.164
2632024-04-03T22:18:29.926Z+ DNS_IP2=10.151.1.165
2642024-04-03T22:18:29.926Z+ UPLINK_IP=10.151.1.174
2652024-04-03T22:18:29.926Z+ IPPOOL_START=10.151.1.175
2662024-04-03T22:18:29.926Z+ IPPOOL_END=10.151.1.227
2672024-04-03T22:18:29.926Z++ ipadm show-addr -po type,addr
2682024-04-03T22:18:29.926Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2692024-04-03T22:18:29.926Z+ GATEWAY_IP=10.151.1.100
2702024-04-03T22:18:29.926Z+ [[ -n 10.151.1.100 ]]
2712024-04-03T22:18:29.926Z+ ping -s 10.151.1.100 56 1
2722024-04-03T22:18:29.926ZPING 10.151.1.100: 56 data bytes
2732024-04-03T22:18:29.926Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.010 ms
2742024-04-03T22:18:29.926Z
2752024-04-03T22:18:29.926Z----10.151.1.100 PING Statistics----
2762024-04-03T22:18:29.926Z1 packets transmitted, 1 packets received, 0% packet loss
2772024-04-03T22:18:29.926Zround-trip (ms) min/avg/max/stddev = 0.010/0.010/0.010/-nan
2782024-04-03T22:18:29.926Z++ arp -an
2792024-04-03T22:18:29.926Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2802024-04-03T22:18:29.951Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2812024-04-03T22:18:29.952Z+ routeadm -e ipv4-forwarding -u
2822024-04-03T22:18:30.041Z+ PXA_START=10.151.1.164
2832024-04-03T22:18:30.041Z+ PXA_END=10.151.1.227
2842024-04-03T22:18:30.041Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2852024-04-03T22:18:30.066Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2862024-04-03T22:18:30.172Z+ VDEV_DIR=/scratch
2872024-04-03T22:18:30.172Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2882024-04-03T22:18:30.197Z+++ dirname ./tools/create_virtual_hardware.sh
2892024-04-03T22:18:30.197Z++ cd ./tools
2902024-04-03T22:18:30.197Z++ pwd
2912024-04-03T22:18:30.197Z+ SOURCE_DIR=/opt/oxide/work/tools
2922024-04-03T22:18:30.197Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2932024-04-03T22:18:30.197Z+ SOFTNPU_MODE=zone
2942024-04-03T22:18:30.197Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2952024-04-03T22:18:30.197Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2962024-04-03T22:18:30.197Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2972024-04-03T22:18:30.197Z++ dladm show-phys -p -o LINK
2982024-04-03T22:18:30.197Z++ head -1
2992024-04-03T22:18:30.266Z+ PHYSICAL_LINK=igb0
3002024-04-03T22:18:30.307Z+ echo 'Using igb0 as physical link'
3012024-04-03T22:18:30.307ZUsing igb0 as physical link
3022024-04-03T22:18:30.307Z+ ensure_run_as_root
3032024-04-03T22:18:30.307Z++ id -u
3042024-04-03T22:18:30.307Z+ [[ 0 -ne 0 ]]
3052024-04-03T22:18:30.307Z+ ensure_vdevs
3062024-04-03T22:18:30.307Z+ VDEV_TYPES=('m2_' 'u2_')
3072024-04-03T22:18:30.307Z+ for VDEV_TYPE in "${VDEV_TYPES[@]}"
3082024-04-03T22:18:30.307Z+ readarray -t VDEVS
3092024-04-03T22:18:30.307Z++ grep '"m2_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3102024-04-03T22:18:30.307Z++ sed 's/[ ",]//g'
3112024-04-03T22:18:30.307Z+ for VDEV in "${VDEVS[@]}"
3122024-04-03T22:18:30.308Z+ echo 'Device: [m2_0.vdev]'
3132024-04-03T22:18:30.308ZDevice: [m2_0.vdev]
3142024-04-03T22:18:30.308Z+ VDEV_PATH=/scratch/m2_0.vdev
3152024-04-03T22:18:30.308Z+ [[ -f /scratch/m2_0.vdev ]]
3162024-04-03T22:18:30.308Z+ dd if=/dev/zero of=/scratch/m2_0.vdev bs=1 count=0 seek=20G
3172024-04-03T22:18:30.308Z0+0 records in
3182024-04-03T22:18:30.308Z0+0 records out
3192024-04-03T22:18:30.308Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3202024-04-03T22:18:30.308Z+ success 'vdev /scratch/m2_0.vdev exists'
3212024-04-03T22:18:30.308Z+ set +x
3222024-04-03T22:18:30.308Zvdev /scratch/m2_0.vdev exists
3232024-04-03T22:18:30.308Z+ for VDEV in "${VDEVS[@]}"
3242024-04-03T22:18:30.308Z+ echo 'Device: [m2_1.vdev]'
3252024-04-03T22:18:30.308ZDevice: [m2_1.vdev]
3262024-04-03T22:18:30.308Z+ VDEV_PATH=/scratch/m2_1.vdev
3272024-04-03T22:18:30.308Z+ [[ -f /scratch/m2_1.vdev ]]
3282024-04-03T22:18:30.308Z+ dd if=/dev/zero of=/scratch/m2_1.vdev bs=1 count=0 seek=20G
3292024-04-03T22:18:30.308Z0+0 records in
3302024-04-03T22:18:30.308Z0+0 records out
3312024-04-03T22:18:30.308Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3322024-04-03T22:18:30.309Z+ success 'vdev /scratch/m2_1.vdev exists'
3332024-04-03T22:18:30.309Z+ set +x
3342024-04-03T22:18:30.309Zvdev /scratch/m2_1.vdev exists
3352024-04-03T22:18:30.309Z+ for VDEV_TYPE in "${VDEV_TYPES[@]}"
3362024-04-03T22:18:30.309Z+ readarray -t VDEVS
3372024-04-03T22:18:30.309Z++ grep '"u2_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3382024-04-03T22:18:30.309Z++ sed 's/[ ",]//g'
3392024-04-03T22:18:30.309Z+ for VDEV in "${VDEVS[@]}"
3402024-04-03T22:18:30.309Z+ echo 'Device: [u2_0.vdev]'
3412024-04-03T22:18:30.309ZDevice: [u2_0.vdev]
3422024-04-03T22:18:30.309Z+ VDEV_PATH=/scratch/u2_0.vdev
3432024-04-03T22:18:30.309Z+ [[ -f /scratch/u2_0.vdev ]]
3442024-04-03T22:18:30.309Z+ dd if=/dev/zero of=/scratch/u2_0.vdev bs=1 count=0 seek=20G
3452024-04-03T22:18:30.309Z0+0 records in
3462024-04-03T22:18:30.309Z0+0 records out
3472024-04-03T22:18:30.309Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3482024-04-03T22:18:30.309Z+ success 'vdev /scratch/u2_0.vdev exists'
3492024-04-03T22:18:30.309Z+ set +x
3502024-04-03T22:18:30.309Zvdev /scratch/u2_0.vdev exists
3512024-04-03T22:18:30.309Z+ for VDEV in "${VDEVS[@]}"
3522024-04-03T22:18:30.309Z+ echo 'Device: [u2_1.vdev]'
3532024-04-03T22:18:30.310ZDevice: [u2_1.vdev]
3542024-04-03T22:18:30.310Z+ VDEV_PATH=/scratch/u2_1.vdev
3552024-04-03T22:18:30.310Z+ [[ -f /scratch/u2_1.vdev ]]
3562024-04-03T22:18:30.310Z+ dd if=/dev/zero of=/scratch/u2_1.vdev bs=1 count=0 seek=20G
3572024-04-03T22:18:30.310Z0+0 records in
3582024-04-03T22:18:30.310Z0+0 records out
3592024-04-03T22:18:30.310Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3602024-04-03T22:18:30.310Z+ success 'vdev /scratch/u2_1.vdev exists'
3612024-04-03T22:18:30.310Z+ set +x
3622024-04-03T22:18:30.310Zvdev /scratch/u2_1.vdev exists
3632024-04-03T22:18:30.310Z+ for VDEV in "${VDEVS[@]}"
3642024-04-03T22:18:30.310Z+ echo 'Device: [u2_2.vdev]'
3652024-04-03T22:18:30.310ZDevice: [u2_2.vdev]
3662024-04-03T22:18:30.310Z+ VDEV_PATH=/scratch/u2_2.vdev
3672024-04-03T22:18:30.310Z+ [[ -f /scratch/u2_2.vdev ]]
3682024-04-03T22:18:30.310Z+ dd if=/dev/zero of=/scratch/u2_2.vdev bs=1 count=0 seek=20G
3692024-04-03T22:18:30.336Z0+0 records in
3702024-04-03T22:18:30.336Z0+0 records out
3712024-04-03T22:18:30.336Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3722024-04-03T22:18:30.336Z+ success 'vdev /scratch/u2_2.vdev exists'
3732024-04-03T22:18:30.336Z+ set +x
3742024-04-03T22:18:30.336Zvdev /scratch/u2_2.vdev exists
3752024-04-03T22:18:30.336Z+ for VDEV in "${VDEVS[@]}"
3762024-04-03T22:18:30.336Z+ echo 'Device: [u2_3.vdev]'
3772024-04-03T22:18:30.336ZDevice: [u2_3.vdev]
3782024-04-03T22:18:30.336Z+ VDEV_PATH=/scratch/u2_3.vdev
3792024-04-03T22:18:30.336Z+ [[ -f /scratch/u2_3.vdev ]]
3802024-04-03T22:18:30.336Z+ dd if=/dev/zero of=/scratch/u2_3.vdev bs=1 count=0 seek=20G
3812024-04-03T22:18:30.336Z0+0 records in
3822024-04-03T22:18:30.336Z0+0 records out
3832024-04-03T22:18:30.336Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3842024-04-03T22:18:30.337Z+ success 'vdev /scratch/u2_3.vdev exists'
3852024-04-03T22:18:30.337Z+ set +x
3862024-04-03T22:18:30.337Zvdev /scratch/u2_3.vdev exists
3872024-04-03T22:18:30.337Z+ for VDEV in "${VDEVS[@]}"
3882024-04-03T22:18:30.337Z+ echo 'Device: [u2_4.vdev]'
3892024-04-03T22:18:30.337ZDevice: [u2_4.vdev]
3902024-04-03T22:18:30.337Z+ VDEV_PATH=/scratch/u2_4.vdev
3912024-04-03T22:18:30.337Z+ [[ -f /scratch/u2_4.vdev ]]
3922024-04-03T22:18:30.337Z+ dd if=/dev/zero of=/scratch/u2_4.vdev bs=1 count=0 seek=20G
3932024-04-03T22:18:30.337Z0+0 records in
3942024-04-03T22:18:30.337Z0+0 records out
3952024-04-03T22:18:30.337Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3962024-04-03T22:18:30.337Z+ success 'vdev /scratch/u2_4.vdev exists'
3972024-04-03T22:18:30.337Z+ set +x
3982024-04-03T22:18:30.337Zvdev /scratch/u2_4.vdev exists
3992024-04-03T22:18:30.337Z+ for VDEV in "${VDEVS[@]}"
4002024-04-03T22:18:30.337Z+ echo 'Device: [u2_5.vdev]'
4012024-04-03T22:18:30.337ZDevice: [u2_5.vdev]
4022024-04-03T22:18:30.337Z+ VDEV_PATH=/scratch/u2_5.vdev
4032024-04-03T22:18:30.337Z+ [[ -f /scratch/u2_5.vdev ]]
4042024-04-03T22:18:30.337Z+ dd if=/dev/zero of=/scratch/u2_5.vdev bs=1 count=0 seek=20G
4052024-04-03T22:18:30.338Z0+0 records in
4062024-04-03T22:18:30.338Z0+0 records out
4072024-04-03T22:18:30.338Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4082024-04-03T22:18:30.338Z+ success 'vdev /scratch/u2_5.vdev exists'
4092024-04-03T22:18:30.338Z+ set +x
4102024-04-03T22:18:30.338Zvdev /scratch/u2_5.vdev exists
4112024-04-03T22:18:30.338Z+ for VDEV in "${VDEVS[@]}"
4122024-04-03T22:18:30.338Z+ echo 'Device: [u2_6.vdev]'
4132024-04-03T22:18:30.338ZDevice: [u2_6.vdev]
4142024-04-03T22:18:30.338Z+ VDEV_PATH=/scratch/u2_6.vdev
4152024-04-03T22:18:30.338Z+ [[ -f /scratch/u2_6.vdev ]]
4162024-04-03T22:18:30.338Z+ dd if=/dev/zero of=/scratch/u2_6.vdev bs=1 count=0 seek=20G
4172024-04-03T22:18:30.338Z0+0 records in
4182024-04-03T22:18:30.338Z0+0 records out
4192024-04-03T22:18:30.338Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4202024-04-03T22:18:30.338Z+ success 'vdev /scratch/u2_6.vdev exists'
4212024-04-03T22:18:30.338Z+ set +x
4222024-04-03T22:18:30.338Zvdev /scratch/u2_6.vdev exists
4232024-04-03T22:18:30.338Z+ for VDEV in "${VDEVS[@]}"
4242024-04-03T22:18:30.338Z+ echo 'Device: [u2_7.vdev]'
4252024-04-03T22:18:30.338ZDevice: [u2_7.vdev]
4262024-04-03T22:18:30.339Z+ VDEV_PATH=/scratch/u2_7.vdev
4272024-04-03T22:18:30.339Z+ [[ -f /scratch/u2_7.vdev ]]
4282024-04-03T22:18:30.339Z+ dd if=/dev/zero of=/scratch/u2_7.vdev bs=1 count=0 seek=20G
4292024-04-03T22:18:30.339Z0+0 records in
4302024-04-03T22:18:30.339Z0+0 records out
4312024-04-03T22:18:30.339Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4322024-04-03T22:18:30.339Z+ success 'vdev /scratch/u2_7.vdev exists'
4332024-04-03T22:18:30.339Z+ set +x
4342024-04-03T22:18:30.339Zvdev /scratch/u2_7.vdev exists
4352024-04-03T22:18:30.339Z+ for VDEV in "${VDEVS[@]}"
4362024-04-03T22:18:30.339Z+ echo 'Device: [u2_8.vdev]'
4372024-04-03T22:18:30.339ZDevice: [u2_8.vdev]
4382024-04-03T22:18:30.339Z+ VDEV_PATH=/scratch/u2_8.vdev
4392024-04-03T22:18:30.339Z+ [[ -f /scratch/u2_8.vdev ]]
4402024-04-03T22:18:30.339Z+ dd if=/dev/zero of=/scratch/u2_8.vdev bs=1 count=0 seek=20G
4412024-04-03T22:18:30.339Z0+0 records in
4422024-04-03T22:18:30.339Z0+0 records out
4432024-04-03T22:18:30.339Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4442024-04-03T22:18:30.339Z+ success 'vdev /scratch/u2_8.vdev exists'
4452024-04-03T22:18:30.339Z+ set +x
4462024-04-03T22:18:30.339Zvdev /scratch/u2_8.vdev exists
4472024-04-03T22:18:30.339Z+ [[ zone == \z\o\n\e ]]
4482024-04-03T22:18:30.340Z+ ensure_simulated_links igb0
4492024-04-03T22:18:30.340Z+ local PHYSICAL_LINK=igb0
4502024-04-03T22:18:30.340Z+ INDICES=("0" "1")
4512024-04-03T22:18:30.340Z+ for I in "${INDICES[@]}"
4522024-04-03T22:18:30.340Z++ get_simnet_name_if_exists net0
4532024-04-03T22:18:30.340Z++ dladm show-simnet -p -o LINK net0
4542024-04-03T22:18:30.340Z++ echo ''
4552024-04-03T22:18:30.340Z+ [[ -z '' ]]
4562024-04-03T22:18:30.340Z+ dladm create-simnet -t net0
4572024-04-03T22:18:30.365Z+ dladm create-simnet -t sc0_0
4582024-04-03T22:18:30.365Z+ dladm modify-simnet -t -p net0 sc0_0
4592024-04-03T22:18:30.365Z+ dladm set-linkprop -p mtu=9000 sc0_0
4602024-04-03T22:18:30.365Z+ success 'Simnet net0/sc0_0 exists'
4612024-04-03T22:18:30.365Z+ set +x
4622024-04-03T22:18:30.365ZSimnet net0/sc0_0 exists
4632024-04-03T22:18:30.365Z+ for I in "${INDICES[@]}"
4642024-04-03T22:18:30.366Z++ get_simnet_name_if_exists net1
4652024-04-03T22:18:30.366Z++ dladm show-simnet -p -o LINK net1
4662024-04-03T22:18:30.366Z++ echo ''
4672024-04-03T22:18:30.366Z+ [[ -z '' ]]
4682024-04-03T22:18:30.366Z+ dladm create-simnet -t net1
4692024-04-03T22:18:30.366Z+ dladm create-simnet -t sc1_0
4702024-04-03T22:18:30.366Z+ dladm modify-simnet -t -p net1 sc1_0
4712024-04-03T22:18:30.391Z+ dladm set-linkprop -p mtu=9000 sc1_0
4722024-04-03T22:18:30.391Z+ success 'Simnet net1/sc1_0 exists'
4732024-04-03T22:18:30.391Z+ set +x
4742024-04-03T22:18:30.391ZSimnet net1/sc1_0 exists
4752024-04-03T22:18:30.391Z++ get_vnic_name_if_exists sc0_1
4762024-04-03T22:18:30.391Z++ dladm show-vnic -p -o LINK sc0_1
4772024-04-03T22:18:30.391Z++ echo ''
4782024-04-03T22:18:30.391Z+ [[ -z '' ]]
4792024-04-03T22:18:30.391Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
4802024-04-03T22:18:30.391Z+ [[ -v PROMISC_FILT_OFF ]]
4812024-04-03T22:18:30.391Z+ success 'Vnic sc0_1 exists'
4822024-04-03T22:18:30.391Z+ set +x
4832024-04-03T22:18:30.392ZVnic sc0_1 exists
4842024-04-03T22:18:30.392Z+ warn_if_no_proxy_arp
4852024-04-03T22:18:30.392Z+ [[ -v PXA_START ]]
4862024-04-03T22:18:30.392Z+ [[ -v PXA_END ]]
4872024-04-03T22:18:30.392Z+ ensure_softnpu_zone
4882024-04-03T22:18:30.392Z+ zoneadm list
4892024-04-03T22:18:30.392Z+ grep -q sidecar_softnpu
4902024-04-03T22:18:30.392Z+ [[ -f out/npuzone/npuzone ]]
4912024-04-03T22:18:30.392Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
4922024-04-03T22:18:30.417Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
4932024-04-03T22:18:35.754Zdownloading softnpu ...done
4942024-04-03T22:18:35.779Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
4952024-04-03T22:18:40.031Zdownloading asic_program.so ...done
4962024-04-03T22:18:40.056Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
4972024-04-03T22:18:46.810Zdownloading scadm ...done
4982024-04-03T22:18:46.835Zcreating port tfportrear0_0 for sc0_0
4992024-04-03T22:18:46.835Zcreating port tfportqsfp0_0 for sc0_1
5002024-04-03T22:18:46.860Zsoftnpu zone setup
5012024-04-03T22:18:46.860Zconfigure zone
5022024-04-03T22:18:46.860Zinstall zone
5032024-04-03T22:18:47.876Zboot zone
5042024-04-03T22:18:50.984Z[sidecar_softnpu] svcs milestone/network
5052024-04-03T22:18:51.011ZSTATE STIME FMRI
5062024-04-03T22:18:51.011Zonline 22:18:49 svc:/milestone/network:default
5072024-04-03T22:18:51.011Z[sidecar_softnpu] /softnpu/npu start
5082024-04-03T22:18:51.038Z
5092024-04-03T22:18:51.066Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5102024-04-03T22:18:51.066Z+ GATEWAY_IP=10.151.1.100
5112024-04-03T22:18:51.066Z+ echo 'Using 10.151.1.100 as gateway ip'
5122024-04-03T22:18:51.066ZUsing 10.151.1.100 as gateway ip
5132024-04-03T22:18:51.066Z+ [[ ! -v GATEWAY_MAC ]]
5142024-04-03T22:18:51.066Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5152024-04-03T22:18:51.066Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5162024-04-03T22:18:51.067Z+++ echo 18:c0:4d:0d:9f:b2
5172024-04-03T22:18:51.067Z+ COUNT=1
5182024-04-03T22:18:51.067Z+ [[ 1 -ne 1 ]]
5192024-04-03T22:18:51.067Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5202024-04-03T22:18:51.067ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5212024-04-03T22:18:51.067Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5222024-04-03T22:18:51.067Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5232024-04-03T22:18:51.092Z+ PXA_MAC=a8:e1:de:01:70:1d
5242024-04-03T22:18:51.092Z+ [[ -v PXA_START ]]
5252024-04-03T22:18:51.092Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5262024-04-03T22:18:51.092Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5272024-04-03T22:18:51.117Z+ z_scadm dump-state
5282024-04-03T22:18:51.117Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5292024-04-03T22:18:51.143Zlocal v6:
5302024-04-03T22:18:51.143Zlocal v4:
5312024-04-03T22:18:51.143Zrouter v6:
5322024-04-03T22:18:51.143Zrouter v4_idx:
5332024-04-03T22:18:51.143Zrouter v4_routes:
5342024-04-03T22:18:51.143Zresolver v4:
5352024-04-03T22:18:51.143Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5362024-04-03T22:18:51.143Zresolver v6:
5372024-04-03T22:18:51.143Znat v4:
5382024-04-03T22:18:51.143Znat_v6:
5392024-04-03T22:18:51.143Zport_mac:
5402024-04-03T22:18:51.143Zproxy arp:
5412024-04-03T22:18:51.143Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5422024-04-03T22:18:51.143Z+ success 'softnpu zone exists'
5432024-04-03T22:18:51.143Z+ set +x
5442024-04-03T22:18:51.143Zsoftnpu zone exists
5452024-04-03T22:18:51.143Z
5462024-04-03T22:18:51.144Zreal 20.960802612
5472024-04-03T22:18:51.144Zuser 0.638063235
5482024-04-03T22:18:51.144Zsys 1.344488900
5492024-04-03T22:18:51.144Ztrap 0.000067078
5502024-04-03T22:18:51.144Ztflt 0.000109658
5512024-04-03T22:18:51.144Zdflt 0.000909329
5522024-04-03T22:18:51.144Zkflt 0.000000000
5532024-04-03T22:18:51.144Zlock 16:29.428850340
5542024-04-03T22:18:51.144Zslp 1:03.434629258
5552024-04-03T22:18:51.144Zlat 0.056967215
5562024-04-03T22:18:51.144Zstop 0.346438230
5572024-04-03T22:18:51.144Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
5582024-04-03T22:18:51.170Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
5592024-04-03T22:18:51.196Z+ diff -u pkg/config.toml~ pkg/config.toml
5602024-04-03T22:18:51.196Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
5612024-04-03T22:18:51.196Z+++ pkg/config.toml Wed Apr 3 22:18:51 2024
5622024-04-03T22:18:51.196Z@@ -29,18 +29,18 @@
5632024-04-03T22:18:51.197Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
5642024-04-03T22:18:51.197Z # followed by a string that is embedded into their fake serial values.
5652024-04-03T22:18:51.197Z vdevs = [
5662024-04-03T22:18:51.197Z- "m2_0.vdev",
5672024-04-03T22:18:51.197Z- "m2_1.vdev",
5682024-04-03T22:18:51.197Z+ "/scratch/m2_0.vdev",
5692024-04-03T22:18:51.197Z+ "/scratch/m2_1.vdev",
5702024-04-03T22:18:51.197Z
5712024-04-03T22:18:51.197Z- "u2_0.vdev",
5722024-04-03T22:18:51.197Z- "u2_1.vdev",
5732024-04-03T22:18:51.197Z- "u2_2.vdev",
5742024-04-03T22:18:51.197Z- "u2_3.vdev",
5752024-04-03T22:18:51.197Z- "u2_4.vdev",
5762024-04-03T22:18:51.197Z- "u2_5.vdev",
5772024-04-03T22:18:51.197Z- "u2_6.vdev",
5782024-04-03T22:18:51.197Z- "u2_7.vdev",
5792024-04-03T22:18:51.197Z- "u2_8.vdev",
5802024-04-03T22:18:51.197Z+ "/scratch/u2_0.vdev",
5812024-04-03T22:18:51.197Z+ "/scratch/u2_1.vdev",
5822024-04-03T22:18:51.197Z+ "/scratch/u2_2.vdev",
5832024-04-03T22:18:51.197Z+ "/scratch/u2_3.vdev",
5842024-04-03T22:18:51.197Z+ "/scratch/u2_4.vdev",
5852024-04-03T22:18:51.198Z+ "/scratch/u2_5.vdev",
5862024-04-03T22:18:51.198Z+ "/scratch/u2_6.vdev",
5872024-04-03T22:18:51.198Z+ "/scratch/u2_7.vdev",
5882024-04-03T22:18:51.198Z+ "/scratch/u2_8.vdev",
5892024-04-03T22:18:51.198Z ]
5902024-04-03T22:18:51.198Z
5912024-04-03T22:18:51.198Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
5922024-04-03T22:18:51.198Z+ true
5932024-04-03T22:18:51.198Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5942024-04-03T22:18:51.198Z+ SILO_NAME=recovery
5952024-04-03T22:18:51.198Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5962024-04-03T22:18:51.198Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5972024-04-03T22:18:51.198Z+ sed -i~ '
5982024-04-03T22:18:51.198Z /^external_dns_ips/c\
5992024-04-03T22:18:51.198Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6002024-04-03T22:18:51.198Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6012024-04-03T22:18:51.198Z /^first/c\
6022024-04-03T22:18:51.198Zfirst = "10.151.1.164"
6032024-04-03T22:18:51.198Z /^last/c\
6042024-04-03T22:18:51.198Zlast = "10.151.1.173"
6052024-04-03T22:18:51.198Z }
6062024-04-03T22:18:51.199Z /^infra_ip_first/c\
6072024-04-03T22:18:51.199Zinfra_ip_first = "10.151.1.174"
6082024-04-03T22:18:51.199Z /^infra_ip_last/c\
6092024-04-03T22:18:51.199Zinfra_ip_last = "10.151.1.174"
6102024-04-03T22:18:51.199Z /^\[\[rack_network_config.ports/,/^$/ {
6112024-04-03T22:18:51.199Z /^routes/c\
6122024-04-03T22:18:51.199Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6132024-04-03T22:18:51.199Z /^addresses/c\
6142024-04-03T22:18:51.199Zaddresses = \["10.151.1.174/24"\]
6152024-04-03T22:18:51.199Z }
6162024-04-03T22:18:51.199Z' pkg/config-rss.toml
6172024-04-03T22:18:51.199Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6182024-04-03T22:18:51.199Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6192024-04-03T22:18:51.199Z+++ pkg/config-rss.toml Wed Apr 3 22:18:51 2024
6202024-04-03T22:18:51.199Z@@ -33,7 +33,7 @@
6212024-04-03T22:18:51.199Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6222024-04-03T22:18:51.199Z # must be contained in one of the "internal services" IP Pool ranges listed
6232024-04-03T22:18:51.199Z # below.
6242024-04-03T22:18:51.199Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6252024-04-03T22:18:51.199Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6262024-04-03T22:18:51.200Z
6272024-04-03T22:18:51.200Z # Initial TLS certificates for the external API
6282024-04-03T22:18:51.200Z #
6292024-04-03T22:18:51.200Z@@ -69,8 +69,8 @@
6302024-04-03T22:18:51.200Z #
6312024-04-03T22:18:51.200Z # For more on this and what to put here, see docs/how-to-run.adoc.
6322024-04-03T22:18:51.200Z [[internal_services_ip_pool_ranges]]
6332024-04-03T22:18:51.200Z-first = "192.168.1.20"
6342024-04-03T22:18:51.200Z-last = "192.168.1.29"
6352024-04-03T22:18:51.200Z+first = "10.151.1.164"
6362024-04-03T22:18:51.200Z+last = "10.151.1.173"
6372024-04-03T22:18:51.200Z
6382024-04-03T22:18:51.200Z # TODO - this configuration is subject to change going forward. Ultimately these
6392024-04-03T22:18:51.200Z # parameters should be provided to the control plane via wicket, but we need to
6402024-04-03T22:18:51.200Z@@ -91,8 +91,8 @@
6412024-04-03T22:18:51.200Z # A range of IP addresses used by Boundary Services on the external network. In
6422024-04-03T22:18:51.200Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6432024-04-03T22:18:51.200Z # With softnpu, only one address is used.
6442024-04-03T22:18:51.200Z-infra_ip_first = "192.168.1.30"
6452024-04-03T22:18:51.200Z-infra_ip_last = "192.168.1.30"
6462024-04-03T22:18:51.200Z+infra_ip_first = "10.151.1.174"
6472024-04-03T22:18:51.200Z+infra_ip_last = "10.151.1.174"
6482024-04-03T22:18:51.201Z
6492024-04-03T22:18:51.201Z # Configurations for BGP routers to run on the scrimlets.
6502024-04-03T22:18:51.201Z bgp = []
6512024-04-03T22:18:51.201Z@@ -100,9 +100,9 @@
6522024-04-03T22:18:51.201Z # You can configure multiple uplinks by repeating the following stanza
6532024-04-03T22:18:51.201Z [[rack_network_config.ports]]
6542024-04-03T22:18:51.201Z # Routes associated with this port.
6552024-04-03T22:18:51.201Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6562024-04-03T22:18:51.201Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6572024-04-03T22:18:51.201Z # Addresses associated with this port.
6582024-04-03T22:18:51.201Z-addresses = ["192.168.1.30/24"]
6592024-04-03T22:18:51.226Z+addresses = ["10.151.1.174/24"]
6602024-04-03T22:18:51.226Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6612024-04-03T22:18:51.226Z port = "qsfp0"
6622024-04-03T22:18:51.226Z # The speed of this port.
6632024-04-03T22:18:51.226Z+ true
6642024-04-03T22:18:51.226Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
6652024-04-03T22:18:51.226Za pkg/config-rss.toml 7K
6662024-04-03T22:18:51.226Za pkg/config.toml 4K
6672024-04-03T22:18:51.226Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
6682024-04-03T22:18:51.226Z+ TLS_NAME=recovery.sys.oxide.test
6692024-04-03T22:18:51.226Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6702024-04-03T22:18:51.871Z...+....+..............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....................+..............+...+.......+...............+...+...+......+.....+.....................+....+.....+......+.........+.........+......+......+....+.........+..............+...+....+........+.+..............+.......+.....+.....................+.......+......+..+....+..............+.......+........+......................+...+.....+............+.......+........+.........+.............+..+...+...+..........+........+................+......+...+......+......+.........+...+..+.+...+...........+.+..............+..................+.......+.....+.....................+...+......+.+........+....+..+.+........+.......+..+...+.........+....+..+.............+............+........+.........+.......+...........+.........+......+.............+......+...+..+...+...+.......+......+..+...+.+........+................+.....+.......+..+......+.+......+.....+............+...............+.+.....+.......+.....+.........+.+...+...........+..........+........+......+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6712024-04-03T22:18:52.065Z....+........+.+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+.........+.....+............+.........+...+.+.....+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...............+...+....+..+........................+.........+...+.............+..+.............+..+.........+....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6722024-04-03T22:18:52.090Z-----
6732024-04-03T22:18:52.090Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6742024-04-03T22:18:52.117Za pkg/initial-tls-cert.pem 2K
6752024-04-03T22:18:52.117Za pkg/initial-tls-key.pem 4K
6762024-04-03T22:18:52.117Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6772024-04-03T22:18:52.117Z+ rmdir pkg
6782024-04-03T22:18:52.117Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6792024-04-03T22:18:52.117Z+ pfexec mkdir -p /usr/oxide
6802024-04-03T22:18:52.117Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6812024-04-03T22:18:52.731Z+ pfexec chmod +x /usr/oxide/oxide
6822024-04-03T22:18:52.756Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6832024-04-03T22:19:11.408Z+ OMICRON_NO_UNINSTALL=1
6842024-04-03T22:19:11.409Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6852024-04-03T22:19:11.434ZLogging to: /opt/oxide/work/out/LOG
6862024-04-03T22:19:11.965Z
6872024-04-03T22:19:11.990Zreal 0.551484479
6882024-04-03T22:19:11.991Zuser 0.113550659
6892024-04-03T22:19:11.991Zsys 2.618700397
6902024-04-03T22:19:11.991Ztrap 0.000006518
6912024-04-03T22:19:11.991Ztflt 0.000010336
6922024-04-03T22:19:11.991Zdflt 0.001194017
6932024-04-03T22:19:11.991Zkflt 0.000000000
6942024-04-03T22:19:11.991Zlock 49.783020158
6952024-04-03T22:19:11.991Zslp 0.777516797
6962024-04-03T22:19:11.991Zlat 0.003531233
6972024-04-03T22:19:11.991Zstop 0.214520391
6982024-04-03T22:19:11.991Z+ retry=0
6992024-04-03T22:19:11.991Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7002024-04-03T22:19:11.991Z+ [[ 0 -gt 30 ]]
7012024-04-03T22:19:11.991Z+ sleep 1
7022024-04-03T22:19:12.980Z+ retry=1
7032024-04-03T22:19:12.980Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7042024-04-03T22:19:13.005Z+ [[ 1 -gt 30 ]]
7052024-04-03T22:19:13.005Z+ sleep 1
7062024-04-03T22:19:13.994Z+ retry=2
7072024-04-03T22:19:13.994Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7082024-04-03T22:19:14.019Z+ [[ 2 -gt 30 ]]
7092024-04-03T22:19:14.019Z+ sleep 1
7102024-04-03T22:19:15.008Z+ retry=3
7112024-04-03T22:19:15.008Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7122024-04-03T22:19:40.179Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7132024-04-03T22:19:40.209Zlocal v6:
7142024-04-03T22:19:40.209Zfd77:2218:e8fe:7f3b::1
7152024-04-03T22:19:40.209Zfe80::bc59:34ff:fe5c:fce3
7162024-04-03T22:19:40.209Zlocal v4:
7172024-04-03T22:19:40.209Z10.151.1.174
7182024-04-03T22:19:40.209Zrouter v6:
7192024-04-03T22:19:40.209Zfd00:1122:3344:101::/64 -> fe80::b842:d1ff:fed8:dc01 (1)
7202024-04-03T22:19:40.209Zfd00:1122:3344:2::/64 -> fe80::b842:d1ff:fed8:dc01 (1)
7212024-04-03T22:19:40.209Zfd00:1122:3344:3::/64 -> fe80::b842:d1ff:fed8:dc01 (1)
7222024-04-03T22:19:40.209Zfd00:1122:3344:1::/64 -> fe80::b842:d1ff:fed8:dc01 (1)
7232024-04-03T22:19:40.209Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::b842:d1ff:fed8:dc01 (1)
7242024-04-03T22:19:40.209Zrouter v4_idx:
7252024-04-03T22:19:40.209Z0.0.0.0/0 -> 0
7262024-04-03T22:19:40.210Zrouter v4_routes:
7272024-04-03T22:19:40.210Z0 -> 10.151.1.100 (2)
7282024-04-03T22:19:40.210Zresolver v4:
7292024-04-03T22:19:40.210Z10.151.1.174 -> 1a:ed:31:97:b8:99
7302024-04-03T22:19:40.210Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7312024-04-03T22:19:40.210Zresolver v6:
7322024-04-03T22:19:40.235Zfe80::bc59:34ff:fe5c:fce3 -> be:59:34:5c:fc:e3
7332024-04-03T22:19:40.235Zfe80::b842:d1ff:fed8:dc01 -> ba:42:d1:d8:dc:01
7342024-04-03T22:19:40.235Znat v4:
7352024-04-03T22:19:40.235Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:db:75
7362024-04-03T22:19:40.235Znat_v6:
7372024-04-03T22:19:40.235Zport_mac:
7382024-04-03T22:19:40.235Z1000: a8:40:25:46:a6:2c
7392024-04-03T22:19:40.235Z1: a8:40:25:46:a6:2d
7402024-04-03T22:19:40.235Z2: a8:40:25:46:a6:4d
7412024-04-03T22:19:40.235Zproxy arp:
7422024-04-03T22:19:40.236Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7432024-04-03T22:19:40.236Z+ retry=0
7442024-04-03T22:19:40.236Z+++ zoneadm list -n
7452024-04-03T22:19:40.236Z+++ grep oxz_ntp
7462024-04-03T22:19:40.236Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
7472024-04-03T22:19:40.261Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7482024-04-03T22:19:40.261Z++ true
7492024-04-03T22:19:40.261Z+ [[ '' != online ]]
7502024-04-03T22:19:40.261Z+ [[ 0 -gt 60 ]]
7512024-04-03T22:19:40.261Z+ sleep 1
7522024-04-03T22:19:41.244Z+ retry=1
7532024-04-03T22:19:41.269Z+++ zoneadm list -n
7542024-04-03T22:19:41.269Z+++ grep oxz_ntp
7552024-04-03T22:19:41.269Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
7562024-04-03T22:19:41.294Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7572024-04-03T22:19:41.294Z++ true
7582024-04-03T22:19:41.294Z+ [[ '' != online ]]
7592024-04-03T22:19:41.294Z+ [[ 1 -gt 60 ]]
7602024-04-03T22:19:41.294Z+ sleep 1
7612024-04-03T22:19:42.274Z+ retry=2
7622024-04-03T22:19:42.299Z+++ zoneadm list -n
7632024-04-03T22:19:42.300Z+++ grep oxz_ntp
7642024-04-03T22:19:42.300Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
7652024-04-03T22:19:42.300Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7662024-04-03T22:19:42.300Z++ true
7672024-04-03T22:19:42.324Z+ [[ '' != online ]]
7682024-04-03T22:19:42.324Z+ [[ 2 -gt 60 ]]
7692024-04-03T22:19:42.325Z+ sleep 1
7702024-04-03T22:19:43.304Z+ retry=3
7712024-04-03T22:19:43.329Z+++ zoneadm list -n
7722024-04-03T22:19:43.329Z+++ grep oxz_ntp
7732024-04-03T22:19:43.329Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
7742024-04-03T22:19:43.353Z+ [[ offline != online ]]
7752024-04-03T22:19:43.354Z+ [[ 3 -gt 60 ]]
7762024-04-03T22:19:43.354Z+ sleep 1
7772024-04-03T22:19:44.328Z+ retry=4
7782024-04-03T22:19:44.352Z+++ zoneadm list -n
7792024-04-03T22:19:44.352Z+++ grep oxz_ntp
7802024-04-03T22:19:44.352Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
7812024-04-03T22:19:44.352Z+ [[ offline != online ]]
7822024-04-03T22:19:44.352Z+ [[ 4 -gt 60 ]]
7832024-04-03T22:19:44.352Z+ sleep 1
7842024-04-03T22:19:45.348Z+ retry=5
7852024-04-03T22:19:45.373Z+++ zoneadm list -n
7862024-04-03T22:19:45.373Z+++ grep oxz_ntp
7872024-04-03T22:19:45.373Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
7882024-04-03T22:19:45.373Z+ [[ offline != online ]]
7892024-04-03T22:19:45.373Z+ [[ 5 -gt 60 ]]
7902024-04-03T22:19:45.373Z+ sleep 1
7912024-04-03T22:19:46.370Z+ retry=6
7922024-04-03T22:19:46.395Z+++ zoneadm list -n
7932024-04-03T22:19:46.395Z+++ grep oxz_ntp
7942024-04-03T22:19:46.395Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
7952024-04-03T22:19:46.395Z+ [[ offline != online ]]
7962024-04-03T22:19:46.395Z+ [[ 6 -gt 60 ]]
7972024-04-03T22:19:46.395Z+ sleep 1
7982024-04-03T22:19:47.393Z+ retry=7
7992024-04-03T22:19:47.418Z+++ zoneadm list -n
8002024-04-03T22:19:47.418Z+++ grep oxz_ntp
8012024-04-03T22:19:47.418Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
8022024-04-03T22:19:47.418Z+ [[ offline != online ]]
8032024-04-03T22:19:47.418Z+ [[ 7 -gt 60 ]]
8042024-04-03T22:19:47.418Z+ sleep 1
8052024-04-03T22:19:48.415Z+ retry=8
 
8062024-04-03T22:19:48.420Zbuskin console login: Apr 3 22:19:48 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8072024-04-03T22:19:48.440Z+++ zoneadm list -n
8082024-04-03T22:19:48.440Z+++ grep oxz_ntp
8092024-04-03T22:19:48.440Z++ pfexec svcs -z oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5 -Hostate oxide/ntp
8102024-04-03T22:19:48.440Z+ [[ online != online ]]
8112024-04-03T22:19:48.440Z+ echo 'Waited for chrony: 8s'
8122024-04-03T22:19:48.440Z+ retry=0
8132024-04-03T22:19:48.440ZWaited for chrony: 8s
8142024-04-03T22:19:48.440Z+ zoneadm list
8152024-04-03T22:19:48.440Z+ grep nexus
8162024-04-03T22:19:48.465Z+ [[ 0 -gt 300 ]]
8172024-04-03T22:19:48.465Z+ sleep 1
8182024-04-03T22:19:49.444Z+ retry=1
8192024-04-03T22:19:49.469Z+ zoneadm list
8202024-04-03T22:19:49.469Z+ grep nexus
8212024-04-03T22:19:49.469Z+ [[ 1 -gt 300 ]]
8222024-04-03T22:19:49.469Z+ sleep 1
8232024-04-03T22:19:50.455Z+ retry=2
8242024-04-03T22:19:50.480Z+ zoneadm list
8252024-04-03T22:19:50.480Z+ grep nexus
8262024-04-03T22:19:50.480Z+ [[ 2 -gt 300 ]]
8272024-04-03T22:19:50.480Z+ sleep 1
8282024-04-03T22:19:51.479Z+ retry=3
8292024-04-03T22:19:51.504Z+ zoneadm list
8302024-04-03T22:19:51.504Z+ grep nexus
8312024-04-03T22:19:51.504Z+ [[ 3 -gt 300 ]]
8322024-04-03T22:19:51.504Z+ sleep 1
8332024-04-03T22:19:52.484Z+ retry=4
8342024-04-03T22:19:52.514Z+ zoneadm list
8352024-04-03T22:19:52.514Z+ grep nexus
8362024-04-03T22:19:52.515Z+ [[ 4 -gt 300 ]]
8372024-04-03T22:19:52.515Z+ sleep 1
8382024-04-03T22:19:53.765Z+ retry=5
8392024-04-03T22:19:53.765Z+ zoneadm list
8402024-04-03T22:19:53.765Z+ grep nexus
8412024-04-03T22:19:53.765Z+ [[ 5 -gt 300 ]]
8422024-04-03T22:19:53.765Z+ sleep 1
8432024-04-03T22:19:54.496Z+ retry=6
8442024-04-03T22:19:54.521Z+ zoneadm list
8452024-04-03T22:19:54.521Z+ grep nexus
8462024-04-03T22:19:54.521Z+ [[ 6 -gt 300 ]]
8472024-04-03T22:19:54.521Z+ sleep 1
8482024-04-03T22:19:55.508Z+ retry=7
8492024-04-03T22:19:55.533Z+ zoneadm list
8502024-04-03T22:19:55.533Z+ grep nexus
8512024-04-03T22:19:55.533Z+ [[ 7 -gt 300 ]]
8522024-04-03T22:19:55.533Z+ sleep 1
8532024-04-03T22:19:56.519Z+ retry=8
8542024-04-03T22:19:56.544Z+ zoneadm list
8552024-04-03T22:19:56.544Z+ grep nexus
8562024-04-03T22:19:56.544Z+ [[ 8 -gt 300 ]]
8572024-04-03T22:19:56.544Z+ sleep 1
8582024-04-03T22:19:57.531Z+ retry=9
8592024-04-03T22:19:57.556Z+ zoneadm list
8602024-04-03T22:19:57.556Z+ grep nexus
8612024-04-03T22:19:57.556Z+ [[ 9 -gt 300 ]]
8622024-04-03T22:19:57.556Z+ sleep 1
8632024-04-03T22:19:58.787Z+ retry=10
8642024-04-03T22:19:58.814Z+ zoneadm list
8652024-04-03T22:19:58.814Z+ grep nexus
8662024-04-03T22:19:58.814Z+ [[ 10 -gt 300 ]]
8672024-04-03T22:19:58.814Z+ sleep 1
8682024-04-03T22:20:00.731Z+ retry=11
8692024-04-03T22:20:00.765Z+ + zoneadm list
8702024-04-03T22:20:00.766Zgrep nexus
8712024-04-03T22:20:00.813Z+ [[ 11 -gt 300 ]]
8722024-04-03T22:20:00.813Z+ sleep 1
8732024-04-03T22:20:01.816Z+ retry=12
8742024-04-03T22:20:01.841Z+ zoneadm list
8752024-04-03T22:20:01.841Z+ grep nexus
8762024-04-03T22:20:01.841Z+ [[ 12 -gt 300 ]]
8772024-04-03T22:20:01.842Z+ sleep 1
8782024-04-03T22:20:02.830Z+ retry=13
8792024-04-03T22:20:02.856Z+ zoneadm list
8802024-04-03T22:20:02.856Z+ grep nexus
8812024-04-03T22:20:02.856Z+ [[ 13 -gt 300 ]]
8822024-04-03T22:20:02.856Z+ sleep 1
8832024-04-03T22:20:03.843Z+ retry=14
8842024-04-03T22:20:03.870Z+ zoneadm list
8852024-04-03T22:20:03.870Z+ grep nexus
8862024-04-03T22:20:03.870Z+ [[ 14 -gt 300 ]]
8872024-04-03T22:20:03.870Z+ sleep 1
8882024-04-03T22:20:04.856Z+ retry=15
8892024-04-03T22:20:04.881Z+ zoneadm list
8902024-04-03T22:20:04.881Z+ grep nexus
8912024-04-03T22:20:04.881Z+ [[ 15 -gt 300 ]]
8922024-04-03T22:20:04.881Z+ sleep 1
8932024-04-03T22:20:05.871Z+ retry=16
8942024-04-03T22:20:05.896Z+ zoneadm list
8952024-04-03T22:20:05.896Z+ grep nexus
8962024-04-03T22:20:05.896Z+ [[ 16 -gt 300 ]]
8972024-04-03T22:20:05.896Z+ sleep 1
8982024-04-03T22:20:06.884Z+ retry=17
8992024-04-03T22:20:06.909Z+ zoneadm list
9002024-04-03T22:20:06.909Z+ grep nexus
9012024-04-03T22:20:06.909Z+ [[ 17 -gt 300 ]]
9022024-04-03T22:20:06.909Z+ sleep 1
9032024-04-03T22:20:07.899Z+ retry=18
9042024-04-03T22:20:07.925Z+ zoneadm list
9052024-04-03T22:20:07.925Z+ grep nexus
9062024-04-03T22:20:07.925Z+ [[ 18 -gt 300 ]]
9072024-04-03T22:20:07.925Z+ sleep 1
9082024-04-03T22:20:08.911Z+ retry=19
9092024-04-03T22:20:08.940Z+ zoneadm list
9102024-04-03T22:20:08.940Z+ grep nexus
9112024-04-03T22:20:08.940Z+ [[ 19 -gt 300 ]]
9122024-04-03T22:20:08.940Z+ sleep 1
9132024-04-03T22:20:09.924Z+ retry=20
9142024-04-03T22:20:09.948Z+ zoneadm list
9152024-04-03T22:20:09.948Z+ grep nexus
9162024-04-03T22:20:09.949Z+ [[ 20 -gt 300 ]]
9172024-04-03T22:20:09.949Z+ sleep 1
9182024-04-03T22:20:10.938Z+ retry=21
9192024-04-03T22:20:10.963Z+ zoneadm list
9202024-04-03T22:20:10.963Z+ grep nexus
9212024-04-03T22:20:10.963Z+ [[ 21 -gt 300 ]]
9222024-04-03T22:20:10.963Z+ sleep 1
9232024-04-03T22:20:12.086Z+ retry=22
9242024-04-03T22:20:12.112Z+ zoneadm list
9252024-04-03T22:20:12.113Z+ grep nexus
9262024-04-03T22:20:12.248Z+ [[ 22 -gt 300 ]]
9272024-04-03T22:20:12.248Z+ sleep 1
9282024-04-03T22:20:13.306Z+ retry=23
9292024-04-03T22:20:13.331Z+ zoneadm list
9302024-04-03T22:20:13.331Z+ grep nexus
9312024-04-03T22:20:13.331Z+ [[ 23 -gt 300 ]]
9322024-04-03T22:20:13.331Z+ sleep 1
9332024-04-03T22:20:14.321Z+ retry=24
9342024-04-03T22:20:14.345Z+ zoneadm list
9352024-04-03T22:20:14.345Z+ grep nexus
9362024-04-03T22:20:14.345Z+ [[ 24 -gt 300 ]]
9372024-04-03T22:20:14.345Z+ sleep 1
9382024-04-03T22:20:15.334Z+ retry=25
9392024-04-03T22:20:15.359Z+ zoneadm list
9402024-04-03T22:20:15.359Z+ grep nexus
9412024-04-03T22:20:15.359Z+ [[ 25 -gt 300 ]]
9422024-04-03T22:20:15.359Z+ sleep 1
9432024-04-03T22:20:16.347Z+ retry=26
9442024-04-03T22:20:16.371Z+ zoneadm list
9452024-04-03T22:20:16.371Z+ grep nexus
9462024-04-03T22:20:16.372Z+ [[ 26 -gt 300 ]]
9472024-04-03T22:20:16.372Z+ sleep 1
9482024-04-03T22:20:17.359Z+ retry=27
9492024-04-03T22:20:17.385Z+ zoneadm list
9502024-04-03T22:20:17.385Z+ grep nexus
9512024-04-03T22:20:17.385Z+ [[ 27 -gt 300 ]]
9522024-04-03T22:20:17.385Z+ sleep 1
9532024-04-03T22:20:18.373Z+ retry=28
9542024-04-03T22:20:18.398Z+ zoneadm list
9552024-04-03T22:20:18.398Z+ grep nexus
9562024-04-03T22:20:18.398Z+ [[ 28 -gt 300 ]]
9572024-04-03T22:20:18.398Z+ sleep 1
9582024-04-03T22:20:19.386Z+ retry=29
9592024-04-03T22:20:19.411Z+ zoneadm list
9602024-04-03T22:20:19.411Z+ grep nexus
9612024-04-03T22:20:19.411Z+ [[ 29 -gt 300 ]]
9622024-04-03T22:20:19.411Z+ sleep 1
9632024-04-03T22:20:20.401Z+ retry=30
9642024-04-03T22:20:20.426Z+ zoneadm list
9652024-04-03T22:20:20.426Z+ grep nexus
9662024-04-03T22:20:20.426Z+ [[ 30 -gt 300 ]]
9672024-04-03T22:20:20.426Z+ sleep 1
9682024-04-03T22:20:21.411Z+ retry=31
9692024-04-03T22:20:21.436Z+ zoneadm list
9702024-04-03T22:20:21.436Z+ grep nexus
9712024-04-03T22:20:21.436Z+ [[ 31 -gt 300 ]]
9722024-04-03T22:20:21.436Z+ sleep 1
9732024-04-03T22:20:22.425Z+ retry=32
9742024-04-03T22:20:22.450Z+ zoneadm list
9752024-04-03T22:20:22.450Z+ grep nexus
9762024-04-03T22:20:22.450Z+ [[ 32 -gt 300 ]]
9772024-04-03T22:20:22.450Z+ sleep 1
9782024-04-03T22:20:23.436Z+ retry=33
9792024-04-03T22:20:23.461Z+ zoneadm list
9802024-04-03T22:20:23.461Z+ grep nexus
9812024-04-03T22:20:23.461Z+ [[ 33 -gt 300 ]]
9822024-04-03T22:20:23.461Z+ sleep 1
9832024-04-03T22:20:24.448Z+ retry=34
9842024-04-03T22:20:24.473Z+ zoneadm list
9852024-04-03T22:20:24.473Z+ grep nexus
9862024-04-03T22:20:24.473Z+ [[ 34 -gt 300 ]]
9872024-04-03T22:20:24.473Z+ sleep 1
9882024-04-03T22:20:25.464Z+ retry=35
9892024-04-03T22:20:25.496Z+ zoneadm list
9902024-04-03T22:20:25.496Z+ grep nexus
9912024-04-03T22:20:25.496Z+ [[ 35 -gt 300 ]]
9922024-04-03T22:20:25.496Z+ sleep 1
9932024-04-03T22:20:26.475Z+ retry=36
9942024-04-03T22:20:26.500Z+ zoneadm list
9952024-04-03T22:20:26.500Z+ grep nexus
9962024-04-03T22:20:26.501Z+ [[ 36 -gt 300 ]]
9972024-04-03T22:20:26.501Z+ sleep 1
9982024-04-03T22:20:27.487Z+ retry=37
9992024-04-03T22:20:27.518Z+ zoneadm list
10002024-04-03T22:20:27.518Z+ grep nexus
10012024-04-03T22:20:27.518Z+ [[ 37 -gt 300 ]]
10022024-04-03T22:20:27.518Z+ sleep 1
10032024-04-03T22:20:28.499Z+ retry=38
10042024-04-03T22:20:28.527Z+ zoneadm list
10052024-04-03T22:20:28.527Z+ grep nexus
10062024-04-03T22:20:28.528Z+ [[ 38 -gt 300 ]]
10072024-04-03T22:20:28.528Z+ sleep 1
10082024-04-03T22:20:29.510Z+ retry=39
10092024-04-03T22:20:29.535Z+ zoneadm list
10102024-04-03T22:20:29.535Z+ grep nexus
10112024-04-03T22:20:29.535Z+ [[ 39 -gt 300 ]]
10122024-04-03T22:20:29.535Z+ sleep 1
10132024-04-03T22:20:30.522Z+ retry=40
10142024-04-03T22:20:30.547Z+ zoneadm list
10152024-04-03T22:20:30.547Z+ grep nexus
10162024-04-03T22:20:30.547Z+ [[ 40 -gt 300 ]]
10172024-04-03T22:20:30.547Z+ sleep 1
10182024-04-03T22:20:31.533Z+ retry=41
10192024-04-03T22:20:31.558Z+ zoneadm list
10202024-04-03T22:20:31.558Z+ grep nexus
10212024-04-03T22:20:31.558Z+ [[ 41 -gt 300 ]]
10222024-04-03T22:20:31.558Z+ sleep 1
10232024-04-03T22:20:32.544Z+ retry=42
10242024-04-03T22:20:32.569Z+ zoneadm list
10252024-04-03T22:20:32.569Z+ grep nexus
10262024-04-03T22:20:32.569Z+ [[ 42 -gt 300 ]]
10272024-04-03T22:20:32.569Z+ sleep 1
10282024-04-03T22:20:33.556Z+ retry=43
10292024-04-03T22:20:33.581Z+ zoneadm list
10302024-04-03T22:20:33.581Z+ grep nexus
10312024-04-03T22:20:33.581Z+ [[ 43 -gt 300 ]]
10322024-04-03T22:20:33.581Z+ sleep 1
10332024-04-03T22:20:34.569Z+ retry=44
10342024-04-03T22:20:34.594Z+ zoneadm list
10352024-04-03T22:20:34.594Z+ grep nexus
10362024-04-03T22:20:34.594Z+ [[ 44 -gt 300 ]]
10372024-04-03T22:20:34.594Z+ sleep 1
10382024-04-03T22:20:35.584Z+ retry=45
10392024-04-03T22:20:35.609Z+ zoneadm list
10402024-04-03T22:20:35.610Z+ grep nexus
10412024-04-03T22:20:35.610Z+ [[ 45 -gt 300 ]]
10422024-04-03T22:20:35.610Z+ sleep 1
10432024-04-03T22:20:36.596Z+ retry=46
10442024-04-03T22:20:36.621Z+ zoneadm list
10452024-04-03T22:20:36.621Z+ grep nexus
10462024-04-03T22:20:36.621Z+ [[ 46 -gt 300 ]]
10472024-04-03T22:20:36.621Z+ sleep 1
10482024-04-03T22:20:37.608Z+ retry=47
10492024-04-03T22:20:37.633Z+ zoneadm list
10502024-04-03T22:20:37.633Z+ grep nexus
10512024-04-03T22:20:37.633Z+ [[ 47 -gt 300 ]]
10522024-04-03T22:20:37.633Z+ sleep 1
10532024-04-03T22:20:38.621Z+ retry=48
10542024-04-03T22:20:38.645Z+ zoneadm list
10552024-04-03T22:20:38.645Z+ grep nexus
10562024-04-03T22:20:38.646Z+ [[ 48 -gt 300 ]]
10572024-04-03T22:20:38.646Z+ sleep 1
10582024-04-03T22:20:39.638Z+ retry=49
10592024-04-03T22:20:39.663Z+ zoneadm list
10602024-04-03T22:20:39.663Z+ grep nexus
10612024-04-03T22:20:39.663Z+ [[ 49 -gt 300 ]]
10622024-04-03T22:20:39.664Z+ sleep 1
10632024-04-03T22:20:40.646Z+ retry=50
10642024-04-03T22:20:40.671Z+ zoneadm list
10652024-04-03T22:20:40.671Z+ grep nexus
10662024-04-03T22:20:40.671Z+ [[ 50 -gt 300 ]]
10672024-04-03T22:20:40.671Z+ sleep 1
10682024-04-03T22:20:41.659Z+ retry=51
10692024-04-03T22:20:41.684Z+ zoneadm list
10702024-04-03T22:20:41.684Z+ grep nexus
10712024-04-03T22:20:41.684Z+ [[ 51 -gt 300 ]]
10722024-04-03T22:20:41.684Z+ sleep 1
10732024-04-03T22:20:42.672Z+ retry=52
10742024-04-03T22:20:42.697Z+ zoneadm list
10752024-04-03T22:20:42.697Z+ grep nexus
10762024-04-03T22:20:42.697Z+ [[ 52 -gt 300 ]]
10772024-04-03T22:20:42.697Z+ sleep 1
10782024-04-03T22:20:43.684Z+ retry=53
10792024-04-03T22:20:43.710Z+ zoneadm list
10802024-04-03T22:20:43.710Z+ grep nexus
10812024-04-03T22:20:43.710Z+ [[ 53 -gt 300 ]]
10822024-04-03T22:20:43.710Z+ sleep 1
10832024-04-03T22:20:44.695Z+ retry=54
10842024-04-03T22:20:44.723Z+ zoneadm list
10852024-04-03T22:20:44.723Z+ grep nexus
10862024-04-03T22:20:44.723Z+ [[ 54 -gt 300 ]]
10872024-04-03T22:20:44.723Z+ sleep 1
10882024-04-03T22:20:45.709Z+ retry=55
10892024-04-03T22:20:45.734Z+ zoneadm list
10902024-04-03T22:20:45.734Z+ grep nexus
10912024-04-03T22:20:45.734Z+ [[ 55 -gt 300 ]]
10922024-04-03T22:20:45.734Z+ sleep 1
10932024-04-03T22:20:46.721Z+ retry=56
10942024-04-03T22:20:46.746Z+ zoneadm list
10952024-04-03T22:20:46.746Z+ grep nexus
10962024-04-03T22:20:46.746Z+ [[ 56 -gt 300 ]]
10972024-04-03T22:20:46.746Z+ sleep 1
10982024-04-03T22:20:47.733Z+ retry=57
10992024-04-03T22:20:47.758Z+ zoneadm list
11002024-04-03T22:20:47.758Z+ grep nexus
11012024-04-03T22:20:47.758Z+ [[ 57 -gt 300 ]]
11022024-04-03T22:20:47.758Z+ sleep 1
11032024-04-03T22:20:48.745Z+ retry=58
11042024-04-03T22:20:48.770Z+ zoneadm list
11052024-04-03T22:20:48.770Z+ grep nexus
11062024-04-03T22:20:48.770Z+ [[ 58 -gt 300 ]]
11072024-04-03T22:20:48.770Z+ sleep 1
11082024-04-03T22:20:49.759Z+ retry=59
11092024-04-03T22:20:49.784Z+ zoneadm list
11102024-04-03T22:20:49.784Z+ grep nexus
11112024-04-03T22:20:49.784Z+ [[ 59 -gt 300 ]]
11122024-04-03T22:20:49.784Z+ sleep 1
11132024-04-03T22:20:50.770Z+ retry=60
11142024-04-03T22:20:50.796Z+ zoneadm list
11152024-04-03T22:20:50.796Z+ grep nexus
11162024-04-03T22:20:50.796Z+ [[ 60 -gt 300 ]]
11172024-04-03T22:20:50.796Z+ sleep 1
11182024-04-03T22:20:51.782Z+ retry=61
11192024-04-03T22:20:51.807Z+ zoneadm list
11202024-04-03T22:20:51.807Z+ grep nexus
11212024-04-03T22:20:51.807Z+ [[ 61 -gt 300 ]]
11222024-04-03T22:20:51.807Z+ sleep 1
11232024-04-03T22:20:52.797Z+ retry=62
11242024-04-03T22:20:52.823Z+ zoneadm list
11252024-04-03T22:20:52.824Z+ grep nexus
11262024-04-03T22:20:52.824Z+ [[ 62 -gt 300 ]]
11272024-04-03T22:20:52.824Z+ sleep 1
11282024-04-03T22:20:53.806Z+ retry=63
11292024-04-03T22:20:53.831Z+ zoneadm list
11302024-04-03T22:20:53.831Z+ grep nexus
11312024-04-03T22:20:53.831Z+ [[ 63 -gt 300 ]]
11322024-04-03T22:20:53.831Z+ sleep 1
11332024-04-03T22:20:54.817Z+ retry=64
11342024-04-03T22:20:54.842Z+ zoneadm list
11352024-04-03T22:20:54.842Z+ grep nexus
11362024-04-03T22:20:54.842Z+ [[ 64 -gt 300 ]]
11372024-04-03T22:20:54.842Z+ sleep 1
11382024-04-03T22:20:55.829Z+ retry=65
11392024-04-03T22:20:55.854Z+ zoneadm list
11402024-04-03T22:20:55.854Z+ grep nexus
11412024-04-03T22:20:55.854Z+ [[ 65 -gt 300 ]]
11422024-04-03T22:20:55.854Z+ sleep 1
11432024-04-03T22:20:56.841Z+ retry=66
11442024-04-03T22:20:56.866Z+ zoneadm list
11452024-04-03T22:20:56.866Z+ grep nexus
11462024-04-03T22:20:56.866Z+ [[ 66 -gt 300 ]]
11472024-04-03T22:20:56.866Z+ sleep 1
11482024-04-03T22:20:57.854Z+ retry=67
11492024-04-03T22:20:57.878Z+ zoneadm list
11502024-04-03T22:20:57.879Z+ grep nexus
11512024-04-03T22:20:57.879Z+ [[ 67 -gt 300 ]]
11522024-04-03T22:20:57.879Z+ sleep 1
11532024-04-03T22:20:58.866Z+ retry=68
11542024-04-03T22:20:58.891Z+ zoneadm list
11552024-04-03T22:20:58.891Z+ grep nexus
11562024-04-03T22:20:58.891Z+ [[ 68 -gt 300 ]]
11572024-04-03T22:20:58.891Z+ sleep 1
11582024-04-03T22:20:59.879Z+ retry=69
11592024-04-03T22:20:59.907Z+ zoneadm list
11602024-04-03T22:20:59.907Z+ grep nexus
11612024-04-03T22:20:59.907Z+ [[ 69 -gt 300 ]]
11622024-04-03T22:20:59.907Z+ sleep 1
11632024-04-03T22:21:00.891Z+ retry=70
11642024-04-03T22:21:00.916Z+ zoneadm list
11652024-04-03T22:21:00.916Z+ grep nexus
11662024-04-03T22:21:00.916Z+ [[ 70 -gt 300 ]]
11672024-04-03T22:21:00.916Z+ sleep 1
11682024-04-03T22:21:01.906Z+ retry=71
11692024-04-03T22:21:01.932Z+ zoneadm list
11702024-04-03T22:21:01.932Z+ grep nexus
11712024-04-03T22:21:01.932Z+ [[ 71 -gt 300 ]]
11722024-04-03T22:21:01.932Z+ sleep 1
11732024-04-03T22:21:02.915Z+ retry=72
11742024-04-03T22:21:02.941Z+ zoneadm list
11752024-04-03T22:21:02.941Z+ grep nexus
11762024-04-03T22:21:02.941Z+ [[ 72 -gt 300 ]]
11772024-04-03T22:21:02.941Z+ sleep 1
11782024-04-03T22:21:03.927Z+ retry=73
11792024-04-03T22:21:03.953Z+ zoneadm list
11802024-04-03T22:21:03.953Z+ grep nexus
11812024-04-03T22:21:03.953Z+ [[ 73 -gt 300 ]]
11822024-04-03T22:21:03.953Z+ sleep 1
11832024-04-03T22:21:04.939Z+ retry=74
11842024-04-03T22:21:04.964Z+ zoneadm list
11852024-04-03T22:21:04.964Z+ grep nexus
11862024-04-03T22:21:04.964Z+ [[ 74 -gt 300 ]]
11872024-04-03T22:21:04.964Z+ sleep 1
11882024-04-03T22:21:05.951Z+ retry=75
11892024-04-03T22:21:05.979Z+ zoneadm list
11902024-04-03T22:21:05.979Z+ grep nexus
11912024-04-03T22:21:05.979Z+ [[ 75 -gt 300 ]]
11922024-04-03T22:21:05.979Z+ sleep 1
11932024-04-03T22:21:06.964Z+ retry=76
11942024-04-03T22:21:06.989Z+ zoneadm list
11952024-04-03T22:21:06.989Z+ grep nexus
11962024-04-03T22:21:06.989Z+ [[ 76 -gt 300 ]]
11972024-04-03T22:21:06.989Z+ sleep 1
11982024-04-03T22:21:07.976Z+ retry=77
11992024-04-03T22:21:08.002Z+ zoneadm list
12002024-04-03T22:21:08.002Z+ grep nexus
12012024-04-03T22:21:08.002Z+ [[ 77 -gt 300 ]]
12022024-04-03T22:21:08.002Z+ sleep 1
12032024-04-03T22:21:08.993Z+ retry=78
12042024-04-03T22:21:09.019Z+ zoneadm list
12052024-04-03T22:21:09.019Z+ grep nexus
12062024-04-03T22:21:09.019Z+ [[ 78 -gt 300 ]]
12072024-04-03T22:21:09.019Z+ sleep 1
12082024-04-03T22:21:10.001Z+ retry=79
12092024-04-03T22:21:10.027Z+ zoneadm list
12102024-04-03T22:21:10.027Z+ grep nexus
12112024-04-03T22:21:10.027Z+ [[ 79 -gt 300 ]]
12122024-04-03T22:21:10.027Z+ sleep 1
12132024-04-03T22:21:11.012Z+ retry=80
12142024-04-03T22:21:11.037Z+ zoneadm list
12152024-04-03T22:21:11.037Z+ grep nexus
12162024-04-03T22:21:11.037Z+ [[ 80 -gt 300 ]]
12172024-04-03T22:21:11.037Z+ sleep 1
12182024-04-03T22:21:12.023Z+ retry=81
12192024-04-03T22:21:12.048Z+ zoneadm list
12202024-04-03T22:21:12.048Z+ grep nexus
12212024-04-03T22:21:12.048Z+ [[ 81 -gt 300 ]]
12222024-04-03T22:21:12.048Z+ sleep 1
12232024-04-03T22:21:13.035Z+ retry=82
12242024-04-03T22:21:13.063Z+ zoneadm list
12252024-04-03T22:21:13.063Z+ grep nexus
12262024-04-03T22:21:13.063Z+ [[ 82 -gt 300 ]]
12272024-04-03T22:21:13.063Z+ sleep 1
12282024-04-03T22:21:14.051Z+ retry=83
12292024-04-03T22:21:14.075Z+ zoneadm list
12302024-04-03T22:21:14.075Z+ grep nexus
12312024-04-03T22:21:14.075Z+ [[ 83 -gt 300 ]]
12322024-04-03T22:21:14.076Z+ sleep 1
12332024-04-03T22:21:15.060Z+ retry=84
12342024-04-03T22:21:15.085Z+ zoneadm list
12352024-04-03T22:21:15.085Z+ grep nexus
12362024-04-03T22:21:15.085Z+ [[ 84 -gt 300 ]]
12372024-04-03T22:21:15.085Z+ sleep 1
12382024-04-03T22:21:16.072Z+ retry=85
12392024-04-03T22:21:16.097Z+ zoneadm list
12402024-04-03T22:21:16.097Z+ grep nexus
12412024-04-03T22:21:16.097Z+ [[ 85 -gt 300 ]]
12422024-04-03T22:21:16.097Z+ sleep 1
12432024-04-03T22:21:17.084Z+ retry=86
12442024-04-03T22:21:17.108Z+ zoneadm list
12452024-04-03T22:21:17.109Z+ grep nexus
12462024-04-03T22:21:17.109Z+ [[ 86 -gt 300 ]]
12472024-04-03T22:21:17.109Z+ sleep 1
12482024-04-03T22:21:18.095Z+ retry=87
12492024-04-03T22:21:18.120Z+ zoneadm list
12502024-04-03T22:21:18.120Z+ grep nexus
12512024-04-03T22:21:18.120Z+ [[ 87 -gt 300 ]]
12522024-04-03T22:21:18.120Z+ sleep 1
12532024-04-03T22:21:19.107Z+ retry=88
12542024-04-03T22:21:19.132Z+ zoneadm list
12552024-04-03T22:21:19.132Z+ grep nexus
12562024-04-03T22:21:19.132Z+ [[ 88 -gt 300 ]]
12572024-04-03T22:21:19.132Z+ sleep 1
12582024-04-03T22:21:20.118Z+ retry=89
12592024-04-03T22:21:20.143Z+ zoneadm list
12602024-04-03T22:21:20.143Z+ grep nexus
12612024-04-03T22:21:20.143Z+ [[ 89 -gt 300 ]]
12622024-04-03T22:21:20.143Z+ sleep 1
12632024-04-03T22:21:21.130Z+ retry=90
12642024-04-03T22:21:21.156Z+ zoneadm list
12652024-04-03T22:21:21.156Z+ grep nexus
12662024-04-03T22:21:21.156Z+ [[ 90 -gt 300 ]]
12672024-04-03T22:21:21.156Z+ sleep 1
12682024-04-03T22:21:22.142Z+ retry=91
12692024-04-03T22:21:22.167Z+ zoneadm list
12702024-04-03T22:21:22.167Z+ grep nexus
12712024-04-03T22:21:22.167Z+ [[ 91 -gt 300 ]]
12722024-04-03T22:21:22.167Z+ sleep 1
12732024-04-03T22:21:23.154Z+ retry=92
12742024-04-03T22:21:23.179Z+ zoneadm list
12752024-04-03T22:21:23.179Z+ grep nexus
12762024-04-03T22:21:23.179Z+ [[ 92 -gt 300 ]]
12772024-04-03T22:21:23.179Z+ sleep 1
12782024-04-03T22:21:24.166Z+ retry=93
12792024-04-03T22:21:24.190Z+ zoneadm list
12802024-04-03T22:21:24.190Z+ grep nexus
12812024-04-03T22:21:24.191Z+ [[ 93 -gt 300 ]]
12822024-04-03T22:21:24.191Z+ sleep 1
12832024-04-03T22:21:25.178Z+ retry=94
12842024-04-03T22:21:25.203Z+ zoneadm list
12852024-04-03T22:21:25.203Z+ grep nexus
12862024-04-03T22:21:25.203Z+ [[ 94 -gt 300 ]]
12872024-04-03T22:21:25.203Z+ sleep 1
12882024-04-03T22:21:26.190Z+ retry=95
12892024-04-03T22:21:26.215Z+ zoneadm list
12902024-04-03T22:21:26.215Z+ grep nexus
12912024-04-03T22:21:26.215Z+ [[ 95 -gt 300 ]]
12922024-04-03T22:21:26.215Z+ sleep 1
12932024-04-03T22:21:27.202Z+ retry=96
12942024-04-03T22:21:27.226Z+ zoneadm list
12952024-04-03T22:21:27.226Z+ grep nexus
12962024-04-03T22:21:27.227Z+ [[ 96 -gt 300 ]]
12972024-04-03T22:21:27.227Z+ sleep 1
12982024-04-03T22:21:28.214Z+ retry=97
12992024-04-03T22:21:28.239Z+ zoneadm list
13002024-04-03T22:21:28.239Z+ grep nexus
13012024-04-03T22:21:28.239Z+ [[ 97 -gt 300 ]]
13022024-04-03T22:21:28.239Z+ sleep 1
13032024-04-03T22:21:29.226Z+ retry=98
13042024-04-03T22:21:29.251Z+ zoneadm list
13052024-04-03T22:21:29.251Z+ grep nexus
13062024-04-03T22:21:29.251Z+ [[ 98 -gt 300 ]]
13072024-04-03T22:21:29.251Z+ sleep 1
13082024-04-03T22:21:30.237Z+ retry=99
13092024-04-03T22:21:30.267Z+ zoneadm list
13102024-04-03T22:21:30.267Z+ grep nexus
13112024-04-03T22:21:30.267Z+ [[ 99 -gt 300 ]]
13122024-04-03T22:21:30.267Z+ sleep 1
13132024-04-03T22:21:31.250Z+ retry=100
13142024-04-03T22:21:31.274Z+ zoneadm list
13152024-04-03T22:21:31.274Z+ grep nexus
13162024-04-03T22:21:31.274Z+ [[ 100 -gt 300 ]]
13172024-04-03T22:21:31.274Z+ sleep 1
13182024-04-03T22:21:32.262Z+ retry=101
13192024-04-03T22:21:32.289Z+ zoneadm list
13202024-04-03T22:21:32.289Z+ grep nexus
13212024-04-03T22:21:32.289Z+ [[ 101 -gt 300 ]]
13222024-04-03T22:21:32.289Z+ sleep 1
13232024-04-03T22:21:33.275Z+ retry=102
13242024-04-03T22:21:33.300Z+ zoneadm list
13252024-04-03T22:21:33.300Z+ grep nexus
13262024-04-03T22:21:33.300Z+ [[ 102 -gt 300 ]]
13272024-04-03T22:21:33.300Z+ sleep 1
13282024-04-03T22:21:34.287Z+ retry=103
13292024-04-03T22:21:34.312Z+ zoneadm list
13302024-04-03T22:21:34.312Z+ grep nexus
13312024-04-03T22:21:34.312Z+ [[ 103 -gt 300 ]]
13322024-04-03T22:21:34.312Z+ sleep 1
13332024-04-03T22:21:35.299Z+ retry=104
13342024-04-03T22:21:35.324Z+ zoneadm list
13352024-04-03T22:21:35.324Z+ grep nexus
13362024-04-03T22:21:35.324Z+ [[ 104 -gt 300 ]]
13372024-04-03T22:21:35.324Z+ sleep 1
13382024-04-03T22:21:36.313Z+ retry=105
13392024-04-03T22:21:36.338Z+ zoneadm list
13402024-04-03T22:21:36.338Z+ grep nexus
13412024-04-03T22:21:36.338Z+ [[ 105 -gt 300 ]]
13422024-04-03T22:21:36.338Z+ sleep 1
13432024-04-03T22:21:37.327Z+ retry=106
13442024-04-03T22:21:37.352Z+ zoneadm list
13452024-04-03T22:21:37.352Z+ grep nexus
13462024-04-03T22:21:37.352Z+ [[ 106 -gt 300 ]]
13472024-04-03T22:21:37.352Z+ sleep 1
13482024-04-03T22:21:38.348Z+ retry=107
13492024-04-03T22:21:38.348Z+ zoneadm list
13502024-04-03T22:21:38.348Z+ grep nexus
13512024-04-03T22:21:38.372Z+ [[ 107 -gt 300 ]]
13522024-04-03T22:21:38.373Z+ sleep 1
13532024-04-03T22:21:39.353Z+ retry=108
13542024-04-03T22:21:39.377Z+ zoneadm list
13552024-04-03T22:21:39.377Z+ grep nexus
13562024-04-03T22:21:39.378Z+ [[ 108 -gt 300 ]]
13572024-04-03T22:21:39.378Z+ sleep 1
13582024-04-03T22:21:40.365Z+ retry=109
13592024-04-03T22:21:40.390Z+ zoneadm list
13602024-04-03T22:21:40.390Z+ grep nexus
13612024-04-03T22:21:40.390Z+ [[ 109 -gt 300 ]]
13622024-04-03T22:21:40.390Z+ sleep 1
13632024-04-03T22:21:41.378Z+ retry=110
13642024-04-03T22:21:41.404Z+ zoneadm list
13652024-04-03T22:21:41.404Z+ grep nexus
13662024-04-03T22:21:41.404Z+ [[ 110 -gt 300 ]]
13672024-04-03T22:21:41.404Z+ sleep 1
13682024-04-03T22:21:42.385Z+ retry=111
13692024-04-03T22:21:42.410Z+ zoneadm list
13702024-04-03T22:21:42.410Z+ grep nexus
13712024-04-03T22:21:42.410Z+ [[ 111 -gt 300 ]]
13722024-04-03T22:21:42.410Z+ sleep 1
13732024-04-03T22:21:43.397Z+ retry=112
13742024-04-03T22:21:43.422Z+ zoneadm list
13752024-04-03T22:21:43.422Z+ grep nexus
13762024-04-03T22:21:43.422Z+ [[ 112 -gt 300 ]]
13772024-04-03T22:21:43.422Z+ sleep 1
13782024-04-03T22:21:44.408Z+ retry=113
13792024-04-03T22:21:44.439Z+ zoneadm list
13802024-04-03T22:21:44.439Z+ grep nexus
13812024-04-03T22:21:44.439Z+ [[ 113 -gt 300 ]]
13822024-04-03T22:21:44.439Z+ sleep 1
13832024-04-03T22:21:45.420Z+ retry=114
13842024-04-03T22:21:45.445Z+ zoneadm list
13852024-04-03T22:21:45.445Z+ grep nexus
13862024-04-03T22:21:45.445Z+ [[ 114 -gt 300 ]]
13872024-04-03T22:21:45.445Z+ sleep 1
13882024-04-03T22:21:46.432Z+ retry=115
13892024-04-03T22:21:46.457Z+ zoneadm list
13902024-04-03T22:21:46.458Z+ grep nexus
13912024-04-03T22:21:46.458Z+ [[ 115 -gt 300 ]]
13922024-04-03T22:21:46.458Z+ sleep 1
13932024-04-03T22:21:47.443Z+ retry=116
13942024-04-03T22:21:47.468Z+ zoneadm list
13952024-04-03T22:21:47.468Z+ grep nexus
13962024-04-03T22:21:47.468Z+ [[ 116 -gt 300 ]]
13972024-04-03T22:21:47.468Z+ sleep 1
13982024-04-03T22:21:48.455Z+ retry=117
13992024-04-03T22:21:48.480Z+ zoneadm list
14002024-04-03T22:21:48.480Z+ grep nexus
14012024-04-03T22:21:48.481Z+ [[ 117 -gt 300 ]]
14022024-04-03T22:21:48.481Z+ sleep 1
14032024-04-03T22:21:49.467Z+ retry=118
14042024-04-03T22:21:49.492Z+ zoneadm list
14052024-04-03T22:21:49.492Z+ grep nexus
14062024-04-03T22:21:49.492Z+ [[ 118 -gt 300 ]]
14072024-04-03T22:21:49.492Z+ sleep 1
14082024-04-03T22:21:50.480Z+ retry=119
14092024-04-03T22:21:50.505Z+ zoneadm list
14102024-04-03T22:21:50.505Z+ grep nexus
14112024-04-03T22:21:50.505Z+ [[ 119 -gt 300 ]]
14122024-04-03T22:21:50.505Z+ sleep 1
14132024-04-03T22:21:51.491Z+ retry=120
14142024-04-03T22:21:51.516Z+ zoneadm list
14152024-04-03T22:21:51.516Z+ grep nexus
14162024-04-03T22:21:51.516Z+ [[ 120 -gt 300 ]]
14172024-04-03T22:21:51.516Z+ sleep 1
14182024-04-03T22:21:52.502Z+ retry=121
14192024-04-03T22:21:52.527Z+ zoneadm list
14202024-04-03T22:21:52.527Z+ grep nexus
14212024-04-03T22:21:52.527Z+ [[ 121 -gt 300 ]]
14222024-04-03T22:21:52.527Z+ sleep 1
14232024-04-03T22:21:53.514Z+ retry=122
14242024-04-03T22:21:53.551Z+ zoneadm list
14252024-04-03T22:21:53.551Z+ grep nexus
14262024-04-03T22:21:53.551Z+ [[ 122 -gt 300 ]]
14272024-04-03T22:21:53.551Z+ sleep 1
14282024-04-03T22:21:54.525Z+ retry=123
14292024-04-03T22:21:54.552Z+ zoneadm list
14302024-04-03T22:21:54.552Z+ grep nexus
14312024-04-03T22:21:54.552Z+ [[ 123 -gt 300 ]]
14322024-04-03T22:21:54.552Z+ sleep 1
14332024-04-03T22:21:55.545Z+ retry=124
14342024-04-03T22:21:55.570Z+ zoneadm list
14352024-04-03T22:21:55.570Z+ grep nexus
14362024-04-03T22:21:55.570Z+ [[ 124 -gt 300 ]]
14372024-04-03T22:21:55.570Z+ sleep 1
14382024-04-03T22:21:56.597Z+ retry=125
14392024-04-03T22:21:56.621Z+ zoneadm list
14402024-04-03T22:21:56.622Z+ grep nexus
14412024-04-03T22:21:56.622Z+ [[ 125 -gt 300 ]]
14422024-04-03T22:21:56.622Z+ sleep 1
14432024-04-03T22:21:57.600Z+ retry=126
14442024-04-03T22:21:57.625Z+ zoneadm list
14452024-04-03T22:21:57.625Z+ grep nexus
14462024-04-03T22:21:57.651Z+ [[ 126 -gt 300 ]]
14472024-04-03T22:21:57.651Z+ sleep 1
14482024-04-03T22:22:04.915Z+ retry=127
14492024-04-03T22:22:04.916Z+ zoneadm list
14502024-04-03T22:22:04.916Z+ grep nexus
14512024-04-03T22:22:04.916Z+ [[ 127 -gt 300 ]]
14522024-04-03T22:22:04.916Z+ sleep 1
14532024-04-03T22:22:04.916Z+ retry=128
14542024-04-03T22:22:04.916Z+ zoneadm list
14552024-04-03T22:22:04.916Z+ grep nexus
14562024-04-03T22:22:04.916Z+ [[ 128 -gt 300 ]]
14572024-04-03T22:22:04.916Z+ sleep 1
14582024-04-03T22:22:05.021Z+ retry=129
14592024-04-03T22:22:05.058Z+ zoneadm list
14602024-04-03T22:22:05.058Z+ grep nexus
14612024-04-03T22:22:05.058Z+ [[ 129 -gt 300 ]]
14622024-04-03T22:22:05.058Z+ sleep 1
14632024-04-03T22:22:06.036Z+ retry=130
14642024-04-03T22:22:06.061Z+ zoneadm list
14652024-04-03T22:22:06.061Z+ grep nexus
14662024-04-03T22:22:06.061Z+ [[ 130 -gt 300 ]]
14672024-04-03T22:22:06.061Z+ sleep 1
14682024-04-03T22:22:07.054Z+ retry=131
14692024-04-03T22:22:07.079Z+ zoneadm list
14702024-04-03T22:22:07.080Z+ grep nexus
14712024-04-03T22:22:07.080Z+ [[ 131 -gt 300 ]]
14722024-04-03T22:22:07.080Z+ sleep 1
14732024-04-03T22:22:08.068Z+ retry=132
14742024-04-03T22:22:08.093Z+ zoneadm list
14752024-04-03T22:22:08.093Z+ grep nexus
14762024-04-03T22:22:08.093Z+ [[ 132 -gt 300 ]]
14772024-04-03T22:22:08.093Z+ sleep 1
14782024-04-03T22:22:09.079Z+ retry=133
14792024-04-03T22:22:09.104Z+ zoneadm list
14802024-04-03T22:22:09.104Z+ grep nexus
14812024-04-03T22:22:09.104Zoxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4
14822024-04-03T22:22:09.104Zoxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2
14832024-04-03T22:22:09.105Z+ echo 'Waited for nexus: 133s'
14842024-04-03T22:22:09.105ZWaited for nexus: 133s
14852024-04-03T22:22:09.105Z+ export RUST_BACKTRACE=1
14862024-04-03T22:22:09.105Z+ RUST_BACKTRACE=1
14872024-04-03T22:22:09.105Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
14882024-04-03T22:22:09.105Z++ ./tests/bootstrap
14892024-04-03T22:22:11.054ZUsing external DNS server at 10.151.1.164:53
14902024-04-03T22:22:11.080Z2024-04-03 22:22:11.054082149 UTC: attempting to log into API
14912024-04-03T22:22:26.204Z2024-04-03 22:22:26.190314110 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
14922024-04-03T22:22:27.204Z2024-04-03 22:22:27.191846797 UTC: attempting to log into API
 
14932024-04-03T22:22:33.510ZApr 3 22:22:32 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
14942024-04-03T22:22:34.073ZApr 3 22:22:33 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
14952024-04-03T22:22:34.664ZApr 3 22:22:34 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
14962024-04-03T22:22:35.237ZApr 3 22:22:34 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
14972024-04-03T22:22:36.639ZApr 3 22:22:36 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
14982024-04-03T22:22:42.254Z2024-04-03 22:22:42.241850690 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
14992024-04-03T22:22:43.256Z2024-04-03 22:22:43.243969960 UTC: attempting to log into API
15002024-04-03T22:22:58.288Z2024-04-03 22:22:58.276685716 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
15012024-04-03T22:22:59.290Z2024-04-03 22:22:59.277858700 UTC: attempting to log into API
15022024-04-03T22:23:00.072Z2024-04-03 22:23:00.060736749 UTC: login succeeded
15032024-04-03T22:23:00.106Zwaiting for nexus to come up...
15042024-04-03T22:23:00.168Zcreating IP pool... 10.151.1.175 - 10.151.1.227
15052024-04-03T22:23:00.357Zsetting up quotas...
15062024-04-03T22:23:00.398Zensuring datasets are ready...
15072024-04-03T22:23:02.696Zlet's roll.
15082024-04-03T22:23:02.722Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
15092024-04-03T22:23:02.722ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
15102024-04-03T22:23:02.722ZOXIDE_TOKEN=oxide-token-709b043265ec4bf78b320910e63a6fc7614bdb3b'
15112024-04-03T22:23:02.722Z++ OXIDE_HOST=https://recovery.sys.oxide.test
15122024-04-03T22:23:02.722Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
15132024-04-03T22:23:02.722Z++ OXIDE_TOKEN=oxide-token-709b043265ec4bf78b320910e63a6fc7614bdb3b
15142024-04-03T22:23:02.723Z+ export OXIDE_HOST OXIDE_TOKEN
15152024-04-03T22:23:02.723Z+ retry=0
15162024-04-03T22:23:02.723Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15172024-04-03T22:23:02.723Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15182024-04-03T22:23:02.723Z+ [[ 0 -gt 60 ]]
15192024-04-03T22:23:02.723Z+ sleep 1
15202024-04-03T22:23:03.724Z+ retry=1
15212024-04-03T22:23:03.724Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15222024-04-03T22:23:03.750Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15232024-04-03T22:23:03.751Z+ [[ 1 -gt 60 ]]
15242024-04-03T22:23:03.751Z+ sleep 1
15252024-04-03T22:23:04.739Z+ retry=2
15262024-04-03T22:23:04.739Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15272024-04-03T22:23:04.764Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15282024-04-03T22:23:04.764Z+ [[ 2 -gt 60 ]]
15292024-04-03T22:23:04.764Z+ sleep 1
15302024-04-03T22:23:05.755Z+ retry=3
15312024-04-03T22:23:05.755Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15322024-04-03T22:23:05.780Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15332024-04-03T22:23:05.780Z+ [[ 3 -gt 60 ]]
15342024-04-03T22:23:05.780Z+ sleep 1
15352024-04-03T22:23:06.770Z+ retry=4
15362024-04-03T22:23:06.770Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15372024-04-03T22:23:06.795Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15382024-04-03T22:23:06.795Z+ [[ 4 -gt 60 ]]
15392024-04-03T22:23:06.795Z+ sleep 1
15402024-04-03T22:23:07.785Z+ retry=5
15412024-04-03T22:23:07.785Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15422024-04-03T22:23:07.810Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15432024-04-03T22:23:07.810Z+ [[ 5 -gt 60 ]]
15442024-04-03T22:23:07.810Z+ sleep 1
15452024-04-03T22:23:08.800Z+ retry=6
15462024-04-03T22:23:08.800Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15472024-04-03T22:23:08.825Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15482024-04-03T22:23:08.825Z+ [[ 6 -gt 60 ]]
15492024-04-03T22:23:08.825Z+ sleep 1
15502024-04-03T22:23:09.817Z+ retry=7
15512024-04-03T22:23:09.817Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15522024-04-03T22:23:09.841Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15532024-04-03T22:23:09.841Z+ [[ 7 -gt 60 ]]
15542024-04-03T22:23:09.842Z+ sleep 1
15552024-04-03T22:23:10.832Z+ retry=8
15562024-04-03T22:23:10.832Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15572024-04-03T22:23:10.857Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15582024-04-03T22:23:10.857Z+ [[ 8 -gt 60 ]]
15592024-04-03T22:23:10.858Z+ sleep 1
15602024-04-03T22:23:11.849Z+ retry=9
15612024-04-03T22:23:11.850Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15622024-04-03T22:23:11.874Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15632024-04-03T22:23:11.875Z+ [[ 9 -gt 60 ]]
15642024-04-03T22:23:11.875Z+ sleep 1
15652024-04-03T22:23:12.867Z+ retry=10
15662024-04-03T22:23:12.867Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15672024-04-03T22:23:12.892Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15682024-04-03T22:23:12.892Z+ [[ 10 -gt 60 ]]
15692024-04-03T22:23:12.892Z+ sleep 1
15702024-04-03T22:23:13.882Z+ retry=11
15712024-04-03T22:23:13.882Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15722024-04-03T22:23:13.908Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15732024-04-03T22:23:13.908Z+ [[ 11 -gt 60 ]]
15742024-04-03T22:23:13.908Z+ sleep 1
15752024-04-03T22:23:14.897Z+ retry=12
15762024-04-03T22:23:14.897Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15772024-04-03T22:23:14.922Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15782024-04-03T22:23:14.922Z+ [[ 12 -gt 60 ]]
15792024-04-03T22:23:14.922Z+ sleep 1
15802024-04-03T22:23:15.913Z+ retry=13
15812024-04-03T22:23:15.914Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15822024-04-03T22:23:15.939Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15832024-04-03T22:23:15.939Z+ [[ 13 -gt 60 ]]
15842024-04-03T22:23:15.939Z+ sleep 1
15852024-04-03T22:23:16.928Z+ retry=14
15862024-04-03T22:23:16.928Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15872024-04-03T22:23:16.953Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15882024-04-03T22:23:16.953Z+ [[ 14 -gt 60 ]]
15892024-04-03T22:23:16.953Z+ sleep 1
15902024-04-03T22:23:17.944Z+ retry=15
15912024-04-03T22:23:17.944Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15922024-04-03T22:23:17.978Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15932024-04-03T22:23:17.978Z+ [[ 15 -gt 60 ]]
15942024-04-03T22:23:17.978Z+ sleep 1
15952024-04-03T22:23:18.960Z+ retry=16
15962024-04-03T22:23:18.960Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15972024-04-03T22:23:18.985Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15982024-04-03T22:23:18.985Z+ [[ 16 -gt 60 ]]
15992024-04-03T22:23:18.985Z+ sleep 1
16002024-04-03T22:23:19.975Z+ retry=17
16012024-04-03T22:23:19.975Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16022024-04-03T22:23:20.000Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16032024-04-03T22:23:20.000Z+ [[ 17 -gt 60 ]]
16042024-04-03T22:23:20.000Z+ sleep 1
16052024-04-03T22:23:20.994Z+ retry=18
16062024-04-03T22:23:20.994Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16072024-04-03T22:23:21.018Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16082024-04-03T22:23:21.018Z+ [[ 18 -gt 60 ]]
16092024-04-03T22:23:21.018Z+ sleep 1
16102024-04-03T22:23:22.022Z+ retry=19
16112024-04-03T22:23:22.022Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16122024-04-03T22:23:22.048Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16132024-04-03T22:23:22.048Z+ [[ 19 -gt 60 ]]
16142024-04-03T22:23:22.048Z+ sleep 1
16152024-04-03T22:23:23.022Z+ retry=20
16162024-04-03T22:23:23.022Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16172024-04-03T22:23:23.047Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16182024-04-03T22:23:23.047Z+ [[ 20 -gt 60 ]]
16192024-04-03T22:23:23.047Z+ sleep 1
16202024-04-03T22:23:24.039Z+ retry=21
16212024-04-03T22:23:24.039Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16222024-04-03T22:23:24.064Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16232024-04-03T22:23:24.064Z+ [[ 21 -gt 60 ]]
16242024-04-03T22:23:24.064Z+ sleep 1
16252024-04-03T22:23:25.055Z+ retry=22
16262024-04-03T22:23:25.055Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16272024-04-03T22:23:25.080Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16282024-04-03T22:23:25.080Z+ [[ 22 -gt 60 ]]
16292024-04-03T22:23:25.080Z+ sleep 1
16302024-04-03T22:23:26.071Z+ retry=23
16312024-04-03T22:23:26.071Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16322024-04-03T22:23:26.096Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16332024-04-03T22:23:26.096Z+ [[ 23 -gt 60 ]]
16342024-04-03T22:23:26.096Z+ sleep 1
16352024-04-03T22:23:27.086Z+ retry=24
16362024-04-03T22:23:27.086Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16372024-04-03T22:23:27.111Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16382024-04-03T22:23:27.111Z+ [[ 24 -gt 60 ]]
16392024-04-03T22:23:27.111Z+ sleep 1
16402024-04-03T22:23:28.102Z+ retry=25
16412024-04-03T22:23:28.102Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16422024-04-03T22:23:28.127Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16432024-04-03T22:23:28.127Z+ [[ 25 -gt 60 ]]
16442024-04-03T22:23:28.127Z+ sleep 1
16452024-04-03T22:23:29.118Z+ retry=26
16462024-04-03T22:23:29.118Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16472024-04-03T22:23:29.143Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16482024-04-03T22:23:29.143Z+ [[ 26 -gt 60 ]]
16492024-04-03T22:23:29.143Z+ sleep 1
16502024-04-03T22:23:30.132Z+ retry=27
16512024-04-03T22:23:30.132Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16522024-04-03T22:23:30.157Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16532024-04-03T22:23:30.157Z+ [[ 27 -gt 60 ]]
16542024-04-03T22:23:30.157Z+ sleep 1
16552024-04-03T22:23:31.147Z+ retry=28
16562024-04-03T22:23:31.147Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16572024-04-03T22:23:31.172Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16582024-04-03T22:23:31.172Z+ [[ 28 -gt 60 ]]
16592024-04-03T22:23:31.172Z+ sleep 1
16602024-04-03T22:23:32.163Z+ retry=29
16612024-04-03T22:23:32.163Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16622024-04-03T22:23:32.188Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16632024-04-03T22:23:32.188Z+ [[ 29 -gt 60 ]]
16642024-04-03T22:23:32.188Z+ sleep 1
16652024-04-03T22:23:33.179Z+ retry=30
16662024-04-03T22:23:33.179Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16672024-04-03T22:23:33.203Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16682024-04-03T22:23:33.204Z+ [[ 30 -gt 60 ]]
16692024-04-03T22:23:33.204Z+ sleep 1
16702024-04-03T22:23:34.195Z+ retry=31
16712024-04-03T22:23:34.195Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16722024-04-03T22:23:34.220Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16732024-04-03T22:23:34.220Z+ [[ 31 -gt 60 ]]
16742024-04-03T22:23:34.220Z+ sleep 1
16752024-04-03T22:23:35.212Z+ retry=32
16762024-04-03T22:23:35.212Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16772024-04-03T22:23:35.237Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16782024-04-03T22:23:35.237Z+ [[ 32 -gt 60 ]]
16792024-04-03T22:23:35.237Z+ sleep 1
16802024-04-03T22:23:36.228Z+ retry=33
16812024-04-03T22:23:36.228Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16822024-04-03T22:23:36.253Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16832024-04-03T22:23:36.253Z+ [[ 33 -gt 60 ]]
16842024-04-03T22:23:36.253Z+ sleep 1
16852024-04-03T22:23:37.244Z+ retry=34
16862024-04-03T22:23:37.244Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16872024-04-03T22:23:37.269Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16882024-04-03T22:23:37.269Z+ [[ 34 -gt 60 ]]
16892024-04-03T22:23:37.269Z+ sleep 1
16902024-04-03T22:23:38.262Z+ retry=35
16912024-04-03T22:23:38.262Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16922024-04-03T22:23:38.287Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16932024-04-03T22:23:38.287Z+ [[ 35 -gt 60 ]]
16942024-04-03T22:23:38.287Z+ sleep 1
16952024-04-03T22:23:39.277Z+ retry=36
16962024-04-03T22:23:39.277Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16972024-04-03T22:23:39.302Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16982024-04-03T22:23:39.302Z+ [[ 36 -gt 60 ]]
16992024-04-03T22:23:39.302Z+ sleep 1
17002024-04-03T22:23:40.292Z+ retry=37
17012024-04-03T22:23:40.292Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
17022024-04-03T22:23:40.318Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
17032024-04-03T22:23:40.318Z+ [[ 37 -gt 60 ]]
17042024-04-03T22:23:40.318Z+ sleep 1
17052024-04-03T22:23:41.308Z+ retry=38
17062024-04-03T22:23:41.308Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
17072024-04-03T22:23:41.390Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
17082024-04-03T22:23:41.702Z{"status":"ok"}success
17092024-04-03T22:23:41.702ZProject {
17102024-04-03T22:23:41.702Z description: "some images",
17112024-04-03T22:23:41.702Z id: 85ad6bab-fe09-424e-a258-11dfce56c66c,
17122024-04-03T22:23:41.702Z name: Name(
17132024-04-03T22:23:41.702Z "images",
17142024-04-03T22:23:41.702Z ),
17152024-04-03T22:23:41.732Z time_created: 2024-04-03T22:23:41.459248Z,
17162024-04-03T22:23:41.733Z time_modified: 2024-04-03T22:23:41.459248Z,
17172024-04-03T22:23:41.733Z}
17182024-04-03T22:23:41.733Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
17192024-04-03T22:29:09.329Zdone!
17202024-04-03T22:29:09.431Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
17212024-04-03T22:29:09.539Zsuccess
17222024-04-03T22:29:09.539ZImage {
17232024-04-03T22:29:09.539Z block_size: ByteCount(
17242024-04-03T22:29:09.539Z 512,
17252024-04-03T22:29:09.539Z ),
17262024-04-03T22:29:09.539Z description: "debian 11 original base image",
17272024-04-03T22:29:09.539Z digest: None,
17282024-04-03T22:29:09.539Z id: fd863805-b3eb-4d16-a3f0-7e0985e657ad,
17292024-04-03T22:29:09.539Z name: Name(
17302024-04-03T22:29:09.539Z "debian11",
17312024-04-03T22:29:09.539Z ),
17322024-04-03T22:29:09.539Z os: "debian",
17332024-04-03T22:29:09.564Z project_id: None,
17342024-04-03T22:29:09.564Z size: ByteCount(
17352024-04-03T22:29:09.564Z 2147483648,
17362024-04-03T22:29:09.564Z ),
17372024-04-03T22:29:09.564Z time_created: 2024-04-03T22:29:09.296573Z,
17382024-04-03T22:29:09.564Z time_modified: 2024-04-03T22:29:09.517707Z,
17392024-04-03T22:29:09.564Z url: None,
17402024-04-03T22:29:09.564Z version: "11",
17412024-04-03T22:29:09.564Z}
17422024-04-03T22:29:09.564Z+ rm ./tests/bootstrap
17432024-04-03T22:29:09.603Z+ for test_bin in tests/*
17442024-04-03T22:29:09.603Z+ ./tests/bootstrap-f0e27235b98aff2d
17452024-04-03T22:29:09.675Z
17462024-04-03T22:29:09.675Zrunning 0 tests
17472024-04-03T22:29:09.700Z
17482024-04-03T22:29:09.700Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
17492024-04-03T22:29:09.700Z
17502024-04-03T22:29:09.700Z+ for test_bin in tests/*
17512024-04-03T22:29:09.700Z+ ./tests/commtest-e9ed9b7b4e031b62
17522024-04-03T22:29:09.725Z
17532024-04-03T22:29:09.725Zrunning 0 tests
17542024-04-03T22:29:09.725Z
17552024-04-03T22:29:09.725Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
17562024-04-03T22:29:09.725Z
17572024-04-03T22:29:09.725Z+ for test_bin in tests/*
17582024-04-03T22:29:09.725Z+ ./tests/dhcp_server-7b097543f8b345b9
17592024-04-03T22:29:09.759Z
17602024-04-03T22:29:09.759Zrunning 0 tests
17612024-04-03T22:29:09.759Z
17622024-04-03T22:29:09.783Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
17632024-04-03T22:29:09.783Z
17642024-04-03T22:29:09.783Z+ for test_bin in tests/*
17652024-04-03T22:29:09.784Z+ ./tests/end_to_end_tests-36d1e5a3b387542b
17662024-04-03T22:29:09.931Z
17672024-04-03T22:29:09.931Zrunning 2 tests
17682024-04-03T22:29:10.173Ztest no_spoof::no_spoof_here ... ok
17692024-04-03T22:29:36.769Ztest instance_launch::instance_launch ... ok
17702024-04-03T22:29:36.769Z
17712024-04-03T22:29:36.769Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 26.84s
17722024-04-03T22:29:36.769Z
17732024-04-03T22:29:36.797Z+ _exit_trap
17742024-04-03T22:29:36.797Z+ local status=0
17752024-04-03T22:29:36.797Z+ [[ 0 -eq 0 ]]
17762024-04-03T22:29:36.797Z+ exit 0
17772024-04-03T22:29:36.825Zprocess exited: duration 675459 ms, exit code 0
 
17782024-04-03T22:29:36.966Zfound 100 output files
17792024-04-03T22:29:36.966Zuploading: /var/svc/log/oxide-sled-agent:default.log (1773284 bytes)
17802024-04-03T22:29:38.767Zuploaded: /var/svc/log/oxide-sled-agent:default.log
17812024-04-03T22:29:38.768Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (2752882 bytes)
17822024-04-03T22:29:40.198Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 2752882 -> 2765667
17832024-04-03T22:29:41.273Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
17842024-04-03T22:29:41.273Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52291 bytes)
17852024-04-03T22:29:42.460Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
17862024-04-03T22:29:42.460Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (206703 bytes)
17872024-04-03T22:29:42.720Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 206703 -> 209098
17882024-04-03T22:29:43.800Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
17892024-04-03T22:29:43.800Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (258031 bytes)
17902024-04-03T22:29:44.087Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 258031 -> 264301
17912024-04-03T22:29:45.159Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
17922024-04-03T22:29:45.159Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1408616 bytes)
17932024-04-03T22:29:46.749Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1408616 -> 1436588
17942024-04-03T22:29:47.826Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
17952024-04-03T22:29:47.826Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (800483 bytes)
17962024-04-03T22:29:48.442Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 800483 -> 820571
17972024-04-03T22:29:49.542Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
17982024-04-03T22:29:49.542Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1388 bytes)
17992024-04-03T22:29:50.648Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
18002024-04-03T22:29:50.648Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (294598 bytes)
18012024-04-03T22:29:51.541Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 294598 -> 301660
18022024-04-03T22:29:52.623Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
18032024-04-03T22:29:52.623Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (8358 bytes)
18042024-04-03T22:29:52.694Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 8358 -> 8943
18052024-04-03T22:29:53.791Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
18062024-04-03T22:29:53.792Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5389 bytes)
18072024-04-03T22:29:54.905Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
18082024-04-03T22:29:54.905Zuploading: /pool/ext/00b9d2d0-59a4-4682-aa18-072c6202c0c8/crypt/zone/oxz_crucible_5e26c358-ec8d-4c32-994c-352789460794/root/var/svc/log/oxide-crucible-agent:default.log (12469 bytes)
18092024-04-03T22:29:56.070Zuploaded: /pool/ext/00b9d2d0-59a4-4682-aa18-072c6202c0c8/crypt/zone/oxz_crucible_5e26c358-ec8d-4c32-994c-352789460794/root/var/svc/log/oxide-crucible-agent:default.log
18102024-04-03T22:29:56.070Zuploading: /pool/ext/00b9d2d0-59a4-4682-aa18-072c6202c0c8/crypt/zone/oxz_crucible_5e26c358-ec8d-4c32-994c-352789460794/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
18112024-04-03T22:29:57.609Zuploaded: /pool/ext/00b9d2d0-59a4-4682-aa18-072c6202c0c8/crypt/zone/oxz_crucible_5e26c358-ec8d-4c32-994c-352789460794/root/var/svc/log/oxide-crucible-downstairs:default.log
18122024-04-03T22:29:57.609Zuploading: /pool/ext/00b9d2d0-59a4-4682-aa18-072c6202c0c8/crypt/zone/oxz_crucible_5e26c358-ec8d-4c32-994c-352789460794/root/var/svc/log/oxide-crucible-downstairs:downstairs-66a22c32-6099-4cc5-b3b2-fc4cf9b96793.log (5613 bytes)
18132024-04-03T22:29:58.740Zuploaded: /pool/ext/00b9d2d0-59a4-4682-aa18-072c6202c0c8/crypt/zone/oxz_crucible_5e26c358-ec8d-4c32-994c-352789460794/root/var/svc/log/oxide-crucible-downstairs:downstairs-66a22c32-6099-4cc5-b3b2-fc4cf9b96793.log
18142024-04-03T22:29:58.741Zuploading: /pool/ext/00b9d2d0-59a4-4682-aa18-072c6202c0c8/crypt/zone/oxz_crucible_5e26c358-ec8d-4c32-994c-352789460794/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
18152024-04-03T22:29:59.850Zuploaded: /pool/ext/00b9d2d0-59a4-4682-aa18-072c6202c0c8/crypt/zone/oxz_crucible_5e26c358-ec8d-4c32-994c-352789460794/root/var/svc/log/oxide-zone-network-setup:default.log
18162024-04-03T22:29:59.876Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_cockroachdb_760e9943-67c9-4971-982a-df71813585c0/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
18172024-04-03T22:30:01.407Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_cockroachdb_760e9943-67c9-4971-982a-df71813585c0/root/var/svc/log/oxide-cockroachdb:default.log
18182024-04-03T22:30:01.408Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_cockroachdb_760e9943-67c9-4971-982a-df71813585c0/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
18192024-04-03T22:30:02.517Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_cockroachdb_760e9943-67c9-4971-982a-df71813585c0/root/var/svc/log/oxide-zone-network-setup:default.log
18202024-04-03T22:30:02.518Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-agent:default.log (18043 bytes)
18212024-04-03T22:30:02.551Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 18043 -> 0
18222024-04-03T22:30:03.640Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-agent:default.log
18232024-04-03T22:30:03.641Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
18242024-04-03T22:30:03.673Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
18252024-04-03T22:30:04.754Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:default.log
18262024-04-03T22:30:04.754Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:downstairs-1dfd1451-c0b7-408b-b027-175c2aae2329.log (5690 bytes)
18272024-04-03T22:30:04.780Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:downstairs-1dfd1451-c0b7-408b-b027-175c2aae2329.log" changed size mid upload: 5690 -> 0
18282024-04-03T22:30:05.880Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:downstairs-1dfd1451-c0b7-408b-b027-175c2aae2329.log
18292024-04-03T22:30:05.880Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:snapshot-1dfd1451-c0b7-408b-b027-175c2aae2329-89934fb9-76d6-49ba-978f-145934040770.log (5304 bytes)
18302024-04-03T22:30:05.908Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:snapshot-1dfd1451-c0b7-408b-b027-175c2aae2329-89934fb9-76d6-49ba-978f-145934040770.log" changed size mid upload: 5304 -> 0
18312024-04-03T22:30:06.978Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-crucible-downstairs:snapshot-1dfd1451-c0b7-408b-b027-175c2aae2329-89934fb9-76d6-49ba-978f-145934040770.log
18322024-04-03T22:30:06.978Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
18332024-04-03T22:30:07.003Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1703 -> 0
18342024-04-03T22:30:08.489Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_crucible_fa50666f-58a0-483d-be64-fa945e831afc/root/var/svc/log/oxide-zone-network-setup:default.log
18352024-04-03T22:30:08.489Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-external_dns:default.log (26866 bytes)
18362024-04-03T22:30:08.514Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26866 -> 0
18372024-04-03T22:30:09.585Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-external_dns:default.log
18382024-04-03T22:30:09.585Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-opte-interface-setup:default.log (1188 bytes)
18392024-04-03T22:30:09.609Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1188 -> 0
18402024-04-03T22:30:10.679Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-opte-interface-setup:default.log
18412024-04-03T22:30:10.679Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-zone-network-setup:default.log (1726 bytes)
18422024-04-03T22:30:10.705Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1726 -> 0
18432024-04-03T22:30:11.780Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_external_dns_8eb46fe3-79ce-42d3-8484-9f04007321b8/root/var/svc/log/oxide-zone-network-setup:default.log
18442024-04-03T22:30:11.781Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_internal_dns_ea42831f-f0e1-4084-840f-aa951f986640/root/var/svc/log/oxide-internal_dns:default.log (108190 bytes)
18452024-04-03T22:30:11.805Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_internal_dns_ea42831f-f0e1-4084-840f-aa951f986640/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 108190 -> 0
18462024-04-03T22:30:12.889Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_internal_dns_ea42831f-f0e1-4084-840f-aa951f986640/root/var/svc/log/oxide-internal_dns:default.log
18472024-04-03T22:30:12.889Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_internal_dns_ea42831f-f0e1-4084-840f-aa951f986640/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
18482024-04-03T22:30:12.922Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_internal_dns_ea42831f-f0e1-4084-840f-aa951f986640/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1709 -> 0
18492024-04-03T22:30:13.993Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_internal_dns_ea42831f-f0e1-4084-840f-aa951f986640/root/var/svc/log/oxide-zone-network-setup:default.log
18502024-04-03T22:30:13.993Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-ntp:default.log (1311 bytes)
18512024-04-03T22:30:14.017Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 1311 -> 0
18522024-04-03T22:30:15.099Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-ntp:default.log
18532024-04-03T22:30:15.100Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
18542024-04-03T22:30:15.134Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1156 -> 0
18552024-04-03T22:30:16.197Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-opte-interface-setup:default.log
18562024-04-03T22:30:16.197Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-zone-network-setup:default.log (1665 bytes)
18572024-04-03T22:30:16.223Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1665 -> 0
18582024-04-03T22:30:17.296Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/svc/log/oxide-zone-network-setup:default.log
18592024-04-03T22:30:17.296Zuploading: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-agent:default.log (23597 bytes)
18602024-04-03T22:30:17.321Zupload warning: file "/pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 23597 -> 0
18612024-04-03T22:30:18.397Zuploaded: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-agent:default.log
18622024-04-03T22:30:18.397Zuploading: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
18632024-04-03T22:30:18.421Zupload warning: file "/pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
18642024-04-03T22:30:19.911Zuploaded: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:default.log
18652024-04-03T22:30:19.911Zuploading: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:downstairs-42d10b54-fa19-4d6d-9495-39e19944b1ec.log (5614 bytes)
18662024-04-03T22:30:19.943Zupload warning: file "/pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:downstairs-42d10b54-fa19-4d6d-9495-39e19944b1ec.log" changed size mid upload: 5614 -> 0
18672024-04-03T22:30:21.035Zuploaded: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:downstairs-42d10b54-fa19-4d6d-9495-39e19944b1ec.log
18682024-04-03T22:30:21.035Zuploading: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:downstairs-aa198f5b-ef35-4b7f-87cc-4e39e32afa4f.log (3019 bytes)
18692024-04-03T22:30:21.059Zupload warning: file "/pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:downstairs-aa198f5b-ef35-4b7f-87cc-4e39e32afa4f.log" changed size mid upload: 3019 -> 0
18702024-04-03T22:30:22.130Zuploaded: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-crucible-downstairs:downstairs-aa198f5b-ef35-4b7f-87cc-4e39e32afa4f.log
18712024-04-03T22:30:22.130Zuploading: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
18722024-04-03T22:30:22.158Zupload warning: file "/pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1704 -> 0
18732024-04-03T22:30:23.261Zuploaded: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_crucible_d51b3a20-a225-4ec7-923b-909364c7c31a/root/var/svc/log/oxide-zone-network-setup:default.log
18742024-04-03T22:30:23.262Zuploading: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-nexus:default.log (36143962 bytes)
18752024-04-03T22:30:23.600Zupload warning: file "/pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36143962 -> 104841
18762024-04-03T22:30:24.677Zuploaded: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-nexus:default.log
18772024-04-03T22:30:24.677Zuploading: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-opte-interface-setup:default.log (1167 bytes)
18782024-04-03T22:30:24.702Zupload warning: file "/pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1167 -> 0
18792024-04-03T22:30:25.774Zuploaded: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-opte-interface-setup:default.log
18802024-04-03T22:30:25.774Zuploading: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
18812024-04-03T22:30:25.799Zupload warning: file "/pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1683 -> 0
18822024-04-03T22:30:26.887Zuploaded: /pool/ext/494a3a1c-f913-4e4b-8eec-202ec6c5bfd4/crypt/zone/oxz_nexus_51c8ee79-ce7f-49ba-8ad8-5c1c00a001d2/root/var/svc/log/oxide-zone-network-setup:default.log
18832024-04-03T22:30:26.887Zuploading: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_cockroachdb_cd4c53d6-b1da-42ff-b18a-4ad3b7218a9d/root/var/svc/log/oxide-cockroachdb:default.log (4406 bytes)
18842024-04-03T22:30:26.913Zupload warning: file "/pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_cockroachdb_cd4c53d6-b1da-42ff-b18a-4ad3b7218a9d/root/var/svc/log/oxide-cockroachdb:default.log" changed size mid upload: 4406 -> 0
18852024-04-03T22:30:28.031Zuploaded: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_cockroachdb_cd4c53d6-b1da-42ff-b18a-4ad3b7218a9d/root/var/svc/log/oxide-cockroachdb:default.log
18862024-04-03T22:30:28.031Zuploading: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_cockroachdb_cd4c53d6-b1da-42ff-b18a-4ad3b7218a9d/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
18872024-04-03T22:30:28.062Zupload warning: file "/pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_cockroachdb_cd4c53d6-b1da-42ff-b18a-4ad3b7218a9d/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1711 -> 0
18882024-04-03T22:30:29.553Zuploaded: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_cockroachdb_cd4c53d6-b1da-42ff-b18a-4ad3b7218a9d/root/var/svc/log/oxide-zone-network-setup:default.log
18892024-04-03T22:30:29.553Zuploading: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-agent:default.log (18039 bytes)
18902024-04-03T22:30:29.578Zupload warning: file "/pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 18039 -> 0
18912024-04-03T22:30:30.661Zuploaded: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-agent:default.log
18922024-04-03T22:30:30.661Zuploading: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
18932024-04-03T22:30:30.696Zupload warning: file "/pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
18942024-04-03T22:30:31.771Zuploaded: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:default.log
18952024-04-03T22:30:31.771Zuploading: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:downstairs-949da396-1287-44bf-997c-f995a52b430f.log (5692 bytes)
18962024-04-03T22:30:31.796Zupload warning: file "/pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:downstairs-949da396-1287-44bf-997c-f995a52b430f.log" changed size mid upload: 5692 -> 0
18972024-04-03T22:30:32.898Zuploaded: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:downstairs-949da396-1287-44bf-997c-f995a52b430f.log
18982024-04-03T22:30:32.898Zuploading: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:snapshot-949da396-1287-44bf-997c-f995a52b430f-89934fb9-76d6-49ba-978f-145934040770.log (5305 bytes)
18992024-04-03T22:30:32.924Zupload warning: file "/pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:snapshot-949da396-1287-44bf-997c-f995a52b430f-89934fb9-76d6-49ba-978f-145934040770.log" changed size mid upload: 5305 -> 0
19002024-04-03T22:30:33.993Zuploaded: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-crucible-downstairs:snapshot-949da396-1287-44bf-997c-f995a52b430f-89934fb9-76d6-49ba-978f-145934040770.log
19012024-04-03T22:30:33.993Zuploading: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
19022024-04-03T22:30:34.021Zupload warning: file "/pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1703 -> 0
19032024-04-03T22:30:35.106Zuploaded: /pool/ext/4eb310e9-0d98-4a07-821c-54f35a32dc4a/crypt/zone/oxz_crucible_c2f00f12-490d-4063-bbdf-ba3339526aca/root/var/svc/log/oxide-zone-network-setup:default.log
19042024-04-03T22:30:35.107Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-agent:default.log (25259 bytes)
19052024-04-03T22:30:35.142Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 25259 -> 0
19062024-04-03T22:30:36.220Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-agent:default.log
19072024-04-03T22:30:36.220Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
19082024-04-03T22:30:36.244Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
19092024-04-03T22:30:37.314Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:default.log
19102024-04-03T22:30:37.315Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:downstairs-81efd347-0587-4daa-a430-0700f1ce21f8.log (5698 bytes)
19112024-04-03T22:30:37.346Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:downstairs-81efd347-0587-4daa-a430-0700f1ce21f8.log" changed size mid upload: 5698 -> 0
19122024-04-03T22:30:38.418Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:downstairs-81efd347-0587-4daa-a430-0700f1ce21f8.log
19132024-04-03T22:30:38.418Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:downstairs-d80c4078-3702-4e97-beab-f43ff9b4b15d.log (3125 bytes)
19142024-04-03T22:30:38.444Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:downstairs-d80c4078-3702-4e97-beab-f43ff9b4b15d.log" changed size mid upload: 3125 -> 0
19152024-04-03T22:30:39.530Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:downstairs-d80c4078-3702-4e97-beab-f43ff9b4b15d.log
19162024-04-03T22:30:39.554Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:snapshot-81efd347-0587-4daa-a430-0700f1ce21f8-89934fb9-76d6-49ba-978f-145934040770.log (5305 bytes)
19172024-04-03T22:30:39.580Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:snapshot-81efd347-0587-4daa-a430-0700f1ce21f8-89934fb9-76d6-49ba-978f-145934040770.log" changed size mid upload: 5305 -> 0
19182024-04-03T22:30:40.630Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-crucible-downstairs:snapshot-81efd347-0587-4daa-a430-0700f1ce21f8-89934fb9-76d6-49ba-978f-145934040770.log
19192024-04-03T22:30:40.630Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
19202024-04-03T22:30:40.661Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1704 -> 0
19212024-04-03T22:30:41.720Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_crucible_314ccbfc-4da6-468c-890e-832bbc1bb521/root/var/svc/log/oxide-zone-network-setup:default.log
19222024-04-03T22:30:41.720Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-nexus:default.log (1811787 bytes)
19232024-04-03T22:30:42.199Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1811787 -> 187315
19242024-04-03T22:30:43.277Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-nexus:default.log
19252024-04-03T22:30:43.277Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-opte-interface-setup:default.log (1167 bytes)
19262024-04-03T22:30:43.301Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1167 -> 0
19272024-04-03T22:30:44.390Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-opte-interface-setup:default.log
19282024-04-03T22:30:44.390Zuploading: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
19292024-04-03T22:30:44.414Zupload warning: file "/pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1683 -> 0
19302024-04-03T22:30:45.483Zuploaded: /pool/ext/70a16060-4587-476f-9772-16ea3a5a39aa/crypt/zone/oxz_nexus_8e55875e-d1c7-4353-bb0e-8bd66a3580e4/root/var/svc/log/oxide-zone-network-setup:default.log
19312024-04-03T22:30:45.483Zuploading: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-agent:default.log (17508 bytes)
19322024-04-03T22:30:45.508Zupload warning: file "/pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 17508 -> 0
19332024-04-03T22:30:46.596Zuploaded: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-agent:default.log
19342024-04-03T22:30:46.596Zuploading: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
19352024-04-03T22:30:46.622Zupload warning: file "/pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
19362024-04-03T22:30:47.699Zuploaded: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:default.log
19372024-04-03T22:30:47.699Zuploading: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:downstairs-df820947-0730-4f83-b67c-1b3b2adf128f.log (3019 bytes)
19382024-04-03T22:30:47.726Zupload warning: file "/pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:downstairs-df820947-0730-4f83-b67c-1b3b2adf128f.log" changed size mid upload: 3019 -> 0
19392024-04-03T22:30:48.803Zuploaded: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:downstairs-df820947-0730-4f83-b67c-1b3b2adf128f.log
19402024-04-03T22:30:48.803Zuploading: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:downstairs-eea7faae-2467-4fce-846e-a18c6d1144e2.log (3125 bytes)
19412024-04-03T22:30:48.848Zupload warning: file "/pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:downstairs-eea7faae-2467-4fce-846e-a18c6d1144e2.log" changed size mid upload: 3125 -> 0
19422024-04-03T22:30:49.910Zuploaded: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-crucible-downstairs:downstairs-eea7faae-2467-4fce-846e-a18c6d1144e2.log
19432024-04-03T22:30:49.940Zuploading: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
19442024-04-03T22:30:49.977Zupload warning: file "/pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1704 -> 0
19452024-04-03T22:30:51.044Zuploaded: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_cb89319f-4814-47d4-b860-8be4b528d881/root/var/svc/log/oxide-zone-network-setup:default.log
19462024-04-03T22:30:51.044Zuploading: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_pantry_af1c3446-0a0d-4d20-8b27-21e6fd6e6326/root/var/svc/log/oxide-crucible-pantry:default.log (1225411 bytes)
19472024-04-03T22:30:51.069Zupload warning: file "/pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_pantry_af1c3446-0a0d-4d20-8b27-21e6fd6e6326/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 1225411 -> 0
19482024-04-03T22:30:52.140Zuploaded: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_pantry_af1c3446-0a0d-4d20-8b27-21e6fd6e6326/root/var/svc/log/oxide-crucible-pantry:default.log
19492024-04-03T22:30:52.140Zuploading: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_pantry_af1c3446-0a0d-4d20-8b27-21e6fd6e6326/root/var/svc/log/oxide-zone-network-setup:default.log (1746 bytes)
19502024-04-03T22:30:52.165Zupload warning: file "/pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_pantry_af1c3446-0a0d-4d20-8b27-21e6fd6e6326/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1746 -> 0
19512024-04-03T22:30:53.253Zuploaded: /pool/ext/761d3524-c333-4332-9563-7d1ceb36709e/crypt/zone/oxz_crucible_pantry_af1c3446-0a0d-4d20-8b27-21e6fd6e6326/root/var/svc/log/oxide-zone-network-setup:default.log
19522024-04-03T22:30:53.291Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_clickhouse_563f58c1-d407-4137-bc76-479e49aec380/root/var/svc/log/oxide-clickhouse:default.log (2211930 bytes)
19532024-04-03T22:30:53.782Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_clickhouse_563f58c1-d407-4137-bc76-479e49aec380/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2211930 -> 252715
19542024-04-03T22:30:54.543Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_clickhouse_563f58c1-d407-4137-bc76-479e49aec380/root/var/svc/log/oxide-clickhouse:default.log
19552024-04-03T22:30:54.543Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_clickhouse_563f58c1-d407-4137-bc76-479e49aec380/root/var/svc/log/oxide-zone-network-setup:default.log (1714 bytes)
19562024-04-03T22:30:54.574Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_clickhouse_563f58c1-d407-4137-bc76-479e49aec380/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1714 -> 0
19572024-04-03T22:30:55.663Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_clickhouse_563f58c1-d407-4137-bc76-479e49aec380/root/var/svc/log/oxide-zone-network-setup:default.log
19582024-04-03T22:30:55.663Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_cockroachdb_e35cba43-078c-4794-99ca-4255942899ac/root/var/svc/log/oxide-cockroachdb:default.log (4482 bytes)
19592024-04-03T22:30:55.690Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_cockroachdb_e35cba43-078c-4794-99ca-4255942899ac/root/var/svc/log/oxide-cockroachdb:default.log" changed size mid upload: 4482 -> 0
19602024-04-03T22:30:56.759Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_cockroachdb_e35cba43-078c-4794-99ca-4255942899ac/root/var/svc/log/oxide-cockroachdb:default.log
19612024-04-03T22:30:56.760Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_cockroachdb_e35cba43-078c-4794-99ca-4255942899ac/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
19622024-04-03T22:30:56.789Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_cockroachdb_e35cba43-078c-4794-99ca-4255942899ac/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1711 -> 0
19632024-04-03T22:30:57.867Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_cockroachdb_e35cba43-078c-4794-99ca-4255942899ac/root/var/svc/log/oxide-zone-network-setup:default.log
19642024-04-03T22:30:57.867Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-crucible-agent:default.log (1324 bytes)
19652024-04-03T22:30:57.900Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 1324 -> 0
19662024-04-03T22:30:58.975Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-crucible-agent:default.log
19672024-04-03T22:30:58.975Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
19682024-04-03T22:30:59.013Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
19692024-04-03T22:31:00.069Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-crucible-downstairs:default.log
19702024-04-03T22:31:00.069Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
19712024-04-03T22:31:00.094Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1704 -> 0
19722024-04-03T22:31:01.185Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_13517379-cc23-4e5c-a042-6fc9b8934357/root/var/svc/log/oxide-zone-network-setup:default.log
19732024-04-03T22:31:01.185Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_cd916a02-7494-435c-a03d-4788b80a4b8f/root/var/svc/log/oxide-crucible-pantry:default.log (780 bytes)
19742024-04-03T22:31:01.210Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_cd916a02-7494-435c-a03d-4788b80a4b8f/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 780 -> 0
19752024-04-03T22:31:02.290Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_cd916a02-7494-435c-a03d-4788b80a4b8f/root/var/svc/log/oxide-crucible-pantry:default.log
19762024-04-03T22:31:02.290Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_cd916a02-7494-435c-a03d-4788b80a4b8f/root/var/svc/log/oxide-zone-network-setup:default.log (1743 bytes)
19772024-04-03T22:31:02.325Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_cd916a02-7494-435c-a03d-4788b80a4b8f/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1743 -> 0
19782024-04-03T22:31:03.408Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_cd916a02-7494-435c-a03d-4788b80a4b8f/root/var/svc/log/oxide-zone-network-setup:default.log
19792024-04-03T22:31:03.408Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_e440ec47-0611-4a7b-a40f-a3a9858d9733/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
19802024-04-03T22:31:03.440Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_e440ec47-0611-4a7b-a40f-a3a9858d9733/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 783 -> 0
19812024-04-03T22:31:04.544Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_e440ec47-0611-4a7b-a40f-a3a9858d9733/root/var/svc/log/oxide-crucible-pantry:default.log
19822024-04-03T22:31:04.544Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_e440ec47-0611-4a7b-a40f-a3a9858d9733/root/var/svc/log/oxide-zone-network-setup:default.log (1746 bytes)
19832024-04-03T22:31:04.584Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_e440ec47-0611-4a7b-a40f-a3a9858d9733/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1746 -> 0
19842024-04-03T22:31:05.657Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_crucible_pantry_e440ec47-0611-4a7b-a40f-a3a9858d9733/root/var/svc/log/oxide-zone-network-setup:default.log
19852024-04-03T22:31:05.657Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-external_dns:default.log (26868 bytes)
19862024-04-03T22:31:05.712Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26868 -> 3772
19872024-04-03T22:31:07.198Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-external_dns:default.log
19882024-04-03T22:31:07.198Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-opte-interface-setup:default.log (1188 bytes)
19892024-04-03T22:31:07.227Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1188 -> 0
19902024-04-03T22:31:08.317Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-opte-interface-setup:default.log
19912024-04-03T22:31:08.317Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-zone-network-setup:default.log (1726 bytes)
19922024-04-03T22:31:08.358Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1726 -> 0
19932024-04-03T22:31:09.440Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_external_dns_a659e3c3-fb10-4e94-881b-2120466ce2b6/root/var/svc/log/oxide-zone-network-setup:default.log
19942024-04-03T22:31:09.441Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_internal_dns_711ccb54-227e-476e-9bc7-c738bae2623e/root/var/svc/log/oxide-internal_dns:default.log (107368 bytes)
19952024-04-03T22:31:09.913Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_internal_dns_711ccb54-227e-476e-9bc7-c738bae2623e/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107368 -> 5432
19962024-04-03T22:31:10.999Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_internal_dns_711ccb54-227e-476e-9bc7-c738bae2623e/root/var/svc/log/oxide-internal_dns:default.log
19972024-04-03T22:31:10.999Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_internal_dns_711ccb54-227e-476e-9bc7-c738bae2623e/root/var/svc/log/oxide-zone-network-setup:default.log (1707 bytes)
19982024-04-03T22:31:11.024Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_internal_dns_711ccb54-227e-476e-9bc7-c738bae2623e/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1707 -> 0
19992024-04-03T22:31:12.094Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_internal_dns_711ccb54-227e-476e-9bc7-c738bae2623e/root/var/svc/log/oxide-zone-network-setup:default.log
20002024-04-03T22:31:12.094Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-nexus:default.log (3172947 bytes)
20012024-04-03T22:31:12.312Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 3172947 -> 259132
20022024-04-03T22:31:13.390Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-nexus:default.log
20032024-04-03T22:31:13.390Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-opte-interface-setup:default.log (1166 bytes)
20042024-04-03T22:31:13.415Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1166 -> 0
20052024-04-03T22:31:14.501Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-opte-interface-setup:default.log
20062024-04-03T22:31:14.531Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
20072024-04-03T22:31:14.531Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1683 -> 0
20082024-04-03T22:31:15.604Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_nexus_0a8b454f-8da6-4dd8-942c-effe3a8487e0/root/var/svc/log/oxide-zone-network-setup:default.log
20092024-04-03T22:31:15.604Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_oximeter_2af5a5df-6e1e-4695-b84f-2a6edd1c1ac4/root/var/svc/log/oxide-oximeter:default.log (1696292 bytes)
20102024-04-03T22:31:15.809Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_oximeter_2af5a5df-6e1e-4695-b84f-2a6edd1c1ac4/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1696292 -> 301609
20112024-04-03T22:31:16.880Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_oximeter_2af5a5df-6e1e-4695-b84f-2a6edd1c1ac4/root/var/svc/log/oxide-oximeter:default.log
20122024-04-03T22:31:16.880Zuploading: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_oximeter_2af5a5df-6e1e-4695-b84f-2a6edd1c1ac4/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
20132024-04-03T22:31:16.905Zupload warning: file "/pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_oximeter_2af5a5df-6e1e-4695-b84f-2a6edd1c1ac4/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1702 -> 0
20142024-04-03T22:31:17.991Zuploaded: /pool/ext/7d954909-2e42-44b1-96d9-f536366f6758/crypt/zone/oxz_oximeter_2af5a5df-6e1e-4695-b84f-2a6edd1c1ac4/root/var/svc/log/oxide-zone-network-setup:default.log
20152024-04-03T22:31:17.991Zuploading: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_cockroachdb_4712897e-ce28-4ed0-ae00-c454b60a50d5/root/var/svc/log/oxide-cockroachdb:default.log (4376 bytes)
20162024-04-03T22:31:18.016Zupload warning: file "/pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_cockroachdb_4712897e-ce28-4ed0-ae00-c454b60a50d5/root/var/svc/log/oxide-cockroachdb:default.log" changed size mid upload: 4376 -> 0
20172024-04-03T22:31:19.084Zuploaded: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_cockroachdb_4712897e-ce28-4ed0-ae00-c454b60a50d5/root/var/svc/log/oxide-cockroachdb:default.log
20182024-04-03T22:31:19.085Zuploading: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_cockroachdb_4712897e-ce28-4ed0-ae00-c454b60a50d5/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
20192024-04-03T22:31:19.111Zupload warning: file "/pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_cockroachdb_4712897e-ce28-4ed0-ae00-c454b60a50d5/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1711 -> 0
20202024-04-03T22:31:20.194Zuploaded: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_cockroachdb_4712897e-ce28-4ed0-ae00-c454b60a50d5/root/var/svc/log/oxide-zone-network-setup:default.log
20212024-04-03T22:31:20.194Zuploading: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-agent:default.log (18828 bytes)
20222024-04-03T22:31:20.227Zupload warning: file "/pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 18828 -> 0
20232024-04-03T22:31:21.713Zuploaded: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-agent:default.log
20242024-04-03T22:31:21.713Zuploading: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
20252024-04-03T22:31:21.746Zupload warning: file "/pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
20262024-04-03T22:31:22.822Zuploaded: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:default.log
20272024-04-03T22:31:22.822Zuploading: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:downstairs-3481c469-c175-4021-85da-ae3d1d04ce3d.log (3020 bytes)
20282024-04-03T22:31:22.850Zupload warning: file "/pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:downstairs-3481c469-c175-4021-85da-ae3d1d04ce3d.log" changed size mid upload: 3020 -> 0
20292024-04-03T22:31:23.929Zuploaded: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:downstairs-3481c469-c175-4021-85da-ae3d1d04ce3d.log
20302024-04-03T22:31:23.930Zuploading: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:downstairs-37cfca01-42ef-4333-81c4-a77e2c5d8f27.log (3124 bytes)
20312024-04-03T22:31:23.962Zupload warning: file "/pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:downstairs-37cfca01-42ef-4333-81c4-a77e2c5d8f27.log" changed size mid upload: 3124 -> 0
20322024-04-03T22:31:25.042Zuploaded: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-crucible-downstairs:downstairs-37cfca01-42ef-4333-81c4-a77e2c5d8f27.log
20332024-04-03T22:31:25.042Zuploading: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
20342024-04-03T22:31:25.076Zupload warning: file "/pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1704 -> 0
20352024-04-03T22:31:26.172Zuploaded: /pool/ext/ae4e2e29-ff41-46eb-978b-335ffe5cd37e/crypt/zone/oxz_crucible_63b23166-4f95-4eb8-ad60-a228d77b8860/root/var/svc/log/oxide-zone-network-setup:default.log
20362024-04-03T22:31:26.173Zuploading: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_cockroachdb_70323a7d-e09e-4fb2-b8a6-3cb5eaff9000/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
20372024-04-03T22:31:26.203Zupload warning: file "/pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_cockroachdb_70323a7d-e09e-4fb2-b8a6-3cb5eaff9000/root/var/svc/log/oxide-cockroachdb:default.log" changed size mid upload: 4407 -> 0
20382024-04-03T22:31:27.286Zuploaded: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_cockroachdb_70323a7d-e09e-4fb2-b8a6-3cb5eaff9000/root/var/svc/log/oxide-cockroachdb:default.log
20392024-04-03T22:31:27.286Zuploading: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_cockroachdb_70323a7d-e09e-4fb2-b8a6-3cb5eaff9000/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
20402024-04-03T22:31:27.322Zupload warning: file "/pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_cockroachdb_70323a7d-e09e-4fb2-b8a6-3cb5eaff9000/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1710 -> 0
20412024-04-03T22:31:28.404Zuploaded: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_cockroachdb_70323a7d-e09e-4fb2-b8a6-3cb5eaff9000/root/var/svc/log/oxide-zone-network-setup:default.log
20422024-04-03T22:31:28.404Zuploading: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-agent:default.log (12007 bytes)
20432024-04-03T22:31:28.440Zupload warning: file "/pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 12007 -> 0
20442024-04-03T22:31:29.523Zuploaded: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-agent:default.log
20452024-04-03T22:31:29.554Zuploading: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
20462024-04-03T22:31:29.554Zupload warning: file "/pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
20472024-04-03T22:31:30.657Zuploaded: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-downstairs:default.log
20482024-04-03T22:31:30.658Zuploading: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-downstairs:downstairs-f7d3c967-a637-4d8a-9d6b-a36a7a05d568.log (5613 bytes)
20492024-04-03T22:31:30.692Zupload warning: file "/pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-downstairs:downstairs-f7d3c967-a637-4d8a-9d6b-a36a7a05d568.log" changed size mid upload: 5613 -> 0
20502024-04-03T22:31:31.764Zuploaded: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-crucible-downstairs:downstairs-f7d3c967-a637-4d8a-9d6b-a36a7a05d568.log
20512024-04-03T22:31:31.764Zuploading: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
20522024-04-03T22:31:31.790Zupload warning: file "/pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1703 -> 0
20532024-04-03T22:31:32.859Zuploaded: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_crucible_bd7c537f-b395-4fac-b80b-c5f64aec5175/root/var/svc/log/oxide-zone-network-setup:default.log
20542024-04-03T22:31:32.859Zuploading: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_internal_dns_82d8d423-6846-428f-8eb7-7d87943ccbca/root/var/svc/log/oxide-internal_dns:default.log (107377 bytes)
20552024-04-03T22:31:32.943Zupload warning: file "/pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_internal_dns_82d8d423-6846-428f-8eb7-7d87943ccbca/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107377 -> 7953
20562024-04-03T22:31:34.025Zuploaded: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_internal_dns_82d8d423-6846-428f-8eb7-7d87943ccbca/root/var/svc/log/oxide-internal_dns:default.log
20572024-04-03T22:31:34.025Zuploading: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_internal_dns_82d8d423-6846-428f-8eb7-7d87943ccbca/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
20582024-04-03T22:31:34.051Zupload warning: file "/pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_internal_dns_82d8d423-6846-428f-8eb7-7d87943ccbca/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1709 -> 0
20592024-04-03T22:31:35.124Zuploaded: /pool/ext/af9b6346-5d28-46df-baea-640dad9b76c3/crypt/zone/oxz_internal_dns_82d8d423-6846-428f-8eb7-7d87943ccbca/root/var/svc/log/oxide-zone-network-setup:default.log
20602024-04-03T22:31:35.125Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/measurements.log (21509 bytes)
20612024-04-03T22:31:35.323Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/measurements.log" changed size mid upload: 21509 -> 25756
20622024-04-03T22:31:36.398Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/measurements.log
20632024-04-03T22:31:36.398Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/statistics.log (14391 bytes)
20642024-04-03T22:31:36.500Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/statistics.log" changed size mid upload: 14391 -> 18018
20652024-04-03T22:31:37.571Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/statistics.log
20662024-04-03T22:31:37.571Zuploading: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/tracking.log (2509 bytes)
20672024-04-03T22:31:37.618Zupload warning: file "/pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/tracking.log" changed size mid upload: 2509 -> 2773
20682024-04-03T22:31:38.699Zuploaded: /pool/ext/0c6b0894-9c77-422a-8363-2705812a672c/crypt/zone/oxz_ntp_4933dd3d-baa4-43a7-b488-a6e5fdad89d5/root/var/log/chrony/tracking.log