01HPX6BXJDQDC3VV39PMEYVTFM: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HPX6CJ5XJA4X2R82H3MWGHDX

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-18T04:41:22.692Zjob dependencies complete; ready to run (waiting for 33 m 20 s)
22024-02-18T04:46:48.970Zjob assigned to worker 01HPX89T2FKG10CA023MT70A6T (queued for 5 m 26 s)
32024-02-18T04:46:49.279Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-02-18T04:46:49.334Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-02-18T04:46:49.365Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-02-18T04:46:49.398Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-02-18T04:46:49.432Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-02-18T04:46:49.465ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-02-18T04:46:49.500Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-02-18T04:46:49.533ZOxide Helios Version helios-2.0.22451 64-bit
112024-02-18T04:46:49.566ZConfiguring devices.
122024-02-18T04:46:49.600Z##################################################
132024-02-18T04:46:49.633Z#### ############# ##
142024-02-18T04:46:49.667Z### ### ############ ##
152024-02-18T04:46:49.701Z## ### # ## ### ## Oxide Computer Company ##
162024-02-18T04:46:49.734Z## ## ## ### # ### ##
172024-02-18T04:46:49.767Z## # ### #### #### This Station Under ##
182024-02-18T04:46:49.801Z### ### #### # ### Computer Control ##
192024-02-18T04:46:49.834Z#### #### ### ## ##
202024-02-18T04:46:49.868Z##################################################
212024-02-18T04:46:49.901ZHostname: buskin
222024-02-18T04:46:49.935ZLoading smf(7) service descriptions:
232024-02-18T04:46:50.940Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-eb11d53ab76d2536.gz
242024-02-18T04:46:52.857Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-eb11d53ab76d2536.gz
252024-02-18T04:46:52.857Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-02-18T04:47:11.538Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-02-18T04:47:11.538Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-fe6fd140b2e71fe7.gz
282024-02-18T04:47:30.770Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-fe6fd140b2e71fe7.gz
292024-02-18T04:47:30.770Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-02-18T04:47:31.588Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-02-18T04:47:31.588Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-02-18T04:47:34.416Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-02-18T04:47:34.453Zdownloading input: /input/package/work/version.txt
342024-02-18T04:47:34.477Zdownloaded input: /input/package/work/version.txt
352024-02-18T04:47:34.477Zdownloading input: /input/package/work/package.tar.gz
362024-02-18T04:47:49.322Zdownloaded input: /input/package/work/package.tar.gz
372024-02-18T04:47:49.322Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-02-18T04:48:10.940Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-02-18T04:48:10.940Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-02-18T04:48:17.588Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-02-18T04:48:17.613Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-02-18T04:48:50.264Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-02-18T04:48:50.264Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-02-18T04:49:23.332Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-02-18T04:49:23.332Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-02-18T04:49:46.264Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-02-18T04:49:46.288Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
482024-02-18T04:49:48.873Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
492024-02-18T04:49:48.873Zdownloading input: /input/package/work/zones/crucible.tar.gz
502024-02-18T04:49:53.941Zdownloaded input: /input/package/work/zones/crucible.tar.gz
512024-02-18T04:49:53.941Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-02-18T04:49:58.107Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-02-18T04:49:58.107Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-02-18T04:50:02.177Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-02-18T04:50:02.177Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-02-18T04:50:02.214Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-02-18T04:50:02.239Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-02-18T04:50:05.743Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-02-18T04:50:05.744Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-02-18T04:50:09.297Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-02-18T04:50:09.297Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-02-18T04:50:24.380Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-02-18T04:50:24.380Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-02-18T04:50:39.526Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-02-18T04:50:39.527Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-02-18T04:50:39.594Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-02-18T04:50:39.618Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-02-18T04:50:49.057Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-02-18T04:50:49.058Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-02-18T04:51:00.224Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-02-18T04:51:00.224Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-02-18T04:51:48.468Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-02-18T04:51:48.468Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-02-18T04:52:24.405Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-02-18T04:52:24.405Zstarting task 0: "setup"
762024-02-18T04:52:24.430Z++ uname -s
772024-02-18T04:52:24.430Z+ kern=SunOS
782024-02-18T04:52:24.430Z+ case "$kern" in
792024-02-18T04:52:24.430Z+ groupadd -g 12345 build
802024-02-18T04:52:24.430Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-02-18T04:52:26.443Z+ zfs create -o mountpoint=/work rpool/work
822024-02-18T04:52:26.473Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-02-18T04:52:26.473Z+ home_fs=zfs
842024-02-18T04:52:26.473Z+ [[ zfs == autofs ]]
852024-02-18T04:52:26.473Z+ mkdir -p /home/build
862024-02-18T04:52:26.474Z+ chown build:build /home/build /work
872024-02-18T04:52:28.460Z+ chmod 0700 /home/build /work
882024-02-18T04:52:28.484Zprocess exited: duration 4058 ms, exit code 0
 
892024-02-18T04:52:28.533Zstarting task 1: "authentication"
902024-02-18T04:52:28.577Zprocess exited: duration 43 ms, exit code 0
 
912024-02-18T04:52:28.625Zstarting task 2: "build"
922024-02-18T04:52:28.650Z+ trap _exit_trap EXIT
932024-02-18T04:52:28.650Z+ set +x
942024-02-18T04:52:55.055Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-02-18T04:52:55.302Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-02-18T04:52:55.302Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-02-18T04:52:55.302Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-02-18T04:52:55.302Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-02-18T04:52:55.326Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-02-18T04:52:55.326Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-02-18T04:52:55.326Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-02-18T04:52:55.326Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-02-18T04:52:55.326Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-02-18T04:52:55.326Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-02-18T04:52:55.327Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-02-18T04:52:55.327Z+ [[ -d /opt/oxide ]]
1072024-02-18T04:52:55.327Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-02-18T04:52:55.327Z+ pfexec mkdir /opt/oxide
1092024-02-18T04:52:55.327Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-02-18T04:52:55.327Z+ [[ -d /opt/oxide-underneath ]]
1112024-02-18T04:52:55.327Z+ cd /opt/oxide-underneath
1122024-02-18T04:52:55.327Z+ pfexec tar ceEp@/f - .
1132024-02-18T04:52:55.327Z+ cd /opt/oxide
1142024-02-18T04:52:55.327Z+ pfexec tar xveEp@/f -
1152024-02-18T04:52:55.364Zx ., 0 bytes, 0 tape blocks
1162024-02-18T04:52:55.364Zx ./opte, 0 bytes, 0 tape blocks
1172024-02-18T04:52:55.364Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-02-18T04:52:55.364Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-02-18T04:52:55.391Z+ pfexec rm -rf /opt/oxide-underneath
1202024-02-18T04:52:55.391Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-02-18T04:52:55.416Z+ pfexec mkdir /opt/oxide/work
1222024-02-18T04:52:55.416Z+ pfexec chown build:build /opt/oxide/work
1232024-02-18T04:52:55.416Z+ cd /opt/oxide/work
1242024-02-18T04:52:55.416Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-02-18T04:52:57.130ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-02-18T04:52:57.130Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1272024-02-18T04:52:57.130Zx out/omicron-sled-agent.tar, 123000832 bytes, 240236 tape blocks
1282024-02-18T04:52:57.130Zx out/oxlog.tar, 8557568 bytes, 16714 tape blocks
1292024-02-18T04:52:57.130Zx out/target/test, 75 bytes, 1 tape blocks
1302024-02-18T04:52:57.130Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-02-18T04:52:57.131Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1322024-02-18T04:52:57.131Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-02-18T04:52:57.131Zx target/release/omicron-package, 45872008 bytes, 89594 tape blocks
1342024-02-18T04:52:57.131Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-02-18T04:52:57.131Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-02-18T04:52:57.131Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-02-18T04:52:57.131Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-02-18T04:52:57.131Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-02-18T04:52:57.131Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-02-18T04:52:57.131Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-02-18T04:52:57.155Z
1422024-02-18T04:52:57.156Zreal 1.723811312
1432024-02-18T04:52:57.156Zuser 1.541368020
1442024-02-18T04:52:57.156Zsys 0.309387658
1452024-02-18T04:52:57.156Ztrap 0.000072512
1462024-02-18T04:52:57.156Ztflt 0.000000000
1472024-02-18T04:52:57.156Zdflt 0.000000000
1482024-02-18T04:52:57.156Zkflt 0.000000000
1492024-02-18T04:52:57.156Zlock 0.000000000
1502024-02-18T04:52:57.156Zslp 1.551881268
1512024-02-18T04:52:57.156Zlat 0.042794782
1522024-02-18T04:52:57.156Zstop 0.000130262
1532024-02-18T04:52:57.156Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-02-18T04:52:58.360Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-02-18T04:52:58.384Z+ mkdir tests
1562024-02-18T04:52:58.384Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-02-18T04:52:58.384Z+ ptime -m gunzip
1582024-02-18T04:52:58.384Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-eb11d53ab76d2536
1592024-02-18T04:52:58.618Z
1602024-02-18T04:52:58.643Zreal 0.236500568
1612024-02-18T04:52:58.643Zuser 0.216719290
1622024-02-18T04:52:58.643Zsys 0.019526112
1632024-02-18T04:52:58.643Ztrap 0.000025940
1642024-02-18T04:52:58.643Ztflt 0.000000000
1652024-02-18T04:52:58.643Zdflt 0.000000000
1662024-02-18T04:52:58.643Zkflt 0.000000000
1672024-02-18T04:52:58.643Zlock 0.000000000
1682024-02-18T04:52:58.643Zslp 0.000024940
1692024-02-18T04:52:58.643Zlat 0.000024151
1702024-02-18T04:52:58.643Zstop 0.000123801
1712024-02-18T04:52:58.643Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-eb11d53ab76d2536
1722024-02-18T04:52:58.643Z+ chmod a+x tests/bootstrap-eb11d53ab76d2536
1732024-02-18T04:52:58.643Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-02-18T04:52:58.643Z+ ptime -m gunzip
1752024-02-18T04:52:58.643Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-02-18T04:53:01.134Z
1772024-02-18T04:53:01.164Zreal 2.503350388
1782024-02-18T04:53:01.164Zuser 2.351795510
1792024-02-18T04:53:01.164Zsys 0.151103914
1802024-02-18T04:53:01.164Ztrap 0.000199969
1812024-02-18T04:53:01.164Ztflt 0.000000000
1822024-02-18T04:53:01.164Zdflt 0.000000000
1832024-02-18T04:53:01.165Zkflt 0.000000000
1842024-02-18T04:53:01.165Zlock 0.000000000
1852024-02-18T04:53:01.165Zslp 0.000022520
1862024-02-18T04:53:01.165Zlat 0.000055370
1872024-02-18T04:53:01.165Zstop 0.000113572
1882024-02-18T04:53:01.165Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-02-18T04:53:01.165Z+ chmod a+x tests/bootstrap
1902024-02-18T04:53:01.166Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-02-18T04:53:01.166Z+ ptime -m gunzip
1922024-02-18T04:53:01.166Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-fe6fd140b2e71fe7
1932024-02-18T04:53:03.759Z
1942024-02-18T04:53:03.784Zreal 2.614235575
1952024-02-18T04:53:03.785Zuser 2.443328056
1962024-02-18T04:53:03.785Zsys 0.170478934
1972024-02-18T04:53:03.785Ztrap 0.000199762
1982024-02-18T04:53:03.785Ztflt 0.000000000
1992024-02-18T04:53:03.785Zdflt 0.000000000
2002024-02-18T04:53:03.785Zkflt 0.000000000
2012024-02-18T04:53:03.785Zlock 0.000000000
2022024-02-18T04:53:03.785Zslp 0.000021240
2032024-02-18T04:53:03.785Zlat 0.000024289
2042024-02-18T04:53:03.785Zstop 0.000122242
2052024-02-18T04:53:03.785Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-fe6fd140b2e71fe7
2062024-02-18T04:53:03.785Z+ chmod a+x tests/end_to_end_tests-fe6fd140b2e71fe7
2072024-02-18T04:53:03.785Z+ bmat address ls
2082024-02-18T04:53:03.785ZNAME CIDR FIRST LAST COUNT
2092024-02-18T04:53:03.785Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-02-18T04:53:03.785Z++ bmat address ls -f extra -Ho first,last,count
2112024-02-18T04:53:03.810Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-02-18T04:53:03.811Z+ EXTRA_IP_START=10.151.1.164
2132024-02-18T04:53:03.811Z+ EXTRA_IP_END=10.151.1.227
2142024-02-18T04:53:03.811Z+ EXTRA_IP_COUNT=64
2152024-02-18T04:53:03.811Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-02-18T04:53:03.811Z+ EXTRA_IP_BASE=10.151.1
2172024-02-18T04:53:03.811Z+ EXTRA_IP_FOCTET=164
2182024-02-18T04:53:03.811Z+ EXTRA_IP_LOCTET=227
2192024-02-18T04:53:03.811Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-02-18T04:53:03.811Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-02-18T04:53:03.811Z+ DNS_IP1=10.151.1.164
2222024-02-18T04:53:03.811Z+ DNS_IP2=10.151.1.165
2232024-02-18T04:53:03.811Z+ UPLINK_IP=10.151.1.174
2242024-02-18T04:53:03.811Z+ IPPOOL_START=10.151.1.175
2252024-02-18T04:53:03.811Z+ IPPOOL_END=10.151.1.227
2262024-02-18T04:53:03.811Z++ ipadm show-addr -po type,addr
2272024-02-18T04:53:03.811Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-02-18T04:53:03.811Z+ GATEWAY_IP=10.151.1.100
2292024-02-18T04:53:03.811Z+ [[ -n 10.151.1.100 ]]
2302024-02-18T04:53:03.811Z+ ping -s 10.151.1.100 56 1
2312024-02-18T04:53:03.811ZPING 10.151.1.100: 56 data bytes
2322024-02-18T04:53:03.811Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2332024-02-18T04:53:03.811Z
2342024-02-18T04:53:03.812Z----10.151.1.100 PING Statistics----
2352024-02-18T04:53:03.812Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-02-18T04:53:03.812Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2372024-02-18T04:53:03.812Z++ arp -an
2382024-02-18T04:53:03.812Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-02-18T04:53:03.836Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-02-18T04:53:03.836Z+ routeadm -e ipv4-forwarding -u
2412024-02-18T04:53:03.923Z+ PXA_START=10.151.1.164
2422024-02-18T04:53:03.923Z+ PXA_END=10.151.1.227
2432024-02-18T04:53:03.948Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-02-18T04:53:03.948Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-02-18T04:53:04.128Z+ ZPOOL_VDEV_DIR=/scratch
2462024-02-18T04:53:04.128Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-02-18T04:53:04.152Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-02-18T04:53:04.152Z++ cd ./tools
2492024-02-18T04:53:04.152Z++ pwd
2502024-02-18T04:53:04.153Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-02-18T04:53:04.153Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-02-18T04:53:04.153Z+ SOFTNPU_MODE=zone
2532024-02-18T04:53:04.153Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-02-18T04:53:04.153Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-02-18T04:53:04.153Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-02-18T04:53:04.153Z++ dladm show-phys -p -o LINK
2572024-02-18T04:53:04.153Z++ head -1
2582024-02-18T04:53:04.178Z+ PHYSICAL_LINK=igb0
2592024-02-18T04:53:04.179Z+ echo 'Using igb0 as physical link'
2602024-02-18T04:53:04.179ZUsing igb0 as physical link
2612024-02-18T04:53:04.179Z+ ensure_run_as_root
2622024-02-18T04:53:04.179Z++ id -u
2632024-02-18T04:53:04.179Z+ [[ 0 -ne 0 ]]
2642024-02-18T04:53:04.179Z+ ensure_zpools
2652024-02-18T04:53:04.179Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-02-18T04:53:04.179Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-02-18T04:53:04.179Z+ readarray -t ZPOOLS
2682024-02-18T04:53:04.179Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-02-18T04:53:04.179Z++ sed 's/[ ",]//g'
2702024-02-18T04:53:04.179Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-02-18T04:53:04.179Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-02-18T04:53:04.179ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-02-18T04:53:04.179Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-02-18T04:53:04.179Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-02-18T04:53:04.179Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-02-18T04:53:04.179Z0+0 records in
2772024-02-18T04:53:04.179Z0+0 records out
2782024-02-18T04:53:04.179Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2792024-02-18T04:53:04.179Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-02-18T04:53:04.179Z+ set +x
2812024-02-18T04:53:04.179ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-02-18T04:53:04.180Z++ zpool list -o name
2832024-02-18T04:53:04.180Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-02-18T04:53:04.180Z+ [[ -z '' ]]
2852024-02-18T04:53:04.180Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-18T04:53:04.208Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-02-18T04:53:04.233Z+ set +x
2882024-02-18T04:53:04.233ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-02-18T04:53:04.233Z+ for ZPOOL in "${ZPOOLS[@]}"
2902024-02-18T04:53:04.233Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2912024-02-18T04:53:04.233ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2922024-02-18T04:53:04.233Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2932024-02-18T04:53:04.233Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2942024-02-18T04:53:04.233Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-02-18T04:53:04.233Z0+0 records in
2962024-02-18T04:53:04.233Z0+0 records out
2972024-02-18T04:53:04.233Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2982024-02-18T04:53:04.233Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-02-18T04:53:04.233Z+ set +x
3002024-02-18T04:53:04.233ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-02-18T04:53:04.233Z++ zpool list -o name
3022024-02-18T04:53:04.233Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-02-18T04:53:04.233Z+ [[ -z '' ]]
3042024-02-18T04:53:04.233Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-18T04:53:04.258Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-02-18T04:53:04.258Z+ set +x
3072024-02-18T04:53:04.258ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-02-18T04:53:04.258Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-02-18T04:53:04.258Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-02-18T04:53:04.258ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-02-18T04:53:04.259Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-02-18T04:53:04.259Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-02-18T04:53:04.259Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-02-18T04:53:04.259Z0+0 records in
3152024-02-18T04:53:04.259Z0+0 records out
3162024-02-18T04:53:04.259Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3172024-02-18T04:53:04.259Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-02-18T04:53:04.259Z+ set +x
3192024-02-18T04:53:04.259ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-02-18T04:53:04.259Z++ zpool list -o name
3212024-02-18T04:53:04.259Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-02-18T04:53:04.283Z+ [[ -z '' ]]
3232024-02-18T04:53:04.284Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-02-18T04:53:04.308Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-02-18T04:53:04.308Z+ set +x
3262024-02-18T04:53:04.308ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-02-18T04:53:04.308Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-02-18T04:53:04.308Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-02-18T04:53:04.308Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3302024-02-18T04:53:04.308ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3312024-02-18T04:53:04.308Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-02-18T04:53:04.309Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-02-18T04:53:04.309Z0+0 records in
3342024-02-18T04:53:04.309Z0+0 records out
3352024-02-18T04:53:04.309Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3362024-02-18T04:53:04.309Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-02-18T04:53:04.309Z+ set +x
3382024-02-18T04:53:04.309ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-02-18T04:53:04.309Z++ zpool list -o name
3402024-02-18T04:53:04.309Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-02-18T04:53:04.309Z+ [[ -z '' ]]
3422024-02-18T04:53:04.309Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-18T04:53:04.339Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-02-18T04:53:04.339Z+ set +x
3452024-02-18T04:53:04.339ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-02-18T04:53:04.339Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-02-18T04:53:04.339Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3482024-02-18T04:53:04.339ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3492024-02-18T04:53:04.339Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-02-18T04:53:04.339Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-02-18T04:53:04.339Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-02-18T04:53:04.339Z0+0 records in
3532024-02-18T04:53:04.339Z0+0 records out
3542024-02-18T04:53:04.339Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3552024-02-18T04:53:04.339Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-02-18T04:53:04.339Z+ set +x
3572024-02-18T04:53:04.339ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-02-18T04:53:04.339Z++ zpool list -o name
3592024-02-18T04:53:04.339Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-02-18T04:53:04.364Z+ [[ -z '' ]]
3612024-02-18T04:53:04.364Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-18T04:53:04.389Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-02-18T04:53:04.389Z+ set +x
3642024-02-18T04:53:04.389ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-02-18T04:53:04.389Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-02-18T04:53:04.389Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-02-18T04:53:04.389ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-02-18T04:53:04.389Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-02-18T04:53:04.389Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-02-18T04:53:04.389Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-02-18T04:53:04.389Z0+0 records in
3722024-02-18T04:53:04.390Z0+0 records out
3732024-02-18T04:53:04.390Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3742024-02-18T04:53:04.390Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-02-18T04:53:04.390Z+ set +x
3762024-02-18T04:53:04.390ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-02-18T04:53:04.390Z++ zpool list -o name
3782024-02-18T04:53:04.390Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-02-18T04:53:04.390Z+ [[ -z '' ]]
3802024-02-18T04:53:04.390Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-18T04:53:04.415Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-02-18T04:53:04.415Z+ set +x
3832024-02-18T04:53:04.415ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-02-18T04:53:04.415Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-02-18T04:53:04.415ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3862024-02-18T04:53:04.415Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3872024-02-18T04:53:04.415Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-02-18T04:53:04.415Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-02-18T04:53:04.415Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-02-18T04:53:04.415Z0+0 records in
3912024-02-18T04:53:04.415Z0+0 records out
3922024-02-18T04:53:04.415Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3932024-02-18T04:53:04.415Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-02-18T04:53:04.415Z+ set +x
3952024-02-18T04:53:04.415ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-02-18T04:53:04.441Z++ zpool list -o name
3972024-02-18T04:53:04.442Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-02-18T04:53:04.442Z+ [[ -z '' ]]
3992024-02-18T04:53:04.442Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-18T04:53:04.467Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-02-18T04:53:04.467Z+ set +x
4022024-02-18T04:53:04.467ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-02-18T04:53:04.467Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-02-18T04:53:04.467Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4052024-02-18T04:53:04.467ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4062024-02-18T04:53:04.467Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-02-18T04:53:04.467Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-02-18T04:53:04.467Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-02-18T04:53:04.467Z0+0 records in
4102024-02-18T04:53:04.467Z0+0 records out
4112024-02-18T04:53:04.467Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4122024-02-18T04:53:04.467Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-02-18T04:53:04.467Z+ set +x
4142024-02-18T04:53:04.467ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-02-18T04:53:04.467Z++ zpool list -o name
4162024-02-18T04:53:04.467Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-02-18T04:53:04.492Z+ [[ -z '' ]]
4182024-02-18T04:53:04.492Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-18T04:53:04.517Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-02-18T04:53:04.517Z+ set +x
4212024-02-18T04:53:04.517ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-02-18T04:53:04.517Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-02-18T04:53:04.517Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-02-18T04:53:04.517ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4252024-02-18T04:53:04.517Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4262024-02-18T04:53:04.517Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-02-18T04:53:04.517Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-02-18T04:53:04.517Z0+0 records in
4292024-02-18T04:53:04.517Z0+0 records out
4302024-02-18T04:53:04.517Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4312024-02-18T04:53:04.517Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-02-18T04:53:04.517Z+ set +x
4332024-02-18T04:53:04.517ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-02-18T04:53:04.517Z++ zpool list -o name
4352024-02-18T04:53:04.517Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-02-18T04:53:04.517Z+ [[ -z '' ]]
4372024-02-18T04:53:04.517Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-18T04:53:04.542Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-02-18T04:53:04.542Z+ set +x
4402024-02-18T04:53:04.542ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-02-18T04:53:04.542Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-02-18T04:53:04.542Z+ readarray -t ZPOOLS
4432024-02-18T04:53:04.542Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-02-18T04:53:04.542Z++ sed 's/[ ",]//g'
4452024-02-18T04:53:04.567Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-02-18T04:53:04.567Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-02-18T04:53:04.567ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-02-18T04:53:04.567Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-02-18T04:53:04.567Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-02-18T04:53:04.567Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-02-18T04:53:04.567Z0+0 records in
4522024-02-18T04:53:04.567Z0+0 records out
4532024-02-18T04:53:04.567Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4542024-02-18T04:53:04.567Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-02-18T04:53:04.567Z+ set +x
4562024-02-18T04:53:04.567ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-02-18T04:53:04.567Z++ zpool list -o name
4582024-02-18T04:53:04.567Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-02-18T04:53:04.567Z+ [[ -z '' ]]
4602024-02-18T04:53:04.567Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-18T04:53:04.592Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-02-18T04:53:04.592Z+ set +x
4632024-02-18T04:53:04.592ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4642024-02-18T04:53:04.592Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-02-18T04:53:04.592Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4662024-02-18T04:53:04.592Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4672024-02-18T04:53:04.592Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4682024-02-18T04:53:04.592ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4692024-02-18T04:53:04.592Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-02-18T04:53:04.592Z0+0 records in
4712024-02-18T04:53:04.592Z0+0 records out
4722024-02-18T04:53:04.592Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-02-18T04:53:04.592Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-02-18T04:53:04.592Z+ set +x
4752024-02-18T04:53:04.592ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-02-18T04:53:04.593Z++ zpool list -o name
4772024-02-18T04:53:04.617Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-02-18T04:53:04.617Z+ [[ -z '' ]]
4792024-02-18T04:53:04.617Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-18T04:53:04.641Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-02-18T04:53:04.641Z+ set +x
4822024-02-18T04:53:04.641ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-02-18T04:53:04.641Z+ [[ zone == \z\o\n\e ]]
4842024-02-18T04:53:04.641Z+ ensure_simulated_links igb0
4852024-02-18T04:53:04.642Z+ local PHYSICAL_LINK=igb0
4862024-02-18T04:53:04.642Z+ INDICES=("0" "1")
4872024-02-18T04:53:04.642Z+ for I in "${INDICES[@]}"
4882024-02-18T04:53:04.642Z++ get_simnet_name_if_exists net0
4892024-02-18T04:53:04.642Z++ dladm show-simnet -p -o LINK net0
4902024-02-18T04:53:04.642Z++ echo ''
4912024-02-18T04:53:04.642Z+ [[ -z '' ]]
4922024-02-18T04:53:04.642Z+ dladm create-simnet -t net0
4932024-02-18T04:53:04.642Z+ dladm create-simnet -t sc0_0
4942024-02-18T04:53:04.666Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-02-18T04:53:04.666Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-02-18T04:53:04.666Z+ success 'Simnet net0/sc0_0 exists'
4972024-02-18T04:53:04.666Z+ set +x
4982024-02-18T04:53:04.666ZSimnet net0/sc0_0 exists
4992024-02-18T04:53:04.666Z+ for I in "${INDICES[@]}"
5002024-02-18T04:53:04.667Z++ get_simnet_name_if_exists net1
5012024-02-18T04:53:04.667Z++ dladm show-simnet -p -o LINK net1
5022024-02-18T04:53:04.667Z++ echo ''
5032024-02-18T04:53:04.667Z+ [[ -z '' ]]
5042024-02-18T04:53:04.667Z+ dladm create-simnet -t net1
5052024-02-18T04:53:04.667Z+ dladm create-simnet -t sc1_0
5062024-02-18T04:53:04.667Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-02-18T04:53:04.691Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-02-18T04:53:04.691Z+ success 'Simnet net1/sc1_0 exists'
5092024-02-18T04:53:04.691Z+ set +x
5102024-02-18T04:53:04.691ZSimnet net1/sc1_0 exists
5112024-02-18T04:53:04.692Z++ get_vnic_name_if_exists sc0_1
5122024-02-18T04:53:04.692Z++ dladm show-vnic -p -o LINK sc0_1
5132024-02-18T04:53:04.692Z++ echo ''
5142024-02-18T04:53:04.692Z+ [[ -z '' ]]
5152024-02-18T04:53:04.692Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-02-18T04:53:04.692Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-02-18T04:53:04.692Z+ success 'Vnic sc0_1 exists'
5182024-02-18T04:53:04.692Z+ set +x
5192024-02-18T04:53:04.692ZVnic sc0_1 exists
5202024-02-18T04:53:04.692Z+ warn_if_no_proxy_arp
5212024-02-18T04:53:04.692Z+ [[ -v PXA_START ]]
5222024-02-18T04:53:04.692Z+ [[ -v PXA_END ]]
5232024-02-18T04:53:04.692Z+ ensure_softnpu_zone
5242024-02-18T04:53:04.692Z+ zoneadm list
5252024-02-18T04:53:04.692Z+ grep -q sidecar_softnpu
5262024-02-18T04:53:04.719Z+ [[ -f out/npuzone/npuzone ]]
5272024-02-18T04:53:04.720Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-02-18T04:53:04.720Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-02-18T04:53:15.396Zdownloading softnpu ...done
5302024-02-18T04:53:15.420Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-02-18T04:53:20.620Zdownloading asic_program.so ...done
5322024-02-18T04:53:20.645Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-02-18T04:53:26.825Zdownloading scadm ...done
5342024-02-18T04:53:26.849Zcreating port tfportrear0_0 for sc0_0
5352024-02-18T04:53:26.849Zcreating port tfportqsfp0_0 for sc0_1
5362024-02-18T04:53:26.873Zsoftnpu zone setup
5372024-02-18T04:53:26.873Zconfigure zone
5382024-02-18T04:53:26.873Zinstall zone
5392024-02-18T04:53:27.912Zboot zone
5402024-02-18T04:53:31.034Z[sidecar_softnpu] svcs milestone/network
5412024-02-18T04:53:31.062ZSTATE STIME FMRI
5422024-02-18T04:53:31.062Zonline 4:53:29 svc:/milestone/network:default
5432024-02-18T04:53:31.062Z[sidecar_softnpu] /softnpu/npu start
5442024-02-18T04:53:31.086Z
5452024-02-18T04:53:31.086Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-02-18T04:53:31.086Z+ GATEWAY_IP=10.151.1.100
5472024-02-18T04:53:31.086Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-02-18T04:53:31.086ZUsing 10.151.1.100 as gateway ip
5492024-02-18T04:53:31.086Z+ [[ ! -v GATEWAY_MAC ]]
5502024-02-18T04:53:31.086Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-02-18T04:53:31.110Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-02-18T04:53:31.110Z+++ echo 18:c0:4d:0d:9f:b2
5532024-02-18T04:53:31.110Z+ COUNT=1
5542024-02-18T04:53:31.110Z+ [[ 1 -ne 1 ]]
5552024-02-18T04:53:31.110Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-02-18T04:53:31.110ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-02-18T04:53:31.110Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-02-18T04:53:31.110Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-02-18T04:53:31.137Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-02-18T04:53:31.137Z+ [[ -v PXA_START ]]
5612024-02-18T04:53:31.137Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-02-18T04:53:31.137Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-02-18T04:53:31.161Z+ z_scadm dump-state
5642024-02-18T04:53:31.161Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-02-18T04:53:31.186Zlocal v6:
5662024-02-18T04:53:31.186Zlocal v4:
5672024-02-18T04:53:31.186Zrouter v6:
5682024-02-18T04:53:31.186Zrouter v4_idx:
5692024-02-18T04:53:31.186Zrouter v4_routes:
5702024-02-18T04:53:31.186Zresolver v4:
5712024-02-18T04:53:31.186Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-02-18T04:53:31.186Zresolver v6:
5732024-02-18T04:53:31.186Znat v4:
5742024-02-18T04:53:31.186Znat_v6:
5752024-02-18T04:53:31.186Zport_mac:
5762024-02-18T04:53:31.186Zproxy arp:
5772024-02-18T04:53:31.186Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-02-18T04:53:31.186Z+ success 'softnpu zone exists'
5792024-02-18T04:53:31.186Z+ set +x
5802024-02-18T04:53:31.186Zsoftnpu zone exists
5812024-02-18T04:53:31.186Z
5822024-02-18T04:53:31.186Zreal 27.042674844
5832024-02-18T04:53:31.186Zuser 0.695116243
5842024-02-18T04:53:31.186Zsys 1.566397501
5852024-02-18T04:53:31.187Ztrap 0.000071938
5862024-02-18T04:53:31.187Ztflt 0.000133848
5872024-02-18T04:53:31.187Zdflt 0.001310377
5882024-02-18T04:53:31.187Zkflt 0.000000000
5892024-02-18T04:53:31.187Zlock 21:04.411018030
5902024-02-18T04:53:31.187Zslp 1:20.836055873
5912024-02-18T04:53:31.187Zlat 0.083059003
5922024-02-18T04:53:31.187Zstop 0.336601479
5932024-02-18T04:53:31.187Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-02-18T04:53:31.219Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-02-18T04:53:31.272Z+ SILO_NAME=recovery
5962024-02-18T04:53:31.272Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-02-18T04:53:31.272Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-02-18T04:53:31.272Z+ sed -i~ '
5992024-02-18T04:53:31.272Z /^external_dns_ips/c\
6002024-02-18T04:53:31.272Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-02-18T04:53:31.273Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-02-18T04:53:31.273Z /^first/c\
6032024-02-18T04:53:31.273Zfirst = "10.151.1.164"
6042024-02-18T04:53:31.273Z /^last/c\
6052024-02-18T04:53:31.273Zlast = "10.151.1.173"
6062024-02-18T04:53:31.273Z }
6072024-02-18T04:53:31.273Z /^\[rack_network_config/,/^$/ {
6082024-02-18T04:53:31.273Z /^infra_ip_first/c\
6092024-02-18T04:53:31.274Zinfra_ip_first = "10.151.1.174"
6102024-02-18T04:53:31.274Z /^infra_ip_last/c\
6112024-02-18T04:53:31.274Zinfra_ip_last = "10.151.1.174"
6122024-02-18T04:53:31.274Z }
6132024-02-18T04:53:31.274Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-02-18T04:53:31.274Z /^routes/c\
6152024-02-18T04:53:31.274Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-02-18T04:53:31.274Z /^addresses/c\
6172024-02-18T04:53:31.274Zaddresses = \["10.151.1.174/24"\]
6182024-02-18T04:53:31.274Z }
6192024-02-18T04:53:31.275Z' pkg/config-rss.toml
6202024-02-18T04:53:31.275Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-02-18T04:53:31.275Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-02-18T04:53:31.275Z+++ pkg/config-rss.toml Sun Feb 18 04:53:31 2024
6232024-02-18T04:53:31.275Z@@ -33,7 +33,7 @@
6242024-02-18T04:53:31.275Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-02-18T04:53:31.275Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-02-18T04:53:31.275Z # below.
6272024-02-18T04:53:31.275Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-02-18T04:53:31.275Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-02-18T04:53:31.276Z
6302024-02-18T04:53:31.276Z # Initial TLS certificates for the external API
6312024-02-18T04:53:31.276Z #
6322024-02-18T04:53:31.276Z@@ -69,8 +69,8 @@
6332024-02-18T04:53:31.276Z #
6342024-02-18T04:53:31.276Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-02-18T04:53:31.276Z [[internal_services_ip_pool_ranges]]
6362024-02-18T04:53:31.276Z-first = "192.168.1.20"
6372024-02-18T04:53:31.277Z-last = "192.168.1.29"
6382024-02-18T04:53:31.277Z+first = "10.151.1.164"
6392024-02-18T04:53:31.277Z+last = "10.151.1.173"
6402024-02-18T04:53:31.277Z
6412024-02-18T04:53:31.277Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-02-18T04:53:31.277Z # parameters should be provided to the control plane via wicket, but we need to
6432024-02-18T04:53:31.277Z@@ -100,9 +100,9 @@
6442024-02-18T04:53:31.278Z # You can configure multiple uplinks by repeating the following stanza
6452024-02-18T04:53:31.278Z [[rack_network_config.ports]]
6462024-02-18T04:53:31.278Z # Routes associated with this port.
6472024-02-18T04:53:31.278Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6482024-02-18T04:53:31.278Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6492024-02-18T04:53:31.278Z # Addresses associated with this port.
6502024-02-18T04:53:31.278Z-addresses = ["192.168.1.30/24"]
6512024-02-18T04:53:31.278Z+addresses = ["10.151.1.174/24"]
6522024-02-18T04:53:31.279Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6532024-02-18T04:53:31.279Z port = "qsfp0"
6542024-02-18T04:53:31.279Z # The speed of this port.
6552024-02-18T04:53:31.279Z+ true
6562024-02-18T04:53:31.279Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6572024-02-18T04:53:31.279Za pkg/config-rss.toml 7K
6582024-02-18T04:53:31.279Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6592024-02-18T04:53:31.280Z+ TLS_NAME=recovery.sys.oxide.test
6602024-02-18T04:53:31.280Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6612024-02-18T04:53:31.828Z.+....+.....+.+...+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+...........+......................+...+..+..........+.....+..........+..............+...+...............+...+..........+.....+....+.....+.+..................+..+.........+.+..+...+...+.......+...............+..................+.....+....+...........+....+.....+................+......+...+..+...+.........................+........+.......+......+..+....+........+.......+.....+................+........+....+...+.........+.....+....+..+............+...+.......+..+....+.....+.+...+...+...............+..+.+......+........+......+.+.....+...+..........+...+...+..+..........+.....+............+.+.....+..........+......+...+......+.....+.+.....+......+...+....+...+........+..........+...............+..+....+...........+...+............+.......+.....+.+..............+...+............+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6622024-02-18T04:53:32.799Z.........+..+.+.................+...+...+.......+............+.....+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+......+.+...+.....+.........+.+......+.........+.........+.....+.+......+........+......+.+...........+...+....+...........+.+...........+...+......+...+.+......+...+........+...+....+......+...........+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+....+...+.........+.....+......+............+.......+........+..........+......+...........+.....................+....+...+...+...............+............+..+.+...+.........+...............+.................+.+...+.....+..........+..+.........+......+...+.....................+..................................+......+...............+.....+.........+.+.....+.........+.......+...+.....+..........+..............+...+....+...+........+.......+......+.....+............+...+.........................+.........+.....+.+..+.......+............+...+...............+..+....+.....+......+...+.+..+.........+...............+.........................+.....+...+...+..........+..+.............+..+.+.....+.+..................+..+......+....+.....+....+.........+..+..........+...........+.............+.........+...+..+.+.....+..........+.....+....+...........+........................+.+..+...................+..................+...+..............+.+..+.......+........+......+..........................................+....+...+...........+....+.....+...............+.............+..+...+....+...+..+......+..........+...+...............+.........+......+......+.....+.+..+.+....................+......+..........+.....+....+.....+.......+.................+..........+.....+......+..........+.....+......+...+.........................+.................+.............+.....+...+....+...........+....+...+...+..+.......+.....+......+....+...........+...+.......+...+..+.........+.+...+.........+..+......+.............+...........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6632024-02-18T04:53:32.829Z-----
6642024-02-18T04:53:32.829Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6652024-02-18T04:53:32.829Za pkg/initial-tls-cert.pem 2K
6662024-02-18T04:53:32.829Za pkg/initial-tls-key.pem 4K
6672024-02-18T04:53:32.830Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6682024-02-18T04:53:32.830Z+ rmdir pkg
6692024-02-18T04:53:32.859Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6702024-02-18T04:53:32.859Z+ pfexec mkdir -p /usr/oxide
6712024-02-18T04:53:32.859Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6722024-02-18T04:53:33.484Z+ pfexec chmod +x /usr/oxide/oxide
6732024-02-18T04:53:33.508Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6742024-02-18T04:53:51.866Z+ OMICRON_NO_UNINSTALL=1
6752024-02-18T04:53:51.867Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6762024-02-18T04:53:51.891ZLogging to: /opt/oxide/work/out/LOG
6772024-02-18T04:53:52.376Z
6782024-02-18T04:53:52.401Zreal 0.504386236
6792024-02-18T04:53:52.401Zuser 0.110163597
6802024-02-18T04:53:52.401Zsys 1.967481818
6812024-02-18T04:53:52.401Ztrap 0.000002139
6822024-02-18T04:53:52.401Ztflt 0.000485885
6832024-02-18T04:53:52.401Zdflt 0.000419841
6842024-02-18T04:53:52.401Zkflt 0.000000000
6852024-02-18T04:53:52.401Zlock 45.836825264
6862024-02-18T04:53:52.401Zslp 0.707372125
6872024-02-18T04:53:52.401Zlat 0.003240472
6882024-02-18T04:53:52.401Zstop 0.211507353
6892024-02-18T04:53:52.401Z+ retry=0
6902024-02-18T04:53:52.401Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6912024-02-18T04:53:52.401Z+ [[ 0 -gt 30 ]]
6922024-02-18T04:53:52.401Z+ sleep 1
6932024-02-18T04:53:53.391Z+ retry=1
6942024-02-18T04:53:53.391Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6952024-02-18T04:53:53.415Z+ [[ 1 -gt 30 ]]
6962024-02-18T04:53:53.416Z+ sleep 1
6972024-02-18T04:53:54.406Z+ retry=2
6982024-02-18T04:53:54.406Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6992024-02-18T04:53:54.430Z+ [[ 2 -gt 30 ]]
7002024-02-18T04:53:54.430Z+ sleep 1
7012024-02-18T04:53:55.420Z+ retry=3
7022024-02-18T04:53:55.420Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7032024-02-18T04:53:55.444Z+ [[ 3 -gt 30 ]]
7042024-02-18T04:53:55.444Z+ sleep 1
7052024-02-18T04:53:56.434Z+ retry=4
7062024-02-18T04:53:56.434Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-02-18T04:54:21.603Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7082024-02-18T04:54:21.630Zlocal v6:
7092024-02-18T04:54:21.630Zfd7c:c283:c70d:c095::1
7102024-02-18T04:54:21.630Zfe80::844e:c3ff:fea7:f602
7112024-02-18T04:54:21.630Zlocal v4:
7122024-02-18T04:54:21.630Z10.151.1.174
7132024-02-18T04:54:21.630Zrouter v6:
7142024-02-18T04:54:21.630Zfd00:1122:3344:101::/64 -> fe80::2c49:1aff:feaa:c273 (1)
7152024-02-18T04:54:21.630Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::2c49:1aff:feaa:c273 (1)
7162024-02-18T04:54:21.630Zfd00:1122:3344:2::/64 -> fe80::2c49:1aff:feaa:c273 (1)
7172024-02-18T04:54:21.630Zfd00:1122:3344:3::/64 -> fe80::2c49:1aff:feaa:c273 (1)
7182024-02-18T04:54:21.630Zfd00:1122:3344:1::/64 -> fe80::2c49:1aff:feaa:c273 (1)
7192024-02-18T04:54:21.630Zrouter v4_idx:
7202024-02-18T04:54:21.630Z0.0.0.0/0 -> 0
7212024-02-18T04:54:21.630Zrouter v4_routes:
7222024-02-18T04:54:21.630Z0 -> 10.151.1.100 (2)
7232024-02-18T04:54:21.630Zresolver v4:
7242024-02-18T04:54:21.654Z10.151.1.174 -> 3a:02:61:ae:8d:84
7252024-02-18T04:54:21.655Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7262024-02-18T04:54:21.655Zresolver v6:
7272024-02-18T04:54:21.655Zfe80::844e:c3ff:fea7:f602 -> 86:4e:c3:a7:f6:02
7282024-02-18T04:54:21.655Zfe80::2c49:1aff:feaa:c273 -> 2e:49:1a:aa:c2:73
7292024-02-18T04:54:21.655Znat v4:
7302024-02-18T04:54:21.655Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:9a:c9
7312024-02-18T04:54:21.655Znat_v6:
7322024-02-18T04:54:21.655Zport_mac:
7332024-02-18T04:54:21.655Z1: a8:40:25:6a:7d:25
7342024-02-18T04:54:21.655Z2: a8:40:25:6a:7d:45
7352024-02-18T04:54:21.655Z1000: a8:40:25:6a:7d:24
7362024-02-18T04:54:21.655Zproxy arp:
7372024-02-18T04:54:21.655Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7382024-02-18T04:54:21.655Z+ retry=0
7392024-02-18T04:54:21.655Z+++ zoneadm list -n
7402024-02-18T04:54:21.655Z+++ grep oxz_ntp
7412024-02-18T04:54:21.655Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
7422024-02-18T04:54:21.680Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7432024-02-18T04:54:21.680Z++ true
7442024-02-18T04:54:21.680Z+ [[ '' != online ]]
7452024-02-18T04:54:21.680Z+ [[ 0 -gt 60 ]]
7462024-02-18T04:54:21.680Z+ sleep 1
7472024-02-18T04:54:22.664Z+ retry=1
7482024-02-18T04:54:22.688Z+++ zoneadm list -n
7492024-02-18T04:54:22.688Z+++ grep oxz_ntp
7502024-02-18T04:54:22.688Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
7512024-02-18T04:54:22.713Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7522024-02-18T04:54:22.713Z++ true
7532024-02-18T04:54:22.713Z+ [[ '' != online ]]
7542024-02-18T04:54:22.713Z+ [[ 1 -gt 60 ]]
7552024-02-18T04:54:22.713Z+ sleep 1
7562024-02-18T04:54:23.695Z+ retry=2
7572024-02-18T04:54:23.719Z+++ zoneadm list -n
7582024-02-18T04:54:23.719Z+++ grep oxz_ntp
7592024-02-18T04:54:23.719Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
7602024-02-18T04:54:23.743Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7612024-02-18T04:54:23.743Z++ true
7622024-02-18T04:54:23.743Z+ [[ '' != online ]]
7632024-02-18T04:54:23.743Z+ [[ 2 -gt 60 ]]
7642024-02-18T04:54:23.744Z+ sleep 1
7652024-02-18T04:54:24.725Z+ retry=3
7662024-02-18T04:54:24.748Z+++ zoneadm list -n
7672024-02-18T04:54:24.749Z+++ grep oxz_ntp
7682024-02-18T04:54:24.749Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
7692024-02-18T04:54:24.749Z+ [[ disabled != online ]]
7702024-02-18T04:54:24.749Z+ [[ 3 -gt 60 ]]
7712024-02-18T04:54:24.749Z+ sleep 1
7722024-02-18T04:54:25.749Z+ retry=4
7732024-02-18T04:54:25.773Z+++ zoneadm list -n
7742024-02-18T04:54:25.773Z+++ grep oxz_ntp
7752024-02-18T04:54:25.773Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
7762024-02-18T04:54:25.773Z+ [[ disabled != online ]]
7772024-02-18T04:54:25.773Z+ [[ 4 -gt 60 ]]
7782024-02-18T04:54:25.773Z+ sleep 1
7792024-02-18T04:54:26.770Z+ retry=5
7802024-02-18T04:54:26.795Z+++ zoneadm list -n
7812024-02-18T04:54:26.795Z+++ grep oxz_ntp
7822024-02-18T04:54:26.795Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
7832024-02-18T04:54:26.796Z+ [[ disabled != online ]]
7842024-02-18T04:54:26.796Z+ [[ 5 -gt 60 ]]
7852024-02-18T04:54:26.796Z+ sleep 1
7862024-02-18T04:54:27.795Z+ retry=6
7872024-02-18T04:54:27.820Z+++ zoneadm list -n
7882024-02-18T04:54:27.820Z+++ grep oxz_ntp
7892024-02-18T04:54:27.820Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
7902024-02-18T04:54:27.820Z+ [[ disabled != online ]]
7912024-02-18T04:54:27.820Z+ [[ 6 -gt 60 ]]
7922024-02-18T04:54:27.820Z+ sleep 1
7932024-02-18T04:54:28.815Z+ retry=7
7942024-02-18T04:54:28.842Z+++ zoneadm list -n
7952024-02-18T04:54:28.842Z+++ grep oxz_ntp
7962024-02-18T04:54:28.842Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
7972024-02-18T04:54:28.842Z+ [[ disabled != online ]]
7982024-02-18T04:54:28.842Z+ [[ 7 -gt 60 ]]
7992024-02-18T04:54:28.842Z+ sleep 1
8002024-02-18T04:54:29.836Z+ retry=8
8012024-02-18T04:54:29.861Z+++ zoneadm list -n
8022024-02-18T04:54:29.861Z+++ grep oxz_ntp
8032024-02-18T04:54:29.861Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
8042024-02-18T04:54:29.861Z+ [[ disabled != online ]]
8052024-02-18T04:54:29.861Z+ [[ 8 -gt 60 ]]
8062024-02-18T04:54:29.861Z+ sleep 1
8072024-02-18T04:54:30.859Z+ retry=9
8082024-02-18T04:54:30.909Z+++ zoneadm list -n
8092024-02-18T04:54:30.909Z+++ grep oxz_ntp
8102024-02-18T04:54:30.909Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
8112024-02-18T04:54:30.933Z+ [[ disabled != online ]]
8122024-02-18T04:54:30.933Z+ [[ 9 -gt 60 ]]
8132024-02-18T04:54:30.933Z+ sleep 1
 
8142024-02-18T04:54:31.038Zbuskin console login: Feb 18 04:54:30 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8152024-02-18T04:54:31.880Z+ retry=10
8162024-02-18T04:54:31.904Z+++ zoneadm list -n
8172024-02-18T04:54:31.904Z+++ grep oxz_ntp
8182024-02-18T04:54:31.904Z++ pfexec svcs -z oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970 -Hostate oxide/ntp
8192024-02-18T04:54:31.904Z+ [[ online != online ]]
8202024-02-18T04:54:31.904Z+ echo 'Waited for chrony: 10s'
8212024-02-18T04:54:31.904ZWaited for chrony: 10s
8222024-02-18T04:54:31.905Z+ export RUST_BACKTRACE=1
8232024-02-18T04:54:31.905Z+ RUST_BACKTRACE=1
8242024-02-18T04:54:31.905Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8252024-02-18T04:54:31.905Z++ ./tests/bootstrap
8262024-02-18T04:54:31.929ZUsing external DNS server at 10.151.1.164:53
8272024-02-18T04:54:31.956Z2024-02-18 04:54:31.920095627 UTC: attempting to log into API
8282024-02-18T04:54:46.969Z2024-02-18 04:54:46.957506607 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8292024-02-18T04:54:47.970Z2024-02-18 04:54:47.958593173 UTC: attempting to log into API
8302024-02-18T04:55:03.002Z2024-02-18 04:55:02.990054236 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8312024-02-18T04:55:04.003Z2024-02-18 04:55:03.991171163 UTC: attempting to log into API
8322024-02-18T04:55:19.053Z2024-02-18 04:55:19.041342265 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8332024-02-18T04:55:20.054Z2024-02-18 04:55:20.042391870 UTC: attempting to log into API
8342024-02-18T04:55:35.099Z2024-02-18 04:55:35.083001809 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8352024-02-18T04:55:36.096Z2024-02-18 04:55:36.085052623 UTC: attempting to log into API
8362024-02-18T04:55:53.496Z2024-02-18 04:55:53.480800704 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8372024-02-18T04:55:54.495Z2024-02-18 04:55:54.481691627 UTC: attempting to log into API
8382024-02-18T04:56:09.601Z2024-02-18 04:56:09.571671140 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8392024-02-18T04:56:10.585Z2024-02-18 04:56:10.573544982 UTC: attempting to log into API
 
8402024-02-18T04:56:18.226ZFeb 18 04:56:17 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8412024-02-18T04:56:24.192ZFeb 18 04:56:23 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
8422024-02-18T04:56:25.696Z2024-02-18 04:56:25.684571537 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8432024-02-18T04:56:26.697Z2024-02-18 04:56:26.685663684 UTC: attempting to log into API
 
8442024-02-18T04:56:31.431ZFeb 18 04:56:30 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
8452024-02-18T04:56:37.653ZFeb 18 04:56:36 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
8462024-02-18T04:56:41.728Z2024-02-18 04:56:41.717267097 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8472024-02-18T04:56:42.730Z2024-02-18 04:56:42.718299552 UTC: attempting to log into API
 
8482024-02-18T04:56:44.121ZFeb 18 04:56:43 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8492024-02-18T04:56:57.760Z2024-02-18 04:56:57.749465927 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8502024-02-18T04:56:58.762Z2024-02-18 04:56:58.750572943 UTC: attempting to log into API
8512024-02-18T04:56:59.551Z2024-02-18 04:56:59.540128401 UTC: login succeeded
8522024-02-18T04:56:59.583Zwaiting for nexus to come up...
8532024-02-18T04:56:59.656Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8542024-02-18T04:56:59.860Zsetting up quotas...
8552024-02-18T04:56:59.915Zensuring datasets are ready...
8562024-02-18T04:57:02.612Zlet's roll.
8572024-02-18T04:57:02.637Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8582024-02-18T04:57:02.637ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8592024-02-18T04:57:02.637ZOXIDE_TOKEN=oxide-token-2c4c462e7efef55af223728ba7192accf5d2f165'
8602024-02-18T04:57:02.637Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8612024-02-18T04:57:02.637Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8622024-02-18T04:57:02.637Z++ OXIDE_TOKEN=oxide-token-2c4c462e7efef55af223728ba7192accf5d2f165
8632024-02-18T04:57:02.637Z+ export OXIDE_HOST OXIDE_TOKEN
8642024-02-18T04:57:02.637Z+ retry=0
8652024-02-18T04:57:02.637Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8662024-02-18T04:57:02.670Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8672024-02-18T04:57:02.694Z+ [[ 0 -gt 60 ]]
8682024-02-18T04:57:02.695Z+ sleep 1
8692024-02-18T04:57:03.674Z+ retry=1
8702024-02-18T04:57:03.674Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8712024-02-18T04:57:03.700Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8722024-02-18T04:57:03.700Z+ [[ 1 -gt 60 ]]
8732024-02-18T04:57:03.700Z+ sleep 1
8742024-02-18T04:57:04.689Z+ retry=2
8752024-02-18T04:57:04.689Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8762024-02-18T04:57:04.714Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8772024-02-18T04:57:04.714Z+ [[ 2 -gt 60 ]]
8782024-02-18T04:57:04.714Z+ sleep 1
8792024-02-18T04:57:05.704Z+ retry=3
8802024-02-18T04:57:05.704Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8812024-02-18T04:57:05.729Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8822024-02-18T04:57:05.729Z+ [[ 3 -gt 60 ]]
8832024-02-18T04:57:05.729Z+ sleep 1
8842024-02-18T04:57:06.718Z+ retry=4
8852024-02-18T04:57:06.719Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8862024-02-18T04:57:06.743Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8872024-02-18T04:57:06.743Z+ [[ 4 -gt 60 ]]
8882024-02-18T04:57:06.743Z+ sleep 1
8892024-02-18T04:57:07.737Z+ retry=5
8902024-02-18T04:57:07.737Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8912024-02-18T04:57:07.761Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8922024-02-18T04:57:07.761Z+ [[ 5 -gt 60 ]]
8932024-02-18T04:57:07.761Z+ sleep 1
8942024-02-18T04:57:08.749Z+ retry=6
8952024-02-18T04:57:08.749Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8962024-02-18T04:57:08.774Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8972024-02-18T04:57:08.774Z+ [[ 6 -gt 60 ]]
8982024-02-18T04:57:08.774Z+ sleep 1
8992024-02-18T04:57:09.764Z+ retry=7
9002024-02-18T04:57:09.764Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9012024-02-18T04:57:09.789Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9022024-02-18T04:57:09.789Z+ [[ 7 -gt 60 ]]
9032024-02-18T04:57:09.789Z+ sleep 1
9042024-02-18T04:57:10.780Z+ retry=8
9052024-02-18T04:57:10.780Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9062024-02-18T04:57:10.805Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9072024-02-18T04:57:10.805Z+ [[ 8 -gt 60 ]]
9082024-02-18T04:57:10.805Z+ sleep 1
9092024-02-18T04:57:11.797Z+ retry=9
9102024-02-18T04:57:11.797Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9112024-02-18T04:57:11.821Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9122024-02-18T04:57:11.821Z+ [[ 9 -gt 60 ]]
9132024-02-18T04:57:11.822Z+ sleep 1
9142024-02-18T04:57:12.811Z+ retry=10
9152024-02-18T04:57:12.811Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9162024-02-18T04:57:12.835Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9172024-02-18T04:57:12.835Z+ [[ 10 -gt 60 ]]
9182024-02-18T04:57:12.835Z+ sleep 1
9192024-02-18T04:57:13.826Z+ retry=11
9202024-02-18T04:57:13.826Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9212024-02-18T04:57:13.850Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9222024-02-18T04:57:13.850Z+ [[ 11 -gt 60 ]]
9232024-02-18T04:57:13.850Z+ sleep 1
9242024-02-18T04:57:14.841Z+ retry=12
9252024-02-18T04:57:14.841Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9262024-02-18T04:57:14.865Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9272024-02-18T04:57:14.866Z+ [[ 12 -gt 60 ]]
9282024-02-18T04:57:14.866Z+ sleep 1
9292024-02-18T04:57:15.856Z+ retry=13
9302024-02-18T04:57:15.857Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9312024-02-18T04:57:15.907Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9322024-02-18T04:57:15.907Z+ [[ 13 -gt 60 ]]
9332024-02-18T04:57:15.907Z+ sleep 1
9342024-02-18T04:57:16.872Z+ retry=14
9352024-02-18T04:57:16.872Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9362024-02-18T04:57:16.897Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9372024-02-18T04:57:16.897Z+ [[ 14 -gt 60 ]]
9382024-02-18T04:57:16.897Z+ sleep 1
9392024-02-18T04:57:17.887Z+ retry=15
9402024-02-18T04:57:17.887Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9412024-02-18T04:57:17.913Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9422024-02-18T04:57:17.913Z+ [[ 15 -gt 60 ]]
9432024-02-18T04:57:17.913Z+ sleep 1
9442024-02-18T04:57:18.902Z+ retry=16
9452024-02-18T04:57:18.902Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9462024-02-18T04:57:18.927Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9472024-02-18T04:57:18.927Z+ [[ 16 -gt 60 ]]
9482024-02-18T04:57:18.927Z+ sleep 1
9492024-02-18T04:57:19.918Z+ retry=17
9502024-02-18T04:57:19.918Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9512024-02-18T04:57:19.943Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9522024-02-18T04:57:19.943Z+ [[ 17 -gt 60 ]]
9532024-02-18T04:57:19.943Z+ sleep 1
9542024-02-18T04:57:20.933Z+ retry=18
9552024-02-18T04:57:20.933Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9562024-02-18T04:57:20.957Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9572024-02-18T04:57:20.957Z+ [[ 18 -gt 60 ]]
9582024-02-18T04:57:20.957Z+ sleep 1
9592024-02-18T04:57:21.949Z+ retry=19
9602024-02-18T04:57:21.949Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9612024-02-18T04:57:21.977Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9622024-02-18T04:57:21.977Z+ [[ 19 -gt 60 ]]
9632024-02-18T04:57:21.977Z+ sleep 1
9642024-02-18T04:57:22.964Z+ retry=20
9652024-02-18T04:57:22.964Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9662024-02-18T04:57:22.989Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9672024-02-18T04:57:22.989Z+ [[ 20 -gt 60 ]]
9682024-02-18T04:57:22.989Z+ sleep 1
9692024-02-18T04:57:23.979Z+ retry=21
9702024-02-18T04:57:23.979Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9712024-02-18T04:57:24.004Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9722024-02-18T04:57:24.004Z+ [[ 21 -gt 60 ]]
9732024-02-18T04:57:24.004Z+ sleep 1
9742024-02-18T04:57:24.994Z+ retry=22
9752024-02-18T04:57:24.995Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9762024-02-18T04:57:25.019Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9772024-02-18T04:57:25.019Z+ [[ 22 -gt 60 ]]
9782024-02-18T04:57:25.019Z+ sleep 1
9792024-02-18T04:57:26.010Z+ retry=23
9802024-02-18T04:57:26.010Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9812024-02-18T04:57:26.034Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9822024-02-18T04:57:26.034Z+ [[ 23 -gt 60 ]]
9832024-02-18T04:57:26.034Z+ sleep 1
9842024-02-18T04:57:27.025Z+ retry=24
9852024-02-18T04:57:27.025Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9862024-02-18T04:57:27.049Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9872024-02-18T04:57:27.050Z+ [[ 24 -gt 60 ]]
9882024-02-18T04:57:27.050Z+ sleep 1
9892024-02-18T04:57:28.042Z+ retry=25
9902024-02-18T04:57:28.066Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9912024-02-18T04:57:28.066Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9922024-02-18T04:57:28.066Z+ [[ 25 -gt 60 ]]
9932024-02-18T04:57:28.066Z+ sleep 1
9942024-02-18T04:57:29.058Z+ retry=26
9952024-02-18T04:57:29.058Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9962024-02-18T04:57:29.082Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9972024-02-18T04:57:29.083Z+ [[ 26 -gt 60 ]]
9982024-02-18T04:57:29.083Z+ sleep 1
9992024-02-18T04:57:30.073Z+ retry=27
10002024-02-18T04:57:30.073Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10012024-02-18T04:57:30.098Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10022024-02-18T04:57:30.098Z+ [[ 27 -gt 60 ]]
10032024-02-18T04:57:30.098Z+ sleep 1
10042024-02-18T04:57:31.089Z+ retry=28
10052024-02-18T04:57:31.089Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10062024-02-18T04:57:31.114Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10072024-02-18T04:57:31.114Z+ [[ 28 -gt 60 ]]
10082024-02-18T04:57:31.114Z+ sleep 1
10092024-02-18T04:57:32.104Z+ retry=29
10102024-02-18T04:57:32.104Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10112024-02-18T04:57:32.128Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10122024-02-18T04:57:32.128Z+ [[ 29 -gt 60 ]]
10132024-02-18T04:57:32.129Z+ sleep 1
10142024-02-18T04:57:33.119Z+ retry=30
10152024-02-18T04:57:33.119Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10162024-02-18T04:57:33.144Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10172024-02-18T04:57:33.144Z+ [[ 30 -gt 60 ]]
10182024-02-18T04:57:33.144Z+ sleep 1
10192024-02-18T04:57:34.135Z+ retry=31
10202024-02-18T04:57:34.135Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10212024-02-18T04:57:34.159Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10222024-02-18T04:57:34.159Z+ [[ 31 -gt 60 ]]
10232024-02-18T04:57:34.159Z+ sleep 1
10242024-02-18T04:57:35.149Z+ retry=32
10252024-02-18T04:57:35.149Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10262024-02-18T04:57:35.174Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10272024-02-18T04:57:35.174Z+ [[ 32 -gt 60 ]]
10282024-02-18T04:57:35.174Z+ sleep 1
10292024-02-18T04:57:36.164Z+ retry=33
10302024-02-18T04:57:36.164Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10312024-02-18T04:57:36.188Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10322024-02-18T04:57:36.188Z+ [[ 33 -gt 60 ]]
10332024-02-18T04:57:36.188Z+ sleep 1
10342024-02-18T04:57:37.179Z+ retry=34
10352024-02-18T04:57:37.179Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10362024-02-18T04:57:37.203Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10372024-02-18T04:57:37.204Z+ [[ 34 -gt 60 ]]
10382024-02-18T04:57:37.204Z+ sleep 1
10392024-02-18T04:57:38.195Z+ retry=35
10402024-02-18T04:57:38.195Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10412024-02-18T04:57:38.220Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10422024-02-18T04:57:38.220Z+ [[ 35 -gt 60 ]]
10432024-02-18T04:57:38.220Z+ sleep 1
10442024-02-18T04:57:39.210Z+ retry=36
10452024-02-18T04:57:39.210Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10462024-02-18T04:57:39.234Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10472024-02-18T04:57:39.234Z+ [[ 36 -gt 60 ]]
10482024-02-18T04:57:39.235Z+ sleep 1
10492024-02-18T04:57:40.226Z+ retry=37
10502024-02-18T04:57:40.226Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10512024-02-18T04:57:40.251Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10522024-02-18T04:57:40.251Z+ [[ 37 -gt 60 ]]
10532024-02-18T04:57:40.251Z+ sleep 1
10542024-02-18T04:57:41.241Z+ retry=38
10552024-02-18T04:57:41.241Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10562024-02-18T04:57:41.265Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10572024-02-18T04:57:41.265Z+ [[ 38 -gt 60 ]]
10582024-02-18T04:57:41.265Z+ sleep 1
10592024-02-18T04:57:42.256Z+ retry=39
10602024-02-18T04:57:42.256Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10612024-02-18T04:57:42.281Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10622024-02-18T04:57:42.281Z+ [[ 39 -gt 60 ]]
10632024-02-18T04:57:42.281Z+ sleep 1
10642024-02-18T04:57:43.271Z+ retry=40
10652024-02-18T04:57:43.271Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10662024-02-18T04:57:43.306Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10672024-02-18T04:57:43.306Z+ [[ 40 -gt 60 ]]
10682024-02-18T04:57:43.307Z+ sleep 1
10692024-02-18T04:57:44.285Z+ retry=41
10702024-02-18T04:57:44.285Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10712024-02-18T04:57:44.309Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10722024-02-18T04:57:44.309Z+ [[ 41 -gt 60 ]]
10732024-02-18T04:57:44.309Z+ sleep 1
10742024-02-18T04:57:45.301Z+ retry=42
10752024-02-18T04:57:45.301Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10762024-02-18T04:57:45.385Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10772024-02-18T04:57:45.771Z{"status":"ok"}success
10782024-02-18T04:57:45.771ZProject {
10792024-02-18T04:57:45.772Z description: "some images",
10802024-02-18T04:57:45.772Z id: 0cd7cbc5-52f3-4852-88c9-8c99c6a3af24,
10812024-02-18T04:57:45.772Z name: Name(
10822024-02-18T04:57:45.772Z "images",
10832024-02-18T04:57:45.772Z ),
10842024-02-18T04:57:45.772Z time_created: 2024-02-18T04:57:45.486729Z,
10852024-02-18T04:57:45.772Z time_modified: 2024-02-18T04:57:45.486729Z,
10862024-02-18T04:57:45.772Z}
10872024-02-18T04:57:45.797Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
10882024-02-18T05:03:26.409Zdone!
10892024-02-18T05:03:26.409Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
10902024-02-18T05:03:26.409Zsuccess
10912024-02-18T05:03:26.409ZImage {
10922024-02-18T05:03:26.409Z block_size: ByteCount(
10932024-02-18T05:03:26.409Z 512,
10942024-02-18T05:03:26.409Z ),
10952024-02-18T05:03:26.409Z description: "debian 11 original base image",
10962024-02-18T05:03:26.409Z digest: None,
10972024-02-18T05:03:26.409Z id: 56c4d6f7-833b-461a-ac04-02ffa3789f2b,
10982024-02-18T05:03:26.409Z name: Name(
10992024-02-18T05:03:26.409Z "debian11",
11002024-02-18T05:03:26.409Z ),
11012024-02-18T05:03:26.443Z os: "debian",
11022024-02-18T05:03:26.443Z project_id: None,
11032024-02-18T05:03:26.443Z size: ByteCount(
11042024-02-18T05:03:26.443Z 2147483648,
11052024-02-18T05:03:26.443Z ),
11062024-02-18T05:03:26.443Z time_created: 2024-02-18T05:03:17.399918Z,
11072024-02-18T05:03:26.443Z time_modified: 2024-02-18T05:03:17.625131Z,
11082024-02-18T05:03:26.443Z url: None,
11092024-02-18T05:03:26.443Z version: "11",
11102024-02-18T05:03:26.443Z}
11112024-02-18T05:03:26.443Z+ rm ./tests/bootstrap
11122024-02-18T05:03:26.443Z+ for test_bin in tests/*
11132024-02-18T05:03:26.443Z+ ./tests/bootstrap-eb11d53ab76d2536
11142024-02-18T05:03:26.443Z
11152024-02-18T05:03:26.444Zrunning 0 tests
11162024-02-18T05:03:26.444Z
11172024-02-18T05:03:26.444Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11182024-02-18T05:03:26.444Z
11192024-02-18T05:03:26.444Z+ for test_bin in tests/*
11202024-02-18T05:03:26.444Z+ ./tests/end_to_end_tests-fe6fd140b2e71fe7
11212024-02-18T05:03:26.444Z
11222024-02-18T05:03:26.444Zrunning 2 tests
11232024-02-18T05:03:26.444Ztest no_spoof::no_spoof_here ... ok
11242024-02-18T05:03:55.980Ztest instance_launch::instance_launch ... ok
11252024-02-18T05:03:55.980Z
11262024-02-18T05:03:56.016Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 37.96s
11272024-02-18T05:03:56.016Z
11282024-02-18T05:03:56.016Z+ _exit_trap
11292024-02-18T05:03:56.016Z+ local status=0
11302024-02-18T05:03:56.016Z+ [[ 0 -eq 0 ]]
11312024-02-18T05:03:56.016Z+ exit 0
11322024-02-18T05:03:56.016Zprocess exited: duration 687351 ms, exit code 0
 
11332024-02-18T05:03:56.128Zfound 131 output files
11342024-02-18T05:03:56.181Zuploading: /var/svc/log/oxide-sled-agent:default.log (885390 bytes)
11352024-02-18T05:03:57.494Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11362024-02-18T05:03:57.495Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (989151 bytes)
11372024-02-18T05:03:58.264Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 989151 -> 998112
11382024-02-18T05:03:58.943Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11392024-02-18T05:03:58.943Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (1513810 bytes)
11402024-02-18T05:04:00.840Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11412024-02-18T05:04:00.872Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
11422024-02-18T05:04:01.913Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11432024-02-18T05:04:01.913Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (8476 bytes)
11442024-02-18T05:04:03.048Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11452024-02-18T05:04:03.048Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (8362 bytes)
11462024-02-18T05:04:04.168Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11472024-02-18T05:04:04.169Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (17135 bytes)
11482024-02-18T05:04:05.311Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11492024-02-18T05:04:05.311Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (533388 bytes)
11502024-02-18T05:04:05.567Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 533388 -> 552553
11512024-02-18T05:04:06.652Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11522024-02-18T05:04:06.653Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1040440 bytes)
11532024-02-18T05:04:08.982Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11542024-02-18T05:04:08.982Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (326778 bytes)
11552024-02-18T05:04:09.638Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 326778 -> 344762
11562024-02-18T05:04:10.711Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11572024-02-18T05:04:10.711Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (581903 bytes)
11582024-02-18T05:04:12.798Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11592024-02-18T05:04:12.798Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11602024-02-18T05:04:14.287Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11612024-02-18T05:04:14.287Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11622024-02-18T05:04:15.384Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11632024-02-18T05:04:15.384Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (115563 bytes)
11642024-02-18T05:04:15.746Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 115563 -> 125152
11652024-02-18T05:04:16.819Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11662024-02-18T05:04:16.819Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (166924 bytes)
11672024-02-18T05:04:18.291Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11682024-02-18T05:04:18.291Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
11692024-02-18T05:04:19.361Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11702024-02-18T05:04:19.361Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
11712024-02-18T05:04:20.455Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
11722024-02-18T05:04:20.455Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
11732024-02-18T05:04:21.952Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11742024-02-18T05:04:21.952Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5759 bytes)
11752024-02-18T05:04:23.077Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
11762024-02-18T05:04:23.078Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-clickhouse:default.log (663469 bytes)
11772024-02-18T05:04:24.104Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 663469 -> 736683
11782024-02-18T05:04:25.596Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-clickhouse:default.log
11792024-02-18T05:04:25.596Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-clickhouse:default.log.0 (596323 bytes)
11802024-02-18T05:04:27.549Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-clickhouse:default.log.0
11812024-02-18T05:04:27.549Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11822024-02-18T05:04:28.620Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-zone-network-setup:default.log
11832024-02-18T05:04:28.621Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
11842024-02-18T05:04:29.715Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_687fd95f-cb58-4ee3-ab08-e53919f1ec8d/root/var/svc/log/oxide-zone-network-setup:default.log.0
11852024-02-18T05:04:29.715Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e7ada947-5112-462f-bb43-2b9b2d42edc3/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11862024-02-18T05:04:30.792Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e7ada947-5112-462f-bb43-2b9b2d42edc3/root/var/svc/log/oxide-cockroachdb:default.log
11872024-02-18T05:04:30.792Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e7ada947-5112-462f-bb43-2b9b2d42edc3/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
11882024-02-18T05:04:31.887Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e7ada947-5112-462f-bb43-2b9b2d42edc3/root/var/svc/log/oxide-cockroachdb:default.log.0
11892024-02-18T05:04:31.887Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e7ada947-5112-462f-bb43-2b9b2d42edc3/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11902024-02-18T05:04:32.989Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e7ada947-5112-462f-bb43-2b9b2d42edc3/root/var/svc/log/oxide-zone-network-setup:default.log
11912024-02-18T05:04:32.989Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e7ada947-5112-462f-bb43-2b9b2d42edc3/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
11922024-02-18T05:04:48.655Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e7ada947-5112-462f-bb43-2b9b2d42edc3/root/var/svc/log/oxide-zone-network-setup:default.log.0
11932024-02-18T05:04:48.655Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-agent:default.log (10681 bytes)
11942024-02-18T05:04:49.691Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-agent:default.log
11952024-02-18T05:04:49.691Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11962024-02-18T05:04:50.803Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-agent:default.log.0
11972024-02-18T05:04:50.803Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11982024-02-18T05:04:51.884Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-downstairs:default.log
11992024-02-18T05:04:51.884Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12002024-02-18T05:04:52.979Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12012024-02-18T05:04:52.979Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-downstairs:downstairs-c2c41296-2ce3-45d5-9c56-796be996d255.log (5593 bytes)
12022024-02-18T05:04:54.084Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0603d7e8-35ce-4b54-9fb7-982ad285e6e6/root/var/svc/log/oxide-crucible-downstairs:downstairs-c2c41296-2ce3-45d5-9c56-796be996d255.log
12032024-02-18T05:04:54.085Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_ab5d9145-9982-4fa1-a96d-7360c29160a0/root/var/svc/log/oxide-external_dns:default.log (15109 bytes)
12042024-02-18T05:04:54.183Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_ab5d9145-9982-4fa1-a96d-7360c29160a0/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 15109 -> 18885
12052024-02-18T05:04:55.273Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_ab5d9145-9982-4fa1-a96d-7360c29160a0/root/var/svc/log/oxide-external_dns:default.log
12062024-02-18T05:04:55.273Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_ab5d9145-9982-4fa1-a96d-7360c29160a0/root/var/svc/log/oxide-external_dns:default.log.0 (15615 bytes)
12072024-02-18T05:04:56.535Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_ab5d9145-9982-4fa1-a96d-7360c29160a0/root/var/svc/log/oxide-external_dns:default.log.0
12082024-02-18T05:04:56.535Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_17547ae1-2459-42eb-bf5c-3acffb93d630/root/var/svc/log/oxide-internal_dns:default.log (18380 bytes)
12092024-02-18T05:04:56.664Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_17547ae1-2459-42eb-bf5c-3acffb93d630/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 18380 -> 22136
12102024-02-18T05:04:57.742Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_17547ae1-2459-42eb-bf5c-3acffb93d630/root/var/svc/log/oxide-internal_dns:default.log
12112024-02-18T05:04:57.742Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_17547ae1-2459-42eb-bf5c-3acffb93d630/root/var/svc/log/oxide-internal_dns:default.log.0 (103942 bytes)
12122024-02-18T05:04:59.240Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_17547ae1-2459-42eb-bf5c-3acffb93d630/root/var/svc/log/oxide-internal_dns:default.log.0
12132024-02-18T05:04:59.240Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_81219d9f-61db-429f-957b-0eca6f6f9a6f/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12142024-02-18T05:05:00.722Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_81219d9f-61db-429f-957b-0eca6f6f9a6f/root/var/svc/log/oxide-cockroachdb:default.log
12152024-02-18T05:05:00.722Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_81219d9f-61db-429f-957b-0eca6f6f9a6f/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
12162024-02-18T05:05:01.821Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_81219d9f-61db-429f-957b-0eca6f6f9a6f/root/var/svc/log/oxide-cockroachdb:default.log.0
12172024-02-18T05:05:01.821Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_81219d9f-61db-429f-957b-0eca6f6f9a6f/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12182024-02-18T05:05:02.897Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_81219d9f-61db-429f-957b-0eca6f6f9a6f/root/var/svc/log/oxide-zone-network-setup:default.log
12192024-02-18T05:05:02.897Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_81219d9f-61db-429f-957b-0eca6f6f9a6f/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
12202024-02-18T05:05:04.005Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_81219d9f-61db-429f-957b-0eca6f6f9a6f/root/var/svc/log/oxide-zone-network-setup:default.log.0
12212024-02-18T05:05:04.005Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-agent:default.log (10250 bytes)
12222024-02-18T05:05:05.128Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-agent:default.log
12232024-02-18T05:05:05.128Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-agent:default.log.0 (14118 bytes)
12242024-02-18T05:05:06.274Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-agent:default.log.0
12252024-02-18T05:05:06.274Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12262024-02-18T05:05:07.370Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:default.log
12272024-02-18T05:05:07.396Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12282024-02-18T05:05:08.481Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12292024-02-18T05:05:08.482Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:downstairs-6d8d46ff-4931-48cb-a074-c0e44116bf9c.log (5586 bytes)
12302024-02-18T05:05:09.585Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:downstairs-6d8d46ff-4931-48cb-a074-c0e44116bf9c.log
12312024-02-18T05:05:09.586Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:downstairs-c639875c-45bc-4235-8aa5-22e03f8aa508.log (0 bytes)
12322024-02-18T05:05:10.676Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:downstairs-c639875c-45bc-4235-8aa5-22e03f8aa508.log
12332024-02-18T05:05:10.701Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:downstairs-c639875c-45bc-4235-8aa5-22e03f8aa508.log.0 (3126 bytes)
12342024-02-18T05:05:11.787Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_61d27292-b3b5-43ea-9528-b4073c7561ad/root/var/svc/log/oxide-crucible-downstairs:downstairs-c639875c-45bc-4235-8aa5-22e03f8aa508.log.0
12352024-02-18T05:05:11.787Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a26051-8fb8-431c-967f-0794fabe25ad/root/var/svc/log/oxide-external_dns:default.log (15106 bytes)
12362024-02-18T05:05:12.294Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a26051-8fb8-431c-967f-0794fabe25ad/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 15106 -> 18881
12372024-02-18T05:05:13.790Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a26051-8fb8-431c-967f-0794fabe25ad/root/var/svc/log/oxide-external_dns:default.log
12382024-02-18T05:05:13.790Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a26051-8fb8-431c-967f-0794fabe25ad/root/var/svc/log/oxide-external_dns:default.log.0 (15609 bytes)
12392024-02-18T05:05:14.931Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a26051-8fb8-431c-967f-0794fabe25ad/root/var/svc/log/oxide-external_dns:default.log.0
12402024-02-18T05:05:14.931Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_feb24bb1-d371-497c-b609-710c726f2e12/root/var/svc/log/oxide-internal_dns:default.log (20063 bytes)
12412024-02-18T05:05:15.067Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_feb24bb1-d371-497c-b609-710c726f2e12/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 20063 -> 23818
12422024-02-18T05:05:16.146Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_feb24bb1-d371-497c-b609-710c726f2e12/root/var/svc/log/oxide-internal_dns:default.log
12432024-02-18T05:05:16.147Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_feb24bb1-d371-497c-b609-710c726f2e12/root/var/svc/log/oxide-internal_dns:default.log.0 (98215 bytes)
12442024-02-18T05:05:17.506Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_feb24bb1-d371-497c-b609-710c726f2e12/root/var/svc/log/oxide-internal_dns:default.log.0
12452024-02-18T05:05:17.506Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1f0c252d-a390-4647-ab91-5b9e0a5cd75d/root/var/svc/log/oxide-nexus:default.log (20484486 bytes)
12462024-02-18T05:05:27.056Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1f0c252d-a390-4647-ab91-5b9e0a5cd75d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 20484486 -> 20627813
12472024-02-18T05:05:28.163Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1f0c252d-a390-4647-ab91-5b9e0a5cd75d/root/var/svc/log/oxide-nexus:default.log
12482024-02-18T05:05:28.164Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1f0c252d-a390-4647-ab91-5b9e0a5cd75d/root/var/svc/log/oxide-nexus:default.log.0 (14045593 bytes)
12492024-02-18T05:05:38.922Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1f0c252d-a390-4647-ab91-5b9e0a5cd75d/root/var/svc/log/oxide-nexus:default.log.0
12502024-02-18T05:05:38.922Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f44259e7-2853-4faf-9861-1821bc2ffe1b/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12512024-02-18T05:05:39.995Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f44259e7-2853-4faf-9861-1821bc2ffe1b/root/var/svc/log/oxide-cockroachdb:default.log
12522024-02-18T05:05:39.995Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f44259e7-2853-4faf-9861-1821bc2ffe1b/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12532024-02-18T05:05:41.104Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f44259e7-2853-4faf-9861-1821bc2ffe1b/root/var/svc/log/oxide-cockroachdb:default.log.0
12542024-02-18T05:05:41.104Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f44259e7-2853-4faf-9861-1821bc2ffe1b/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12552024-02-18T05:05:42.178Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f44259e7-2853-4faf-9861-1821bc2ffe1b/root/var/svc/log/oxide-zone-network-setup:default.log
12562024-02-18T05:05:42.178Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f44259e7-2853-4faf-9861-1821bc2ffe1b/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
12572024-02-18T05:05:43.274Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f44259e7-2853-4faf-9861-1821bc2ffe1b/root/var/svc/log/oxide-zone-network-setup:default.log.0
12582024-02-18T05:05:43.274Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-agent:default.log (7757 bytes)
12592024-02-18T05:05:44.392Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-agent:default.log
12602024-02-18T05:05:44.392Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-agent:default.log.0 (20042 bytes)
12612024-02-18T05:05:45.556Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-agent:default.log.0
12622024-02-18T05:05:45.580Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12632024-02-18T05:05:46.728Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:default.log
12642024-02-18T05:05:46.728Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12652024-02-18T05:05:48.254Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12662024-02-18T05:05:48.254Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-13f388ec-fb00-418e-a11e-03adf2951f07.log (0 bytes)
12672024-02-18T05:05:49.332Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-13f388ec-fb00-418e-a11e-03adf2951f07.log
12682024-02-18T05:05:49.358Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-13f388ec-fb00-418e-a11e-03adf2951f07.log.0 (3125 bytes)
12692024-02-18T05:05:50.446Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-13f388ec-fb00-418e-a11e-03adf2951f07.log.0
12702024-02-18T05:05:50.446Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-ea7293ad-8550-46ae-86af-3cb18eeff9bd.log (1091 bytes)
12712024-02-18T05:05:51.579Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-ea7293ad-8550-46ae-86af-3cb18eeff9bd.log
12722024-02-18T05:05:51.579Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-ea7293ad-8550-46ae-86af-3cb18eeff9bd.log.0 (4605 bytes)
12732024-02-18T05:05:52.715Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-ea7293ad-8550-46ae-86af-3cb18eeff9bd.log.0
12742024-02-18T05:05:52.715Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:snapshot-ea7293ad-8550-46ae-86af-3cb18eeff9bd-cdfb52d0-df59-49b3-af11-4ea03c748fb4.log (5284 bytes)
12752024-02-18T05:05:53.857Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c1be6108-fdb4-4f77-8e64-1ee18fdc1b5a/root/var/svc/log/oxide-crucible-downstairs:snapshot-ea7293ad-8550-46ae-86af-3cb18eeff9bd-cdfb52d0-df59-49b3-af11-4ea03c748fb4.log
12762024-02-18T05:05:53.857Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_19a40ded-d232-470f-bbf4-72b979147b10/root/var/svc/log/oxide-internal_dns:default.log (15019 bytes)
12772024-02-18T05:05:53.947Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_19a40ded-d232-470f-bbf4-72b979147b10/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 15019 -> 22524
12782024-02-18T05:05:55.018Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_19a40ded-d232-470f-bbf4-72b979147b10/root/var/svc/log/oxide-internal_dns:default.log
12792024-02-18T05:05:55.019Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_19a40ded-d232-470f-bbf4-72b979147b10/root/var/svc/log/oxide-internal_dns:default.log.0 (103378 bytes)
12802024-02-18T05:05:56.228Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_19a40ded-d232-470f-bbf4-72b979147b10/root/var/svc/log/oxide-internal_dns:default.log.0
12812024-02-18T05:05:56.228Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_8cc53ffd-e043-4c74-8c83-b57d86b99f9d/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12822024-02-18T05:05:57.299Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_8cc53ffd-e043-4c74-8c83-b57d86b99f9d/root/var/svc/log/oxide-cockroachdb:default.log
12832024-02-18T05:05:57.299Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_8cc53ffd-e043-4c74-8c83-b57d86b99f9d/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12842024-02-18T05:05:58.412Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_8cc53ffd-e043-4c74-8c83-b57d86b99f9d/root/var/svc/log/oxide-cockroachdb:default.log.0
12852024-02-18T05:05:58.412Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_8cc53ffd-e043-4c74-8c83-b57d86b99f9d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12862024-02-18T05:05:59.483Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_8cc53ffd-e043-4c74-8c83-b57d86b99f9d/root/var/svc/log/oxide-zone-network-setup:default.log
12872024-02-18T05:05:59.508Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_8cc53ffd-e043-4c74-8c83-b57d86b99f9d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
12882024-02-18T05:06:00.584Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_8cc53ffd-e043-4c74-8c83-b57d86b99f9d/root/var/svc/log/oxide-zone-network-setup:default.log.0
12892024-02-18T05:06:00.584Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-agent:default.log (10680 bytes)
12902024-02-18T05:06:01.774Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-agent:default.log
12912024-02-18T05:06:01.774Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12922024-02-18T05:06:02.936Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-agent:default.log.0
12932024-02-18T05:06:02.936Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12942024-02-18T05:06:04.025Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-downstairs:default.log
12952024-02-18T05:06:04.025Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12962024-02-18T05:06:05.124Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12972024-02-18T05:06:05.124Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-downstairs:downstairs-43c8655e-8d12-48a7-97be-6d86626197d0.log (5593 bytes)
12982024-02-18T05:06:06.331Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_992ecbcc-42a8-4a63-9acd-af8b720062d1/root/var/svc/log/oxide-crucible-downstairs:downstairs-43c8655e-8d12-48a7-97be-6d86626197d0.log
12992024-02-18T05:06:06.331Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_13a75a31-2c8d-44cd-8703-790d5a734968/root/var/svc/log/oxide-crucible-pantry:default.log (702634 bytes)
13002024-02-18T05:06:08.286Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_13a75a31-2c8d-44cd-8703-790d5a734968/root/var/svc/log/oxide-crucible-pantry:default.log
13012024-02-18T05:06:08.286Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_13a75a31-2c8d-44cd-8703-790d5a734968/root/var/svc/log/oxide-crucible-pantry:default.log.0 (512933 bytes)
13022024-02-18T05:06:10.186Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_13a75a31-2c8d-44cd-8703-790d5a734968/root/var/svc/log/oxide-crucible-pantry:default.log.0
13032024-02-18T05:06:10.187Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_fcbce23f-afa7-499a-bcd0-da6715e03b29/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13042024-02-18T05:06:11.264Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_fcbce23f-afa7-499a-bcd0-da6715e03b29/root/var/svc/log/oxide-cockroachdb:default.log
13052024-02-18T05:06:11.265Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_fcbce23f-afa7-499a-bcd0-da6715e03b29/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
13062024-02-18T05:06:12.362Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_fcbce23f-afa7-499a-bcd0-da6715e03b29/root/var/svc/log/oxide-cockroachdb:default.log.0
13072024-02-18T05:06:12.362Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_fcbce23f-afa7-499a-bcd0-da6715e03b29/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13082024-02-18T05:06:13.435Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_fcbce23f-afa7-499a-bcd0-da6715e03b29/root/var/svc/log/oxide-zone-network-setup:default.log
13092024-02-18T05:06:13.435Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_fcbce23f-afa7-499a-bcd0-da6715e03b29/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
13102024-02-18T05:06:14.531Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_fcbce23f-afa7-499a-bcd0-da6715e03b29/root/var/svc/log/oxide-zone-network-setup:default.log.0
13112024-02-18T05:06:14.531Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13122024-02-18T05:06:16.035Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-agent:default.log
13132024-02-18T05:06:16.035Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-agent:default.log.0 (14115 bytes)
13142024-02-18T05:06:16.778Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-agent:default.log.0
13152024-02-18T05:06:16.778Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13162024-02-18T05:06:17.858Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-downstairs:default.log
13172024-02-18T05:06:17.858Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13182024-02-18T05:06:18.958Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13192024-02-18T05:06:18.958Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-downstairs:downstairs-9346e860-0f56-41a4-911f-48657f74e4d2.log (0 bytes)
13202024-02-18T05:06:20.465Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-downstairs:downstairs-9346e860-0f56-41a4-911f-48657f74e4d2.log
13212024-02-18T05:06:20.465Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-downstairs:downstairs-9346e860-0f56-41a4-911f-48657f74e4d2.log.0 (3126 bytes)
13222024-02-18T05:06:21.563Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_d338d4a9-e07a-4784-ad42-40c8e0e493ab/root/var/svc/log/oxide-crucible-downstairs:downstairs-9346e860-0f56-41a4-911f-48657f74e4d2.log.0
13232024-02-18T05:06:21.563Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_91d8f993-f0cb-4ac5-9d9c-6204af94ea8d/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13242024-02-18T05:06:22.642Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_91d8f993-f0cb-4ac5-9d9c-6204af94ea8d/root/var/svc/log/oxide-crucible-pantry:default.log
13252024-02-18T05:06:22.642Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_91d8f993-f0cb-4ac5-9d9c-6204af94ea8d/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
13262024-02-18T05:06:23.761Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_91d8f993-f0cb-4ac5-9d9c-6204af94ea8d/root/var/svc/log/oxide-crucible-pantry:default.log.0
13272024-02-18T05:06:23.793Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-agent:default.log (7757 bytes)
13282024-02-18T05:06:25.359Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-agent:default.log
13292024-02-18T05:06:25.359Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-agent:default.log.0 (9790 bytes)
13302024-02-18T05:06:26.932Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-agent:default.log.0
13312024-02-18T05:06:26.932Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13322024-02-18T05:06:28.027Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:default.log
13332024-02-18T05:06:28.029Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13342024-02-18T05:06:29.138Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13352024-02-18T05:06:29.138Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-c136ed39-7489-4e90-8685-97be7af48ae9.log (1091 bytes)
13362024-02-18T05:06:30.268Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-c136ed39-7489-4e90-8685-97be7af48ae9.log
13372024-02-18T05:06:30.268Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-c136ed39-7489-4e90-8685-97be7af48ae9.log.0 (4604 bytes)
13382024-02-18T05:06:31.404Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-c136ed39-7489-4e90-8685-97be7af48ae9.log.0
13392024-02-18T05:06:31.405Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:snapshot-c136ed39-7489-4e90-8685-97be7af48ae9-cdfb52d0-df59-49b3-af11-4ea03c748fb4.log (5287 bytes)
13402024-02-18T05:06:32.537Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_eb53eb08-9408-4e57-94f7-9f5aa41462d7/root/var/svc/log/oxide-crucible-downstairs:snapshot-c136ed39-7489-4e90-8685-97be7af48ae9-cdfb52d0-df59-49b3-af11-4ea03c748fb4.log
13412024-02-18T05:06:32.537Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_6e11af7e-95ef-451d-abf4-ae7cc27d0440/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13422024-02-18T05:06:33.613Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_6e11af7e-95ef-451d-abf4-ae7cc27d0440/root/var/svc/log/oxide-crucible-pantry:default.log
13432024-02-18T05:06:33.613Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_6e11af7e-95ef-451d-abf4-ae7cc27d0440/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
13442024-02-18T05:06:34.746Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_6e11af7e-95ef-451d-abf4-ae7cc27d0440/root/var/svc/log/oxide-crucible-pantry:default.log.0
13452024-02-18T05:06:34.746Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-agent:default.log (13679 bytes)
13462024-02-18T05:06:35.932Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-agent:default.log
13472024-02-18T05:06:35.932Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-agent:default.log.0 (9792 bytes)
13482024-02-18T05:06:37.083Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-agent:default.log.0
13492024-02-18T05:06:37.083Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13502024-02-18T05:06:38.184Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:default.log
13512024-02-18T05:06:38.184Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13522024-02-18T05:06:39.719Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13532024-02-18T05:06:39.719Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:downstairs-83c93fb6-9b82-4371-8ab5-015a1cd6d938.log (1091 bytes)
13542024-02-18T05:06:40.814Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:downstairs-83c93fb6-9b82-4371-8ab5-015a1cd6d938.log
13552024-02-18T05:06:40.814Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:downstairs-83c93fb6-9b82-4371-8ab5-015a1cd6d938.log.0 (4605 bytes)
13562024-02-18T05:06:41.928Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:downstairs-83c93fb6-9b82-4371-8ab5-015a1cd6d938.log.0
13572024-02-18T05:06:41.928Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:downstairs-e829e180-f406-4735-a85b-9c89800029e7.log (3003 bytes)
13582024-02-18T05:06:43.066Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:downstairs-e829e180-f406-4735-a85b-9c89800029e7.log
13592024-02-18T05:06:43.066Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:snapshot-83c93fb6-9b82-4371-8ab5-015a1cd6d938-cdfb52d0-df59-49b3-af11-4ea03c748fb4.log (5285 bytes)
13602024-02-18T05:06:44.172Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_3af96ca8-2406-4fc7-a9da-1a1e9727382d/root/var/svc/log/oxide-crucible-downstairs:snapshot-83c93fb6-9b82-4371-8ab5-015a1cd6d938-cdfb52d0-df59-49b3-af11-4ea03c748fb4.log
13612024-02-18T05:06:44.172Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-agent:default.log (6356 bytes)
13622024-02-18T05:06:45.713Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-agent:default.log
13632024-02-18T05:06:45.714Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-agent:default.log.0 (3434 bytes)
13642024-02-18T05:06:46.843Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-agent:default.log.0
13652024-02-18T05:06:46.843Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13662024-02-18T05:06:47.908Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-downstairs:default.log
13672024-02-18T05:06:47.908Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13682024-02-18T05:06:49.035Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13692024-02-18T05:06:49.035Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-downstairs:downstairs-c964be9a-7060-4700-b223-3fead763eecc.log (3008 bytes)
13702024-02-18T05:06:50.166Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6909d054-67ae-4771-896c-07422f53686f/root/var/svc/log/oxide-crucible-downstairs:downstairs-c964be9a-7060-4700-b223-3fead763eecc.log
13712024-02-18T05:06:50.167Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/svc/log/oxide-ntp:default.log (0 bytes)
13722024-02-18T05:06:51.273Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/svc/log/oxide-ntp:default.log
13732024-02-18T05:06:51.273Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/svc/log/oxide-ntp:default.log.0 (780 bytes)
13742024-02-18T05:06:52.830Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/svc/log/oxide-ntp:default.log.0
13752024-02-18T05:06:52.831Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-oximeter:default.log (186804 bytes)
13762024-02-18T05:06:53.521Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 186804 -> 322558
13772024-02-18T05:06:54.596Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-oximeter:default.log
13782024-02-18T05:06:54.596Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-oximeter:default.log.0 (156456 bytes)
13792024-02-18T05:06:56.702Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-oximeter:default.log.0
13802024-02-18T05:06:56.702Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13812024-02-18T05:06:57.779Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-zone-network-setup:default.log
13822024-02-18T05:06:57.779Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes)
13832024-02-18T05:06:58.876Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_9d9bab2b-be33-430f-b8ac-b932ff2088fb/root/var/svc/log/oxide-zone-network-setup:default.log.0
13842024-02-18T05:06:58.900Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-agent:default.log (6358 bytes)
13852024-02-18T05:07:00.022Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-agent:default.log
13862024-02-18T05:07:00.023Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13872024-02-18T05:07:01.137Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-agent:default.log.0
13882024-02-18T05:07:01.137Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13892024-02-18T05:07:02.256Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-downstairs:default.log
13902024-02-18T05:07:02.256Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13912024-02-18T05:07:03.400Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13922024-02-18T05:07:03.401Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-downstairs:downstairs-038742e4-dab0-4547-a6be-5e570f88bc71.log (3007 bytes)
13932024-02-18T05:07:04.544Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b136cc07-31af-4c42-800f-8f3881f20654/root/var/svc/log/oxide-crucible-downstairs:downstairs-038742e4-dab0-4547-a6be-5e570f88bc71.log
13942024-02-18T05:07:04.544Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_018d33a8-3d02-46d5-8c59-7fd1f0174d18/root/var/svc/log/oxide-nexus:default.log (1280819 bytes)
13952024-02-18T05:07:06.903Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_018d33a8-3d02-46d5-8c59-7fd1f0174d18/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1280819 -> 2030327
13962024-02-18T05:07:07.969Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_018d33a8-3d02-46d5-8c59-7fd1f0174d18/root/var/svc/log/oxide-nexus:default.log
13972024-02-18T05:07:07.969Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_018d33a8-3d02-46d5-8c59-7fd1f0174d18/root/var/svc/log/oxide-nexus:default.log.0 (5069213 bytes)
13982024-02-18T05:07:16.359Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_018d33a8-3d02-46d5-8c59-7fd1f0174d18/root/var/svc/log/oxide-nexus:default.log.0
13992024-02-18T05:07:16.359Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_35941a95-4a67-4d5b-a143-5119a6100d51/root/var/svc/log/oxide-nexus:default.log (460771 bytes)
14002024-02-18T05:07:17.457Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_35941a95-4a67-4d5b-a143-5119a6100d51/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 460771 -> 872413
14012024-02-18T05:07:18.543Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_35941a95-4a67-4d5b-a143-5119a6100d51/root/var/svc/log/oxide-nexus:default.log
14022024-02-18T05:07:18.544Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_35941a95-4a67-4d5b-a143-5119a6100d51/root/var/svc/log/oxide-nexus:default.log.0 (824741 bytes)
14032024-02-18T05:07:20.408Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_35941a95-4a67-4d5b-a143-5119a6100d51/root/var/svc/log/oxide-nexus:default.log.0
14042024-02-18T05:07:20.409Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/measurements.log (15892 bytes)
14052024-02-18T05:07:20.511Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/measurements.log" changed size mid upload: 15892 -> 21235
14062024-02-18T05:07:21.609Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/measurements.log
14072024-02-18T05:07:21.609Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/statistics.log (10062 bytes)
14082024-02-18T05:07:21.716Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/statistics.log" changed size mid upload: 10062 -> 14625
14092024-02-18T05:07:24.149Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/statistics.log
14102024-02-18T05:07:24.149Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/tracking.log (1849 bytes)
14112024-02-18T05:07:24.224Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/tracking.log" changed size mid upload: 1849 -> 2245
14122024-02-18T05:07:25.314Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_87934b4e-d3f2-4f7b-ab43-fa05c3136970/root/var/log/chrony/tracking.log