01HNHRQN2HNSFWWCJJA3P3RF8Y: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HNHRSDA3H5JEQBYZJR2C1Y1S

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-01T08:17:55.690Zjob dependencies complete; ready to run (waiting for 54 m 53 s)
22024-02-01T08:48:11.891Zjob assigned to worker 01HNHXBSGZSQQEXK0X7Z34HGVW (queued for 30 m 16 s)
32024-02-01T08:48:11.919Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-02-01T08:48:11.965Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-02-01T08:48:11.998Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-02-01T08:48:12.032Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-02-01T08:48:12.068Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-02-01T08:48:12.098ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-02-01T08:48:12.140Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-02-01T08:48:12.185ZOxide Helios Version helios-2.0.22418 64-bit
112024-02-01T08:48:12.221ZConfiguring devices.
122024-02-01T08:48:12.255Z##################################################
132024-02-01T08:48:12.288Z#### ############# ##
142024-02-01T08:48:12.321Z### ### ############ ##
152024-02-01T08:48:12.355Z## ### # ## ### ## Oxide Computer Company ##
162024-02-01T08:48:12.388Z## ## ## ### # ### ##
172024-02-01T08:48:12.421Z## # ### #### #### This Station Under ##
182024-02-01T08:48:12.458Z### ### #### # ### Computer Control ##
192024-02-01T08:48:12.488Z#### #### ### ## ##
202024-02-01T08:48:12.522Z##################################################
212024-02-01T08:48:12.555ZHostname: buskin
222024-02-01T08:48:12.589ZLoading smf(7) service descriptions:
232024-02-01T08:48:12.956Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-7af1bd138257bcb8.gz
242024-02-01T08:48:14.938Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-7af1bd138257bcb8.gz
252024-02-01T08:48:14.962Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-02-01T08:48:34.246Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-02-01T08:48:34.271Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-add7be4a9ab9d514.gz
282024-02-01T08:48:54.470Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-add7be4a9ab9d514.gz
292024-02-01T08:48:54.471Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-02-01T08:48:55.286Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-02-01T08:48:55.286Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-02-01T08:48:58.888Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-02-01T08:48:58.915Zdownloading input: /input/package/work/version.txt
342024-02-01T08:48:58.940Zdownloaded input: /input/package/work/version.txt
352024-02-01T08:48:58.941Zdownloading input: /input/package/work/package.tar.gz
362024-02-01T08:49:20.029Zdownloaded input: /input/package/work/package.tar.gz
372024-02-01T08:49:20.057Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-02-01T08:49:44.106Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-02-01T08:49:44.141Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-02-01T08:49:51.144Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-02-01T08:49:51.169Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-02-01T08:50:45.210Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-02-01T08:50:45.210Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-02-01T08:51:22.394Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-02-01T08:51:22.394Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-02-01T08:51:56.043Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-02-01T08:51:56.043Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
482024-02-01T08:52:00.132Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
492024-02-01T08:52:00.165Zdownloading input: /input/package/work/zones/crucible.tar.gz
502024-02-01T08:52:14.461Zdownloaded input: /input/package/work/zones/crucible.tar.gz
512024-02-01T08:52:14.461Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-02-01T08:52:19.253Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-02-01T08:52:19.285Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-02-01T08:52:23.996Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-02-01T08:52:23.997Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-02-01T08:52:24.067Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-02-01T08:52:24.098Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-02-01T08:52:29.805Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-02-01T08:52:29.805Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-02-01T08:52:36.636Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-02-01T08:52:36.636Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-02-01T08:53:00.833Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-02-01T08:53:00.833Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-02-01T08:53:22.312Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-02-01T08:53:22.338Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-02-01T08:53:22.393Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-02-01T08:53:22.424Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-02-01T08:53:38.414Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-02-01T08:53:38.414Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-02-01T08:53:53.460Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-02-01T08:53:53.491Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-02-01T08:54:45.201Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-02-01T08:54:45.201Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-02-01T08:55:31.810Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-02-01T08:55:31.810Zstarting task 0: "setup"
762024-02-01T08:55:31.834Z++ uname -s
772024-02-01T08:55:31.834Z+ kern=SunOS
782024-02-01T08:55:31.837Z+ case "$kern" in
792024-02-01T08:55:31.837Z+ groupadd -g 12345 build
802024-02-01T08:55:31.837Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-02-01T08:55:33.828Z+ zfs create -o mountpoint=/work rpool/work
822024-02-01T08:55:33.852Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-02-01T08:55:33.876Z+ home_fs=zfs
842024-02-01T08:55:33.876Z+ [[ zfs == autofs ]]
852024-02-01T08:55:33.876Z+ mkdir -p /home/build
862024-02-01T08:55:33.876Z+ chown build:build /home/build /work
872024-02-01T08:55:35.863Z+ chmod 0700 /home/build /work
882024-02-01T08:55:35.887Zprocess exited: duration 4054 ms, exit code 0
 
892024-02-01T08:55:35.936Zstarting task 1: "authentication"
902024-02-01T08:55:35.978Zprocess exited: duration 42 ms, exit code 0
 
912024-02-01T08:55:36.027Zstarting task 2: "build"
922024-02-01T08:55:36.051Z+ trap _exit_trap EXIT
932024-02-01T08:55:36.051Z+ set +x
942024-02-01T08:56:08.204Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-02-01T08:56:08.444Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-02-01T08:56:08.444Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-02-01T08:56:08.444Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-02-01T08:56:08.444Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-02-01T08:56:08.469Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-02-01T08:56:08.469Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-02-01T08:56:08.469Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-02-01T08:56:08.470Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-02-01T08:56:08.470Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-02-01T08:56:08.470Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-02-01T08:56:08.471Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-02-01T08:56:08.471Z+ [[ -d /opt/oxide ]]
1072024-02-01T08:56:08.471Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-02-01T08:56:08.471Z+ pfexec mkdir /opt/oxide
1092024-02-01T08:56:08.471Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-02-01T08:56:08.471Z+ [[ -d /opt/oxide-underneath ]]
1112024-02-01T08:56:08.471Z+ cd /opt/oxide-underneath
1122024-02-01T08:56:08.471Z+ pfexec tar ceEp@/f - .
1132024-02-01T08:56:08.471Z+ cd /opt/oxide
1142024-02-01T08:56:08.471Z+ pfexec tar xveEp@/f -
1152024-02-01T08:56:08.514Zx ., 0 bytes, 0 tape blocks
1162024-02-01T08:56:08.515Zx ./opte, 0 bytes, 0 tape blocks
1172024-02-01T08:56:08.515Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-02-01T08:56:08.516Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-02-01T08:56:08.549Z+ pfexec rm -rf /opt/oxide-underneath
1202024-02-01T08:56:08.549Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-02-01T08:56:08.549Z+ pfexec mkdir /opt/oxide/work
1222024-02-01T08:56:08.549Z+ pfexec chown build:build /opt/oxide/work
1232024-02-01T08:56:08.550Z+ cd /opt/oxide/work
1242024-02-01T08:56:08.550Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-02-01T08:56:10.209ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-02-01T08:56:10.209Zx out/mg-ddm-gz.tar, 63076864 bytes, 123197 tape blocks
1272024-02-01T08:56:10.209Zx out/omicron-sled-agent.tar, 122247680 bytes, 238765 tape blocks
1282024-02-01T08:56:10.209Zx out/oxlog.tar, 8382976 bytes, 16373 tape blocks
1292024-02-01T08:56:10.209Zx out/target/test, 75 bytes, 1 tape blocks
1302024-02-01T08:56:10.209Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-02-01T08:56:10.209Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1322024-02-01T08:56:10.209Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-02-01T08:56:10.209Zx target/release/omicron-package, 44570272 bytes, 87052 tape blocks
1342024-02-01T08:56:10.210Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-02-01T08:56:10.210Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-02-01T08:56:10.210Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-02-01T08:56:10.210Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-02-01T08:56:10.210Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-02-01T08:56:10.210Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-02-01T08:56:10.210Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-02-01T08:56:10.241Z
1422024-02-01T08:56:10.241Zreal 1.660397684
1432024-02-01T08:56:10.242Zuser 1.496782755
1442024-02-01T08:56:10.242Zsys 0.290648517
1452024-02-01T08:56:10.242Ztrap 0.000074572
1462024-02-01T08:56:10.242Ztflt 0.000000000
1472024-02-01T08:56:10.242Zdflt 0.000000000
1482024-02-01T08:56:10.242Zkflt 0.000000000
1492024-02-01T08:56:10.242Zlock 0.000000000
1502024-02-01T08:56:10.242Zslp 1.492298078
1512024-02-01T08:56:10.242Zlat 0.038736659
1522024-02-01T08:56:10.242Zstop 0.000129992
1532024-02-01T08:56:10.242Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-02-01T08:56:11.396Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-02-01T08:56:11.421Z+ mkdir tests
1562024-02-01T08:56:11.421Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-02-01T08:56:11.421Z+ ptime -m gunzip
1582024-02-01T08:56:11.421Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-7af1bd138257bcb8
1592024-02-01T08:56:11.727Z
1602024-02-01T08:56:11.752Zreal 0.236522187
1612024-02-01T08:56:11.752Zuser 0.215873729
1622024-02-01T08:56:11.754Zsys 0.020352721
1632024-02-01T08:56:11.754Ztrap 0.000025880
1642024-02-01T08:56:11.754Ztflt 0.000000000
1652024-02-01T08:56:11.755Zdflt 0.000000000
1662024-02-01T08:56:11.755Zkflt 0.000000000
1672024-02-01T08:56:11.755Zlock 0.000000000
1682024-02-01T08:56:11.755Zslp 0.000018350
1692024-02-01T08:56:11.755Zlat 0.000037639
1702024-02-01T08:56:11.755Zstop 0.000153513
1712024-02-01T08:56:11.755Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-7af1bd138257bcb8
1722024-02-01T08:56:11.755Z+ chmod a+x tests/bootstrap-7af1bd138257bcb8
1732024-02-01T08:56:11.755Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-02-01T08:56:11.755Z+ ptime -m gunzip
1752024-02-01T08:56:11.755Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-02-01T08:56:14.146Z
1772024-02-01T08:56:14.173Zreal 2.477001137
1782024-02-01T08:56:14.173Zuser 2.334825422
1792024-02-01T08:56:14.173Zsys 0.141782026
1802024-02-01T08:56:14.173Ztrap 0.000176106
1812024-02-01T08:56:14.173Ztflt 0.000000000
1822024-02-01T08:56:14.173Zdflt 0.000000000
1832024-02-01T08:56:14.173Zkflt 0.000000000
1842024-02-01T08:56:14.173Zlock 0.000000000
1852024-02-01T08:56:14.173Zslp 0.000025750
1862024-02-01T08:56:14.173Zlat 0.000020669
1872024-02-01T08:56:14.173Zstop 0.000116542
1882024-02-01T08:56:14.173Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-02-01T08:56:14.173Z+ chmod a+x tests/bootstrap
1902024-02-01T08:56:14.173Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-02-01T08:56:14.173Z+ ptime -m gunzip
1922024-02-01T08:56:14.173Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-add7be4a9ab9d514
1932024-02-01T08:56:16.703Z
1942024-02-01T08:56:16.727Zreal 2.545882772
1952024-02-01T08:56:16.727Zuser 2.400960311
1962024-02-01T08:56:16.727Zsys 0.144465523
1972024-02-01T08:56:16.727Ztrap 0.000207253
1982024-02-01T08:56:16.728Ztflt 0.000000000
1992024-02-01T08:56:16.728Zdflt 0.000000000
2002024-02-01T08:56:16.728Zkflt 0.000000000
2012024-02-01T08:56:16.728Zlock 0.000000000
2022024-02-01T08:56:16.728Zslp 0.000020860
2032024-02-01T08:56:16.728Zlat 0.000045460
2042024-02-01T08:56:16.728Zstop 0.000123812
2052024-02-01T08:56:16.728Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-add7be4a9ab9d514
2062024-02-01T08:56:16.728Z+ chmod a+x tests/end_to_end_tests-add7be4a9ab9d514
2072024-02-01T08:56:16.728Z+ bmat address ls
2082024-02-01T08:56:16.728ZNAME CIDR FIRST LAST COUNT
2092024-02-01T08:56:16.728Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-02-01T08:56:16.728Z++ bmat address ls -f extra -Ho first,last,count
2112024-02-01T08:56:16.754Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-02-01T08:56:16.754Z+ EXTRA_IP_START=10.151.1.164
2132024-02-01T08:56:16.754Z+ EXTRA_IP_END=10.151.1.227
2142024-02-01T08:56:16.754Z+ EXTRA_IP_COUNT=64
2152024-02-01T08:56:16.754Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-02-01T08:56:16.754Z+ EXTRA_IP_BASE=10.151.1
2172024-02-01T08:56:16.754Z+ EXTRA_IP_FOCTET=164
2182024-02-01T08:56:16.754Z+ EXTRA_IP_LOCTET=227
2192024-02-01T08:56:16.754Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-02-01T08:56:16.754Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-02-01T08:56:16.754Z+ DNS_IP1=10.151.1.164
2222024-02-01T08:56:16.754Z+ DNS_IP2=10.151.1.165
2232024-02-01T08:56:16.754Z+ UPLINK_IP=10.151.1.174
2242024-02-01T08:56:16.754Z+ IPPOOL_START=10.151.1.175
2252024-02-01T08:56:16.754Z+ IPPOOL_END=10.151.1.227
2262024-02-01T08:56:16.754Z++ ipadm show-addr -po type,addr
2272024-02-01T08:56:16.755Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-02-01T08:56:16.755Z+ GATEWAY_IP=10.151.1.100
2292024-02-01T08:56:16.755Z+ [[ -n 10.151.1.100 ]]
2302024-02-01T08:56:16.755Z+ ping -s 10.151.1.100 56 1
2312024-02-01T08:56:16.755ZPING 10.151.1.100: 56 data bytes
2322024-02-01T08:56:16.755Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.010 ms
2332024-02-01T08:56:16.755Z
2342024-02-01T08:56:16.755Z----10.151.1.100 PING Statistics----
2352024-02-01T08:56:16.755Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-02-01T08:56:16.756Zround-trip (ms) min/avg/max/stddev = 0.010/0.010/0.010/-nan
2372024-02-01T08:56:16.756Z++ arp -an
2382024-02-01T08:56:16.756Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-02-01T08:56:16.780Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-02-01T08:56:16.780Z+ routeadm -e ipv4-forwarding -u
2412024-02-01T08:56:16.865Z+ PXA_START=10.151.1.164
2422024-02-01T08:56:16.866Z+ PXA_END=10.151.1.227
2432024-02-01T08:56:16.866Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-02-01T08:56:16.890Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-02-01T08:56:17.069Z+ ZPOOL_VDEV_DIR=/scratch
2462024-02-01T08:56:17.069Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-02-01T08:56:17.093Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-02-01T08:56:17.093Z++ cd ./tools
2492024-02-01T08:56:17.093Z++ pwd
2502024-02-01T08:56:17.093Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-02-01T08:56:17.093Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-02-01T08:56:17.093Z+ SOFTNPU_MODE=zone
2532024-02-01T08:56:17.093Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-02-01T08:56:17.093Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-02-01T08:56:17.093Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-02-01T08:56:17.093Z++ dladm show-phys -p -o LINK
2572024-02-01T08:56:17.093Z++ head -1
2582024-02-01T08:56:17.119Z+ PHYSICAL_LINK=igb0
2592024-02-01T08:56:17.119Z+ echo 'Using igb0 as physical link'
2602024-02-01T08:56:17.119ZUsing igb0 as physical link
2612024-02-01T08:56:17.120Z+ ensure_run_as_root
2622024-02-01T08:56:17.120Z++ id -u
2632024-02-01T08:56:17.120Z+ [[ 0 -ne 0 ]]
2642024-02-01T08:56:17.120Z+ ensure_zpools
2652024-02-01T08:56:17.120Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-02-01T08:56:17.120Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-02-01T08:56:17.120Z+ readarray -t ZPOOLS
2682024-02-01T08:56:17.121Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-02-01T08:56:17.121Z++ sed 's/[ ",]//g'
2702024-02-01T08:56:17.121Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-02-01T08:56:17.121Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-02-01T08:56:17.121ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-02-01T08:56:17.121Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-02-01T08:56:17.121Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-02-01T08:56:17.121Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-02-01T08:56:17.121Z0+0 records in
2772024-02-01T08:56:17.121Z0+0 records out
2782024-02-01T08:56:17.121Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2792024-02-01T08:56:17.121Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-02-01T08:56:17.121Z+ set +x
2812024-02-01T08:56:17.121ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-02-01T08:56:17.121Z++ zpool list -o name
2832024-02-01T08:56:17.121Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-02-01T08:56:17.121Z+ [[ -z '' ]]
2852024-02-01T08:56:17.121Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-01T08:56:17.150Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-02-01T08:56:17.174Z+ set +x
2882024-02-01T08:56:17.175ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-02-01T08:56:17.175Z+ for ZPOOL in "${ZPOOLS[@]}"
2902024-02-01T08:56:17.175Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2912024-02-01T08:56:17.175ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2922024-02-01T08:56:17.175Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2932024-02-01T08:56:17.175Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2942024-02-01T08:56:17.175Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-02-01T08:56:17.175Z0+0 records in
2962024-02-01T08:56:17.175Z0+0 records out
2972024-02-01T08:56:17.175Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2982024-02-01T08:56:17.175Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-02-01T08:56:17.175Z+ set +x
3002024-02-01T08:56:17.175ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-02-01T08:56:17.175Z++ zpool list -o name
3022024-02-01T08:56:17.175Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-02-01T08:56:17.175Z+ [[ -z '' ]]
3042024-02-01T08:56:17.175Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-01T08:56:17.200Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-02-01T08:56:17.200Z+ set +x
3072024-02-01T08:56:17.200ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-02-01T08:56:17.200Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-02-01T08:56:17.200Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-02-01T08:56:17.200ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-02-01T08:56:17.200Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-02-01T08:56:17.200Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-02-01T08:56:17.202Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-02-01T08:56:17.202Z0+0 records in
3152024-02-01T08:56:17.202Z0+0 records out
3162024-02-01T08:56:17.202Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3172024-02-01T08:56:17.202Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-02-01T08:56:17.202Z+ set +x
3192024-02-01T08:56:17.202ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-02-01T08:56:17.202Z++ zpool list -o name
3212024-02-01T08:56:17.202Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-02-01T08:56:17.226Z+ [[ -z '' ]]
3232024-02-01T08:56:17.226Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-02-01T08:56:17.251Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-02-01T08:56:17.251Z+ set +x
3262024-02-01T08:56:17.251ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-02-01T08:56:17.251Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-02-01T08:56:17.251Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-02-01T08:56:17.251ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3302024-02-01T08:56:17.251Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3312024-02-01T08:56:17.251Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-02-01T08:56:17.251Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-02-01T08:56:17.252Z0+0 records in
3342024-02-01T08:56:17.252Z0+0 records out
3352024-02-01T08:56:17.252Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3362024-02-01T08:56:17.252Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-02-01T08:56:17.252Z+ set +x
3382024-02-01T08:56:17.252ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-02-01T08:56:17.252Z++ zpool list -o name
3402024-02-01T08:56:17.252Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-02-01T08:56:17.252Z+ [[ -z '' ]]
3422024-02-01T08:56:17.252Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-01T08:56:17.276Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-02-01T08:56:17.276Z+ set +x
3452024-02-01T08:56:17.277ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-02-01T08:56:17.277Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-02-01T08:56:17.277Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3482024-02-01T08:56:17.277ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3492024-02-01T08:56:17.277Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-02-01T08:56:17.277Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-02-01T08:56:17.277Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-02-01T08:56:17.277Z0+0 records in
3532024-02-01T08:56:17.277Z0+0 records out
3542024-02-01T08:56:17.277Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3552024-02-01T08:56:17.277Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-02-01T08:56:17.277Z+ set +x
3572024-02-01T08:56:17.277ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-02-01T08:56:17.278Z++ zpool list -o name
3592024-02-01T08:56:17.302Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-02-01T08:56:17.303Z+ [[ -z '' ]]
3612024-02-01T08:56:17.303Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-01T08:56:17.328Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-02-01T08:56:17.328Z+ set +x
3642024-02-01T08:56:17.328ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-02-01T08:56:17.328Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-02-01T08:56:17.328Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-02-01T08:56:17.328ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-02-01T08:56:17.328Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-02-01T08:56:17.328Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-02-01T08:56:17.328Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-02-01T08:56:17.329Z0+0 records in
3722024-02-01T08:56:17.329Z0+0 records out
3732024-02-01T08:56:17.329Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3742024-02-01T08:56:17.329Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-02-01T08:56:17.329Z+ set +x
3762024-02-01T08:56:17.329ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-02-01T08:56:17.329Z++ zpool list -o name
3782024-02-01T08:56:17.329Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-02-01T08:56:17.329Z+ [[ -z '' ]]
3802024-02-01T08:56:17.329Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-01T08:56:17.354Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-02-01T08:56:17.354Z+ set +x
3832024-02-01T08:56:17.378ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-02-01T08:56:17.378Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-02-01T08:56:17.378Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3862024-02-01T08:56:17.379ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3872024-02-01T08:56:17.379Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-02-01T08:56:17.379Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-02-01T08:56:17.379Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-02-01T08:56:17.379Z0+0 records in
3912024-02-01T08:56:17.379Z0+0 records out
3922024-02-01T08:56:17.379Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3932024-02-01T08:56:17.379Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-02-01T08:56:17.379Z+ set +x
3952024-02-01T08:56:17.379ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-02-01T08:56:17.379Z++ zpool list -o name
3972024-02-01T08:56:17.379Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-02-01T08:56:17.379Z+ [[ -z '' ]]
3992024-02-01T08:56:17.379Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-01T08:56:17.403Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-02-01T08:56:17.404Z+ set +x
4022024-02-01T08:56:17.404ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-02-01T08:56:17.404Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-02-01T08:56:17.404Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4052024-02-01T08:56:17.404ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4062024-02-01T08:56:17.404Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-02-01T08:56:17.404Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-02-01T08:56:17.404Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-02-01T08:56:17.404Z0+0 records in
4102024-02-01T08:56:17.404Z0+0 records out
4112024-02-01T08:56:17.404Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4122024-02-01T08:56:17.404Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-02-01T08:56:17.404Z+ set +x
4142024-02-01T08:56:17.404ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-02-01T08:56:17.404Z++ zpool list -o name
4162024-02-01T08:56:17.404Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-02-01T08:56:17.428Z+ [[ -z '' ]]
4182024-02-01T08:56:17.428Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-01T08:56:17.452Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-02-01T08:56:17.452Z+ set +x
4212024-02-01T08:56:17.452ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-02-01T08:56:17.452Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-02-01T08:56:17.452Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-02-01T08:56:17.452ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4252024-02-01T08:56:17.453Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4262024-02-01T08:56:17.453Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-02-01T08:56:17.453Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-02-01T08:56:17.453Z0+0 records in
4292024-02-01T08:56:17.453Z0+0 records out
4302024-02-01T08:56:17.453Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4312024-02-01T08:56:17.453Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-02-01T08:56:17.453Z+ set +x
4332024-02-01T08:56:17.453ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-02-01T08:56:17.453Z++ zpool list -o name
4352024-02-01T08:56:17.453Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-02-01T08:56:17.453Z+ [[ -z '' ]]
4372024-02-01T08:56:17.453Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-01T08:56:17.479Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-02-01T08:56:17.479Z+ set +x
4402024-02-01T08:56:17.504ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-02-01T08:56:17.504Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-02-01T08:56:17.504Z+ readarray -t ZPOOLS
4432024-02-01T08:56:17.504Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-02-01T08:56:17.504Z++ sed 's/[ ",]//g'
4452024-02-01T08:56:17.504Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-02-01T08:56:17.504Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-02-01T08:56:17.504ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-02-01T08:56:17.505Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-02-01T08:56:17.505Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-02-01T08:56:17.505Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-02-01T08:56:17.505Z0+0 records in
4522024-02-01T08:56:17.505Z0+0 records out
4532024-02-01T08:56:17.505Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4542024-02-01T08:56:17.505Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-02-01T08:56:17.505Z+ set +x
4562024-02-01T08:56:17.506ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-02-01T08:56:17.506Z++ zpool list -o name
4582024-02-01T08:56:17.506Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-02-01T08:56:17.506Z+ [[ -z '' ]]
4602024-02-01T08:56:17.506Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-01T08:56:17.531Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-02-01T08:56:17.531Z+ set +x
4632024-02-01T08:56:17.531ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4642024-02-01T08:56:17.532Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-02-01T08:56:17.532Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4662024-02-01T08:56:17.532ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4672024-02-01T08:56:17.532Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4682024-02-01T08:56:17.532Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4692024-02-01T08:56:17.532Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-02-01T08:56:17.556Z0+0 records in
4712024-02-01T08:56:17.556Z0+0 records out
4722024-02-01T08:56:17.557Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4732024-02-01T08:56:17.557Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-02-01T08:56:17.557Z+ set +x
4752024-02-01T08:56:17.557ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-02-01T08:56:17.557Z++ zpool list -o name
4772024-02-01T08:56:17.557Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-02-01T08:56:17.557Z+ [[ -z '' ]]
4792024-02-01T08:56:17.557Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-01T08:56:17.582Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-02-01T08:56:17.582Z+ set +x
4822024-02-01T08:56:17.582ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-02-01T08:56:17.582Z+ [[ zone == \z\o\n\e ]]
4842024-02-01T08:56:17.582Z+ ensure_simulated_links igb0
4852024-02-01T08:56:17.582Z+ local PHYSICAL_LINK=igb0
4862024-02-01T08:56:17.582Z+ INDICES=("0" "1")
4872024-02-01T08:56:17.582Z+ for I in "${INDICES[@]}"
4882024-02-01T08:56:17.582Z++ get_simnet_name_if_exists net0
4892024-02-01T08:56:17.582Z++ dladm show-simnet -p -o LINK net0
4902024-02-01T08:56:17.582Z++ echo ''
4912024-02-01T08:56:17.582Z+ [[ -z '' ]]
4922024-02-01T08:56:17.582Z+ dladm create-simnet -t net0
4932024-02-01T08:56:17.607Z+ dladm create-simnet -t sc0_0
4942024-02-01T08:56:17.607Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-02-01T08:56:17.607Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-02-01T08:56:17.607Z+ success 'Simnet net0/sc0_0 exists'
4972024-02-01T08:56:17.607Z+ set +x
4982024-02-01T08:56:17.607ZSimnet net0/sc0_0 exists
4992024-02-01T08:56:17.607Z+ for I in "${INDICES[@]}"
5002024-02-01T08:56:17.607Z++ get_simnet_name_if_exists net1
5012024-02-01T08:56:17.607Z++ dladm show-simnet -p -o LINK net1
5022024-02-01T08:56:17.607Z++ echo ''
5032024-02-01T08:56:17.608Z+ [[ -z '' ]]
5042024-02-01T08:56:17.608Z+ dladm create-simnet -t net1
5052024-02-01T08:56:17.608Z+ dladm create-simnet -t sc1_0
5062024-02-01T08:56:17.635Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-02-01T08:56:17.635Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-02-01T08:56:17.635Z+ success 'Simnet net1/sc1_0 exists'
5092024-02-01T08:56:17.635Z+ set +x
5102024-02-01T08:56:17.635ZSimnet net1/sc1_0 exists
5112024-02-01T08:56:17.635Z++ get_vnic_name_if_exists sc0_1
5122024-02-01T08:56:17.636Z++ dladm show-vnic -p -o LINK sc0_1
5132024-02-01T08:56:17.636Z++ echo ''
5142024-02-01T08:56:17.636Z+ [[ -z '' ]]
5152024-02-01T08:56:17.636Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-02-01T08:56:17.636Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-02-01T08:56:17.636Z+ success 'Vnic sc0_1 exists'
5182024-02-01T08:56:17.636Z+ set +x
5192024-02-01T08:56:17.636ZVnic sc0_1 exists
5202024-02-01T08:56:17.636Z+ warn_if_no_proxy_arp
5212024-02-01T08:56:17.636Z+ [[ -v PXA_START ]]
5222024-02-01T08:56:17.636Z+ [[ -v PXA_END ]]
5232024-02-01T08:56:17.636Z+ ensure_softnpu_zone
5242024-02-01T08:56:17.636Z+ zoneadm list
5252024-02-01T08:56:17.665Z+ grep -q sidecar_softnpu
5262024-02-01T08:56:17.665Z+ [[ -f out/npuzone/npuzone ]]
5272024-02-01T08:56:17.665Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-02-01T08:56:17.665Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-02-01T08:56:24.088Zdownloading softnpu ...done
5302024-02-01T08:56:24.113Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-02-01T08:56:30.667Zdownloading asic_program.so ...done
5322024-02-01T08:56:30.691Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-02-01T08:56:38.113Zdownloading scadm ...done
5342024-02-01T08:56:38.144Zcreating port tfportrear0_0 for sc0_0
5352024-02-01T08:56:38.144Zcreating port tfportqsfp0_0 for sc0_1
5362024-02-01T08:56:38.174Zsoftnpu zone setup
5372024-02-01T08:56:38.175Zconfigure zone
5382024-02-01T08:56:38.175Zinstall zone
5392024-02-01T08:56:39.226Zboot zone
5402024-02-01T08:56:42.326Z[sidecar_softnpu] svcs milestone/network
5412024-02-01T08:56:42.354ZSTATE STIME FMRI
5422024-02-01T08:56:42.354Zonline 8:56:40 svc:/milestone/network:default
5432024-02-01T08:56:42.354Z[sidecar_softnpu] /softnpu/npu start
5442024-02-01T08:56:42.379Z
5452024-02-01T08:56:42.403Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-02-01T08:56:42.403Z+ GATEWAY_IP=10.151.1.100
5472024-02-01T08:56:42.403Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-02-01T08:56:42.403ZUsing 10.151.1.100 as gateway ip
5492024-02-01T08:56:42.403Z+ [[ ! -v GATEWAY_MAC ]]
5502024-02-01T08:56:42.403Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-02-01T08:56:42.403Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-02-01T08:56:42.404Z+++ echo 18:c0:4d:0d:9f:b2
5532024-02-01T08:56:42.404Z+ COUNT=1
5542024-02-01T08:56:42.404Z+ [[ 1 -ne 1 ]]
5552024-02-01T08:56:42.404Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-02-01T08:56:42.404ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-02-01T08:56:42.404Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-02-01T08:56:42.404Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-02-01T08:56:42.428Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-02-01T08:56:42.428Z+ [[ -v PXA_START ]]
5612024-02-01T08:56:42.428Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-02-01T08:56:42.428Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-02-01T08:56:42.453Z+ z_scadm dump-state
5642024-02-01T08:56:42.453Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-02-01T08:56:42.477Zlocal v6:
5662024-02-01T08:56:42.477Zlocal v4:
5672024-02-01T08:56:42.477Zrouter v6:
5682024-02-01T08:56:42.477Zrouter v4_idx:
5692024-02-01T08:56:42.477Zrouter v4_routes:
5702024-02-01T08:56:42.477Zresolver v4:
5712024-02-01T08:56:42.477Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-02-01T08:56:42.477Zresolver v6:
5732024-02-01T08:56:42.477Znat v4:
5742024-02-01T08:56:42.477Znat_v6:
5752024-02-01T08:56:42.477Zport_mac:
5762024-02-01T08:56:42.478Zproxy arp:
5772024-02-01T08:56:42.478Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-02-01T08:56:42.504Z+ success 'softnpu zone exists'
5792024-02-01T08:56:42.504Z+ set +x
5802024-02-01T08:56:42.504Zsoftnpu zone exists
5812024-02-01T08:56:42.504Z
5822024-02-01T08:56:42.504Zreal 25.407955469
5832024-02-01T08:56:42.504Zuser 0.695854241
5842024-02-01T08:56:42.504Zsys 1.562350459
5852024-02-01T08:56:42.504Ztrap 0.000071064
5862024-02-01T08:56:42.504Ztflt 0.000187937
5872024-02-01T08:56:42.505Zdflt 0.001275987
5882024-02-01T08:56:42.505Zkflt 0.000000000
5892024-02-01T08:56:42.505Zlock 19:44.940640991
5902024-02-01T08:56:42.505Zslp 1:15.971538375
5912024-02-01T08:56:42.505Zlat 0.074253044
5922024-02-01T08:56:42.505Zstop 0.361536188
5932024-02-01T08:56:42.505Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-02-01T08:56:42.531Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-02-01T08:56:42.531Z+ SILO_NAME=recovery
5962024-02-01T08:56:42.531Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-02-01T08:56:42.531Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-02-01T08:56:42.531Z+ sed -i~ '
5992024-02-01T08:56:42.532Z /^external_dns_ips/c\
6002024-02-01T08:56:42.532Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-02-01T08:56:42.532Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-02-01T08:56:42.532Z /^first/c\
6032024-02-01T08:56:42.532Zfirst = "10.151.1.164"
6042024-02-01T08:56:42.532Z /^last/c\
6052024-02-01T08:56:42.532Zlast = "10.151.1.173"
6062024-02-01T08:56:42.532Z }
6072024-02-01T08:56:42.532Z /^\[rack_network_config/,/^$/ {
6082024-02-01T08:56:42.532Z /^infra_ip_first/c\
6092024-02-01T08:56:42.532Zinfra_ip_first = "10.151.1.174"
6102024-02-01T08:56:42.533Z /^infra_ip_last/c\
6112024-02-01T08:56:42.533Zinfra_ip_last = "10.151.1.174"
6122024-02-01T08:56:42.533Z }
6132024-02-01T08:56:42.533Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-02-01T08:56:42.533Z /^routes/c\
6152024-02-01T08:56:42.533Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-02-01T08:56:42.533Z /^addresses/c\
6172024-02-01T08:56:42.533Zaddresses = \["10.151.1.174/24"\]
6182024-02-01T08:56:42.533Z }
6192024-02-01T08:56:42.533Z' pkg/config-rss.toml
6202024-02-01T08:56:42.533Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-02-01T08:56:42.533Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-02-01T08:56:42.534Z+++ pkg/config-rss.toml Thu Feb 1 08:56:42 2024
6232024-02-01T08:56:42.534Z@@ -41,7 +41,7 @@
6242024-02-01T08:56:42.534Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-02-01T08:56:42.534Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-02-01T08:56:42.534Z # below.
6272024-02-01T08:56:42.535Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-02-01T08:56:42.535Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-02-01T08:56:42.535Z
6302024-02-01T08:56:42.535Z # Initial TLS certificates for the external API
6312024-02-01T08:56:42.535Z #
6322024-02-01T08:56:42.535Z@@ -77,8 +77,8 @@
6332024-02-01T08:56:42.535Z #
6342024-02-01T08:56:42.535Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-02-01T08:56:42.535Z [[internal_services_ip_pool_ranges]]
6362024-02-01T08:56:42.535Z-first = "192.168.1.20"
6372024-02-01T08:56:42.535Z-last = "192.168.1.29"
6382024-02-01T08:56:42.535Z+first = "10.151.1.164"
6392024-02-01T08:56:42.535Z+last = "10.151.1.173"
6402024-02-01T08:56:42.536Z
6412024-02-01T08:56:42.536Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-02-01T08:56:42.536Z # parameters should be provided to the control plane via wicket, but we need to
6432024-02-01T08:56:42.536Z@@ -92,8 +92,8 @@
6442024-02-01T08:56:42.536Z # A range of IP addresses used by Boundary Services on the external network. In
6452024-02-01T08:56:42.536Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6462024-02-01T08:56:42.536Z # With softnpu, only one address is used.
6472024-02-01T08:56:42.536Z-infra_ip_first = "192.168.1.30"
6482024-02-01T08:56:42.537Z-infra_ip_last = "192.168.1.30"
6492024-02-01T08:56:42.537Z+infra_ip_first = "10.151.1.174"
6502024-02-01T08:56:42.538Z+infra_ip_last = "10.151.1.174"
6512024-02-01T08:56:42.538Z
6522024-02-01T08:56:42.538Z # Configurations for BGP routers to run on the scrimlets.
6532024-02-01T08:56:42.538Z bgp = []
6542024-02-01T08:56:42.538Z@@ -101,9 +101,9 @@
6552024-02-01T08:56:42.538Z # You can configure multiple uplinks by repeating the following stanza
6562024-02-01T08:56:42.538Z [[rack_network_config.ports]]
6572024-02-01T08:56:42.538Z # Routes associated with this port.
6582024-02-01T08:56:42.538Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6592024-02-01T08:56:42.538Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6602024-02-01T08:56:42.538Z # Addresses associated with this port.
6612024-02-01T08:56:42.538Z-addresses = ["192.168.1.30/24"]
6622024-02-01T08:56:42.538Z+addresses = ["10.151.1.174/24"]
6632024-02-01T08:56:42.539Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6642024-02-01T08:56:42.539Z port = "qsfp0"
6652024-02-01T08:56:42.539Z # The speed of this port.
6662024-02-01T08:56:42.539Z+ true
6672024-02-01T08:56:42.539Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6682024-02-01T08:56:42.564Za pkg/config-rss.toml 7K
6692024-02-01T08:56:42.564Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6702024-02-01T08:56:42.564Z+ TLS_NAME=recovery.sys.oxide.test
6712024-02-01T08:56:42.564Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6722024-02-01T08:56:42.882Z......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+..........+..+.......+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+..+.............+........+.+.........+.....+......+.........+......+....+..............+......................+........+..........+............+.....+....+.....+.+...+...........+.+..........................+.......+..+...+.............+.....+.......+.................+....+.....+....+..+......+.........+.+...+...........+.............+..+....+............+..+.............+..+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6732024-02-01T08:56:43.218Z.....+.+...+.....+.......+...+.....................+...+..+.+............+..+....+...........+...+.+..+..........+............+...+..+......+.+......+...+......+...+...+....................+...+....+...+..+.......+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+.+.....+.+......+........+......+....+......+...........+.........+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+.............+............+..+.......+..............+....+......+.........+...........+.......+...+...........+...+..........+...............+..+.+.....+.......+..................+........+......+...............+...............+..........+...+.......................+.......+........+.......+......+...............+.....+......+....+...........+..........+...+..+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6742024-02-01T08:56:43.246Z-----
6752024-02-01T08:56:43.247Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6762024-02-01T08:56:43.247Za pkg/initial-tls-cert.pem 2K
6772024-02-01T08:56:43.247Za pkg/initial-tls-key.pem 4K
6782024-02-01T08:56:43.247Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6792024-02-01T08:56:43.248Z+ rmdir pkg
6802024-02-01T08:56:43.248Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6812024-02-01T08:56:43.248Z+ pfexec mkdir -p /usr/oxide
6822024-02-01T08:56:43.277Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6832024-02-01T08:56:43.960Z+ pfexec chmod +x /usr/oxide/oxide
6842024-02-01T08:56:43.990Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6852024-02-01T08:57:02.271Z+ OMICRON_NO_UNINSTALL=1
6862024-02-01T08:57:02.271Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6872024-02-01T08:57:02.296ZFeb 01 08:57:02.138 DEBG target[test]: Target({"image": "standard", "machine": "non-gimlet", "rack-topology": "single-sled", "switch": "softnpu"})
6882024-02-01T08:57:02.296ZFeb 01 08:57:02.140 INFO Installing service, dst: /opt/oxide/ntp.tar.gz, src: out/ntp.tar.gz
6892024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/crucible_pantry.tar.gz, src: out/crucible-pantry.tar.gz
6902024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/mgs.tar.gz, src: out/omicron-gateway-softnpu.tar.gz
6912024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/cockroachdb.tar.gz, src: out/cockroachdb.tar.gz
6922024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/nexus.tar.gz, src: out/omicron-nexus.tar.gz
6932024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/clickhouse_keeper.tar.gz, src: out/clickhouse_keeper.tar.gz
6942024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/overlay.tar.gz, src: out/overlay.tar.gz
6952024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/oxlog.tar, src: out/oxlog.tar
6962024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/switch.tar.gz, src: out/switch-softnpu.tar.gz
6972024-02-01T08:57:02.296ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/propolis-server.tar.gz, src: out/propolis-server.tar.gz
6982024-02-01T08:57:02.301ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/sled-agent.tar, src: out/omicron-sled-agent.tar
6992024-02-01T08:57:02.301ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/mg-ddm.tar, src: out/mg-ddm-gz.tar
7002024-02-01T08:57:02.301ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/internal_dns.tar.gz, src: out/internal-dns.tar.gz
7012024-02-01T08:57:02.301ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/crucible.tar.gz, src: out/crucible.tar.gz
7022024-02-01T08:57:02.301ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/clickhouse.tar.gz, src: out/clickhouse.tar.gz
7032024-02-01T08:57:02.302ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/external_dns.tar.gz, src: out/external-dns.tar.gz
7042024-02-01T08:57:02.302ZFeb 01 08:57:02.141 INFO Installing service, dst: /opt/oxide/oximeter.tar.gz, src: out/oximeter.tar.gz
7052024-02-01T08:57:02.538ZFeb 01 08:57:02.392 INFO Unpacking service tarball, service_path: /opt/oxide/mg-ddm, tar_path: /opt/oxide/mg-ddm.tar
7062024-02-01T08:57:02.572ZFeb 01 08:57:02.426 INFO Unpacking service tarball, service_path: /opt/oxide/sled-agent, tar_path: /opt/oxide/sled-agent.tar
7072024-02-01T08:57:02.641ZFeb 01 08:57:02.492 INFO Unpacking service tarball, service_path: /opt/oxide/oxlog, tar_path: /opt/oxide/oxlog.tar
7082024-02-01T08:57:02.667ZFeb 01 08:57:02.497 INFO Installing bootstrap service from /opt/oxide/sled-agent/pkg/manifest.xml
7092024-02-01T08:57:02.774Z
7102024-02-01T08:57:02.799Zreal 0.498762964
7112024-02-01T08:57:02.800Zuser 0.107565875
7122024-02-01T08:57:02.800Zsys 2.197768531
7132024-02-01T08:57:02.800Ztrap 0.000000420
7142024-02-01T08:57:02.800Ztflt 0.000020370
7152024-02-01T08:57:02.800Zdflt 0.001768307
7162024-02-01T08:57:02.800Zkflt 0.000000000
7172024-02-01T08:57:02.800Zlock 44.609848462
7182024-02-01T08:57:02.800Zslp 0.715224630
7192024-02-01T08:57:02.800Zlat 0.003263275
7202024-02-01T08:57:02.800Zstop 0.209280400
7212024-02-01T08:57:02.800Z+ retry=0
7222024-02-01T08:57:02.800Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7232024-02-01T08:57:02.800Z+ [[ 0 -gt 30 ]]
7242024-02-01T08:57:02.800Z+ sleep 1
7252024-02-01T08:57:03.788Z+ retry=1
7262024-02-01T08:57:03.788Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7272024-02-01T08:57:03.818Z+ [[ 1 -gt 30 ]]
7282024-02-01T08:57:03.818Z+ sleep 1
7292024-02-01T08:57:04.803Z+ retry=2
7302024-02-01T08:57:04.804Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7312024-02-01T08:57:04.828Z+ [[ 2 -gt 30 ]]
7322024-02-01T08:57:04.828Z+ sleep 1
7332024-02-01T08:57:05.818Z+ retry=3
7342024-02-01T08:57:05.818Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7352024-02-01T08:57:05.846Z+ [[ 3 -gt 30 ]]
7362024-02-01T08:57:05.846Z+ sleep 1
7372024-02-01T08:57:06.834Z+ retry=4
7382024-02-01T08:57:06.834Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7392024-02-01T08:57:32.009Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7402024-02-01T08:57:32.042Zlocal v6:
7412024-02-01T08:57:32.042Zfd25:8ee3:517b:d2ac::1
7422024-02-01T08:57:32.042Zfe80::10c2:2cff:fe91:c5e3
7432024-02-01T08:57:32.042Zlocal v4:
7442024-02-01T08:57:32.043Z10.151.1.174
7452024-02-01T08:57:32.043Zrouter v6:
7462024-02-01T08:57:32.043Zfd00:1122:3344:1::/64 -> fe80::549b:1aff:fe75:8f88 (1)
7472024-02-01T08:57:32.043Zfd00:1122:3344:2::/64 -> fe80::549b:1aff:fe75:8f88 (1)
7482024-02-01T08:57:32.043Zfd00:1122:3344:101::/64 -> fe80::549b:1aff:fe75:8f88 (1)
7492024-02-01T08:57:32.043Zfd00:1122:3344:3::/64 -> fe80::549b:1aff:fe75:8f88 (1)
7502024-02-01T08:57:32.043Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::549b:1aff:fe75:8f88 (1)
7512024-02-01T08:57:32.043Zrouter v4_idx:
7522024-02-01T08:57:32.043Z0.0.0.0/0 -> 0
7532024-02-01T08:57:32.043Zrouter v4_routes:
7542024-02-01T08:57:32.044Z0 -> 10.151.1.100 (2)
7552024-02-01T08:57:32.044Zresolver v4:
7562024-02-01T08:57:32.071Z10.151.1.174 -> e6:ea:cd:16:f4:50
7572024-02-01T08:57:32.072Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7582024-02-01T08:57:32.072Zresolver v6:
7592024-02-01T08:57:32.072Zfe80::10c2:2cff:fe91:c5e3 -> 12:c2:2c:91:c5:e3
7602024-02-01T08:57:32.072Zfe80::549b:1aff:fe75:8f88 -> 56:9b:1a:75:8f:88
7612024-02-01T08:57:32.072Znat v4:
7622024-02-01T08:57:32.072Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:d5:b1
7632024-02-01T08:57:32.072Znat_v6:
7642024-02-01T08:57:32.072Zport_mac:
7652024-02-01T08:57:32.072Z1: a8:40:25:18:82:c2
7662024-02-01T08:57:32.072Z1000: a8:40:25:18:82:c1
7672024-02-01T08:57:32.073Zproxy arp:
7682024-02-01T08:57:32.073Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7692024-02-01T08:57:32.073Z+ retry=0
7702024-02-01T08:57:32.074Z+++ zoneadm list -n
7712024-02-01T08:57:32.074Z+++ grep oxz_ntp
7722024-02-01T08:57:32.074Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
7732024-02-01T08:57:32.074Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7742024-02-01T08:57:32.074Z++ true
7752024-02-01T08:57:32.074Z+ [[ '' != online ]]
7762024-02-01T08:57:32.074Z+ [[ 0 -gt 60 ]]
7772024-02-01T08:57:32.074Z+ sleep 1
7782024-02-01T08:57:33.073Z+ retry=1
7792024-02-01T08:57:33.098Z+++ zoneadm list -n
7802024-02-01T08:57:33.098Z+++ grep oxz_ntp
7812024-02-01T08:57:33.098Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
7822024-02-01T08:57:33.098Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7832024-02-01T08:57:33.123Z++ true
7842024-02-01T08:57:33.123Z+ [[ '' != online ]]
7852024-02-01T08:57:33.123Z+ [[ 1 -gt 60 ]]
7862024-02-01T08:57:33.123Z+ sleep 1
7872024-02-01T08:57:34.102Z+ retry=2
7882024-02-01T08:57:34.131Z+++ zoneadm list -n
7892024-02-01T08:57:34.131Z+++ grep oxz_ntp
7902024-02-01T08:57:34.135Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
7912024-02-01T08:57:34.135Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7922024-02-01T08:57:34.135Z++ true
7932024-02-01T08:57:34.135Z+ [[ '' != online ]]
7942024-02-01T08:57:34.135Z+ [[ 2 -gt 60 ]]
7952024-02-01T08:57:34.135Z+ sleep 1
7962024-02-01T08:57:35.131Z+ retry=3
7972024-02-01T08:57:35.156Z+++ zoneadm list -n
7982024-02-01T08:57:35.156Z+++ grep oxz_ntp
7992024-02-01T08:57:35.156Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8002024-02-01T08:57:35.156Z+ [[ disabled != online ]]
8012024-02-01T08:57:35.156Z+ [[ 3 -gt 60 ]]
8022024-02-01T08:57:35.156Z+ sleep 1
8032024-02-01T08:57:36.155Z+ retry=4
8042024-02-01T08:57:36.180Z+++ zoneadm list -n
8052024-02-01T08:57:36.180Z+++ grep oxz_ntp
8062024-02-01T08:57:36.180Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8072024-02-01T08:57:36.180Z+ [[ disabled != online ]]
8082024-02-01T08:57:36.180Z+ [[ 4 -gt 60 ]]
8092024-02-01T08:57:36.180Z+ sleep 1
8102024-02-01T08:57:37.178Z+ retry=5
8112024-02-01T08:57:37.202Z+++ zoneadm list -n
8122024-02-01T08:57:37.203Z+++ grep oxz_ntp
8132024-02-01T08:57:37.203Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8142024-02-01T08:57:37.203Z+ [[ disabled != online ]]
8152024-02-01T08:57:37.203Z+ [[ 5 -gt 60 ]]
8162024-02-01T08:57:37.203Z+ sleep 1
8172024-02-01T08:57:38.199Z+ retry=6
8182024-02-01T08:57:38.223Z+++ zoneadm list -n
8192024-02-01T08:57:38.223Z+++ grep oxz_ntp
8202024-02-01T08:57:38.223Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8212024-02-01T08:57:38.223Z+ [[ disabled != online ]]
8222024-02-01T08:57:38.223Z+ [[ 6 -gt 60 ]]
8232024-02-01T08:57:38.223Z+ sleep 1
8242024-02-01T08:57:39.220Z+ retry=7
8252024-02-01T08:57:39.244Z+++ zoneadm list -n
8262024-02-01T08:57:39.244Z+++ grep oxz_ntp
8272024-02-01T08:57:39.244Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8282024-02-01T08:57:39.244Z+ [[ disabled != online ]]
8292024-02-01T08:57:39.244Z+ [[ 7 -gt 60 ]]
8302024-02-01T08:57:39.244Z+ sleep 1
8312024-02-01T08:57:40.243Z+ retry=8
8322024-02-01T08:57:40.267Z+++ zoneadm list -n
8332024-02-01T08:57:40.268Z+++ grep oxz_ntp
8342024-02-01T08:57:40.268Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8352024-02-01T08:57:40.268Z+ [[ disabled != online ]]
8362024-02-01T08:57:40.268Z+ [[ 8 -gt 60 ]]
8372024-02-01T08:57:40.268Z+ sleep 1
8382024-02-01T08:57:41.269Z+ retry=9
8392024-02-01T08:57:41.294Z+++ zoneadm list -n
8402024-02-01T08:57:41.294Z+++ grep oxz_ntp
8412024-02-01T08:57:41.294Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8422024-02-01T08:57:41.294Z+ [[ disabled != online ]]
8432024-02-01T08:57:41.294Z+ [[ 9 -gt 60 ]]
8442024-02-01T08:57:41.294Z+ sleep 1
8452024-02-01T08:57:42.288Z+ retry=10
8462024-02-01T08:57:42.424Z+++ zoneadm list -n
8472024-02-01T08:57:42.424Z+++ grep oxz_ntp
8482024-02-01T08:57:42.424Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8492024-02-01T08:57:42.424Z+ [[ disabled != online ]]
8502024-02-01T08:57:42.424Z+ [[ 10 -gt 60 ]]
8512024-02-01T08:57:42.424Z+ sleep 1
 
8522024-02-01T08:57:42.426Zbuskin console login: Feb 1 08:57:41 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8532024-02-01T08:57:43.309Z+ retry=11
8542024-02-01T08:57:43.333Z+++ zoneadm list -n
8552024-02-01T08:57:43.333Z+++ grep oxz_ntp
8562024-02-01T08:57:43.333Z++ pfexec svcs -z oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a -Hostate oxide/ntp
8572024-02-01T08:57:43.334Z+ [[ online != online ]]
8582024-02-01T08:57:43.334Z+ echo 'Waited for chrony: 11s'
8592024-02-01T08:57:43.334Z+ export RUST_BACKTRACE=1
8602024-02-01T08:57:43.334ZWaited for chrony: 11s
8612024-02-01T08:57:43.334Z+ RUST_BACKTRACE=1
8622024-02-01T08:57:43.334Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8632024-02-01T08:57:43.334Z++ ./tests/bootstrap
8642024-02-01T08:57:43.359ZUsing external DNS server at 10.151.1.164:53
8652024-02-01T08:57:43.359Z2024-02-01 08:57:43.211449635 UTC: attempting to log into API
8662024-02-01T08:57:58.395Z2024-02-01 08:57:58.356275717 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8672024-02-01T08:57:59.398Z2024-02-01 08:57:59.357363385 UTC: attempting to log into API
8682024-02-01T08:58:14.434Z2024-02-01 08:58:14.393126739 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8692024-02-01T08:58:15.433Z2024-02-01 08:58:15.394481513 UTC: attempting to log into API
8702024-02-01T08:58:30.508Z2024-02-01 08:58:30.470335260 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8712024-02-01T08:58:31.509Z2024-02-01 08:58:31.471507200 UTC: attempting to log into API
8722024-02-01T08:58:46.542Z2024-02-01 08:58:46.504749074 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8732024-02-01T08:58:47.543Z2024-02-01 08:58:47.506560356 UTC: attempting to log into API
8742024-02-01T08:59:02.576Z2024-02-01 08:59:02.566030730 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8752024-02-01T08:59:03.578Z2024-02-01 08:59:03.568758970 UTC: attempting to log into API
 
8762024-02-01T08:59:06.627ZFeb 1 08:59:06 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8772024-02-01T08:59:13.178ZFeb 1 08:59:12 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
8782024-02-01T08:59:18.612Z2024-02-01 08:59:18.607188180 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8792024-02-01T08:59:18.916ZFeb 1 08:59:18 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
8802024-02-01T08:59:19.612Z2024-02-01 08:59:19.608719159 UTC: attempting to log into API
 
8812024-02-01T08:59:24.524ZFeb 1 08:59:24 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
8822024-02-01T08:59:31.173ZFeb 1 08:59:30 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8832024-02-01T08:59:34.645Z2024-02-01 08:59:34.648191230 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8842024-02-01T08:59:35.646Z2024-02-01 08:59:35.649638812 UTC: attempting to log into API
8852024-02-01T08:59:46.459Z2024-02-01 08:59:46.466970135 UTC: login succeeded
8862024-02-01T08:59:46.492Zwaiting for nexus to come up...
8872024-02-01T08:59:46.558Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8882024-02-01T08:59:46.761Zsetting up quotas...
8892024-02-01T08:59:46.813Zensuring datasets are ready...
8902024-02-01T08:59:51.277Zlet's roll.
8912024-02-01T08:59:51.303Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8922024-02-01T08:59:51.303ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8932024-02-01T08:59:51.303ZOXIDE_TOKEN=oxide-token-1ead7cb55dd88dd62737c1028fbceabc1722fb14'
8942024-02-01T08:59:51.303Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8952024-02-01T08:59:51.303Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8962024-02-01T08:59:51.303Z++ OXIDE_TOKEN=oxide-token-1ead7cb55dd88dd62737c1028fbceabc1722fb14
8972024-02-01T08:59:51.303Z+ export OXIDE_HOST OXIDE_TOKEN
8982024-02-01T08:59:51.303Z+ retry=0
8992024-02-01T08:59:51.303Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9002024-02-01T08:59:51.304Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9012024-02-01T08:59:51.304Z+ [[ 0 -gt 60 ]]
9022024-02-01T08:59:51.304Z+ sleep 1
9032024-02-01T08:59:52.301Z+ retry=1
9042024-02-01T08:59:52.301Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9052024-02-01T08:59:52.325Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9062024-02-01T08:59:52.325Z+ [[ 1 -gt 60 ]]
9072024-02-01T08:59:52.325Z+ sleep 1
9082024-02-01T08:59:53.318Z+ retry=2
9092024-02-01T08:59:53.318Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9102024-02-01T08:59:53.342Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9112024-02-01T08:59:53.343Z+ [[ 2 -gt 60 ]]
9122024-02-01T08:59:53.343Z+ sleep 1
9132024-02-01T08:59:54.340Z+ retry=3
9142024-02-01T08:59:54.341Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9152024-02-01T08:59:54.369Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9162024-02-01T08:59:54.369Z+ [[ 3 -gt 60 ]]
9172024-02-01T08:59:54.369Z+ sleep 1
9182024-02-01T08:59:55.349Z+ retry=4
9192024-02-01T08:59:55.349Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9202024-02-01T08:59:55.374Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9212024-02-01T08:59:55.374Z+ [[ 4 -gt 60 ]]
9222024-02-01T08:59:55.374Z+ sleep 1
9232024-02-01T08:59:56.364Z+ retry=5
9242024-02-01T08:59:56.364Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9252024-02-01T08:59:56.396Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9262024-02-01T08:59:56.396Z+ [[ 5 -gt 60 ]]
9272024-02-01T08:59:56.396Z+ sleep 1
9282024-02-01T08:59:57.381Z+ retry=6
9292024-02-01T08:59:57.381Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9302024-02-01T08:59:57.405Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9312024-02-01T08:59:57.405Z+ [[ 6 -gt 60 ]]
9322024-02-01T08:59:57.406Z+ sleep 1
9332024-02-01T08:59:58.398Z+ retry=7
9342024-02-01T08:59:58.398Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9352024-02-01T08:59:58.521Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9362024-02-01T08:59:58.522Z+ [[ 7 -gt 60 ]]
9372024-02-01T08:59:58.522Z+ sleep 1
9382024-02-01T08:59:59.417Z+ retry=8
9392024-02-01T08:59:59.417Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9402024-02-01T08:59:59.442Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9412024-02-01T08:59:59.443Z+ [[ 8 -gt 60 ]]
9422024-02-01T08:59:59.443Z+ sleep 1
9432024-02-01T09:00:00.431Z+ retry=9
9442024-02-01T09:00:00.431Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9452024-02-01T09:00:00.456Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9462024-02-01T09:00:00.456Z+ [[ 9 -gt 60 ]]
9472024-02-01T09:00:00.456Z+ sleep 1
9482024-02-01T09:00:01.461Z+ retry=10
9492024-02-01T09:00:01.461Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9502024-02-01T09:00:01.486Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9512024-02-01T09:00:01.486Z+ [[ 10 -gt 60 ]]
9522024-02-01T09:00:01.487Z+ sleep 1
9532024-02-01T09:00:02.478Z+ retry=11
9542024-02-01T09:00:02.479Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9552024-02-01T09:00:02.504Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9562024-02-01T09:00:02.504Z+ [[ 11 -gt 60 ]]
9572024-02-01T09:00:02.504Z+ sleep 1
9582024-02-01T09:00:03.497Z+ retry=12
9592024-02-01T09:00:03.497Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9602024-02-01T09:00:03.533Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9612024-02-01T09:00:03.534Z+ [[ 12 -gt 60 ]]
9622024-02-01T09:00:03.534Z+ sleep 1
9632024-02-01T09:00:04.514Z+ retry=13
9642024-02-01T09:00:04.514Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9652024-02-01T09:00:04.545Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9662024-02-01T09:00:04.545Z+ [[ 13 -gt 60 ]]
9672024-02-01T09:00:04.545Z+ sleep 1
9682024-02-01T09:00:05.528Z+ retry=14
9692024-02-01T09:00:05.528Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9702024-02-01T09:00:05.553Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9712024-02-01T09:00:05.553Z+ [[ 14 -gt 60 ]]
9722024-02-01T09:00:05.554Z+ sleep 1
9732024-02-01T09:00:06.544Z+ retry=15
9742024-02-01T09:00:06.544Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9752024-02-01T09:00:06.574Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9762024-02-01T09:00:06.575Z+ [[ 15 -gt 60 ]]
9772024-02-01T09:00:06.576Z+ sleep 1
9782024-02-01T09:00:07.562Z+ retry=16
9792024-02-01T09:00:07.562Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9802024-02-01T09:00:07.586Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9812024-02-01T09:00:07.586Z+ [[ 16 -gt 60 ]]
9822024-02-01T09:00:07.586Z+ sleep 1
9832024-02-01T09:00:08.586Z+ retry=17
9842024-02-01T09:00:08.586Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9852024-02-01T09:00:08.612Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9862024-02-01T09:00:08.612Z+ [[ 17 -gt 60 ]]
9872024-02-01T09:00:08.612Z+ sleep 1
9882024-02-01T09:00:09.596Z+ retry=18
9892024-02-01T09:00:09.596Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9902024-02-01T09:00:09.623Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9912024-02-01T09:00:09.623Z+ [[ 18 -gt 60 ]]
9922024-02-01T09:00:09.623Z+ sleep 1
9932024-02-01T09:00:10.612Z+ retry=19
9942024-02-01T09:00:10.612Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9952024-02-01T09:00:10.636Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9962024-02-01T09:00:10.636Z+ [[ 19 -gt 60 ]]
9972024-02-01T09:00:10.637Z+ sleep 1
9982024-02-01T09:00:11.634Z+ retry=20
9992024-02-01T09:00:11.634Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10002024-02-01T09:00:11.659Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10012024-02-01T09:00:11.659Z+ [[ 20 -gt 60 ]]
10022024-02-01T09:00:11.659Z+ sleep 1
10032024-02-01T09:00:12.644Z+ retry=21
10042024-02-01T09:00:12.644Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10052024-02-01T09:00:12.676Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10062024-02-01T09:00:12.676Z+ [[ 21 -gt 60 ]]
10072024-02-01T09:00:12.676Z+ sleep 1
10082024-02-01T09:00:13.663Z+ retry=22
10092024-02-01T09:00:13.663Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10102024-02-01T09:00:13.688Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10112024-02-01T09:00:13.688Z+ [[ 22 -gt 60 ]]
10122024-02-01T09:00:13.688Z+ sleep 1
10132024-02-01T09:00:14.677Z+ retry=23
10142024-02-01T09:00:14.677Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10152024-02-01T09:00:14.710Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10162024-02-01T09:00:14.710Z+ [[ 23 -gt 60 ]]
10172024-02-01T09:00:14.710Z+ sleep 1
10182024-02-01T09:00:15.693Z+ retry=24
10192024-02-01T09:00:15.693Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10202024-02-01T09:00:15.718Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10212024-02-01T09:00:15.718Z+ [[ 24 -gt 60 ]]
10222024-02-01T09:00:15.718Z+ sleep 1
10232024-02-01T09:00:16.711Z+ retry=25
10242024-02-01T09:00:16.711Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10252024-02-01T09:00:16.739Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10262024-02-01T09:00:16.739Z+ [[ 25 -gt 60 ]]
10272024-02-01T09:00:16.739Z+ sleep 1
10282024-02-01T09:00:17.725Z+ retry=26
10292024-02-01T09:00:17.725Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10302024-02-01T09:00:17.750Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10312024-02-01T09:00:17.750Z+ [[ 26 -gt 60 ]]
10322024-02-01T09:00:17.751Z+ sleep 1
10332024-02-01T09:00:18.741Z+ retry=27
10342024-02-01T09:00:18.742Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10352024-02-01T09:00:18.767Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10362024-02-01T09:00:18.767Z+ [[ 27 -gt 60 ]]
10372024-02-01T09:00:18.767Z+ sleep 1
10382024-02-01T09:00:19.758Z+ retry=28
10392024-02-01T09:00:19.758Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10402024-02-01T09:00:19.782Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10412024-02-01T09:00:19.782Z+ [[ 28 -gt 60 ]]
10422024-02-01T09:00:19.783Z+ sleep 1
10432024-02-01T09:00:20.779Z+ retry=29
10442024-02-01T09:00:20.780Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10452024-02-01T09:00:20.806Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10462024-02-01T09:00:20.808Z+ [[ 29 -gt 60 ]]
10472024-02-01T09:00:20.808Z+ sleep 1
10482024-02-01T09:00:21.791Z+ retry=30
10492024-02-01T09:00:21.791Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10502024-02-01T09:00:21.821Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10512024-02-01T09:00:21.822Z+ [[ 30 -gt 60 ]]
10522024-02-01T09:00:21.822Z+ sleep 1
10532024-02-01T09:00:22.803Z+ retry=31
10542024-02-01T09:00:22.803Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10552024-02-01T09:00:22.829Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10562024-02-01T09:00:22.829Z+ [[ 31 -gt 60 ]]
10572024-02-01T09:00:22.829Z+ sleep 1
10582024-02-01T09:00:23.818Z+ retry=32
10592024-02-01T09:00:23.818Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10602024-02-01T09:00:23.846Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10612024-02-01T09:00:23.847Z+ [[ 32 -gt 60 ]]
10622024-02-01T09:00:23.847Z+ sleep 1
10632024-02-01T09:00:24.843Z+ retry=33
10642024-02-01T09:00:24.844Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10652024-02-01T09:00:24.871Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10662024-02-01T09:00:24.871Z+ [[ 33 -gt 60 ]]
10672024-02-01T09:00:24.871Z+ sleep 1
10682024-02-01T09:00:25.849Z+ retry=34
10692024-02-01T09:00:25.849Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10702024-02-01T09:00:25.874Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10712024-02-01T09:00:25.875Z+ [[ 34 -gt 60 ]]
10722024-02-01T09:00:25.875Z+ sleep 1
10732024-02-01T09:00:26.866Z+ retry=35
10742024-02-01T09:00:26.866Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10752024-02-01T09:00:26.890Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10762024-02-01T09:00:26.890Z+ [[ 35 -gt 60 ]]
10772024-02-01T09:00:26.890Z+ sleep 1
10782024-02-01T09:00:27.882Z+ retry=36
10792024-02-01T09:00:27.882Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10802024-02-01T09:00:27.936Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10812024-02-01T09:00:27.936Z+ [[ 36 -gt 60 ]]
10822024-02-01T09:00:27.936Z+ sleep 1
10832024-02-01T09:00:28.898Z+ retry=37
10842024-02-01T09:00:28.898Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10852024-02-01T09:00:28.923Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10862024-02-01T09:00:28.923Z+ [[ 37 -gt 60 ]]
10872024-02-01T09:00:28.923Z+ sleep 1
10882024-02-01T09:00:29.913Z+ retry=38
10892024-02-01T09:00:29.913Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10902024-02-01T09:00:29.937Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10912024-02-01T09:00:29.938Z+ [[ 38 -gt 60 ]]
10922024-02-01T09:00:29.938Z+ sleep 1
10932024-02-01T09:00:30.928Z+ retry=39
10942024-02-01T09:00:30.928Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10952024-02-01T09:00:30.953Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10962024-02-01T09:00:30.953Z+ [[ 39 -gt 60 ]]
10972024-02-01T09:00:30.953Z+ sleep 1
10982024-02-01T09:00:31.943Z+ retry=40
10992024-02-01T09:00:31.944Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11002024-02-01T09:00:31.968Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11012024-02-01T09:00:31.968Z+ [[ 40 -gt 60 ]]
11022024-02-01T09:00:31.968Z+ sleep 1
11032024-02-01T09:00:32.959Z+ retry=41
11042024-02-01T09:00:32.960Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11052024-02-01T09:00:33.041Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
11062024-02-01T09:00:33.494Z{"status":"ok"}success
11072024-02-01T09:00:33.494ZProject {
11082024-02-01T09:00:33.494Z description: "some images",
11092024-02-01T09:00:33.494Z id: 08e20a01-1156-40d8-90e3-7375cb35546e,
11102024-02-01T09:00:33.495Z name: Name(
11112024-02-01T09:00:33.519Z "images",
11122024-02-01T09:00:33.519Z ),
11132024-02-01T09:00:33.519Z time_created: 2024-02-01T09:00:33.154844Z,
11142024-02-01T09:00:33.520Z time_modified: 2024-02-01T09:00:33.154844Z,
11152024-02-01T09:00:33.520Z}
11162024-02-01T09:00:33.520Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
11172024-02-01T09:06:00.275Zdone!
11182024-02-01T09:06:00.384Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
11192024-02-01T09:06:00.487Zsuccess
11202024-02-01T09:06:00.514ZImage {
11212024-02-01T09:06:00.545Z block_size: ByteCount(
11222024-02-01T09:06:00.545Z 512,
11232024-02-01T09:06:00.545Z ),
11242024-02-01T09:06:00.545Z description: "debian 11 original base image",
11252024-02-01T09:06:00.545Z digest: None,
11262024-02-01T09:06:00.545Z id: 35843901-1575-45ca-a00a-0f1358c339eb,
11272024-02-01T09:06:00.546Z name: Name(
11282024-02-01T09:06:00.546Z "debian11",
11292024-02-01T09:06:00.546Z ),
11302024-02-01T09:06:00.546Z os: "debian",
11312024-02-01T09:06:00.546Z project_id: None,
11322024-02-01T09:06:00.546Z size: ByteCount(
11332024-02-01T09:06:00.546Z 2147483648,
11342024-02-01T09:06:00.546Z ),
11352024-02-01T09:06:00.546Z time_created: 2024-02-01T09:06:00.230172Z,
11362024-02-01T09:06:00.546Z time_modified: 2024-02-01T09:06:00.460844Z,
11372024-02-01T09:06:00.546Z url: None,
11382024-02-01T09:06:00.546Z version: "11",
11392024-02-01T09:06:00.546Z}
11402024-02-01T09:06:00.546Z+ rm ./tests/bootstrap
11412024-02-01T09:06:00.579Z+ for test_bin in tests/*
11422024-02-01T09:06:00.579Z+ ./tests/bootstrap-7af1bd138257bcb8
11432024-02-01T09:06:00.579Z
11442024-02-01T09:06:00.579Zrunning 0 tests
11452024-02-01T09:06:00.579Z
11462024-02-01T09:06:00.579Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11472024-02-01T09:06:00.580Z
11482024-02-01T09:06:00.580Z+ for test_bin in tests/*
11492024-02-01T09:06:00.580Z+ ./tests/end_to_end_tests-add7be4a9ab9d514
11502024-02-01T09:06:00.581Z
11512024-02-01T09:06:00.581Zrunning 2 tests
11522024-02-01T09:06:00.793Ztest no_spoof::no_spoof_here ... ok
11532024-02-01T09:06:34.215Ztest instance_launch::instance_launch ... ok
11542024-02-01T09:06:34.215Z
11552024-02-01T09:06:34.215Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 33.62s
11562024-02-01T09:06:34.215Z
11572024-02-01T09:06:34.245Z+ _exit_trap
11582024-02-01T09:06:34.245Z+ local status=0
11592024-02-01T09:06:34.245Z+ [[ 0 -eq 0 ]]
11602024-02-01T09:06:34.245Z+ exit 0
11612024-02-01T09:06:34.267Zprocess exited: duration 658165 ms, exit code 0
 
11622024-02-01T09:06:34.444Zfound 128 output files
11632024-02-01T09:06:34.447Zuploading: /var/svc/log/oxide-sled-agent:default.log (741805 bytes)
11642024-02-01T09:06:35.754Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11652024-02-01T09:06:35.754Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (1646285 bytes)
11662024-02-01T09:06:36.582Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 1646285 -> 1654494
11672024-02-01T09:06:37.675Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11682024-02-01T09:06:37.675Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (733329 bytes)
11692024-02-01T09:06:39.653Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11702024-02-01T09:06:39.653Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (54590 bytes)
11712024-02-01T09:06:39.820Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 54590 -> 55285
11722024-02-01T09:06:41.305Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11732024-02-01T09:06:41.306Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (26210 bytes)
11742024-02-01T09:06:42.458Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11752024-02-01T09:06:42.483Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (72774 bytes)
11762024-02-01T09:06:42.599Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 72774 -> 73966
11772024-02-01T09:06:43.684Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11782024-02-01T09:06:43.684Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (34133 bytes)
11792024-02-01T09:06:44.874Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11802024-02-01T09:06:44.874Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (785865 bytes)
11812024-02-01T09:06:45.194Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 785865 -> 805033
11822024-02-01T09:06:46.273Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11832024-02-01T09:06:46.273Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (443475 bytes)
11842024-02-01T09:06:47.580Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11852024-02-01T09:06:47.581Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (500878 bytes)
11862024-02-01T09:06:47.835Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 500878 -> 513344
11872024-02-01T09:06:48.909Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11882024-02-01T09:06:48.909Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (244205 bytes)
11892024-02-01T09:06:50.182Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11902024-02-01T09:06:50.182Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11912024-02-01T09:06:51.269Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11922024-02-01T09:06:51.269Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11932024-02-01T09:06:52.366Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11942024-02-01T09:06:52.366Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (189754 bytes)
11952024-02-01T09:06:52.574Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 189754 -> 199340
11962024-02-01T09:06:53.657Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11972024-02-01T09:06:53.657Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (80127 bytes)
11982024-02-01T09:06:55.260Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11992024-02-01T09:06:55.260Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
12002024-02-01T09:06:56.332Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
12012024-02-01T09:06:56.333Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
12022024-02-01T09:06:57.845Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
12032024-02-01T09:06:57.845Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (10356 bytes)
12042024-02-01T09:06:57.922Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log" changed size mid upload: 10356 -> 11153
12052024-02-01T09:06:58.995Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
12062024-02-01T09:06:58.995Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (9375 bytes)
12072024-02-01T09:07:00.147Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
12082024-02-01T09:07:00.147Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-clickhouse:default.log (1033415 bytes)
12092024-02-01T09:07:01.130Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1033415 -> 1111455
12102024-02-01T09:07:02.622Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-clickhouse:default.log
12112024-02-01T09:07:02.622Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-clickhouse:default.log.0 (151271 bytes)
12122024-02-01T09:07:03.927Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-clickhouse:default.log.0
12132024-02-01T09:07:03.927Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12142024-02-01T09:07:05.020Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-zone-network-setup:default.log
12152024-02-01T09:07:05.020Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
12162024-02-01T09:07:06.122Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e608954c-3143-4a65-9cb1-cc5392fcde9b/root/var/svc/log/oxide-zone-network-setup:default.log.0
12172024-02-01T09:07:06.122Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_6e2e4ff4-9436-485b-8691-fda9d10a48ce/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12182024-02-01T09:07:07.200Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_6e2e4ff4-9436-485b-8691-fda9d10a48ce/root/var/svc/log/oxide-cockroachdb:default.log
12192024-02-01T09:07:07.201Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_6e2e4ff4-9436-485b-8691-fda9d10a48ce/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
12202024-02-01T09:07:08.420Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_6e2e4ff4-9436-485b-8691-fda9d10a48ce/root/var/svc/log/oxide-cockroachdb:default.log.0
12212024-02-01T09:07:08.421Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_6e2e4ff4-9436-485b-8691-fda9d10a48ce/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12222024-02-01T09:07:21.081Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_6e2e4ff4-9436-485b-8691-fda9d10a48ce/root/var/svc/log/oxide-zone-network-setup:default.log
12232024-02-01T09:07:21.081Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_6e2e4ff4-9436-485b-8691-fda9d10a48ce/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
12242024-02-01T09:07:22.074Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_6e2e4ff4-9436-485b-8691-fda9d10a48ce/root/var/svc/log/oxide-zone-network-setup:default.log.0
12252024-02-01T09:07:22.074Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-agent:default.log (41125 bytes)
12262024-02-01T09:07:23.661Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-agent:default.log
12272024-02-01T09:07:23.661Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12282024-02-01T09:07:24.826Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-agent:default.log.0
12292024-02-01T09:07:24.856Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12302024-02-01T09:07:25.898Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:default.log
12312024-02-01T09:07:25.899Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12322024-02-01T09:07:27.016Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12332024-02-01T09:07:27.016Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:downstairs-8b37be31-1c5d-49dc-addc-29bba0508969.log (5518 bytes)
12342024-02-01T09:07:28.110Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:downstairs-8b37be31-1c5d-49dc-addc-29bba0508969.log
12352024-02-01T09:07:28.110Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:downstairs-bdfa33b0-3b31-45ea-9225-0444649a0c6a.log (2932 bytes)
12362024-02-01T09:07:29.213Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:downstairs-bdfa33b0-3b31-45ea-9225-0444649a0c6a.log
12372024-02-01T09:07:29.214Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:downstairs-e5c017ab-2085-4d64-a04c-e5e730bb0ebf.log (5599 bytes)
12382024-02-01T09:07:30.342Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:downstairs-e5c017ab-2085-4d64-a04c-e5e730bb0ebf.log
12392024-02-01T09:07:30.343Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:snapshot-e5c017ab-2085-4d64-a04c-e5e730bb0ebf-2839f329-0315-4eef-84bf-18eb46bddaa5.log (5157 bytes)
12402024-02-01T09:07:31.450Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_427ce4b5-199f-4dae-856a-188d9b956fb0/root/var/svc/log/oxide-crucible-downstairs:snapshot-e5c017ab-2085-4d64-a04c-e5e730bb0ebf-2839f329-0315-4eef-84bf-18eb46bddaa5.log
12412024-02-01T09:07:31.450Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_e1d138dc-c1c0-4f1a-b454-7d198662a7db/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
12422024-02-01T09:07:32.530Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_e1d138dc-c1c0-4f1a-b454-7d198662a7db/root/var/svc/log/oxide-crucible-pantry:default.log
12432024-02-01T09:07:32.531Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_e1d138dc-c1c0-4f1a-b454-7d198662a7db/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
12442024-02-01T09:07:33.688Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_e1d138dc-c1c0-4f1a-b454-7d198662a7db/root/var/svc/log/oxide-crucible-pantry:default.log.0
12452024-02-01T09:07:33.688Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_abddbe78-4703-4f47-88e5-d641216fcd00/root/var/svc/log/oxide-external_dns:default.log (26433 bytes)
12462024-02-01T09:07:33.813Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_abddbe78-4703-4f47-88e5-d641216fcd00/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26433 -> 30208
12472024-02-01T09:07:34.904Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_abddbe78-4703-4f47-88e5-d641216fcd00/root/var/svc/log/oxide-external_dns:default.log
12482024-02-01T09:07:34.904Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_abddbe78-4703-4f47-88e5-d641216fcd00/root/var/svc/log/oxide-external_dns:default.log.0 (4282 bytes)
12492024-02-01T09:07:36.040Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_abddbe78-4703-4f47-88e5-d641216fcd00/root/var/svc/log/oxide-external_dns:default.log.0
12502024-02-01T09:07:36.040Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1dd544d5-e0bb-4637-95c3-deb24fdbc5b7/root/var/svc/log/oxide-internal_dns:default.log (30484 bytes)
12512024-02-01T09:07:36.162Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1dd544d5-e0bb-4637-95c3-deb24fdbc5b7/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 30484 -> 34240
12522024-02-01T09:07:37.248Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1dd544d5-e0bb-4637-95c3-deb24fdbc5b7/root/var/svc/log/oxide-internal_dns:default.log
12532024-02-01T09:07:37.248Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1dd544d5-e0bb-4637-95c3-deb24fdbc5b7/root/var/svc/log/oxide-internal_dns:default.log.0 (89006 bytes)
12542024-02-01T09:07:38.506Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1dd544d5-e0bb-4637-95c3-deb24fdbc5b7/root/var/svc/log/oxide-internal_dns:default.log.0
12552024-02-01T09:07:38.506Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_eeacbd9e-1c2c-4557-9342-0604593ec303/root/var/svc/log/oxide-nexus:default.log (34056961 bytes)
12562024-02-01T09:07:52.659Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_eeacbd9e-1c2c-4557-9342-0604593ec303/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 34056961 -> 34151122
12572024-02-01T09:07:53.909Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_eeacbd9e-1c2c-4557-9342-0604593ec303/root/var/svc/log/oxide-nexus:default.log
12582024-02-01T09:07:53.909Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_eeacbd9e-1c2c-4557-9342-0604593ec303/root/var/svc/log/oxide-nexus:default.log.0 (373410 bytes)
12592024-02-01T09:07:55.221Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_eeacbd9e-1c2c-4557-9342-0604593ec303/root/var/svc/log/oxide-nexus:default.log.0
12602024-02-01T09:07:55.221Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9811a122-9a12-46ab-b629-309649638159/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12612024-02-01T09:07:56.306Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9811a122-9a12-46ab-b629-309649638159/root/var/svc/log/oxide-cockroachdb:default.log
12622024-02-01T09:07:56.306Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9811a122-9a12-46ab-b629-309649638159/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12632024-02-01T09:07:57.404Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9811a122-9a12-46ab-b629-309649638159/root/var/svc/log/oxide-cockroachdb:default.log.0
12642024-02-01T09:07:57.404Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9811a122-9a12-46ab-b629-309649638159/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12652024-02-01T09:07:58.493Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9811a122-9a12-46ab-b629-309649638159/root/var/svc/log/oxide-zone-network-setup:default.log
12662024-02-01T09:07:58.493Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9811a122-9a12-46ab-b629-309649638159/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
12672024-02-01T09:07:59.591Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9811a122-9a12-46ab-b629-309649638159/root/var/svc/log/oxide-zone-network-setup:default.log.0
12682024-02-01T09:07:59.595Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-agent:default.log (6359 bytes)
12692024-02-01T09:08:00.689Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-agent:default.log
12702024-02-01T09:08:00.689Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12712024-02-01T09:08:01.793Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-agent:default.log.0
12722024-02-01T09:08:01.793Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12732024-02-01T09:08:03.323Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-downstairs:default.log
12742024-02-01T09:08:03.323Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12752024-02-01T09:08:04.436Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12762024-02-01T09:08:04.436Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-downstairs:downstairs-a16f39c2-399e-4288-9b8d-40904941a1c0.log (2933 bytes)
12772024-02-01T09:08:05.547Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_670f52c7-7003-46fa-a257-cb3c7e1361b2/root/var/svc/log/oxide-crucible-downstairs:downstairs-a16f39c2-399e-4288-9b8d-40904941a1c0.log
12782024-02-01T09:08:05.547Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_7be5fbb4-db87-48b4-8900-851ed20f3e7d/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
12792024-02-01T09:08:06.622Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_7be5fbb4-db87-48b4-8900-851ed20f3e7d/root/var/svc/log/oxide-crucible-pantry:default.log
12802024-02-01T09:08:06.622Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_7be5fbb4-db87-48b4-8900-851ed20f3e7d/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2333 bytes)
12812024-02-01T09:08:07.718Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_7be5fbb4-db87-48b4-8900-851ed20f3e7d/root/var/svc/log/oxide-crucible-pantry:default.log.0
12822024-02-01T09:08:07.718Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_821178fe-7051-407c-b3cd-ce0b7dfb0519/root/var/svc/log/oxide-external_dns:default.log (26442 bytes)
12832024-02-01T09:08:07.878Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_821178fe-7051-407c-b3cd-ce0b7dfb0519/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26442 -> 30220
12842024-02-01T09:08:09.012Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_821178fe-7051-407c-b3cd-ce0b7dfb0519/root/var/svc/log/oxide-external_dns:default.log
12852024-02-01T09:08:09.012Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_821178fe-7051-407c-b3cd-ce0b7dfb0519/root/var/svc/log/oxide-external_dns:default.log.0 (4282 bytes)
12862024-02-01T09:08:10.562Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_821178fe-7051-407c-b3cd-ce0b7dfb0519/root/var/svc/log/oxide-external_dns:default.log.0
12872024-02-01T09:08:10.562Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_cb561b20-19ed-49e6-8ae5-1f9647f72957/root/var/svc/log/oxide-internal_dns:default.log (30477 bytes)
12882024-02-01T09:08:10.736Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_cb561b20-19ed-49e6-8ae5-1f9647f72957/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 30477 -> 34232
12892024-02-01T09:08:11.837Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_cb561b20-19ed-49e6-8ae5-1f9647f72957/root/var/svc/log/oxide-internal_dns:default.log
12902024-02-01T09:08:11.871Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_cb561b20-19ed-49e6-8ae5-1f9647f72957/root/var/svc/log/oxide-internal_dns:default.log.0 (90612 bytes)
12912024-02-01T09:08:13.201Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_cb561b20-19ed-49e6-8ae5-1f9647f72957/root/var/svc/log/oxide-internal_dns:default.log.0
12922024-02-01T09:08:13.201Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_d34f626c-8c7a-4643-83b7-f3155df20abf/root/var/svc/log/oxide-nexus:default.log (796316 bytes)
12932024-02-01T09:08:14.884Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_d34f626c-8c7a-4643-83b7-f3155df20abf/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 796316 -> 907247
12942024-02-01T09:08:15.967Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_d34f626c-8c7a-4643-83b7-f3155df20abf/root/var/svc/log/oxide-nexus:default.log
12952024-02-01T09:08:15.967Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_d34f626c-8c7a-4643-83b7-f3155df20abf/root/var/svc/log/oxide-nexus:default.log.0 (366462 bytes)
12962024-02-01T09:08:18.213Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_d34f626c-8c7a-4643-83b7-f3155df20abf/root/var/svc/log/oxide-nexus:default.log.0
12972024-02-01T09:08:18.213Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2f3ab13c-51f4-4ad2-96ff-2069d88cf130/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12982024-02-01T09:08:18.852Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2f3ab13c-51f4-4ad2-96ff-2069d88cf130/root/var/svc/log/oxide-cockroachdb:default.log
12992024-02-01T09:08:18.853Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2f3ab13c-51f4-4ad2-96ff-2069d88cf130/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
13002024-02-01T09:08:19.983Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2f3ab13c-51f4-4ad2-96ff-2069d88cf130/root/var/svc/log/oxide-cockroachdb:default.log.0
13012024-02-01T09:08:19.983Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2f3ab13c-51f4-4ad2-96ff-2069d88cf130/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13022024-02-01T09:08:21.057Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2f3ab13c-51f4-4ad2-96ff-2069d88cf130/root/var/svc/log/oxide-zone-network-setup:default.log
13032024-02-01T09:08:21.058Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2f3ab13c-51f4-4ad2-96ff-2069d88cf130/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
13042024-02-01T09:08:22.568Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2f3ab13c-51f4-4ad2-96ff-2069d88cf130/root/var/svc/log/oxide-zone-network-setup:default.log.0
13052024-02-01T09:08:22.600Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13062024-02-01T09:08:23.243Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-agent:default.log
13072024-02-01T09:08:23.243Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-agent:default.log.0 (14580 bytes)
13082024-02-01T09:08:24.392Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-agent:default.log.0
13092024-02-01T09:08:24.839Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13102024-02-01T09:08:26.362Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-downstairs:default.log
13112024-02-01T09:08:26.362Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13122024-02-01T09:08:27.459Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13132024-02-01T09:08:27.459Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3261056-9986-497f-bcd0-b4453b844e7b.log (0 bytes)
13142024-02-01T09:08:28.536Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3261056-9986-497f-bcd0-b4453b844e7b.log
13152024-02-01T09:08:28.537Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3261056-9986-497f-bcd0-b4453b844e7b.log.0 (3051 bytes)
13162024-02-01T09:08:29.639Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_76092670-be08-42a1-a417-abdda2784f1d/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3261056-9986-497f-bcd0-b4453b844e7b.log.0
13172024-02-01T09:08:29.642Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_306e2776-3687-434f-987f-8a19f9cca8a9/root/var/svc/log/oxide-internal_dns:default.log (29644 bytes)
13182024-02-01T09:08:29.807Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_306e2776-3687-434f-987f-8a19f9cca8a9/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 29644 -> 34652
13192024-02-01T09:08:30.885Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_306e2776-3687-434f-987f-8a19f9cca8a9/root/var/svc/log/oxide-internal_dns:default.log
13202024-02-01T09:08:30.887Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_306e2776-3687-434f-987f-8a19f9cca8a9/root/var/svc/log/oxide-internal_dns:default.log.0 (94304 bytes)
13212024-02-01T09:08:32.255Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_306e2776-3687-434f-987f-8a19f9cca8a9/root/var/svc/log/oxide-internal_dns:default.log.0
13222024-02-01T09:08:32.255Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/svc/log/oxide-ntp:default.log (69 bytes)
13232024-02-01T09:08:33.771Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/svc/log/oxide-ntp:default.log
13242024-02-01T09:08:33.772Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/svc/log/oxide-ntp:default.log.0 (846 bytes)
13252024-02-01T09:08:34.883Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/svc/log/oxide-ntp:default.log.0
13262024-02-01T09:08:34.883Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_485f5fa2-b38d-4398-a74b-b5532480a910/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13272024-02-01T09:08:35.961Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_485f5fa2-b38d-4398-a74b-b5532480a910/root/var/svc/log/oxide-cockroachdb:default.log
13282024-02-01T09:08:35.962Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_485f5fa2-b38d-4398-a74b-b5532480a910/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
13292024-02-01T09:08:37.169Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_485f5fa2-b38d-4398-a74b-b5532480a910/root/var/svc/log/oxide-cockroachdb:default.log.0
13302024-02-01T09:08:37.170Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_485f5fa2-b38d-4398-a74b-b5532480a910/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13312024-02-01T09:08:38.252Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_485f5fa2-b38d-4398-a74b-b5532480a910/root/var/svc/log/oxide-zone-network-setup:default.log
13322024-02-01T09:08:38.253Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_485f5fa2-b38d-4398-a74b-b5532480a910/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
13332024-02-01T09:08:39.378Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_485f5fa2-b38d-4398-a74b-b5532480a910/root/var/svc/log/oxide-zone-network-setup:default.log.0
13342024-02-01T09:08:39.378Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a276abcc-1adf-4a68-b281-2347d436541c/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13352024-02-01T09:08:40.461Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a276abcc-1adf-4a68-b281-2347d436541c/root/var/svc/log/oxide-crucible-agent:default.log
13362024-02-01T09:08:40.461Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a276abcc-1adf-4a68-b281-2347d436541c/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13372024-02-01T09:08:41.571Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a276abcc-1adf-4a68-b281-2347d436541c/root/var/svc/log/oxide-crucible-agent:default.log.0
13382024-02-01T09:08:41.571Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a276abcc-1adf-4a68-b281-2347d436541c/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13392024-02-01T09:08:42.644Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a276abcc-1adf-4a68-b281-2347d436541c/root/var/svc/log/oxide-crucible-downstairs:default.log
13402024-02-01T09:08:42.644Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a276abcc-1adf-4a68-b281-2347d436541c/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13412024-02-01T09:08:43.751Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a276abcc-1adf-4a68-b281-2347d436541c/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13422024-02-01T09:08:43.751Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7a0a1277-9dfd-4db1-b4e8-2de06abceb05/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13432024-02-01T09:08:44.844Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7a0a1277-9dfd-4db1-b4e8-2de06abceb05/root/var/svc/log/oxide-cockroachdb:default.log
13442024-02-01T09:08:44.844Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7a0a1277-9dfd-4db1-b4e8-2de06abceb05/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
13452024-02-01T09:08:45.962Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7a0a1277-9dfd-4db1-b4e8-2de06abceb05/root/var/svc/log/oxide-cockroachdb:default.log.0
13462024-02-01T09:08:45.962Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7a0a1277-9dfd-4db1-b4e8-2de06abceb05/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13472024-02-01T09:08:47.054Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7a0a1277-9dfd-4db1-b4e8-2de06abceb05/root/var/svc/log/oxide-zone-network-setup:default.log
13482024-02-01T09:08:47.054Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7a0a1277-9dfd-4db1-b4e8-2de06abceb05/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
13492024-02-01T09:08:48.171Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7a0a1277-9dfd-4db1-b4e8-2de06abceb05/root/var/svc/log/oxide-zone-network-setup:default.log.0
13502024-02-01T09:08:48.172Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f44ea60c-e096-4de7-a63e-c69fd6d71e37/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13512024-02-01T09:08:49.252Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f44ea60c-e096-4de7-a63e-c69fd6d71e37/root/var/svc/log/oxide-crucible-agent:default.log
13522024-02-01T09:08:49.276Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f44ea60c-e096-4de7-a63e-c69fd6d71e37/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13532024-02-01T09:08:50.350Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f44ea60c-e096-4de7-a63e-c69fd6d71e37/root/var/svc/log/oxide-crucible-agent:default.log.0
13542024-02-01T09:08:50.350Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f44ea60c-e096-4de7-a63e-c69fd6d71e37/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13552024-02-01T09:08:51.430Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f44ea60c-e096-4de7-a63e-c69fd6d71e37/root/var/svc/log/oxide-crucible-downstairs:default.log
13562024-02-01T09:08:51.430Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f44ea60c-e096-4de7-a63e-c69fd6d71e37/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13572024-02-01T09:08:52.547Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f44ea60c-e096-4de7-a63e-c69fd6d71e37/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13582024-02-01T09:08:52.549Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-agent:default.log (16713 bytes)
13592024-02-01T09:08:53.699Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-agent:default.log
13602024-02-01T09:08:53.699Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13612024-02-01T09:08:54.822Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-agent:default.log.0
13622024-02-01T09:08:54.823Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13632024-02-01T09:08:55.905Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-downstairs:default.log
13642024-02-01T09:08:55.905Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13652024-02-01T09:08:58.533Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13662024-02-01T09:08:58.533Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-downstairs:downstairs-c72708fe-6770-43f9-910a-5b37116a2eca.log (5598 bytes)
13672024-02-01T09:08:59.621Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-downstairs:downstairs-c72708fe-6770-43f9-910a-5b37116a2eca.log
13682024-02-01T09:08:59.622Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-downstairs:snapshot-c72708fe-6770-43f9-910a-5b37116a2eca-2839f329-0315-4eef-84bf-18eb46bddaa5.log (5157 bytes)
13692024-02-01T09:09:00.729Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c2e07aee-c6bc-4648-a2a2-9176819736e2/root/var/svc/log/oxide-crucible-downstairs:snapshot-c72708fe-6770-43f9-910a-5b37116a2eca-2839f329-0315-4eef-84bf-18eb46bddaa5.log
13702024-02-01T09:09:00.730Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-oximeter:default.log (301311 bytes)
13712024-02-01T09:09:01.464Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 301311 -> 410961
13722024-02-01T09:09:02.551Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-oximeter:default.log
13732024-02-01T09:09:02.551Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-oximeter:default.log.0 (27786 bytes)
13742024-02-01T09:09:03.745Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-oximeter:default.log.0
13752024-02-01T09:09:03.745Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13762024-02-01T09:09:04.819Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-zone-network-setup:default.log
13772024-02-01T09:09:04.819Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes)
13782024-02-01T09:09:06.376Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_e9ef6757-f42f-4ae5-8548-fb6ab94c30e9/root/var/svc/log/oxide-zone-network-setup:default.log.0
13792024-02-01T09:09:06.376Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-agent:default.log (30716 bytes)
13802024-02-01T09:09:07.642Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-agent:default.log
13812024-02-01T09:09:07.642Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-agent:default.log.0 (14543 bytes)
13822024-02-01T09:09:08.786Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-agent:default.log.0
13832024-02-01T09:09:08.786Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13842024-02-01T09:09:09.860Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:default.log
13852024-02-01T09:09:09.860Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13862024-02-01T09:09:10.958Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13872024-02-01T09:09:10.958Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-22e9cdca-3e63-4c37-b6fc-bc5fa4e1bee7.log (5513 bytes)
13882024-02-01T09:09:12.086Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-22e9cdca-3e63-4c37-b6fc-bc5fa4e1bee7.log
13892024-02-01T09:09:12.086Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-4516ea2b-d914-4c40-b86c-e70fd0818eae.log (5597 bytes)
13902024-02-01T09:09:13.204Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-4516ea2b-d914-4c40-b86c-e70fd0818eae.log
13912024-02-01T09:09:13.205Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-8ebcd679-db0f-4a84-b34b-5d387d6d65d4.log (2933 bytes)
13922024-02-01T09:09:14.306Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-8ebcd679-db0f-4a84-b34b-5d387d6d65d4.log
13932024-02-01T09:09:14.306Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-a24ede0b-1bab-4535-b29d-7588e6d534f1.log (0 bytes)
13942024-02-01T09:09:15.390Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-a24ede0b-1bab-4535-b29d-7588e6d534f1.log
13952024-02-01T09:09:15.390Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-a24ede0b-1bab-4535-b29d-7588e6d534f1.log.0 (3049 bytes)
13962024-02-01T09:09:16.498Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:downstairs-a24ede0b-1bab-4535-b29d-7588e6d534f1.log.0
13972024-02-01T09:09:16.498Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:snapshot-4516ea2b-d914-4c40-b86c-e70fd0818eae-2839f329-0315-4eef-84bf-18eb46bddaa5.log (5158 bytes)
13982024-02-01T09:09:17.608Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_77a606c0-477e-4aa7-9c0a-8f802aa58471/root/var/svc/log/oxide-crucible-downstairs:snapshot-4516ea2b-d914-4c40-b86c-e70fd0818eae-2839f329-0315-4eef-84bf-18eb46bddaa5.log
13992024-02-01T09:09:17.608Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_4a920748-4c61-4689-b7b4-fec972e87d58/root/var/svc/log/oxide-crucible-pantry:default.log (1224118 bytes)
14002024-02-01T09:09:20.499Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_4a920748-4c61-4689-b7b4-fec972e87d58/root/var/svc/log/oxide-crucible-pantry:default.log
14012024-02-01T09:09:20.499Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_4a920748-4c61-4689-b7b4-fec972e87d58/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
14022024-02-01T09:09:21.613Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_4a920748-4c61-4689-b7b4-fec972e87d58/root/var/svc/log/oxide-crucible-pantry:default.log.0
14032024-02-01T09:09:21.613Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-agent:default.log (10678 bytes)
14042024-02-01T09:09:22.737Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-agent:default.log
14052024-02-01T09:09:22.737Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
14062024-02-01T09:09:23.838Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-agent:default.log.0
14072024-02-01T09:09:23.838Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14082024-02-01T09:09:24.912Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-downstairs:default.log
14092024-02-01T09:09:24.912Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14102024-02-01T09:09:26.007Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14112024-02-01T09:09:26.007Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-downstairs:downstairs-1e2f9340-57c8-4eb8-b58b-676c34af6ae4.log (5513 bytes)
14122024-02-01T09:09:27.129Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a06592bc-b510-4c3a-b75a-3e888303136f/root/var/svc/log/oxide-crucible-downstairs:downstairs-1e2f9340-57c8-4eb8-b58b-676c34af6ae4.log
14132024-02-01T09:09:27.129Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_9ea7e9a1-87b6-4cf5-a153-6d7a1eb86b9c/root/var/svc/log/oxide-nexus:default.log (767810 bytes)
14142024-02-01T09:09:28.393Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_9ea7e9a1-87b6-4cf5-a153-6d7a1eb86b9c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 767810 -> 1098322
14152024-02-01T09:09:29.465Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_9ea7e9a1-87b6-4cf5-a153-6d7a1eb86b9c/root/var/svc/log/oxide-nexus:default.log
14162024-02-01T09:09:29.465Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_9ea7e9a1-87b6-4cf5-a153-6d7a1eb86b9c/root/var/svc/log/oxide-nexus:default.log.0 (1959461 bytes)
14172024-02-01T09:09:32.667Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_9ea7e9a1-87b6-4cf5-a153-6d7a1eb86b9c/root/var/svc/log/oxide-nexus:default.log.0
14182024-02-01T09:09:32.668Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
14192024-02-01T09:09:33.742Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-agent:default.log
14202024-02-01T09:09:33.742Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-agent:default.log.0 (14119 bytes)
14212024-02-01T09:09:34.862Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-agent:default.log.0
14222024-02-01T09:09:34.862Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14232024-02-01T09:09:35.939Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-downstairs:default.log
14242024-02-01T09:09:35.939Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14252024-02-01T09:09:37.035Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14262024-02-01T09:09:37.036Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-downstairs:downstairs-c42ba362-7878-4108-b11f-55401bb7040a.log (0 bytes)
14272024-02-01T09:09:38.114Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-downstairs:downstairs-c42ba362-7878-4108-b11f-55401bb7040a.log
14282024-02-01T09:09:38.114Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-downstairs:downstairs-c42ba362-7878-4108-b11f-55401bb7040a.log.0 (3049 bytes)
14292024-02-01T09:09:39.210Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c8740e28-f1ee-4d3a-bc4f-3475e0efd7a8/root/var/svc/log/oxide-crucible-downstairs:downstairs-c42ba362-7878-4108-b11f-55401bb7040a.log.0
14302024-02-01T09:09:39.210Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/measurements.log (18358 bytes)
14312024-02-01T09:09:39.306Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/measurements.log" changed size mid upload: 18358 -> 24523
14322024-02-01T09:09:40.381Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/measurements.log
14332024-02-01T09:09:40.381Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/statistics.log (11700 bytes)
14342024-02-01T09:09:40.477Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/statistics.log" changed size mid upload: 11700 -> 16965
14352024-02-01T09:09:41.556Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/statistics.log
14362024-02-01T09:09:41.556Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/tracking.log (1717 bytes)
14372024-02-01T09:09:41.621Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/tracking.log" changed size mid upload: 1717 -> 2113
14382024-02-01T09:09:42.691Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_c83ef691-b506-4f92-a70a-14f7609db11a/root/var/log/chrony/tracking.log