01HPQ7QZTDKRCFGEG1CYYPNG8Z: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HPQ7S4J3Q15G8Y01M8PCR0ZT

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-15T21:15:22.654Zjob dependencies complete; ready to run (waiting for 38 m 26 s)
22024-02-15T21:56:22.654Zjob assigned to worker 01HPQC3NRVDB43CGANYJJ5N1BV (queued for 40 m 59 s)
32024-02-15T21:56:22.959Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-02-15T21:56:26.375Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-02-15T21:56:26.487Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-02-15T21:56:27.006Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-02-15T21:56:27.061Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-02-15T21:56:27.120ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-02-15T21:56:27.166Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-02-15T21:56:27.202ZOxide Helios Version helios-2.0.22451 64-bit
112024-02-15T21:56:27.249ZConfiguring devices.
122024-02-15T21:56:27.287Z##################################################
132024-02-15T21:56:27.331Z#### ############# ##
142024-02-15T21:56:27.384Z### ### ############ ##
152024-02-15T21:56:27.424Z## ### # ## ### ## Oxide Computer Company ##
162024-02-15T21:56:27.924Z## ## ## ### # ### ##
172024-02-15T21:56:27.984Z## # ### #### #### This Station Under ##
182024-02-15T21:56:28.023Z### ### #### # ### Computer Control ##
192024-02-15T21:56:28.056Z#### #### ### ## ##
202024-02-15T21:56:28.090Z##################################################
212024-02-15T21:56:28.134ZHostname: buskin
222024-02-15T21:56:28.181ZLoading smf(7) service descriptions:
232024-02-15T21:56:28.616Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-53acd5ae20bb1630.gz
242024-02-15T21:56:40.772Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-53acd5ae20bb1630.gz
252024-02-15T21:56:41.364Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-02-15T21:58:05.139Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-02-15T21:58:05.187Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-510c49e5fe726d0c.gz
282024-02-15T21:59:50.795Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-510c49e5fe726d0c.gz
292024-02-15T21:59:50.795Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-02-15T21:59:52.282Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-02-15T21:59:52.307Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-02-15T22:00:04.095Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-02-15T22:00:04.095Zdownloading input: /input/package/work/version.txt
342024-02-15T22:00:04.095Zdownloaded input: /input/package/work/version.txt
352024-02-15T22:00:04.095Zdownloading input: /input/package/work/package.tar.gz
362024-02-15T22:01:30.277Zdownloaded input: /input/package/work/package.tar.gz
372024-02-15T22:01:30.278Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-02-15T22:03:15.692Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-02-15T22:03:15.693Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-02-15T22:04:48.082Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-02-15T22:04:48.125Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-02-15T22:06:44.824Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-02-15T22:06:44.824Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-02-15T22:09:57.155Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-02-15T22:09:57.156Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-02-15T22:11:52.162Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-02-15T22:11:52.163Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
482024-02-15T22:11:58.791Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
492024-02-15T22:11:58.824Zdownloading input: /input/package/work/zones/crucible.tar.gz
502024-02-15T22:12:28.401Zdownloaded input: /input/package/work/zones/crucible.tar.gz
512024-02-15T22:12:28.401Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-02-15T22:12:43.271Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-02-15T22:12:43.271Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-02-15T22:12:55.001Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-02-15T22:12:55.001Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-02-15T22:12:55.370Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-02-15T22:12:55.370Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-02-15T22:13:23.255Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-02-15T22:13:23.255Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-02-15T22:13:41.750Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-02-15T22:13:41.750Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-02-15T22:14:29.471Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-02-15T22:14:29.471Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-02-15T22:15:31.339Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-02-15T22:15:31.339Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-02-15T22:15:31.451Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-02-15T22:15:31.483Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-02-15T22:16:26.324Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-02-15T22:16:26.324Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-02-15T22:17:32.185Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-02-15T22:17:32.186Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-02-15T22:19:28.333Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-02-15T22:19:28.333Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-02-15T22:21:34.472Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-02-15T22:21:34.473Zstarting task 0: "setup"
762024-02-15T22:21:34.500Z++ uname -s
772024-02-15T22:21:34.500Z+ kern=SunOS
782024-02-15T22:21:34.501Z+ case "$kern" in
792024-02-15T22:21:34.501Z+ groupadd -g 12345 build
802024-02-15T22:21:34.501Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-02-15T22:21:36.908Z+ zfs create -o mountpoint=/work rpool/work
822024-02-15T22:21:36.942Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-02-15T22:21:36.943Z+ home_fs=zfs
842024-02-15T22:21:36.943Z+ [[ zfs == autofs ]]
852024-02-15T22:21:36.943Z+ mkdir -p /home/build
862024-02-15T22:21:36.943Z+ chown build:build /home/build /work
872024-02-15T22:21:38.523Z+ chmod 0700 /home/build /work
882024-02-15T22:21:38.555Zprocess exited: duration 4053 ms, exit code 0
 
892024-02-15T22:21:38.618Zstarting task 1: "authentication"
902024-02-15T22:21:38.697Zprocess exited: duration 84 ms, exit code 0
 
912024-02-15T22:21:38.751Zstarting task 2: "build"
922024-02-15T22:21:38.791Z+ trap _exit_trap EXIT
932024-02-15T22:21:38.791Z+ set +x
942024-02-15T22:23:34.775Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-02-15T22:23:35.244Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-02-15T22:23:35.244Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-02-15T22:23:35.244Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-02-15T22:23:35.244Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-02-15T22:23:35.245Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-02-15T22:23:35.245Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-02-15T22:23:35.245Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-02-15T22:23:35.245Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-02-15T22:23:35.246Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-02-15T22:23:35.246Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-02-15T22:23:35.253Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-02-15T22:23:35.253Z+ [[ -d /opt/oxide ]]
1072024-02-15T22:23:35.254Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-02-15T22:23:35.254Z+ pfexec mkdir /opt/oxide
1092024-02-15T22:23:35.254Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-02-15T22:23:35.254Z+ [[ -d /opt/oxide-underneath ]]
1112024-02-15T22:23:35.254Z+ cd /opt/oxide-underneath
1122024-02-15T22:23:35.254Z+ pfexec tar ceEp@/f - .
1132024-02-15T22:23:35.254Z+ cd /opt/oxide
1142024-02-15T22:23:35.255Z+ pfexec tar xveEp@/f -
1152024-02-15T22:23:35.255Zx ., 0 bytes, 0 tape blocks
1162024-02-15T22:23:35.255Zx ./opte, 0 bytes, 0 tape blocks
1172024-02-15T22:23:35.255Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-02-15T22:23:35.255Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-02-15T22:23:35.256Z+ pfexec rm -rf /opt/oxide-underneath
1202024-02-15T22:23:35.256Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-02-15T22:23:35.256Z+ pfexec mkdir /opt/oxide/work
1222024-02-15T22:23:35.256Z+ pfexec chown build:build /opt/oxide/work
1232024-02-15T22:23:35.256Z+ cd /opt/oxide/work
1242024-02-15T22:23:35.257Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-02-15T22:23:36.819ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-02-15T22:23:36.820Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1272024-02-15T22:23:36.820Zx out/omicron-sled-agent.tar, 122944512 bytes, 240126 tape blocks
1282024-02-15T22:23:36.820Zx out/oxlog.tar, 8382464 bytes, 16372 tape blocks
1292024-02-15T22:23:36.820Zx out/target/test, 75 bytes, 1 tape blocks
1302024-02-15T22:23:36.820Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-02-15T22:23:36.820Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1322024-02-15T22:23:36.820Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-02-15T22:23:36.820Zx target/release/omicron-package, 45821728 bytes, 89496 tape blocks
1342024-02-15T22:23:36.820Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-02-15T22:23:36.820Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-02-15T22:23:36.821Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-02-15T22:23:36.821Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-02-15T22:23:36.821Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-02-15T22:23:36.821Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-02-15T22:23:36.821Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-02-15T22:23:36.846Z
1422024-02-15T22:23:36.846Zreal 1.707332054
1432024-02-15T22:23:36.846Zuser 1.539718075
1442024-02-15T22:23:36.846Zsys 0.297053454
1452024-02-15T22:23:36.846Ztrap 0.000069431
1462024-02-15T22:23:36.846Ztflt 0.000000000
1472024-02-15T22:23:36.846Zdflt 0.000000000
1482024-02-15T22:23:36.846Zkflt 0.000000000
1492024-02-15T22:23:36.847Zlock 0.000000000
1502024-02-15T22:23:36.847Zslp 1.538771549
1512024-02-15T22:23:36.847Zlat 0.037130054
1522024-02-15T22:23:36.847Zstop 0.000120622
1532024-02-15T22:23:36.847Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-02-15T22:23:38.011Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-02-15T22:23:38.043Z+ mkdir tests
1562024-02-15T22:23:38.043Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-02-15T22:23:38.044Z+ ptime -m gunzip
1582024-02-15T22:23:38.044Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-53acd5ae20bb1630
1592024-02-15T22:23:38.272Z
1602024-02-15T22:23:38.328Zreal 0.232528426
1612024-02-15T22:23:38.328Zuser 0.214413916
1622024-02-15T22:23:38.329Zsys 0.017874774
1632024-02-15T22:23:38.329Ztrap 0.000014210
1642024-02-15T22:23:38.329Ztflt 0.000000000
1652024-02-15T22:23:38.329Zdflt 0.000000000
1662024-02-15T22:23:38.329Zkflt 0.000000000
1672024-02-15T22:23:38.329Zlock 0.000000000
1682024-02-15T22:23:38.329Zslp 0.000020750
1692024-02-15T22:23:38.329Zlat 0.000016610
1702024-02-15T22:23:38.329Zstop 0.000122672
1712024-02-15T22:23:38.329Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-53acd5ae20bb1630
1722024-02-15T22:23:38.329Z+ chmod a+x tests/bootstrap-53acd5ae20bb1630
1732024-02-15T22:23:38.329Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-02-15T22:23:38.329Z+ ptime -m gunzip
1752024-02-15T22:23:38.329Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-02-15T22:23:40.768Z
1772024-02-15T22:23:40.802Zreal 2.496250421
1782024-02-15T22:23:40.803Zuser 2.354071147
1792024-02-15T22:23:40.803Zsys 0.141748025
1802024-02-15T22:23:40.803Ztrap 0.000202894
1812024-02-15T22:23:40.803Ztflt 0.000000000
1822024-02-15T22:23:40.803Zdflt 0.000000000
1832024-02-15T22:23:40.803Zkflt 0.000000000
1842024-02-15T22:23:40.803Zlock 0.000000000
1852024-02-15T22:23:40.803Zslp 0.000020170
1862024-02-15T22:23:40.803Zlat 0.000023590
1872024-02-15T22:23:40.803Zstop 0.000126342
1882024-02-15T22:23:40.803Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-02-15T22:23:40.804Z+ chmod a+x tests/bootstrap
1902024-02-15T22:23:40.804Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-02-15T22:23:40.804Z+ ptime -m gunzip
1922024-02-15T22:23:40.804Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-510c49e5fe726d0c
1932024-02-15T22:23:43.386Z
1942024-02-15T22:23:43.446Zreal 2.582941543
1952024-02-15T22:23:43.446Zuser 2.424406560
1962024-02-15T22:23:43.446Zsys 0.158074248
1972024-02-15T22:23:43.446Ztrap 0.000223141
1982024-02-15T22:23:43.446Ztflt 0.000000000
1992024-02-15T22:23:43.446Zdflt 0.000000000
2002024-02-15T22:23:43.446Zkflt 0.000000000
2012024-02-15T22:23:43.447Zlock 0.000000000
2022024-02-15T22:23:43.447Zslp 0.000023640
2032024-02-15T22:23:43.447Zlat 0.000027790
2042024-02-15T22:23:43.447Zstop 0.000120032
2052024-02-15T22:23:43.447Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-510c49e5fe726d0c
2062024-02-15T22:23:43.447Z+ chmod a+x tests/end_to_end_tests-510c49e5fe726d0c
2072024-02-15T22:23:43.447Z+ bmat address ls
2082024-02-15T22:23:43.448ZNAME CIDR FIRST LAST COUNT
2092024-02-15T22:23:43.448Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-02-15T22:23:43.448Z++ bmat address ls -f extra -Ho first,last,count
2112024-02-15T22:23:43.448Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-02-15T22:23:43.448Z+ EXTRA_IP_START=10.151.1.164
2132024-02-15T22:23:43.448Z+ EXTRA_IP_END=10.151.1.227
2142024-02-15T22:23:43.448Z+ EXTRA_IP_COUNT=64
2152024-02-15T22:23:43.448Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-02-15T22:23:43.448Z+ EXTRA_IP_BASE=10.151.1
2172024-02-15T22:23:43.448Z+ EXTRA_IP_FOCTET=164
2182024-02-15T22:23:43.448Z+ EXTRA_IP_LOCTET=227
2192024-02-15T22:23:43.449Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-02-15T22:23:43.449Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-02-15T22:23:43.449Z+ DNS_IP1=10.151.1.164
2222024-02-15T22:23:43.449Z+ DNS_IP2=10.151.1.165
2232024-02-15T22:23:43.449Z+ UPLINK_IP=10.151.1.174
2242024-02-15T22:23:43.449Z+ IPPOOL_START=10.151.1.175
2252024-02-15T22:23:43.449Z+ IPPOOL_END=10.151.1.227
2262024-02-15T22:23:43.450Z++ ipadm show-addr -po type,addr
2272024-02-15T22:23:43.450Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-02-15T22:23:43.450Z+ GATEWAY_IP=10.151.1.100
2292024-02-15T22:23:43.450Z+ [[ -n 10.151.1.100 ]]
2302024-02-15T22:23:43.450Z+ ping -s 10.151.1.100 56 1
2312024-02-15T22:23:43.450ZPING 10.151.1.100: 56 data bytes
2322024-02-15T22:23:43.450Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2332024-02-15T22:23:43.450Z
2342024-02-15T22:23:43.450Z----10.151.1.100 PING Statistics----
2352024-02-15T22:23:43.451Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-02-15T22:23:43.451Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2372024-02-15T22:23:43.451Z++ arp -an
2382024-02-15T22:23:43.451Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-02-15T22:23:43.451Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-02-15T22:23:43.451Z+ routeadm -e ipv4-forwarding -u
2412024-02-15T22:23:43.538Z+ PXA_START=10.151.1.164
2422024-02-15T22:23:43.538Z+ PXA_END=10.151.1.227
2432024-02-15T22:23:43.538Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-02-15T22:23:43.643Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-02-15T22:23:43.743Z+ ZPOOL_VDEV_DIR=/scratch
2462024-02-15T22:23:43.743Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-02-15T22:23:43.785Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-02-15T22:23:43.785Z++ cd ./tools
2492024-02-15T22:23:43.785Z++ pwd
2502024-02-15T22:23:43.786Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-02-15T22:23:43.786Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-02-15T22:23:43.786Z+ SOFTNPU_MODE=zone
2532024-02-15T22:23:43.786Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-02-15T22:23:43.786Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-02-15T22:23:43.786Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-02-15T22:23:43.786Z++ dladm show-phys -p -o LINK
2572024-02-15T22:23:43.786Z++ head -1
2582024-02-15T22:23:43.786Z+ PHYSICAL_LINK=igb0
2592024-02-15T22:23:43.786Z+ echo 'Using igb0 as physical link'
2602024-02-15T22:23:43.786ZUsing igb0 as physical link
2612024-02-15T22:23:43.786Z+ ensure_run_as_root
2622024-02-15T22:23:43.786Z++ id -u
2632024-02-15T22:23:43.786Z+ [[ 0 -ne 0 ]]
2642024-02-15T22:23:43.786Z+ ensure_zpools
2652024-02-15T22:23:43.786Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-02-15T22:23:43.786Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-02-15T22:23:43.786Z+ readarray -t ZPOOLS
2682024-02-15T22:23:43.786Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-02-15T22:23:43.786Z++ sed 's/[ ",]//g'
2702024-02-15T22:23:43.787Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-02-15T22:23:43.787Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-02-15T22:23:43.787ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-02-15T22:23:43.787Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-02-15T22:23:43.787Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-02-15T22:23:43.787Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-02-15T22:23:43.787Z0+0 records in
2772024-02-15T22:23:43.787Z0+0 records out
2782024-02-15T22:23:43.787Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2792024-02-15T22:23:43.787Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-02-15T22:23:43.787Z+ set +x
2812024-02-15T22:23:43.787ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-02-15T22:23:43.851Z++ zpool list -o name
2832024-02-15T22:23:43.851Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-02-15T22:23:43.852Z+ [[ -z '' ]]
2852024-02-15T22:23:43.852Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-15T22:23:43.852Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-02-15T22:23:43.852Z+ set +x
2882024-02-15T22:23:43.852ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-02-15T22:23:43.853Z+ for ZPOOL in "${ZPOOLS[@]}"
2902024-02-15T22:23:43.853Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2912024-02-15T22:23:43.853ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2922024-02-15T22:23:43.853Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2932024-02-15T22:23:43.853Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2942024-02-15T22:23:43.853Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-02-15T22:23:43.853Z0+0 records in
2962024-02-15T22:23:43.853Z0+0 records out
2972024-02-15T22:23:43.854Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2982024-02-15T22:23:43.854Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-02-15T22:23:43.854Z+ set +x
3002024-02-15T22:23:43.854ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-02-15T22:23:43.854Z++ zpool list -o name
3022024-02-15T22:23:43.854Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-02-15T22:23:43.854Z+ [[ -z '' ]]
3042024-02-15T22:23:43.854Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-15T22:23:43.898Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-02-15T22:23:43.898Z+ set +x
3072024-02-15T22:23:43.898ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-02-15T22:23:43.898Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-02-15T22:23:43.898Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-02-15T22:23:43.899ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-02-15T22:23:43.899Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-02-15T22:23:43.899Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-02-15T22:23:43.899Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-02-15T22:23:43.899Z0+0 records in
3152024-02-15T22:23:43.899Z0+0 records out
3162024-02-15T22:23:43.899Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3172024-02-15T22:23:43.900Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-02-15T22:23:43.900Z+ set +x
3192024-02-15T22:23:43.900ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-02-15T22:23:43.900Z++ zpool list -o name
3212024-02-15T22:23:43.900Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-02-15T22:23:43.900Z+ [[ -z '' ]]
3232024-02-15T22:23:43.900Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-02-15T22:23:43.944Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-02-15T22:23:43.944Z+ set +x
3262024-02-15T22:23:43.944ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-02-15T22:23:43.944Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-02-15T22:23:43.944Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-02-15T22:23:43.944ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3302024-02-15T22:23:43.944Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3312024-02-15T22:23:43.944Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-02-15T22:23:43.944Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-02-15T22:23:43.944Z0+0 records in
3342024-02-15T22:23:43.944Z0+0 records out
3352024-02-15T22:23:43.945Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3362024-02-15T22:23:43.945Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-02-15T22:23:43.945Z+ set +x
3382024-02-15T22:23:43.945ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-02-15T22:23:43.945Z++ zpool list -o name
3402024-02-15T22:23:43.945Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-02-15T22:23:43.945Z+ [[ -z '' ]]
3422024-02-15T22:23:43.945Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-15T22:23:43.987Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-02-15T22:23:43.987Z+ set +x
3452024-02-15T22:23:43.988ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-02-15T22:23:43.988Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-02-15T22:23:43.988Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3482024-02-15T22:23:43.988ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3492024-02-15T22:23:43.988Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-02-15T22:23:43.988Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-02-15T22:23:43.988Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-02-15T22:23:43.988Z0+0 records in
3532024-02-15T22:23:43.988Z0+0 records out
3542024-02-15T22:23:43.989Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3552024-02-15T22:23:43.989Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-02-15T22:23:43.989Z+ set +x
3572024-02-15T22:23:43.989ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-02-15T22:23:43.989Z++ zpool list -o name
3592024-02-15T22:23:43.989Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-02-15T22:23:43.989Z+ [[ -z '' ]]
3612024-02-15T22:23:43.989Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-15T22:23:44.034Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-02-15T22:23:44.034Z+ set +x
3642024-02-15T22:23:44.034ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-02-15T22:23:44.034Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-02-15T22:23:44.034Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-02-15T22:23:44.034ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-02-15T22:23:44.034Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-02-15T22:23:44.034Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-02-15T22:23:44.034Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-02-15T22:23:44.034Z0+0 records in
3722024-02-15T22:23:44.034Z0+0 records out
3732024-02-15T22:23:44.034Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3742024-02-15T22:23:44.034Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-02-15T22:23:44.034Z+ set +x
3762024-02-15T22:23:44.034ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-02-15T22:23:44.034Z++ zpool list -o name
3782024-02-15T22:23:44.034Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-02-15T22:23:44.034Z+ [[ -z '' ]]
3802024-02-15T22:23:44.034Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-15T22:23:44.035Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-02-15T22:23:44.035Z+ set +x
3832024-02-15T22:23:44.035ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-02-15T22:23:44.035Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-02-15T22:23:44.035Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3862024-02-15T22:23:44.035ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3872024-02-15T22:23:44.035Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-02-15T22:23:44.035Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-02-15T22:23:44.035Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-02-15T22:23:44.035Z0+0 records in
3912024-02-15T22:23:44.035Z0+0 records out
3922024-02-15T22:23:44.035Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3932024-02-15T22:23:44.035Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-02-15T22:23:44.035Z+ set +x
3952024-02-15T22:23:44.035ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-02-15T22:23:44.092Z++ zpool list -o name
3972024-02-15T22:23:44.092Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-02-15T22:23:44.092Z+ [[ -z '' ]]
3992024-02-15T22:23:44.092Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-15T22:23:44.092Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-02-15T22:23:44.093Z+ set +x
4022024-02-15T22:23:44.093ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-02-15T22:23:44.093Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-02-15T22:23:44.093ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4052024-02-15T22:23:44.093Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4062024-02-15T22:23:44.093Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-02-15T22:23:44.093Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-02-15T22:23:44.093Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-02-15T22:23:44.093Z0+0 records in
4102024-02-15T22:23:44.093Z0+0 records out
4112024-02-15T22:23:44.093Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4122024-02-15T22:23:44.093Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-02-15T22:23:44.093Z+ set +x
4142024-02-15T22:23:44.093ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-02-15T22:23:44.093Z++ zpool list -o name
4162024-02-15T22:23:44.093Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-02-15T22:23:44.145Z+ [[ -z '' ]]
4182024-02-15T22:23:44.145Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-15T22:23:44.146Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-02-15T22:23:44.146Z+ set +x
4212024-02-15T22:23:44.146ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-02-15T22:23:44.146Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-02-15T22:23:44.147Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-02-15T22:23:44.147ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4252024-02-15T22:23:44.147Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4262024-02-15T22:23:44.147Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-02-15T22:23:44.147Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-02-15T22:23:44.147Z0+0 records in
4292024-02-15T22:23:44.147Z0+0 records out
4302024-02-15T22:23:44.147Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4312024-02-15T22:23:44.147Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-02-15T22:23:44.147Z+ set +x
4332024-02-15T22:23:44.147ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-02-15T22:23:44.147Z++ zpool list -o name
4352024-02-15T22:23:44.147Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-02-15T22:23:44.147Z+ [[ -z '' ]]
4372024-02-15T22:23:44.147Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-15T22:23:44.193Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-02-15T22:23:44.193Z+ set +x
4402024-02-15T22:23:44.194ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-02-15T22:23:44.194Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-02-15T22:23:44.194Z+ readarray -t ZPOOLS
4432024-02-15T22:23:44.194Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-02-15T22:23:44.194Z++ sed 's/[ ",]//g'
4452024-02-15T22:23:44.194Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-02-15T22:23:44.194Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-02-15T22:23:44.194ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-02-15T22:23:44.194Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-02-15T22:23:44.194Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-02-15T22:23:44.194Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-02-15T22:23:44.194Z0+0 records in
4522024-02-15T22:23:44.194Z0+0 records out
4532024-02-15T22:23:44.194Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4542024-02-15T22:23:44.194Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-02-15T22:23:44.194Z+ set +x
4562024-02-15T22:23:44.194ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-02-15T22:23:44.194Z++ zpool list -o name
4582024-02-15T22:23:44.194Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-02-15T22:23:44.194Z+ [[ -z '' ]]
4602024-02-15T22:23:44.195Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-15T22:23:44.228Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-02-15T22:23:44.228Z+ set +x
4632024-02-15T22:23:44.229ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4642024-02-15T22:23:44.229Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-02-15T22:23:44.229Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4662024-02-15T22:23:44.229Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4672024-02-15T22:23:44.229ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4682024-02-15T22:23:44.229Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4692024-02-15T22:23:44.229Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-02-15T22:23:44.229Z0+0 records in
4712024-02-15T22:23:44.229Z0+0 records out
4722024-02-15T22:23:44.229Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4732024-02-15T22:23:44.229Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-02-15T22:23:44.229Z+ set +x
4752024-02-15T22:23:44.229ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-02-15T22:23:44.229Z++ zpool list -o name
4772024-02-15T22:23:44.229Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-02-15T22:23:44.229Z+ [[ -z '' ]]
4792024-02-15T22:23:44.229Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-15T22:23:44.272Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-02-15T22:23:44.272Z+ set +x
4822024-02-15T22:23:44.272ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-02-15T22:23:44.273Z+ [[ zone == \z\o\n\e ]]
4842024-02-15T22:23:44.273Z+ ensure_simulated_links igb0
4852024-02-15T22:23:44.273Z+ local PHYSICAL_LINK=igb0
4862024-02-15T22:23:44.273Z+ INDICES=("0" "1")
4872024-02-15T22:23:44.273Z+ for I in "${INDICES[@]}"
4882024-02-15T22:23:44.273Z++ get_simnet_name_if_exists net0
4892024-02-15T22:23:44.273Z++ dladm show-simnet -p -o LINK net0
4902024-02-15T22:23:44.337Z++ echo ''
4912024-02-15T22:23:44.338Z+ [[ -z '' ]]
4922024-02-15T22:23:44.338Z+ dladm create-simnet -t net0
4932024-02-15T22:23:44.338Z+ dladm create-simnet -t sc0_0
4942024-02-15T22:23:44.338Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-02-15T22:23:44.338Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-02-15T22:23:44.338Z+ success 'Simnet net0/sc0_0 exists'
4972024-02-15T22:23:44.338Z+ set +x
4982024-02-15T22:23:44.338ZSimnet net0/sc0_0 exists
4992024-02-15T22:23:44.338Z+ for I in "${INDICES[@]}"
5002024-02-15T22:23:44.339Z++ get_simnet_name_if_exists net1
5012024-02-15T22:23:44.339Z++ dladm show-simnet -p -o LINK net1
5022024-02-15T22:23:44.339Z++ echo ''
5032024-02-15T22:23:44.340Z+ [[ -z '' ]]
5042024-02-15T22:23:44.340Z+ dladm create-simnet -t net1
5052024-02-15T22:23:44.340Z+ dladm create-simnet -t sc1_0
5062024-02-15T22:23:44.340Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-02-15T22:23:44.340Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-02-15T22:23:44.340Z+ success 'Simnet net1/sc1_0 exists'
5092024-02-15T22:23:44.340Z+ set +x
5102024-02-15T22:23:44.341ZSimnet net1/sc1_0 exists
5112024-02-15T22:23:44.341Z++ get_vnic_name_if_exists sc0_1
5122024-02-15T22:23:44.341Z++ dladm show-vnic -p -o LINK sc0_1
5132024-02-15T22:23:44.341Z++ echo ''
5142024-02-15T22:23:44.341Z+ [[ -z '' ]]
5152024-02-15T22:23:44.341Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-02-15T22:23:44.342Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-02-15T22:23:44.342Z+ success 'Vnic sc0_1 exists'
5182024-02-15T22:23:44.342Z+ set +x
5192024-02-15T22:23:44.342ZVnic sc0_1 exists
5202024-02-15T22:23:44.342Z+ warn_if_no_proxy_arp
5212024-02-15T22:23:44.342Z+ [[ -v PXA_START ]]
5222024-02-15T22:23:44.342Z+ [[ -v PXA_END ]]
5232024-02-15T22:23:44.342Z+ ensure_softnpu_zone
5242024-02-15T22:23:44.342Z+ zoneadm list
5252024-02-15T22:23:44.342Z+ grep -q sidecar_softnpu
5262024-02-15T22:23:44.343Z+ [[ -f out/npuzone/npuzone ]]
5272024-02-15T22:23:44.343Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-02-15T22:23:44.378Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-02-15T22:24:09.887Zdownloading softnpu ...done
5302024-02-15T22:24:09.917Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-02-15T22:24:21.891Zdownloading asic_program.so ...done
5322024-02-15T22:24:21.933Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-02-15T22:24:45.792Zdownloading scadm ...done
5342024-02-15T22:24:45.826Zcreating port tfportrear0_0 for sc0_0
5352024-02-15T22:24:45.826Zcreating port tfportqsfp0_0 for sc0_1
5362024-02-15T22:24:45.826Zsoftnpu zone setup
5372024-02-15T22:24:45.826Zconfigure zone
5382024-02-15T22:24:45.870Zinstall zone
5392024-02-15T22:24:46.916Zboot zone
5402024-02-15T22:24:50.019Z[sidecar_softnpu] svcs milestone/network
5412024-02-15T22:24:50.085ZSTATE STIME FMRI
5422024-02-15T22:24:50.085Zonline 22:24:48 svc:/milestone/network:default
5432024-02-15T22:24:50.086Z[sidecar_softnpu] /softnpu/npu start
5442024-02-15T22:24:50.151Z
5452024-02-15T22:24:50.152Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-02-15T22:24:50.152Z+ GATEWAY_IP=10.151.1.100
5472024-02-15T22:24:50.152Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-02-15T22:24:50.152ZUsing 10.151.1.100 as gateway ip
5492024-02-15T22:24:50.152Z+ [[ ! -v GATEWAY_MAC ]]
5502024-02-15T22:24:50.152Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-02-15T22:24:50.153Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-02-15T22:24:50.153Z+++ echo 18:c0:4d:0d:9f:b2
5532024-02-15T22:24:50.153Z+ COUNT=1
5542024-02-15T22:24:50.153Z+ [[ 1 -ne 1 ]]
5552024-02-15T22:24:50.153Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-02-15T22:24:50.153ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-02-15T22:24:50.154Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-02-15T22:24:50.154Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-02-15T22:24:50.154Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-02-15T22:24:50.154Z+ [[ -v PXA_START ]]
5612024-02-15T22:24:50.154Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-02-15T22:24:50.154Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-02-15T22:24:50.193Z+ z_scadm dump-state
5642024-02-15T22:24:50.193Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-02-15T22:24:50.193Zlocal v6:
5662024-02-15T22:24:50.193Zlocal v4:
5672024-02-15T22:24:50.193Zrouter v6:
5682024-02-15T22:24:50.194Zrouter v4_idx:
5692024-02-15T22:24:50.194Zrouter v4_routes:
5702024-02-15T22:24:50.194Zresolver v4:
5712024-02-15T22:24:50.194Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-02-15T22:24:50.194Zresolver v6:
5732024-02-15T22:24:50.195Znat v4:
5742024-02-15T22:24:50.195Znat_v6:
5752024-02-15T22:24:50.195Zport_mac:
5762024-02-15T22:24:50.195Zproxy arp:
5772024-02-15T22:24:50.195Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-02-15T22:24:50.195Z+ success 'softnpu zone exists'
5792024-02-15T22:24:50.195Z+ set +x
5802024-02-15T22:24:50.195Zsoftnpu zone exists
5812024-02-15T22:24:50.195Z
5822024-02-15T22:24:50.195Zreal 1:06.430149453
5832024-02-15T22:24:50.195Zuser 0.689860549
5842024-02-15T22:24:50.195Zsys 1.592738327
5852024-02-15T22:24:50.196Ztrap 0.000072577
5862024-02-15T22:24:50.196Ztflt 0.000113847
5872024-02-15T22:24:50.196Zdflt 0.001293998
5882024-02-15T22:24:50.196Zkflt 0.000000000
5892024-02-15T22:24:50.196Zlock 52:32.894439472
5902024-02-15T22:24:50.196Zslp 3:19.051201762
5912024-02-15T22:24:50.196Zlat 0.067292695
5922024-02-15T22:24:50.196Zstop 0.351625499
5932024-02-15T22:24:50.196Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-02-15T22:24:50.265Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-02-15T22:24:50.265Z+ SILO_NAME=recovery
5962024-02-15T22:24:50.266Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-02-15T22:24:50.266Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-02-15T22:24:50.266Z+ sed -i~ '
5992024-02-15T22:24:50.266Z /^external_dns_ips/c\
6002024-02-15T22:24:50.266Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-02-15T22:24:50.266Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-02-15T22:24:50.266Z /^first/c\
6032024-02-15T22:24:50.266Zfirst = "10.151.1.164"
6042024-02-15T22:24:50.267Z /^last/c\
6052024-02-15T22:24:50.267Zlast = "10.151.1.173"
6062024-02-15T22:24:50.267Z }
6072024-02-15T22:24:50.267Z /^\[rack_network_config/,/^$/ {
6082024-02-15T22:24:50.267Z /^infra_ip_first/c\
6092024-02-15T22:24:50.267Zinfra_ip_first = "10.151.1.174"
6102024-02-15T22:24:50.267Z /^infra_ip_last/c\
6112024-02-15T22:24:50.267Zinfra_ip_last = "10.151.1.174"
6122024-02-15T22:24:50.267Z }
6132024-02-15T22:24:50.268Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-02-15T22:24:50.268Z /^routes/c\
6152024-02-15T22:24:50.268Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-02-15T22:24:50.268Z /^addresses/c\
6172024-02-15T22:24:50.268Zaddresses = \["10.151.1.174/24"\]
6182024-02-15T22:24:50.268Z }
6192024-02-15T22:24:50.268Z' pkg/config-rss.toml
6202024-02-15T22:24:50.268Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-02-15T22:24:50.269Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-02-15T22:24:50.269Z+++ pkg/config-rss.toml Thu Feb 15 22:24:50 2024
6232024-02-15T22:24:50.269Z@@ -33,7 +33,7 @@
6242024-02-15T22:24:50.269Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-02-15T22:24:50.269Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-02-15T22:24:50.269Z # below.
6272024-02-15T22:24:50.269Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-02-15T22:24:50.269Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-02-15T22:24:50.269Z
6302024-02-15T22:24:50.269Z # Initial TLS certificates for the external API
6312024-02-15T22:24:50.269Z #
6322024-02-15T22:24:50.270Z@@ -69,8 +69,8 @@
6332024-02-15T22:24:50.270Z #
6342024-02-15T22:24:50.270Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-02-15T22:24:50.270Z [[internal_services_ip_pool_ranges]]
6362024-02-15T22:24:50.270Z-first = "192.168.1.20"
6372024-02-15T22:24:50.270Z-last = "192.168.1.29"
6382024-02-15T22:24:50.270Z+first = "10.151.1.164"
6392024-02-15T22:24:50.270Z+last = "10.151.1.173"
6402024-02-15T22:24:50.270Z
6412024-02-15T22:24:50.270Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-02-15T22:24:50.271Z # parameters should be provided to the control plane via wicket, but we need to
6432024-02-15T22:24:50.271Z@@ -100,9 +100,9 @@
6442024-02-15T22:24:50.271Z # You can configure multiple uplinks by repeating the following stanza
6452024-02-15T22:24:50.271Z [[rack_network_config.ports]]
6462024-02-15T22:24:50.271Z # Routes associated with this port.
6472024-02-15T22:24:50.271Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6482024-02-15T22:24:50.271Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6492024-02-15T22:24:50.271Z # Addresses associated with this port.
6502024-02-15T22:24:50.271Z-addresses = ["192.168.1.30/24"]
6512024-02-15T22:24:50.271Z+addresses = ["10.151.1.174/24"]
6522024-02-15T22:24:50.271Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6532024-02-15T22:24:50.272Z port = "qsfp0"
6542024-02-15T22:24:50.272Z # The speed of this port.
6552024-02-15T22:24:50.272Z+ true
6562024-02-15T22:24:50.272Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6572024-02-15T22:24:50.272Za pkg/config-rss.toml 7K
6582024-02-15T22:24:50.272Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6592024-02-15T22:24:50.272Z+ TLS_NAME=recovery.sys.oxide.test
6602024-02-15T22:24:50.272Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6612024-02-15T22:24:51.839Z.+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.........+....+..+........................+.......+...+..+.......+.....+.+...............+.........+............+.....+.........+.......+...+......+...+.....+...+...+................+...+..+...+......................+........+......+.+.........+...........+.............+..+...+...+............+.+.........+...+..+......+.+........+..........+..+.+............+...+..................+..+.........+...+......+....+......+...........+..........+......+...+.....+.+...+..+......+....+...+..+.....................+...............+..........+...+.....+......+.+.........+...........+...+...............+.+.........+..+...+.........+.+.........+............+..............+..........+...........+............................+...+...+..+.......+..+....+...........+......+..................+.+.....................+.................+.......+...........+...+............+.......+....................+.+......+.....+....+...............+.........+..+...+..........+......+...........+....+..+.........+..........+..............+.+.....+.........+..........+..............+................+.....................+...........+...+.+...+...........+....+...........+......+.+........+......+...+.........................+..+..........+...+........+...+....+...+..+...........................+.+...+..+.........+.+............+...+...............+.........+...+..+....+..........................+...+.......+.......................+......+.+.....+.+...........................+......+..+..........+.....+.........+.+........+......+.+...+.........+..+...............+....+...........+......+....+.....+...+...+....+......+..+...+..........+........................+...+...........+.+.....+......+...+.......+..+.+.........+.....+.+.....+.......+........+.......+...+......+......+.....+...+.+...+.....+..........+...+...+..+.........+........................+..........+..+...........................+.+.....+....+.....+.......+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6622024-02-15T22:24:51.868Z...+....+......+.........+...+..+................+..+...+....+.........+......+...........+....+........+.+...........+...+.+.....+......+..........+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.....+............+...+....+..+.........+.+...+...+........+.........+.+..+....+.........+.................+...+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6632024-02-15T22:24:51.868Z-----
6642024-02-15T22:24:51.868Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6652024-02-15T22:24:51.868Za pkg/initial-tls-cert.pem 2K
6662024-02-15T22:24:51.868Za pkg/initial-tls-key.pem 4K
6672024-02-15T22:24:51.868Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6682024-02-15T22:24:51.868Z+ rmdir pkg
6692024-02-15T22:24:51.868Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6702024-02-15T22:24:51.868Z+ pfexec mkdir -p /usr/oxide
6712024-02-15T22:24:51.868Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6722024-02-15T22:24:52.332Z+ pfexec chmod +x /usr/oxide/oxide
6732024-02-15T22:24:52.358Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6742024-02-15T22:25:10.619Z+ OMICRON_NO_UNINSTALL=1
6752024-02-15T22:25:10.620Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6762024-02-15T22:25:11.151ZLogging to: /opt/oxide/work/out/LOG
6772024-02-15T22:25:12.078Z
6782024-02-15T22:25:12.078Zreal 0.534901857
6792024-02-15T22:25:12.078Zuser 0.108132293
6802024-02-15T22:25:12.078Zsys 2.253438097
6812024-02-15T22:25:12.078Ztrap 0.000005449
6822024-02-15T22:25:12.079Ztflt 0.000571552
6832024-02-15T22:25:12.079Zdflt 0.000340999
6842024-02-15T22:25:12.079Zkflt 0.000000000
6852024-02-15T22:25:12.079Zlock 48.578673466
6862024-02-15T22:25:12.079Zslp 0.743205830
6872024-02-15T22:25:12.079Zlat 0.003217003
6882024-02-15T22:25:12.079Zstop 0.213110214
6892024-02-15T22:25:12.079Z+ retry=0
6902024-02-15T22:25:12.079Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6912024-02-15T22:25:12.079Z+ [[ 0 -gt 30 ]]
6922024-02-15T22:25:12.079Z+ sleep 1
6932024-02-15T22:25:12.222Z+ retry=1
6942024-02-15T22:25:12.223Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6952024-02-15T22:25:12.297Z+ [[ 1 -gt 30 ]]
6962024-02-15T22:25:12.297Z+ sleep 1
6972024-02-15T22:25:13.219Z+ retry=2
6982024-02-15T22:25:13.219Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6992024-02-15T22:25:13.252Z+ [[ 2 -gt 30 ]]
7002024-02-15T22:25:13.253Z+ sleep 1
7012024-02-15T22:25:25.734Z+ retry=3
7022024-02-15T22:25:25.734Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7032024-02-15T22:25:26.523Z+ [[ 3 -gt 30 ]]
7042024-02-15T22:25:26.523Z+ sleep 1
7052024-02-15T22:25:26.523Z+ retry=4
7062024-02-15T22:25:26.524Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-02-15T22:25:40.400Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7082024-02-15T22:25:40.443Zlocal v6:
7092024-02-15T22:25:40.444Zfd58:e7ad:ae5f:9d25::1
7102024-02-15T22:25:40.444Zfe80::2058:1cff:fedd:1d3b
7112024-02-15T22:25:40.444Zlocal v4:
7122024-02-15T22:25:40.444Z10.151.1.174
7132024-02-15T22:25:40.444Zrouter v6:
7142024-02-15T22:25:40.444Zfd00:1122:3344:1::/64 -> fe80::48a6:b1ff:fed0:e86e (1)
7152024-02-15T22:25:40.444Zfd00:1122:3344:2::/64 -> fe80::48a6:b1ff:fed0:e86e (1)
7162024-02-15T22:25:40.444Zfd00:1122:3344:3::/64 -> fe80::48a6:b1ff:fed0:e86e (1)
7172024-02-15T22:25:40.444Zfd00:1122:3344:101::/64 -> fe80::48a6:b1ff:fed0:e86e (1)
7182024-02-15T22:25:40.444Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::48a6:b1ff:fed0:e86e (1)
7192024-02-15T22:25:40.444Zrouter v4_idx:
7202024-02-15T22:25:40.444Z0.0.0.0/0 -> 0
7212024-02-15T22:25:40.444Zrouter v4_routes:
7222024-02-15T22:25:40.444Z0 -> 10.151.1.100 (2)
7232024-02-15T22:25:40.444Zresolver v4:
7242024-02-15T22:25:40.444Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7252024-02-15T22:25:40.444Z10.151.1.174 -> ee:69:78:c6:ea:8e
7262024-02-15T22:25:40.444Zresolver v6:
7272024-02-15T22:25:40.444Zfe80::2058:1cff:fedd:1d3b -> 22:58:1c:dd:1d:3b
7282024-02-15T22:25:40.444Zfe80::48a6:b1ff:fed0:e86e -> 4a:a6:b1:d0:e8:6e
7292024-02-15T22:25:40.444Znat v4:
7302024-02-15T22:25:40.444Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:a0:f3
7312024-02-15T22:25:40.444Znat_v6:
7322024-02-15T22:25:40.444Zport_mac:
7332024-02-15T22:25:40.444Z1000: a8:40:25:35:84:be
7342024-02-15T22:25:40.445Z2: a8:40:25:35:84:df
7352024-02-15T22:25:40.445Z1: a8:40:25:35:84:bf
7362024-02-15T22:25:40.445Zproxy arp:
7372024-02-15T22:25:40.445Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7382024-02-15T22:25:40.445Z+ retry=0
7392024-02-15T22:25:40.445Z+++ zoneadm list -n
7402024-02-15T22:25:40.445Z+++ grep oxz_ntp
7412024-02-15T22:25:40.445Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
7422024-02-15T22:25:40.483Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7432024-02-15T22:25:40.483Z++ true
7442024-02-15T22:25:40.483Z+ [[ '' != online ]]
7452024-02-15T22:25:40.483Z+ [[ 0 -gt 60 ]]
7462024-02-15T22:25:40.483Z+ sleep 1
7472024-02-15T22:25:41.868Z+ retry=1
7482024-02-15T22:25:41.908Z+++ zoneadm list -n
7492024-02-15T22:25:41.908Z+++ grep oxz_ntp
7502024-02-15T22:25:41.909Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
7512024-02-15T22:25:41.909Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7522024-02-15T22:25:41.909Z++ true
7532024-02-15T22:25:41.909Z+ [[ '' != online ]]
7542024-02-15T22:25:41.909Z+ [[ 1 -gt 60 ]]
7552024-02-15T22:25:41.909Z+ sleep 1
7562024-02-15T22:25:42.896Z+ retry=2
7572024-02-15T22:25:43.433Z+++ zoneadm list -n
7582024-02-15T22:25:43.433Z+++ grep oxz_ntp
7592024-02-15T22:25:43.433Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
7602024-02-15T22:25:43.433Z+ [[ disabled != online ]]
7612024-02-15T22:25:43.433Z+ [[ 2 -gt 60 ]]
7622024-02-15T22:25:43.434Z+ sleep 1
7632024-02-15T22:25:43.513Z+ retry=3
7642024-02-15T22:25:43.550Z+++ zoneadm list -n
7652024-02-15T22:25:43.551Z+++ grep oxz_ntp
7662024-02-15T22:25:43.551Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
7672024-02-15T22:25:43.551Z+ [[ disabled != online ]]
7682024-02-15T22:25:43.551Z+ [[ 3 -gt 60 ]]
7692024-02-15T22:25:43.551Z+ sleep 1
7702024-02-15T22:25:44.526Z+ retry=4
7712024-02-15T22:25:44.561Z+++ zoneadm list -n
7722024-02-15T22:25:44.561Z+++ grep oxz_ntp
7732024-02-15T22:25:44.561Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
7742024-02-15T22:25:44.561Z+ [[ disabled != online ]]
7752024-02-15T22:25:44.562Z+ [[ 4 -gt 60 ]]
7762024-02-15T22:25:44.562Z+ sleep 1
7772024-02-15T22:25:45.554Z+ retry=5
7782024-02-15T22:25:45.588Z+++ zoneadm list -n
7792024-02-15T22:25:45.589Z+++ grep oxz_ntp
7802024-02-15T22:25:45.589Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
7812024-02-15T22:25:45.589Z+ [[ disabled != online ]]
7822024-02-15T22:25:45.589Z+ [[ 5 -gt 60 ]]
7832024-02-15T22:25:45.589Z+ sleep 1
7842024-02-15T22:25:46.573Z+ retry=6
7852024-02-15T22:25:46.609Z+++ zoneadm list -n
7862024-02-15T22:25:46.609Z+++ grep oxz_ntp
7872024-02-15T22:25:46.609Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
7882024-02-15T22:25:46.609Z+ [[ disabled != online ]]
7892024-02-15T22:25:46.610Z+ [[ 6 -gt 60 ]]
7902024-02-15T22:25:46.610Z+ sleep 1
7912024-02-15T22:25:47.604Z+ retry=7
7922024-02-15T22:25:47.637Z+++ zoneadm list -n
7932024-02-15T22:25:47.637Z+++ grep oxz_ntp
7942024-02-15T22:25:47.637Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
7952024-02-15T22:25:47.637Z+ [[ disabled != online ]]
7962024-02-15T22:25:47.638Z+ [[ 7 -gt 60 ]]
7972024-02-15T22:25:47.638Z+ sleep 1
7982024-02-15T22:25:48.618Z+ retry=8
7992024-02-15T22:25:48.653Z+++ zoneadm list -n
8002024-02-15T22:25:48.653Z+++ grep oxz_ntp
8012024-02-15T22:25:48.653Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
8022024-02-15T22:25:48.654Z+ [[ disabled != online ]]
8032024-02-15T22:25:48.654Z+ [[ 8 -gt 60 ]]
8042024-02-15T22:25:48.654Z+ sleep 1
 
8052024-02-15T22:25:49.378Zbuskin console login: Feb 15 22:25:48 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8062024-02-15T22:25:49.656Z+ retry=9
8072024-02-15T22:25:49.695Z+++ zoneadm list -n
8082024-02-15T22:25:49.695Z+++ grep oxz_ntp
8092024-02-15T22:25:49.695Z++ pfexec svcs -z oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe -Hostate oxide/ntp
8102024-02-15T22:25:49.695Z+ [[ online != online ]]
8112024-02-15T22:25:49.695Z+ echo 'Waited for chrony: 9s'
8122024-02-15T22:25:49.695ZWaited for chrony: 9s
8132024-02-15T22:25:49.695Z+ export RUST_BACKTRACE=1
8142024-02-15T22:25:49.695Z+ RUST_BACKTRACE=1
8152024-02-15T22:25:49.696Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8162024-02-15T22:25:49.696Z++ ./tests/bootstrap
8172024-02-15T22:25:49.696ZUsing external DNS server at 10.151.1.164:53
8182024-02-15T22:25:49.696Z2024-02-15 22:25:49.739203617 UTC: attempting to log into API
8192024-02-15T22:26:05.136Z2024-02-15 22:26:04.748085015 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8202024-02-15T22:26:05.728Z2024-02-15 22:26:05.746182852 UTC: attempting to log into API
8212024-02-15T22:26:20.784Z2024-02-15 22:26:20.737058069 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8222024-02-15T22:26:21.768Z2024-02-15 22:26:21.737939933 UTC: attempting to log into API
8232024-02-15T22:26:36.790Z2024-02-15 22:26:36.775039772 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8242024-02-15T22:26:37.794Z2024-02-15 22:26:37.776084574 UTC: attempting to log into API
8252024-02-15T22:26:52.826Z2024-02-15 22:26:52.807219372 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8262024-02-15T22:26:53.834Z2024-02-15 22:26:53.808904607 UTC: attempting to log into API
8272024-02-15T22:27:08.857Z2024-02-15 22:27:08.841234401 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8282024-02-15T22:27:09.852Z2024-02-15 22:27:09.843159092 UTC: attempting to log into API
8292024-02-15T22:27:24.889Z2024-02-15 22:27:24.872521070 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8302024-02-15T22:27:25.889Z2024-02-15 22:27:25.874456291 UTC: attempting to log into API
8312024-02-15T22:27:40.918Z2024-02-15 22:27:40.906585997 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8322024-02-15T22:27:42.334Z2024-02-15 22:27:41.908537248 UTC: attempting to log into API
8332024-02-15T22:27:56.961Z2024-02-15 22:27:56.942401061 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8342024-02-15T22:27:57.958Z2024-02-15 22:27:57.943781800 UTC: attempting to log into API
8352024-02-15T22:28:13.672Z2024-02-15 22:28:13.252769729 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8362024-02-15T22:28:14.431Z2024-02-15 22:28:14.313788949 UTC: attempting to log into API
8372024-02-15T22:28:29.507Z2024-02-15 22:28:29.480413969 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8382024-02-15T22:28:30.911Z2024-02-15 22:28:30.481243936 UTC: attempting to log into API
8392024-02-15T22:28:48.743Z2024-02-15 22:28:45.520752439 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8402024-02-15T22:28:49.069ZFeb 15 22:28:47 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
8412024-02-15T22:28:49.108Z2024-02-15 22:28:46.521671298 UTC: attempting to log into API
 
8422024-02-15T22:28:55.027ZFeb 15 22:28:54 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8432024-02-15T22:29:00.651ZFeb 15 22:29:00 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
8442024-02-15T22:29:01.564Z2024-02-15 22:29:01.553408836 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8452024-02-15T22:29:02.574Z2024-02-15 22:29:02.554453458 UTC: attempting to log into API
 
8462024-02-15T22:29:07.692ZFeb 15 22:29:07 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
8472024-02-15T22:29:12.832ZFeb 15 22:29:12 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
8482024-02-15T22:29:20.466Z2024-02-15 22:29:17.585821018 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8492024-02-15T22:29:20.764Z2024-02-15 22:29:18.586820230 UTC: attempting to log into API
8502024-02-15T22:29:33.641Z2024-02-15 22:29:33.618447255 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8512024-02-15T22:29:34.644Z2024-02-15 22:29:34.619174360 UTC: attempting to log into API
8522024-02-15T22:29:49.664Z2024-02-15 22:29:49.651530952 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8532024-02-15T22:29:50.663Z2024-02-15 22:29:50.652557323 UTC: attempting to log into API
8542024-02-15T22:29:50.708Z2024-02-15 22:29:50.696634145 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: tcp connect error: Connection refused (os error 146)
8552024-02-15T22:29:51.721Z2024-02-15 22:29:51.698351661 UTC: attempting to log into API
8562024-02-15T22:29:51.748Z2024-02-15 22:29:51.730807167 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: tcp connect error: Connection refused (os error 146)
8572024-02-15T22:29:52.751Z2024-02-15 22:29:52.732039753 UTC: attempting to log into API
8582024-02-15T22:29:53.508Z2024-02-15 22:29:53.497141497 UTC: login succeeded
8592024-02-15T22:29:53.563Zwaiting for nexus to come up...
8602024-02-15T22:29:53.642Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8612024-02-15T22:29:53.774Zsetting up quotas...
8622024-02-15T22:29:54.234Zensuring datasets are ready...
8632024-02-15T22:29:55.916Zlet's roll.
8642024-02-15T22:29:56.035Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8652024-02-15T22:29:56.035ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8662024-02-15T22:29:56.069ZOXIDE_TOKEN=oxide-token-2a839a134cfe37ceb90ea0ebbfaa34a8e2e39854'
8672024-02-15T22:29:56.070Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8682024-02-15T22:29:56.071Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8692024-02-15T22:29:56.071Z++ OXIDE_TOKEN=oxide-token-2a839a134cfe37ceb90ea0ebbfaa34a8e2e39854
8702024-02-15T22:29:56.071Z+ export OXIDE_HOST OXIDE_TOKEN
8712024-02-15T22:29:56.071Z+ retry=0
8722024-02-15T22:29:56.071Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8732024-02-15T22:29:56.071Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8742024-02-15T22:29:56.071Z+ [[ 0 -gt 60 ]]
8752024-02-15T22:29:56.071Z+ sleep 1
8762024-02-15T22:29:57.100Z+ retry=1
8772024-02-15T22:29:57.100Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8782024-02-15T22:29:57.138Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8792024-02-15T22:29:57.144Z+ [[ 1 -gt 60 ]]
8802024-02-15T22:29:57.144Z+ sleep 1
8812024-02-15T22:29:58.080Z+ retry=2
8822024-02-15T22:29:58.081Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8832024-02-15T22:29:58.125Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8842024-02-15T22:29:58.125Z+ [[ 2 -gt 60 ]]
8852024-02-15T22:29:58.125Z+ sleep 1
8862024-02-15T22:29:59.097Z+ retry=3
8872024-02-15T22:29:59.097Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8882024-02-15T22:29:59.146Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8892024-02-15T22:29:59.146Z+ [[ 3 -gt 60 ]]
8902024-02-15T22:29:59.146Z+ sleep 1
8912024-02-15T22:30:00.106Z+ retry=4
8922024-02-15T22:30:00.106Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8932024-02-15T22:30:00.133Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8942024-02-15T22:30:00.134Z+ [[ 4 -gt 60 ]]
8952024-02-15T22:30:00.134Z+ sleep 1
8962024-02-15T22:30:01.455Z+ retry=5
8972024-02-15T22:30:01.455Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8982024-02-15T22:30:01.455Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8992024-02-15T22:30:01.455Z+ [[ 5 -gt 60 ]]
9002024-02-15T22:30:01.455Z+ sleep 1
9012024-02-15T22:30:02.147Z+ retry=6
9022024-02-15T22:30:02.147Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9032024-02-15T22:30:02.195Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9042024-02-15T22:30:02.196Z+ [[ 6 -gt 60 ]]
9052024-02-15T22:30:02.197Z+ sleep 1
9062024-02-15T22:30:06.405Z+ retry=7
9072024-02-15T22:30:06.405Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9082024-02-15T22:30:06.571Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9092024-02-15T22:30:06.571Z+ [[ 7 -gt 60 ]]
9102024-02-15T22:30:06.571Z+ sleep 1
9112024-02-15T22:30:06.641Z+ retry=8
9122024-02-15T22:30:06.641Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9132024-02-15T22:30:06.641Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9142024-02-15T22:30:06.641Z+ [[ 8 -gt 60 ]]
9152024-02-15T22:30:06.641Z+ sleep 1
9162024-02-15T22:30:06.641Z+ retry=9
9172024-02-15T22:30:06.641Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9182024-02-15T22:30:06.641Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9192024-02-15T22:30:06.641Z+ [[ 9 -gt 60 ]]
9202024-02-15T22:30:06.641Z+ sleep 1
9212024-02-15T22:30:06.641Z+ retry=10
9222024-02-15T22:30:06.642Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9232024-02-15T22:30:06.642Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9242024-02-15T22:30:06.642Z+ [[ 10 -gt 60 ]]
9252024-02-15T22:30:06.642Z+ sleep 1
9262024-02-15T22:30:07.229Z+ retry=11
9272024-02-15T22:30:07.229Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9282024-02-15T22:30:07.262Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9292024-02-15T22:30:07.262Z+ [[ 11 -gt 60 ]]
9302024-02-15T22:30:07.263Z+ sleep 1
9312024-02-15T22:30:08.244Z+ retry=12
9322024-02-15T22:30:08.244Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9332024-02-15T22:30:08.344Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9342024-02-15T22:30:08.345Z+ [[ 12 -gt 60 ]]
9352024-02-15T22:30:08.345Z+ sleep 1
9362024-02-15T22:30:09.266Z+ retry=13
9372024-02-15T22:30:09.266Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9382024-02-15T22:30:09.303Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9392024-02-15T22:30:09.303Z+ [[ 13 -gt 60 ]]
9402024-02-15T22:30:09.303Z+ sleep 1
9412024-02-15T22:30:10.273Z+ retry=14
9422024-02-15T22:30:10.273Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9432024-02-15T22:30:10.302Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9442024-02-15T22:30:10.302Z+ [[ 14 -gt 60 ]]
9452024-02-15T22:30:10.302Z+ sleep 1
9462024-02-15T22:30:11.289Z+ retry=15
9472024-02-15T22:30:11.289Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9482024-02-15T22:30:11.313Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9492024-02-15T22:30:11.313Z+ [[ 15 -gt 60 ]]
9502024-02-15T22:30:11.313Z+ sleep 1
9512024-02-15T22:30:12.333Z+ retry=16
9522024-02-15T22:30:12.333Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9532024-02-15T22:30:12.426Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9542024-02-15T22:30:12.426Z+ [[ 16 -gt 60 ]]
9552024-02-15T22:30:12.426Z+ sleep 1
9562024-02-15T22:30:13.319Z+ retry=17
9572024-02-15T22:30:13.320Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9582024-02-15T22:30:13.347Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9592024-02-15T22:30:13.347Z+ [[ 17 -gt 60 ]]
9602024-02-15T22:30:13.347Z+ sleep 1
9612024-02-15T22:30:14.333Z+ retry=18
9622024-02-15T22:30:14.333Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9632024-02-15T22:30:14.410Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9642024-02-15T22:30:14.752Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
9652024-02-15T22:30:15.190Z{"status":"ok"}success
9662024-02-15T22:30:15.190ZProject {
9672024-02-15T22:30:15.190Z description: "some images",
9682024-02-15T22:30:15.190Z id: 36af431a-0f66-49f6-8f08-a4c9953fc0e1,
9692024-02-15T22:30:15.190Z name: Name(
9702024-02-15T22:30:15.190Z "images",
9712024-02-15T22:30:15.191Z ),
9722024-02-15T22:30:15.191Z time_created: 2024-02-15T22:30:14.490897Z,
9732024-02-15T22:30:15.191Z time_modified: 2024-02-15T22:30:14.490897Z,
9742024-02-15T22:30:15.191Z}
9752024-02-15T22:35:53.456Zdone!
9762024-02-15T22:35:54.048Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9772024-02-15T22:35:54.215Zsuccess
9782024-02-15T22:35:54.215ZImage {
9792024-02-15T22:35:54.215Z block_size: ByteCount(
9802024-02-15T22:35:54.216Z 512,
9812024-02-15T22:35:54.216Z ),
9822024-02-15T22:35:54.216Z description: "debian 11 original base image",
9832024-02-15T22:35:54.216Z digest: None,
9842024-02-15T22:35:54.217Z id: b4290b19-4ed6-4cb8-b58a-92c510dcb5eb,
9852024-02-15T22:35:54.217Z name: Name(
9862024-02-15T22:35:54.217Z "debian11",
9872024-02-15T22:35:54.217Z ),
9882024-02-15T22:35:54.218Z os: "debian",
9892024-02-15T22:35:54.218Z project_id: None,
9902024-02-15T22:35:54.218Z size: ByteCount(
9912024-02-15T22:35:54.218Z 2147483648,
9922024-02-15T22:35:54.218Z ),
9932024-02-15T22:35:54.218Z time_created: 2024-02-15T22:35:53.408570Z,
9942024-02-15T22:35:54.218Z time_modified: 2024-02-15T22:35:53.647965Z,
9952024-02-15T22:35:54.219Z url: None,
9962024-02-15T22:35:54.219Z version: "11",
9972024-02-15T22:35:54.219Z}
9982024-02-15T22:35:54.219Z+ rm ./tests/bootstrap
9992024-02-15T22:35:54.219Z+ for test_bin in tests/*
10002024-02-15T22:35:54.219Z+ ./tests/bootstrap-53acd5ae20bb1630
10012024-02-15T22:35:54.219Z
10022024-02-15T22:35:54.220Zrunning 0 tests
10032024-02-15T22:35:54.220Z
10042024-02-15T22:35:54.220Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10052024-02-15T22:35:54.220Z
10062024-02-15T22:35:54.220Z+ for test_bin in tests/*
10072024-02-15T22:35:54.221Z+ ./tests/end_to_end_tests-510c49e5fe726d0c
10082024-02-15T22:35:54.221Z
10092024-02-15T22:35:54.221Zrunning 2 tests
10102024-02-15T22:35:54.631Ztest no_spoof::no_spoof_here ... ok
10112024-02-15T22:36:30.155Ztest instance_launch::instance_launch ... ok
10122024-02-15T22:36:30.155Z
10132024-02-15T22:36:30.155Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 34.04s
10142024-02-15T22:36:30.155Z
10152024-02-15T22:36:30.155Z+ _exit_trap
10162024-02-15T22:36:30.155Z+ local status=0
10172024-02-15T22:36:30.155Z+ [[ 0 -eq 0 ]]
10182024-02-15T22:36:30.155Z+ exit 0
10192024-02-15T22:36:30.751Zprocess exited: duration 890260 ms, exit code 0
 
10202024-02-15T22:36:36.516Zfound 128 output files
10212024-02-15T22:36:36.516Zuploading: /var/svc/log/oxide-sled-agent:default.log (931004 bytes)
10222024-02-15T22:36:39.243Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10232024-02-15T22:36:39.243Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (1637137 bytes)
10242024-02-15T22:36:41.152Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 1637137 -> 1676349
10252024-02-15T22:36:42.266Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
10262024-02-15T22:36:42.267Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (1177784 bytes)
10272024-02-15T22:36:46.141Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
10282024-02-15T22:36:46.141Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
10292024-02-15T22:36:47.465Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
10302024-02-15T22:36:47.465Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (7664 bytes)
10312024-02-15T22:36:49.691Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
10322024-02-15T22:36:49.692Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (13588 bytes)
10332024-02-15T22:36:49.778Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 13588 -> 14632
10342024-02-15T22:36:50.363Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
10352024-02-15T22:36:50.363Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (11555 bytes)
10362024-02-15T22:36:51.735Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
10372024-02-15T22:36:51.736Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (947621 bytes)
10382024-02-15T22:37:06.592Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 947621 -> 1030041
10392024-02-15T22:37:08.166Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
10402024-02-15T22:37:08.166Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (630872 bytes)
10412024-02-15T22:37:10.409Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
10422024-02-15T22:37:10.409Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (571188 bytes)
10432024-02-15T22:37:16.165Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 571188 -> 634874
10442024-02-15T22:37:17.703Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10452024-02-15T22:37:17.704Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (369233 bytes)
10462024-02-15T22:37:19.736Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
10472024-02-15T22:37:19.736Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
10482024-02-15T22:37:20.821Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10492024-02-15T22:37:20.821Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
10502024-02-15T22:37:23.360Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
10512024-02-15T22:37:23.361Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (188748 bytes)
10522024-02-15T22:37:25.301Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 188748 -> 215500
10532024-02-15T22:37:26.386Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10542024-02-15T22:37:26.386Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (131106 bytes)
10552024-02-15T22:37:28.815Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
10562024-02-15T22:37:28.815Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
10572024-02-15T22:37:30.043Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10582024-02-15T22:37:30.044Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
10592024-02-15T22:37:42.944Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
10602024-02-15T22:37:42.944Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
10612024-02-15T22:38:03.665Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10622024-02-15T22:38:03.665Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5394 bytes)
10632024-02-15T22:38:06.835Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
10642024-02-15T22:38:06.835Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-clickhouse:default.log (755339 bytes)
10652024-02-15T22:38:10.726Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 755339 -> 940013
10662024-02-15T22:38:11.825Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-clickhouse:default.log
10672024-02-15T22:38:11.825Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-clickhouse:default.log.0 (129182 bytes)
10682024-02-15T22:38:19.167Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-clickhouse:default.log.0
10692024-02-15T22:38:19.167Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10702024-02-15T22:38:20.243Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-zone-network-setup:default.log
10712024-02-15T22:38:20.244Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
10722024-02-15T22:38:21.758Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_843bdcc3-892c-408f-9ffb-2b7dff11b0b7/root/var/svc/log/oxide-zone-network-setup:default.log.0
10732024-02-15T22:38:21.758Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_84fa966a-991c-4b0f-9405-d1ded31aa5ca/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
10742024-02-15T22:38:22.882Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_84fa966a-991c-4b0f-9405-d1ded31aa5ca/root/var/svc/log/oxide-cockroachdb:default.log
10752024-02-15T22:38:22.882Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_84fa966a-991c-4b0f-9405-d1ded31aa5ca/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
10762024-02-15T22:38:25.224Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_84fa966a-991c-4b0f-9405-d1ded31aa5ca/root/var/svc/log/oxide-cockroachdb:default.log.0
10772024-02-15T22:38:25.224Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_84fa966a-991c-4b0f-9405-d1ded31aa5ca/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10782024-02-15T22:38:26.740Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_84fa966a-991c-4b0f-9405-d1ded31aa5ca/root/var/svc/log/oxide-zone-network-setup:default.log
10792024-02-15T22:38:26.740Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_84fa966a-991c-4b0f-9405-d1ded31aa5ca/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
10802024-02-15T22:38:31.451Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_84fa966a-991c-4b0f-9405-d1ded31aa5ca/root/var/svc/log/oxide-zone-network-setup:default.log.0
10812024-02-15T22:38:31.451Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-agent:default.log (11145 bytes)
10822024-02-15T22:38:33.123Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-agent:default.log
10832024-02-15T22:38:33.123Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
10842024-02-15T22:38:34.318Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-agent:default.log.0
10852024-02-15T22:38:34.318Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
10862024-02-15T22:38:35.863Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-downstairs:default.log
10872024-02-15T22:38:35.863Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
10882024-02-15T22:38:37.432Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-downstairs:default.log.0
10892024-02-15T22:38:37.432Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-downstairs:downstairs-c8c27dbb-b1dd-4482-b147-f7c810e80327.log (5593 bytes)
10902024-02-15T22:38:42.738Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cddf99a1-1ca8-48ba-a951-2992e48ef9cd/root/var/svc/log/oxide-crucible-downstairs:downstairs-c8c27dbb-b1dd-4482-b147-f7c810e80327.log
10912024-02-15T22:38:42.738Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f3169072-10d2-4e3a-bbca-82be1453306a/root/var/svc/log/oxide-external_dns:default.log (26433 bytes)
10922024-02-15T22:38:43.052Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f3169072-10d2-4e3a-bbca-82be1453306a/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26433 -> 33987
10932024-02-15T22:38:44.164Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f3169072-10d2-4e3a-bbca-82be1453306a/root/var/svc/log/oxide-external_dns:default.log
10942024-02-15T22:38:44.164Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f3169072-10d2-4e3a-bbca-82be1453306a/root/var/svc/log/oxide-external_dns:default.log.0 (4283 bytes)
10952024-02-15T22:38:45.638Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f3169072-10d2-4e3a-bbca-82be1453306a/root/var/svc/log/oxide-external_dns:default.log.0
10962024-02-15T22:38:45.638Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4df5326e-2e32-4875-9c3f-2804721cb785/root/var/svc/log/oxide-internal_dns:default.log (26289 bytes)
10972024-02-15T22:38:45.849Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4df5326e-2e32-4875-9c3f-2804721cb785/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 26289 -> 33798
10982024-02-15T22:38:47.320Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4df5326e-2e32-4875-9c3f-2804721cb785/root/var/svc/log/oxide-internal_dns:default.log
10992024-02-15T22:38:47.320Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4df5326e-2e32-4875-9c3f-2804721cb785/root/var/svc/log/oxide-internal_dns:default.log.0 (91578 bytes)
11002024-02-15T22:38:54.782Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4df5326e-2e32-4875-9c3f-2804721cb785/root/var/svc/log/oxide-internal_dns:default.log.0
11012024-02-15T22:38:54.782Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72b6b802-d468-4fc3-b15b-7a8c6f02a7fd/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11022024-02-15T22:38:56.345Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72b6b802-d468-4fc3-b15b-7a8c6f02a7fd/root/var/svc/log/oxide-cockroachdb:default.log
11032024-02-15T22:38:56.345Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72b6b802-d468-4fc3-b15b-7a8c6f02a7fd/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
11042024-02-15T22:38:57.664Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72b6b802-d468-4fc3-b15b-7a8c6f02a7fd/root/var/svc/log/oxide-cockroachdb:default.log.0
11052024-02-15T22:38:57.664Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72b6b802-d468-4fc3-b15b-7a8c6f02a7fd/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11062024-02-15T22:38:59.531Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72b6b802-d468-4fc3-b15b-7a8c6f02a7fd/root/var/svc/log/oxide-zone-network-setup:default.log
11072024-02-15T22:38:59.531Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72b6b802-d468-4fc3-b15b-7a8c6f02a7fd/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
11082024-02-15T22:39:00.974Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72b6b802-d468-4fc3-b15b-7a8c6f02a7fd/root/var/svc/log/oxide-zone-network-setup:default.log.0
11092024-02-15T22:39:00.974Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-agent:default.log (16609 bytes)
11102024-02-15T22:39:11.268Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-agent:default.log
11112024-02-15T22:39:11.268Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11122024-02-15T22:39:24.766Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-agent:default.log.0
11132024-02-15T22:39:24.766Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11142024-02-15T22:39:27.268Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-downstairs:default.log
11152024-02-15T22:39:27.268Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11162024-02-15T22:39:28.411Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11172024-02-15T22:39:28.411Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-212ba81d-0452-43d8-953a-555834b78a85.log (3008 bytes)
11182024-02-15T22:39:29.945Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-212ba81d-0452-43d8-953a-555834b78a85.log
11192024-02-15T22:39:29.945Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-682111e2-1ae2-46df-be1b-50512bf28217.log (5592 bytes)
11202024-02-15T22:39:31.125Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64b9e64c-5a72-4a09-8ba2-58058775af5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-682111e2-1ae2-46df-be1b-50512bf28217.log
11212024-02-15T22:39:31.126Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_0c36655f-e4ee-4208-838a-0a7bac5af333/root/var/svc/log/oxide-crucible-pantry:default.log (1225468 bytes)
11222024-02-15T22:39:36.757Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_0c36655f-e4ee-4208-838a-0a7bac5af333/root/var/svc/log/oxide-crucible-pantry:default.log
11232024-02-15T22:39:36.757Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_0c36655f-e4ee-4208-838a-0a7bac5af333/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2337 bytes)
11242024-02-15T22:39:37.935Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_0c36655f-e4ee-4208-838a-0a7bac5af333/root/var/svc/log/oxide-crucible-pantry:default.log.0
11252024-02-15T22:39:37.935Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_cd69d2b9-7a42-4373-9fa5-0fd753fd546e/root/var/svc/log/oxide-external_dns:default.log (26436 bytes)
11262024-02-15T22:39:38.672Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_cd69d2b9-7a42-4373-9fa5-0fd753fd546e/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26436 -> 37765
11272024-02-15T22:39:40.584Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_cd69d2b9-7a42-4373-9fa5-0fd753fd546e/root/var/svc/log/oxide-external_dns:default.log
11282024-02-15T22:39:40.584Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_cd69d2b9-7a42-4373-9fa5-0fd753fd546e/root/var/svc/log/oxide-external_dns:default.log.0 (4280 bytes)
11292024-02-15T22:39:41.715Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_cd69d2b9-7a42-4373-9fa5-0fd753fd546e/root/var/svc/log/oxide-external_dns:default.log.0
11302024-02-15T22:39:41.715Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6bcd7612-7b4f-435f-a7c9-b2fd96099119/root/var/svc/log/oxide-internal_dns:default.log (27963 bytes)
11312024-02-15T22:39:42.548Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6bcd7612-7b4f-435f-a7c9-b2fd96099119/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27963 -> 39227
11322024-02-15T22:39:45.285Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6bcd7612-7b4f-435f-a7c9-b2fd96099119/root/var/svc/log/oxide-internal_dns:default.log
11332024-02-15T22:39:45.285Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6bcd7612-7b4f-435f-a7c9-b2fd96099119/root/var/svc/log/oxide-internal_dns:default.log.0 (91120 bytes)
11342024-02-15T22:39:46.007Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6bcd7612-7b4f-435f-a7c9-b2fd96099119/root/var/svc/log/oxide-internal_dns:default.log.0
11352024-02-15T22:39:46.007Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cf693bed-6665-49ce-8b99-029cb5abcb8d/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11362024-02-15T22:39:46.707Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cf693bed-6665-49ce-8b99-029cb5abcb8d/root/var/svc/log/oxide-cockroachdb:default.log
11372024-02-15T22:39:46.707Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cf693bed-6665-49ce-8b99-029cb5abcb8d/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
11382024-02-15T22:39:47.843Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cf693bed-6665-49ce-8b99-029cb5abcb8d/root/var/svc/log/oxide-cockroachdb:default.log.0
11392024-02-15T22:39:47.844Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cf693bed-6665-49ce-8b99-029cb5abcb8d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11402024-02-15T22:39:49.779Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cf693bed-6665-49ce-8b99-029cb5abcb8d/root/var/svc/log/oxide-zone-network-setup:default.log
11412024-02-15T22:39:49.780Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cf693bed-6665-49ce-8b99-029cb5abcb8d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
11422024-02-15T22:39:52.823Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cf693bed-6665-49ce-8b99-029cb5abcb8d/root/var/svc/log/oxide-zone-network-setup:default.log.0
11432024-02-15T22:39:52.823Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-agent:default.log (13686 bytes)
11442024-02-15T22:39:54.124Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-agent:default.log
11452024-02-15T22:39:54.124Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11462024-02-15T22:39:55.563Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-agent:default.log.0
11472024-02-15T22:39:55.612Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11482024-02-15T22:39:57.081Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-downstairs:default.log
11492024-02-15T22:39:57.081Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11502024-02-15T22:39:58.230Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11512024-02-15T22:39:58.308Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-0c1418a5-1329-40a9-8adb-8a48da243f26.log (5672 bytes)
11522024-02-15T22:40:02.055Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-downstairs:downstairs-0c1418a5-1329-40a9-8adb-8a48da243f26.log
11532024-02-15T22:40:02.055Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-downstairs:snapshot-0c1418a5-1329-40a9-8adb-8a48da243f26-a886df7f-b8f2-4e61-87bd-1070ae592dc9.log (5280 bytes)
11542024-02-15T22:40:03.385Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6b638615-5f2b-4bf8-b55a-a03b9bcdf7d7/root/var/svc/log/oxide-crucible-downstairs:snapshot-0c1418a5-1329-40a9-8adb-8a48da243f26-a886df7f-b8f2-4e61-87bd-1070ae592dc9.log
11552024-02-15T22:40:03.385Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_d43b30da-3a8b-46f5-b36c-54d74e469dc0/root/var/svc/log/oxide-internal_dns:default.log (26280 bytes)
11562024-02-15T22:40:04.106Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_d43b30da-3a8b-46f5-b36c-54d74e469dc0/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 26280 -> 37542
11572024-02-15T22:40:05.234Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_d43b30da-3a8b-46f5-b36c-54d74e469dc0/root/var/svc/log/oxide-internal_dns:default.log
11582024-02-15T22:40:05.234Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_d43b30da-3a8b-46f5-b36c-54d74e469dc0/root/var/svc/log/oxide-internal_dns:default.log.0 (95626 bytes)
11592024-02-15T22:40:19.430Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_d43b30da-3a8b-46f5-b36c-54d74e469dc0/root/var/svc/log/oxide-internal_dns:default.log.0
11602024-02-15T22:40:19.430Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/svc/log/oxide-ntp:default.log (68 bytes)
11612024-02-15T22:40:19.430Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/svc/log/oxide-ntp:default.log
11622024-02-15T22:40:19.430Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/svc/log/oxide-ntp:default.log.0 (919 bytes)
11632024-02-15T22:40:21.070Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/svc/log/oxide-ntp:default.log.0
11642024-02-15T22:40:21.070Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-oximeter:default.log (251757 bytes)
11652024-02-15T22:40:37.368Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 251757 -> 401339
11662024-02-15T22:40:39.297Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-oximeter:default.log
11672024-02-15T22:40:39.297Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-oximeter:default.log.0 (20078 bytes)
11682024-02-15T22:40:40.505Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-oximeter:default.log.0
11692024-02-15T22:40:40.505Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11702024-02-15T22:40:42.315Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-zone-network-setup:default.log
11712024-02-15T22:40:42.315Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes)
11722024-02-15T22:40:44.595Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_7d316a2f-bea3-45f1-b8c9-235c2b8bbc9b/root/var/svc/log/oxide-zone-network-setup:default.log.0
11732024-02-15T22:40:44.595Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_2c4a45dc-4ff7-4387-ae79-3f539a13b70c/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11742024-02-15T22:40:46.140Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_2c4a45dc-4ff7-4387-ae79-3f539a13b70c/root/var/svc/log/oxide-cockroachdb:default.log
11752024-02-15T22:40:46.183Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_2c4a45dc-4ff7-4387-ae79-3f539a13b70c/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
11762024-02-15T22:40:48.189Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_2c4a45dc-4ff7-4387-ae79-3f539a13b70c/root/var/svc/log/oxide-cockroachdb:default.log.0
11772024-02-15T22:40:48.189Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_2c4a45dc-4ff7-4387-ae79-3f539a13b70c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11782024-02-15T22:40:49.780Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_2c4a45dc-4ff7-4387-ae79-3f539a13b70c/root/var/svc/log/oxide-zone-network-setup:default.log
11792024-02-15T22:40:49.781Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_2c4a45dc-4ff7-4387-ae79-3f539a13b70c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
11802024-02-15T22:40:50.902Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_2c4a45dc-4ff7-4387-ae79-3f539a13b70c/root/var/svc/log/oxide-zone-network-setup:default.log.0
11812024-02-15T22:40:50.902Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a22612b5-f799-41d6-a7e1-c129821fa155/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
11822024-02-15T22:40:51.990Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a22612b5-f799-41d6-a7e1-c129821fa155/root/var/svc/log/oxide-crucible-agent:default.log
11832024-02-15T22:40:51.990Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a22612b5-f799-41d6-a7e1-c129821fa155/root/var/svc/log/oxide-crucible-agent:default.log.0 (3435 bytes)
11842024-02-15T22:40:54.728Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a22612b5-f799-41d6-a7e1-c129821fa155/root/var/svc/log/oxide-crucible-agent:default.log.0
11852024-02-15T22:40:54.728Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a22612b5-f799-41d6-a7e1-c129821fa155/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11862024-02-15T22:40:54.807Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a22612b5-f799-41d6-a7e1-c129821fa155/root/var/svc/log/oxide-crucible-downstairs:default.log
11872024-02-15T22:40:54.807Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a22612b5-f799-41d6-a7e1-c129821fa155/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11882024-02-15T22:40:56.386Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a22612b5-f799-41d6-a7e1-c129821fa155/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11892024-02-15T22:40:56.532Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_42d477a8-5d59-4b41-848d-c29350302606/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
11902024-02-15T22:40:57.577Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_42d477a8-5d59-4b41-848d-c29350302606/root/var/svc/log/oxide-crucible-pantry:default.log
11912024-02-15T22:40:57.578Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_42d477a8-5d59-4b41-848d-c29350302606/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2333 bytes)
11922024-02-15T22:41:00.273Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_42d477a8-5d59-4b41-848d-c29350302606/root/var/svc/log/oxide-crucible-pantry:default.log.0
11932024-02-15T22:41:00.274Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_280ac23e-32df-4ed9-a6e7-1aee67c08c7b/root/var/svc/log/oxide-nexus:default.log (958762 bytes)
11942024-02-15T22:41:03.200Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_280ac23e-32df-4ed9-a6e7-1aee67c08c7b/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 958762 -> 1506687
11952024-02-15T22:41:04.464Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_280ac23e-32df-4ed9-a6e7-1aee67c08c7b/root/var/svc/log/oxide-nexus:default.log
11962024-02-15T22:41:04.464Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_280ac23e-32df-4ed9-a6e7-1aee67c08c7b/root/var/svc/log/oxide-nexus:default.log.0 (398753 bytes)
11972024-02-15T22:41:07.624Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_280ac23e-32df-4ed9-a6e7-1aee67c08c7b/root/var/svc/log/oxide-nexus:default.log.0
11982024-02-15T22:41:07.727Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_e2926dd2-d9ce-45ed-8251-05f87b9c8f79/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11992024-02-15T22:41:18.789Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_e2926dd2-d9ce-45ed-8251-05f87b9c8f79/root/var/svc/log/oxide-cockroachdb:default.log
12002024-02-15T22:41:18.934Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_e2926dd2-d9ce-45ed-8251-05f87b9c8f79/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12012024-02-15T22:41:19.462Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_e2926dd2-d9ce-45ed-8251-05f87b9c8f79/root/var/svc/log/oxide-cockroachdb:default.log.0
12022024-02-15T22:41:19.462Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_e2926dd2-d9ce-45ed-8251-05f87b9c8f79/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12032024-02-15T22:41:20.571Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_e2926dd2-d9ce-45ed-8251-05f87b9c8f79/root/var/svc/log/oxide-zone-network-setup:default.log
12042024-02-15T22:41:20.572Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_e2926dd2-d9ce-45ed-8251-05f87b9c8f79/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
12052024-02-15T22:41:22.860Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_e2926dd2-d9ce-45ed-8251-05f87b9c8f79/root/var/svc/log/oxide-zone-network-setup:default.log.0
12062024-02-15T22:41:22.860Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-agent:default.log (13675 bytes)
12072024-02-15T22:41:28.589Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-agent:default.log
12082024-02-15T22:41:28.589Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-agent:default.log.0 (14151 bytes)
12092024-02-15T22:41:30.712Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-agent:default.log.0
12102024-02-15T22:41:30.712Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12112024-02-15T22:41:32.230Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:default.log
12122024-02-15T22:41:32.230Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12132024-02-15T22:41:34.336Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12142024-02-15T22:41:34.336Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:downstairs-2f2ab242-031f-4258-acc3-8f09556149d3.log (5671 bytes)
12152024-02-15T22:41:35.501Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:downstairs-2f2ab242-031f-4258-acc3-8f09556149d3.log
12162024-02-15T22:41:35.502Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:downstairs-45d3d3c3-d69a-492d-9f00-df045bafded7.log (0 bytes)
12172024-02-15T22:41:36.599Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:downstairs-45d3d3c3-d69a-492d-9f00-df045bafded7.log
12182024-02-15T22:41:36.600Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:downstairs-45d3d3c3-d69a-492d-9f00-df045bafded7.log.0 (3123 bytes)
12192024-02-15T22:41:37.776Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:downstairs-45d3d3c3-d69a-492d-9f00-df045bafded7.log.0
12202024-02-15T22:41:37.776Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:snapshot-2f2ab242-031f-4258-acc3-8f09556149d3-a886df7f-b8f2-4e61-87bd-1070ae592dc9.log (5283 bytes)
12212024-02-15T22:41:38.925Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f6ff2391-d3ec-43ac-a718-94fdef529fd9/root/var/svc/log/oxide-crucible-downstairs:snapshot-2f2ab242-031f-4258-acc3-8f09556149d3-a886df7f-b8f2-4e61-87bd-1070ae592dc9.log
12222024-02-15T22:41:38.925Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12232024-02-15T22:41:40.429Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-agent:default.log
12242024-02-15T22:41:40.429Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-agent:default.log.0 (13683 bytes)
12252024-02-15T22:41:42.474Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-agent:default.log.0
12262024-02-15T22:41:42.518Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12272024-02-15T22:41:43.731Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-downstairs:default.log
12282024-02-15T22:41:43.731Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12292024-02-15T22:41:45.342Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12302024-02-15T22:41:45.342Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-downstairs:downstairs-4c81b5c2-a2c6-4c77-b7a9-3546ff714fcb.log (0 bytes)
12312024-02-15T22:41:46.861Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-downstairs:downstairs-4c81b5c2-a2c6-4c77-b7a9-3546ff714fcb.log
12322024-02-15T22:41:46.861Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-downstairs:downstairs-4c81b5c2-a2c6-4c77-b7a9-3546ff714fcb.log.0 (3123 bytes)
12332024-02-15T22:41:48.010Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_9397c469-e335-4844-8730-33d7ab1ce496/root/var/svc/log/oxide-crucible-downstairs:downstairs-4c81b5c2-a2c6-4c77-b7a9-3546ff714fcb.log.0
12342024-02-15T22:41:48.010Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_6a7f901a-20e8-41c1-8995-f5f9f6b44c37/root/var/svc/log/oxide-nexus:default.log (34184077 bytes)
12352024-02-15T22:42:26.583Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_6a7f901a-20e8-41c1-8995-f5f9f6b44c37/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 34184077 -> 34911263
12362024-02-15T22:42:27.783Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_6a7f901a-20e8-41c1-8995-f5f9f6b44c37/root/var/svc/log/oxide-nexus:default.log
12372024-02-15T22:42:27.784Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_6a7f901a-20e8-41c1-8995-f5f9f6b44c37/root/var/svc/log/oxide-nexus:default.log.0 (248909 bytes)
12382024-02-15T22:42:30.340Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_6a7f901a-20e8-41c1-8995-f5f9f6b44c37/root/var/svc/log/oxide-nexus:default.log.0
12392024-02-15T22:42:30.340Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-agent:default.log (6357 bytes)
12402024-02-15T22:42:32.349Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-agent:default.log
12412024-02-15T22:42:32.349Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-agent:default.log.0 (13682 bytes)
12422024-02-15T22:42:34.359Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-agent:default.log.0
12432024-02-15T22:42:34.359Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12442024-02-15T22:42:35.866Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:default.log
12452024-02-15T22:42:35.866Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12462024-02-15T22:42:37.417Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12472024-02-15T22:42:37.417Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:downstairs-525408ee-a721-4aa7-9dc9-c67c9813e8a9.log (3008 bytes)
12482024-02-15T22:42:40.206Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:downstairs-525408ee-a721-4aa7-9dc9-c67c9813e8a9.log
12492024-02-15T22:42:40.206Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:downstairs-6c353424-30fa-4d61-b335-740f1845eb41.log (0 bytes)
12502024-02-15T22:42:41.328Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:downstairs-6c353424-30fa-4d61-b335-740f1845eb41.log
12512024-02-15T22:42:41.328Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:downstairs-6c353424-30fa-4d61-b335-740f1845eb41.log.0 (3125 bytes)
12522024-02-15T22:42:42.433Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_7eafd85f-fbcd-44d6-8c5a-961b00ae72f4/root/var/svc/log/oxide-crucible-downstairs:downstairs-6c353424-30fa-4d61-b335-740f1845eb41.log.0
12532024-02-15T22:42:42.434Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-agent:default.log (30717 bytes)
12542024-02-15T22:42:43.803Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-agent:default.log
12552024-02-15T22:42:43.803Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-agent:default.log.0 (3434 bytes)
12562024-02-15T22:42:49.234Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-agent:default.log.0
12572024-02-15T22:42:49.234Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12582024-02-15T22:42:50.749Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:default.log
12592024-02-15T22:42:50.749Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12602024-02-15T22:42:51.884Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12612024-02-15T22:42:51.908Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4b38917-4310-4291-989f-bdde70d84919.log (3007 bytes)
12622024-02-15T22:42:52.996Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4b38917-4310-4291-989f-bdde70d84919.log
12632024-02-15T22:42:52.996Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:downstairs-ddd17ee8-a338-4135-8709-754cdab526f1.log (5672 bytes)
12642024-02-15T22:42:54.201Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:downstairs-ddd17ee8-a338-4135-8709-754cdab526f1.log
12652024-02-15T22:42:54.201Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3efd9b0-3125-4f07-94d9-b0e9965a6fd9.log (5592 bytes)
12662024-02-15T22:42:55.332Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3efd9b0-3125-4f07-94d9-b0e9965a6fd9.log
12672024-02-15T22:42:55.332Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:snapshot-ddd17ee8-a338-4135-8709-754cdab526f1-a886df7f-b8f2-4e61-87bd-1070ae592dc9.log (5284 bytes)
12682024-02-15T22:42:57.792Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_358f6515-8881-4c6e-9f62-6887e6150952/root/var/svc/log/oxide-crucible-downstairs:snapshot-ddd17ee8-a338-4135-8709-754cdab526f1-a886df7f-b8f2-4e61-87bd-1070ae592dc9.log
12692024-02-15T22:42:57.792Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_98042d91-9881-49cc-9c16-54a1af521f5c/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
12702024-02-15T22:42:59.347Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_98042d91-9881-49cc-9c16-54a1af521f5c/root/var/svc/log/oxide-crucible-pantry:default.log
12712024-02-15T22:42:59.348Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_98042d91-9881-49cc-9c16-54a1af521f5c/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
12722024-02-15T22:43:00.892Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_98042d91-9881-49cc-9c16-54a1af521f5c/root/var/svc/log/oxide-crucible-pantry:default.log.0
12732024-02-15T22:43:00.892Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f99f7937-0972-4b74-a946-33017c00edf3/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12742024-02-15T22:43:02.016Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f99f7937-0972-4b74-a946-33017c00edf3/root/var/svc/log/oxide-crucible-agent:default.log
12752024-02-15T22:43:02.069Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f99f7937-0972-4b74-a946-33017c00edf3/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12762024-02-15T22:43:03.584Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f99f7937-0972-4b74-a946-33017c00edf3/root/var/svc/log/oxide-crucible-agent:default.log.0
12772024-02-15T22:43:03.584Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f99f7937-0972-4b74-a946-33017c00edf3/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12782024-02-15T22:43:05.164Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f99f7937-0972-4b74-a946-33017c00edf3/root/var/svc/log/oxide-crucible-downstairs:default.log
12792024-02-15T22:43:05.164Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f99f7937-0972-4b74-a946-33017c00edf3/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12802024-02-15T22:43:07.663Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f99f7937-0972-4b74-a946-33017c00edf3/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12812024-02-15T22:43:07.663Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_083bde05-2bba-4a0a-b1c4-e79a5b6e8652/root/var/svc/log/oxide-nexus:default.log (2807176 bytes)
12822024-02-15T22:43:13.595Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_083bde05-2bba-4a0a-b1c4-e79a5b6e8652/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2807176 -> 4272027
12832024-02-15T22:43:14.668Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_083bde05-2bba-4a0a-b1c4-e79a5b6e8652/root/var/svc/log/oxide-nexus:default.log
12842024-02-15T22:43:14.668Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_083bde05-2bba-4a0a-b1c4-e79a5b6e8652/root/var/svc/log/oxide-nexus:default.log.0 (2194312 bytes)
12852024-02-15T22:43:19.171Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_083bde05-2bba-4a0a-b1c4-e79a5b6e8652/root/var/svc/log/oxide-nexus:default.log.0
12862024-02-15T22:43:19.171Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/measurements.log (26578 bytes)
12872024-02-15T22:43:19.302Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/measurements.log" changed size mid upload: 26578 -> 41511
12882024-02-15T22:43:20.408Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/measurements.log
12892024-02-15T22:43:20.408Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/statistics.log (18252 bytes)
12902024-02-15T22:43:20.553Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/statistics.log" changed size mid upload: 18252 -> 30420
12912024-02-15T22:43:21.643Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/statistics.log
12922024-02-15T22:43:21.643Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/tracking.log (2248 bytes)
12932024-02-15T22:43:21.708Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/tracking.log" changed size mid upload: 2248 -> 3172
12942024-02-15T22:43:22.793Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_8b63ff52-7059-46bc-a6bd-8c2d7170ffbe/root/var/log/chrony/tracking.log