01HQY11E1Q3QDAH5GSCW22Z7QR: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HQY126M964K45SY0JR1QFPBM

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-03-01T22:47:21.958Zjob dependencies complete; ready to run (waiting for 37 m 26 s)
22024-03-01T23:04:35.573Zjob assigned to worker 01HQY3XAGQFPWER2GGJFGNPJS8 (queued for 17 m 13 s)
32024-03-01T23:04:35.854Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-03-01T23:04:35.978Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-03-01T23:04:36.112Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-03-01T23:04:36.245Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-03-01T23:04:36.374Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-03-01T23:04:36.507ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-03-01T23:04:36.637Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-03-01T23:04:36.764ZOxide Helios Version helios-2.0.22451 64-bit
112024-03-01T23:04:36.893ZConfiguring devices.
122024-03-01T23:04:37.076Z##################################################
132024-03-01T23:04:37.243Z#### ############# ##
142024-03-01T23:04:37.321Z### ### ############ ##
152024-03-01T23:04:37.394Z## ### # ## ### ## Oxide Computer Company ##
162024-03-01T23:04:37.470Z## ## ## ### # ### ##
172024-03-01T23:04:37.547Z## # ### #### #### This Station Under ##
182024-03-01T23:04:37.631Z### ### #### # ### Computer Control ##
192024-03-01T23:04:37.735Z#### #### ### ## ##
202024-03-01T23:04:37.823Z##################################################
212024-03-01T23:04:37.904ZHostname: buskin
222024-03-01T23:04:37.981ZLoading smf(7) service descriptions:
232024-03-01T23:04:38.435Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-ec7dc70942caaa25.gz
242024-03-01T23:04:41.192Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-ec7dc70942caaa25.gz
252024-03-01T23:04:41.193Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-03-01T23:05:04.468Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-03-01T23:05:04.494Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-06239e2b0a4ace4f.gz
282024-03-01T23:05:23.856Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-06239e2b0a4ace4f.gz
292024-03-01T23:05:23.882Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-03-01T23:05:24.835Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-03-01T23:05:24.862Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-03-01T23:05:27.940Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-03-01T23:05:27.964Zdownloading input: /input/package/work/version.txt
342024-03-01T23:05:27.996Zdownloaded input: /input/package/work/version.txt
352024-03-01T23:05:27.996Zdownloading input: /input/package/work/package.tar.gz
362024-03-01T23:05:53.678Zdownloaded input: /input/package/work/package.tar.gz
372024-03-01T23:05:53.702Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-03-01T23:06:17.613Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-03-01T23:06:17.613Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-03-01T23:06:24.207Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-03-01T23:06:24.232Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-03-01T23:06:59.923Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-03-01T23:06:59.924Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-03-01T23:07:37.674Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-03-01T23:07:37.674Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-03-01T23:08:05.166Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-03-01T23:08:05.166Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
482024-03-01T23:08:11.927Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
492024-03-01T23:08:11.927Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
502024-03-01T23:08:20.381Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
512024-03-01T23:08:20.381Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-03-01T23:08:29.199Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-03-01T23:08:29.246Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-03-01T23:08:34.481Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-03-01T23:08:34.481Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-03-01T23:08:34.552Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-03-01T23:08:34.589Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-03-01T23:08:39.308Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-03-01T23:08:39.333Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-03-01T23:08:44.227Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-03-01T23:08:44.324Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-03-01T23:08:59.525Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-03-01T23:08:59.525Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-03-01T23:09:15.677Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-03-01T23:09:15.707Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-03-01T23:09:15.755Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-03-01T23:09:15.755Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-03-01T23:09:27.735Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-03-01T23:09:27.761Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-03-01T23:09:45.398Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-03-01T23:09:45.399Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-03-01T23:10:57.514Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-03-01T23:10:57.514Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-03-01T23:11:52.168Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-03-01T23:11:52.195Zstarting task 0: "setup"
762024-03-01T23:11:52.195Z++ uname -s
772024-03-01T23:11:52.196Z+ kern=SunOS
782024-03-01T23:11:52.196Z+ case "$kern" in
792024-03-01T23:11:52.196Z+ groupadd -g 12345 build
802024-03-01T23:11:52.196Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-03-01T23:11:54.191Z+ zfs create -o mountpoint=/work rpool/work
822024-03-01T23:11:54.236Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-03-01T23:11:54.237Z+ home_fs=zfs
842024-03-01T23:11:54.237Z+ [[ zfs == autofs ]]
852024-03-01T23:11:54.237Z+ mkdir -p /home/build
862024-03-01T23:11:54.237Z+ chown build:build /home/build /work
872024-03-01T23:11:56.229Z+ chmod 0700 /home/build /work
882024-03-01T23:11:56.254Zprocess exited: duration 4064 ms, exit code 0
 
892024-03-01T23:11:56.751Zstarting task 1: "authentication"
902024-03-01T23:11:56.788Zprocess exited: duration 54 ms, exit code 0
 
912024-03-01T23:11:56.854Zstarting task 2: "build"
922024-03-01T23:11:56.881Z+ trap _exit_trap EXIT
932024-03-01T23:11:56.881Z+ set +x
942024-03-01T23:12:44.631Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-03-01T23:12:44.874Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-03-01T23:12:44.874Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-03-01T23:12:44.874Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-03-01T23:12:44.875Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-03-01T23:12:44.903Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-03-01T23:12:44.903Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-03-01T23:12:44.903Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-03-01T23:12:44.903Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-03-01T23:12:44.903Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-03-01T23:12:44.903Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-03-01T23:12:44.904Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-03-01T23:12:44.904Z+ [[ -d /opt/oxide ]]
1072024-03-01T23:12:44.904Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-03-01T23:12:44.904Z+ pfexec mkdir /opt/oxide
1092024-03-01T23:12:44.904Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-03-01T23:12:44.904Z+ [[ -d /opt/oxide-underneath ]]
1112024-03-01T23:12:44.904Z+ cd /opt/oxide-underneath
1122024-03-01T23:12:44.904Z+ pfexec tar ceEp@/f - .
1132024-03-01T23:12:44.904Z+ cd /opt/oxide
1142024-03-01T23:12:44.904Z+ pfexec tar xveEp@/f -
1152024-03-01T23:12:44.949Zx ., 0 bytes, 0 tape blocks
1162024-03-01T23:12:44.949Zx ./opte, 0 bytes, 0 tape blocks
1172024-03-01T23:12:44.949Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-03-01T23:12:44.949Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-03-01T23:12:44.950Z+ pfexec rm -rf /opt/oxide-underneath
1202024-03-01T23:12:44.977Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-03-01T23:12:44.978Z+ pfexec mkdir /opt/oxide/work
1222024-03-01T23:12:44.978Z+ pfexec chown build:build /opt/oxide/work
1232024-03-01T23:12:45.006Z+ cd /opt/oxide/work
1242024-03-01T23:12:45.006Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-03-01T23:12:46.556ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-03-01T23:12:46.556Zx out/mg-ddm-gz.tar, 67661824 bytes, 132152 tape blocks
1272024-03-01T23:12:46.556Zx out/omicron-sled-agent.tar, 109155328 bytes, 213194 tape blocks
1282024-03-01T23:12:46.556Zx out/oxlog.tar, 6664704 bytes, 13017 tape blocks
1292024-03-01T23:12:46.556Zx out/target/test, 75 bytes, 1 tape blocks
1302024-03-01T23:12:46.556Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-03-01T23:12:46.556Zx package-manifest.toml, 25053 bytes, 49 tape blocks
1322024-03-01T23:12:46.556Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-03-01T23:12:46.556Zx target/release/omicron-package, 39987744 bytes, 78102 tape blocks
1342024-03-01T23:12:46.556Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-03-01T23:12:46.556Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-03-01T23:12:46.556Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-03-01T23:12:46.556Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-03-01T23:12:46.556Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-03-01T23:12:46.556Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-03-01T23:12:46.556Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-03-01T23:12:46.583Z
1422024-03-01T23:12:46.583Zreal 1.575327098
1432024-03-01T23:12:46.583Zuser 1.420156772
1442024-03-01T23:12:46.583Zsys 0.271366582
1452024-03-01T23:12:46.583Ztrap 0.000055409
1462024-03-01T23:12:46.583Ztflt 0.000000000
1472024-03-01T23:12:46.583Zdflt 0.000000000
1482024-03-01T23:12:46.583Zkflt 0.000000000
1492024-03-01T23:12:46.583Zlock 0.000000000
1502024-03-01T23:12:46.583Zslp 1.421498312
1512024-03-01T23:12:46.583Zlat 0.035677054
1522024-03-01T23:12:46.583Zstop 0.000127733
1532024-03-01T23:12:46.584Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-03-01T23:12:47.720Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-03-01T23:12:47.747Z+ mkdir tests
1562024-03-01T23:12:47.748Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-03-01T23:12:47.748Z+ ptime -m gunzip
1582024-03-01T23:12:47.748Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-ec7dc70942caaa25
1592024-03-01T23:12:47.941Z
1602024-03-01T23:12:47.966Zreal 0.205541915
1612024-03-01T23:12:47.966Zuser 0.189988821
1622024-03-01T23:12:47.966Zsys 0.015296187
1632024-03-01T23:12:47.966Ztrap 0.000018610
1642024-03-01T23:12:47.966Ztflt 0.000000000
1652024-03-01T23:12:47.967Zdflt 0.000000000
1662024-03-01T23:12:47.967Zkflt 0.000000000
1672024-03-01T23:12:47.967Zlock 0.000000000
1682024-03-01T23:12:47.967Zslp 0.000020780
1692024-03-01T23:12:47.967Zlat 0.000022740
1702024-03-01T23:12:47.967Zstop 0.000132982
1712024-03-01T23:12:47.967Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-ec7dc70942caaa25
1722024-03-01T23:12:47.967Z+ chmod a+x tests/bootstrap-ec7dc70942caaa25
1732024-03-01T23:12:47.967Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-03-01T23:12:47.967Z+ ptime -m gunzip
1752024-03-01T23:12:47.967Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-03-01T23:12:50.106Z
1772024-03-01T23:12:50.136Zreal 2.152018406
1782024-03-01T23:12:50.136Zuser 2.014374463
1792024-03-01T23:12:50.136Zsys 0.137279006
1802024-03-01T23:12:50.136Ztrap 0.000139052
1812024-03-01T23:12:50.137Ztflt 0.000000000
1822024-03-01T23:12:50.137Zdflt 0.000000000
1832024-03-01T23:12:50.137Zkflt 0.000000000
1842024-03-01T23:12:50.137Zlock 0.000000000
1852024-03-01T23:12:50.138Zslp 0.000021400
1862024-03-01T23:12:50.138Zlat 0.000015930
1872024-03-01T23:12:50.138Zstop 0.000123392
1882024-03-01T23:12:50.138Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-03-01T23:12:50.139Z+ chmod a+x tests/bootstrap
1902024-03-01T23:12:50.139Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-03-01T23:12:50.139Z+ ptime -m gunzip
1922024-03-01T23:12:50.139Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-06239e2b0a4ace4f
1932024-03-01T23:12:52.741Z
1942024-03-01T23:12:52.795Zreal 2.216617649
1952024-03-01T23:12:52.796Zuser 2.069706608
1962024-03-01T23:12:52.796Zsys 0.146522491
1972024-03-01T23:12:52.796Ztrap 0.000163394
1982024-03-01T23:12:52.796Ztflt 0.000000000
1992024-03-01T23:12:52.796Zdflt 0.000000000
2002024-03-01T23:12:52.796Zkflt 0.000000000
2012024-03-01T23:12:52.796Zlock 0.000000000
2022024-03-01T23:12:52.796Zslp 0.000019960
2032024-03-01T23:12:52.796Zlat 0.000021301
2042024-03-01T23:12:52.796Zstop 0.000119842
2052024-03-01T23:12:52.796Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-06239e2b0a4ace4f
2062024-03-01T23:12:52.796Z+ chmod a+x tests/end_to_end_tests-06239e2b0a4ace4f
2072024-03-01T23:12:52.796Z+ bmat address ls
2082024-03-01T23:12:52.796ZNAME CIDR FIRST LAST COUNT
2092024-03-01T23:12:52.796Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-03-01T23:12:52.796Z++ bmat address ls -f extra -Ho first,last,count
2112024-03-01T23:12:52.796Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-03-01T23:12:52.797Z+ EXTRA_IP_START=10.151.1.164
2132024-03-01T23:12:52.797Z+ EXTRA_IP_END=10.151.1.227
2142024-03-01T23:12:52.797Z+ EXTRA_IP_COUNT=64
2152024-03-01T23:12:52.797Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-03-01T23:12:52.797Z+ EXTRA_IP_BASE=10.151.1
2172024-03-01T23:12:52.797Z+ EXTRA_IP_FOCTET=164
2182024-03-01T23:12:52.797Z+ EXTRA_IP_LOCTET=227
2192024-03-01T23:12:52.797Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-03-01T23:12:52.797Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-03-01T23:12:52.797Z+ DNS_IP1=10.151.1.164
2222024-03-01T23:12:52.797Z+ DNS_IP2=10.151.1.165
2232024-03-01T23:12:52.798Z+ UPLINK_IP=10.151.1.174
2242024-03-01T23:12:52.798Z+ IPPOOL_START=10.151.1.175
2252024-03-01T23:12:52.798Z+ IPPOOL_END=10.151.1.227
2262024-03-01T23:12:52.798Z++ ipadm show-addr -po type,addr
2272024-03-01T23:12:52.798Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-03-01T23:12:52.798Z+ GATEWAY_IP=10.151.1.100
2292024-03-01T23:12:52.798Z+ [[ -n 10.151.1.100 ]]
2302024-03-01T23:12:52.798Z+ ping -s 10.151.1.100 56 1
2312024-03-01T23:12:52.798ZPING 10.151.1.100: 56 data bytes
2322024-03-01T23:12:52.798Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2332024-03-01T23:12:52.798Z
2342024-03-01T23:12:52.798Z----10.151.1.100 PING Statistics----
2352024-03-01T23:12:52.799Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-03-01T23:12:52.799Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2372024-03-01T23:12:52.799Z++ arp -an
2382024-03-01T23:12:52.799Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-03-01T23:12:52.799Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-03-01T23:12:52.799Z+ routeadm -e ipv4-forwarding -u
2412024-03-01T23:12:52.799Z+ PXA_START=10.151.1.164
2422024-03-01T23:12:52.799Z+ PXA_END=10.151.1.227
2432024-03-01T23:12:52.799Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-03-01T23:12:52.800Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-03-01T23:12:52.800Z+ ZPOOL_VDEV_DIR=/scratch
2462024-03-01T23:12:52.800Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-03-01T23:12:52.800Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-03-01T23:12:52.800Z++ cd ./tools
2492024-03-01T23:12:52.800Z++ pwd
2502024-03-01T23:12:52.800Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-03-01T23:12:52.800Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-03-01T23:12:52.800Z+ SOFTNPU_MODE=zone
2532024-03-01T23:12:52.800Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-03-01T23:12:52.800Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-03-01T23:12:52.801Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-03-01T23:12:52.801Z++ dladm show-phys -p -o LINK
2572024-03-01T23:12:52.801Z++ head -1
2582024-03-01T23:12:52.801Z+ PHYSICAL_LINK=igb0
2592024-03-01T23:12:52.801Z+ echo 'Using igb0 as physical link'
2602024-03-01T23:12:52.801ZUsing igb0 as physical link
2612024-03-01T23:12:52.801Z+ ensure_run_as_root
2622024-03-01T23:12:52.801Z++ id -u
2632024-03-01T23:12:52.801Z+ [[ 0 -ne 0 ]]
2642024-03-01T23:12:52.801Z+ ensure_zpools
2652024-03-01T23:12:52.802Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-03-01T23:12:52.802Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-03-01T23:12:52.802Z+ readarray -t ZPOOLS
2682024-03-01T23:12:52.802Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-03-01T23:12:52.802Z++ sed 's/[ ",]//g'
2702024-03-01T23:12:52.802Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-03-01T23:12:52.802Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-03-01T23:12:52.802ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-03-01T23:12:52.802Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-03-01T23:12:52.802Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-03-01T23:12:52.802Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-03-01T23:12:52.803Z0+0 records in
2772024-03-01T23:12:52.803Z0+0 records out
2782024-03-01T23:12:52.803Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2792024-03-01T23:12:52.803Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-03-01T23:12:52.803Z+ set +x
2812024-03-01T23:12:52.803ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-03-01T23:12:52.803Z++ zpool list -o name
2832024-03-01T23:12:52.803Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-03-01T23:12:52.803Z+ [[ -z '' ]]
2852024-03-01T23:12:52.803Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-03-01T23:12:53.245Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-03-01T23:12:53.245Z+ set +x
2882024-03-01T23:12:53.246ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-03-01T23:12:53.246ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2902024-03-01T23:12:53.246Z+ for ZPOOL in "${ZPOOLS[@]}"
2912024-03-01T23:12:53.247Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2922024-03-01T23:12:53.247Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2932024-03-01T23:12:53.247Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2942024-03-01T23:12:53.247Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-03-01T23:12:53.247Z0+0 records in
2962024-03-01T23:12:53.247Z0+0 records out
2972024-03-01T23:12:53.247Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2982024-03-01T23:12:53.248Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-03-01T23:12:53.248Z+ set +x
3002024-03-01T23:12:53.248ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-03-01T23:12:53.248Z++ zpool list -o name
3022024-03-01T23:12:53.249Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-03-01T23:12:53.249Z+ [[ -z '' ]]
3042024-03-01T23:12:53.249Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-03-01T23:12:53.249Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-03-01T23:12:53.249Z+ set +x
3072024-03-01T23:12:53.249ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-03-01T23:12:53.249Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-03-01T23:12:53.250Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-03-01T23:12:53.250ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-03-01T23:12:53.250Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-03-01T23:12:53.250Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-03-01T23:12:53.251Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-03-01T23:12:53.251Z0+0 records in
3152024-03-01T23:12:53.251Z0+0 records out
3162024-03-01T23:12:53.251Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3172024-03-01T23:12:53.251Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-03-01T23:12:53.251Z+ set +x
3192024-03-01T23:12:53.251ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-03-01T23:12:53.251Z++ zpool list -o name
3212024-03-01T23:12:53.252Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-03-01T23:12:53.252Z+ [[ -z '' ]]
3232024-03-01T23:12:53.252Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-03-01T23:12:53.330Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-03-01T23:12:53.331Z+ set +x
3262024-03-01T23:12:53.331ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-03-01T23:12:53.331Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-03-01T23:12:53.331Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-03-01T23:12:53.331ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3302024-03-01T23:12:53.331Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3312024-03-01T23:12:53.331Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-03-01T23:12:53.332Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-03-01T23:12:53.332Z0+0 records in
3342024-03-01T23:12:53.332Z0+0 records out
3352024-03-01T23:12:53.332Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3362024-03-01T23:12:53.332Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-03-01T23:12:53.332Z+ set +x
3382024-03-01T23:12:53.332ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-03-01T23:12:53.332Z++ zpool list -o name
3402024-03-01T23:12:53.332Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-03-01T23:12:53.333Z+ [[ -z '' ]]
3422024-03-01T23:12:53.333Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-03-01T23:12:53.333Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-03-01T23:12:53.333Z+ set +x
3452024-03-01T23:12:53.333ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-03-01T23:12:53.333Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-03-01T23:12:53.333Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3482024-03-01T23:12:53.333ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3492024-03-01T23:12:53.334Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-03-01T23:12:53.334Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-03-01T23:12:53.334Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-03-01T23:12:53.334Z0+0 records in
3532024-03-01T23:12:53.334Z0+0 records out
3542024-03-01T23:12:53.334Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3552024-03-01T23:12:53.334Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-03-01T23:12:53.334Z+ set +x
3572024-03-01T23:12:53.335ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-03-01T23:12:53.335Z++ zpool list -o name
3592024-03-01T23:12:53.335Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-03-01T23:12:53.335Z+ [[ -z '' ]]
3612024-03-01T23:12:53.335Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-03-01T23:12:53.335Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-03-01T23:12:53.335Z+ set +x
3642024-03-01T23:12:53.335ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-03-01T23:12:53.336Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-03-01T23:12:53.336Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-03-01T23:12:53.336ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-03-01T23:12:53.336Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-03-01T23:12:53.336Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-03-01T23:12:53.336Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-03-01T23:12:53.336Z0+0 records in
3722024-03-01T23:12:53.336Z0+0 records out
3732024-03-01T23:12:53.337Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3742024-03-01T23:12:53.337Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-03-01T23:12:53.337Z+ set +x
3762024-03-01T23:12:53.337ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-03-01T23:12:53.337Z++ zpool list -o name
3782024-03-01T23:12:53.337Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-03-01T23:12:53.337Z+ [[ -z '' ]]
3802024-03-01T23:12:53.337Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-03-01T23:12:53.338Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-03-01T23:12:53.338Z+ set +x
3832024-03-01T23:12:53.338ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-03-01T23:12:53.338Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-03-01T23:12:53.338Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3862024-03-01T23:12:53.338ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3872024-03-01T23:12:53.338Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-03-01T23:12:53.338Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-03-01T23:12:53.338Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-03-01T23:12:53.339Z0+0 records in
3912024-03-01T23:12:53.339Z0+0 records out
3922024-03-01T23:12:53.339Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3932024-03-01T23:12:53.339Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-03-01T23:12:53.339Z+ set +x
3952024-03-01T23:12:53.339ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-03-01T23:12:53.339Z++ zpool list -o name
3972024-03-01T23:12:53.339Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-03-01T23:12:53.339Z+ [[ -z '' ]]
3992024-03-01T23:12:53.340Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-03-01T23:12:53.340Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-03-01T23:12:53.340Z+ set +x
4022024-03-01T23:12:53.340ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-03-01T23:12:53.340Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-03-01T23:12:53.340Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4052024-03-01T23:12:53.340ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4062024-03-01T23:12:53.340Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-03-01T23:12:53.340Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-03-01T23:12:53.341Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-03-01T23:12:53.341Z0+0 records in
4102024-03-01T23:12:53.341Z0+0 records out
4112024-03-01T23:12:53.341Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4122024-03-01T23:12:53.341Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-03-01T23:12:53.341Z+ set +x
4142024-03-01T23:12:53.341ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-03-01T23:12:53.341Z++ zpool list -o name
4162024-03-01T23:12:53.341Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-03-01T23:12:53.342Z+ [[ -z '' ]]
4182024-03-01T23:12:53.342Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-03-01T23:12:53.342Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-03-01T23:12:53.342Z+ set +x
4212024-03-01T23:12:53.342ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-03-01T23:12:53.342Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-03-01T23:12:53.342Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-03-01T23:12:53.377ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4252024-03-01T23:12:53.377Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4262024-03-01T23:12:53.377Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-03-01T23:12:53.378Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-03-01T23:12:53.378Z0+0 records in
4292024-03-01T23:12:53.378Z0+0 records out
4302024-03-01T23:12:53.378Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4312024-03-01T23:12:53.378Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-03-01T23:12:53.378Z+ set +x
4332024-03-01T23:12:53.378ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-03-01T23:12:53.379Z++ zpool list -o name
4352024-03-01T23:12:53.379Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-03-01T23:12:53.379Z+ [[ -z '' ]]
4372024-03-01T23:12:53.380Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-03-01T23:12:53.380Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-03-01T23:12:53.380Z+ set +x
4402024-03-01T23:12:53.380ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-03-01T23:12:53.380Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-03-01T23:12:53.380Z+ readarray -t ZPOOLS
4432024-03-01T23:12:53.381Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-03-01T23:12:53.381Z++ sed 's/[ ",]//g'
4452024-03-01T23:12:53.381Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-03-01T23:12:53.381Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-03-01T23:12:53.381ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-03-01T23:12:53.382Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-03-01T23:12:53.382Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-03-01T23:12:53.382Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-03-01T23:12:53.382Z0+0 records in
4522024-03-01T23:12:53.382Z0+0 records out
4532024-03-01T23:12:53.382Z0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec)
4542024-03-01T23:12:53.382Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-03-01T23:12:53.382Z+ set +x
4562024-03-01T23:12:53.382ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-03-01T23:12:53.383Z++ zpool list -o name
4582024-03-01T23:12:53.383Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-03-01T23:12:53.383Z+ [[ -z '' ]]
4602024-03-01T23:12:53.383Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-03-01T23:12:53.383Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-03-01T23:12:53.383Z+ set +x
4632024-03-01T23:12:53.383ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4642024-03-01T23:12:53.383Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-03-01T23:12:53.383ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4662024-03-01T23:12:53.384Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4672024-03-01T23:12:53.384Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4682024-03-01T23:12:53.384Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4692024-03-01T23:12:53.384Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-03-01T23:12:53.384Z0+0 records in
4712024-03-01T23:12:53.384Z0+0 records out
4722024-03-01T23:12:53.384Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-03-01T23:12:53.385Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-03-01T23:12:53.385Z+ set +x
4752024-03-01T23:12:53.385ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-03-01T23:12:53.385Z++ zpool list -o name
4772024-03-01T23:12:53.385Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-03-01T23:12:53.385Z+ [[ -z '' ]]
4792024-03-01T23:12:53.385Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-03-01T23:12:53.385Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-03-01T23:12:53.386Z+ set +x
4822024-03-01T23:12:53.386ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-03-01T23:12:53.386Z+ [[ zone == \z\o\n\e ]]
4842024-03-01T23:12:53.386Z+ ensure_simulated_links igb0
4852024-03-01T23:12:53.386Z+ local PHYSICAL_LINK=igb0
4862024-03-01T23:12:53.386Z+ INDICES=("0" "1")
4872024-03-01T23:12:53.387Z+ for I in "${INDICES[@]}"
4882024-03-01T23:12:53.387Z++ get_simnet_name_if_exists net0
4892024-03-01T23:12:53.387Z++ dladm show-simnet -p -o LINK net0
4902024-03-01T23:12:53.387Z++ echo ''
4912024-03-01T23:12:53.387Z+ [[ -z '' ]]
4922024-03-01T23:12:53.387Z+ dladm create-simnet -t net0
4932024-03-01T23:12:53.387Z+ dladm create-simnet -t sc0_0
4942024-03-01T23:12:53.388Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-03-01T23:12:53.388Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-03-01T23:12:53.388Z+ success 'Simnet net0/sc0_0 exists'
4972024-03-01T23:12:53.388Z+ set +x
4982024-03-01T23:12:53.388ZSimnet net0/sc0_0 exists
4992024-03-01T23:12:53.388Z+ for I in "${INDICES[@]}"
5002024-03-01T23:12:53.388Z++ get_simnet_name_if_exists net1
5012024-03-01T23:12:53.388Z++ dladm show-simnet -p -o LINK net1
5022024-03-01T23:12:53.388Z++ echo ''
5032024-03-01T23:12:53.388Z+ [[ -z '' ]]
5042024-03-01T23:12:53.388Z+ dladm create-simnet -t net1
5052024-03-01T23:12:53.389Z+ dladm create-simnet -t sc1_0
5062024-03-01T23:12:53.389Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-03-01T23:12:53.389Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-03-01T23:12:53.389Z+ success 'Simnet net1/sc1_0 exists'
5092024-03-01T23:12:53.389Z+ set +x
5102024-03-01T23:12:53.389ZSimnet net1/sc1_0 exists
5112024-03-01T23:12:53.389Z++ get_vnic_name_if_exists sc0_1
5122024-03-01T23:12:53.389Z++ dladm show-vnic -p -o LINK sc0_1
5132024-03-01T23:12:53.389Z++ echo ''
5142024-03-01T23:12:53.390Z+ [[ -z '' ]]
5152024-03-01T23:12:53.390Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-03-01T23:12:53.390Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-03-01T23:12:53.390Z+ success 'Vnic sc0_1 exists'
5182024-03-01T23:12:53.390Z+ set +x
5192024-03-01T23:12:53.390ZVnic sc0_1 exists
5202024-03-01T23:12:53.390Z+ warn_if_no_proxy_arp
5212024-03-01T23:12:53.390Z+ [[ -v PXA_START ]]
5222024-03-01T23:12:53.390Z+ [[ -v PXA_END ]]
5232024-03-01T23:12:53.390Z+ ensure_softnpu_zone
5242024-03-01T23:12:53.434Z+ zoneadm list
5252024-03-01T23:12:53.434Z+ grep -q sidecar_softnpu
5262024-03-01T23:12:53.434Z+ [[ -f out/npuzone/npuzone ]]
5272024-03-01T23:12:53.435Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-03-01T23:12:53.435Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-03-01T23:13:01.818Zdownloading softnpu ...done
5302024-03-01T23:13:01.843Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-03-01T23:13:12.621Zdownloading asic_program.so ...done
5322024-03-01T23:13:12.654Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-03-01T23:13:25.150Zdownloading scadm ...done
5342024-03-01T23:13:25.180Zcreating port tfportrear0_0 for sc0_0
5352024-03-01T23:13:25.180Zcreating port tfportqsfp0_0 for sc0_1
5362024-03-01T23:13:25.180Zsoftnpu zone setup
5372024-03-01T23:13:25.180Zconfigure zone
5382024-03-01T23:13:25.206Zinstall zone
5392024-03-01T23:13:26.261Zboot zone
5402024-03-01T23:13:29.367Z[sidecar_softnpu] svcs milestone/network
5412024-03-01T23:13:29.394ZSTATE STIME FMRI
5422024-03-01T23:13:29.394Zonline 23:13:27 svc:/milestone/network:default
5432024-03-01T23:13:29.394Z[sidecar_softnpu] /softnpu/npu start
5442024-03-01T23:13:29.418Z
5452024-03-01T23:13:29.443Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-03-01T23:13:29.443Z+ GATEWAY_IP=10.151.1.100
5472024-03-01T23:13:29.443Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-03-01T23:13:29.443ZUsing 10.151.1.100 as gateway ip
5492024-03-01T23:13:29.443Z+ [[ ! -v GATEWAY_MAC ]]
5502024-03-01T23:13:29.443Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-03-01T23:13:29.443Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-03-01T23:13:29.443Z+++ echo 18:c0:4d:0d:9f:b2
5532024-03-01T23:13:29.443Z+ COUNT=1
5542024-03-01T23:13:29.443Z+ [[ 1 -ne 1 ]]
5552024-03-01T23:13:29.443Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-03-01T23:13:29.443ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-03-01T23:13:29.443Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-03-01T23:13:29.443Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-03-01T23:13:29.468Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-03-01T23:13:29.468Z+ [[ -v PXA_START ]]
5612024-03-01T23:13:29.468Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-03-01T23:13:29.468Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-03-01T23:13:29.492Z+ z_scadm dump-state
5642024-03-01T23:13:29.492Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-03-01T23:13:29.521Zlocal v6:
5662024-03-01T23:13:29.522Zlocal v4:
5672024-03-01T23:13:29.522Zrouter v6:
5682024-03-01T23:13:29.522Zrouter v4_idx:
5692024-03-01T23:13:29.522Zrouter v4_routes:
5702024-03-01T23:13:29.522Zresolver v4:
5712024-03-01T23:13:29.522Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-03-01T23:13:29.522Zresolver v6:
5732024-03-01T23:13:29.522Znat v4:
5742024-03-01T23:13:29.522Znat_v6:
5752024-03-01T23:13:29.522Zport_mac:
5762024-03-01T23:13:29.522Zproxy arp:
5772024-03-01T23:13:29.522Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-03-01T23:13:29.522Z+ success 'softnpu zone exists'
5792024-03-01T23:13:29.522Z+ set +x
5802024-03-01T23:13:29.522Zsoftnpu zone exists
5812024-03-01T23:13:29.522Z
5822024-03-01T23:13:29.522Zreal 36.824943721
5832024-03-01T23:13:29.522Zuser 0.697290167
5842024-03-01T23:13:29.522Zsys 1.588032073
5852024-03-01T23:13:29.522Ztrap 0.000091857
5862024-03-01T23:13:29.522Ztflt 0.000169066
5872024-03-01T23:13:29.522Zdflt 0.001182122
5882024-03-01T23:13:29.523Zkflt 0.000000000
5892024-03-01T23:13:29.523Zlock 28:52.991962466
5902024-03-01T23:13:29.523Zslp 1:50.194925072
5912024-03-01T23:13:29.523Zlat 0.073284223
5922024-03-01T23:13:29.523Zstop 0.352835762
5932024-03-01T23:13:29.549Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-03-01T23:13:29.574Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-03-01T23:13:29.574Z+ SILO_NAME=recovery
5962024-03-01T23:13:29.574Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-03-01T23:13:29.574Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-03-01T23:13:29.574Z+ sed -i~ '
5992024-03-01T23:13:29.574Z /^external_dns_ips/c\
6002024-03-01T23:13:29.574Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-03-01T23:13:29.574Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-03-01T23:13:29.574Z /^first/c\
6032024-03-01T23:13:29.574Zfirst = "10.151.1.164"
6042024-03-01T23:13:29.574Z /^last/c\
6052024-03-01T23:13:29.574Zlast = "10.151.1.173"
6062024-03-01T23:13:29.574Z }
6072024-03-01T23:13:29.574Z /^\[rack_network_config/,/^$/ {
6082024-03-01T23:13:29.574Z /^infra_ip_first/c\
6092024-03-01T23:13:29.574Zinfra_ip_first = "10.151.1.174"
6102024-03-01T23:13:29.575Z /^infra_ip_last/c\
6112024-03-01T23:13:29.575Zinfra_ip_last = "10.151.1.174"
6122024-03-01T23:13:29.575Z }
6132024-03-01T23:13:29.575Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-03-01T23:13:29.575Z /^routes/c\
6152024-03-01T23:13:29.575Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-03-01T23:13:29.575Z /^addresses/c\
6172024-03-01T23:13:29.575Zaddresses = \["10.151.1.174/24"\]
6182024-03-01T23:13:29.575Z }
6192024-03-01T23:13:29.575Z' pkg/config-rss.toml
6202024-03-01T23:13:29.575Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-03-01T23:13:29.575Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-03-01T23:13:29.575Z+++ pkg/config-rss.toml Fri Mar 1 23:13:29 2024
6232024-03-01T23:13:29.575Z@@ -33,7 +33,7 @@
6242024-03-01T23:13:29.575Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-03-01T23:13:29.575Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-03-01T23:13:29.576Z # below.
6272024-03-01T23:13:29.576Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-03-01T23:13:29.576Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-03-01T23:13:29.576Z
6302024-03-01T23:13:29.576Z # Initial TLS certificates for the external API
6312024-03-01T23:13:29.576Z #
6322024-03-01T23:13:29.576Z@@ -69,8 +69,8 @@
6332024-03-01T23:13:29.576Z #
6342024-03-01T23:13:29.576Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-03-01T23:13:29.576Z [[internal_services_ip_pool_ranges]]
6362024-03-01T23:13:29.576Z-first = "192.168.1.20"
6372024-03-01T23:13:29.576Z-last = "192.168.1.29"
6382024-03-01T23:13:29.576Z+first = "10.151.1.164"
6392024-03-01T23:13:29.576Z+last = "10.151.1.173"
6402024-03-01T23:13:29.577Z
6412024-03-01T23:13:29.577Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-03-01T23:13:29.577Z # parameters should be provided to the control plane via wicket, but we need to
6432024-03-01T23:13:29.577Z@@ -100,9 +100,9 @@
6442024-03-01T23:13:29.577Z # You can configure multiple uplinks by repeating the following stanza
6452024-03-01T23:13:29.577Z [[rack_network_config.ports]]
6462024-03-01T23:13:29.577Z # Routes associated with this port.
6472024-03-01T23:13:29.577Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6482024-03-01T23:13:29.578Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6492024-03-01T23:13:29.578Z # Addresses associated with this port.
6502024-03-01T23:13:29.578Z-addresses = ["192.168.1.30/24"]
6512024-03-01T23:13:29.578Z+addresses = ["10.151.1.174/24"]
6522024-03-01T23:13:29.578Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6532024-03-01T23:13:29.578Z port = "qsfp0"
6542024-03-01T23:13:29.579Z # The speed of this port.
6552024-03-01T23:13:29.579Z+ true
6562024-03-01T23:13:29.579Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6572024-03-01T23:13:29.579Za pkg/config-rss.toml 7K
6582024-03-01T23:13:29.579Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6592024-03-01T23:13:29.579Z+ TLS_NAME=recovery.sys.oxide.test
6602024-03-01T23:13:29.580Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6612024-03-01T23:13:30.102Z.....+.............+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+...+...+.+...+...........+......+...+...............+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...............+..+...+.......+..+...+............+...........................+.+.....+....+.........+.....+.........+............+.............+...+.........+.........+............+.....+...+.+...+........+...+....+......+..+...................+...+.....+...+............+...+.........+.+...+....................+......+...+.......+...+........+............+.+..+.........+...+...+...+........................+.......+......+............+................................+.............+...........+....+...+..+.+.....+..........+.....................+..............+....+..+......+.........+.............+.....+.......+...+...+..+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6622024-03-01T23:13:30.362Z....+..+...+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+......+...+.........+.+.....+......+.+..+......+.......+.....+.......+...+..+...+...+.+...+...........+....+..+......+.........+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+....+.....+....+...+............+..+...+.+..+..........+...+............+..............+..........+.....+.........+.+.....+....+............+...+......+...+...............+..................+..+................+..+....+...........+.........+.+...+...........+......+.........+...+...+.............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6632024-03-01T23:13:30.398Z-----
6642024-03-01T23:13:30.398Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6652024-03-01T23:13:30.398Za pkg/initial-tls-cert.pem 2K
6662024-03-01T23:13:30.398Za pkg/initial-tls-key.pem 4K
6672024-03-01T23:13:30.398Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6682024-03-01T23:13:30.398Z+ rmdir pkg
6692024-03-01T23:13:30.398Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6702024-03-01T23:13:30.398Z+ pfexec mkdir -p /usr/oxide
6712024-03-01T23:13:30.432Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6722024-03-01T23:13:31.744Z+ pfexec chmod +x /usr/oxide/oxide
6732024-03-01T23:13:31.777Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6742024-03-01T23:15:05.111Z+ OMICRON_NO_UNINSTALL=1
6752024-03-01T23:15:05.111Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6762024-03-01T23:15:05.544ZLogging to: /opt/oxide/work/out/LOG
6772024-03-01T23:15:05.610Z
6782024-03-01T23:15:05.638Zreal 0.494537094
6792024-03-01T23:15:05.638Zuser 0.106832046
6802024-03-01T23:15:05.638Zsys 2.145994740
6812024-03-01T23:15:05.638Ztrap 0.000009869
6822024-03-01T23:15:05.638Ztflt 0.000692214
6832024-03-01T23:15:05.638Zdflt 0.000474240
6842024-03-01T23:15:05.638Zkflt 0.000000000
6852024-03-01T23:15:05.638Zlock 44.746027651
6862024-03-01T23:15:05.639Zslp 0.706920868
6872024-03-01T23:15:05.639Zlat 0.003115877
6882024-03-01T23:15:05.639Zstop 0.207094460
6892024-03-01T23:15:05.639Z+ retry=0
6902024-03-01T23:15:05.639Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6912024-03-01T23:15:05.639Z+ [[ 0 -gt 30 ]]
6922024-03-01T23:15:05.639Z+ sleep 1
6932024-03-01T23:15:06.632Z+ retry=1
6942024-03-01T23:15:06.632Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6952024-03-01T23:15:06.665Z+ [[ 1 -gt 30 ]]
6962024-03-01T23:15:06.665Z+ sleep 1
6972024-03-01T23:15:07.652Z+ retry=2
6982024-03-01T23:15:07.652Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6992024-03-01T23:15:07.716Z+ [[ 2 -gt 30 ]]
7002024-03-01T23:15:07.717Z+ sleep 1
7012024-03-01T23:15:08.656Z+ retry=3
7022024-03-01T23:15:08.656Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7032024-03-01T23:15:08.682Z+ [[ 3 -gt 30 ]]
7042024-03-01T23:15:08.683Z+ sleep 1
7052024-03-01T23:15:09.674Z+ retry=4
7062024-03-01T23:15:09.674Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-03-01T23:15:34.843Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7082024-03-01T23:15:34.870Zlocal v6:
7092024-03-01T23:15:34.870Zfe80::689c:56ff:fed3:4615
7102024-03-01T23:15:34.870Zfd0d:1346:d241:369f::1
7112024-03-01T23:15:34.870Zlocal v4:
7122024-03-01T23:15:34.870Z10.151.1.174
7132024-03-01T23:15:34.870Zrouter v6:
7142024-03-01T23:15:34.871Zfd00:1122:3344:101::/64 -> fe80::e0c3:31ff:fe64:259c (1)
7152024-03-01T23:15:34.871Zfd00:1122:3344:1::/64 -> fe80::e0c3:31ff:fe64:259c (1)
7162024-03-01T23:15:34.871Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::e0c3:31ff:fe64:259c (1)
7172024-03-01T23:15:34.871Zfd00:1122:3344:3::/64 -> fe80::e0c3:31ff:fe64:259c (1)
7182024-03-01T23:15:34.871Zfd00:1122:3344:2::/64 -> fe80::e0c3:31ff:fe64:259c (1)
7192024-03-01T23:15:34.871Zrouter v4_idx:
7202024-03-01T23:15:34.895Z0.0.0.0/0 -> 0
7212024-03-01T23:15:34.895Zrouter v4_routes:
7222024-03-01T23:15:34.895Z0 -> 10.151.1.100 (2)
7232024-03-01T23:15:34.895Zresolver v4:
7242024-03-01T23:15:34.895Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7252024-03-01T23:15:34.895Z10.151.1.174 -> 26:1a:8a:c1:32:c4
7262024-03-01T23:15:34.896Zresolver v6:
7272024-03-01T23:15:34.896Zfe80::e0c3:31ff:fe64:259c -> e2:c3:31:64:25:9c
7282024-03-01T23:15:34.896Zfe80::689c:56ff:fed3:4615 -> 6a:9c:56:d3:46:15
7292024-03-01T23:15:34.896Znat v4:
7302024-03-01T23:15:34.896Znat_v6:
7312024-03-01T23:15:34.896Zport_mac:
7322024-03-01T23:15:34.896Z1000: a8:40:25:7e:c4:74
7332024-03-01T23:15:34.896Z1: a8:40:25:7e:c4:75
7342024-03-01T23:15:34.896Z2: a8:40:25:7e:c4:95
7352024-03-01T23:15:34.896Zproxy arp:
7362024-03-01T23:15:34.896Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7372024-03-01T23:15:34.896Z+ retry=0
7382024-03-01T23:15:34.896Z+++ zoneadm list -n
7392024-03-01T23:15:34.896Z+++ grep oxz_ntp
7402024-03-01T23:15:34.896Z++ pfexec svcs -z -Hostate oxide/ntp
7412024-03-01T23:15:34.896Zsvcs: zone '-Hostate': entity not found
7422024-03-01T23:15:34.896Z++ true
7432024-03-01T23:15:34.896Z+ [[ '' != online ]]
7442024-03-01T23:15:34.896Z+ [[ 0 -gt 60 ]]
7452024-03-01T23:15:34.896Z+ sleep 1
7462024-03-01T23:15:35.895Z+ retry=1
7472024-03-01T23:15:35.920Z+++ zoneadm list -n
7482024-03-01T23:15:35.920Z+++ grep oxz_ntp
7492024-03-01T23:15:35.920Z++ pfexec svcs -z -Hostate oxide/ntp
7502024-03-01T23:15:35.920Zsvcs: zone '-Hostate': entity not found
7512024-03-01T23:15:35.920Z++ true
7522024-03-01T23:15:35.920Z+ [[ '' != online ]]
7532024-03-01T23:15:35.920Z+ [[ 1 -gt 60 ]]
7542024-03-01T23:15:35.920Z+ sleep 1
7552024-03-01T23:15:36.917Z+ retry=2
7562024-03-01T23:15:37.356Z+++ zoneadm list -n
7572024-03-01T23:15:37.356Z+++ grep oxz_ntp
7582024-03-01T23:15:37.357Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
7592024-03-01T23:15:37.357Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7602024-03-01T23:15:37.357Z++ true
7612024-03-01T23:15:37.357Z+ [[ '' != online ]]
7622024-03-01T23:15:37.357Z+ [[ 2 -gt 60 ]]
7632024-03-01T23:15:37.358Z+ sleep 1
7642024-03-01T23:15:37.948Z+ retry=3
7652024-03-01T23:15:37.972Z+++ zoneadm list -n
7662024-03-01T23:15:37.972Z+++ grep oxz_ntp
7672024-03-01T23:15:37.972Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
7682024-03-01T23:15:37.997Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7692024-03-01T23:15:37.997Z++ true
7702024-03-01T23:15:37.997Z+ [[ '' != online ]]
7712024-03-01T23:15:37.997Z+ [[ 3 -gt 60 ]]
7722024-03-01T23:15:37.997Z+ sleep 1
7732024-03-01T23:15:38.978Z+ retry=4
7742024-03-01T23:15:39.003Z+++ zoneadm list -n
7752024-03-01T23:15:39.003Z+++ grep oxz_ntp
7762024-03-01T23:15:39.003Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
7772024-03-01T23:15:39.003Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7782024-03-01T23:15:39.003Z++ true
7792024-03-01T23:15:39.027Z+ [[ '' != online ]]
7802024-03-01T23:15:39.028Z+ [[ 4 -gt 60 ]]
7812024-03-01T23:15:39.028Z+ sleep 1
7822024-03-01T23:15:40.007Z+ retry=5
7832024-03-01T23:15:40.034Z+++ zoneadm list -n
7842024-03-01T23:15:40.034Z+++ grep oxz_ntp
7852024-03-01T23:15:40.034Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
7862024-03-01T23:15:40.034Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7872024-03-01T23:15:40.034Z++ true
7882024-03-01T23:15:40.059Z+ [[ '' != online ]]
7892024-03-01T23:15:40.059Z+ [[ 5 -gt 60 ]]
7902024-03-01T23:15:40.059Z+ sleep 1
7912024-03-01T23:15:42.876Z+ retry=6
7922024-03-01T23:15:42.913Z+++ zoneadm list -n
7932024-03-01T23:15:42.913Z+++ grep oxz_ntp
7942024-03-01T23:15:42.913Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
7952024-03-01T23:15:42.914Z+ [[ disabled != online ]]
7962024-03-01T23:15:42.914Z+ [[ 6 -gt 60 ]]
7972024-03-01T23:15:42.914Z+ sleep 1
7982024-03-01T23:15:42.914Z+ retry=7
7992024-03-01T23:15:42.914Z+++ zoneadm list -n
8002024-03-01T23:15:42.914Z+++ grep oxz_ntp
8012024-03-01T23:15:42.914Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8022024-03-01T23:15:42.914Z+ [[ disabled != online ]]
8032024-03-01T23:15:42.914Z+ [[ 7 -gt 60 ]]
8042024-03-01T23:15:42.914Z+ sleep 1
8052024-03-01T23:15:43.081Z+ retry=8
8062024-03-01T23:15:43.107Z+++ zoneadm list -n
8072024-03-01T23:15:43.107Z+++ grep oxz_ntp
8082024-03-01T23:15:43.107Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8092024-03-01T23:15:43.107Z+ [[ disabled != online ]]
8102024-03-01T23:15:43.107Z+ [[ 8 -gt 60 ]]
8112024-03-01T23:15:43.107Z+ sleep 1
8122024-03-01T23:15:44.101Z+ retry=9
8132024-03-01T23:15:44.140Z+++ zoneadm list -n
8142024-03-01T23:15:44.140Z+++ grep oxz_ntp
8152024-03-01T23:15:44.140Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8162024-03-01T23:15:44.140Z+ [[ disabled != online ]]
8172024-03-01T23:15:44.140Z+ [[ 9 -gt 60 ]]
8182024-03-01T23:15:44.140Z+ sleep 1
8192024-03-01T23:15:45.127Z+ retry=10
8202024-03-01T23:15:45.153Z+++ zoneadm list -n
8212024-03-01T23:15:45.153Z+++ grep oxz_ntp
8222024-03-01T23:15:45.153Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8232024-03-01T23:15:45.153Z+ [[ disabled != online ]]
8242024-03-01T23:15:45.153Z+ [[ 10 -gt 60 ]]
8252024-03-01T23:15:45.153Z+ sleep 1
8262024-03-01T23:15:46.149Z+ retry=11
8272024-03-01T23:15:46.173Z+++ zoneadm list -n
8282024-03-01T23:15:46.173Z+++ grep oxz_ntp
8292024-03-01T23:15:46.173Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8302024-03-01T23:15:46.173Z+ [[ disabled != online ]]
8312024-03-01T23:15:46.173Z+ [[ 11 -gt 60 ]]
8322024-03-01T23:15:46.173Z+ sleep 1
8332024-03-01T23:15:47.171Z+ retry=12
8342024-03-01T23:15:47.197Z+++ zoneadm list -n
8352024-03-01T23:15:47.197Z+++ grep oxz_ntp
8362024-03-01T23:15:47.197Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8372024-03-01T23:15:47.198Z+ [[ disabled != online ]]
8382024-03-01T23:15:47.198Z+ [[ 12 -gt 60 ]]
8392024-03-01T23:15:47.198Z+ sleep 1
8402024-03-01T23:15:48.193Z+ retry=13
8412024-03-01T23:15:48.217Z+++ zoneadm list -n
8422024-03-01T23:15:48.217Z+++ grep oxz_ntp
8432024-03-01T23:15:48.217Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8442024-03-01T23:15:48.217Z+ [[ disabled != online ]]
8452024-03-01T23:15:48.217Z+ [[ 13 -gt 60 ]]
8462024-03-01T23:15:48.218Z+ sleep 1
8472024-03-01T23:15:49.214Z+ retry=14
8482024-03-01T23:15:49.238Z+++ zoneadm list -n
8492024-03-01T23:15:49.239Z+++ grep oxz_ntp
8502024-03-01T23:15:49.239Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8512024-03-01T23:15:49.239Z+ [[ disabled != online ]]
8522024-03-01T23:15:49.239Z+ [[ 14 -gt 60 ]]
8532024-03-01T23:15:49.239Z+ sleep 1
 
8542024-03-01T23:15:49.779Zbuskin console login: Mar 1 23:15:48 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8552024-03-01T23:15:50.245Z+ retry=15
8562024-03-01T23:15:50.273Z+++ zoneadm list -n
8572024-03-01T23:15:50.273Z+++ grep oxz_ntp
8582024-03-01T23:15:50.273Z++ pfexec svcs -z oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484 -Hostate oxide/ntp
8592024-03-01T23:15:50.273Z+ [[ online != online ]]
8602024-03-01T23:15:50.273Z+ echo 'Waited for chrony: 15s'
8612024-03-01T23:15:50.273ZWaited for chrony: 15s
8622024-03-01T23:15:50.273Z+ export RUST_BACKTRACE=1
8632024-03-01T23:15:50.273Z+ RUST_BACKTRACE=1
8642024-03-01T23:15:50.273Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8652024-03-01T23:15:50.273Z++ ./tests/bootstrap
8662024-03-01T23:15:50.298ZUsing external DNS server at 10.151.1.164:53
8672024-03-01T23:15:50.298Z2024-03-01 23:15:49.796935839 UTC: attempting to log into API
8682024-03-01T23:16:05.331Z2024-03-01 23:16:05.451293636 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8692024-03-01T23:16:06.330Z2024-03-01 23:16:06.452172823 UTC: attempting to log into API
8702024-03-01T23:16:21.361Z2024-03-01 23:16:21.484783655 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8712024-03-01T23:16:22.362Z2024-03-01 23:16:22.485759735 UTC: attempting to log into API
8722024-03-01T23:16:37.396Z2024-03-01 23:16:37.517529257 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8732024-03-01T23:16:38.395Z2024-03-01 23:16:38.518207060 UTC: attempting to log into API
8742024-03-01T23:16:53.836Z2024-03-01 23:16:53.549443429 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8752024-03-01T23:16:54.432Z2024-03-01 23:16:54.550588183 UTC: attempting to log into API
8762024-03-01T23:17:12.091Z2024-03-01 23:17:11.940354073 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8772024-03-01T23:17:13.056Z2024-03-01 23:17:12.977864658 UTC: attempting to log into API
8782024-03-01T23:17:28.697Z2024-03-01 23:17:28.631576742 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8792024-03-01T23:17:29.666Z2024-03-01 23:17:29.636498553 UTC: attempting to log into API
8802024-03-01T23:17:44.708Z2024-03-01 23:17:44.696903302 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8812024-03-01T23:17:45.722Z2024-03-01 23:17:45.698227200 UTC: attempting to log into API
 
8822024-03-01T23:17:48.599ZMar 1 23:17:47 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
8832024-03-01T23:17:48.823ZMar 1 23:17:48 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
8842024-03-01T23:17:51.966ZMar 1 23:17:51 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8852024-03-01T23:18:03.515ZMar 1 23:17:58 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8862024-03-01T23:18:03.801Z2024-03-01 23:18:00.730762043 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8872024-03-01T23:18:03.847Z2024-03-01 23:18:01.731976308 UTC: attempting to log into API
 
8882024-03-01T23:18:05.635ZMar 1 23:18:04 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
8892024-03-01T23:18:16.783Z2024-03-01 23:18:16.764926041 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8902024-03-01T23:18:17.789Z2024-03-01 23:18:17.766185657 UTC: attempting to log into API
8912024-03-01T23:18:23.588Z2024-03-01 23:18:23.573559299 UTC: login succeeded
8922024-03-01T23:18:23.623Zwaiting for nexus to come up...
8932024-03-01T23:18:23.698Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8942024-03-01T23:18:23.857Zsetting up quotas...
8952024-03-01T23:18:23.893Zensuring datasets are ready...
8962024-03-01T23:18:26.119Zlet's roll.
8972024-03-01T23:18:26.152Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8982024-03-01T23:18:26.152ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8992024-03-01T23:18:26.152ZOXIDE_TOKEN=oxide-token-eab9d3136c5bec9182395d6eec32f4d4f2793019'
9002024-03-01T23:18:26.153Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9012024-03-01T23:18:26.153Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9022024-03-01T23:18:26.153Z++ OXIDE_TOKEN=oxide-token-eab9d3136c5bec9182395d6eec32f4d4f2793019
9032024-03-01T23:18:26.153Z+ export OXIDE_HOST OXIDE_TOKEN
9042024-03-01T23:18:26.153Z+ retry=0
9052024-03-01T23:18:26.153Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9062024-03-01T23:18:26.153Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9072024-03-01T23:18:26.154Z+ [[ 0 -gt 60 ]]
9082024-03-01T23:18:26.154Z+ sleep 1
9092024-03-01T23:18:27.167Z+ retry=1
9102024-03-01T23:18:27.168Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9112024-03-01T23:18:27.199Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9122024-03-01T23:18:27.200Z+ [[ 1 -gt 60 ]]
9132024-03-01T23:18:27.200Z+ sleep 1
9142024-03-01T23:18:28.175Z+ retry=2
9152024-03-01T23:18:28.176Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9162024-03-01T23:18:28.210Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9172024-03-01T23:18:28.210Z+ [[ 2 -gt 60 ]]
9182024-03-01T23:18:28.210Z+ sleep 1
9192024-03-01T23:18:29.182Z+ retry=3
9202024-03-01T23:18:29.182Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9212024-03-01T23:18:29.207Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9222024-03-01T23:18:29.207Z+ [[ 3 -gt 60 ]]
9232024-03-01T23:18:29.207Z+ sleep 1
9242024-03-01T23:18:30.197Z+ retry=4
9252024-03-01T23:18:30.197Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9262024-03-01T23:18:30.222Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9272024-03-01T23:18:30.223Z+ [[ 4 -gt 60 ]]
9282024-03-01T23:18:30.223Z+ sleep 1
9292024-03-01T23:18:31.213Z+ retry=5
9302024-03-01T23:18:31.213Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9312024-03-01T23:18:31.239Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9322024-03-01T23:18:31.239Z+ [[ 5 -gt 60 ]]
9332024-03-01T23:18:31.239Z+ sleep 1
9342024-03-01T23:18:32.232Z+ retry=6
9352024-03-01T23:18:32.233Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9362024-03-01T23:18:32.263Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9372024-03-01T23:18:32.264Z+ [[ 6 -gt 60 ]]
9382024-03-01T23:18:32.264Z+ sleep 1
9392024-03-01T23:18:33.243Z+ retry=7
9402024-03-01T23:18:33.244Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9412024-03-01T23:18:33.269Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9422024-03-01T23:18:33.269Z+ [[ 7 -gt 60 ]]
9432024-03-01T23:18:33.269Z+ sleep 1
9442024-03-01T23:18:34.273Z+ retry=8
9452024-03-01T23:18:34.273Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9462024-03-01T23:18:34.298Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9472024-03-01T23:18:34.298Z+ [[ 8 -gt 60 ]]
9482024-03-01T23:18:34.298Z+ sleep 1
9492024-03-01T23:18:35.277Z+ retry=9
9502024-03-01T23:18:35.277Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9512024-03-01T23:18:35.302Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9522024-03-01T23:18:35.303Z+ [[ 9 -gt 60 ]]
9532024-03-01T23:18:35.303Z+ sleep 1
9542024-03-01T23:18:36.297Z+ retry=10
9552024-03-01T23:18:36.297Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9562024-03-01T23:18:36.323Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9572024-03-01T23:18:36.323Z+ [[ 10 -gt 60 ]]
9582024-03-01T23:18:36.323Z+ sleep 1
9592024-03-01T23:18:37.310Z+ retry=11
9602024-03-01T23:18:37.310Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9612024-03-01T23:18:37.337Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9622024-03-01T23:18:37.337Z+ [[ 11 -gt 60 ]]
9632024-03-01T23:18:37.337Z+ sleep 1
9642024-03-01T23:18:38.330Z+ retry=12
9652024-03-01T23:18:38.330Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9662024-03-01T23:18:38.356Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9672024-03-01T23:18:38.356Z+ [[ 12 -gt 60 ]]
9682024-03-01T23:18:38.356Z+ sleep 1
9692024-03-01T23:18:39.353Z+ retry=13
9702024-03-01T23:18:39.353Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9712024-03-01T23:18:39.389Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9722024-03-01T23:18:39.390Z+ [[ 13 -gt 60 ]]
9732024-03-01T23:18:39.390Z+ sleep 1
9742024-03-01T23:18:40.357Z+ retry=14
9752024-03-01T23:18:40.357Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9762024-03-01T23:18:40.402Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9772024-03-01T23:18:40.402Z+ [[ 14 -gt 60 ]]
9782024-03-01T23:18:40.402Z+ sleep 1
9792024-03-01T23:18:41.381Z+ retry=15
9802024-03-01T23:18:41.381Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9812024-03-01T23:18:41.415Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9822024-03-01T23:18:41.415Z+ [[ 15 -gt 60 ]]
9832024-03-01T23:18:41.415Z+ sleep 1
9842024-03-01T23:18:42.394Z+ retry=16
9852024-03-01T23:18:42.394Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9862024-03-01T23:18:42.426Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9872024-03-01T23:18:42.426Z+ [[ 16 -gt 60 ]]
9882024-03-01T23:18:42.426Z+ sleep 1
9892024-03-01T23:18:43.413Z+ retry=17
9902024-03-01T23:18:43.911Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9912024-03-01T23:18:43.911Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9922024-03-01T23:18:43.911Z+ [[ 17 -gt 60 ]]
9932024-03-01T23:18:43.911Z+ sleep 1
9942024-03-01T23:18:44.425Z+ retry=18
9952024-03-01T23:18:44.426Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9962024-03-01T23:18:44.453Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9972024-03-01T23:18:44.454Z+ [[ 18 -gt 60 ]]
9982024-03-01T23:18:44.454Z+ sleep 1
9992024-03-01T23:18:45.437Z+ retry=19
10002024-03-01T23:18:45.437Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10012024-03-01T23:18:45.462Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10022024-03-01T23:18:45.462Z+ [[ 19 -gt 60 ]]
10032024-03-01T23:18:45.462Z+ sleep 1
10042024-03-01T23:18:46.457Z+ retry=20
10052024-03-01T23:18:46.458Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10062024-03-01T23:18:46.490Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10072024-03-01T23:18:46.490Z+ [[ 20 -gt 60 ]]
10082024-03-01T23:18:46.490Z+ sleep 1
10092024-03-01T23:18:47.486Z+ retry=21
10102024-03-01T23:18:47.486Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10112024-03-01T23:18:47.521Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10122024-03-01T23:18:47.521Z+ [[ 21 -gt 60 ]]
10132024-03-01T23:18:47.521Z+ sleep 1
10142024-03-01T23:18:48.490Z+ retry=22
10152024-03-01T23:18:48.524Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10162024-03-01T23:18:48.524Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10172024-03-01T23:18:48.525Z+ [[ 22 -gt 60 ]]
10182024-03-01T23:18:48.525Z+ sleep 1
10192024-03-01T23:18:49.505Z+ retry=23
10202024-03-01T23:18:49.505Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10212024-03-01T23:18:49.534Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10222024-03-01T23:18:49.534Z+ [[ 23 -gt 60 ]]
10232024-03-01T23:18:49.534Z+ sleep 1
10242024-03-01T23:18:50.514Z+ retry=24
10252024-03-01T23:18:50.514Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10262024-03-01T23:18:50.557Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10272024-03-01T23:18:50.557Z+ [[ 24 -gt 60 ]]
10282024-03-01T23:18:50.557Z+ sleep 1
10292024-03-01T23:18:51.532Z+ retry=25
10302024-03-01T23:18:51.532Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10312024-03-01T23:18:51.565Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10322024-03-01T23:18:51.566Z+ [[ 25 -gt 60 ]]
10332024-03-01T23:18:51.566Z+ sleep 1
10342024-03-01T23:18:52.545Z+ retry=26
10352024-03-01T23:18:52.545Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10362024-03-01T23:18:52.569Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10372024-03-01T23:18:52.569Z+ [[ 26 -gt 60 ]]
10382024-03-01T23:18:52.570Z+ sleep 1
10392024-03-01T23:18:53.576Z+ retry=27
10402024-03-01T23:18:53.576Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10412024-03-01T23:18:53.617Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10422024-03-01T23:18:53.617Z+ [[ 27 -gt 60 ]]
10432024-03-01T23:18:53.617Z+ sleep 1
10442024-03-01T23:18:54.577Z+ retry=28
10452024-03-01T23:18:54.578Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10462024-03-01T23:18:54.602Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10472024-03-01T23:18:54.602Z+ [[ 28 -gt 60 ]]
10482024-03-01T23:18:54.602Z+ sleep 1
10492024-03-01T23:18:55.606Z+ retry=29
10502024-03-01T23:18:55.606Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10512024-03-01T23:18:55.638Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10522024-03-01T23:18:55.638Z+ [[ 29 -gt 60 ]]
10532024-03-01T23:18:55.639Z+ sleep 1
10542024-03-01T23:18:56.614Z+ retry=30
10552024-03-01T23:18:56.614Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10562024-03-01T23:18:57.452Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10572024-03-01T23:18:57.452Z+ [[ 30 -gt 60 ]]
10582024-03-01T23:18:57.452Z+ sleep 1
10592024-03-01T23:18:57.628Z+ retry=31
10602024-03-01T23:18:57.628Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10612024-03-01T23:18:57.660Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10622024-03-01T23:18:57.660Z+ [[ 31 -gt 60 ]]
10632024-03-01T23:18:57.660Z+ sleep 1
10642024-03-01T23:18:58.642Z+ retry=32
10652024-03-01T23:18:58.642Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10662024-03-01T23:18:58.673Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10672024-03-01T23:18:58.673Z+ [[ 32 -gt 60 ]]
10682024-03-01T23:18:58.674Z+ sleep 1
10692024-03-01T23:18:59.739Z+ retry=33
10702024-03-01T23:18:59.740Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10712024-03-01T23:18:59.775Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10722024-03-01T23:18:59.775Z+ [[ 33 -gt 60 ]]
10732024-03-01T23:18:59.775Z+ sleep 1
10742024-03-01T23:19:02.120Z+ retry=34
10752024-03-01T23:19:02.120Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10762024-03-01T23:19:02.161Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10772024-03-01T23:19:02.161Z+ [[ 34 -gt 60 ]]
10782024-03-01T23:19:02.161Z+ sleep 1
10792024-03-01T23:19:02.161Z+ retry=35
10802024-03-01T23:19:02.161Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10812024-03-01T23:19:02.161Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10822024-03-01T23:19:02.161Z+ [[ 35 -gt 60 ]]
10832024-03-01T23:19:02.161Z+ sleep 1
10842024-03-01T23:19:02.712Z+ retry=36
10852024-03-01T23:19:02.712Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10862024-03-01T23:19:02.751Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10872024-03-01T23:19:02.751Z+ [[ 36 -gt 60 ]]
10882024-03-01T23:19:02.752Z+ sleep 1
10892024-03-01T23:19:03.723Z+ retry=37
10902024-03-01T23:19:03.723Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10912024-03-01T23:19:03.748Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10922024-03-01T23:19:03.749Z+ [[ 37 -gt 60 ]]
10932024-03-01T23:19:03.749Z+ sleep 1
10942024-03-01T23:19:04.740Z+ retry=38
10952024-03-01T23:19:04.740Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10962024-03-01T23:19:04.771Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10972024-03-01T23:19:04.771Z+ [[ 38 -gt 60 ]]
10982024-03-01T23:19:04.771Z+ sleep 1
10992024-03-01T23:19:05.752Z+ retry=39
11002024-03-01T23:19:05.752Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11012024-03-01T23:19:05.779Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11022024-03-01T23:19:05.779Z+ [[ 39 -gt 60 ]]
11032024-03-01T23:19:05.779Z+ sleep 1
11042024-03-01T23:19:06.769Z+ retry=40
11052024-03-01T23:19:06.769Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11062024-03-01T23:19:07.250Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
11072024-03-01T23:19:07.275Z{"status":"ok"}success
11082024-03-01T23:19:07.275ZProject {
11092024-03-01T23:19:07.275Z description: "some images",
11102024-03-01T23:19:07.276Z id: fefa7542-6178-4fb7-ae24-63ff493c3e25,
11112024-03-01T23:19:07.276Z name: Name(
11122024-03-01T23:19:07.276Z "images",
11132024-03-01T23:19:07.276Z ),
11142024-03-01T23:19:07.276Z time_created: 2024-03-01T23:19:06.925264Z,
11152024-03-01T23:19:07.276Z time_modified: 2024-03-01T23:19:06.925264Z,
11162024-03-01T23:19:07.276Z}
11172024-03-01T23:19:07.276Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
11182024-03-01T23:24:32.392Zdone!
11192024-03-01T23:24:32.488Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
11202024-03-01T23:24:32.614Zsuccess
11212024-03-01T23:24:32.614ZImage {
11222024-03-01T23:24:32.643Z block_size: ByteCount(
11232024-03-01T23:24:32.643Z 512,
11242024-03-01T23:24:32.643Z ),
11252024-03-01T23:24:32.643Z description: "debian 11 original base image",
11262024-03-01T23:24:32.643Z digest: None,
11272024-03-01T23:24:32.643Z id: c443587c-04a9-47fd-a4a5-d34dccf4de61,
11282024-03-01T23:24:32.643Z name: Name(
11292024-03-01T23:24:32.643Z "debian11",
11302024-03-01T23:24:32.643Z ),
11312024-03-01T23:24:32.644Z os: "debian",
11322024-03-01T23:24:32.644Z project_id: None,
11332024-03-01T23:24:32.644Z size: ByteCount(
11342024-03-01T23:24:32.644Z 2147483648,
11352024-03-01T23:24:32.644Z ),
11362024-03-01T23:24:32.644Z time_created: 2024-03-01T23:24:32.339482Z,
11372024-03-01T23:24:32.644Z time_modified: 2024-03-01T23:24:32.571787Z,
11382024-03-01T23:24:32.644Z url: None,
11392024-03-01T23:24:32.644Z version: "11",
11402024-03-01T23:24:32.644Z}
11412024-03-01T23:24:32.644Z+ rm ./tests/bootstrap
11422024-03-01T23:24:32.720Z+ for test_bin in tests/*
11432024-03-01T23:24:32.721Z+ ./tests/bootstrap-ec7dc70942caaa25
11442024-03-01T23:24:32.827Z
11452024-03-01T23:24:32.827Zrunning 0 tests
11462024-03-01T23:24:32.827Z
11472024-03-01T23:24:32.861Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11482024-03-01T23:24:32.862Z
11492024-03-01T23:24:32.862Z+ for test_bin in tests/*
11502024-03-01T23:24:32.862Z+ ./tests/end_to_end_tests-06239e2b0a4ace4f
11512024-03-01T23:24:33.121Z
11522024-03-01T23:24:33.121Zrunning 2 tests
11532024-03-01T23:24:33.455Ztest no_spoof::no_spoof_here ... ok
11542024-03-01T23:25:24.479Ztest instance_launch::instance_launch ... ok
11552024-03-01T23:25:24.508Z
11562024-03-01T23:25:24.508Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 51.36s
11572024-03-01T23:25:24.508Z
11582024-03-01T23:25:24.509Z+ _exit_trap
11592024-03-01T23:25:24.543Z+ local status=0
11602024-03-01T23:25:24.572Z+ [[ 0 -eq 0 ]]
11612024-03-01T23:25:24.572Z+ exit 0
11622024-03-01T23:25:24.572Zprocess exited: duration 807683 ms, exit code 0
 
11632024-03-01T23:25:25.145Zfound 88 output files
11642024-03-01T23:25:25.145Zuploading: /var/svc/log/oxide-sled-agent:default.log (1825958 bytes)
11652024-03-01T23:25:29.321Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11662024-03-01T23:25:29.321Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (2561362 bytes)
11672024-03-01T23:25:31.044Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 2561362 -> 2585983
11682024-03-01T23:25:32.118Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11692024-03-01T23:25:32.142Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (6235 bytes)
11702024-03-01T23:25:33.228Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11712024-03-01T23:25:33.228Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (25496 bytes)
11722024-03-01T23:25:34.384Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11732024-03-01T23:25:34.384Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1611810 bytes)
11742024-03-01T23:25:35.482Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1611810 -> 1633373
11752024-03-01T23:25:36.562Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11762024-03-01T23:25:36.597Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (933597 bytes)
11772024-03-01T23:25:38.369Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 933597 -> 946753
11782024-03-01T23:25:39.061Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11792024-03-01T23:25:39.061Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1388 bytes)
11802024-03-01T23:25:40.579Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11812024-03-01T23:25:40.579Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (292980 bytes)
11822024-03-01T23:25:41.121Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 292980 -> 301561
11832024-03-01T23:25:42.196Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11842024-03-01T23:25:42.196Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (617 bytes)
11852024-03-01T23:25:43.296Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11862024-03-01T23:25:43.296Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5388 bytes)
11872024-03-01T23:25:44.402Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11882024-03-01T23:25:44.432Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_74802856-0b1c-433c-9e82-d4aedb5e0749/root/var/svc/log/oxide-clickhouse:default.log (1289761 bytes)
11892024-03-01T23:25:45.771Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_74802856-0b1c-433c-9e82-d4aedb5e0749/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1289761 -> 1353645
11902024-03-01T23:25:47.289Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_74802856-0b1c-433c-9e82-d4aedb5e0749/root/var/svc/log/oxide-clickhouse:default.log
11912024-03-01T23:25:47.324Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_74802856-0b1c-433c-9e82-d4aedb5e0749/root/var/svc/log/oxide-zone-network-setup:default.log (1714 bytes)
11922024-03-01T23:25:48.855Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_74802856-0b1c-433c-9e82-d4aedb5e0749/root/var/svc/log/oxide-zone-network-setup:default.log
11932024-03-01T23:25:48.856Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3c66b1e8-6f9c-4af5-9706-40f991312a36/root/var/svc/log/oxide-cockroachdb:default.log (4380 bytes)
11942024-03-01T23:25:50.316Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3c66b1e8-6f9c-4af5-9706-40f991312a36/root/var/svc/log/oxide-cockroachdb:default.log
11952024-03-01T23:25:50.316Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3c66b1e8-6f9c-4af5-9706-40f991312a36/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
11962024-03-01T23:25:51.450Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3c66b1e8-6f9c-4af5-9706-40f991312a36/root/var/svc/log/oxide-zone-network-setup:default.log
11972024-03-01T23:25:51.487Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3de24d1d-6129-402e-99c6-cbe1a3727280/root/var/svc/log/oxide-crucible-agent:default.log (13405 bytes)
11982024-03-01T23:25:53.112Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3de24d1d-6129-402e-99c6-cbe1a3727280/root/var/svc/log/oxide-crucible-agent:default.log
11992024-03-01T23:25:53.112Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3de24d1d-6129-402e-99c6-cbe1a3727280/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12002024-03-01T23:25:54.222Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3de24d1d-6129-402e-99c6-cbe1a3727280/root/var/svc/log/oxide-crucible-downstairs:default.log
12012024-03-01T23:25:54.222Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3de24d1d-6129-402e-99c6-cbe1a3727280/root/var/svc/log/oxide-crucible-downstairs:downstairs-f4bbe774-3df3-4979-bab5-2d451174086a.log (5610 bytes)
12022024-03-01T23:25:55.359Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3de24d1d-6129-402e-99c6-cbe1a3727280/root/var/svc/log/oxide-crucible-downstairs:downstairs-f4bbe774-3df3-4979-bab5-2d451174086a.log
12032024-03-01T23:25:55.359Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3de24d1d-6129-402e-99c6-cbe1a3727280/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
12042024-03-01T23:25:56.486Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3de24d1d-6129-402e-99c6-cbe1a3727280/root/var/svc/log/oxide-zone-network-setup:default.log
12052024-03-01T23:25:56.486Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ecba71f7-525f-4818-b686-c9ff63ca561f/root/var/svc/log/oxide-crucible-pantry:default.log (780 bytes)
12062024-03-01T23:25:57.627Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ecba71f7-525f-4818-b686-c9ff63ca561f/root/var/svc/log/oxide-crucible-pantry:default.log
12072024-03-01T23:25:57.627Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ecba71f7-525f-4818-b686-c9ff63ca561f/root/var/svc/log/oxide-zone-network-setup:default.log (1744 bytes)
12082024-03-01T23:25:58.744Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ecba71f7-525f-4818-b686-c9ff63ca561f/root/var/svc/log/oxide-zone-network-setup:default.log
12092024-03-01T23:25:58.744Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0a603215-e206-4aa0-8930-250f278a0d89/root/var/svc/log/oxide-external_dns:default.log (30639 bytes)
12102024-03-01T23:26:00.819Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0a603215-e206-4aa0-8930-250f278a0d89/root/var/svc/log/oxide-external_dns:default.log
12112024-03-01T23:26:00.820Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0a603215-e206-4aa0-8930-250f278a0d89/root/var/svc/log/oxide-opte-interface-setup:default.log (1158 bytes)
12122024-03-01T23:26:01.947Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0a603215-e206-4aa0-8930-250f278a0d89/root/var/svc/log/oxide-opte-interface-setup:default.log
12132024-03-01T23:26:01.988Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0a603215-e206-4aa0-8930-250f278a0d89/root/var/svc/log/oxide-zone-network-setup:default.log (1726 bytes)
12142024-03-01T23:26:03.090Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0a603215-e206-4aa0-8930-250f278a0d89/root/var/svc/log/oxide-zone-network-setup:default.log
12152024-03-01T23:26:03.115Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_720f4076-e581-438f-9cb1-67dafb6cb05c/root/var/svc/log/oxide-internal_dns:default.log (112817 bytes)
12162024-03-01T23:26:05.068Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_720f4076-e581-438f-9cb1-67dafb6cb05c/root/var/svc/log/oxide-internal_dns:default.log
12172024-03-01T23:26:05.068Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_7290f55a-1449-4cf7-88e8-036470e643e8/root/var/svc/log/oxide-cockroachdb:default.log (4481 bytes)
12182024-03-01T23:26:06.856Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_7290f55a-1449-4cf7-88e8-036470e643e8/root/var/svc/log/oxide-cockroachdb:default.log
12192024-03-01T23:26:06.856Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_7290f55a-1449-4cf7-88e8-036470e643e8/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
12202024-03-01T23:26:08.495Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_7290f55a-1449-4cf7-88e8-036470e643e8/root/var/svc/log/oxide-zone-network-setup:default.log
12212024-03-01T23:26:08.495Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-agent:default.log (20940 bytes)
12222024-03-01T23:26:09.658Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-agent:default.log
12232024-03-01T23:26:09.684Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12242024-03-01T23:26:10.769Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-downstairs:default.log
12252024-03-01T23:26:10.769Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-25203dea-71f8-48a0-b9dd-02b7c7e4f226.log (3020 bytes)
12262024-03-01T23:26:12.277Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-25203dea-71f8-48a0-b9dd-02b7c7e4f226.log
12272024-03-01T23:26:12.277Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-6743e1e5-2301-457a-bd56-d0b4458ec760.log (5698 bytes)
12282024-03-01T23:26:13.417Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-6743e1e5-2301-457a-bd56-d0b4458ec760.log
12292024-03-01T23:26:13.417Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-downstairs:snapshot-6743e1e5-2301-457a-bd56-d0b4458ec760-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0.log (5304 bytes)
12302024-03-01T23:26:14.908Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-crucible-downstairs:snapshot-6743e1e5-2301-457a-bd56-d0b4458ec760-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0.log
12312024-03-01T23:26:14.908Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
12322024-03-01T23:26:16.044Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f367ce2-eb70-48d4-b9f5-2554c178c7d8/root/var/svc/log/oxide-zone-network-setup:default.log
12332024-03-01T23:26:16.073Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3f949516-3930-421a-bae2-b58ff4ea0dc8/root/var/svc/log/oxide-external_dns:default.log (30649 bytes)
12342024-03-01T23:26:16.201Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3f949516-3930-421a-bae2-b58ff4ea0dc8/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 30649 -> 34428
12352024-03-01T23:26:17.286Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3f949516-3930-421a-bae2-b58ff4ea0dc8/root/var/svc/log/oxide-external_dns:default.log
12362024-03-01T23:26:17.286Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3f949516-3930-421a-bae2-b58ff4ea0dc8/root/var/svc/log/oxide-opte-interface-setup:default.log (1158 bytes)
12372024-03-01T23:26:19.269Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3f949516-3930-421a-bae2-b58ff4ea0dc8/root/var/svc/log/oxide-opte-interface-setup:default.log
12382024-03-01T23:26:19.269Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3f949516-3930-421a-bae2-b58ff4ea0dc8/root/var/svc/log/oxide-zone-network-setup:default.log (1726 bytes)
12392024-03-01T23:26:20.380Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3f949516-3930-421a-bae2-b58ff4ea0dc8/root/var/svc/log/oxide-zone-network-setup:default.log
12402024-03-01T23:26:20.412Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0fb91602-87a5-4c5e-baa6-f0c1b28cef23/root/var/svc/log/oxide-internal_dns:default.log (118910 bytes)
12412024-03-01T23:26:21.146Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0fb91602-87a5-4c5e-baa6-f0c1b28cef23/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 118910 -> 122665
12422024-03-01T23:26:21.827Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0fb91602-87a5-4c5e-baa6-f0c1b28cef23/root/var/svc/log/oxide-internal_dns:default.log
12432024-03-01T23:26:21.855Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_933c0d3a-d49d-431b-8f65-51222f67e8f3/root/var/svc/log/oxide-nexus:default.log (1282269 bytes)
12442024-03-01T23:26:24.680Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_933c0d3a-d49d-431b-8f65-51222f67e8f3/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1282269 -> 1396729
12452024-03-01T23:26:25.765Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_933c0d3a-d49d-431b-8f65-51222f67e8f3/root/var/svc/log/oxide-nexus:default.log
12462024-03-01T23:26:25.765Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a87cb16a-062c-4865-a37d-8e0d7e2bd2b9/root/var/svc/log/oxide-oximeter:default.log (349451 bytes)
12472024-03-01T23:26:26.335Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a87cb16a-062c-4865-a37d-8e0d7e2bd2b9/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 349451 -> 398017
12482024-03-01T23:26:27.436Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a87cb16a-062c-4865-a37d-8e0d7e2bd2b9/root/var/svc/log/oxide-oximeter:default.log
12492024-03-01T23:26:27.436Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a87cb16a-062c-4865-a37d-8e0d7e2bd2b9/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
12502024-03-01T23:26:28.555Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a87cb16a-062c-4865-a37d-8e0d7e2bd2b9/root/var/svc/log/oxide-zone-network-setup:default.log
12512024-03-01T23:26:28.555Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_669c55e0-1c27-4089-9470-6ce2af215227/root/var/svc/log/oxide-cockroachdb:default.log (4406 bytes)
12522024-03-01T23:26:29.657Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_669c55e0-1c27-4089-9470-6ce2af215227/root/var/svc/log/oxide-cockroachdb:default.log
12532024-03-01T23:26:29.657Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_669c55e0-1c27-4089-9470-6ce2af215227/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
12542024-03-01T23:26:30.763Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_669c55e0-1c27-4089-9470-6ce2af215227/root/var/svc/log/oxide-zone-network-setup:default.log
12552024-03-01T23:26:30.763Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-crucible-agent:default.log (17937 bytes)
12562024-03-01T23:26:31.905Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-crucible-agent:default.log
12572024-03-01T23:26:31.905Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12582024-03-01T23:26:33.046Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-crucible-downstairs:default.log
12592024-03-01T23:26:33.046Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-4191742d-78a6-4330-b3c4-72d2bb7984f4.log (3019 bytes)
12602024-03-01T23:26:34.173Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-4191742d-78a6-4330-b3c4-72d2bb7984f4.log
12612024-03-01T23:26:34.173Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-77115e99-3a1f-406f-bb6f-eaa5f35c2a84.log (3122 bytes)
12622024-03-01T23:26:35.284Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-77115e99-3a1f-406f-bb6f-eaa5f35c2a84.log
12632024-03-01T23:26:35.284Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
12642024-03-01T23:26:36.381Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cf8e7366-58a5-4520-b2ad-904e641779d8/root/var/svc/log/oxide-zone-network-setup:default.log
12652024-03-01T23:26:36.381Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_2698336d-5a4b-4958-8e5d-8a26f208fcce/root/var/svc/log/oxide-internal_dns:default.log (118195 bytes)
12662024-03-01T23:26:36.666Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_2698336d-5a4b-4958-8e5d-8a26f208fcce/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 118195 -> 121948
12672024-03-01T23:26:37.741Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_2698336d-5a4b-4958-8e5d-8a26f208fcce/root/var/svc/log/oxide-internal_dns:default.log
12682024-03-01T23:26:37.741Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_44640223-615f-49ba-b60a-a001dba9c022/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
12692024-03-01T23:26:38.835Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_44640223-615f-49ba-b60a-a001dba9c022/root/var/svc/log/oxide-cockroachdb:default.log
12702024-03-01T23:26:38.835Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_44640223-615f-49ba-b60a-a001dba9c022/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
12712024-03-01T23:26:39.930Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_44640223-615f-49ba-b60a-a001dba9c022/root/var/svc/log/oxide-zone-network-setup:default.log
12722024-03-01T23:26:39.956Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_81f36664-5b2e-47bc-8f86-8336a864a7bb/root/var/svc/log/oxide-crucible-agent:default.log (7683 bytes)
12732024-03-01T23:26:41.054Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_81f36664-5b2e-47bc-8f86-8336a864a7bb/root/var/svc/log/oxide-crucible-agent:default.log
12742024-03-01T23:26:41.054Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_81f36664-5b2e-47bc-8f86-8336a864a7bb/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12752024-03-01T23:26:42.151Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_81f36664-5b2e-47bc-8f86-8336a864a7bb/root/var/svc/log/oxide-crucible-downstairs:default.log
12762024-03-01T23:26:42.151Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_81f36664-5b2e-47bc-8f86-8336a864a7bb/root/var/svc/log/oxide-crucible-downstairs:downstairs-38151cc8-31e2-4f58-af2f-a3d71f962253.log (3018 bytes)
12772024-03-01T23:26:43.258Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_81f36664-5b2e-47bc-8f86-8336a864a7bb/root/var/svc/log/oxide-crucible-downstairs:downstairs-38151cc8-31e2-4f58-af2f-a3d71f962253.log
12782024-03-01T23:26:43.258Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_81f36664-5b2e-47bc-8f86-8336a864a7bb/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
12792024-03-01T23:26:44.374Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_81f36664-5b2e-47bc-8f86-8336a864a7bb/root/var/svc/log/oxide-zone-network-setup:default.log
12802024-03-01T23:26:44.374Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_bcf0a56e-6585-45f9-8061-123749957160/root/var/svc/log/oxide-cockroachdb:default.log (4405 bytes)
12812024-03-01T23:26:45.476Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_bcf0a56e-6585-45f9-8061-123749957160/root/var/svc/log/oxide-cockroachdb:default.log
12822024-03-01T23:26:45.476Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_bcf0a56e-6585-45f9-8061-123749957160/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
12832024-03-01T23:26:46.572Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_bcf0a56e-6585-45f9-8061-123749957160/root/var/svc/log/oxide-zone-network-setup:default.log
12842024-03-01T23:26:46.598Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-crucible-agent:default.log (15443 bytes)
12852024-03-01T23:26:47.701Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-crucible-agent:default.log
12862024-03-01T23:26:47.701Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12872024-03-01T23:26:49.214Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-crucible-downstairs:default.log
12882024-03-01T23:26:49.214Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-crucible-downstairs:downstairs-1136a670-e0c2-4677-a2a0-e27bf38aad53.log (5694 bytes)
12892024-03-01T23:26:51.785Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-crucible-downstairs:downstairs-1136a670-e0c2-4677-a2a0-e27bf38aad53.log
12902024-03-01T23:26:51.786Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-crucible-downstairs:snapshot-1136a670-e0c2-4677-a2a0-e27bf38aad53-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0.log (5305 bytes)
12912024-03-01T23:26:52.897Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-crucible-downstairs:snapshot-1136a670-e0c2-4677-a2a0-e27bf38aad53-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0.log
12922024-03-01T23:26:52.897Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
12932024-03-01T23:26:53.997Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_5bbf29d8-d45a-494e-b486-773cde91df47/root/var/svc/log/oxide-zone-network-setup:default.log
12942024-03-01T23:26:53.997Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_264d5dd4-3eb2-4adb-b639-f0a26ab5534d/root/var/svc/log/oxide-nexus:default.log (6226518 bytes)
12952024-03-01T23:27:00.843Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_264d5dd4-3eb2-4adb-b639-f0a26ab5534d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 6226518 -> 6729712
12962024-03-01T23:27:01.918Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_264d5dd4-3eb2-4adb-b639-f0a26ab5534d/root/var/svc/log/oxide-nexus:default.log
12972024-03-01T23:27:01.919Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_4ea96463-fca7-4b4a-8a70-4e88cc368897/root/var/svc/log/oxide-nexus:default.log (34719825 bytes)
12982024-03-01T23:27:17.397Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_4ea96463-fca7-4b4a-8a70-4e88cc368897/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 34719825 -> 34948770
12992024-03-01T23:27:18.473Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_4ea96463-fca7-4b4a-8a70-4e88cc368897/root/var/svc/log/oxide-nexus:default.log
13002024-03-01T23:27:18.474Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_6c91a708-fa2b-487f-8528-4d94d9438931/root/var/svc/log/oxide-crucible-agent:default.log (11575 bytes)
13012024-03-01T23:27:21.062Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_6c91a708-fa2b-487f-8528-4d94d9438931/root/var/svc/log/oxide-crucible-agent:default.log
13022024-03-01T23:27:21.062Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_6c91a708-fa2b-487f-8528-4d94d9438931/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13032024-03-01T23:27:22.194Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_6c91a708-fa2b-487f-8528-4d94d9438931/root/var/svc/log/oxide-crucible-downstairs:default.log
13042024-03-01T23:27:22.194Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_6c91a708-fa2b-487f-8528-4d94d9438931/root/var/svc/log/oxide-crucible-downstairs:downstairs-3a42a1df-cf06-4bd7-badc-99b81ebca0b4.log (3125 bytes)
13052024-03-01T23:27:23.289Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_6c91a708-fa2b-487f-8528-4d94d9438931/root/var/svc/log/oxide-crucible-downstairs:downstairs-3a42a1df-cf06-4bd7-badc-99b81ebca0b4.log
13062024-03-01T23:27:23.319Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_6c91a708-fa2b-487f-8528-4d94d9438931/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
13072024-03-01T23:27:24.409Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_6c91a708-fa2b-487f-8528-4d94d9438931/root/var/svc/log/oxide-zone-network-setup:default.log
13082024-03-01T23:27:24.409Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-agent:default.log (26158 bytes)
13092024-03-01T23:27:25.614Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-agent:default.log
13102024-03-01T23:27:25.614Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13112024-03-01T23:27:27.376Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-downstairs:default.log
13122024-03-01T23:27:27.533Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-downstairs:downstairs-7a19008c-9c9c-4036-aa51-5a4ee7396154.log (5612 bytes)
13132024-03-01T23:27:28.760Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-downstairs:downstairs-7a19008c-9c9c-4036-aa51-5a4ee7396154.log
13142024-03-01T23:27:28.800Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-downstairs:downstairs-b14d9f9b-dd00-4a5e-b35e-ca70c6463a96.log (5697 bytes)
13152024-03-01T23:27:29.903Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-downstairs:downstairs-b14d9f9b-dd00-4a5e-b35e-ca70c6463a96.log
13162024-03-01T23:27:30.559Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-downstairs:snapshot-b14d9f9b-dd00-4a5e-b35e-ca70c6463a96-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0.log (5306 bytes)
13172024-03-01T23:27:31.879Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-crucible-downstairs:snapshot-b14d9f9b-dd00-4a5e-b35e-ca70c6463a96-8e91b2a9-31e6-4d8a-8ad3-322b7a218ff0.log
13182024-03-01T23:27:31.879Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
13192024-03-01T23:27:33.221Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_85a1d6ba-7262-4d27-a9fc-1d1499e79005/root/var/svc/log/oxide-zone-network-setup:default.log
13202024-03-01T23:27:33.221Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/svc/log/oxide-ntp:default.log (1247 bytes)
13212024-03-01T23:27:34.466Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/svc/log/oxide-ntp:default.log
13222024-03-01T23:27:34.466Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-crucible-agent:default.log (23149 bytes)
13232024-03-01T23:27:35.901Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-crucible-agent:default.log
13242024-03-01T23:27:35.901Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13252024-03-01T23:27:37.670Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-crucible-downstairs:default.log
13262024-03-01T23:27:37.670Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-crucible-downstairs:downstairs-01ffcc17-a3af-4163-add0-e38d72ddde6a.log (5611 bytes)
13272024-03-01T23:27:39.148Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-crucible-downstairs:downstairs-01ffcc17-a3af-4163-add0-e38d72ddde6a.log
13282024-03-01T23:27:39.148Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-crucible-downstairs:downstairs-6508d8cb-e18d-45ef-b719-85f4e49a886f.log (3123 bytes)
13292024-03-01T23:27:52.355Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-crucible-downstairs:downstairs-6508d8cb-e18d-45ef-b719-85f4e49a886f.log
13302024-03-01T23:27:52.355Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
13312024-03-01T23:27:53.486Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_056f8fb6-5500-4b9e-92d0-2be6e076a7d3/root/var/svc/log/oxide-zone-network-setup:default.log
13322024-03-01T23:27:53.487Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_282e3323-14c4-4d62-8807-8693fcbf40ea/root/var/svc/log/oxide-crucible-pantry:default.log (1225807 bytes)
13332024-03-01T23:27:54.932Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_282e3323-14c4-4d62-8807-8693fcbf40ea/root/var/svc/log/oxide-crucible-pantry:default.log
13342024-03-01T23:27:54.932Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_282e3323-14c4-4d62-8807-8693fcbf40ea/root/var/svc/log/oxide-zone-network-setup:default.log (1745 bytes)
13352024-03-01T23:27:56.069Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_282e3323-14c4-4d62-8807-8693fcbf40ea/root/var/svc/log/oxide-zone-network-setup:default.log
13362024-03-01T23:27:56.070Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_925e71e3-e0b8-4973-8ff8-5438a755ef84/root/var/svc/log/oxide-crucible-pantry:default.log (781 bytes)
13372024-03-01T23:27:57.215Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_925e71e3-e0b8-4973-8ff8-5438a755ef84/root/var/svc/log/oxide-crucible-pantry:default.log
13382024-03-01T23:27:57.737Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_925e71e3-e0b8-4973-8ff8-5438a755ef84/root/var/svc/log/oxide-zone-network-setup:default.log (1745 bytes)
13392024-03-01T23:27:58.349Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_925e71e3-e0b8-4973-8ff8-5438a755ef84/root/var/svc/log/oxide-zone-network-setup:default.log
13402024-03-01T23:27:58.349Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5fb374a2-2d09-404e-b2d8-6f14e3884eab/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
13412024-03-01T23:27:59.450Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5fb374a2-2d09-404e-b2d8-6f14e3884eab/root/var/svc/log/oxide-crucible-agent:default.log
13422024-03-01T23:27:59.450Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5fb374a2-2d09-404e-b2d8-6f14e3884eab/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13432024-03-01T23:28:00.546Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5fb374a2-2d09-404e-b2d8-6f14e3884eab/root/var/svc/log/oxide-crucible-downstairs:default.log
13442024-03-01T23:28:00.546Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5fb374a2-2d09-404e-b2d8-6f14e3884eab/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
13452024-03-01T23:28:01.646Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5fb374a2-2d09-404e-b2d8-6f14e3884eab/root/var/svc/log/oxide-zone-network-setup:default.log
13462024-03-01T23:28:01.646Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/measurements.log (20687 bytes)
13472024-03-01T23:28:01.739Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/measurements.log" changed size mid upload: 20687 -> 26304
13482024-03-01T23:28:02.825Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/measurements.log
13492024-03-01T23:28:02.825Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/statistics.log (13806 bytes)
13502024-03-01T23:28:02.915Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/statistics.log" changed size mid upload: 13806 -> 18252
13512024-03-01T23:28:03.989Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/statistics.log
13522024-03-01T23:28:03.990Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/tracking.log (2250 bytes)
13532024-03-01T23:28:04.036Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/tracking.log" changed size mid upload: 2250 -> 2646
13542024-03-01T23:28:05.110Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_1c292cfd-336a-4f75-8eb1-9f4fab725484/root/var/log/chrony/tracking.log