01HQ4GA6TAQB44BNSR1QHR2B1K: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HQ4GB3PKR8ENREDS3HGAP9SF

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-21T00:59:42.986Zjob dependencies complete; ready to run (waiting for 43 m 1 s)
22024-02-21T01:00:31.574Zjob assigned to worker 01HQ4JT3B155QGSYPS8061QJ9A (queued for 48 s)
32024-02-21T01:00:31.778Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-02-21T01:00:31.839Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-02-21T01:00:31.876Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-02-21T01:00:31.914Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-02-21T01:00:31.950Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-02-21T01:00:31.991ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-02-21T01:00:32.446Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-02-21T01:00:32.489ZOxide Helios Version helios-2.0.22451 64-bit
112024-02-21T01:00:32.530ZConfiguring devices.
122024-02-21T01:00:32.572Z##################################################
132024-02-21T01:00:32.618Z#### ############# ##
142024-02-21T01:00:32.658Z### ### ############ ##
152024-02-21T01:00:32.697Z## ### # ## ### ## Oxide Computer Company ##
162024-02-21T01:00:32.745Z## ## ## ### # ### ##
172024-02-21T01:00:32.778Z## # ### #### #### This Station Under ##
182024-02-21T01:00:32.811Z### ### #### # ### Computer Control ##
192024-02-21T01:00:32.849Z#### #### ### ## ##
202024-02-21T01:00:32.898Z##################################################
212024-02-21T01:00:32.942ZHostname: buskin
222024-02-21T01:00:32.985ZLoading smf(7) service descriptions:
232024-02-21T01:00:34.170Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-cf824cb4b739d2ec.gz
242024-02-21T01:00:38.220Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-cf824cb4b739d2ec.gz
252024-02-21T01:00:38.221Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-02-21T01:01:16.328Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-02-21T01:01:16.328Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a83ae36ae0f33128.gz
282024-02-21T01:01:50.310Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a83ae36ae0f33128.gz
292024-02-21T01:01:50.310Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-02-21T01:01:53.131Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-02-21T01:01:53.131Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-02-21T01:01:58.076Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-02-21T01:01:58.102Zdownloading input: /input/package/work/version.txt
342024-02-21T01:01:58.102Zdownloaded input: /input/package/work/version.txt
352024-02-21T01:01:58.102Zdownloading input: /input/package/work/package.tar.gz
362024-02-21T01:02:31.722Zdownloaded input: /input/package/work/package.tar.gz
372024-02-21T01:02:31.722Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-02-21T01:03:31.932Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-02-21T01:03:31.932Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-02-21T01:03:45.400Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-02-21T01:03:45.438Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-02-21T01:04:47.501Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-02-21T01:04:47.501Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-02-21T01:05:48.197Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-02-21T01:05:48.273Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-02-21T01:06:26.034Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-02-21T01:06:26.034Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
482024-02-21T01:06:34.479Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
492024-02-21T01:06:34.516Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
502024-02-21T01:06:46.730Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
512024-02-21T01:06:46.730Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-02-21T01:06:54.959Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-02-21T01:06:55.009Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-02-21T01:07:01.397Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-02-21T01:07:01.423Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-02-21T01:07:01.467Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-02-21T01:07:01.467Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-02-21T01:07:10.663Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-02-21T01:07:10.696Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-02-21T01:07:17.683Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-02-21T01:07:17.683Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-02-21T01:07:44.276Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-02-21T01:07:44.723Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-02-21T01:08:12.728Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-02-21T01:08:12.728Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-02-21T01:08:12.773Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-02-21T01:08:12.773Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-02-21T01:08:36.872Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-02-21T01:08:36.872Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-02-21T01:08:56.801Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-02-21T01:08:56.832Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-02-21T01:10:43.708Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-02-21T01:10:43.709Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-02-21T01:11:44.617Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-02-21T01:11:44.617Zstarting task 0: "setup"
762024-02-21T01:11:44.642Z++ uname -s
772024-02-21T01:11:44.642Z+ kern=SunOS
782024-02-21T01:11:44.642Z+ case "$kern" in
792024-02-21T01:11:44.642Z+ groupadd -g 12345 build
802024-02-21T01:11:44.642Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-02-21T01:11:46.640Z+ zfs create -o mountpoint=/work rpool/work
822024-02-21T01:11:46.666Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-02-21T01:11:46.667Z+ home_fs=zfs
842024-02-21T01:11:46.667Z+ [[ zfs == autofs ]]
852024-02-21T01:11:46.667Z+ mkdir -p /home/build
862024-02-21T01:11:46.667Z+ chown build:build /home/build /work
872024-02-21T01:11:53.549Z+ chmod 0700 /home/build /work
882024-02-21T01:11:53.687Zprocess exited: duration 4045 ms, exit code 0
 
892024-02-21T01:11:53.749Zstarting task 1: "authentication"
902024-02-21T01:11:53.873Zprocess exited: duration 68 ms, exit code 0
 
912024-02-21T01:11:53.979Zstarting task 2: "build"
922024-02-21T01:11:54.019Z+ trap _exit_trap EXIT
932024-02-21T01:11:54.019Z+ set +x
942024-02-21T01:12:32.455Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-02-21T01:12:32.700Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-02-21T01:12:32.700Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-02-21T01:12:32.700Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-02-21T01:12:32.700Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-02-21T01:12:32.700Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-02-21T01:12:32.700Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-02-21T01:12:32.726Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-02-21T01:12:32.726Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-02-21T01:12:32.726Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-02-21T01:12:32.726Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-02-21T01:12:32.726Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-02-21T01:12:32.726Z+ [[ -d /opt/oxide ]]
1072024-02-21T01:12:32.727Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-02-21T01:12:32.727Z+ pfexec mkdir /opt/oxide
1092024-02-21T01:12:32.727Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-02-21T01:12:32.727Z+ [[ -d /opt/oxide-underneath ]]
1112024-02-21T01:12:32.727Z+ cd /opt/oxide-underneath
1122024-02-21T01:12:32.727Z+ pfexec tar ceEp@/f - .
1132024-02-21T01:12:32.727Z+ cd /opt/oxide
1142024-02-21T01:12:32.727Z+ pfexec tar xveEp@/f -
1152024-02-21T01:12:32.760Zx ., 0 bytes, 0 tape blocks
1162024-02-21T01:12:32.760Zx ./opte, 0 bytes, 0 tape blocks
1172024-02-21T01:12:32.760Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-02-21T01:12:32.760Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-02-21T01:12:32.787Z+ pfexec rm -rf /opt/oxide-underneath
1202024-02-21T01:12:32.787Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-02-21T01:12:32.813Z+ pfexec mkdir /opt/oxide/work
1222024-02-21T01:12:32.813Z+ pfexec chown build:build /opt/oxide/work
1232024-02-21T01:12:32.813Z+ cd /opt/oxide/work
1242024-02-21T01:12:32.813Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-02-21T01:12:34.516ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-02-21T01:12:34.516Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1272024-02-21T01:12:34.516Zx out/omicron-sled-agent.tar, 123017216 bytes, 240268 tape blocks
1282024-02-21T01:12:34.516Zx out/oxlog.tar, 8557568 bytes, 16714 tape blocks
1292024-02-21T01:12:34.516Zx out/target/test, 75 bytes, 1 tape blocks
1302024-02-21T01:12:34.516Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-02-21T01:12:34.516Zx package-manifest.toml, 24242 bytes, 48 tape blocks
1322024-02-21T01:12:34.516Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-02-21T01:12:34.516Zx target/release/omicron-package, 45889560 bytes, 89629 tape blocks
1342024-02-21T01:12:34.516Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-02-21T01:12:34.516Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-02-21T01:12:34.516Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-02-21T01:12:34.517Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-02-21T01:12:34.517Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-02-21T01:12:34.517Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-02-21T01:12:34.517Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-02-21T01:12:34.543Z
1422024-02-21T01:12:34.543Zreal 1.714651676
1432024-02-21T01:12:34.543Zuser 1.542791606
1442024-02-21T01:12:34.544Zsys 0.304642790
1452024-02-21T01:12:34.544Ztrap 0.000071842
1462024-02-21T01:12:34.544Ztflt 0.000000000
1472024-02-21T01:12:34.544Zdflt 0.000000000
1482024-02-21T01:12:34.544Zkflt 0.000000000
1492024-02-21T01:12:34.544Zlock 0.000000000
1502024-02-21T01:12:34.544Zslp 1.542260283
1512024-02-21T01:12:34.544Zlat 0.037620981
1522024-02-21T01:12:34.544Zstop 0.000120573
1532024-02-21T01:12:34.544Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-02-21T01:12:35.767Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-02-21T01:12:35.797Z+ mkdir tests
1562024-02-21T01:12:35.797Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-02-21T01:12:35.797Z+ ptime -m gunzip
1582024-02-21T01:12:35.797Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-cf824cb4b739d2ec
1592024-02-21T01:12:36.021Z
1602024-02-21T01:12:36.048Zreal 0.231044679
1612024-02-21T01:12:36.048Zuser 0.215583612
1622024-02-21T01:12:36.048Zsys 0.015185067
1632024-02-21T01:12:36.048Ztrap 0.000025081
1642024-02-21T01:12:36.048Ztflt 0.000000000
1652024-02-21T01:12:36.048Zdflt 0.000000000
1662024-02-21T01:12:36.048Zkflt 0.000000000
1672024-02-21T01:12:36.048Zlock 0.000000000
1682024-02-21T01:12:36.048Zslp 0.000022580
1692024-02-21T01:12:36.048Zlat 0.000032351
1702024-02-21T01:12:36.048Zstop 0.000131043
1712024-02-21T01:12:36.048Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-cf824cb4b739d2ec
1722024-02-21T01:12:36.048Z+ chmod a+x tests/bootstrap-cf824cb4b739d2ec
1732024-02-21T01:12:36.049Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-02-21T01:12:36.049Z+ ptime -m gunzip
1752024-02-21T01:12:36.049Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-02-21T01:12:38.565Z
1772024-02-21T01:12:38.594Zreal 2.533068932
1782024-02-21T01:12:38.594Zuser 2.354268646
1792024-02-21T01:12:38.594Zsys 0.178323774
1802024-02-21T01:12:38.594Ztrap 0.000236167
1812024-02-21T01:12:38.595Ztflt 0.000000000
1822024-02-21T01:12:38.595Zdflt 0.000000000
1832024-02-21T01:12:38.595Zkflt 0.000000000
1842024-02-21T01:12:38.595Zlock 0.000000000
1852024-02-21T01:12:38.595Zslp 0.000024810
1862024-02-21T01:12:38.595Zlat 0.000022800
1872024-02-21T01:12:38.595Zstop 0.000127913
1882024-02-21T01:12:38.595Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-02-21T01:12:38.595Z+ chmod a+x tests/bootstrap
1902024-02-21T01:12:38.595Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-02-21T01:12:38.595Z+ ptime -m gunzip
1922024-02-21T01:12:38.595Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a83ae36ae0f33128
1932024-02-21T01:12:41.152Z
1942024-02-21T01:12:41.179Zreal 2.574240486
1952024-02-21T01:12:41.179Zuser 2.419258344
1962024-02-21T01:12:41.179Zsys 0.154559230
1972024-02-21T01:12:41.179Ztrap 0.000190635
1982024-02-21T01:12:41.179Ztflt 0.000000000
1992024-02-21T01:12:41.179Zdflt 0.000000000
2002024-02-21T01:12:41.179Zkflt 0.000000000
2012024-02-21T01:12:41.179Zlock 0.000000000
2022024-02-21T01:12:41.179Zslp 0.000021610
2032024-02-21T01:12:41.179Zlat 0.000021311
2042024-02-21T01:12:41.179Zstop 0.000131283
2052024-02-21T01:12:41.179Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a83ae36ae0f33128
2062024-02-21T01:12:41.179Z+ chmod a+x tests/end_to_end_tests-a83ae36ae0f33128
2072024-02-21T01:12:41.179Z+ bmat address ls
2082024-02-21T01:12:41.180ZNAME CIDR FIRST LAST COUNT
2092024-02-21T01:12:41.180Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-02-21T01:12:41.180Z++ bmat address ls -f extra -Ho first,last,count
2112024-02-21T01:12:41.180Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-02-21T01:12:41.180Z+ EXTRA_IP_START=10.151.1.164
2132024-02-21T01:12:41.180Z+ EXTRA_IP_END=10.151.1.227
2142024-02-21T01:12:41.180Z+ EXTRA_IP_COUNT=64
2152024-02-21T01:12:41.180Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-02-21T01:12:41.209Z+ EXTRA_IP_BASE=10.151.1
2172024-02-21T01:12:41.209Z+ EXTRA_IP_FOCTET=164
2182024-02-21T01:12:41.209Z+ EXTRA_IP_LOCTET=227
2192024-02-21T01:12:41.209Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-02-21T01:12:41.209Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-02-21T01:12:41.209Z+ DNS_IP1=10.151.1.164
2222024-02-21T01:12:41.209Z+ DNS_IP2=10.151.1.165
2232024-02-21T01:12:41.209Z+ UPLINK_IP=10.151.1.174
2242024-02-21T01:12:41.210Z+ IPPOOL_START=10.151.1.175
2252024-02-21T01:12:41.210Z+ IPPOOL_END=10.151.1.227
2262024-02-21T01:12:41.210Z++ ipadm show-addr -po type,addr
2272024-02-21T01:12:41.210Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-02-21T01:12:41.210Z+ GATEWAY_IP=10.151.1.100
2292024-02-21T01:12:41.210Z+ [[ -n 10.151.1.100 ]]
2302024-02-21T01:12:41.210Z+ ping -s 10.151.1.100 56 1
2312024-02-21T01:12:41.210ZPING 10.151.1.100: 56 data bytes
2322024-02-21T01:12:41.210Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.012 ms
2332024-02-21T01:12:41.210Z
2342024-02-21T01:12:41.210Z----10.151.1.100 PING Statistics----
2352024-02-21T01:12:41.210Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-02-21T01:12:41.210Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
2372024-02-21T01:12:41.210Z++ arp -an
2382024-02-21T01:12:41.210Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-02-21T01:12:41.210Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-02-21T01:12:41.210Z+ routeadm -e ipv4-forwarding -u
2412024-02-21T01:12:41.322Z+ PXA_START=10.151.1.164
2422024-02-21T01:12:41.322Z+ PXA_END=10.151.1.227
2432024-02-21T01:12:41.348Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-02-21T01:12:41.348Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-02-21T01:12:41.519Z+ ZPOOL_VDEV_DIR=/scratch
2462024-02-21T01:12:41.519Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-02-21T01:12:41.545Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-02-21T01:12:41.545Z++ cd ./tools
2492024-02-21T01:12:41.545Z++ pwd
2502024-02-21T01:12:41.545Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-02-21T01:12:41.546Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-02-21T01:12:41.546Z+ SOFTNPU_MODE=zone
2532024-02-21T01:12:41.546Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-02-21T01:12:41.546Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-02-21T01:12:41.546Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-02-21T01:12:41.546Z++ dladm show-phys -p -o LINK
2572024-02-21T01:12:41.546Z++ head -1
2582024-02-21T01:12:41.546Z+ PHYSICAL_LINK=igb0
2592024-02-21T01:12:41.546Z+ echo 'Using igb0 as physical link'
2602024-02-21T01:12:41.546ZUsing igb0 as physical link
2612024-02-21T01:12:41.546Z+ ensure_run_as_root
2622024-02-21T01:12:41.573Z++ id -u
2632024-02-21T01:12:41.573Z+ [[ 0 -ne 0 ]]
2642024-02-21T01:12:41.573Z+ ensure_zpools
2652024-02-21T01:12:41.573Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-02-21T01:12:41.574Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-02-21T01:12:41.574Z+ readarray -t ZPOOLS
2682024-02-21T01:12:41.574Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-02-21T01:12:41.574Z++ sed 's/[ ",]//g'
2702024-02-21T01:12:41.574Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-02-21T01:12:41.574Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-02-21T01:12:41.574ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-02-21T01:12:41.574Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-02-21T01:12:41.574Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-02-21T01:12:41.574Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-02-21T01:12:41.574Z0+0 records in
2772024-02-21T01:12:41.574Z0+0 records out
2782024-02-21T01:12:41.574Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2792024-02-21T01:12:41.574Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-02-21T01:12:41.574Z+ set +x
2812024-02-21T01:12:41.575ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-02-21T01:12:41.575Z++ zpool list -o name
2832024-02-21T01:12:41.575Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-02-21T01:12:41.575Z+ [[ -z '' ]]
2852024-02-21T01:12:41.575Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-21T01:12:41.601Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-02-21T01:12:41.601Z+ set +x
2882024-02-21T01:12:41.601ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-02-21T01:12:41.601Z+ for ZPOOL in "${ZPOOLS[@]}"
2902024-02-21T01:12:41.601Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2912024-02-21T01:12:41.601ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2922024-02-21T01:12:41.601Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2932024-02-21T01:12:41.601Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2942024-02-21T01:12:41.601Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-02-21T01:12:41.627Z0+0 records in
2962024-02-21T01:12:41.627Z0+0 records out
2972024-02-21T01:12:41.627Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2982024-02-21T01:12:41.627Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-02-21T01:12:41.627Z+ set +x
3002024-02-21T01:12:41.627ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-02-21T01:12:41.627Z++ zpool list -o name
3022024-02-21T01:12:41.627Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-02-21T01:12:41.627Z+ [[ -z '' ]]
3042024-02-21T01:12:41.627Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-21T01:12:41.652Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-02-21T01:12:41.652Z+ set +x
3072024-02-21T01:12:41.653ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-02-21T01:12:41.653Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-02-21T01:12:41.653Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-02-21T01:12:41.653ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-02-21T01:12:41.653Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-02-21T01:12:41.653Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-02-21T01:12:41.653Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-02-21T01:12:41.653Z0+0 records in
3152024-02-21T01:12:41.653Z0+0 records out
3162024-02-21T01:12:41.653Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3172024-02-21T01:12:41.653Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-02-21T01:12:41.653Z+ set +x
3192024-02-21T01:12:41.653ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-02-21T01:12:41.653Z++ zpool list -o name
3212024-02-21T01:12:41.653Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-02-21T01:12:41.678Z+ [[ -z '' ]]
3232024-02-21T01:12:41.678Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-02-21T01:12:41.704Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-02-21T01:12:41.704Z+ set +x
3262024-02-21T01:12:41.704ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-02-21T01:12:41.704Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-02-21T01:12:41.704Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-02-21T01:12:41.704ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3302024-02-21T01:12:41.704Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3312024-02-21T01:12:41.704Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-02-21T01:12:41.704Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-02-21T01:12:41.704Z0+0 records in
3342024-02-21T01:12:41.704Z0+0 records out
3352024-02-21T01:12:41.704Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3362024-02-21T01:12:41.704Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-02-21T01:12:41.704Z+ set +x
3382024-02-21T01:12:41.704ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-02-21T01:12:41.704Z++ zpool list -o name
3402024-02-21T01:12:41.704Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-02-21T01:12:41.704Z+ [[ -z '' ]]
3422024-02-21T01:12:41.704Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-21T01:12:41.738Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-02-21T01:12:41.738Z+ set +x
3452024-02-21T01:12:41.738ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-02-21T01:12:41.738Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-02-21T01:12:41.738ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3482024-02-21T01:12:41.738Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3492024-02-21T01:12:41.738Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-02-21T01:12:41.738Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-02-21T01:12:41.738Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-02-21T01:12:41.738Z0+0 records in
3532024-02-21T01:12:41.738Z0+0 records out
3542024-02-21T01:12:41.738Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3552024-02-21T01:12:41.738Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-02-21T01:12:41.738Z+ set +x
3572024-02-21T01:12:41.738ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-02-21T01:12:41.768Z++ zpool list -o name
3592024-02-21T01:12:41.768Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-02-21T01:12:41.768Z+ [[ -z '' ]]
3612024-02-21T01:12:41.768Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-21T01:12:41.796Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-02-21T01:12:41.796Z+ set +x
3642024-02-21T01:12:41.796ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-02-21T01:12:41.796Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-02-21T01:12:41.796Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-02-21T01:12:41.796ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-02-21T01:12:41.796Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-02-21T01:12:41.796Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-02-21T01:12:41.796Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-02-21T01:12:41.796Z0+0 records in
3722024-02-21T01:12:41.796Z0+0 records out
3732024-02-21T01:12:41.796Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3742024-02-21T01:12:41.796Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-02-21T01:12:41.797Z+ set +x
3762024-02-21T01:12:41.797ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-02-21T01:12:41.797Z++ zpool list -o name
3782024-02-21T01:12:41.797Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-02-21T01:12:41.797Z+ [[ -z '' ]]
3802024-02-21T01:12:41.797Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-21T01:12:41.827Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-02-21T01:12:41.827Z+ set +x
3832024-02-21T01:12:41.827ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-02-21T01:12:41.828Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-02-21T01:12:41.828Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3862024-02-21T01:12:41.828ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3872024-02-21T01:12:41.828Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-02-21T01:12:41.828Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-02-21T01:12:41.828Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-02-21T01:12:41.828Z0+0 records in
3912024-02-21T01:12:41.828Z0+0 records out
3922024-02-21T01:12:41.828Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3932024-02-21T01:12:41.828Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-02-21T01:12:41.828Z+ set +x
3952024-02-21T01:12:41.828ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-02-21T01:12:41.828Z++ zpool list -o name
3972024-02-21T01:12:41.828Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-02-21T01:12:41.828Z+ [[ -z '' ]]
3992024-02-21T01:12:41.828Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-21T01:12:41.862Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-02-21T01:12:41.862Z+ set +x
4022024-02-21T01:12:41.862ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-02-21T01:12:41.862Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-02-21T01:12:41.862Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4052024-02-21T01:12:41.862ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4062024-02-21T01:12:41.862Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-02-21T01:12:41.862Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-02-21T01:12:41.862Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-02-21T01:12:41.892Z0+0 records in
4102024-02-21T01:12:41.892Z0+0 records out
4112024-02-21T01:12:41.893Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4122024-02-21T01:12:41.893Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-02-21T01:12:41.893Z+ set +x
4142024-02-21T01:12:41.893ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-02-21T01:12:41.893Z++ zpool list -o name
4162024-02-21T01:12:41.893Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-02-21T01:12:41.893Z+ [[ -z '' ]]
4182024-02-21T01:12:41.893Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-21T01:12:41.920Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-02-21T01:12:41.920Z+ set +x
4212024-02-21T01:12:41.920ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-02-21T01:12:41.921Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-02-21T01:12:41.921Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-02-21T01:12:41.921ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4252024-02-21T01:12:41.921Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4262024-02-21T01:12:41.921Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-02-21T01:12:41.921Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-02-21T01:12:41.921Z0+0 records in
4292024-02-21T01:12:41.921Z0+0 records out
4302024-02-21T01:12:41.921Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4312024-02-21T01:12:41.922Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-02-21T01:12:41.922Z+ set +x
4332024-02-21T01:12:41.922ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-02-21T01:12:41.922Z++ zpool list -o name
4352024-02-21T01:12:41.922Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-02-21T01:12:41.922Z+ [[ -z '' ]]
4372024-02-21T01:12:41.922Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-21T01:12:41.960Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-02-21T01:12:41.960Z+ set +x
4402024-02-21T01:12:41.961ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-02-21T01:12:41.961Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-02-21T01:12:41.961Z+ readarray -t ZPOOLS
4432024-02-21T01:12:41.961Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-02-21T01:12:41.961Z++ sed 's/[ ",]//g'
4452024-02-21T01:12:41.962Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-02-21T01:12:41.962Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-02-21T01:12:41.962ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-02-21T01:12:41.962Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-02-21T01:12:41.962Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-02-21T01:12:41.962Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-02-21T01:12:42.005Z0+0 records in
4522024-02-21T01:12:42.005Z0+0 records out
4532024-02-21T01:12:42.005Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4542024-02-21T01:12:42.005Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-02-21T01:12:42.005Z+ set +x
4562024-02-21T01:12:42.007ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-02-21T01:12:42.007Z++ zpool list -o name
4582024-02-21T01:12:42.007Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-02-21T01:12:42.007Z+ [[ -z '' ]]
4602024-02-21T01:12:42.007Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-21T01:12:42.041Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-02-21T01:12:42.041Z+ set +x
4632024-02-21T01:12:42.041ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4642024-02-21T01:12:42.041Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-02-21T01:12:42.041Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4662024-02-21T01:12:42.041ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4672024-02-21T01:12:42.041Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4682024-02-21T01:12:42.042Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4692024-02-21T01:12:42.042Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-02-21T01:12:42.042Z0+0 records in
4712024-02-21T01:12:42.042Z0+0 records out
4722024-02-21T01:12:42.042Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-02-21T01:12:42.042Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-02-21T01:12:42.042Z+ set +x
4752024-02-21T01:12:42.042ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-02-21T01:12:42.042Z++ zpool list -o name
4772024-02-21T01:12:42.042Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-02-21T01:12:42.042Z+ [[ -z '' ]]
4792024-02-21T01:12:42.042Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-21T01:12:42.073Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-02-21T01:12:42.073Z+ set +x
4822024-02-21T01:12:42.073ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-02-21T01:12:42.073Z+ [[ zone == \z\o\n\e ]]
4842024-02-21T01:12:42.073Z+ ensure_simulated_links igb0
4852024-02-21T01:12:42.073Z+ local PHYSICAL_LINK=igb0
4862024-02-21T01:12:42.074Z+ INDICES=("0" "1")
4872024-02-21T01:12:42.074Z+ for I in "${INDICES[@]}"
4882024-02-21T01:12:42.074Z++ get_simnet_name_if_exists net0
4892024-02-21T01:12:42.074Z++ dladm show-simnet -p -o LINK net0
4902024-02-21T01:12:42.074Z++ echo ''
4912024-02-21T01:12:42.074Z+ [[ -z '' ]]
4922024-02-21T01:12:42.074Z+ dladm create-simnet -t net0
4932024-02-21T01:12:42.074Z+ dladm create-simnet -t sc0_0
4942024-02-21T01:12:42.074Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-02-21T01:12:42.074Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-02-21T01:12:42.074Z+ success 'Simnet net0/sc0_0 exists'
4972024-02-21T01:12:42.074Z+ set +x
4982024-02-21T01:12:42.074ZSimnet net0/sc0_0 exists
4992024-02-21T01:12:42.075Z+ for I in "${INDICES[@]}"
5002024-02-21T01:12:42.075Z++ get_simnet_name_if_exists net1
5012024-02-21T01:12:42.075Z++ dladm show-simnet -p -o LINK net1
5022024-02-21T01:12:42.075Z++ echo ''
5032024-02-21T01:12:42.075Z+ [[ -z '' ]]
5042024-02-21T01:12:42.075Z+ dladm create-simnet -t net1
5052024-02-21T01:12:42.112Z+ dladm create-simnet -t sc1_0
5062024-02-21T01:12:42.113Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-02-21T01:12:42.113Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-02-21T01:12:42.113Z+ success 'Simnet net1/sc1_0 exists'
5092024-02-21T01:12:42.113Z+ set +x
5102024-02-21T01:12:42.113ZSimnet net1/sc1_0 exists
5112024-02-21T01:12:42.113Z++ get_vnic_name_if_exists sc0_1
5122024-02-21T01:12:42.113Z++ dladm show-vnic -p -o LINK sc0_1
5132024-02-21T01:12:42.113Z++ echo ''
5142024-02-21T01:12:42.113Z+ [[ -z '' ]]
5152024-02-21T01:12:42.114Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-02-21T01:12:42.114Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-02-21T01:12:42.114Z+ success 'Vnic sc0_1 exists'
5182024-02-21T01:12:42.114Z+ set +x
5192024-02-21T01:12:42.114ZVnic sc0_1 exists
5202024-02-21T01:12:42.114Z+ warn_if_no_proxy_arp
5212024-02-21T01:12:42.114Z+ [[ -v PXA_START ]]
5222024-02-21T01:12:42.114Z+ [[ -v PXA_END ]]
5232024-02-21T01:12:42.114Z+ ensure_softnpu_zone
5242024-02-21T01:12:42.114Z+ zoneadm list
5252024-02-21T01:12:42.114Z+ grep -q sidecar_softnpu
5262024-02-21T01:12:42.114Z+ [[ -f out/npuzone/npuzone ]]
5272024-02-21T01:12:42.115Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-02-21T01:12:42.142Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-02-21T01:12:54.129Zdownloading softnpu ...done
5302024-02-21T01:12:54.155Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-02-21T01:13:01.083Zdownloading asic_program.so ...done
5322024-02-21T01:13:01.083Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-02-21T01:13:08.155Zdownloading scadm ...done
5342024-02-21T01:13:08.181Zcreating port tfportrear0_0 for sc0_0
5352024-02-21T01:13:08.181Zcreating port tfportqsfp0_0 for sc0_1
5362024-02-21T01:13:08.181Zsoftnpu zone setup
5372024-02-21T01:13:08.182Zconfigure zone
5382024-02-21T01:13:08.208Zinstall zone
5392024-02-21T01:13:09.250Zboot zone
5402024-02-21T01:13:12.344Z[sidecar_softnpu] svcs milestone/network
5412024-02-21T01:13:12.384ZSTATE STIME FMRI
5422024-02-21T01:13:12.384Zonline 1:13:10 svc:/milestone/network:default
5432024-02-21T01:13:12.384Z[sidecar_softnpu] /softnpu/npu start
5442024-02-21T01:13:12.414Z
5452024-02-21T01:13:12.414Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-02-21T01:13:12.414Z+ GATEWAY_IP=10.151.1.100
5472024-02-21T01:13:12.414Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-02-21T01:13:12.414ZUsing 10.151.1.100 as gateway ip
5492024-02-21T01:13:12.414Z+ [[ ! -v GATEWAY_MAC ]]
5502024-02-21T01:13:12.414Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-02-21T01:13:12.414Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-02-21T01:13:12.414Z+++ echo 18:c0:4d:0d:9f:b2
5532024-02-21T01:13:12.441Z+ COUNT=1
5542024-02-21T01:13:12.441Z+ [[ 1 -ne 1 ]]
5552024-02-21T01:13:12.441Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-02-21T01:13:12.442ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-02-21T01:13:12.442Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-02-21T01:13:12.442Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-02-21T01:13:12.442Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-02-21T01:13:12.442Z+ [[ -v PXA_START ]]
5612024-02-21T01:13:12.442Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-02-21T01:13:12.442Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-02-21T01:13:12.468Z+ z_scadm dump-state
5642024-02-21T01:13:12.468Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-02-21T01:13:12.494Zlocal v6:
5662024-02-21T01:13:12.494Zlocal v4:
5672024-02-21T01:13:12.494Zrouter v6:
5682024-02-21T01:13:12.494Zrouter v4_idx:
5692024-02-21T01:13:12.494Zrouter v4_routes:
5702024-02-21T01:13:12.495Zresolver v4:
5712024-02-21T01:13:12.495Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-02-21T01:13:12.495Zresolver v6:
5732024-02-21T01:13:12.495Znat v4:
5742024-02-21T01:13:12.495Znat_v6:
5752024-02-21T01:13:12.495Zport_mac:
5762024-02-21T01:13:12.495Zproxy arp:
5772024-02-21T01:13:12.495Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-02-21T01:13:12.522Z+ success 'softnpu zone exists'
5792024-02-21T01:13:12.522Z+ set +x
5802024-02-21T01:13:12.522Zsoftnpu zone exists
5812024-02-21T01:13:12.522Z
5822024-02-21T01:13:12.522Zreal 30.975954023
5832024-02-21T01:13:12.522Zuser 0.707848842
5842024-02-21T01:13:12.523Zsys 1.578411359
5852024-02-21T01:13:12.523Ztrap 0.000078556
5862024-02-21T01:13:12.523Ztflt 0.000190990
5872024-02-21T01:13:12.523Zdflt 0.001038485
5882024-02-21T01:13:12.523Zkflt 0.000000000
5892024-02-21T01:13:12.523Zlock 24:11.100490418
5902024-02-21T01:13:12.523Zslp 1:32.590292715
5912024-02-21T01:13:12.523Zlat 0.088118286
5922024-02-21T01:13:12.523Zstop 0.336780358
5932024-02-21T01:13:12.523Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-02-21T01:13:12.553Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-02-21T01:13:12.553Z+ SILO_NAME=recovery
5962024-02-21T01:13:12.553Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-02-21T01:13:12.553Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-02-21T01:13:12.554Z+ sed -i~ '
5992024-02-21T01:13:12.554Z /^external_dns_ips/c\
6002024-02-21T01:13:12.554Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-02-21T01:13:12.554Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-02-21T01:13:12.554Z /^first/c\
6032024-02-21T01:13:12.554Zfirst = "10.151.1.164"
6042024-02-21T01:13:12.554Z /^last/c\
6052024-02-21T01:13:12.554Zlast = "10.151.1.173"
6062024-02-21T01:13:12.555Z }
6072024-02-21T01:13:12.555Z /^\[rack_network_config/,/^$/ {
6082024-02-21T01:13:12.555Z /^infra_ip_first/c\
6092024-02-21T01:13:12.555Zinfra_ip_first = "10.151.1.174"
6102024-02-21T01:13:12.555Z /^infra_ip_last/c\
6112024-02-21T01:13:12.555Zinfra_ip_last = "10.151.1.174"
6122024-02-21T01:13:12.555Z }
6132024-02-21T01:13:12.555Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-02-21T01:13:12.555Z /^routes/c\
6152024-02-21T01:13:12.555Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-02-21T01:13:12.555Z /^addresses/c\
6172024-02-21T01:13:12.556Zaddresses = \["10.151.1.174/24"\]
6182024-02-21T01:13:12.556Z }
6192024-02-21T01:13:12.556Z' pkg/config-rss.toml
6202024-02-21T01:13:12.556Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-02-21T01:13:12.556Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-02-21T01:13:12.556Z+++ pkg/config-rss.toml Wed Feb 21 01:13:12 2024
6232024-02-21T01:13:12.556Z@@ -33,7 +33,7 @@
6242024-02-21T01:13:12.556Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-02-21T01:13:12.556Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-02-21T01:13:12.556Z # below.
6272024-02-21T01:13:12.556Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-02-21T01:13:12.556Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-02-21T01:13:12.556Z
6302024-02-21T01:13:12.556Z # Initial TLS certificates for the external API
6312024-02-21T01:13:12.557Z #
6322024-02-21T01:13:12.557Z@@ -69,8 +69,8 @@
6332024-02-21T01:13:12.557Z #
6342024-02-21T01:13:12.557Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-02-21T01:13:12.557Z [[internal_services_ip_pool_ranges]]
6362024-02-21T01:13:12.557Z-first = "192.168.1.20"
6372024-02-21T01:13:12.557Z-last = "192.168.1.29"
6382024-02-21T01:13:12.557Z+first = "10.151.1.164"
6392024-02-21T01:13:12.557Z+last = "10.151.1.173"
6402024-02-21T01:13:12.557Z
6412024-02-21T01:13:12.557Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-02-21T01:13:12.557Z # parameters should be provided to the control plane via wicket, but we need to
6432024-02-21T01:13:12.557Z@@ -100,9 +100,9 @@
6442024-02-21T01:13:12.557Z # You can configure multiple uplinks by repeating the following stanza
6452024-02-21T01:13:12.557Z [[rack_network_config.ports]]
6462024-02-21T01:13:12.557Z # Routes associated with this port.
6472024-02-21T01:13:12.558Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6482024-02-21T01:13:12.558Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6492024-02-21T01:13:12.558Z # Addresses associated with this port.
6502024-02-21T01:13:12.558Z-addresses = ["192.168.1.30/24"]
6512024-02-21T01:13:12.558Z+addresses = ["10.151.1.174/24"]
6522024-02-21T01:13:12.558Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6532024-02-21T01:13:12.558Z port = "qsfp0"
6542024-02-21T01:13:12.558Z # The speed of this port.
6552024-02-21T01:13:12.558Z+ true
6562024-02-21T01:13:12.558Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6572024-02-21T01:13:12.558Za pkg/config-rss.toml 7K
6582024-02-21T01:13:12.585Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6592024-02-21T01:13:12.585Z+ TLS_NAME=recovery.sys.oxide.test
6602024-02-21T01:13:12.585Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6612024-02-21T01:13:12.827Z.......+.+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+......+.....+.+......+..+............+...+...+...+.+...+........+...+....+.................+......+...+....+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+...+...+....................+....+.........+..+.............+..+...+.........+......+.........+.......+...+............+..........................+....+..............+.......+..+.+.....+....+............+.........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6622024-02-21T01:13:13.082Z..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+..+.............+...............+.....+.......+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.+.................+....+...............+...+..+.........+......+......+.......+........+.........+.............+...............+.....+............................+...+.....+.+......+.....+..........+........+....+......+...........+......+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6632024-02-21T01:13:13.109Z-----
6642024-02-21T01:13:13.109Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6652024-02-21T01:13:13.109Za pkg/initial-tls-cert.pem 2K
6662024-02-21T01:13:13.109Za pkg/initial-tls-key.pem 4K
6672024-02-21T01:13:13.110Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6682024-02-21T01:13:13.110Z+ rmdir pkg
6692024-02-21T01:13:13.156Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6702024-02-21T01:13:13.157Z+ pfexec mkdir -p /usr/oxide
6712024-02-21T01:13:13.157Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6722024-02-21T01:13:13.869Z+ pfexec chmod +x /usr/oxide/oxide
6732024-02-21T01:13:13.896Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6742024-02-21T01:13:32.173Z+ OMICRON_NO_UNINSTALL=1
6752024-02-21T01:13:32.173Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6762024-02-21T01:13:32.215ZLogging to: /opt/oxide/work/out/LOG
6772024-02-21T01:13:32.660Z
6782024-02-21T01:13:32.690Zreal 0.497175169
6792024-02-21T01:13:32.690Zuser 0.110337853
6802024-02-21T01:13:32.690Zsys 2.059415524
6812024-02-21T01:13:32.690Ztrap 0.000008488
6822024-02-21T01:13:32.690Ztflt 0.000026570
6832024-02-21T01:13:32.690Zdflt 0.000424272
6842024-02-21T01:13:32.690Zkflt 0.000000000
6852024-02-21T01:13:32.690Zlock 45.041392699
6862024-02-21T01:13:32.690Zslp 0.712583540
6872024-02-21T01:13:32.690Zlat 0.002958481
6882024-02-21T01:13:32.690Zstop 0.224941207
6892024-02-21T01:13:32.690Z+ retry=0
6902024-02-21T01:13:32.690Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6912024-02-21T01:13:32.690Z+ [[ 0 -gt 30 ]]
6922024-02-21T01:13:32.690Z+ sleep 1
6932024-02-21T01:13:33.673Z+ retry=1
6942024-02-21T01:13:33.674Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6952024-02-21T01:13:33.709Z+ [[ 1 -gt 30 ]]
6962024-02-21T01:13:33.709Z+ sleep 1
6972024-02-21T01:13:34.689Z+ retry=2
6982024-02-21T01:13:34.689Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6992024-02-21T01:13:34.721Z+ [[ 2 -gt 30 ]]
7002024-02-21T01:13:34.721Z+ sleep 1
7012024-02-21T01:13:35.703Z+ retry=3
7022024-02-21T01:13:35.704Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7032024-02-21T01:13:35.730Z+ [[ 3 -gt 30 ]]
7042024-02-21T01:13:35.730Z+ sleep 1
7052024-02-21T01:13:36.718Z+ retry=4
7062024-02-21T01:13:36.718Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-02-21T01:14:02.295Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7082024-02-21T01:14:02.344Zlocal v6:
7092024-02-21T01:14:02.344Zfe80::b04d:2bff:fe31:78db
7102024-02-21T01:14:02.345Zfdb7:b6cb:a134:6527::1
7112024-02-21T01:14:02.345Zlocal v4:
7122024-02-21T01:14:02.345Z10.151.1.174
7132024-02-21T01:14:02.345Zrouter v6:
7142024-02-21T01:14:02.345Zfd00:1122:3344:2::/64 -> fe80::bcff:f5ff:fe56:62a3 (1)
7152024-02-21T01:14:02.345Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::bcff:f5ff:fe56:62a3 (1)
7162024-02-21T01:14:02.345Zfd00:1122:3344:101::/64 -> fe80::bcff:f5ff:fe56:62a3 (1)
7172024-02-21T01:14:02.345Zfd00:1122:3344:1::/64 -> fe80::bcff:f5ff:fe56:62a3 (1)
7182024-02-21T01:14:02.345Zfd00:1122:3344:3::/64 -> fe80::bcff:f5ff:fe56:62a3 (1)
7192024-02-21T01:14:02.345Zrouter v4_idx:
7202024-02-21T01:14:02.345Z0.0.0.0/0 -> 0
7212024-02-21T01:14:02.345Zrouter v4_routes:
7222024-02-21T01:14:02.345Z0 -> 10.151.1.100 (2)
7232024-02-21T01:14:02.345Zresolver v4:
7242024-02-21T01:14:02.345Z10.151.1.174 -> ea:81:1a:76:c6:9d
7252024-02-21T01:14:02.345Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7262024-02-21T01:14:02.345Zresolver v6:
7272024-02-21T01:14:02.345Zfe80::b04d:2bff:fe31:78db -> b2:4d:2b:31:78:db
7282024-02-21T01:14:02.345Zfe80::bcff:f5ff:fe56:62a3 -> be:ff:f5:56:62:a3
7292024-02-21T01:14:02.345Znat v4:
7302024-02-21T01:14:02.345Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:d5:1f
7312024-02-21T01:14:02.345Znat_v6:
7322024-02-21T01:14:02.345Zport_mac:
7332024-02-21T01:14:02.345Z1000: a8:40:25:5b:e7:71
7342024-02-21T01:14:02.346Z1: a8:40:25:5b:e7:72
7352024-02-21T01:14:02.346Z2: a8:40:25:5b:e7:92
7362024-02-21T01:14:02.346Zproxy arp:
7372024-02-21T01:14:02.346Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7382024-02-21T01:14:02.346Z+ retry=0
7392024-02-21T01:14:02.346Z+++ zoneadm list -n
7402024-02-21T01:14:02.346Z+++ grep oxz_ntp
7412024-02-21T01:14:02.346Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
7422024-02-21T01:14:02.346Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7432024-02-21T01:14:02.346Z++ true
7442024-02-21T01:14:02.346Z+ [[ '' != online ]]
7452024-02-21T01:14:02.346Z+ [[ 0 -gt 60 ]]
7462024-02-21T01:14:02.346Z+ sleep 1
7472024-02-21T01:14:02.954Z+ retry=1
7482024-02-21T01:14:02.983Z+++ zoneadm list -n
7492024-02-21T01:14:02.983Z+++ grep oxz_ntp
7502024-02-21T01:14:02.983Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
7512024-02-21T01:14:02.983Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7522024-02-21T01:14:02.983Z++ true
7532024-02-21T01:14:02.984Z+ [[ '' != online ]]
7542024-02-21T01:14:02.984Z+ [[ 1 -gt 60 ]]
7552024-02-21T01:14:02.984Z+ sleep 1
7562024-02-21T01:14:03.992Z+ retry=2
7572024-02-21T01:14:04.020Z+++ zoneadm list -n
7582024-02-21T01:14:04.020Z+++ grep oxz_ntp
7592024-02-21T01:14:04.020Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
7602024-02-21T01:14:04.020Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7612024-02-21T01:14:04.020Z++ true
7622024-02-21T01:14:04.020Z+ [[ '' != online ]]
7632024-02-21T01:14:04.020Z+ [[ 2 -gt 60 ]]
7642024-02-21T01:14:04.020Z+ sleep 1
7652024-02-21T01:14:05.017Z+ retry=3
7662024-02-21T01:14:05.046Z+++ zoneadm list -n
7672024-02-21T01:14:05.047Z+++ grep oxz_ntp
7682024-02-21T01:14:05.047Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
7692024-02-21T01:14:05.047Z+ [[ disabled != online ]]
7702024-02-21T01:14:05.047Z+ [[ 3 -gt 60 ]]
7712024-02-21T01:14:05.047Z+ sleep 1
7722024-02-21T01:14:06.033Z+ retry=4
7732024-02-21T01:14:06.059Z+++ zoneadm list -n
7742024-02-21T01:14:06.059Z+++ grep oxz_ntp
7752024-02-21T01:14:06.059Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
7762024-02-21T01:14:06.059Z+ [[ disabled != online ]]
7772024-02-21T01:14:06.059Z+ [[ 4 -gt 60 ]]
7782024-02-21T01:14:06.060Z+ sleep 1
7792024-02-21T01:14:07.054Z+ retry=5
7802024-02-21T01:14:07.498Z+++ zoneadm list -n
7812024-02-21T01:14:07.499Z+++ grep oxz_ntp
7822024-02-21T01:14:07.499Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
7832024-02-21T01:14:07.499Z+ [[ disabled != online ]]
7842024-02-21T01:14:07.499Z+ [[ 5 -gt 60 ]]
7852024-02-21T01:14:07.499Z+ sleep 1
7862024-02-21T01:14:08.075Z+ retry=6
7872024-02-21T01:14:08.102Z+++ zoneadm list -n
7882024-02-21T01:14:08.102Z+++ grep oxz_ntp
7892024-02-21T01:14:08.102Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
7902024-02-21T01:14:08.102Z+ [[ disabled != online ]]
7912024-02-21T01:14:08.102Z+ [[ 6 -gt 60 ]]
7922024-02-21T01:14:08.102Z+ sleep 1
7932024-02-21T01:14:09.121Z+ retry=7
7942024-02-21T01:14:09.121Z+++ zoneadm list -n
7952024-02-21T01:14:09.122Z+++ grep oxz_ntp
7962024-02-21T01:14:09.122Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
7972024-02-21T01:14:09.149Z+ [[ disabled != online ]]
7982024-02-21T01:14:09.150Z+ [[ 7 -gt 60 ]]
7992024-02-21T01:14:09.150Z+ sleep 1
8002024-02-21T01:14:10.123Z+ retry=8
8012024-02-21T01:14:10.160Z+++ zoneadm list -n
8022024-02-21T01:14:10.161Z+++ grep oxz_ntp
8032024-02-21T01:14:10.161Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
8042024-02-21T01:14:10.161Z+ [[ disabled != online ]]
8052024-02-21T01:14:10.161Z+ [[ 8 -gt 60 ]]
8062024-02-21T01:14:10.161Z+ sleep 1
8072024-02-21T01:14:11.141Z+ retry=9
8082024-02-21T01:14:11.167Z+++ zoneadm list -n
8092024-02-21T01:14:11.167Z+++ grep oxz_ntp
8102024-02-21T01:14:11.167Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
8112024-02-21T01:14:11.167Z+ [[ disabled != online ]]
8122024-02-21T01:14:11.167Z+ [[ 9 -gt 60 ]]
8132024-02-21T01:14:11.167Z+ sleep 1
 
8142024-02-21T01:14:11.767Zbuskin console login: Feb 21 01:14:11 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8152024-02-21T01:14:12.164Z+ retry=10
8162024-02-21T01:14:12.190Z+++ zoneadm list -n
8172024-02-21T01:14:12.190Z+++ grep oxz_ntp
8182024-02-21T01:14:12.190Z++ pfexec svcs -z oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056 -Hostate oxide/ntp
8192024-02-21T01:14:12.191Z+ [[ online != online ]]
8202024-02-21T01:14:12.191Z+ echo 'Waited for chrony: 10s'
8212024-02-21T01:14:12.191ZWaited for chrony: 10s
8222024-02-21T01:14:12.191Z+ export RUST_BACKTRACE=1
8232024-02-21T01:14:12.191Z+ RUST_BACKTRACE=1
8242024-02-21T01:14:12.191Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8252024-02-21T01:14:12.191Z++ ./tests/bootstrap
8262024-02-21T01:14:12.218ZUsing external DNS server at 10.151.1.164:53
8272024-02-21T01:14:12.218Z2024-02-21 01:14:12.045386580 UTC: attempting to log into API
8282024-02-21T01:14:27.431Z2024-02-21 01:14:27.203156861 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8292024-02-21T01:14:28.255Z2024-02-21 01:14:28.207573289 UTC: attempting to log into API
8302024-02-21T01:14:43.289Z2024-02-21 01:14:43.273952490 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8312024-02-21T01:14:44.287Z2024-02-21 01:14:44.274692398 UTC: attempting to log into API
8322024-02-21T01:14:59.319Z2024-02-21 01:14:59.305602694 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8332024-02-21T01:15:00.316Z2024-02-21 01:15:00.306717993 UTC: attempting to log into API
8342024-02-21T01:15:15.370Z2024-02-21 01:15:15.338307978 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8352024-02-21T01:15:16.349Z2024-02-21 01:15:16.339021944 UTC: attempting to log into API
8362024-02-21T01:15:31.381Z2024-02-21 01:15:31.370488683 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8372024-02-21T01:15:32.395Z2024-02-21 01:15:32.371540893 UTC: attempting to log into API
8382024-02-21T01:15:47.419Z2024-02-21 01:15:47.401877325 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8392024-02-21T01:15:48.420Z2024-02-21 01:15:48.402781131 UTC: attempting to log into API
8402024-02-21T01:16:03.447Z2024-02-21 01:16:03.433616143 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8412024-02-21T01:16:04.448Z2024-02-21 01:16:04.434693091 UTC: attempting to log into API
8422024-02-21T01:16:19.491Z2024-02-21 01:16:19.471987166 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8432024-02-21T01:16:20.490Z2024-02-21 01:16:20.473701434 UTC: attempting to log into API
8442024-02-21T01:16:35.541Z2024-02-21 01:16:35.521547092 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8452024-02-21T01:16:36.541Z2024-02-21 01:16:36.522668531 UTC: attempting to log into API
8462024-02-21T01:16:51.580Z2024-02-21 01:16:51.555417956 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8472024-02-21T01:16:52.571Z2024-02-21 01:16:52.556542885 UTC: attempting to log into API
 
8482024-02-21T01:17:04.163ZFeb 21 01:17:03 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
 
8492024-02-21T01:17:07.713Z2024-02-21 01:17:07.698451287 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8502024-02-21T01:17:08.714Z2024-02-21 01:17:08.699601467 UTC: attempting to log into API
 
8512024-02-21T01:17:10.996ZFeb 21 01:17:10 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
8522024-02-21T01:17:18.574ZFeb 21 01:17:17 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
8532024-02-21T01:17:23.749Z2024-02-21 01:17:23.732984970 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8542024-02-21T01:17:24.755Z2024-02-21 01:17:24.734063847 UTC: attempting to log into API
 
8552024-02-21T01:17:26.156ZFeb 21 01:17:25 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
8562024-02-21T01:17:32.300ZFeb 21 01:17:31 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8572024-02-21T01:17:39.782Z2024-02-21 01:17:39.765697857 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8582024-02-21T01:17:40.781Z2024-02-21 01:17:40.766772044 UTC: attempting to log into API
8592024-02-21T01:17:40.827Z2024-02-21 01:17:40.808821133 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: dns error: no record found for Query { name: Name("recovery.sys.oxide.test."), query_type: AAAA, query_class: IN }
8602024-02-21T01:17:41.826Z2024-02-21 01:17:41.812780348 UTC: attempting to log into API
8612024-02-21T01:17:42.807Z2024-02-21 01:17:42.792784794 UTC: login succeeded
8622024-02-21T01:17:42.843Zwaiting for nexus to come up...
8632024-02-21T01:17:42.945Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8642024-02-21T01:17:43.172Zsetting up quotas...
8652024-02-21T01:17:43.233Zensuring datasets are ready...
8662024-02-21T01:17:46.736Zlet's roll.
8672024-02-21T01:17:47.176Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8682024-02-21T01:17:47.176ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8692024-02-21T01:17:47.176ZOXIDE_TOKEN=oxide-token-fdb073d0bdfe0203dbbc10a4784f0bc4cff39a30'
8702024-02-21T01:17:47.209Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8712024-02-21T01:17:47.209Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8722024-02-21T01:17:47.209Z++ OXIDE_TOKEN=oxide-token-fdb073d0bdfe0203dbbc10a4784f0bc4cff39a30
8732024-02-21T01:17:47.209Z+ export OXIDE_HOST OXIDE_TOKEN
8742024-02-21T01:17:47.209Z+ retry=0
8752024-02-21T01:17:47.209Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8762024-02-21T01:17:47.209Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8772024-02-21T01:17:47.209Z+ [[ 0 -gt 60 ]]
8782024-02-21T01:17:47.209Z+ sleep 1
8792024-02-21T01:17:47.792Z+ retry=1
8802024-02-21T01:17:47.792Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8812024-02-21T01:17:47.819Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8822024-02-21T01:17:47.819Z+ [[ 1 -gt 60 ]]
8832024-02-21T01:17:47.819Z+ sleep 1
8842024-02-21T01:17:48.809Z+ retry=2
8852024-02-21T01:17:48.809Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8862024-02-21T01:17:48.836Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8872024-02-21T01:17:48.836Z+ [[ 2 -gt 60 ]]
8882024-02-21T01:17:48.836Z+ sleep 1
8892024-02-21T01:17:49.821Z+ retry=3
8902024-02-21T01:17:49.821Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8912024-02-21T01:17:49.848Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8922024-02-21T01:17:49.848Z+ [[ 3 -gt 60 ]]
8932024-02-21T01:17:49.848Z+ sleep 1
8942024-02-21T01:17:50.840Z+ retry=4
8952024-02-21T01:17:50.841Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8962024-02-21T01:17:50.869Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8972024-02-21T01:17:50.869Z+ [[ 4 -gt 60 ]]
8982024-02-21T01:17:50.869Z+ sleep 1
8992024-02-21T01:17:51.853Z+ retry=5
9002024-02-21T01:17:51.853Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9012024-02-21T01:17:51.880Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9022024-02-21T01:17:51.880Z+ [[ 5 -gt 60 ]]
9032024-02-21T01:17:51.880Z+ sleep 1
9042024-02-21T01:17:52.871Z+ retry=6
9052024-02-21T01:17:52.871Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9062024-02-21T01:17:52.904Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9072024-02-21T01:17:52.904Z+ [[ 6 -gt 60 ]]
9082024-02-21T01:17:52.904Z+ sleep 1
9092024-02-21T01:17:53.885Z+ retry=7
9102024-02-21T01:17:53.885Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9112024-02-21T01:17:53.914Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9122024-02-21T01:17:53.914Z+ [[ 7 -gt 60 ]]
9132024-02-21T01:17:53.914Z+ sleep 1
9142024-02-21T01:17:54.901Z+ retry=8
9152024-02-21T01:17:54.901Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9162024-02-21T01:17:54.927Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9172024-02-21T01:17:54.927Z+ [[ 8 -gt 60 ]]
9182024-02-21T01:17:54.927Z+ sleep 1
9192024-02-21T01:17:55.917Z+ retry=9
9202024-02-21T01:17:55.917Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9212024-02-21T01:17:55.942Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9222024-02-21T01:17:55.942Z+ [[ 9 -gt 60 ]]
9232024-02-21T01:17:55.942Z+ sleep 1
9242024-02-21T01:17:56.932Z+ retry=10
9252024-02-21T01:17:56.932Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9262024-02-21T01:17:56.959Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9272024-02-21T01:17:56.959Z+ [[ 10 -gt 60 ]]
9282024-02-21T01:17:56.959Z+ sleep 1
9292024-02-21T01:17:57.954Z+ retry=11
9302024-02-21T01:17:57.954Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9312024-02-21T01:17:57.984Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9322024-02-21T01:17:57.984Z+ [[ 11 -gt 60 ]]
9332024-02-21T01:17:57.984Z+ sleep 1
9342024-02-21T01:17:58.965Z+ retry=12
9352024-02-21T01:17:58.965Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9362024-02-21T01:17:58.992Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9372024-02-21T01:17:58.992Z+ [[ 12 -gt 60 ]]
9382024-02-21T01:17:58.992Z+ sleep 1
9392024-02-21T01:17:59.982Z+ retry=13
9402024-02-21T01:17:59.982Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9412024-02-21T01:18:00.014Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9422024-02-21T01:18:00.014Z+ [[ 13 -gt 60 ]]
9432024-02-21T01:18:00.014Z+ sleep 1
9442024-02-21T01:18:00.999Z+ retry=14
9452024-02-21T01:18:00.999Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9462024-02-21T01:18:01.034Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9472024-02-21T01:18:01.034Z+ [[ 14 -gt 60 ]]
9482024-02-21T01:18:01.035Z+ sleep 1
9492024-02-21T01:18:02.015Z+ retry=15
9502024-02-21T01:18:02.015Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9512024-02-21T01:18:02.044Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9522024-02-21T01:18:02.044Z+ [[ 15 -gt 60 ]]
9532024-02-21T01:18:02.044Z+ sleep 1
9542024-02-21T01:18:03.032Z+ retry=16
9552024-02-21T01:18:03.032Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9562024-02-21T01:18:03.057Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9572024-02-21T01:18:03.058Z+ [[ 16 -gt 60 ]]
9582024-02-21T01:18:03.058Z+ sleep 1
9592024-02-21T01:18:04.047Z+ retry=17
9602024-02-21T01:18:04.047Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9612024-02-21T01:18:04.076Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9622024-02-21T01:18:04.076Z+ [[ 17 -gt 60 ]]
9632024-02-21T01:18:04.076Z+ sleep 1
9642024-02-21T01:18:05.063Z+ retry=18
9652024-02-21T01:18:05.063Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9662024-02-21T01:18:05.092Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9672024-02-21T01:18:05.092Z+ [[ 18 -gt 60 ]]
9682024-02-21T01:18:05.092Z+ sleep 1
9692024-02-21T01:18:06.080Z+ retry=19
9702024-02-21T01:18:06.080Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9712024-02-21T01:18:06.106Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9722024-02-21T01:18:06.106Z+ [[ 19 -gt 60 ]]
9732024-02-21T01:18:06.106Z+ sleep 1
9742024-02-21T01:18:07.101Z+ retry=20
9752024-02-21T01:18:07.102Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9762024-02-21T01:18:07.541Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9772024-02-21T01:18:07.541Z+ [[ 20 -gt 60 ]]
9782024-02-21T01:18:07.541Z+ sleep 1
9792024-02-21T01:18:08.111Z+ retry=21
9802024-02-21T01:18:08.111Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9812024-02-21T01:18:08.136Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9822024-02-21T01:18:08.136Z+ [[ 21 -gt 60 ]]
9832024-02-21T01:18:08.136Z+ sleep 1
9842024-02-21T01:18:09.154Z+ retry=22
9852024-02-21T01:18:09.154Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9862024-02-21T01:18:09.154Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9872024-02-21T01:18:09.154Z+ [[ 22 -gt 60 ]]
9882024-02-21T01:18:09.154Z+ sleep 1
9892024-02-21T01:18:10.144Z+ retry=23
9902024-02-21T01:18:10.144Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9912024-02-21T01:18:10.170Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9922024-02-21T01:18:10.170Z+ [[ 23 -gt 60 ]]
9932024-02-21T01:18:10.170Z+ sleep 1
9942024-02-21T01:18:11.162Z+ retry=24
9952024-02-21T01:18:11.162Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9962024-02-21T01:18:11.202Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9972024-02-21T01:18:11.202Z+ [[ 24 -gt 60 ]]
9982024-02-21T01:18:11.202Z+ sleep 1
9992024-02-21T01:18:12.182Z+ retry=25
10002024-02-21T01:18:12.182Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10012024-02-21T01:18:12.208Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10022024-02-21T01:18:12.208Z+ [[ 25 -gt 60 ]]
10032024-02-21T01:18:12.208Z+ sleep 1
10042024-02-21T01:18:13.192Z+ retry=26
10052024-02-21T01:18:13.192Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10062024-02-21T01:18:13.217Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10072024-02-21T01:18:13.217Z+ [[ 26 -gt 60 ]]
10082024-02-21T01:18:13.218Z+ sleep 1
10092024-02-21T01:18:14.212Z+ retry=27
10102024-02-21T01:18:14.212Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10112024-02-21T01:18:14.240Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10122024-02-21T01:18:14.240Z+ [[ 27 -gt 60 ]]
10132024-02-21T01:18:14.240Z+ sleep 1
10142024-02-21T01:18:15.223Z+ retry=28
10152024-02-21T01:18:15.223Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10162024-02-21T01:18:15.249Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10172024-02-21T01:18:15.249Z+ [[ 28 -gt 60 ]]
10182024-02-21T01:18:15.249Z+ sleep 1
10192024-02-21T01:18:16.239Z+ retry=29
10202024-02-21T01:18:16.239Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10212024-02-21T01:18:16.264Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10222024-02-21T01:18:16.264Z+ [[ 29 -gt 60 ]]
10232024-02-21T01:18:16.264Z+ sleep 1
10242024-02-21T01:18:17.264Z+ retry=30
10252024-02-21T01:18:17.264Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10262024-02-21T01:18:17.295Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10272024-02-21T01:18:17.295Z+ [[ 30 -gt 60 ]]
10282024-02-21T01:18:17.295Z+ sleep 1
10292024-02-21T01:18:18.271Z+ retry=31
10302024-02-21T01:18:18.271Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10312024-02-21T01:18:18.296Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10322024-02-21T01:18:18.296Z+ [[ 31 -gt 60 ]]
10332024-02-21T01:18:18.296Z+ sleep 1
10342024-02-21T01:18:19.288Z+ retry=32
10352024-02-21T01:18:19.288Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10362024-02-21T01:18:19.314Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10372024-02-21T01:18:19.314Z+ [[ 32 -gt 60 ]]
10382024-02-21T01:18:19.314Z+ sleep 1
10392024-02-21T01:18:20.312Z+ retry=33
10402024-02-21T01:18:20.312Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10412024-02-21T01:18:20.346Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10422024-02-21T01:18:20.346Z+ [[ 33 -gt 60 ]]
10432024-02-21T01:18:20.346Z+ sleep 1
10442024-02-21T01:18:21.320Z+ retry=34
10452024-02-21T01:18:21.320Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10462024-02-21T01:18:21.346Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10472024-02-21T01:18:21.346Z+ [[ 34 -gt 60 ]]
10482024-02-21T01:18:21.346Z+ sleep 1
10492024-02-21T01:18:22.335Z+ retry=35
10502024-02-21T01:18:22.335Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10512024-02-21T01:18:22.361Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10522024-02-21T01:18:22.361Z+ [[ 35 -gt 60 ]]
10532024-02-21T01:18:22.361Z+ sleep 1
10542024-02-21T01:18:23.351Z+ retry=36
10552024-02-21T01:18:23.351Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10562024-02-21T01:18:23.377Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10572024-02-21T01:18:23.377Z+ [[ 36 -gt 60 ]]
10582024-02-21T01:18:23.377Z+ sleep 1
10592024-02-21T01:18:24.366Z+ retry=37
10602024-02-21T01:18:24.366Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10612024-02-21T01:18:24.392Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10622024-02-21T01:18:24.392Z+ [[ 37 -gt 60 ]]
10632024-02-21T01:18:24.392Z+ sleep 1
10642024-02-21T01:18:25.381Z+ retry=38
10652024-02-21T01:18:25.382Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10662024-02-21T01:18:25.409Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10672024-02-21T01:18:25.409Z+ [[ 38 -gt 60 ]]
10682024-02-21T01:18:25.409Z+ sleep 1
10692024-02-21T01:18:26.398Z+ retry=39
10702024-02-21T01:18:26.398Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10712024-02-21T01:18:26.430Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10722024-02-21T01:18:26.430Z+ [[ 39 -gt 60 ]]
10732024-02-21T01:18:26.430Z+ sleep 1
10742024-02-21T01:18:27.412Z+ retry=40
10752024-02-21T01:18:27.413Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10762024-02-21T01:18:27.450Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10772024-02-21T01:18:27.450Z+ [[ 40 -gt 60 ]]
10782024-02-21T01:18:27.450Z+ sleep 1
10792024-02-21T01:18:28.430Z+ retry=41
10802024-02-21T01:18:28.430Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10812024-02-21T01:18:28.459Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10822024-02-21T01:18:28.459Z+ [[ 41 -gt 60 ]]
10832024-02-21T01:18:28.460Z+ sleep 1
10842024-02-21T01:18:29.446Z+ retry=42
10852024-02-21T01:18:29.446Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10862024-02-21T01:18:29.472Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10872024-02-21T01:18:29.472Z+ [[ 42 -gt 60 ]]
10882024-02-21T01:18:29.472Z+ sleep 1
10892024-02-21T01:18:30.462Z+ retry=43
10902024-02-21T01:18:30.463Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10912024-02-21T01:18:30.488Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10922024-02-21T01:18:30.488Z+ [[ 43 -gt 60 ]]
10932024-02-21T01:18:30.488Z+ sleep 1
10942024-02-21T01:18:31.478Z+ retry=44
10952024-02-21T01:18:31.478Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10962024-02-21T01:18:31.505Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10972024-02-21T01:18:31.505Z+ [[ 44 -gt 60 ]]
10982024-02-21T01:18:31.505Z+ sleep 1
10992024-02-21T01:18:32.494Z+ retry=45
11002024-02-21T01:18:32.494Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11012024-02-21T01:18:32.520Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11022024-02-21T01:18:32.520Z+ [[ 45 -gt 60 ]]
11032024-02-21T01:18:32.520Z+ sleep 1
11042024-02-21T01:18:33.517Z+ retry=46
11052024-02-21T01:18:33.517Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11062024-02-21T01:18:33.587Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
11072024-02-21T01:18:33.897Z{"status":"ok"}success
11082024-02-21T01:18:33.897ZProject {
11092024-02-21T01:18:33.897Z description: "some images",
11102024-02-21T01:18:33.897Z id: 257c7fb1-c4b8-4bbd-9438-479e704cd04b,
11112024-02-21T01:18:33.898Z name: Name(
11122024-02-21T01:18:33.898Z "images",
11132024-02-21T01:18:33.898Z ),
11142024-02-21T01:18:33.898Z time_created: 2024-02-21T01:18:33.662417Z,
11152024-02-21T01:18:33.898Z time_modified: 2024-02-21T01:18:33.662417Z,
11162024-02-21T01:18:33.898Z}
11172024-02-21T01:18:33.925Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
11182024-02-21T01:24:00.403Zdone!
11192024-02-21T01:24:00.505Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
11202024-02-21T01:24:00.651Zsuccess
11212024-02-21T01:24:00.651ZImage {
11222024-02-21T01:24:00.651Z block_size: ByteCount(
11232024-02-21T01:24:00.651Z 512,
11242024-02-21T01:24:00.651Z ),
11252024-02-21T01:24:00.651Z description: "debian 11 original base image",
11262024-02-21T01:24:00.651Z digest: None,
11272024-02-21T01:24:00.651Z id: 77f6ad75-4b9f-4beb-9646-0396cab1c6bb,
11282024-02-21T01:24:00.651Z name: Name(
11292024-02-21T01:24:00.651Z "debian11",
11302024-02-21T01:24:00.651Z ),
11312024-02-21T01:24:00.677Z os: "debian",
11322024-02-21T01:24:00.677Z project_id: None,
11332024-02-21T01:24:00.677Z size: ByteCount(
11342024-02-21T01:24:00.677Z 2147483648,
11352024-02-21T01:24:00.677Z ),
11362024-02-21T01:24:00.677Z time_created: 2024-02-21T01:24:00.312516Z,
11372024-02-21T01:24:00.678Z time_modified: 2024-02-21T01:24:00.594626Z,
11382024-02-21T01:24:00.678Z url: None,
11392024-02-21T01:24:00.678Z version: "11",
11402024-02-21T01:24:00.678Z}
11412024-02-21T01:24:00.678Z+ rm ./tests/bootstrap
11422024-02-21T01:24:00.731Z+ for test_bin in tests/*
11432024-02-21T01:24:00.732Z+ ./tests/bootstrap-cf824cb4b739d2ec
11442024-02-21T01:24:00.858Z
11452024-02-21T01:24:00.858Zrunning 0 tests
11462024-02-21T01:24:00.858Z
11472024-02-21T01:24:00.883Z+ for test_bin in tests/*
11482024-02-21T01:24:00.883Z+ ./tests/end_to_end_tests-a83ae36ae0f33128
11492024-02-21T01:24:00.883Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11502024-02-21T01:24:00.883Z
11512024-02-21T01:24:01.014Z
11522024-02-21T01:24:01.015Zrunning 2 tests
11532024-02-21T01:24:01.247Ztest no_spoof::no_spoof_here ... ok
11542024-02-21T01:24:46.740Ztest instance_launch::instance_launch ... ok
11552024-02-21T01:24:46.740Z
11562024-02-21T01:24:46.740Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 45.73s
11572024-02-21T01:24:46.740Z
11582024-02-21T01:24:46.767Z+ _exit_trap
11592024-02-21T01:24:46.767Z+ local status=0
11602024-02-21T01:24:46.767Z+ [[ 0 -eq 0 ]]
11612024-02-21T01:24:46.767Z+ exit 0
11622024-02-21T01:24:46.767Zprocess exited: duration 772781 ms, exit code 0
 
11632024-02-21T01:24:46.902Zfound 97 output files
11642024-02-21T01:24:46.902Zuploading: /var/svc/log/oxide-sled-agent:default.log (930009 bytes)
11652024-02-21T01:24:48.260Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11662024-02-21T01:24:48.260Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (2429118 bytes)
11672024-02-21T01:24:50.939Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 2429118 -> 2447052
11682024-02-21T01:24:52.451Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11692024-02-21T01:24:52.452Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (334124 bytes)
11702024-02-21T01:24:53.850Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11712024-02-21T01:24:53.850Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (402 bytes)
11722024-02-21T01:24:54.966Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11732024-02-21T01:24:54.966Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (4450 bytes)
11742024-02-21T01:24:56.525Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11752024-02-21T01:24:56.525Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (17422 bytes)
11762024-02-21T01:24:56.757Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 17422 -> 17770
11772024-02-21T01:24:57.852Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11782024-02-21T01:24:57.852Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (8073 bytes)
11792024-02-21T01:24:59.814Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11802024-02-21T01:24:59.814Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1678450 bytes)
11812024-02-21T01:25:00.244Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1678450 -> 1712000
11822024-02-21T01:25:01.326Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11832024-02-21T01:25:01.360Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (163907 bytes)
11842024-02-21T01:25:02.600Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11852024-02-21T01:25:02.601Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (970108 bytes)
11862024-02-21T01:25:03.354Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 970108 -> 990196
11872024-02-21T01:25:04.444Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11882024-02-21T01:25:04.444Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (88157 bytes)
11892024-02-21T01:25:05.665Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11902024-02-21T01:25:05.665Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11912024-02-21T01:25:08.240Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11922024-02-21T01:25:08.240Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11932024-02-21T01:25:09.349Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11942024-02-21T01:25:09.349Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (280567 bytes)
11952024-02-21T01:25:09.560Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 280567 -> 291163
11962024-02-21T01:25:11.051Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11972024-02-21T01:25:11.051Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (31676 bytes)
11982024-02-21T01:25:11.840Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11992024-02-21T01:25:11.840Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
12002024-02-21T01:25:12.922Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
12012024-02-21T01:25:12.948Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
12022024-02-21T01:25:14.026Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
12032024-02-21T01:25:14.026Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
12042024-02-21T01:25:15.099Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
12052024-02-21T01:25:15.099Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5393 bytes)
12062024-02-21T01:25:16.202Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
12072024-02-21T01:25:16.202Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_94071c0a-5439-4e93-8ecd-5aa5632f4b16/root/var/svc/log/oxide-clickhouse:default.log (852752 bytes)
12082024-02-21T01:25:17.584Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_94071c0a-5439-4e93-8ecd-5aa5632f4b16/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 852752 -> 898491
12092024-02-21T01:25:19.085Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_94071c0a-5439-4e93-8ecd-5aa5632f4b16/root/var/svc/log/oxide-clickhouse:default.log
12102024-02-21T01:25:19.085Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_94071c0a-5439-4e93-8ecd-5aa5632f4b16/root/var/svc/log/oxide-zone-network-setup:default.log (1708 bytes)
12112024-02-21T01:25:20.200Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_94071c0a-5439-4e93-8ecd-5aa5632f4b16/root/var/svc/log/oxide-zone-network-setup:default.log
12122024-02-21T01:25:20.201Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_92b49ea0-e3e1-4f9b-a63a-962ca2ffa1dc/root/var/svc/log/oxide-cockroachdb:default.log (4408 bytes)
12132024-02-21T01:25:21.321Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_92b49ea0-e3e1-4f9b-a63a-962ca2ffa1dc/root/var/svc/log/oxide-cockroachdb:default.log
12142024-02-21T01:25:21.321Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_92b49ea0-e3e1-4f9b-a63a-962ca2ffa1dc/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
12152024-02-21T01:25:22.831Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_92b49ea0-e3e1-4f9b-a63a-962ca2ffa1dc/root/var/svc/log/oxide-zone-network-setup:default.log
12162024-02-21T01:25:22.831Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0e4a3836-04d0-4f79-8d44-917309a284f0/root/var/svc/log/oxide-crucible-agent:default.log (1326 bytes)
12172024-02-21T01:25:23.543Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0e4a3836-04d0-4f79-8d44-917309a284f0/root/var/svc/log/oxide-crucible-agent:default.log
12182024-02-21T01:25:23.543Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0e4a3836-04d0-4f79-8d44-917309a284f0/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12192024-02-21T01:25:24.639Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0e4a3836-04d0-4f79-8d44-917309a284f0/root/var/svc/log/oxide-crucible-downstairs:default.log
12202024-02-21T01:25:24.639Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0e4a3836-04d0-4f79-8d44-917309a284f0/root/var/svc/log/oxide-zone-network-setup:default.log (1699 bytes)
12212024-02-21T01:25:25.745Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0e4a3836-04d0-4f79-8d44-917309a284f0/root/var/svc/log/oxide-zone-network-setup:default.log
12222024-02-21T01:25:25.745Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_77f5b44a-bcf8-4cdf-8139-5d7ab8ce8567/root/var/svc/log/oxide-crucible-pantry:default.log (782 bytes)
12232024-02-21T01:25:27.292Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_77f5b44a-bcf8-4cdf-8139-5d7ab8ce8567/root/var/svc/log/oxide-crucible-pantry:default.log
12242024-02-21T01:25:27.293Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_77f5b44a-bcf8-4cdf-8139-5d7ab8ce8567/root/var/svc/log/oxide-zone-network-setup:default.log (1738 bytes)
12252024-02-21T01:25:28.392Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_77f5b44a-bcf8-4cdf-8139-5d7ab8ce8567/root/var/svc/log/oxide-zone-network-setup:default.log
12262024-02-21T01:25:28.392Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2de41604-22b3-4f53-9337-2f8b70764ab6/root/var/svc/log/oxide-external_dns:default.log (31482 bytes)
12272024-02-21T01:25:28.590Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2de41604-22b3-4f53-9337-2f8b70764ab6/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 31482 -> 32742
12282024-02-21T01:25:29.681Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2de41604-22b3-4f53-9337-2f8b70764ab6/root/var/svc/log/oxide-external_dns:default.log
12292024-02-21T01:25:29.681Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_700623de-c583-4fb3-919e-ba9d29b557ad/root/var/svc/log/oxide-internal_dns:default.log (106905 bytes)
12302024-02-21T01:25:30.028Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_700623de-c583-4fb3-919e-ba9d29b557ad/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 106905 -> 108157
12312024-02-21T01:25:31.519Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_700623de-c583-4fb3-919e-ba9d29b557ad/root/var/svc/log/oxide-internal_dns:default.log
12322024-02-21T01:25:31.520Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_700623de-c583-4fb3-919e-ba9d29b557ad/root/var/svc/log/oxide-internal_dns:default.log.0 (5507 bytes)
12332024-02-21T01:25:32.656Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_700623de-c583-4fb3-919e-ba9d29b557ad/root/var/svc/log/oxide-internal_dns:default.log.0
12342024-02-21T01:25:32.657Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_49f856e2-1f33-4345-8bb6-886438f3f3a5/root/var/svc/log/oxide-cockroachdb:default.log (4405 bytes)
12352024-02-21T01:25:33.765Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_49f856e2-1f33-4345-8bb6-886438f3f3a5/root/var/svc/log/oxide-cockroachdb:default.log
12362024-02-21T01:25:33.766Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_49f856e2-1f33-4345-8bb6-886438f3f3a5/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
12372024-02-21T01:25:35.384Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_49f856e2-1f33-4345-8bb6-886438f3f3a5/root/var/svc/log/oxide-zone-network-setup:default.log
12382024-02-21T01:25:35.384Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f51b96cd-d26e-40cf-98e1-1c994df3c27a/root/var/svc/log/oxide-crucible-agent:default.log (12006 bytes)
12392024-02-21T01:25:36.070Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f51b96cd-d26e-40cf-98e1-1c994df3c27a/root/var/svc/log/oxide-crucible-agent:default.log
12402024-02-21T01:25:36.071Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f51b96cd-d26e-40cf-98e1-1c994df3c27a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12412024-02-21T01:25:37.182Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f51b96cd-d26e-40cf-98e1-1c994df3c27a/root/var/svc/log/oxide-crucible-downstairs:default.log
12422024-02-21T01:25:37.183Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f51b96cd-d26e-40cf-98e1-1c994df3c27a/root/var/svc/log/oxide-crucible-downstairs:downstairs-8149c736-45d4-4e51-bfbd-a67ab08f213e.log (3126 bytes)
12432024-02-21T01:25:38.300Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f51b96cd-d26e-40cf-98e1-1c994df3c27a/root/var/svc/log/oxide-crucible-downstairs:downstairs-8149c736-45d4-4e51-bfbd-a67ab08f213e.log
12442024-02-21T01:25:38.300Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f51b96cd-d26e-40cf-98e1-1c994df3c27a/root/var/svc/log/oxide-zone-network-setup:default.log (1698 bytes)
12452024-02-21T01:25:39.383Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f51b96cd-d26e-40cf-98e1-1c994df3c27a/root/var/svc/log/oxide-zone-network-setup:default.log
12462024-02-21T01:25:39.383Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_9c6599b8-c7ab-4f25-b056-23e43b8fe12b/root/var/svc/log/oxide-external_dns:default.log (30716 bytes)
12472024-02-21T01:25:39.556Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_9c6599b8-c7ab-4f25-b056-23e43b8fe12b/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 30716 -> 34494
12482024-02-21T01:25:40.645Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_9c6599b8-c7ab-4f25-b056-23e43b8fe12b/root/var/svc/log/oxide-external_dns:default.log
12492024-02-21T01:25:40.645Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_02704d1f-954b-4e0c-9b26-6533918b4f4e/root/var/svc/log/oxide-internal_dns:default.log (106916 bytes)
12502024-02-21T01:25:41.021Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_02704d1f-954b-4e0c-9b26-6533918b4f4e/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 106916 -> 110664
12512024-02-21T01:25:42.103Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_02704d1f-954b-4e0c-9b26-6533918b4f4e/root/var/svc/log/oxide-internal_dns:default.log
12522024-02-21T01:25:42.103Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_02704d1f-954b-4e0c-9b26-6533918b4f4e/root/var/svc/log/oxide-internal_dns:default.log.0 (11188 bytes)
12532024-02-21T01:25:43.233Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_02704d1f-954b-4e0c-9b26-6533918b4f4e/root/var/svc/log/oxide-internal_dns:default.log.0
12542024-02-21T01:25:43.233Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e52b342c-5123-4ee0-8381-9ade76cf7b08/root/var/svc/log/oxide-cockroachdb:default.log (4406 bytes)
12552024-02-21T01:25:44.331Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e52b342c-5123-4ee0-8381-9ade76cf7b08/root/var/svc/log/oxide-cockroachdb:default.log
12562024-02-21T01:25:44.331Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e52b342c-5123-4ee0-8381-9ade76cf7b08/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
12572024-02-21T01:25:45.431Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e52b342c-5123-4ee0-8381-9ade76cf7b08/root/var/svc/log/oxide-zone-network-setup:default.log
12582024-02-21T01:25:45.431Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c85b77b6-7977-4356-bde8-a9db2835e863/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
12592024-02-21T01:25:46.968Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c85b77b6-7977-4356-bde8-a9db2835e863/root/var/svc/log/oxide-crucible-agent:default.log
12602024-02-21T01:25:46.968Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c85b77b6-7977-4356-bde8-a9db2835e863/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12612024-02-21T01:25:48.083Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c85b77b6-7977-4356-bde8-a9db2835e863/root/var/svc/log/oxide-crucible-downstairs:default.log
12622024-02-21T01:25:48.083Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c85b77b6-7977-4356-bde8-a9db2835e863/root/var/svc/log/oxide-zone-network-setup:default.log (1699 bytes)
12632024-02-21T01:25:49.195Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_c85b77b6-7977-4356-bde8-a9db2835e863/root/var/svc/log/oxide-zone-network-setup:default.log
12642024-02-21T01:25:49.196Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_0945713f-ddaf-4f2b-9137-0031e1c00671/root/var/svc/log/oxide-crucible-pantry:default.log (1217329 bytes)
12652024-02-21T01:25:52.097Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_0945713f-ddaf-4f2b-9137-0031e1c00671/root/var/svc/log/oxide-crucible-pantry:default.log
12662024-02-21T01:25:52.122Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_0945713f-ddaf-4f2b-9137-0031e1c00671/root/var/svc/log/oxide-zone-network-setup:default.log (1740 bytes)
12672024-02-21T01:25:53.217Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_0945713f-ddaf-4f2b-9137-0031e1c00671/root/var/svc/log/oxide-zone-network-setup:default.log
12682024-02-21T01:25:53.217Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_a38c78a7-e970-4a13-84cd-6df4297ada77/root/var/svc/log/oxide-internal_dns:default.log (106903 bytes)
12692024-02-21T01:25:53.574Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_a38c78a7-e970-4a13-84cd-6df4297ada77/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 106903 -> 110655
12702024-02-21T01:25:54.650Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_a38c78a7-e970-4a13-84cd-6df4297ada77/root/var/svc/log/oxide-internal_dns:default.log
12712024-02-21T01:25:54.650Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_a38c78a7-e970-4a13-84cd-6df4297ada77/root/var/svc/log/oxide-internal_dns:default.log.0 (7130 bytes)
12722024-02-21T01:25:55.778Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_a38c78a7-e970-4a13-84cd-6df4297ada77/root/var/svc/log/oxide-internal_dns:default.log.0
12732024-02-21T01:25:55.778Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_af1553b4-c9e8-47a4-b048-a1a6b0c352a3/root/var/svc/log/oxide-oximeter:default.log (264254 bytes)
12742024-02-21T01:25:56.586Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_af1553b4-c9e8-47a4-b048-a1a6b0c352a3/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 264254 -> 304664
12752024-02-21T01:25:57.663Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_af1553b4-c9e8-47a4-b048-a1a6b0c352a3/root/var/svc/log/oxide-oximeter:default.log
12762024-02-21T01:25:57.663Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_af1553b4-c9e8-47a4-b048-a1a6b0c352a3/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
12772024-02-21T01:25:59.302Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_af1553b4-c9e8-47a4-b048-a1a6b0c352a3/root/var/svc/log/oxide-zone-network-setup:default.log
12782024-02-21T01:25:59.302Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_ba0d234f-e27f-4de4-b2d9-de30b75918a9/root/var/svc/log/oxide-cockroachdb:default.log (4408 bytes)
12792024-02-21T01:26:00.361Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_ba0d234f-e27f-4de4-b2d9-de30b75918a9/root/var/svc/log/oxide-cockroachdb:default.log
12802024-02-21T01:26:00.361Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_ba0d234f-e27f-4de4-b2d9-de30b75918a9/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
12812024-02-21T01:26:01.468Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_ba0d234f-e27f-4de4-b2d9-de30b75918a9/root/var/svc/log/oxide-zone-network-setup:default.log
12822024-02-21T01:26:01.468Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_9ddb46a3-c8e1-4cac-bc5f-bf6b0449770e/root/var/svc/log/oxide-crucible-agent:default.log (12438 bytes)
12832024-02-21T01:26:03.082Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_9ddb46a3-c8e1-4cac-bc5f-bf6b0449770e/root/var/svc/log/oxide-crucible-agent:default.log
12842024-02-21T01:26:03.082Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_9ddb46a3-c8e1-4cac-bc5f-bf6b0449770e/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12852024-02-21T01:26:04.185Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_9ddb46a3-c8e1-4cac-bc5f-bf6b0449770e/root/var/svc/log/oxide-crucible-downstairs:default.log
12862024-02-21T01:26:04.186Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_9ddb46a3-c8e1-4cac-bc5f-bf6b0449770e/root/var/svc/log/oxide-crucible-downstairs:downstairs-bbfb8ac5-b4d0-418f-b715-93fddfc483e7.log (5614 bytes)
12872024-02-21T01:26:05.305Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_9ddb46a3-c8e1-4cac-bc5f-bf6b0449770e/root/var/svc/log/oxide-crucible-downstairs:downstairs-bbfb8ac5-b4d0-418f-b715-93fddfc483e7.log
12882024-02-21T01:26:05.305Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_9ddb46a3-c8e1-4cac-bc5f-bf6b0449770e/root/var/svc/log/oxide-zone-network-setup:default.log (1699 bytes)
12892024-02-21T01:26:06.409Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_9ddb46a3-c8e1-4cac-bc5f-bf6b0449770e/root/var/svc/log/oxide-zone-network-setup:default.log
12902024-02-21T01:26:06.409Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_e52e2e3d-261b-421f-819c-a8a15c99b958/root/var/svc/log/oxide-nexus:default.log (34577816 bytes)
12912024-02-21T01:26:29.695Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_e52e2e3d-261b-421f-819c-a8a15c99b958/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 34577816 -> 34725057
12922024-02-21T01:26:30.773Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_e52e2e3d-261b-421f-819c-a8a15c99b958/root/var/svc/log/oxide-nexus:default.log
12932024-02-21T01:26:30.773Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/svc/log/oxide-ntp:default.log (136 bytes)
12942024-02-21T01:26:31.868Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/svc/log/oxide-ntp:default.log
12952024-02-21T01:26:31.869Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/svc/log/oxide-ntp:default.log.0 (847 bytes)
12962024-02-21T01:26:32.967Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/svc/log/oxide-ntp:default.log.0
12972024-02-21T01:26:32.967Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_246392af-50f8-4876-af10-46d3f4039f66/root/var/svc/log/oxide-cockroachdb:default.log (4381 bytes)
12982024-02-21T01:26:34.089Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_246392af-50f8-4876-af10-46d3f4039f66/root/var/svc/log/oxide-cockroachdb:default.log
12992024-02-21T01:26:34.089Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_246392af-50f8-4876-af10-46d3f4039f66/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
13002024-02-21T01:26:35.198Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_246392af-50f8-4876-af10-46d3f4039f66/root/var/svc/log/oxide-zone-network-setup:default.log
13012024-02-21T01:26:35.198Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-agent:default.log (27002 bytes)
13022024-02-21T01:26:36.395Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-agent:default.log
13032024-02-21T01:26:36.395Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13042024-02-21T01:26:37.725Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-downstairs:default.log
13052024-02-21T01:26:37.725Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-downstairs:downstairs-5ddcb8d4-bed4-487d-9a77-98053c37874e.log (5698 bytes)
13062024-02-21T01:26:38.853Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-downstairs:downstairs-5ddcb8d4-bed4-487d-9a77-98053c37874e.log
13072024-02-21T01:26:38.853Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-downstairs:downstairs-94088b25-4202-488a-af76-4a4a0d5ace14.log (3018 bytes)
13082024-02-21T01:26:39.952Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-downstairs:downstairs-94088b25-4202-488a-af76-4a4a0d5ace14.log
13092024-02-21T01:26:39.952Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-downstairs:snapshot-5ddcb8d4-bed4-487d-9a77-98053c37874e-a3e9b599-0b1b-4d20-be9f-3b9142328a61.log (5305 bytes)
13102024-02-21T01:26:41.067Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-crucible-downstairs:snapshot-5ddcb8d4-bed4-487d-9a77-98053c37874e-a3e9b599-0b1b-4d20-be9f-3b9142328a61.log
13112024-02-21T01:26:41.067Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-zone-network-setup:default.log (1699 bytes)
13122024-02-21T01:26:42.195Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_da803974-d01d-444d-9603-508c8c6b4ce8/root/var/svc/log/oxide-zone-network-setup:default.log
13132024-02-21T01:26:42.195Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_386829dc-b57b-4a9f-8912-e6031f0482fc/root/var/svc/log/oxide-crucible-pantry:default.log (779 bytes)
13142024-02-21T01:26:43.316Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_386829dc-b57b-4a9f-8912-e6031f0482fc/root/var/svc/log/oxide-crucible-pantry:default.log
13152024-02-21T01:26:43.316Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_386829dc-b57b-4a9f-8912-e6031f0482fc/root/var/svc/log/oxide-zone-network-setup:default.log (1737 bytes)
13162024-02-21T01:26:44.416Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_386829dc-b57b-4a9f-8912-e6031f0482fc/root/var/svc/log/oxide-zone-network-setup:default.log
13172024-02-21T01:26:44.417Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_aca47f6f-95ab-43b6-a3a4-20f68ca9edb3/root/var/svc/log/oxide-nexus:default.log (1418481 bytes)
13182024-02-21T01:26:47.099Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_aca47f6f-95ab-43b6-a3a4-20f68ca9edb3/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1418481 -> 1656374
13192024-02-21T01:26:48.170Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_aca47f6f-95ab-43b6-a3a4-20f68ca9edb3/root/var/svc/log/oxide-nexus:default.log
13202024-02-21T01:26:48.170Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-agent:default.log (43195 bytes)
13212024-02-21T01:26:49.400Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-agent:default.log
13222024-02-21T01:26:49.401Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13232024-02-21T01:26:50.521Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:default.log
13242024-02-21T01:26:50.521Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:downstairs-69fe203d-ed2c-4e61-83f4-a04444c7b977.log (5610 bytes)
13252024-02-21T01:26:52.078Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:downstairs-69fe203d-ed2c-4e61-83f4-a04444c7b977.log
13262024-02-21T01:26:52.078Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1f63843-a2ce-42da-bf8e-8ff9427eff55.log (3123 bytes)
13272024-02-21T01:26:53.184Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1f63843-a2ce-42da-bf8e-8ff9427eff55.log
13282024-02-21T01:26:53.184Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:downstairs-ba25a01f-9eb4-4e5f-bf86-70df47103f1d.log (5698 bytes)
13292024-02-21T01:26:54.322Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:downstairs-ba25a01f-9eb4-4e5f-bf86-70df47103f1d.log
13302024-02-21T01:26:54.322Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:downstairs-f6ac57d0-ebf8-48ca-8b5f-2396a86de577.log (3017 bytes)
13312024-02-21T01:26:55.453Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:downstairs-f6ac57d0-ebf8-48ca-8b5f-2396a86de577.log
13322024-02-21T01:26:55.454Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:snapshot-ba25a01f-9eb4-4e5f-bf86-70df47103f1d-a3e9b599-0b1b-4d20-be9f-3b9142328a61.log (5304 bytes)
13332024-02-21T01:26:56.559Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-crucible-downstairs:snapshot-ba25a01f-9eb4-4e5f-bf86-70df47103f1d-a3e9b599-0b1b-4d20-be9f-3b9142328a61.log
13342024-02-21T01:26:56.559Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-zone-network-setup:default.log (1698 bytes)
13352024-02-21T01:26:57.664Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_58c5784e-4891-4906-904a-df8d17287992/root/var/svc/log/oxide-zone-network-setup:default.log
13362024-02-21T01:26:57.664Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-agent:default.log (26160 bytes)
13372024-02-21T01:26:58.914Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-agent:default.log
13382024-02-21T01:26:58.915Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13392024-02-21T01:27:00.430Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-downstairs:default.log
13402024-02-21T01:27:00.430Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-downstairs:downstairs-7cbb08fa-fc5a-4491-933a-07ae98cd7e5d.log (5696 bytes)
13412024-02-21T01:27:01.562Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-downstairs:downstairs-7cbb08fa-fc5a-4491-933a-07ae98cd7e5d.log
13422024-02-21T01:27:01.562Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-downstairs:downstairs-ce9aac36-1935-44d6-8dc2-43c79b373b96.log (3126 bytes)
13432024-02-21T01:27:02.674Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-downstairs:downstairs-ce9aac36-1935-44d6-8dc2-43c79b373b96.log
13442024-02-21T01:27:02.674Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-downstairs:snapshot-7cbb08fa-fc5a-4491-933a-07ae98cd7e5d-a3e9b599-0b1b-4d20-be9f-3b9142328a61.log (5305 bytes)
13452024-02-21T01:27:03.777Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-crucible-downstairs:snapshot-7cbb08fa-fc5a-4491-933a-07ae98cd7e5d-a3e9b599-0b1b-4d20-be9f-3b9142328a61.log
13462024-02-21T01:27:03.777Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-zone-network-setup:default.log (1699 bytes)
13472024-02-21T01:27:04.878Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_69e8a713-5f13-4004-93bb-dfa402b1c1aa/root/var/svc/log/oxide-zone-network-setup:default.log
13482024-02-21T01:27:04.878Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_0ed420df-f0a3-44cd-b24a-925ce14f9887/root/var/svc/log/oxide-nexus:default.log (7342157 bytes)
13492024-02-21T01:27:12.038Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_0ed420df-f0a3-44cd-b24a-925ce14f9887/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 7342157 -> 7770861
13502024-02-21T01:27:13.113Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_0ed420df-f0a3-44cd-b24a-925ce14f9887/root/var/svc/log/oxide-nexus:default.log
13512024-02-21T01:27:13.113Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-crucible-agent:default.log (24000 bytes)
13522024-02-21T01:27:14.589Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-crucible-agent:default.log
13532024-02-21T01:27:14.589Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13542024-02-21T01:27:15.696Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-crucible-downstairs:default.log
13552024-02-21T01:27:15.696Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-238f4bf7-9e42-4e48-89e3-b307c964f02e.log (5613 bytes)
13562024-02-21T01:27:16.802Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-238f4bf7-9e42-4e48-89e3-b307c964f02e.log
13572024-02-21T01:27:16.802Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-d9ec3fd6-557e-47de-9bfc-a89d7f023a9f.log (3020 bytes)
13582024-02-21T01:27:17.903Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-d9ec3fd6-557e-47de-9bfc-a89d7f023a9f.log
13592024-02-21T01:27:17.933Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-zone-network-setup:default.log (1699 bytes)
13602024-02-21T01:27:19.012Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f2452bb9-fa12-43b2-bc48-f39941b931d8/root/var/svc/log/oxide-zone-network-setup:default.log
13612024-02-21T01:27:19.056Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8d35f7cf-fe9f-4c1f-8ffa-82a5df7d2dd3/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
13622024-02-21T01:27:20.118Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8d35f7cf-fe9f-4c1f-8ffa-82a5df7d2dd3/root/var/svc/log/oxide-crucible-agent:default.log
13632024-02-21T01:27:20.148Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8d35f7cf-fe9f-4c1f-8ffa-82a5df7d2dd3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13642024-02-21T01:27:21.267Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8d35f7cf-fe9f-4c1f-8ffa-82a5df7d2dd3/root/var/svc/log/oxide-crucible-downstairs:default.log
13652024-02-21T01:27:21.267Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8d35f7cf-fe9f-4c1f-8ffa-82a5df7d2dd3/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
13662024-02-21T01:27:22.398Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8d35f7cf-fe9f-4c1f-8ffa-82a5df7d2dd3/root/var/svc/log/oxide-zone-network-setup:default.log
13672024-02-21T01:27:22.399Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/measurements.log (26441 bytes)
13682024-02-21T01:27:22.535Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/measurements.log" changed size mid upload: 26441 -> 32606
13692024-02-21T01:27:23.610Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/measurements.log
13702024-02-21T01:27:23.610Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/statistics.log (16263 bytes)
13712024-02-21T01:27:23.706Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/statistics.log" changed size mid upload: 16263 -> 21645
13722024-02-21T01:27:24.793Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/statistics.log
13732024-02-21T01:27:24.793Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/tracking.log (1851 bytes)
13742024-02-21T01:27:24.844Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/tracking.log" changed size mid upload: 1851 -> 2247
13752024-02-21T01:27:25.925Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_be36beb9-71c5-4c79-9b0b-275857893056/root/var/log/chrony/tracking.log