01KQJ4PHWMA9QPAFW0VA7TD0C0: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-*.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
        "/tmp/kstat/*.kstat",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.40",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01KQJ4QTK81WCBCTE95S65GZHP

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12026-05-01T16:25:51.424Zjob dependencies complete; ready to run (waiting for 17 m 57 s)
22026-05-01T17:35:56.197Zjob assigned to worker 01KQJ9Q9RGA74VTXSDS2D06DF5 [factory lab, buskin/20285] (queued for 1 h 10 m 4 s)
32026-05-01T17:35:56.250Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42026-05-01T17:35:56.303Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52026-05-01T17:35:56.340Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62026-05-01T17:35:56.407Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72026-05-01T17:35:56.441Zhttp://172.20.0.5:9969/postboot/buskin... ok
82026-05-01T17:35:56.474ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92026-05-01T17:35:56.508ZWARNING: cpu0: failed to update microcode from version 0xa001133 to 0xa0011de
102026-05-01T17:35:56.541ZWARNING: cpu0: using older fallback microcode; update the system firmware
112026-05-01T17:35:56.575Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
122026-05-01T17:35:56.620ZOxide Helios Version helios-2.0.23894 64-bit
132026-05-01T17:35:56.653ZConfiguring devices.
142026-05-01T17:35:56.686Z##################################################
152026-05-01T17:35:56.720Z#### ############# ##
162026-05-01T17:35:56.753Z### ### ############ ##
172026-05-01T17:35:56.786Z## ### # ## ### ## Oxide Computer Company ##
182026-05-01T17:35:56.820Z## ## ## ### # ### ##
192026-05-01T17:35:56.853Z## # ### #### #### This Station Under ##
202026-05-01T17:35:56.887Z### ### #### # ### Computer Control ##
212026-05-01T17:35:56.920Z#### #### ### ## ##
222026-05-01T17:35:56.954Z##################################################
232026-05-01T17:35:56.987ZHostname: buskin
242026-05-01T17:35:57.021ZLoading smf(7) service descriptions:
252026-05-01T17:35:57.849Zdownloading input: /input/package/work/package.tar.gz
262026-05-01T17:43:07.206Zdownloaded input: /input/package/work/package.tar.gz
 
272026-05-01T17:43:07.230Zstarting task 0: "setup"
282026-05-01T17:43:07.230Z++ uname -s
292026-05-01T17:43:07.230Z+ kern=SunOS
302026-05-01T17:43:07.230Z+ build_user=build
312026-05-01T17:43:07.230Z+ build_uid=12345
322026-05-01T17:43:07.230Z+ work_dir=/work
332026-05-01T17:43:07.230Z+ input_dir=/input
342026-05-01T17:43:07.230Z+ [[ 0 == 12345 ]]
352026-05-01T17:43:07.230Z+ case "$kern" in
362026-05-01T17:43:07.230Z+ groupadd -g 12345 build
372026-05-01T17:43:07.230Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
382026-05-01T17:43:09.223Z+ zfs create -o mountpoint=/work rpool/work
392026-05-01T17:43:09.256Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
402026-05-01T17:43:09.281Z+ home_fs=zfs
412026-05-01T17:43:09.281Z+ [[ zfs == autofs ]]
422026-05-01T17:43:09.281Z+ mkdir -p /home/build
432026-05-01T17:43:09.281Z+ chown build:build /home/build /work
442026-05-01T17:43:11.264Z+ chmod 0700 /home/build /work
452026-05-01T17:43:11.289Zprocess exited: duration 4061 ms, exit code 0
 
462026-05-01T17:43:11.337Zstarting task 1: "authentication"
472026-05-01T17:43:11.382Zprocess exited: duration 45 ms, exit code 0
 
482026-05-01T17:43:11.430Zstarting task 2: "build"
492026-05-01T17:43:11.454Z+ trap _exit_trap EXIT
502026-05-01T17:43:11.454Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
512026-05-01T17:43:11.546Zsecpolicy_fs_linkdir: 0x55 = 0x55
522026-05-01T17:43:11.546Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
532026-05-01T17:43:11.546Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
542026-05-01T17:43:11.546Zsecpolicy_fs_linkdir+3: 0 = 0xe5
552026-05-01T17:43:11.547Zsecpolicy_fs_linkdir+4: 0 = 0xb8
562026-05-01T17:43:11.547Zsecpolicy_fs_linkdir+5: 0 = 0x1
572026-05-01T17:43:11.547Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
582026-05-01T17:43:11.547Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
592026-05-01T17:43:11.547Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
602026-05-01T17:43:11.547Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
612026-05-01T17:43:11.547Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
622026-05-01T17:43:11.571Z+ [[ -d /opt/oxide ]]
632026-05-01T17:43:11.571Z+ pfexec mv /opt/oxide /opt/oxide-underneath
642026-05-01T17:43:11.571Z+ pfexec mkdir /opt/oxide
652026-05-01T17:43:11.572Z+ pfexec mount -F tmpfs -O swap /opt/oxide
662026-05-01T17:43:11.572Z+ [[ -d /opt/oxide-underneath ]]
672026-05-01T17:43:11.572Z+ cd /opt/oxide-underneath
682026-05-01T17:43:11.572Z+ pfexec tar ceEp@/f - .
692026-05-01T17:43:11.572Z+ cd /opt/oxide
702026-05-01T17:43:11.572Z+ pfexec tar xveEp@/f -
712026-05-01T17:43:11.619Zx ., 0 bytes, 0 tape blocks
722026-05-01T17:43:11.619Zx ./opte, 0 bytes, 0 tape blocks
732026-05-01T17:43:11.619Zx ./opte/bin, 0 bytes, 0 tape blocks
742026-05-01T17:43:11.619Zx ./opte/bin/opteadm, 24311432 bytes, 47484 tape blocks
752026-05-01T17:43:11.643Z+ pfexec rm -rf /opt/oxide-underneath
762026-05-01T17:43:11.643Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
772026-05-01T17:43:11.667Z+ pfexec mkdir /opt/oxide/work
782026-05-01T17:43:11.667Z+ pfexec chown build:build /opt/oxide/work
792026-05-01T17:43:11.667Z+ cd /opt/oxide/work
802026-05-01T17:43:11.667Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
812026-05-01T17:43:33.554ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
822026-05-01T17:43:33.554Zx .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks
832026-05-01T17:43:33.554Zx out/target/test, 107 bytes, 1 tape blocks
842026-05-01T17:43:33.554Zx out/npuzone/npuzone, 28059200 bytes, 54804 tape blocks
852026-05-01T17:43:33.554Zx package-manifest.toml, 35397 bytes, 70 tape blocks
862026-05-01T17:43:33.554Zx smf/sled-agent/non-gimlet/config.toml, 5328 bytes, 11 tape blocks
872026-05-01T17:43:33.554Zx target/release/omicron-package, 46874664 bytes, 91553 tape blocks
882026-05-01T17:43:33.554Zx target/release/xtask, 11723800 bytes, 22899 tape blocks
892026-05-01T17:43:33.554Zx target/debug/bootstrap, 350611056 bytes, 684788 tape blocks
902026-05-01T17:43:33.554Zx tests/bootstrap-74e6eb0f591daf49, 31963248 bytes, 62429 tape blocks
912026-05-01T17:43:33.554Zx tests/commtest-018d2ccb778f4c10, 33074192 bytes, 64599 tape blocks
922026-05-01T17:43:33.554Zx tests/dhcp_server-76e3ebbc5d3ea82e, 31963264 bytes, 62429 tape blocks
932026-05-01T17:43:33.554Zx tests/end_to_end_tests-b1282d7c5a8b36f5, 393724688 bytes, 768994 tape blocks
942026-05-01T17:43:33.554Zx tools/opte_version, 9 bytes, 1 tape blocks
952026-05-01T17:43:33.554Zx tools/opte_version_override, 870 bytes, 2 tape blocks
962026-05-01T17:43:33.554Zx out/clickhouse.tar.gz, 327217034 bytes, 639096 tape blocks
972026-05-01T17:43:33.555Zx out/clickhouse_keeper.tar.gz, 312126542 bytes, 609623 tape blocks
982026-05-01T17:43:33.555Zx out/clickhouse_server.tar.gz, 327216265 bytes, 639095 tape blocks
992026-05-01T17:43:33.555Zx out/cockroachdb.tar.gz, 169413014 bytes, 330885 tape blocks
1002026-05-01T17:43:33.555Zx out/crucible-pantry-zone.tar.gz, 47774082 bytes, 93309 tape blocks
1012026-05-01T17:43:33.555Zx out/crucible-utils.tar, 16733184 bytes, 32682 tape blocks
1022026-05-01T17:43:33.555Zx out/crucible-zone.tar.gz, 64112181 bytes, 125220 tape blocks
1032026-05-01T17:43:33.555Zx out/external-dns.tar.gz, 50984367 bytes, 99579 tape blocks
1042026-05-01T17:43:33.555Zx out/internal-dns.tar.gz, 50983965 bytes, 99579 tape blocks
1052026-05-01T17:43:33.555Zx out/mg-ddm-gz.tar, 102636032 bytes, 200461 tape blocks
1062026-05-01T17:43:33.555Zx out/nexus.tar.gz, 225601268 bytes, 440628 tape blocks
1072026-05-01T17:43:33.555Zx out/ntp.tar.gz, 33125340 bytes, 64698 tape blocks
1082026-05-01T17:43:33.555Zx out/omicron-gateway-softnpu.tar.gz, 30412142 bytes, 59399 tape blocks
1092026-05-01T17:43:33.555Zx out/omicron-sled-agent.tar, 208527872 bytes, 407281 tape blocks
1102026-05-01T17:43:33.555Zx out/overlay.tar.gz, 3030 bytes, 6 tape blocks
1112026-05-01T17:43:33.555Zx out/oximeter.tar.gz, 67632368 bytes, 132095 tape blocks
1122026-05-01T17:43:33.555Zx out/oxlog.tar, 3872768 bytes, 7564 tape blocks
1132026-05-01T17:43:33.555Zx out/probe.tar.gz, 3109568 bytes, 6074 tape blocks
1142026-05-01T17:43:33.555Zx out/propolis-server.tar.gz, 39738416 bytes, 77615 tape blocks
1152026-05-01T17:43:33.555Zx out/pumpkind-gz.tar, 27286528 bytes, 53294 tape blocks
1162026-05-01T17:43:33.555Zx out/switch-softnpu.tar.gz, 407200463 bytes, 795314 tape blocks
1172026-05-01T17:43:33.579Z
1182026-05-01T17:43:33.579Zreal 21.876821172
1192026-05-01T17:43:33.579Zuser 19.629783665
1202026-05-01T17:43:33.579Zsys 3.789293670
1212026-05-01T17:43:33.579Ztrap 0.000973704
1222026-05-01T17:43:33.579Ztflt 0.000000000
1232026-05-01T17:43:33.579Zdflt 0.000000000
1242026-05-01T17:43:33.579Zkflt 0.000000000
1252026-05-01T17:43:33.579Zlock 0.000000000
1262026-05-01T17:43:33.579Zslp 19.770660788
1272026-05-01T17:43:33.579Zlat 0.560944557
1282026-05-01T17:43:33.580Zstop 0.000120781
1292026-05-01T17:43:33.580Z+ source .github/buildomat/ci-env.sh
1302026-05-01T17:43:33.580Z++ export CARGO_TERM_COLOR=always
1312026-05-01T17:43:33.580Z++ CARGO_TERM_COLOR=always
1322026-05-01T17:43:33.580Z+ source tools/opte_version_override
1332026-05-01T17:43:33.580Z++ OPTE_COMMIT=c570ac2126dbbebbd8e98e73b580c5be6b7e460e
1342026-05-01T17:43:33.580Z+ [[ xc570ac2126dbbebbd8e98e73b580c5be6b7e460e != \x ]]
1352026-05-01T17:43:33.580Z+ curl -sSfOL https://buildomat.eng.oxide.computer/public/file/oxidecomputer/opte/module/c570ac2126dbbebbd8e98e73b580c5be6b7e460e/xde
1362026-05-01T17:43:42.378Z+ pfexec rem_drv xde
1372026-05-01T17:43:42.402Z+ pfexec mv xde /kernel/drv/amd64/xde
1382026-05-01T17:43:42.443Z+ pfexec add_drv xde
1392026-05-01T17:43:42.523Z+ curl -sSfOL https://buildomat.eng.oxide.computer/public/file/oxidecomputer/opte/release/c570ac2126dbbebbd8e98e73b580c5be6b7e460e/opteadm
1402026-05-01T17:43:47.039Z+ chmod +x opteadm
1412026-05-01T17:43:47.063Z+ cp opteadm /tmp/opteadm
1422026-05-01T17:43:47.063Z+ pfexec mv opteadm /opt/oxide/opte/bin/opteadm
1432026-05-01T17:43:47.087Z+ bmat address ls
1442026-05-01T17:43:47.087ZNAME CIDR FIRST LAST COUNT
1452026-05-01T17:43:47.087Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1462026-05-01T17:43:47.087Z++ bmat address ls -f extra -Ho first,last,count
1472026-05-01T17:43:47.111Z+ set -- 10.151.1.164 10.151.1.227 64
1482026-05-01T17:43:47.111Z+ EXTRA_IP_START=10.151.1.164
1492026-05-01T17:43:47.111Z+ EXTRA_IP_END=10.151.1.227
1502026-05-01T17:43:47.111Z+ EXTRA_IP_COUNT=64
1512026-05-01T17:43:47.111Z+ (( EXTRA_IP_COUNT >= 32 ))
1522026-05-01T17:43:47.111Z+ EXTRA_IP_BASE=10.151.1
1532026-05-01T17:43:47.111Z+ EXTRA_IP_FOCTET=164
1542026-05-01T17:43:47.111Z+ EXTRA_IP_LOCTET=227
1552026-05-01T17:43:47.111Z+ SERVICE_IP_POOL_START=10.151.1.164
1562026-05-01T17:43:47.111Z+ SERVICE_IP_POOL_END=10.151.1.173
1572026-05-01T17:43:47.111Z+ DNS_IP1=10.151.1.164
1582026-05-01T17:43:47.111Z+ DNS_IP2=10.151.1.165
1592026-05-01T17:43:47.111Z+ UPLINK_IP=10.151.1.174
1602026-05-01T17:43:47.111Z+ IPPOOL_START=10.151.1.175
1612026-05-01T17:43:47.111Z+ IPPOOL_END=10.151.1.227
1622026-05-01T17:43:47.111Z++ ipadm show-addr -po type,addr
1632026-05-01T17:43:47.112Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1642026-05-01T17:43:47.112Z+ GATEWAY_IP=10.151.1.100
1652026-05-01T17:43:47.112Z+ [[ -n 10.151.1.100 ]]
1662026-05-01T17:43:47.112Z+ ping -s 10.151.1.100 56 1
1672026-05-01T17:43:47.112ZPING 10.151.1.100: 56 data bytes
1682026-05-01T17:43:47.112Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.012 ms
1692026-05-01T17:43:47.112Z
1702026-05-01T17:43:47.112Z----10.151.1.100 PING Statistics----
1712026-05-01T17:43:47.112Z1 packets transmitted, 1 packets received, 0% packet loss
1722026-05-01T17:43:47.112Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
1732026-05-01T17:43:47.112Z++ arp -an
1742026-05-01T17:43:47.112Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1752026-05-01T17:43:47.136Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1762026-05-01T17:43:47.136Z+ routeadm -e ipv4-forwarding -u
1772026-05-01T17:43:47.214Z+ PXA_START=10.151.1.164
1782026-05-01T17:43:47.214Z+ PXA_END=10.151.1.227
1792026-05-01T17:43:47.214Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1802026-05-01T17:43:47.427Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1812026-05-01T17:43:47.451ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1822026-05-01T17:43:47.451Zcreating virtual hardware
1832026-05-01T17:43:47.451Zcreating /scratch/m2_0.vdev
1842026-05-01T17:43:47.451Zcreating /scratch/m2_1.vdev
1852026-05-01T17:43:47.451Zcreating /scratch/u2_0.vdev
1862026-05-01T17:43:47.451Zcreating /scratch/u2_1.vdev
1872026-05-01T17:43:47.451Zcreating /scratch/u2_2.vdev
1882026-05-01T17:43:47.451Zcreating /scratch/u2_3.vdev
1892026-05-01T17:43:47.451Zcreating /scratch/u2_4.vdev
1902026-05-01T17:43:47.451Zcreating /scratch/u2_5.vdev
1912026-05-01T17:43:47.451Zcreating /scratch/u2_6.vdev
1922026-05-01T17:43:47.451Zcreating /scratch/u2_7.vdev
1932026-05-01T17:43:47.451Zcreating /scratch/u2_8.vdev
1942026-05-01T17:43:47.475ZSimnet net0/sc0_0 exists
1952026-05-01T17:43:47.475ZSimnet net1/sc1_0 exists
1962026-05-01T17:43:47.499ZVnic sc0_1 exists
1972026-05-01T17:44:00.297ZUsing 10.151.1.100 as gateway ip
1982026-05-01T17:44:00.297Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1992026-05-01T17:44:00.297Zconfiguring SoftNPU ARP entry
2002026-05-01T17:44:00.322Zconfiguring SoftNPU proxy ARP
2012026-05-01T17:44:00.372ZSoftNPU state:
2022026-05-01T17:44:00.372Z local v6:
2032026-05-01T17:44:00.372Z local v4:
2042026-05-01T17:44:00.372Z router v6_idx:
2052026-05-01T17:44:00.372Z router v6_routes:
2062026-05-01T17:44:00.372Z router v4_idx:
2072026-05-01T17:44:00.372Z router v4_routes:
2082026-05-01T17:44:00.372Z resolver v4:
2092026-05-01T17:44:00.372Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
2102026-05-01T17:44:00.372Z resolver v6:
2112026-05-01T17:44:00.372Z nat v4:
2122026-05-01T17:44:00.372Z nat_v6:
2132026-05-01T17:44:00.372Z attached subnet v4:
2142026-05-01T17:44:00.372Z attached subnet v6:
2152026-05-01T17:44:00.372Z port_mac:
2162026-05-01T17:44:00.372Z proxy arp:
2172026-05-01T17:44:00.373Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
2182026-05-01T17:44:00.373Zcreated virtual hardware
2192026-05-01T17:44:00.397Z
2202026-05-01T17:44:00.397Zreal 12.942387120
2212026-05-01T17:44:00.397Zuser 0.651752585
2222026-05-01T17:44:00.397Zsys 3.187546292
2232026-05-01T17:44:00.397Ztrap 0.000086558
2242026-05-01T17:44:00.397Ztflt 0.000270665
2252026-05-01T17:44:00.397Zdflt 0.000576420
2262026-05-01T17:44:00.397Zkflt 0.000002569
2272026-05-01T17:44:00.397Zlock 10:05.427670560
2282026-05-01T17:44:00.397Zslp 39.123097834
2292026-05-01T17:44:00.397Zlat 0.121407483
2302026-05-01T17:44:00.397Zstop 0.240579126
2312026-05-01T17:44:00.397Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2322026-05-01T17:44:00.435Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2332026-05-01T17:44:00.481Z+ diff -u pkg/config.toml~ pkg/config.toml
2342026-05-01T17:44:00.481Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2352026-05-01T17:44:00.481Z+++ pkg/config.toml Fri May 1 17:44:01 2026
2362026-05-01T17:44:00.481Z@@ -29,18 +29,18 @@
2372026-05-01T17:44:00.481Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2382026-05-01T17:44:00.481Z # followed by a string that is embedded into their fake serial values.
2392026-05-01T17:44:00.481Z vdevs = [
2402026-05-01T17:44:00.481Z- "m2_0.vdev",
2412026-05-01T17:44:00.481Z- "m2_1.vdev",
2422026-05-01T17:44:00.481Z+ "/scratch/m2_0.vdev",
2432026-05-01T17:44:00.481Z+ "/scratch/m2_1.vdev",
2442026-05-01T17:44:00.481Z
2452026-05-01T17:44:00.481Z- "u2_0.vdev",
2462026-05-01T17:44:00.481Z- "u2_1.vdev",
2472026-05-01T17:44:00.481Z- "u2_2.vdev",
2482026-05-01T17:44:00.481Z- "u2_3.vdev",
2492026-05-01T17:44:00.481Z- "u2_4.vdev",
2502026-05-01T17:44:00.481Z- "u2_5.vdev",
2512026-05-01T17:44:00.481Z- "u2_6.vdev",
2522026-05-01T17:44:00.482Z- "u2_7.vdev",
2532026-05-01T17:44:00.482Z- "u2_8.vdev",
2542026-05-01T17:44:00.482Z+ "/scratch/u2_0.vdev",
2552026-05-01T17:44:00.482Z+ "/scratch/u2_1.vdev",
2562026-05-01T17:44:00.482Z+ "/scratch/u2_2.vdev",
2572026-05-01T17:44:00.482Z+ "/scratch/u2_3.vdev",
2582026-05-01T17:44:00.482Z+ "/scratch/u2_4.vdev",
2592026-05-01T17:44:00.482Z+ "/scratch/u2_5.vdev",
2602026-05-01T17:44:00.482Z+ "/scratch/u2_6.vdev",
2612026-05-01T17:44:00.482Z+ "/scratch/u2_7.vdev",
2622026-05-01T17:44:00.482Z+ "/scratch/u2_8.vdev",
2632026-05-01T17:44:00.482Z ]
2642026-05-01T17:44:00.482Z
2652026-05-01T17:44:00.482Z # The amount of memory held back for services which exist between zero and one
2662026-05-01T17:44:00.482Z+ true
2672026-05-01T17:44:00.482Z++ grep -c -E 'u2.*\.vdev' pkg/config.toml
2682026-05-01T17:44:00.482Z+ EXPECTED_ZPOOL_COUNT=9
2692026-05-01T17:44:00.482Z+ echo 'expected number of zpools is 9'
2702026-05-01T17:44:00.482Zexpected number of zpools is 9
2712026-05-01T17:44:00.482Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2722026-05-01T17:44:00.483Z+ SILO_NAME=recovery
2732026-05-01T17:44:00.483Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2742026-05-01T17:44:00.483Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2752026-05-01T17:44:00.483Z+ sed -i~ '
2762026-05-01T17:44:00.483Z /^external_dns_ips/c\
2772026-05-01T17:44:00.483Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2782026-05-01T17:44:00.483Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2792026-05-01T17:44:00.483Z /^first/c\
2802026-05-01T17:44:00.483Zfirst = "10.151.1.164"
2812026-05-01T17:44:00.483Z /^last/c\
2822026-05-01T17:44:00.484Zlast = "10.151.1.173"
2832026-05-01T17:44:00.484Z }
2842026-05-01T17:44:00.484Z /^infra_ip_first/c\
2852026-05-01T17:44:00.484Zinfra_ip_first = "10.151.1.174"
2862026-05-01T17:44:00.484Z /^infra_ip_last/c\
2872026-05-01T17:44:00.484Zinfra_ip_last = "10.151.1.174"
2882026-05-01T17:44:00.484Z /^\[\[rack_network_config.ports/,/^$/ {
2892026-05-01T17:44:00.484Z /^routes/c\
2902026-05-01T17:44:00.484Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2912026-05-01T17:44:00.484Z /^addresses/c\
2922026-05-01T17:44:00.484Zaddresses = \[{address = {type = "static", ip_net = "10.151.1.174/24"} }\]
2932026-05-01T17:44:00.484Z }
2942026-05-01T17:44:00.484Z' pkg/config-rss.toml
2952026-05-01T17:44:00.484Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2962026-05-01T17:44:00.484Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2972026-05-01T17:44:00.484Z+++ pkg/config-rss.toml Fri May 1 17:44:01 2026
2982026-05-01T17:44:00.484Z@@ -33,7 +33,7 @@
2992026-05-01T17:44:00.484Z # the DNS domain delegated to the rack by the customer. Each of these addresses
3002026-05-01T17:44:00.484Z # must be contained in one of the "internal services" IP Pool ranges listed
3012026-05-01T17:44:00.484Z # below.
3022026-05-01T17:44:00.484Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
3032026-05-01T17:44:00.484Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
3042026-05-01T17:44:00.484Z
3052026-05-01T17:44:00.484Z # Initial TLS certificates for the external API
3062026-05-01T17:44:00.484Z #
3072026-05-01T17:44:00.484Z@@ -69,8 +69,8 @@
3082026-05-01T17:44:00.484Z #
3092026-05-01T17:44:00.484Z # For more on this and what to put here, see docs/how-to-run.adoc.
3102026-05-01T17:44:00.484Z [[internal_services_ip_pool_ranges]]
3112026-05-01T17:44:00.484Z-first = "192.168.1.20"
3122026-05-01T17:44:00.484Z-last = "192.168.1.29"
3132026-05-01T17:44:00.484Z+first = "10.151.1.164"
3142026-05-01T17:44:00.484Z+last = "10.151.1.173"
3152026-05-01T17:44:00.484Z
3162026-05-01T17:44:00.484Z # TODO - this configuration is subject to change going forward. Ultimately these
3172026-05-01T17:44:00.484Z # parameters should be provided to the control plane via wicket, but we need to
3182026-05-01T17:44:00.484Z@@ -91,8 +91,8 @@
3192026-05-01T17:44:00.485Z # A range of IP addresses used by Boundary Services on the external network. In
3202026-05-01T17:44:00.485Z # a real system, these would be addresses of the uplink ports on the Sidecar.
3212026-05-01T17:44:00.485Z # With softnpu, only one address is used.
3222026-05-01T17:44:00.485Z-infra_ip_first = "192.168.1.30"
3232026-05-01T17:44:00.485Z-infra_ip_last = "192.168.1.30"
3242026-05-01T17:44:00.485Z+infra_ip_first = "10.151.1.174"
3252026-05-01T17:44:00.485Z+infra_ip_last = "10.151.1.174"
3262026-05-01T17:44:00.485Z
3272026-05-01T17:44:00.485Z # Configurations for BGP routers to run on the scrimlets.
3282026-05-01T17:44:00.485Z bgp = []
3292026-05-01T17:44:00.485Z@@ -100,9 +100,9 @@
3302026-05-01T17:44:00.485Z # You can configure multiple uplinks by repeating the following stanza
3312026-05-01T17:44:00.485Z [[rack_network_config.ports]]
3322026-05-01T17:44:00.485Z # Routes associated with this port.
3332026-05-01T17:44:00.510Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3342026-05-01T17:44:00.510Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3352026-05-01T17:44:00.510Z # Addresses associated with this port.
3362026-05-01T17:44:00.510Z-addresses = [{address = {type = "static", ip_net = "192.168.1.30/24"}}]
3372026-05-01T17:44:00.510Z+addresses = [{address = {type = "static", ip_net = "10.151.1.174/24"} }]
3382026-05-01T17:44:00.510Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3392026-05-01T17:44:00.510Z port = "qsfp0"
3402026-05-01T17:44:00.510Z # The speed of this port.
3412026-05-01T17:44:00.510Z+ true
3422026-05-01T17:44:00.510Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3432026-05-01T17:44:00.510Za pkg/config-rss.toml 8K
3442026-05-01T17:44:00.510Za pkg/config.toml 6K
3452026-05-01T17:44:00.510Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3462026-05-01T17:44:00.510Z+ TLS_NAME=recovery.sys.oxide.test
3472026-05-01T17:44:00.510Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3482026-05-01T17:44:00.608Z.+....+..+..........+.........+.....+...+.+..............+......+....+..+...+.+...........+.........................+...+........+.......+..+.....................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*............+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3492026-05-01T17:44:01.309Z...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+..........+.....+.........+...+.+............+...+.....+.........+...+....+......+.....+.........+...+.+..+.......+..+...+......+.+......+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..........+..............+.........+.......+..............+...+.......+...+........+...+.+.....+...+................+...........+.+..+.......+...+........+............+.......+..................+......+..............+.............+...+......+......+..+...+..........+...+...........+.....................+..................+.+...+...+........+.+........+............+......+.......+..+.+.....+.............+...........+....+.....+..........+..+.........+...+.+.................+...+.......+..+......+.+.....+.+.................................+.....+..........+.....+.+.....+...+.+..............+..........+...+.....+....+.....+.+.....+..........+............+.....+...+...............+.......+..................+...+..+....+......+.........+...........+...+....+..+.+.....+............+......+.+........+...............+.+......+......+.....+.................................+....+........+.......+.....+......+.+...+.....+...+...+....+............+......+........+....+.................+....+.....+................+..............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3502026-05-01T17:44:01.333Z-----
3512026-05-01T17:44:01.357Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3522026-05-01T17:44:01.357Za pkg/initial-tls-cert.pem 2K
3532026-05-01T17:44:01.357Za pkg/initial-tls-key.pem 4K
3542026-05-01T17:44:01.357Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3552026-05-01T17:44:01.357Z+ rmdir pkg
3562026-05-01T17:44:01.357Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3572026-05-01T17:44:01.357Z+ pfexec mkdir -p /usr/oxide
3582026-05-01T17:44:01.357Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v2025112000
3592026-05-01T17:44:07.046Z+ pfexec chmod +x /usr/oxide/oxide
3602026-05-01T17:44:07.070Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3612026-05-01T17:44:25.481Z+ OMICRON_NO_UNINSTALL=1
3622026-05-01T17:44:25.481Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3632026-05-01T17:44:25.505ZLogging to: /opt/oxide/work/out/LOG
3642026-05-01T17:44:26.320Z
3652026-05-01T17:44:26.320Zreal 0.833328930
3662026-05-01T17:44:26.320Zuser 0.179564151
3672026-05-01T17:44:26.344Zsys 4.659343925
3682026-05-01T17:44:26.344Ztrap 0.000005369
3692026-05-01T17:44:26.344Ztflt 0.000060130
3702026-05-01T17:44:26.344Zdflt 0.000174435
3712026-05-01T17:44:26.344Zkflt 0.000001080
3722026-05-01T17:44:26.344Zlock 1:15.286981529
3732026-05-01T17:44:26.344Zslp 1.038470409
3742026-05-01T17:44:26.344Zlat 0.037874231
3752026-05-01T17:44:26.344Zstop 0.073542552
3762026-05-01T17:44:26.344Z+ retry=0
3772026-05-01T17:44:26.344Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3782026-05-01T17:44:26.344Zcurl: (7) Failed to connect to fd00:1122:3344:101::2 port 12224 after 0 ms: Could not connect to server
3792026-05-01T17:44:26.344Z+ [[ 0 -gt 30 ]]
3802026-05-01T17:44:26.344Z+ sleep 1
3812026-05-01T17:44:27.335Z+ retry=1
3822026-05-01T17:44:27.336Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3832026-05-01T17:44:27.360Zcurl: (7) Failed to connect to fd00:1122:3344:101::2 port 12224 after 0 ms: Could not connect to server
3842026-05-01T17:44:27.360Z+ [[ 1 -gt 30 ]]
3852026-05-01T17:44:27.360Z+ sleep 1
3862026-05-01T17:44:28.350Z+ retry=2
3872026-05-01T17:44:28.350Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3882026-05-01T17:44:28.374Zcurl: (7) Failed to connect to fd00:1122:3344:101::2 port 12224 after 0 ms: Could not connect to server
3892026-05-01T17:44:28.374Z+ [[ 2 -gt 30 ]]
3902026-05-01T17:44:28.374Z+ sleep 1
3912026-05-01T17:44:29.365Z+ retry=3
3922026-05-01T17:44:29.365Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3932026-05-01T17:44:30.377Zcurl: (28) Connection timed out after 1000 milliseconds
3942026-05-01T17:44:30.401Z+ [[ 3 -gt 30 ]]
3952026-05-01T17:44:30.401Z+ sleep 1
3962026-05-01T17:44:31.382Z+ retry=4
3972026-05-01T17:44:31.382Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3982026-05-01T17:44:32.393Zcurl: (28) Connection timed out after 1000 milliseconds
3992026-05-01T17:44:32.417Z+ [[ 4 -gt 30 ]]
4002026-05-01T17:44:32.417Z+ sleep 1
4012026-05-01T17:44:33.399Z+ retry=5
4022026-05-01T17:44:33.399Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4032026-05-01T17:44:34.411Zcurl: (28) Connection timed out after 1000 milliseconds
4042026-05-01T17:44:34.435Z+ [[ 5 -gt 30 ]]
4052026-05-01T17:44:34.435Z+ sleep 1
4062026-05-01T17:44:35.417Z+ retry=6
4072026-05-01T17:44:35.417Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4082026-05-01T17:44:36.430Zcurl: (28) Connection timed out after 1000 milliseconds
4092026-05-01T17:44:36.454Z+ [[ 6 -gt 30 ]]
4102026-05-01T17:44:36.454Z+ sleep 1
4112026-05-01T17:44:37.436Z+ retry=7
4122026-05-01T17:44:37.436Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4132026-05-01T17:44:38.448Zcurl: (28) Connection timed out after 1000 milliseconds
4142026-05-01T17:44:38.472Z+ [[ 7 -gt 30 ]]
4152026-05-01T17:44:38.472Z+ sleep 1
4162026-05-01T17:44:39.454Z+ retry=8
4172026-05-01T17:44:39.454Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4182026-05-01T17:44:40.465Zcurl: (28) Connection timed out after 1000 milliseconds
4192026-05-01T17:44:40.489Z+ [[ 8 -gt 30 ]]
4202026-05-01T17:44:40.489Z+ sleep 1
4212026-05-01T17:44:41.471Z+ retry=9
4222026-05-01T17:44:41.471Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4232026-05-01T17:44:42.484Zcurl: (28) Connection timed out after 1000 milliseconds
4242026-05-01T17:44:42.508Z+ [[ 9 -gt 30 ]]
4252026-05-01T17:44:42.508Z+ sleep 1
4262026-05-01T17:44:43.490Z+ retry=10
4272026-05-01T17:44:43.490Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4282026-05-01T17:44:44.502Zcurl: (28) Connection timed out after 1000 milliseconds
4292026-05-01T17:44:44.526Z+ [[ 10 -gt 30 ]]
4302026-05-01T17:44:44.526Z+ sleep 1
4312026-05-01T17:44:45.507Z+ retry=11
4322026-05-01T17:44:45.507Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4332026-05-01T17:44:46.520Zcurl: (28) Connection timed out after 1000 milliseconds
4342026-05-01T17:44:46.544Z+ [[ 11 -gt 30 ]]
4352026-05-01T17:44:46.544Z+ sleep 1
4362026-05-01T17:44:47.524Z+ retry=12
4372026-05-01T17:44:47.524Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4382026-05-01T17:44:48.535Zcurl: (28) Connection timed out after 1000 milliseconds
4392026-05-01T17:44:48.559Z+ [[ 12 -gt 30 ]]
4402026-05-01T17:44:48.559Z+ sleep 1
4412026-05-01T17:44:49.540Z+ retry=13
4422026-05-01T17:44:49.540Z+ curl --max-time 1 --head --silent --show-error -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
4432026-05-01T17:44:49.565Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
4442026-05-01T17:44:49.589Zlocal v6:
4452026-05-01T17:44:49.589Zfd61:8303:abdc:ec9f::1
4462026-05-01T17:44:49.589Zfe80::d03e:5cff:fee3:e8fa
4472026-05-01T17:44:49.589Zlocal v4:
4482026-05-01T17:44:49.589Zrouter v6_idx:
4492026-05-01T17:44:49.589Zrouter v6_routes:
4502026-05-01T17:44:49.589Zrouter v4_idx:
4512026-05-01T17:44:49.589Zrouter v4_routes:
4522026-05-01T17:44:49.589Zresolver v4:
4532026-05-01T17:44:49.589Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
4542026-05-01T17:44:49.589Zresolver v6:
4552026-05-01T17:44:49.589Zfe80::d03e:5cff:fee3:e8fa -> d2:3e:5c:e3:e8:fa
4562026-05-01T17:44:49.589Znat v4:
4572026-05-01T17:44:49.589Znat_v6:
4582026-05-01T17:44:49.589Zattached subnet v4:
4592026-05-01T17:44:49.589Zattached subnet v6:
4602026-05-01T17:44:49.589Zport_mac:
4612026-05-01T17:44:49.589Z1: a8:40:25:12:57:3a
4622026-05-01T17:44:49.589Z1000: a8:40:25:12:57:39
4632026-05-01T17:44:49.589Zproxy arp:
4642026-05-01T17:44:49.589Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
4652026-05-01T17:44:49.589Z+ retry=0
4662026-05-01T17:44:49.613Z+++ zoneadm list -n
4672026-05-01T17:44:49.613Z+++ grep oxz_ntp
4682026-05-01T17:44:49.613Z++ pfexec svcs -z -Hostate oxide/ntp
4692026-05-01T17:44:49.613Zsvcs: zone '-Hostate': entity not found
4702026-05-01T17:44:49.613Z++ true
4712026-05-01T17:44:49.613Z+ [[ '' != online ]]
4722026-05-01T17:44:49.613Z+ [[ 0 -gt 60 ]]
4732026-05-01T17:44:49.613Z+ sleep 1
4742026-05-01T17:44:50.613Z+ retry=1
4752026-05-01T17:44:50.637Z+++ zoneadm list -n
4762026-05-01T17:44:50.637Z+++ grep oxz_ntp
4772026-05-01T17:44:50.637Z++ pfexec svcs -z -Hostate oxide/ntp
4782026-05-01T17:44:50.637Zsvcs: zone '-Hostate': entity not found
4792026-05-01T17:44:50.637Z++ true
4802026-05-01T17:44:50.637Z+ [[ '' != online ]]
4812026-05-01T17:44:50.637Z+ [[ 1 -gt 60 ]]
4822026-05-01T17:44:50.637Z+ sleep 1
4832026-05-01T17:44:51.634Z+ retry=2
4842026-05-01T17:44:51.658Z+++ zoneadm list -n
4852026-05-01T17:44:51.658Z+++ grep oxz_ntp
4862026-05-01T17:44:51.658Z++ pfexec svcs -z -Hostate oxide/ntp
4872026-05-01T17:44:51.658Zsvcs: zone '-Hostate': entity not found
4882026-05-01T17:44:51.658Z++ true
4892026-05-01T17:44:51.658Z+ [[ '' != online ]]
4902026-05-01T17:44:51.658Z+ [[ 2 -gt 60 ]]
4912026-05-01T17:44:51.658Z+ sleep 1
4922026-05-01T17:44:52.657Z+ retry=3
4932026-05-01T17:44:52.681Z+++ zoneadm list -n
4942026-05-01T17:44:52.681Z+++ grep oxz_ntp
4952026-05-01T17:44:52.681Z++ pfexec svcs -z -Hostate oxide/ntp
4962026-05-01T17:44:52.681Zsvcs: zone '-Hostate': entity not found
4972026-05-01T17:44:52.681Z++ true
4982026-05-01T17:44:52.681Z+ [[ '' != online ]]
4992026-05-01T17:44:52.681Z+ [[ 3 -gt 60 ]]
5002026-05-01T17:44:52.681Z+ sleep 1
5012026-05-01T17:44:53.677Z+ retry=4
5022026-05-01T17:44:53.701Z+++ zoneadm list -n
5032026-05-01T17:44:53.701Z+++ grep oxz_ntp
5042026-05-01T17:44:53.701Z++ pfexec svcs -z -Hostate oxide/ntp
5052026-05-01T17:44:53.701Zsvcs: zone '-Hostate': entity not found
5062026-05-01T17:44:53.701Z++ true
5072026-05-01T17:44:53.701Z+ [[ '' != online ]]
5082026-05-01T17:44:53.701Z+ [[ 4 -gt 60 ]]
5092026-05-01T17:44:53.701Z+ sleep 1
5102026-05-01T17:44:54.699Z+ retry=5
5112026-05-01T17:44:54.723Z+++ zoneadm list -n
5122026-05-01T17:44:54.723Z+++ grep oxz_ntp
5132026-05-01T17:44:54.723Z++ pfexec svcs -z -Hostate oxide/ntp
5142026-05-01T17:44:54.723Zsvcs: zone '-Hostate': entity not found
5152026-05-01T17:44:54.723Z++ true
5162026-05-01T17:44:54.723Z+ [[ '' != online ]]
5172026-05-01T17:44:54.723Z+ [[ 5 -gt 60 ]]
5182026-05-01T17:44:54.723Z+ sleep 1
5192026-05-01T17:44:55.722Z+ retry=6
5202026-05-01T17:44:55.747Z+++ zoneadm list -n
5212026-05-01T17:44:55.747Z+++ grep oxz_ntp
5222026-05-01T17:44:55.747Z++ pfexec svcs -z -Hostate oxide/ntp
5232026-05-01T17:44:55.747Zsvcs: zone '-Hostate': entity not found
5242026-05-01T17:44:55.747Z++ true
5252026-05-01T17:44:55.747Z+ [[ '' != online ]]
5262026-05-01T17:44:55.747Z+ [[ 6 -gt 60 ]]
5272026-05-01T17:44:55.747Z+ sleep 1
5282026-05-01T17:44:56.744Z+ retry=7
5292026-05-01T17:44:56.768Z+++ zoneadm list -n
5302026-05-01T17:44:56.768Z+++ grep oxz_ntp
5312026-05-01T17:44:56.768Z++ pfexec svcs -z -Hostate oxide/ntp
5322026-05-01T17:44:56.768Zsvcs: zone '-Hostate': entity not found
5332026-05-01T17:44:56.768Z++ true
5342026-05-01T17:44:56.768Z+ [[ '' != online ]]
5352026-05-01T17:44:56.768Z+ [[ 7 -gt 60 ]]
5362026-05-01T17:44:56.769Z+ sleep 1
5372026-05-01T17:44:57.767Z+ retry=8
5382026-05-01T17:44:57.791Z+++ zoneadm list -n
5392026-05-01T17:44:57.791Z+++ grep oxz_ntp
5402026-05-01T17:44:57.791Z++ pfexec svcs -z -Hostate oxide/ntp
5412026-05-01T17:44:57.791Zsvcs: zone '-Hostate': entity not found
5422026-05-01T17:44:57.791Z++ true
5432026-05-01T17:44:57.791Z+ [[ '' != online ]]
5442026-05-01T17:44:57.791Z+ [[ 8 -gt 60 ]]
5452026-05-01T17:44:57.791Z+ sleep 1
5462026-05-01T17:44:58.788Z+ retry=9
5472026-05-01T17:44:58.813Z+++ zoneadm list -n
5482026-05-01T17:44:58.813Z+++ grep oxz_ntp
5492026-05-01T17:44:58.813Z++ pfexec svcs -z -Hostate oxide/ntp
5502026-05-01T17:44:58.813Zsvcs: zone '-Hostate': entity not found
5512026-05-01T17:44:58.813Z++ true
5522026-05-01T17:44:58.813Z+ [[ '' != online ]]
5532026-05-01T17:44:58.813Z+ [[ 9 -gt 60 ]]
5542026-05-01T17:44:58.813Z+ sleep 1
5552026-05-01T17:44:59.811Z+ retry=10
5562026-05-01T17:44:59.836Z+++ zoneadm list -n
5572026-05-01T17:44:59.836Z+++ grep oxz_ntp
5582026-05-01T17:44:59.836Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
5592026-05-01T17:44:59.873Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
5602026-05-01T17:44:59.898Z++ true
5612026-05-01T17:44:59.898Z+ [[ '' != online ]]
5622026-05-01T17:44:59.898Z+ [[ 10 -gt 60 ]]
5632026-05-01T17:44:59.898Z+ sleep 1
5642026-05-01T17:45:00.879Z+ retry=11
5652026-05-01T17:45:00.907Z+++ zoneadm list -n
5662026-05-01T17:45:00.907Z+++ grep oxz_ntp
5672026-05-01T17:45:00.907Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
5682026-05-01T17:45:00.932Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
5692026-05-01T17:45:00.932Z++ true
5702026-05-01T17:45:00.932Z+ [[ '' != online ]]
5712026-05-01T17:45:00.932Z+ [[ 11 -gt 60 ]]
5722026-05-01T17:45:00.932Z+ sleep 1
5732026-05-01T17:45:01.917Z+ retry=12
5742026-05-01T17:45:01.941Z+++ zoneadm list -n
5752026-05-01T17:45:01.941Z+++ grep oxz_ntp
5762026-05-01T17:45:01.941Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
5772026-05-01T17:45:01.941Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
5782026-05-01T17:45:01.941Z++ true
5792026-05-01T17:45:01.942Z+ [[ '' != online ]]
5802026-05-01T17:45:01.942Z+ [[ 12 -gt 60 ]]
5812026-05-01T17:45:01.942Z+ sleep 1
5822026-05-01T17:45:02.939Z+ retry=13
5832026-05-01T17:45:02.964Z+++ zoneadm list -n
5842026-05-01T17:45:02.964Z+++ grep oxz_ntp
5852026-05-01T17:45:02.964Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
5862026-05-01T17:45:02.964Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
5872026-05-01T17:45:02.989Z++ true
5882026-05-01T17:45:02.989Z+ [[ '' != online ]]
5892026-05-01T17:45:02.989Z+ [[ 13 -gt 60 ]]
5902026-05-01T17:45:02.989Z+ sleep 1
5912026-05-01T17:45:03.968Z+ retry=14
5922026-05-01T17:45:03.992Z+++ zoneadm list -n
5932026-05-01T17:45:03.992Z+++ grep oxz_ntp
5942026-05-01T17:45:03.992Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
5952026-05-01T17:45:03.992Z+ [[ offline != online ]]
5962026-05-01T17:45:03.992Z+ [[ 14 -gt 60 ]]
5972026-05-01T17:45:03.992Z+ sleep 1
5982026-05-01T17:45:04.991Z+ retry=15
5992026-05-01T17:45:05.015Z+++ zoneadm list -n
6002026-05-01T17:45:05.016Z+++ grep oxz_ntp
6012026-05-01T17:45:05.016Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
6022026-05-01T17:45:05.016Z+ [[ offline != online ]]
6032026-05-01T17:45:05.016Z+ [[ 15 -gt 60 ]]
6042026-05-01T17:45:05.016Z+ sleep 1
6052026-05-01T17:45:06.014Z+ retry=16
6062026-05-01T17:45:06.038Z+++ zoneadm list -n
6072026-05-01T17:45:06.038Z+++ grep oxz_ntp
6082026-05-01T17:45:06.038Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
6092026-05-01T17:45:06.038Z+ [[ offline != online ]]
6102026-05-01T17:45:06.038Z+ [[ 16 -gt 60 ]]
6112026-05-01T17:45:06.038Z+ sleep 1
6122026-05-01T17:45:07.040Z+ retry=17
6132026-05-01T17:45:07.065Z+++ zoneadm list -n
6142026-05-01T17:45:07.065Z+++ grep oxz_ntp
6152026-05-01T17:45:07.065Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
6162026-05-01T17:45:07.065Z+ [[ offline != online ]]
6172026-05-01T17:45:07.065Z+ [[ 17 -gt 60 ]]
6182026-05-01T17:45:07.065Z+ sleep 1
6192026-05-01T17:45:08.063Z+ retry=18
6202026-05-01T17:45:08.088Z+++ zoneadm list -n
6212026-05-01T17:45:08.088Z+++ grep oxz_ntp
6222026-05-01T17:45:08.088Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
6232026-05-01T17:45:08.088Z+ [[ offline != online ]]
6242026-05-01T17:45:08.088Z+ [[ 18 -gt 60 ]]
6252026-05-01T17:45:08.088Z+ sleep 1
6262026-05-01T17:45:09.086Z+ retry=19
6272026-05-01T17:45:09.110Z+++ zoneadm list -n
6282026-05-01T17:45:09.110Z+++ grep oxz_ntp
6292026-05-01T17:45:09.110Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
6302026-05-01T17:45:09.110Z+ [[ offline != online ]]
6312026-05-01T17:45:09.111Z+ [[ 19 -gt 60 ]]
6322026-05-01T17:45:09.111Z+ sleep 1
6332026-05-01T17:45:10.108Z+ retry=20
6342026-05-01T17:45:10.133Z+++ zoneadm list -n
6352026-05-01T17:45:10.133Z+++ grep oxz_ntp
6362026-05-01T17:45:10.133Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
6372026-05-01T17:45:10.133Z+ [[ offline != online ]]
6382026-05-01T17:45:10.133Z+ [[ 20 -gt 60 ]]
6392026-05-01T17:45:10.133Z+ sleep 1
6402026-05-01T17:45:11.130Z+ retry=21
6412026-05-01T17:45:11.155Z+++ zoneadm list -n
6422026-05-01T17:45:11.155Z+++ grep oxz_ntp
6432026-05-01T17:45:11.155Z++ pfexec svcs -z oxz_ntp_1305a132-0669-493b-a551-d62614c9de47 -Hostate oxide/ntp
6442026-05-01T17:45:11.155Z+ [[ online != online ]]
6452026-05-01T17:45:11.155Z+ echo 'Waited for chrony: 21s'
6462026-05-01T17:45:11.155Z+ retry=0
6472026-05-01T17:45:11.155ZWaited for chrony: 21s
6482026-05-01T17:45:11.155Z+ zoneadm list
6492026-05-01T17:45:11.155Z+ grep nexus
6502026-05-01T17:45:11.179Z+ [[ 0 -gt 300 ]]
6512026-05-01T17:45:11.179Z+ sleep 1
6522026-05-01T17:45:12.160Z+ retry=1
6532026-05-01T17:45:12.185Z+ zoneadm list
6542026-05-01T17:45:12.185Z+ grep nexus
6552026-05-01T17:45:12.185Z+ [[ 1 -gt 300 ]]
6562026-05-01T17:45:12.185Z+ sleep 1
6572026-05-01T17:45:13.170Z+ retry=2
6582026-05-01T17:45:13.195Z+ zoneadm list
6592026-05-01T17:45:13.195Z+ grep nexus
6602026-05-01T17:45:13.195Z+ [[ 2 -gt 300 ]]
6612026-05-01T17:45:13.195Z+ sleep 1
6622026-05-01T17:45:14.181Z+ retry=3
6632026-05-01T17:45:14.205Z+ zoneadm list
6642026-05-01T17:45:14.205Z+ grep nexus
6652026-05-01T17:45:14.205Z+ [[ 3 -gt 300 ]]
6662026-05-01T17:45:14.206Z+ sleep 1
6672026-05-01T17:45:15.198Z+ retry=4
6682026-05-01T17:45:15.226Z+ zoneadm list
6692026-05-01T17:45:15.226Z+ grep nexus
6702026-05-01T17:45:15.226Z+ [[ 4 -gt 300 ]]
6712026-05-01T17:45:15.226Z+ sleep 1
6722026-05-01T17:45:16.212Z+ retry=5
6732026-05-01T17:45:16.236Z+ zoneadm list
6742026-05-01T17:45:16.236Z+ grep nexus
6752026-05-01T17:45:16.237Z+ [[ 5 -gt 300 ]]
6762026-05-01T17:45:16.237Z+ sleep 1
6772026-05-01T17:45:17.227Z+ retry=6
6782026-05-01T17:45:17.280Z+ zoneadm list
6792026-05-01T17:45:17.304Z+ grep nexus
6802026-05-01T17:45:17.414Z+ [[ 6 -gt 300 ]]
6812026-05-01T17:45:17.414Z+ sleep 1
6822026-05-01T17:45:19.811Z+ retry=7
6832026-05-01T17:45:19.837Z+ zoneadm list
6842026-05-01T17:45:19.837Z+ grep nexus
6852026-05-01T17:45:19.837Z+ [[ 7 -gt 300 ]]
6862026-05-01T17:45:19.837Z+ sleep 1
6872026-05-01T17:45:20.840Z+ retry=8
6882026-05-01T17:45:20.865Z+ zoneadm list
6892026-05-01T17:45:20.865Z+ grep nexus
6902026-05-01T17:45:20.865Z+ [[ 8 -gt 300 ]]
6912026-05-01T17:45:20.865Z+ sleep 1
6922026-05-01T17:45:21.855Z+ retry=9
6932026-05-01T17:45:21.879Z+ zoneadm list
6942026-05-01T17:45:21.879Z+ grep nexus
6952026-05-01T17:45:21.879Z+ [[ 9 -gt 300 ]]
6962026-05-01T17:45:21.879Z+ sleep 1
6972026-05-01T17:45:22.873Z+ retry=10
6982026-05-01T17:45:22.897Z+ zoneadm list
6992026-05-01T17:45:22.897Z+ grep nexus
7002026-05-01T17:45:22.897Z+ [[ 10 -gt 300 ]]
7012026-05-01T17:45:22.897Z+ sleep 1
7022026-05-01T17:45:23.888Z+ retry=11
7032026-05-01T17:45:23.913Z+ zoneadm list
7042026-05-01T17:45:23.913Z+ grep nexus
7052026-05-01T17:45:23.913Z+ [[ 11 -gt 300 ]]
7062026-05-01T17:45:23.913Z+ sleep 1
7072026-05-01T17:45:24.906Z+ retry=12
7082026-05-01T17:45:24.930Z+ zoneadm list
7092026-05-01T17:45:24.931Z+ grep nexus
7102026-05-01T17:45:24.931Z+ [[ 12 -gt 300 ]]
7112026-05-01T17:45:24.931Z+ sleep 1
7122026-05-01T17:45:25.922Z+ retry=13
7132026-05-01T17:45:25.946Z+ zoneadm list
7142026-05-01T17:45:25.946Z+ grep nexus
7152026-05-01T17:45:25.946Z+ [[ 13 -gt 300 ]]
7162026-05-01T17:45:25.946Z+ sleep 1
7172026-05-01T17:45:26.943Z+ retry=14
7182026-05-01T17:45:26.968Z+ zoneadm list
7192026-05-01T17:45:26.968Z+ grep nexus
7202026-05-01T17:45:26.968Z+ [[ 14 -gt 300 ]]
7212026-05-01T17:45:26.968Z+ sleep 1
7222026-05-01T17:45:27.965Z+ retry=15
7232026-05-01T17:45:27.989Z+ zoneadm list
7242026-05-01T17:45:27.990Z+ grep nexus
7252026-05-01T17:45:27.990Z+ [[ 15 -gt 300 ]]
7262026-05-01T17:45:27.990Z+ sleep 1
7272026-05-01T17:45:28.982Z+ retry=16
7282026-05-01T17:45:29.008Z+ zoneadm list
7292026-05-01T17:45:29.008Z+ grep nexus
7302026-05-01T17:45:29.008Z+ [[ 16 -gt 300 ]]
7312026-05-01T17:45:29.008Z+ sleep 1
7322026-05-01T17:45:30.005Z+ retry=17
7332026-05-01T17:45:30.029Z+ zoneadm list
7342026-05-01T17:45:30.029Z+ grep nexus
7352026-05-01T17:45:30.029Z+ [[ 17 -gt 300 ]]
7362026-05-01T17:45:30.029Z+ sleep 1
7372026-05-01T17:45:31.024Z+ retry=18
7382026-05-01T17:45:31.049Z+ zoneadm list
7392026-05-01T17:45:31.049Z+ grep nexus
7402026-05-01T17:45:31.049Z+ [[ 18 -gt 300 ]]
7412026-05-01T17:45:31.049Z+ sleep 1
7422026-05-01T17:45:32.038Z+ retry=19
7432026-05-01T17:45:32.063Z+ zoneadm list
7442026-05-01T17:45:32.063Z+ grep nexus
7452026-05-01T17:45:32.063Z+ [[ 19 -gt 300 ]]
7462026-05-01T17:45:32.063Z+ sleep 1
7472026-05-01T17:45:33.050Z+ retry=20
7482026-05-01T17:45:33.075Z+ zoneadm list
7492026-05-01T17:45:33.075Z+ grep nexus
7502026-05-01T17:45:33.075Z+ [[ 20 -gt 300 ]]
7512026-05-01T17:45:33.075Z+ sleep 1
7522026-05-01T17:45:34.062Z+ retry=21
7532026-05-01T17:45:34.087Z+ zoneadm list
7542026-05-01T17:45:34.087Z+ grep nexus
7552026-05-01T17:45:34.087Z+ [[ 21 -gt 300 ]]
7562026-05-01T17:45:34.087Z+ sleep 1
7572026-05-01T17:45:35.076Z+ retry=22
7582026-05-01T17:45:35.100Z+ zoneadm list
7592026-05-01T17:45:35.100Z+ grep nexus
7602026-05-01T17:45:35.100Z+ [[ 22 -gt 300 ]]
7612026-05-01T17:45:35.100Z+ sleep 1
7622026-05-01T17:45:36.086Z+ retry=23
7632026-05-01T17:45:36.111Z+ zoneadm list
7642026-05-01T17:45:36.111Z+ grep nexus
7652026-05-01T17:45:36.111Z+ [[ 23 -gt 300 ]]
7662026-05-01T17:45:36.111Z+ sleep 1
7672026-05-01T17:45:37.098Z+ retry=24
7682026-05-01T17:45:37.122Z+ zoneadm list
7692026-05-01T17:45:37.122Z+ grep nexus
7702026-05-01T17:45:37.122Z+ [[ 24 -gt 300 ]]
7712026-05-01T17:45:37.122Z+ sleep 1
7722026-05-01T17:45:38.110Z+ retry=25
7732026-05-01T17:45:38.135Z+ zoneadm list
7742026-05-01T17:45:38.135Z+ grep nexus
7752026-05-01T17:45:38.135Z+ [[ 25 -gt 300 ]]
7762026-05-01T17:45:38.135Z+ sleep 1
7772026-05-01T17:45:39.125Z+ retry=26
7782026-05-01T17:45:39.150Z+ zoneadm list
7792026-05-01T17:45:39.150Z+ grep nexus
7802026-05-01T17:45:39.150Z+ [[ 26 -gt 300 ]]
7812026-05-01T17:45:39.150Z+ sleep 1
7822026-05-01T17:45:40.138Z+ retry=27
7832026-05-01T17:45:40.163Z+ zoneadm list
7842026-05-01T17:45:40.163Z+ grep nexus
7852026-05-01T17:45:40.163Z+ [[ 27 -gt 300 ]]
7862026-05-01T17:45:40.163Z+ sleep 1
7872026-05-01T17:45:41.153Z+ retry=28
7882026-05-01T17:45:41.177Z+ zoneadm list
7892026-05-01T17:45:41.178Z+ grep nexus
7902026-05-01T17:45:41.178Z+ [[ 28 -gt 300 ]]
7912026-05-01T17:45:41.178Z+ sleep 1
7922026-05-01T17:45:42.166Z+ retry=29
7932026-05-01T17:45:42.191Z+ zoneadm list
7942026-05-01T17:45:42.191Z+ grep nexus
7952026-05-01T17:45:42.191Z+ [[ 29 -gt 300 ]]
7962026-05-01T17:45:42.191Z+ sleep 1
7972026-05-01T17:45:43.184Z+ retry=30
7982026-05-01T17:45:43.215Z+ zoneadm list
7992026-05-01T17:45:43.215Z+ grep nexus
8002026-05-01T17:45:43.215Z+ [[ 30 -gt 300 ]]
8012026-05-01T17:45:43.216Z+ sleep 1
8022026-05-01T17:45:44.197Z+ retry=31
8032026-05-01T17:45:44.222Z+ zoneadm list
8042026-05-01T17:45:44.222Z+ grep nexus
8052026-05-01T17:45:44.222Z+ [[ 31 -gt 300 ]]
8062026-05-01T17:45:44.222Z+ sleep 1
8072026-05-01T17:45:45.209Z+ retry=32
8082026-05-01T17:45:45.233Z+ zoneadm list
8092026-05-01T17:45:45.233Z+ grep nexus
8102026-05-01T17:45:45.233Z+ [[ 32 -gt 300 ]]
8112026-05-01T17:45:45.233Z+ sleep 1
8122026-05-01T17:45:46.221Z+ retry=33
8132026-05-01T17:45:46.246Z+ zoneadm list
8142026-05-01T17:45:46.246Z+ grep nexus
8152026-05-01T17:45:46.246Z+ [[ 33 -gt 300 ]]
8162026-05-01T17:45:46.246Z+ sleep 1
8172026-05-01T17:45:47.233Z+ retry=34
8182026-05-01T17:45:47.258Z+ zoneadm list
8192026-05-01T17:45:47.258Z+ grep nexus
8202026-05-01T17:45:47.258Z+ [[ 34 -gt 300 ]]
8212026-05-01T17:45:47.258Z+ sleep 1
8222026-05-01T17:45:48.246Z+ retry=35
8232026-05-01T17:45:48.274Z+ zoneadm list
8242026-05-01T17:45:48.274Z+ grep nexus
8252026-05-01T17:45:48.274Z+ [[ 35 -gt 300 ]]
8262026-05-01T17:45:48.274Z+ sleep 1
8272026-05-01T17:45:49.258Z+ retry=36
8282026-05-01T17:45:49.282Z+ zoneadm list
8292026-05-01T17:45:49.282Z+ grep nexus
8302026-05-01T17:45:49.282Z+ [[ 36 -gt 300 ]]
8312026-05-01T17:45:49.282Z+ sleep 1
8322026-05-01T17:45:50.270Z+ retry=37
8332026-05-01T17:45:50.296Z+ zoneadm list
8342026-05-01T17:45:50.296Z+ grep nexus
8352026-05-01T17:45:50.296Z+ [[ 37 -gt 300 ]]
8362026-05-01T17:45:50.296Z+ sleep 1
8372026-05-01T17:45:51.282Z+ retry=38
8382026-05-01T17:45:51.306Z+ zoneadm list
8392026-05-01T17:45:51.306Z+ grep nexus
8402026-05-01T17:45:51.306Z+ [[ 38 -gt 300 ]]
8412026-05-01T17:45:51.306Z+ sleep 1
8422026-05-01T17:45:52.294Z+ retry=39
8432026-05-01T17:45:52.318Z+ zoneadm list
8442026-05-01T17:45:52.318Z+ grep nexus
8452026-05-01T17:45:52.318Z+ [[ 39 -gt 300 ]]
8462026-05-01T17:45:52.318Z+ sleep 1
8472026-05-01T17:45:53.306Z+ retry=40
8482026-05-01T17:45:53.331Z+ zoneadm list
8492026-05-01T17:45:53.331Z+ grep nexus
8502026-05-01T17:45:53.331Z+ [[ 40 -gt 300 ]]
8512026-05-01T17:45:53.331Z+ sleep 1
8522026-05-01T17:45:54.320Z+ retry=41
8532026-05-01T17:45:54.344Z+ zoneadm list
8542026-05-01T17:45:54.345Z+ grep nexus
8552026-05-01T17:45:54.345Z+ [[ 41 -gt 300 ]]
8562026-05-01T17:45:54.345Z+ sleep 1
8572026-05-01T17:45:55.332Z+ retry=42
8582026-05-01T17:45:55.356Z+ zoneadm list
8592026-05-01T17:45:55.356Z+ grep nexus
8602026-05-01T17:45:55.356Z+ [[ 42 -gt 300 ]]
8612026-05-01T17:45:55.356Z+ sleep 1
8622026-05-01T17:45:56.345Z+ retry=43
8632026-05-01T17:45:56.370Z+ zoneadm list
8642026-05-01T17:45:56.370Z+ grep nexus
8652026-05-01T17:45:56.370Z+ [[ 43 -gt 300 ]]
8662026-05-01T17:45:56.370Z+ sleep 1
8672026-05-01T17:45:57.358Z+ retry=44
8682026-05-01T17:45:57.382Z+ zoneadm list
8692026-05-01T17:45:57.382Z+ grep nexus
8702026-05-01T17:45:57.383Z+ [[ 44 -gt 300 ]]
8712026-05-01T17:45:57.383Z+ sleep 1
8722026-05-01T17:45:58.370Z+ retry=45
8732026-05-01T17:45:58.394Z+ zoneadm list
8742026-05-01T17:45:58.394Z+ grep nexus
8752026-05-01T17:45:58.394Z+ [[ 45 -gt 300 ]]
8762026-05-01T17:45:58.395Z+ sleep 1
8772026-05-01T17:45:59.383Z+ retry=46
8782026-05-01T17:45:59.408Z+ zoneadm list
8792026-05-01T17:45:59.408Z+ grep nexus
8802026-05-01T17:45:59.408Z+ [[ 46 -gt 300 ]]
8812026-05-01T17:45:59.408Z+ sleep 1
8822026-05-01T17:46:00.396Z+ retry=47
8832026-05-01T17:46:00.422Z+ zoneadm list
8842026-05-01T17:46:00.422Z+ grep nexus
8852026-05-01T17:46:00.422Z+ [[ 47 -gt 300 ]]
8862026-05-01T17:46:00.422Z+ sleep 1
8872026-05-01T17:46:01.409Z+ retry=48
8882026-05-01T17:46:01.433Z+ zoneadm list
8892026-05-01T17:46:01.433Z+ grep nexus
8902026-05-01T17:46:01.433Z+ [[ 48 -gt 300 ]]
8912026-05-01T17:46:01.433Z+ sleep 1
8922026-05-01T17:46:02.423Z+ retry=49
8932026-05-01T17:46:02.447Z+ zoneadm list
8942026-05-01T17:46:02.447Z+ grep nexus
8952026-05-01T17:46:02.447Z+ [[ 49 -gt 300 ]]
8962026-05-01T17:46:02.447Z+ sleep 1
8972026-05-01T17:46:03.436Z+ retry=50
8982026-05-01T17:46:03.460Z+ zoneadm list
8992026-05-01T17:46:03.460Z+ grep nexus
9002026-05-01T17:46:03.460Z+ [[ 50 -gt 300 ]]
9012026-05-01T17:46:03.460Z+ sleep 1
9022026-05-01T17:46:04.449Z+ retry=51
9032026-05-01T17:46:04.473Z+ zoneadm list
9042026-05-01T17:46:04.473Z+ grep nexus
9052026-05-01T17:46:04.474Z+ [[ 51 -gt 300 ]]
9062026-05-01T17:46:04.474Z+ sleep 1
9072026-05-01T17:46:05.461Z+ retry=52
9082026-05-01T17:46:05.486Z+ zoneadm list
9092026-05-01T17:46:05.486Z+ grep nexus
9102026-05-01T17:46:05.486Z+ [[ 52 -gt 300 ]]
9112026-05-01T17:46:05.486Z+ sleep 1
9122026-05-01T17:46:06.473Z+ retry=53
9132026-05-01T17:46:06.498Z+ zoneadm list
9142026-05-01T17:46:06.498Z+ grep nexus
9152026-05-01T17:46:06.498Z+ [[ 53 -gt 300 ]]
9162026-05-01T17:46:06.498Z+ sleep 1
9172026-05-01T17:46:07.486Z+ retry=54
9182026-05-01T17:46:07.510Z+ zoneadm list
9192026-05-01T17:46:07.511Z+ grep nexus
9202026-05-01T17:46:07.511Z+ [[ 54 -gt 300 ]]
9212026-05-01T17:46:07.511Z+ sleep 1
9222026-05-01T17:46:08.499Z+ retry=55
9232026-05-01T17:46:08.523Z+ zoneadm list
9242026-05-01T17:46:08.523Z+ grep nexus
9252026-05-01T17:46:08.523Z+ [[ 55 -gt 300 ]]
9262026-05-01T17:46:08.523Z+ sleep 1
9272026-05-01T17:46:09.511Z+ retry=56
9282026-05-01T17:46:09.535Z+ zoneadm list
9292026-05-01T17:46:09.536Z+ grep nexus
9302026-05-01T17:46:09.536Z+ [[ 56 -gt 300 ]]
9312026-05-01T17:46:09.536Z+ sleep 1
9322026-05-01T17:46:10.525Z+ retry=57
9332026-05-01T17:46:10.549Z+ zoneadm list
9342026-05-01T17:46:10.549Z+ grep nexus
9352026-05-01T17:46:10.549Z+ [[ 57 -gt 300 ]]
9362026-05-01T17:46:10.549Z+ sleep 1
9372026-05-01T17:46:11.536Z+ retry=58
9382026-05-01T17:46:11.560Z+ zoneadm list
9392026-05-01T17:46:11.560Z+ grep nexus
9402026-05-01T17:46:11.560Z+ [[ 58 -gt 300 ]]
9412026-05-01T17:46:11.560Z+ sleep 1
9422026-05-01T17:46:12.548Z+ retry=59
9432026-05-01T17:46:12.573Z+ zoneadm list
9442026-05-01T17:46:12.573Z+ grep nexus
9452026-05-01T17:46:12.573Z+ [[ 59 -gt 300 ]]
9462026-05-01T17:46:12.573Z+ sleep 1
9472026-05-01T17:46:13.561Z+ retry=60
9482026-05-01T17:46:13.585Z+ zoneadm list
9492026-05-01T17:46:13.585Z+ grep nexus
9502026-05-01T17:46:13.585Z+ [[ 60 -gt 300 ]]
9512026-05-01T17:46:13.585Z+ sleep 1
9522026-05-01T17:46:14.573Z+ retry=61
9532026-05-01T17:46:14.598Z+ zoneadm list
9542026-05-01T17:46:14.598Z+ grep nexus
9552026-05-01T17:46:14.598Z+ [[ 61 -gt 300 ]]
9562026-05-01T17:46:14.598Z+ sleep 1
9572026-05-01T17:46:15.586Z+ retry=62
9582026-05-01T17:46:15.610Z+ zoneadm list
9592026-05-01T17:46:15.610Z+ grep nexus
9602026-05-01T17:46:15.610Z+ [[ 62 -gt 300 ]]
9612026-05-01T17:46:15.610Z+ sleep 1
9622026-05-01T17:46:16.598Z+ retry=63
9632026-05-01T17:46:16.622Z+ zoneadm list
9642026-05-01T17:46:16.622Z+ grep nexus
9652026-05-01T17:46:16.622Z+ [[ 63 -gt 300 ]]
9662026-05-01T17:46:16.623Z+ sleep 1
9672026-05-01T17:46:17.611Z+ retry=64
9682026-05-01T17:46:17.635Z+ zoneadm list
9692026-05-01T17:46:17.635Z+ grep nexus
9702026-05-01T17:46:17.635Z+ [[ 64 -gt 300 ]]
9712026-05-01T17:46:17.635Z+ sleep 1
9722026-05-01T17:46:18.624Z+ retry=65
9732026-05-01T17:46:18.649Z+ zoneadm list
9742026-05-01T17:46:18.649Z+ grep nexus
9752026-05-01T17:46:18.649Z+ [[ 65 -gt 300 ]]
9762026-05-01T17:46:18.649Z+ sleep 1
9772026-05-01T17:46:19.638Z+ retry=66
9782026-05-01T17:46:19.662Z+ zoneadm list
9792026-05-01T17:46:19.662Z+ grep nexus
9802026-05-01T17:46:19.662Z+ [[ 66 -gt 300 ]]
9812026-05-01T17:46:19.662Z+ sleep 1
9822026-05-01T17:46:20.652Z+ retry=67
9832026-05-01T17:46:20.676Z+ zoneadm list
9842026-05-01T17:46:20.676Z+ grep nexus
9852026-05-01T17:46:20.676Z+ [[ 67 -gt 300 ]]
9862026-05-01T17:46:20.676Z+ sleep 1
9872026-05-01T17:46:21.666Z+ retry=68
9882026-05-01T17:46:21.690Z+ zoneadm list
9892026-05-01T17:46:21.690Z+ grep nexus
9902026-05-01T17:46:21.690Z+ [[ 68 -gt 300 ]]
9912026-05-01T17:46:21.690Z+ sleep 1
9922026-05-01T17:46:22.679Z+ retry=69
9932026-05-01T17:46:22.704Z+ zoneadm list
9942026-05-01T17:46:22.704Z+ grep nexus
9952026-05-01T17:46:22.704Z+ [[ 69 -gt 300 ]]
9962026-05-01T17:46:22.704Z+ sleep 1
9972026-05-01T17:46:23.692Z+ retry=70
9982026-05-01T17:46:23.717Z+ zoneadm list
9992026-05-01T17:46:23.717Z+ grep nexus
10002026-05-01T17:46:23.717Z+ [[ 70 -gt 300 ]]
10012026-05-01T17:46:23.717Z+ sleep 1
10022026-05-01T17:46:24.706Z+ retry=71
10032026-05-01T17:46:24.730Z+ zoneadm list
10042026-05-01T17:46:24.730Z+ grep nexus
10052026-05-01T17:46:24.730Z+ [[ 71 -gt 300 ]]
10062026-05-01T17:46:24.730Z+ sleep 1
10072026-05-01T17:46:25.718Z+ retry=72
10082026-05-01T17:46:25.743Z+ zoneadm list
10092026-05-01T17:46:25.743Z+ grep nexus
10102026-05-01T17:46:25.743Z+ [[ 72 -gt 300 ]]
10112026-05-01T17:46:25.743Z+ sleep 1
10122026-05-01T17:46:26.731Z+ retry=73
10132026-05-01T17:46:26.756Z+ zoneadm list
10142026-05-01T17:46:26.756Z+ grep nexus
10152026-05-01T17:46:26.756Z+ [[ 73 -gt 300 ]]
10162026-05-01T17:46:26.756Z+ sleep 1
10172026-05-01T17:46:27.744Z+ retry=74
10182026-05-01T17:46:27.769Z+ zoneadm list
10192026-05-01T17:46:27.769Z+ grep nexus
10202026-05-01T17:46:27.769Z+ [[ 74 -gt 300 ]]
10212026-05-01T17:46:27.769Z+ sleep 1
10222026-05-01T17:46:28.757Z+ retry=75
10232026-05-01T17:46:28.781Z+ zoneadm list
10242026-05-01T17:46:28.781Z+ grep nexus
10252026-05-01T17:46:28.781Z+ [[ 75 -gt 300 ]]
10262026-05-01T17:46:28.781Z+ sleep 1
10272026-05-01T17:46:29.769Z+ retry=76
10282026-05-01T17:46:29.794Z+ zoneadm list
10292026-05-01T17:46:29.794Z+ grep nexus
10302026-05-01T17:46:29.794Z+ [[ 76 -gt 300 ]]
10312026-05-01T17:46:29.794Z+ sleep 1
10322026-05-01T17:46:30.793Z+ retry=77
10332026-05-01T17:46:30.817Z+ zoneadm list
10342026-05-01T17:46:30.817Z+ grep nexus
10352026-05-01T17:46:30.818Z+ [[ 77 -gt 300 ]]
10362026-05-01T17:46:30.818Z+ sleep 1
10372026-05-01T17:46:31.853Z+ retry=78
10382026-05-01T17:46:31.889Z+ grep nexus
10392026-05-01T17:46:31.889Z+ zoneadm list
10402026-05-01T17:46:31.915Z+ [[ 78 -gt 300 ]]
10412026-05-01T17:46:31.915Z+ sleep 1
10422026-05-01T17:46:36.164Z+ retry=79
10432026-05-01T17:46:36.189Z+ zoneadm list
10442026-05-01T17:46:36.267Z+ grep nexus
10452026-05-01T17:46:36.296Z+ [[ 79 -gt 300 ]]
10462026-05-01T17:46:36.320Z+ sleep 1
10472026-05-01T17:46:37.442Z+ retry=80
10482026-05-01T17:46:37.467Z+ zoneadm list
10492026-05-01T17:46:37.467Z+ grep nexus
10502026-05-01T17:46:37.467Z+ [[ 80 -gt 300 ]]
10512026-05-01T17:46:37.467Z+ sleep 1
10522026-05-01T17:46:38.607Z+ retry=81
10532026-05-01T17:46:38.608Z+ zoneadm list
10542026-05-01T17:46:38.608Z+ grep nexus
10552026-05-01T17:46:38.608Z+ [[ 81 -gt 300 ]]
10562026-05-01T17:46:38.608Z+ sleep 1
10572026-05-01T17:46:39.335Z+ retry=82
10582026-05-01T17:46:39.360Z+ zoneadm list
10592026-05-01T17:46:39.360Z+ grep nexus
10602026-05-01T17:46:39.360Z+ [[ 82 -gt 300 ]]
10612026-05-01T17:46:39.360Z+ sleep 1
10622026-05-01T17:46:40.354Z+ retry=83
10632026-05-01T17:46:40.378Z+ zoneadm list
10642026-05-01T17:46:40.378Z+ grep nexus
10652026-05-01T17:46:40.378Z+ [[ 83 -gt 300 ]]
10662026-05-01T17:46:40.378Z+ sleep 1
10672026-05-01T17:46:41.372Z+ retry=84
10682026-05-01T17:46:41.396Z+ zoneadm list
10692026-05-01T17:46:41.396Z+ grep nexus
10702026-05-01T17:46:41.396Z+ [[ 84 -gt 300 ]]
10712026-05-01T17:46:41.396Z+ sleep 1
10722026-05-01T17:46:42.387Z+ retry=85
10732026-05-01T17:46:42.412Z+ zoneadm list
10742026-05-01T17:46:42.412Z+ grep nexus
10752026-05-01T17:46:42.412Z+ [[ 85 -gt 300 ]]
10762026-05-01T17:46:42.412Z+ sleep 1
10772026-05-01T17:46:43.401Z+ retry=86
10782026-05-01T17:46:43.425Z+ zoneadm list
10792026-05-01T17:46:43.425Z+ grep nexus
10802026-05-01T17:46:43.425Z+ [[ 86 -gt 300 ]]
10812026-05-01T17:46:43.425Z+ sleep 1
10822026-05-01T17:46:44.417Z+ retry=87
10832026-05-01T17:46:44.441Z+ zoneadm list
10842026-05-01T17:46:44.441Z+ grep nexus
10852026-05-01T17:46:44.441Z+ [[ 87 -gt 300 ]]
10862026-05-01T17:46:44.441Z+ sleep 1
10872026-05-01T17:46:45.438Z+ retry=88
10882026-05-01T17:46:45.463Z+ zoneadm list
10892026-05-01T17:46:45.463Z+ grep nexus
10902026-05-01T17:46:45.463Z+ [[ 88 -gt 300 ]]
10912026-05-01T17:46:45.463Z+ sleep 1
10922026-05-01T17:46:46.457Z+ retry=89
10932026-05-01T17:46:46.482Z+ zoneadm list
10942026-05-01T17:46:46.482Z+ grep nexus
10952026-05-01T17:46:46.482Z+ [[ 89 -gt 300 ]]
10962026-05-01T17:46:46.482Z+ sleep 1
10972026-05-01T17:46:47.478Z+ retry=90
10982026-05-01T17:46:47.502Z+ zoneadm list
10992026-05-01T17:46:47.502Z+ grep nexus
11002026-05-01T17:46:47.503Z+ [[ 90 -gt 300 ]]
11012026-05-01T17:46:47.503Z+ sleep 1
11022026-05-01T17:46:48.493Z+ retry=91
11032026-05-01T17:46:48.518Z+ zoneadm list
11042026-05-01T17:46:48.518Z+ grep nexus
11052026-05-01T17:46:48.518Z+ [[ 91 -gt 300 ]]
11062026-05-01T17:46:48.518Z+ sleep 1
11072026-05-01T17:46:49.509Z+ retry=92
11082026-05-01T17:46:49.534Z+ zoneadm list
11092026-05-01T17:46:49.534Z+ grep nexus
11102026-05-01T17:46:49.534Z+ [[ 92 -gt 300 ]]
11112026-05-01T17:46:49.534Z+ sleep 1
11122026-05-01T17:46:50.529Z+ retry=93
11132026-05-01T17:46:50.554Z+ zoneadm list
11142026-05-01T17:46:50.554Z+ grep nexus
11152026-05-01T17:46:50.554Z+ [[ 93 -gt 300 ]]
11162026-05-01T17:46:50.554Z+ sleep 1
11172026-05-01T17:46:51.552Z+ retry=94
11182026-05-01T17:46:51.577Z+ zoneadm list
11192026-05-01T17:46:51.577Z+ grep nexus
11202026-05-01T17:46:51.577Z+ [[ 94 -gt 300 ]]
11212026-05-01T17:46:51.577Z+ sleep 1
11222026-05-01T17:46:52.573Z+ retry=95
11232026-05-01T17:46:52.599Z+ zoneadm list
11242026-05-01T17:46:52.599Z+ grep nexus
11252026-05-01T17:46:52.599Z+ [[ 95 -gt 300 ]]
11262026-05-01T17:46:52.599Z+ sleep 1
11272026-05-01T17:46:53.595Z+ retry=96
11282026-05-01T17:46:53.620Z+ zoneadm list
11292026-05-01T17:46:53.620Z+ grep nexus
11302026-05-01T17:46:53.620Z+ [[ 96 -gt 300 ]]
11312026-05-01T17:46:53.620Z+ sleep 1
11322026-05-01T17:46:54.612Z+ retry=97
11332026-05-01T17:46:54.637Z+ zoneadm list
11342026-05-01T17:46:54.637Z+ grep nexus
11352026-05-01T17:46:54.637Z+ echo 'Waited for nexus: 97s'
11362026-05-01T17:46:54.637Z+ retry=0
11372026-05-01T17:46:54.637Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11382026-05-01T17:46:54.637Zoxz_nexus_95acbec6-42d5-41e5-b8a8-cab8e54d3010
11392026-05-01T17:46:54.637Zoxz_nexus_7f7afcd1-9cd9-4ac8-a666-8634c38d0333
11402026-05-01T17:46:54.637Zoxz_nexus_db638d7d-5097-4b39-8929-d13e0c283380
11412026-05-01T17:46:54.637ZWaited for nexus: 97s
11422026-05-01T17:46:54.637Z+ [[ 0 -gt 300 ]]
11432026-05-01T17:46:54.637Z+ sleep 1
11442026-05-01T17:46:55.641Z+ retry=1
11452026-05-01T17:46:55.641Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11462026-05-01T17:46:55.665Z+ [[ 1 -gt 300 ]]
11472026-05-01T17:46:55.665Z+ sleep 1
11482026-05-01T17:46:56.649Z+ retry=2
11492026-05-01T17:46:56.649Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11502026-05-01T17:46:56.674Z+ [[ 2 -gt 300 ]]
11512026-05-01T17:46:56.674Z+ sleep 1
11522026-05-01T17:46:57.657Z+ retry=3
11532026-05-01T17:46:57.657Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11542026-05-01T17:46:57.682Z+ [[ 3 -gt 300 ]]
11552026-05-01T17:46:57.682Z+ sleep 1
11562026-05-01T17:46:58.666Z+ retry=4
11572026-05-01T17:46:58.666Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11582026-05-01T17:46:58.690Z+ [[ 4 -gt 300 ]]
11592026-05-01T17:46:58.691Z+ sleep 1
11602026-05-01T17:46:59.676Z+ retry=5
11612026-05-01T17:46:59.676Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11622026-05-01T17:46:59.701Z+ [[ 5 -gt 300 ]]
11632026-05-01T17:46:59.701Z+ sleep 1
11642026-05-01T17:47:00.685Z+ retry=6
11652026-05-01T17:47:00.685Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11662026-05-01T17:47:00.709Z+ [[ 6 -gt 300 ]]
11672026-05-01T17:47:00.709Z+ sleep 1
11682026-05-01T17:47:01.696Z+ retry=7
11692026-05-01T17:47:01.696Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11702026-05-01T17:47:01.721Z+ [[ 7 -gt 300 ]]
11712026-05-01T17:47:01.721Z+ sleep 1
11722026-05-01T17:47:02.704Z+ retry=8
11732026-05-01T17:47:02.704Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11742026-05-01T17:47:02.729Z+ [[ 8 -gt 300 ]]
11752026-05-01T17:47:02.729Z+ sleep 1
11762026-05-01T17:47:03.713Z+ retry=9
11772026-05-01T17:47:03.713Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11782026-05-01T17:47:03.737Z+ [[ 9 -gt 300 ]]
11792026-05-01T17:47:03.737Z+ sleep 1
11802026-05-01T17:47:04.723Z+ retry=10
11812026-05-01T17:47:04.723Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11822026-05-01T17:47:04.748Z+ [[ 10 -gt 300 ]]
11832026-05-01T17:47:04.748Z+ sleep 1
11842026-05-01T17:47:05.733Z+ retry=11
11852026-05-01T17:47:05.733Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11862026-05-01T17:47:05.758Z+ [[ 11 -gt 300 ]]
11872026-05-01T17:47:05.758Z+ sleep 1
11882026-05-01T17:47:06.744Z+ retry=12
11892026-05-01T17:47:06.744Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11902026-05-01T17:47:06.769Z+ [[ 12 -gt 300 ]]
11912026-05-01T17:47:06.769Z+ sleep 1
11922026-05-01T17:47:07.755Z+ retry=13
11932026-05-01T17:47:07.755Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11942026-05-01T17:47:07.780Z+ [[ 13 -gt 300 ]]
11952026-05-01T17:47:07.780Z+ sleep 1
11962026-05-01T17:47:08.764Z+ retry=14
11972026-05-01T17:47:08.765Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11982026-05-01T17:47:08.789Z+ [[ 14 -gt 300 ]]
11992026-05-01T17:47:08.789Z+ sleep 1
12002026-05-01T17:47:09.776Z+ retry=15
12012026-05-01T17:47:09.776Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12022026-05-01T17:47:09.800Z+ [[ 15 -gt 300 ]]
12032026-05-01T17:47:09.801Z+ sleep 1
12042026-05-01T17:47:10.786Z+ retry=16
12052026-05-01T17:47:10.786Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12062026-05-01T17:47:10.810Z+ [[ 16 -gt 300 ]]
12072026-05-01T17:47:10.810Z+ sleep 1
12082026-05-01T17:47:11.797Z+ retry=17
12092026-05-01T17:47:11.797Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12102026-05-01T17:47:11.822Z+ [[ 17 -gt 300 ]]
12112026-05-01T17:47:11.822Z+ sleep 1
12122026-05-01T17:47:12.833Z+ retry=18
12132026-05-01T17:47:12.833Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12142026-05-01T17:47:12.833Z+ [[ 18 -gt 300 ]]
12152026-05-01T17:47:12.833Z+ sleep 1
12162026-05-01T17:47:13.819Z+ retry=19
12172026-05-01T17:47:13.819Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12182026-05-01T17:47:13.844Z+ [[ 19 -gt 300 ]]
12192026-05-01T17:47:13.844Z+ sleep 1
12202026-05-01T17:47:14.829Z+ retry=20
12212026-05-01T17:47:14.830Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12222026-05-01T17:47:14.854Z+ [[ 20 -gt 300 ]]
12232026-05-01T17:47:14.854Z+ sleep 1
12242026-05-01T17:47:15.838Z+ retry=21
12252026-05-01T17:47:15.838Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12262026-05-01T17:47:15.863Z+ [[ 21 -gt 300 ]]
12272026-05-01T17:47:15.863Z+ sleep 1
12282026-05-01T17:47:16.847Z+ retry=22
12292026-05-01T17:47:16.847Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12302026-05-01T17:47:16.871Z+ [[ 22 -gt 300 ]]
12312026-05-01T17:47:16.871Z+ sleep 1
12322026-05-01T17:47:17.856Z+ retry=23
12332026-05-01T17:47:17.856Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12342026-05-01T17:47:17.880Z+ [[ 23 -gt 300 ]]
12352026-05-01T17:47:17.880Z+ sleep 1
12362026-05-01T17:47:18.865Z+ retry=24
12372026-05-01T17:47:18.865Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12382026-05-01T17:47:18.890Z+ [[ 24 -gt 300 ]]
12392026-05-01T17:47:18.890Z+ sleep 1
12402026-05-01T17:47:19.875Z+ retry=25
12412026-05-01T17:47:19.875Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12422026-05-01T17:47:19.900Z+ [[ 25 -gt 300 ]]
12432026-05-01T17:47:19.900Z+ sleep 1
12442026-05-01T17:47:20.884Z+ retry=26
12452026-05-01T17:47:20.884Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12462026-05-01T17:47:20.910Z+ [[ 26 -gt 300 ]]
12472026-05-01T17:47:20.910Z+ sleep 1
12482026-05-01T17:47:21.894Z+ retry=27
12492026-05-01T17:47:21.894Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12502026-05-01T17:47:21.919Z+ [[ 27 -gt 300 ]]
12512026-05-01T17:47:21.919Z+ sleep 1
12522026-05-01T17:47:22.907Z+ retry=28
12532026-05-01T17:47:22.907Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12542026-05-01T17:47:22.932Z+ [[ 28 -gt 300 ]]
12552026-05-01T17:47:22.932Z+ sleep 1
12562026-05-01T17:47:23.922Z+ retry=29
12572026-05-01T17:47:23.922Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12582026-05-01T17:47:23.947Z+ [[ 29 -gt 300 ]]
12592026-05-01T17:47:23.947Z+ sleep 1
12602026-05-01T17:47:24.932Z+ retry=30
12612026-05-01T17:47:24.932Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
12622026-05-01T17:47:24.957Z{"msg":"Handoff to Nexus is complete","v":0,"name":"SledAgent","level":30,"time":"2026-05-01T17:47:24.652529475Z","hostname":"buskin","pid":1567,"component":"RSS","file":"sled-agent/src/rack_setup/service.rs:1068"}
12632026-05-01T17:47:24.957Z+ echo 'Waited for handoff: 30s'
12642026-05-01T17:47:24.957ZWaited for handoff: 30s
12652026-05-01T17:47:24.957Z+ retry=0
12662026-05-01T17:47:24.957Z++ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db inventory collections list
12672026-05-01T17:47:24.957Z++ wc -l
12682026-05-01T17:47:25.121Znote: database URL not specified. Will search DNS.
12692026-05-01T17:47:25.121Znote: (override with --db-url or OMDB_DB_URL)
12702026-05-01T17:47:25.146Znote: using DNS from system config (typically /etc/resolv.conf)
12712026-05-01T17:47:25.146Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12722026-05-01T17:47:25.148Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12732026-05-01T17:47:25.206Znote: database schema version matches expected (252.0.0)
12742026-05-01T17:47:25.449Z+ INVENTORY_COLLECTION_COUNT=' 6'
12752026-05-01T17:47:25.474Z+ [[ 6 -gt 1 ]]
12762026-05-01T17:47:25.474Z+ echo 'Waited for inventory collection: 0s'
12772026-05-01T17:47:25.474Z+ retry=0
12782026-05-01T17:47:25.474ZWaited for inventory collection: 0s
12792026-05-01T17:47:25.474Z++ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i
12802026-05-01T17:47:25.475Z++ wc -l
12812026-05-01T17:47:25.500Znote: database URL not specified. Will search DNS.
12822026-05-01T17:47:25.500Znote: (override with --db-url or OMDB_DB_URL)
12832026-05-01T17:47:25.500Znote: using DNS from system config (typically /etc/resolv.conf)
12842026-05-01T17:47:25.500Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12852026-05-01T17:47:25.500Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12862026-05-01T17:47:25.525Znote: database schema version matches expected (252.0.0)
12872026-05-01T17:47:25.793Z+ ACTUAL_ZPOOL_COUNT=' 9'
12882026-05-01T17:47:25.817Z+ [[ 9 -eq 9 ]]
12892026-05-01T17:47:25.817Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb nexus fetch-omdb /tmp/fetched-omdb
12902026-05-01T17:47:25.842Znote: Nexus URL not specified. Will pick one from DNS.
12912026-05-01T17:47:25.842Znote: using DNS from system config (typically /etc/resolv.conf)
12922026-05-01T17:47:25.842Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12932026-05-01T17:47:25.842Znote: using Nexus URL http://[fd00:1122:3344:101::c]:12232
12942026-05-01T17:47:28.292Z+ pfexec zlogin oxz_switch /tmp/fetched-omdb db inventory collections list
12952026-05-01T17:47:28.332Znote: database URL not specified. Will search DNS.
12962026-05-01T17:47:28.332Znote: (override with --db-url or OMDB_DB_URL)
12972026-05-01T17:47:28.332Znote: using DNS from system config (typically /etc/resolv.conf)
12982026-05-01T17:47:28.332Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12992026-05-01T17:47:28.357Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13002026-05-01T17:47:28.357Znote: database schema version matches expected (252.0.0)
13012026-05-01T17:47:28.382ZID STARTED TOOK NSPS NERRORS
13022026-05-01T17:47:28.382Zf89e0e20-ea7d-4383-8c13-41443888c111 2026-05-01T17:47:21Z 1753 ms 2 0
13032026-05-01T17:47:28.382Z09c105df-d903-40f0-9789-724c1e350027 2026-05-01T17:47:23Z 942 ms 2 0
13042026-05-01T17:47:28.382Zd3c20764-3a73-426b-be03-9d154df2a5ef 2026-05-01T17:47:23Z 901 ms 2 0
13052026-05-01T17:47:28.382Z83efc99c-7d00-4d11-b3c9-50fc623e8317 2026-05-01T17:47:24Z 277 ms 2 0
13062026-05-01T17:47:28.382Z2b96b721-b7d5-4371-92e9-c68a13db2e4c 2026-05-01T17:47:24Z 141 ms 2 0
13072026-05-01T17:47:28.407Z+ echo 'Confirmed switch zone omdb can fetch a usable omdb from Nexus'
13082026-05-01T17:47:28.407ZConfirmed switch zone omdb can fetch a usable omdb from Nexus
13092026-05-01T17:47:28.407Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list
13102026-05-01T17:47:28.431Znote: database URL not specified. Will search DNS.
13112026-05-01T17:47:28.431Znote: (override with --db-url or OMDB_DB_URL)
13122026-05-01T17:47:28.431Znote: using DNS from system config (typically /etc/resolv.conf)
13132026-05-01T17:47:28.431Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13142026-05-01T17:47:28.456Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13152026-05-01T17:47:28.456Znote: database schema version matches expected (252.0.0)
13162026-05-01T17:47:28.728ZID |TIME_DELETED |SLED_ID |PHYSICAL_DISK_ID |TOTAL_SIZE |CONTROL_PLANE_STORAGE_BUFFER
13172026-05-01T17:47:28.728Z-------------------------------------+-------------+-------------------------------------+-------------------------------------+------------+-----------------------------
13182026-05-01T17:47:28.728Z01a79cc7-66f5-4420-93a2-2ca2a6ac9f26 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |7c16dc0f-62b4-48f8-b0a3-533c906c4766 |20937965568 |268435456000
13192026-05-01T17:47:28.728Z01d68f80-4ecd-4c6a-9332-7bde4729ed97 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |a3f27d40-b42c-4513-a51a-a38cfa0d71c5 |20937965568 |268435456000
13202026-05-01T17:47:28.728Z32bcd368-4687-4015-a93c-0cb550aaabdd | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |18542bb7-9d11-490c-80c8-770708182ea4 |20937965568 |268435456000
13212026-05-01T17:47:28.728Z55d69189-14b6-4d38-ab2a-8b8b0826ceee | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |c108a037-fc69-41b4-9e8e-a4d2fe817a1e |20937965568 |268435456000
13222026-05-01T17:47:28.728Z5c5d8536-e0f7-442e-b7c1-2a265a743b7a | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |ae4717a0-751a-4d2a-b169-da82a7689aa0 |20937965568 |268435456000
13232026-05-01T17:47:28.728Z6b66cf61-6fec-4687-9f98-c6973910c3a7 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |a8e737e2-60a6-490a-b951-8bf0c0303a19 |20937965568 |268435456000
13242026-05-01T17:47:28.728Z8b6986f3-3af1-4e41-90c8-aa0b7e52932a | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |81a97778-8589-4fea-9c51-5a93b1eea10b |20937965568 |268435456000
13252026-05-01T17:47:28.728Z98c2d617-8407-4424-8cab-ec0527dfb202 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |3873d25a-aa7e-48cf-88aa-1354b33cdeed |20937965568 |268435456000
13262026-05-01T17:47:28.728Zb580567f-d36f-4e1d-b183-dae6a39f94e9 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |fea8cfea-ce04-40eb-b873-a0a19b1f73b4 |20937965568 |268435456000
13272026-05-01T17:47:28.753Z++ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i
13282026-05-01T17:47:28.778Znote: database URL not specified. Will search DNS.
13292026-05-01T17:47:28.778Znote: (override with --db-url or OMDB_DB_URL)
13302026-05-01T17:47:28.778Znote: using DNS from system config (typically /etc/resolv.conf)
13312026-05-01T17:47:28.778Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13322026-05-01T17:47:28.803Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13332026-05-01T17:47:28.803Znote: database schema version matches expected (252.0.0)
13342026-05-01T17:47:29.030Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
13352026-05-01T17:47:29.054Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 01a79cc7-66f5-4420-93a2-2ca2a6ac9f26 0
13362026-05-01T17:47:29.079Znote: database URL not specified. Will search DNS.
13372026-05-01T17:47:29.079Znote: (override with --db-url or OMDB_DB_URL)
13382026-05-01T17:47:29.079Znote: using DNS from system config (typically /etc/resolv.conf)
13392026-05-01T17:47:29.079Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13402026-05-01T17:47:29.079Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13412026-05-01T17:47:29.103Znote: database schema version matches expected (252.0.0)
13422026-05-01T17:47:29.174Zset pool 01a79cc7-66f5-4420-93a2-2ca2a6ac9f26 control plane storage buffer bytes to 0
13432026-05-01T17:47:29.198Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
13442026-05-01T17:47:29.198Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 01d68f80-4ecd-4c6a-9332-7bde4729ed97 0
13452026-05-01T17:47:29.230Znote: database URL not specified. Will search DNS.
13462026-05-01T17:47:29.230Znote: (override with --db-url or OMDB_DB_URL)
13472026-05-01T17:47:29.230Znote: using DNS from system config (typically /etc/resolv.conf)
13482026-05-01T17:47:29.230Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13492026-05-01T17:47:29.255Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13502026-05-01T17:47:29.255Znote: database schema version matches expected (252.0.0)
13512026-05-01T17:47:29.320Zset pool 01d68f80-4ecd-4c6a-9332-7bde4729ed97 control plane storage buffer bytes to 0
13522026-05-01T17:47:29.345Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
13532026-05-01T17:47:29.345Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 32bcd368-4687-4015-a93c-0cb550aaabdd 0
13542026-05-01T17:47:29.372Znote: database URL not specified. Will search DNS.
13552026-05-01T17:47:29.372Znote: (override with --db-url or OMDB_DB_URL)
13562026-05-01T17:47:29.373Znote: using DNS from system config (typically /etc/resolv.conf)
13572026-05-01T17:47:29.373Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13582026-05-01T17:47:29.397Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13592026-05-01T17:47:29.397Znote: database schema version matches expected (252.0.0)
13602026-05-01T17:47:29.468Zset pool 32bcd368-4687-4015-a93c-0cb550aaabdd control plane storage buffer bytes to 0
13612026-05-01T17:47:29.492Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
13622026-05-01T17:47:29.492Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 55d69189-14b6-4d38-ab2a-8b8b0826ceee 0
13632026-05-01T17:47:29.521Znote: database URL not specified. Will search DNS.
13642026-05-01T17:47:29.521Znote: (override with --db-url or OMDB_DB_URL)
13652026-05-01T17:47:29.521Znote: using DNS from system config (typically /etc/resolv.conf)
13662026-05-01T17:47:29.521Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13672026-05-01T17:47:29.545Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13682026-05-01T17:47:29.545Znote: database schema version matches expected (252.0.0)
13692026-05-01T17:47:29.609Zset pool 55d69189-14b6-4d38-ab2a-8b8b0826ceee control plane storage buffer bytes to 0
13702026-05-01T17:47:29.633Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
13712026-05-01T17:47:29.633Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 5c5d8536-e0f7-442e-b7c1-2a265a743b7a 0
13722026-05-01T17:47:29.661Znote: database URL not specified. Will search DNS.
13732026-05-01T17:47:29.661Znote: (override with --db-url or OMDB_DB_URL)
13742026-05-01T17:47:29.661Znote: using DNS from system config (typically /etc/resolv.conf)
13752026-05-01T17:47:29.661Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13762026-05-01T17:47:29.686Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13772026-05-01T17:47:29.686Znote: database schema version matches expected (252.0.0)
13782026-05-01T17:47:29.745Zset pool 5c5d8536-e0f7-442e-b7c1-2a265a743b7a control plane storage buffer bytes to 0
13792026-05-01T17:47:29.770Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
13802026-05-01T17:47:29.770Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 6b66cf61-6fec-4687-9f98-c6973910c3a7 0
13812026-05-01T17:47:29.800Znote: database URL not specified. Will search DNS.
13822026-05-01T17:47:29.800Znote: (override with --db-url or OMDB_DB_URL)
13832026-05-01T17:47:29.800Znote: using DNS from system config (typically /etc/resolv.conf)
13842026-05-01T17:47:29.800Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13852026-05-01T17:47:29.825Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13862026-05-01T17:47:29.825Znote: database schema version matches expected (252.0.0)
13872026-05-01T17:47:29.889Zset pool 6b66cf61-6fec-4687-9f98-c6973910c3a7 control plane storage buffer bytes to 0
13882026-05-01T17:47:29.914Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
13892026-05-01T17:47:29.914Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 8b6986f3-3af1-4e41-90c8-aa0b7e52932a 0
13902026-05-01T17:47:29.947Znote: database URL not specified. Will search DNS.
13912026-05-01T17:47:29.947Znote: (override with --db-url or OMDB_DB_URL)
13922026-05-01T17:47:29.947Znote: using DNS from system config (typically /etc/resolv.conf)
13932026-05-01T17:47:29.947Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
13942026-05-01T17:47:29.972Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
13952026-05-01T17:47:29.972Znote: database schema version matches expected (252.0.0)
13962026-05-01T17:47:30.044Zset pool 8b6986f3-3af1-4e41-90c8-aa0b7e52932a control plane storage buffer bytes to 0
13972026-05-01T17:47:30.069Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
13982026-05-01T17:47:30.069Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 98c2d617-8407-4424-8cab-ec0527dfb202 0
13992026-05-01T17:47:30.098Znote: database URL not specified. Will search DNS.
14002026-05-01T17:47:30.098Znote: (override with --db-url or OMDB_DB_URL)
14012026-05-01T17:47:30.098Znote: using DNS from system config (typically /etc/resolv.conf)
14022026-05-01T17:47:30.098Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
14032026-05-01T17:47:30.123Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
14042026-05-01T17:47:30.123Znote: database schema version matches expected (252.0.0)
14052026-05-01T17:47:30.188Zset pool 98c2d617-8407-4424-8cab-ec0527dfb202 control plane storage buffer bytes to 0
14062026-05-01T17:47:30.212Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
14072026-05-01T17:47:30.212Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer b580567f-d36f-4e1d-b183-dae6a39f94e9 0
14082026-05-01T17:47:30.241Znote: database URL not specified. Will search DNS.
14092026-05-01T17:47:30.241Znote: (override with --db-url or OMDB_DB_URL)
14102026-05-01T17:47:30.241Znote: using DNS from system config (typically /etc/resolv.conf)
14112026-05-01T17:47:30.241Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
14122026-05-01T17:47:30.266Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
14132026-05-01T17:47:30.266Znote: database schema version matches expected (252.0.0)
14142026-05-01T17:47:30.340Zset pool b580567f-d36f-4e1d-b183-dae6a39f94e9 control plane storage buffer bytes to 0
14152026-05-01T17:47:30.364Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list
14162026-05-01T17:47:30.392Znote: database URL not specified. Will search DNS.
14172026-05-01T17:47:30.392Znote: (override with --db-url or OMDB_DB_URL)
14182026-05-01T17:47:30.392Znote: using DNS from system config (typically /etc/resolv.conf)
14192026-05-01T17:47:30.392Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
14202026-05-01T17:47:30.416Znote: using database URL postgresql://root@[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
14212026-05-01T17:47:30.440Znote: database schema version matches expected (252.0.0)
14222026-05-01T17:47:30.653ZID |TIME_DELETED |SLED_ID |PHYSICAL_DISK_ID |TOTAL_SIZE |CONTROL_PLANE_STORAGE_BUFFER
14232026-05-01T17:47:30.653Z-------------------------------------+-------------+-------------------------------------+-------------------------------------+------------+-----------------------------
14242026-05-01T17:47:30.653Z01a79cc7-66f5-4420-93a2-2ca2a6ac9f26 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |7c16dc0f-62b4-48f8-b0a3-533c906c4766 |20937965568 |0
14252026-05-01T17:47:30.653Z01d68f80-4ecd-4c6a-9332-7bde4729ed97 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |a3f27d40-b42c-4513-a51a-a38cfa0d71c5 |20937965568 |0
14262026-05-01T17:47:30.653Z32bcd368-4687-4015-a93c-0cb550aaabdd | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |18542bb7-9d11-490c-80c8-770708182ea4 |20937965568 |0
14272026-05-01T17:47:30.653Z55d69189-14b6-4d38-ab2a-8b8b0826ceee | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |c108a037-fc69-41b4-9e8e-a4d2fe817a1e |20937965568 |0
14282026-05-01T17:47:30.653Z5c5d8536-e0f7-442e-b7c1-2a265a743b7a | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |ae4717a0-751a-4d2a-b169-da82a7689aa0 |20937965568 |0
14292026-05-01T17:47:30.653Z6b66cf61-6fec-4687-9f98-c6973910c3a7 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |a8e737e2-60a6-490a-b951-8bf0c0303a19 |20937965568 |0
14302026-05-01T17:47:30.653Z8b6986f3-3af1-4e41-90c8-aa0b7e52932a | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |81a97778-8589-4fea-9c51-5a93b1eea10b |20937965568 |0
14312026-05-01T17:47:30.653Z98c2d617-8407-4424-8cab-ec0527dfb202 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |3873d25a-aa7e-48cf-88aa-1354b33cdeed |20937965568 |0
14322026-05-01T17:47:30.653Zb580567f-d36f-4e1d-b183-dae6a39f94e9 | |fa5f59b3-a0f4-4fc7-973c-14fb3c8fd792 |fea8cfea-ce04-40eb-b873-a0a19b1f73b4 |20937965568 |0
14332026-05-01T17:47:30.678Z+ export RUST_BACKTRACE=1
14342026-05-01T17:47:30.678Z+ RUST_BACKTRACE=1
14352026-05-01T17:47:30.678Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
14362026-05-01T17:47:30.678Z++ ./target/debug/bootstrap
14372026-05-01T17:47:30.795ZUsing external DNS server at 10.151.1.164:53
14382026-05-01T17:47:30.820Z2026-05-01 17:47:30.788956026 UTC: attempting to log into API
14392026-05-01T17:47:32.378Z2026-05-01 17:47:32.368154137 UTC: login succeeded
14402026-05-01T17:47:32.403Zwaiting for nexus to come up...
14412026-05-01T17:47:32.571Zcreating IPv4 IP pool... 10.151.1.175 - 10.151.1.227
14422026-05-01T17:47:33.511Zcreating IPv6 IP pool... fd00::aa - fd00::bb
14432026-05-01T17:47:34.305Zsetting up quotas...
14442026-05-01T17:47:34.443Zensuring datasets are ready...
14452026-05-01T17:47:38.552Zlet's roll.
14462026-05-01T17:47:38.577Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
14472026-05-01T17:47:38.577ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.168
14482026-05-01T17:47:38.577ZOXIDE_TOKEN=oxide-token-8599f7c352f05d992a8586ff2687fde6bfd10dba'
14492026-05-01T17:47:38.577Z++ OXIDE_HOST=https://recovery.sys.oxide.test
14502026-05-01T17:47:38.577Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.168
14512026-05-01T17:47:38.577Z++ OXIDE_TOKEN=oxide-token-8599f7c352f05d992a8586ff2687fde6bfd10dba
14522026-05-01T17:47:38.577Z+ export OXIDE_HOST OXIDE_TOKEN
14532026-05-01T17:47:38.577Z+ retry=0
14542026-05-01T17:47:38.577Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14552026-05-01T17:47:38.602Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
14562026-05-01T17:47:39.527Z{"status":"ok"}{
14572026-05-01T17:47:39.527Z "description": "some images",
14582026-05-01T17:47:39.527Z "id": "85c78de4-3ecd-4f56-8383-2894302b7980",
14592026-05-01T17:47:39.527Z "name": "images",
14602026-05-01T17:47:39.527Z "time_created": "2026-05-01T17:47:38.687961Z",
14612026-05-01T17:47:39.527Z "time_modified": "2026-05-01T17:47:38.687961Z"
14622026-05-01T17:47:39.527Z}
14632026-05-01T17:47:39.552Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 --parallelism 1
14642026-05-01T17:58:37.280ZDone!
14652026-05-01T17:58:37.305Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
14662026-05-01T17:58:37.489Z{
14672026-05-01T17:58:37.489Z "block_size": 512,
14682026-05-01T17:58:37.489Z "description": "debian 11 original base image",
14692026-05-01T17:58:37.489Z "id": "f37369ac-db0a-4997-96f5-dbc7be56bcd0",
14702026-05-01T17:58:37.489Z "name": "debian11",
14712026-05-01T17:58:37.489Z "os": "debian",
14722026-05-01T17:58:37.489Z "size": 2147483648,
14732026-05-01T17:58:37.489Z "time_created": "2026-05-01T17:58:37.152168Z",
14742026-05-01T17:58:37.489Z "time_modified": "2026-05-01T17:58:37.413464Z",
14752026-05-01T17:58:37.489Z "version": "11"
14762026-05-01T17:58:37.489Z}
14772026-05-01T17:58:37.514Z+ for test_bin in tests/*
14782026-05-01T17:58:37.514Z+ ./tests/bootstrap-74e6eb0f591daf49
14792026-05-01T17:58:37.514Z
14802026-05-01T17:58:37.514Zrunning 0 tests
14812026-05-01T17:58:37.514Z
14822026-05-01T17:58:37.514Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
14832026-05-01T17:58:37.514Z
14842026-05-01T17:58:37.538Z+ for test_bin in tests/*
14852026-05-01T17:58:37.538Z+ ./tests/commtest-018d2ccb778f4c10
14862026-05-01T17:58:37.538Z
14872026-05-01T17:58:37.538Zrunning 0 tests
14882026-05-01T17:58:37.538Z
14892026-05-01T17:58:37.538Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
14902026-05-01T17:58:37.538Z
14912026-05-01T17:58:37.538Z+ for test_bin in tests/*
14922026-05-01T17:58:37.538Z+ ./tests/dhcp_server-76e3ebbc5d3ea82e
14932026-05-01T17:58:37.563Z
14942026-05-01T17:58:37.563Zrunning 0 tests
14952026-05-01T17:58:37.563Z
14962026-05-01T17:58:37.563Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
14972026-05-01T17:58:37.563Z
14982026-05-01T17:58:37.563Z+ for test_bin in tests/*
14992026-05-01T17:58:37.563Z+ ./tests/end_to_end_tests-b1282d7c5a8b36f5
15002026-05-01T17:58:37.637Z
15012026-05-01T17:58:37.637Zrunning 3 tests
15022026-05-01T17:58:37.662Znote: configured to log to "/tmp/end_to_end_tests-b1282d7c5a8b36f5-new_blueprint_noop.4201.0.log"
15032026-05-01T17:58:37.771Ztest no_spoof::no_spoof_here ... ok
15042026-05-01T17:58:38.101Ztest noop_blueprint::new_blueprint_noop ... ok
15052026-05-01T17:59:07.769Ztest instance_launch::instance_launch ... ok
15062026-05-01T17:59:07.770Z
15072026-05-01T17:59:07.770Ztest result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 30.13s
15082026-05-01T17:59:07.770Z
15092026-05-01T17:59:07.794Z+ _exit_trap
15102026-05-01T17:59:07.794Z+ local status=0
15112026-05-01T17:59:07.794Z+ set +o errexit
15122026-05-01T17:59:07.794Z+ [[ xc570ac2126dbbebbd8e98e73b580c5be6b7e460e != \x ]]
15132026-05-01T17:59:07.794Z+ pfexec cp /tmp/opteadm /opt/oxide/opte/bin/opteadm
15142026-05-01T17:59:07.949Z+ pfexec svcadm -Z disable -s cron
15152026-05-01T17:59:09.467Z+ [[ 0 -eq 0 ]]
15162026-05-01T17:59:09.467Z+ exit 0
15172026-05-01T17:59:09.491Zprocess exited: duration 958031 ms, exit code 0
 
15182026-05-01T17:59:09.605Zfound 127 output files
15192026-05-01T17:59:09.633Zuploading: /var/svc/log/oxide-mg-ddm:default.log (304954 bytes)
15202026-05-01T17:59:09.859Zupload warning: file "/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 304954 -> 305351
15212026-05-01T17:59:10.931Zuploaded: /var/svc/log/oxide-mg-ddm:default.log
15222026-05-01T17:59:10.931Zuploading: /var/svc/log/oxide-sled-agent:default.log (2848624 bytes)
15232026-05-01T17:59:12.323Zuploaded: /var/svc/log/oxide-sled-agent:default.log
15242026-05-01T17:59:12.323Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (14624315 bytes)
15252026-05-01T17:59:12.995Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 14624315 -> 14677058
15262026-05-01T17:59:14.066Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
15272026-05-01T17:59:14.089Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (8001 bytes)
15282026-05-01T17:59:15.184Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
15292026-05-01T17:59:15.208Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (292362 bytes)
15302026-05-01T17:59:15.396Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 292362 -> 294741
15312026-05-01T17:59:16.467Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
15322026-05-01T17:59:16.491Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (471309 bytes)
15332026-05-01T17:59:16.737Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 471309 -> 474477
15342026-05-01T17:59:17.807Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
15352026-05-01T17:59:17.831Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (4526245 bytes)
15362026-05-01T17:59:18.209Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 4526245 -> 4553140
15372026-05-01T17:59:19.278Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
15382026-05-01T17:59:19.278Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (7065103 bytes)
15392026-05-01T17:59:19.751Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 7065103 -> 7143641
15402026-05-01T17:59:20.883Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
15412026-05-01T17:59:20.883Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
15422026-05-01T17:59:21.955Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
15432026-05-01T17:59:21.955Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (505960 bytes)
15442026-05-01T17:59:22.196Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 505960 -> 513138
15452026-05-01T17:59:23.265Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
15462026-05-01T17:59:23.265Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (13455 bytes)
15472026-05-01T17:59:23.382Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 13455 -> 14040
15482026-05-01T17:59:24.451Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
15492026-05-01T17:59:24.451Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
15502026-05-01T17:59:25.521Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
15512026-05-01T17:59:25.521Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15522026-05-01T17:59:26.590Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
15532026-05-01T17:59:26.590Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_cockroachdb_5a2be691-0a40-4213-be9e-838c1e85eaf0/root/var/svc/log/oxide-cockroach-admin:default.log (64710 bytes)
15542026-05-01T17:59:26.722Zupload warning: file "/pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_cockroachdb_5a2be691-0a40-4213-be9e-838c1e85eaf0/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 64710 -> 69143
15552026-05-01T17:59:27.792Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_cockroachdb_5a2be691-0a40-4213-be9e-838c1e85eaf0/root/var/svc/log/oxide-cockroach-admin:default.log
15562026-05-01T17:59:27.792Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_cockroachdb_5a2be691-0a40-4213-be9e-838c1e85eaf0/root/var/svc/log/oxide-cockroachdb:default.log (4376 bytes)
15572026-05-01T17:59:28.887Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_cockroachdb_5a2be691-0a40-4213-be9e-838c1e85eaf0/root/var/svc/log/oxide-cockroachdb:default.log
15582026-05-01T17:59:28.887Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_cockroachdb_5a2be691-0a40-4213-be9e-838c1e85eaf0/root/var/svc/log/oxide-zone-network-setup:default.log (2096 bytes)
15592026-05-01T17:59:29.980Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_cockroachdb_5a2be691-0a40-4213-be9e-838c1e85eaf0/root/var/svc/log/oxide-zone-network-setup:default.log
15602026-05-01T17:59:29.980Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_9c0214e2-73de-447c-a052-f46cf1b88e21/root/var/svc/log/oxide-crucible-agent:default.log (1983 bytes)
15612026-05-01T17:59:31.074Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_9c0214e2-73de-447c-a052-f46cf1b88e21/root/var/svc/log/oxide-crucible-agent:default.log
15622026-05-01T17:59:31.097Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_9c0214e2-73de-447c-a052-f46cf1b88e21/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15632026-05-01T17:59:32.167Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_9c0214e2-73de-447c-a052-f46cf1b88e21/root/var/svc/log/oxide-crucible-downstairs:default.log
15642026-05-01T17:59:32.191Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_9c0214e2-73de-447c-a052-f46cf1b88e21/root/var/svc/log/oxide-zone-network-setup:default.log (2078 bytes)
15652026-05-01T17:59:33.259Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_9c0214e2-73de-447c-a052-f46cf1b88e21/root/var/svc/log/oxide-zone-network-setup:default.log
15662026-05-01T17:59:33.259Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_pantry_5147ddfb-2b31-4189-b6db-b9249d9ae5d5/root/var/svc/log/oxide-crucible-pantry:default.log (161452 bytes)
15672026-05-01T17:59:33.436Zupload warning: file "/pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_pantry_5147ddfb-2b31-4189-b6db-b9249d9ae5d5/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 161452 -> 168128
15682026-05-01T17:59:34.505Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_pantry_5147ddfb-2b31-4189-b6db-b9249d9ae5d5/root/var/svc/log/oxide-crucible-pantry:default.log
15692026-05-01T17:59:34.505Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_pantry_5147ddfb-2b31-4189-b6db-b9249d9ae5d5/root/var/svc/log/oxide-zone-network-setup:default.log (2134 bytes)
15702026-05-01T17:59:35.600Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_crucible_pantry_5147ddfb-2b31-4189-b6db-b9249d9ae5d5/root/var/svc/log/oxide-zone-network-setup:default.log
15712026-05-01T17:59:35.600Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/root/var/svc/log/oxide-internal_dns:default.log (445592 bytes)
15722026-05-01T17:59:35.842Zupload warning: file "/pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 445592 -> 473988
15732026-05-01T17:59:36.911Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/root/var/svc/log/oxide-internal_dns:default.log
15742026-05-01T17:59:36.911Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15752026-05-01T17:59:37.983Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/zone/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/root/var/svc/log/oxide-zone-network-setup:default.log
15762026-05-01T17:59:37.983Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_cockroachdb_b23d14a5-92ca-4d36-925a-a9ff3242873b/root/var/svc/log/oxide-cockroach-admin:default.log (64704 bytes)
15772026-05-01T17:59:38.116Zupload warning: file "/pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_cockroachdb_b23d14a5-92ca-4d36-925a-a9ff3242873b/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 64704 -> 69136
15782026-05-01T17:59:39.186Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_cockroachdb_b23d14a5-92ca-4d36-925a-a9ff3242873b/root/var/svc/log/oxide-cockroach-admin:default.log
15792026-05-01T17:59:39.210Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_cockroachdb_b23d14a5-92ca-4d36-925a-a9ff3242873b/root/var/svc/log/oxide-cockroachdb:default.log (4378 bytes)
15802026-05-01T17:59:40.279Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_cockroachdb_b23d14a5-92ca-4d36-925a-a9ff3242873b/root/var/svc/log/oxide-cockroachdb:default.log
15812026-05-01T17:59:40.279Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_cockroachdb_b23d14a5-92ca-4d36-925a-a9ff3242873b/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
15822026-05-01T17:59:41.374Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_cockroachdb_b23d14a5-92ca-4d36-925a-a9ff3242873b/root/var/svc/log/oxide-zone-network-setup:default.log
15832026-05-01T17:59:41.397Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_crucible_af577535-46b8-4dee-a19e-42bb81a46ae2/root/var/svc/log/oxide-crucible-agent:default.log (1985 bytes)
15842026-05-01T17:59:42.466Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_crucible_af577535-46b8-4dee-a19e-42bb81a46ae2/root/var/svc/log/oxide-crucible-agent:default.log
15852026-05-01T17:59:42.490Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_crucible_af577535-46b8-4dee-a19e-42bb81a46ae2/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15862026-05-01T17:59:43.560Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_crucible_af577535-46b8-4dee-a19e-42bb81a46ae2/root/var/svc/log/oxide-crucible-downstairs:default.log
15872026-05-01T17:59:43.584Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_crucible_af577535-46b8-4dee-a19e-42bb81a46ae2/root/var/svc/log/oxide-zone-network-setup:default.log (2076 bytes)
15882026-05-01T17:59:44.654Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_crucible_af577535-46b8-4dee-a19e-42bb81a46ae2/root/var/svc/log/oxide-zone-network-setup:default.log
15892026-05-01T17:59:44.654Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_nexus_db638d7d-5097-4b39-8929-d13e0c283380/root/var/svc/log/oxide-nexus:default.log (13215448 bytes)
15902026-05-01T17:59:45.306Zupload warning: file "/pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_nexus_db638d7d-5097-4b39-8929-d13e0c283380/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 13215448 -> 14054110
15912026-05-01T17:59:46.375Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_nexus_db638d7d-5097-4b39-8929-d13e0c283380/root/var/svc/log/oxide-nexus:default.log
15922026-05-01T17:59:46.375Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_nexus_db638d7d-5097-4b39-8929-d13e0c283380/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
15932026-05-01T17:59:47.469Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_nexus_db638d7d-5097-4b39-8929-d13e0c283380/root/var/svc/log/oxide-opte-interface-setup:default.log
15942026-05-01T17:59:47.469Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_nexus_db638d7d-5097-4b39-8929-d13e0c283380/root/var/svc/log/oxide-zone-network-setup:default.log (2053 bytes)
15952026-05-01T17:59:48.562Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_nexus_db638d7d-5097-4b39-8929-d13e0c283380/root/var/svc/log/oxide-zone-network-setup:default.log
15962026-05-01T17:59:48.586Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-chrony-setup:default.log (15278 bytes)
15972026-05-01T17:59:49.678Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-chrony-setup:default.log
15982026-05-01T17:59:49.678Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-ntp-admin:default.log (75334 bytes)
15992026-05-01T17:59:49.812Zupload warning: file "/pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-ntp-admin:default.log" changed size mid upload: 75334 -> 80018
16002026-05-01T17:59:50.882Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-ntp-admin:default.log
16012026-05-01T17:59:50.883Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-ntp:default.log (1131 bytes)
16022026-05-01T17:59:50.930Zupload warning: file "/pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 1131 -> 1216
16032026-05-01T17:59:51.999Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-ntp:default.log
16042026-05-01T17:59:51.999Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
16052026-05-01T17:59:53.091Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-opte-interface-setup:default.log
16062026-05-01T17:59:53.091Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-zone-network-setup:default.log (2027 bytes)
16072026-05-01T17:59:54.184Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/svc/log/oxide-zone-network-setup:default.log
16082026-05-01T17:59:54.184Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_clickhouse_eba09bee-ea9b-43ec-aeab-03b4471cc083/root/var/svc/log/oxide-clickhouse-admin-single:default.log (48412 bytes)
16092026-05-01T17:59:54.316Zupload warning: file "/pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_clickhouse_eba09bee-ea9b-43ec-aeab-03b4471cc083/root/var/svc/log/oxide-clickhouse-admin-single:default.log" changed size mid upload: 48412 -> 52189
16102026-05-01T17:59:55.388Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_clickhouse_eba09bee-ea9b-43ec-aeab-03b4471cc083/root/var/svc/log/oxide-clickhouse-admin-single:default.log
16112026-05-01T17:59:55.424Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_clickhouse_eba09bee-ea9b-43ec-aeab-03b4471cc083/root/var/svc/log/oxide-clickhouse:default.log (4656928 bytes)
16122026-05-01T17:59:55.799Zupload warning: file "/pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_clickhouse_eba09bee-ea9b-43ec-aeab-03b4471cc083/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 4656928 -> 4968373
16132026-05-01T17:59:56.871Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_clickhouse_eba09bee-ea9b-43ec-aeab-03b4471cc083/root/var/svc/log/oxide-clickhouse:default.log
16142026-05-01T17:59:56.895Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_clickhouse_eba09bee-ea9b-43ec-aeab-03b4471cc083/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
16152026-05-01T17:59:57.965Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_clickhouse_eba09bee-ea9b-43ec-aeab-03b4471cc083/root/var/svc/log/oxide-zone-network-setup:default.log
16162026-05-01T17:59:57.965Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_cockroachdb_014dc873-48a5-45c3-b392-e1955a7a7799/root/var/svc/log/oxide-cockroach-admin:default.log (66510 bytes)
16172026-05-01T17:59:58.097Zupload warning: file "/pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_cockroachdb_014dc873-48a5-45c3-b392-e1955a7a7799/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 66510 -> 70942
16182026-05-01T17:59:59.238Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_cockroachdb_014dc873-48a5-45c3-b392-e1955a7a7799/root/var/svc/log/oxide-cockroach-admin:default.log
16192026-05-01T17:59:59.238Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_cockroachdb_014dc873-48a5-45c3-b392-e1955a7a7799/root/var/svc/log/oxide-cockroachdb:default.log (4351 bytes)
16202026-05-01T18:00:00.331Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_cockroachdb_014dc873-48a5-45c3-b392-e1955a7a7799/root/var/svc/log/oxide-cockroachdb:default.log
16212026-05-01T18:00:00.331Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_cockroachdb_014dc873-48a5-45c3-b392-e1955a7a7799/root/var/svc/log/oxide-zone-network-setup:default.log (2095 bytes)
16222026-05-01T18:00:01.424Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_cockroachdb_014dc873-48a5-45c3-b392-e1955a7a7799/root/var/svc/log/oxide-zone-network-setup:default.log
16232026-05-01T18:00:01.424Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-crucible-agent:default.log (18414 bytes)
16242026-05-01T18:00:02.561Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-crucible-agent:default.log
16252026-05-01T18:00:02.585Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16262026-05-01T18:00:03.655Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-crucible-downstairs:default.log
16272026-05-01T18:00:03.655Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-crucible-downstairs:downstairs-1be80289-f7a3-4dc5-b8d2-5bf19d27e9d3.log (6105 bytes)
16282026-05-01T18:00:04.751Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-crucible-downstairs:downstairs-1be80289-f7a3-4dc5-b8d2-5bf19d27e9d3.log
16292026-05-01T18:00:04.775Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-crucible-downstairs:snapshot-1be80289-f7a3-4dc5-b8d2-5bf19d27e9d3-375ad000-cde4-4b35-8b5f-bbf420bf5694.log (5676 bytes)
16302026-05-01T18:00:05.844Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-crucible-downstairs:snapshot-1be80289-f7a3-4dc5-b8d2-5bf19d27e9d3-375ad000-cde4-4b35-8b5f-bbf420bf5694.log
16312026-05-01T18:00:05.844Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-zone-network-setup:default.log (2078 bytes)
16322026-05-01T18:00:06.935Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_bf397ec8-d09b-4d27-af30-829797b51e54/root/var/svc/log/oxide-zone-network-setup:default.log
16332026-05-01T18:00:06.935Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_pantry_92ee2c1d-1569-4f9e-b184-d87c6b2f31a1/root/var/svc/log/oxide-crucible-pantry:default.log (160828 bytes)
16342026-05-01T18:00:07.114Zupload warning: file "/pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_pantry_92ee2c1d-1569-4f9e-b184-d87c6b2f31a1/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 160828 -> 174178
16352026-05-01T18:00:08.185Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_pantry_92ee2c1d-1569-4f9e-b184-d87c6b2f31a1/root/var/svc/log/oxide-crucible-pantry:default.log
16362026-05-01T18:00:08.185Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_pantry_92ee2c1d-1569-4f9e-b184-d87c6b2f31a1/root/var/svc/log/oxide-zone-network-setup:default.log (2133 bytes)
16372026-05-01T18:00:09.280Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_crucible_pantry_92ee2c1d-1569-4f9e-b184-d87c6b2f31a1/root/var/svc/log/oxide-zone-network-setup:default.log
16382026-05-01T18:00:09.280Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_external_dns_03862149-4182-4e3e-a603-59ed360270cd/root/var/svc/log/oxide-external_dns:default.log (45742 bytes)
16392026-05-01T18:00:09.388Zupload warning: file "/pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_external_dns_03862149-4182-4e3e-a603-59ed360270cd/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 45742 -> 49512
16402026-05-01T18:00:10.459Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_external_dns_03862149-4182-4e3e-a603-59ed360270cd/root/var/svc/log/oxide-external_dns:default.log
16412026-05-01T18:00:10.459Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_external_dns_03862149-4182-4e3e-a603-59ed360270cd/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
16422026-05-01T18:00:11.560Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_external_dns_03862149-4182-4e3e-a603-59ed360270cd/root/var/svc/log/oxide-opte-interface-setup:default.log
16432026-05-01T18:00:11.560Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_external_dns_03862149-4182-4e3e-a603-59ed360270cd/root/var/svc/log/oxide-zone-network-setup:default.log (2109 bytes)
16442026-05-01T18:00:12.652Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_external_dns_03862149-4182-4e3e-a603-59ed360270cd/root/var/svc/log/oxide-zone-network-setup:default.log
16452026-05-01T18:00:12.652Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/root/var/svc/log/oxide-internal_dns:default.log (445572 bytes)
16462026-05-01T18:00:12.894Zupload warning: file "/pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 445572 -> 482739
16472026-05-01T18:00:13.963Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/root/var/svc/log/oxide-internal_dns:default.log
16482026-05-01T18:00:13.986Zuploading: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16492026-05-01T18:00:15.033Zuploaded: /pool/ext/32bcd368-4687-4015-a93c-0cb550aaabdd/crypt/zone/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/root/var/svc/log/oxide-zone-network-setup:default.log
16502026-05-01T18:00:15.033Zuploading: /pool/ext/55d69189-14b6-4d38-ab2a-8b8b0826ceee/crypt/zone/oxz_crucible_5e7a0577-bbf5-4898-b60b-8379c0896cd3/root/var/svc/log/oxide-crucible-agent:default.log (12921 bytes)
16512026-05-01T18:00:16.148Zuploaded: /pool/ext/55d69189-14b6-4d38-ab2a-8b8b0826ceee/crypt/zone/oxz_crucible_5e7a0577-bbf5-4898-b60b-8379c0896cd3/root/var/svc/log/oxide-crucible-agent:default.log
16522026-05-01T18:00:16.148Zuploading: /pool/ext/55d69189-14b6-4d38-ab2a-8b8b0826ceee/crypt/zone/oxz_crucible_5e7a0577-bbf5-4898-b60b-8379c0896cd3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16532026-05-01T18:00:17.240Zuploaded: /pool/ext/55d69189-14b6-4d38-ab2a-8b8b0826ceee/crypt/zone/oxz_crucible_5e7a0577-bbf5-4898-b60b-8379c0896cd3/root/var/svc/log/oxide-crucible-downstairs:default.log
16542026-05-01T18:00:17.240Zuploading: /pool/ext/55d69189-14b6-4d38-ab2a-8b8b0826ceee/crypt/zone/oxz_crucible_5e7a0577-bbf5-4898-b60b-8379c0896cd3/root/var/svc/log/oxide-crucible-downstairs:downstairs-4c9e669b-74b3-4798-b9db-8cb146d4db54.log (3127 bytes)
16552026-05-01T18:00:18.334Zuploaded: /pool/ext/55d69189-14b6-4d38-ab2a-8b8b0826ceee/crypt/zone/oxz_crucible_5e7a0577-bbf5-4898-b60b-8379c0896cd3/root/var/svc/log/oxide-crucible-downstairs:downstairs-4c9e669b-74b3-4798-b9db-8cb146d4db54.log
16562026-05-01T18:00:18.358Zuploading: /pool/ext/55d69189-14b6-4d38-ab2a-8b8b0826ceee/crypt/zone/oxz_crucible_5e7a0577-bbf5-4898-b60b-8379c0896cd3/root/var/svc/log/oxide-zone-network-setup:default.log (2078 bytes)
16572026-05-01T18:00:19.428Zuploaded: /pool/ext/55d69189-14b6-4d38-ab2a-8b8b0826ceee/crypt/zone/oxz_crucible_5e7a0577-bbf5-4898-b60b-8379c0896cd3/root/var/svc/log/oxide-zone-network-setup:default.log
16582026-05-01T18:00:19.428Zuploading: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-agent:default.log (45021 bytes)
16592026-05-01T18:00:20.585Zuploaded: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-agent:default.log
16602026-05-01T18:00:20.610Zuploading: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16612026-05-01T18:00:21.680Zuploaded: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:default.log
16622026-05-01T18:00:21.680Zuploading: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c35150b-fa6b-4f6a-bbda-31b67f32a5aa.log (6104 bytes)
16632026-05-01T18:00:22.773Zuploaded: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c35150b-fa6b-4f6a-bbda-31b67f32a5aa.log
16642026-05-01T18:00:22.773Zuploading: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:downstairs-9b7546ed-a35d-4a69-a8e8-a9b4c2e0a4b7.log (6001 bytes)
16652026-05-01T18:00:23.867Zuploaded: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:downstairs-9b7546ed-a35d-4a69-a8e8-a9b4c2e0a4b7.log
16662026-05-01T18:00:23.867Zuploading: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:downstairs-a566b4c8-34a9-4758-aa70-7f7d109bda9b.log (3127 bytes)
16672026-05-01T18:00:24.960Zuploaded: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:downstairs-a566b4c8-34a9-4758-aa70-7f7d109bda9b.log
16682026-05-01T18:00:24.960Zuploading: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:downstairs-f105ba7a-bec1-4ea7-b51f-eefcd6d99a41.log (3007 bytes)
16692026-05-01T18:00:26.054Zuploaded: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:downstairs-f105ba7a-bec1-4ea7-b51f-eefcd6d99a41.log
16702026-05-01T18:00:26.078Zuploading: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:snapshot-5c35150b-fa6b-4f6a-bbda-31b67f32a5aa-375ad000-cde4-4b35-8b5f-bbf420bf5694.log (5678 bytes)
16712026-05-01T18:00:27.147Zuploaded: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-crucible-downstairs:snapshot-5c35150b-fa6b-4f6a-bbda-31b67f32a5aa-375ad000-cde4-4b35-8b5f-bbf420bf5694.log
16722026-05-01T18:00:27.172Zuploading: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-zone-network-setup:default.log (2079 bytes)
16732026-05-01T18:00:28.242Zuploaded: /pool/ext/5c5d8536-e0f7-442e-b7c1-2a265a743b7a/crypt/zone/oxz_crucible_a67dc0d4-2172-45a3-9f0d-eb03662b804a/root/var/svc/log/oxide-zone-network-setup:default.log
16742026-05-01T18:00:28.242Zuploading: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-crucible-agent:default.log (24319 bytes)
16752026-05-01T18:00:29.377Zuploaded: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-crucible-agent:default.log
16762026-05-01T18:00:29.377Zuploading: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16772026-05-01T18:00:30.472Zuploaded: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-crucible-downstairs:default.log
16782026-05-01T18:00:30.495Zuploading: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-crucible-downstairs:downstairs-316899de-4b14-4ab0-9f6a-6a946da72258.log (6000 bytes)
16792026-05-01T18:00:31.564Zuploaded: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-crucible-downstairs:downstairs-316899de-4b14-4ab0-9f6a-6a946da72258.log
16802026-05-01T18:00:31.564Zuploading: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-crucible-downstairs:downstairs-7e57b96c-574e-4dde-b56e-db7709ffa813.log (3009 bytes)
16812026-05-01T18:00:32.657Zuploaded: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-crucible-downstairs:downstairs-7e57b96c-574e-4dde-b56e-db7709ffa813.log
16822026-05-01T18:00:32.657Zuploading: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-zone-network-setup:default.log (2079 bytes)
16832026-05-01T18:00:33.754Zuploaded: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_crucible_3171d54d-d955-41f5-82c6-ac6836ab4660/root/var/svc/log/oxide-zone-network-setup:default.log
16842026-05-01T18:00:33.754Zuploading: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_nexus_7f7afcd1-9cd9-4ac8-a666-8634c38d0333/root/var/svc/log/oxide-nexus:default.log (70976151 bytes)
16852026-05-01T18:00:39.422Zupload warning: file "/pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_nexus_7f7afcd1-9cd9-4ac8-a666-8634c38d0333/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 70976151 -> 72834381
16862026-05-01T18:00:40.492Zuploaded: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_nexus_7f7afcd1-9cd9-4ac8-a666-8634c38d0333/root/var/svc/log/oxide-nexus:default.log
16872026-05-01T18:00:40.492Zuploading: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_nexus_7f7afcd1-9cd9-4ac8-a666-8634c38d0333/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
16882026-05-01T18:00:41.585Zuploaded: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_nexus_7f7afcd1-9cd9-4ac8-a666-8634c38d0333/root/var/svc/log/oxide-opte-interface-setup:default.log
16892026-05-01T18:00:41.585Zuploading: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_nexus_7f7afcd1-9cd9-4ac8-a666-8634c38d0333/root/var/svc/log/oxide-zone-network-setup:default.log (2052 bytes)
16902026-05-01T18:00:42.677Zuploaded: /pool/ext/6b66cf61-6fec-4687-9f98-c6973910c3a7/crypt/zone/oxz_nexus_7f7afcd1-9cd9-4ac8-a666-8634c38d0333/root/var/svc/log/oxide-zone-network-setup:default.log
16912026-05-01T18:00:42.700Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_cockroachdb_2c2bd635-5356-45b2-ab19-152d64da79f1/root/var/svc/log/oxide-cockroach-admin:default.log (64702 bytes)
16922026-05-01T18:00:42.810Zupload warning: file "/pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_cockroachdb_2c2bd635-5356-45b2-ab19-152d64da79f1/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 64702 -> 73564
16932026-05-01T18:00:43.880Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_cockroachdb_2c2bd635-5356-45b2-ab19-152d64da79f1/root/var/svc/log/oxide-cockroach-admin:default.log
16942026-05-01T18:00:43.880Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_cockroachdb_2c2bd635-5356-45b2-ab19-152d64da79f1/root/var/svc/log/oxide-cockroachdb:default.log (4451 bytes)
16952026-05-01T18:00:44.974Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_cockroachdb_2c2bd635-5356-45b2-ab19-152d64da79f1/root/var/svc/log/oxide-cockroachdb:default.log
16962026-05-01T18:00:44.999Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_cockroachdb_2c2bd635-5356-45b2-ab19-152d64da79f1/root/var/svc/log/oxide-zone-network-setup:default.log (2097 bytes)
16972026-05-01T18:00:46.066Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_cockroachdb_2c2bd635-5356-45b2-ab19-152d64da79f1/root/var/svc/log/oxide-zone-network-setup:default.log
16982026-05-01T18:00:46.067Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_2641098c-9d4a-4f78-8d1a-bcca04b1bdbd/root/var/svc/log/oxide-crucible-agent:default.log (1984 bytes)
16992026-05-01T18:00:47.160Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_2641098c-9d4a-4f78-8d1a-bcca04b1bdbd/root/var/svc/log/oxide-crucible-agent:default.log
17002026-05-01T18:00:47.160Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_2641098c-9d4a-4f78-8d1a-bcca04b1bdbd/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
17012026-05-01T18:00:48.253Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_2641098c-9d4a-4f78-8d1a-bcca04b1bdbd/root/var/svc/log/oxide-crucible-downstairs:default.log
17022026-05-01T18:00:48.253Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_2641098c-9d4a-4f78-8d1a-bcca04b1bdbd/root/var/svc/log/oxide-zone-network-setup:default.log (2078 bytes)
17032026-05-01T18:00:49.347Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_2641098c-9d4a-4f78-8d1a-bcca04b1bdbd/root/var/svc/log/oxide-zone-network-setup:default.log
17042026-05-01T18:00:49.347Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_pantry_1fde02c2-c246-4d75-8ddf-9723fc2df75c/root/var/svc/log/oxide-crucible-pantry:default.log (916653 bytes)
17052026-05-01T18:00:49.637Zupload warning: file "/pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_pantry_1fde02c2-c246-4d75-8ddf-9723fc2df75c/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 916653 -> 938849
17062026-05-01T18:00:50.706Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_pantry_1fde02c2-c246-4d75-8ddf-9723fc2df75c/root/var/svc/log/oxide-crucible-pantry:default.log
17072026-05-01T18:00:50.706Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_pantry_1fde02c2-c246-4d75-8ddf-9723fc2df75c/root/var/svc/log/oxide-zone-network-setup:default.log (2132 bytes)
17082026-05-01T18:00:51.800Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_crucible_pantry_1fde02c2-c246-4d75-8ddf-9723fc2df75c/root/var/svc/log/oxide-zone-network-setup:default.log
17092026-05-01T18:00:51.800Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_oximeter_e8290920-23d1-4523-b016-0e1656e8c315/root/var/svc/log/oxide-oximeter:default.log (4462836 bytes)
17102026-05-01T18:00:52.601Zupload warning: file "/pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_oximeter_e8290920-23d1-4523-b016-0e1656e8c315/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 4462836 -> 5134699
17112026-05-01T18:00:53.670Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_oximeter_e8290920-23d1-4523-b016-0e1656e8c315/root/var/svc/log/oxide-oximeter:default.log
17122026-05-01T18:00:53.694Zuploading: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_oximeter_e8290920-23d1-4523-b016-0e1656e8c315/root/var/svc/log/oxide-zone-network-setup:default.log (2077 bytes)
17132026-05-01T18:00:54.763Zuploaded: /pool/ext/8b6986f3-3af1-4e41-90c8-aa0b7e52932a/crypt/zone/oxz_oximeter_e8290920-23d1-4523-b016-0e1656e8c315/root/var/svc/log/oxide-zone-network-setup:default.log
17142026-05-01T18:00:54.763Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_cockroachdb_31c9bcc6-ccc6-49f7-8867-27dd9c749a17/root/var/svc/log/oxide-cockroach-admin:default.log (64704 bytes)
17152026-05-01T18:00:54.895Zupload warning: file "/pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_cockroachdb_31c9bcc6-ccc6-49f7-8867-27dd9c749a17/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 64704 -> 73566
17162026-05-01T18:00:55.964Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_cockroachdb_31c9bcc6-ccc6-49f7-8867-27dd9c749a17/root/var/svc/log/oxide-cockroach-admin:default.log
17172026-05-01T18:00:55.964Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_cockroachdb_31c9bcc6-ccc6-49f7-8867-27dd9c749a17/root/var/svc/log/oxide-cockroachdb:default.log (4377 bytes)
17182026-05-01T18:00:57.058Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_cockroachdb_31c9bcc6-ccc6-49f7-8867-27dd9c749a17/root/var/svc/log/oxide-cockroachdb:default.log
17192026-05-01T18:00:57.058Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_cockroachdb_31c9bcc6-ccc6-49f7-8867-27dd9c749a17/root/var/svc/log/oxide-zone-network-setup:default.log (2097 bytes)
17202026-05-01T18:00:58.151Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_cockroachdb_31c9bcc6-ccc6-49f7-8867-27dd9c749a17/root/var/svc/log/oxide-zone-network-setup:default.log
17212026-05-01T18:00:58.151Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-agent:default.log (35243 bytes)
17222026-05-01T18:00:59.288Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-agent:default.log
17232026-05-01T18:00:59.288Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
17242026-05-01T18:01:00.381Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:default.log
17252026-05-01T18:01:00.405Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:downstairs-3d54173f-cf4f-42e2-9826-a4af3ebbb714.log (6001 bytes)
17262026-05-01T18:01:01.473Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:downstairs-3d54173f-cf4f-42e2-9826-a4af3ebbb714.log
17272026-05-01T18:01:01.473Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:downstairs-919ea6ef-85ca-4e3f-b2a2-d9195d854a21.log (3007 bytes)
17282026-05-01T18:01:02.566Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:downstairs-919ea6ef-85ca-4e3f-b2a2-d9195d854a21.log
17292026-05-01T18:01:02.591Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:downstairs-c802d9e2-1d70-4778-9583-642a17c369c6.log (6107 bytes)
17302026-05-01T18:01:03.659Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:downstairs-c802d9e2-1d70-4778-9583-642a17c369c6.log
17312026-05-01T18:01:03.660Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:snapshot-c802d9e2-1d70-4778-9583-642a17c369c6-375ad000-cde4-4b35-8b5f-bbf420bf5694.log (5679 bytes)
17322026-05-01T18:01:04.752Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-crucible-downstairs:snapshot-c802d9e2-1d70-4778-9583-642a17c369c6-375ad000-cde4-4b35-8b5f-bbf420bf5694.log
17332026-05-01T18:01:04.776Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-zone-network-setup:default.log (2078 bytes)
17342026-05-01T18:01:05.845Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_crucible_3f8cadda-832f-4702-ab8e-29ebd6655628/root/var/svc/log/oxide-zone-network-setup:default.log
17352026-05-01T18:01:05.869Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_external_dns_cfb5e377-b1e7-4b2b-9f9e-0faaef032667/root/var/svc/log/oxide-external_dns:default.log (45751 bytes)
17362026-05-01T18:01:05.977Zupload warning: file "/pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_external_dns_cfb5e377-b1e7-4b2b-9f9e-0faaef032667/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 45751 -> 53293
17372026-05-01T18:01:07.048Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_external_dns_cfb5e377-b1e7-4b2b-9f9e-0faaef032667/root/var/svc/log/oxide-external_dns:default.log
17382026-05-01T18:01:07.048Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_external_dns_cfb5e377-b1e7-4b2b-9f9e-0faaef032667/root/var/svc/log/oxide-opte-interface-setup:default.log (1154 bytes)
17392026-05-01T18:01:08.141Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_external_dns_cfb5e377-b1e7-4b2b-9f9e-0faaef032667/root/var/svc/log/oxide-opte-interface-setup:default.log
17402026-05-01T18:01:08.141Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_external_dns_cfb5e377-b1e7-4b2b-9f9e-0faaef032667/root/var/svc/log/oxide-zone-network-setup:default.log (2108 bytes)
17412026-05-01T18:01:09.265Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_external_dns_cfb5e377-b1e7-4b2b-9f9e-0faaef032667/root/var/svc/log/oxide-zone-network-setup:default.log
17422026-05-01T18:01:09.265Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/root/var/svc/log/oxide-internal_dns:default.log (445583 bytes)
17432026-05-01T18:01:09.510Zupload warning: file "/pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 445583 -> 514785
17442026-05-01T18:01:10.580Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/root/var/svc/log/oxide-internal_dns:default.log
17452026-05-01T18:01:10.581Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
17462026-05-01T18:01:11.651Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/root/var/svc/log/oxide-zone-network-setup:default.log
17472026-05-01T18:01:11.651Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_nexus_95acbec6-42d5-41e5-b8a8-cab8e54d3010/root/var/svc/log/oxide-nexus:default.log (13121509 bytes)
17482026-05-01T18:01:13.559Zupload warning: file "/pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_nexus_95acbec6-42d5-41e5-b8a8-cab8e54d3010/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 13121509 -> 15152767
17492026-05-01T18:01:14.629Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_nexus_95acbec6-42d5-41e5-b8a8-cab8e54d3010/root/var/svc/log/oxide-nexus:default.log
17502026-05-01T18:01:14.629Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_nexus_95acbec6-42d5-41e5-b8a8-cab8e54d3010/root/var/svc/log/oxide-opte-interface-setup:default.log (1134 bytes)
17512026-05-01T18:01:15.723Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_nexus_95acbec6-42d5-41e5-b8a8-cab8e54d3010/root/var/svc/log/oxide-opte-interface-setup:default.log
17522026-05-01T18:01:15.723Zuploading: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_nexus_95acbec6-42d5-41e5-b8a8-cab8e54d3010/root/var/svc/log/oxide-zone-network-setup:default.log (2053 bytes)
17532026-05-01T18:01:16.816Zuploaded: /pool/ext/98c2d617-8407-4424-8cab-ec0527dfb202/crypt/zone/oxz_nexus_95acbec6-42d5-41e5-b8a8-cab8e54d3010/root/var/svc/log/oxide-zone-network-setup:default.log
17542026-05-01T18:01:16.816Zuploading: /pool/ext/b580567f-d36f-4e1d-b183-dae6a39f94e9/crypt/zone/oxz_crucible_db6f4927-4541-4edc-bc4b-3e322dadbf5a/root/var/svc/log/oxide-crucible-agent:default.log (12919 bytes)
17552026-05-01T18:01:17.932Zuploaded: /pool/ext/b580567f-d36f-4e1d-b183-dae6a39f94e9/crypt/zone/oxz_crucible_db6f4927-4541-4edc-bc4b-3e322dadbf5a/root/var/svc/log/oxide-crucible-agent:default.log
17562026-05-01T18:01:17.932Zuploading: /pool/ext/b580567f-d36f-4e1d-b183-dae6a39f94e9/crypt/zone/oxz_crucible_db6f4927-4541-4edc-bc4b-3e322dadbf5a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
17572026-05-01T18:01:19.033Zuploaded: /pool/ext/b580567f-d36f-4e1d-b183-dae6a39f94e9/crypt/zone/oxz_crucible_db6f4927-4541-4edc-bc4b-3e322dadbf5a/root/var/svc/log/oxide-crucible-downstairs:default.log
17582026-05-01T18:01:19.058Zuploading: /pool/ext/b580567f-d36f-4e1d-b183-dae6a39f94e9/crypt/zone/oxz_crucible_db6f4927-4541-4edc-bc4b-3e322dadbf5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-78836028-a920-4404-8505-33d5cf9e37ea.log (3127 bytes)
17592026-05-01T18:01:20.127Zuploaded: /pool/ext/b580567f-d36f-4e1d-b183-dae6a39f94e9/crypt/zone/oxz_crucible_db6f4927-4541-4edc-bc4b-3e322dadbf5a/root/var/svc/log/oxide-crucible-downstairs:downstairs-78836028-a920-4404-8505-33d5cf9e37ea.log
17602026-05-01T18:01:20.127Zuploading: /pool/ext/b580567f-d36f-4e1d-b183-dae6a39f94e9/crypt/zone/oxz_crucible_db6f4927-4541-4edc-bc4b-3e322dadbf5a/root/var/svc/log/oxide-zone-network-setup:default.log (2078 bytes)
17612026-05-01T18:01:21.220Zuploaded: /pool/ext/b580567f-d36f-4e1d-b183-dae6a39f94e9/crypt/zone/oxz_crucible_db6f4927-4541-4edc-bc4b-3e322dadbf5a/root/var/svc/log/oxide-zone-network-setup:default.log
17622026-05-01T18:01:21.220Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/measurements.log (656739 bytes)
17632026-05-01T18:01:21.515Zupload warning: file "/pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/measurements.log" changed size mid upload: 656739 -> 783882
17642026-05-01T18:01:22.585Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/measurements.log
17652026-05-01T18:01:22.585Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/statistics.log (506844 bytes)
17662026-05-01T18:01:22.862Zupload warning: file "/pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/statistics.log" changed size mid upload: 506844 -> 610623
17672026-05-01T18:01:23.932Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/statistics.log
17682026-05-01T18:01:23.932Zuploading: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/tracking.log (78293 bytes)
17692026-05-01T18:01:24.086Zupload warning: file "/pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/tracking.log" changed size mid upload: 78293 -> 90437
17702026-05-01T18:01:25.157Zuploaded: /pool/ext/01d68f80-4ecd-4c6a-9332-7bde4729ed97/crypt/zone/oxz_ntp_1305a132-0669-493b-a551-d62614c9de47/root/var/log/chrony/tracking.log
17712026-05-01T18:01:25.157Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/oxide-internal_dns:default.log.1777657500 (73860 bytes)
17722026-05-01T18:01:26.337Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/oxide-internal_dns:default.log.1777657500
17732026-05-01T18:01:26.337Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/oxide-zone-network-setup:default.log.1777657492 (2089 bytes)
17742026-05-01T18:01:27.431Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_a7f32d2b-d294-4282-a76e-6091f0e4a823/oxide-zone-network-setup:default.log.1777657492
17752026-05-01T18:01:27.455Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/oxide-internal_dns:default.log.1777657500 (73857 bytes)
17762026-05-01T18:01:28.631Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/oxide-internal_dns:default.log.1777657500
17772026-05-01T18:01:28.632Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/oxide-zone-network-setup:default.log.1777657492 (2089 bytes)
17782026-05-01T18:01:29.726Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_e298d354-593f-4477-8752-2062226d4e9d/oxide-zone-network-setup:default.log.1777657492
17792026-05-01T18:01:29.750Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/oxide-internal_dns:default.log.1777657500 (73860 bytes)
17802026-05-01T18:01:30.905Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/oxide-internal_dns:default.log.1777657500
17812026-05-01T18:01:30.905Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/oxide-zone-network-setup:default.log.1777657492 (2090 bytes)
17822026-05-01T18:01:31.997Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_internal_dns_eff604c5-d202-4477-aafc-1b786febb272/oxide-zone-network-setup:default.log.1777657492
17832026-05-01T18:01:31.997Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-dendrite:default.log.1777657500 (339915 bytes)
17842026-05-01T18:01:33.264Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-dendrite:default.log.1777657500
17852026-05-01T18:01:33.264Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-lldpd:default.log.1777657490 (33217 bytes)
17862026-05-01T18:01:34.401Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-lldpd:default.log.1777657490
17872026-05-01T18:01:34.401Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-mg-ddm:default.log.1777657499 (12056 bytes)
17882026-05-01T18:01:35.517Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-mg-ddm:default.log.1777657499
17892026-05-01T18:01:35.517Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-mgd:default.log.1777657499 (48096 bytes)
17902026-05-01T18:01:36.676Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-mgd:default.log.1777657499
17912026-05-01T18:01:36.701Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-mgs:default.log.1777657499 (104994 bytes)
17922026-05-01T18:01:37.878Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-mgs:default.log.1777657499
17932026-05-01T18:01:37.878Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-sp-sim:default.log.1777657500 (101403 bytes)
17942026-05-01T18:01:39.058Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-sp-sim:default.log.1777657500
17952026-05-01T18:01:39.058Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-switch_zone_setup:default.log.1777657489 (3339 bytes)
17962026-05-01T18:01:40.151Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-switch_zone_setup:default.log.1777657489
17972026-05-01T18:01:40.176Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-tfport:default.log.1777657499 (21284 bytes)
17982026-05-01T18:01:41.294Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-tfport:default.log.1777657499
17992026-05-01T18:01:41.294Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-uplink:default.log.1777657491 (835 bytes)
18002026-05-01T18:01:42.387Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-uplink:default.log.1777657491
18012026-05-01T18:01:42.387Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-wicketd:default.log.1777657490 (3499 bytes)
18022026-05-01T18:01:43.481Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-wicketd:default.log.1777657490
18032026-05-01T18:01:43.481Zuploading: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-zone-network-setup:default.log.1777657489 (2383 bytes)
18042026-05-01T18:01:44.574Zuploaded: /pool/ext/01a79cc7-66f5-4420-93a2-2ca2a6ac9f26/crypt/debug/oxz_switch/oxide-zone-network-setup:default.log.1777657489