01K0F4SC0MN342K2QA5QWKGMB0: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-*.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
        "/tmp/kstat/*.kstat",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.37",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01K0F4V7DQTFAPZG1BDV2HB300

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12025-07-18T16:53:08.528Zjob dependencies complete; ready to run (waiting for 42 m 8 s)
22025-07-18T19:05:03.649Zjob assigned to worker 01K0FEJX8FNXCSN42AP5SHKXMF [factory lab, buskin/15902] (queued for 2 h 11 m 55 s)
32025-07-18T19:05:03.893Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42025-07-18T19:05:03.938Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52025-07-18T19:05:03.972Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62025-07-18T19:05:04.005Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72025-07-18T19:05:04.039Zhttp://172.20.0.5:9969/postboot/buskin... ok
82025-07-18T19:05:04.073ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92025-07-18T19:05:04.106Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102025-07-18T19:05:04.140ZOxide Helios Version helios-2.0.23457 64-bit
112025-07-18T19:05:04.173ZConfiguring devices.
122025-07-18T19:05:04.207Z##################################################
132025-07-18T19:05:04.241Z#### ############# ##
142025-07-18T19:05:04.275Z### ### ############ ##
152025-07-18T19:05:04.330Z## ### # ## ### ## Oxide Computer Company ##
162025-07-18T19:05:04.364Z## ## ## ### # ### ##
172025-07-18T19:05:04.398Z## # ### #### #### This Station Under ##
182025-07-18T19:05:04.431Z### ### #### # ### Computer Control ##
192025-07-18T19:05:04.464Z#### #### ### ## ##
202025-07-18T19:05:04.498Z##################################################
212025-07-18T19:05:04.531ZHostname: buskin
222025-07-18T19:05:04.565ZLoading smf(7) service descriptions:
232025-07-18T19:05:04.768Zdownloading input: /input/package/work/package.tar.gz
242025-07-18T19:11:35.289Zdownloaded input: /input/package/work/package.tar.gz
 
252025-07-18T19:11:35.314Zstarting task 0: "setup"
262025-07-18T19:11:35.314Z++ uname -s
272025-07-18T19:11:35.314Z+ kern=SunOS
282025-07-18T19:11:35.314Z+ build_user=build
292025-07-18T19:11:35.314Z+ build_uid=12345
302025-07-18T19:11:35.314Z+ work_dir=/work
312025-07-18T19:11:35.314Z+ input_dir=/input
322025-07-18T19:11:35.314Z+ [[ 0 == 12345 ]]
332025-07-18T19:11:35.314Z+ case "$kern" in
342025-07-18T19:11:35.314Z+ groupadd -g 12345 build
352025-07-18T19:11:35.314Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
362025-07-18T19:11:37.269Z+ zfs create -o mountpoint=/work rpool/work
372025-07-18T19:11:37.306Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
382025-07-18T19:11:37.330Z+ home_fs=zfs
392025-07-18T19:11:37.333Z+ [[ zfs == autofs ]]
402025-07-18T19:11:37.333Z+ mkdir -p /home/build
412025-07-18T19:11:37.333Z+ chown build:build /home/build /work
422025-07-18T19:11:39.314Z+ chmod 0700 /home/build /work
432025-07-18T19:11:39.339Zprocess exited: duration 4068 ms, exit code 0
 
442025-07-18T19:11:39.388Zstarting task 1: "authentication"
452025-07-18T19:11:39.484Zprocess exited: duration 45 ms, exit code 0
 
462025-07-18T19:11:39.538Zstarting task 2: "build"
472025-07-18T19:11:39.563Z+ trap _exit_trap EXIT
482025-07-18T19:11:39.563Z+ OPTE_COMMIT=
492025-07-18T19:11:39.563Z+ [[ x != \x ]]
502025-07-18T19:11:39.563Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
512025-07-18T19:11:39.657Zsecpolicy_fs_linkdir: 0x55 = 0x55
522025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
532025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
542025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+3: 0 = 0xe5
552025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+4: 0 = 0xb8
562025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+5: 0 = 0x1
572025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
582025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
592025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
602025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
612025-07-18T19:11:39.657Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
622025-07-18T19:11:39.684Z+ [[ -d /opt/oxide ]]
632025-07-18T19:11:39.684Z+ pfexec mv /opt/oxide /opt/oxide-underneath
642025-07-18T19:11:39.684Z+ pfexec mkdir /opt/oxide
652025-07-18T19:11:39.684Z+ pfexec mount -F tmpfs -O swap /opt/oxide
662025-07-18T19:11:39.684Z+ [[ -d /opt/oxide-underneath ]]
672025-07-18T19:11:39.684Z+ cd /opt/oxide-underneath
682025-07-18T19:11:39.684Z+ pfexec tar ceEp@/f - .
692025-07-18T19:11:39.685Z+ cd /opt/oxide
702025-07-18T19:11:39.685Z+ pfexec tar xveEp@/f -
712025-07-18T19:11:39.718Zx ., 0 bytes, 0 tape blocks
722025-07-18T19:11:39.718Zx ./opte, 0 bytes, 0 tape blocks
732025-07-18T19:11:39.718Zx ./opte/bin, 0 bytes, 0 tape blocks
742025-07-18T19:11:39.718Zx ./opte/bin/opteadm, 20875880 bytes, 40774 tape blocks
752025-07-18T19:11:39.743Z+ pfexec rm -rf /opt/oxide-underneath
762025-07-18T19:11:39.744Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
772025-07-18T19:11:39.769Z+ pfexec mkdir /opt/oxide/work
782025-07-18T19:11:39.769Z+ pfexec chown build:build /opt/oxide/work
792025-07-18T19:11:39.769Z+ cd /opt/oxide/work
802025-07-18T19:11:39.769Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
812025-07-18T19:11:59.144ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
822025-07-18T19:11:59.144Zx .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks
832025-07-18T19:11:59.144Zx out/target/test, 107 bytes, 1 tape blocks
842025-07-18T19:11:59.144Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
852025-07-18T19:11:59.144Zx package-manifest.toml, 34353 bytes, 68 tape blocks
862025-07-18T19:11:59.144Zx smf/sled-agent/non-gimlet/config.toml, 4942 bytes, 10 tape blocks
872025-07-18T19:11:59.144Zx target/release/omicron-package, 41877504 bytes, 81792 tape blocks
882025-07-18T19:11:59.144Zx target/release/xtask, 11872928 bytes, 23190 tape blocks
892025-07-18T19:11:59.144Zx target/debug/bootstrap, 249501560 bytes, 487308 tape blocks
902025-07-18T19:11:59.144Zx tests/bootstrap-0475c9d74c3b1c63, 23895536 bytes, 46671 tape blocks
912025-07-18T19:11:59.144Zx tests/commtest-cac5147583770bcc, 30201984 bytes, 58989 tape blocks
922025-07-18T19:11:59.144Zx tests/dhcp_server-5ebd6d92daba20bd, 23895536 bytes, 46671 tape blocks
932025-07-18T19:11:59.145Zx tests/end_to_end_tests-01cfe3e16a30235b, 340495776 bytes, 665031 tape blocks
942025-07-18T19:11:59.145Zx out/clickhouse.tar.gz, 327713096 bytes, 640065 tape blocks
952025-07-18T19:11:59.145Zx out/clickhouse_keeper.tar.gz, 311178669 bytes, 607771 tape blocks
962025-07-18T19:11:59.145Zx out/clickhouse_server.tar.gz, 327712028 bytes, 640063 tape blocks
972025-07-18T19:11:59.145Zx out/cockroachdb.tar.gz, 166482662 bytes, 325162 tape blocks
982025-07-18T19:11:59.145Zx out/crucible-dtrace.tar, 100352 bytes, 196 tape blocks
992025-07-18T19:11:59.145Zx out/crucible-pantry-zone.tar.gz, 39917973 bytes, 77965 tape blocks
1002025-07-18T19:11:59.145Zx out/crucible-zone.tar.gz, 50038585 bytes, 97732 tape blocks
1012025-07-18T19:11:59.145Zx out/external-dns.tar.gz, 51803006 bytes, 101178 tape blocks
1022025-07-18T19:11:59.145Zx out/internal-dns.tar.gz, 51802606 bytes, 101177 tape blocks
1032025-07-18T19:11:59.145Zx out/mg-ddm-gz.tar, 93026304 bytes, 181692 tape blocks
1042025-07-18T19:11:59.145Zx out/nexus.tar.gz, 135761009 bytes, 265159 tape blocks
1052025-07-18T19:11:59.145Zx out/ntp.tar.gz, 33843990 bytes, 66102 tape blocks
1062025-07-18T19:11:59.145Zx out/omicron-gateway-softnpu.tar.gz, 31413486 bytes, 61355 tape blocks
1072025-07-18T19:11:59.145Zx out/omicron-sled-agent.tar, 143807488 bytes, 280874 tape blocks
1082025-07-18T19:11:59.145Zx out/overlay.tar.gz, 3007 bytes, 6 tape blocks
1092025-07-18T19:11:59.145Zx out/oximeter.tar.gz, 65611178 bytes, 128147 tape blocks
1102025-07-18T19:11:59.145Zx out/oxlog.tar, 4044288 bytes, 7899 tape blocks
1112025-07-18T19:11:59.145Zx out/probe.tar.gz, 3109568 bytes, 6074 tape blocks
1122025-07-18T19:11:59.145Zx out/propolis-server.tar.gz, 70181561 bytes, 137074 tape blocks
1132025-07-18T19:11:59.145Zx out/pumpkind-gz.tar, 27287040 bytes, 53295 tape blocks
1142025-07-18T19:11:59.145Zx out/switch-softnpu.tar.gz, 346663114 bytes, 677077 tape blocks
1152025-07-18T19:11:59.171Z
1162025-07-18T19:11:59.171Zreal 19.369664519
1172025-07-18T19:11:59.171Zuser 17.259942610
1182025-07-18T19:11:59.171Zsys 3.304850611
1192025-07-18T19:11:59.171Ztrap 0.000740001
1202025-07-18T19:11:59.171Ztflt 0.000000000
1212025-07-18T19:11:59.171Zdflt 0.000000000
1222025-07-18T19:11:59.171Zkflt 0.000000000
1232025-07-18T19:11:59.171Zlock 0.000000000
1242025-07-18T19:11:59.171Zslp 17.551208957
1252025-07-18T19:11:59.171Zlat 0.620642345
1262025-07-18T19:11:59.171Zstop 0.000129121
1272025-07-18T19:11:59.171Z+ source .github/buildomat/ci-env.sh
1282025-07-18T19:11:59.171Z++ export CARGO_TERM_COLOR=always
1292025-07-18T19:11:59.171Z++ CARGO_TERM_COLOR=always
1302025-07-18T19:11:59.171Z+ bmat address ls
1312025-07-18T19:11:59.171ZNAME CIDR FIRST LAST COUNT
1322025-07-18T19:11:59.171Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1332025-07-18T19:11:59.171Z++ bmat address ls -f extra -Ho first,last,count
1342025-07-18T19:11:59.171Z+ set -- 10.151.1.164 10.151.1.227 64
1352025-07-18T19:11:59.171Z+ EXTRA_IP_START=10.151.1.164
1362025-07-18T19:11:59.171Z+ EXTRA_IP_END=10.151.1.227
1372025-07-18T19:11:59.171Z+ EXTRA_IP_COUNT=64
1382025-07-18T19:11:59.171Z+ (( EXTRA_IP_COUNT >= 32 ))
1392025-07-18T19:11:59.171Z+ EXTRA_IP_BASE=10.151.1
1402025-07-18T19:11:59.171Z+ EXTRA_IP_FOCTET=164
1412025-07-18T19:11:59.171Z+ EXTRA_IP_LOCTET=227
1422025-07-18T19:11:59.171Z+ SERVICE_IP_POOL_START=10.151.1.164
1432025-07-18T19:11:59.171Z+ SERVICE_IP_POOL_END=10.151.1.173
1442025-07-18T19:11:59.171Z+ DNS_IP1=10.151.1.164
1452025-07-18T19:11:59.171Z+ DNS_IP2=10.151.1.165
1462025-07-18T19:11:59.171Z+ UPLINK_IP=10.151.1.174
1472025-07-18T19:11:59.172Z+ IPPOOL_START=10.151.1.175
1482025-07-18T19:11:59.172Z+ IPPOOL_END=10.151.1.227
1492025-07-18T19:11:59.172Z++ ipadm show-addr -po type,addr
1502025-07-18T19:11:59.172Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1512025-07-18T19:11:59.172Z+ GATEWAY_IP=10.151.1.100
1522025-07-18T19:11:59.172Z+ [[ -n 10.151.1.100 ]]
1532025-07-18T19:11:59.172Z+ ping -s 10.151.1.100 56 1
1542025-07-18T19:11:59.172ZPING 10.151.1.100: 56 data bytes
1552025-07-18T19:11:59.172Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
1562025-07-18T19:11:59.172Z
1572025-07-18T19:11:59.172Z----10.151.1.100 PING Statistics----
1582025-07-18T19:11:59.172Z1 packets transmitted, 1 packets received, 0% packet loss
1592025-07-18T19:11:59.172Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
1602025-07-18T19:11:59.172Z++ arp -an
1612025-07-18T19:11:59.172Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1622025-07-18T19:11:59.172Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1632025-07-18T19:11:59.172Z+ routeadm -e ipv4-forwarding -u
1642025-07-18T19:11:59.271Z+ PXA_START=10.151.1.164
1652025-07-18T19:11:59.271Z+ PXA_END=10.151.1.227
1662025-07-18T19:11:59.271Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1672025-07-18T19:11:59.438Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1682025-07-18T19:11:59.462ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1692025-07-18T19:11:59.511Zcreating virtual hardware
1702025-07-18T19:11:59.536Zcreating /scratch/m2_0.vdev
1712025-07-18T19:11:59.536Zcreating /scratch/m2_1.vdev
1722025-07-18T19:11:59.537Zcreating /scratch/u2_0.vdev
1732025-07-18T19:11:59.537Zcreating /scratch/u2_1.vdev
1742025-07-18T19:11:59.537Zcreating /scratch/u2_2.vdev
1752025-07-18T19:11:59.537Zcreating /scratch/u2_3.vdev
1762025-07-18T19:11:59.537Zcreating /scratch/u2_4.vdev
1772025-07-18T19:11:59.537Zcreating /scratch/u2_5.vdev
1782025-07-18T19:11:59.537Zcreating /scratch/u2_6.vdev
1792025-07-18T19:11:59.537Zcreating /scratch/u2_7.vdev
1802025-07-18T19:11:59.537Zcreating /scratch/u2_8.vdev
1812025-07-18T19:11:59.562ZSimnet net0/sc0_0 exists
1822025-07-18T19:11:59.562ZSimnet net1/sc1_0 exists
1832025-07-18T19:11:59.587ZVnic sc0_1 exists
1842025-07-18T19:12:11.908ZUsing 10.151.1.100 as gateway ip
1852025-07-18T19:12:11.908Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1862025-07-18T19:12:11.909Zconfiguring SoftNPU ARP entry
1872025-07-18T19:12:11.935Zconfiguring SoftNPU proxy ARP
1882025-07-18T19:12:11.987ZSoftNPU state:
1892025-07-18T19:12:11.987Z local v6:
1902025-07-18T19:12:11.987Z local v4:
1912025-07-18T19:12:11.987Z router v6:
1922025-07-18T19:12:11.987Z router v4_idx:
1932025-07-18T19:12:11.987Z router v4_routes:
1942025-07-18T19:12:11.987Z resolver v4:
1952025-07-18T19:12:11.987Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1962025-07-18T19:12:11.987Z resolver v6:
1972025-07-18T19:12:11.987Z nat v4:
1982025-07-18T19:12:11.987Z nat_v6:
1992025-07-18T19:12:11.987Z port_mac:
2002025-07-18T19:12:11.987Z proxy arp:
2012025-07-18T19:12:11.987Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
2022025-07-18T19:12:11.987Zcreated virtual hardware
2032025-07-18T19:12:12.012Z
2042025-07-18T19:12:12.012Zreal 12.546358470
2052025-07-18T19:12:12.012Zuser 0.636712731
2062025-07-18T19:12:12.012Zsys 3.144259889
2072025-07-18T19:12:12.012Ztrap 0.000096795
2082025-07-18T19:12:12.012Ztflt 0.000463923
2092025-07-18T19:12:12.012Zdflt 0.000557217
2102025-07-18T19:12:12.012Zkflt 0.000008540
2112025-07-18T19:12:12.012Zlock 9:43.218309077
2122025-07-18T19:12:12.013Zslp 37.961385186
2132025-07-18T19:12:12.013Zlat 0.103742382
2142025-07-18T19:12:12.013Zstop 0.381761320
2152025-07-18T19:12:12.013Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2162025-07-18T19:12:12.038Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2172025-07-18T19:12:12.038Z+ diff -u pkg/config.toml~ pkg/config.toml
2182025-07-18T19:12:12.038Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2192025-07-18T19:12:12.038Z+++ pkg/config.toml Fri Jul 18 19:12:12 2025
2202025-07-18T19:12:12.038Z@@ -29,18 +29,18 @@
2212025-07-18T19:12:12.038Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2222025-07-18T19:12:12.038Z # followed by a string that is embedded into their fake serial values.
2232025-07-18T19:12:12.038Z vdevs = [
2242025-07-18T19:12:12.038Z- "m2_0.vdev",
2252025-07-18T19:12:12.038Z- "m2_1.vdev",
2262025-07-18T19:12:12.038Z+ "/scratch/m2_0.vdev",
2272025-07-18T19:12:12.038Z+ "/scratch/m2_1.vdev",
2282025-07-18T19:12:12.038Z
2292025-07-18T19:12:12.038Z- "u2_0.vdev",
2302025-07-18T19:12:12.038Z- "u2_1.vdev",
2312025-07-18T19:12:12.038Z- "u2_2.vdev",
2322025-07-18T19:12:12.038Z- "u2_3.vdev",
2332025-07-18T19:12:12.038Z- "u2_4.vdev",
2342025-07-18T19:12:12.038Z- "u2_5.vdev",
2352025-07-18T19:12:12.038Z- "u2_6.vdev",
2362025-07-18T19:12:12.038Z- "u2_7.vdev",
2372025-07-18T19:12:12.038Z- "u2_8.vdev",
2382025-07-18T19:12:12.039Z+ "/scratch/u2_0.vdev",
2392025-07-18T19:12:12.039Z+ "/scratch/u2_1.vdev",
2402025-07-18T19:12:12.039Z+ "/scratch/u2_2.vdev",
2412025-07-18T19:12:12.039Z+ "/scratch/u2_3.vdev",
2422025-07-18T19:12:12.039Z+ "/scratch/u2_4.vdev",
2432025-07-18T19:12:12.039Z+ "/scratch/u2_5.vdev",
2442025-07-18T19:12:12.039Z+ "/scratch/u2_6.vdev",
2452025-07-18T19:12:12.039Z+ "/scratch/u2_7.vdev",
2462025-07-18T19:12:12.039Z+ "/scratch/u2_8.vdev",
2472025-07-18T19:12:12.039Z ]
2482025-07-18T19:12:12.039Z
2492025-07-18T19:12:12.039Z # The amount of memory held back for services which exist between zero and one
2502025-07-18T19:12:12.039Z+ true
2512025-07-18T19:12:12.039Z++ grep -c -E 'u2.*\.vdev' pkg/config.toml
2522025-07-18T19:12:12.039Z+ EXPECTED_ZPOOL_COUNT=9
2532025-07-18T19:12:12.039Z+ echo 'expected number of zpools is 9'
2542025-07-18T19:12:12.039Zexpected number of zpools is 9
2552025-07-18T19:12:12.065Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2562025-07-18T19:12:12.065Z+ SILO_NAME=recovery
2572025-07-18T19:12:12.065Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2582025-07-18T19:12:12.065Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2592025-07-18T19:12:12.065Z+ sed -i~ '
2602025-07-18T19:12:12.065Z /^external_dns_ips/c\
2612025-07-18T19:12:12.065Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2622025-07-18T19:12:12.065Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2632025-07-18T19:12:12.065Z /^first/c\
2642025-07-18T19:12:12.065Zfirst = "10.151.1.164"
2652025-07-18T19:12:12.065Z /^last/c\
2662025-07-18T19:12:12.065Zlast = "10.151.1.173"
2672025-07-18T19:12:12.065Z }
2682025-07-18T19:12:12.065Z /^infra_ip_first/c\
2692025-07-18T19:12:12.065Zinfra_ip_first = "10.151.1.174"
2702025-07-18T19:12:12.065Z /^infra_ip_last/c\
2712025-07-18T19:12:12.065Zinfra_ip_last = "10.151.1.174"
2722025-07-18T19:12:12.065Z /^\[\[rack_network_config.ports/,/^$/ {
2732025-07-18T19:12:12.066Z /^routes/c\
2742025-07-18T19:12:12.066Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2752025-07-18T19:12:12.066Z /^addresses/c\
2762025-07-18T19:12:12.066Zaddresses = \[{address = "10.151.1.174/24"} \]
2772025-07-18T19:12:12.066Z }
2782025-07-18T19:12:12.066Z' pkg/config-rss.toml
2792025-07-18T19:12:12.066Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2802025-07-18T19:12:12.066Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2812025-07-18T19:12:12.066Z+++ pkg/config-rss.toml Fri Jul 18 19:12:12 2025
2822025-07-18T19:12:12.066Z@@ -33,7 +33,7 @@
2832025-07-18T19:12:12.066Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2842025-07-18T19:12:12.066Z # must be contained in one of the "internal services" IP Pool ranges listed
2852025-07-18T19:12:12.066Z # below.
2862025-07-18T19:12:12.066Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2872025-07-18T19:12:12.066Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2882025-07-18T19:12:12.066Z
2892025-07-18T19:12:12.066Z # Initial TLS certificates for the external API
2902025-07-18T19:12:12.066Z #
2912025-07-18T19:12:12.066Z@@ -69,8 +69,8 @@
2922025-07-18T19:12:12.066Z #
2932025-07-18T19:12:12.066Z # For more on this and what to put here, see docs/how-to-run.adoc.
2942025-07-18T19:12:12.066Z [[internal_services_ip_pool_ranges]]
2952025-07-18T19:12:12.066Z-first = "192.168.1.20"
2962025-07-18T19:12:12.066Z-last = "192.168.1.29"
2972025-07-18T19:12:12.066Z+first = "10.151.1.164"
2982025-07-18T19:12:12.066Z+last = "10.151.1.173"
2992025-07-18T19:12:12.066Z
3002025-07-18T19:12:12.066Z # TODO - this configuration is subject to change going forward. Ultimately these
3012025-07-18T19:12:12.066Z # parameters should be provided to the control plane via wicket, but we need to
3022025-07-18T19:12:12.066Z@@ -91,8 +91,8 @@
3032025-07-18T19:12:12.066Z # A range of IP addresses used by Boundary Services on the external network. In
3042025-07-18T19:12:12.067Z # a real system, these would be addresses of the uplink ports on the Sidecar.
3052025-07-18T19:12:12.067Z # With softnpu, only one address is used.
3062025-07-18T19:12:12.067Z-infra_ip_first = "192.168.1.30"
3072025-07-18T19:12:12.067Z-infra_ip_last = "192.168.1.30"
3082025-07-18T19:12:12.067Z+infra_ip_first = "10.151.1.174"
3092025-07-18T19:12:12.067Z+infra_ip_last = "10.151.1.174"
3102025-07-18T19:12:12.067Z
3112025-07-18T19:12:12.067Z # Configurations for BGP routers to run on the scrimlets.
3122025-07-18T19:12:12.067Z bgp = []
3132025-07-18T19:12:12.067Z@@ -100,9 +100,9 @@
3142025-07-18T19:12:12.067Z # You can configure multiple uplinks by repeating the following stanza
3152025-07-18T19:12:12.067Z [[rack_network_config.ports]]
3162025-07-18T19:12:12.067Z # Routes associated with this port.
3172025-07-18T19:12:12.067Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3182025-07-18T19:12:12.067Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3192025-07-18T19:12:12.067Z # Addresses associated with this port.
3202025-07-18T19:12:12.067Z-addresses = [{address = "192.168.1.30/24"}]
3212025-07-18T19:12:12.067Z+addresses = [{address = "10.151.1.174/24"} ]
3222025-07-18T19:12:12.067Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3232025-07-18T19:12:12.067Z port = "qsfp0"
3242025-07-18T19:12:12.067Z # The speed of this port.
3252025-07-18T19:12:12.068Z+ true
3262025-07-18T19:12:12.068Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3272025-07-18T19:12:12.068Za pkg/config-rss.toml 8K
3282025-07-18T19:12:12.068Za pkg/config.toml 5K
3292025-07-18T19:12:12.068Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3302025-07-18T19:12:12.069Z+ TLS_NAME=recovery.sys.oxide.test
3312025-07-18T19:12:12.069Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3322025-07-18T19:12:12.382Z.....+....+..+.+..+.......+...+..+....+..+...+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...............+.......+...+.....+.+..+....+........+......+.+........+.+......+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.........+.....+..........+..+......+...+....+...+..+.............+....................+...............+.......+..+........................................+........+.+.....+....+..+.........+..........+.........+..+.........+.......+........+............+.............+..+...+.+........+...+............+............+.+.........+..................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3332025-07-18T19:12:12.651Z........+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+........+......+.+...+..+.......+.....+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+........+..................+.........+.+.....+......+.............+.......................+.............+.....+.........+......+....+...+..............+.+..+......+....+...+..+...+...+...............+.......+.........+.....+......+............+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3342025-07-18T19:12:12.676Z-----
3352025-07-18T19:12:12.676Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3362025-07-18T19:12:12.701Za pkg/initial-tls-cert.pem 2K
3372025-07-18T19:12:12.701Za pkg/initial-tls-key.pem 4K
3382025-07-18T19:12:12.701Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3392025-07-18T19:12:12.701Z+ rmdir pkg
3402025-07-18T19:12:12.701Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3412025-07-18T19:12:12.701Z+ pfexec mkdir -p /usr/oxide
3422025-07-18T19:12:12.701Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.1
3432025-07-18T19:12:13.343Z+ pfexec chmod +x /usr/oxide/oxide
3442025-07-18T19:12:13.368Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3452025-07-18T19:12:32.370Z+ OMICRON_NO_UNINSTALL=1
3462025-07-18T19:12:32.370Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3472025-07-18T19:12:32.395ZLogging to: /opt/oxide/work/out/LOG
3482025-07-18T19:12:33.131Z
3492025-07-18T19:12:33.131Zreal 0.755466415
3502025-07-18T19:12:33.132Zuser 0.161475796
3512025-07-18T19:12:33.132Zsys 4.471154704
3522025-07-18T19:12:33.132Ztrap 0.000004109
3532025-07-18T19:12:33.132Ztflt 0.000056249
3542025-07-18T19:12:33.132Zdflt 0.000181756
3552025-07-18T19:12:33.157Zkflt 0.000003700
3562025-07-18T19:12:33.157Zlock 1:07.891477630
3572025-07-18T19:12:33.157Zslp 0.933122453
3582025-07-18T19:12:33.157Zlat 0.026171636
3592025-07-18T19:12:33.157Zstop 0.068672535
3602025-07-18T19:12:33.157Z+ retry=0
3612025-07-18T19:12:33.157Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3622025-07-18T19:12:33.157Z+ [[ 0 -gt 30 ]]
3632025-07-18T19:12:33.157Z+ sleep 1
3642025-07-18T19:12:34.146Z+ retry=1
3652025-07-18T19:12:34.146Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3662025-07-18T19:12:34.171Z+ [[ 1 -gt 30 ]]
3672025-07-18T19:12:34.171Z+ sleep 1
3682025-07-18T19:12:35.160Z+ retry=2
3692025-07-18T19:12:35.160Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3702025-07-18T19:12:35.185Z+ [[ 2 -gt 30 ]]
3712025-07-18T19:12:35.185Z+ sleep 1
3722025-07-18T19:12:36.176Z+ retry=3
3732025-07-18T19:12:36.176Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3742025-07-18T19:12:55.563Z+ [[ 3 -gt 30 ]]
3752025-07-18T19:12:55.563Z+ sleep 1
3762025-07-18T19:12:56.567Z+ retry=4
3772025-07-18T19:12:56.567Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3782025-07-18T19:12:56.592Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3792025-07-18T19:12:56.619Zlocal v6:
3802025-07-18T19:12:56.619Zfe80::cc79:e4ff:feae:b59b
3812025-07-18T19:12:56.619Zfd62:890d:d43f:3afc::1
3822025-07-18T19:12:56.619Zlocal v4:
3832025-07-18T19:12:56.619Z10.151.1.174
3842025-07-18T19:12:56.619Zrouter v6:
3852025-07-18T19:12:56.619Zrouter v4_idx:
3862025-07-18T19:12:56.619Zrouter v4_routes:
3872025-07-18T19:12:56.619Zresolver v4:
3882025-07-18T19:12:56.619Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3892025-07-18T19:12:56.619Zresolver v6:
3902025-07-18T19:12:56.619Zfe80::cc79:e4ff:feae:b59b -> ce:79:e4:ae:b5:9b
3912025-07-18T19:12:56.619Zfe80::e02c:edff:fe35:1da8 -> e2:2c:ed:35:1d:a8
3922025-07-18T19:12:56.619Znat v4:
3932025-07-18T19:12:56.619Znat_v6:
3942025-07-18T19:12:56.619Zport_mac:
3952025-07-18T19:12:56.619Z1000: a8:40:25:2d:6d:e6
3962025-07-18T19:12:56.619Z1: a8:40:25:2d:6d:e7
3972025-07-18T19:12:56.619Z2: a8:40:25:2d:6e:07
3982025-07-18T19:12:56.619Zproxy arp:
3992025-07-18T19:12:56.619Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
4002025-07-18T19:12:56.619Z+ retry=0
4012025-07-18T19:12:56.644Z+++ zoneadm list -n
4022025-07-18T19:12:56.644Z+++ grep oxz_ntp
4032025-07-18T19:12:56.644Z++ pfexec svcs -z -Hostate oxide/ntp
4042025-07-18T19:12:56.644Zsvcs: zone '-Hostate': entity not found
4052025-07-18T19:12:56.644Z++ true
4062025-07-18T19:12:56.644Z+ [[ '' != online ]]
4072025-07-18T19:12:56.644Z+ [[ 0 -gt 60 ]]
4082025-07-18T19:12:56.644Z+ sleep 1
4092025-07-18T19:12:57.638Z+ retry=1
4102025-07-18T19:12:57.663Z+++ zoneadm list -n
4112025-07-18T19:12:57.663Z+++ grep oxz_ntp
4122025-07-18T19:12:57.663Z++ pfexec svcs -z -Hostate oxide/ntp
4132025-07-18T19:12:57.663Zsvcs: zone '-Hostate': entity not found
4142025-07-18T19:12:57.663Z++ true
4152025-07-18T19:12:57.663Z+ [[ '' != online ]]
4162025-07-18T19:12:57.663Z+ [[ 1 -gt 60 ]]
4172025-07-18T19:12:57.663Z+ sleep 1
4182025-07-18T19:12:58.660Z+ retry=2
4192025-07-18T19:12:58.684Z+++ zoneadm list -n
4202025-07-18T19:12:58.684Z+++ grep oxz_ntp
4212025-07-18T19:12:58.685Z++ pfexec svcs -z -Hostate oxide/ntp
4222025-07-18T19:12:58.685Zsvcs: zone '-Hostate': entity not found
4232025-07-18T19:12:58.685Z++ true
4242025-07-18T19:12:58.685Z+ [[ '' != online ]]
4252025-07-18T19:12:58.685Z+ [[ 2 -gt 60 ]]
4262025-07-18T19:12:58.685Z+ sleep 1
4272025-07-18T19:12:59.681Z+ retry=3
4282025-07-18T19:12:59.706Z+++ zoneadm list -n
4292025-07-18T19:12:59.706Z+++ grep oxz_ntp
4302025-07-18T19:12:59.706Z++ pfexec svcs -z -Hostate oxide/ntp
4312025-07-18T19:12:59.706Zsvcs: zone '-Hostate': entity not found
4322025-07-18T19:12:59.706Z++ true
4332025-07-18T19:12:59.706Z+ [[ '' != online ]]
4342025-07-18T19:12:59.706Z+ [[ 3 -gt 60 ]]
4352025-07-18T19:12:59.706Z+ sleep 1
4362025-07-18T19:13:00.703Z+ retry=4
4372025-07-18T19:13:00.755Z+++ zoneadm list -n
4382025-07-18T19:13:00.755Z+++ grep oxz_ntp
4392025-07-18T19:13:00.755Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
4402025-07-18T19:13:00.755Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4412025-07-18T19:13:00.756Z++ true
4422025-07-18T19:13:00.756Z+ [[ '' != online ]]
4432025-07-18T19:13:00.756Z+ [[ 4 -gt 60 ]]
4442025-07-18T19:13:00.756Z+ sleep 1
4452025-07-18T19:13:01.732Z+ retry=5
4462025-07-18T19:13:01.756Z+++ zoneadm list -n
4472025-07-18T19:13:01.756Z+++ grep oxz_ntp
4482025-07-18T19:13:01.756Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
4492025-07-18T19:13:01.780Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4502025-07-18T19:13:01.780Z++ true
4512025-07-18T19:13:01.780Z+ [[ '' != online ]]
4522025-07-18T19:13:01.780Z+ [[ 5 -gt 60 ]]
4532025-07-18T19:13:01.780Z+ sleep 1
4542025-07-18T19:13:02.765Z+ retry=6
4552025-07-18T19:13:02.789Z+++ zoneadm list -n
4562025-07-18T19:13:02.789Z+++ grep oxz_ntp
4572025-07-18T19:13:02.789Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
4582025-07-18T19:13:02.789Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4592025-07-18T19:13:02.789Z++ true
4602025-07-18T19:13:02.813Z+ [[ '' != online ]]
4612025-07-18T19:13:02.815Z+ [[ 6 -gt 60 ]]
4622025-07-18T19:13:02.815Z+ sleep 1
4632025-07-18T19:13:03.793Z+ retry=7
4642025-07-18T19:13:03.817Z+++ zoneadm list -n
4652025-07-18T19:13:03.817Z+++ grep oxz_ntp
4662025-07-18T19:13:03.817Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
4672025-07-18T19:13:03.817Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4682025-07-18T19:13:03.841Z++ true
4692025-07-18T19:13:03.841Z+ [[ '' != online ]]
4702025-07-18T19:13:03.841Z+ [[ 7 -gt 60 ]]
4712025-07-18T19:13:03.841Z+ sleep 1
4722025-07-18T19:13:04.821Z+ retry=8
4732025-07-18T19:13:04.845Z+++ zoneadm list -n
4742025-07-18T19:13:04.845Z+++ grep oxz_ntp
4752025-07-18T19:13:04.845Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
4762025-07-18T19:13:04.845Z+ [[ offline != online ]]
4772025-07-18T19:13:04.845Z+ [[ 8 -gt 60 ]]
4782025-07-18T19:13:04.845Z+ sleep 1
4792025-07-18T19:13:05.842Z+ retry=9
4802025-07-18T19:13:05.866Z+++ zoneadm list -n
4812025-07-18T19:13:05.866Z+++ grep oxz_ntp
4822025-07-18T19:13:05.866Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
4832025-07-18T19:13:05.866Z+ [[ offline != online ]]
4842025-07-18T19:13:05.866Z+ [[ 9 -gt 60 ]]
4852025-07-18T19:13:05.866Z+ sleep 1
4862025-07-18T19:13:06.863Z+ retry=10
4872025-07-18T19:13:06.887Z+++ zoneadm list -n
4882025-07-18T19:13:06.887Z+++ grep oxz_ntp
4892025-07-18T19:13:06.887Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
4902025-07-18T19:13:06.887Z+ [[ offline != online ]]
4912025-07-18T19:13:06.887Z+ [[ 10 -gt 60 ]]
4922025-07-18T19:13:06.887Z+ sleep 1
4932025-07-18T19:13:07.886Z+ retry=11
4942025-07-18T19:13:07.910Z+++ zoneadm list -n
4952025-07-18T19:13:07.910Z+++ grep oxz_ntp
4962025-07-18T19:13:07.910Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
4972025-07-18T19:13:07.910Z+ [[ offline != online ]]
4982025-07-18T19:13:07.910Z+ [[ 11 -gt 60 ]]
4992025-07-18T19:13:07.911Z+ sleep 1
5002025-07-18T19:13:08.908Z+ retry=12
5012025-07-18T19:13:08.932Z+++ zoneadm list -n
5022025-07-18T19:13:08.932Z+++ grep oxz_ntp
5032025-07-18T19:13:08.932Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
5042025-07-18T19:13:08.932Z+ [[ offline != online ]]
5052025-07-18T19:13:08.932Z+ [[ 12 -gt 60 ]]
5062025-07-18T19:13:08.932Z+ sleep 1
5072025-07-18T19:13:09.930Z+ retry=13
5082025-07-18T19:13:09.954Z+++ zoneadm list -n
5092025-07-18T19:13:09.954Z+++ grep oxz_ntp
5102025-07-18T19:13:09.954Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
5112025-07-18T19:13:09.954Z+ [[ offline != online ]]
5122025-07-18T19:13:09.954Z+ [[ 13 -gt 60 ]]
5132025-07-18T19:13:09.954Z+ sleep 1
5142025-07-18T19:13:10.952Z+ retry=14
5152025-07-18T19:13:10.976Z+++ zoneadm list -n
5162025-07-18T19:13:10.976Z+++ grep oxz_ntp
5172025-07-18T19:13:10.976Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
5182025-07-18T19:13:10.976Z+ [[ offline != online ]]
5192025-07-18T19:13:10.976Z+ [[ 14 -gt 60 ]]
5202025-07-18T19:13:10.976Z+ sleep 1
 
5212025-07-18T19:13:11.318Zbuskin console login: Jul 18 19:13:11 buskin ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5222025-07-18T19:13:11.974Z+ retry=15
5232025-07-18T19:13:11.998Z+++ zoneadm list -n
5242025-07-18T19:13:11.998Z+++ grep oxz_ntp
5252025-07-18T19:13:11.999Z++ pfexec svcs -z oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026 -Hostate oxide/ntp
5262025-07-18T19:13:11.999Z+ [[ online != online ]]
5272025-07-18T19:13:11.999Z+ echo 'Waited for chrony: 15s'
5282025-07-18T19:13:11.999Z+ retry=0
5292025-07-18T19:13:11.999ZWaited for chrony: 15s
5302025-07-18T19:13:11.999Z+ zoneadm list
5312025-07-18T19:13:11.999Z+ grep nexus
5322025-07-18T19:13:12.023Z+ [[ 0 -gt 300 ]]
5332025-07-18T19:13:12.023Z+ sleep 1
5342025-07-18T19:13:13.004Z+ retry=1
5352025-07-18T19:13:13.029Z+ zoneadm list
5362025-07-18T19:13:13.029Z+ grep nexus
5372025-07-18T19:13:13.029Z+ [[ 1 -gt 300 ]]
5382025-07-18T19:13:13.029Z+ sleep 1
5392025-07-18T19:13:14.015Z+ retry=2
5402025-07-18T19:13:14.039Z+ zoneadm list
5412025-07-18T19:13:14.039Z+ grep nexus
5422025-07-18T19:13:14.039Z+ [[ 2 -gt 300 ]]
5432025-07-18T19:13:14.039Z+ sleep 1
5442025-07-18T19:13:15.031Z+ retry=3
5452025-07-18T19:13:15.055Z+ zoneadm list
5462025-07-18T19:13:15.055Z+ grep nexus
5472025-07-18T19:13:15.055Z+ [[ 3 -gt 300 ]]
5482025-07-18T19:13:15.055Z+ sleep 1
5492025-07-18T19:13:16.043Z+ retry=4
5502025-07-18T19:13:16.067Z+ zoneadm list
5512025-07-18T19:13:16.067Z+ grep nexus
5522025-07-18T19:13:16.067Z+ [[ 4 -gt 300 ]]
5532025-07-18T19:13:16.067Z+ sleep 1
5542025-07-18T19:13:17.101Z+ retry=5
5552025-07-18T19:13:17.174Z+ zoneadm list
5562025-07-18T19:13:17.203Z+ grep nexus
5572025-07-18T19:13:17.276Z+ [[ 5 -gt 300 ]]
5582025-07-18T19:13:17.276Z+ sleep 1
5592025-07-18T19:13:18.257Z+ retry=6
5602025-07-18T19:13:18.282Z+ zoneadm list
5612025-07-18T19:13:18.282Z+ grep nexus
5622025-07-18T19:13:18.282Z+ [[ 6 -gt 300 ]]
5632025-07-18T19:13:18.282Z+ sleep 1
5642025-07-18T19:13:19.284Z+ retry=7
5652025-07-18T19:13:19.308Z+ zoneadm list
5662025-07-18T19:13:19.308Z+ grep nexus
5672025-07-18T19:13:19.308Z+ [[ 7 -gt 300 ]]
5682025-07-18T19:13:19.308Z+ sleep 1
5692025-07-18T19:13:20.305Z+ retry=8
5702025-07-18T19:13:20.329Z+ zoneadm list
5712025-07-18T19:13:20.329Z+ grep nexus
5722025-07-18T19:13:20.329Z+ [[ 8 -gt 300 ]]
5732025-07-18T19:13:20.329Z+ sleep 1
5742025-07-18T19:13:21.318Z+ retry=9
5752025-07-18T19:13:21.342Z+ zoneadm list
5762025-07-18T19:13:21.342Z+ grep nexus
5772025-07-18T19:13:21.342Z+ [[ 9 -gt 300 ]]
5782025-07-18T19:13:21.342Z+ sleep 1
5792025-07-18T19:13:22.335Z+ retry=10
5802025-07-18T19:13:22.359Z+ zoneadm list
5812025-07-18T19:13:22.359Z+ grep nexus
5822025-07-18T19:13:22.359Z+ [[ 10 -gt 300 ]]
5832025-07-18T19:13:22.360Z+ sleep 1
5842025-07-18T19:13:23.349Z+ retry=11
5852025-07-18T19:13:23.373Z+ zoneadm list
5862025-07-18T19:13:23.374Z+ grep nexus
5872025-07-18T19:13:23.374Z+ [[ 11 -gt 300 ]]
5882025-07-18T19:13:23.374Z+ sleep 1
5892025-07-18T19:13:24.365Z+ retry=12
5902025-07-18T19:13:24.389Z+ zoneadm list
5912025-07-18T19:13:24.389Z+ grep nexus
5922025-07-18T19:13:24.389Z+ [[ 12 -gt 300 ]]
5932025-07-18T19:13:24.389Z+ sleep 1
5942025-07-18T19:13:25.380Z+ retry=13
5952025-07-18T19:13:25.404Z+ zoneadm list
5962025-07-18T19:13:25.404Z+ grep nexus
5972025-07-18T19:13:25.404Z+ [[ 13 -gt 300 ]]
5982025-07-18T19:13:25.404Z+ sleep 1
5992025-07-18T19:13:26.395Z+ retry=14
6002025-07-18T19:13:26.419Z+ zoneadm list
6012025-07-18T19:13:26.419Z+ grep nexus
6022025-07-18T19:13:26.419Z+ [[ 14 -gt 300 ]]
6032025-07-18T19:13:26.419Z+ sleep 1
6042025-07-18T19:13:27.409Z+ retry=15
6052025-07-18T19:13:27.433Z+ zoneadm list
6062025-07-18T19:13:27.434Z+ grep nexus
6072025-07-18T19:13:27.434Z+ [[ 15 -gt 300 ]]
6082025-07-18T19:13:27.434Z+ sleep 1
6092025-07-18T19:13:28.425Z+ retry=16
6102025-07-18T19:13:28.449Z+ zoneadm list
6112025-07-18T19:13:28.449Z+ grep nexus
6122025-07-18T19:13:28.449Z+ [[ 16 -gt 300 ]]
6132025-07-18T19:13:28.449Z+ sleep 1
6142025-07-18T19:13:29.441Z+ retry=17
6152025-07-18T19:13:29.465Z+ zoneadm list
6162025-07-18T19:13:29.465Z+ grep nexus
6172025-07-18T19:13:29.465Z+ [[ 17 -gt 300 ]]
6182025-07-18T19:13:29.465Z+ sleep 1
6192025-07-18T19:13:30.454Z+ retry=18
6202025-07-18T19:13:30.479Z+ zoneadm list
6212025-07-18T19:13:30.479Z+ grep nexus
6222025-07-18T19:13:30.479Z+ [[ 18 -gt 300 ]]
6232025-07-18T19:13:30.479Z+ sleep 1
6242025-07-18T19:13:31.469Z+ retry=19
6252025-07-18T19:13:31.494Z+ zoneadm list
6262025-07-18T19:13:31.494Z+ grep nexus
6272025-07-18T19:13:31.494Z+ [[ 19 -gt 300 ]]
6282025-07-18T19:13:31.494Z+ sleep 1
6292025-07-18T19:13:32.485Z+ retry=20
6302025-07-18T19:13:32.510Z+ zoneadm list
6312025-07-18T19:13:32.510Z+ grep nexus
6322025-07-18T19:13:32.510Z+ [[ 20 -gt 300 ]]
6332025-07-18T19:13:32.510Z+ sleep 1
6342025-07-18T19:13:33.501Z+ retry=21
6352025-07-18T19:13:33.525Z+ zoneadm list
6362025-07-18T19:13:33.525Z+ grep nexus
6372025-07-18T19:13:33.525Z+ [[ 21 -gt 300 ]]
6382025-07-18T19:13:33.526Z+ sleep 1
6392025-07-18T19:13:39.787Z+ retry=22
6402025-07-18T19:13:39.813Z+ zoneadm list
6412025-07-18T19:13:39.813Z+ grep nexus
6422025-07-18T19:13:39.813Z+ [[ 22 -gt 300 ]]
6432025-07-18T19:13:39.813Z+ sleep 1
6442025-07-18T19:13:40.786Z+ retry=23
6452025-07-18T19:13:40.811Z+ zoneadm list
6462025-07-18T19:13:40.811Z+ grep nexus
6472025-07-18T19:13:40.811Z+ [[ 23 -gt 300 ]]
6482025-07-18T19:13:40.811Z+ sleep 1
6492025-07-18T19:13:41.809Z+ retry=24
6502025-07-18T19:13:41.835Z+ zoneadm list
6512025-07-18T19:13:41.835Z+ grep nexus
6522025-07-18T19:13:41.835Z+ [[ 24 -gt 300 ]]
6532025-07-18T19:13:41.835Z+ sleep 1
6542025-07-18T19:13:42.833Z+ retry=25
6552025-07-18T19:13:42.858Z+ zoneadm list
6562025-07-18T19:13:42.858Z+ grep nexus
6572025-07-18T19:13:42.858Z+ [[ 25 -gt 300 ]]
6582025-07-18T19:13:42.858Z+ sleep 1
6592025-07-18T19:13:43.854Z+ retry=26
6602025-07-18T19:13:43.878Z+ zoneadm list
6612025-07-18T19:13:43.879Z+ grep nexus
6622025-07-18T19:13:43.879Z+ [[ 26 -gt 300 ]]
6632025-07-18T19:13:43.879Z+ sleep 1
6642025-07-18T19:13:44.873Z+ retry=27
6652025-07-18T19:13:44.898Z+ zoneadm list
6662025-07-18T19:13:44.898Z+ grep nexus
6672025-07-18T19:13:44.898Z+ [[ 27 -gt 300 ]]
6682025-07-18T19:13:44.898Z+ sleep 1
6692025-07-18T19:13:45.889Z+ retry=28
6702025-07-18T19:13:45.913Z+ zoneadm list
6712025-07-18T19:13:45.913Z+ grep nexus
6722025-07-18T19:13:45.913Z+ [[ 28 -gt 300 ]]
6732025-07-18T19:13:45.913Z+ sleep 1
6742025-07-18T19:13:46.903Z+ retry=29
6752025-07-18T19:13:46.928Z+ zoneadm list
6762025-07-18T19:13:46.928Z+ grep nexus
6772025-07-18T19:13:46.928Z+ [[ 29 -gt 300 ]]
6782025-07-18T19:13:46.928Z+ sleep 1
6792025-07-18T19:13:47.920Z+ retry=30
6802025-07-18T19:13:47.945Z+ zoneadm list
6812025-07-18T19:13:47.945Z+ grep nexus
6822025-07-18T19:13:47.945Z+ [[ 30 -gt 300 ]]
6832025-07-18T19:13:47.945Z+ sleep 1
6842025-07-18T19:13:48.935Z+ retry=31
6852025-07-18T19:13:48.960Z+ zoneadm list
6862025-07-18T19:13:48.960Z+ grep nexus
6872025-07-18T19:13:48.960Z+ [[ 31 -gt 300 ]]
6882025-07-18T19:13:48.960Z+ sleep 1
6892025-07-18T19:13:49.950Z+ retry=32
6902025-07-18T19:13:49.975Z+ zoneadm list
6912025-07-18T19:13:49.975Z+ grep nexus
6922025-07-18T19:13:49.975Z+ [[ 32 -gt 300 ]]
6932025-07-18T19:13:49.975Z+ sleep 1
6942025-07-18T19:13:50.966Z+ retry=33
6952025-07-18T19:13:50.991Z+ zoneadm list
6962025-07-18T19:13:50.991Z+ grep nexus
6972025-07-18T19:13:50.991Z+ [[ 33 -gt 300 ]]
6982025-07-18T19:13:50.991Z+ sleep 1
6992025-07-18T19:13:51.981Z+ retry=34
7002025-07-18T19:13:52.006Z+ zoneadm list
7012025-07-18T19:13:52.006Z+ grep nexus
7022025-07-18T19:13:52.006Z+ [[ 34 -gt 300 ]]
7032025-07-18T19:13:52.006Z+ sleep 1
7042025-07-18T19:13:52.995Z+ retry=35
7052025-07-18T19:13:53.021Z+ zoneadm list
7062025-07-18T19:13:53.021Z+ grep nexus
7072025-07-18T19:13:53.021Z+ [[ 35 -gt 300 ]]
7082025-07-18T19:13:53.021Z+ sleep 1
7092025-07-18T19:13:54.011Z+ retry=36
7102025-07-18T19:13:54.036Z+ zoneadm list
7112025-07-18T19:13:54.036Z+ grep nexus
7122025-07-18T19:13:54.036Z+ [[ 36 -gt 300 ]]
7132025-07-18T19:13:54.036Z+ sleep 1
7142025-07-18T19:13:55.026Z+ retry=37
7152025-07-18T19:13:55.051Z+ zoneadm list
7162025-07-18T19:13:55.051Z+ grep nexus
7172025-07-18T19:13:55.051Z+ [[ 37 -gt 300 ]]
7182025-07-18T19:13:55.051Z+ sleep 1
7192025-07-18T19:13:56.042Z+ retry=38
7202025-07-18T19:13:56.067Z+ zoneadm list
7212025-07-18T19:13:56.067Z+ grep nexus
7222025-07-18T19:13:56.067Z+ [[ 38 -gt 300 ]]
7232025-07-18T19:13:56.068Z+ sleep 1
7242025-07-18T19:13:57.058Z+ retry=39
7252025-07-18T19:13:57.083Z+ zoneadm list
7262025-07-18T19:13:57.083Z+ grep nexus
7272025-07-18T19:13:57.083Z+ [[ 39 -gt 300 ]]
7282025-07-18T19:13:57.083Z+ sleep 1
7292025-07-18T19:13:58.076Z+ retry=40
7302025-07-18T19:13:58.101Z+ zoneadm list
7312025-07-18T19:13:58.101Z+ grep nexus
7322025-07-18T19:13:58.101Z+ [[ 40 -gt 300 ]]
7332025-07-18T19:13:58.101Z+ sleep 1
7342025-07-18T19:13:59.090Z+ retry=41
7352025-07-18T19:13:59.115Z+ zoneadm list
7362025-07-18T19:13:59.115Z+ grep nexus
7372025-07-18T19:13:59.115Z+ [[ 41 -gt 300 ]]
7382025-07-18T19:13:59.115Z+ sleep 1
 
7392025-07-18T19:13:59.243ZSUNW-MSG-ID: ZFS-8000-FD, TYPE: Fault, VER: 1, SEVERITY: Major
7402025-07-18T19:13:59.291ZEVENT-TIME: Fri Jul 18 19:13:58 UTC 2025
7412025-07-18T19:13:59.352ZPLATFORM: R152-Z32-00, CSN: GKG8N7212A0021, HOSTNAME: buskin
7422025-07-18T19:13:59.386ZSOURCE: zfs-diagnosis, REV: 1.0
7432025-07-18T19:13:59.426ZEVENT-ID: fb2fb599-4341-49ad-9098-db3e32be6403
7442025-07-18T19:13:59.471ZDESC: The number of I/O errors associated with a ZFS device exceeded
7452025-07-18T19:13:59.516Zacceptable levels. Refer to http://illumos.org/msg/ZFS-8000-FD for more information.
7462025-07-18T19:13:59.561ZAUTO-RESPONSE: The device has been offlined and marked as faulted. An attempt
7472025-07-18T19:13:59.606Zwill be made to activate a hot spare if available.
7482025-07-18T19:13:59.652ZIMPACT: Fault tolerance of the pool may be compromised.
7492025-07-18T19:13:59.690ZREC-ACTION: Run 'zpool status -x' and replace the bad device.
7502025-07-18T19:13:59.734Z^@
7512025-07-18T19:13:59.779ZSUNW-MSG-ID: ZFS-8000-FD, TYPE: Fault, VER: 1, SEVERITY: Major
7522025-07-18T19:13:59.824ZEVENT-TIME: Fri Jul 18 19:13:58 UTC 2025
7532025-07-18T19:13:59.869ZPLATFORM: R152-Z32-00, CSN: GKG8N7212A0021, HOSTNAME: buskin
7542025-07-18T19:13:59.915ZSOURCE: zfs-diagnosis, REV: 1.0
7552025-07-18T19:13:59.961ZEVENT-ID: 350fcf33-1394-4fc1-938a-9fe42a39057c
7562025-07-18T19:14:00.011ZDESC: The number of I/O errors associated with a ZFS device exceeded
7572025-07-18T19:14:00.057Zacceptable levels. Refer to http://illumos.org/msg/ZFS-8000-FD for more information.
7582025-07-18T19:14:00.096ZAUTO-RESPONSE: The device has been offlined and marked as faulted. An attempt
 
7592025-07-18T19:14:00.106Z+ retry=42
7602025-07-18T19:14:00.131Z+ zoneadm list
7612025-07-18T19:14:00.131Z+ grep nexus
7622025-07-18T19:14:00.131Z+ [[ 42 -gt 300 ]]
7632025-07-18T19:14:00.131Z+ sleep 1
 
7642025-07-18T19:14:00.136Zwill be made to activate a hot spare if available.
7652025-07-18T19:14:00.175ZIMPACT: Fault tolerance of the pool may be compromised.
7662025-07-18T19:14:00.231ZREC-ACTION: Run 'zpool status -x' and replace the bad device.
 
7672025-07-18T19:14:01.124Z+ retry=43
7682025-07-18T19:14:01.149Z+ zoneadm list
7692025-07-18T19:14:01.149Z+ grep nexus
7702025-07-18T19:14:01.149Z+ [[ 43 -gt 300 ]]
7712025-07-18T19:14:01.149Z+ sleep 1
7722025-07-18T19:14:02.139Z+ retry=44
7732025-07-18T19:14:02.164Z+ zoneadm list
7742025-07-18T19:14:02.164Z+ grep nexus
7752025-07-18T19:14:02.164Z+ [[ 44 -gt 300 ]]
7762025-07-18T19:14:02.164Z+ sleep 1
7772025-07-18T19:14:03.154Z+ retry=45
7782025-07-18T19:14:03.179Z+ zoneadm list
7792025-07-18T19:14:03.179Z+ grep nexus
7802025-07-18T19:14:03.179Z+ [[ 45 -gt 300 ]]
7812025-07-18T19:14:03.179Z+ sleep 1
7822025-07-18T19:14:04.169Z+ retry=46
7832025-07-18T19:14:04.195Z+ zoneadm list
7842025-07-18T19:14:04.195Z+ grep nexus
7852025-07-18T19:14:04.195Z+ [[ 46 -gt 300 ]]
7862025-07-18T19:14:04.195Z+ sleep 1
7872025-07-18T19:14:05.187Z+ retry=47
7882025-07-18T19:14:05.212Z+ zoneadm list
7892025-07-18T19:14:05.212Z+ grep nexus
7902025-07-18T19:14:05.212Z+ [[ 47 -gt 300 ]]
7912025-07-18T19:14:05.212Z+ sleep 1
7922025-07-18T19:14:06.203Z+ retry=48
7932025-07-18T19:14:06.227Z+ zoneadm list
7942025-07-18T19:14:06.227Z+ grep nexus
7952025-07-18T19:14:06.227Z+ [[ 48 -gt 300 ]]
7962025-07-18T19:14:06.227Z+ sleep 1
7972025-07-18T19:14:07.218Z+ retry=49
7982025-07-18T19:14:07.242Z+ zoneadm list
7992025-07-18T19:14:07.242Z+ grep nexus
8002025-07-18T19:14:07.242Z+ [[ 49 -gt 300 ]]
8012025-07-18T19:14:07.242Z+ sleep 1
8022025-07-18T19:14:08.233Z+ retry=50
8032025-07-18T19:14:08.258Z+ zoneadm list
8042025-07-18T19:14:08.258Z+ grep nexus
8052025-07-18T19:14:08.258Z+ [[ 50 -gt 300 ]]
8062025-07-18T19:14:08.258Z+ sleep 1
8072025-07-18T19:14:09.249Z+ retry=51
8082025-07-18T19:14:09.274Z+ zoneadm list
8092025-07-18T19:14:09.274Z+ grep nexus
8102025-07-18T19:14:09.274Z+ [[ 51 -gt 300 ]]
8112025-07-18T19:14:09.274Z+ sleep 1
8122025-07-18T19:14:10.265Z+ retry=52
8132025-07-18T19:14:10.289Z+ zoneadm list
8142025-07-18T19:14:10.290Z+ grep nexus
8152025-07-18T19:14:10.290Z+ [[ 52 -gt 300 ]]
8162025-07-18T19:14:10.290Z+ sleep 1
8172025-07-18T19:14:11.280Z+ retry=53
8182025-07-18T19:14:11.305Z+ zoneadm list
8192025-07-18T19:14:11.305Z+ grep nexus
8202025-07-18T19:14:11.305Z+ [[ 53 -gt 300 ]]
8212025-07-18T19:14:11.305Z+ sleep 1
8222025-07-18T19:14:12.295Z+ retry=54
8232025-07-18T19:14:12.320Z+ zoneadm list
8242025-07-18T19:14:12.320Z+ grep nexus
8252025-07-18T19:14:12.320Z+ [[ 54 -gt 300 ]]
8262025-07-18T19:14:12.320Z+ sleep 1
8272025-07-18T19:14:13.310Z+ retry=55
8282025-07-18T19:14:13.335Z+ zoneadm list
8292025-07-18T19:14:13.335Z+ grep nexus
8302025-07-18T19:14:13.335Z+ [[ 55 -gt 300 ]]
8312025-07-18T19:14:13.335Z+ sleep 1
8322025-07-18T19:14:14.326Z+ retry=56
8332025-07-18T19:14:14.351Z+ zoneadm list
8342025-07-18T19:14:14.351Z+ grep nexus
8352025-07-18T19:14:14.351Z+ [[ 56 -gt 300 ]]
8362025-07-18T19:14:14.351Z+ sleep 1
8372025-07-18T19:14:15.343Z+ retry=57
8382025-07-18T19:14:15.368Z+ zoneadm list
8392025-07-18T19:14:15.368Z+ grep nexus
8402025-07-18T19:14:15.368Z+ [[ 57 -gt 300 ]]
8412025-07-18T19:14:15.368Z+ sleep 1
8422025-07-18T19:14:16.359Z+ retry=58
8432025-07-18T19:14:16.383Z+ zoneadm list
8442025-07-18T19:14:16.385Z+ grep nexus
8452025-07-18T19:14:16.385Z+ [[ 58 -gt 300 ]]
8462025-07-18T19:14:16.385Z+ sleep 1
8472025-07-18T19:14:17.375Z+ retry=59
8482025-07-18T19:14:17.400Z+ zoneadm list
8492025-07-18T19:14:17.400Z+ grep nexus
8502025-07-18T19:14:17.400Z+ [[ 59 -gt 300 ]]
8512025-07-18T19:14:17.400Z+ sleep 1
8522025-07-18T19:14:18.391Z+ retry=60
8532025-07-18T19:14:18.416Z+ zoneadm list
8542025-07-18T19:14:18.416Z+ grep nexus
8552025-07-18T19:14:18.416Z+ [[ 60 -gt 300 ]]
8562025-07-18T19:14:18.416Z+ sleep 1
8572025-07-18T19:14:19.406Z+ retry=61
8582025-07-18T19:14:19.430Z+ zoneadm list
8592025-07-18T19:14:19.430Z+ grep nexus
8602025-07-18T19:14:19.431Z+ [[ 61 -gt 300 ]]
8612025-07-18T19:14:19.431Z+ sleep 1
8622025-07-18T19:14:20.421Z+ retry=62
8632025-07-18T19:14:20.446Z+ zoneadm list
8642025-07-18T19:14:20.446Z+ grep nexus
8652025-07-18T19:14:20.446Z+ [[ 62 -gt 300 ]]
8662025-07-18T19:14:20.446Z+ sleep 1
8672025-07-18T19:14:21.435Z+ retry=63
8682025-07-18T19:14:21.460Z+ zoneadm list
8692025-07-18T19:14:21.460Z+ grep nexus
8702025-07-18T19:14:21.460Z+ [[ 63 -gt 300 ]]
8712025-07-18T19:14:21.460Z+ sleep 1
8722025-07-18T19:14:22.451Z+ retry=64
8732025-07-18T19:14:22.476Z+ zoneadm list
8742025-07-18T19:14:22.476Z+ grep nexus
8752025-07-18T19:14:22.476Z+ [[ 64 -gt 300 ]]
8762025-07-18T19:14:22.476Z+ sleep 1
8772025-07-18T19:14:23.466Z+ retry=65
8782025-07-18T19:14:23.491Z+ zoneadm list
8792025-07-18T19:14:23.491Z+ grep nexus
8802025-07-18T19:14:23.491Z+ [[ 65 -gt 300 ]]
8812025-07-18T19:14:23.491Z+ sleep 1
8822025-07-18T19:14:24.481Z+ retry=66
8832025-07-18T19:14:24.506Z+ zoneadm list
8842025-07-18T19:14:24.506Z+ grep nexus
8852025-07-18T19:14:24.506Z+ [[ 66 -gt 300 ]]
8862025-07-18T19:14:24.506Z+ sleep 1
8872025-07-18T19:14:25.497Z+ retry=67
8882025-07-18T19:14:25.522Z+ zoneadm list
8892025-07-18T19:14:25.522Z+ grep nexus
8902025-07-18T19:14:25.522Z+ [[ 67 -gt 300 ]]
8912025-07-18T19:14:25.522Z+ sleep 1
8922025-07-18T19:14:26.513Z+ retry=68
8932025-07-18T19:14:26.538Z+ zoneadm list
8942025-07-18T19:14:26.538Z+ grep nexus
8952025-07-18T19:14:26.538Z+ [[ 68 -gt 300 ]]
8962025-07-18T19:14:26.538Z+ sleep 1
8972025-07-18T19:14:27.529Z+ retry=69
8982025-07-18T19:14:27.554Z+ zoneadm list
8992025-07-18T19:14:27.554Z+ grep nexus
9002025-07-18T19:14:27.554Z+ [[ 69 -gt 300 ]]
9012025-07-18T19:14:27.554Z+ sleep 1
9022025-07-18T19:14:28.545Z+ retry=70
9032025-07-18T19:14:28.570Z+ zoneadm list
9042025-07-18T19:14:28.570Z+ grep nexus
9052025-07-18T19:14:28.570Z+ [[ 70 -gt 300 ]]
9062025-07-18T19:14:28.570Z+ sleep 1
9072025-07-18T19:14:29.561Z+ retry=71
9082025-07-18T19:14:29.586Z+ zoneadm list
9092025-07-18T19:14:29.586Z+ grep nexus
9102025-07-18T19:14:29.586Z+ [[ 71 -gt 300 ]]
9112025-07-18T19:14:29.586Z+ sleep 1
9122025-07-18T19:14:30.576Z+ retry=72
9132025-07-18T19:14:30.602Z+ zoneadm list
9142025-07-18T19:14:30.602Z+ grep nexus
9152025-07-18T19:14:30.602Z+ [[ 72 -gt 300 ]]
9162025-07-18T19:14:30.602Z+ sleep 1
9172025-07-18T19:14:31.591Z+ retry=73
9182025-07-18T19:14:31.616Z+ zoneadm list
9192025-07-18T19:14:31.616Z+ grep nexus
9202025-07-18T19:14:31.616Z+ [[ 73 -gt 300 ]]
9212025-07-18T19:14:31.616Z+ sleep 1
9222025-07-18T19:14:32.606Z+ retry=74
9232025-07-18T19:14:32.631Z+ zoneadm list
9242025-07-18T19:14:32.631Z+ grep nexus
9252025-07-18T19:14:32.631Z+ [[ 74 -gt 300 ]]
9262025-07-18T19:14:32.631Z+ sleep 1
9272025-07-18T19:14:33.620Z+ retry=75
9282025-07-18T19:14:33.645Z+ zoneadm list
9292025-07-18T19:14:33.645Z+ grep nexus
9302025-07-18T19:14:33.645Z+ [[ 75 -gt 300 ]]
9312025-07-18T19:14:33.645Z+ sleep 1
9322025-07-18T19:14:34.635Z+ retry=76
9332025-07-18T19:14:34.661Z+ zoneadm list
9342025-07-18T19:14:34.661Z+ grep nexus
9352025-07-18T19:14:34.661Z+ [[ 76 -gt 300 ]]
9362025-07-18T19:14:34.661Z+ sleep 1
9372025-07-18T19:14:35.649Z+ retry=77
9382025-07-18T19:14:35.674Z+ zoneadm list
9392025-07-18T19:14:35.674Z+ grep nexus
9402025-07-18T19:14:35.674Z+ [[ 77 -gt 300 ]]
9412025-07-18T19:14:35.674Z+ sleep 1
9422025-07-18T19:14:36.667Z+ retry=78
9432025-07-18T19:14:36.693Z+ zoneadm list
9442025-07-18T19:14:36.693Z+ grep nexus
9452025-07-18T19:14:36.693Z+ [[ 78 -gt 300 ]]
9462025-07-18T19:14:36.693Z+ sleep 1
9472025-07-18T19:14:37.688Z+ retry=79
9482025-07-18T19:14:37.712Z+ zoneadm list
9492025-07-18T19:14:37.713Z+ grep nexus
9502025-07-18T19:14:37.713Z+ [[ 79 -gt 300 ]]
9512025-07-18T19:14:37.713Z+ sleep 1
9522025-07-18T19:14:38.712Z+ retry=80
9532025-07-18T19:14:38.737Z+ zoneadm list
9542025-07-18T19:14:38.737Z+ grep nexus
9552025-07-18T19:14:38.737Z+ [[ 80 -gt 300 ]]
9562025-07-18T19:14:38.737Z+ sleep 1
9572025-07-18T19:14:39.758Z+ retry=81
9582025-07-18T19:14:39.758Z+ zoneadm list
9592025-07-18T19:14:39.758Z+ grep nexus
9602025-07-18T19:14:39.758Z+ [[ 81 -gt 300 ]]
9612025-07-18T19:14:39.758Z+ sleep 1
9622025-07-18T19:14:40.787Z+ retry=82
9632025-07-18T19:14:40.787Z+ zoneadm list
9642025-07-18T19:14:40.787Z+ grep nexus
9652025-07-18T19:14:40.832Z+ [[ 82 -gt 300 ]]
9662025-07-18T19:14:40.832Z+ sleep 1
9672025-07-18T19:14:43.015Z+ retry=83
9682025-07-18T19:14:43.102Z+ zoneadm list
9692025-07-18T19:14:43.178Z+ grep nexus
9702025-07-18T19:14:43.294Z+ [[ 83 -gt 300 ]]
9712025-07-18T19:14:43.294Z+ sleep 1
9722025-07-18T19:14:44.444Z+ retry=84
9732025-07-18T19:14:44.469Z+ zoneadm list
9742025-07-18T19:14:44.469Z+ grep nexus
9752025-07-18T19:14:44.469Z+ [[ 84 -gt 300 ]]
9762025-07-18T19:14:44.469Z+ sleep 1
9772025-07-18T19:14:45.468Z+ retry=85
9782025-07-18T19:14:45.493Z+ zoneadm list
9792025-07-18T19:14:45.493Z+ grep nexus
9802025-07-18T19:14:45.494Z+ [[ 85 -gt 300 ]]
9812025-07-18T19:14:45.494Z+ sleep 1
9822025-07-18T19:14:46.506Z+ retry=86
9832025-07-18T19:14:46.531Z+ zoneadm list
9842025-07-18T19:14:46.531Z+ grep nexus
9852025-07-18T19:14:46.532Zoxz_nexus_4627777a-3582-477b-a211-43f686d83b54
9862025-07-18T19:14:46.532Zoxz_nexus_33fb85a6-524f-4ef3-b2bc-002d659a2026
9872025-07-18T19:14:46.556Z+ echo 'Waited for nexus: 86s'
9882025-07-18T19:14:46.556ZWaited for nexus: 86s
9892025-07-18T19:14:46.556Z+ retry=0
9902025-07-18T19:14:46.556Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9912025-07-18T19:14:46.556Z+ [[ 0 -gt 300 ]]
9922025-07-18T19:14:46.557Z+ sleep 1
9932025-07-18T19:14:47.560Z+ retry=1
9942025-07-18T19:14:47.560Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9952025-07-18T19:14:47.585Z+ [[ 1 -gt 300 ]]
9962025-07-18T19:14:47.585Z+ sleep 1
9972025-07-18T19:14:48.578Z+ retry=2
9982025-07-18T19:14:48.578Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9992025-07-18T19:14:48.603Z+ [[ 2 -gt 300 ]]
10002025-07-18T19:14:48.603Z+ sleep 1
10012025-07-18T19:14:49.595Z+ retry=3
10022025-07-18T19:14:49.595Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10032025-07-18T19:14:49.620Z+ [[ 3 -gt 300 ]]
10042025-07-18T19:14:49.620Z+ sleep 1
10052025-07-18T19:14:50.623Z+ retry=4
10062025-07-18T19:14:50.623Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10072025-07-18T19:14:50.648Z+ [[ 4 -gt 300 ]]
10082025-07-18T19:14:50.648Z+ sleep 1
10092025-07-18T19:14:51.626Z+ retry=5
10102025-07-18T19:14:51.626Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10112025-07-18T19:14:51.651Z+ [[ 5 -gt 300 ]]
10122025-07-18T19:14:51.652Z+ sleep 1
10132025-07-18T19:14:52.637Z+ retry=6
10142025-07-18T19:14:52.637Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10152025-07-18T19:14:52.662Z+ [[ 6 -gt 300 ]]
10162025-07-18T19:14:52.662Z+ sleep 1
10172025-07-18T19:14:53.645Z+ retry=7
10182025-07-18T19:14:53.646Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10192025-07-18T19:14:53.673Z+ [[ 7 -gt 300 ]]
10202025-07-18T19:14:53.673Z+ sleep 1
10212025-07-18T19:14:54.655Z+ retry=8
10222025-07-18T19:14:54.655Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10232025-07-18T19:14:54.679Z+ [[ 8 -gt 300 ]]
10242025-07-18T19:14:54.679Z+ sleep 1
10252025-07-18T19:14:55.664Z+ retry=9
10262025-07-18T19:14:55.664Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10272025-07-18T19:14:55.689Z+ [[ 9 -gt 300 ]]
10282025-07-18T19:14:55.689Z+ sleep 1
10292025-07-18T19:14:56.676Z+ retry=10
10302025-07-18T19:14:56.676Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10312025-07-18T19:14:56.701Z+ [[ 10 -gt 300 ]]
10322025-07-18T19:14:56.701Z+ sleep 1
10332025-07-18T19:14:57.687Z+ retry=11
10342025-07-18T19:14:57.687Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10352025-07-18T19:14:57.711Z+ [[ 11 -gt 300 ]]
10362025-07-18T19:14:57.712Z+ sleep 1
10372025-07-18T19:14:58.697Z+ retry=12
10382025-07-18T19:14:58.697Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10392025-07-18T19:14:58.722Z+ [[ 12 -gt 300 ]]
10402025-07-18T19:14:58.722Z+ sleep 1
10412025-07-18T19:14:59.709Z+ retry=13
10422025-07-18T19:14:59.709Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10432025-07-18T19:14:59.740Z+ [[ 13 -gt 300 ]]
10442025-07-18T19:14:59.740Z+ sleep 1
10452025-07-18T19:15:00.720Z+ retry=14
10462025-07-18T19:15:00.720Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10472025-07-18T19:15:00.744Z+ [[ 14 -gt 300 ]]
10482025-07-18T19:15:00.744Z+ sleep 1
10492025-07-18T19:15:01.730Z+ retry=15
10502025-07-18T19:15:01.731Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10512025-07-18T19:15:01.755Z+ [[ 15 -gt 300 ]]
10522025-07-18T19:15:01.755Z+ sleep 1
10532025-07-18T19:15:02.746Z+ retry=16
10542025-07-18T19:15:02.746Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10552025-07-18T19:15:02.770Z+ [[ 16 -gt 300 ]]
10562025-07-18T19:15:02.770Z+ sleep 1
10572025-07-18T19:15:03.759Z+ retry=17
10582025-07-18T19:15:03.759Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10592025-07-18T19:15:03.784Z+ [[ 17 -gt 300 ]]
10602025-07-18T19:15:03.784Z+ sleep 1
10612025-07-18T19:15:04.772Z+ retry=18
10622025-07-18T19:15:04.772Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10632025-07-18T19:15:04.796Z+ [[ 18 -gt 300 ]]
10642025-07-18T19:15:04.797Z+ sleep 1
10652025-07-18T19:15:05.782Z+ retry=19
10662025-07-18T19:15:05.782Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10672025-07-18T19:15:05.807Z+ [[ 19 -gt 300 ]]
10682025-07-18T19:15:05.807Z+ sleep 1
10692025-07-18T19:15:06.792Z+ retry=20
10702025-07-18T19:15:06.792Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10712025-07-18T19:15:06.816Z+ [[ 20 -gt 300 ]]
10722025-07-18T19:15:06.816Z+ sleep 1
10732025-07-18T19:15:07.803Z+ retry=21
10742025-07-18T19:15:07.803Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10752025-07-18T19:15:07.827Z+ [[ 21 -gt 300 ]]
10762025-07-18T19:15:07.827Z+ sleep 1
 
10772025-07-18T19:15:08.251Z^@Jul 18 19:15:07 buskin ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
 
10782025-07-18T19:15:08.811Z+ retry=22
10792025-07-18T19:15:08.811Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10802025-07-18T19:15:08.836Z+ [[ 22 -gt 300 ]]
10812025-07-18T19:15:08.836Z+ sleep 1
10822025-07-18T19:15:09.823Z+ retry=23
10832025-07-18T19:15:09.823Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10842025-07-18T19:15:09.848Z+ [[ 23 -gt 300 ]]
10852025-07-18T19:15:09.848Z+ sleep 1
 
10862025-07-18T19:15:10.274ZJul 18 19:15:09 buskin ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
 
10872025-07-18T19:15:10.833Z+ retry=24
10882025-07-18T19:15:10.833Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10892025-07-18T19:15:10.858Z+ [[ 24 -gt 300 ]]
10902025-07-18T19:15:10.858Z+ sleep 1
10912025-07-18T19:15:11.843Z+ retry=25
10922025-07-18T19:15:11.843Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10932025-07-18T19:15:11.868Z+ [[ 25 -gt 300 ]]
10942025-07-18T19:15:11.868Z+ sleep 1
 
10952025-07-18T19:15:12.280ZJul 18 19:15:11 buskin ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
 
10962025-07-18T19:15:12.853Z+ retry=26
10972025-07-18T19:15:12.853Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10982025-07-18T19:15:12.877Z+ [[ 26 -gt 300 ]]
10992025-07-18T19:15:12.877Z+ sleep 1
 
11002025-07-18T19:15:12.888ZJul 18 19:15:12 buskin ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
11012025-07-18T19:15:13.486ZJul 18 19:15:12 buskin ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
 
11022025-07-18T19:15:13.862Z+ retry=27
11032025-07-18T19:15:13.862Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11042025-07-18T19:15:13.887Z+ [[ 27 -gt 300 ]]
11052025-07-18T19:15:13.888Z+ sleep 1
11062025-07-18T19:15:14.872Z+ retry=28
11072025-07-18T19:15:14.873Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11082025-07-18T19:15:14.897Z+ [[ 28 -gt 300 ]]
11092025-07-18T19:15:14.898Z+ sleep 1
11102025-07-18T19:15:15.884Z+ retry=29
11112025-07-18T19:15:15.884Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11122025-07-18T19:15:15.908Z+ [[ 29 -gt 300 ]]
11132025-07-18T19:15:15.908Z+ sleep 1
11142025-07-18T19:15:16.893Z+ retry=30
11152025-07-18T19:15:16.893Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11162025-07-18T19:15:16.918Z+ [[ 30 -gt 300 ]]
11172025-07-18T19:15:16.918Z+ sleep 1
11182025-07-18T19:15:17.906Z+ retry=31
11192025-07-18T19:15:17.906Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11202025-07-18T19:15:17.930Z+ [[ 31 -gt 300 ]]
11212025-07-18T19:15:17.930Z+ sleep 1
11222025-07-18T19:15:18.918Z+ retry=32
11232025-07-18T19:15:18.918Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11242025-07-18T19:15:18.943Z+ [[ 32 -gt 300 ]]
11252025-07-18T19:15:18.943Z+ sleep 1
11262025-07-18T19:15:19.932Z+ retry=33
11272025-07-18T19:15:19.932Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11282025-07-18T19:15:19.956Z+ [[ 33 -gt 300 ]]
11292025-07-18T19:15:19.956Z+ sleep 1
11302025-07-18T19:15:20.941Z+ retry=34
11312025-07-18T19:15:20.941Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11322025-07-18T19:15:20.965Z{"msg":"Handoff to Nexus is complete","v":0,"name":"SledAgent","level":30,"time":"2025-07-18T19:15:20.1956443Z","hostname":"buskin","pid":1567,"component":"RSS","file":"sled-agent/src/rack_setup/service.rs:1063"}
11332025-07-18T19:15:20.965Z+ echo 'Waited for handoff: 34s'
11342025-07-18T19:15:20.965ZWaited for handoff: 34s
11352025-07-18T19:15:20.965Z+ retry=0
11362025-07-18T19:15:20.965Z++ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i
11372025-07-18T19:15:20.965Z++ wc -l
11382025-07-18T19:15:21.077Znote: database URL not specified. Will search DNS.
11392025-07-18T19:15:21.077Znote: (override with --db-url or OMDB_DB_URL)
11402025-07-18T19:15:21.077Znote: using DNS server for subnet fd00:1122:3344::/48
11412025-07-18T19:15:21.077Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11422025-07-18T19:15:21.102Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
11432025-07-18T19:15:21.126Znote: database schema version matches expected (166.0.0)
11442025-07-18T19:15:21.332Z+ ACTUAL_ZPOOL_COUNT=' 9'
11452025-07-18T19:15:21.356Z+ [[ 9 -eq 9 ]]
11462025-07-18T19:15:21.356Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list
11472025-07-18T19:15:21.382Znote: database URL not specified. Will search DNS.
11482025-07-18T19:15:21.382Znote: (override with --db-url or OMDB_DB_URL)
11492025-07-18T19:15:21.382Znote: using DNS server for subnet fd00:1122:3344::/48
11502025-07-18T19:15:21.382Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11512025-07-18T19:15:21.382Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
11522025-07-18T19:15:21.407Znote: database schema version matches expected (166.0.0)
11532025-07-18T19:15:21.976ZID |TIME_DELETED |SLED_ID |PHYSICAL_DISK_ID |TOTAL_SIZE |CONTROL_PLANE_STORAGE_BUFFER
11542025-07-18T19:15:21.976Z-------------------------------------+-------------+-------------------------------------+-------------------------------------+------------+-----------------------------
11552025-07-18T19:15:21.977Z1679f4a1-f74d-466c-993c-53dc4e8a3e2d | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |666ee3df-4e2d-4675-b4f7-262c4fcaf84c |20937965568 |268435456000
11562025-07-18T19:15:21.977Z1e7d570d-3d03-40ee-9daa-ae06d6108b26 | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |cc74758a-60a4-4b18-a150-be7e5166c866 |20937965568 |268435456000
11572025-07-18T19:15:21.977Z3ab4a452-84a6-46f6-80a9-f6196c8fe34e | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |1ff1769b-924a-4ddb-a162-9a36bc1662bd |20937965568 |268435456000
11582025-07-18T19:15:21.977Z3fd3a792-884d-4bd2-ab43-8b905c2f9aba | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |143c4e3a-41ff-4d1d-a650-758193ab652e |20937965568 |268435456000
11592025-07-18T19:15:21.977Z4499d734-b205-4772-85c2-355cd1af612e | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |cc173db8-21b3-47ed-aeac-c2b9f03fb6e4 |20937965568 |268435456000
11602025-07-18T19:15:21.977Z8e508f4c-2811-49cd-ab16-1715133cdbf4 | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |c9231f8b-a219-4367-96c4-958f52f1f1d6 |20937965568 |268435456000
11612025-07-18T19:15:21.977Zb138564a-bfcc-4cdb-a4ac-30965a1ed56c | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |5c5a2cb8-8b5f-483b-8574-d9f7aac433f3 |20937965568 |268435456000
11622025-07-18T19:15:21.977Zd434fc66-9378-47a1-bac3-8eaeb65e5efa | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |1ed8ca04-3a7b-417a-8bac-3919505293a9 |20937965568 |268435456000
11632025-07-18T19:15:21.977Zec33aee0-8f40-4df3-85e3-896c3de94650 | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |9440d6f8-a503-4ace-b6a9-6038f7529c16 |20937965568 |268435456000
11642025-07-18T19:15:22.002Z++ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i
11652025-07-18T19:15:22.033Znote: database URL not specified. Will search DNS.
11662025-07-18T19:15:22.033Znote: (override with --db-url or OMDB_DB_URL)
11672025-07-18T19:15:22.033Znote: using DNS server for subnet fd00:1122:3344::/48
11682025-07-18T19:15:22.033Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11692025-07-18T19:15:22.033Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
11702025-07-18T19:15:22.033Znote: database schema version matches expected (166.0.0)
11712025-07-18T19:15:22.220Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
11722025-07-18T19:15:22.220Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 1679f4a1-f74d-466c-993c-53dc4e8a3e2d 0
11732025-07-18T19:15:22.257Znote: database URL not specified. Will search DNS.
11742025-07-18T19:15:22.257Znote: (override with --db-url or OMDB_DB_URL)
11752025-07-18T19:15:22.257Znote: using DNS server for subnet fd00:1122:3344::/48
11762025-07-18T19:15:22.282Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11772025-07-18T19:15:22.282Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
11782025-07-18T19:15:22.282Znote: database schema version matches expected (166.0.0)
11792025-07-18T19:15:22.326Zset pool 1679f4a1-f74d-466c-993c-53dc4e8a3e2d control plane storage buffer bytes to 0
11802025-07-18T19:15:22.354Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
11812025-07-18T19:15:22.354Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 1e7d570d-3d03-40ee-9daa-ae06d6108b26 0
11822025-07-18T19:15:22.378Znote: database URL not specified. Will search DNS.
11832025-07-18T19:15:22.378Znote: (override with --db-url or OMDB_DB_URL)
11842025-07-18T19:15:22.378Znote: using DNS server for subnet fd00:1122:3344::/48
11852025-07-18T19:15:22.378Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11862025-07-18T19:15:22.378Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
11872025-07-18T19:15:22.406Znote: database schema version matches expected (166.0.0)
11882025-07-18T19:15:22.434Zset pool 1e7d570d-3d03-40ee-9daa-ae06d6108b26 control plane storage buffer bytes to 0
11892025-07-18T19:15:22.459Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
11902025-07-18T19:15:22.459Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 3ab4a452-84a6-46f6-80a9-f6196c8fe34e 0
11912025-07-18T19:15:22.483Znote: database URL not specified. Will search DNS.
11922025-07-18T19:15:22.483Znote: (override with --db-url or OMDB_DB_URL)
11932025-07-18T19:15:22.483Znote: using DNS server for subnet fd00:1122:3344::/48
11942025-07-18T19:15:22.483Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11952025-07-18T19:15:22.483Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
11962025-07-18T19:15:22.512Znote: database schema version matches expected (166.0.0)
11972025-07-18T19:15:22.546Zset pool 3ab4a452-84a6-46f6-80a9-f6196c8fe34e control plane storage buffer bytes to 0
11982025-07-18T19:15:22.570Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
11992025-07-18T19:15:22.570Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 3fd3a792-884d-4bd2-ab43-8b905c2f9aba 0
12002025-07-18T19:15:22.595Znote: database URL not specified. Will search DNS.
12012025-07-18T19:15:22.595Znote: (override with --db-url or OMDB_DB_URL)
12022025-07-18T19:15:22.595Znote: using DNS server for subnet fd00:1122:3344::/48
12032025-07-18T19:15:22.595Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12042025-07-18T19:15:22.595Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12052025-07-18T19:15:22.619Znote: database schema version matches expected (166.0.0)
12062025-07-18T19:15:22.656Zset pool 3fd3a792-884d-4bd2-ab43-8b905c2f9aba control plane storage buffer bytes to 0
12072025-07-18T19:15:22.680Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12082025-07-18T19:15:22.680Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 4499d734-b205-4772-85c2-355cd1af612e 0
12092025-07-18T19:15:22.706Znote: database URL not specified. Will search DNS.
12102025-07-18T19:15:22.706Znote: (override with --db-url or OMDB_DB_URL)
12112025-07-18T19:15:22.706Znote: using DNS server for subnet fd00:1122:3344::/48
12122025-07-18T19:15:22.706Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12132025-07-18T19:15:22.706Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12142025-07-18T19:15:22.730Znote: database schema version matches expected (166.0.0)
12152025-07-18T19:15:22.771Zset pool 4499d734-b205-4772-85c2-355cd1af612e control plane storage buffer bytes to 0
12162025-07-18T19:15:22.798Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12172025-07-18T19:15:22.798Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 8e508f4c-2811-49cd-ab16-1715133cdbf4 0
12182025-07-18T19:15:22.822Znote: database URL not specified. Will search DNS.
12192025-07-18T19:15:22.823Znote: (override with --db-url or OMDB_DB_URL)
12202025-07-18T19:15:22.823Znote: using DNS server for subnet fd00:1122:3344::/48
12212025-07-18T19:15:22.823Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12222025-07-18T19:15:22.823Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12232025-07-18T19:15:22.847Znote: database schema version matches expected (166.0.0)
12242025-07-18T19:15:22.880Zset pool 8e508f4c-2811-49cd-ab16-1715133cdbf4 control plane storage buffer bytes to 0
12252025-07-18T19:15:22.904Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12262025-07-18T19:15:22.904Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer b138564a-bfcc-4cdb-a4ac-30965a1ed56c 0
12272025-07-18T19:15:22.928Znote: database URL not specified. Will search DNS.
12282025-07-18T19:15:22.928Znote: (override with --db-url or OMDB_DB_URL)
12292025-07-18T19:15:22.928Znote: using DNS server for subnet fd00:1122:3344::/48
12302025-07-18T19:15:22.928Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12312025-07-18T19:15:22.929Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12322025-07-18T19:15:22.953Znote: database schema version matches expected (166.0.0)
12332025-07-18T19:15:22.990Zset pool b138564a-bfcc-4cdb-a4ac-30965a1ed56c control plane storage buffer bytes to 0
12342025-07-18T19:15:23.018Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12352025-07-18T19:15:23.018Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer d434fc66-9378-47a1-bac3-8eaeb65e5efa 0
12362025-07-18T19:15:23.042Znote: database URL not specified. Will search DNS.
12372025-07-18T19:15:23.042Znote: (override with --db-url or OMDB_DB_URL)
12382025-07-18T19:15:23.042Znote: using DNS server for subnet fd00:1122:3344::/48
12392025-07-18T19:15:23.042Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12402025-07-18T19:15:23.042Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12412025-07-18T19:15:23.042Znote: database schema version matches expected (166.0.0)
12422025-07-18T19:15:23.106Zset pool d434fc66-9378-47a1-bac3-8eaeb65e5efa control plane storage buffer bytes to 0
12432025-07-18T19:15:23.130Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12442025-07-18T19:15:23.130Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer ec33aee0-8f40-4df3-85e3-896c3de94650 0
12452025-07-18T19:15:23.155Znote: database URL not specified. Will search DNS.
12462025-07-18T19:15:23.155Znote: (override with --db-url or OMDB_DB_URL)
12472025-07-18T19:15:23.155Znote: using DNS server for subnet fd00:1122:3344::/48
12482025-07-18T19:15:23.155Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12492025-07-18T19:15:23.155Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12502025-07-18T19:15:23.180Znote: database schema version matches expected (166.0.0)
12512025-07-18T19:15:23.214Zset pool ec33aee0-8f40-4df3-85e3-896c3de94650 control plane storage buffer bytes to 0
12522025-07-18T19:15:23.238Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list
12532025-07-18T19:15:23.263Znote: database URL not specified. Will search DNS.
12542025-07-18T19:15:23.263Znote: (override with --db-url or OMDB_DB_URL)
12552025-07-18T19:15:23.263Znote: using DNS server for subnet fd00:1122:3344::/48
12562025-07-18T19:15:23.263Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12572025-07-18T19:15:23.263Znote: using database URL postgresql://root@[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221/omicron?sslmode=disable
12582025-07-18T19:15:23.287Znote: database schema version matches expected (166.0.0)
12592025-07-18T19:15:23.444ZID |TIME_DELETED |SLED_ID |PHYSICAL_DISK_ID |TOTAL_SIZE |CONTROL_PLANE_STORAGE_BUFFER
12602025-07-18T19:15:23.444Z-------------------------------------+-------------+-------------------------------------+-------------------------------------+------------+-----------------------------
12612025-07-18T19:15:23.444Z1679f4a1-f74d-466c-993c-53dc4e8a3e2d | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |666ee3df-4e2d-4675-b4f7-262c4fcaf84c |20937965568 |0
12622025-07-18T19:15:23.444Z1e7d570d-3d03-40ee-9daa-ae06d6108b26 | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |cc74758a-60a4-4b18-a150-be7e5166c866 |20937965568 |0
12632025-07-18T19:15:23.444Z3ab4a452-84a6-46f6-80a9-f6196c8fe34e | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |1ff1769b-924a-4ddb-a162-9a36bc1662bd |20937965568 |0
12642025-07-18T19:15:23.444Z3fd3a792-884d-4bd2-ab43-8b905c2f9aba | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |143c4e3a-41ff-4d1d-a650-758193ab652e |20937965568 |0
12652025-07-18T19:15:23.444Z4499d734-b205-4772-85c2-355cd1af612e | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |cc173db8-21b3-47ed-aeac-c2b9f03fb6e4 |20937965568 |0
12662025-07-18T19:15:23.444Z8e508f4c-2811-49cd-ab16-1715133cdbf4 | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |c9231f8b-a219-4367-96c4-958f52f1f1d6 |20937965568 |0
12672025-07-18T19:15:23.444Zb138564a-bfcc-4cdb-a4ac-30965a1ed56c | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |5c5a2cb8-8b5f-483b-8574-d9f7aac433f3 |20937965568 |0
12682025-07-18T19:15:23.444Zd434fc66-9378-47a1-bac3-8eaeb65e5efa | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |1ed8ca04-3a7b-417a-8bac-3919505293a9 |20937965568 |0
12692025-07-18T19:15:23.444Zec33aee0-8f40-4df3-85e3-896c3de94650 | |3aa4df2d-7952-46ae-b7f9-0b15b952eda6 |9440d6f8-a503-4ace-b6a9-6038f7529c16 |20937965568 |0
12702025-07-18T19:15:23.469Z+ export RUST_BACKTRACE=1
12712025-07-18T19:15:23.469Z+ RUST_BACKTRACE=1
12722025-07-18T19:15:23.469Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
12732025-07-18T19:15:23.469Z++ ./target/debug/bootstrap
12742025-07-18T19:15:23.724ZUsing external DNS server at 10.151.1.164:53
12752025-07-18T19:15:23.755Z2025-07-18 19:15:23.743326085 UTC: attempting to log into API
12762025-07-18T19:15:25.154Z2025-07-18 19:15:25.142321225 UTC: login succeeded
12772025-07-18T19:15:25.187Zwaiting for nexus to come up...
12782025-07-18T19:15:25.290Zcreating IP pool... 10.151.1.175 - 10.151.1.227
12792025-07-18T19:15:25.612Zsetting up quotas...
12802025-07-18T19:15:25.673Zensuring datasets are ready...
12812025-07-18T19:15:29.643Zlet's roll.
12822025-07-18T19:15:29.668Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
12832025-07-18T19:15:29.668ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
12842025-07-18T19:15:29.668ZOXIDE_TOKEN=oxide-token-bfc49a14bc340ac29085ceb80534379d0b02139e'
12852025-07-18T19:15:29.668Z++ OXIDE_HOST=https://recovery.sys.oxide.test
12862025-07-18T19:15:29.668Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
12872025-07-18T19:15:29.668Z++ OXIDE_TOKEN=oxide-token-bfc49a14bc340ac29085ceb80534379d0b02139e
12882025-07-18T19:15:29.668Z+ export OXIDE_HOST OXIDE_TOKEN
12892025-07-18T19:15:29.668Z+ retry=0
12902025-07-18T19:15:29.668Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12912025-07-18T19:15:29.753Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
12922025-07-18T19:15:30.494Z{"status":"ok"}{
12932025-07-18T19:15:30.494Z "description": "some images",
12942025-07-18T19:15:30.494Z "id": "7c3210b6-76bf-471b-8ba2-b2c17932fc42",
12952025-07-18T19:15:30.494Z "name": "images",
12962025-07-18T19:15:30.494Z "time_created": "2025-07-18T19:15:29.823642Z",
12972025-07-18T19:15:30.494Z "time_modified": "2025-07-18T19:15:29.823642Z"
12982025-07-18T19:15:30.494Z}
12992025-07-18T19:15:30.519Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 --parallelism 1
13002025-07-18T19:26:17.648ZDone!
13012025-07-18T19:26:17.673Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
13022025-07-18T19:26:17.921Z{
13032025-07-18T19:26:17.921Z "block_size": 512,
13042025-07-18T19:26:17.921Z "description": "debian 11 original base image",
13052025-07-18T19:26:17.921Z "id": "58548503-7bf4-44a8-b991-820434e19f71",
13062025-07-18T19:26:17.921Z "name": "debian11",
13072025-07-18T19:26:17.921Z "os": "debian",
13082025-07-18T19:26:17.921Z "size": 2147483648,
13092025-07-18T19:26:17.921Z "time_created": "2025-07-18T19:26:17.474748Z",
13102025-07-18T19:26:17.921Z "time_modified": "2025-07-18T19:26:17.895776Z",
13112025-07-18T19:26:17.921Z "version": "11"
13122025-07-18T19:26:17.921Z}
13132025-07-18T19:26:17.981Z+ for test_bin in tests/*
13142025-07-18T19:26:17.981Z+ ./tests/bootstrap-0475c9d74c3b1c63
13152025-07-18T19:26:17.981Z
13162025-07-18T19:26:17.981Zrunning 0 tests
13172025-07-18T19:26:17.981Z
13182025-07-18T19:26:17.981Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13192025-07-18T19:26:17.981Z
13202025-07-18T19:26:17.981Z+ for test_bin in tests/*
13212025-07-18T19:26:17.981Z+ ./tests/commtest-cac5147583770bcc
13222025-07-18T19:26:18.013Z
13232025-07-18T19:26:18.013Zrunning 0 tests
13242025-07-18T19:26:18.038Z
13252025-07-18T19:26:18.038Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13262025-07-18T19:26:18.038Z
13272025-07-18T19:26:18.038Z+ for test_bin in tests/*
13282025-07-18T19:26:18.038Z+ ./tests/dhcp_server-5ebd6d92daba20bd
13292025-07-18T19:26:18.063Z
13302025-07-18T19:26:18.063Zrunning 0 tests
13312025-07-18T19:26:18.063Z
13322025-07-18T19:26:18.063Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13332025-07-18T19:26:18.063Z
13342025-07-18T19:26:18.063Z+ for test_bin in tests/*
13352025-07-18T19:26:18.064Z+ ./tests/end_to_end_tests-01cfe3e16a30235b
13362025-07-18T19:26:18.344Z
13372025-07-18T19:26:18.344Zrunning 3 tests
13382025-07-18T19:26:18.369Znote: configured to log to "/tmp/end_to_end_tests-01cfe3e16a30235b-new_blueprint_noop.6557.0.log"
13392025-07-18T19:26:18.739Ztest no_spoof::no_spoof_here ... ok
13402025-07-18T19:26:19.061Ztest noop_blueprint::new_blueprint_noop ... ok
13412025-07-18T19:26:48.335Ztest instance_launch::instance_launch ... ok
13422025-07-18T19:26:48.335Z
13432025-07-18T19:26:48.335Ztest result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 29.99s
13442025-07-18T19:26:48.335Z
13452025-07-18T19:26:48.359Z+ _exit_trap
13462025-07-18T19:26:48.359Z+ local status=0
13472025-07-18T19:26:48.359Z+ set +o errexit
13482025-07-18T19:26:48.359Z+ [[ x != \x ]]
13492025-07-18T19:26:48.359Z+ pfexec svcadm -Z disable -s cron
13502025-07-18T19:26:50.489Z+ [[ 0 -eq 0 ]]
13512025-07-18T19:26:50.489Z+ exit 0
13522025-07-18T19:26:50.513Zprocess exited: duration 910945 ms, exit code 0
 
13532025-07-18T19:26:50.669Zfound 147 output files
13542025-07-18T19:26:50.669Zuploading: /var/svc/log/oxide-mg-ddm:default.log (335651 bytes)
13552025-07-18T19:26:51.962Zuploaded: /var/svc/log/oxide-mg-ddm:default.log
13562025-07-18T19:26:51.987Zuploading: /var/svc/log/oxide-sled-agent:default.log (3014297 bytes)
13572025-07-18T19:26:53.377Zuploaded: /var/svc/log/oxide-sled-agent:default.log
13582025-07-18T19:26:53.377Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (6689302 bytes)
13592025-07-18T19:26:55.907Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 6689302 -> 6734040
13602025-07-18T19:26:56.980Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
13612025-07-18T19:26:57.004Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (1149428 bytes)
13622025-07-18T19:26:59.114Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
13632025-07-18T19:26:59.114Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (7485 bytes)
13642025-07-18T19:27:00.234Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
13652025-07-18T19:27:00.235Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0 (32053 bytes)
13662025-07-18T19:27:01.378Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0
13672025-07-18T19:27:01.378Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (328730 bytes)
13682025-07-18T19:27:01.900Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 328730 -> 333087
13692025-07-18T19:27:02.973Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
13702025-07-18T19:27:02.973Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (33251 bytes)
13712025-07-18T19:27:04.141Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
13722025-07-18T19:27:04.141Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (430254 bytes)
13732025-07-18T19:27:04.762Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 430254 -> 435798
13742025-07-18T19:27:05.835Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
13752025-07-18T19:27:05.835Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (31434 bytes)
13762025-07-18T19:27:07.002Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
13772025-07-18T19:27:07.002Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (2244987 bytes)
13782025-07-18T19:27:08.624Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 2244987 -> 2277810
13792025-07-18T19:27:09.698Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
13802025-07-18T19:27:09.698Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (341761 bytes)
13812025-07-18T19:27:11.246Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
13822025-07-18T19:27:11.246Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (5469927 bytes)
13832025-07-18T19:27:13.942Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 5469927 -> 5633953
13842025-07-18T19:27:15.015Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
13852025-07-18T19:27:15.015Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (927561 bytes)
13862025-07-18T19:27:16.994Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
13872025-07-18T19:27:16.994Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
13882025-07-18T19:27:18.068Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
13892025-07-18T19:27:18.068Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (3337 bytes)
13902025-07-18T19:27:19.166Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
13912025-07-18T19:27:19.166Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (400440 bytes)
13922025-07-18T19:27:19.782Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 400440 -> 416347
13932025-07-18T19:27:20.855Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
13942025-07-18T19:27:20.855Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (86718 bytes)
13952025-07-18T19:27:22.112Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
13962025-07-18T19:27:22.112Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (13553 bytes)
13972025-07-18T19:27:22.185Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 13553 -> 14138
13982025-07-18T19:27:23.260Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
13992025-07-18T19:27:23.260Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (835 bytes)
14002025-07-18T19:27:24.359Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
14012025-07-18T19:27:24.359Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
14022025-07-18T19:27:25.432Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
14032025-07-18T19:27:25.432Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (3847 bytes)
14042025-07-18T19:27:26.530Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
14052025-07-18T19:27:26.553Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14062025-07-18T19:27:27.603Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
14072025-07-18T19:27:27.603Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2342 bytes)
14082025-07-18T19:27:28.701Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log.0
14092025-07-18T19:27:28.701Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-cockroach-admin:default.log (11948 bytes)
14102025-07-18T19:27:29.822Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-cockroach-admin:default.log
14112025-07-18T19:27:29.822Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-cockroach-admin:default.log.0 (2078 bytes)
14122025-07-18T19:27:30.919Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-cockroach-admin:default.log.0
14132025-07-18T19:27:30.919Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
14142025-07-18T19:27:31.994Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-cockroachdb:default.log
14152025-07-18T19:27:31.994Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-cockroachdb:default.log.0 (4326 bytes)
14162025-07-18T19:27:33.090Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-cockroachdb:default.log.0
14172025-07-18T19:27:33.090Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14182025-07-18T19:27:34.165Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-zone-network-setup:default.log
14192025-07-18T19:27:34.166Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2101 bytes)
14202025-07-18T19:27:35.263Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_cockroachdb_d8a35743-b094-4622-aabf-b574dbcb25df/root/var/svc/log/oxide-zone-network-setup:default.log.0
14212025-07-18T19:27:35.263Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_87453d0b-6d7c-4456-aa50-91489abf8355/root/var/svc/log/oxide-crucible-agent:default.log (12967 bytes)
14222025-07-18T19:27:36.384Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_87453d0b-6d7c-4456-aa50-91489abf8355/root/var/svc/log/oxide-crucible-agent:default.log
14232025-07-18T19:27:36.384Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_87453d0b-6d7c-4456-aa50-91489abf8355/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14242025-07-18T19:27:37.487Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_87453d0b-6d7c-4456-aa50-91489abf8355/root/var/svc/log/oxide-crucible-downstairs:default.log
14252025-07-18T19:27:37.487Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_87453d0b-6d7c-4456-aa50-91489abf8355/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f5732ed-ae16-42a4-bbae-735d3e78953d.log (3127 bytes)
14262025-07-18T19:27:38.581Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_87453d0b-6d7c-4456-aa50-91489abf8355/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f5732ed-ae16-42a4-bbae-735d3e78953d.log
14272025-07-18T19:27:38.581Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_87453d0b-6d7c-4456-aa50-91489abf8355/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
14282025-07-18T19:27:39.679Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_87453d0b-6d7c-4456-aa50-91489abf8355/root/var/svc/log/oxide-zone-network-setup:default.log
14292025-07-18T19:27:39.704Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_pantry_17ea50f2-b45a-4e94-b2d4-401f9dd8e196/root/var/svc/log/oxide-crucible-pantry:default.log (922670 bytes)
14302025-07-18T19:27:40.629Zupload warning: file "/pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_pantry_17ea50f2-b45a-4e94-b2d4-401f9dd8e196/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 922670 -> 929366
14312025-07-18T19:27:41.703Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_pantry_17ea50f2-b45a-4e94-b2d4-401f9dd8e196/root/var/svc/log/oxide-crucible-pantry:default.log
14322025-07-18T19:27:41.703Zuploading: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_pantry_17ea50f2-b45a-4e94-b2d4-401f9dd8e196/root/var/svc/log/oxide-zone-network-setup:default.log (2136 bytes)
14332025-07-18T19:27:42.803Zuploaded: /pool/ext/1679f4a1-f74d-466c-993c-53dc4e8a3e2d/crypt/zone/oxz_crucible_pantry_17ea50f2-b45a-4e94-b2d4-401f9dd8e196/root/var/svc/log/oxide-zone-network-setup:default.log
14342025-07-18T19:27:42.827Zuploading: /pool/ext/1e7d570d-3d03-40ee-9daa-ae06d6108b26/crypt/zone/oxz_crucible_a7842c0b-8a46-4319-8207-b03f594da8c3/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
14352025-07-18T19:27:43.897Zuploaded: /pool/ext/1e7d570d-3d03-40ee-9daa-ae06d6108b26/crypt/zone/oxz_crucible_a7842c0b-8a46-4319-8207-b03f594da8c3/root/var/svc/log/oxide-crucible-agent:default.log
14362025-07-18T19:27:43.897Zuploading: /pool/ext/1e7d570d-3d03-40ee-9daa-ae06d6108b26/crypt/zone/oxz_crucible_a7842c0b-8a46-4319-8207-b03f594da8c3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14372025-07-18T19:27:44.993Zuploaded: /pool/ext/1e7d570d-3d03-40ee-9daa-ae06d6108b26/crypt/zone/oxz_crucible_a7842c0b-8a46-4319-8207-b03f594da8c3/root/var/svc/log/oxide-crucible-downstairs:default.log
14382025-07-18T19:27:44.993Zuploading: /pool/ext/1e7d570d-3d03-40ee-9daa-ae06d6108b26/crypt/zone/oxz_crucible_a7842c0b-8a46-4319-8207-b03f594da8c3/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
14392025-07-18T19:27:46.088Zuploaded: /pool/ext/1e7d570d-3d03-40ee-9daa-ae06d6108b26/crypt/zone/oxz_crucible_a7842c0b-8a46-4319-8207-b03f594da8c3/root/var/svc/log/oxide-zone-network-setup:default.log
14402025-07-18T19:27:46.088Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-cockroach-admin:default.log (11948 bytes)
14412025-07-18T19:27:47.205Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-cockroach-admin:default.log
14422025-07-18T19:27:47.206Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-cockroach-admin:default.log.0 (2076 bytes)
14432025-07-18T19:27:48.302Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-cockroach-admin:default.log.0
14442025-07-18T19:27:48.302Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
14452025-07-18T19:27:49.373Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-cockroachdb:default.log
14462025-07-18T19:27:49.374Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-cockroachdb:default.log.0 (4325 bytes)
14472025-07-18T19:27:50.474Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-cockroachdb:default.log.0
14482025-07-18T19:27:50.474Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14492025-07-18T19:27:51.546Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-zone-network-setup:default.log
14502025-07-18T19:27:51.570Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2101 bytes)
14512025-07-18T19:27:52.643Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_cockroachdb_77579738-b8bd-4993-8dd4-fc94ae536abb/root/var/svc/log/oxide-zone-network-setup:default.log.0
14522025-07-18T19:27:52.643Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_crucible_76825c61-fe9e-408e-aa9e-df29e07275f1/root/var/svc/log/oxide-crucible-agent:default.log (12510 bytes)
14532025-07-18T19:27:53.760Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_crucible_76825c61-fe9e-408e-aa9e-df29e07275f1/root/var/svc/log/oxide-crucible-agent:default.log
14542025-07-18T19:27:53.785Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_crucible_76825c61-fe9e-408e-aa9e-df29e07275f1/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14552025-07-18T19:27:54.858Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_crucible_76825c61-fe9e-408e-aa9e-df29e07275f1/root/var/svc/log/oxide-crucible-downstairs:default.log
14562025-07-18T19:27:54.858Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_crucible_76825c61-fe9e-408e-aa9e-df29e07275f1/root/var/svc/log/oxide-crucible-downstairs:downstairs-9cf6d216-6216-462c-8cfd-e32e9f6666f1.log (5973 bytes)
14572025-07-18T19:27:55.954Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_crucible_76825c61-fe9e-408e-aa9e-df29e07275f1/root/var/svc/log/oxide-crucible-downstairs:downstairs-9cf6d216-6216-462c-8cfd-e32e9f6666f1.log
14582025-07-18T19:27:55.978Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_crucible_76825c61-fe9e-408e-aa9e-df29e07275f1/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
14592025-07-18T19:27:57.046Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_crucible_76825c61-fe9e-408e-aa9e-df29e07275f1/root/var/svc/log/oxide-zone-network-setup:default.log
14602025-07-18T19:27:57.047Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-internal_dns:default.log (308880 bytes)
14612025-07-18T19:27:57.272Zupload warning: file "/pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 308880 -> 333094
14622025-07-18T19:27:58.343Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-internal_dns:default.log
14632025-07-18T19:27:58.371Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-internal_dns:default.log.0 (428649 bytes)
14642025-07-18T19:27:59.621Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-internal_dns:default.log.0
14652025-07-18T19:27:59.621Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14662025-07-18T19:28:00.692Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-zone-network-setup:default.log
14672025-07-18T19:28:00.692Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2093 bytes)
14682025-07-18T19:28:01.788Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_internal_dns_4a0db33f-007b-4a73-af82-eb6c0e52c6eb/root/var/svc/log/oxide-zone-network-setup:default.log.0
14692025-07-18T19:28:01.788Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_nexus_4627777a-3582-477b-a211-43f686d83b54/root/var/svc/log/oxide-nexus:default.log (6011445 bytes)
14702025-07-18T19:28:02.872Zupload warning: file "/pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_nexus_4627777a-3582-477b-a211-43f686d83b54/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 6011445 -> 6478437
14712025-07-18T19:28:03.944Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_nexus_4627777a-3582-477b-a211-43f686d83b54/root/var/svc/log/oxide-nexus:default.log
14722025-07-18T19:28:03.944Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_nexus_4627777a-3582-477b-a211-43f686d83b54/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
14732025-07-18T19:28:05.039Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_nexus_4627777a-3582-477b-a211-43f686d83b54/root/var/svc/log/oxide-opte-interface-setup:default.log
14742025-07-18T19:28:05.039Zuploading: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_nexus_4627777a-3582-477b-a211-43f686d83b54/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
14752025-07-18T19:28:06.133Zuploaded: /pool/ext/3ab4a452-84a6-46f6-80a9-f6196c8fe34e/crypt/zone/oxz_nexus_4627777a-3582-477b-a211-43f686d83b54/root/var/svc/log/oxide-zone-network-setup:default.log
14762025-07-18T19:28:06.133Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_clickhouse_526387f2-9782-406e-bf21-ecee932ce885/root/var/svc/log/oxide-clickhouse-admin-single:default.log (937 bytes)
14772025-07-18T19:28:07.228Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_clickhouse_526387f2-9782-406e-bf21-ecee932ce885/root/var/svc/log/oxide-clickhouse-admin-single:default.log
14782025-07-18T19:28:07.228Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_clickhouse_526387f2-9782-406e-bf21-ecee932ce885/root/var/svc/log/oxide-clickhouse:default.log (3342042 bytes)
14792025-07-18T19:28:08.859Zupload warning: file "/pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_clickhouse_526387f2-9782-406e-bf21-ecee932ce885/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 3342042 -> 3719652
14802025-07-18T19:28:09.929Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_clickhouse_526387f2-9782-406e-bf21-ecee932ce885/root/var/svc/log/oxide-clickhouse:default.log
14812025-07-18T19:28:09.929Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_clickhouse_526387f2-9782-406e-bf21-ecee932ce885/root/var/svc/log/oxide-zone-network-setup:default.log (2097 bytes)
14822025-07-18T19:28:11.025Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_clickhouse_526387f2-9782-406e-bf21-ecee932ce885/root/var/svc/log/oxide-zone-network-setup:default.log
14832025-07-18T19:28:11.025Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-cockroach-admin:default.log (11951 bytes)
14842025-07-18T19:28:12.140Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-cockroach-admin:default.log
14852025-07-18T19:28:12.140Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-cockroach-admin:default.log.0 (2078 bytes)
14862025-07-18T19:28:13.234Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-cockroach-admin:default.log.0
14872025-07-18T19:28:13.234Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
14882025-07-18T19:28:14.308Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-cockroachdb:default.log
14892025-07-18T19:28:14.308Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-cockroachdb:default.log.0 (4324 bytes)
14902025-07-18T19:28:15.405Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-cockroachdb:default.log.0
14912025-07-18T19:28:15.405Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14922025-07-18T19:28:16.475Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-zone-network-setup:default.log
14932025-07-18T19:28:16.475Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2101 bytes)
14942025-07-18T19:28:17.570Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_cockroachdb_c8856f82-601a-4bb9-98df-3b8caeac8dd3/root/var/svc/log/oxide-zone-network-setup:default.log.0
14952025-07-18T19:28:17.570Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_crucible_47df98b7-98b7-4f60-a595-83887b4ca845/root/var/svc/log/oxide-crucible-agent:default.log (12506 bytes)
14962025-07-18T19:28:18.688Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_crucible_47df98b7-98b7-4f60-a595-83887b4ca845/root/var/svc/log/oxide-crucible-agent:default.log
14972025-07-18T19:28:18.688Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_crucible_47df98b7-98b7-4f60-a595-83887b4ca845/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14982025-07-18T19:28:19.780Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_crucible_47df98b7-98b7-4f60-a595-83887b4ca845/root/var/svc/log/oxide-crucible-downstairs:default.log
14992025-07-18T19:28:19.780Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_crucible_47df98b7-98b7-4f60-a595-83887b4ca845/root/var/svc/log/oxide-crucible-downstairs:downstairs-dfad04d2-afef-45e1-8f3d-76c383727fef.log (5967 bytes)
15002025-07-18T19:28:20.877Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_crucible_47df98b7-98b7-4f60-a595-83887b4ca845/root/var/svc/log/oxide-crucible-downstairs:downstairs-dfad04d2-afef-45e1-8f3d-76c383727fef.log
15012025-07-18T19:28:20.877Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_crucible_47df98b7-98b7-4f60-a595-83887b4ca845/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
15022025-07-18T19:28:21.971Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_crucible_47df98b7-98b7-4f60-a595-83887b4ca845/root/var/svc/log/oxide-zone-network-setup:default.log
15032025-07-18T19:28:21.996Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_external_dns_6b6b4565-3ff7-442d-b070-dcaae5f9fbe5/root/var/svc/log/oxide-external_dns:default.log (45743 bytes)
15042025-07-18T19:28:22.131Zupload warning: file "/pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_external_dns_6b6b4565-3ff7-442d-b070-dcaae5f9fbe5/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 45743 -> 53285
15052025-07-18T19:28:23.204Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_external_dns_6b6b4565-3ff7-442d-b070-dcaae5f9fbe5/root/var/svc/log/oxide-external_dns:default.log
15062025-07-18T19:28:23.204Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_external_dns_6b6b4565-3ff7-442d-b070-dcaae5f9fbe5/root/var/svc/log/oxide-opte-interface-setup:default.log (1155 bytes)
15072025-07-18T19:28:24.300Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_external_dns_6b6b4565-3ff7-442d-b070-dcaae5f9fbe5/root/var/svc/log/oxide-opte-interface-setup:default.log
15082025-07-18T19:28:24.300Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_external_dns_6b6b4565-3ff7-442d-b070-dcaae5f9fbe5/root/var/svc/log/oxide-zone-network-setup:default.log (2112 bytes)
15092025-07-18T19:28:25.399Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_external_dns_6b6b4565-3ff7-442d-b070-dcaae5f9fbe5/root/var/svc/log/oxide-zone-network-setup:default.log
15102025-07-18T19:28:25.399Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-internal_dns:default.log (308887 bytes)
15112025-07-18T19:28:26.066Zupload warning: file "/pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 308887 -> 345620
15122025-07-18T19:28:27.140Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-internal_dns:default.log
15132025-07-18T19:28:27.140Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-internal_dns:default.log.0 (428644 bytes)
15142025-07-18T19:28:28.782Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-internal_dns:default.log.0
15152025-07-18T19:28:28.782Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15162025-07-18T19:28:29.854Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-zone-network-setup:default.log
15172025-07-18T19:28:29.854Zuploading: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
15182025-07-18T19:28:30.949Zuploaded: /pool/ext/3fd3a792-884d-4bd2-ab43-8b905c2f9aba/crypt/zone/oxz_internal_dns_03a1cd24-7a71-42e9-b13c-6d10e0447748/root/var/svc/log/oxide-zone-network-setup:default.log.0
15192025-07-18T19:28:30.975Zuploading: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-agent:default.log (24205 bytes)
15202025-07-18T19:28:32.090Zuploaded: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-agent:default.log
15212025-07-18T19:28:32.090Zuploading: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15222025-07-18T19:28:33.188Zuploaded: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-downstairs:default.log
15232025-07-18T19:28:33.188Zuploading: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-downstairs:downstairs-424b19ac-5a97-47eb-8e06-7a4e643f3a3b.log (6079 bytes)
15242025-07-18T19:28:34.284Zuploaded: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-downstairs:downstairs-424b19ac-5a97-47eb-8e06-7a4e643f3a3b.log
15252025-07-18T19:28:34.309Zuploading: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-downstairs:downstairs-5103b90f-8073-4895-b244-ad527dca24d4.log (3008 bytes)
15262025-07-18T19:28:35.384Zuploaded: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-downstairs:downstairs-5103b90f-8073-4895-b244-ad527dca24d4.log
15272025-07-18T19:28:35.384Zuploading: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-downstairs:snapshot-424b19ac-5a97-47eb-8e06-7a4e643f3a3b-116a239b-954f-4639-80ac-bb95bc129003.log (5652 bytes)
15282025-07-18T19:28:36.479Zuploaded: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-crucible-downstairs:snapshot-424b19ac-5a97-47eb-8e06-7a4e643f3a3b-116a239b-954f-4639-80ac-bb95bc129003.log
15292025-07-18T19:28:36.504Zuploading: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
15302025-07-18T19:28:37.576Zuploaded: /pool/ext/4499d734-b205-4772-85c2-355cd1af612e/crypt/zone/oxz_crucible_a1ba5f64-90a0-4fde-bbf2-11dbd20963d0/root/var/svc/log/oxide-zone-network-setup:default.log
15312025-07-18T19:28:37.576Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-crucible-agent:default.log (18008 bytes)
15322025-07-18T19:28:38.715Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-crucible-agent:default.log
15332025-07-18T19:28:38.715Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15342025-07-18T19:28:39.811Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-crucible-downstairs:default.log
15352025-07-18T19:28:39.811Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-crucible-downstairs:downstairs-3e77c582-6607-416d-904d-d725fc796064.log (6078 bytes)
15362025-07-18T19:28:40.906Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-crucible-downstairs:downstairs-3e77c582-6607-416d-904d-d725fc796064.log
15372025-07-18T19:28:40.906Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-crucible-downstairs:snapshot-3e77c582-6607-416d-904d-d725fc796064-116a239b-954f-4639-80ac-bb95bc129003.log (5654 bytes)
15382025-07-18T19:28:42.002Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-crucible-downstairs:snapshot-3e77c582-6607-416d-904d-d725fc796064-116a239b-954f-4639-80ac-bb95bc129003.log
15392025-07-18T19:28:42.002Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
15402025-07-18T19:28:43.099Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_crucible_4d7bb1db-68b3-4ac9-9b25-f910f1780a34/root/var/svc/log/oxide-zone-network-setup:default.log
15412025-07-18T19:28:43.099Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_nexus_33fb85a6-524f-4ef3-b2bc-002d659a2026/root/var/svc/log/oxide-nexus:default.log (42863288 bytes)
15422025-07-18T19:28:51.045Zupload warning: file "/pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_nexus_33fb85a6-524f-4ef3-b2bc-002d659a2026/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 42863288 -> 43990971
15432025-07-18T19:28:52.121Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_nexus_33fb85a6-524f-4ef3-b2bc-002d659a2026/root/var/svc/log/oxide-nexus:default.log
15442025-07-18T19:28:52.121Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_nexus_33fb85a6-524f-4ef3-b2bc-002d659a2026/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
15452025-07-18T19:28:53.218Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_nexus_33fb85a6-524f-4ef3-b2bc-002d659a2026/root/var/svc/log/oxide-opte-interface-setup:default.log
15462025-07-18T19:28:53.243Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_nexus_33fb85a6-524f-4ef3-b2bc-002d659a2026/root/var/svc/log/oxide-zone-network-setup:default.log (2056 bytes)
15472025-07-18T19:28:54.317Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_nexus_33fb85a6-524f-4ef3-b2bc-002d659a2026/root/var/svc/log/oxide-zone-network-setup:default.log
15482025-07-18T19:28:54.343Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-chrony-setup:default.log (0 bytes)
15492025-07-18T19:28:55.392Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-chrony-setup:default.log
15502025-07-18T19:28:55.392Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-chrony-setup:default.log.0 (15276 bytes)
15512025-07-18T19:28:56.510Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-chrony-setup:default.log.0
15522025-07-18T19:28:56.510Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-ntp-admin:default.log (0 bytes)
15532025-07-18T19:28:57.581Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-ntp-admin:default.log
15542025-07-18T19:28:57.581Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-ntp-admin:default.log.0 (21121 bytes)
15552025-07-18T19:28:58.722Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-ntp-admin:default.log.0
15562025-07-18T19:28:58.722Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-ntp:default.log (1288 bytes)
15572025-07-18T19:28:59.816Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-ntp:default.log
15582025-07-18T19:28:59.817Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-ntp:default.log.0 (1838 bytes)
15592025-07-18T19:29:00.915Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-ntp:default.log.0
15602025-07-18T19:29:00.915Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
15612025-07-18T19:29:01.986Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-opte-interface-setup:default.log
15622025-07-18T19:29:01.986Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1125 bytes)
15632025-07-18T19:29:03.087Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-opte-interface-setup:default.log.0
15642025-07-18T19:29:03.087Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15652025-07-18T19:29:04.164Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-zone-network-setup:default.log
15662025-07-18T19:29:04.164Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2032 bytes)
15672025-07-18T19:29:05.261Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/svc/log/oxide-zone-network-setup:default.log.0
15682025-07-18T19:29:05.261Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-cockroach-admin:default.log (11948 bytes)
15692025-07-18T19:29:06.379Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-cockroach-admin:default.log
15702025-07-18T19:29:06.379Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-cockroach-admin:default.log.0 (2077 bytes)
15712025-07-18T19:29:07.473Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-cockroach-admin:default.log.0
15722025-07-18T19:29:07.473Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
15732025-07-18T19:29:08.545Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-cockroachdb:default.log
15742025-07-18T19:29:08.570Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-cockroachdb:default.log.0 (4324 bytes)
15752025-07-18T19:29:09.643Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-cockroachdb:default.log.0
15762025-07-18T19:29:09.643Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15772025-07-18T19:29:10.713Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-zone-network-setup:default.log
15782025-07-18T19:29:10.713Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2101 bytes)
15792025-07-18T19:29:11.809Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_cockroachdb_46e7252f-fdc5-43aa-8ce6-4132dffee41e/root/var/svc/log/oxide-zone-network-setup:default.log.0
15802025-07-18T19:29:11.834Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_a200367d-12e4-4856-a919-86ae63144350/root/var/svc/log/oxide-crucible-agent:default.log (12504 bytes)
15812025-07-18T19:29:12.932Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_a200367d-12e4-4856-a919-86ae63144350/root/var/svc/log/oxide-crucible-agent:default.log
15822025-07-18T19:29:13.000Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_a200367d-12e4-4856-a919-86ae63144350/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15832025-07-18T19:29:14.068Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_a200367d-12e4-4856-a919-86ae63144350/root/var/svc/log/oxide-crucible-downstairs:default.log
15842025-07-18T19:29:14.068Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_a200367d-12e4-4856-a919-86ae63144350/root/var/svc/log/oxide-crucible-downstairs:downstairs-d32acd4b-8774-460a-8ac2-7fb4a2fbca2f.log (3127 bytes)
15852025-07-18T19:29:15.165Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_a200367d-12e4-4856-a919-86ae63144350/root/var/svc/log/oxide-crucible-downstairs:downstairs-d32acd4b-8774-460a-8ac2-7fb4a2fbca2f.log
15862025-07-18T19:29:15.165Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_a200367d-12e4-4856-a919-86ae63144350/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
15872025-07-18T19:29:16.263Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_a200367d-12e4-4856-a919-86ae63144350/root/var/svc/log/oxide-zone-network-setup:default.log
15882025-07-18T19:29:16.264Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_pantry_a7444400-08f2-412c-a4a3-aa2bf9da50de/root/var/svc/log/oxide-crucible-pantry:default.log (162050 bytes)
15892025-07-18T19:29:16.618Zupload warning: file "/pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_pantry_a7444400-08f2-412c-a4a3-aa2bf9da50de/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 162050 -> 195213
15902025-07-18T19:29:17.689Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_pantry_a7444400-08f2-412c-a4a3-aa2bf9da50de/root/var/svc/log/oxide-crucible-pantry:default.log
15912025-07-18T19:29:17.689Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_pantry_a7444400-08f2-412c-a4a3-aa2bf9da50de/root/var/svc/log/oxide-zone-network-setup:default.log (2139 bytes)
15922025-07-18T19:29:18.785Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_crucible_pantry_a7444400-08f2-412c-a4a3-aa2bf9da50de/root/var/svc/log/oxide-zone-network-setup:default.log
15932025-07-18T19:29:18.785Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_nexus_8d963aca-f065-4d8f-a1ae-e4fe8d4ec172/root/var/svc/log/oxide-nexus:default.log (6097565 bytes)
15942025-07-18T19:29:21.780Zupload warning: file "/pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_nexus_8d963aca-f065-4d8f-a1ae-e4fe8d4ec172/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 6097565 -> 7231015
15952025-07-18T19:29:22.852Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_nexus_8d963aca-f065-4d8f-a1ae-e4fe8d4ec172/root/var/svc/log/oxide-nexus:default.log
15962025-07-18T19:29:22.852Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_nexus_8d963aca-f065-4d8f-a1ae-e4fe8d4ec172/root/var/svc/log/oxide-opte-interface-setup:default.log (1133 bytes)
15972025-07-18T19:29:23.947Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_nexus_8d963aca-f065-4d8f-a1ae-e4fe8d4ec172/root/var/svc/log/oxide-opte-interface-setup:default.log
15982025-07-18T19:29:23.947Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_nexus_8d963aca-f065-4d8f-a1ae-e4fe8d4ec172/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
15992025-07-18T19:29:25.043Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_nexus_8d963aca-f065-4d8f-a1ae-e4fe8d4ec172/root/var/svc/log/oxide-zone-network-setup:default.log
16002025-07-18T19:29:25.043Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_oximeter_f5f9abeb-3493-4d9f-a286-6eb2d7b4cefc/root/var/svc/log/oxide-oximeter:default.log (3772116 bytes)
16012025-07-18T19:29:27.423Zupload warning: file "/pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_oximeter_f5f9abeb-3493-4d9f-a286-6eb2d7b4cefc/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 3772116 -> 4646069
16022025-07-18T19:29:28.498Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_oximeter_f5f9abeb-3493-4d9f-a286-6eb2d7b4cefc/root/var/svc/log/oxide-oximeter:default.log
16032025-07-18T19:29:28.498Zuploading: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_oximeter_f5f9abeb-3493-4d9f-a286-6eb2d7b4cefc/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
16042025-07-18T19:29:29.595Zuploaded: /pool/ext/b138564a-bfcc-4cdb-a4ac-30965a1ed56c/crypt/zone/oxz_oximeter_f5f9abeb-3493-4d9f-a286-6eb2d7b4cefc/root/var/svc/log/oxide-zone-network-setup:default.log
16052025-07-18T19:29:29.623Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-cockroach-admin:default.log (11950 bytes)
16062025-07-18T19:29:30.718Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-cockroach-admin:default.log
16072025-07-18T19:29:30.719Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-cockroach-admin:default.log.0 (3887 bytes)
16082025-07-18T19:29:31.816Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-cockroach-admin:default.log.0
16092025-07-18T19:29:31.817Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
16102025-07-18T19:29:32.889Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-cockroachdb:default.log
16112025-07-18T19:29:32.889Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-cockroachdb:default.log.0 (4299 bytes)
16122025-07-18T19:29:33.989Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-cockroachdb:default.log.0
16132025-07-18T19:29:33.989Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16142025-07-18T19:29:35.062Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-zone-network-setup:default.log
16152025-07-18T19:29:35.062Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2101 bytes)
16162025-07-18T19:29:36.157Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_cockroachdb_3627d1f5-94e8-4592-811f-5582d7b551a3/root/var/svc/log/oxide-zone-network-setup:default.log.0
16172025-07-18T19:29:36.157Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-agent:default.log (34415 bytes)
16182025-07-18T19:29:37.319Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-agent:default.log
16192025-07-18T19:29:37.319Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16202025-07-18T19:29:38.417Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:default.log
16212025-07-18T19:29:38.417Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:downstairs-b188987f-9146-4344-8372-56a2ec1e4352.log (5971 bytes)
16222025-07-18T19:29:39.516Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:downstairs-b188987f-9146-4344-8372-56a2ec1e4352.log
16232025-07-18T19:29:39.516Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:downstairs-c9a388be-2ad2-48f3-9bc9-1d62075d5025.log (3009 bytes)
16242025-07-18T19:29:40.628Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:downstairs-c9a388be-2ad2-48f3-9bc9-1d62075d5025.log
16252025-07-18T19:29:40.628Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:downstairs-f19df003-f2d8-4868-87c4-037da4de73f8.log (6078 bytes)
16262025-07-18T19:29:41.726Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:downstairs-f19df003-f2d8-4868-87c4-037da4de73f8.log
16272025-07-18T19:29:41.750Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:snapshot-f19df003-f2d8-4868-87c4-037da4de73f8-116a239b-954f-4639-80ac-bb95bc129003.log (5655 bytes)
16282025-07-18T19:29:42.823Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-crucible-downstairs:snapshot-f19df003-f2d8-4868-87c4-037da4de73f8-116a239b-954f-4639-80ac-bb95bc129003.log
16292025-07-18T19:29:42.847Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
16302025-07-18T19:29:43.919Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_crucible_043e1bb4-0b83-4e03-befc-d664846db10b/root/var/svc/log/oxide-zone-network-setup:default.log
16312025-07-18T19:29:43.943Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_external_dns_1da91d8a-a9cc-4214-a44d-d851f1da0330/root/var/svc/log/oxide-external_dns:default.log (45746 bytes)
16322025-07-18T19:29:44.077Zupload warning: file "/pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_external_dns_1da91d8a-a9cc-4214-a44d-d851f1da0330/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 45746 -> 57060
16332025-07-18T19:29:45.148Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_external_dns_1da91d8a-a9cc-4214-a44d-d851f1da0330/root/var/svc/log/oxide-external_dns:default.log
16342025-07-18T19:29:45.148Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_external_dns_1da91d8a-a9cc-4214-a44d-d851f1da0330/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
16352025-07-18T19:29:46.244Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_external_dns_1da91d8a-a9cc-4214-a44d-d851f1da0330/root/var/svc/log/oxide-opte-interface-setup:default.log
16362025-07-18T19:29:46.244Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_external_dns_1da91d8a-a9cc-4214-a44d-d851f1da0330/root/var/svc/log/oxide-zone-network-setup:default.log (2113 bytes)
16372025-07-18T19:29:47.356Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_external_dns_1da91d8a-a9cc-4214-a44d-d851f1da0330/root/var/svc/log/oxide-zone-network-setup:default.log
16382025-07-18T19:29:47.356Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-internal_dns:default.log (308873 bytes)
16392025-07-18T19:29:47.894Zupload warning: file "/pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 308873 -> 377886
16402025-07-18T19:29:48.966Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-internal_dns:default.log
16412025-07-18T19:29:48.966Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-internal_dns:default.log.0 (428650 bytes)
16422025-07-18T19:29:50.600Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-internal_dns:default.log.0
16432025-07-18T19:29:50.600Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16442025-07-18T19:29:51.672Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-zone-network-setup:default.log
16452025-07-18T19:29:51.672Zuploading: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
16462025-07-18T19:29:52.769Zuploaded: /pool/ext/d434fc66-9378-47a1-bac3-8eaeb65e5efa/crypt/zone/oxz_internal_dns_a6b8dac4-4672-4450-a996-3354285baef8/root/var/svc/log/oxide-zone-network-setup:default.log.0
16472025-07-18T19:29:52.769Zuploading: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-crucible-agent:default.log (19001 bytes)
16482025-07-18T19:29:53.911Zuploaded: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-crucible-agent:default.log
16492025-07-18T19:29:53.935Zuploading: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16502025-07-18T19:29:55.020Zuploaded: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-crucible-downstairs:default.log
16512025-07-18T19:29:55.021Zuploading: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-crucible-downstairs:downstairs-50c056ec-ec6a-4f84-8aed-275cc273a967.log (3127 bytes)
16522025-07-18T19:29:56.119Zuploaded: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-crucible-downstairs:downstairs-50c056ec-ec6a-4f84-8aed-275cc273a967.log
16532025-07-18T19:29:56.119Zuploading: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-crucible-downstairs:downstairs-b14024bd-8cc7-43f3-bf23-e0e1474ec14a.log (3007 bytes)
16542025-07-18T19:29:57.215Zuploaded: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-crucible-downstairs:downstairs-b14024bd-8cc7-43f3-bf23-e0e1474ec14a.log
16552025-07-18T19:29:57.240Zuploading: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
16562025-07-18T19:29:58.314Zuploaded: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_589be8a6-8866-41c4-9d0a-3272be846ee1/root/var/svc/log/oxide-zone-network-setup:default.log
16572025-07-18T19:29:58.314Zuploading: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_pantry_33849732-57ba-465e-90e3-0235d508f07d/root/var/svc/log/oxide-crucible-pantry:default.log (161318 bytes)
16582025-07-18T19:29:58.675Zupload warning: file "/pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_pantry_33849732-57ba-465e-90e3-0235d508f07d/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 161318 -> 201072
16592025-07-18T19:29:59.763Zuploaded: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_pantry_33849732-57ba-465e-90e3-0235d508f07d/root/var/svc/log/oxide-crucible-pantry:default.log
16602025-07-18T19:29:59.763Zuploading: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_pantry_33849732-57ba-465e-90e3-0235d508f07d/root/var/svc/log/oxide-zone-network-setup:default.log (2135 bytes)
16612025-07-18T19:30:00.842Zuploaded: /pool/ext/ec33aee0-8f40-4df3-85e3-896c3de94650/crypt/zone/oxz_crucible_pantry_33849732-57ba-465e-90e3-0235d508f07d/root/var/svc/log/oxide-zone-network-setup:default.log
16622025-07-18T19:30:00.842Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/measurements.log (615639 bytes)
16632025-07-18T19:30:01.732Zupload warning: file "/pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/measurements.log" changed size mid upload: 615639 -> 764846
16642025-07-18T19:30:02.809Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/measurements.log
16652025-07-18T19:30:02.809Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/statistics.log (477360 bytes)
16662025-07-18T19:30:03.547Zupload warning: file "/pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/statistics.log" changed size mid upload: 477360 -> 595530
16672025-07-18T19:30:04.623Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/statistics.log
16682025-07-18T19:30:04.624Zuploading: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/tracking.log (75127 bytes)
16692025-07-18T19:30:04.824Zupload warning: file "/pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/tracking.log" changed size mid upload: 75127 -> 91759
16702025-07-18T19:30:05.896Zuploaded: /pool/ext/8e508f4c-2811-49cd-ab16-1715133cdbf4/crypt/zone/oxz_ntp_d9c9637e-f343-4f0a-8594-86277dfcc026/root/var/log/chrony/tracking.log