01KAH14VWF19KRFTMP1FSVVQDX: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-*.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
        "/tmp/kstat/*.kstat",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.37",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01KAH15GHZD9PZB2TQ74E6EHHH

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12025-11-20T17:04:28.749Zjob dependencies complete; ready to run (waiting for 42 m 19 s)
22025-11-20T17:07:08.483Zjob assigned to worker 01KAH3K1X6RBV7G8KB9MBH5EFF [factory lab, buskin/17666] (queued for 2 m 39 s)
32025-11-20T17:07:08.486Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42025-11-20T17:07:08.534Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52025-11-20T17:07:08.568Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62025-11-20T17:07:08.601Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72025-11-20T17:07:08.635Zhttp://172.20.0.5:9969/postboot/buskin... ok
82025-11-20T17:07:08.668ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92025-11-20T17:07:08.701Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102025-11-20T17:07:08.735ZOxide Helios Version helios-2.0.23457 64-bit
112025-11-20T17:07:08.768ZConfiguring devices.
122025-11-20T17:07:08.802Z##################################################
132025-11-20T17:07:08.835Z#### ############# ##
142025-11-20T17:07:08.868Z### ### ############ ##
152025-11-20T17:07:08.930Z## ### # ## ### ## Oxide Computer Company ##
162025-11-20T17:07:08.969Z## ## ## ### # ### ##
172025-11-20T17:07:09.002Z## # ### #### #### This Station Under ##
182025-11-20T17:07:09.035Z### ### #### # ### Computer Control ##
192025-11-20T17:07:09.069Z#### #### ### ## ##
202025-11-20T17:07:09.102Z##################################################
212025-11-20T17:07:09.136ZHostname: buskin
222025-11-20T17:07:09.169ZLoading smf(7) service descriptions:
232025-11-20T17:07:09.534Zdownloading input: /input/package/work/package.tar.gz
242025-11-20T17:13:58.750Zdownloaded input: /input/package/work/package.tar.gz
 
252025-11-20T17:13:58.775Zstarting task 0: "setup"
262025-11-20T17:13:58.775Z++ uname -s
272025-11-20T17:13:58.775Z+ kern=SunOS
282025-11-20T17:13:58.775Z+ build_user=build
292025-11-20T17:13:58.775Z+ build_uid=12345
302025-11-20T17:13:58.775Z+ work_dir=/work
312025-11-20T17:13:58.775Z+ input_dir=/input
322025-11-20T17:13:58.775Z+ [[ 0 == 12345 ]]
332025-11-20T17:13:58.775Z+ case "$kern" in
342025-11-20T17:13:58.775Z+ groupadd -g 12345 build
352025-11-20T17:13:58.775Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
362025-11-20T17:14:00.714Z+ zfs create -o mountpoint=/work rpool/work
372025-11-20T17:14:00.738Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
382025-11-20T17:14:00.762Z+ home_fs=zfs
392025-11-20T17:14:00.762Z+ [[ zfs == autofs ]]
402025-11-20T17:14:00.762Z+ mkdir -p /home/build
412025-11-20T17:14:00.763Z+ chown build:build /home/build /work
422025-11-20T17:14:02.745Z+ chmod 0700 /home/build /work
432025-11-20T17:14:02.770Zprocess exited: duration 4052 ms, exit code 0
 
442025-11-20T17:14:02.819Zstarting task 1: "authentication"
452025-11-20T17:14:02.865Zprocess exited: duration 45 ms, exit code 0
 
462025-11-20T17:14:02.916Zstarting task 2: "build"
472025-11-20T17:14:02.941Z+ trap _exit_trap EXIT
482025-11-20T17:14:02.941Z+ OPTE_COMMIT=
492025-11-20T17:14:02.941Z+ [[ x != \x ]]
502025-11-20T17:14:02.941Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
512025-11-20T17:14:03.032Zsecpolicy_fs_linkdir: 0x55 = 0x55
522025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
532025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
542025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+3: 0 = 0xe5
552025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+4: 0 = 0xb8
562025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+5: 0 = 0x1
572025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
582025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
592025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
602025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
612025-11-20T17:14:03.032Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
622025-11-20T17:14:03.057Z+ [[ -d /opt/oxide ]]
632025-11-20T17:14:03.057Z+ pfexec mv /opt/oxide /opt/oxide-underneath
642025-11-20T17:14:03.057Z+ pfexec mkdir /opt/oxide
652025-11-20T17:14:03.057Z+ pfexec mount -F tmpfs -O swap /opt/oxide
662025-11-20T17:14:03.057Z+ [[ -d /opt/oxide-underneath ]]
672025-11-20T17:14:03.057Z+ cd /opt/oxide-underneath
682025-11-20T17:14:03.057Z+ pfexec tar ceEp@/f - .
692025-11-20T17:14:03.057Z+ cd /opt/oxide
702025-11-20T17:14:03.057Z+ pfexec tar xveEp@/f -
712025-11-20T17:14:03.095Zx ., 0 bytes, 0 tape blocks
722025-11-20T17:14:03.095Zx ./opte, 0 bytes, 0 tape blocks
732025-11-20T17:14:03.095Zx ./opte/bin, 0 bytes, 0 tape blocks
742025-11-20T17:14:03.095Zx ./opte/bin/opteadm, 20875880 bytes, 40774 tape blocks
752025-11-20T17:14:03.120Z+ pfexec rm -rf /opt/oxide-underneath
762025-11-20T17:14:03.120Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
772025-11-20T17:14:03.120Z+ pfexec mkdir /opt/oxide/work
782025-11-20T17:14:03.144Z+ pfexec chown build:build /opt/oxide/work
792025-11-20T17:14:03.144Z+ cd /opt/oxide/work
802025-11-20T17:14:03.144Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
812025-11-20T17:14:23.900ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
822025-11-20T17:14:23.900Zx .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks
832025-11-20T17:14:23.900Zx out/target/test, 107 bytes, 1 tape blocks
842025-11-20T17:14:23.900Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
852025-11-20T17:14:23.900Zx package-manifest.toml, 34385 bytes, 68 tape blocks
862025-11-20T17:14:23.900Zx smf/sled-agent/non-gimlet/config.toml, 5158 bytes, 11 tape blocks
872025-11-20T17:14:23.900Zx target/release/omicron-package, 42602440 bytes, 83208 tape blocks
882025-11-20T17:14:23.900Zx target/release/xtask, 12027816 bytes, 23492 tape blocks
892025-11-20T17:14:23.900Zx target/debug/bootstrap, 305233432 bytes, 596160 tape blocks
902025-11-20T17:14:23.900Zx tests/bootstrap-a1752e91d8bf1274, 24207888 bytes, 47282 tape blocks
912025-11-20T17:14:23.900Zx tests/commtest-635471e46e7ef3ca, 24309280 bytes, 47480 tape blocks
922025-11-20T17:14:23.900Zx tests/dhcp_server-db23293cb38ad620, 24207904 bytes, 47282 tape blocks
932025-11-20T17:14:23.900Zx tests/end_to_end_tests-14c0b2efde98dc3b, 351502224 bytes, 686528 tape blocks
942025-11-20T17:14:23.900Zx out/clickhouse.tar.gz, 323925253 bytes, 632667 tape blocks
952025-11-20T17:14:23.900Zx out/clickhouse_keeper.tar.gz, 307189382 bytes, 599980 tape blocks
962025-11-20T17:14:23.900Zx out/clickhouse_server.tar.gz, 323923971 bytes, 632665 tape blocks
972025-11-20T17:14:23.900Zx out/cockroachdb.tar.gz, 169891961 bytes, 331821 tape blocks
982025-11-20T17:14:23.900Zx out/crucible-pantry-zone.tar.gz, 44855839 bytes, 87610 tape blocks
992025-11-20T17:14:23.900Zx out/crucible-utils.tar, 18169344 bytes, 35487 tape blocks
1002025-11-20T17:14:23.900Zx out/crucible-zone.tar.gz, 59333276 bytes, 115886 tape blocks
1012025-11-20T17:14:23.900Zx out/external-dns.tar.gz, 52397503 bytes, 102339 tape blocks
1022025-11-20T17:14:23.900Zx out/internal-dns.tar.gz, 52397104 bytes, 102339 tape blocks
1032025-11-20T17:14:23.900Zx out/mg-ddm-gz.tar, 119918080 bytes, 234215 tape blocks
1042025-11-20T17:14:23.900Zx out/nexus.tar.gz, 195993583 bytes, 382800 tape blocks
1052025-11-20T17:14:23.900Zx out/ntp.tar.gz, 34278107 bytes, 66950 tape blocks
1062025-11-20T17:14:23.900Zx out/omicron-gateway-softnpu.tar.gz, 28267445 bytes, 55210 tape blocks
1072025-11-20T17:14:23.900Zx out/omicron-sled-agent.tar, 157146624 bytes, 306927 tape blocks
1082025-11-20T17:14:23.900Zx out/overlay.tar.gz, 3030 bytes, 6 tape blocks
1092025-11-20T17:14:23.900Zx out/oximeter.tar.gz, 64853896 bytes, 126668 tape blocks
1102025-11-20T17:14:23.900Zx out/oxlog.tar, 4108288 bytes, 8024 tape blocks
1112025-11-20T17:14:23.900Zx out/probe.tar.gz, 3109568 bytes, 6074 tape blocks
1122025-11-20T17:14:23.901Zx out/propolis-server.tar.gz, 75246872 bytes, 146967 tape blocks
1132025-11-20T17:14:23.901Zx out/pumpkind-gz.tar, 27286528 bytes, 53294 tape blocks
1142025-11-20T17:14:23.901Zx out/switch-softnpu.tar.gz, 397296066 bytes, 775969 tape blocks
1152025-11-20T17:14:23.926Z
1162025-11-20T17:14:23.926Zreal 20.748093562
1172025-11-20T17:14:23.927Zuser 18.562143121
1182025-11-20T17:14:23.927Zsys 3.682892035
1192025-11-20T17:14:23.927Ztrap 0.000833285
1202025-11-20T17:14:23.927Ztflt 0.000000000
1212025-11-20T17:14:23.927Zdflt 0.000000000
1222025-11-20T17:14:23.927Zkflt 0.000000000
1232025-11-20T17:14:23.927Zlock 0.000000000
1242025-11-20T17:14:23.927Zslp 18.728636537
1252025-11-20T17:14:23.927Zlat 0.519366695
1262025-11-20T17:14:23.927Zstop 0.000117741
1272025-11-20T17:14:23.927Z+ source .github/buildomat/ci-env.sh
1282025-11-20T17:14:23.927Z++ export CARGO_TERM_COLOR=always
1292025-11-20T17:14:23.927Z++ CARGO_TERM_COLOR=always
1302025-11-20T17:14:23.927Z+ bmat address ls
1312025-11-20T17:14:23.927ZNAME CIDR FIRST LAST COUNT
1322025-11-20T17:14:23.927Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1332025-11-20T17:14:23.928Z++ bmat address ls -f extra -Ho first,last,count
1342025-11-20T17:14:23.928Z+ set -- 10.151.1.164 10.151.1.227 64
1352025-11-20T17:14:23.928Z+ EXTRA_IP_START=10.151.1.164
1362025-11-20T17:14:23.928Z+ EXTRA_IP_END=10.151.1.227
1372025-11-20T17:14:23.928Z+ EXTRA_IP_COUNT=64
1382025-11-20T17:14:23.928Z+ (( EXTRA_IP_COUNT >= 32 ))
1392025-11-20T17:14:23.928Z+ EXTRA_IP_BASE=10.151.1
1402025-11-20T17:14:23.928Z+ EXTRA_IP_FOCTET=164
1412025-11-20T17:14:23.928Z+ EXTRA_IP_LOCTET=227
1422025-11-20T17:14:23.928Z+ SERVICE_IP_POOL_START=10.151.1.164
1432025-11-20T17:14:23.928Z+ SERVICE_IP_POOL_END=10.151.1.173
1442025-11-20T17:14:23.928Z+ DNS_IP1=10.151.1.164
1452025-11-20T17:14:23.928Z+ DNS_IP2=10.151.1.165
1462025-11-20T17:14:23.928Z+ UPLINK_IP=10.151.1.174
1472025-11-20T17:14:23.928Z+ IPPOOL_START=10.151.1.175
1482025-11-20T17:14:23.928Z+ IPPOOL_END=10.151.1.227
1492025-11-20T17:14:23.928Z++ ipadm show-addr -po type,addr
1502025-11-20T17:14:23.928Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1512025-11-20T17:14:23.928Z+ GATEWAY_IP=10.151.1.100
1522025-11-20T17:14:23.928Z+ [[ -n 10.151.1.100 ]]
1532025-11-20T17:14:23.928Z+ ping -s 10.151.1.100 56 1
1542025-11-20T17:14:23.928ZPING 10.151.1.100: 56 data bytes
1552025-11-20T17:14:23.928Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
1562025-11-20T17:14:23.928Z
1572025-11-20T17:14:23.928Z----10.151.1.100 PING Statistics----
1582025-11-20T17:14:23.928Z1 packets transmitted, 1 packets received, 0% packet loss
1592025-11-20T17:14:23.928Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
1602025-11-20T17:14:23.928Z++ arp -an
1612025-11-20T17:14:23.928Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1622025-11-20T17:14:23.928Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1632025-11-20T17:14:23.928Z+ routeadm -e ipv4-forwarding -u
1642025-11-20T17:14:24.027Z+ PXA_START=10.151.1.164
1652025-11-20T17:14:24.027Z+ PXA_END=10.151.1.227
1662025-11-20T17:14:24.027Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1672025-11-20T17:14:24.205Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1682025-11-20T17:14:24.230ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1692025-11-20T17:14:24.297Zcreating virtual hardware
1702025-11-20T17:14:24.322Zcreating /scratch/m2_0.vdev
1712025-11-20T17:14:24.322Zcreating /scratch/m2_1.vdev
1722025-11-20T17:14:24.322Zcreating /scratch/u2_0.vdev
1732025-11-20T17:14:24.322Zcreating /scratch/u2_1.vdev
1742025-11-20T17:14:24.322Zcreating /scratch/u2_2.vdev
1752025-11-20T17:14:24.322Zcreating /scratch/u2_3.vdev
1762025-11-20T17:14:24.322Zcreating /scratch/u2_4.vdev
1772025-11-20T17:14:24.322Zcreating /scratch/u2_5.vdev
1782025-11-20T17:14:24.322Zcreating /scratch/u2_6.vdev
1792025-11-20T17:14:24.322Zcreating /scratch/u2_7.vdev
1802025-11-20T17:14:24.323Zcreating /scratch/u2_8.vdev
1812025-11-20T17:14:24.323ZSimnet net0/sc0_0 exists
1822025-11-20T17:14:24.347ZSimnet net1/sc1_0 exists
1832025-11-20T17:14:24.347ZVnic sc0_1 exists
1842025-11-20T17:14:36.855ZUsing 10.151.1.100 as gateway ip
1852025-11-20T17:14:36.855Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1862025-11-20T17:14:36.855Zconfiguring SoftNPU ARP entry
1872025-11-20T17:14:36.883Zconfiguring SoftNPU proxy ARP
1882025-11-20T17:14:36.933ZSoftNPU state:
1892025-11-20T17:14:36.933Z local v6:
1902025-11-20T17:14:36.933Z local v4:
1912025-11-20T17:14:36.933Z router v6_idx:
1922025-11-20T17:14:36.933Z router v6_routes:
1932025-11-20T17:14:36.933Z router v4_idx:
1942025-11-20T17:14:36.933Z router v4_routes:
1952025-11-20T17:14:36.933Z resolver v4:
1962025-11-20T17:14:36.933Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1972025-11-20T17:14:36.933Z resolver v6:
1982025-11-20T17:14:36.933Z nat v4:
1992025-11-20T17:14:36.933Z nat_v6:
2002025-11-20T17:14:36.934Z port_mac:
2012025-11-20T17:14:36.934Z proxy arp:
2022025-11-20T17:14:36.934Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
2032025-11-20T17:14:36.934Zcreated virtual hardware
2042025-11-20T17:14:36.959Z
2052025-11-20T17:14:36.959Zreal 12.725264426
2062025-11-20T17:14:36.959Zuser 0.624204701
2072025-11-20T17:14:36.959Zsys 3.145093337
2082025-11-20T17:14:36.959Ztrap 0.000069170
2092025-11-20T17:14:36.959Ztflt 0.000073303
2102025-11-20T17:14:36.959Zdflt 0.000484216
2112025-11-20T17:14:36.959Zkflt 0.000010660
2122025-11-20T17:14:36.959Zlock 9:51.363539297
2132025-11-20T17:14:36.959Zslp 38.563111643
2142025-11-20T17:14:36.959Zlat 0.097270875
2152025-11-20T17:14:36.959Zstop 0.390311457
2162025-11-20T17:14:36.959Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2172025-11-20T17:14:36.986Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2182025-11-20T17:14:37.033Z+ diff -u pkg/config.toml~ pkg/config.toml
2192025-11-20T17:14:37.033Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2202025-11-20T17:14:37.033Z+++ pkg/config.toml Thu Nov 20 17:14:37 2025
2212025-11-20T17:14:37.033Z@@ -29,18 +29,18 @@
2222025-11-20T17:14:37.033Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2232025-11-20T17:14:37.033Z # followed by a string that is embedded into their fake serial values.
2242025-11-20T17:14:37.033Z vdevs = [
2252025-11-20T17:14:37.033Z- "m2_0.vdev",
2262025-11-20T17:14:37.033Z- "m2_1.vdev",
2272025-11-20T17:14:37.033Z+ "/scratch/m2_0.vdev",
2282025-11-20T17:14:37.033Z+ "/scratch/m2_1.vdev",
2292025-11-20T17:14:37.033Z
2302025-11-20T17:14:37.033Z- "u2_0.vdev",
2312025-11-20T17:14:37.033Z- "u2_1.vdev",
2322025-11-20T17:14:37.033Z- "u2_2.vdev",
2332025-11-20T17:14:37.033Z- "u2_3.vdev",
2342025-11-20T17:14:37.033Z- "u2_4.vdev",
2352025-11-20T17:14:37.033Z- "u2_5.vdev",
2362025-11-20T17:14:37.033Z- "u2_6.vdev",
2372025-11-20T17:14:37.033Z- "u2_7.vdev",
2382025-11-20T17:14:37.033Z- "u2_8.vdev",
2392025-11-20T17:14:37.033Z+ "/scratch/u2_0.vdev",
2402025-11-20T17:14:37.033Z+ "/scratch/u2_1.vdev",
2412025-11-20T17:14:37.033Z+ "/scratch/u2_2.vdev",
2422025-11-20T17:14:37.034Z+ "/scratch/u2_3.vdev",
2432025-11-20T17:14:37.034Z+ "/scratch/u2_4.vdev",
2442025-11-20T17:14:37.034Z+ "/scratch/u2_5.vdev",
2452025-11-20T17:14:37.034Z+ "/scratch/u2_6.vdev",
2462025-11-20T17:14:37.034Z+ "/scratch/u2_7.vdev",
2472025-11-20T17:14:37.034Z+ "/scratch/u2_8.vdev",
2482025-11-20T17:14:37.034Z ]
2492025-11-20T17:14:37.034Z
2502025-11-20T17:14:37.034Z # The amount of memory held back for services which exist between zero and one
2512025-11-20T17:14:37.034Z+ true
2522025-11-20T17:14:37.034Z++ grep -c -E 'u2.*\.vdev' pkg/config.toml
2532025-11-20T17:14:37.034Z+ EXPECTED_ZPOOL_COUNT=9
2542025-11-20T17:14:37.034Z+ echo 'expected number of zpools is 9'
2552025-11-20T17:14:37.034Zexpected number of zpools is 9
2562025-11-20T17:14:37.034Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2572025-11-20T17:14:37.034Z+ SILO_NAME=recovery
2582025-11-20T17:14:37.034Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2592025-11-20T17:14:37.034Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2602025-11-20T17:14:37.034Z+ sed -i~ '
2612025-11-20T17:14:37.034Z /^external_dns_ips/c\
2622025-11-20T17:14:37.034Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2632025-11-20T17:14:37.034Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2642025-11-20T17:14:37.034Z /^first/c\
2652025-11-20T17:14:37.034Zfirst = "10.151.1.164"
2662025-11-20T17:14:37.034Z /^last/c\
2672025-11-20T17:14:37.034Zlast = "10.151.1.173"
2682025-11-20T17:14:37.034Z }
2692025-11-20T17:14:37.034Z /^infra_ip_first/c\
2702025-11-20T17:14:37.034Zinfra_ip_first = "10.151.1.174"
2712025-11-20T17:14:37.034Z /^infra_ip_last/c\
2722025-11-20T17:14:37.034Zinfra_ip_last = "10.151.1.174"
2732025-11-20T17:14:37.034Z /^\[\[rack_network_config.ports/,/^$/ {
2742025-11-20T17:14:37.034Z /^routes/c\
2752025-11-20T17:14:37.034Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2762025-11-20T17:14:37.034Z /^addresses/c\
2772025-11-20T17:14:37.034Zaddresses = \[{address = "10.151.1.174/24"} \]
2782025-11-20T17:14:37.035Z }
2792025-11-20T17:14:37.035Z' pkg/config-rss.toml
2802025-11-20T17:14:37.035Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2812025-11-20T17:14:37.035Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2822025-11-20T17:14:37.035Z+++ pkg/config-rss.toml Thu Nov 20 17:14:37 2025
2832025-11-20T17:14:37.035Z@@ -33,7 +33,7 @@
2842025-11-20T17:14:37.035Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2852025-11-20T17:14:37.035Z # must be contained in one of the "internal services" IP Pool ranges listed
2862025-11-20T17:14:37.035Z # below.
2872025-11-20T17:14:37.035Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2882025-11-20T17:14:37.035Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2892025-11-20T17:14:37.035Z
2902025-11-20T17:14:37.035Z # Initial TLS certificates for the external API
2912025-11-20T17:14:37.035Z #
2922025-11-20T17:14:37.035Z@@ -69,8 +69,8 @@
2932025-11-20T17:14:37.035Z #
2942025-11-20T17:14:37.035Z # For more on this and what to put here, see docs/how-to-run.adoc.
2952025-11-20T17:14:37.035Z [[internal_services_ip_pool_ranges]]
2962025-11-20T17:14:37.035Z-first = "192.168.1.20"
2972025-11-20T17:14:37.035Z-last = "192.168.1.29"
2982025-11-20T17:14:37.035Z+first = "10.151.1.164"
2992025-11-20T17:14:37.035Z+last = "10.151.1.173"
3002025-11-20T17:14:37.035Z
3012025-11-20T17:14:37.035Z # TODO - this configuration is subject to change going forward. Ultimately these
3022025-11-20T17:14:37.035Z # parameters should be provided to the control plane via wicket, but we need to
3032025-11-20T17:14:37.035Z@@ -91,8 +91,8 @@
3042025-11-20T17:14:37.035Z # A range of IP addresses used by Boundary Services on the external network. In
3052025-11-20T17:14:37.035Z # a real system, these would be addresses of the uplink ports on the Sidecar.
3062025-11-20T17:14:37.035Z # With softnpu, only one address is used.
3072025-11-20T17:14:37.035Z-infra_ip_first = "192.168.1.30"
3082025-11-20T17:14:37.035Z-infra_ip_last = "192.168.1.30"
3092025-11-20T17:14:37.035Z+infra_ip_first = "10.151.1.174"
3102025-11-20T17:14:37.035Z+infra_ip_last = "10.151.1.174"
3112025-11-20T17:14:37.035Z
3122025-11-20T17:14:37.035Z # Configurations for BGP routers to run on the scrimlets.
3132025-11-20T17:14:37.035Z bgp = []
3142025-11-20T17:14:37.035Z@@ -100,9 +100,9 @@
3152025-11-20T17:14:37.035Z # You can configure multiple uplinks by repeating the following stanza
3162025-11-20T17:14:37.035Z [[rack_network_config.ports]]
3172025-11-20T17:14:37.036Z # Routes associated with this port.
3182025-11-20T17:14:37.061Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3192025-11-20T17:14:37.061Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3202025-11-20T17:14:37.061Z # Addresses associated with this port.
3212025-11-20T17:14:37.061Z-addresses = [{address = "192.168.1.30/24"}]
3222025-11-20T17:14:37.061Z+addresses = [{address = "10.151.1.174/24"} ]
3232025-11-20T17:14:37.061Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3242025-11-20T17:14:37.061Z port = "qsfp0"
3252025-11-20T17:14:37.061Z # The speed of this port.
3262025-11-20T17:14:37.061Z+ true
3272025-11-20T17:14:37.061Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3282025-11-20T17:14:37.061Za pkg/config-rss.toml 8K
3292025-11-20T17:14:37.061Za pkg/config.toml 6K
3302025-11-20T17:14:37.061Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3312025-11-20T17:14:37.061Z+ TLS_NAME=recovery.sys.oxide.test
3322025-11-20T17:14:37.061Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3332025-11-20T17:14:37.158Z.+...+.....+......+......+....+.....+......+.........+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3342025-11-20T17:14:38.420Z..+.....+.......+...+......+...+..+...+...+....+.....+....+..+...+......+....+..+.........+.............+...+...+......+......+..............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+........+.+......+..+.+...........+.+.....+....+...+...........+..........+..+............+.+.................+....+......+.................+.......+...+..+..........+.........+..+...+.......+..+.+.........+........+...................+.....+...+.+......+........+.......+...+...........+.+...........+..........+...+......+.....+....+............+.....+...+.+...+..+.+...+............+...+..............+...+...+......+....+.................+..................+.+......+..+...............+.............+...+.........+...+........+......+......+.............+.........+................................+...............+...+.......+...+..+...+................+..+...........................+.+.........+...+..............+................+..+.+...........+.+........+....+......+..+.............+..............+...+.............+.........+......+.....................+...+...+..+......+......+.+...+.........+...+.................+...+.......+...+.........+......+...+............+..+.......+.....+.+.........+...+..+......+...+....+..+.+..+.......+...+...............+...........................+.....+.+...+...........+.+........+......+....+.....+....+..+.+........................+........+...+...+......+...+............+.+..+.......+........+...+...+.+.....................+...+..+....+...+..+....+.........+...+.....+...+..........+.................+......................+...............+..+.............+......+..+....+...............+...+...+...............+.........+.....+......+......................+..+..........+...+..+...+.............+............+......+.....+.+..............+.+...+............+...+...+............+........+.............+..+.......+......+............+..+.+....................+............+....+.....+....+.........+..+....+.........+..+....+............+..+...+.......+...........+.+......+.....+...+......+...+...+...+....+...+..............+.+...+..+.........+.............+......+.....+.........+.+...........+.+...+.........+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3352025-11-20T17:14:38.445Z-----
3362025-11-20T17:14:38.445Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3372025-11-20T17:14:38.470Za pkg/initial-tls-cert.pem 2K
3382025-11-20T17:14:38.470Za pkg/initial-tls-key.pem 4K
3392025-11-20T17:14:38.470Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3402025-11-20T17:14:38.470Z+ rmdir pkg
3412025-11-20T17:14:38.470Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3422025-11-20T17:14:38.470Z+ pfexec mkdir -p /usr/oxide
3432025-11-20T17:14:38.470Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.1
3442025-11-20T17:14:39.054Z+ pfexec chmod +x /usr/oxide/oxide
3452025-11-20T17:14:39.079Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3462025-11-20T17:14:57.381Z+ OMICRON_NO_UNINSTALL=1
3472025-11-20T17:14:57.381Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3482025-11-20T17:14:57.406ZLogging to: /opt/oxide/work/out/LOG
3492025-11-20T17:14:58.246Z
3502025-11-20T17:14:58.272Zreal 0.859631636
3512025-11-20T17:14:58.272Zuser 0.173943887
3522025-11-20T17:14:58.272Zsys 5.208002267
3532025-11-20T17:14:58.273Ztrap 0.000020598
3542025-11-20T17:14:58.273Ztflt 0.000078959
3552025-11-20T17:14:58.273Zdflt 0.000281147
3562025-11-20T17:14:58.273Zkflt 0.000000000
3572025-11-20T17:14:58.273Zlock 1:17.350169718
3582025-11-20T17:14:58.273Zslp 1.036007907
3592025-11-20T17:14:58.273Zlat 0.040974628
3602025-11-20T17:14:58.273Zstop 0.063030955
3612025-11-20T17:14:58.273Z+ retry=0
3622025-11-20T17:14:58.273Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3632025-11-20T17:14:58.273Z+ [[ 0 -gt 30 ]]
3642025-11-20T17:14:58.273Z+ sleep 1
3652025-11-20T17:14:59.261Z+ retry=1
3662025-11-20T17:14:59.261Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3672025-11-20T17:14:59.286Z+ [[ 1 -gt 30 ]]
3682025-11-20T17:14:59.286Z+ sleep 1
3692025-11-20T17:15:00.274Z+ retry=2
3702025-11-20T17:15:00.274Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3712025-11-20T17:15:00.299Z+ [[ 2 -gt 30 ]]
3722025-11-20T17:15:00.299Z+ sleep 1
3732025-11-20T17:15:01.288Z+ retry=3
3742025-11-20T17:15:01.288Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3752025-11-20T17:15:21.048Z+ [[ 3 -gt 30 ]]
3762025-11-20T17:15:21.049Z+ sleep 1
3772025-11-20T17:15:22.051Z+ retry=4
3782025-11-20T17:15:22.051Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3792025-11-20T17:15:22.076Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3802025-11-20T17:15:22.101Zlocal v6:
3812025-11-20T17:15:22.101Zfe80::7cd9:64ff:fe58:3bda
3822025-11-20T17:15:22.101Zfd92:e7f9:1c37:4adf::1
3832025-11-20T17:15:22.101Zlocal v4:
3842025-11-20T17:15:22.101Z10.151.1.174
3852025-11-20T17:15:22.101Zrouter v6_idx:
3862025-11-20T17:15:22.101Zrouter v6_routes:
3872025-11-20T17:15:22.101Zrouter v4_idx:
3882025-11-20T17:15:22.101Zrouter v4_routes:
3892025-11-20T17:15:22.101Zresolver v4:
3902025-11-20T17:15:22.102Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3912025-11-20T17:15:22.102Zresolver v6:
3922025-11-20T17:15:22.102Zfe80::7cd9:64ff:fe58:3bda -> 7e:d9:64:58:3b:da
3932025-11-20T17:15:22.102Zfe80::f4f0:12ff:fe2f:afc -> f6:f0:12:2f:0a:fc
3942025-11-20T17:15:22.102Znat v4:
3952025-11-20T17:15:22.102Znat_v6:
3962025-11-20T17:15:22.102Zport_mac:
3972025-11-20T17:15:22.102Z1000: a8:40:25:5d:55:9a
3982025-11-20T17:15:22.102Z2: a8:40:25:5d:55:bb
3992025-11-20T17:15:22.102Z1: a8:40:25:5d:55:9b
4002025-11-20T17:15:22.103Zproxy arp:
4012025-11-20T17:15:22.103Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
4022025-11-20T17:15:22.103Z+ retry=0
4032025-11-20T17:15:22.103Z+++ zoneadm list -n
4042025-11-20T17:15:22.103Z+++ grep oxz_ntp
4052025-11-20T17:15:22.128Z++ pfexec svcs -z -Hostate oxide/ntp
4062025-11-20T17:15:22.128Zsvcs: zone '-Hostate': entity not found
4072025-11-20T17:15:22.128Z++ true
4082025-11-20T17:15:22.128Z+ [[ '' != online ]]
4092025-11-20T17:15:22.128Z+ [[ 0 -gt 60 ]]
4102025-11-20T17:15:22.128Z+ sleep 1
4112025-11-20T17:15:23.113Z+ retry=1
4122025-11-20T17:15:23.140Z+++ zoneadm list -n
4132025-11-20T17:15:23.140Z+++ grep oxz_ntp
4142025-11-20T17:15:23.140Z++ pfexec svcs -z -Hostate oxide/ntp
4152025-11-20T17:15:23.140Zsvcs: zone '-Hostate': entity not found
4162025-11-20T17:15:23.140Z++ true
4172025-11-20T17:15:23.140Z+ [[ '' != online ]]
4182025-11-20T17:15:23.141Z+ [[ 1 -gt 60 ]]
4192025-11-20T17:15:23.141Z+ sleep 1
4202025-11-20T17:15:24.134Z+ retry=2
4212025-11-20T17:15:24.161Z+++ zoneadm list -n
4222025-11-20T17:15:24.161Z+++ grep oxz_ntp
4232025-11-20T17:15:24.161Z++ pfexec svcs -z -Hostate oxide/ntp
4242025-11-20T17:15:24.161Zsvcs: zone '-Hostate': entity not found
4252025-11-20T17:15:24.161Z++ true
4262025-11-20T17:15:24.161Z+ [[ '' != online ]]
4272025-11-20T17:15:24.161Z+ [[ 2 -gt 60 ]]
4282025-11-20T17:15:24.161Z+ sleep 1
4292025-11-20T17:15:25.157Z+ retry=3
4302025-11-20T17:15:25.184Z+++ zoneadm list -n
4312025-11-20T17:15:25.184Z+++ grep oxz_ntp
4322025-11-20T17:15:25.184Z++ pfexec svcs -z -Hostate oxide/ntp
4332025-11-20T17:15:25.184Zsvcs: zone '-Hostate': entity not found
4342025-11-20T17:15:25.184Z++ true
4352025-11-20T17:15:25.184Z+ [[ '' != online ]]
4362025-11-20T17:15:25.184Z+ [[ 3 -gt 60 ]]
4372025-11-20T17:15:25.184Z+ sleep 1
4382025-11-20T17:15:26.177Z+ retry=4
4392025-11-20T17:15:26.202Z+++ zoneadm list -n
4402025-11-20T17:15:26.202Z+++ grep oxz_ntp
4412025-11-20T17:15:26.202Z++ pfexec svcs -z -Hostate oxide/ntp
4422025-11-20T17:15:26.202Zsvcs: zone '-Hostate': entity not found
4432025-11-20T17:15:26.202Z++ true
4442025-11-20T17:15:26.202Z+ [[ '' != online ]]
4452025-11-20T17:15:26.202Z+ [[ 4 -gt 60 ]]
4462025-11-20T17:15:26.202Z+ sleep 1
4472025-11-20T17:15:27.198Z+ retry=5
4482025-11-20T17:15:27.223Z+++ zoneadm list -n
4492025-11-20T17:15:27.223Z+++ grep oxz_ntp
4502025-11-20T17:15:27.223Z++ pfexec svcs -z -Hostate oxide/ntp
4512025-11-20T17:15:27.223Zsvcs: zone '-Hostate': entity not found
4522025-11-20T17:15:27.223Z++ true
4532025-11-20T17:15:27.223Z+ [[ '' != online ]]
4542025-11-20T17:15:27.223Z+ [[ 5 -gt 60 ]]
4552025-11-20T17:15:27.223Z+ sleep 1
4562025-11-20T17:15:28.220Z+ retry=6
4572025-11-20T17:15:28.245Z+++ zoneadm list -n
4582025-11-20T17:15:28.245Z+++ grep oxz_ntp
4592025-11-20T17:15:28.245Z++ pfexec svcs -z -Hostate oxide/ntp
4602025-11-20T17:15:28.245Zsvcs: zone '-Hostate': entity not found
4612025-11-20T17:15:28.245Z++ true
4622025-11-20T17:15:28.245Z+ [[ '' != online ]]
4632025-11-20T17:15:28.245Z+ [[ 6 -gt 60 ]]
4642025-11-20T17:15:28.245Z+ sleep 1
4652025-11-20T17:15:29.241Z+ retry=7
4662025-11-20T17:15:29.267Z+++ zoneadm list -n
4672025-11-20T17:15:29.267Z+++ grep oxz_ntp
4682025-11-20T17:15:29.267Z++ pfexec svcs -z -Hostate oxide/ntp
4692025-11-20T17:15:29.267Zsvcs: zone '-Hostate': entity not found
4702025-11-20T17:15:29.267Z++ true
4712025-11-20T17:15:29.268Z+ [[ '' != online ]]
4722025-11-20T17:15:29.268Z+ [[ 7 -gt 60 ]]
4732025-11-20T17:15:29.268Z+ sleep 1
4742025-11-20T17:15:30.264Z+ retry=8
4752025-11-20T17:15:30.288Z+++ zoneadm list -n
4762025-11-20T17:15:30.288Z+++ grep oxz_ntp
4772025-11-20T17:15:30.288Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
4782025-11-20T17:15:30.313Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4792025-11-20T17:15:30.313Z++ true
4802025-11-20T17:15:30.313Z+ [[ '' != online ]]
4812025-11-20T17:15:30.313Z+ [[ 8 -gt 60 ]]
4822025-11-20T17:15:30.313Z+ sleep 1
4832025-11-20T17:15:31.295Z+ retry=9
4842025-11-20T17:15:31.321Z+++ zoneadm list -n
4852025-11-20T17:15:31.321Z+++ grep oxz_ntp
4862025-11-20T17:15:31.321Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
4872025-11-20T17:15:31.346Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4882025-11-20T17:15:31.346Z++ true
4892025-11-20T17:15:31.346Z+ [[ '' != online ]]
4902025-11-20T17:15:31.346Z+ [[ 9 -gt 60 ]]
4912025-11-20T17:15:31.346Z+ sleep 1
4922025-11-20T17:15:32.327Z+ retry=10
4932025-11-20T17:15:32.352Z+++ zoneadm list -n
4942025-11-20T17:15:32.352Z+++ grep oxz_ntp
4952025-11-20T17:15:32.352Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
4962025-11-20T17:15:32.352Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4972025-11-20T17:15:32.352Z++ true
4982025-11-20T17:15:32.377Z+ [[ '' != online ]]
4992025-11-20T17:15:32.377Z+ [[ 10 -gt 60 ]]
5002025-11-20T17:15:32.377Z+ sleep 1
5012025-11-20T17:15:33.356Z+ retry=11
5022025-11-20T17:15:33.387Z+++ zoneadm list -n
5032025-11-20T17:15:33.387Z+++ grep oxz_ntp
5042025-11-20T17:15:33.387Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
5052025-11-20T17:15:33.387Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
5062025-11-20T17:15:33.387Z++ true
5072025-11-20T17:15:33.387Z+ [[ '' != online ]]
5082025-11-20T17:15:33.387Z+ [[ 11 -gt 60 ]]
5092025-11-20T17:15:33.387Z+ sleep 1
5102025-11-20T17:15:34.379Z+ retry=12
5112025-11-20T17:15:34.404Z+++ zoneadm list -n
5122025-11-20T17:15:34.404Z+++ grep oxz_ntp
5132025-11-20T17:15:34.404Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
5142025-11-20T17:15:34.404Z+ [[ offline != online ]]
5152025-11-20T17:15:34.404Z+ [[ 12 -gt 60 ]]
5162025-11-20T17:15:34.404Z+ sleep 1
5172025-11-20T17:15:35.405Z+ retry=13
5182025-11-20T17:15:35.430Z+++ zoneadm list -n
5192025-11-20T17:15:35.430Z+++ grep oxz_ntp
5202025-11-20T17:15:35.430Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
5212025-11-20T17:15:35.430Z+ [[ offline != online ]]
5222025-11-20T17:15:35.430Z+ [[ 13 -gt 60 ]]
5232025-11-20T17:15:35.430Z+ sleep 1
5242025-11-20T17:15:36.428Z+ retry=14
5252025-11-20T17:15:36.454Z+++ zoneadm list -n
5262025-11-20T17:15:36.455Z+++ grep oxz_ntp
5272025-11-20T17:15:36.455Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
5282025-11-20T17:15:36.455Z+ [[ offline != online ]]
5292025-11-20T17:15:36.455Z+ [[ 14 -gt 60 ]]
5302025-11-20T17:15:36.455Z+ sleep 1
5312025-11-20T17:15:37.448Z+ retry=15
5322025-11-20T17:15:37.475Z+++ zoneadm list -n
5332025-11-20T17:15:37.475Z+++ grep oxz_ntp
5342025-11-20T17:15:37.475Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
5352025-11-20T17:15:37.475Z+ [[ offline != online ]]
5362025-11-20T17:15:37.475Z+ [[ 15 -gt 60 ]]
5372025-11-20T17:15:37.475Z+ sleep 1
5382025-11-20T17:15:38.472Z+ retry=16
5392025-11-20T17:15:38.497Z+++ zoneadm list -n
5402025-11-20T17:15:38.498Z+++ grep oxz_ntp
5412025-11-20T17:15:38.498Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
5422025-11-20T17:15:38.498Z+ [[ offline != online ]]
5432025-11-20T17:15:38.498Z+ [[ 16 -gt 60 ]]
5442025-11-20T17:15:38.498Z+ sleep 1
5452025-11-20T17:15:39.517Z+ retry=17
5462025-11-20T17:15:39.517Z+++ zoneadm list -n
5472025-11-20T17:15:39.517Z+++ grep oxz_ntp
5482025-11-20T17:15:39.517Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
5492025-11-20T17:15:39.517Z+ [[ offline != online ]]
5502025-11-20T17:15:39.517Z+ [[ 17 -gt 60 ]]
5512025-11-20T17:15:39.517Z+ sleep 1
 
5522025-11-20T17:15:40.380Zbuskin console login: Nov 20 17:15:40 buskin ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5532025-11-20T17:15:40.515Z+ retry=18
5542025-11-20T17:15:40.541Z+++ zoneadm list -n
5552025-11-20T17:15:40.541Z+++ grep oxz_ntp
5562025-11-20T17:15:40.541Z++ pfexec svcs -z oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418 -Hostate oxide/ntp
5572025-11-20T17:15:40.541Z+ [[ online != online ]]
5582025-11-20T17:15:40.541Z+ echo 'Waited for chrony: 18s'
5592025-11-20T17:15:40.541Z+ retry=0
5602025-11-20T17:15:40.541ZWaited for chrony: 18s
5612025-11-20T17:15:40.541Z+ zoneadm list
5622025-11-20T17:15:40.541Z+ grep nexus
5632025-11-20T17:15:40.566Z+ [[ 0 -gt 300 ]]
5642025-11-20T17:15:40.566Z+ sleep 1
5652025-11-20T17:15:41.544Z+ retry=1
5662025-11-20T17:15:41.569Z+ zoneadm list
5672025-11-20T17:15:41.569Z+ grep nexus
5682025-11-20T17:15:41.569Z+ [[ 1 -gt 300 ]]
5692025-11-20T17:15:41.569Z+ sleep 1
5702025-11-20T17:15:42.555Z+ retry=2
5712025-11-20T17:15:42.579Z+ zoneadm list
5722025-11-20T17:15:42.579Z+ grep nexus
5732025-11-20T17:15:42.579Z+ [[ 2 -gt 300 ]]
5742025-11-20T17:15:42.579Z+ sleep 1
5752025-11-20T17:15:43.567Z+ retry=3
5762025-11-20T17:15:43.593Z+ zoneadm list
5772025-11-20T17:15:43.593Z+ grep nexus
5782025-11-20T17:15:43.593Z+ [[ 3 -gt 300 ]]
5792025-11-20T17:15:43.593Z+ sleep 1
5802025-11-20T17:15:44.576Z+ retry=4
5812025-11-20T17:15:44.602Z+ zoneadm list
5822025-11-20T17:15:44.602Z+ grep nexus
5832025-11-20T17:15:44.602Z+ [[ 4 -gt 300 ]]
5842025-11-20T17:15:44.602Z+ sleep 1
5852025-11-20T17:15:45.587Z+ retry=5
5862025-11-20T17:15:45.612Z+ zoneadm list
5872025-11-20T17:15:45.612Z+ grep nexus
5882025-11-20T17:15:45.612Z+ [[ 5 -gt 300 ]]
5892025-11-20T17:15:45.612Z+ sleep 1
5902025-11-20T17:15:46.599Z+ retry=6
5912025-11-20T17:15:46.624Z+ zoneadm list
5922025-11-20T17:15:46.624Z+ grep nexus
5932025-11-20T17:15:46.624Z+ [[ 6 -gt 300 ]]
5942025-11-20T17:15:46.624Z+ sleep 1
5952025-11-20T17:15:47.609Z+ retry=7
5962025-11-20T17:15:47.634Z+ zoneadm list
5972025-11-20T17:15:47.634Z+ grep nexus
5982025-11-20T17:15:47.634Z+ [[ 7 -gt 300 ]]
5992025-11-20T17:15:47.634Z+ sleep 1
6002025-11-20T17:15:48.623Z+ retry=8
6012025-11-20T17:15:48.672Z+ zoneadm list
6022025-11-20T17:15:48.672Z+ grep nexus
6032025-11-20T17:15:48.672Z+ [[ 8 -gt 300 ]]
6042025-11-20T17:15:48.672Z+ sleep 1
6052025-11-20T17:15:49.630Z+ retry=9
6062025-11-20T17:15:49.655Z+ zoneadm list
6072025-11-20T17:15:49.655Z+ grep nexus
6082025-11-20T17:15:49.655Z+ [[ 9 -gt 300 ]]
6092025-11-20T17:15:49.655Z+ sleep 1
6102025-11-20T17:15:50.641Z+ retry=10
6112025-11-20T17:15:50.666Z+ zoneadm list
6122025-11-20T17:15:50.666Z+ grep nexus
6132025-11-20T17:15:50.666Z+ [[ 10 -gt 300 ]]
6142025-11-20T17:15:50.666Z+ sleep 1
6152025-11-20T17:15:51.652Z+ retry=11
6162025-11-20T17:15:51.677Z+ zoneadm list
6172025-11-20T17:15:51.677Z+ grep nexus
6182025-11-20T17:15:51.677Z+ [[ 11 -gt 300 ]]
6192025-11-20T17:15:51.677Z+ sleep 1
6202025-11-20T17:15:52.663Z+ retry=12
6212025-11-20T17:15:52.688Z+ zoneadm list
6222025-11-20T17:15:52.688Z+ grep nexus
6232025-11-20T17:15:52.688Z+ [[ 12 -gt 300 ]]
6242025-11-20T17:15:52.688Z+ sleep 1
6252025-11-20T17:15:53.674Z+ retry=13
6262025-11-20T17:15:53.700Z+ zoneadm list
6272025-11-20T17:15:53.700Z+ grep nexus
6282025-11-20T17:15:53.700Z+ [[ 13 -gt 300 ]]
6292025-11-20T17:15:53.700Z+ sleep 1
6302025-11-20T17:15:54.688Z+ retry=14
6312025-11-20T17:15:54.713Z+ zoneadm list
6322025-11-20T17:15:54.713Z+ grep nexus
6332025-11-20T17:15:54.713Z+ [[ 14 -gt 300 ]]
6342025-11-20T17:15:54.713Z+ sleep 1
6352025-11-20T17:15:55.703Z+ retry=15
6362025-11-20T17:15:55.728Z+ zoneadm list
6372025-11-20T17:15:55.728Z+ grep nexus
6382025-11-20T17:15:55.728Z+ [[ 15 -gt 300 ]]
6392025-11-20T17:15:55.728Z+ sleep 1
6402025-11-20T17:15:56.724Z+ retry=16
6412025-11-20T17:15:56.753Z+ zoneadm list
6422025-11-20T17:15:56.803Z+ grep nexus
6432025-11-20T17:15:56.984Z+ [[ 16 -gt 300 ]]
6442025-11-20T17:15:56.985Z+ sleep 1
6452025-11-20T17:15:58.026Z+ retry=17
6462025-11-20T17:15:58.050Z+ zoneadm list
6472025-11-20T17:15:58.050Z+ grep nexus
6482025-11-20T17:15:58.050Z+ [[ 17 -gt 300 ]]
6492025-11-20T17:15:58.050Z+ sleep 1
6502025-11-20T17:15:59.044Z+ retry=18
6512025-11-20T17:15:59.069Z+ zoneadm list
6522025-11-20T17:15:59.069Z+ grep nexus
6532025-11-20T17:15:59.069Z+ [[ 18 -gt 300 ]]
6542025-11-20T17:15:59.069Z+ sleep 1
6552025-11-20T17:16:00.057Z+ retry=19
6562025-11-20T17:16:00.082Z+ zoneadm list
6572025-11-20T17:16:00.082Z+ grep nexus
6582025-11-20T17:16:00.082Z+ [[ 19 -gt 300 ]]
6592025-11-20T17:16:00.082Z+ sleep 1
6602025-11-20T17:16:01.070Z+ retry=20
6612025-11-20T17:16:01.095Z+ zoneadm list
6622025-11-20T17:16:01.095Z+ grep nexus
6632025-11-20T17:16:01.095Z+ [[ 20 -gt 300 ]]
6642025-11-20T17:16:01.096Z+ sleep 1
6652025-11-20T17:16:02.083Z+ retry=21
6662025-11-20T17:16:02.108Z+ zoneadm list
6672025-11-20T17:16:02.108Z+ grep nexus
6682025-11-20T17:16:02.108Z+ [[ 21 -gt 300 ]]
6692025-11-20T17:16:02.108Z+ sleep 1
6702025-11-20T17:16:03.094Z+ retry=22
6712025-11-20T17:16:03.119Z+ zoneadm list
6722025-11-20T17:16:03.119Z+ grep nexus
6732025-11-20T17:16:03.119Z+ [[ 22 -gt 300 ]]
6742025-11-20T17:16:03.119Z+ sleep 1
6752025-11-20T17:16:04.109Z+ retry=23
6762025-11-20T17:16:04.134Z+ zoneadm list
6772025-11-20T17:16:04.134Z+ grep nexus
6782025-11-20T17:16:04.134Z+ [[ 23 -gt 300 ]]
6792025-11-20T17:16:04.134Z+ sleep 1
6802025-11-20T17:16:05.121Z+ retry=24
6812025-11-20T17:16:05.178Z+ zoneadm list
6822025-11-20T17:16:05.178Z+ grep nexus
6832025-11-20T17:16:05.178Z+ [[ 24 -gt 300 ]]
6842025-11-20T17:16:05.178Z+ sleep 1
6852025-11-20T17:16:06.133Z+ retry=25
6862025-11-20T17:16:06.158Z+ zoneadm list
6872025-11-20T17:16:06.158Z+ grep nexus
6882025-11-20T17:16:06.158Z+ [[ 25 -gt 300 ]]
6892025-11-20T17:16:06.158Z+ sleep 1
6902025-11-20T17:16:07.145Z+ retry=26
6912025-11-20T17:16:07.169Z+ zoneadm list
6922025-11-20T17:16:07.170Z+ grep nexus
6932025-11-20T17:16:07.170Z+ [[ 26 -gt 300 ]]
6942025-11-20T17:16:07.170Z+ sleep 1
6952025-11-20T17:16:08.156Z+ retry=27
6962025-11-20T17:16:08.181Z+ zoneadm list
6972025-11-20T17:16:08.181Z+ grep nexus
6982025-11-20T17:16:08.181Z+ [[ 27 -gt 300 ]]
6992025-11-20T17:16:08.181Z+ sleep 1
7002025-11-20T17:16:09.167Z+ retry=28
7012025-11-20T17:16:09.192Z+ zoneadm list
7022025-11-20T17:16:09.192Z+ grep nexus
7032025-11-20T17:16:09.192Z+ [[ 28 -gt 300 ]]
7042025-11-20T17:16:09.192Z+ sleep 1
7052025-11-20T17:16:10.178Z+ retry=29
7062025-11-20T17:16:10.203Z+ zoneadm list
7072025-11-20T17:16:10.203Z+ grep nexus
7082025-11-20T17:16:10.203Z+ [[ 29 -gt 300 ]]
7092025-11-20T17:16:10.203Z+ sleep 1
7102025-11-20T17:16:14.803Z+ retry=30
7112025-11-20T17:16:14.803Z+ grep nexus
7122025-11-20T17:16:14.803Z+ zoneadm list
7132025-11-20T17:16:14.803Z+ [[ 30 -gt 300 ]]
7142025-11-20T17:16:14.803Z+ sleep 1
7152025-11-20T17:16:15.750Z+ retry=31
7162025-11-20T17:16:15.775Z+ zoneadm list
7172025-11-20T17:16:15.775Z+ grep nexus
7182025-11-20T17:16:15.775Z+ [[ 31 -gt 300 ]]
7192025-11-20T17:16:15.775Z+ sleep 1
7202025-11-20T17:16:16.766Z+ retry=32
7212025-11-20T17:16:16.791Z+ zoneadm list
7222025-11-20T17:16:16.792Z+ grep nexus
7232025-11-20T17:16:16.792Z+ [[ 32 -gt 300 ]]
7242025-11-20T17:16:16.792Z+ sleep 1
7252025-11-20T17:16:17.783Z+ retry=33
7262025-11-20T17:16:17.808Z+ zoneadm list
7272025-11-20T17:16:17.808Z+ grep nexus
7282025-11-20T17:16:17.809Z+ [[ 33 -gt 300 ]]
7292025-11-20T17:16:17.809Z+ sleep 1
7302025-11-20T17:16:18.801Z+ retry=34
7312025-11-20T17:16:18.826Z+ zoneadm list
7322025-11-20T17:16:18.826Z+ grep nexus
7332025-11-20T17:16:18.826Z+ [[ 34 -gt 300 ]]
7342025-11-20T17:16:18.826Z+ sleep 1
7352025-11-20T17:16:19.815Z+ retry=35
7362025-11-20T17:16:19.840Z+ zoneadm list
7372025-11-20T17:16:19.840Z+ grep nexus
7382025-11-20T17:16:19.840Z+ [[ 35 -gt 300 ]]
7392025-11-20T17:16:19.840Z+ sleep 1
7402025-11-20T17:16:20.833Z+ retry=36
7412025-11-20T17:16:20.858Z+ zoneadm list
7422025-11-20T17:16:20.858Z+ grep nexus
7432025-11-20T17:16:20.858Z+ [[ 36 -gt 300 ]]
7442025-11-20T17:16:20.858Z+ sleep 1
7452025-11-20T17:16:21.844Z+ retry=37
7462025-11-20T17:16:21.868Z+ zoneadm list
7472025-11-20T17:16:21.869Z+ grep nexus
7482025-11-20T17:16:21.869Z+ [[ 37 -gt 300 ]]
7492025-11-20T17:16:21.869Z+ sleep 1
7502025-11-20T17:16:22.859Z+ retry=38
7512025-11-20T17:16:22.884Z+ zoneadm list
7522025-11-20T17:16:22.884Z+ grep nexus
7532025-11-20T17:16:22.884Z+ [[ 38 -gt 300 ]]
7542025-11-20T17:16:22.884Z+ sleep 1
7552025-11-20T17:16:23.871Z+ retry=39
7562025-11-20T17:16:23.896Z+ zoneadm list
7572025-11-20T17:16:23.896Z+ grep nexus
7582025-11-20T17:16:23.896Z+ [[ 39 -gt 300 ]]
7592025-11-20T17:16:23.896Z+ sleep 1
7602025-11-20T17:16:24.883Z+ retry=40
7612025-11-20T17:16:24.908Z+ zoneadm list
7622025-11-20T17:16:24.908Z+ grep nexus
7632025-11-20T17:16:24.908Z+ [[ 40 -gt 300 ]]
7642025-11-20T17:16:24.908Z+ sleep 1
7652025-11-20T17:16:25.896Z+ retry=41
7662025-11-20T17:16:25.921Z+ zoneadm list
7672025-11-20T17:16:25.921Z+ grep nexus
7682025-11-20T17:16:25.921Z+ [[ 41 -gt 300 ]]
7692025-11-20T17:16:25.921Z+ sleep 1
7702025-11-20T17:16:26.910Z+ retry=42
7712025-11-20T17:16:26.935Z+ zoneadm list
7722025-11-20T17:16:26.935Z+ grep nexus
7732025-11-20T17:16:26.935Z+ [[ 42 -gt 300 ]]
7742025-11-20T17:16:26.935Z+ sleep 1
7752025-11-20T17:16:27.923Z+ retry=43
7762025-11-20T17:16:27.949Z+ zoneadm list
7772025-11-20T17:16:27.949Z+ grep nexus
7782025-11-20T17:16:27.949Z+ [[ 43 -gt 300 ]]
7792025-11-20T17:16:27.949Z+ sleep 1
7802025-11-20T17:16:28.938Z+ retry=44
7812025-11-20T17:16:28.963Z+ zoneadm list
7822025-11-20T17:16:28.963Z+ grep nexus
7832025-11-20T17:16:28.963Z+ [[ 44 -gt 300 ]]
7842025-11-20T17:16:28.963Z+ sleep 1
7852025-11-20T17:16:29.948Z+ retry=45
7862025-11-20T17:16:29.973Z+ zoneadm list
7872025-11-20T17:16:29.973Z+ grep nexus
7882025-11-20T17:16:29.973Z+ [[ 45 -gt 300 ]]
7892025-11-20T17:16:29.973Z+ sleep 1
7902025-11-20T17:16:30.959Z+ retry=46
7912025-11-20T17:16:30.984Z+ zoneadm list
7922025-11-20T17:16:30.984Z+ grep nexus
7932025-11-20T17:16:30.984Z+ [[ 46 -gt 300 ]]
7942025-11-20T17:16:30.984Z+ sleep 1
7952025-11-20T17:16:31.971Z+ retry=47
7962025-11-20T17:16:31.996Z+ zoneadm list
7972025-11-20T17:16:31.996Z+ grep nexus
7982025-11-20T17:16:31.996Z+ [[ 47 -gt 300 ]]
7992025-11-20T17:16:31.996Z+ sleep 1
8002025-11-20T17:16:32.983Z+ retry=48
8012025-11-20T17:16:33.007Z+ zoneadm list
8022025-11-20T17:16:33.007Z+ grep nexus
8032025-11-20T17:16:33.007Z+ [[ 48 -gt 300 ]]
8042025-11-20T17:16:33.008Z+ sleep 1
8052025-11-20T17:16:34.006Z+ retry=49
8062025-11-20T17:16:34.031Z+ zoneadm list
8072025-11-20T17:16:34.031Z+ grep nexus
8082025-11-20T17:16:34.031Z+ [[ 49 -gt 300 ]]
8092025-11-20T17:16:34.031Z+ sleep 1
8102025-11-20T17:16:35.025Z+ retry=50
8112025-11-20T17:16:35.052Z+ zoneadm list
8122025-11-20T17:16:35.052Z+ grep nexus
8132025-11-20T17:16:35.052Z+ [[ 50 -gt 300 ]]
8142025-11-20T17:16:35.052Z+ sleep 1
8152025-11-20T17:16:36.045Z+ retry=51
8162025-11-20T17:16:36.074Z+ zoneadm list
8172025-11-20T17:16:36.074Z+ grep nexus
8182025-11-20T17:16:36.074Z+ [[ 51 -gt 300 ]]
8192025-11-20T17:16:36.074Z+ sleep 1
8202025-11-20T17:16:37.061Z+ retry=52
8212025-11-20T17:16:37.086Z+ zoneadm list
8222025-11-20T17:16:37.086Z+ grep nexus
8232025-11-20T17:16:37.086Z+ [[ 52 -gt 300 ]]
8242025-11-20T17:16:37.086Z+ sleep 1
8252025-11-20T17:16:38.078Z+ retry=53
8262025-11-20T17:16:38.103Z+ zoneadm list
8272025-11-20T17:16:38.103Z+ grep nexus
8282025-11-20T17:16:38.103Z+ [[ 53 -gt 300 ]]
8292025-11-20T17:16:38.103Z+ sleep 1
8302025-11-20T17:16:39.098Z+ retry=54
8312025-11-20T17:16:39.124Z+ zoneadm list
8322025-11-20T17:16:39.124Z+ grep nexus
8332025-11-20T17:16:39.124Z+ [[ 54 -gt 300 ]]
8342025-11-20T17:16:39.124Z+ sleep 1
8352025-11-20T17:16:40.121Z+ retry=55
8362025-11-20T17:16:40.146Z+ zoneadm list
8372025-11-20T17:16:40.146Z+ grep nexus
8382025-11-20T17:16:40.146Z+ [[ 55 -gt 300 ]]
8392025-11-20T17:16:40.146Z+ sleep 1
8402025-11-20T17:16:41.143Z+ retry=56
8412025-11-20T17:16:41.168Z+ zoneadm list
8422025-11-20T17:16:41.168Z+ grep nexus
8432025-11-20T17:16:41.168Z+ [[ 56 -gt 300 ]]
8442025-11-20T17:16:41.168Z+ sleep 1
8452025-11-20T17:16:42.164Z+ retry=57
8462025-11-20T17:16:42.191Z+ zoneadm list
8472025-11-20T17:16:42.191Z+ grep nexus
8482025-11-20T17:16:42.191Z+ [[ 57 -gt 300 ]]
8492025-11-20T17:16:42.191Z+ sleep 1
8502025-11-20T17:16:43.176Z+ retry=58
8512025-11-20T17:16:43.201Z+ zoneadm list
8522025-11-20T17:16:43.201Z+ grep nexus
8532025-11-20T17:16:43.201Z+ [[ 58 -gt 300 ]]
8542025-11-20T17:16:43.201Z+ sleep 1
8552025-11-20T17:16:44.191Z+ retry=59
8562025-11-20T17:16:44.216Z+ zoneadm list
8572025-11-20T17:16:44.216Z+ grep nexus
8582025-11-20T17:16:44.216Z+ [[ 59 -gt 300 ]]
8592025-11-20T17:16:44.216Z+ sleep 1
8602025-11-20T17:16:45.206Z+ retry=60
8612025-11-20T17:16:45.231Z+ zoneadm list
8622025-11-20T17:16:45.231Z+ grep nexus
8632025-11-20T17:16:45.231Z+ [[ 60 -gt 300 ]]
8642025-11-20T17:16:45.231Z+ sleep 1
8652025-11-20T17:16:46.222Z+ retry=61
8662025-11-20T17:16:46.247Z+ zoneadm list
8672025-11-20T17:16:46.247Z+ grep nexus
8682025-11-20T17:16:46.247Z+ [[ 61 -gt 300 ]]
8692025-11-20T17:16:46.247Z+ sleep 1
8702025-11-20T17:16:47.247Z+ retry=62
8712025-11-20T17:16:47.271Z+ zoneadm list
8722025-11-20T17:16:47.271Z+ grep nexus
8732025-11-20T17:16:47.272Z+ [[ 62 -gt 300 ]]
8742025-11-20T17:16:47.272Z+ sleep 1
8752025-11-20T17:16:48.262Z+ retry=63
8762025-11-20T17:16:48.288Z+ zoneadm list
8772025-11-20T17:16:48.288Z+ grep nexus
8782025-11-20T17:16:48.288Z+ [[ 63 -gt 300 ]]
8792025-11-20T17:16:48.288Z+ sleep 1
8802025-11-20T17:16:49.276Z+ retry=64
8812025-11-20T17:16:49.301Z+ zoneadm list
8822025-11-20T17:16:49.301Z+ grep nexus
8832025-11-20T17:16:49.301Z+ [[ 64 -gt 300 ]]
8842025-11-20T17:16:49.301Z+ sleep 1
8852025-11-20T17:16:50.292Z+ retry=65
8862025-11-20T17:16:50.316Z+ zoneadm list
8872025-11-20T17:16:50.316Z+ grep nexus
8882025-11-20T17:16:50.316Z+ [[ 65 -gt 300 ]]
8892025-11-20T17:16:50.316Z+ sleep 1
8902025-11-20T17:16:51.306Z+ retry=66
8912025-11-20T17:16:51.332Z+ zoneadm list
8922025-11-20T17:16:51.332Z+ grep nexus
8932025-11-20T17:16:51.332Z+ [[ 66 -gt 300 ]]
8942025-11-20T17:16:51.332Z+ sleep 1
8952025-11-20T17:16:52.321Z+ retry=67
8962025-11-20T17:16:52.346Z+ zoneadm list
8972025-11-20T17:16:52.346Z+ grep nexus
8982025-11-20T17:16:52.346Z+ [[ 67 -gt 300 ]]
8992025-11-20T17:16:52.346Z+ sleep 1
9002025-11-20T17:16:53.335Z+ retry=68
9012025-11-20T17:16:53.361Z+ zoneadm list
9022025-11-20T17:16:53.361Z+ grep nexus
9032025-11-20T17:16:53.361Z+ [[ 68 -gt 300 ]]
9042025-11-20T17:16:53.361Z+ sleep 1
9052025-11-20T17:16:54.350Z+ retry=69
9062025-11-20T17:16:54.375Z+ zoneadm list
9072025-11-20T17:16:54.375Z+ grep nexus
9082025-11-20T17:16:54.375Z+ [[ 69 -gt 300 ]]
9092025-11-20T17:16:54.375Z+ sleep 1
9102025-11-20T17:16:55.365Z+ retry=70
9112025-11-20T17:16:55.390Z+ zoneadm list
9122025-11-20T17:16:55.390Z+ grep nexus
9132025-11-20T17:16:55.390Z+ [[ 70 -gt 300 ]]
9142025-11-20T17:16:55.390Z+ sleep 1
9152025-11-20T17:16:56.381Z+ retry=71
9162025-11-20T17:16:56.406Z+ zoneadm list
9172025-11-20T17:16:56.406Z+ grep nexus
9182025-11-20T17:16:56.406Z+ [[ 71 -gt 300 ]]
9192025-11-20T17:16:56.406Z+ sleep 1
9202025-11-20T17:16:57.396Z+ retry=72
9212025-11-20T17:16:57.421Z+ zoneadm list
9222025-11-20T17:16:57.421Z+ grep nexus
9232025-11-20T17:16:57.421Z+ [[ 72 -gt 300 ]]
9242025-11-20T17:16:57.421Z+ sleep 1
9252025-11-20T17:16:58.411Z+ retry=73
9262025-11-20T17:16:58.436Z+ zoneadm list
9272025-11-20T17:16:58.436Z+ grep nexus
9282025-11-20T17:16:58.436Z+ [[ 73 -gt 300 ]]
9292025-11-20T17:16:58.436Z+ sleep 1
9302025-11-20T17:16:59.431Z+ retry=74
9312025-11-20T17:16:59.456Z+ zoneadm list
9322025-11-20T17:16:59.456Z+ grep nexus
9332025-11-20T17:16:59.456Zoxz_nexus_61dbaadc-58db-4630-af5f-a16a5198754d
9342025-11-20T17:16:59.456Zoxz_nexus_5e431490-a2ae-4e9c-bfa0-5119ec8c3eae
9352025-11-20T17:16:59.456Zoxz_nexus_91d1d1b3-e26f-4f93-b244-1773f61f221d
9362025-11-20T17:16:59.456Z+ echo 'Waited for nexus: 74s'
9372025-11-20T17:16:59.456ZWaited for nexus: 74s
9382025-11-20T17:16:59.456Z+ retry=0
9392025-11-20T17:16:59.456Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9402025-11-20T17:16:59.482Z+ [[ 0 -gt 300 ]]
9412025-11-20T17:16:59.482Z+ sleep 1
9422025-11-20T17:17:00.464Z+ retry=1
9432025-11-20T17:17:00.465Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9442025-11-20T17:17:00.489Z+ [[ 1 -gt 300 ]]
9452025-11-20T17:17:00.489Z+ sleep 1
9462025-11-20T17:17:01.474Z+ retry=2
9472025-11-20T17:17:01.474Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9482025-11-20T17:17:01.498Z+ [[ 2 -gt 300 ]]
9492025-11-20T17:17:01.498Z+ sleep 1
9502025-11-20T17:17:02.487Z+ retry=3
9512025-11-20T17:17:02.487Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9522025-11-20T17:17:02.512Z+ [[ 3 -gt 300 ]]
9532025-11-20T17:17:02.512Z+ sleep 1
9542025-11-20T17:17:03.499Z+ retry=4
9552025-11-20T17:17:03.499Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9562025-11-20T17:17:03.523Z+ [[ 4 -gt 300 ]]
9572025-11-20T17:17:03.523Z+ sleep 1
9582025-11-20T17:17:04.538Z+ retry=5
9592025-11-20T17:17:04.538Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9602025-11-20T17:17:04.538Z+ [[ 5 -gt 300 ]]
9612025-11-20T17:17:04.538Z+ sleep 1
9622025-11-20T17:17:05.519Z+ retry=6
9632025-11-20T17:17:05.519Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9642025-11-20T17:17:05.544Z+ [[ 6 -gt 300 ]]
9652025-11-20T17:17:05.544Z+ sleep 1
9662025-11-20T17:17:06.530Z+ retry=7
9672025-11-20T17:17:06.530Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9682025-11-20T17:17:06.554Z+ [[ 7 -gt 300 ]]
9692025-11-20T17:17:06.554Z+ sleep 1
9702025-11-20T17:17:07.539Z+ retry=8
9712025-11-20T17:17:07.539Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9722025-11-20T17:17:07.563Z+ [[ 8 -gt 300 ]]
9732025-11-20T17:17:07.563Z+ sleep 1
9742025-11-20T17:17:08.548Z+ retry=9
9752025-11-20T17:17:08.548Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9762025-11-20T17:17:08.573Z+ [[ 9 -gt 300 ]]
9772025-11-20T17:17:08.573Z+ sleep 1
9782025-11-20T17:17:09.559Z+ retry=10
9792025-11-20T17:17:09.559Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9802025-11-20T17:17:09.583Z+ [[ 10 -gt 300 ]]
9812025-11-20T17:17:09.583Z+ sleep 1
9822025-11-20T17:17:10.571Z+ retry=11
9832025-11-20T17:17:10.571Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9842025-11-20T17:17:10.596Z+ [[ 11 -gt 300 ]]
9852025-11-20T17:17:10.596Z+ sleep 1
9862025-11-20T17:17:11.581Z+ retry=12
9872025-11-20T17:17:11.581Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9882025-11-20T17:17:11.606Z+ [[ 12 -gt 300 ]]
9892025-11-20T17:17:11.606Z+ sleep 1
9902025-11-20T17:17:12.590Z+ retry=13
9912025-11-20T17:17:12.590Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9922025-11-20T17:17:12.614Z+ [[ 13 -gt 300 ]]
9932025-11-20T17:17:12.614Z+ sleep 1
 
9942025-11-20T17:17:13.114ZNov 20 17:17:12 buskin ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
 
9952025-11-20T17:17:13.599Z+ retry=14
9962025-11-20T17:17:13.599Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
9972025-11-20T17:17:13.627Z+ [[ 14 -gt 300 ]]
9982025-11-20T17:17:13.627Z+ sleep 1
 
9992025-11-20T17:17:14.595ZNov 20 17:17:14 buskin ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
 
10002025-11-20T17:17:14.607Z+ retry=15
10012025-11-20T17:17:14.607Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10022025-11-20T17:17:14.632Z+ [[ 15 -gt 300 ]]
10032025-11-20T17:17:14.632Z+ sleep 1
 
10042025-11-20T17:17:15.201ZNov 20 17:17:14 buskin ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
 
10052025-11-20T17:17:15.617Z+ retry=16
10062025-11-20T17:17:15.617Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10072025-11-20T17:17:15.641Z+ [[ 16 -gt 300 ]]
10082025-11-20T17:17:15.641Z+ sleep 1
 
10092025-11-20T17:17:16.383ZNov 20 17:17:15 buskin ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
10102025-11-20T17:17:16.450ZNov 20 17:17:15 buskin ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
 
10112025-11-20T17:17:16.628Z+ retry=17
10122025-11-20T17:17:16.628Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10132025-11-20T17:17:16.653Z+ [[ 17 -gt 300 ]]
10142025-11-20T17:17:16.653Z+ sleep 1
10152025-11-20T17:17:17.638Z+ retry=18
10162025-11-20T17:17:17.638Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10172025-11-20T17:17:17.663Z+ [[ 18 -gt 300 ]]
10182025-11-20T17:17:17.663Z+ sleep 1
10192025-11-20T17:17:18.648Z+ retry=19
10202025-11-20T17:17:18.649Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10212025-11-20T17:17:18.673Z+ [[ 19 -gt 300 ]]
10222025-11-20T17:17:18.673Z+ sleep 1
10232025-11-20T17:17:19.655Z+ retry=20
10242025-11-20T17:17:19.655Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10252025-11-20T17:17:19.680Z+ [[ 20 -gt 300 ]]
10262025-11-20T17:17:19.680Z+ sleep 1
10272025-11-20T17:17:20.664Z+ retry=21
10282025-11-20T17:17:20.664Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10292025-11-20T17:17:20.688Z+ [[ 21 -gt 300 ]]
10302025-11-20T17:17:20.688Z+ sleep 1
10312025-11-20T17:17:21.673Z+ retry=22
10322025-11-20T17:17:21.673Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10332025-11-20T17:17:21.698Z+ [[ 22 -gt 300 ]]
10342025-11-20T17:17:21.698Z+ sleep 1
10352025-11-20T17:17:22.686Z+ retry=23
10362025-11-20T17:17:22.686Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10372025-11-20T17:17:22.710Z+ [[ 23 -gt 300 ]]
10382025-11-20T17:17:22.710Z+ sleep 1
10392025-11-20T17:17:23.695Z+ retry=24
10402025-11-20T17:17:23.695Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10412025-11-20T17:17:23.720Z+ [[ 24 -gt 300 ]]
10422025-11-20T17:17:23.720Z+ sleep 1
10432025-11-20T17:17:24.704Z+ retry=25
10442025-11-20T17:17:24.704Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10452025-11-20T17:17:24.729Z+ [[ 25 -gt 300 ]]
10462025-11-20T17:17:24.729Z+ sleep 1
10472025-11-20T17:17:25.713Z+ retry=26
10482025-11-20T17:17:25.713Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10492025-11-20T17:17:25.737Z+ [[ 26 -gt 300 ]]
10502025-11-20T17:17:25.737Z+ sleep 1
10512025-11-20T17:17:26.721Z+ retry=27
10522025-11-20T17:17:26.721Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10532025-11-20T17:17:26.746Z+ [[ 27 -gt 300 ]]
10542025-11-20T17:17:26.746Z+ sleep 1
10552025-11-20T17:17:27.731Z+ retry=28
10562025-11-20T17:17:27.731Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10572025-11-20T17:17:27.755Z+ [[ 28 -gt 300 ]]
10582025-11-20T17:17:27.755Z+ sleep 1
10592025-11-20T17:17:28.740Z+ retry=29
10602025-11-20T17:17:28.740Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10612025-11-20T17:17:28.764Z+ [[ 29 -gt 300 ]]
10622025-11-20T17:17:28.764Z+ sleep 1
10632025-11-20T17:17:29.748Z+ retry=30
10642025-11-20T17:17:29.748Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10652025-11-20T17:17:29.773Z+ [[ 30 -gt 300 ]]
10662025-11-20T17:17:29.773Z+ sleep 1
10672025-11-20T17:17:30.757Z+ retry=31
10682025-11-20T17:17:30.757Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10692025-11-20T17:17:30.782Z+ [[ 31 -gt 300 ]]
10702025-11-20T17:17:30.782Z+ sleep 1
10712025-11-20T17:17:31.766Z+ retry=32
10722025-11-20T17:17:31.766Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10732025-11-20T17:17:31.790Z+ [[ 32 -gt 300 ]]
10742025-11-20T17:17:31.790Z+ sleep 1
10752025-11-20T17:17:32.775Z+ retry=33
10762025-11-20T17:17:32.775Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10772025-11-20T17:17:32.799Z+ [[ 33 -gt 300 ]]
10782025-11-20T17:17:32.799Z+ sleep 1
10792025-11-20T17:17:33.783Z+ retry=34
10802025-11-20T17:17:33.783Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10812025-11-20T17:17:33.808Z+ [[ 34 -gt 300 ]]
10822025-11-20T17:17:33.808Z+ sleep 1
10832025-11-20T17:17:34.792Z+ retry=35
10842025-11-20T17:17:34.792Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10852025-11-20T17:17:34.816Z+ [[ 35 -gt 300 ]]
10862025-11-20T17:17:34.816Z+ sleep 1
10872025-11-20T17:17:35.800Z+ retry=36
10882025-11-20T17:17:35.801Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10892025-11-20T17:17:35.825Z+ [[ 36 -gt 300 ]]
10902025-11-20T17:17:35.825Z+ sleep 1
10912025-11-20T17:17:36.809Z+ retry=37
10922025-11-20T17:17:36.809Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10932025-11-20T17:17:36.834Z+ [[ 37 -gt 300 ]]
10942025-11-20T17:17:36.834Z+ sleep 1
10952025-11-20T17:17:37.818Z+ retry=38
10962025-11-20T17:17:37.818Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
10972025-11-20T17:17:37.843Z+ [[ 38 -gt 300 ]]
10982025-11-20T17:17:37.843Z+ sleep 1
10992025-11-20T17:17:38.827Z+ retry=39
11002025-11-20T17:17:38.827Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11012025-11-20T17:17:38.852Z+ [[ 39 -gt 300 ]]
11022025-11-20T17:17:38.852Z+ sleep 1
11032025-11-20T17:17:39.836Z+ retry=40
11042025-11-20T17:17:39.836Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11052025-11-20T17:17:39.860Z+ [[ 40 -gt 300 ]]
11062025-11-20T17:17:39.860Z+ sleep 1
11072025-11-20T17:17:40.844Z+ retry=41
11082025-11-20T17:17:40.844Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11092025-11-20T17:17:40.869Z+ [[ 41 -gt 300 ]]
11102025-11-20T17:17:40.869Z+ sleep 1
11112025-11-20T17:17:41.852Z+ retry=42
11122025-11-20T17:17:41.853Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11132025-11-20T17:17:41.877Z+ [[ 42 -gt 300 ]]
11142025-11-20T17:17:41.877Z+ sleep 1
11152025-11-20T17:17:42.861Z+ retry=43
11162025-11-20T17:17:42.861Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11172025-11-20T17:17:42.885Z+ [[ 43 -gt 300 ]]
11182025-11-20T17:17:42.886Z+ sleep 1
11192025-11-20T17:17:43.869Z+ retry=44
11202025-11-20T17:17:43.870Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11212025-11-20T17:17:43.895Z+ [[ 44 -gt 300 ]]
11222025-11-20T17:17:43.895Z+ sleep 1
11232025-11-20T17:17:44.879Z+ retry=45
11242025-11-20T17:17:44.879Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11252025-11-20T17:17:44.903Z+ [[ 45 -gt 300 ]]
11262025-11-20T17:17:44.903Z+ sleep 1
11272025-11-20T17:17:45.887Z+ retry=46
11282025-11-20T17:17:45.888Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11292025-11-20T17:17:45.912Z+ [[ 46 -gt 300 ]]
11302025-11-20T17:17:45.912Z+ sleep 1
11312025-11-20T17:17:46.896Z+ retry=47
11322025-11-20T17:17:46.896Z+ grep 'Handoff to Nexus is complete' /var/svc/log/oxide-sled-agent:default.log
11332025-11-20T17:17:46.921Z{"msg":"Handoff to Nexus is complete","v":0,"name":"SledAgent","level":30,"time":"2025-11-20T17:17:46.648599096Z","hostname":"buskin","pid":1567,"component":"RSS","file":"sled-agent/src/rack_setup/service.rs:1061"}
11342025-11-20T17:17:46.921Z+ echo 'Waited for handoff: 47s'
11352025-11-20T17:17:46.921ZWaited for handoff: 47s
11362025-11-20T17:17:46.921Z+ retry=0
11372025-11-20T17:17:46.921Z++ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db inventory collections list
11382025-11-20T17:17:46.921Z++ wc -l
11392025-11-20T17:17:47.050Znote: database URL not specified. Will search DNS.
11402025-11-20T17:17:47.050Znote: (override with --db-url or OMDB_DB_URL)
11412025-11-20T17:17:47.075Znote: using DNS server for subnet fd00:1122:3344::/48
11422025-11-20T17:17:47.075Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11432025-11-20T17:17:47.075Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
11442025-11-20T17:17:47.119Znote: database schema version matches expected (211.0.0)
11452025-11-20T17:17:47.179Z+ INVENTORY_COLLECTION_COUNT=' 4'
11462025-11-20T17:17:47.204Z+ [[ 4 -gt 1 ]]
11472025-11-20T17:17:47.204Z+ echo 'Waited for inventory collection: 0s'
11482025-11-20T17:17:47.204Z+ retry=0
11492025-11-20T17:17:47.204ZWaited for inventory collection: 0s
11502025-11-20T17:17:47.204Z++ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i
11512025-11-20T17:17:47.204Z++ wc -l
11522025-11-20T17:17:47.229Znote: database URL not specified. Will search DNS.
11532025-11-20T17:17:47.229Znote: (override with --db-url or OMDB_DB_URL)
11542025-11-20T17:17:47.229Znote: using DNS server for subnet fd00:1122:3344::/48
11552025-11-20T17:17:47.229Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11562025-11-20T17:17:47.229Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
11572025-11-20T17:17:47.253Znote: database schema version matches expected (211.0.0)
11582025-11-20T17:17:47.436Z+ ACTUAL_ZPOOL_COUNT=' 9'
11592025-11-20T17:17:47.460Z+ [[ 9 -eq 9 ]]
11602025-11-20T17:17:47.460Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb nexus fetch-omdb /tmp/fetched-omdb
11612025-11-20T17:17:47.485Znote: Nexus URL not specified. Will pick one from DNS.
11622025-11-20T17:17:47.485Znote: using DNS server for subnet fd00:1122:3344::/48
11632025-11-20T17:17:47.485Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11642025-11-20T17:17:47.485Znote: using Nexus URL http://[fd00:1122:3344:101::c]:12232
11652025-11-20T17:17:49.845Z+ pfexec zlogin oxz_switch /tmp/fetched-omdb db inventory collections list
11662025-11-20T17:17:49.882Znote: database URL not specified. Will search DNS.
11672025-11-20T17:17:49.882Znote: (override with --db-url or OMDB_DB_URL)
11682025-11-20T17:17:49.882Znote: using DNS server for subnet fd00:1122:3344::/48
11692025-11-20T17:17:49.882Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11702025-11-20T17:17:49.906Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
11712025-11-20T17:17:49.906Znote: database schema version matches expected (211.0.0)
11722025-11-20T17:17:49.931ZID STARTED TOOK NSPS NERRORS
11732025-11-20T17:17:49.931Z6573340d-d4ee-4a18-ab4e-e0cae3c84051 2025-11-20T17:17:21Z 1645 ms 2 0
11742025-11-20T17:17:49.931Ze9de2af3-35e1-4091-a2be-a0bc89bed39b 2025-11-20T17:17:44Z 537 ms 2 0
11752025-11-20T17:17:49.931Z10152ab7-67b4-40e7-a642-40b235648594 2025-11-20T17:17:46Z 511 ms 2 0
11762025-11-20T17:17:49.931Z43ca87f4-5ab6-40c1-b65f-2f880873a128 2025-11-20T17:17:48Z 318 ms 2 0
11772025-11-20T17:17:49.955Z+ echo 'Confirmed switch zone omdb can fetch a usable omdb from Nexus'
11782025-11-20T17:17:49.955ZConfirmed switch zone omdb can fetch a usable omdb from Nexus
11792025-11-20T17:17:49.955Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list
11802025-11-20T17:17:49.980Znote: database URL not specified. Will search DNS.
11812025-11-20T17:17:49.980Znote: (override with --db-url or OMDB_DB_URL)
11822025-11-20T17:17:49.980Znote: using DNS server for subnet fd00:1122:3344::/48
11832025-11-20T17:17:49.980Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
11842025-11-20T17:17:49.980Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
11852025-11-20T17:17:50.004Znote: database schema version matches expected (211.0.0)
11862025-11-20T17:17:50.138ZID |TIME_DELETED |SLED_ID |PHYSICAL_DISK_ID |TOTAL_SIZE |CONTROL_PLANE_STORAGE_BUFFER
11872025-11-20T17:17:50.138Z-------------------------------------+-------------+-------------------------------------+-------------------------------------+------------+-----------------------------
11882025-11-20T17:17:50.138Z0949f092-4321-4675-a59f-ca080d289ddd | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |78a08e6e-2b9b-4848-bc40-84a9fbb02540 |20937965568 |268435456000
11892025-11-20T17:17:50.138Z62a83fb4-08ff-43fb-936b-e04df192a7f1 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |37b25432-331e-4357-b214-17058e19ecf8 |20937965568 |268435456000
11902025-11-20T17:17:50.138Z6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |4ad09e0b-9c36-46d9-b8c8-d6dbb2e3189c |20937965568 |268435456000
11912025-11-20T17:17:50.138Z9df57238-6136-42f2-b59f-cd2639b21a40 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |fe7f9b53-d644-4a6d-8219-b925fa9c8a04 |20937965568 |268435456000
11922025-11-20T17:17:50.138Za4e5f091-097a-4e30-9a30-3da744d92ec5 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |0655228a-ae8e-4a32-adb2-450c7173d73e |20937965568 |268435456000
11932025-11-20T17:17:50.138Za6f08b8b-db33-4adb-bc91-ad6cab10227e | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |0db73dc0-9a8b-4e32-957c-a41807f5cd04 |20937965568 |268435456000
11942025-11-20T17:17:50.138Zae3fc226-efac-432d-9185-68a0cb33e17e | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |de3719d5-c65f-41b9-8d39-4e7e64c687a5 |20937965568 |268435456000
11952025-11-20T17:17:50.138Zc27d15f0-c997-49b9-b613-18813516cf60 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |6a2cd444-4d54-46a0-bc9b-41d8c199cca1 |20937965568 |268435456000
11962025-11-20T17:17:50.138Ze2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |70078df3-97c0-4bb2-8b11-e4c22c028a77 |20937965568 |268435456000
11972025-11-20T17:17:50.163Z++ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i
11982025-11-20T17:17:50.187Znote: database URL not specified. Will search DNS.
11992025-11-20T17:17:50.187Znote: (override with --db-url or OMDB_DB_URL)
12002025-11-20T17:17:50.187Znote: using DNS server for subnet fd00:1122:3344::/48
12012025-11-20T17:17:50.187Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12022025-11-20T17:17:50.212Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12032025-11-20T17:17:50.212Znote: database schema version matches expected (211.0.0)
12042025-11-20T17:17:50.367Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12052025-11-20T17:17:50.367Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 0949f092-4321-4675-a59f-ca080d289ddd 0
12062025-11-20T17:17:50.405Znote: database URL not specified. Will search DNS.
12072025-11-20T17:17:50.405Znote: (override with --db-url or OMDB_DB_URL)
12082025-11-20T17:17:50.405Znote: using DNS server for subnet fd00:1122:3344::/48
12092025-11-20T17:17:50.405Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12102025-11-20T17:17:50.430Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12112025-11-20T17:17:50.430Znote: database schema version matches expected (211.0.0)
12122025-11-20T17:17:50.486Zset pool 0949f092-4321-4675-a59f-ca080d289ddd control plane storage buffer bytes to 0
12132025-11-20T17:17:50.510Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12142025-11-20T17:17:50.510Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 62a83fb4-08ff-43fb-936b-e04df192a7f1 0
12152025-11-20T17:17:50.534Znote: database URL not specified. Will search DNS.
12162025-11-20T17:17:50.534Znote: (override with --db-url or OMDB_DB_URL)
12172025-11-20T17:17:50.534Znote: using DNS server for subnet fd00:1122:3344::/48
12182025-11-20T17:17:50.534Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12192025-11-20T17:17:50.559Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12202025-11-20T17:17:50.559Znote: database schema version matches expected (211.0.0)
12212025-11-20T17:17:50.617Zset pool 62a83fb4-08ff-43fb-936b-e04df192a7f1 control plane storage buffer bytes to 0
12222025-11-20T17:17:50.642Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12232025-11-20T17:17:50.642Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db 0
12242025-11-20T17:17:50.666Znote: database URL not specified. Will search DNS.
12252025-11-20T17:17:50.666Znote: (override with --db-url or OMDB_DB_URL)
12262025-11-20T17:17:50.666Znote: using DNS server for subnet fd00:1122:3344::/48
12272025-11-20T17:17:50.666Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12282025-11-20T17:17:50.691Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12292025-11-20T17:17:50.691Znote: database schema version matches expected (211.0.0)
12302025-11-20T17:17:50.745Zset pool 6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db control plane storage buffer bytes to 0
12312025-11-20T17:17:50.770Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12322025-11-20T17:17:50.770Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer 9df57238-6136-42f2-b59f-cd2639b21a40 0
12332025-11-20T17:17:50.794Znote: database URL not specified. Will search DNS.
12342025-11-20T17:17:50.794Znote: (override with --db-url or OMDB_DB_URL)
12352025-11-20T17:17:50.794Znote: using DNS server for subnet fd00:1122:3344::/48
12362025-11-20T17:17:50.794Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12372025-11-20T17:17:50.794Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12382025-11-20T17:17:50.819Znote: database schema version matches expected (211.0.0)
12392025-11-20T17:17:50.871Zset pool 9df57238-6136-42f2-b59f-cd2639b21a40 control plane storage buffer bytes to 0
12402025-11-20T17:17:50.896Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12412025-11-20T17:17:50.896Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer a4e5f091-097a-4e30-9a30-3da744d92ec5 0
12422025-11-20T17:17:50.923Znote: database URL not specified. Will search DNS.
12432025-11-20T17:17:50.923Znote: (override with --db-url or OMDB_DB_URL)
12442025-11-20T17:17:50.923Znote: using DNS server for subnet fd00:1122:3344::/48
12452025-11-20T17:17:50.923Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12462025-11-20T17:17:50.947Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12472025-11-20T17:17:50.947Znote: database schema version matches expected (211.0.0)
12482025-11-20T17:17:51.007Zset pool a4e5f091-097a-4e30-9a30-3da744d92ec5 control plane storage buffer bytes to 0
12492025-11-20T17:17:51.032Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12502025-11-20T17:17:51.032Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer a6f08b8b-db33-4adb-bc91-ad6cab10227e 0
12512025-11-20T17:17:51.078Znote: database URL not specified. Will search DNS.
12522025-11-20T17:17:51.078Znote: (override with --db-url or OMDB_DB_URL)
12532025-11-20T17:17:51.078Znote: using DNS server for subnet fd00:1122:3344::/48
12542025-11-20T17:17:51.078Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12552025-11-20T17:17:51.103Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12562025-11-20T17:17:51.131Znote: database schema version matches expected (211.0.0)
12572025-11-20T17:17:51.294Zset pool a6f08b8b-db33-4adb-bc91-ad6cab10227e control plane storage buffer bytes to 0
12582025-11-20T17:17:51.318Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12592025-11-20T17:17:51.318Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer ae3fc226-efac-432d-9185-68a0cb33e17e 0
12602025-11-20T17:17:51.360Znote: database URL not specified. Will search DNS.
12612025-11-20T17:17:51.360Znote: (override with --db-url or OMDB_DB_URL)
12622025-11-20T17:17:51.360Znote: using DNS server for subnet fd00:1122:3344::/48
12632025-11-20T17:17:51.360Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12642025-11-20T17:17:51.385Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12652025-11-20T17:17:51.410Znote: database schema version matches expected (211.0.0)
12662025-11-20T17:17:51.469Zset pool ae3fc226-efac-432d-9185-68a0cb33e17e control plane storage buffer bytes to 0
12672025-11-20T17:17:51.494Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12682025-11-20T17:17:51.494Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer c27d15f0-c997-49b9-b613-18813516cf60 0
12692025-11-20T17:17:51.534Znote: database URL not specified. Will search DNS.
12702025-11-20T17:17:51.534Znote: (override with --db-url or OMDB_DB_URL)
12712025-11-20T17:17:51.534Znote: using DNS server for subnet fd00:1122:3344::/48
12722025-11-20T17:17:51.534Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12732025-11-20T17:17:51.534Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12742025-11-20T17:17:51.560Znote: database schema version matches expected (211.0.0)
12752025-11-20T17:17:51.630Zset pool c27d15f0-c997-49b9-b613-18813516cf60 control plane storage buffer bytes to 0
12762025-11-20T17:17:51.654Z+ for ZPOOL in $(pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list -i)
12772025-11-20T17:17:51.654Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb -w db zpool set-storage-buffer e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2 0
12782025-11-20T17:17:51.685Znote: database URL not specified. Will search DNS.
12792025-11-20T17:17:51.685Znote: (override with --db-url or OMDB_DB_URL)
12802025-11-20T17:17:51.685Znote: using DNS server for subnet fd00:1122:3344::/48
12812025-11-20T17:17:51.685Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12822025-11-20T17:17:51.709Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12832025-11-20T17:17:51.709Znote: database schema version matches expected (211.0.0)
12842025-11-20T17:17:51.771Zset pool e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2 control plane storage buffer bytes to 0
12852025-11-20T17:17:51.795Z+ pfexec zlogin oxz_switch /opt/oxide/omdb/bin/omdb db zpool list
12862025-11-20T17:17:51.828Znote: database URL not specified. Will search DNS.
12872025-11-20T17:17:51.828Znote: (override with --db-url or OMDB_DB_URL)
12882025-11-20T17:17:51.829Znote: using DNS server for subnet fd00:1122:3344::/48
12892025-11-20T17:17:51.829Znote: (if this is not right, use --dns-server to specify an alternate DNS server)
12902025-11-20T17:17:51.853Znote: using database URL postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::3]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221/omicron?sslmode=disable
12912025-11-20T17:17:51.853Znote: database schema version matches expected (211.0.0)
12922025-11-20T17:17:52.019ZID |TIME_DELETED |SLED_ID |PHYSICAL_DISK_ID |TOTAL_SIZE |CONTROL_PLANE_STORAGE_BUFFER
12932025-11-20T17:17:52.019Z-------------------------------------+-------------+-------------------------------------+-------------------------------------+------------+-----------------------------
12942025-11-20T17:17:52.019Z0949f092-4321-4675-a59f-ca080d289ddd | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |78a08e6e-2b9b-4848-bc40-84a9fbb02540 |20937965568 |0
12952025-11-20T17:17:52.019Z62a83fb4-08ff-43fb-936b-e04df192a7f1 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |37b25432-331e-4357-b214-17058e19ecf8 |20937965568 |0
12962025-11-20T17:17:52.019Z6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |4ad09e0b-9c36-46d9-b8c8-d6dbb2e3189c |20937965568 |0
12972025-11-20T17:17:52.019Z9df57238-6136-42f2-b59f-cd2639b21a40 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |fe7f9b53-d644-4a6d-8219-b925fa9c8a04 |20937965568 |0
12982025-11-20T17:17:52.019Za4e5f091-097a-4e30-9a30-3da744d92ec5 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |0655228a-ae8e-4a32-adb2-450c7173d73e |20937965568 |0
12992025-11-20T17:17:52.020Za6f08b8b-db33-4adb-bc91-ad6cab10227e | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |0db73dc0-9a8b-4e32-957c-a41807f5cd04 |20937965568 |0
13002025-11-20T17:17:52.020Zae3fc226-efac-432d-9185-68a0cb33e17e | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |de3719d5-c65f-41b9-8d39-4e7e64c687a5 |20937965568 |0
13012025-11-20T17:17:52.020Zc27d15f0-c997-49b9-b613-18813516cf60 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |6a2cd444-4d54-46a0-bc9b-41d8c199cca1 |20937965568 |0
13022025-11-20T17:17:52.020Ze2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2 | |1157dcd6-6803-4ffd-82ec-10f81d2538fd |70078df3-97c0-4bb2-8b11-e4c22c028a77 |20937965568 |0
13032025-11-20T17:17:52.045Z+ export RUST_BACKTRACE=1
13042025-11-20T17:17:52.045Z+ RUST_BACKTRACE=1
13052025-11-20T17:17:52.045Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
13062025-11-20T17:17:52.045Z++ ./target/debug/bootstrap
13072025-11-20T17:17:52.281ZUsing external DNS server at 10.151.1.164:53
13082025-11-20T17:17:52.306Z2025-11-20 17:17:52.285012136 UTC: attempting to log into API
13092025-11-20T17:17:53.807Z2025-11-20 17:17:53.793819387 UTC: login succeeded
13102025-11-20T17:17:53.839Zwaiting for nexus to come up...
13112025-11-20T17:17:53.924Zcreating IPv4 IP pool... 10.151.1.175 - 10.151.1.227
13122025-11-20T17:17:54.436Zsetting up quotas...
13132025-11-20T17:17:54.519Zensuring datasets are ready...
13142025-11-20T17:17:58.325Zlet's roll.
13152025-11-20T17:17:58.350Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
13162025-11-20T17:17:58.350ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.168
13172025-11-20T17:17:58.350ZOXIDE_TOKEN=oxide-token-94f42c1da4ee4cd00f7be48de50e48753d0dc730'
13182025-11-20T17:17:58.350Z++ OXIDE_HOST=https://recovery.sys.oxide.test
13192025-11-20T17:17:58.350Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.168
13202025-11-20T17:17:58.350Z++ OXIDE_TOKEN=oxide-token-94f42c1da4ee4cd00f7be48de50e48753d0dc730
13212025-11-20T17:17:58.350Z+ export OXIDE_HOST OXIDE_TOKEN
13222025-11-20T17:17:58.350Z+ retry=0
13232025-11-20T17:17:58.350Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13242025-11-20T17:17:58.415Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
13252025-11-20T17:17:59.253Z{"status":"ok"}{
13262025-11-20T17:17:59.253Z "description": "some images",
13272025-11-20T17:17:59.253Z "id": "42e57e98-2988-4851-843f-184640ead2d8",
13282025-11-20T17:17:59.253Z "name": "images",
13292025-11-20T17:17:59.253Z "time_created": "2025-11-20T17:17:58.520438Z",
13302025-11-20T17:17:59.253Z "time_modified": "2025-11-20T17:17:58.520438Z"
13312025-11-20T17:17:59.253Z}
13322025-11-20T17:17:59.278Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 --parallelism 1
13332025-11-20T17:29:05.779ZDone!
13342025-11-20T17:29:05.803Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
13352025-11-20T17:29:05.921Z{
13362025-11-20T17:29:05.921Z "block_size": 512,
13372025-11-20T17:29:05.921Z "description": "debian 11 original base image",
13382025-11-20T17:29:05.921Z "id": "7f6b8fe6-6732-4026-b363-97aae921ec3f",
13392025-11-20T17:29:05.921Z "name": "debian11",
13402025-11-20T17:29:05.921Z "os": "debian",
13412025-11-20T17:29:05.921Z "size": 2147483648,
13422025-11-20T17:29:05.922Z "time_created": "2025-11-20T17:29:05.631449Z",
13432025-11-20T17:29:05.922Z "time_modified": "2025-11-20T17:29:05.902157Z",
13442025-11-20T17:29:05.922Z "version": "11"
13452025-11-20T17:29:05.922Z}
13462025-11-20T17:29:05.946Z+ for test_bin in tests/*
13472025-11-20T17:29:05.946Z+ ./tests/bootstrap-a1752e91d8bf1274
13482025-11-20T17:29:05.946Z
13492025-11-20T17:29:05.946Zrunning 0 tests
13502025-11-20T17:29:05.946Z
13512025-11-20T17:29:05.946Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13522025-11-20T17:29:05.946Z
13532025-11-20T17:29:05.946Z+ for test_bin in tests/*
13542025-11-20T17:29:05.946Z+ ./tests/commtest-635471e46e7ef3ca
13552025-11-20T17:29:05.971Z
13562025-11-20T17:29:05.971Zrunning 0 tests
13572025-11-20T17:29:05.971Z
13582025-11-20T17:29:05.971Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13592025-11-20T17:29:05.971Z
13602025-11-20T17:29:05.971Z+ for test_bin in tests/*
13612025-11-20T17:29:05.971Z+ ./tests/dhcp_server-db23293cb38ad620
13622025-11-20T17:29:05.971Z
13632025-11-20T17:29:05.971Zrunning 0 tests
13642025-11-20T17:29:05.971Z
13652025-11-20T17:29:05.971Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13662025-11-20T17:29:05.971Z
13672025-11-20T17:29:05.971Z+ for test_bin in tests/*
13682025-11-20T17:29:05.971Z+ ./tests/end_to_end_tests-14c0b2efde98dc3b
13692025-11-20T17:29:06.113Z
13702025-11-20T17:29:06.113Zrunning 3 tests
13712025-11-20T17:29:06.137Znote: configured to log to "/tmp/end_to_end_tests-14c0b2efde98dc3b-new_blueprint_noop.2213.0.log"
13722025-11-20T17:29:06.512Ztest no_spoof::no_spoof_here ... ok
13732025-11-20T17:29:06.981Ztest noop_blueprint::new_blueprint_noop ... ok
13742025-11-20T17:29:36.218Ztest instance_launch::instance_launch ... ok
13752025-11-20T17:29:36.219Z
13762025-11-20T17:29:36.219Ztest result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 30.11s
13772025-11-20T17:29:36.219Z
13782025-11-20T17:29:36.244Z+ _exit_trap
13792025-11-20T17:29:36.244Z+ local status=0
13802025-11-20T17:29:36.244Z+ set +o errexit
13812025-11-20T17:29:36.244Z+ [[ x != \x ]]
13822025-11-20T17:29:36.244Z+ pfexec svcadm -Z disable -s cron
13832025-11-20T17:29:38.202Z+ [[ 0 -eq 0 ]]
13842025-11-20T17:29:38.203Z+ exit 0
13852025-11-20T17:29:38.227Zprocess exited: duration 935280 ms, exit code 0
 
13862025-11-20T17:29:38.346Zfound 110 output files
13872025-11-20T17:29:38.346Zuploading: /var/svc/log/oxide-mg-ddm:default.log (343620 bytes)
13882025-11-20T17:29:38.531Zupload warning: file "/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 343620 -> 344017
13892025-11-20T17:29:39.607Zuploaded: /var/svc/log/oxide-mg-ddm:default.log
13902025-11-20T17:29:39.608Zuploading: /var/svc/log/oxide-sled-agent:default.log (3144108 bytes)
13912025-11-20T17:29:40.993Zuploaded: /var/svc/log/oxide-sled-agent:default.log
13922025-11-20T17:29:41.025Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (15790946 bytes)
13932025-11-20T17:29:42.162Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 15790946 -> 15843553
13942025-11-20T17:29:42.827Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
13952025-11-20T17:29:42.827Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (41517 bytes)
13962025-11-20T17:29:45.014Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
13972025-11-20T17:29:45.015Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (363831 bytes)
13982025-11-20T17:29:45.240Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 363831 -> 366209
13992025-11-20T17:29:46.310Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
14002025-11-20T17:29:46.310Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (488835 bytes)
14012025-11-20T17:29:46.556Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 488835 -> 492399
14022025-11-20T17:29:47.631Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
14032025-11-20T17:29:47.659Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (3971862 bytes)
14042025-11-20T17:29:48.020Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 3971862 -> 3998757
14052025-11-20T17:29:49.091Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
14062025-11-20T17:29:49.120Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (6625351 bytes)
14072025-11-20T17:29:49.557Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 6625351 -> 6703889
14082025-11-20T17:29:50.627Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
14092025-11-20T17:29:50.627Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (3336 bytes)
14102025-11-20T17:29:51.722Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
14112025-11-20T17:29:51.722Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (519090 bytes)
14122025-11-20T17:29:51.975Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 519090 -> 527331
14132025-11-20T17:29:53.049Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
14142025-11-20T17:29:53.073Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (14973 bytes)
14152025-11-20T17:29:53.117Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 14973 -> 15558
14162025-11-20T17:29:54.187Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
14172025-11-20T17:29:54.187Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3847 bytes)
14182025-11-20T17:29:55.281Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
14192025-11-20T17:29:55.282Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (2341 bytes)
14202025-11-20T17:29:56.376Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
14212025-11-20T17:29:56.402Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-agent:default.log (28619 bytes)
14222025-11-20T17:29:57.520Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-agent:default.log
14232025-11-20T17:29:57.520Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14242025-11-20T17:29:58.616Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-downstairs:default.log
14252025-11-20T17:29:58.616Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-downstairs:downstairs-919b001a-67e1-4194-b537-3a9144a572ef.log (6109 bytes)
14262025-11-20T17:29:59.711Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-downstairs:downstairs-919b001a-67e1-4194-b537-3a9144a572ef.log
14272025-11-20T17:29:59.711Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-downstairs:downstairs-99c1e8df-c8b0-439c-b58e-100080b9d4ca.log (3126 bytes)
14282025-11-20T17:30:00.805Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-downstairs:downstairs-99c1e8df-c8b0-439c-b58e-100080b9d4ca.log
14292025-11-20T17:30:00.806Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-downstairs:snapshot-919b001a-67e1-4194-b537-3a9144a572ef-4f346ed9-024c-495a-8f6b-940dcddd6e5b.log (5677 bytes)
14302025-11-20T17:30:01.899Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-crucible-downstairs:snapshot-919b001a-67e1-4194-b537-3a9144a572ef-4f346ed9-024c-495a-8f6b-940dcddd6e5b.log
14312025-11-20T17:30:01.899Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
14322025-11-20T17:30:02.994Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_crucible_6a62735e-1c8c-43a7-ac2f-b0ae48f624a3/root/var/svc/log/oxide-zone-network-setup:default.log
14332025-11-20T17:30:02.994Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_5e431490-a2ae-4e9c-bfa0-5119ec8c3eae/root/var/svc/log/oxide-nexus:default.log (71275865 bytes)
14342025-11-20T17:30:05.682Zupload warning: file "/pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_5e431490-a2ae-4e9c-bfa0-5119ec8c3eae/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 71275865 -> 71462778
14352025-11-20T17:30:06.752Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_5e431490-a2ae-4e9c-bfa0-5119ec8c3eae/root/var/svc/log/oxide-nexus:default.log
14362025-11-20T17:30:06.752Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_5e431490-a2ae-4e9c-bfa0-5119ec8c3eae/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
14372025-11-20T17:30:07.850Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_5e431490-a2ae-4e9c-bfa0-5119ec8c3eae/root/var/svc/log/oxide-opte-interface-setup:default.log
14382025-11-20T17:30:07.850Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_5e431490-a2ae-4e9c-bfa0-5119ec8c3eae/root/var/svc/log/oxide-zone-network-setup:default.log (2055 bytes)
14392025-11-20T17:30:08.948Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_5e431490-a2ae-4e9c-bfa0-5119ec8c3eae/root/var/svc/log/oxide-zone-network-setup:default.log
14402025-11-20T17:30:08.948Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_61dbaadc-58db-4630-af5f-a16a5198754d/root/var/svc/log/oxide-nexus:default.log (12372580 bytes)
14412025-11-20T17:30:09.630Zupload warning: file "/pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_61dbaadc-58db-4630-af5f-a16a5198754d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 12372580 -> 12556283
14422025-11-20T17:30:10.700Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_61dbaadc-58db-4630-af5f-a16a5198754d/root/var/svc/log/oxide-nexus:default.log
14432025-11-20T17:30:10.700Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_61dbaadc-58db-4630-af5f-a16a5198754d/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
14442025-11-20T17:30:11.794Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_61dbaadc-58db-4630-af5f-a16a5198754d/root/var/svc/log/oxide-opte-interface-setup:default.log
14452025-11-20T17:30:11.795Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_61dbaadc-58db-4630-af5f-a16a5198754d/root/var/svc/log/oxide-zone-network-setup:default.log (2056 bytes)
14462025-11-20T17:30:12.889Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_nexus_61dbaadc-58db-4630-af5f-a16a5198754d/root/var/svc/log/oxide-zone-network-setup:default.log
14472025-11-20T17:30:12.930Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_oximeter_64956c81-06a9-401c-97c8-6a76a831b36d/root/var/svc/log/oxide-oximeter:default.log (4610110 bytes)
14482025-11-20T17:30:13.339Zupload warning: file "/pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_oximeter_64956c81-06a9-401c-97c8-6a76a831b36d/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 4610110 -> 4832355
14492025-11-20T17:30:14.409Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_oximeter_64956c81-06a9-401c-97c8-6a76a831b36d/root/var/svc/log/oxide-oximeter:default.log
14502025-11-20T17:30:14.433Zuploading: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_oximeter_64956c81-06a9-401c-97c8-6a76a831b36d/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
14512025-11-20T17:30:15.502Zuploaded: /pool/ext/0949f092-4321-4675-a59f-ca080d289ddd/crypt/zone/oxz_oximeter_64956c81-06a9-401c-97c8-6a76a831b36d/root/var/svc/log/oxide-zone-network-setup:default.log
14522025-11-20T17:30:15.502Zuploading: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_cockroachdb_813482f3-a6a2-4f32-a19e-94b7bba03d02/root/var/svc/log/oxide-cockroach-admin:default.log (69178 bytes)
14532025-11-20T17:30:16.685Zuploaded: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_cockroachdb_813482f3-a6a2-4f32-a19e-94b7bba03d02/root/var/svc/log/oxide-cockroach-admin:default.log
14542025-11-20T17:30:16.685Zuploading: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_cockroachdb_813482f3-a6a2-4f32-a19e-94b7bba03d02/root/var/svc/log/oxide-cockroachdb:default.log (4323 bytes)
14552025-11-20T17:30:17.780Zuploaded: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_cockroachdb_813482f3-a6a2-4f32-a19e-94b7bba03d02/root/var/svc/log/oxide-cockroachdb:default.log
14562025-11-20T17:30:17.780Zuploading: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_cockroachdb_813482f3-a6a2-4f32-a19e-94b7bba03d02/root/var/svc/log/oxide-zone-network-setup:default.log (2101 bytes)
14572025-11-20T17:30:18.874Zuploaded: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_cockroachdb_813482f3-a6a2-4f32-a19e-94b7bba03d02/root/var/svc/log/oxide-zone-network-setup:default.log
14582025-11-20T17:30:18.898Zuploading: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_crucible_83877cab-dd62-42a4-a911-3e41b9a7f065/root/var/svc/log/oxide-crucible-agent:default.log (1985 bytes)
14592025-11-20T17:30:19.968Zuploaded: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_crucible_83877cab-dd62-42a4-a911-3e41b9a7f065/root/var/svc/log/oxide-crucible-agent:default.log
14602025-11-20T17:30:19.968Zuploading: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_crucible_83877cab-dd62-42a4-a911-3e41b9a7f065/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14612025-11-20T17:30:21.064Zuploaded: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_crucible_83877cab-dd62-42a4-a911-3e41b9a7f065/root/var/svc/log/oxide-crucible-downstairs:default.log
14622025-11-20T17:30:21.064Zuploading: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_crucible_83877cab-dd62-42a4-a911-3e41b9a7f065/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
14632025-11-20T17:30:22.162Zuploaded: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_crucible_83877cab-dd62-42a4-a911-3e41b9a7f065/root/var/svc/log/oxide-zone-network-setup:default.log
14642025-11-20T17:30:22.162Zuploading: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_internal_dns_c5c04136-3561-449e-ae0f-70074d4581b5/root/var/svc/log/oxide-internal_dns:default.log (972501 bytes)
14652025-11-20T17:30:22.438Zupload warning: file "/pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_internal_dns_c5c04136-3561-449e-ae0f-70074d4581b5/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 972501 -> 995999
14662025-11-20T17:30:23.508Zuploaded: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_internal_dns_c5c04136-3561-449e-ae0f-70074d4581b5/root/var/svc/log/oxide-internal_dns:default.log
14672025-11-20T17:30:23.508Zuploading: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_internal_dns_c5c04136-3561-449e-ae0f-70074d4581b5/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
14682025-11-20T17:30:24.603Zuploaded: /pool/ext/62a83fb4-08ff-43fb-936b-e04df192a7f1/crypt/zone/oxz_internal_dns_c5c04136-3561-449e-ae0f-70074d4581b5/root/var/svc/log/oxide-zone-network-setup:default.log
14692025-11-20T17:30:24.603Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_cockroachdb_0abc5065-7d43-440e-9ff7-de2d23962810/root/var/svc/log/oxide-cockroach-admin:default.log (77866 bytes)
14702025-11-20T17:30:24.738Zupload warning: file "/pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_cockroachdb_0abc5065-7d43-440e-9ff7-de2d23962810/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 77866 -> 82298
14712025-11-20T17:30:25.808Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_cockroachdb_0abc5065-7d43-440e-9ff7-de2d23962810/root/var/svc/log/oxide-cockroach-admin:default.log
14722025-11-20T17:30:25.832Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_cockroachdb_0abc5065-7d43-440e-9ff7-de2d23962810/root/var/svc/log/oxide-cockroachdb:default.log (4300 bytes)
14732025-11-20T17:30:26.902Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_cockroachdb_0abc5065-7d43-440e-9ff7-de2d23962810/root/var/svc/log/oxide-cockroachdb:default.log
14742025-11-20T17:30:26.903Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_cockroachdb_0abc5065-7d43-440e-9ff7-de2d23962810/root/var/svc/log/oxide-zone-network-setup:default.log (2101 bytes)
14752025-11-20T17:30:27.998Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_cockroachdb_0abc5065-7d43-440e-9ff7-de2d23962810/root/var/svc/log/oxide-zone-network-setup:default.log
14762025-11-20T17:30:27.998Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-crucible-agent:default.log (19112 bytes)
14772025-11-20T17:30:29.136Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-crucible-agent:default.log
14782025-11-20T17:30:29.136Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14792025-11-20T17:30:30.231Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-crucible-downstairs:default.log
14802025-11-20T17:30:30.231Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-crucible-downstairs:downstairs-08e796c5-ea2f-4fe5-abd4-2734ba6a957b.log (3006 bytes)
14812025-11-20T17:30:31.325Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-crucible-downstairs:downstairs-08e796c5-ea2f-4fe5-abd4-2734ba6a957b.log
14822025-11-20T17:30:31.325Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-crucible-downstairs:downstairs-c6174019-4786-4011-b541-dd0ddb2c6725.log (6000 bytes)
14832025-11-20T17:30:32.419Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-crucible-downstairs:downstairs-c6174019-4786-4011-b541-dd0ddb2c6725.log
14842025-11-20T17:30:32.419Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
14852025-11-20T17:30:33.514Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_e4a69284-7d83-4e99-9b7f-0b0ba2a01c67/root/var/svc/log/oxide-zone-network-setup:default.log
14862025-11-20T17:30:33.541Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_pantry_854c006f-7bb1-4353-9716-4b00de72fb7a/root/var/svc/log/oxide-crucible-pantry:default.log (926083 bytes)
14872025-11-20T17:30:33.789Zupload warning: file "/pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_pantry_854c006f-7bb1-4353-9716-4b00de72fb7a/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 926083 -> 939434
14882025-11-20T17:30:34.858Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_pantry_854c006f-7bb1-4353-9716-4b00de72fb7a/root/var/svc/log/oxide-crucible-pantry:default.log
14892025-11-20T17:30:34.859Zuploading: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_pantry_854c006f-7bb1-4353-9716-4b00de72fb7a/root/var/svc/log/oxide-zone-network-setup:default.log (2136 bytes)
14902025-11-20T17:30:35.954Zuploaded: /pool/ext/6ae71eb2-0d96-4d4e-a9e1-3ca99c5e13db/crypt/zone/oxz_crucible_pantry_854c006f-7bb1-4353-9716-4b00de72fb7a/root/var/svc/log/oxide-zone-network-setup:default.log
14912025-11-20T17:30:35.954Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_crucible_bdc4cf3c-9678-41e3-a4f2-1701fa500580/root/var/svc/log/oxide-crucible-agent:default.log (1984 bytes)
14922025-11-20T17:30:37.049Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_crucible_bdc4cf3c-9678-41e3-a4f2-1701fa500580/root/var/svc/log/oxide-crucible-agent:default.log
14932025-11-20T17:30:37.049Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_crucible_bdc4cf3c-9678-41e3-a4f2-1701fa500580/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14942025-11-20T17:30:38.144Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_crucible_bdc4cf3c-9678-41e3-a4f2-1701fa500580/root/var/svc/log/oxide-crucible-downstairs:default.log
14952025-11-20T17:30:38.144Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_crucible_bdc4cf3c-9678-41e3-a4f2-1701fa500580/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
14962025-11-20T17:30:39.239Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_crucible_bdc4cf3c-9678-41e3-a4f2-1701fa500580/root/var/svc/log/oxide-zone-network-setup:default.log
14972025-11-20T17:30:39.239Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_nexus_91d1d1b3-e26f-4f93-b244-1773f61f221d/root/var/svc/log/oxide-nexus:default.log (12329059 bytes)
14982025-11-20T17:30:39.931Zupload warning: file "/pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_nexus_91d1d1b3-e26f-4f93-b244-1773f61f221d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 12329059 -> 13197015
14992025-11-20T17:30:41.002Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_nexus_91d1d1b3-e26f-4f93-b244-1773f61f221d/root/var/svc/log/oxide-nexus:default.log
15002025-11-20T17:30:41.002Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_nexus_91d1d1b3-e26f-4f93-b244-1773f61f221d/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
15012025-11-20T17:30:42.096Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_nexus_91d1d1b3-e26f-4f93-b244-1773f61f221d/root/var/svc/log/oxide-opte-interface-setup:default.log
15022025-11-20T17:30:42.096Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_nexus_91d1d1b3-e26f-4f93-b244-1773f61f221d/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
15032025-11-20T17:30:43.192Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_nexus_91d1d1b3-e26f-4f93-b244-1773f61f221d/root/var/svc/log/oxide-zone-network-setup:default.log
15042025-11-20T17:30:43.192Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-chrony-setup:default.log (15277 bytes)
15052025-11-20T17:30:44.309Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-chrony-setup:default.log
15062025-11-20T17:30:44.333Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-ntp-admin:default.log (78738 bytes)
15072025-11-20T17:30:44.466Zupload warning: file "/pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-ntp-admin:default.log" changed size mid upload: 78738 -> 83411
15082025-11-20T17:30:45.536Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-ntp-admin:default.log
15092025-11-20T17:30:45.536Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-ntp:default.log (905 bytes)
15102025-11-20T17:30:45.583Zupload warning: file "/pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 905 -> 1058
15112025-11-20T17:30:46.656Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-ntp:default.log
15122025-11-20T17:30:46.656Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
15132025-11-20T17:30:47.752Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-opte-interface-setup:default.log
15142025-11-20T17:30:47.778Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-zone-network-setup:default.log (2031 bytes)
15152025-11-20T17:30:48.850Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/svc/log/oxide-zone-network-setup:default.log
15162025-11-20T17:30:48.875Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_clickhouse_4348254d-22c1-407f-af3b-c720822d5ec6/root/var/svc/log/oxide-clickhouse-admin-single:default.log (49481 bytes)
15172025-11-20T17:30:48.992Zupload warning: file "/pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_clickhouse_4348254d-22c1-407f-af3b-c720822d5ec6/root/var/svc/log/oxide-clickhouse-admin-single:default.log" changed size mid upload: 49481 -> 53256
15182025-11-20T17:30:50.070Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_clickhouse_4348254d-22c1-407f-af3b-c720822d5ec6/root/var/svc/log/oxide-clickhouse-admin-single:default.log
15192025-11-20T17:30:50.070Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_clickhouse_4348254d-22c1-407f-af3b-c720822d5ec6/root/var/svc/log/oxide-clickhouse:default.log (4055076 bytes)
15202025-11-20T17:30:50.474Zupload warning: file "/pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_clickhouse_4348254d-22c1-407f-af3b-c720822d5ec6/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 4055076 -> 4415770
15212025-11-20T17:30:51.993Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_clickhouse_4348254d-22c1-407f-af3b-c720822d5ec6/root/var/svc/log/oxide-clickhouse:default.log
15222025-11-20T17:30:51.993Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_clickhouse_4348254d-22c1-407f-af3b-c720822d5ec6/root/var/svc/log/oxide-zone-network-setup:default.log (2096 bytes)
15232025-11-20T17:30:53.087Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_clickhouse_4348254d-22c1-407f-af3b-c720822d5ec6/root/var/svc/log/oxide-zone-network-setup:default.log
15242025-11-20T17:30:53.087Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_cockroachdb_7985a74b-c87e-4adf-819a-da2ebf9ee765/root/var/svc/log/oxide-cockroach-admin:default.log (69174 bytes)
15252025-11-20T17:30:53.356Zupload warning: file "/pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_cockroachdb_7985a74b-c87e-4adf-819a-da2ebf9ee765/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 69174 -> 73607
15262025-11-20T17:30:54.427Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_cockroachdb_7985a74b-c87e-4adf-819a-da2ebf9ee765/root/var/svc/log/oxide-cockroach-admin:default.log
15272025-11-20T17:30:54.427Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_cockroachdb_7985a74b-c87e-4adf-819a-da2ebf9ee765/root/var/svc/log/oxide-cockroachdb:default.log (4326 bytes)
15282025-11-20T17:30:55.522Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_cockroachdb_7985a74b-c87e-4adf-819a-da2ebf9ee765/root/var/svc/log/oxide-cockroachdb:default.log
15292025-11-20T17:30:55.548Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_cockroachdb_7985a74b-c87e-4adf-819a-da2ebf9ee765/root/var/svc/log/oxide-zone-network-setup:default.log (2101 bytes)
15302025-11-20T17:30:56.617Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_cockroachdb_7985a74b-c87e-4adf-819a-da2ebf9ee765/root/var/svc/log/oxide-zone-network-setup:default.log
15312025-11-20T17:30:56.617Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-agent:default.log (29616 bytes)
15322025-11-20T17:30:57.778Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-agent:default.log
15332025-11-20T17:30:57.778Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15342025-11-20T17:30:58.873Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-downstairs:default.log
15352025-11-20T17:30:58.873Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-downstairs:downstairs-0c3b5349-8b6f-477c-98c3-05b14fcf181c.log (6000 bytes)
15362025-11-20T17:30:59.968Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-downstairs:downstairs-0c3b5349-8b6f-477c-98c3-05b14fcf181c.log
15372025-11-20T17:30:59.968Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-downstairs:downstairs-2893208a-fa84-4ab6-9297-fc3292ce2a71.log (3009 bytes)
15382025-11-20T17:31:01.064Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-downstairs:downstairs-2893208a-fa84-4ab6-9297-fc3292ce2a71.log
15392025-11-20T17:31:01.064Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-downstairs:downstairs-a05c8eb9-223d-4ecf-8da0-0a4482c34381.log (3127 bytes)
15402025-11-20T17:31:02.163Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-crucible-downstairs:downstairs-a05c8eb9-223d-4ecf-8da0-0a4482c34381.log
15412025-11-20T17:31:02.164Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
15422025-11-20T17:31:03.258Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_crucible_4860a88e-f84e-4141-8420-198a9aa0bc7b/root/var/svc/log/oxide-zone-network-setup:default.log
15432025-11-20T17:31:03.258Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_external_dns_3df97a9a-9cbc-40d5-8b73-432ef9593899/root/var/svc/log/oxide-external_dns:default.log (49521 bytes)
15442025-11-20T17:31:03.393Zupload warning: file "/pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_external_dns_3df97a9a-9cbc-40d5-8b73-432ef9593899/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 49521 -> 53295
15452025-11-20T17:31:04.464Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_external_dns_3df97a9a-9cbc-40d5-8b73-432ef9593899/root/var/svc/log/oxide-external_dns:default.log
15462025-11-20T17:31:04.464Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_external_dns_3df97a9a-9cbc-40d5-8b73-432ef9593899/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
15472025-11-20T17:31:05.562Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_external_dns_3df97a9a-9cbc-40d5-8b73-432ef9593899/root/var/svc/log/oxide-opte-interface-setup:default.log
15482025-11-20T17:31:05.562Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_external_dns_3df97a9a-9cbc-40d5-8b73-432ef9593899/root/var/svc/log/oxide-zone-network-setup:default.log (2112 bytes)
15492025-11-20T17:31:06.656Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_external_dns_3df97a9a-9cbc-40d5-8b73-432ef9593899/root/var/svc/log/oxide-zone-network-setup:default.log
15502025-11-20T17:31:06.656Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_internal_dns_eafde61e-1e25-4825-b65a-74e3cc1bf09e/root/var/svc/log/oxide-internal_dns:default.log (981951 bytes)
15512025-11-20T17:31:07.831Zupload warning: file "/pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_internal_dns_eafde61e-1e25-4825-b65a-74e3cc1bf09e/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 981951 -> 1027890
15522025-11-20T17:31:08.902Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_internal_dns_eafde61e-1e25-4825-b65a-74e3cc1bf09e/root/var/svc/log/oxide-internal_dns:default.log
15532025-11-20T17:31:08.902Zuploading: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_internal_dns_eafde61e-1e25-4825-b65a-74e3cc1bf09e/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
15542025-11-20T17:31:09.996Zuploaded: /pool/ext/a4e5f091-097a-4e30-9a30-3da744d92ec5/crypt/zone/oxz_internal_dns_eafde61e-1e25-4825-b65a-74e3cc1bf09e/root/var/svc/log/oxide-zone-network-setup:default.log
15552025-11-20T17:31:09.997Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_cockroachdb_8868c62e-9bc3-4a28-a0e3-8411b992ede8/root/var/svc/log/oxide-cockroach-admin:default.log (69180 bytes)
15562025-11-20T17:31:10.283Zupload warning: file "/pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_cockroachdb_8868c62e-9bc3-4a28-a0e3-8411b992ede8/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 69180 -> 73613
15572025-11-20T17:31:11.355Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_cockroachdb_8868c62e-9bc3-4a28-a0e3-8411b992ede8/root/var/svc/log/oxide-cockroach-admin:default.log
15582025-11-20T17:31:11.355Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_cockroachdb_8868c62e-9bc3-4a28-a0e3-8411b992ede8/root/var/svc/log/oxide-cockroachdb:default.log (4401 bytes)
15592025-11-20T17:31:12.450Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_cockroachdb_8868c62e-9bc3-4a28-a0e3-8411b992ede8/root/var/svc/log/oxide-cockroachdb:default.log
15602025-11-20T17:31:12.450Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_cockroachdb_8868c62e-9bc3-4a28-a0e3-8411b992ede8/root/var/svc/log/oxide-zone-network-setup:default.log (2101 bytes)
15612025-11-20T17:31:13.546Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_cockroachdb_8868c62e-9bc3-4a28-a0e3-8411b992ede8/root/var/svc/log/oxide-zone-network-setup:default.log
15622025-11-20T17:31:13.570Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-agent:default.log (38830 bytes)
15632025-11-20T17:31:14.777Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-agent:default.log
15642025-11-20T17:31:14.777Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15652025-11-20T17:31:15.874Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:default.log
15662025-11-20T17:31:15.874Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4b5d89d-62d1-4623-80b1-7f8b68f3320d.log (6001 bytes)
15672025-11-20T17:31:16.991Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4b5d89d-62d1-4623-80b1-7f8b68f3320d.log
15682025-11-20T17:31:16.991Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:downstairs-d83b2dfb-e927-4767-810f-3227f072d47b.log (6106 bytes)
15692025-11-20T17:31:18.110Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:downstairs-d83b2dfb-e927-4767-810f-3227f072d47b.log
15702025-11-20T17:31:18.110Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:downstairs-dd021a78-7655-457e-a499-9aaba01687b6.log (3124 bytes)
15712025-11-20T17:31:19.206Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:downstairs-dd021a78-7655-457e-a499-9aaba01687b6.log
15722025-11-20T17:31:19.206Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:snapshot-d83b2dfb-e927-4767-810f-3227f072d47b-4f346ed9-024c-495a-8f6b-940dcddd6e5b.log (5678 bytes)
15732025-11-20T17:31:20.323Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-crucible-downstairs:snapshot-d83b2dfb-e927-4767-810f-3227f072d47b-4f346ed9-024c-495a-8f6b-940dcddd6e5b.log
15742025-11-20T17:31:20.323Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
15752025-11-20T17:31:21.418Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_708a87e1-8989-4758-bc37-5aca69f98b25/root/var/svc/log/oxide-zone-network-setup:default.log
15762025-11-20T17:31:21.418Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_pantry_8368fb23-1d2d-482c-9b82-83bc80624d89/root/var/svc/log/oxide-crucible-pantry:default.log (167667 bytes)
15772025-11-20T17:31:21.885Zupload warning: file "/pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_pantry_8368fb23-1d2d-482c-9b82-83bc80624d89/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 167667 -> 194304
15782025-11-20T17:31:22.954Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_pantry_8368fb23-1d2d-482c-9b82-83bc80624d89/root/var/svc/log/oxide-crucible-pantry:default.log
15792025-11-20T17:31:22.955Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_pantry_8368fb23-1d2d-482c-9b82-83bc80624d89/root/var/svc/log/oxide-zone-network-setup:default.log (2136 bytes)
15802025-11-20T17:31:24.051Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_crucible_pantry_8368fb23-1d2d-482c-9b82-83bc80624d89/root/var/svc/log/oxide-zone-network-setup:default.log
15812025-11-20T17:31:24.051Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_external_dns_1bcdb094-3f8a-4f4e-bf0e-57dc7a6657cf/root/var/svc/log/oxide-external_dns:default.log (49534 bytes)
15822025-11-20T17:31:24.275Zupload warning: file "/pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_external_dns_1bcdb094-3f8a-4f4e-bf0e-57dc7a6657cf/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 49534 -> 57078
15832025-11-20T17:31:25.346Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_external_dns_1bcdb094-3f8a-4f4e-bf0e-57dc7a6657cf/root/var/svc/log/oxide-external_dns:default.log
15842025-11-20T17:31:25.346Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_external_dns_1bcdb094-3f8a-4f4e-bf0e-57dc7a6657cf/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
15852025-11-20T17:31:26.441Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_external_dns_1bcdb094-3f8a-4f4e-bf0e-57dc7a6657cf/root/var/svc/log/oxide-opte-interface-setup:default.log
15862025-11-20T17:31:26.441Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_external_dns_1bcdb094-3f8a-4f4e-bf0e-57dc7a6657cf/root/var/svc/log/oxide-zone-network-setup:default.log (2113 bytes)
15872025-11-20T17:31:27.537Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_external_dns_1bcdb094-3f8a-4f4e-bf0e-57dc7a6657cf/root/var/svc/log/oxide-zone-network-setup:default.log
15882025-11-20T17:31:27.564Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_internal_dns_bf94f576-6c71-4ba3-913c-e745ec148fd2/root/var/svc/log/oxide-internal_dns:default.log (969950 bytes)
15892025-11-20T17:31:28.721Zupload warning: file "/pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_internal_dns_bf94f576-6c71-4ba3-913c-e745ec148fd2/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 969950 -> 1036227
15902025-11-20T17:31:29.792Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_internal_dns_bf94f576-6c71-4ba3-913c-e745ec148fd2/root/var/svc/log/oxide-internal_dns:default.log
15912025-11-20T17:31:29.816Zuploading: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_internal_dns_bf94f576-6c71-4ba3-913c-e745ec148fd2/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
15922025-11-20T17:31:30.887Zuploaded: /pool/ext/a6f08b8b-db33-4adb-bc91-ad6cab10227e/crypt/zone/oxz_internal_dns_bf94f576-6c71-4ba3-913c-e745ec148fd2/root/var/svc/log/oxide-zone-network-setup:default.log
15932025-11-20T17:31:30.911Zuploading: /pool/ext/ae3fc226-efac-432d-9185-68a0cb33e17e/crypt/zone/oxz_crucible_6a3b93e4-e6ca-44ea-96dc-1ee3ee77aefc/root/var/svc/log/oxide-crucible-agent:default.log (1984 bytes)
15942025-11-20T17:31:31.981Zuploaded: /pool/ext/ae3fc226-efac-432d-9185-68a0cb33e17e/crypt/zone/oxz_crucible_6a3b93e4-e6ca-44ea-96dc-1ee3ee77aefc/root/var/svc/log/oxide-crucible-agent:default.log
15952025-11-20T17:31:31.981Zuploading: /pool/ext/ae3fc226-efac-432d-9185-68a0cb33e17e/crypt/zone/oxz_crucible_6a3b93e4-e6ca-44ea-96dc-1ee3ee77aefc/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15962025-11-20T17:31:33.075Zuploaded: /pool/ext/ae3fc226-efac-432d-9185-68a0cb33e17e/crypt/zone/oxz_crucible_6a3b93e4-e6ca-44ea-96dc-1ee3ee77aefc/root/var/svc/log/oxide-crucible-downstairs:default.log
15972025-11-20T17:31:33.100Zuploading: /pool/ext/ae3fc226-efac-432d-9185-68a0cb33e17e/crypt/zone/oxz_crucible_6a3b93e4-e6ca-44ea-96dc-1ee3ee77aefc/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
15982025-11-20T17:31:34.172Zuploaded: /pool/ext/ae3fc226-efac-432d-9185-68a0cb33e17e/crypt/zone/oxz_crucible_6a3b93e4-e6ca-44ea-96dc-1ee3ee77aefc/root/var/svc/log/oxide-zone-network-setup:default.log
15992025-11-20T17:31:34.173Zuploading: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_cockroachdb_79f2e469-2506-40e9-9497-ea1ceac83d4b/root/var/svc/log/oxide-cockroach-admin:default.log (69184 bytes)
16002025-11-20T17:31:34.441Zupload warning: file "/pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_cockroachdb_79f2e469-2506-40e9-9497-ea1ceac83d4b/root/var/svc/log/oxide-cockroach-admin:default.log" changed size mid upload: 69184 -> 78048
16012025-11-20T17:31:35.512Zuploaded: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_cockroachdb_79f2e469-2506-40e9-9497-ea1ceac83d4b/root/var/svc/log/oxide-cockroach-admin:default.log
16022025-11-20T17:31:35.537Zuploading: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_cockroachdb_79f2e469-2506-40e9-9497-ea1ceac83d4b/root/var/svc/log/oxide-cockroachdb:default.log (4326 bytes)
16032025-11-20T17:31:36.610Zuploaded: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_cockroachdb_79f2e469-2506-40e9-9497-ea1ceac83d4b/root/var/svc/log/oxide-cockroachdb:default.log
16042025-11-20T17:31:36.610Zuploading: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_cockroachdb_79f2e469-2506-40e9-9497-ea1ceac83d4b/root/var/svc/log/oxide-zone-network-setup:default.log (2101 bytes)
16052025-11-20T17:31:37.706Zuploaded: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_cockroachdb_79f2e469-2506-40e9-9497-ea1ceac83d4b/root/var/svc/log/oxide-zone-network-setup:default.log
16062025-11-20T17:31:37.706Zuploading: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-crucible-agent:default.log (18420 bytes)
16072025-11-20T17:31:38.847Zuploaded: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-crucible-agent:default.log
16082025-11-20T17:31:38.847Zuploading: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16092025-11-20T17:31:39.942Zuploaded: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-crucible-downstairs:default.log
16102025-11-20T17:31:39.942Zuploading: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-crucible-downstairs:downstairs-aeb1d67e-1d05-4b00-9dca-efe8dd6b5792.log (6107 bytes)
16112025-11-20T17:31:41.059Zuploaded: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-crucible-downstairs:downstairs-aeb1d67e-1d05-4b00-9dca-efe8dd6b5792.log
16122025-11-20T17:31:41.083Zuploading: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-crucible-downstairs:snapshot-aeb1d67e-1d05-4b00-9dca-efe8dd6b5792-4f346ed9-024c-495a-8f6b-940dcddd6e5b.log (5679 bytes)
16132025-11-20T17:31:42.175Zuploaded: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-crucible-downstairs:snapshot-aeb1d67e-1d05-4b00-9dca-efe8dd6b5792-4f346ed9-024c-495a-8f6b-940dcddd6e5b.log
16142025-11-20T17:31:42.175Zuploading: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
16152025-11-20T17:31:43.270Zuploaded: /pool/ext/c27d15f0-c997-49b9-b613-18813516cf60/crypt/zone/oxz_crucible_af9546f2-a32c-428a-95bd-3e38a3ab0294/root/var/svc/log/oxide-zone-network-setup:default.log
16162025-11-20T17:31:43.270Zuploading: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_a3caa3ca-71b4-4079-862d-51c76cf87000/root/var/svc/log/oxide-crucible-agent:default.log (8905 bytes)
16172025-11-20T17:31:44.387Zuploaded: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_a3caa3ca-71b4-4079-862d-51c76cf87000/root/var/svc/log/oxide-crucible-agent:default.log
16182025-11-20T17:31:44.387Zuploading: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_a3caa3ca-71b4-4079-862d-51c76cf87000/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
16192025-11-20T17:31:45.481Zuploaded: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_a3caa3ca-71b4-4079-862d-51c76cf87000/root/var/svc/log/oxide-crucible-downstairs:default.log
16202025-11-20T17:31:45.481Zuploading: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_a3caa3ca-71b4-4079-862d-51c76cf87000/root/var/svc/log/oxide-crucible-downstairs:downstairs-7fc00b13-97a4-489d-8f3a-8b4f48efa8c1.log (3009 bytes)
16212025-11-20T17:31:46.578Zuploaded: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_a3caa3ca-71b4-4079-862d-51c76cf87000/root/var/svc/log/oxide-crucible-downstairs:downstairs-7fc00b13-97a4-489d-8f3a-8b4f48efa8c1.log
16222025-11-20T17:31:46.602Zuploading: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_a3caa3ca-71b4-4079-862d-51c76cf87000/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
16232025-11-20T17:31:47.672Zuploaded: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_a3caa3ca-71b4-4079-862d-51c76cf87000/root/var/svc/log/oxide-zone-network-setup:default.log
16242025-11-20T17:31:47.672Zuploading: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_pantry_9418169d-7db2-418b-91eb-556b35c8ca0b/root/var/svc/log/oxide-crucible-pantry:default.log (168119 bytes)
16252025-11-20T17:31:48.141Zupload warning: file "/pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_pantry_9418169d-7db2-418b-91eb-556b35c8ca0b/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 168119 -> 197050
16262025-11-20T17:31:49.212Zuploaded: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_pantry_9418169d-7db2-418b-91eb-556b35c8ca0b/root/var/svc/log/oxide-crucible-pantry:default.log
16272025-11-20T17:31:49.212Zuploading: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_pantry_9418169d-7db2-418b-91eb-556b35c8ca0b/root/var/svc/log/oxide-zone-network-setup:default.log (2139 bytes)
16282025-11-20T17:31:50.308Zuploaded: /pool/ext/e2d8cc81-a2bc-414c-b1ad-15f2aadb0ac2/crypt/zone/oxz_crucible_pantry_9418169d-7db2-418b-91eb-556b35c8ca0b/root/var/svc/log/oxide-zone-network-setup:default.log
16292025-11-20T17:31:50.308Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/measurements.log (675371 bytes)
16302025-11-20T17:31:51.337Zupload warning: file "/pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/measurements.log" changed size mid upload: 675371 -> 773333
16312025-11-20T17:31:52.409Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/measurements.log
16322025-11-20T17:31:52.409Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/statistics.log (526851 bytes)
16332025-11-20T17:31:53.323Zupload warning: file "/pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/statistics.log" changed size mid upload: 526851 -> 605943
16342025-11-20T17:31:54.394Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/statistics.log
16352025-11-20T17:31:54.394Zuploading: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/tracking.log (76707 bytes)
16362025-11-20T17:31:54.685Zupload warning: file "/pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/tracking.log" changed size mid upload: 76707 -> 89643
16372025-11-20T17:31:55.756Zuploaded: /pool/ext/9df57238-6136-42f2-b59f-cd2639b21a40/crypt/zone/oxz_ntp_32cc5427-9ee4-40ba-8f76-7eba7ecff418/root/var/log/chrony/tracking.log