01JMN66TSPZXHMN8YGNDP3QRVK: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
        "/tmp/kstat/*.kstat",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.34",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01JMN6862XP4E9R3FHMPH619AB

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12025-02-21T22:34:51.029Zjob dependencies complete; ready to run (waiting for 1 h 12 m 13 s)
22025-02-22T01:37:45.080Zjob assigned to worker 01JMNMHGP28ZT7JDQJ9ZSKVVRM [factory lab, buskin/13573] (queued for 3 h 2 m 54 s)
32025-02-22T01:37:45.174Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42025-02-22T01:37:45.223Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52025-02-22T01:37:45.257Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62025-02-22T01:37:45.290Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72025-02-22T01:37:45.335Zhttp://172.20.0.5:9969/postboot/buskin... ok
82025-02-22T01:37:45.379ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92025-02-22T01:37:45.413Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102025-02-22T01:37:45.446ZOxide Helios Version helios-2.0.23032 64-bit
112025-02-22T01:37:45.479ZConfiguring devices.
122025-02-22T01:37:45.513Z##################################################
132025-02-22T01:37:45.546Z#### ############# ##
142025-02-22T01:37:45.580Z### ### ############ ##
152025-02-22T01:37:45.613Z## ### # ## ### ## Oxide Computer Company ##
162025-02-22T01:37:45.647Z## ## ## ### # ### ##
172025-02-22T01:37:45.680Z## # ### #### #### This Station Under ##
182025-02-22T01:37:45.713Z### ### #### # ### Computer Control ##
192025-02-22T01:37:45.747Z#### #### ### ## ##
202025-02-22T01:37:45.780Z##################################################
212025-02-22T01:37:45.815ZHostname: buskin
222025-02-22T01:37:45.847ZLoading smf(7) service descriptions:
232025-02-22T01:37:46.857Zdownloading input: /input/package/work/package.tar.gz
242025-02-22T01:43:52.104Zdownloaded input: /input/package/work/package.tar.gz
 
252025-02-22T01:43:52.129Zstarting task 0: "setup"
262025-02-22T01:43:52.129Z++ uname -s
272025-02-22T01:43:52.129Z+ kern=SunOS
282025-02-22T01:43:52.129Z+ build_user=build
292025-02-22T01:43:52.129Z+ build_uid=12345
302025-02-22T01:43:52.129Z+ work_dir=/work
312025-02-22T01:43:52.129Z+ input_dir=/input
322025-02-22T01:43:52.129Z+ [[ 0 == 12345 ]]
332025-02-22T01:43:52.129Z+ case "$kern" in
342025-02-22T01:43:52.129Z+ groupadd -g 12345 build
352025-02-22T01:43:52.129Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
362025-02-22T01:43:54.037Z+ zfs create -o mountpoint=/work rpool/work
372025-02-22T01:43:54.091Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
382025-02-22T01:43:54.116Z+ home_fs=zfs
392025-02-22T01:43:54.116Z+ [[ zfs == autofs ]]
402025-02-22T01:43:54.116Z+ mkdir -p /home/build
412025-02-22T01:43:54.116Z+ chown build:build /home/build /work
422025-02-22T01:43:56.087Z+ chmod 0700 /home/build /work
432025-02-22T01:43:56.112Zprocess exited: duration 4072 ms, exit code 0
 
442025-02-22T01:43:56.163Zstarting task 1: "authentication"
452025-02-22T01:43:56.207Zprocess exited: duration 45 ms, exit code 0
 
462025-02-22T01:43:56.255Zstarting task 2: "build"
472025-02-22T01:43:56.279Z+ trap _exit_trap EXIT
482025-02-22T01:43:56.279Z+ OPTE_COMMIT=
492025-02-22T01:43:56.279Z+ [[ x != \x ]]
502025-02-22T01:43:56.279Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
512025-02-22T01:43:56.373Zsecpolicy_fs_linkdir: 0x55 = 0x55
522025-02-22T01:43:56.373Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
532025-02-22T01:43:56.373Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
542025-02-22T01:43:56.374Zsecpolicy_fs_linkdir+3: 0 = 0xe5
552025-02-22T01:43:56.374Zsecpolicy_fs_linkdir+4: 0 = 0xb8
562025-02-22T01:43:56.374Zsecpolicy_fs_linkdir+5: 0 = 0x1
572025-02-22T01:43:56.374Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
582025-02-22T01:43:56.374Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
592025-02-22T01:43:56.374Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
602025-02-22T01:43:56.374Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
612025-02-22T01:43:56.374Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
622025-02-22T01:43:56.398Z+ [[ -d /opt/oxide ]]
632025-02-22T01:43:56.398Z+ pfexec mv /opt/oxide /opt/oxide-underneath
642025-02-22T01:43:56.398Z+ pfexec mkdir /opt/oxide
652025-02-22T01:43:56.398Z+ pfexec mount -F tmpfs -O swap /opt/oxide
662025-02-22T01:43:56.398Z+ [[ -d /opt/oxide-underneath ]]
672025-02-22T01:43:56.398Z+ cd /opt/oxide-underneath
682025-02-22T01:43:56.398Z+ pfexec tar ceEp@/f - .
692025-02-22T01:43:56.398Z+ cd /opt/oxide
702025-02-22T01:43:56.398Z+ pfexec tar xveEp@/f -
712025-02-22T01:43:56.430Zx ., 0 bytes, 0 tape blocks
722025-02-22T01:43:56.430Zx ./opte, 0 bytes, 0 tape blocks
732025-02-22T01:43:56.430Zx ./opte/bin, 0 bytes, 0 tape blocks
742025-02-22T01:43:56.430Zx ./opte/bin/opteadm, 17490984 bytes, 34163 tape blocks
752025-02-22T01:43:56.454Z+ pfexec rm -rf /opt/oxide-underneath
762025-02-22T01:43:56.454Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
772025-02-22T01:43:56.478Z+ pfexec mkdir /opt/oxide/work
782025-02-22T01:43:56.478Z+ pfexec chown build:build /opt/oxide/work
792025-02-22T01:43:56.478Z+ cd /opt/oxide/work
802025-02-22T01:43:56.478Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
812025-02-22T01:44:11.429ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
822025-02-22T01:44:11.429Zx .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks
832025-02-22T01:44:11.429Zx out/target/test, 107 bytes, 1 tape blocks
842025-02-22T01:44:11.429Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
852025-02-22T01:44:11.430Zx package-manifest.toml, 33785 bytes, 66 tape blocks
862025-02-22T01:44:11.430Zx smf/sled-agent/non-gimlet/config.toml, 3472 bytes, 7 tape blocks
872025-02-22T01:44:11.430Zx target/release/omicron-package, 40529192 bytes, 79159 tape blocks
882025-02-22T01:44:11.430Zx target/release/xtask, 11004232 bytes, 21493 tape blocks
892025-02-22T01:44:11.430Zx target/debug/bootstrap, 225485464 bytes, 440402 tape blocks
902025-02-22T01:44:11.430Zx tests/bootstrap-08f7c3d692b89c36, 24818520 bytes, 48474 tape blocks
912025-02-22T01:44:11.430Zx tests/commtest-1abc88a50428029e, 25113272 bytes, 49050 tape blocks
922025-02-22T01:44:11.430Zx tests/dhcp_server-84ec46e31a36f495, 24818528 bytes, 48474 tape blocks
932025-02-22T01:44:11.430Zx tests/end_to_end_tests-26901deb272eb193, 287403120 bytes, 561335 tape blocks
942025-02-22T01:44:11.430Zx out/clickhouse.tar.gz, 313283838 bytes, 611883 tape blocks
952025-02-22T01:44:11.430Zx out/clickhouse_keeper.tar.gz, 298613707 bytes, 583230 tape blocks
962025-02-22T01:44:11.430Zx out/clickhouse_server.tar.gz, 313279516 bytes, 611875 tape blocks
972025-02-22T01:44:11.430Zx out/cockroachdb.tar.gz, 148126392 bytes, 289310 tape blocks
982025-02-22T01:44:11.430Zx out/crucible-dtrace.tar, 100864 bytes, 197 tape blocks
992025-02-22T01:44:11.430Zx out/crucible-pantry-zone.tar.gz, 33779912 bytes, 65977 tape blocks
1002025-02-22T01:44:11.430Zx out/crucible-zone.tar.gz, 42351998 bytes, 82719 tape blocks
1012025-02-22T01:44:11.430Zx out/external-dns.tar.gz, 47575883 bytes, 92922 tape blocks
1022025-02-22T01:44:11.430Zx out/internal-dns.tar.gz, 47575828 bytes, 92922 tape blocks
1032025-02-22T01:44:11.430Zx out/mg-ddm-gz.tar, 64588288 bytes, 126149 tape blocks
1042025-02-22T01:44:11.430Zx out/nexus.tar.gz, 113721604 bytes, 222113 tape blocks
1052025-02-22T01:44:11.430Zx out/ntp.tar.gz, 15290624 bytes, 29865 tape blocks
1062025-02-22T01:44:11.430Zx out/omicron-gateway-softnpu.tar.gz, 26701568 bytes, 52152 tape blocks
1072025-02-22T01:44:11.430Zx out/omicron-sled-agent.tar, 133145600 bytes, 260050 tape blocks
1082025-02-22T01:44:11.430Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1092025-02-22T01:44:11.430Zx out/oximeter.tar.gz, 57499237 bytes, 112304 tape blocks
1102025-02-22T01:44:11.430Zx out/oxlog.tar, 3213312 bytes, 6276 tape blocks
1112025-02-22T01:44:11.430Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1122025-02-22T01:44:11.430Zx out/propolis-server.tar.gz, 68018873 bytes, 132850 tape blocks
1132025-02-22T01:44:11.430Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1142025-02-22T01:44:11.430Zx out/switch-softnpu.tar.gz, 272012131 bytes, 531274 tape blocks
1152025-02-22T01:44:11.458Z
1162025-02-22T01:44:11.458Zreal 14.944145296
1172025-02-22T01:44:11.458Zuser 13.258436889
1182025-02-22T01:44:11.458Zsys 2.914202123
1192025-02-22T01:44:11.458Ztrap 0.000570187
1202025-02-22T01:44:11.458Ztflt 0.000000000
1212025-02-22T01:44:11.458Zdflt 0.000000000
1222025-02-22T01:44:11.458Zkflt 0.000000000
1232025-02-22T01:44:11.459Zlock 0.000000000
1242025-02-22T01:44:11.459Zslp 13.349548054
1252025-02-22T01:44:11.459Zlat 0.363541013
1262025-02-22T01:44:11.459Zstop 0.000127322
1272025-02-22T01:44:11.459Z+ source .github/buildomat/ci-env.sh
1282025-02-22T01:44:11.459Z++ export CARGO_TERM_COLOR=always
1292025-02-22T01:44:11.459Z++ CARGO_TERM_COLOR=always
1302025-02-22T01:44:11.459Z+ bmat address ls
1312025-02-22T01:44:11.459ZNAME CIDR FIRST LAST COUNT
1322025-02-22T01:44:11.459Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1332025-02-22T01:44:11.459Z++ bmat address ls -f extra -Ho first,last,count
1342025-02-22T01:44:11.459Z+ set -- 10.151.1.164 10.151.1.227 64
1352025-02-22T01:44:11.459Z+ EXTRA_IP_START=10.151.1.164
1362025-02-22T01:44:11.459Z+ EXTRA_IP_END=10.151.1.227
1372025-02-22T01:44:11.459Z+ EXTRA_IP_COUNT=64
1382025-02-22T01:44:11.459Z+ (( EXTRA_IP_COUNT >= 32 ))
1392025-02-22T01:44:11.459Z+ EXTRA_IP_BASE=10.151.1
1402025-02-22T01:44:11.459Z+ EXTRA_IP_FOCTET=164
1412025-02-22T01:44:11.459Z+ EXTRA_IP_LOCTET=227
1422025-02-22T01:44:11.459Z+ SERVICE_IP_POOL_START=10.151.1.164
1432025-02-22T01:44:11.459Z+ SERVICE_IP_POOL_END=10.151.1.173
1442025-02-22T01:44:11.459Z+ DNS_IP1=10.151.1.164
1452025-02-22T01:44:11.459Z+ DNS_IP2=10.151.1.165
1462025-02-22T01:44:11.459Z+ UPLINK_IP=10.151.1.174
1472025-02-22T01:44:11.459Z+ IPPOOL_START=10.151.1.175
1482025-02-22T01:44:11.459Z+ IPPOOL_END=10.151.1.227
1492025-02-22T01:44:11.459Z++ ipadm show-addr -po type,addr
1502025-02-22T01:44:11.459Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1512025-02-22T01:44:11.459Z+ GATEWAY_IP=10.151.1.100
1522025-02-22T01:44:11.459Z+ [[ -n 10.151.1.100 ]]
1532025-02-22T01:44:11.459Z+ ping -s 10.151.1.100 56 1
1542025-02-22T01:44:11.459ZPING 10.151.1.100: 56 data bytes
1552025-02-22T01:44:11.459Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
1562025-02-22T01:44:11.459Z
1572025-02-22T01:44:11.459Z----10.151.1.100 PING Statistics----
1582025-02-22T01:44:11.459Z1 packets transmitted, 1 packets received, 0% packet loss
1592025-02-22T01:44:11.460Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
1602025-02-22T01:44:11.460Z++ arp -an
1612025-02-22T01:44:11.460Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1622025-02-22T01:44:11.484Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1632025-02-22T01:44:11.485Z+ routeadm -e ipv4-forwarding -u
1642025-02-22T01:44:11.571Z+ PXA_START=10.151.1.164
1652025-02-22T01:44:11.571Z+ PXA_END=10.151.1.227
1662025-02-22T01:44:11.595Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1672025-02-22T01:44:11.702Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1682025-02-22T01:44:11.727ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1692025-02-22T01:44:11.778Zcreating virtual hardware
1702025-02-22T01:44:11.802Zcreating /scratch/m2_0.vdev
1712025-02-22T01:44:11.802Zcreating /scratch/m2_1.vdev
1722025-02-22T01:44:11.802Zcreating /scratch/u2_0.vdev
1732025-02-22T01:44:11.802Zcreating /scratch/u2_1.vdev
1742025-02-22T01:44:11.802Zcreating /scratch/u2_2.vdev
1752025-02-22T01:44:11.802Zcreating /scratch/u2_3.vdev
1762025-02-22T01:44:11.802Zcreating /scratch/u2_4.vdev
1772025-02-22T01:44:11.802Zcreating /scratch/u2_5.vdev
1782025-02-22T01:44:11.802Zcreating /scratch/u2_6.vdev
1792025-02-22T01:44:11.802Zcreating /scratch/u2_7.vdev
1802025-02-22T01:44:11.802Zcreating /scratch/u2_8.vdev
1812025-02-22T01:44:11.849ZSimnet net0/sc0_0 exists
1822025-02-22T01:44:11.849ZSimnet net1/sc1_0 exists
1832025-02-22T01:44:11.849ZVnic sc0_1 exists
1842025-02-22T01:44:24.604ZUsing 10.151.1.100 as gateway ip
1852025-02-22T01:44:24.604Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1862025-02-22T01:44:24.604Zconfiguring SoftNPU ARP entry
1872025-02-22T01:44:24.631Zconfiguring SoftNPU proxy ARP
1882025-02-22T01:44:24.685ZSoftNPU state:
1892025-02-22T01:44:24.685Z local v6:
1902025-02-22T01:44:24.685Z local v4:
1912025-02-22T01:44:24.685Z router v6:
1922025-02-22T01:44:24.685Z router v4_idx:
1932025-02-22T01:44:24.685Z router v4_routes:
1942025-02-22T01:44:24.685Z resolver v4:
1952025-02-22T01:44:24.685Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1962025-02-22T01:44:24.685Z resolver v6:
1972025-02-22T01:44:24.686Z nat v4:
1982025-02-22T01:44:24.686Z nat_v6:
1992025-02-22T01:44:24.686Z port_mac:
2002025-02-22T01:44:24.686Z proxy arp:
2012025-02-22T01:44:24.686Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
2022025-02-22T01:44:24.686Zcreated virtual hardware
2032025-02-22T01:44:24.711Z
2042025-02-22T01:44:24.711Zreal 12.980612295
2052025-02-22T01:44:24.711Zuser 0.673902639
2062025-02-22T01:44:24.711Zsys 3.231141237
2072025-02-22T01:44:24.711Ztrap 0.000075146
2082025-02-22T01:44:24.711Ztflt 0.000341841
2092025-02-22T01:44:24.711Zdflt 0.000261965
2102025-02-22T01:44:24.711Zkflt 0.000060062
2112025-02-22T01:44:24.711Zlock 10:02.567154390
2122025-02-22T01:44:24.711Zslp 39.129299234
2132025-02-22T01:44:24.711Zlat 0.073352287
2142025-02-22T01:44:24.711Zstop 0.348152743
2152025-02-22T01:44:24.711Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2162025-02-22T01:44:24.736Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2172025-02-22T01:44:24.737Z+ diff -u pkg/config.toml~ pkg/config.toml
2182025-02-22T01:44:24.737Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2192025-02-22T01:44:24.737Z+++ pkg/config.toml Sat Feb 22 01:44:24 2025
2202025-02-22T01:44:24.737Z@@ -29,18 +29,18 @@
2212025-02-22T01:44:24.737Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2222025-02-22T01:44:24.737Z # followed by a string that is embedded into their fake serial values.
2232025-02-22T01:44:24.737Z vdevs = [
2242025-02-22T01:44:24.737Z- "m2_0.vdev",
2252025-02-22T01:44:24.737Z- "m2_1.vdev",
2262025-02-22T01:44:24.737Z+ "/scratch/m2_0.vdev",
2272025-02-22T01:44:24.737Z+ "/scratch/m2_1.vdev",
2282025-02-22T01:44:24.737Z
2292025-02-22T01:44:24.737Z- "u2_0.vdev",
2302025-02-22T01:44:24.737Z- "u2_1.vdev",
2312025-02-22T01:44:24.737Z- "u2_2.vdev",
2322025-02-22T01:44:24.737Z- "u2_3.vdev",
2332025-02-22T01:44:24.737Z- "u2_4.vdev",
2342025-02-22T01:44:24.737Z- "u2_5.vdev",
2352025-02-22T01:44:24.737Z- "u2_6.vdev",
2362025-02-22T01:44:24.737Z- "u2_7.vdev",
2372025-02-22T01:44:24.737Z- "u2_8.vdev",
2382025-02-22T01:44:24.737Z+ "/scratch/u2_0.vdev",
2392025-02-22T01:44:24.737Z+ "/scratch/u2_1.vdev",
2402025-02-22T01:44:24.737Z+ "/scratch/u2_2.vdev",
2412025-02-22T01:44:24.737Z+ "/scratch/u2_3.vdev",
2422025-02-22T01:44:24.737Z+ "/scratch/u2_4.vdev",
2432025-02-22T01:44:24.737Z+ "/scratch/u2_5.vdev",
2442025-02-22T01:44:24.737Z+ "/scratch/u2_6.vdev",
2452025-02-22T01:44:24.737Z+ "/scratch/u2_7.vdev",
2462025-02-22T01:44:24.737Z+ "/scratch/u2_8.vdev",
2472025-02-22T01:44:24.737Z ]
2482025-02-22T01:44:24.737Z
2492025-02-22T01:44:24.737Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2502025-02-22T01:44:24.737Z+ true
2512025-02-22T01:44:24.737Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2522025-02-22T01:44:24.737Z+ SILO_NAME=recovery
2532025-02-22T01:44:24.737Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2542025-02-22T01:44:24.737Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2552025-02-22T01:44:24.738Z+ sed -i~ '
2562025-02-22T01:44:24.738Z /^external_dns_ips/c\
2572025-02-22T01:44:24.738Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2582025-02-22T01:44:24.738Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2592025-02-22T01:44:24.738Z /^first/c\
2602025-02-22T01:44:24.738Zfirst = "10.151.1.164"
2612025-02-22T01:44:24.738Z /^last/c\
2622025-02-22T01:44:24.738Zlast = "10.151.1.173"
2632025-02-22T01:44:24.738Z }
2642025-02-22T01:44:24.738Z /^infra_ip_first/c\
2652025-02-22T01:44:24.738Zinfra_ip_first = "10.151.1.174"
2662025-02-22T01:44:24.738Z /^infra_ip_last/c\
2672025-02-22T01:44:24.738Zinfra_ip_last = "10.151.1.174"
2682025-02-22T01:44:24.738Z /^\[\[rack_network_config.ports/,/^$/ {
2692025-02-22T01:44:24.738Z /^routes/c\
2702025-02-22T01:44:24.738Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2712025-02-22T01:44:24.738Z /^addresses/c\
2722025-02-22T01:44:24.738Zaddresses = \[{address = "10.151.1.174/24"} \]
2732025-02-22T01:44:24.738Z }
2742025-02-22T01:44:24.738Z' pkg/config-rss.toml
2752025-02-22T01:44:24.763Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2762025-02-22T01:44:24.763Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2772025-02-22T01:44:24.763Z+++ pkg/config-rss.toml Sat Feb 22 01:44:24 2025
2782025-02-22T01:44:24.763Z@@ -33,7 +33,7 @@
2792025-02-22T01:44:24.763Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2802025-02-22T01:44:24.763Z # must be contained in one of the "internal services" IP Pool ranges listed
2812025-02-22T01:44:24.763Z # below.
2822025-02-22T01:44:24.763Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2832025-02-22T01:44:24.764Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2842025-02-22T01:44:24.764Z
2852025-02-22T01:44:24.764Z # Initial TLS certificates for the external API
2862025-02-22T01:44:24.764Z #
2872025-02-22T01:44:24.764Z@@ -69,8 +69,8 @@
2882025-02-22T01:44:24.764Z #
2892025-02-22T01:44:24.764Z # For more on this and what to put here, see docs/how-to-run.adoc.
2902025-02-22T01:44:24.764Z [[internal_services_ip_pool_ranges]]
2912025-02-22T01:44:24.764Z-first = "192.168.1.20"
2922025-02-22T01:44:24.764Z-last = "192.168.1.29"
2932025-02-22T01:44:24.764Z+first = "10.151.1.164"
2942025-02-22T01:44:24.764Z+last = "10.151.1.173"
2952025-02-22T01:44:24.764Z
2962025-02-22T01:44:24.764Z # TODO - this configuration is subject to change going forward. Ultimately these
2972025-02-22T01:44:24.764Z # parameters should be provided to the control plane via wicket, but we need to
2982025-02-22T01:44:24.764Z@@ -91,8 +91,8 @@
2992025-02-22T01:44:24.764Z # A range of IP addresses used by Boundary Services on the external network. In
3002025-02-22T01:44:24.764Z # a real system, these would be addresses of the uplink ports on the Sidecar.
3012025-02-22T01:44:24.764Z # With softnpu, only one address is used.
3022025-02-22T01:44:24.764Z-infra_ip_first = "192.168.1.30"
3032025-02-22T01:44:24.764Z-infra_ip_last = "192.168.1.30"
3042025-02-22T01:44:24.764Z+infra_ip_first = "10.151.1.174"
3052025-02-22T01:44:24.764Z+infra_ip_last = "10.151.1.174"
3062025-02-22T01:44:24.764Z
3072025-02-22T01:44:24.764Z # Configurations for BGP routers to run on the scrimlets.
3082025-02-22T01:44:24.764Z bgp = []
3092025-02-22T01:44:24.764Z@@ -100,9 +100,9 @@
3102025-02-22T01:44:24.764Z # You can configure multiple uplinks by repeating the following stanza
3112025-02-22T01:44:24.764Z [[rack_network_config.ports]]
3122025-02-22T01:44:24.764Z # Routes associated with this port.
3132025-02-22T01:44:24.764Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3142025-02-22T01:44:24.764Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3152025-02-22T01:44:24.764Z # Addresses associated with this port.
3162025-02-22T01:44:24.764Z-addresses = [{address = "192.168.1.30/24"}]
3172025-02-22T01:44:24.764Z+addresses = [{address = "10.151.1.174/24"} ]
3182025-02-22T01:44:24.764Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3192025-02-22T01:44:24.764Z port = "qsfp0"
3202025-02-22T01:44:24.764Z # The speed of this port.
3212025-02-22T01:44:24.764Z+ true
3222025-02-22T01:44:24.765Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3232025-02-22T01:44:24.765Za pkg/config-rss.toml 8K
3242025-02-22T01:44:24.765Za pkg/config.toml 4K
3252025-02-22T01:44:24.765Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3262025-02-22T01:44:24.765Z+ TLS_NAME=recovery.sys.oxide.test
3272025-02-22T01:44:24.765Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3282025-02-22T01:44:25.078Z.....+...+............+.+......+...+...+...+..+.........+...+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.........+.+..............+.......+........+....+..+...............+................+.....+....+.............................+....+..+......+..................+..........+..+.......+..+..........+.........+...........+................+...+..+..........+.....+.........+.........+....+..+...+...+.............+.....+.......+........+..........+...........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3292025-02-22T01:44:25.833Z..+.....+...+...+.......+........+.+.....+...+...+...+....+.....+......+..........+..............+...+....+.....+...+.+..+...+.........+...+....+.....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+...........+.+..+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+.+......+........+............+............+...+....+......+..............+.........+......+.........+......+.........+......+......+.........+...+..........+..+......+...+.+.........+.........+..+.........+.+......+...+..+............+......+..........+............+...+...............+....................+..........+.....................+..............+.+..................+...+..+...+.......+.......................+...+....+.......................+.........+...+.......+...+..+.+...+............+..+.+..+............+...+...............+.......+.....+.......+......+..+.......+......+........+....+........+...+....+......+...........................+...+.....+.+...............+.....+.+..+..........+...+.........+...+...........+....+.....+.+...........+.....................+.......+..+.........+.+...........+...+....+.....+.............+..............+...+...+....+.....................+..+.+...........+...+.+.................+.......+..+...+.......+......+.....+.........+....+.........+......+..+....+.........+.....+....+.....+..................+....+......+.........+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3302025-02-22T01:44:25.858Z-----
3312025-02-22T01:44:25.858Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3322025-02-22T01:44:25.883Za pkg/initial-tls-cert.pem 2K
3332025-02-22T01:44:25.883Za pkg/initial-tls-key.pem 4K
3342025-02-22T01:44:25.883Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3352025-02-22T01:44:25.883Z+ rmdir pkg
3362025-02-22T01:44:25.883Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3372025-02-22T01:44:25.883Z+ pfexec mkdir -p /usr/oxide
3382025-02-22T01:44:25.883Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.1
3392025-02-22T01:44:26.435Z+ pfexec chmod +x /usr/oxide/oxide
3402025-02-22T01:44:26.460Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3412025-02-22T01:44:44.785Z+ OMICRON_NO_UNINSTALL=1
3422025-02-22T01:44:44.785Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3432025-02-22T01:44:44.810ZLogging to: /opt/oxide/work/out/LOG
3442025-02-22T01:44:45.506Z
3452025-02-22T01:44:45.531Zreal 0.716173786
3462025-02-22T01:44:45.531Zuser 0.149381907
3472025-02-22T01:44:45.531Zsys 3.897584449
3482025-02-22T01:44:45.531Ztrap 0.000005908
3492025-02-22T01:44:45.531Ztflt 0.000040068
3502025-02-22T01:44:45.531Zdflt 0.000505651
3512025-02-22T01:44:45.531Zkflt 0.000000000
3522025-02-22T01:44:45.532Zlock 1:04.538123498
3532025-02-22T01:44:45.532Zslp 0.913969443
3542025-02-22T01:44:45.532Zlat 0.003114298
3552025-02-22T01:44:45.532Zstop 0.223047298
3562025-02-22T01:44:45.532Z+ retry=0
3572025-02-22T01:44:45.532Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3582025-02-22T01:44:45.532Z+ [[ 0 -gt 30 ]]
3592025-02-22T01:44:45.532Z+ sleep 1
3602025-02-22T01:44:46.521Z+ retry=1
3612025-02-22T01:44:46.521Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3622025-02-22T01:44:46.546Z+ [[ 1 -gt 30 ]]
3632025-02-22T01:44:46.546Z+ sleep 1
3642025-02-22T01:44:47.536Z+ retry=2
3652025-02-22T01:44:47.536Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3662025-02-22T01:44:47.561Z+ [[ 2 -gt 30 ]]
3672025-02-22T01:44:47.561Z+ sleep 1
3682025-02-22T01:44:48.551Z+ retry=3
3692025-02-22T01:44:48.551Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3702025-02-22T01:45:07.817Z+ [[ 3 -gt 30 ]]
3712025-02-22T01:45:07.817Z+ sleep 1
3722025-02-22T01:45:08.821Z+ retry=4
3732025-02-22T01:45:08.821Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3742025-02-22T01:45:08.846Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3752025-02-22T01:45:08.870Zlocal v6:
3762025-02-22T01:45:08.870Zfe80::3cca:f4ff:fe36:9278
3772025-02-22T01:45:08.870Zfd72:a286:8a35:108c::1
3782025-02-22T01:45:08.870Zlocal v4:
3792025-02-22T01:45:08.871Zrouter v6:
3802025-02-22T01:45:08.871Zrouter v4_idx:
3812025-02-22T01:45:08.871Zrouter v4_routes:
3822025-02-22T01:45:08.871Zresolver v4:
3832025-02-22T01:45:08.871Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3842025-02-22T01:45:08.871Zresolver v6:
3852025-02-22T01:45:08.871Zfe80::3cca:f4ff:fe36:9278 -> 3e:ca:f4:36:92:78
3862025-02-22T01:45:08.871Znat v4:
3872025-02-22T01:45:08.871Znat_v6:
3882025-02-22T01:45:08.871Zport_mac:
3892025-02-22T01:45:08.871Z1: a8:40:25:22:ff:49
3902025-02-22T01:45:08.871Z1000: a8:40:25:22:ff:48
3912025-02-22T01:45:08.871Zproxy arp:
3922025-02-22T01:45:08.871Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
3932025-02-22T01:45:08.871Z+ retry=0
3942025-02-22T01:45:08.896Z+++ zoneadm list -n
3952025-02-22T01:45:08.896Z+++ grep oxz_ntp
3962025-02-22T01:45:08.896Z++ pfexec svcs -z -Hostate oxide/ntp
3972025-02-22T01:45:08.896Zsvcs: zone '-Hostate': entity not found
3982025-02-22T01:45:08.896Z++ true
3992025-02-22T01:45:08.896Z+ [[ '' != online ]]
4002025-02-22T01:45:08.896Z+ [[ 0 -gt 60 ]]
4012025-02-22T01:45:08.896Z+ sleep 1
4022025-02-22T01:45:09.894Z+ retry=1
4032025-02-22T01:45:09.924Z+++ zoneadm list -n
4042025-02-22T01:45:09.924Z+++ grep oxz_ntp
4052025-02-22T01:45:09.924Z++ pfexec svcs -z -Hostate oxide/ntp
4062025-02-22T01:45:09.924Zsvcs: zone '-Hostate': entity not found
4072025-02-22T01:45:09.924Z++ true
4082025-02-22T01:45:09.924Z+ [[ '' != online ]]
4092025-02-22T01:45:09.924Z+ [[ 1 -gt 60 ]]
4102025-02-22T01:45:09.924Z+ sleep 1
4112025-02-22T01:45:10.913Z+ retry=2
4122025-02-22T01:45:10.938Z+++ zoneadm list -n
4132025-02-22T01:45:10.938Z+++ grep oxz_ntp
4142025-02-22T01:45:10.938Z++ pfexec svcs -z -Hostate oxide/ntp
4152025-02-22T01:45:10.938Zsvcs: zone '-Hostate': entity not found
4162025-02-22T01:45:10.938Z++ true
4172025-02-22T01:45:10.938Z+ [[ '' != online ]]
4182025-02-22T01:45:10.938Z+ [[ 2 -gt 60 ]]
4192025-02-22T01:45:10.938Z+ sleep 1
4202025-02-22T01:45:11.934Z+ retry=3
4212025-02-22T01:45:11.959Z+++ zoneadm list -n
4222025-02-22T01:45:11.959Z+++ grep oxz_ntp
4232025-02-22T01:45:11.959Z++ pfexec svcs -z -Hostate oxide/ntp
4242025-02-22T01:45:11.959Zsvcs: zone '-Hostate': entity not found
4252025-02-22T01:45:11.959Z++ true
4262025-02-22T01:45:11.959Z+ [[ '' != online ]]
4272025-02-22T01:45:11.959Z+ [[ 3 -gt 60 ]]
4282025-02-22T01:45:11.959Z+ sleep 1
4292025-02-22T01:45:12.955Z+ retry=4
4302025-02-22T01:45:12.980Z+++ zoneadm list -n
4312025-02-22T01:45:12.980Z+++ grep oxz_ntp
4322025-02-22T01:45:12.980Z++ pfexec svcs -z -Hostate oxide/ntp
4332025-02-22T01:45:12.980Zsvcs: zone '-Hostate': entity not found
4342025-02-22T01:45:12.980Z++ true
4352025-02-22T01:45:12.980Z+ [[ '' != online ]]
4362025-02-22T01:45:12.981Z+ [[ 4 -gt 60 ]]
4372025-02-22T01:45:12.981Z+ sleep 1
4382025-02-22T01:45:13.979Z+ retry=5
4392025-02-22T01:45:14.004Z+++ zoneadm list -n
4402025-02-22T01:45:14.004Z+++ grep oxz_ntp
4412025-02-22T01:45:14.004Z++ pfexec svcs -z -Hostate oxide/ntp
4422025-02-22T01:45:14.004Zsvcs: zone '-Hostate': entity not found
4432025-02-22T01:45:14.004Z++ true
4442025-02-22T01:45:14.004Z+ [[ '' != online ]]
4452025-02-22T01:45:14.004Z+ [[ 5 -gt 60 ]]
4462025-02-22T01:45:14.004Z+ sleep 1
4472025-02-22T01:45:15.002Z+ retry=6
4482025-02-22T01:45:15.027Z+++ zoneadm list -n
4492025-02-22T01:45:15.027Z+++ grep oxz_ntp
4502025-02-22T01:45:15.027Z++ pfexec svcs -z -Hostate oxide/ntp
4512025-02-22T01:45:15.027Zsvcs: zone '-Hostate': entity not found
4522025-02-22T01:45:15.027Z++ true
4532025-02-22T01:45:15.027Z+ [[ '' != online ]]
4542025-02-22T01:45:15.027Z+ [[ 6 -gt 60 ]]
4552025-02-22T01:45:15.027Z+ sleep 1
4562025-02-22T01:45:16.025Z+ retry=7
4572025-02-22T01:45:16.051Z+++ zoneadm list -n
4582025-02-22T01:45:16.051Z+++ grep oxz_ntp
4592025-02-22T01:45:16.051Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
4602025-02-22T01:45:16.076Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4612025-02-22T01:45:16.076Z++ true
4622025-02-22T01:45:16.076Z+ [[ '' != online ]]
4632025-02-22T01:45:16.076Z+ [[ 7 -gt 60 ]]
4642025-02-22T01:45:16.076Z+ sleep 1
4652025-02-22T01:45:17.056Z+ retry=8
4662025-02-22T01:45:17.082Z+++ zoneadm list -n
4672025-02-22T01:45:17.082Z+++ grep oxz_ntp
4682025-02-22T01:45:17.082Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
4692025-02-22T01:45:17.082Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4702025-02-22T01:45:17.106Z++ true
4712025-02-22T01:45:17.107Z+ [[ '' != online ]]
4722025-02-22T01:45:17.107Z+ [[ 8 -gt 60 ]]
4732025-02-22T01:45:17.107Z+ sleep 1
4742025-02-22T01:45:18.086Z+ retry=9
4752025-02-22T01:45:18.111Z+++ zoneadm list -n
4762025-02-22T01:45:18.111Z+++ grep oxz_ntp
4772025-02-22T01:45:18.111Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
4782025-02-22T01:45:18.111Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4792025-02-22T01:45:18.136Z++ true
4802025-02-22T01:45:18.136Z+ [[ '' != online ]]
4812025-02-22T01:45:18.136Z+ [[ 9 -gt 60 ]]
4822025-02-22T01:45:18.136Z+ sleep 1
4832025-02-22T01:45:19.116Z+ retry=10
4842025-02-22T01:45:19.141Z+++ zoneadm list -n
4852025-02-22T01:45:19.141Z+++ grep oxz_ntp
4862025-02-22T01:45:19.141Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
4872025-02-22T01:45:19.141Z+ [[ offline != online ]]
4882025-02-22T01:45:19.141Z+ [[ 10 -gt 60 ]]
4892025-02-22T01:45:19.141Z+ sleep 1
4902025-02-22T01:45:20.138Z+ retry=11
4912025-02-22T01:45:20.163Z+++ zoneadm list -n
4922025-02-22T01:45:20.163Z+++ grep oxz_ntp
4932025-02-22T01:45:20.163Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
4942025-02-22T01:45:20.163Z+ [[ offline != online ]]
4952025-02-22T01:45:20.164Z+ [[ 11 -gt 60 ]]
4962025-02-22T01:45:20.164Z+ sleep 1
4972025-02-22T01:45:21.161Z+ retry=12
4982025-02-22T01:45:21.186Z+++ zoneadm list -n
4992025-02-22T01:45:21.186Z+++ grep oxz_ntp
5002025-02-22T01:45:21.186Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
5012025-02-22T01:45:21.186Z+ [[ offline != online ]]
5022025-02-22T01:45:21.186Z+ [[ 12 -gt 60 ]]
5032025-02-22T01:45:21.186Z+ sleep 1
5042025-02-22T01:45:22.182Z+ retry=13
5052025-02-22T01:45:22.207Z+++ zoneadm list -n
5062025-02-22T01:45:22.207Z+++ grep oxz_ntp
5072025-02-22T01:45:22.207Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
5082025-02-22T01:45:22.207Z+ [[ offline != online ]]
5092025-02-22T01:45:22.207Z+ [[ 13 -gt 60 ]]
5102025-02-22T01:45:22.207Z+ sleep 1
5112025-02-22T01:45:23.206Z+ retry=14
5122025-02-22T01:45:23.231Z+++ zoneadm list -n
5132025-02-22T01:45:23.231Z+++ grep oxz_ntp
5142025-02-22T01:45:23.231Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
5152025-02-22T01:45:23.231Z+ [[ offline != online ]]
5162025-02-22T01:45:23.231Z+ [[ 14 -gt 60 ]]
5172025-02-22T01:45:23.231Z+ sleep 1
5182025-02-22T01:45:24.229Z+ retry=15
5192025-02-22T01:45:24.254Z+++ zoneadm list -n
5202025-02-22T01:45:24.254Z+++ grep oxz_ntp
5212025-02-22T01:45:24.254Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
5222025-02-22T01:45:24.254Z+ [[ offline != online ]]
5232025-02-22T01:45:24.254Z+ [[ 15 -gt 60 ]]
5242025-02-22T01:45:24.254Z+ sleep 1
5252025-02-22T01:45:25.251Z+ retry=16
5262025-02-22T01:45:25.275Z+++ zoneadm list -n
5272025-02-22T01:45:25.275Z+++ grep oxz_ntp
5282025-02-22T01:45:25.275Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
5292025-02-22T01:45:25.275Z+ [[ offline != online ]]
5302025-02-22T01:45:25.275Z+ [[ 16 -gt 60 ]]
5312025-02-22T01:45:25.276Z+ sleep 1
 
5322025-02-22T01:45:25.800Zbuskin console login: Feb 22 01:45:25 buskin ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5332025-02-22T01:45:26.278Z+ retry=17
5342025-02-22T01:45:26.318Z+++ zoneadm list -n
5352025-02-22T01:45:26.318Z+++ grep oxz_ntp
5362025-02-22T01:45:26.318Z++ pfexec svcs -z oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139 -Hostate oxide/ntp
5372025-02-22T01:45:26.318Z+ [[ online != online ]]
5382025-02-22T01:45:26.318Z+ echo 'Waited for chrony: 17s'
5392025-02-22T01:45:26.318ZWaited for chrony: 17s
5402025-02-22T01:45:26.318Z+ retry=0
5412025-02-22T01:45:26.318Z+ zoneadm list
5422025-02-22T01:45:26.318Z+ grep nexus
5432025-02-22T01:45:26.318Z+ [[ 0 -gt 300 ]]
5442025-02-22T01:45:26.318Z+ sleep 1
5452025-02-22T01:45:27.316Z+ retry=1
5462025-02-22T01:45:27.363Z+ zoneadm list
5472025-02-22T01:45:27.363Z+ grep nexus
5482025-02-22T01:45:27.363Z+ [[ 1 -gt 300 ]]
5492025-02-22T01:45:27.363Z+ sleep 1
5502025-02-22T01:45:28.315Z+ retry=2
5512025-02-22T01:45:28.343Z+ zoneadm list
5522025-02-22T01:45:28.344Z+ grep nexus
5532025-02-22T01:45:28.344Z+ [[ 2 -gt 300 ]]
5542025-02-22T01:45:28.344Z+ sleep 1
5552025-02-22T01:45:29.328Z+ retry=3
5562025-02-22T01:45:29.353Z+ zoneadm list
5572025-02-22T01:45:29.353Z+ grep nexus
5582025-02-22T01:45:29.354Z+ [[ 3 -gt 300 ]]
5592025-02-22T01:45:29.354Z+ sleep 1
5602025-02-22T01:45:30.342Z+ retry=4
5612025-02-22T01:45:30.368Z+ zoneadm list
5622025-02-22T01:45:30.368Z+ grep nexus
5632025-02-22T01:45:30.368Z+ [[ 4 -gt 300 ]]
5642025-02-22T01:45:30.368Z+ sleep 1
5652025-02-22T01:45:31.356Z+ retry=5
5662025-02-22T01:45:31.381Z+ zoneadm list
5672025-02-22T01:45:31.381Z+ grep nexus
5682025-02-22T01:45:31.381Z+ [[ 5 -gt 300 ]]
5692025-02-22T01:45:31.381Z+ sleep 1
5702025-02-22T01:45:32.370Z+ retry=6
5712025-02-22T01:45:32.395Z+ zoneadm list
5722025-02-22T01:45:32.395Z+ grep nexus
5732025-02-22T01:45:32.395Z+ [[ 6 -gt 300 ]]
5742025-02-22T01:45:32.395Z+ sleep 1
5752025-02-22T01:45:33.384Z+ retry=7
5762025-02-22T01:45:33.408Z+ zoneadm list
5772025-02-22T01:45:33.408Z+ grep nexus
5782025-02-22T01:45:33.409Z+ [[ 7 -gt 300 ]]
5792025-02-22T01:45:33.409Z+ sleep 1
5802025-02-22T01:45:34.397Z+ retry=8
5812025-02-22T01:45:34.422Z+ zoneadm list
5822025-02-22T01:45:34.422Z+ grep nexus
5832025-02-22T01:45:34.422Z+ [[ 8 -gt 300 ]]
5842025-02-22T01:45:34.422Z+ sleep 1
5852025-02-22T01:45:35.411Z+ retry=9
5862025-02-22T01:45:35.436Z+ zoneadm list
5872025-02-22T01:45:35.436Z+ grep nexus
5882025-02-22T01:45:35.436Z+ [[ 9 -gt 300 ]]
5892025-02-22T01:45:35.436Z+ sleep 1
5902025-02-22T01:45:36.427Z+ retry=10
5912025-02-22T01:45:36.453Z+ zoneadm list
5922025-02-22T01:45:36.453Z+ grep nexus
5932025-02-22T01:45:36.453Z+ [[ 10 -gt 300 ]]
5942025-02-22T01:45:36.453Z+ sleep 1
5952025-02-22T01:45:37.442Z+ retry=11
5962025-02-22T01:45:37.466Z+ zoneadm list
5972025-02-22T01:45:37.467Z+ grep nexus
5982025-02-22T01:45:37.467Z+ [[ 11 -gt 300 ]]
5992025-02-22T01:45:37.467Z+ sleep 1
6002025-02-22T01:45:38.459Z+ retry=12
6012025-02-22T01:45:38.577Z+ zoneadm list
6022025-02-22T01:45:38.629Z+ grep nexus
6032025-02-22T01:45:38.677Z+ [[ 12 -gt 300 ]]
6042025-02-22T01:45:38.677Z+ sleep 1
6052025-02-22T01:45:39.715Z+ retry=13
6062025-02-22T01:45:39.740Z+ zoneadm list
6072025-02-22T01:45:39.741Z+ grep nexus
6082025-02-22T01:45:39.741Z+ [[ 13 -gt 300 ]]
6092025-02-22T01:45:39.741Z+ sleep 1
6102025-02-22T01:45:40.743Z+ retry=14
6112025-02-22T01:45:40.768Z+ zoneadm list
6122025-02-22T01:45:40.768Z+ grep nexus
6132025-02-22T01:45:40.768Z+ [[ 14 -gt 300 ]]
6142025-02-22T01:45:40.768Z+ sleep 1
6152025-02-22T01:45:41.766Z+ retry=15
6162025-02-22T01:45:41.791Z+ zoneadm list
6172025-02-22T01:45:41.791Z+ grep nexus
6182025-02-22T01:45:41.791Z+ [[ 15 -gt 300 ]]
6192025-02-22T01:45:41.791Z+ sleep 1
6202025-02-22T01:45:42.787Z+ retry=16
6212025-02-22T01:45:42.811Z+ zoneadm list
6222025-02-22T01:45:42.811Z+ grep nexus
6232025-02-22T01:45:42.835Z+ [[ 16 -gt 300 ]]
6242025-02-22T01:45:42.835Z+ sleep 1
6252025-02-22T01:45:43.827Z+ retry=17
6262025-02-22T01:45:43.851Z+ zoneadm list
6272025-02-22T01:45:43.851Z+ grep nexus
6282025-02-22T01:45:43.851Z+ [[ 17 -gt 300 ]]
6292025-02-22T01:45:43.851Z+ sleep 1
6302025-02-22T01:45:44.841Z+ retry=18
6312025-02-22T01:45:44.865Z+ zoneadm list
6322025-02-22T01:45:44.865Z+ grep nexus
6332025-02-22T01:45:44.865Z+ [[ 18 -gt 300 ]]
6342025-02-22T01:45:44.865Z+ sleep 1
6352025-02-22T01:45:45.858Z+ retry=19
6362025-02-22T01:45:45.882Z+ zoneadm list
6372025-02-22T01:45:45.882Z+ grep nexus
6382025-02-22T01:45:45.882Z+ [[ 19 -gt 300 ]]
6392025-02-22T01:45:45.882Z+ sleep 1
6402025-02-22T01:45:46.873Z+ retry=20
6412025-02-22T01:45:46.897Z+ zoneadm list
6422025-02-22T01:45:46.897Z+ grep nexus
6432025-02-22T01:45:46.897Z+ [[ 20 -gt 300 ]]
6442025-02-22T01:45:46.897Z+ sleep 1
6452025-02-22T01:45:47.888Z+ retry=21
6462025-02-22T01:45:47.912Z+ zoneadm list
6472025-02-22T01:45:47.912Z+ grep nexus
6482025-02-22T01:45:47.912Z+ [[ 21 -gt 300 ]]
6492025-02-22T01:45:47.912Z+ sleep 1
6502025-02-22T01:45:48.905Z+ retry=22
6512025-02-22T01:45:48.929Z+ zoneadm list
6522025-02-22T01:45:48.929Z+ grep nexus
6532025-02-22T01:45:48.929Z+ [[ 22 -gt 300 ]]
6542025-02-22T01:45:48.929Z+ sleep 1
6552025-02-22T01:45:49.922Z+ retry=23
6562025-02-22T01:45:49.946Z+ zoneadm list
6572025-02-22T01:45:49.946Z+ grep nexus
6582025-02-22T01:45:49.946Z+ [[ 23 -gt 300 ]]
6592025-02-22T01:45:49.946Z+ sleep 1
6602025-02-22T01:45:50.938Z+ retry=24
6612025-02-22T01:45:50.961Z+ zoneadm list
6622025-02-22T01:45:50.962Z+ grep nexus
6632025-02-22T01:45:50.962Z+ [[ 24 -gt 300 ]]
6642025-02-22T01:45:50.962Z+ sleep 1
6652025-02-22T01:45:51.951Z+ retry=25
6662025-02-22T01:45:51.977Z+ zoneadm list
6672025-02-22T01:45:51.977Z+ grep nexus
6682025-02-22T01:45:51.977Z+ [[ 25 -gt 300 ]]
6692025-02-22T01:45:51.977Z+ sleep 1
6702025-02-22T01:45:52.963Z+ retry=26
6712025-02-22T01:45:52.987Z+ zoneadm list
6722025-02-22T01:45:52.987Z+ grep nexus
6732025-02-22T01:45:52.987Z+ [[ 26 -gt 300 ]]
6742025-02-22T01:45:52.987Z+ sleep 1
6752025-02-22T01:45:53.976Z+ retry=27
6762025-02-22T01:45:54.001Z+ zoneadm list
6772025-02-22T01:45:54.001Z+ grep nexus
6782025-02-22T01:45:54.001Z+ [[ 27 -gt 300 ]]
6792025-02-22T01:45:54.001Z+ sleep 1
6802025-02-22T01:45:54.987Z+ retry=28
6812025-02-22T01:45:55.011Z+ zoneadm list
6822025-02-22T01:45:55.011Z+ grep nexus
6832025-02-22T01:45:55.011Z+ [[ 28 -gt 300 ]]
6842025-02-22T01:45:55.011Z+ sleep 1
6852025-02-22T01:45:55.998Z+ retry=29
6862025-02-22T01:45:56.025Z+ zoneadm list
6872025-02-22T01:45:56.025Z+ grep nexus
6882025-02-22T01:45:56.025Z+ [[ 29 -gt 300 ]]
6892025-02-22T01:45:56.025Z+ sleep 1
6902025-02-22T01:45:57.010Z+ retry=30
6912025-02-22T01:45:57.035Z+ zoneadm list
6922025-02-22T01:45:57.035Z+ grep nexus
6932025-02-22T01:45:57.035Z+ [[ 30 -gt 300 ]]
6942025-02-22T01:45:57.035Z+ sleep 1
6952025-02-22T01:45:58.022Z+ retry=31
6962025-02-22T01:45:58.058Z+ zoneadm list
6972025-02-22T01:45:58.058Z+ grep nexus
6982025-02-22T01:45:58.058Z+ [[ 31 -gt 300 ]]
6992025-02-22T01:45:58.058Z+ sleep 1
7002025-02-22T01:45:59.036Z+ retry=32
7012025-02-22T01:45:59.060Z+ zoneadm list
7022025-02-22T01:45:59.060Z+ grep nexus
7032025-02-22T01:45:59.060Z+ [[ 32 -gt 300 ]]
7042025-02-22T01:45:59.060Z+ sleep 1
7052025-02-22T01:46:00.053Z+ retry=33
7062025-02-22T01:46:00.078Z+ zoneadm list
7072025-02-22T01:46:00.078Z+ grep nexus
7082025-02-22T01:46:00.078Z+ [[ 33 -gt 300 ]]
7092025-02-22T01:46:00.078Z+ sleep 1
7102025-02-22T01:46:01.077Z+ retry=34
7112025-02-22T01:46:01.101Z+ zoneadm list
7122025-02-22T01:46:01.101Z+ grep nexus
7132025-02-22T01:46:01.101Z+ [[ 34 -gt 300 ]]
7142025-02-22T01:46:01.101Z+ sleep 1
7152025-02-22T01:46:02.080Z+ retry=35
7162025-02-22T01:46:02.104Z+ zoneadm list
7172025-02-22T01:46:02.104Z+ grep nexus
7182025-02-22T01:46:02.104Z+ [[ 35 -gt 300 ]]
7192025-02-22T01:46:02.104Z+ sleep 1
7202025-02-22T01:46:03.093Z+ retry=36
7212025-02-22T01:46:03.117Z+ zoneadm list
7222025-02-22T01:46:03.117Z+ grep nexus
7232025-02-22T01:46:03.117Z+ [[ 36 -gt 300 ]]
7242025-02-22T01:46:03.117Z+ sleep 1
7252025-02-22T01:46:04.106Z+ retry=37
7262025-02-22T01:46:04.131Z+ zoneadm list
7272025-02-22T01:46:04.131Z+ grep nexus
7282025-02-22T01:46:04.131Z+ [[ 37 -gt 300 ]]
7292025-02-22T01:46:04.131Z+ sleep 1
7302025-02-22T01:46:05.119Z+ retry=38
7312025-02-22T01:46:05.143Z+ zoneadm list
7322025-02-22T01:46:05.143Z+ grep nexus
7332025-02-22T01:46:05.143Z+ [[ 38 -gt 300 ]]
7342025-02-22T01:46:05.143Z+ sleep 1
7352025-02-22T01:46:06.132Z+ retry=39
7362025-02-22T01:46:06.157Z+ zoneadm list
7372025-02-22T01:46:06.157Z+ grep nexus
7382025-02-22T01:46:06.157Z+ [[ 39 -gt 300 ]]
7392025-02-22T01:46:06.157Z+ sleep 1
7402025-02-22T01:46:07.145Z+ retry=40
7412025-02-22T01:46:07.169Z+ zoneadm list
7422025-02-22T01:46:07.169Z+ grep nexus
7432025-02-22T01:46:07.169Z+ [[ 40 -gt 300 ]]
7442025-02-22T01:46:07.169Z+ sleep 1
7452025-02-22T01:46:08.155Z+ retry=41
7462025-02-22T01:46:08.180Z+ zoneadm list
7472025-02-22T01:46:08.180Z+ grep nexus
7482025-02-22T01:46:08.180Z+ [[ 41 -gt 300 ]]
7492025-02-22T01:46:08.180Z+ sleep 1
7502025-02-22T01:46:09.168Z+ retry=42
7512025-02-22T01:46:09.193Z+ zoneadm list
7522025-02-22T01:46:09.193Z+ grep nexus
7532025-02-22T01:46:09.193Z+ [[ 42 -gt 300 ]]
7542025-02-22T01:46:09.193Z+ sleep 1
7552025-02-22T01:46:10.180Z+ retry=43
7562025-02-22T01:46:10.211Z+ zoneadm list
7572025-02-22T01:46:10.211Z+ grep nexus
7582025-02-22T01:46:10.211Z+ [[ 43 -gt 300 ]]
7592025-02-22T01:46:10.211Z+ sleep 1
7602025-02-22T01:46:11.193Z+ retry=44
7612025-02-22T01:46:11.219Z+ zoneadm list
7622025-02-22T01:46:11.219Z+ grep nexus
7632025-02-22T01:46:11.219Z+ [[ 44 -gt 300 ]]
7642025-02-22T01:46:11.219Z+ sleep 1
7652025-02-22T01:46:12.205Z+ retry=45
7662025-02-22T01:46:12.233Z+ zoneadm list
7672025-02-22T01:46:12.233Z+ grep nexus
7682025-02-22T01:46:12.233Z+ [[ 45 -gt 300 ]]
7692025-02-22T01:46:12.233Z+ sleep 1
7702025-02-22T01:46:13.222Z+ retry=46
7712025-02-22T01:46:13.246Z+ zoneadm list
7722025-02-22T01:46:13.246Z+ grep nexus
7732025-02-22T01:46:13.246Z+ [[ 46 -gt 300 ]]
7742025-02-22T01:46:13.246Z+ sleep 1
7752025-02-22T01:46:14.239Z+ retry=47
7762025-02-22T01:46:14.264Z+ zoneadm list
7772025-02-22T01:46:14.288Z+ grep nexus
7782025-02-22T01:46:14.288Z+ [[ 47 -gt 300 ]]
7792025-02-22T01:46:14.288Z+ sleep 1
7802025-02-22T01:46:15.454Z+ retry=48
7812025-02-22T01:46:22.231Z+ grep nexus
7822025-02-22T01:46:22.510Z+ zoneadm list
7832025-02-22T01:46:22.869Z+ [[ 48 -gt 300 ]]
7842025-02-22T01:46:22.897Z+ sleep 1
7852025-02-22T01:46:23.924Z+ retry=49
7862025-02-22T01:46:24.061Z+ zoneadm list
7872025-02-22T01:46:24.296Z+ grep nexus
7882025-02-22T01:46:24.822Z+ [[ 49 -gt 300 ]]
7892025-02-22T01:46:24.822Z+ sleep 1
7902025-02-22T01:46:25.860Z+ retry=50
7912025-02-22T01:46:25.890Z+ grep nexus
7922025-02-22T01:46:25.891Z+ zoneadm list
7932025-02-22T01:46:25.915Z+ [[ 50 -gt 300 ]]
7942025-02-22T01:46:25.915Z+ sleep 1
7952025-02-22T01:46:27.081Z+ retry=51
7962025-02-22T01:46:27.081Z+ zoneadm list
7972025-02-22T01:46:27.081Z+ grep nexus
7982025-02-22T01:46:27.081Z+ [[ 51 -gt 300 ]]
7992025-02-22T01:46:27.081Z+ sleep 1
8002025-02-22T01:46:27.917Z+ retry=52
8012025-02-22T01:46:27.963Z+ zoneadm list
8022025-02-22T01:46:27.963Z+ grep nexus
8032025-02-22T01:46:27.963Z+ [[ 52 -gt 300 ]]
8042025-02-22T01:46:27.963Z+ sleep 1
8052025-02-22T01:46:28.969Z+ retry=53
8062025-02-22T01:46:29.035Z+ zoneadm list
8072025-02-22T01:46:29.035Z+ grep nexus
8082025-02-22T01:46:29.035Zoxz_nexus_e67ff8a6-dd93-409c-881c-f32e425223c6
8092025-02-22T01:46:29.035Z+ echo 'Waited for nexus: 53s'
8102025-02-22T01:46:29.035ZWaited for nexus: 53s
8112025-02-22T01:46:29.035Z+ export RUST_BACKTRACE=1
8122025-02-22T01:46:29.035Z+ RUST_BACKTRACE=1
8132025-02-22T01:46:29.035Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8142025-02-22T01:46:29.035Z++ ./target/debug/bootstrap
8152025-02-22T01:46:29.171ZUsing external DNS server at 10.151.1.164:53
8162025-02-22T01:46:29.281Z2025-02-22 01:46:29.171996478 UTC: attempting to log into API
8172025-02-22T01:46:44.258Z2025-02-22 01:46:44.227551363 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8182025-02-22T01:46:45.241Z2025-02-22 01:46:45.228698299 UTC: attempting to log into API
8192025-02-22T01:47:01.369Z2025-02-22 01:47:00.261065409 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8202025-02-22T01:47:01.465Z2025-02-22 01:47:01.262295958 UTC: attempting to log into API
 
8212025-02-22T01:47:01.638ZFeb 22 01:46:58 buskin ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
8222025-02-22T01:47:01.688ZFeb 22 01:46:59 buskin ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
8232025-02-22T01:47:01.751ZFeb 22 01:46:59 buskin ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
8242025-02-22T01:47:01.803ZFeb 22 01:46:59 buskin ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
8252025-02-22T01:47:01.847ZFeb 22 01:46:59 buskin ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
 
8262025-02-22T01:47:16.310Z2025-02-22 01:47:16.298628635 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8272025-02-22T01:47:17.313Z2025-02-22 01:47:17.299915565 UTC: attempting to log into API
8282025-02-22T01:47:32.344Z2025-02-22 01:47:32.332705767 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8292025-02-22T01:47:33.345Z2025-02-22 01:47:33.333905345 UTC: attempting to log into API
8302025-02-22T01:47:33.390Z2025-02-22 01:47:33.378202562 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8312025-02-22T01:47:34.391Z2025-02-22 01:47:34.379483432 UTC: attempting to log into API
8322025-02-22T01:47:35.624Z2025-02-22 01:47:35.612372455 UTC: login succeeded
8332025-02-22T01:47:35.657Zwaiting for nexus to come up...
8342025-02-22T01:47:35.766Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8352025-02-22T01:47:36.029Zsetting up quotas...
8362025-02-22T01:47:36.119Zensuring datasets are ready...
8372025-02-22T01:47:39.521Zlet's roll.
8382025-02-22T01:47:39.545Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8392025-02-22T01:47:39.545ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.167
8402025-02-22T01:47:39.545ZOXIDE_TOKEN=oxide-token-0f8dfdb33a8aea1a7242b3665d59a8e8ec10926f'
8412025-02-22T01:47:39.546Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8422025-02-22T01:47:39.546Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.167
8432025-02-22T01:47:39.546Z++ OXIDE_TOKEN=oxide-token-0f8dfdb33a8aea1a7242b3665d59a8e8ec10926f
8442025-02-22T01:47:39.546Z+ export OXIDE_HOST OXIDE_TOKEN
8452025-02-22T01:47:39.546Z+ retry=0
8462025-02-22T01:47:39.546Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.167 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8472025-02-22T01:47:39.615Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.167 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
8482025-02-22T01:47:40.400Z{"status":"ok"}{
8492025-02-22T01:47:40.400Z "description": "some images",
8502025-02-22T01:47:40.400Z "id": "ce35a60a-84a0-4491-9fab-416ce29c4cf6",
8512025-02-22T01:47:40.400Z "name": "images",
8522025-02-22T01:47:40.400Z "time_created": "2025-02-22T01:47:39.708272Z",
8532025-02-22T01:47:40.400Z "time_modified": "2025-02-22T01:47:39.708272Z"
8542025-02-22T01:47:40.400Z}
8552025-02-22T01:47:40.424Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.167 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 --parallelism 1
 
8562025-02-22T01:50:48.181ZFeb 22 01:50:47 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:173.73.96.68:0 Unexpected { msg: "Expected ICMP Echo Request, found: 3" }
8572025-02-22T01:55:25.062ZFeb 22 01:55:24 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:24.229.44.105:0 Unexpected { msg: "Expected ICMP Echo Request, found: 3" }
 
8582025-02-22T01:58:39.389ZDone!
8592025-02-22T01:58:39.473Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.167 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
8602025-02-22T01:58:39.524Z{
8612025-02-22T01:58:39.524Z "block_size": 512,
8622025-02-22T01:58:39.524Z "description": "debian 11 original base image",
8632025-02-22T01:58:39.524Z "id": "09335800-2a7e-45e5-9936-2b868b8f561a",
8642025-02-22T01:58:39.524Z "name": "debian11",
8652025-02-22T01:58:39.524Z "os": "debian",
8662025-02-22T01:58:39.524Z "size": 2147483648,
8672025-02-22T01:58:39.524Z "time_created": "2025-02-22T01:58:39.274640Z",
8682025-02-22T01:58:39.525Z "time_modified": "2025-02-22T01:58:39.468993Z",
8692025-02-22T01:58:39.525Z "version": "11"
8702025-02-22T01:58:39.525Z}
8712025-02-22T01:58:39.525Z+ for test_bin in tests/*
8722025-02-22T01:58:39.525Z+ ./tests/bootstrap-08f7c3d692b89c36
8732025-02-22T01:58:39.594Z
8742025-02-22T01:58:39.594Zrunning 0 tests
8752025-02-22T01:58:39.622Z
8762025-02-22T01:58:39.622Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8772025-02-22T01:58:39.622Z
8782025-02-22T01:58:39.622Z+ for test_bin in tests/*
8792025-02-22T01:58:39.622Z+ ./tests/commtest-1abc88a50428029e
8802025-02-22T01:58:39.622Z
8812025-02-22T01:58:39.622Zrunning 0 tests
8822025-02-22T01:58:39.622Z
8832025-02-22T01:58:39.622Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8842025-02-22T01:58:39.622Z
8852025-02-22T01:58:39.622Z+ for test_bin in tests/*
8862025-02-22T01:58:39.622Z+ ./tests/dhcp_server-84ec46e31a36f495
8872025-02-22T01:58:39.648Z
8882025-02-22T01:58:39.649Zrunning 0 tests
8892025-02-22T01:58:39.649Z
8902025-02-22T01:58:39.649Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8912025-02-22T01:58:39.649Z
8922025-02-22T01:58:39.649Z+ for test_bin in tests/*
8932025-02-22T01:58:39.649Z+ ./tests/end_to_end_tests-26901deb272eb193
8942025-02-22T01:58:39.772Z
8952025-02-22T01:58:39.772Zrunning 3 tests
8962025-02-22T01:58:39.801Znote: configured to log to "/tmp/end_to_end_tests-26901deb272eb193-new_blueprint_noop.1407.0.log"
8972025-02-22T01:58:40.189Ztest no_spoof::no_spoof_here ... ok
8982025-02-22T01:58:41.192Ztest noop_blueprint::new_blueprint_noop ... ok
 
8992025-02-22T01:58:55.273ZFeb 22 01:58:54 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:23.141.40.123:0 Unexpected { msg: "Expected ICMP Echo Request, found: 3" }
 
9002025-02-22T01:59:10.302Ztest instance_launch::instance_launch ... ok
9012025-02-22T01:59:10.302Z
9022025-02-22T01:59:10.302Ztest result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 30.54s
9032025-02-22T01:59:10.302Z
9042025-02-22T01:59:10.326Z+ _exit_trap
9052025-02-22T01:59:10.326Z+ local status=0
9062025-02-22T01:59:10.326Z+ set +o errexit
9072025-02-22T01:59:10.326Z+ [[ x != \x ]]
9082025-02-22T01:59:10.326Z+ pfexec svcadm -Z disable -s cron
9092025-02-22T01:59:12.154Z+ [[ 0 -eq 0 ]]
9102025-02-22T01:59:12.154Z+ exit 0
9112025-02-22T01:59:12.178Zprocess exited: duration 915896 ms, exit code 0
 
9122025-02-22T01:59:12.323Zfound 119 output files
9132025-02-22T01:59:12.323Zuploading: /var/svc/log/oxide-sled-agent:default.log (1357966 bytes)
9142025-02-22T01:59:12.607Zupload warning: file "/var/svc/log/oxide-sled-agent:default.log" changed size mid upload: 1357966 -> 1361762
9152025-02-22T01:59:13.677Zuploaded: /var/svc/log/oxide-sled-agent:default.log
9162025-02-22T01:59:13.706Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (7854017 bytes)
9172025-02-22T01:59:14.222Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 7854017 -> 7879071
9182025-02-22T01:59:15.296Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
9192025-02-22T01:59:15.296Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (43375 bytes)
9202025-02-22T01:59:16.505Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
9212025-02-22T01:59:16.505Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (37244 bytes)
9222025-02-22T01:59:16.621Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log" changed size mid upload: 37244 -> 37343
9232025-02-22T01:59:17.695Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
9242025-02-22T01:59:17.695Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0 (1538 bytes)
9252025-02-22T01:59:18.787Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0
9262025-02-22T01:59:18.787Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (366776 bytes)
9272025-02-22T01:59:19.035Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 366776 -> 370375
9282025-02-22T01:59:20.103Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
9292025-02-22T01:59:20.103Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (3266 bytes)
9302025-02-22T01:59:21.196Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
9312025-02-22T01:59:21.221Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (466739 bytes)
9322025-02-22T01:59:21.443Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 466739 -> 472593
9332025-02-22T01:59:22.512Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
9342025-02-22T01:59:22.512Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (12550 bytes)
9352025-02-22T01:59:23.627Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
9362025-02-22T01:59:23.627Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (2263088 bytes)
9372025-02-22T01:59:23.959Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 2263088 -> 2298464
9382025-02-22T01:59:25.042Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
9392025-02-22T01:59:25.042Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (13617 bytes)
9402025-02-22T01:59:26.159Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
9412025-02-22T01:59:26.159Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (5534438 bytes)
9422025-02-22T01:59:26.593Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 5534438 -> 5631948
9432025-02-22T01:59:27.662Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
9442025-02-22T01:59:27.662Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (8180 bytes)
9452025-02-22T01:59:28.777Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
9462025-02-22T01:59:28.777Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (251 bytes)
9472025-02-22T01:59:29.871Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
9482025-02-22T01:59:29.871Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (3087 bytes)
9492025-02-22T01:59:30.966Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
9502025-02-22T01:59:30.966Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (506699 bytes)
9512025-02-22T01:59:31.214Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 506699 -> 517527
9522025-02-22T01:59:32.283Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
9532025-02-22T01:59:32.284Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (119 bytes)
9542025-02-22T01:59:33.376Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
9552025-02-22T01:59:33.376Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (14220 bytes)
9562025-02-22T01:59:33.444Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 14220 -> 14415
9572025-02-22T01:59:34.513Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
9582025-02-22T01:59:34.513Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (460 bytes)
9592025-02-22T01:59:35.606Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
9602025-02-22T01:59:35.606Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3383 bytes)
9612025-02-22T01:59:36.700Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
9622025-02-22T01:59:36.700Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (119 bytes)
9632025-02-22T01:59:37.795Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
9642025-02-22T01:59:37.795Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
9652025-02-22T01:59:38.865Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
9662025-02-22T01:59:38.865Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1656 bytes)
9672025-02-22T01:59:39.958Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log.0
9682025-02-22T01:59:39.983Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_clickhouse_0f177013-994e-415e-8a74-91068cd57de6/root/var/svc/log/oxide-clickhouse-admin-single:default.log (936 bytes)
9692025-02-22T01:59:41.051Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_clickhouse_0f177013-994e-415e-8a74-91068cd57de6/root/var/svc/log/oxide-clickhouse-admin-single:default.log
9702025-02-22T01:59:41.051Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_clickhouse_0f177013-994e-415e-8a74-91068cd57de6/root/var/svc/log/oxide-clickhouse:default.log (2946882 bytes)
9712025-02-22T01:59:41.412Zupload warning: file "/pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_clickhouse_0f177013-994e-415e-8a74-91068cd57de6/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2946882 -> 3073927
9722025-02-22T01:59:42.481Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_clickhouse_0f177013-994e-415e-8a74-91068cd57de6/root/var/svc/log/oxide-clickhouse:default.log
9732025-02-22T01:59:42.481Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_clickhouse_0f177013-994e-415e-8a74-91068cd57de6/root/var/svc/log/oxide-zone-network-setup:default.log (2096 bytes)
9742025-02-22T01:59:43.576Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_clickhouse_0f177013-994e-415e-8a74-91068cd57de6/root/var/svc/log/oxide-zone-network-setup:default.log
9752025-02-22T01:59:43.576Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_cockroachdb_9bbcfd58-7de5-4f55-9172-ebcd733ba9e5/root/var/svc/log/oxide-cockroach-admin:default.log (3754 bytes)
9762025-02-22T01:59:44.667Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_cockroachdb_9bbcfd58-7de5-4f55-9172-ebcd733ba9e5/root/var/svc/log/oxide-cockroach-admin:default.log
9772025-02-22T01:59:44.692Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_cockroachdb_9bbcfd58-7de5-4f55-9172-ebcd733ba9e5/root/var/svc/log/oxide-cockroachdb:default.log (4325 bytes)
9782025-02-22T01:59:45.759Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_cockroachdb_9bbcfd58-7de5-4f55-9172-ebcd733ba9e5/root/var/svc/log/oxide-cockroachdb:default.log
9792025-02-22T01:59:45.759Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_cockroachdb_9bbcfd58-7de5-4f55-9172-ebcd733ba9e5/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
9802025-02-22T01:59:46.854Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_cockroachdb_9bbcfd58-7de5-4f55-9172-ebcd733ba9e5/root/var/svc/log/oxide-zone-network-setup:default.log
9812025-02-22T01:59:46.854Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_crucible_61da01ac-7cd0-4ecb-a481-49e02736e9ae/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
9822025-02-22T01:59:47.953Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_crucible_61da01ac-7cd0-4ecb-a481-49e02736e9ae/root/var/svc/log/oxide-crucible-agent:default.log
9832025-02-22T01:59:47.977Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_crucible_61da01ac-7cd0-4ecb-a481-49e02736e9ae/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9842025-02-22T01:59:49.050Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_crucible_61da01ac-7cd0-4ecb-a481-49e02736e9ae/root/var/svc/log/oxide-crucible-downstairs:default.log
9852025-02-22T01:59:49.050Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_crucible_61da01ac-7cd0-4ecb-a481-49e02736e9ae/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
9862025-02-22T01:59:50.158Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_crucible_61da01ac-7cd0-4ecb-a481-49e02736e9ae/root/var/svc/log/oxide-zone-network-setup:default.log
9872025-02-22T01:59:50.187Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_external_dns_cb118c04-086e-4fc9-92b6-24023b160963/root/var/svc/log/oxide-external_dns:default.log (48300 bytes)
9882025-02-22T01:59:50.279Zupload warning: file "/pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_external_dns_cb118c04-086e-4fc9-92b6-24023b160963/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 48300 -> 49559
9892025-02-22T01:59:51.355Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_external_dns_cb118c04-086e-4fc9-92b6-24023b160963/root/var/svc/log/oxide-external_dns:default.log
9902025-02-22T01:59:51.355Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_external_dns_cb118c04-086e-4fc9-92b6-24023b160963/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
9912025-02-22T01:59:52.452Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_external_dns_cb118c04-086e-4fc9-92b6-24023b160963/root/var/svc/log/oxide-opte-interface-setup:default.log
9922025-02-22T01:59:52.452Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_external_dns_cb118c04-086e-4fc9-92b6-24023b160963/root/var/svc/log/oxide-zone-network-setup:default.log (2112 bytes)
9932025-02-22T01:59:53.559Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_external_dns_cb118c04-086e-4fc9-92b6-24023b160963/root/var/svc/log/oxide-zone-network-setup:default.log
9942025-02-22T01:59:53.615Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_internal_dns_c21714f1-d46e-4a76-8d24-58db3ca7edf2/root/var/svc/log/oxide-internal_dns:default.log (450326 bytes)
9952025-02-22T01:59:53.798Zupload warning: file "/pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_internal_dns_c21714f1-d46e-4a76-8d24-58db3ca7edf2/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 450326 -> 451575
9962025-02-22T01:59:54.877Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_internal_dns_c21714f1-d46e-4a76-8d24-58db3ca7edf2/root/var/svc/log/oxide-internal_dns:default.log
9972025-02-22T01:59:54.903Zuploading: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_internal_dns_c21714f1-d46e-4a76-8d24-58db3ca7edf2/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
9982025-02-22T01:59:55.976Zuploaded: /pool/ext/242255ee-bf6f-45b5-b558-56e4bbe7cc55/crypt/zone/oxz_internal_dns_c21714f1-d46e-4a76-8d24-58db3ca7edf2/root/var/svc/log/oxide-zone-network-setup:default.log
9992025-02-22T01:59:55.976Zuploading: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_dc7702f9-38be-4d8b-a0ee-bc2c25449fda/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
10002025-02-22T01:59:57.076Zuploaded: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_dc7702f9-38be-4d8b-a0ee-bc2c25449fda/root/var/svc/log/oxide-crucible-agent:default.log
10012025-02-22T01:59:57.076Zuploading: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_dc7702f9-38be-4d8b-a0ee-bc2c25449fda/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10022025-02-22T01:59:58.188Zuploaded: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_dc7702f9-38be-4d8b-a0ee-bc2c25449fda/root/var/svc/log/oxide-crucible-downstairs:default.log
10032025-02-22T01:59:58.188Zuploading: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_dc7702f9-38be-4d8b-a0ee-bc2c25449fda/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
10042025-02-22T01:59:59.296Zuploaded: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_dc7702f9-38be-4d8b-a0ee-bc2c25449fda/root/var/svc/log/oxide-zone-network-setup:default.log
10052025-02-22T01:59:59.296Zuploading: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_pantry_5a4e8e32-15b2-459b-9c78-9a21c5113481/root/var/svc/log/oxide-crucible-pantry:default.log (862662 bytes)
10062025-02-22T01:59:59.588Zupload warning: file "/pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_pantry_5a4e8e32-15b2-459b-9c78-9a21c5113481/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 862662 -> 866566
10072025-02-22T02:00:00.667Zuploaded: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_pantry_5a4e8e32-15b2-459b-9c78-9a21c5113481/root/var/svc/log/oxide-crucible-pantry:default.log
10082025-02-22T02:00:00.668Zuploading: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_pantry_5a4e8e32-15b2-459b-9c78-9a21c5113481/root/var/svc/log/oxide-zone-network-setup:default.log (2134 bytes)
10092025-02-22T02:00:01.765Zuploaded: /pool/ext/45596f7b-edce-48b7-90f1-422b674892bc/crypt/zone/oxz_crucible_pantry_5a4e8e32-15b2-459b-9c78-9a21c5113481/root/var/svc/log/oxide-zone-network-setup:default.log
10102025-02-22T02:00:01.790Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-agent:default.log (38438 bytes)
10112025-02-22T02:00:02.933Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-agent:default.log
10122025-02-22T02:00:02.933Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10132025-02-22T02:00:04.053Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:default.log
10142025-02-22T02:00:04.053Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-51b2d35c-f78b-46e4-a0e5-7dd718e002bc.log (3126 bytes)
10152025-02-22T02:00:05.166Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-51b2d35c-f78b-46e4-a0e5-7dd718e002bc.log
10162025-02-22T02:00:05.166Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-5444f2fd-bbc6-4b38-a70d-5a2a09296c1c.log (6079 bytes)
10172025-02-22T02:00:06.266Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-5444f2fd-bbc6-4b38-a70d-5a2a09296c1c.log
10182025-02-22T02:00:06.293Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-cfb8034d-78c2-4b4d-bccd-0049b79a39f5.log (5972 bytes)
10192025-02-22T02:00:07.392Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-cfb8034d-78c2-4b4d-bccd-0049b79a39f5.log
10202025-02-22T02:00:07.393Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:snapshot-5444f2fd-bbc6-4b38-a70d-5a2a09296c1c-c128378a-f9db-4e1b-a144-6c99137592dd.log (5653 bytes)
10212025-02-22T02:00:08.530Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-crucible-downstairs:snapshot-5444f2fd-bbc6-4b38-a70d-5a2a09296c1c-c128378a-f9db-4e1b-a144-6c99137592dd.log
10222025-02-22T02:00:08.530Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
10232025-02-22T02:00:09.639Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_crucible_da8cd6f5-800f-488f-b0e6-ebcecc4e56ca/root/var/svc/log/oxide-zone-network-setup:default.log
10242025-02-22T02:00:09.639Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_nexus_e67ff8a6-dd93-409c-881c-f32e425223c6/root/var/svc/log/oxide-nexus:default.log (5450796 bytes)
10252025-02-22T02:00:10.130Zupload warning: file "/pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_nexus_e67ff8a6-dd93-409c-881c-f32e425223c6/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5450796 -> 5807311
10262025-02-22T02:00:11.205Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_nexus_e67ff8a6-dd93-409c-881c-f32e425223c6/root/var/svc/log/oxide-nexus:default.log
10272025-02-22T02:00:11.234Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_nexus_e67ff8a6-dd93-409c-881c-f32e425223c6/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
10282025-02-22T02:00:12.309Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_nexus_e67ff8a6-dd93-409c-881c-f32e425223c6/root/var/svc/log/oxide-opte-interface-setup:default.log
10292025-02-22T02:00:12.309Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_nexus_e67ff8a6-dd93-409c-881c-f32e425223c6/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
10302025-02-22T02:00:13.407Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_nexus_e67ff8a6-dd93-409c-881c-f32e425223c6/root/var/svc/log/oxide-zone-network-setup:default.log
10312025-02-22T02:00:13.407Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-chrony-setup:default.log (14495 bytes)
10322025-02-22T02:00:14.529Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-chrony-setup:default.log
10332025-02-22T02:00:14.529Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-ntp:default.log (1235 bytes)
10342025-02-22T02:00:14.598Zupload warning: file "/pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 1235 -> 1294
10352025-02-22T02:00:15.669Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-ntp:default.log
10362025-02-22T02:00:15.670Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
10372025-02-22T02:00:16.770Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-opte-interface-setup:default.log
10382025-02-22T02:00:16.770Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-zone-network-setup:default.log (2031 bytes)
10392025-02-22T02:00:17.946Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/svc/log/oxide-zone-network-setup:default.log
10402025-02-22T02:00:17.946Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-agent:default.log (34880 bytes)
10412025-02-22T02:00:19.200Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-agent:default.log
10422025-02-22T02:00:19.228Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10432025-02-22T02:00:20.301Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:default.log
10442025-02-22T02:00:20.329Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:downstairs-34196514-5260-438e-9921-11aab37fedeb.log (6077 bytes)
10452025-02-22T02:00:21.404Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:downstairs-34196514-5260-438e-9921-11aab37fedeb.log
10462025-02-22T02:00:21.404Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:downstairs-56de0bbd-c37a-4677-99d2-299beaff0142.log (3009 bytes)
10472025-02-22T02:00:22.501Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:downstairs-56de0bbd-c37a-4677-99d2-299beaff0142.log
10482025-02-22T02:00:22.533Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:downstairs-dfb11945-06e4-4c16-b40d-818448f2b132.log (3126 bytes)
10492025-02-22T02:00:23.620Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:downstairs-dfb11945-06e4-4c16-b40d-818448f2b132.log
10502025-02-22T02:00:23.620Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:snapshot-34196514-5260-438e-9921-11aab37fedeb-c128378a-f9db-4e1b-a144-6c99137592dd.log (5652 bytes)
10512025-02-22T02:00:24.731Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-crucible-downstairs:snapshot-34196514-5260-438e-9921-11aab37fedeb-c128378a-f9db-4e1b-a144-6c99137592dd.log
10522025-02-22T02:00:24.764Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
10532025-02-22T02:00:25.849Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_a73295d9-1baa-46cd-9169-ae355c29e52b/root/var/svc/log/oxide-zone-network-setup:default.log
10542025-02-22T02:00:25.883Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_pantry_78ea240e-08bc-42bc-8969-a84fde9012c3/root/var/svc/log/oxide-crucible-pantry:default.log (103298 bytes)
10552025-02-22T02:00:26.026Zupload warning: file "/pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_pantry_78ea240e-08bc-42bc-8969-a84fde9012c3/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 103298 -> 111128
10562025-02-22T02:00:30.782Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_pantry_78ea240e-08bc-42bc-8969-a84fde9012c3/root/var/svc/log/oxide-crucible-pantry:default.log
10572025-02-22T02:00:30.782Zuploading: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_pantry_78ea240e-08bc-42bc-8969-a84fde9012c3/root/var/svc/log/oxide-zone-network-setup:default.log (2139 bytes)
10582025-02-22T02:00:31.884Zuploaded: /pool/ext/7f7223e3-5b2a-425e-a2a7-baf128bc24d4/crypt/zone/oxz_crucible_pantry_78ea240e-08bc-42bc-8969-a84fde9012c3/root/var/svc/log/oxide-zone-network-setup:default.log
10592025-02-22T02:00:31.884Zuploading: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_cockroachdb_5fbf54b7-fbac-4500-a0fc-acd25eba9143/root/var/svc/log/oxide-cockroach-admin:default.log (3755 bytes)
10602025-02-22T02:00:32.955Zuploaded: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_cockroachdb_5fbf54b7-fbac-4500-a0fc-acd25eba9143/root/var/svc/log/oxide-cockroach-admin:default.log
10612025-02-22T02:00:32.979Zuploading: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_cockroachdb_5fbf54b7-fbac-4500-a0fc-acd25eba9143/root/var/svc/log/oxide-cockroachdb:default.log (4298 bytes)
10622025-02-22T02:00:34.053Zuploaded: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_cockroachdb_5fbf54b7-fbac-4500-a0fc-acd25eba9143/root/var/svc/log/oxide-cockroachdb:default.log
10632025-02-22T02:00:34.077Zuploading: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_cockroachdb_5fbf54b7-fbac-4500-a0fc-acd25eba9143/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
10642025-02-22T02:00:35.151Zuploaded: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_cockroachdb_5fbf54b7-fbac-4500-a0fc-acd25eba9143/root/var/svc/log/oxide-zone-network-setup:default.log
10652025-02-22T02:00:35.151Zuploading: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_crucible_4ebf6991-3e24-454c-8bd8-32369f755e03/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
10662025-02-22T02:00:36.248Zuploaded: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_crucible_4ebf6991-3e24-454c-8bd8-32369f755e03/root/var/svc/log/oxide-crucible-agent:default.log
10672025-02-22T02:00:36.248Zuploading: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_crucible_4ebf6991-3e24-454c-8bd8-32369f755e03/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10682025-02-22T02:00:37.346Zuploaded: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_crucible_4ebf6991-3e24-454c-8bd8-32369f755e03/root/var/svc/log/oxide-crucible-downstairs:default.log
10692025-02-22T02:00:37.346Zuploading: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_crucible_4ebf6991-3e24-454c-8bd8-32369f755e03/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
10702025-02-22T02:00:38.443Zuploaded: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_crucible_4ebf6991-3e24-454c-8bd8-32369f755e03/root/var/svc/log/oxide-zone-network-setup:default.log
10712025-02-22T02:00:38.444Zuploading: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_oximeter_02e142fb-b85b-4bbc-9ff9-3aab00914e12/root/var/svc/log/oxide-oximeter:default.log (3780668 bytes)
10722025-02-22T02:00:38.850Zupload warning: file "/pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_oximeter_02e142fb-b85b-4bbc-9ff9-3aab00914e12/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 3780668 -> 4233293
10732025-02-22T02:00:39.924Zuploaded: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_oximeter_02e142fb-b85b-4bbc-9ff9-3aab00914e12/root/var/svc/log/oxide-oximeter:default.log
10742025-02-22T02:00:39.948Zuploading: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_oximeter_02e142fb-b85b-4bbc-9ff9-3aab00914e12/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
10752025-02-22T02:00:41.022Zuploaded: /pool/ext/93bd467c-936a-4919-8955-99d1930a20e3/crypt/zone/oxz_oximeter_02e142fb-b85b-4bbc-9ff9-3aab00914e12/root/var/svc/log/oxide-zone-network-setup:default.log
10762025-02-22T02:00:41.022Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_cockroachdb_bbf3976f-9829-4596-a123-f2cd6a1d6604/root/var/svc/log/oxide-cockroach-admin:default.log (3753 bytes)
10772025-02-22T02:00:42.119Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_cockroachdb_bbf3976f-9829-4596-a123-f2cd6a1d6604/root/var/svc/log/oxide-cockroach-admin:default.log
10782025-02-22T02:00:42.143Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_cockroachdb_bbf3976f-9829-4596-a123-f2cd6a1d6604/root/var/svc/log/oxide-cockroachdb:default.log (4324 bytes)
10792025-02-22T02:00:43.217Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_cockroachdb_bbf3976f-9829-4596-a123-f2cd6a1d6604/root/var/svc/log/oxide-cockroachdb:default.log
10802025-02-22T02:00:43.217Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_cockroachdb_bbf3976f-9829-4596-a123-f2cd6a1d6604/root/var/svc/log/oxide-zone-network-setup:default.log (2092 bytes)
10812025-02-22T02:00:44.315Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_cockroachdb_bbf3976f-9829-4596-a123-f2cd6a1d6604/root/var/svc/log/oxide-zone-network-setup:default.log
10822025-02-22T02:00:44.315Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_crucible_654635ae-67c7-4f70-b692-b73514e87685/root/var/svc/log/oxide-crucible-agent:default.log (12507 bytes)
10832025-02-22T02:00:45.435Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_crucible_654635ae-67c7-4f70-b692-b73514e87685/root/var/svc/log/oxide-crucible-agent:default.log
10842025-02-22T02:00:45.459Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_crucible_654635ae-67c7-4f70-b692-b73514e87685/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10852025-02-22T02:00:46.993Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_crucible_654635ae-67c7-4f70-b692-b73514e87685/root/var/svc/log/oxide-crucible-downstairs:default.log
10862025-02-22T02:00:46.993Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_crucible_654635ae-67c7-4f70-b692-b73514e87685/root/var/svc/log/oxide-crucible-downstairs:downstairs-a0e33b77-061c-429d-9c02-52b76cef048c.log (5971 bytes)
10872025-02-22T02:00:48.077Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_crucible_654635ae-67c7-4f70-b692-b73514e87685/root/var/svc/log/oxide-crucible-downstairs:downstairs-a0e33b77-061c-429d-9c02-52b76cef048c.log
10882025-02-22T02:00:48.077Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_crucible_654635ae-67c7-4f70-b692-b73514e87685/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
10892025-02-22T02:00:49.176Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_crucible_654635ae-67c7-4f70-b692-b73514e87685/root/var/svc/log/oxide-zone-network-setup:default.log
10902025-02-22T02:00:49.176Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_external_dns_1994584b-5773-4376-b710-79bb28f848a0/root/var/svc/log/oxide-external_dns:default.log (48602 bytes)
10912025-02-22T02:00:49.320Zupload warning: file "/pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_external_dns_1994584b-5773-4376-b710-79bb28f848a0/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 48602 -> 53340
10922025-02-22T02:00:50.391Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_external_dns_1994584b-5773-4376-b710-79bb28f848a0/root/var/svc/log/oxide-external_dns:default.log
10932025-02-22T02:00:50.416Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_external_dns_1994584b-5773-4376-b710-79bb28f848a0/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
10942025-02-22T02:00:51.489Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_external_dns_1994584b-5773-4376-b710-79bb28f848a0/root/var/svc/log/oxide-opte-interface-setup:default.log
10952025-02-22T02:00:51.489Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_external_dns_1994584b-5773-4376-b710-79bb28f848a0/root/var/svc/log/oxide-zone-network-setup:default.log (2109 bytes)
10962025-02-22T02:00:52.587Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_external_dns_1994584b-5773-4376-b710-79bb28f848a0/root/var/svc/log/oxide-zone-network-setup:default.log
10972025-02-22T02:00:52.587Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_internal_dns_0dfbf37e-349c-4252-b58d-3da0ffc7107d/root/var/svc/log/oxide-internal_dns:default.log (462075 bytes)
10982025-02-22T02:00:52.847Zupload warning: file "/pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_internal_dns_0dfbf37e-349c-4252-b58d-3da0ffc7107d/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 462075 -> 466790
10992025-02-22T02:00:53.924Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_internal_dns_0dfbf37e-349c-4252-b58d-3da0ffc7107d/root/var/svc/log/oxide-internal_dns:default.log
11002025-02-22T02:00:53.924Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_internal_dns_0dfbf37e-349c-4252-b58d-3da0ffc7107d/root/var/svc/log/oxide-zone-network-setup:default.log (2092 bytes)
11012025-02-22T02:00:55.020Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_internal_dns_0dfbf37e-349c-4252-b58d-3da0ffc7107d/root/var/svc/log/oxide-zone-network-setup:default.log
11022025-02-22T02:00:55.020Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_9916d778-ee8a-4e75-abbe-2b22c89c5672/root/var/svc/log/oxide-nexus:default.log (42715915 bytes)
11032025-02-22T02:00:56.840Zupload warning: file "/pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_9916d778-ee8a-4e75-abbe-2b22c89c5672/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 42715915 -> 43446945
11042025-02-22T02:00:57.890Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_9916d778-ee8a-4e75-abbe-2b22c89c5672/root/var/svc/log/oxide-nexus:default.log
11052025-02-22T02:00:57.890Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_9916d778-ee8a-4e75-abbe-2b22c89c5672/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11062025-02-22T02:00:58.988Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_9916d778-ee8a-4e75-abbe-2b22c89c5672/root/var/svc/log/oxide-opte-interface-setup:default.log
11072025-02-22T02:00:58.988Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_9916d778-ee8a-4e75-abbe-2b22c89c5672/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
11082025-02-22T02:01:00.090Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_9916d778-ee8a-4e75-abbe-2b22c89c5672/root/var/svc/log/oxide-zone-network-setup:default.log
11092025-02-22T02:01:00.114Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_c065a585-68b5-4708-9a3d-c341f4b1ef29/root/var/svc/log/oxide-nexus:default.log (5256681 bytes)
11102025-02-22T02:01:00.569Zupload warning: file "/pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_c065a585-68b5-4708-9a3d-c341f4b1ef29/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5256681 -> 5831830
11112025-02-22T02:01:01.640Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_c065a585-68b5-4708-9a3d-c341f4b1ef29/root/var/svc/log/oxide-nexus:default.log
11122025-02-22T02:01:01.664Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_c065a585-68b5-4708-9a3d-c341f4b1ef29/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11132025-02-22T02:01:02.737Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_c065a585-68b5-4708-9a3d-c341f4b1ef29/root/var/svc/log/oxide-opte-interface-setup:default.log
11142025-02-22T02:01:02.737Zuploading: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_c065a585-68b5-4708-9a3d-c341f4b1ef29/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
11152025-02-22T02:01:03.836Zuploaded: /pool/ext/98afd505-6f26-4738-8641-0d42480ddd75/crypt/zone/oxz_nexus_c065a585-68b5-4708-9a3d-c341f4b1ef29/root/var/svc/log/oxide-zone-network-setup:default.log
11162025-02-22T02:01:03.836Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_cockroachdb_efa5a110-bc81-4416-a145-bdd0128f923e/root/var/svc/log/oxide-cockroach-admin:default.log (3759 bytes)
11172025-02-22T02:01:04.933Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_cockroachdb_efa5a110-bc81-4416-a145-bdd0128f923e/root/var/svc/log/oxide-cockroach-admin:default.log
11182025-02-22T02:01:04.933Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_cockroachdb_efa5a110-bc81-4416-a145-bdd0128f923e/root/var/svc/log/oxide-cockroachdb:default.log (4324 bytes)
11192025-02-22T02:01:06.032Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_cockroachdb_efa5a110-bc81-4416-a145-bdd0128f923e/root/var/svc/log/oxide-cockroachdb:default.log
11202025-02-22T02:01:06.032Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_cockroachdb_efa5a110-bc81-4416-a145-bdd0128f923e/root/var/svc/log/oxide-zone-network-setup:default.log (2100 bytes)
11212025-02-22T02:01:07.130Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_cockroachdb_efa5a110-bc81-4416-a145-bdd0128f923e/root/var/svc/log/oxide-zone-network-setup:default.log
11222025-02-22T02:01:07.130Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_eebf34e5-86bd-429d-bbfb-1ec273498da9/root/var/svc/log/oxide-crucible-agent:default.log (8487 bytes)
11232025-02-22T02:01:08.250Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_eebf34e5-86bd-429d-bbfb-1ec273498da9/root/var/svc/log/oxide-crucible-agent:default.log
11242025-02-22T02:01:08.250Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_eebf34e5-86bd-429d-bbfb-1ec273498da9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11252025-02-22T02:01:09.347Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_eebf34e5-86bd-429d-bbfb-1ec273498da9/root/var/svc/log/oxide-crucible-downstairs:default.log
11262025-02-22T02:01:09.347Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_eebf34e5-86bd-429d-bbfb-1ec273498da9/root/var/svc/log/oxide-crucible-downstairs:downstairs-40d5da76-3a70-4f05-8b69-961819a2e576.log (3007 bytes)
11272025-02-22T02:01:10.444Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_eebf34e5-86bd-429d-bbfb-1ec273498da9/root/var/svc/log/oxide-crucible-downstairs:downstairs-40d5da76-3a70-4f05-8b69-961819a2e576.log
11282025-02-22T02:01:10.444Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_eebf34e5-86bd-429d-bbfb-1ec273498da9/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
11292025-02-22T02:01:11.542Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_eebf34e5-86bd-429d-bbfb-1ec273498da9/root/var/svc/log/oxide-zone-network-setup:default.log
11302025-02-22T02:01:11.542Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_pantry_759fe041-4f4a-44bc-86b8-373b004c47f5/root/var/svc/log/oxide-crucible-pantry:default.log (102052 bytes)
11312025-02-22T02:01:11.730Zupload warning: file "/pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_pantry_759fe041-4f4a-44bc-86b8-373b004c47f5/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 102052 -> 116833
11322025-02-22T02:01:12.804Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_pantry_759fe041-4f4a-44bc-86b8-373b004c47f5/root/var/svc/log/oxide-crucible-pantry:default.log
11332025-02-22T02:01:12.804Zuploading: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_pantry_759fe041-4f4a-44bc-86b8-373b004c47f5/root/var/svc/log/oxide-zone-network-setup:default.log (2138 bytes)
11342025-02-22T02:01:13.903Zuploaded: /pool/ext/99ca6666-eeb1-4fbd-913d-464bf7f67c34/crypt/zone/oxz_crucible_pantry_759fe041-4f4a-44bc-86b8-373b004c47f5/root/var/svc/log/oxide-zone-network-setup:default.log
11352025-02-22T02:01:13.903Zuploading: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-agent:default.log (34456 bytes)
11362025-02-22T02:01:15.070Zuploaded: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-agent:default.log
11372025-02-22T02:01:15.070Zuploading: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11382025-02-22T02:01:16.169Zuploaded: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:default.log
11392025-02-22T02:01:16.169Zuploading: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:downstairs-58ba5051-677c-4041-b886-ee9ecfde672c.log (3126 bytes)
11402025-02-22T02:01:17.267Zuploaded: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:downstairs-58ba5051-677c-4041-b886-ee9ecfde672c.log
11412025-02-22T02:01:17.267Zuploading: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:downstairs-5a941db4-791c-46d3-b759-5c2e62c85815.log (3007 bytes)
11422025-02-22T02:01:18.365Zuploaded: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:downstairs-5a941db4-791c-46d3-b759-5c2e62c85815.log
11432025-02-22T02:01:18.365Zuploading: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:downstairs-df36c583-269b-4c08-b1a7-978f2859157a.log (6079 bytes)
11442025-02-22T02:01:19.463Zuploaded: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:downstairs-df36c583-269b-4c08-b1a7-978f2859157a.log
11452025-02-22T02:01:19.464Zuploading: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:snapshot-df36c583-269b-4c08-b1a7-978f2859157a-c128378a-f9db-4e1b-a144-6c99137592dd.log (5653 bytes)
11462025-02-22T02:01:20.562Zuploaded: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-crucible-downstairs:snapshot-df36c583-269b-4c08-b1a7-978f2859157a-c128378a-f9db-4e1b-a144-6c99137592dd.log
11472025-02-22T02:01:20.562Zuploading: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
11482025-02-22T02:01:21.661Zuploaded: /pool/ext/ab346549-5ce3-4d03-94c3-5473cb6f4586/crypt/zone/oxz_crucible_0e6c70ea-6076-4f47-89ec-29391be27f10/root/var/svc/log/oxide-zone-network-setup:default.log
11492025-02-22T02:01:21.661Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_cockroachdb_a54c0b2b-b610-41f4-897b-ebd968418b27/root/var/svc/log/oxide-cockroach-admin:default.log (3760 bytes)
11502025-02-22T02:01:22.877Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_cockroachdb_a54c0b2b-b610-41f4-897b-ebd968418b27/root/var/svc/log/oxide-cockroach-admin:default.log
11512025-02-22T02:01:22.878Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_cockroachdb_a54c0b2b-b610-41f4-897b-ebd968418b27/root/var/svc/log/oxide-cockroachdb:default.log (4323 bytes)
11522025-02-22T02:01:23.974Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_cockroachdb_a54c0b2b-b610-41f4-897b-ebd968418b27/root/var/svc/log/oxide-cockroachdb:default.log
11532025-02-22T02:01:23.974Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_cockroachdb_a54c0b2b-b610-41f4-897b-ebd968418b27/root/var/svc/log/oxide-zone-network-setup:default.log (2099 bytes)
11542025-02-22T02:01:25.069Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_cockroachdb_a54c0b2b-b610-41f4-897b-ebd968418b27/root/var/svc/log/oxide-zone-network-setup:default.log
11552025-02-22T02:01:25.070Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_crucible_b4fc36de-9934-4ebd-a268-f4bc22da9ceb/root/var/svc/log/oxide-crucible-agent:default.log (12503 bytes)
11562025-02-22T02:01:26.188Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_crucible_b4fc36de-9934-4ebd-a268-f4bc22da9ceb/root/var/svc/log/oxide-crucible-agent:default.log
11572025-02-22T02:01:26.188Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_crucible_b4fc36de-9934-4ebd-a268-f4bc22da9ceb/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11582025-02-22T02:01:27.284Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_crucible_b4fc36de-9934-4ebd-a268-f4bc22da9ceb/root/var/svc/log/oxide-crucible-downstairs:default.log
11592025-02-22T02:01:27.285Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_crucible_b4fc36de-9934-4ebd-a268-f4bc22da9ceb/root/var/svc/log/oxide-crucible-downstairs:downstairs-016e31a0-ee61-4a5d-b47a-5747c1bd0a0d.log (5971 bytes)
11602025-02-22T02:01:28.380Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_crucible_b4fc36de-9934-4ebd-a268-f4bc22da9ceb/root/var/svc/log/oxide-crucible-downstairs:downstairs-016e31a0-ee61-4a5d-b47a-5747c1bd0a0d.log
11612025-02-22T02:01:28.380Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_crucible_b4fc36de-9934-4ebd-a268-f4bc22da9ceb/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
11622025-02-22T02:01:29.476Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_crucible_b4fc36de-9934-4ebd-a268-f4bc22da9ceb/root/var/svc/log/oxide-zone-network-setup:default.log
11632025-02-22T02:01:29.476Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_internal_dns_6cf08afa-9c12-46b1-bb89-3a6699eff241/root/var/svc/log/oxide-internal_dns:default.log (450331 bytes)
11642025-02-22T02:01:29.708Zupload warning: file "/pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_internal_dns_6cf08afa-9c12-46b1-bb89-3a6699eff241/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 450331 -> 459091
11652025-02-22T02:01:30.781Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_internal_dns_6cf08afa-9c12-46b1-bb89-3a6699eff241/root/var/svc/log/oxide-internal_dns:default.log
11662025-02-22T02:01:30.781Zuploading: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_internal_dns_6cf08afa-9c12-46b1-bb89-3a6699eff241/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
11672025-02-22T02:01:31.876Zuploaded: /pool/ext/fb89486c-95fa-4a60-9a74-58aaaafa7563/crypt/zone/oxz_internal_dns_6cf08afa-9c12-46b1-bb89-3a6699eff241/root/var/svc/log/oxide-zone-network-setup:default.log
11682025-02-22T02:01:31.876Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/measurements.log (214679 bytes)
11692025-02-22T02:01:31.962ZFeb 22 02:00:19 buskin last message repeated 1 time
11702025-02-22T02:01:31.996ZFeb 22 02:01:31 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:216.31.17.12:0 Unexpected { msg: "Expected ICMP Echo Request, found: 3" }
11712025-02-22T02:01:32.083Zupload warning: file "/pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/measurements.log" changed size mid upload: 214679 -> 269205
11722025-02-22T02:01:33.152Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/measurements.log
11732025-02-22T02:01:33.152Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/statistics.log (140868 bytes)
11742025-02-22T02:01:33.334Zupload warning: file "/pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/statistics.log" changed size mid upload: 140868 -> 173277
11752025-02-22T02:01:34.405Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/statistics.log
11762025-02-22T02:01:34.405Zuploading: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/tracking.log (19937 bytes)
11772025-02-22T02:01:34.497Zupload warning: file "/pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/tracking.log" changed size mid upload: 19937 -> 22313
11782025-02-22T02:01:35.567Zuploaded: /pool/ext/516b6318-9c27-4413-9ae7-5e1a474a8d3b/crypt/zone/oxz_ntp_5958d04f-e0b2-427d-b5a4-8023341d0139/root/var/log/chrony/tracking.log