01JHSH6KJHCX56HPY6BGKQRW35: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
        "/tmp/kstat/*.kstat",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.34",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01JHSH7CTFD0YB2475EZEC0DKG

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12025-01-17T07:39:26.433Zjob dependencies complete; ready to run (waiting for 35 m 7 s)
22025-01-17T07:52:04.968Zjob assigned to worker 01JHSKM4HMMBTF36Y19Q3YPVN1 [factory lab, buskin/13043] (queued for 12 m 38 s)
32025-01-17T07:52:05.236Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42025-01-17T07:52:05.284Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52025-01-17T07:52:05.322Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62025-01-17T07:52:05.356Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72025-01-17T07:52:05.389Zhttp://172.20.0.5:9969/postboot/buskin... ok
82025-01-17T07:52:05.423ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92025-01-17T07:52:05.458Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102025-01-17T07:52:05.490ZOxide Helios Version helios-2.0.23032 64-bit
112025-01-17T07:52:05.532ZConfiguring devices.
122025-01-17T07:52:05.568Z##################################################
132025-01-17T07:52:05.601Z#### ############# ##
142025-01-17T07:52:05.635Z### ### ############ ##
152025-01-17T07:52:05.668Z## ### # ## ### ## Oxide Computer Company ##
162025-01-17T07:52:05.702Z## ## ## ### # ### ##
172025-01-17T07:52:05.735Z## # ### #### #### This Station Under ##
182025-01-17T07:52:05.769Z### ### #### # ### Computer Control ##
192025-01-17T07:52:05.802Z#### #### ### ## ##
202025-01-17T07:52:05.837Z##################################################
212025-01-17T07:52:05.869ZHostname: buskin
222025-01-17T07:52:05.903ZLoading smf(7) service descriptions:
232025-01-17T07:52:06.386Zdownloading input: /input/package/work/package.tar.gz
242025-01-17T07:57:31.822Zdownloaded input: /input/package/work/package.tar.gz
 
252025-01-17T07:57:31.848Zstarting task 0: "setup"
262025-01-17T07:57:31.848Z++ uname -s
272025-01-17T07:57:31.848Z+ kern=SunOS
282025-01-17T07:57:31.848Z+ case "$kern" in
292025-01-17T07:57:31.848Z+ groupadd -g 12345 build
302025-01-17T07:57:31.848Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312025-01-17T07:57:33.840Z+ zfs create -o mountpoint=/work rpool/work
322025-01-17T07:57:33.890Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332025-01-17T07:57:33.914Z+ home_fs=zfs
342025-01-17T07:57:33.914Z+ [[ zfs == autofs ]]
352025-01-17T07:57:33.914Z+ mkdir -p /home/build
362025-01-17T07:57:33.914Z+ chown build:build /home/build /work
372025-01-17T07:57:35.899Z+ chmod 0700 /home/build /work
382025-01-17T07:57:35.923Zprocess exited: duration 4079 ms, exit code 0
 
392025-01-17T07:57:35.971Zstarting task 1: "authentication"
402025-01-17T07:57:36.013Zprocess exited: duration 41 ms, exit code 0
 
412025-01-17T07:57:36.061Zstarting task 2: "build"
422025-01-17T07:57:36.086Z+ trap _exit_trap EXIT
432025-01-17T07:57:36.087Z+ OPTE_COMMIT=
442025-01-17T07:57:36.087Z+ [[ x != \x ]]
452025-01-17T07:57:36.087Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
462025-01-17T07:57:36.182Zsecpolicy_fs_linkdir: 0x55 = 0x55
472025-01-17T07:57:36.182Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
482025-01-17T07:57:36.182Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
492025-01-17T07:57:36.182Zsecpolicy_fs_linkdir+3: 0 = 0xe5
502025-01-17T07:57:36.182Zsecpolicy_fs_linkdir+4: 0 = 0xb8
512025-01-17T07:57:36.182Zsecpolicy_fs_linkdir+5: 0 = 0x1
522025-01-17T07:57:36.182Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
532025-01-17T07:57:36.183Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
542025-01-17T07:57:36.183Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
552025-01-17T07:57:36.183Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
562025-01-17T07:57:36.183Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
572025-01-17T07:57:36.206Z+ [[ -d /opt/oxide ]]
582025-01-17T07:57:36.206Z+ pfexec mv /opt/oxide /opt/oxide-underneath
592025-01-17T07:57:36.206Z+ pfexec mkdir /opt/oxide
602025-01-17T07:57:36.206Z+ pfexec mount -F tmpfs -O swap /opt/oxide
612025-01-17T07:57:36.206Z+ [[ -d /opt/oxide-underneath ]]
622025-01-17T07:57:36.207Z+ cd /opt/oxide-underneath
632025-01-17T07:57:36.207Z+ pfexec tar ceEp@/f - .
642025-01-17T07:57:36.207Z+ cd /opt/oxide
652025-01-17T07:57:36.207Z+ pfexec tar xveEp@/f -
662025-01-17T07:57:36.239Zx ., 0 bytes, 0 tape blocks
672025-01-17T07:57:36.239Zx ./opte, 0 bytes, 0 tape blocks
682025-01-17T07:57:36.239Zx ./opte/bin, 0 bytes, 0 tape blocks
692025-01-17T07:57:36.239Zx ./opte/bin/opteadm, 17490984 bytes, 34163 tape blocks
702025-01-17T07:57:36.263Z+ pfexec rm -rf /opt/oxide-underneath
712025-01-17T07:57:36.263Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
722025-01-17T07:57:36.288Z+ pfexec mkdir /opt/oxide/work
732025-01-17T07:57:36.288Z+ pfexec chown build:build /opt/oxide/work
742025-01-17T07:57:36.288Z+ cd /opt/oxide/work
752025-01-17T07:57:36.288Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
762025-01-17T07:57:50.477ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
772025-01-17T07:57:50.478Zx .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks
782025-01-17T07:57:50.478Zx out/target/test, 107 bytes, 1 tape blocks
792025-01-17T07:57:50.478Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
802025-01-17T07:57:50.478Zx package-manifest.toml, 34009 bytes, 67 tape blocks
812025-01-17T07:57:50.478Zx smf/sled-agent/non-gimlet/config.toml, 3472 bytes, 7 tape blocks
822025-01-17T07:57:50.478Zx target/release/omicron-package, 36879272 bytes, 72030 tape blocks
832025-01-17T07:57:50.478Zx target/release/xtask, 12196664 bytes, 23822 tape blocks
842025-01-17T07:57:50.478Zx target/debug/bootstrap, 225639328 bytes, 440702 tape blocks
852025-01-17T07:57:50.478Zx tests/bootstrap-1bc1748b498a1bbc, 24857880 bytes, 48551 tape blocks
862025-01-17T07:57:50.478Zx tests/commtest-850b6ef35a64e808, 25362816 bytes, 49537 tape blocks
872025-01-17T07:57:50.478Zx tests/dhcp_server-0c31c41a3d01b317, 24857896 bytes, 48551 tape blocks
882025-01-17T07:57:50.478Zx tests/end_to_end_tests-8326264a25c96ef4, 289168600 bytes, 564783 tape blocks
892025-01-17T07:57:50.478Zx out/clickhouse.tar.gz, 300922520 bytes, 587740 tape blocks
902025-01-17T07:57:50.479Zx out/clickhouse_keeper.tar.gz, 287736346 bytes, 561986 tape blocks
912025-01-17T07:57:50.479Zx out/clickhouse_server.tar.gz, 300888407 bytes, 587673 tape blocks
922025-01-17T07:57:50.479Zx out/cockroachdb.tar.gz, 138231114 bytes, 269983 tape blocks
932025-01-17T07:57:50.479Zx out/crucible-dtrace.tar, 97792 bytes, 191 tape blocks
942025-01-17T07:57:50.479Zx out/crucible-pantry-zone.tar.gz, 29227220 bytes, 57085 tape blocks
952025-01-17T07:57:50.479Zx out/crucible-zone.tar.gz, 37704848 bytes, 73643 tape blocks
962025-01-17T07:57:50.479Zx out/external-dns.tar.gz, 36291360 bytes, 70882 tape blocks
972025-01-17T07:57:50.479Zx out/internal-dns.tar.gz, 36290356 bytes, 70880 tape blocks
982025-01-17T07:57:50.479Zx out/mg-ddm-gz.tar, 64588288 bytes, 126149 tape blocks
992025-01-17T07:57:50.479Zx out/nexus.tar.gz, 102140787 bytes, 199494 tape blocks
1002025-01-17T07:57:50.479Zx out/ntp.tar.gz, 10757920 bytes, 21012 tape blocks
1012025-01-17T07:57:50.479Zx out/omicron-gateway-softnpu.tar.gz, 24679540 bytes, 48203 tape blocks
1022025-01-17T07:57:50.479Zx out/omicron-sled-agent.tar, 116867584 bytes, 228257 tape blocks
1032025-01-17T07:57:50.479Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1042025-01-17T07:57:50.480Zx out/oximeter.tar.gz, 49287321 bytes, 96265 tape blocks
1052025-01-17T07:57:50.480Zx out/oxlog.tar, 3225600 bytes, 6300 tape blocks
1062025-01-17T07:57:50.480Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1072025-01-17T07:57:50.480Zx out/propolis-server.tar.gz, 68061443 bytes, 132933 tape blocks
1082025-01-17T07:57:50.480Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1092025-01-17T07:57:50.480Zx out/switch-softnpu.tar.gz, 241632120 bytes, 471938 tape blocks
1102025-01-17T07:57:50.508Z
1112025-01-17T07:57:50.508Zreal 14.183137923
1122025-01-17T07:57:50.508Zuser 12.551128817
1132025-01-17T07:57:50.508Zsys 2.823053101
1142025-01-17T07:57:50.508Ztrap 0.000541876
1152025-01-17T07:57:50.508Ztflt 0.000000000
1162025-01-17T07:57:50.508Zdflt 0.000000000
1172025-01-17T07:57:50.508Zkflt 0.000000000
1182025-01-17T07:57:50.508Zlock 0.000000000
1192025-01-17T07:57:50.508Zslp 12.645396337
1202025-01-17T07:57:50.508Zlat 0.344251050
1212025-01-17T07:57:50.508Zstop 0.000125592
1222025-01-17T07:57:50.508Z+ source .github/buildomat/ci-env.sh
1232025-01-17T07:57:50.508Z++ export CARGO_TERM_COLOR=always
1242025-01-17T07:57:50.508Z++ CARGO_TERM_COLOR=always
1252025-01-17T07:57:50.508Z+ bmat address ls
1262025-01-17T07:57:50.508ZNAME CIDR FIRST LAST COUNT
1272025-01-17T07:57:50.508Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1282025-01-17T07:57:50.508Z++ bmat address ls -f extra -Ho first,last,count
1292025-01-17T07:57:50.508Z+ set -- 10.151.1.164 10.151.1.227 64
1302025-01-17T07:57:50.508Z+ EXTRA_IP_START=10.151.1.164
1312025-01-17T07:57:50.509Z+ EXTRA_IP_END=10.151.1.227
1322025-01-17T07:57:50.509Z+ EXTRA_IP_COUNT=64
1332025-01-17T07:57:50.509Z+ (( EXTRA_IP_COUNT >= 32 ))
1342025-01-17T07:57:50.509Z+ EXTRA_IP_BASE=10.151.1
1352025-01-17T07:57:50.509Z+ EXTRA_IP_FOCTET=164
1362025-01-17T07:57:50.509Z+ EXTRA_IP_LOCTET=227
1372025-01-17T07:57:50.509Z+ SERVICE_IP_POOL_START=10.151.1.164
1382025-01-17T07:57:50.509Z+ SERVICE_IP_POOL_END=10.151.1.173
1392025-01-17T07:57:50.509Z+ DNS_IP1=10.151.1.164
1402025-01-17T07:57:50.509Z+ DNS_IP2=10.151.1.165
1412025-01-17T07:57:50.509Z+ UPLINK_IP=10.151.1.174
1422025-01-17T07:57:50.509Z+ IPPOOL_START=10.151.1.175
1432025-01-17T07:57:50.509Z+ IPPOOL_END=10.151.1.227
1442025-01-17T07:57:50.509Z++ ipadm show-addr -po type,addr
1452025-01-17T07:57:50.509Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1462025-01-17T07:57:50.509Z+ GATEWAY_IP=10.151.1.100
1472025-01-17T07:57:50.509Z+ [[ -n 10.151.1.100 ]]
1482025-01-17T07:57:50.509Z+ ping -s 10.151.1.100 56 1
1492025-01-17T07:57:50.509ZPING 10.151.1.100: 56 data bytes
1502025-01-17T07:57:50.509Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.013 ms
1512025-01-17T07:57:50.509Z
1522025-01-17T07:57:50.510Z----10.151.1.100 PING Statistics----
1532025-01-17T07:57:50.510Z1 packets transmitted, 1 packets received, 0% packet loss
1542025-01-17T07:57:50.510Zround-trip (ms) min/avg/max/stddev = 0.013/0.013/0.013/-nan
1552025-01-17T07:57:50.510Z++ arp -an
1562025-01-17T07:57:50.510Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1572025-01-17T07:57:50.510Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1582025-01-17T07:57:50.510Z+ routeadm -e ipv4-forwarding -u
1592025-01-17T07:57:50.617Z+ PXA_START=10.151.1.164
1602025-01-17T07:57:50.617Z+ PXA_END=10.151.1.227
1612025-01-17T07:57:50.643Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1622025-01-17T07:57:50.833Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1632025-01-17T07:57:50.858ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1642025-01-17T07:57:50.891Zcreating virtual hardware
1652025-01-17T07:57:50.915Zcreating /scratch/m2_0.vdev
1662025-01-17T07:57:50.915Zcreating /scratch/m2_1.vdev
1672025-01-17T07:57:50.915Zcreating /scratch/u2_0.vdev
1682025-01-17T07:57:50.915Zcreating /scratch/u2_1.vdev
1692025-01-17T07:57:50.915Zcreating /scratch/u2_2.vdev
1702025-01-17T07:57:50.916Zcreating /scratch/u2_3.vdev
1712025-01-17T07:57:50.916Zcreating /scratch/u2_4.vdev
1722025-01-17T07:57:50.916Zcreating /scratch/u2_5.vdev
1732025-01-17T07:57:50.916Zcreating /scratch/u2_6.vdev
1742025-01-17T07:57:50.916Zcreating /scratch/u2_7.vdev
1752025-01-17T07:57:50.916Zcreating /scratch/u2_8.vdev
1762025-01-17T07:57:50.940ZSimnet net0/sc0_0 exists
1772025-01-17T07:57:50.964ZSimnet net1/sc1_0 exists
1782025-01-17T07:57:50.964ZVnic sc0_1 exists
1792025-01-17T07:58:04.316ZUsing 10.151.1.100 as gateway ip
1802025-01-17T07:58:04.316Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1812025-01-17T07:58:04.316Zconfiguring SoftNPU ARP entry
1822025-01-17T07:58:04.361Zconfiguring SoftNPU proxy ARP
1832025-01-17T07:58:04.361ZSoftNPU state:
1842025-01-17T07:58:04.361Z local v6:
1852025-01-17T07:58:04.361Z local v4:
1862025-01-17T07:58:04.361Z router v6:
1872025-01-17T07:58:04.361Z router v4_idx:
1882025-01-17T07:58:04.361Z router v4_routes:
1892025-01-17T07:58:04.361Z resolver v4:
1902025-01-17T07:58:04.361Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1912025-01-17T07:58:04.361Z resolver v6:
1922025-01-17T07:58:04.364Z nat v4:
1932025-01-17T07:58:04.364Z nat_v6:
1942025-01-17T07:58:04.364Z port_mac:
1952025-01-17T07:58:04.364Z proxy arp:
1962025-01-17T07:58:04.364Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
1972025-01-17T07:58:04.364Zcreated virtual hardware
1982025-01-17T07:58:04.364Z
1992025-01-17T07:58:04.364Zreal 12.437558357
2002025-01-17T07:58:04.364Zuser 0.669972767
2012025-01-17T07:58:04.364Zsys 3.330289123
2022025-01-17T07:58:04.364Ztrap 0.000060606
2032025-01-17T07:58:04.364Ztflt 0.000238895
2042025-01-17T07:58:04.364Zdflt 0.000538272
2052025-01-17T07:58:04.364Zkflt 0.000025948
2062025-01-17T07:58:04.364Zlock 9:36.785301508
2072025-01-17T07:58:04.364Zslp 37.533679361
2082025-01-17T07:58:04.364Zlat 0.075689686
2092025-01-17T07:58:04.364Zstop 0.344982634
2102025-01-17T07:58:04.364Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2112025-01-17T07:58:04.364Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2122025-01-17T07:58:04.364Z+ diff -u pkg/config.toml~ pkg/config.toml
2132025-01-17T07:58:04.364Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2142025-01-17T07:58:04.364Z+++ pkg/config.toml Fri Jan 17 07:58:02 2025
2152025-01-17T07:58:04.364Z@@ -29,18 +29,18 @@
2162025-01-17T07:58:04.364Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2172025-01-17T07:58:04.364Z # followed by a string that is embedded into their fake serial values.
2182025-01-17T07:58:04.364Z vdevs = [
2192025-01-17T07:58:04.364Z- "m2_0.vdev",
2202025-01-17T07:58:04.364Z- "m2_1.vdev",
2212025-01-17T07:58:04.367Z+ "/scratch/m2_0.vdev",
2222025-01-17T07:58:04.367Z+ "/scratch/m2_1.vdev",
2232025-01-17T07:58:04.367Z
2242025-01-17T07:58:04.367Z- "u2_0.vdev",
2252025-01-17T07:58:04.367Z- "u2_1.vdev",
2262025-01-17T07:58:04.367Z- "u2_2.vdev",
2272025-01-17T07:58:04.367Z- "u2_3.vdev",
2282025-01-17T07:58:04.367Z- "u2_4.vdev",
2292025-01-17T07:58:04.367Z- "u2_5.vdev",
2302025-01-17T07:58:04.367Z- "u2_6.vdev",
2312025-01-17T07:58:04.367Z- "u2_7.vdev",
2322025-01-17T07:58:04.367Z- "u2_8.vdev",
2332025-01-17T07:58:04.367Z+ "/scratch/u2_0.vdev",
2342025-01-17T07:58:04.367Z+ "/scratch/u2_1.vdev",
2352025-01-17T07:58:04.367Z+ "/scratch/u2_2.vdev",
2362025-01-17T07:58:04.367Z+ "/scratch/u2_3.vdev",
2372025-01-17T07:58:04.367Z+ "/scratch/u2_4.vdev",
2382025-01-17T07:58:04.367Z+ "/scratch/u2_5.vdev",
2392025-01-17T07:58:04.367Z+ "/scratch/u2_6.vdev",
2402025-01-17T07:58:04.367Z+ "/scratch/u2_7.vdev",
2412025-01-17T07:58:04.367Z+ "/scratch/u2_8.vdev",
2422025-01-17T07:58:04.367Z ]
2432025-01-17T07:58:04.367Z
2442025-01-17T07:58:04.367Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2452025-01-17T07:58:04.368Z+ true
2462025-01-17T07:58:04.368Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2472025-01-17T07:58:04.368Z+ SILO_NAME=recovery
2482025-01-17T07:58:04.368Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2492025-01-17T07:58:04.368Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2502025-01-17T07:58:04.368Z+ sed -i~ '
2512025-01-17T07:58:04.369Z /^external_dns_ips/c\
2522025-01-17T07:58:04.369Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2532025-01-17T07:58:04.369Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2542025-01-17T07:58:04.369Z /^first/c\
2552025-01-17T07:58:04.369Zfirst = "10.151.1.164"
2562025-01-17T07:58:04.369Z /^last/c\
2572025-01-17T07:58:04.369Zlast = "10.151.1.173"
2582025-01-17T07:58:04.369Z }
2592025-01-17T07:58:04.369Z /^infra_ip_first/c\
2602025-01-17T07:58:04.369Zinfra_ip_first = "10.151.1.174"
2612025-01-17T07:58:04.369Z /^infra_ip_last/c\
2622025-01-17T07:58:04.369Zinfra_ip_last = "10.151.1.174"
2632025-01-17T07:58:04.369Z /^\[\[rack_network_config.ports/,/^$/ {
2642025-01-17T07:58:04.369Z /^routes/c\
2652025-01-17T07:58:04.369Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2662025-01-17T07:58:04.369Z /^addresses/c\
2672025-01-17T07:58:04.369Zaddresses = \[{address = "10.151.1.174/24"} \]
2682025-01-17T07:58:04.369Z }
2692025-01-17T07:58:04.369Z' pkg/config-rss.toml
2702025-01-17T07:58:04.369Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2712025-01-17T07:58:04.369Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2722025-01-17T07:58:04.369Z+++ pkg/config-rss.toml Fri Jan 17 07:58:02 2025
2732025-01-17T07:58:04.369Z@@ -33,7 +33,7 @@
2742025-01-17T07:58:04.370Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2752025-01-17T07:58:04.370Z # must be contained in one of the "internal services" IP Pool ranges listed
2762025-01-17T07:58:04.370Z # below.
2772025-01-17T07:58:04.370Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2782025-01-17T07:58:04.370Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2792025-01-17T07:58:04.370Z
2802025-01-17T07:58:04.370Z+ true
2812025-01-17T07:58:04.370Z # Initial TLS certificates for the external API
2822025-01-17T07:58:04.394Z #
2832025-01-17T07:58:04.394Z@@ -69,8 +69,8 @@
2842025-01-17T07:58:04.394Z #
2852025-01-17T07:58:04.394Z # For more on this and what to put here, see docs/how-to-run.adoc.
2862025-01-17T07:58:04.394Z [[internal_services_ip_pool_ranges]]
2872025-01-17T07:58:04.394Z-first = "192.168.1.20"
2882025-01-17T07:58:04.394Z-last = "192.168.1.29"
2892025-01-17T07:58:04.394Z+first = "10.151.1.164"
2902025-01-17T07:58:04.394Z+last = "10.151.1.173"
2912025-01-17T07:58:04.394Z
2922025-01-17T07:58:04.394Z # TODO - this configuration is subject to change going forward. Ultimately these
2932025-01-17T07:58:04.394Z # parameters should be provided to the control plane via wicket, but we need to
2942025-01-17T07:58:04.394Z@@ -91,8 +91,8 @@
2952025-01-17T07:58:04.394Z # A range of IP addresses used by Boundary Services on the external network. In
2962025-01-17T07:58:04.394Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2972025-01-17T07:58:04.394Z # With softnpu, only one address is used.
2982025-01-17T07:58:04.394Z-infra_ip_first = "192.168.1.30"
2992025-01-17T07:58:04.394Z-infra_ip_last = "192.168.1.30"
3002025-01-17T07:58:04.394Z+infra_ip_first = "10.151.1.174"
3012025-01-17T07:58:04.394Z+infra_ip_last = "10.151.1.174"
3022025-01-17T07:58:04.394Z
3032025-01-17T07:58:04.395Z # Configurations for BGP routers to run on the scrimlets.
3042025-01-17T07:58:04.395Z bgp = []
3052025-01-17T07:58:04.395Z@@ -100,9 +100,9 @@
3062025-01-17T07:58:04.395Z # You can configure multiple uplinks by repeating the following stanza
3072025-01-17T07:58:04.395Z [[rack_network_config.ports]]
3082025-01-17T07:58:04.395Z # Routes associated with this port.
3092025-01-17T07:58:04.395Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3102025-01-17T07:58:04.395Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3112025-01-17T07:58:04.395Z # Addresses associated with this port.
3122025-01-17T07:58:04.395Z-addresses = [{address = "192.168.1.30/24"}]
3132025-01-17T07:58:04.395Z+addresses = [{address = "10.151.1.174/24"} ]
3142025-01-17T07:58:04.395Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3152025-01-17T07:58:04.395Z port = "qsfp0"
3162025-01-17T07:58:04.395Z # The speed of this port.
3172025-01-17T07:58:04.395Za pkg/config-rss.toml 8K
3182025-01-17T07:58:04.395Za pkg/config.toml 4K
3192025-01-17T07:58:04.395Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3202025-01-17T07:58:04.395Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3212025-01-17T07:58:04.395Z+ TLS_NAME=recovery.sys.oxide.test
3222025-01-17T07:58:04.395Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3232025-01-17T07:58:04.395Z......+...+.+.........+.....+.+......+.........+......+.........+............+...+......+.....+...+...+...+......+.+...+..+.......+.....+...+.......+......+.....+.+..............+....+...+.........+.....+....+..+...+.......+........+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.............+...+..+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+............+..+...............+...+.+.....+.+........+...+...+............+...+.......+..+.......+...........+.............+..............................+............+........+.+.....+......+.......+...+..................+..+...+....+.................+..........+......+........+............+....+......+........+...................+............+....................+.+..+............+....+.....+.+........+......+.+...+..................+.................................+......+...+...+..............+.+............+...........+.......+...+............+.....+............+.+..+....+...........+...+......+....+......+...........+....+...........+...+....+...+.....+.........+.............+..+...+.+.....+....+.....+..........+..+...................+..+....+...........+......................+...+..+.+..+.......+.....+.......+..................+...........+...................+...+........+...................+............+........+.............+...+......+.........+.....+.+.....+.+..+...+.......+............+.........+.....+......+....+..+....+...+.......................+.......+......+.....+..........+............+.....+....+...+...+...+.....+.........+.......+...+...........+....+....................+.+.....+.........+.............+.....+....+...+...+...+..............................+......+...........+.......+...+..+.....................+................+...+...+..................+....................+.......+...+..+....+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3242025-01-17T07:58:05.052Z......+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+.................+.+......+...+..+...+...+...+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.........+...+........+....+...+...+.........+........+...+.+...+........+.......+..+..................+.+.....+......+.+.....+....+.....+..................+...+...............+..........+...+......+..............+.......+..+...+.........+.+........+.+.....+.............+....................+.+..............+.+..+...+.+......+..+..................+...................+...+...+............+.....+..........+...........+..........+.........+............+.........+...........+.+..+.......+...........+...+......+...+.......+.....+.........+...............+.......+...+....................+............+....+.....+.+.....+...+............+............+.+.....+....+...+............+.....+.............+..............+.+.........+...+..................+.........+..................+...+..+...+....+......+..+......+.+.....+......+.........+...+..........+.................+....+..+............+.+..+....+...+......+..+....+.........+.....+..........+.....+......+......+...+.+..................+.....+...+.......+...............+...............+..+.+..+..................+...+.+...............+.....+.+...+..+.......+..+..................+.+.....+.+...+.....+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3252025-01-17T07:58:05.075Z-----
3262025-01-17T07:58:05.099Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3272025-01-17T07:58:05.099Za pkg/initial-tls-cert.pem 2K
3282025-01-17T07:58:05.099Za pkg/initial-tls-key.pem 4K
3292025-01-17T07:58:05.099Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3302025-01-17T07:58:05.099Z+ rmdir pkg
3312025-01-17T07:58:05.099Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3322025-01-17T07:58:05.099Z+ pfexec mkdir -p /usr/oxide
3332025-01-17T07:58:05.099Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.1
3342025-01-17T07:58:05.686Z+ pfexec chmod +x /usr/oxide/oxide
3352025-01-17T07:58:05.710Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3362025-01-17T07:58:23.983Z+ OMICRON_NO_UNINSTALL=1
3372025-01-17T07:58:23.983Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3382025-01-17T07:58:24.005ZLogging to: /opt/oxide/work/out/LOG
3392025-01-17T07:58:24.641Z
3402025-01-17T07:58:24.664Zreal 0.653027499
3412025-01-17T07:58:24.664Zuser 0.140102379
3422025-01-17T07:58:24.664Zsys 3.326040889
3432025-01-17T07:58:24.664Ztrap 0.000001669
3442025-01-17T07:58:24.664Ztflt 0.000032910
3452025-01-17T07:58:24.665Zdflt 0.000850857
3462025-01-17T07:58:24.665Zkflt 0.000000000
3472025-01-17T07:58:24.665Zlock 58.834530279
3482025-01-17T07:58:24.665Zslp 0.861050744
3492025-01-17T07:58:24.665Zlat 0.003631523
3502025-01-17T07:58:24.665Zstop 0.210315609
3512025-01-17T07:58:24.665Z+ retry=0
3522025-01-17T07:58:24.665Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3532025-01-17T07:58:24.665Z+ [[ 0 -gt 30 ]]
3542025-01-17T07:58:24.665Z+ sleep 1
3552025-01-17T07:58:25.656Z+ retry=1
3562025-01-17T07:58:25.656Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3572025-01-17T07:58:25.679Z+ [[ 1 -gt 30 ]]
3582025-01-17T07:58:25.679Z+ sleep 1
3592025-01-17T07:58:26.671Z+ retry=2
3602025-01-17T07:58:26.671Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3612025-01-17T07:58:26.694Z+ [[ 2 -gt 30 ]]
3622025-01-17T07:58:26.694Z+ sleep 1
3632025-01-17T07:58:27.685Z+ retry=3
3642025-01-17T07:58:27.685Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3652025-01-17T07:58:47.932Z+ [[ 3 -gt 30 ]]
3662025-01-17T07:58:47.932Z+ sleep 1
3672025-01-17T07:58:48.935Z+ retry=4
3682025-01-17T07:58:48.935Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3692025-01-17T07:58:48.958Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3702025-01-17T07:58:48.982Zlocal v6:
3712025-01-17T07:58:48.982Zfd63:8d8a:af74:2056::1
3722025-01-17T07:58:48.982Zfe80::e887:f8ff:fe58:7635
3732025-01-17T07:58:48.982Zlocal v4:
3742025-01-17T07:58:48.982Z10.151.1.174
3752025-01-17T07:58:48.982Zrouter v6:
3762025-01-17T07:58:48.982Zrouter v4_idx:
3772025-01-17T07:58:48.982Z0.0.0.0/0 -> 0
3782025-01-17T07:58:48.982Zrouter v4_routes:
3792025-01-17T07:58:48.982Z0 -> 10.151.1.100 (2)
3802025-01-17T07:58:48.982Zresolver v4:
3812025-01-17T07:58:48.982Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3822025-01-17T07:58:48.982Z10.151.1.174 -> 8a:cd:5b:a3:6c:00
3832025-01-17T07:58:48.982Zresolver v6:
3842025-01-17T07:58:48.982Zfe80::e887:f8ff:fe58:7635 -> ea:87:f8:58:76:35
3852025-01-17T07:58:48.982Zfe80::b876:e2ff:fe11:b5db -> ba:76:e2:11:b5:db
3862025-01-17T07:58:48.982Znat v4:
3872025-01-17T07:58:48.982Znat_v6:
3882025-01-17T07:58:48.982Zport_mac:
3892025-01-17T07:58:48.982Z1000: a8:40:25:61:21:04
3902025-01-17T07:58:48.982Z2: a8:40:25:61:21:25
3912025-01-17T07:58:48.982Z1: a8:40:25:61:21:05
3922025-01-17T07:58:48.982Zproxy arp:
3932025-01-17T07:58:48.982Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
3942025-01-17T07:58:48.982Z+ retry=0
3952025-01-17T07:58:48.982Z+++ zoneadm list -n
3962025-01-17T07:58:48.982Z+++ grep oxz_ntp
3972025-01-17T07:58:49.006Z++ pfexec svcs -z -Hostate oxide/ntp
3982025-01-17T07:58:49.006Zsvcs: zone '-Hostate': entity not found
3992025-01-17T07:58:49.006Z++ true
4002025-01-17T07:58:49.006Z+ [[ '' != online ]]
4012025-01-17T07:58:49.006Z+ [[ 0 -gt 60 ]]
4022025-01-17T07:58:49.006Z+ sleep 1
4032025-01-17T07:58:49.996Z+ retry=1
4042025-01-17T07:58:50.020Z+++ zoneadm list -n
4052025-01-17T07:58:50.022Z+++ grep oxz_ntp
4062025-01-17T07:58:50.022Z++ pfexec svcs -z -Hostate oxide/ntp
4072025-01-17T07:58:50.022Zsvcs: zone '-Hostate': entity not found
4082025-01-17T07:58:50.022Z++ true
4092025-01-17T07:58:50.022Z+ [[ '' != online ]]
4102025-01-17T07:58:50.022Z+ [[ 1 -gt 60 ]]
4112025-01-17T07:58:50.023Z+ sleep 1
4122025-01-17T07:58:51.018Z+ retry=2
4132025-01-17T07:58:51.042Z+++ zoneadm list -n
4142025-01-17T07:58:51.043Z+++ grep oxz_ntp
4152025-01-17T07:58:51.043Z++ pfexec svcs -z -Hostate oxide/ntp
4162025-01-17T07:58:51.043Zsvcs: zone '-Hostate': entity not found
4172025-01-17T07:58:51.043Z++ true
4182025-01-17T07:58:51.043Z+ [[ '' != online ]]
4192025-01-17T07:58:51.043Z+ [[ 2 -gt 60 ]]
4202025-01-17T07:58:51.043Z+ sleep 1
4212025-01-17T07:58:52.044Z+ retry=3
4222025-01-17T07:58:52.067Z+++ zoneadm list -n
4232025-01-17T07:58:52.068Z+++ grep oxz_ntp
4242025-01-17T07:58:52.068Z++ pfexec svcs -z -Hostate oxide/ntp
4252025-01-17T07:58:52.068Zsvcs: zone '-Hostate': entity not found
4262025-01-17T07:58:52.068Z++ true
4272025-01-17T07:58:52.068Z+ [[ '' != online ]]
4282025-01-17T07:58:52.068Z+ [[ 3 -gt 60 ]]
4292025-01-17T07:58:52.068Z+ sleep 1
4302025-01-17T07:58:53.065Z+ retry=4
4312025-01-17T07:58:53.089Z+++ zoneadm list -n
4322025-01-17T07:58:53.089Z+++ grep oxz_ntp
4332025-01-17T07:58:53.089Z++ pfexec svcs -z -Hostate oxide/ntp
4342025-01-17T07:58:53.090Zsvcs: zone '-Hostate': entity not found
4352025-01-17T07:58:53.090Z++ true
4362025-01-17T07:58:53.090Z+ [[ '' != online ]]
4372025-01-17T07:58:53.090Z+ [[ 4 -gt 60 ]]
4382025-01-17T07:58:53.090Z+ sleep 1
4392025-01-17T07:58:54.089Z+ retry=5
4402025-01-17T07:58:54.113Z+++ zoneadm list -n
4412025-01-17T07:58:54.113Z+++ grep oxz_ntp
4422025-01-17T07:58:54.113Z++ pfexec svcs -z -Hostate oxide/ntp
4432025-01-17T07:58:54.113Zsvcs: zone '-Hostate': entity not found
4442025-01-17T07:58:54.113Z++ true
4452025-01-17T07:58:54.113Z+ [[ '' != online ]]
4462025-01-17T07:58:54.113Z+ [[ 5 -gt 60 ]]
4472025-01-17T07:58:54.113Z+ sleep 1
4482025-01-17T07:58:55.111Z+ retry=6
4492025-01-17T07:58:55.135Z+++ zoneadm list -n
4502025-01-17T07:58:55.135Z+++ grep oxz_ntp
4512025-01-17T07:58:55.135Z++ pfexec svcs -z -Hostate oxide/ntp
4522025-01-17T07:58:55.135Zsvcs: zone '-Hostate': entity not found
4532025-01-17T07:58:55.135Z++ true
4542025-01-17T07:58:55.135Z+ [[ '' != online ]]
4552025-01-17T07:58:55.135Z+ [[ 6 -gt 60 ]]
4562025-01-17T07:58:55.135Z+ sleep 1
4572025-01-17T07:58:56.133Z+ retry=7
4582025-01-17T07:58:56.157Z+++ zoneadm list -n
4592025-01-17T07:58:56.157Z+++ grep oxz_ntp
4602025-01-17T07:58:56.157Z++ pfexec svcs -z -Hostate oxide/ntp
4612025-01-17T07:58:56.157Zsvcs: zone '-Hostate': entity not found
4622025-01-17T07:58:56.158Z++ true
4632025-01-17T07:58:56.158Z+ [[ '' != online ]]
4642025-01-17T07:58:56.158Z+ [[ 7 -gt 60 ]]
4652025-01-17T07:58:56.158Z+ sleep 1
4662025-01-17T07:58:57.156Z+ retry=8
4672025-01-17T07:58:57.180Z+++ zoneadm list -n
4682025-01-17T07:58:57.180Z+++ grep oxz_ntp
4692025-01-17T07:58:57.181Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
4702025-01-17T07:58:57.207Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4712025-01-17T07:58:57.231Z++ true
4722025-01-17T07:58:57.231Z+ [[ '' != online ]]
4732025-01-17T07:58:57.231Z+ [[ 8 -gt 60 ]]
4742025-01-17T07:58:57.231Z+ sleep 1
4752025-01-17T07:58:58.212Z+ retry=9
4762025-01-17T07:58:58.236Z+++ zoneadm list -n
4772025-01-17T07:58:58.236Z+++ grep oxz_ntp
4782025-01-17T07:58:58.236Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
4792025-01-17T07:58:58.259Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4802025-01-17T07:58:58.259Z++ true
4812025-01-17T07:58:58.259Z+ [[ '' != online ]]
4822025-01-17T07:58:58.259Z+ [[ 9 -gt 60 ]]
4832025-01-17T07:58:58.259Z+ sleep 1
4842025-01-17T07:58:59.242Z+ retry=10
4852025-01-17T07:58:59.265Z+++ zoneadm list -n
4862025-01-17T07:58:59.265Z+++ grep oxz_ntp
4872025-01-17T07:58:59.265Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
4882025-01-17T07:58:59.289Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4892025-01-17T07:58:59.289Z++ true
4902025-01-17T07:58:59.289Z+ [[ '' != online ]]
4912025-01-17T07:58:59.289Z+ [[ 10 -gt 60 ]]
4922025-01-17T07:58:59.289Z+ sleep 1
4932025-01-17T07:59:00.271Z+ retry=11
4942025-01-17T07:59:00.296Z+++ zoneadm list -n
4952025-01-17T07:59:00.296Z+++ grep oxz_ntp
4962025-01-17T07:59:00.296Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
4972025-01-17T07:59:00.296Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4982025-01-17T07:59:00.320Z++ true
4992025-01-17T07:59:00.320Z+ [[ '' != online ]]
5002025-01-17T07:59:00.320Z+ [[ 11 -gt 60 ]]
5012025-01-17T07:59:00.320Z+ sleep 1
5022025-01-17T07:59:01.300Z+ retry=12
5032025-01-17T07:59:01.324Z+++ zoneadm list -n
5042025-01-17T07:59:01.324Z+++ grep oxz_ntp
5052025-01-17T07:59:01.324Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
5062025-01-17T07:59:01.324Z+ [[ offline != online ]]
5072025-01-17T07:59:01.324Z+ [[ 12 -gt 60 ]]
5082025-01-17T07:59:01.324Z+ sleep 1
5092025-01-17T07:59:02.323Z+ retry=13
5102025-01-17T07:59:02.347Z+++ zoneadm list -n
5112025-01-17T07:59:02.347Z+++ grep oxz_ntp
5122025-01-17T07:59:02.347Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
5132025-01-17T07:59:02.348Z+ [[ offline != online ]]
5142025-01-17T07:59:02.348Z+ [[ 13 -gt 60 ]]
5152025-01-17T07:59:02.348Z+ sleep 1
5162025-01-17T07:59:03.346Z+ retry=14
5172025-01-17T07:59:03.380Z+++ zoneadm list -n
5182025-01-17T07:59:03.380Z+++ grep oxz_ntp
5192025-01-17T07:59:03.380Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
5202025-01-17T07:59:03.380Z+ [[ offline != online ]]
5212025-01-17T07:59:03.380Z+ [[ 14 -gt 60 ]]
5222025-01-17T07:59:03.380Z+ sleep 1
5232025-01-17T07:59:04.368Z+ retry=15
5242025-01-17T07:59:04.392Z+++ zoneadm list -n
5252025-01-17T07:59:04.392Z+++ grep oxz_ntp
5262025-01-17T07:59:04.392Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
5272025-01-17T07:59:04.392Z+ [[ offline != online ]]
5282025-01-17T07:59:04.392Z+ [[ 15 -gt 60 ]]
5292025-01-17T07:59:04.392Z+ sleep 1
5302025-01-17T07:59:05.390Z+ retry=16
5312025-01-17T07:59:05.414Z+++ zoneadm list -n
5322025-01-17T07:59:05.415Z+++ grep oxz_ntp
5332025-01-17T07:59:05.415Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
5342025-01-17T07:59:05.415Z+ [[ offline != online ]]
5352025-01-17T07:59:05.415Z+ [[ 16 -gt 60 ]]
5362025-01-17T07:59:05.415Z+ sleep 1
5372025-01-17T07:59:06.413Z+ retry=17
5382025-01-17T07:59:06.437Z+++ zoneadm list -n
5392025-01-17T07:59:06.437Z+++ grep oxz_ntp
5402025-01-17T07:59:06.437Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
5412025-01-17T07:59:06.437Z+ [[ offline != online ]]
5422025-01-17T07:59:06.437Z+ [[ 17 -gt 60 ]]
5432025-01-17T07:59:06.437Z+ sleep 1
 
5442025-01-17T07:59:06.905Zbuskin console login: Jan 17 07:59:05 buskin ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5452025-01-17T07:59:07.435Z+ retry=18
5462025-01-17T07:59:07.459Z+++ zoneadm list -n
5472025-01-17T07:59:07.459Z+++ grep oxz_ntp
5482025-01-17T07:59:07.459Z++ pfexec svcs -z oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df -Hostate oxide/ntp
5492025-01-17T07:59:07.459Z+ [[ online != online ]]
5502025-01-17T07:59:07.459Z+ echo 'Waited for chrony: 18s'
5512025-01-17T07:59:07.459ZWaited for chrony: 18s
5522025-01-17T07:59:07.459Z+ retry=0
5532025-01-17T07:59:07.459Z+ zoneadm list
5542025-01-17T07:59:07.460Z+ grep nexus
5552025-01-17T07:59:07.484Z+ [[ 0 -gt 300 ]]
5562025-01-17T07:59:07.484Z+ sleep 1
5572025-01-17T07:59:08.466Z+ retry=1
5582025-01-17T07:59:08.490Z+ zoneadm list
5592025-01-17T07:59:08.490Z+ grep nexus
5602025-01-17T07:59:08.490Z+ [[ 1 -gt 300 ]]
5612025-01-17T07:59:08.490Z+ sleep 1
5622025-01-17T07:59:09.476Z+ retry=2
5632025-01-17T07:59:09.500Z+ zoneadm list
5642025-01-17T07:59:09.500Z+ grep nexus
5652025-01-17T07:59:09.500Z+ [[ 2 -gt 300 ]]
5662025-01-17T07:59:09.500Z+ sleep 1
5672025-01-17T07:59:10.487Z+ retry=3
5682025-01-17T07:59:10.510Z+ zoneadm list
5692025-01-17T07:59:10.510Z+ grep nexus
5702025-01-17T07:59:10.511Z+ [[ 3 -gt 300 ]]
5712025-01-17T07:59:10.511Z+ sleep 1
5722025-01-17T07:59:11.498Z+ retry=4
5732025-01-17T07:59:11.522Z+ zoneadm list
5742025-01-17T07:59:11.522Z+ grep nexus
5752025-01-17T07:59:11.522Z+ [[ 4 -gt 300 ]]
5762025-01-17T07:59:11.522Z+ sleep 1
5772025-01-17T07:59:12.514Z+ retry=5
5782025-01-17T07:59:12.537Z+ zoneadm list
5792025-01-17T07:59:12.537Z+ grep nexus
5802025-01-17T07:59:12.537Z+ [[ 5 -gt 300 ]]
5812025-01-17T07:59:12.537Z+ sleep 1
5822025-01-17T07:59:13.525Z+ retry=6
5832025-01-17T07:59:13.549Z+ zoneadm list
5842025-01-17T07:59:13.549Z+ grep nexus
5852025-01-17T07:59:13.549Z+ [[ 6 -gt 300 ]]
5862025-01-17T07:59:13.549Z+ sleep 1
5872025-01-17T07:59:14.540Z+ retry=7
5882025-01-17T07:59:14.579Z+ zoneadm list
5892025-01-17T07:59:14.603Z+ grep nexus
5902025-01-17T07:59:14.603Z+ [[ 7 -gt 300 ]]
5912025-01-17T07:59:14.603Z+ sleep 1
5922025-01-17T07:59:15.605Z+ retry=8
5932025-01-17T07:59:15.605Z+ grep nexus
5942025-01-17T07:59:15.629Z+ zoneadm list
5952025-01-17T07:59:15.689Z+ [[ 8 -gt 300 ]]
5962025-01-17T07:59:15.691Z+ sleep 1
5972025-01-17T07:59:16.705Z+ retry=9
5982025-01-17T07:59:16.729Z+ zoneadm list
5992025-01-17T07:59:16.729Z+ grep nexus
6002025-01-17T07:59:16.729Z+ [[ 9 -gt 300 ]]
6012025-01-17T07:59:16.729Z+ sleep 1
6022025-01-17T07:59:17.724Z+ retry=10
6032025-01-17T07:59:17.748Z+ zoneadm list
6042025-01-17T07:59:17.748Z+ grep nexus
6052025-01-17T07:59:17.748Z+ [[ 10 -gt 300 ]]
6062025-01-17T07:59:17.748Z+ sleep 1
6072025-01-17T07:59:18.739Z+ retry=11
6082025-01-17T07:59:18.762Z+ zoneadm list
6092025-01-17T07:59:18.762Z+ grep nexus
6102025-01-17T07:59:18.762Z+ [[ 11 -gt 300 ]]
6112025-01-17T07:59:18.763Z+ sleep 1
6122025-01-17T07:59:19.753Z+ retry=12
6132025-01-17T07:59:19.777Z+ zoneadm list
6142025-01-17T07:59:19.777Z+ grep nexus
6152025-01-17T07:59:19.777Z+ [[ 12 -gt 300 ]]
6162025-01-17T07:59:19.777Z+ sleep 1
6172025-01-17T07:59:20.769Z+ retry=13
6182025-01-17T07:59:20.793Z+ zoneadm list
6192025-01-17T07:59:20.793Z+ grep nexus
6202025-01-17T07:59:20.793Z+ [[ 13 -gt 300 ]]
6212025-01-17T07:59:20.793Z+ sleep 1
6222025-01-17T07:59:21.782Z+ retry=14
6232025-01-17T07:59:21.806Z+ zoneadm list
6242025-01-17T07:59:21.807Z+ grep nexus
6252025-01-17T07:59:21.807Z+ [[ 14 -gt 300 ]]
6262025-01-17T07:59:21.807Z+ sleep 1
6272025-01-17T07:59:22.794Z+ retry=15
6282025-01-17T07:59:22.818Z+ zoneadm list
6292025-01-17T07:59:22.818Z+ grep nexus
6302025-01-17T07:59:22.818Z+ [[ 15 -gt 300 ]]
6312025-01-17T07:59:22.818Z+ sleep 1
6322025-01-17T07:59:23.808Z+ retry=16
6332025-01-17T07:59:23.832Z+ zoneadm list
6342025-01-17T07:59:23.832Z+ grep nexus
6352025-01-17T07:59:23.832Z+ [[ 16 -gt 300 ]]
6362025-01-17T07:59:23.832Z+ sleep 1
6372025-01-17T07:59:24.820Z+ retry=17
6382025-01-17T07:59:24.844Z+ zoneadm list
6392025-01-17T07:59:24.844Z+ grep nexus
6402025-01-17T07:59:24.844Z+ [[ 17 -gt 300 ]]
6412025-01-17T07:59:24.844Z+ sleep 1
6422025-01-17T07:59:25.832Z+ retry=18
6432025-01-17T07:59:25.857Z+ zoneadm list
6442025-01-17T07:59:25.857Z+ grep nexus
6452025-01-17T07:59:25.857Z+ [[ 18 -gt 300 ]]
6462025-01-17T07:59:25.857Z+ sleep 1
6472025-01-17T07:59:26.844Z+ retry=19
6482025-01-17T07:59:26.868Z+ zoneadm list
6492025-01-17T07:59:26.868Z+ grep nexus
6502025-01-17T07:59:26.868Z+ [[ 19 -gt 300 ]]
6512025-01-17T07:59:26.868Z+ sleep 1
6522025-01-17T07:59:27.856Z+ retry=20
6532025-01-17T07:59:27.880Z+ zoneadm list
6542025-01-17T07:59:27.880Z+ grep nexus
6552025-01-17T07:59:27.880Z+ [[ 20 -gt 300 ]]
6562025-01-17T07:59:27.880Z+ sleep 1
6572025-01-17T07:59:28.868Z+ retry=21
6582025-01-17T07:59:28.891Z+ zoneadm list
6592025-01-17T07:59:28.891Z+ grep nexus
6602025-01-17T07:59:28.891Z+ [[ 21 -gt 300 ]]
6612025-01-17T07:59:28.892Z+ sleep 1
6622025-01-17T07:59:29.881Z+ retry=22
6632025-01-17T07:59:29.905Z+ zoneadm list
6642025-01-17T07:59:29.905Z+ grep nexus
6652025-01-17T07:59:29.905Z+ [[ 22 -gt 300 ]]
6662025-01-17T07:59:29.905Z+ sleep 1
6672025-01-17T07:59:30.902Z+ retry=23
6682025-01-17T07:59:31.022Z+ zoneadm list
6692025-01-17T07:59:31.023Z+ grep nexus
6702025-01-17T07:59:31.023Z+ [[ 23 -gt 300 ]]
6712025-01-17T07:59:31.023Z+ sleep 1
6722025-01-17T07:59:35.477Z+ retry=24
6732025-01-17T07:59:35.725Z+ zoneadm list
6742025-01-17T07:59:35.748Z+ grep nexus
6752025-01-17T07:59:35.748Z+ [[ 24 -gt 300 ]]
6762025-01-17T07:59:35.748Z+ sleep 1
6772025-01-17T07:59:36.742Z+ retry=25
6782025-01-17T07:59:36.766Z+ zoneadm list
6792025-01-17T07:59:36.766Z+ grep nexus
6802025-01-17T07:59:36.766Z+ [[ 25 -gt 300 ]]
6812025-01-17T07:59:36.766Z+ sleep 1
6822025-01-17T07:59:37.755Z+ retry=26
6832025-01-17T07:59:37.779Z+ zoneadm list
6842025-01-17T07:59:37.779Z+ grep nexus
6852025-01-17T07:59:37.779Z+ [[ 26 -gt 300 ]]
6862025-01-17T07:59:37.779Z+ sleep 1
6872025-01-17T07:59:38.769Z+ retry=27
6882025-01-17T07:59:38.793Z+ zoneadm list
6892025-01-17T07:59:38.793Z+ grep nexus
6902025-01-17T07:59:38.793Z+ [[ 27 -gt 300 ]]
6912025-01-17T07:59:38.793Z+ sleep 1
6922025-01-17T07:59:39.785Z+ retry=28
6932025-01-17T07:59:39.809Z+ zoneadm list
6942025-01-17T07:59:39.809Z+ grep nexus
6952025-01-17T07:59:39.809Z+ [[ 28 -gt 300 ]]
6962025-01-17T07:59:39.809Z+ sleep 1
6972025-01-17T07:59:40.798Z+ retry=29
6982025-01-17T07:59:40.821Z+ zoneadm list
6992025-01-17T07:59:40.821Z+ grep nexus
7002025-01-17T07:59:40.821Z+ [[ 29 -gt 300 ]]
7012025-01-17T07:59:40.821Z+ sleep 1
7022025-01-17T07:59:41.809Z+ retry=30
7032025-01-17T07:59:41.833Z+ zoneadm list
7042025-01-17T07:59:41.833Z+ grep nexus
7052025-01-17T07:59:41.833Z+ [[ 30 -gt 300 ]]
7062025-01-17T07:59:41.833Z+ sleep 1
7072025-01-17T07:59:42.822Z+ retry=31
7082025-01-17T07:59:42.845Z+ zoneadm list
7092025-01-17T07:59:42.846Z+ grep nexus
7102025-01-17T07:59:42.846Z+ [[ 31 -gt 300 ]]
7112025-01-17T07:59:42.846Z+ sleep 1
7122025-01-17T07:59:43.836Z+ retry=32
7132025-01-17T07:59:43.860Z+ zoneadm list
7142025-01-17T07:59:43.860Z+ grep nexus
7152025-01-17T07:59:43.860Z+ [[ 32 -gt 300 ]]
7162025-01-17T07:59:43.860Z+ sleep 1
7172025-01-17T07:59:44.849Z+ retry=33
7182025-01-17T07:59:44.873Z+ zoneadm list
7192025-01-17T07:59:44.873Z+ grep nexus
7202025-01-17T07:59:44.873Z+ [[ 33 -gt 300 ]]
7212025-01-17T07:59:44.873Z+ sleep 1
7222025-01-17T07:59:45.864Z+ retry=34
7232025-01-17T07:59:45.888Z+ zoneadm list
7242025-01-17T07:59:45.888Z+ grep nexus
7252025-01-17T07:59:45.888Z+ [[ 34 -gt 300 ]]
7262025-01-17T07:59:45.888Z+ sleep 1
7272025-01-17T07:59:46.890Z+ retry=35
7282025-01-17T07:59:46.915Z+ zoneadm list
7292025-01-17T07:59:46.915Z+ grep nexus
7302025-01-17T07:59:46.915Z+ [[ 35 -gt 300 ]]
7312025-01-17T07:59:46.915Z+ sleep 1
7322025-01-17T07:59:47.910Z+ retry=36
7332025-01-17T07:59:47.934Z+ zoneadm list
7342025-01-17T07:59:47.934Z+ grep nexus
7352025-01-17T07:59:47.934Z+ [[ 36 -gt 300 ]]
7362025-01-17T07:59:47.934Z+ sleep 1
7372025-01-17T07:59:51.252Z+ retry=37
7382025-01-17T07:59:51.284Z+ zoneadm list
7392025-01-17T07:59:51.284Z+ grep nexus
7402025-01-17T07:59:51.653Z+ [[ 37 -gt 300 ]]
7412025-01-17T07:59:51.653Z+ sleep 1
7422025-01-17T07:59:52.729Z+ retry=38
7432025-01-17T07:59:52.753Z+ zoneadm list
7442025-01-17T07:59:52.777Z+ grep nexus
7452025-01-17T07:59:52.800Z+ [[ 38 -gt 300 ]]
7462025-01-17T07:59:52.800Z+ sleep 1
7472025-01-17T07:59:53.890Z+ retry=39
7482025-01-17T07:59:53.915Z+ zoneadm list
7492025-01-17T07:59:53.915Z+ grep nexus
7502025-01-17T07:59:53.915Z+ [[ 39 -gt 300 ]]
7512025-01-17T07:59:53.915Z+ sleep 1
7522025-01-17T07:59:54.905Z+ retry=40
7532025-01-17T07:59:54.929Z+ zoneadm list
7542025-01-17T07:59:54.929Z+ grep nexus
7552025-01-17T07:59:54.929Z+ [[ 40 -gt 300 ]]
7562025-01-17T07:59:54.929Z+ sleep 1
7572025-01-17T07:59:55.931Z+ retry=41
7582025-01-17T07:59:55.955Z+ zoneadm list
7592025-01-17T07:59:55.955Z+ grep nexus
7602025-01-17T07:59:55.955Z+ [[ 41 -gt 300 ]]
7612025-01-17T07:59:55.955Z+ sleep 1
7622025-01-17T08:00:02.951Z+ retry=42
7632025-01-17T08:00:03.346Z+ zoneadm list
7642025-01-17T08:00:03.346Z+ grep nexus
7652025-01-17T08:00:03.347Z+ [[ 42 -gt 300 ]]
7662025-01-17T08:00:03.347Z+ sleep 1
7672025-01-17T08:00:03.638Z+ retry=43
7682025-01-17T08:00:03.662Z+ zoneadm list
7692025-01-17T08:00:03.662Z+ grep nexus
7702025-01-17T08:00:03.662Z+ [[ 43 -gt 300 ]]
7712025-01-17T08:00:03.662Z+ sleep 1
7722025-01-17T08:00:04.667Z+ retry=44
7732025-01-17T08:00:04.692Z+ zoneadm list
7742025-01-17T08:00:04.692Z+ grep nexus
7752025-01-17T08:00:04.692Z+ [[ 44 -gt 300 ]]
7762025-01-17T08:00:04.692Z+ sleep 1
7772025-01-17T08:00:05.691Z+ retry=45
7782025-01-17T08:00:05.797Z+ zoneadm list
7792025-01-17T08:00:05.797Z+ grep nexus
7802025-01-17T08:00:05.797Zoxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
7812025-01-17T08:00:05.797Z+ echo 'Waited for nexus: 45s'
7822025-01-17T08:00:05.797ZWaited for nexus: 45s
7832025-01-17T08:00:05.797Z+ export RUST_BACKTRACE=1
7842025-01-17T08:00:05.797Z+ RUST_BACKTRACE=1
7852025-01-17T08:00:05.797Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
7862025-01-17T08:00:05.797Z++ ./target/debug/bootstrap
7872025-01-17T08:00:07.611ZUsing external DNS server at 10.151.1.164:53
7882025-01-17T08:00:07.650Z2025-01-17 08:00:07.638005179 UTC: attempting to log into API
7892025-01-17T08:00:22.713Z2025-01-17 08:00:22.700747228 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
7902025-01-17T08:00:23.720Z2025-01-17 08:00:23.701774721 UTC: attempting to log into API
 
7912025-01-17T08:00:33.163ZJan 17 08:00:32 buskin ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
7922025-01-17T08:00:33.196ZJan 17 08:00:32 buskin ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
7932025-01-17T08:00:34.074ZJan 17 08:00:33 buskin ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
7942025-01-17T08:00:34.109ZJan 17 08:00:33 buskin ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
7952025-01-17T08:00:34.700ZJan 17 08:00:34 buskin ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
 
7962025-01-17T08:00:38.766Z2025-01-17 08:00:38.754392365 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
7972025-01-17T08:00:39.767Z2025-01-17 08:00:39.755730372 UTC: attempting to log into API
7982025-01-17T08:00:54.800Z2025-01-17 08:00:54.788918838 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
7992025-01-17T08:00:55.801Z2025-01-17 08:00:55.789147520 UTC: attempting to log into API
8002025-01-17T08:01:10.833Z2025-01-17 08:01:10.822056553 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8012025-01-17T08:01:11.835Z2025-01-17 08:01:11.823340369 UTC: attempting to log into API
8022025-01-17T08:01:22.656Z2025-01-17 08:01:22.644232758 UTC: login succeeded
8032025-01-17T08:01:22.689Zwaiting for nexus to come up...
8042025-01-17T08:01:22.781Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8052025-01-17T08:01:23.013Zsetting up quotas...
8062025-01-17T08:01:23.065Zensuring datasets are ready...
8072025-01-17T08:01:26.345Zlet's roll.
8082025-01-17T08:01:26.371Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8092025-01-17T08:01:26.371ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.168
8102025-01-17T08:01:26.371ZOXIDE_TOKEN=oxide-token-f40500ef0085bc738da278157110ca04cfd7c1a0'
8112025-01-17T08:01:26.371Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8122025-01-17T08:01:26.371Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.168
8132025-01-17T08:01:26.371Z++ OXIDE_TOKEN=oxide-token-f40500ef0085bc738da278157110ca04cfd7c1a0
8142025-01-17T08:01:26.371Z+ export OXIDE_HOST OXIDE_TOKEN
8152025-01-17T08:01:26.371Z+ retry=0
8162025-01-17T08:01:26.371Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8172025-01-17T08:01:26.432Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
8182025-01-17T08:01:27.413Z{"status":"ok"}{
8192025-01-17T08:01:27.413Z "description": "some images",
8202025-01-17T08:01:27.413Z "id": "10aa9a0d-d85b-4119-b038-1f20c7ce6d3a",
8212025-01-17T08:01:27.413Z "name": "images",
8222025-01-17T08:01:27.413Z "time_created": "2025-01-17T08:01:26.542629Z",
8232025-01-17T08:01:27.413Z "time_modified": "2025-01-17T08:01:26.542629Z"
8242025-01-17T08:01:27.413Z}
8252025-01-17T08:01:27.436Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 --parallelism 1
 
8262025-01-17T08:08:41.691ZJan 17 08:08:41 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:23.141.40.123:0 Unexpected { msg: "Expected ICMP Echo Request, found: 3" }
 
8272025-01-17T08:12:11.622ZDone!
8282025-01-17T08:12:11.647Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.168 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
8292025-01-17T08:12:11.775Z{
8302025-01-17T08:12:11.775Z "block_size": 512,
8312025-01-17T08:12:11.775Z "description": "debian 11 original base image",
8322025-01-17T08:12:11.775Z "id": "12698e16-746f-45c2-98ab-3b3aba628905",
8332025-01-17T08:12:11.775Z "name": "debian11",
8342025-01-17T08:12:11.775Z "os": "debian",
8352025-01-17T08:12:11.775Z "size": 2147483648,
8362025-01-17T08:12:11.775Z "time_created": "2025-01-17T08:12:11.529142Z",
8372025-01-17T08:12:11.775Z "time_modified": "2025-01-17T08:12:11.752586Z",
8382025-01-17T08:12:11.775Z "version": "11"
8392025-01-17T08:12:11.779Z}
8402025-01-17T08:12:11.807Z+ for test_bin in tests/*
8412025-01-17T08:12:11.807Z+ ./tests/bootstrap-1bc1748b498a1bbc
8422025-01-17T08:12:11.843Z
8432025-01-17T08:12:11.843Zrunning 0 tests
8442025-01-17T08:12:11.843Z
8452025-01-17T08:12:11.843Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8462025-01-17T08:12:11.843Z
8472025-01-17T08:12:11.843Z+ for test_bin in tests/*
8482025-01-17T08:12:11.843Z+ ./tests/commtest-850b6ef35a64e808
8492025-01-17T08:12:11.868Z
8502025-01-17T08:12:11.868Zrunning 0 tests
8512025-01-17T08:12:11.868Z
8522025-01-17T08:12:11.868Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8532025-01-17T08:12:11.868Z
8542025-01-17T08:12:11.868Z+ for test_bin in tests/*
8552025-01-17T08:12:11.868Z+ ./tests/dhcp_server-0c31c41a3d01b317
8562025-01-17T08:12:11.892Z
8572025-01-17T08:12:11.892Zrunning 0 tests
8582025-01-17T08:12:11.892Z
8592025-01-17T08:12:11.892Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8602025-01-17T08:12:11.892Z
8612025-01-17T08:12:11.892Z+ for test_bin in tests/*
8622025-01-17T08:12:11.892Z+ ./tests/end_to_end_tests-8326264a25c96ef4
8632025-01-17T08:12:12.173Z
8642025-01-17T08:12:12.173Zrunning 3 tests
8652025-01-17T08:12:12.202Znote: configured to log to "/tmp/end_to_end_tests-8326264a25c96ef4-new_blueprint_noop.5397.0.log"
8662025-01-17T08:12:12.593Ztest no_spoof::no_spoof_here ... ok
8672025-01-17T08:12:13.691Ztest noop_blueprint::new_blueprint_noop ... ok
8682025-01-17T08:12:41.162Ztest instance_launch::instance_launch ... ok
8692025-01-17T08:12:41.185Z
8702025-01-17T08:12:41.185Ztest result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 28.99s
8712025-01-17T08:12:41.185Z
8722025-01-17T08:12:41.186Z+ _exit_trap
8732025-01-17T08:12:41.186Z+ local status=0
8742025-01-17T08:12:41.186Z+ set +o errexit
8752025-01-17T08:12:41.186Z+ [[ x != \x ]]
8762025-01-17T08:12:41.186Z+ pfexec svcadm -Z disable -s cron
8772025-01-17T08:12:43.240Z+ [[ 0 -eq 0 ]]
8782025-01-17T08:12:43.240Z+ exit 0
8792025-01-17T08:12:43.263Zprocess exited: duration 907168 ms, exit code 0
 
8802025-01-17T08:12:43.337Zfound 144 output files
8812025-01-17T08:12:43.389Zuploading: /var/svc/log/oxide-sled-agent:default.log (1388958 bytes)
8822025-01-17T08:12:44.704Zuploaded: /var/svc/log/oxide-sled-agent:default.log
8832025-01-17T08:12:44.704Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (7212082 bytes)
8842025-01-17T08:12:45.162Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 7212082 -> 7227763
8852025-01-17T08:12:46.229Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
8862025-01-17T08:12:46.229Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (633932 bytes)
8872025-01-17T08:12:47.516Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
8882025-01-17T08:12:47.516Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (7310 bytes)
8892025-01-17T08:12:48.627Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
8902025-01-17T08:12:48.627Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0 (31213 bytes)
8912025-01-17T08:12:49.782Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0
8922025-01-17T08:12:49.782Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (350736 bytes)
8932025-01-17T08:12:49.999Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 350736 -> 353509
8942025-01-17T08:12:51.066Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
8952025-01-17T08:12:51.066Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (18413 bytes)
8962025-01-17T08:12:52.199Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
8972025-01-17T08:12:52.224Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (455040 bytes)
8982025-01-17T08:12:52.417Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 455040 -> 458604
8992025-01-17T08:12:53.484Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
9002025-01-17T08:12:53.484Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (20637 bytes)
9012025-01-17T08:12:54.618Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
9022025-01-17T08:12:54.618Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (2044398 bytes)
9032025-01-17T08:12:54.931Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 2044398 -> 2069307
9042025-01-17T08:12:55.998Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
9052025-01-17T08:12:55.998Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (211585 bytes)
9062025-01-17T08:12:57.238Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
9072025-01-17T08:12:57.238Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (4969718 bytes)
9082025-01-17T08:12:57.653Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 4969718 -> 5066552
9092025-01-17T08:12:58.722Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
9102025-01-17T08:12:58.722Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (512708 bytes)
9112025-01-17T08:13:00.007Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
9122025-01-17T08:13:00.007Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
9132025-01-17T08:13:01.078Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
9142025-01-17T08:13:01.078Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (3336 bytes)
9152025-01-17T08:13:02.168Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
9162025-01-17T08:13:02.168Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (381019 bytes)
9172025-01-17T08:13:02.385Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 381019 -> 390856
9182025-01-17T08:13:03.453Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
9192025-01-17T08:13:03.453Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (32372 bytes)
9202025-01-17T08:13:04.606Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
9212025-01-17T08:13:04.606Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (13455 bytes)
9222025-01-17T08:13:05.717Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
9232025-01-17T08:13:05.717Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (835 bytes)
9242025-01-17T08:13:06.807Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
9252025-01-17T08:13:06.807Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
9262025-01-17T08:13:07.874Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
9272025-01-17T08:13:07.898Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (3502 bytes)
9282025-01-17T08:13:08.964Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
9292025-01-17T08:13:08.964Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
9302025-01-17T08:13:10.032Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
9312025-01-17T08:13:10.032Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1663 bytes)
9322025-01-17T08:13:11.123Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log.0
9332025-01-17T08:13:11.123Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-agent:default.log (28683 bytes)
9342025-01-17T08:13:12.277Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-agent:default.log
9352025-01-17T08:13:12.277Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9362025-01-17T08:13:13.368Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-downstairs:default.log
9372025-01-17T08:13:13.368Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-downstairs:downstairs-80727c8b-27d4-41fa-99be-f749a47ed528.log (5973 bytes)
9382025-01-17T08:13:14.460Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-downstairs:downstairs-80727c8b-27d4-41fa-99be-f749a47ed528.log
9392025-01-17T08:13:14.460Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-downstairs:downstairs-c88d64a3-2fcf-47ca-8597-3efb7f868941.log (6080 bytes)
9402025-01-17T08:13:15.550Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-downstairs:downstairs-c88d64a3-2fcf-47ca-8597-3efb7f868941.log
9412025-01-17T08:13:15.550Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-downstairs:snapshot-c88d64a3-2fcf-47ca-8597-3efb7f868941-83c188b1-47d6-489c-ada4-e53845a57c36.log (5653 bytes)
9422025-01-17T08:13:16.639Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-crucible-downstairs:snapshot-c88d64a3-2fcf-47ca-8597-3efb7f868941-83c188b1-47d6-489c-ada4-e53845a57c36.log
9432025-01-17T08:13:16.639Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
9442025-01-17T08:13:17.730Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442/root/var/svc/log/oxide-zone-network-setup:default.log
9452025-01-17T08:13:17.730Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff/root/var/svc/log/oxide-nexus:default.log (5235220 bytes)
9462025-01-17T08:13:18.166Zupload warning: file "/pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5235220 -> 5382572
9472025-01-17T08:13:19.233Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff/root/var/svc/log/oxide-nexus:default.log
9482025-01-17T08:13:19.233Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
9492025-01-17T08:13:20.325Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff/root/var/svc/log/oxide-opte-interface-setup:default.log
9502025-01-17T08:13:20.325Zuploading: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff/root/var/svc/log/oxide-zone-network-setup:default.log (2056 bytes)
9512025-01-17T08:13:21.416Zuploaded: /pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff/root/var/svc/log/oxide-zone-network-setup:default.log
9522025-01-17T08:13:21.416Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-cockroach-admin:default.log (2827 bytes)
9532025-01-17T08:13:22.596Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-cockroach-admin:default.log
9542025-01-17T08:13:22.596Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-cockroach-admin:default.log.0 (1868 bytes)
9552025-01-17T08:13:23.688Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-cockroach-admin:default.log.0
9562025-01-17T08:13:23.688Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
9572025-01-17T08:13:24.754Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-cockroachdb:default.log
9582025-01-17T08:13:24.754Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-cockroachdb:default.log.0 (4298 bytes)
9592025-01-17T08:13:25.844Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-cockroachdb:default.log.0
9602025-01-17T08:13:25.845Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
9612025-01-17T08:13:26.911Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-zone-network-setup:default.log
9622025-01-17T08:13:26.911Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
9632025-01-17T08:13:28.001Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0/root/var/svc/log/oxide-zone-network-setup:default.log.0
9642025-01-17T08:13:28.001Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-crucible-agent:default.log (18571 bytes)
9652025-01-17T08:13:29.134Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-crucible-agent:default.log
9662025-01-17T08:13:29.134Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9672025-01-17T08:13:30.227Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-crucible-downstairs:default.log
9682025-01-17T08:13:30.227Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-crucible-downstairs:downstairs-008880e9-74a1-4f14-bc52-fb7f28e2f251.log (3006 bytes)
9692025-01-17T08:13:31.316Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-crucible-downstairs:downstairs-008880e9-74a1-4f14-bc52-fb7f28e2f251.log
9702025-01-17T08:13:31.316Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-crucible-downstairs:downstairs-de3d9386-5728-4e6e-8c49-771daaa1e33e.log (3126 bytes)
9712025-01-17T08:13:32.407Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-crucible-downstairs:downstairs-de3d9386-5728-4e6e-8c49-771daaa1e33e.log
9722025-01-17T08:13:32.407Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
9732025-01-17T08:13:33.498Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993/root/var/svc/log/oxide-zone-network-setup:default.log
9742025-01-17T08:13:33.498Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3/root/var/svc/log/oxide-crucible-pantry:default.log (867985 bytes)
9752025-01-17T08:13:33.764Zupload warning: file "/pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 867985 -> 871900
9762025-01-17T08:13:34.831Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3/root/var/svc/log/oxide-crucible-pantry:default.log
9772025-01-17T08:13:34.831Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3/root/var/svc/log/oxide-zone-network-setup:default.log (2137 bytes)
9782025-01-17T08:13:35.921Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3/root/var/svc/log/oxide-zone-network-setup:default.log
9792025-01-17T08:13:35.921Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52/root/var/svc/log/oxide-internal_dns:default.log (97400 bytes)
9802025-01-17T08:13:37.117Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52/root/var/svc/log/oxide-internal_dns:default.log
9812025-01-17T08:13:37.117Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52/root/var/svc/log/oxide-internal_dns:default.log.0 (378295 bytes)
9822025-01-17T08:13:38.380Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52/root/var/svc/log/oxide-internal_dns:default.log.0
9832025-01-17T08:13:38.380Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
9842025-01-17T08:13:39.448Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52/root/var/svc/log/oxide-zone-network-setup:default.log
9852025-01-17T08:13:39.448Zuploading: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
9862025-01-17T08:13:40.538Zuploaded: /pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52/root/var/svc/log/oxide-zone-network-setup:default.log.0
9872025-01-17T08:13:40.538Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68/root/var/svc/log/oxide-clickhouse-admin-single:default.log (937 bytes)
9882025-01-17T08:13:41.628Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68/root/var/svc/log/oxide-clickhouse-admin-single:default.log
9892025-01-17T08:13:41.628Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68/root/var/svc/log/oxide-clickhouse:default.log (3703298 bytes)
9902025-01-17T08:13:42.004Zupload warning: file "/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 3703298 -> 3974279
9912025-01-17T08:13:43.071Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68/root/var/svc/log/oxide-clickhouse:default.log
9922025-01-17T08:13:43.071Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68/root/var/svc/log/oxide-zone-network-setup:default.log (2097 bytes)
9932025-01-17T08:13:44.161Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68/root/var/svc/log/oxide-zone-network-setup:default.log
9942025-01-17T08:13:44.161Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-cockroach-admin:default.log (2828 bytes)
9952025-01-17T08:13:45.252Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-cockroach-admin:default.log
9962025-01-17T08:13:45.253Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-cockroach-admin:default.log.0 (1868 bytes)
9972025-01-17T08:13:46.343Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-cockroach-admin:default.log.0
9982025-01-17T08:13:46.343Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
9992025-01-17T08:13:47.414Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-cockroachdb:default.log
10002025-01-17T08:13:47.414Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-cockroachdb:default.log.0 (4325 bytes)
10012025-01-17T08:13:48.507Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-cockroachdb:default.log.0
10022025-01-17T08:13:48.507Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10032025-01-17T08:13:49.578Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-zone-network-setup:default.log
10042025-01-17T08:13:49.578Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
10052025-01-17T08:13:50.671Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410/root/var/svc/log/oxide-zone-network-setup:default.log.0
10062025-01-17T08:13:50.671Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-agent:default.log (28219 bytes)
10072025-01-17T08:13:51.807Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-agent:default.log
10082025-01-17T08:13:51.807Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10092025-01-17T08:13:52.901Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-downstairs:default.log
10102025-01-17T08:13:52.901Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-downstairs:downstairs-0a02382e-1a45-42b8-81c6-035431a3844e.log (5972 bytes)
10112025-01-17T08:13:53.995Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-downstairs:downstairs-0a02382e-1a45-42b8-81c6-035431a3844e.log
10122025-01-17T08:13:53.995Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-downstairs:downstairs-9d003104-34aa-45e0-9663-7d75f1faa489.log (6078 bytes)
10132025-01-17T08:13:55.089Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-downstairs:downstairs-9d003104-34aa-45e0-9663-7d75f1faa489.log
10142025-01-17T08:13:55.089Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-downstairs:snapshot-9d003104-34aa-45e0-9663-7d75f1faa489-83c188b1-47d6-489c-ada4-e53845a57c36.log (5653 bytes)
10152025-01-17T08:13:56.181Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-crucible-downstairs:snapshot-9d003104-34aa-45e0-9663-7d75f1faa489-83c188b1-47d6-489c-ada4-e53845a57c36.log
10162025-01-17T08:13:56.205Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
10172025-01-17T08:13:57.275Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077/root/var/svc/log/oxide-zone-network-setup:default.log
10182025-01-17T08:13:57.276Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef/root/var/svc/log/oxide-external_dns:default.log (49565 bytes)
10192025-01-17T08:13:57.410Zupload warning: file "/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 49565 -> 53342
10202025-01-17T08:13:58.480Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef/root/var/svc/log/oxide-external_dns:default.log
10212025-01-17T08:13:58.504Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
10222025-01-17T08:13:59.575Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef/root/var/svc/log/oxide-opte-interface-setup:default.log
10232025-01-17T08:13:59.577Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef/root/var/svc/log/oxide-zone-network-setup:default.log (2113 bytes)
10242025-01-17T08:14:00.672Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef/root/var/svc/log/oxide-zone-network-setup:default.log
10252025-01-17T08:14:00.672Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-internal_dns:default.log (97402 bytes)
10262025-01-17T08:14:00.827Zupload warning: file "/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 97402 -> 101155
10272025-01-17T08:14:01.901Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-internal_dns:default.log
10282025-01-17T08:14:01.901Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-internal_dns:default.log.0 (378294 bytes)
10292025-01-17T08:14:03.176Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-internal_dns:default.log.0
10302025-01-17T08:14:03.176Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10312025-01-17T08:14:04.247Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-zone-network-setup:default.log
10322025-01-17T08:14:04.270Zuploading: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2092 bytes)
10332025-01-17T08:14:05.341Zuploaded: /pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b/root/var/svc/log/oxide-zone-network-setup:default.log.0
10342025-01-17T08:14:05.341Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-crucible-agent:default.log (20606 bytes)
10352025-01-17T08:14:06.478Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-crucible-agent:default.log
10362025-01-17T08:14:06.479Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10372025-01-17T08:14:07.574Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-crucible-downstairs:default.log
10382025-01-17T08:14:07.574Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-crucible-downstairs:downstairs-35aa7493-e976-47d2-aaa6-0395561442a0.log (6079 bytes)
10392025-01-17T08:14:08.694Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-crucible-downstairs:downstairs-35aa7493-e976-47d2-aaa6-0395561442a0.log
10402025-01-17T08:14:08.720Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-crucible-downstairs:snapshot-35aa7493-e976-47d2-aaa6-0395561442a0-83c188b1-47d6-489c-ada4-e53845a57c36.log (5658 bytes)
10412025-01-17T08:14:09.790Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-crucible-downstairs:snapshot-35aa7493-e976-47d2-aaa6-0395561442a0-83c188b1-47d6-489c-ada4-e53845a57c36.log
10422025-01-17T08:14:09.790Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
10432025-01-17T08:14:10.883Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506/root/var/svc/log/oxide-zone-network-setup:default.log
10442025-01-17T08:14:10.883Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-chrony-setup:default.log (0 bytes)
10452025-01-17T08:14:11.953Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-chrony-setup:default.log
10462025-01-17T08:14:11.953Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-chrony-setup:default.log.0 (14495 bytes)
10472025-01-17T08:14:13.069Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-chrony-setup:default.log.0
10482025-01-17T08:14:13.069Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-ntp:default.log (2926 bytes)
10492025-01-17T08:14:14.165Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-ntp:default.log
10502025-01-17T08:14:14.165Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-ntp:default.log.0 (1755 bytes)
10512025-01-17T08:14:15.262Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-ntp:default.log.0
10522025-01-17T08:14:15.262Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
10532025-01-17T08:14:16.332Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-opte-interface-setup:default.log
10542025-01-17T08:14:16.332Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1125 bytes)
10552025-01-17T08:14:17.425Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-opte-interface-setup:default.log.0
10562025-01-17T08:14:17.425Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10572025-01-17T08:14:18.493Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-zone-network-setup:default.log
10582025-01-17T08:14:18.493Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2032 bytes)
10592025-01-17T08:14:19.583Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/svc/log/oxide-zone-network-setup:default.log.0
10602025-01-17T08:14:19.584Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7/root/var/svc/log/oxide-oximeter:default.log (3950648 bytes)
10612025-01-17T08:14:21.055Zupload warning: file "/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 3950648 -> 4476923
10622025-01-17T08:14:22.121Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7/root/var/svc/log/oxide-oximeter:default.log
10632025-01-17T08:14:22.121Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7/root/var/svc/log/oxide-zone-network-setup:default.log (2080 bytes)
10642025-01-17T08:14:23.212Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7/root/var/svc/log/oxide-zone-network-setup:default.log
10652025-01-17T08:14:23.212Zuploading: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b/root/var/svc/log/oxide-crucible-agent:default.log (12501 bytes)
10662025-01-17T08:14:24.325Zuploaded: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b/root/var/svc/log/oxide-crucible-agent:default.log
10672025-01-17T08:14:24.325Zuploading: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10682025-01-17T08:14:25.415Zuploaded: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b/root/var/svc/log/oxide-crucible-downstairs:default.log
10692025-01-17T08:14:25.416Zuploading: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b/root/var/svc/log/oxide-crucible-downstairs:downstairs-1acc49d3-3d9d-4af9-ac75-79601553b71e.log (3127 bytes)
10702025-01-17T08:14:26.505Zuploaded: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b/root/var/svc/log/oxide-crucible-downstairs:downstairs-1acc49d3-3d9d-4af9-ac75-79601553b71e.log
10712025-01-17T08:14:26.506Zuploading: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
10722025-01-17T08:14:27.595Zuploaded: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b/root/var/svc/log/oxide-zone-network-setup:default.log
10732025-01-17T08:14:27.595Zuploading: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047/root/var/svc/log/oxide-nexus:default.log (42469152 bytes)
10742025-01-17T08:14:35.339Zupload warning: file "/pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 42469152 -> 43218970
10752025-01-17T08:14:36.406Zuploaded: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047/root/var/svc/log/oxide-nexus:default.log
10762025-01-17T08:14:36.406Zuploading: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047/root/var/svc/log/oxide-opte-interface-setup:default.log (1133 bytes)
10772025-01-17T08:14:37.497Zuploaded: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047/root/var/svc/log/oxide-opte-interface-setup:default.log
10782025-01-17T08:14:37.497Zuploading: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047/root/var/svc/log/oxide-zone-network-setup:default.log (2054 bytes)
10792025-01-17T08:14:38.588Zuploaded: /pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047/root/var/svc/log/oxide-zone-network-setup:default.log
10802025-01-17T08:14:38.588Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-cockroach-admin:default.log (2828 bytes)
10812025-01-17T08:14:39.678Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-cockroach-admin:default.log
10822025-01-17T08:14:39.678Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-cockroach-admin:default.log.0 (1868 bytes)
10832025-01-17T08:14:40.768Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-cockroach-admin:default.log.0
10842025-01-17T08:14:40.769Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
10852025-01-17T08:14:41.835Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-cockroachdb:default.log
10862025-01-17T08:14:41.835Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-cockroachdb:default.log.0 (4325 bytes)
10872025-01-17T08:14:42.927Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-cockroachdb:default.log.0
10882025-01-17T08:14:42.951Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10892025-01-17T08:14:43.994Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-zone-network-setup:default.log
10902025-01-17T08:14:43.994Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
10912025-01-17T08:14:45.088Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2/root/var/svc/log/oxide-zone-network-setup:default.log.0
10922025-01-17T08:14:45.112Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d/root/var/svc/log/oxide-crucible-agent:default.log (8485 bytes)
10932025-01-17T08:14:46.203Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d/root/var/svc/log/oxide-crucible-agent:default.log
10942025-01-17T08:14:46.203Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10952025-01-17T08:14:47.307Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d/root/var/svc/log/oxide-crucible-downstairs:default.log
10962025-01-17T08:14:47.307Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d/root/var/svc/log/oxide-crucible-downstairs:downstairs-71067eec-900d-49af-ad2e-99872cd97132.log (3005 bytes)
10972025-01-17T08:14:48.399Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d/root/var/svc/log/oxide-crucible-downstairs:downstairs-71067eec-900d-49af-ad2e-99872cd97132.log
10982025-01-17T08:14:48.400Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
10992025-01-17T08:14:49.493Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d/root/var/svc/log/oxide-zone-network-setup:default.log
11002025-01-17T08:14:49.494Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e/root/var/svc/log/oxide-crucible-pantry:default.log (102371 bytes)
11012025-01-17T08:14:49.653Zupload warning: file "/pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 102371 -> 118025
11022025-01-17T08:14:50.723Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e/root/var/svc/log/oxide-crucible-pantry:default.log
11032025-01-17T08:14:50.723Zuploading: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e/root/var/svc/log/oxide-zone-network-setup:default.log (2139 bytes)
11042025-01-17T08:14:51.816Zuploaded: /pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e/root/var/svc/log/oxide-zone-network-setup:default.log
11052025-01-17T08:14:51.817Zuploading: /pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone/oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
11062025-01-17T08:14:52.910Zuploaded: /pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone/oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0/root/var/svc/log/oxide-crucible-agent:default.log
11072025-01-17T08:14:52.910Zuploading: /pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone/oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11082025-01-17T08:14:54.005Zuploaded: /pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone/oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0/root/var/svc/log/oxide-crucible-downstairs:default.log
11092025-01-17T08:14:54.005Zuploading: /pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone/oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
11102025-01-17T08:14:55.098Zuploaded: /pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone/oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0/root/var/svc/log/oxide-zone-network-setup:default.log
11112025-01-17T08:14:55.099Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-cockroach-admin:default.log (7319 bytes)
11122025-01-17T08:14:56.215Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-cockroach-admin:default.log
11132025-01-17T08:14:56.215Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-cockroach-admin:default.log.0 (1868 bytes)
11142025-01-17T08:14:57.309Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-cockroach-admin:default.log.0
11152025-01-17T08:14:57.309Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11162025-01-17T08:14:58.379Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-cockroachdb:default.log
11172025-01-17T08:14:58.379Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-cockroachdb:default.log.0 (4325 bytes)
11182025-01-17T08:14:59.473Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-cockroachdb:default.log.0
11192025-01-17T08:14:59.473Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11202025-01-17T08:15:00.543Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-zone-network-setup:default.log
11212025-01-17T08:15:00.545Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
11222025-01-17T08:15:01.639Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680/root/var/svc/log/oxide-zone-network-setup:default.log.0
11232025-01-17T08:15:01.639Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
11242025-01-17T08:15:02.732Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19/root/var/svc/log/oxide-crucible-agent:default.log
11252025-01-17T08:15:02.732Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11262025-01-17T08:15:03.825Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19/root/var/svc/log/oxide-crucible-downstairs:default.log
11272025-01-17T08:15:03.825Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
11282025-01-17T08:15:04.918Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19/root/var/svc/log/oxide-zone-network-setup:default.log
11292025-01-17T08:15:04.918Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d/root/var/svc/log/oxide-external_dns:default.log (49574 bytes)
11302025-01-17T08:15:05.053Zupload warning: file "/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 49574 -> 57126
11312025-01-17T08:15:06.122Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d/root/var/svc/log/oxide-external_dns:default.log
11322025-01-17T08:15:06.122Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d/root/var/svc/log/oxide-opte-interface-setup:default.log (1154 bytes)
11332025-01-17T08:15:07.216Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d/root/var/svc/log/oxide-opte-interface-setup:default.log
11342025-01-17T08:15:07.216Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d/root/var/svc/log/oxide-zone-network-setup:default.log (2113 bytes)
11352025-01-17T08:15:08.311Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d/root/var/svc/log/oxide-zone-network-setup:default.log
11362025-01-17T08:15:08.311Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-internal_dns:default.log (97404 bytes)
11372025-01-17T08:15:08.469Zupload warning: file "/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 97404 -> 104912
11382025-01-17T08:15:09.539Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-internal_dns:default.log
11392025-01-17T08:15:09.539Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-internal_dns:default.log.0 (378274 bytes)
11402025-01-17T08:15:10.813Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-internal_dns:default.log.0
11412025-01-17T08:15:10.813Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11422025-01-17T08:15:11.884Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-zone-network-setup:default.log
11432025-01-17T08:15:11.884Zuploading: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
11442025-01-17T08:15:12.977Zuploaded: /pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680/root/var/svc/log/oxide-zone-network-setup:default.log.0
11452025-01-17T08:15:12.977Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-cockroach-admin:default.log (2829 bytes)
11462025-01-17T08:15:14.071Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-cockroach-admin:default.log
11472025-01-17T08:15:14.071Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-cockroach-admin:default.log.0 (1868 bytes)
11482025-01-17T08:15:15.164Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-cockroach-admin:default.log.0
11492025-01-17T08:15:15.165Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11502025-01-17T08:15:16.237Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-cockroachdb:default.log
11512025-01-17T08:15:16.237Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-cockroachdb:default.log.0 (4325 bytes)
11522025-01-17T08:15:17.332Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-cockroachdb:default.log.0
11532025-01-17T08:15:17.332Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11542025-01-17T08:15:18.403Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-zone-network-setup:default.log
11552025-01-17T08:15:18.403Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2094 bytes)
11562025-01-17T08:15:19.497Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759/root/var/svc/log/oxide-zone-network-setup:default.log.0
11572025-01-17T08:15:19.497Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-agent:default.log (29674 bytes)
11582025-01-17T08:15:20.655Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-agent:default.log
11592025-01-17T08:15:20.655Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11602025-01-17T08:15:21.749Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-downstairs:default.log
11612025-01-17T08:15:21.749Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-downstairs:downstairs-3d97d1ba-698d-464f-b362-54d6d0af8486.log (5974 bytes)
11622025-01-17T08:15:22.842Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-downstairs:downstairs-3d97d1ba-698d-464f-b362-54d6d0af8486.log
11632025-01-17T08:15:22.842Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-downstairs:downstairs-6827c2de-9e4d-4bbc-bd98-2b56c8f2b4f5.log (3125 bytes)
11642025-01-17T08:15:23.937Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-downstairs:downstairs-6827c2de-9e4d-4bbc-bd98-2b56c8f2b4f5.log
11652025-01-17T08:15:23.937Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-downstairs:downstairs-846186e5-e120-4e1f-9f79-69c3df2c8165.log (3006 bytes)
11662025-01-17T08:15:25.031Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-crucible-downstairs:downstairs-846186e5-e120-4e1f-9f79-69c3df2c8165.log
11672025-01-17T08:15:25.032Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
11682025-01-17T08:15:26.126Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14/root/var/svc/log/oxide-zone-network-setup:default.log
11692025-01-17T08:15:26.126Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c/root/var/svc/log/oxide-crucible-pantry:default.log (102111 bytes)
11702025-01-17T08:15:26.283Zupload warning: file "/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 102111 -> 121634
11712025-01-17T08:15:27.353Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c/root/var/svc/log/oxide-crucible-pantry:default.log
11722025-01-17T08:15:27.353Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c/root/var/svc/log/oxide-zone-network-setup:default.log (2137 bytes)
11732025-01-17T08:15:28.446Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c/root/var/svc/log/oxide-zone-network-setup:default.log
11742025-01-17T08:15:28.446Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2/root/var/svc/log/oxide-nexus:default.log (5282665 bytes)
11752025-01-17T08:15:28.905Zupload warning: file "/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5282665 -> 6155071
11762025-01-17T08:15:29.975Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2/root/var/svc/log/oxide-nexus:default.log
11772025-01-17T08:15:29.975Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11782025-01-17T08:15:31.069Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2/root/var/svc/log/oxide-opte-interface-setup:default.log
11792025-01-17T08:15:31.070Zuploading: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2/root/var/svc/log/oxide-zone-network-setup:default.log (2056 bytes)
11802025-01-17T08:15:32.163Zuploaded: /pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2/root/var/svc/log/oxide-zone-network-setup:default.log
11812025-01-17T08:15:32.164Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/measurements.log (227968 bytes)
11822025-01-17T08:15:32.390Zupload warning: file "/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/measurements.log" changed size mid upload: 227968 -> 280987
11832025-01-17T08:15:33.460Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/measurements.log
11842025-01-17T08:15:33.460Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/statistics.log (157716 bytes)
11852025-01-17T08:15:33.641Zupload warning: file "/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/statistics.log" changed size mid upload: 157716 -> 196443
11862025-01-17T08:15:34.715Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/statistics.log
11872025-01-17T08:15:34.715Zuploading: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/tracking.log (22448 bytes)
11882025-01-17T08:15:34.806Zupload warning: file "/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/tracking.log" changed size mid upload: 22448 -> 25484
11892025-01-17T08:15:35.877Zuploaded: /pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df/root/var/log/chrony/tracking.log