01J5HYM2T5CCDZSFPX43J85BN7: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.33",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01J5HYND5A3NC90Y7WB247AYDN

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-08-18T05:46:58.561Zjob dependencies complete; ready to run (waiting for 30 m 6 s)
22024-08-18T06:09:55.006Zjob assigned to worker 01J5J1N84H8HTY2N72S699CWKZ (queued for 22 m 56 s)
32024-08-18T06:09:55.132Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-08-18T06:09:55.171Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-08-18T06:09:55.205Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-08-18T06:09:55.238Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-08-18T06:09:55.292Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-08-18T06:09:55.327ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-08-18T06:09:55.361Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102024-08-18T06:09:55.394ZOxide Helios Version helios-2.0.22815 64-bit
112024-08-18T06:09:55.428ZConfiguring devices.
122024-08-18T06:09:55.461Z##################################################
132024-08-18T06:09:55.494Z#### ############# ##
142024-08-18T06:09:55.528Z### ### ############ ##
152024-08-18T06:09:55.561Z## ### # ## ### ## Oxide Computer Company ##
162024-08-18T06:09:55.595Z## ## ## ### # ### ##
172024-08-18T06:09:55.628Z## # ### #### #### This Station Under ##
182024-08-18T06:09:55.662Z### ### #### # ### Computer Control ##
192024-08-18T06:09:55.695Z#### #### ### ## ##
202024-08-18T06:09:55.729Z##################################################
212024-08-18T06:09:55.762ZHostname: sock
222024-08-18T06:09:55.795ZLoading smf(7) service descriptions:
232024-08-18T06:09:56.917Zdownloading input: /input/package/work/package.tar.gz
242024-08-18T06:13:47.227Zdownloaded input: /input/package/work/package.tar.gz
 
252024-08-18T06:13:47.251Zstarting task 0: "setup"
262024-08-18T06:13:47.252Z++ uname -s
272024-08-18T06:13:47.252Z+ kern=SunOS
282024-08-18T06:13:47.252Z+ case "$kern" in
292024-08-18T06:13:47.252Z+ groupadd -g 12345 build
302024-08-18T06:13:47.252Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-08-18T06:13:49.195Z+ zfs create -o mountpoint=/work rpool/work
322024-08-18T06:13:49.238Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-08-18T06:13:49.262Z+ home_fs=zfs
342024-08-18T06:13:49.262Z+ [[ zfs == autofs ]]
352024-08-18T06:13:49.262Z+ mkdir -p /home/build
362024-08-18T06:13:49.262Z+ chown build:build /home/build /work
372024-08-18T06:13:51.247Z+ chmod 0700 /home/build /work
382024-08-18T06:13:51.271Zprocess exited: duration 4073 ms, exit code 0
 
392024-08-18T06:13:51.319Zstarting task 1: "authentication"
402024-08-18T06:13:51.362Zprocess exited: duration 43 ms, exit code 0
 
412024-08-18T06:13:51.411Zstarting task 2: "build"
422024-08-18T06:13:51.435Z+ trap _exit_trap EXIT
432024-08-18T06:13:51.435Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-08-18T06:13:51.531Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-08-18T06:13:51.531Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-08-18T06:13:51.531Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-08-18T06:13:51.531Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-08-18T06:13:51.531Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-08-18T06:13:51.531Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-08-18T06:13:51.531Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-08-18T06:13:51.531Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-08-18T06:13:51.555Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-08-18T06:13:51.555Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-08-18T06:13:51.555Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-08-18T06:13:51.555Z+ [[ -d /opt/oxide ]]
562024-08-18T06:13:51.555Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-08-18T06:13:51.555Z+ pfexec mkdir /opt/oxide
582024-08-18T06:13:51.555Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-08-18T06:13:51.555Z+ [[ -d /opt/oxide-underneath ]]
602024-08-18T06:13:51.555Z+ cd /opt/oxide-underneath
612024-08-18T06:13:51.555Z+ pfexec tar ceEp@/f - .
622024-08-18T06:13:51.555Z+ cd /opt/oxide
632024-08-18T06:13:51.556Z+ pfexec tar xveEp@/f -
642024-08-18T06:13:51.661Zx ., 0 bytes, 0 tape blocks
652024-08-18T06:13:51.661Zx ./opte, 0 bytes, 0 tape blocks
662024-08-18T06:13:51.661Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-08-18T06:13:51.661Zx ./opte/bin/opteadm, 52693888 bytes, 102918 tape blocks
682024-08-18T06:13:51.685Z+ pfexec rm -rf /opt/oxide-underneath
692024-08-18T06:13:51.685Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-08-18T06:13:51.709Z+ pfexec mkdir /opt/oxide/work
712024-08-18T06:13:51.709Z+ pfexec chown build:build /opt/oxide/work
722024-08-18T06:13:51.709Z+ cd /opt/oxide/work
732024-08-18T06:13:51.709Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-08-18T06:14:02.313ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-08-18T06:14:02.313Zx out/target/test, 75 bytes, 1 tape blocks
762024-08-18T06:14:02.313Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-08-18T06:14:02.313Zx package-manifest.toml, 30603 bytes, 60 tape blocks
782024-08-18T06:14:02.313Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-08-18T06:14:02.313Zx target/release/omicron-package, 33037560 bytes, 64527 tape blocks
802024-08-18T06:14:02.313Zx target/release/xtask, 11905056 bytes, 23253 tape blocks
812024-08-18T06:14:02.313Zx target/debug/bootstrap, 195532904 bytes, 381901 tape blocks
822024-08-18T06:14:02.313Zx tests/bootstrap-af8d5cc3281ab129, 24308600 bytes, 47478 tape blocks
832024-08-18T06:14:02.313Zx tests/commtest-bd5d25e5dea10e42, 24541008 bytes, 47932 tape blocks
842024-08-18T06:14:02.313Zx tests/dhcp_server-6c88a0f47b8cceda, 24308616 bytes, 47478 tape blocks
852024-08-18T06:14:02.313Zx tests/end_to_end_tests-083eddcef089b629, 208729664 bytes, 407676 tape blocks
862024-08-18T06:14:02.313Zx out/clickhouse.tar.gz, 237932435 bytes, 464712 tape blocks
872024-08-18T06:14:02.313Zx out/clickhouse_keeper.tar.gz, 237906993 bytes, 464663 tape blocks
882024-08-18T06:14:02.313Zx out/cockroachdb.tar.gz, 135044626 bytes, 263760 tape blocks
892024-08-18T06:14:02.313Zx out/crucible-dtrace.tar, 85504 bytes, 167 tape blocks
902024-08-18T06:14:02.313Zx out/crucible-pantry-zone.tar.gz, 28486397 bytes, 55638 tape blocks
912024-08-18T06:14:02.313Zx out/crucible-zone.tar.gz, 39052324 bytes, 76275 tape blocks
922024-08-18T06:14:02.313Zx out/external-dns.tar.gz, 25470110 bytes, 49747 tape blocks
932024-08-18T06:14:02.313Zx out/internal-dns.tar.gz, 25469636 bytes, 49746 tape blocks
942024-08-18T06:14:02.313Zx out/mg-ddm-gz.tar, 63430656 bytes, 123888 tape blocks
952024-08-18T06:14:02.313Zx out/nexus.tar.gz, 88902049 bytes, 173637 tape blocks
962024-08-18T06:14:02.313Zx out/ntp.tar.gz, 9184524 bytes, 17939 tape blocks
972024-08-18T06:14:02.313Zx out/omicron-gateway-softnpu.tar.gz, 13935278 bytes, 27218 tape blocks
982024-08-18T06:14:02.313Zx out/omicron-sled-agent.tar, 99306496 bytes, 193958 tape blocks
992024-08-18T06:14:02.313Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1002024-08-18T06:14:02.313Zx out/oximeter.tar.gz, 43136881 bytes, 84252 tape blocks
1012024-08-18T06:14:02.313Zx out/oxlog.tar, 3016704 bytes, 5892 tape blocks
1022024-08-18T06:14:02.313Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1032024-08-18T06:14:02.313Zx out/propolis-server.tar.gz, 66857321 bytes, 130581 tape blocks
1042024-08-18T06:14:02.313Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1052024-08-18T06:14:02.313Zx out/switch-softnpu.tar.gz, 211014353 bytes, 412138 tape blocks
1062024-08-18T06:14:02.338Z
1072024-08-18T06:14:02.338Zreal 10.611531870
1082024-08-18T06:14:02.338Zuser 9.442148215
1092024-08-18T06:14:02.338Zsys 2.039584337
1102024-08-18T06:14:02.338Ztrap 0.000316192
1112024-08-18T06:14:02.338Ztflt 0.000000000
1122024-08-18T06:14:02.338Zdflt 0.000000000
1132024-08-18T06:14:02.338Zkflt 0.000000000
1142024-08-18T06:14:02.338Zlock 0.000000000
1152024-08-18T06:14:02.338Zslp 9.482847462
1162024-08-18T06:14:02.338Zlat 0.255834615
1172024-08-18T06:14:02.338Zstop 0.000126390
1182024-08-18T06:14:02.338Z+ bmat address ls
1192024-08-18T06:14:02.338ZNAME CIDR FIRST LAST COUNT
1202024-08-18T06:14:02.338Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1212024-08-18T06:14:02.338Z++ bmat address ls -f extra -Ho first,last,count
1222024-08-18T06:14:02.338Z+ set -- 10.151.2.164 10.151.2.227 64
1232024-08-18T06:14:02.338Z+ EXTRA_IP_START=10.151.2.164
1242024-08-18T06:14:02.338Z+ EXTRA_IP_END=10.151.2.227
1252024-08-18T06:14:02.338Z+ EXTRA_IP_COUNT=64
1262024-08-18T06:14:02.338Z+ (( EXTRA_IP_COUNT >= 32 ))
1272024-08-18T06:14:02.338Z+ EXTRA_IP_BASE=10.151.2
1282024-08-18T06:14:02.338Z+ EXTRA_IP_FOCTET=164
1292024-08-18T06:14:02.338Z+ EXTRA_IP_LOCTET=227
1302024-08-18T06:14:02.338Z+ SERVICE_IP_POOL_START=10.151.2.164
1312024-08-18T06:14:02.339Z+ SERVICE_IP_POOL_END=10.151.2.173
1322024-08-18T06:14:02.339Z+ DNS_IP1=10.151.2.164
1332024-08-18T06:14:02.339Z+ DNS_IP2=10.151.2.165
1342024-08-18T06:14:02.339Z+ UPLINK_IP=10.151.2.174
1352024-08-18T06:14:02.339Z+ IPPOOL_START=10.151.2.175
1362024-08-18T06:14:02.339Z+ IPPOOL_END=10.151.2.227
1372024-08-18T06:14:02.339Z++ ipadm show-addr -po type,addr
1382024-08-18T06:14:02.339Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1392024-08-18T06:14:02.363Z+ GATEWAY_IP=10.151.2.100
1402024-08-18T06:14:02.363Z+ [[ -n 10.151.2.100 ]]
1412024-08-18T06:14:02.363Z+ ping -s 10.151.2.100 56 1
1422024-08-18T06:14:02.363ZPING 10.151.2.100: 56 data bytes
1432024-08-18T06:14:02.363Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.010 ms
1442024-08-18T06:14:02.363Z
1452024-08-18T06:14:02.363Z----10.151.2.100 PING Statistics----
1462024-08-18T06:14:02.363Z1 packets transmitted, 1 packets received, 0% packet loss
1472024-08-18T06:14:02.363Zround-trip (ms) min/avg/max/stddev = 0.010/0.010/0.010/-nan
1482024-08-18T06:14:02.363Z++ arp -an
1492024-08-18T06:14:02.363Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1502024-08-18T06:14:02.363Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1512024-08-18T06:14:02.363Z+ routeadm -e ipv4-forwarding -u
1522024-08-18T06:14:02.469Z+ PXA_START=10.151.2.164
1532024-08-18T06:14:02.469Z+ PXA_END=10.151.2.227
1542024-08-18T06:14:02.493Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1552024-08-18T06:14:02.610Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227
1562024-08-18T06:14:02.634ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1572024-08-18T06:14:02.688Zcreating virtual hardware
1582024-08-18T06:14:02.712Zcreating /scratch/m2_0.vdev
1592024-08-18T06:14:02.712Zcreating /scratch/m2_1.vdev
1602024-08-18T06:14:02.712Zcreating /scratch/u2_0.vdev
1612024-08-18T06:14:02.712Zcreating /scratch/u2_1.vdev
1622024-08-18T06:14:02.712Zcreating /scratch/u2_2.vdev
1632024-08-18T06:14:02.712Zcreating /scratch/u2_3.vdev
1642024-08-18T06:14:02.712Zcreating /scratch/u2_4.vdev
1652024-08-18T06:14:02.712Zcreating /scratch/u2_5.vdev
1662024-08-18T06:14:02.712Zcreating /scratch/u2_6.vdev
1672024-08-18T06:14:02.713Zcreating /scratch/u2_7.vdev
1682024-08-18T06:14:02.713Zcreating /scratch/u2_8.vdev
1692024-08-18T06:14:02.713ZSimnet net0/sc0_0 exists
1702024-08-18T06:14:02.756ZSimnet net1/sc1_0 exists
1712024-08-18T06:14:02.780ZVnic sc0_1 exists
1722024-08-18T06:14:15.495ZUsing 10.151.2.100 as gateway ip
1732024-08-18T06:14:15.495Zusing 18:C0:4D:0D:A0:2A as gateway mac
1742024-08-18T06:14:15.495Zconfiguring SoftNPU ARP entry
1752024-08-18T06:14:15.522Zconfiguring SoftNPU proxy ARP
1762024-08-18T06:14:15.577ZSoftNPU state:
1772024-08-18T06:14:15.577Z local v6:
1782024-08-18T06:14:15.577Z local v4:
1792024-08-18T06:14:15.577Z router v6:
1802024-08-18T06:14:15.577Z router v4_idx:
1812024-08-18T06:14:15.577Z router v4_routes:
1822024-08-18T06:14:15.577Z resolver v4:
1832024-08-18T06:14:15.577Z 10.151.2.100 -> 18:c0:4d:0d:a0:2a
1842024-08-18T06:14:15.577Z resolver v6:
1852024-08-18T06:14:15.578Z nat v4:
1862024-08-18T06:14:15.578Z nat_v6:
1872024-08-18T06:14:15.578Z port_mac:
1882024-08-18T06:14:15.578Z proxy arp:
1892024-08-18T06:14:15.578Z 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
1902024-08-18T06:14:15.578Zcreated virtual hardware
1912024-08-18T06:14:15.602Z
1922024-08-18T06:14:15.602Zreal 12.964506379
1932024-08-18T06:14:15.602Zuser 0.681314475
1942024-08-18T06:14:15.602Zsys 3.263777645
1952024-08-18T06:14:15.602Ztrap 0.000079619
1962024-08-18T06:14:15.602Ztflt 0.000272637
1972024-08-18T06:14:15.602Zdflt 0.000328033
1982024-08-18T06:14:15.602Zkflt 0.000003620
1992024-08-18T06:14:15.602Zlock 10:01.331655777
2002024-08-18T06:14:15.602Zslp 39.231555895
2012024-08-18T06:14:15.602Zlat 0.085865584
2022024-08-18T06:14:15.602Zstop 0.369204928
2032024-08-18T06:14:15.602Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2042024-08-18T06:14:15.626Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2052024-08-18T06:14:15.626Z+ diff -u pkg/config.toml~ pkg/config.toml
2062024-08-18T06:14:15.626Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2072024-08-18T06:14:15.626Z+++ pkg/config.toml Sun Aug 18 06:14:15 2024
2082024-08-18T06:14:15.626Z@@ -29,18 +29,18 @@
2092024-08-18T06:14:15.626Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2102024-08-18T06:14:15.626Z # followed by a string that is embedded into their fake serial values.
2112024-08-18T06:14:15.626Z vdevs = [
2122024-08-18T06:14:15.626Z- "m2_0.vdev",
2132024-08-18T06:14:15.626Z- "m2_1.vdev",
2142024-08-18T06:14:15.626Z+ "/scratch/m2_0.vdev",
2152024-08-18T06:14:15.626Z+ "/scratch/m2_1.vdev",
2162024-08-18T06:14:15.626Z
2172024-08-18T06:14:15.626Z- "u2_0.vdev",
2182024-08-18T06:14:15.626Z- "u2_1.vdev",
2192024-08-18T06:14:15.626Z- "u2_2.vdev",
2202024-08-18T06:14:15.626Z- "u2_3.vdev",
2212024-08-18T06:14:15.626Z- "u2_4.vdev",
2222024-08-18T06:14:15.626Z- "u2_5.vdev",
2232024-08-18T06:14:15.627Z- "u2_6.vdev",
2242024-08-18T06:14:15.627Z- "u2_7.vdev",
2252024-08-18T06:14:15.627Z- "u2_8.vdev",
2262024-08-18T06:14:15.627Z+ "/scratch/u2_0.vdev",
2272024-08-18T06:14:15.627Z+ "/scratch/u2_1.vdev",
2282024-08-18T06:14:15.627Z+ "/scratch/u2_2.vdev",
2292024-08-18T06:14:15.627Z+ "/scratch/u2_3.vdev",
2302024-08-18T06:14:15.627Z+ "/scratch/u2_4.vdev",
2312024-08-18T06:14:15.627Z+ "/scratch/u2_5.vdev",
2322024-08-18T06:14:15.627Z+ "/scratch/u2_6.vdev",
2332024-08-18T06:14:15.627Z+ "/scratch/u2_7.vdev",
2342024-08-18T06:14:15.627Z+ "/scratch/u2_8.vdev",
2352024-08-18T06:14:15.627Z ]
2362024-08-18T06:14:15.627Z
2372024-08-18T06:14:15.627Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2382024-08-18T06:14:15.627Z+ true
2392024-08-18T06:14:15.627Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2402024-08-18T06:14:15.627Z+ SILO_NAME=recovery
2412024-08-18T06:14:15.627Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2422024-08-18T06:14:15.627Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2432024-08-18T06:14:15.627Z+ sed -i~ '
2442024-08-18T06:14:15.627Z /^external_dns_ips/c\
2452024-08-18T06:14:15.627Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2462024-08-18T06:14:15.627Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2472024-08-18T06:14:15.627Z /^first/c\
2482024-08-18T06:14:15.627Zfirst = "10.151.2.164"
2492024-08-18T06:14:15.627Z /^last/c\
2502024-08-18T06:14:15.627Zlast = "10.151.2.173"
2512024-08-18T06:14:15.627Z }
2522024-08-18T06:14:15.627Z /^infra_ip_first/c\
2532024-08-18T06:14:15.627Zinfra_ip_first = "10.151.2.174"
2542024-08-18T06:14:15.627Z /^infra_ip_last/c\
2552024-08-18T06:14:15.627Zinfra_ip_last = "10.151.2.174"
2562024-08-18T06:14:15.627Z /^\[\[rack_network_config.ports/,/^$/ {
2572024-08-18T06:14:15.627Z /^routes/c\
2582024-08-18T06:14:15.627Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
2592024-08-18T06:14:15.627Z /^addresses/c\
2602024-08-18T06:14:15.627Zaddresses = \[{address = "10.151.2.174/24"} \]
2612024-08-18T06:14:15.627Z }
2622024-08-18T06:14:15.627Z' pkg/config-rss.toml
2632024-08-18T06:14:15.628Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2642024-08-18T06:14:15.652Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2652024-08-18T06:14:15.652Z+++ pkg/config-rss.toml Sun Aug 18 06:14:15 2024
2662024-08-18T06:14:15.652Z@@ -33,7 +33,7 @@
2672024-08-18T06:14:15.652Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2682024-08-18T06:14:15.652Z # must be contained in one of the "internal services" IP Pool ranges listed
2692024-08-18T06:14:15.652Z # below.
2702024-08-18T06:14:15.652Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2712024-08-18T06:14:15.652Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2722024-08-18T06:14:15.652Z
2732024-08-18T06:14:15.652Z # Initial TLS certificates for the external API
2742024-08-18T06:14:15.652Z #
2752024-08-18T06:14:15.652Z@@ -69,8 +69,8 @@
2762024-08-18T06:14:15.652Z #
2772024-08-18T06:14:15.652Z # For more on this and what to put here, see docs/how-to-run.adoc.
2782024-08-18T06:14:15.652Z [[internal_services_ip_pool_ranges]]
2792024-08-18T06:14:15.652Z-first = "192.168.1.20"
2802024-08-18T06:14:15.652Z-last = "192.168.1.29"
2812024-08-18T06:14:15.652Z+first = "10.151.2.164"
2822024-08-18T06:14:15.652Z+last = "10.151.2.173"
2832024-08-18T06:14:15.652Z
2842024-08-18T06:14:15.652Z # TODO - this configuration is subject to change going forward. Ultimately these
2852024-08-18T06:14:15.652Z # parameters should be provided to the control plane via wicket, but we need to
2862024-08-18T06:14:15.652Z@@ -91,8 +91,8 @@
2872024-08-18T06:14:15.652Z # A range of IP addresses used by Boundary Services on the external network. In
2882024-08-18T06:14:15.652Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2892024-08-18T06:14:15.652Z # With softnpu, only one address is used.
2902024-08-18T06:14:15.652Z-infra_ip_first = "192.168.1.30"
2912024-08-18T06:14:15.652Z-infra_ip_last = "192.168.1.30"
2922024-08-18T06:14:15.652Z+infra_ip_first = "10.151.2.174"
2932024-08-18T06:14:15.652Z+infra_ip_last = "10.151.2.174"
2942024-08-18T06:14:15.653Z
2952024-08-18T06:14:15.653Z # Configurations for BGP routers to run on the scrimlets.
2962024-08-18T06:14:15.653Z bgp = []
2972024-08-18T06:14:15.653Z@@ -100,9 +100,9 @@
2982024-08-18T06:14:15.653Z # You can configure multiple uplinks by repeating the following stanza
2992024-08-18T06:14:15.653Z [[rack_network_config.ports]]
3002024-08-18T06:14:15.653Z # Routes associated with this port.
3012024-08-18T06:14:15.653Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3022024-08-18T06:14:15.653Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
3032024-08-18T06:14:15.653Z # Addresses associated with this port.
3042024-08-18T06:14:15.653Z-addresses = [{address = "192.168.1.30/24"}]
3052024-08-18T06:14:15.653Z+addresses = [{address = "10.151.2.174/24"} ]
3062024-08-18T06:14:15.653Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3072024-08-18T06:14:15.653Z port = "qsfp0"
3082024-08-18T06:14:15.653Z # The speed of this port.
3092024-08-18T06:14:15.653Z+ true
3102024-08-18T06:14:15.653Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3112024-08-18T06:14:15.653Za pkg/config-rss.toml 7K
3122024-08-18T06:14:15.653Za pkg/config.toml 4K
3132024-08-18T06:14:15.653Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3142024-08-18T06:14:15.653Z+ TLS_NAME=recovery.sys.oxide.test
3152024-08-18T06:14:15.653Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3162024-08-18T06:14:16.111Z.+......+.......+.....+...+......+...+...+.........+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..+.+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..+..........+............+...........+...+.+........+..............................+.+..+.......+..+..........+.........+..+....+.....+..................+.+..+.......+........+...+....+..............................+...............+......+..+....+.........+......+...........+...+.........+............+.+...+..+...+......+.+..+.......+...............+.........+..+...+......+...+.+..............+..........+.....+......+......+...............+..........+..................+...........+.+.....+....+..............+.......+...+...+.........+..............+......+..........+...+.....+...+.............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-08-18T06:14:17.030Z........+......+......+......+....+...+..+.+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+....+.................+....+.....+.+..................+..+...+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+............+...+..+.+..+..................+.+..............+..............................+............+.........+......+.......+..+.+.....+.............+............+...+..+...+.+.......................+.+......+.....+......+.......+...+...+.........+..+...+.......+...+...............+...+..+...+...+..........+...........+.+..+..........+...............+...+.....+.............+.........+..+....+..+...+.+...+.....+...+....+.....+....+...........+......+...+.........+.............+...............+.........+.....+.........+...............+.+......+........+............+.........+.+..+..........+......+...........+.+...+..+.......+..+......+...+.+........................+...........+..........+......+............+..+.+........+......+.+..+.......+........+...+............+...+....+.....+...............+......+.........+...+......+.+.........+.........+..+...+.+.........+........+..................+....+......+.....+..........+......+..................+...+...+..+.....................................+...+.........+...+...+.........+...........+...+.+...........+.............+.....+....+...............+.....+.............+...+......+.......................+...+.........+...+......+.+......+........+.........+.......+.....+....+..+.......+......+.....+.........+......+......+.+...+.........+..+................+.....+......................+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3182024-08-18T06:14:17.053Z-----
3192024-08-18T06:14:17.077Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3202024-08-18T06:14:17.077Za pkg/initial-tls-cert.pem 2K
3212024-08-18T06:14:17.077Za pkg/initial-tls-key.pem 4K
3222024-08-18T06:14:17.077Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3232024-08-18T06:14:17.077Z+ rmdir pkg
3242024-08-18T06:14:17.077Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3252024-08-18T06:14:17.077Z+ pfexec mkdir -p /usr/oxide
3262024-08-18T06:14:17.077Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3272024-08-18T06:14:17.682Z+ pfexec chmod +x /usr/oxide/oxide
3282024-08-18T06:14:17.708Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3292024-08-18T06:14:36.012Z+ OMICRON_NO_UNINSTALL=1
3302024-08-18T06:14:36.012Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3312024-08-18T06:14:36.036ZLogging to: /opt/oxide/work/out/LOG
3322024-08-18T06:14:36.554Z
3332024-08-18T06:14:36.578Zreal 0.536971788
3342024-08-18T06:14:36.578Zuser 0.118519891
3352024-08-18T06:14:36.578Zsys 2.365142304
3362024-08-18T06:14:36.578Ztrap 0.000000549
3372024-08-18T06:14:36.578Ztflt 0.000000000
3382024-08-18T06:14:36.578Zdflt 0.000499423
3392024-08-18T06:14:36.579Zkflt 0.000000000
3402024-08-18T06:14:36.579Zlock 48.542609674
3412024-08-18T06:14:36.579Zslp 0.724532439
3422024-08-18T06:14:36.579Zlat 0.003197162
3432024-08-18T06:14:36.579Zstop 0.214713356
3442024-08-18T06:14:36.579Z+ retry=0
3452024-08-18T06:14:36.579Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3462024-08-18T06:14:36.579Z+ [[ 0 -gt 30 ]]
3472024-08-18T06:14:36.579Z+ sleep 1
3482024-08-18T06:14:37.569Z+ retry=1
3492024-08-18T06:14:37.569Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3502024-08-18T06:14:37.593Z+ [[ 1 -gt 30 ]]
3512024-08-18T06:14:37.593Z+ sleep 1
3522024-08-18T06:14:38.584Z+ retry=2
3532024-08-18T06:14:38.584Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3542024-08-18T06:14:38.608Z+ [[ 2 -gt 30 ]]
3552024-08-18T06:14:38.608Z+ sleep 1
3562024-08-18T06:14:39.600Z+ retry=3
3572024-08-18T06:14:39.600Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3582024-08-18T06:14:58.031Z+ [[ 3 -gt 30 ]]
3592024-08-18T06:14:58.031Z+ sleep 1
3602024-08-18T06:14:59.034Z+ retry=4
3612024-08-18T06:14:59.034Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3622024-08-18T06:14:59.058Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3632024-08-18T06:14:59.082Zlocal v6:
3642024-08-18T06:14:59.082Zfe80::14d2:a1ff:fe74:61d7
3652024-08-18T06:14:59.082Zlocal v4:
3662024-08-18T06:14:59.082Z10.151.2.174
3672024-08-18T06:14:59.082Zrouter v6:
3682024-08-18T06:14:59.082Zrouter v4_idx:
3692024-08-18T06:14:59.082Zrouter v4_routes:
3702024-08-18T06:14:59.083Zresolver v4:
3712024-08-18T06:14:59.083Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
3722024-08-18T06:14:59.083Zresolver v6:
3732024-08-18T06:14:59.083Zfe80::e8ee:c4ff:fe63:32d -> ea:ee:c4:63:03:2d
3742024-08-18T06:14:59.083Zfe80::14d2:a1ff:fe74:61d7 -> 16:d2:a1:74:61:d7
3752024-08-18T06:14:59.083Znat v4:
3762024-08-18T06:14:59.083Znat_v6:
3772024-08-18T06:14:59.083Zport_mac:
3782024-08-18T06:14:59.083Z1000: a8:40:25:4d:3b:c9
3792024-08-18T06:14:59.083Z1: a8:40:25:4d:3b:ca
3802024-08-18T06:14:59.083Z2: a8:40:25:4d:3b:ea
3812024-08-18T06:14:59.083Zproxy arp:
3822024-08-18T06:14:59.083Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
3832024-08-18T06:14:59.083Z+ retry=0
3842024-08-18T06:14:59.083Z+++ zoneadm list -n
3852024-08-18T06:14:59.083Z+++ grep oxz_ntp
3862024-08-18T06:14:59.107Z++ pfexec svcs -z -Hostate oxide/ntp
3872024-08-18T06:14:59.107Zsvcs: zone '-Hostate': entity not found
3882024-08-18T06:14:59.107Z++ true
3892024-08-18T06:14:59.107Z+ [[ '' != online ]]
3902024-08-18T06:14:59.107Z+ [[ 0 -gt 60 ]]
3912024-08-18T06:14:59.107Z+ sleep 1
3922024-08-18T06:15:00.097Z+ retry=1
3932024-08-18T06:15:00.121Z+++ zoneadm list -n
3942024-08-18T06:15:00.121Z+++ grep oxz_ntp
3952024-08-18T06:15:00.121Z++ pfexec svcs -z -Hostate oxide/ntp
3962024-08-18T06:15:00.121Zsvcs: zone '-Hostate': entity not found
3972024-08-18T06:15:00.121Z++ true
3982024-08-18T06:15:00.121Z+ [[ '' != online ]]
3992024-08-18T06:15:00.121Z+ [[ 1 -gt 60 ]]
4002024-08-18T06:15:00.121Z+ sleep 1
4012024-08-18T06:15:01.119Z+ retry=2
4022024-08-18T06:15:01.144Z+++ zoneadm list -n
4032024-08-18T06:15:01.144Z+++ grep oxz_ntp
4042024-08-18T06:15:01.144Z++ pfexec svcs -z -Hostate oxide/ntp
4052024-08-18T06:15:01.144Zsvcs: zone '-Hostate': entity not found
4062024-08-18T06:15:01.144Z++ true
4072024-08-18T06:15:01.144Z+ [[ '' != online ]]
4082024-08-18T06:15:01.144Z+ [[ 2 -gt 60 ]]
4092024-08-18T06:15:01.144Z+ sleep 1
4102024-08-18T06:15:02.143Z+ retry=3
4112024-08-18T06:15:02.167Z+++ zoneadm list -n
4122024-08-18T06:15:02.168Z+++ grep oxz_ntp
4132024-08-18T06:15:02.168Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4142024-08-18T06:15:02.192Zsvcs: Could not bind to repository server for zone oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888: repository server unavailable
4152024-08-18T06:15:02.192Z++ true
4162024-08-18T06:15:02.192Z+ [[ '' != online ]]
4172024-08-18T06:15:02.192Z+ [[ 3 -gt 60 ]]
4182024-08-18T06:15:02.192Z+ sleep 1
4192024-08-18T06:15:03.176Z+ retry=4
4202024-08-18T06:15:03.201Z+++ zoneadm list -n
4212024-08-18T06:15:03.201Z+++ grep oxz_ntp
4222024-08-18T06:15:03.201Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4232024-08-18T06:15:03.225Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4242024-08-18T06:15:03.225Z++ true
4252024-08-18T06:15:03.225Z+ [[ '' != online ]]
4262024-08-18T06:15:03.225Z+ [[ 4 -gt 60 ]]
4272024-08-18T06:15:03.225Z+ sleep 1
4282024-08-18T06:15:04.209Z+ retry=5
4292024-08-18T06:15:04.233Z+++ zoneadm list -n
4302024-08-18T06:15:04.233Z+++ grep oxz_ntp
4312024-08-18T06:15:04.233Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4322024-08-18T06:15:04.257Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4332024-08-18T06:15:04.257Z++ true
4342024-08-18T06:15:04.257Z+ [[ '' != online ]]
4352024-08-18T06:15:04.257Z+ [[ 5 -gt 60 ]]
4362024-08-18T06:15:04.257Z+ sleep 1
4372024-08-18T06:15:05.240Z+ retry=6
4382024-08-18T06:15:05.264Z+++ zoneadm list -n
4392024-08-18T06:15:05.264Z+++ grep oxz_ntp
4402024-08-18T06:15:05.264Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4412024-08-18T06:15:05.288Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4422024-08-18T06:15:05.288Z++ true
4432024-08-18T06:15:05.288Z+ [[ '' != online ]]
4442024-08-18T06:15:05.288Z+ [[ 6 -gt 60 ]]
4452024-08-18T06:15:05.289Z+ sleep 1
4462024-08-18T06:15:06.270Z+ retry=7
4472024-08-18T06:15:06.294Z+++ zoneadm list -n
4482024-08-18T06:15:06.294Z+++ grep oxz_ntp
4492024-08-18T06:15:06.294Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4502024-08-18T06:15:06.294Z+ [[ offline != online ]]
4512024-08-18T06:15:06.294Z+ [[ 7 -gt 60 ]]
4522024-08-18T06:15:06.294Z+ sleep 1
4532024-08-18T06:15:07.293Z+ retry=8
4542024-08-18T06:15:07.317Z+++ zoneadm list -n
4552024-08-18T06:15:07.317Z+++ grep oxz_ntp
4562024-08-18T06:15:07.317Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4572024-08-18T06:15:07.317Z+ [[ offline != online ]]
4582024-08-18T06:15:07.317Z+ [[ 8 -gt 60 ]]
4592024-08-18T06:15:07.317Z+ sleep 1
4602024-08-18T06:15:08.315Z+ retry=9
4612024-08-18T06:15:08.340Z+++ zoneadm list -n
4622024-08-18T06:15:08.340Z+++ grep oxz_ntp
4632024-08-18T06:15:08.340Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4642024-08-18T06:15:08.340Z+ [[ offline != online ]]
4652024-08-18T06:15:08.340Z+ [[ 9 -gt 60 ]]
4662024-08-18T06:15:08.340Z+ sleep 1
4672024-08-18T06:15:09.338Z+ retry=10
4682024-08-18T06:15:09.362Z+++ zoneadm list -n
4692024-08-18T06:15:09.362Z+++ grep oxz_ntp
4702024-08-18T06:15:09.362Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4712024-08-18T06:15:09.362Z+ [[ offline != online ]]
4722024-08-18T06:15:09.362Z+ [[ 10 -gt 60 ]]
4732024-08-18T06:15:09.362Z+ sleep 1
4742024-08-18T06:15:10.360Z+ retry=11
4752024-08-18T06:15:10.384Z+++ zoneadm list -n
4762024-08-18T06:15:10.384Z+++ grep oxz_ntp
4772024-08-18T06:15:10.384Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4782024-08-18T06:15:10.384Z+ [[ offline != online ]]
4792024-08-18T06:15:10.384Z+ [[ 11 -gt 60 ]]
4802024-08-18T06:15:10.384Z+ sleep 1
4812024-08-18T06:15:11.382Z+ retry=12
4822024-08-18T06:15:11.408Z+++ zoneadm list -n
4832024-08-18T06:15:11.409Z+++ grep oxz_ntp
4842024-08-18T06:15:11.409Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4852024-08-18T06:15:11.409Z+ [[ offline != online ]]
4862024-08-18T06:15:11.409Z+ [[ 12 -gt 60 ]]
4872024-08-18T06:15:11.409Z+ sleep 1
4882024-08-18T06:15:12.405Z+ retry=13
4892024-08-18T06:15:12.429Z+++ zoneadm list -n
4902024-08-18T06:15:12.429Z+++ grep oxz_ntp
4912024-08-18T06:15:12.429Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4922024-08-18T06:15:12.429Z+ [[ offline != online ]]
4932024-08-18T06:15:12.429Z+ [[ 13 -gt 60 ]]
4942024-08-18T06:15:12.429Z+ sleep 1
4952024-08-18T06:15:13.427Z+ retry=14
4962024-08-18T06:15:13.451Z+++ zoneadm list -n
4972024-08-18T06:15:13.451Z+++ grep oxz_ntp
4982024-08-18T06:15:13.451Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
4992024-08-18T06:15:13.451Z+ [[ offline != online ]]
5002024-08-18T06:15:13.451Z+ [[ 14 -gt 60 ]]
5012024-08-18T06:15:13.451Z+ sleep 1
 
5022024-08-18T06:15:13.693Zsock console login: Aug 18 06:15:13 sock ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5032024-08-18T06:15:14.449Z+ retry=15
5042024-08-18T06:15:14.473Z+++ zoneadm list -n
5052024-08-18T06:15:14.474Z+++ grep oxz_ntp
5062024-08-18T06:15:14.474Z++ pfexec svcs -z oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888 -Hostate oxide/ntp
5072024-08-18T06:15:14.474Z+ [[ online != online ]]
5082024-08-18T06:15:14.474Z+ echo 'Waited for chrony: 15s'
5092024-08-18T06:15:14.474ZWaited for chrony: 15s
5102024-08-18T06:15:14.474Z+ retry=0
5112024-08-18T06:15:14.474Z+ zoneadm list
5122024-08-18T06:15:14.474Z+ grep nexus
5132024-08-18T06:15:14.498Z+ [[ 0 -gt 300 ]]
5142024-08-18T06:15:14.498Z+ sleep 1
5152024-08-18T06:15:15.479Z+ retry=1
5162024-08-18T06:15:15.503Z+ zoneadm list
5172024-08-18T06:15:15.503Z+ grep nexus
5182024-08-18T06:15:15.503Z+ [[ 1 -gt 300 ]]
5192024-08-18T06:15:15.503Z+ sleep 1
5202024-08-18T06:15:16.492Z+ retry=2
5212024-08-18T06:15:16.517Z+ zoneadm list
5222024-08-18T06:15:16.517Z+ grep nexus
5232024-08-18T06:15:16.517Z+ [[ 2 -gt 300 ]]
5242024-08-18T06:15:16.517Z+ sleep 1
5252024-08-18T06:15:17.504Z+ retry=3
5262024-08-18T06:15:17.528Z+ zoneadm list
5272024-08-18T06:15:17.528Z+ grep nexus
5282024-08-18T06:15:17.528Z+ [[ 3 -gt 300 ]]
5292024-08-18T06:15:17.528Z+ sleep 1
5302024-08-18T06:15:18.517Z+ retry=4
5312024-08-18T06:15:18.542Z+ zoneadm list
5322024-08-18T06:15:18.542Z+ grep nexus
5332024-08-18T06:15:18.542Z+ [[ 4 -gt 300 ]]
5342024-08-18T06:15:18.542Z+ sleep 1
5352024-08-18T06:15:19.532Z+ retry=5
5362024-08-18T06:15:19.556Z+ zoneadm list
5372024-08-18T06:15:19.556Z+ grep nexus
5382024-08-18T06:15:19.556Z+ [[ 5 -gt 300 ]]
5392024-08-18T06:15:19.556Z+ sleep 1
5402024-08-18T06:15:20.547Z+ retry=6
5412024-08-18T06:15:20.571Z+ zoneadm list
5422024-08-18T06:15:20.571Z+ grep nexus
5432024-08-18T06:15:20.571Z+ [[ 6 -gt 300 ]]
5442024-08-18T06:15:20.571Z+ sleep 1
5452024-08-18T06:15:21.562Z+ retry=7
5462024-08-18T06:15:21.589Z+ zoneadm list
5472024-08-18T06:15:21.589Z+ grep nexus
5482024-08-18T06:15:21.589Z+ [[ 7 -gt 300 ]]
5492024-08-18T06:15:21.589Z+ sleep 1
5502024-08-18T06:15:22.575Z+ retry=8
5512024-08-18T06:15:22.600Z+ zoneadm list
5522024-08-18T06:15:22.600Z+ grep nexus
5532024-08-18T06:15:22.600Z+ [[ 8 -gt 300 ]]
5542024-08-18T06:15:22.600Z+ sleep 1
5552024-08-18T06:15:23.590Z+ retry=9
5562024-08-18T06:15:23.614Z+ zoneadm list
5572024-08-18T06:15:23.614Z+ grep nexus
5582024-08-18T06:15:23.614Z+ [[ 9 -gt 300 ]]
5592024-08-18T06:15:23.614Z+ sleep 1
5602024-08-18T06:15:24.604Z+ retry=10
5612024-08-18T06:15:24.628Z+ zoneadm list
5622024-08-18T06:15:24.628Z+ grep nexus
5632024-08-18T06:15:24.628Z+ [[ 10 -gt 300 ]]
5642024-08-18T06:15:24.628Z+ sleep 1
5652024-08-18T06:15:25.624Z+ retry=11
5662024-08-18T06:15:25.648Z+ zoneadm list
5672024-08-18T06:15:25.648Z+ grep nexus
5682024-08-18T06:15:25.648Z+ [[ 11 -gt 300 ]]
5692024-08-18T06:15:25.648Z+ sleep 1
5702024-08-18T06:15:26.637Z+ retry=12
5712024-08-18T06:15:26.661Z+ zoneadm list
5722024-08-18T06:15:26.661Z+ grep nexus
5732024-08-18T06:15:26.661Z+ [[ 12 -gt 300 ]]
5742024-08-18T06:15:26.661Z+ sleep 1
5752024-08-18T06:15:27.658Z+ retry=13
5762024-08-18T06:15:27.683Z+ zoneadm list
5772024-08-18T06:15:27.683Z+ grep nexus
5782024-08-18T06:15:27.828Z+ [[ 13 -gt 300 ]]
5792024-08-18T06:15:27.828Z+ sleep 1
5802024-08-18T06:15:28.837Z+ retry=14
5812024-08-18T06:15:28.862Z+ zoneadm list
5822024-08-18T06:15:28.862Z+ grep nexus
5832024-08-18T06:15:28.862Z+ [[ 14 -gt 300 ]]
5842024-08-18T06:15:28.862Z+ sleep 1
5852024-08-18T06:15:29.884Z+ retry=15
5862024-08-18T06:15:29.908Z+ + grep nexus
5872024-08-18T06:15:29.908Zzoneadm list
5882024-08-18T06:15:29.968Z+ [[ 15 -gt 300 ]]
5892024-08-18T06:15:29.968Z+ sleep 1
5902024-08-18T06:15:30.962Z+ retry=16
5912024-08-18T06:15:30.986Z+ zoneadm list
5922024-08-18T06:15:30.986Z+ grep nexus
5932024-08-18T06:15:30.986Z+ [[ 16 -gt 300 ]]
5942024-08-18T06:15:30.986Z+ sleep 1
5952024-08-18T06:15:31.976Z+ retry=17
5962024-08-18T06:15:32.000Z+ zoneadm list
5972024-08-18T06:15:32.000Z+ grep nexus
5982024-08-18T06:15:32.000Z+ [[ 17 -gt 300 ]]
5992024-08-18T06:15:32.000Z+ sleep 1
6002024-08-18T06:15:32.996Z+ retry=18
6012024-08-18T06:15:33.021Z+ zoneadm list
6022024-08-18T06:15:33.021Z+ grep nexus
6032024-08-18T06:15:33.021Z+ [[ 18 -gt 300 ]]
6042024-08-18T06:15:33.022Z+ sleep 1
6052024-08-18T06:15:34.012Z+ retry=19
6062024-08-18T06:15:34.036Z+ zoneadm list
6072024-08-18T06:15:34.037Z+ grep nexus
6082024-08-18T06:15:34.037Z+ [[ 19 -gt 300 ]]
6092024-08-18T06:15:34.037Z+ sleep 1
6102024-08-18T06:15:35.029Z+ retry=20
6112024-08-18T06:15:35.053Z+ zoneadm list
6122024-08-18T06:15:35.053Z+ grep nexus
6132024-08-18T06:15:35.053Z+ [[ 20 -gt 300 ]]
6142024-08-18T06:15:35.053Z+ sleep 1
6152024-08-18T06:15:36.044Z+ retry=21
6162024-08-18T06:15:36.068Z+ zoneadm list
6172024-08-18T06:15:36.068Z+ grep nexus
6182024-08-18T06:15:36.068Z+ [[ 21 -gt 300 ]]
6192024-08-18T06:15:36.068Z+ sleep 1
6202024-08-18T06:15:37.061Z+ retry=22
6212024-08-18T06:15:37.085Z+ zoneadm list
6222024-08-18T06:15:37.085Z+ grep nexus
6232024-08-18T06:15:37.085Z+ [[ 22 -gt 300 ]]
6242024-08-18T06:15:37.085Z+ sleep 1
6252024-08-18T06:15:38.077Z+ retry=23
6262024-08-18T06:15:38.102Z+ zoneadm list
6272024-08-18T06:15:38.102Z+ grep nexus
6282024-08-18T06:15:38.102Z+ [[ 23 -gt 300 ]]
6292024-08-18T06:15:38.102Z+ sleep 1
6302024-08-18T06:15:39.095Z+ retry=24
6312024-08-18T06:15:39.120Z+ zoneadm list
6322024-08-18T06:15:39.120Z+ grep nexus
6332024-08-18T06:15:39.120Z+ [[ 24 -gt 300 ]]
6342024-08-18T06:15:39.120Z+ sleep 1
6352024-08-18T06:15:40.111Z+ retry=25
6362024-08-18T06:15:40.135Z+ zoneadm list
6372024-08-18T06:15:40.135Z+ grep nexus
6382024-08-18T06:15:40.135Z+ [[ 25 -gt 300 ]]
6392024-08-18T06:15:40.135Z+ sleep 1
6402024-08-18T06:15:41.126Z+ retry=26
6412024-08-18T06:15:41.151Z+ zoneadm list
6422024-08-18T06:15:41.151Z+ grep nexus
6432024-08-18T06:15:41.151Z+ [[ 26 -gt 300 ]]
6442024-08-18T06:15:41.151Z+ sleep 1
6452024-08-18T06:15:42.143Z+ retry=27
6462024-08-18T06:15:42.167Z+ zoneadm list
6472024-08-18T06:15:42.167Z+ grep nexus
6482024-08-18T06:15:42.167Z+ [[ 27 -gt 300 ]]
6492024-08-18T06:15:42.167Z+ sleep 1
6502024-08-18T06:15:43.154Z+ retry=28
6512024-08-18T06:15:43.178Z+ zoneadm list
6522024-08-18T06:15:43.178Z+ grep nexus
6532024-08-18T06:15:43.178Z+ [[ 28 -gt 300 ]]
6542024-08-18T06:15:43.178Z+ sleep 1
6552024-08-18T06:15:44.165Z+ retry=29
6562024-08-18T06:15:44.190Z+ zoneadm list
6572024-08-18T06:15:44.190Z+ grep nexus
6582024-08-18T06:15:44.190Z+ [[ 29 -gt 300 ]]
6592024-08-18T06:15:44.190Z+ sleep 1
6602024-08-18T06:15:45.178Z+ retry=30
6612024-08-18T06:15:45.202Z+ zoneadm list
6622024-08-18T06:15:45.202Z+ grep nexus
6632024-08-18T06:15:45.202Z+ [[ 30 -gt 300 ]]
6642024-08-18T06:15:45.202Z+ sleep 1
6652024-08-18T06:15:46.191Z+ retry=31
6662024-08-18T06:15:46.215Z+ zoneadm list
6672024-08-18T06:15:46.215Z+ grep nexus
6682024-08-18T06:15:46.215Z+ [[ 31 -gt 300 ]]
6692024-08-18T06:15:46.215Z+ sleep 1
6702024-08-18T06:15:47.203Z+ retry=32
6712024-08-18T06:15:47.227Z+ zoneadm list
6722024-08-18T06:15:47.227Z+ grep nexus
6732024-08-18T06:15:47.227Z+ [[ 32 -gt 300 ]]
6742024-08-18T06:15:47.227Z+ sleep 1
6752024-08-18T06:15:48.215Z+ retry=33
6762024-08-18T06:15:48.239Z+ zoneadm list
6772024-08-18T06:15:48.239Z+ grep nexus
6782024-08-18T06:15:48.239Z+ [[ 33 -gt 300 ]]
6792024-08-18T06:15:48.239Z+ sleep 1
6802024-08-18T06:15:49.228Z+ retry=34
6812024-08-18T06:15:49.252Z+ zoneadm list
6822024-08-18T06:15:49.252Z+ grep nexus
6832024-08-18T06:15:49.252Z+ [[ 34 -gt 300 ]]
6842024-08-18T06:15:49.252Z+ sleep 1
6852024-08-18T06:15:50.239Z+ retry=35
6862024-08-18T06:15:50.263Z+ zoneadm list
6872024-08-18T06:15:50.263Z+ grep nexus
6882024-08-18T06:15:50.263Z+ [[ 35 -gt 300 ]]
6892024-08-18T06:15:50.263Z+ sleep 1
6902024-08-18T06:15:51.252Z+ retry=36
6912024-08-18T06:15:51.278Z+ zoneadm list
6922024-08-18T06:15:51.278Z+ grep nexus
6932024-08-18T06:15:51.278Z+ [[ 36 -gt 300 ]]
6942024-08-18T06:15:51.278Z+ sleep 1
6952024-08-18T06:15:52.267Z+ retry=37
6962024-08-18T06:15:52.291Z+ zoneadm list
6972024-08-18T06:15:52.291Z+ grep nexus
6982024-08-18T06:15:52.291Z+ [[ 37 -gt 300 ]]
6992024-08-18T06:15:52.291Z+ sleep 1
7002024-08-18T06:15:53.280Z+ retry=38
7012024-08-18T06:15:53.307Z+ zoneadm list
7022024-08-18T06:15:53.307Z+ grep nexus
7032024-08-18T06:15:53.307Z+ [[ 38 -gt 300 ]]
7042024-08-18T06:15:53.307Z+ sleep 1
7052024-08-18T06:15:54.294Z+ retry=39
7062024-08-18T06:15:54.318Z+ zoneadm list
7072024-08-18T06:15:54.318Z+ grep nexus
7082024-08-18T06:15:54.318Z+ [[ 39 -gt 300 ]]
7092024-08-18T06:15:54.318Z+ sleep 1
7102024-08-18T06:15:55.306Z+ retry=40
7112024-08-18T06:15:55.330Z+ zoneadm list
7122024-08-18T06:15:55.331Z+ grep nexus
7132024-08-18T06:15:55.331Z+ [[ 40 -gt 300 ]]
7142024-08-18T06:15:55.331Z+ sleep 1
7152024-08-18T06:15:56.320Z+ retry=41
7162024-08-18T06:15:56.344Z+ zoneadm list
7172024-08-18T06:15:56.344Z+ grep nexus
7182024-08-18T06:15:56.344Z+ [[ 41 -gt 300 ]]
7192024-08-18T06:15:56.344Z+ sleep 1
7202024-08-18T06:15:57.333Z+ retry=42
7212024-08-18T06:15:57.357Z+ zoneadm list
7222024-08-18T06:15:57.357Z+ grep nexus
7232024-08-18T06:15:57.357Z+ [[ 42 -gt 300 ]]
7242024-08-18T06:15:57.357Z+ sleep 1
7252024-08-18T06:15:58.348Z+ retry=43
7262024-08-18T06:15:58.372Z+ zoneadm list
7272024-08-18T06:15:58.372Z+ grep nexus
7282024-08-18T06:15:58.372Z+ [[ 43 -gt 300 ]]
7292024-08-18T06:15:58.372Z+ sleep 1
7302024-08-18T06:15:59.360Z+ retry=44
7312024-08-18T06:15:59.384Z+ zoneadm list
7322024-08-18T06:15:59.384Z+ grep nexus
7332024-08-18T06:15:59.384Z+ [[ 44 -gt 300 ]]
7342024-08-18T06:15:59.384Z+ sleep 1
7352024-08-18T06:16:00.372Z+ retry=45
7362024-08-18T06:16:00.396Z+ zoneadm list
7372024-08-18T06:16:00.396Z+ grep nexus
7382024-08-18T06:16:00.396Z+ [[ 45 -gt 300 ]]
7392024-08-18T06:16:00.396Z+ sleep 1
7402024-08-18T06:16:01.384Z+ retry=46
7412024-08-18T06:16:01.408Z+ zoneadm list
7422024-08-18T06:16:01.408Z+ grep nexus
7432024-08-18T06:16:01.408Z+ [[ 46 -gt 300 ]]
7442024-08-18T06:16:01.408Z+ sleep 1
7452024-08-18T06:16:02.395Z+ retry=47
7462024-08-18T06:16:02.420Z+ zoneadm list
7472024-08-18T06:16:02.420Z+ grep nexus
7482024-08-18T06:16:02.420Z+ [[ 47 -gt 300 ]]
7492024-08-18T06:16:02.420Z+ sleep 1
7502024-08-18T06:16:03.408Z+ retry=48
7512024-08-18T06:16:03.432Z+ zoneadm list
7522024-08-18T06:16:03.432Z+ grep nexus
7532024-08-18T06:16:03.432Z+ [[ 48 -gt 300 ]]
7542024-08-18T06:16:03.432Z+ sleep 1
7552024-08-18T06:16:04.420Z+ retry=49
7562024-08-18T06:16:04.445Z+ zoneadm list
7572024-08-18T06:16:04.445Z+ grep nexus
7582024-08-18T06:16:04.445Z+ [[ 49 -gt 300 ]]
7592024-08-18T06:16:04.445Z+ sleep 1
7602024-08-18T06:16:05.432Z+ retry=50
7612024-08-18T06:16:05.456Z+ zoneadm list
7622024-08-18T06:16:05.457Z+ grep nexus
7632024-08-18T06:16:05.457Z+ [[ 50 -gt 300 ]]
7642024-08-18T06:16:05.457Z+ sleep 1
7652024-08-18T06:16:06.446Z+ retry=51
7662024-08-18T06:16:06.470Z+ zoneadm list
7672024-08-18T06:16:06.470Z+ grep nexus
7682024-08-18T06:16:06.470Z+ [[ 51 -gt 300 ]]
7692024-08-18T06:16:06.470Z+ sleep 1
7702024-08-18T06:16:07.458Z+ retry=52
7712024-08-18T06:16:07.482Z+ zoneadm list
7722024-08-18T06:16:07.482Z+ grep nexus
7732024-08-18T06:16:07.482Z+ [[ 52 -gt 300 ]]
7742024-08-18T06:16:07.482Z+ sleep 1
7752024-08-18T06:16:08.472Z+ retry=53
7762024-08-18T06:16:08.496Z+ zoneadm list
7772024-08-18T06:16:08.497Z+ grep nexus
7782024-08-18T06:16:08.497Z+ [[ 53 -gt 300 ]]
7792024-08-18T06:16:08.497Z+ sleep 1
7802024-08-18T06:16:09.491Z+ retry=54
7812024-08-18T06:16:10.193Z+ zoneadm list
7822024-08-18T06:16:10.218Z+ grep nexus
7832024-08-18T06:16:10.218Z+ [[ 54 -gt 300 ]]
7842024-08-18T06:16:10.218Z+ sleep 1
7852024-08-18T06:16:11.212Z+ retry=55
7862024-08-18T06:16:11.236Z+ zoneadm list
7872024-08-18T06:16:11.236Z+ grep nexus
7882024-08-18T06:16:11.236Z+ [[ 55 -gt 300 ]]
7892024-08-18T06:16:11.236Z+ sleep 1
7902024-08-18T06:16:12.227Z+ retry=56
7912024-08-18T06:16:12.252Z+ zoneadm list
7922024-08-18T06:16:12.252Z+ grep nexus
7932024-08-18T06:16:12.252Z+ [[ 56 -gt 300 ]]
7942024-08-18T06:16:12.252Z+ sleep 1
7952024-08-18T06:16:13.245Z+ retry=57
7962024-08-18T06:16:13.270Z+ zoneadm list
7972024-08-18T06:16:13.270Z+ grep nexus
7982024-08-18T06:16:13.270Z+ [[ 57 -gt 300 ]]
7992024-08-18T06:16:13.270Z+ sleep 1
8002024-08-18T06:16:14.267Z+ retry=58
8012024-08-18T06:16:14.291Z+ zoneadm list
8022024-08-18T06:16:14.291Z+ grep nexus
8032024-08-18T06:16:14.291Z+ [[ 58 -gt 300 ]]
8042024-08-18T06:16:14.291Z+ sleep 1
8052024-08-18T06:16:15.482Z+ retry=59
8062024-08-18T06:16:15.509Z+ zoneadm list
8072024-08-18T06:16:15.533Z+ grep nexus
8082024-08-18T06:16:15.533Z+ [[ 59 -gt 300 ]]
8092024-08-18T06:16:15.533Z+ sleep 1
8102024-08-18T06:16:16.530Z+ retry=60
8112024-08-18T06:16:16.554Z+ zoneadm list
8122024-08-18T06:16:16.554Z+ grep nexus
8132024-08-18T06:16:16.555Z+ [[ 60 -gt 300 ]]
8142024-08-18T06:16:16.555Z+ sleep 1
8152024-08-18T06:16:17.551Z+ retry=61
8162024-08-18T06:16:17.575Z+ zoneadm list
8172024-08-18T06:16:17.575Z+ grep nexus
8182024-08-18T06:16:17.575Z+ [[ 61 -gt 300 ]]
8192024-08-18T06:16:17.575Z+ sleep 1
8202024-08-18T06:16:18.570Z+ retry=62
8212024-08-18T06:16:18.594Z+ zoneadm list
8222024-08-18T06:16:18.594Z+ grep nexus
8232024-08-18T06:16:18.594Z+ [[ 62 -gt 300 ]]
8242024-08-18T06:16:18.594Z+ sleep 1
8252024-08-18T06:16:19.591Z+ retry=63
8262024-08-18T06:16:19.615Z+ zoneadm list
8272024-08-18T06:16:19.615Z+ grep nexus
8282024-08-18T06:16:19.615Z+ [[ 63 -gt 300 ]]
8292024-08-18T06:16:19.615Z+ sleep 1
8302024-08-18T06:16:20.615Z+ retry=64
8312024-08-18T06:16:20.639Z+ zoneadm list
8322024-08-18T06:16:20.639Z+ grep nexus
8332024-08-18T06:16:20.639Z+ [[ 64 -gt 300 ]]
8342024-08-18T06:16:20.639Z+ sleep 1
8352024-08-18T06:16:21.635Z+ retry=65
8362024-08-18T06:16:21.659Z+ zoneadm list
8372024-08-18T06:16:21.659Z+ grep nexus
8382024-08-18T06:16:21.659Z+ [[ 65 -gt 300 ]]
8392024-08-18T06:16:21.659Z+ sleep 1
8402024-08-18T06:16:22.666Z+ retry=66
8412024-08-18T06:16:22.666Z+ grep nexus
8422024-08-18T06:16:22.690Z+ zoneadm list
8432024-08-18T06:16:22.714Z+ [[ 66 -gt 300 ]]
8442024-08-18T06:16:22.714Z+ sleep 1
8452024-08-18T06:16:23.707Z+ retry=67
8462024-08-18T06:16:23.731Z+ zoneadm list
8472024-08-18T06:16:23.731Z+ grep nexus
8482024-08-18T06:16:23.731Z+ [[ 67 -gt 300 ]]
8492024-08-18T06:16:23.731Z+ sleep 1
8502024-08-18T06:16:24.728Z+ retry=68
8512024-08-18T06:16:24.752Z+ zoneadm list
8522024-08-18T06:16:24.752Z+ grep nexus
8532024-08-18T06:16:24.752Z+ [[ 68 -gt 300 ]]
8542024-08-18T06:16:24.752Z+ sleep 1
8552024-08-18T06:16:25.756Z+ retry=69
8562024-08-18T06:16:25.780Z+ zoneadm list
8572024-08-18T06:16:25.780Z+ grep nexus
8582024-08-18T06:16:25.780Z+ [[ 69 -gt 300 ]]
8592024-08-18T06:16:25.780Z+ sleep 1
8602024-08-18T06:16:26.781Z+ retry=70
8612024-08-18T06:16:26.805Z+ zoneadm list
8622024-08-18T06:16:26.805Z+ grep nexus
8632024-08-18T06:16:26.805Zoxz_nexus_6435951b-5b28-4085-9312-13963c642b0a
8642024-08-18T06:16:26.805Zoxz_nexus_b14dadef-31ef-4672-9e08-16ba925b913c
8652024-08-18T06:16:26.805Z+ echo 'Waited for nexus: 70s'
8662024-08-18T06:16:26.805ZWaited for nexus: 70s
8672024-08-18T06:16:26.805Z+ export RUST_BACKTRACE=1
8682024-08-18T06:16:26.805Z+ RUST_BACKTRACE=1
8692024-08-18T06:16:26.805Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8702024-08-18T06:16:26.830Z++ ./target/debug/bootstrap
8712024-08-18T06:16:27.463ZUsing external DNS server at 10.151.2.164:53
8722024-08-18T06:16:27.487Z2024-08-18 06:16:27.474944271 UTC: attempting to log into API
 
8732024-08-18T06:16:33.754ZAug 18 06:16:32 sock xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:216.31.17.12:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8742024-08-18T06:16:42.530Z2024-08-18 06:16:42.517887694 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8752024-08-18T06:16:43.001ZAug 18 06:16:36 sock last message repeated 2 times
8762024-08-18T06:16:43.035ZAug 18 06:16:42 sock ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
8772024-08-18T06:16:43.069ZAug 18 06:16:42 sock ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
 
8782024-08-18T06:16:43.531Z2024-08-18 06:16:43.518937988 UTC: attempting to log into API
 
8792024-08-18T06:16:43.637ZAug 18 06:16:43 sock ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
8802024-08-18T06:16:44.491ZAug 18 06:16:43 sock ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
8812024-08-18T06:16:44.525ZAug 18 06:16:43 sock ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
 
8822024-08-18T06:16:58.563Z2024-08-18 06:16:58.551099109 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8832024-08-18T06:16:59.564Z2024-08-18 06:16:59.552393275 UTC: attempting to log into API
8842024-08-18T06:17:14.596Z2024-08-18 06:17:14.584515802 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8852024-08-18T06:17:15.596Z2024-08-18 06:17:15.584755998 UTC: attempting to log into API
8862024-08-18T06:17:30.627Z2024-08-18 06:17:30.616106620 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8872024-08-18T06:17:31.629Z2024-08-18 06:17:31.617270574 UTC: attempting to log into API
8882024-08-18T06:17:32.387Z2024-08-18 06:17:32.375311787 UTC: login succeeded
8892024-08-18T06:17:32.418Zwaiting for nexus to come up...
8902024-08-18T06:17:32.493Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8912024-08-18T06:17:32.659Zsetting up quotas...
8922024-08-18T06:17:32.698Zensuring datasets are ready...
8932024-08-18T06:17:34.922Zlet's roll.
8942024-08-18T06:17:34.946Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8952024-08-18T06:17:34.947ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8962024-08-18T06:17:34.947ZOXIDE_TOKEN=oxide-token-8dd4523b90063791a38f2235cee42d80d9d401cf'
8972024-08-18T06:17:34.947Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8982024-08-18T06:17:34.947Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8992024-08-18T06:17:34.947Z++ OXIDE_TOKEN=oxide-token-8dd4523b90063791a38f2235cee42d80d9d401cf
9002024-08-18T06:17:34.947Z+ export OXIDE_HOST OXIDE_TOKEN
9012024-08-18T06:17:34.947Z+ retry=0
9022024-08-18T06:17:34.947Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9032024-08-18T06:17:34.947Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9042024-08-18T06:17:34.947Z+ [[ 0 -gt 60 ]]
9052024-08-18T06:17:34.947Z+ sleep 1
9062024-08-18T06:17:35.950Z+ retry=1
9072024-08-18T06:17:35.950Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9082024-08-18T06:17:35.974Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9092024-08-18T06:17:35.974Z+ [[ 1 -gt 60 ]]
9102024-08-18T06:17:35.974Z+ sleep 1
9112024-08-18T06:17:36.966Z+ retry=2
9122024-08-18T06:17:36.966Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9132024-08-18T06:17:36.990Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9142024-08-18T06:17:36.990Z+ [[ 2 -gt 60 ]]
9152024-08-18T06:17:36.990Z+ sleep 1
9162024-08-18T06:17:37.982Z+ retry=3
9172024-08-18T06:17:37.982Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9182024-08-18T06:17:38.006Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9192024-08-18T06:17:38.006Z+ [[ 3 -gt 60 ]]
9202024-08-18T06:17:38.007Z+ sleep 1
9212024-08-18T06:17:38.998Z+ retry=4
9222024-08-18T06:17:38.998Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9232024-08-18T06:17:39.022Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9242024-08-18T06:17:39.022Z+ [[ 4 -gt 60 ]]
9252024-08-18T06:17:39.022Z+ sleep 1
9262024-08-18T06:17:40.012Z+ retry=5
9272024-08-18T06:17:40.012Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9282024-08-18T06:17:40.036Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9292024-08-18T06:17:40.036Z+ [[ 5 -gt 60 ]]
9302024-08-18T06:17:40.036Z+ sleep 1
9312024-08-18T06:17:41.028Z+ retry=6
9322024-08-18T06:17:41.028Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9332024-08-18T06:17:41.052Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9342024-08-18T06:17:41.052Z+ [[ 6 -gt 60 ]]
9352024-08-18T06:17:41.052Z+ sleep 1
9362024-08-18T06:17:42.043Z+ retry=7
9372024-08-18T06:17:42.043Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9382024-08-18T06:17:42.070Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9392024-08-18T06:17:42.070Z+ [[ 7 -gt 60 ]]
9402024-08-18T06:17:42.070Z+ sleep 1
9412024-08-18T06:17:43.058Z+ retry=8
9422024-08-18T06:17:43.058Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9432024-08-18T06:17:43.083Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9442024-08-18T06:17:43.083Z+ [[ 8 -gt 60 ]]
9452024-08-18T06:17:43.083Z+ sleep 1
9462024-08-18T06:17:44.075Z+ retry=9
9472024-08-18T06:17:44.075Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9482024-08-18T06:17:44.100Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9492024-08-18T06:17:44.100Z+ [[ 9 -gt 60 ]]
9502024-08-18T06:17:44.100Z+ sleep 1
9512024-08-18T06:17:45.090Z+ retry=10
9522024-08-18T06:17:45.090Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9532024-08-18T06:17:45.114Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9542024-08-18T06:17:45.114Z+ [[ 10 -gt 60 ]]
9552024-08-18T06:17:45.114Z+ sleep 1
9562024-08-18T06:17:46.104Z+ retry=11
9572024-08-18T06:17:46.105Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9582024-08-18T06:17:46.129Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9592024-08-18T06:17:46.129Z+ [[ 11 -gt 60 ]]
9602024-08-18T06:17:46.129Z+ sleep 1
9612024-08-18T06:17:47.120Z+ retry=12
9622024-08-18T06:17:47.120Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9632024-08-18T06:17:47.144Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9642024-08-18T06:17:47.144Z+ [[ 12 -gt 60 ]]
9652024-08-18T06:17:47.144Z+ sleep 1
9662024-08-18T06:17:48.136Z+ retry=13
9672024-08-18T06:17:48.136Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9682024-08-18T06:17:48.160Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9692024-08-18T06:17:48.160Z+ [[ 13 -gt 60 ]]
9702024-08-18T06:17:48.160Z+ sleep 1
9712024-08-18T06:17:49.152Z+ retry=14
9722024-08-18T06:17:49.152Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9732024-08-18T06:17:49.176Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9742024-08-18T06:17:49.176Z+ [[ 14 -gt 60 ]]
9752024-08-18T06:17:49.176Z+ sleep 1
9762024-08-18T06:17:50.170Z+ retry=15
9772024-08-18T06:17:50.170Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9782024-08-18T06:17:50.252Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9792024-08-18T06:17:50.772Z{"status":"ok"}success
9802024-08-18T06:17:50.772ZProject {
9812024-08-18T06:17:50.772Z description: "some images",
9822024-08-18T06:17:50.772Z id: 24b03536-cd6d-45ce-961d-b6008bdfd93f,
9832024-08-18T06:17:50.772Z name: Name(
9842024-08-18T06:17:50.772Z "images",
9852024-08-18T06:17:50.772Z ),
9862024-08-18T06:17:50.772Z time_created: 2024-08-18T06:17:50.357274Z,
9872024-08-18T06:17:50.772Z time_modified: 2024-08-18T06:17:50.357274Z,
9882024-08-18T06:17:50.772Z}
9892024-08-18T06:17:50.797Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
9902024-08-18T06:23:16.129Zdone!
9912024-08-18T06:23:16.226Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9922024-08-18T06:23:16.331Zsuccess
9932024-08-18T06:23:16.331ZImage {
9942024-08-18T06:23:16.331Z block_size: ByteCount(
9952024-08-18T06:23:16.331Z 512,
9962024-08-18T06:23:16.331Z ),
9972024-08-18T06:23:16.331Z description: "debian 11 original base image",
9982024-08-18T06:23:16.331Z digest: None,
9992024-08-18T06:23:16.331Z id: 0a9c85d5-d388-4eaa-81ac-e79e4a238985,
10002024-08-18T06:23:16.331Z name: Name(
10012024-08-18T06:23:16.331Z "debian11",
10022024-08-18T06:23:16.331Z ),
10032024-08-18T06:23:16.331Z os: "debian",
10042024-08-18T06:23:16.331Z project_id: None,
10052024-08-18T06:23:16.331Z size: ByteCount(
10062024-08-18T06:23:16.331Z 2147483648,
10072024-08-18T06:23:16.331Z ),
10082024-08-18T06:23:16.356Z time_created: 2024-08-18T06:23:16.068643Z,
10092024-08-18T06:23:16.356Z time_modified: 2024-08-18T06:23:16.311876Z,
10102024-08-18T06:23:16.356Z url: None,
10112024-08-18T06:23:16.356Z version: "11",
10122024-08-18T06:23:16.356Z}
10132024-08-18T06:23:16.356Z+ for test_bin in tests/*
10142024-08-18T06:23:16.356Z+ ./tests/bootstrap-af8d5cc3281ab129
10152024-08-18T06:23:16.356Z
10162024-08-18T06:23:16.356Zrunning 0 tests
10172024-08-18T06:23:16.356Z
10182024-08-18T06:23:16.356Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10192024-08-18T06:23:16.356Z
10202024-08-18T06:23:16.356Z+ for test_bin in tests/*
10212024-08-18T06:23:16.356Z+ ./tests/commtest-bd5d25e5dea10e42
10222024-08-18T06:23:16.380Z
10232024-08-18T06:23:16.380Zrunning 0 tests
10242024-08-18T06:23:16.380Z
10252024-08-18T06:23:16.380Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10262024-08-18T06:23:16.380Z
10272024-08-18T06:23:16.380Z+ for test_bin in tests/*
10282024-08-18T06:23:16.380Z+ ./tests/dhcp_server-6c88a0f47b8cceda
10292024-08-18T06:23:16.405Z
10302024-08-18T06:23:16.405Zrunning 0 tests
10312024-08-18T06:23:16.405Z
10322024-08-18T06:23:16.405Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10332024-08-18T06:23:16.405Z
10342024-08-18T06:23:16.405Z+ for test_bin in tests/*
10352024-08-18T06:23:16.405Z+ ./tests/end_to_end_tests-083eddcef089b629
10362024-08-18T06:23:16.464Z
10372024-08-18T06:23:16.464Zrunning 2 tests
10382024-08-18T06:23:16.713Ztest no_spoof::no_spoof_here ... ok
10392024-08-18T06:23:57.119Ztest instance_launch::instance_launch ... ok
10402024-08-18T06:23:57.119Z
10412024-08-18T06:23:57.119Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 40.65s
10422024-08-18T06:23:57.119Z
10432024-08-18T06:23:57.143Z+ _exit_trap
10442024-08-18T06:23:57.143Z+ local status=0
10452024-08-18T06:23:57.143Z+ set +o errexit
10462024-08-18T06:23:57.143Z+ pfexec svcadm -Z disable -s cron
10472024-08-18T06:23:59.038Z+ [[ 0 -eq 0 ]]
10482024-08-18T06:23:59.038Z+ exit 0
10492024-08-18T06:23:59.063Zprocess exited: duration 607629 ms, exit code 0
 
10502024-08-18T06:23:59.142Zfound 119 output files
10512024-08-18T06:23:59.142Zuploading: /var/svc/log/oxide-sled-agent:default.log (971081 bytes)
10522024-08-18T06:24:00.484Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10532024-08-18T06:24:00.484Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (4556078 bytes)
10542024-08-18T06:24:00.847Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 4556078 -> 4567371
10552024-08-18T06:24:01.917Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
10562024-08-18T06:24:01.917Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (101690 bytes)
10572024-08-18T06:24:03.124Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
10582024-08-18T06:24:03.147Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (0 bytes)
10592024-08-18T06:24:04.193Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
10602024-08-18T06:24:04.193Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0 (33191 bytes)
10612024-08-18T06:24:05.350Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0
10622024-08-18T06:24:05.351Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (176378 bytes)
10632024-08-18T06:24:05.528Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 176378 -> 178724
10642024-08-18T06:24:06.596Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
10652024-08-18T06:24:06.596Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (9953 bytes)
10662024-08-18T06:24:07.710Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
10672024-08-18T06:24:07.710Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (225228 bytes)
10682024-08-18T06:24:07.909Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 225228 -> 228747
10692024-08-18T06:24:08.978Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
10702024-08-18T06:24:08.978Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (16306 bytes)
10712024-08-18T06:24:10.113Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
10722024-08-18T06:24:10.113Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1357830 bytes)
10732024-08-18T06:24:10.406Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1357830 -> 1395531
10742024-08-18T06:24:11.475Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
10752024-08-18T06:24:11.475Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (46013 bytes)
10762024-08-18T06:24:12.632Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
10772024-08-18T06:24:12.632Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (734226 bytes)
10782024-08-18T06:24:12.899Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 734226 -> 755190
10792024-08-18T06:24:13.967Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10802024-08-18T06:24:13.967Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (13814 bytes)
10812024-08-18T06:24:15.082Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
10822024-08-18T06:24:15.082Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
10832024-08-18T06:24:16.151Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10842024-08-18T06:24:16.151Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (3335 bytes)
10852024-08-18T06:24:17.243Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
10862024-08-18T06:24:17.243Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (266091 bytes)
10872024-08-18T06:24:17.442Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 266091 -> 275411
10882024-08-18T06:24:18.511Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10892024-08-18T06:24:18.511Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (2341 bytes)
10902024-08-18T06:24:19.604Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
10912024-08-18T06:24:19.604Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (7605 bytes)
10922024-08-18T06:24:19.671Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 7605 -> 7995
10932024-08-18T06:24:20.739Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10942024-08-18T06:24:20.739Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (1151 bytes)
10952024-08-18T06:24:21.831Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
10962024-08-18T06:24:21.831Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
10972024-08-18T06:24:22.901Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10982024-08-18T06:24:22.901Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (3976 bytes)
10992024-08-18T06:24:23.995Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
11002024-08-18T06:24:23.995Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11012024-08-18T06:24:25.066Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
11022024-08-18T06:24:25.066Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log.0 (8130 bytes)
11032024-08-18T06:24:26.183Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log.0
11042024-08-18T06:24:26.183Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_cockroachdb_3baab9b0-4a4a-4526-b9b7-e3e1de7c7577/root/var/svc/log/oxide-cockroach-admin:default.log (4658 bytes)
11052024-08-18T06:24:27.277Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_cockroachdb_3baab9b0-4a4a-4526-b9b7-e3e1de7c7577/root/var/svc/log/oxide-cockroach-admin:default.log
11062024-08-18T06:24:27.277Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_cockroachdb_3baab9b0-4a4a-4526-b9b7-e3e1de7c7577/root/var/svc/log/oxide-cockroachdb:default.log (4289 bytes)
11072024-08-18T06:24:28.371Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_cockroachdb_3baab9b0-4a4a-4526-b9b7-e3e1de7c7577/root/var/svc/log/oxide-cockroachdb:default.log
11082024-08-18T06:24:28.395Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_cockroachdb_3baab9b0-4a4a-4526-b9b7-e3e1de7c7577/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11092024-08-18T06:24:29.465Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_cockroachdb_3baab9b0-4a4a-4526-b9b7-e3e1de7c7577/root/var/svc/log/oxide-zone-network-setup:default.log
11102024-08-18T06:24:29.465Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_crucible_47625c74-c470-4430-b553-8da4b4bccb94/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
11112024-08-18T06:24:30.558Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_crucible_47625c74-c470-4430-b553-8da4b4bccb94/root/var/svc/log/oxide-crucible-agent:default.log
11122024-08-18T06:24:30.559Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_crucible_47625c74-c470-4430-b553-8da4b4bccb94/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11132024-08-18T06:24:31.653Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_crucible_47625c74-c470-4430-b553-8da4b4bccb94/root/var/svc/log/oxide-crucible-downstairs:default.log
11142024-08-18T06:24:31.653Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_crucible_47625c74-c470-4430-b553-8da4b4bccb94/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
11152024-08-18T06:24:32.747Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_crucible_47625c74-c470-4430-b553-8da4b4bccb94/root/var/svc/log/oxide-zone-network-setup:default.log
11162024-08-18T06:24:32.747Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_nexus_5ae66c1f-a0e8-4cbe-b76d-bf3ecf933503/root/var/svc/log/oxide-nexus:default.log (5435488 bytes)
11172024-08-18T06:24:33.210Zupload warning: file "/pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_nexus_5ae66c1f-a0e8-4cbe-b76d-bf3ecf933503/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5435488 -> 5621956
11182024-08-18T06:24:34.280Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_nexus_5ae66c1f-a0e8-4cbe-b76d-bf3ecf933503/root/var/svc/log/oxide-nexus:default.log
11192024-08-18T06:24:34.280Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_nexus_5ae66c1f-a0e8-4cbe-b76d-bf3ecf933503/root/var/svc/log/oxide-opte-interface-setup:default.log (1134 bytes)
11202024-08-18T06:24:35.375Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_nexus_5ae66c1f-a0e8-4cbe-b76d-bf3ecf933503/root/var/svc/log/oxide-opte-interface-setup:default.log
11212024-08-18T06:24:35.375Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_nexus_5ae66c1f-a0e8-4cbe-b76d-bf3ecf933503/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
11222024-08-18T06:24:36.469Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_nexus_5ae66c1f-a0e8-4cbe-b76d-bf3ecf933503/root/var/svc/log/oxide-zone-network-setup:default.log
11232024-08-18T06:24:36.469Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_oximeter_dbdf10b7-b4bc-4c7b-920c-891d68ada61f/root/var/svc/log/oxide-oximeter:default.log (1799836 bytes)
11242024-08-18T06:24:36.895Zupload warning: file "/pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_oximeter_dbdf10b7-b4bc-4c7b-920c-891d68ada61f/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1799836 -> 1967792
11252024-08-18T06:24:37.964Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_oximeter_dbdf10b7-b4bc-4c7b-920c-891d68ada61f/root/var/svc/log/oxide-oximeter:default.log
11262024-08-18T06:24:37.964Zuploading: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_oximeter_dbdf10b7-b4bc-4c7b-920c-891d68ada61f/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
11272024-08-18T06:24:39.058Zuploaded: /pool/ext/17d623e7-e5e4-4640-a9bd-8d57148c59f0/crypt/zone/oxz_oximeter_dbdf10b7-b4bc-4c7b-920c-891d68ada61f/root/var/svc/log/oxide-zone-network-setup:default.log
11282024-08-18T06:24:39.058Zuploading: /pool/ext/46bc38c5-f8ad-42ba-9fdc-09df7e77b2f5/crypt/zone/oxz_crucible_d41ac305-5e40-4a05-87b9-000df30e5746/root/var/svc/log/oxide-crucible-agent:default.log (12505 bytes)
11292024-08-18T06:24:40.175Zuploaded: /pool/ext/46bc38c5-f8ad-42ba-9fdc-09df7e77b2f5/crypt/zone/oxz_crucible_d41ac305-5e40-4a05-87b9-000df30e5746/root/var/svc/log/oxide-crucible-agent:default.log
11302024-08-18T06:24:40.198Zuploading: /pool/ext/46bc38c5-f8ad-42ba-9fdc-09df7e77b2f5/crypt/zone/oxz_crucible_d41ac305-5e40-4a05-87b9-000df30e5746/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11312024-08-18T06:24:41.269Zuploaded: /pool/ext/46bc38c5-f8ad-42ba-9fdc-09df7e77b2f5/crypt/zone/oxz_crucible_d41ac305-5e40-4a05-87b9-000df30e5746/root/var/svc/log/oxide-crucible-downstairs:default.log
11322024-08-18T06:24:41.269Zuploading: /pool/ext/46bc38c5-f8ad-42ba-9fdc-09df7e77b2f5/crypt/zone/oxz_crucible_d41ac305-5e40-4a05-87b9-000df30e5746/root/var/svc/log/oxide-crucible-downstairs:downstairs-12a9d618-a360-4992-aba9-0f90c7320b15.log (5992 bytes)
11332024-08-18T06:24:42.363Zuploaded: /pool/ext/46bc38c5-f8ad-42ba-9fdc-09df7e77b2f5/crypt/zone/oxz_crucible_d41ac305-5e40-4a05-87b9-000df30e5746/root/var/svc/log/oxide-crucible-downstairs:downstairs-12a9d618-a360-4992-aba9-0f90c7320b15.log
11342024-08-18T06:24:42.363Zuploading: /pool/ext/46bc38c5-f8ad-42ba-9fdc-09df7e77b2f5/crypt/zone/oxz_crucible_d41ac305-5e40-4a05-87b9-000df30e5746/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11352024-08-18T06:24:43.457Zuploaded: /pool/ext/46bc38c5-f8ad-42ba-9fdc-09df7e77b2f5/crypt/zone/oxz_crucible_d41ac305-5e40-4a05-87b9-000df30e5746/root/var/svc/log/oxide-zone-network-setup:default.log
11362024-08-18T06:24:43.457Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_cockroachdb_d74e133d-94ec-4a87-8822-6ae30db858a3/root/var/svc/log/oxide-cockroach-admin:default.log (4661 bytes)
11372024-08-18T06:24:44.551Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_cockroachdb_d74e133d-94ec-4a87-8822-6ae30db858a3/root/var/svc/log/oxide-cockroach-admin:default.log
11382024-08-18T06:24:44.552Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_cockroachdb_d74e133d-94ec-4a87-8822-6ae30db858a3/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11392024-08-18T06:24:45.646Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_cockroachdb_d74e133d-94ec-4a87-8822-6ae30db858a3/root/var/svc/log/oxide-cockroachdb:default.log
11402024-08-18T06:24:45.646Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_cockroachdb_d74e133d-94ec-4a87-8822-6ae30db858a3/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11412024-08-18T06:24:46.740Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_cockroachdb_d74e133d-94ec-4a87-8822-6ae30db858a3/root/var/svc/log/oxide-zone-network-setup:default.log
11422024-08-18T06:24:46.740Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_crucible_f1d69810-53e3-4bb4-8bc2-bf86dbd17022/root/var/svc/log/oxide-crucible-agent:default.log (12073 bytes)
11432024-08-18T06:24:47.856Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_crucible_f1d69810-53e3-4bb4-8bc2-bf86dbd17022/root/var/svc/log/oxide-crucible-agent:default.log
11442024-08-18T06:24:47.856Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_crucible_f1d69810-53e3-4bb4-8bc2-bf86dbd17022/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11452024-08-18T06:24:48.949Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_crucible_f1d69810-53e3-4bb4-8bc2-bf86dbd17022/root/var/svc/log/oxide-crucible-downstairs:default.log
11462024-08-18T06:24:48.949Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_crucible_f1d69810-53e3-4bb4-8bc2-bf86dbd17022/root/var/svc/log/oxide-crucible-downstairs:downstairs-ca376baa-c146-4c8e-ad5c-bcd332aa98a3.log (3126 bytes)
11472024-08-18T06:24:50.043Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_crucible_f1d69810-53e3-4bb4-8bc2-bf86dbd17022/root/var/svc/log/oxide-crucible-downstairs:downstairs-ca376baa-c146-4c8e-ad5c-bcd332aa98a3.log
11482024-08-18T06:24:50.043Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_crucible_f1d69810-53e3-4bb4-8bc2-bf86dbd17022/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
11492024-08-18T06:24:51.139Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_crucible_f1d69810-53e3-4bb4-8bc2-bf86dbd17022/root/var/svc/log/oxide-zone-network-setup:default.log
11502024-08-18T06:24:51.139Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_external_dns_297a5ad1-ce34-4bc9-8928-d8ab31f04536/root/var/svc/log/oxide-external_dns:default.log (30678 bytes)
11512024-08-18T06:24:51.252Zupload warning: file "/pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_external_dns_297a5ad1-ce34-4bc9-8928-d8ab31f04536/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 30678 -> 34451
11522024-08-18T06:24:52.322Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_external_dns_297a5ad1-ce34-4bc9-8928-d8ab31f04536/root/var/svc/log/oxide-external_dns:default.log
11532024-08-18T06:24:52.322Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_external_dns_297a5ad1-ce34-4bc9-8928-d8ab31f04536/root/var/svc/log/oxide-opte-interface-setup:default.log (1155 bytes)
11542024-08-18T06:24:53.416Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_external_dns_297a5ad1-ce34-4bc9-8928-d8ab31f04536/root/var/svc/log/oxide-opte-interface-setup:default.log
11552024-08-18T06:24:53.416Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_external_dns_297a5ad1-ce34-4bc9-8928-d8ab31f04536/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
11562024-08-18T06:24:54.510Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_external_dns_297a5ad1-ce34-4bc9-8928-d8ab31f04536/root/var/svc/log/oxide-zone-network-setup:default.log
11572024-08-18T06:24:54.510Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_internal_dns_864c47fa-5631-4926-99a5-ffb4ea13de0e/root/var/svc/log/oxide-internal_dns:default.log (403166 bytes)
11582024-08-18T06:24:54.744Zupload warning: file "/pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_internal_dns_864c47fa-5631-4926-99a5-ffb4ea13de0e/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 403166 -> 406920
11592024-08-18T06:24:55.813Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_internal_dns_864c47fa-5631-4926-99a5-ffb4ea13de0e/root/var/svc/log/oxide-internal_dns:default.log
11602024-08-18T06:24:55.813Zuploading: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_internal_dns_864c47fa-5631-4926-99a5-ffb4ea13de0e/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
11612024-08-18T06:24:56.917Zuploaded: /pool/ext/798a6bb2-1c7f-4d4c-8d38-b76e96d050e2/crypt/zone/oxz_internal_dns_864c47fa-5631-4926-99a5-ffb4ea13de0e/root/var/svc/log/oxide-zone-network-setup:default.log
11622024-08-18T06:24:56.918Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_cockroachdb_c73d737a-e884-45aa-b1f3-67987951e640/root/var/svc/log/oxide-cockroach-admin:default.log (4660 bytes)
11632024-08-18T06:24:58.009Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_cockroachdb_c73d737a-e884-45aa-b1f3-67987951e640/root/var/svc/log/oxide-cockroach-admin:default.log
11642024-08-18T06:24:58.009Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_cockroachdb_c73d737a-e884-45aa-b1f3-67987951e640/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
11652024-08-18T06:24:59.101Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_cockroachdb_c73d737a-e884-45aa-b1f3-67987951e640/root/var/svc/log/oxide-cockroachdb:default.log
11662024-08-18T06:24:59.101Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_cockroachdb_c73d737a-e884-45aa-b1f3-67987951e640/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11672024-08-18T06:25:00.194Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_cockroachdb_c73d737a-e884-45aa-b1f3-67987951e640/root/var/svc/log/oxide-zone-network-setup:default.log
11682024-08-18T06:25:00.194Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-crucible-agent:default.log (20177 bytes)
11692024-08-18T06:25:01.330Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-crucible-agent:default.log
11702024-08-18T06:25:01.330Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11712024-08-18T06:25:02.421Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-crucible-downstairs:default.log
11722024-08-18T06:25:02.421Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-crucible-downstairs:downstairs-b954be3c-a83c-48b5-a59f-9d0b94e961e9.log (6077 bytes)
11732024-08-18T06:25:03.513Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-crucible-downstairs:downstairs-b954be3c-a83c-48b5-a59f-9d0b94e961e9.log
11742024-08-18T06:25:03.514Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-crucible-downstairs:snapshot-b954be3c-a83c-48b5-a59f-9d0b94e961e9-6ba0d46d-8653-4de5-9939-d741d8b06564.log (5683 bytes)
11752024-08-18T06:25:04.606Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-crucible-downstairs:snapshot-b954be3c-a83c-48b5-a59f-9d0b94e961e9-6ba0d46d-8653-4de5-9939-d741d8b06564.log
11762024-08-18T06:25:04.606Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
11772024-08-18T06:25:05.698Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_crucible_bec349ce-e94e-420c-8a63-6655b78ff1c3/root/var/svc/log/oxide-zone-network-setup:default.log
11782024-08-18T06:25:05.723Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_internal_dns_446ae7d8-5ece-4764-8da3-05c988d9dd90/root/var/svc/log/oxide-internal_dns:default.log (406886 bytes)
11792024-08-18T06:25:05.926Zupload warning: file "/pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_internal_dns_446ae7d8-5ece-4764-8da3-05c988d9dd90/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 406886 -> 410638
11802024-08-18T06:25:06.995Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_internal_dns_446ae7d8-5ece-4764-8da3-05c988d9dd90/root/var/svc/log/oxide-internal_dns:default.log
11812024-08-18T06:25:06.995Zuploading: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_internal_dns_446ae7d8-5ece-4764-8da3-05c988d9dd90/root/var/svc/log/oxide-zone-network-setup:default.log (1679 bytes)
11822024-08-18T06:25:08.086Zuploaded: /pool/ext/b408d014-914b-4e88-a9b0-e25b88f1e788/crypt/zone/oxz_internal_dns_446ae7d8-5ece-4764-8da3-05c988d9dd90/root/var/svc/log/oxide-zone-network-setup:default.log
11832024-08-18T06:25:08.087Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_crucible_b2eeca78-5402-47d2-89c3-6f3ab4931f20/root/var/svc/log/oxide-crucible-agent:default.log (8487 bytes)
11842024-08-18T06:25:09.200Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_crucible_b2eeca78-5402-47d2-89c3-6f3ab4931f20/root/var/svc/log/oxide-crucible-agent:default.log
11852024-08-18T06:25:09.200Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_crucible_b2eeca78-5402-47d2-89c3-6f3ab4931f20/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11862024-08-18T06:25:10.292Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_crucible_b2eeca78-5402-47d2-89c3-6f3ab4931f20/root/var/svc/log/oxide-crucible-downstairs:default.log
11872024-08-18T06:25:10.316Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_crucible_b2eeca78-5402-47d2-89c3-6f3ab4931f20/root/var/svc/log/oxide-crucible-downstairs:downstairs-07fd727c-7779-459d-8412-07a4b987841e.log (3019 bytes)
11882024-08-18T06:25:11.384Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_crucible_b2eeca78-5402-47d2-89c3-6f3ab4931f20/root/var/svc/log/oxide-crucible-downstairs:downstairs-07fd727c-7779-459d-8412-07a4b987841e.log
11892024-08-18T06:25:11.384Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_crucible_b2eeca78-5402-47d2-89c3-6f3ab4931f20/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11902024-08-18T06:25:12.475Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_crucible_b2eeca78-5402-47d2-89c3-6f3ab4931f20/root/var/svc/log/oxide-zone-network-setup:default.log
11912024-08-18T06:25:12.475Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/svc/log/oxide-chrony-setup:default.log (14495 bytes)
11922024-08-18T06:25:13.589Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/svc/log/oxide-chrony-setup:default.log
11932024-08-18T06:25:13.589Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/svc/log/oxide-ntp:default.log (526 bytes)
11942024-08-18T06:25:14.680Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/svc/log/oxide-ntp:default.log
11952024-08-18T06:25:14.680Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
11962024-08-18T06:25:15.772Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/svc/log/oxide-opte-interface-setup:default.log
11972024-08-18T06:25:15.772Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/svc/log/oxide-zone-network-setup:default.log (1635 bytes)
11982024-08-18T06:25:16.865Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/svc/log/oxide-zone-network-setup:default.log
11992024-08-18T06:25:16.865Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-agent:default.log (44984 bytes)
12002024-08-18T06:25:18.049Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-agent:default.log
12012024-08-18T06:25:18.049Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12022024-08-18T06:25:19.143Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:default.log
12032024-08-18T06:25:19.167Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:downstairs-11cdd038-e8ad-4414-b861-80eaedb8f67e.log (6073 bytes)
12042024-08-18T06:25:20.237Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:downstairs-11cdd038-e8ad-4414-b861-80eaedb8f67e.log
12052024-08-18T06:25:20.237Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:downstairs-4d3a68c5-cc10-478c-992a-53b4fb5c2327.log (3019 bytes)
12062024-08-18T06:25:21.330Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:downstairs-4d3a68c5-cc10-478c-992a-53b4fb5c2327.log
12072024-08-18T06:25:21.354Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:downstairs-7c0ecc64-3d19-4fec-86d7-60c6eda84095.log (3123 bytes)
12082024-08-18T06:25:22.425Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:downstairs-7c0ecc64-3d19-4fec-86d7-60c6eda84095.log
12092024-08-18T06:25:22.425Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:downstairs-e2fe1954-b90d-4f7b-afcb-1a13b2a11636.log (5994 bytes)
12102024-08-18T06:25:23.519Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:downstairs-e2fe1954-b90d-4f7b-afcb-1a13b2a11636.log
12112024-08-18T06:25:23.519Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:snapshot-11cdd038-e8ad-4414-b861-80eaedb8f67e-6ba0d46d-8653-4de5-9939-d741d8b06564.log (5685 bytes)
12122024-08-18T06:25:24.613Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-crucible-downstairs:snapshot-11cdd038-e8ad-4414-b861-80eaedb8f67e-6ba0d46d-8653-4de5-9939-d741d8b06564.log
12132024-08-18T06:25:24.613Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
12142024-08-18T06:25:25.707Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_crucible_9b1e17ca-e700-4670-827c-219ea540a63e/root/var/svc/log/oxide-zone-network-setup:default.log
12152024-08-18T06:25:25.707Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_nexus_6435951b-5b28-4085-9312-13963c642b0a/root/var/svc/log/oxide-nexus:default.log (2875463 bytes)
12162024-08-18T06:25:26.076Zupload warning: file "/pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_nexus_6435951b-5b28-4085-9312-13963c642b0a/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2875463 -> 3301238
12172024-08-18T06:25:27.146Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_nexus_6435951b-5b28-4085-9312-13963c642b0a/root/var/svc/log/oxide-nexus:default.log
12182024-08-18T06:25:27.146Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_nexus_6435951b-5b28-4085-9312-13963c642b0a/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
12192024-08-18T06:25:28.240Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_nexus_6435951b-5b28-4085-9312-13963c642b0a/root/var/svc/log/oxide-opte-interface-setup:default.log
12202024-08-18T06:25:28.240Zuploading: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_nexus_6435951b-5b28-4085-9312-13963c642b0a/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
12212024-08-18T06:25:29.334Zuploaded: /pool/ext/e11f1bee-9083-4bdd-8940-0d8a2554b66d/crypt/zone/oxz_nexus_6435951b-5b28-4085-9312-13963c642b0a/root/var/svc/log/oxide-zone-network-setup:default.log
12222024-08-18T06:25:29.334Zuploading: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_cockroachdb_deac1630-58ce-433a-82f3-52baf2c94c58/root/var/svc/log/oxide-cockroach-admin:default.log (4659 bytes)
12232024-08-18T06:25:30.430Zuploaded: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_cockroachdb_deac1630-58ce-433a-82f3-52baf2c94c58/root/var/svc/log/oxide-cockroach-admin:default.log
12242024-08-18T06:25:30.430Zuploading: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_cockroachdb_deac1630-58ce-433a-82f3-52baf2c94c58/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
12252024-08-18T06:25:31.525Zuploaded: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_cockroachdb_deac1630-58ce-433a-82f3-52baf2c94c58/root/var/svc/log/oxide-cockroachdb:default.log
12262024-08-18T06:25:31.525Zuploading: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_cockroachdb_deac1630-58ce-433a-82f3-52baf2c94c58/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
12272024-08-18T06:25:32.620Zuploaded: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_cockroachdb_deac1630-58ce-433a-82f3-52baf2c94c58/root/var/svc/log/oxide-zone-network-setup:default.log
12282024-08-18T06:25:32.620Zuploading: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-crucible-agent:default.log (23019 bytes)
12292024-08-18T06:25:33.759Zuploaded: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-crucible-agent:default.log
12302024-08-18T06:25:33.759Zuploading: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12312024-08-18T06:25:34.852Zuploaded: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-crucible-downstairs:default.log
12322024-08-18T06:25:34.853Zuploading: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-crucible-downstairs:downstairs-2a34d673-9289-4509-93af-34c25dae380f.log (5993 bytes)
12332024-08-18T06:25:35.947Zuploaded: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-crucible-downstairs:downstairs-2a34d673-9289-4509-93af-34c25dae380f.log
12342024-08-18T06:25:35.947Zuploading: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-crucible-downstairs:downstairs-59f14b00-13c1-4274-a219-d1e502ce9c58.log (3123 bytes)
12352024-08-18T06:25:37.041Zuploaded: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-crucible-downstairs:downstairs-59f14b00-13c1-4274-a219-d1e502ce9c58.log
12362024-08-18T06:25:37.041Zuploading: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
12372024-08-18T06:25:38.135Zuploaded: /pool/ext/edc0180f-7bc5-4c2f-a183-d0464e09651b/crypt/zone/oxz_crucible_3a67927f-abc9-4bee-b608-449706069eab/root/var/svc/log/oxide-zone-network-setup:default.log
12382024-08-18T06:25:38.136Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-agent:default.log (29836 bytes)
12392024-08-18T06:25:39.297Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-agent:default.log
12402024-08-18T06:25:39.297Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12412024-08-18T06:25:40.391Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-downstairs:default.log
12422024-08-18T06:25:40.391Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-downstairs:downstairs-1333dee4-cd2a-4ec7-a9e4-f65e6da327e3.log (6078 bytes)
12432024-08-18T06:25:41.485Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-downstairs:downstairs-1333dee4-cd2a-4ec7-a9e4-f65e6da327e3.log
12442024-08-18T06:25:41.485Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-downstairs:downstairs-ca2c4e84-53e3-43f2-a604-99f528c9591c.log (3017 bytes)
12452024-08-18T06:25:42.579Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-downstairs:downstairs-ca2c4e84-53e3-43f2-a604-99f528c9591c.log
12462024-08-18T06:25:42.579Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-downstairs:snapshot-1333dee4-cd2a-4ec7-a9e4-f65e6da327e3-6ba0d46d-8653-4de5-9939-d741d8b06564.log (5685 bytes)
12472024-08-18T06:25:43.673Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-crucible-downstairs:snapshot-1333dee4-cd2a-4ec7-a9e4-f65e6da327e3-6ba0d46d-8653-4de5-9939-d741d8b06564.log
12482024-08-18T06:25:43.673Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
12492024-08-18T06:25:44.767Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_571f06ae-b5a1-4164-886e-b191ad4711e6/root/var/svc/log/oxide-zone-network-setup:default.log
12502024-08-18T06:25:44.767Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_pantry_7e8672f5-9391-4b42-85bd-5b0ce3e89263/root/var/svc/log/oxide-crucible-pantry:default.log (765709 bytes)
12512024-08-18T06:25:46.091Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_pantry_7e8672f5-9391-4b42-85bd-5b0ce3e89263/root/var/svc/log/oxide-crucible-pantry:default.log
12522024-08-18T06:25:46.091Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_pantry_7e8672f5-9391-4b42-85bd-5b0ce3e89263/root/var/svc/log/oxide-zone-network-setup:default.log (1715 bytes)
12532024-08-18T06:25:47.185Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_crucible_pantry_7e8672f5-9391-4b42-85bd-5b0ce3e89263/root/var/svc/log/oxide-zone-network-setup:default.log
12542024-08-18T06:25:47.185Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_nexus_b14dadef-31ef-4672-9e08-16ba925b913c/root/var/svc/log/oxide-nexus:default.log (36750861 bytes)
12552024-08-18T06:25:48.710Zupload warning: file "/pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_nexus_b14dadef-31ef-4672-9e08-16ba925b913c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36750861 -> 37205921
12562024-08-18T06:25:49.779Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_nexus_b14dadef-31ef-4672-9e08-16ba925b913c/root/var/svc/log/oxide-nexus:default.log
12572024-08-18T06:25:49.779Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_nexus_b14dadef-31ef-4672-9e08-16ba925b913c/root/var/svc/log/oxide-opte-interface-setup:default.log (1133 bytes)
12582024-08-18T06:25:50.873Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_nexus_b14dadef-31ef-4672-9e08-16ba925b913c/root/var/svc/log/oxide-opte-interface-setup:default.log
12592024-08-18T06:25:50.874Zuploading: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_nexus_b14dadef-31ef-4672-9e08-16ba925b913c/root/var/svc/log/oxide-zone-network-setup:default.log (1654 bytes)
12602024-08-18T06:25:51.967Zuploaded: /pool/ext/ee7acdf1-3bb9-4cae-8205-e287afa88e3c/crypt/zone/oxz_nexus_b14dadef-31ef-4672-9e08-16ba925b913c/root/var/svc/log/oxide-zone-network-setup:default.log
12612024-08-18T06:25:51.967Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_clickhouse_81c0ce7a-5cbe-4542-90d2-493873da96a1/root/var/svc/log/oxide-clickhouse-admin:default.log (823 bytes)
12622024-08-18T06:25:53.061Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_clickhouse_81c0ce7a-5cbe-4542-90d2-493873da96a1/root/var/svc/log/oxide-clickhouse-admin:default.log
12632024-08-18T06:25:53.061Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_clickhouse_81c0ce7a-5cbe-4542-90d2-493873da96a1/root/var/svc/log/oxide-clickhouse:default.log (3209205 bytes)
12642024-08-18T06:25:53.473Zupload warning: file "/pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_clickhouse_81c0ce7a-5cbe-4542-90d2-493873da96a1/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 3209205 -> 4033997
12652024-08-18T06:25:54.542Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_clickhouse_81c0ce7a-5cbe-4542-90d2-493873da96a1/root/var/svc/log/oxide-clickhouse:default.log
12662024-08-18T06:25:54.542Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_clickhouse_81c0ce7a-5cbe-4542-90d2-493873da96a1/root/var/svc/log/oxide-zone-network-setup:default.log (1684 bytes)
12672024-08-18T06:25:55.636Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_clickhouse_81c0ce7a-5cbe-4542-90d2-493873da96a1/root/var/svc/log/oxide-zone-network-setup:default.log
12682024-08-18T06:25:55.636Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_cockroachdb_5f8262dd-442f-4044-99d0-3f9cb205de77/root/var/svc/log/oxide-cockroach-admin:default.log (4660 bytes)
12692024-08-18T06:25:56.730Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_cockroachdb_5f8262dd-442f-4044-99d0-3f9cb205de77/root/var/svc/log/oxide-cockroach-admin:default.log
12702024-08-18T06:25:56.755Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_cockroachdb_5f8262dd-442f-4044-99d0-3f9cb205de77/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
12712024-08-18T06:25:57.826Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_cockroachdb_5f8262dd-442f-4044-99d0-3f9cb205de77/root/var/svc/log/oxide-cockroachdb:default.log
12722024-08-18T06:25:57.826Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_cockroachdb_5f8262dd-442f-4044-99d0-3f9cb205de77/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
12732024-08-18T06:25:58.921Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_cockroachdb_5f8262dd-442f-4044-99d0-3f9cb205de77/root/var/svc/log/oxide-zone-network-setup:default.log
12742024-08-18T06:25:58.945Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_7d4a0be9-2255-4d23-9750-f3cfdbd02b1b/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
12752024-08-18T06:26:00.016Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_7d4a0be9-2255-4d23-9750-f3cfdbd02b1b/root/var/svc/log/oxide-crucible-agent:default.log
12762024-08-18T06:26:00.016Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_7d4a0be9-2255-4d23-9750-f3cfdbd02b1b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12772024-08-18T06:26:01.110Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_7d4a0be9-2255-4d23-9750-f3cfdbd02b1b/root/var/svc/log/oxide-crucible-downstairs:default.log
12782024-08-18T06:26:01.134Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_7d4a0be9-2255-4d23-9750-f3cfdbd02b1b/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
12792024-08-18T06:26:02.204Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_7d4a0be9-2255-4d23-9750-f3cfdbd02b1b/root/var/svc/log/oxide-zone-network-setup:default.log
12802024-08-18T06:26:02.204Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_pantry_8a4382bc-2e4f-4b5e-be2f-1a77c43c4551/root/var/svc/log/oxide-crucible-pantry:default.log (780 bytes)
12812024-08-18T06:26:03.297Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_pantry_8a4382bc-2e4f-4b5e-be2f-1a77c43c4551/root/var/svc/log/oxide-crucible-pantry:default.log
12822024-08-18T06:26:03.297Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_pantry_8a4382bc-2e4f-4b5e-be2f-1a77c43c4551/root/var/svc/log/oxide-zone-network-setup:default.log (1715 bytes)
12832024-08-18T06:26:04.391Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_pantry_8a4382bc-2e4f-4b5e-be2f-1a77c43c4551/root/var/svc/log/oxide-zone-network-setup:default.log
12842024-08-18T06:26:04.392Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_pantry_d45b9d58-fe1f-46d8-85a5-3df0b8128471/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
12852024-08-18T06:26:05.486Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_pantry_d45b9d58-fe1f-46d8-85a5-3df0b8128471/root/var/svc/log/oxide-crucible-pantry:default.log
12862024-08-18T06:26:05.486Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_pantry_d45b9d58-fe1f-46d8-85a5-3df0b8128471/root/var/svc/log/oxide-zone-network-setup:default.log (1717 bytes)
12872024-08-18T06:26:06.580Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_crucible_pantry_d45b9d58-fe1f-46d8-85a5-3df0b8128471/root/var/svc/log/oxide-zone-network-setup:default.log
12882024-08-18T06:26:06.580Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_external_dns_1fae26e5-78d4-4098-9cdb-565457353346/root/var/svc/log/oxide-external_dns:default.log (30676 bytes)
12892024-08-18T06:26:06.694Zupload warning: file "/pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_external_dns_1fae26e5-78d4-4098-9cdb-565457353346/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 30676 -> 38229
12902024-08-18T06:26:07.764Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_external_dns_1fae26e5-78d4-4098-9cdb-565457353346/root/var/svc/log/oxide-external_dns:default.log
12912024-08-18T06:26:07.788Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_external_dns_1fae26e5-78d4-4098-9cdb-565457353346/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
12922024-08-18T06:26:08.863Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_external_dns_1fae26e5-78d4-4098-9cdb-565457353346/root/var/svc/log/oxide-opte-interface-setup:default.log
12932024-08-18T06:26:08.863Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_external_dns_1fae26e5-78d4-4098-9cdb-565457353346/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
12942024-08-18T06:26:09.957Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_external_dns_1fae26e5-78d4-4098-9cdb-565457353346/root/var/svc/log/oxide-zone-network-setup:default.log
12952024-08-18T06:26:09.983Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_internal_dns_bda872c5-3ae0-47aa-8815-f482041a32ec/root/var/svc/log/oxide-internal_dns:default.log (403184 bytes)
12962024-08-18T06:26:10.188Zupload warning: file "/pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_internal_dns_bda872c5-3ae0-47aa-8815-f482041a32ec/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 403184 -> 410693
12972024-08-18T06:26:11.259Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_internal_dns_bda872c5-3ae0-47aa-8815-f482041a32ec/root/var/svc/log/oxide-internal_dns:default.log
12982024-08-18T06:26:11.259Zuploading: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_internal_dns_bda872c5-3ae0-47aa-8815-f482041a32ec/root/var/svc/log/oxide-zone-network-setup:default.log (1679 bytes)
12992024-08-18T06:26:12.353Zuploaded: /pool/ext/f378036d-8690-4a72-aa52-93403a67ff3c/crypt/zone/oxz_internal_dns_bda872c5-3ae0-47aa-8815-f482041a32ec/root/var/svc/log/oxide-zone-network-setup:default.log
13002024-08-18T06:26:12.353Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/measurements.log (180155 bytes)
13012024-08-18T06:26:12.557Zupload warning: file "/pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/measurements.log" changed size mid upload: 180155 -> 218515
13022024-08-18T06:26:13.628Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/measurements.log
13032024-08-18T06:26:13.628Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/statistics.log (120042 bytes)
13042024-08-18T06:26:13.810Zupload warning: file "/pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/statistics.log" changed size mid upload: 120042 -> 148941
13052024-08-18T06:26:14.879Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/statistics.log
13062024-08-18T06:26:14.879Zuploading: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/tracking.log (19012 bytes)
13072024-08-18T06:26:14.975Zupload warning: file "/pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/tracking.log" changed size mid upload: 19012 -> 20860
13082024-08-18T06:26:16.045Zuploaded: /pool/ext/cab49891-8757-4052-a3b8-c09be1de7228/crypt/zone/oxz_ntp_25b9fcea-29c1-4092-9203-244d1426b888/root/var/log/chrony/tracking.log