01J5497VZP1VJ4GHCNTRKFH1B8: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.33",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01J5498V5PFK2P8G8ZHV1X6K3A

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-08-12T22:22:10.362Zjob dependencies complete; ready to run (waiting for 29 m 17 s)
22024-08-12T22:25:42.905Zjob assigned to worker 01J54AYGKK5XXT1CQ7W53SBW9A (queued for 3 m 32 s)
32024-08-12T22:25:43.185Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-08-12T22:25:43.225Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-08-12T22:25:43.259Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-08-12T22:25:43.292Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-08-12T22:25:43.326Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-08-12T22:25:43.360ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-08-12T22:25:43.394Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d3
102024-08-12T22:25:43.427ZOxide Helios Version helios-2.0.22764 64-bit
112024-08-12T22:25:43.461ZConfiguring devices.
122024-08-12T22:25:43.494Z##################################################
132024-08-12T22:25:43.528Z#### ############# ##
142024-08-12T22:25:43.561Z### ### ############ ##
152024-08-12T22:25:43.595Z## ### # ## ### ## Oxide Computer Company ##
162024-08-12T22:25:43.628Z## ## ## ### # ### ##
172024-08-12T22:25:43.663Z## # ### #### #### This Station Under ##
182024-08-12T22:25:43.696Z### ### #### # ### Computer Control ##
192024-08-12T22:25:43.729Z#### #### ### ## ##
202024-08-12T22:25:43.766Z##################################################
212024-08-12T22:25:43.796ZHostname: sock
222024-08-12T22:25:43.829ZLoading smf(7) service descriptions:
232024-08-12T22:25:44.775Zdownloading input: /input/package/work/package.tar.gz
242024-08-12T22:29:33.682Zdownloaded input: /input/package/work/package.tar.gz
 
252024-08-12T22:29:33.706Zstarting task 0: "setup"
262024-08-12T22:29:33.706Z++ uname -s
272024-08-12T22:29:33.706Z+ kern=SunOS
282024-08-12T22:29:33.706Z+ case "$kern" in
292024-08-12T22:29:33.706Z+ groupadd -g 12345 build
302024-08-12T22:29:33.706Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-08-12T22:29:35.701Z+ zfs create -o mountpoint=/work rpool/work
322024-08-12T22:29:35.729Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-08-12T22:29:35.753Z+ home_fs=zfs
342024-08-12T22:29:35.753Z+ [[ zfs == autofs ]]
352024-08-12T22:29:35.753Z+ mkdir -p /home/build
362024-08-12T22:29:35.753Z+ chown build:build /home/build /work
372024-08-12T22:29:37.737Z+ chmod 0700 /home/build /work
382024-08-12T22:29:37.761Zprocess exited: duration 4058 ms, exit code 0
 
392024-08-12T22:29:37.809Zstarting task 1: "authentication"
402024-08-12T22:29:37.852Zprocess exited: duration 42 ms, exit code 0
 
412024-08-12T22:29:37.899Zstarting task 2: "build"
422024-08-12T22:29:37.922Z+ trap _exit_trap EXIT
432024-08-12T22:29:37.922Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-08-12T22:29:38.019Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-08-12T22:29:38.019Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-08-12T22:29:38.019Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-08-12T22:29:38.019Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-08-12T22:29:38.043Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-08-12T22:29:38.043Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-08-12T22:29:38.043Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-08-12T22:29:38.043Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-08-12T22:29:38.043Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-08-12T22:29:38.043Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-08-12T22:29:38.043Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-08-12T22:29:38.043Z+ [[ -d /opt/oxide ]]
562024-08-12T22:29:38.043Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-08-12T22:29:38.043Z+ pfexec mkdir /opt/oxide
582024-08-12T22:29:38.043Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-08-12T22:29:38.043Z+ [[ -d /opt/oxide-underneath ]]
602024-08-12T22:29:38.043Z+ cd /opt/oxide-underneath
612024-08-12T22:29:38.043Z+ pfexec tar ceEp@/f - .
622024-08-12T22:29:38.043Z+ cd /opt/oxide
632024-08-12T22:29:38.043Z+ pfexec tar xveEp@/f -
642024-08-12T22:29:38.149Zx ., 0 bytes, 0 tape blocks
652024-08-12T22:29:38.149Zx ./opte, 0 bytes, 0 tape blocks
662024-08-12T22:29:38.149Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-08-12T22:29:38.149Zx ./opte/bin/opteadm, 53012184 bytes, 103540 tape blocks
682024-08-12T22:29:38.172Z+ pfexec rm -rf /opt/oxide-underneath
692024-08-12T22:29:38.172Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-08-12T22:29:38.196Z+ pfexec mkdir /opt/oxide/work
712024-08-12T22:29:38.196Z+ pfexec chown build:build /opt/oxide/work
722024-08-12T22:29:38.196Z+ cd /opt/oxide/work
732024-08-12T22:29:38.196Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-08-12T22:29:48.708ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-08-12T22:29:48.708Zx out/target/test, 75 bytes, 1 tape blocks
762024-08-12T22:29:48.708Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-08-12T22:29:48.708Zx package-manifest.toml, 30053 bytes, 59 tape blocks
782024-08-12T22:29:48.708Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-08-12T22:29:48.708Zx target/release/omicron-package, 33153408 bytes, 64753 tape blocks
802024-08-12T22:29:48.708Zx target/release/xtask, 11839368 bytes, 23124 tape blocks
812024-08-12T22:29:48.708Zx target/debug/bootstrap, 192602576 bytes, 376177 tape blocks
822024-08-12T22:29:48.708Zx tests/bootstrap-6959a528301c963e, 24079896 bytes, 47032 tape blocks
832024-08-12T22:29:48.708Zx tests/commtest-fe0e06aa62582c2e, 24823496 bytes, 48484 tape blocks
842024-08-12T22:29:48.708Zx tests/dhcp_server-b03c16178e50660f, 24079912 bytes, 47032 tape blocks
852024-08-12T22:29:48.708Zx tests/end_to_end_tests-31d997e80d2140bb, 203695904 bytes, 397844 tape blocks
862024-08-12T22:29:48.708Zx out/clickhouse.tar.gz, 228518585 bytes, 446326 tape blocks
872024-08-12T22:29:48.708Zx out/clickhouse_keeper.tar.gz, 228493098 bytes, 446276 tape blocks
882024-08-12T22:29:48.708Zx out/cockroachdb.tar.gz, 134974349 bytes, 263622 tape blocks
892024-08-12T22:29:48.708Zx out/crucible-dtrace.tar, 85504 bytes, 167 tape blocks
902024-08-12T22:29:48.708Zx out/crucible-pantry-zone.tar.gz, 28531754 bytes, 55727 tape blocks
912024-08-12T22:29:48.709Zx out/crucible-zone.tar.gz, 39097269 bytes, 76362 tape blocks
922024-08-12T22:29:48.709Zx out/external-dns.tar.gz, 25788712 bytes, 50369 tape blocks
932024-08-12T22:29:48.709Zx out/internal-dns.tar.gz, 25788488 bytes, 50369 tape blocks
942024-08-12T22:29:48.709Zx out/mg-ddm-gz.tar, 63430656 bytes, 123888 tape blocks
952024-08-12T22:29:48.709Zx out/nexus.tar.gz, 88899168 bytes, 173632 tape blocks
962024-08-12T22:29:48.709Zx out/ntp.tar.gz, 9227226 bytes, 18022 tape blocks
972024-08-12T22:29:48.709Zx out/omicron-gateway-softnpu.tar.gz, 13932337 bytes, 27212 tape blocks
982024-08-12T22:29:48.709Zx out/omicron-sled-agent.tar, 99106816 bytes, 193568 tape blocks
992024-08-12T22:29:48.709Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1002024-08-12T22:29:48.709Zx out/oximeter.tar.gz, 43614356 bytes, 85185 tape blocks
1012024-08-12T22:29:48.709Zx out/oxlog.tar, 3016192 bytes, 5891 tape blocks
1022024-08-12T22:29:48.709Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1032024-08-12T22:29:48.709Zx out/propolis-server.tar.gz, 66857321 bytes, 130581 tape blocks
1042024-08-12T22:29:48.709Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1052024-08-12T22:29:48.709Zx out/switch-softnpu.tar.gz, 210421644 bytes, 410980 tape blocks
1062024-08-12T22:29:48.733Z
1072024-08-12T22:29:48.733Zreal 10.500017589
1082024-08-12T22:29:48.733Zuser 9.299269235
1092024-08-12T22:29:48.733Zsys 2.091255630
1102024-08-12T22:29:48.733Ztrap 0.000425264
1112024-08-12T22:29:48.733Ztflt 0.000000000
1122024-08-12T22:29:48.733Zdflt 0.000000000
1132024-08-12T22:29:48.733Zkflt 0.000000000
1142024-08-12T22:29:48.733Zlock 0.000000000
1152024-08-12T22:29:48.733Zslp 9.358611779
1162024-08-12T22:29:48.733Zlat 0.248495515
1172024-08-12T22:29:48.733Zstop 0.000118193
1182024-08-12T22:29:48.733Z+ bmat address ls
1192024-08-12T22:29:48.733ZNAME CIDR FIRST LAST COUNT
1202024-08-12T22:29:48.733Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1212024-08-12T22:29:48.733Z++ bmat address ls -f extra -Ho first,last,count
1222024-08-12T22:29:48.733Z+ set -- 10.151.2.164 10.151.2.227 64
1232024-08-12T22:29:48.733Z+ EXTRA_IP_START=10.151.2.164
1242024-08-12T22:29:48.733Z+ EXTRA_IP_END=10.151.2.227
1252024-08-12T22:29:48.733Z+ EXTRA_IP_COUNT=64
1262024-08-12T22:29:48.733Z+ (( EXTRA_IP_COUNT >= 32 ))
1272024-08-12T22:29:48.733Z+ EXTRA_IP_BASE=10.151.2
1282024-08-12T22:29:48.733Z+ EXTRA_IP_FOCTET=164
1292024-08-12T22:29:48.733Z+ EXTRA_IP_LOCTET=227
1302024-08-12T22:29:48.733Z+ SERVICE_IP_POOL_START=10.151.2.164
1312024-08-12T22:29:48.733Z+ SERVICE_IP_POOL_END=10.151.2.173
1322024-08-12T22:29:48.733Z+ DNS_IP1=10.151.2.164
1332024-08-12T22:29:48.733Z+ DNS_IP2=10.151.2.165
1342024-08-12T22:29:48.733Z+ UPLINK_IP=10.151.2.174
1352024-08-12T22:29:48.733Z+ IPPOOL_START=10.151.2.175
1362024-08-12T22:29:48.733Z+ IPPOOL_END=10.151.2.227
1372024-08-12T22:29:48.734Z++ ipadm show-addr -po type,addr
1382024-08-12T22:29:48.734Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1392024-08-12T22:29:48.734Z+ GATEWAY_IP=10.151.2.100
1402024-08-12T22:29:48.734Z+ [[ -n 10.151.2.100 ]]
1412024-08-12T22:29:48.734Z+ ping -s 10.151.2.100 56 1
1422024-08-12T22:29:48.734ZPING 10.151.2.100: 56 data bytes
1432024-08-12T22:29:48.734Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
1442024-08-12T22:29:48.734Z
1452024-08-12T22:29:48.734Z----10.151.2.100 PING Statistics----
1462024-08-12T22:29:48.734Z1 packets transmitted, 1 packets received, 0% packet loss
1472024-08-12T22:29:48.734Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
1482024-08-12T22:29:48.734Z++ arp -an
1492024-08-12T22:29:48.734Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1502024-08-12T22:29:48.757Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1512024-08-12T22:29:48.757Z+ routeadm -e ipv4-forwarding -u
1522024-08-12T22:29:48.852Z+ PXA_START=10.151.2.164
1532024-08-12T22:29:48.852Z+ PXA_END=10.151.2.227
1542024-08-12T22:29:48.875Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1552024-08-12T22:29:48.991Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227
1562024-08-12T22:29:49.015ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1572024-08-12T22:29:49.067Zcreating virtual hardware
1582024-08-12T22:29:49.090Zcreating /scratch/m2_0.vdev
1592024-08-12T22:29:49.090Zcreating /scratch/m2_1.vdev
1602024-08-12T22:29:49.090Zcreating /scratch/u2_0.vdev
1612024-08-12T22:29:49.090Zcreating /scratch/u2_1.vdev
1622024-08-12T22:29:49.090Zcreating /scratch/u2_2.vdev
1632024-08-12T22:29:49.090Zcreating /scratch/u2_3.vdev
1642024-08-12T22:29:49.090Zcreating /scratch/u2_4.vdev
1652024-08-12T22:29:49.090Zcreating /scratch/u2_5.vdev
1662024-08-12T22:29:49.090Zcreating /scratch/u2_6.vdev
1672024-08-12T22:29:49.090Zcreating /scratch/u2_7.vdev
1682024-08-12T22:29:49.090Zcreating /scratch/u2_8.vdev
1692024-08-12T22:29:49.114ZSimnet net0/sc0_0 exists
1702024-08-12T22:29:49.137ZSimnet net1/sc1_0 exists
1712024-08-12T22:29:49.161ZVnic sc0_1 exists
1722024-08-12T22:30:01.631ZUsing 10.151.2.100 as gateway ip
1732024-08-12T22:30:01.631Zusing 18:C0:4D:0D:A0:2A as gateway mac
1742024-08-12T22:30:01.631Zconfiguring SoftNPU ARP entry
1752024-08-12T22:30:01.658Zconfiguring SoftNPU proxy ARP
1762024-08-12T22:30:01.714ZSoftNPU state:
1772024-08-12T22:30:01.714Z local v6:
1782024-08-12T22:30:01.714Z local v4:
1792024-08-12T22:30:01.714Z router v6:
1802024-08-12T22:30:01.714Z router v4_idx:
1812024-08-12T22:30:01.714Z router v4_routes:
1822024-08-12T22:30:01.714Z resolver v4:
1832024-08-12T22:30:01.714Z 10.151.2.100 -> 18:c0:4d:0d:a0:2a
1842024-08-12T22:30:01.714Z resolver v6:
1852024-08-12T22:30:01.714Z nat v4:
1862024-08-12T22:30:01.714Z nat_v6:
1872024-08-12T22:30:01.714Z port_mac:
1882024-08-12T22:30:01.714Z proxy arp:
1892024-08-12T22:30:01.715Z 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
1902024-08-12T22:30:01.715Zcreated virtual hardware
1912024-08-12T22:30:01.738Z
1922024-08-12T22:30:01.738Zreal 12.720668050
1932024-08-12T22:30:01.738Zuser 0.664083049
1942024-08-12T22:30:01.738Zsys 3.282657797
1952024-08-12T22:30:01.738Ztrap 0.000074835
1962024-08-12T22:30:01.738Ztflt 0.000250260
1972024-08-12T22:30:01.738Zdflt 0.000402888
1982024-08-12T22:30:01.739Zkflt 0.000009130
1992024-08-12T22:30:01.739Zlock 9:49.997938331
2002024-08-12T22:30:01.739Zslp 38.340584841
2012024-08-12T22:30:01.739Zlat 0.080874906
2022024-08-12T22:30:01.739Zstop 0.362051209
2032024-08-12T22:30:01.739Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2042024-08-12T22:30:01.762Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2052024-08-12T22:30:01.762Z+ diff -u pkg/config.toml~ pkg/config.toml
2062024-08-12T22:30:01.762Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2072024-08-12T22:30:01.762Z+++ pkg/config.toml Mon Aug 12 22:30:02 2024
2082024-08-12T22:30:01.762Z@@ -29,18 +29,18 @@
2092024-08-12T22:30:01.762Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2102024-08-12T22:30:01.763Z # followed by a string that is embedded into their fake serial values.
2112024-08-12T22:30:01.763Z vdevs = [
2122024-08-12T22:30:01.763Z- "m2_0.vdev",
2132024-08-12T22:30:01.763Z- "m2_1.vdev",
2142024-08-12T22:30:01.763Z+ "/scratch/m2_0.vdev",
2152024-08-12T22:30:01.763Z+ "/scratch/m2_1.vdev",
2162024-08-12T22:30:01.763Z
2172024-08-12T22:30:01.763Z- "u2_0.vdev",
2182024-08-12T22:30:01.763Z- "u2_1.vdev",
2192024-08-12T22:30:01.763Z- "u2_2.vdev",
2202024-08-12T22:30:01.763Z- "u2_3.vdev",
2212024-08-12T22:30:01.763Z- "u2_4.vdev",
2222024-08-12T22:30:01.763Z- "u2_5.vdev",
2232024-08-12T22:30:01.763Z- "u2_6.vdev",
2242024-08-12T22:30:01.763Z- "u2_7.vdev",
2252024-08-12T22:30:01.763Z- "u2_8.vdev",
2262024-08-12T22:30:01.763Z+ "/scratch/u2_0.vdev",
2272024-08-12T22:30:01.763Z+ "/scratch/u2_1.vdev",
2282024-08-12T22:30:01.763Z+ "/scratch/u2_2.vdev",
2292024-08-12T22:30:01.763Z+ "/scratch/u2_3.vdev",
2302024-08-12T22:30:01.763Z+ "/scratch/u2_4.vdev",
2312024-08-12T22:30:01.763Z+ "/scratch/u2_5.vdev",
2322024-08-12T22:30:01.763Z+ "/scratch/u2_6.vdev",
2332024-08-12T22:30:01.763Z+ "/scratch/u2_7.vdev",
2342024-08-12T22:30:01.763Z+ "/scratch/u2_8.vdev",
2352024-08-12T22:30:01.763Z ]
2362024-08-12T22:30:01.763Z
2372024-08-12T22:30:01.763Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2382024-08-12T22:30:01.763Z+ true
2392024-08-12T22:30:01.763Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2402024-08-12T22:30:01.763Z+ SILO_NAME=recovery
2412024-08-12T22:30:01.763Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2422024-08-12T22:30:01.763Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2432024-08-12T22:30:01.763Z+ sed -i~ '
2442024-08-12T22:30:01.763Z /^external_dns_ips/c\
2452024-08-12T22:30:01.763Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2462024-08-12T22:30:01.763Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2472024-08-12T22:30:01.763Z /^first/c\
2482024-08-12T22:30:01.764Zfirst = "10.151.2.164"
2492024-08-12T22:30:01.764Z /^last/c\
2502024-08-12T22:30:01.764Zlast = "10.151.2.173"
2512024-08-12T22:30:01.764Z }
2522024-08-12T22:30:01.764Z /^infra_ip_first/c\
2532024-08-12T22:30:01.764Zinfra_ip_first = "10.151.2.174"
2542024-08-12T22:30:01.764Z /^infra_ip_last/c\
2552024-08-12T22:30:01.764Zinfra_ip_last = "10.151.2.174"
2562024-08-12T22:30:01.764Z /^\[\[rack_network_config.ports/,/^$/ {
2572024-08-12T22:30:01.764Z /^routes/c\
2582024-08-12T22:30:01.764Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
2592024-08-12T22:30:01.764Z /^addresses/c\
2602024-08-12T22:30:01.764Zaddresses = \[{address = "10.151.2.174/24"} \]
2612024-08-12T22:30:01.764Z }
2622024-08-12T22:30:01.764Z' pkg/config-rss.toml
2632024-08-12T22:30:01.788Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2642024-08-12T22:30:01.788Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2652024-08-12T22:30:01.788Z+++ pkg/config-rss.toml Mon Aug 12 22:30:02 2024
2662024-08-12T22:30:01.788Z@@ -33,7 +33,7 @@
2672024-08-12T22:30:01.788Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2682024-08-12T22:30:01.788Z # must be contained in one of the "internal services" IP Pool ranges listed
2692024-08-12T22:30:01.788Z # below.
2702024-08-12T22:30:01.788Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2712024-08-12T22:30:01.788Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2722024-08-12T22:30:01.788Z
2732024-08-12T22:30:01.788Z # Initial TLS certificates for the external API
2742024-08-12T22:30:01.788Z #
2752024-08-12T22:30:01.788Z@@ -69,8 +69,8 @@
2762024-08-12T22:30:01.788Z #
2772024-08-12T22:30:01.788Z # For more on this and what to put here, see docs/how-to-run.adoc.
2782024-08-12T22:30:01.789Z [[internal_services_ip_pool_ranges]]
2792024-08-12T22:30:01.789Z-first = "192.168.1.20"
2802024-08-12T22:30:01.789Z-last = "192.168.1.29"
2812024-08-12T22:30:01.789Z+first = "10.151.2.164"
2822024-08-12T22:30:01.789Z+last = "10.151.2.173"
2832024-08-12T22:30:01.789Z
2842024-08-12T22:30:01.789Z # TODO - this configuration is subject to change going forward. Ultimately these
2852024-08-12T22:30:01.789Z # parameters should be provided to the control plane via wicket, but we need to
2862024-08-12T22:30:01.789Z@@ -91,8 +91,8 @@
2872024-08-12T22:30:01.789Z # A range of IP addresses used by Boundary Services on the external network. In
2882024-08-12T22:30:01.789Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2892024-08-12T22:30:01.789Z # With softnpu, only one address is used.
2902024-08-12T22:30:01.789Z-infra_ip_first = "192.168.1.30"
2912024-08-12T22:30:01.789Z-infra_ip_last = "192.168.1.30"
2922024-08-12T22:30:01.789Z+infra_ip_first = "10.151.2.174"
2932024-08-12T22:30:01.789Z+infra_ip_last = "10.151.2.174"
2942024-08-12T22:30:01.789Z
2952024-08-12T22:30:01.789Z # Configurations for BGP routers to run on the scrimlets.
2962024-08-12T22:30:01.789Z bgp = []
2972024-08-12T22:30:01.789Z@@ -100,9 +100,9 @@
2982024-08-12T22:30:01.789Z # You can configure multiple uplinks by repeating the following stanza
2992024-08-12T22:30:01.789Z [[rack_network_config.ports]]
3002024-08-12T22:30:01.789Z # Routes associated with this port.
3012024-08-12T22:30:01.789Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3022024-08-12T22:30:01.789Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
3032024-08-12T22:30:01.789Z # Addresses associated with this port.
3042024-08-12T22:30:01.789Z-addresses = [{address = "192.168.1.30/24"}]
3052024-08-12T22:30:01.789Z+addresses = [{address = "10.151.2.174/24"} ]
3062024-08-12T22:30:01.789Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3072024-08-12T22:30:01.789Z port = "qsfp0"
3082024-08-12T22:30:01.789Z # The speed of this port.
3092024-08-12T22:30:01.789Z+ true
3102024-08-12T22:30:01.789Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3112024-08-12T22:30:01.789Za pkg/config-rss.toml 7K
3122024-08-12T22:30:01.789Za pkg/config.toml 4K
3132024-08-12T22:30:01.789Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3142024-08-12T22:30:01.789Z+ TLS_NAME=recovery.sys.oxide.test
3152024-08-12T22:30:01.789Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3162024-08-12T22:30:02.235Z.+.......+...............+...+...+...............+..+......+.......+...+...........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+...+.....+.+.................+.......+........+...+.......+........+......+...............................+..+.+.....+....+...........+......+....+.....+......+..........+...+......+.........+..........................+.+...+...+..+.......+......+........+.+.....+.+..+.+.........+..+.+..............+......+.............+.........+........+...................+...+.....+......+................+.....+...+...+...+........................+...+...................+...+......+.........+...........+...................+........+...+......+.+...+...............+..+.........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-08-12T22:30:02.413Z...............+...+...+......+.....+.............+......+..+..................+.+......+.....+....+.....+...+...+.........+.+...+..+.......+......+..+....+.........+......+........+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.....+.........+..........+..+...+.......+...+......+...+.....+.+..+............+............+...+.+......+.........+..+....+........+...+....+..............+....+...+..+.....................+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...................+...+........+.........+................+...+......+........+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3182024-08-12T22:30:02.436Z-----
3192024-08-12T22:30:02.460Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3202024-08-12T22:30:02.460Za pkg/initial-tls-cert.pem 2K
3212024-08-12T22:30:02.460Za pkg/initial-tls-key.pem 4K
3222024-08-12T22:30:02.460Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3232024-08-12T22:30:02.460Z+ rmdir pkg
3242024-08-12T22:30:02.460Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3252024-08-12T22:30:02.460Z+ pfexec mkdir -p /usr/oxide
3262024-08-12T22:30:02.460Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3272024-08-12T22:30:03.173Z+ pfexec chmod +x /usr/oxide/oxide
3282024-08-12T22:30:03.198Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3292024-08-12T22:30:21.541Z+ OMICRON_NO_UNINSTALL=1
3302024-08-12T22:30:21.541Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3312024-08-12T22:30:21.565ZLogging to: /opt/oxide/work/out/LOG
3322024-08-12T22:30:22.088Z
3332024-08-12T22:30:22.088Zreal 0.541134931
3342024-08-12T22:30:22.088Zuser 0.117969794
3352024-08-12T22:30:22.111Zsys 2.439050084
3362024-08-12T22:30:22.111Ztrap 0.000002360
3372024-08-12T22:30:22.111Ztflt 0.000026390
3382024-08-12T22:30:22.111Zdflt 0.000540459
3392024-08-12T22:30:22.111Zkflt 0.000001820
3402024-08-12T22:30:22.111Zlock 48.933160895
3412024-08-12T22:30:22.111Zslp 0.734852509
3422024-08-12T22:30:22.111Zlat 0.002902009
3432024-08-12T22:30:22.112Zstop 0.201170667
3442024-08-12T22:30:22.112Z+ retry=0
3452024-08-12T22:30:22.112Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3462024-08-12T22:30:22.112Z+ [[ 0 -gt 30 ]]
3472024-08-12T22:30:22.112Z+ sleep 1
3482024-08-12T22:30:23.102Z+ retry=1
3492024-08-12T22:30:23.102Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3502024-08-12T22:30:23.126Z+ [[ 1 -gt 30 ]]
3512024-08-12T22:30:23.126Z+ sleep 1
3522024-08-12T22:30:24.117Z+ retry=2
3532024-08-12T22:30:24.117Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3542024-08-12T22:30:24.141Z+ [[ 2 -gt 30 ]]
3552024-08-12T22:30:24.141Z+ sleep 1
3562024-08-12T22:30:25.135Z+ retry=3
3572024-08-12T22:30:25.135Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3582024-08-12T22:30:43.524Z+ [[ 3 -gt 30 ]]
3592024-08-12T22:30:43.524Z+ sleep 1
3602024-08-12T22:30:44.528Z+ retry=4
3612024-08-12T22:30:44.528Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3622024-08-12T22:30:44.552Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3632024-08-12T22:30:44.577Zlocal v6:
3642024-08-12T22:30:44.577Zfe80::108c:70ff:fe8f:ed68
3652024-08-12T22:30:44.577Zlocal v4:
3662024-08-12T22:30:44.577Z10.151.2.174
3672024-08-12T22:30:44.577Zrouter v6:
3682024-08-12T22:30:44.577Zrouter v4_idx:
3692024-08-12T22:30:44.577Zrouter v4_routes:
3702024-08-12T22:30:44.577Zresolver v4:
3712024-08-12T22:30:44.577Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
3722024-08-12T22:30:44.577Zresolver v6:
3732024-08-12T22:30:44.577Zfe80::7065:beff:feb6:d3a0 -> 72:65:be:b6:d3:a0
3742024-08-12T22:30:44.577Zfe80::108c:70ff:fe8f:ed68 -> 12:8c:70:8f:ed:68
3752024-08-12T22:30:44.577Znat v4:
3762024-08-12T22:30:44.577Znat_v6:
3772024-08-12T22:30:44.577Zport_mac:
3782024-08-12T22:30:44.578Z1000: a8:40:25:4c:ca:ee
3792024-08-12T22:30:44.578Z2: a8:40:25:4c:cb:0f
3802024-08-12T22:30:44.578Z1: a8:40:25:4c:ca:ef
3812024-08-12T22:30:44.578Zproxy arp:
3822024-08-12T22:30:44.578Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
3832024-08-12T22:30:44.578Z+ retry=0
3842024-08-12T22:30:44.578Z+++ zoneadm list -n
3852024-08-12T22:30:44.578Z+++ grep oxz_ntp
3862024-08-12T22:30:44.602Z++ pfexec svcs -z -Hostate oxide/ntp
3872024-08-12T22:30:44.602Zsvcs: zone '-Hostate': entity not found
3882024-08-12T22:30:44.602Z++ true
3892024-08-12T22:30:44.602Z+ [[ '' != online ]]
3902024-08-12T22:30:44.602Z+ [[ 0 -gt 60 ]]
3912024-08-12T22:30:44.602Z+ sleep 1
3922024-08-12T22:30:45.591Z+ retry=1
3932024-08-12T22:30:45.615Z+++ zoneadm list -n
3942024-08-12T22:30:45.615Z+++ grep oxz_ntp
3952024-08-12T22:30:45.615Z++ pfexec svcs -z -Hostate oxide/ntp
3962024-08-12T22:30:45.615Zsvcs: zone '-Hostate': entity not found
3972024-08-12T22:30:45.615Z++ true
3982024-08-12T22:30:45.615Z+ [[ '' != online ]]
3992024-08-12T22:30:45.615Z+ [[ 1 -gt 60 ]]
4002024-08-12T22:30:45.615Z+ sleep 1
4012024-08-12T22:30:46.617Z+ retry=2
4022024-08-12T22:30:46.640Z+++ zoneadm list -n
4032024-08-12T22:30:46.640Z+++ grep oxz_ntp
4042024-08-12T22:30:46.641Z++ pfexec svcs -z -Hostate oxide/ntp
4052024-08-12T22:30:46.641Zsvcs: zone '-Hostate': entity not found
4062024-08-12T22:30:46.641Z++ true
4072024-08-12T22:30:46.641Z+ [[ '' != online ]]
4082024-08-12T22:30:46.641Z+ [[ 2 -gt 60 ]]
4092024-08-12T22:30:46.641Z+ sleep 1
4102024-08-12T22:30:47.636Z+ retry=3
4112024-08-12T22:30:47.660Z+++ zoneadm list -n
4122024-08-12T22:30:47.660Z+++ grep oxz_ntp
4132024-08-12T22:30:47.660Z++ pfexec svcs -z -Hostate oxide/ntp
4142024-08-12T22:30:47.660Zsvcs: zone '-Hostate': entity not found
4152024-08-12T22:30:47.660Z++ true
4162024-08-12T22:30:47.660Z+ [[ '' != online ]]
4172024-08-12T22:30:47.660Z+ [[ 3 -gt 60 ]]
4182024-08-12T22:30:47.660Z+ sleep 1
4192024-08-12T22:30:48.658Z+ retry=4
4202024-08-12T22:30:48.682Z+++ zoneadm list -n
4212024-08-12T22:30:48.682Z+++ grep oxz_ntp
4222024-08-12T22:30:48.682Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4232024-08-12T22:30:48.705Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4242024-08-12T22:30:48.705Z++ true
4252024-08-12T22:30:48.705Z+ [[ '' != online ]]
4262024-08-12T22:30:48.705Z+ [[ 4 -gt 60 ]]
4272024-08-12T22:30:48.705Z+ sleep 1
4282024-08-12T22:30:49.690Z+ retry=5
4292024-08-12T22:30:49.713Z+++ zoneadm list -n
4302024-08-12T22:30:49.713Z+++ grep oxz_ntp
4312024-08-12T22:30:49.713Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4322024-08-12T22:30:49.737Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4332024-08-12T22:30:49.737Z++ true
4342024-08-12T22:30:49.737Z+ [[ '' != online ]]
4352024-08-12T22:30:49.737Z+ [[ 5 -gt 60 ]]
4362024-08-12T22:30:49.737Z+ sleep 1
4372024-08-12T22:30:50.724Z+ retry=6
4382024-08-12T22:30:50.747Z+++ zoneadm list -n
4392024-08-12T22:30:50.747Z+++ grep oxz_ntp
4402024-08-12T22:30:50.748Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4412024-08-12T22:30:50.771Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4422024-08-12T22:30:50.771Z++ true
4432024-08-12T22:30:50.771Z+ [[ '' != online ]]
4442024-08-12T22:30:50.771Z+ [[ 6 -gt 60 ]]
4452024-08-12T22:30:50.771Z+ sleep 1
4462024-08-12T22:30:51.753Z+ retry=7
4472024-08-12T22:30:51.777Z+++ zoneadm list -n
4482024-08-12T22:30:51.777Z+++ grep oxz_ntp
4492024-08-12T22:30:51.777Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4502024-08-12T22:30:51.800Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4512024-08-12T22:30:51.800Z++ true
4522024-08-12T22:30:51.800Z+ [[ '' != online ]]
4532024-08-12T22:30:51.800Z+ [[ 7 -gt 60 ]]
4542024-08-12T22:30:51.800Z+ sleep 1
4552024-08-12T22:30:52.784Z+ retry=8
4562024-08-12T22:30:52.808Z+++ zoneadm list -n
4572024-08-12T22:30:52.808Z+++ grep oxz_ntp
4582024-08-12T22:30:52.808Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4592024-08-12T22:30:52.808Z+ [[ offline != online ]]
4602024-08-12T22:30:52.808Z+ [[ 8 -gt 60 ]]
4612024-08-12T22:30:52.808Z+ sleep 1
4622024-08-12T22:30:53.807Z+ retry=9
4632024-08-12T22:30:53.831Z+++ zoneadm list -n
4642024-08-12T22:30:53.831Z+++ grep oxz_ntp
4652024-08-12T22:30:53.831Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4662024-08-12T22:30:53.831Z+ [[ offline != online ]]
4672024-08-12T22:30:53.831Z+ [[ 9 -gt 60 ]]
4682024-08-12T22:30:53.831Z+ sleep 1
4692024-08-12T22:30:54.828Z+ retry=10
4702024-08-12T22:30:54.851Z+++ zoneadm list -n
4712024-08-12T22:30:54.851Z+++ grep oxz_ntp
4722024-08-12T22:30:54.851Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4732024-08-12T22:30:54.851Z+ [[ offline != online ]]
4742024-08-12T22:30:54.851Z+ [[ 10 -gt 60 ]]
4752024-08-12T22:30:54.851Z+ sleep 1
4762024-08-12T22:30:55.850Z+ retry=11
4772024-08-12T22:30:55.874Z+++ zoneadm list -n
4782024-08-12T22:30:55.874Z+++ grep oxz_ntp
4792024-08-12T22:30:55.874Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4802024-08-12T22:30:55.874Z+ [[ offline != online ]]
4812024-08-12T22:30:55.874Z+ [[ 11 -gt 60 ]]
4822024-08-12T22:30:55.874Z+ sleep 1
4832024-08-12T22:30:56.873Z+ retry=12
4842024-08-12T22:30:56.897Z+++ zoneadm list -n
4852024-08-12T22:30:56.897Z+++ grep oxz_ntp
4862024-08-12T22:30:56.897Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4872024-08-12T22:30:56.897Z+ [[ offline != online ]]
4882024-08-12T22:30:56.897Z+ [[ 12 -gt 60 ]]
4892024-08-12T22:30:56.897Z+ sleep 1
4902024-08-12T22:30:57.896Z+ retry=13
4912024-08-12T22:30:57.919Z+++ zoneadm list -n
4922024-08-12T22:30:57.919Z+++ grep oxz_ntp
4932024-08-12T22:30:57.919Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
4942024-08-12T22:30:57.919Z+ [[ offline != online ]]
4952024-08-12T22:30:57.919Z+ [[ 13 -gt 60 ]]
4962024-08-12T22:30:57.919Z+ sleep 1
4972024-08-12T22:30:58.918Z+ retry=14
4982024-08-12T22:30:58.942Z+++ zoneadm list -n
4992024-08-12T22:30:58.942Z+++ grep oxz_ntp
5002024-08-12T22:30:58.942Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
5012024-08-12T22:30:58.942Z+ [[ offline != online ]]
5022024-08-12T22:30:58.942Z+ [[ 14 -gt 60 ]]
5032024-08-12T22:30:58.942Z+ sleep 1
 
5042024-08-12T22:30:59.264Zsock console login: Aug 12 22:30:59 sock ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5052024-08-12T22:30:59.940Z+ retry=15
5062024-08-12T22:30:59.963Z+++ zoneadm list -n
5072024-08-12T22:30:59.963Z+++ grep oxz_ntp
5082024-08-12T22:30:59.963Z++ pfexec svcs -z oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265 -Hostate oxide/ntp
5092024-08-12T22:30:59.963Z+ [[ online != online ]]
5102024-08-12T22:30:59.963Z+ echo 'Waited for chrony: 15s'
5112024-08-12T22:30:59.963Z+ retry=0
5122024-08-12T22:30:59.963ZWaited for chrony: 15s
5132024-08-12T22:30:59.963Z+ zoneadm list
5142024-08-12T22:30:59.963Z+ grep nexus
5152024-08-12T22:30:59.987Z+ [[ 0 -gt 300 ]]
5162024-08-12T22:30:59.987Z+ sleep 1
5172024-08-12T22:31:00.970Z+ retry=1
5182024-08-12T22:31:00.993Z+ zoneadm list
5192024-08-12T22:31:00.993Z+ grep nexus
5202024-08-12T22:31:00.993Z+ [[ 1 -gt 300 ]]
5212024-08-12T22:31:00.993Z+ sleep 1
5222024-08-12T22:31:01.980Z+ retry=2
5232024-08-12T22:31:02.004Z+ zoneadm list
5242024-08-12T22:31:02.004Z+ grep nexus
5252024-08-12T22:31:02.004Z+ [[ 2 -gt 300 ]]
5262024-08-12T22:31:02.004Z+ sleep 1
5272024-08-12T22:31:02.991Z+ retry=3
5282024-08-12T22:31:03.015Z+ zoneadm list
5292024-08-12T22:31:03.015Z+ grep nexus
5302024-08-12T22:31:03.015Z+ [[ 3 -gt 300 ]]
5312024-08-12T22:31:03.015Z+ sleep 1
5322024-08-12T22:31:04.002Z+ retry=4
5332024-08-12T22:31:04.025Z+ zoneadm list
5342024-08-12T22:31:04.025Z+ grep nexus
5352024-08-12T22:31:04.025Z+ [[ 4 -gt 300 ]]
5362024-08-12T22:31:04.025Z+ sleep 1
5372024-08-12T22:31:05.012Z+ retry=5
5382024-08-12T22:31:05.036Z+ zoneadm list
5392024-08-12T22:31:05.036Z+ grep nexus
5402024-08-12T22:31:05.036Z+ [[ 5 -gt 300 ]]
5412024-08-12T22:31:05.036Z+ sleep 1
5422024-08-12T22:31:06.023Z+ retry=6
5432024-08-12T22:31:06.047Z+ zoneadm list
5442024-08-12T22:31:06.047Z+ grep nexus
5452024-08-12T22:31:06.047Z+ [[ 6 -gt 300 ]]
5462024-08-12T22:31:06.047Z+ sleep 1
5472024-08-12T22:31:07.033Z+ retry=7
5482024-08-12T22:31:07.057Z+ zoneadm list
5492024-08-12T22:31:07.057Z+ grep nexus
5502024-08-12T22:31:07.057Z+ [[ 7 -gt 300 ]]
5512024-08-12T22:31:07.057Z+ sleep 1
5522024-08-12T22:31:08.044Z+ retry=8
5532024-08-12T22:31:08.068Z+ zoneadm list
5542024-08-12T22:31:08.068Z+ grep nexus
5552024-08-12T22:31:08.068Z+ [[ 8 -gt 300 ]]
5562024-08-12T22:31:08.068Z+ sleep 1
5572024-08-12T22:31:09.055Z+ retry=9
5582024-08-12T22:31:09.078Z+ zoneadm list
5592024-08-12T22:31:09.079Z+ grep nexus
5602024-08-12T22:31:09.079Z+ [[ 9 -gt 300 ]]
5612024-08-12T22:31:09.079Z+ sleep 1
5622024-08-12T22:31:10.066Z+ retry=10
5632024-08-12T22:31:10.090Z+ zoneadm list
5642024-08-12T22:31:10.090Z+ grep nexus
5652024-08-12T22:31:10.090Z+ [[ 10 -gt 300 ]]
5662024-08-12T22:31:10.090Z+ sleep 1
5672024-08-12T22:31:11.076Z+ retry=11
5682024-08-12T22:31:11.100Z+ zoneadm list
5692024-08-12T22:31:11.100Z+ grep nexus
5702024-08-12T22:31:11.100Z+ [[ 11 -gt 300 ]]
5712024-08-12T22:31:11.100Z+ sleep 1
5722024-08-12T22:31:12.087Z+ retry=12
5732024-08-12T22:31:12.111Z+ zoneadm list
5742024-08-12T22:31:12.111Z+ grep nexus
5752024-08-12T22:31:12.111Z+ [[ 12 -gt 300 ]]
5762024-08-12T22:31:12.111Z+ sleep 1
5772024-08-12T22:31:13.098Z+ retry=13
5782024-08-12T22:31:13.122Z+ zoneadm list
5792024-08-12T22:31:13.122Z+ grep nexus
5802024-08-12T22:31:13.122Z+ [[ 13 -gt 300 ]]
5812024-08-12T22:31:13.122Z+ sleep 1
5822024-08-12T22:31:14.110Z+ retry=14
5832024-08-12T22:31:14.134Z+ zoneadm list
5842024-08-12T22:31:14.134Z+ grep nexus
5852024-08-12T22:31:14.134Z+ [[ 14 -gt 300 ]]
5862024-08-12T22:31:14.134Z+ sleep 1
5872024-08-12T22:31:15.121Z+ retry=15
5882024-08-12T22:31:15.145Z+ zoneadm list
5892024-08-12T22:31:15.145Z+ grep nexus
5902024-08-12T22:31:15.145Z+ [[ 15 -gt 300 ]]
5912024-08-12T22:31:15.145Z+ sleep 1
5922024-08-12T22:31:16.223Z+ retry=16
5932024-08-12T22:31:16.265Z+ zoneadm list
5942024-08-12T22:31:16.349Z+ grep nexus
5952024-08-12T22:31:16.468Z+ [[ 16 -gt 300 ]]
5962024-08-12T22:31:16.468Z+ sleep 1
5972024-08-12T22:31:17.867Z+ retry=17
5982024-08-12T22:31:17.867Z+ zoneadm list
5992024-08-12T22:31:17.867Z+ grep nexus
6002024-08-12T22:31:17.867Z+ [[ 17 -gt 300 ]]
6012024-08-12T22:31:17.867Z+ sleep 1
6022024-08-12T22:31:18.655Z+ retry=18
6032024-08-12T22:31:18.678Z+ zoneadm list
6042024-08-12T22:31:18.678Z+ grep nexus
6052024-08-12T22:31:18.678Z+ [[ 18 -gt 300 ]]
6062024-08-12T22:31:18.678Z+ sleep 1
6072024-08-12T22:31:19.668Z+ retry=19
6082024-08-12T22:31:19.691Z+ zoneadm list
6092024-08-12T22:31:19.691Z+ grep nexus
6102024-08-12T22:31:19.691Z+ [[ 19 -gt 300 ]]
6112024-08-12T22:31:19.691Z+ sleep 1
6122024-08-12T22:31:20.681Z+ retry=20
6132024-08-12T22:31:20.704Z+ zoneadm list
6142024-08-12T22:31:20.704Z+ grep nexus
6152024-08-12T22:31:20.704Z+ [[ 20 -gt 300 ]]
6162024-08-12T22:31:20.704Z+ sleep 1
6172024-08-12T22:31:21.692Z+ retry=21
6182024-08-12T22:31:21.716Z+ zoneadm list
6192024-08-12T22:31:21.716Z+ grep nexus
6202024-08-12T22:31:21.716Z+ [[ 21 -gt 300 ]]
6212024-08-12T22:31:21.716Z+ sleep 1
6222024-08-12T22:31:22.706Z+ retry=22
6232024-08-12T22:31:22.729Z+ zoneadm list
6242024-08-12T22:31:22.729Z+ grep nexus
6252024-08-12T22:31:22.729Z+ [[ 22 -gt 300 ]]
6262024-08-12T22:31:22.729Z+ sleep 1
6272024-08-12T22:31:23.718Z+ retry=23
6282024-08-12T22:31:23.741Z+ zoneadm list
6292024-08-12T22:31:23.741Z+ grep nexus
6302024-08-12T22:31:23.741Z+ [[ 23 -gt 300 ]]
6312024-08-12T22:31:23.741Z+ sleep 1
6322024-08-12T22:31:24.748Z+ retry=24
6332024-08-12T22:31:24.748Z+ zoneadm list
6342024-08-12T22:31:24.748Z+ grep nexus
6352024-08-12T22:31:24.748Z+ [[ 24 -gt 300 ]]
6362024-08-12T22:31:24.748Z+ sleep 1
6372024-08-12T22:31:25.743Z+ retry=25
6382024-08-12T22:31:25.767Z+ zoneadm list
6392024-08-12T22:31:25.767Z+ grep nexus
6402024-08-12T22:31:25.767Z+ [[ 25 -gt 300 ]]
6412024-08-12T22:31:25.767Z+ sleep 1
6422024-08-12T22:31:26.759Z+ retry=26
6432024-08-12T22:31:26.783Z+ zoneadm list
6442024-08-12T22:31:26.783Z+ grep nexus
6452024-08-12T22:31:26.783Z+ [[ 26 -gt 300 ]]
6462024-08-12T22:31:26.783Z+ sleep 1
6472024-08-12T22:31:27.777Z+ retry=27
6482024-08-12T22:31:27.777Z+ zoneadm list
6492024-08-12T22:31:27.838Z+ grep nexus
6502024-08-12T22:31:27.870Z+ [[ 27 -gt 300 ]]
6512024-08-12T22:31:27.870Z+ sleep 1
6522024-08-12T22:31:28.871Z+ retry=28
6532024-08-12T22:31:28.894Z+ zoneadm list
6542024-08-12T22:31:28.895Z+ grep nexus
6552024-08-12T22:31:28.895Z+ [[ 28 -gt 300 ]]
6562024-08-12T22:31:28.895Z+ sleep 1
6572024-08-12T22:31:29.888Z+ retry=29
6582024-08-12T22:31:29.912Z+ zoneadm list
6592024-08-12T22:31:29.912Z+ grep nexus
6602024-08-12T22:31:29.912Z+ [[ 29 -gt 300 ]]
6612024-08-12T22:31:29.912Z+ sleep 1
6622024-08-12T22:31:30.904Z+ retry=30
6632024-08-12T22:31:30.929Z+ zoneadm list
6642024-08-12T22:31:30.929Z+ grep nexus
6652024-08-12T22:31:30.929Z+ [[ 30 -gt 300 ]]
6662024-08-12T22:31:30.929Z+ sleep 1
6672024-08-12T22:31:31.918Z+ retry=31
6682024-08-12T22:31:31.942Z+ zoneadm list
6692024-08-12T22:31:31.942Z+ grep nexus
6702024-08-12T22:31:31.942Z+ [[ 31 -gt 300 ]]
6712024-08-12T22:31:31.942Z+ sleep 1
6722024-08-12T22:31:32.930Z+ retry=32
6732024-08-12T22:31:32.959Z+ zoneadm list
6742024-08-12T22:31:32.959Z+ grep nexus
6752024-08-12T22:31:32.959Z+ [[ 32 -gt 300 ]]
6762024-08-12T22:31:32.959Z+ sleep 1
6772024-08-12T22:31:33.946Z+ retry=33
6782024-08-12T22:31:33.970Z+ zoneadm list
6792024-08-12T22:31:33.970Z+ grep nexus
6802024-08-12T22:31:33.970Z+ [[ 33 -gt 300 ]]
6812024-08-12T22:31:33.970Z+ sleep 1
6822024-08-12T22:31:34.955Z+ retry=34
6832024-08-12T22:31:34.981Z+ zoneadm list
6842024-08-12T22:31:34.981Z+ grep nexus
6852024-08-12T22:31:34.982Z+ [[ 34 -gt 300 ]]
6862024-08-12T22:31:34.982Z+ sleep 1
6872024-08-12T22:31:35.967Z+ retry=35
6882024-08-12T22:31:35.991Z+ zoneadm list
6892024-08-12T22:31:35.991Z+ grep nexus
6902024-08-12T22:31:35.991Z+ [[ 35 -gt 300 ]]
6912024-08-12T22:31:35.991Z+ sleep 1
6922024-08-12T22:31:36.981Z+ retry=36
6932024-08-12T22:31:37.004Z+ zoneadm list
6942024-08-12T22:31:37.004Z+ grep nexus
6952024-08-12T22:31:37.004Z+ [[ 36 -gt 300 ]]
6962024-08-12T22:31:37.004Z+ sleep 1
6972024-08-12T22:31:37.994Z+ retry=37
6982024-08-12T22:31:38.018Z+ zoneadm list
6992024-08-12T22:31:38.018Z+ grep nexus
7002024-08-12T22:31:38.018Z+ [[ 37 -gt 300 ]]
7012024-08-12T22:31:38.018Z+ sleep 1
7022024-08-12T22:31:39.007Z+ retry=38
7032024-08-12T22:31:39.054Z+ zoneadm list
7042024-08-12T22:31:39.054Z+ grep nexus
7052024-08-12T22:31:39.054Z+ [[ 38 -gt 300 ]]
7062024-08-12T22:31:39.055Z+ sleep 1
7072024-08-12T22:31:40.020Z+ retry=39
7082024-08-12T22:31:40.044Z+ zoneadm list
7092024-08-12T22:31:40.044Z+ grep nexus
7102024-08-12T22:31:40.044Z+ [[ 39 -gt 300 ]]
7112024-08-12T22:31:40.044Z+ sleep 1
7122024-08-12T22:31:41.035Z+ retry=40
7132024-08-12T22:31:41.059Z+ zoneadm list
7142024-08-12T22:31:41.059Z+ grep nexus
7152024-08-12T22:31:41.059Z+ [[ 40 -gt 300 ]]
7162024-08-12T22:31:41.060Z+ sleep 1
7172024-08-12T22:31:42.055Z+ retry=41
7182024-08-12T22:31:42.078Z+ zoneadm list
7192024-08-12T22:31:42.078Z+ grep nexus
7202024-08-12T22:31:42.078Z+ [[ 41 -gt 300 ]]
7212024-08-12T22:31:42.078Z+ sleep 1
7222024-08-12T22:31:43.067Z+ retry=42
7232024-08-12T22:31:43.091Z+ zoneadm list
7242024-08-12T22:31:43.091Z+ grep nexus
7252024-08-12T22:31:43.091Z+ [[ 42 -gt 300 ]]
7262024-08-12T22:31:43.091Z+ sleep 1
7272024-08-12T22:31:44.081Z+ retry=43
7282024-08-12T22:31:44.104Z+ zoneadm list
7292024-08-12T22:31:44.104Z+ grep nexus
7302024-08-12T22:31:44.104Z+ [[ 43 -gt 300 ]]
7312024-08-12T22:31:44.104Z+ sleep 1
7322024-08-12T22:31:45.096Z+ retry=44
7332024-08-12T22:31:45.119Z+ zoneadm list
7342024-08-12T22:31:45.119Z+ grep nexus
7352024-08-12T22:31:45.119Z+ [[ 44 -gt 300 ]]
7362024-08-12T22:31:45.119Z+ sleep 1
7372024-08-12T22:31:46.108Z+ retry=45
7382024-08-12T22:31:46.131Z+ zoneadm list
7392024-08-12T22:31:46.131Z+ grep nexus
7402024-08-12T22:31:46.131Z+ [[ 45 -gt 300 ]]
7412024-08-12T22:31:46.131Z+ sleep 1
7422024-08-12T22:31:47.121Z+ retry=46
7432024-08-12T22:31:47.145Z+ zoneadm list
7442024-08-12T22:31:47.145Z+ grep nexus
7452024-08-12T22:31:47.145Z+ [[ 46 -gt 300 ]]
7462024-08-12T22:31:47.145Z+ sleep 1
7472024-08-12T22:31:48.135Z+ retry=47
7482024-08-12T22:31:48.159Z+ zoneadm list
7492024-08-12T22:31:48.159Z+ grep nexus
7502024-08-12T22:31:48.159Z+ [[ 47 -gt 300 ]]
7512024-08-12T22:31:48.159Z+ sleep 1
7522024-08-12T22:31:49.148Z+ retry=48
7532024-08-12T22:31:49.171Z+ zoneadm list
7542024-08-12T22:31:49.171Z+ grep nexus
7552024-08-12T22:31:49.171Z+ [[ 48 -gt 300 ]]
7562024-08-12T22:31:49.171Z+ sleep 1
7572024-08-12T22:31:50.160Z+ retry=49
7582024-08-12T22:31:50.185Z+ zoneadm list
7592024-08-12T22:31:50.185Z+ grep nexus
7602024-08-12T22:31:50.185Z+ [[ 49 -gt 300 ]]
7612024-08-12T22:31:50.185Z+ sleep 1
7622024-08-12T22:31:51.173Z+ retry=50
7632024-08-12T22:31:51.197Z+ zoneadm list
7642024-08-12T22:31:51.197Z+ grep nexus
7652024-08-12T22:31:51.197Z+ [[ 50 -gt 300 ]]
7662024-08-12T22:31:51.197Z+ sleep 1
7672024-08-12T22:31:52.194Z+ retry=51
7682024-08-12T22:31:52.219Z+ grep nexus
7692024-08-12T22:31:52.219Z+ zoneadm list
7702024-08-12T22:31:52.276Z+ [[ 51 -gt 300 ]]
7712024-08-12T22:31:52.276Z+ sleep 1
7722024-08-12T22:31:53.284Z+ retry=52
7732024-08-12T22:31:53.307Z+ zoneadm list
7742024-08-12T22:31:53.307Z+ grep nexus
7752024-08-12T22:31:53.307Z+ [[ 52 -gt 300 ]]
7762024-08-12T22:31:53.308Z+ sleep 1
7772024-08-12T22:31:54.302Z+ retry=53
7782024-08-12T22:31:54.326Z+ zoneadm list
7792024-08-12T22:31:54.326Z+ grep nexus
7802024-08-12T22:31:54.350Z+ [[ 53 -gt 300 ]]
7812024-08-12T22:31:54.350Z+ sleep 1
7822024-08-12T22:31:55.421Z+ retry=54
7832024-08-12T22:31:55.470Z+ zoneadm list
7842024-08-12T22:31:55.494Z+ grep nexus
7852024-08-12T22:31:55.518Z+ [[ 54 -gt 300 ]]
7862024-08-12T22:31:55.518Z+ sleep 1
7872024-08-12T22:31:56.524Z+ retry=55
7882024-08-12T22:31:56.548Z+ zoneadm list
7892024-08-12T22:31:56.548Z+ grep nexus
7902024-08-12T22:31:56.548Z+ [[ 55 -gt 300 ]]
7912024-08-12T22:31:56.548Z+ sleep 1
7922024-08-12T22:31:57.544Z+ retry=56
7932024-08-12T22:31:57.568Z+ zoneadm list
7942024-08-12T22:31:57.568Z+ grep nexus
7952024-08-12T22:31:57.568Z+ [[ 56 -gt 300 ]]
7962024-08-12T22:31:57.568Z+ sleep 1
7972024-08-12T22:31:58.567Z+ retry=57
7982024-08-12T22:31:58.592Z+ zoneadm list
7992024-08-12T22:31:58.592Z+ grep nexus
8002024-08-12T22:31:58.592Z+ [[ 57 -gt 300 ]]
8012024-08-12T22:31:58.592Z+ sleep 1
8022024-08-12T22:31:59.595Z+ retry=58
8032024-08-12T22:31:59.619Z+ zoneadm list
8042024-08-12T22:31:59.619Z+ grep nexus
8052024-08-12T22:31:59.619Zoxz_nexus_8e5fb63d-011e-4f8e-b416-8713dac504ae
8062024-08-12T22:31:59.619Zoxz_nexus_4c699543-0a26-420d-8b7a-4a0104f01339
8072024-08-12T22:31:59.619Zoxz_nexus_d512bf60-e3a1-492a-aa6e-6bf28969f94c
8082024-08-12T22:31:59.619Z+ echo 'Waited for nexus: 58s'
8092024-08-12T22:31:59.619ZWaited for nexus: 58s
8102024-08-12T22:31:59.619Z+ export RUST_BACKTRACE=1
8112024-08-12T22:31:59.619Z+ RUST_BACKTRACE=1
8122024-08-12T22:31:59.619Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8132024-08-12T22:31:59.619Z++ ./target/debug/bootstrap
8142024-08-12T22:31:59.749ZUsing external DNS server at 10.151.2.164:53
8152024-08-12T22:31:59.786Z2024-08-12 22:31:59.776275045 UTC: attempting to log into API
 
8162024-08-12T22:32:04.023ZAug 12 22:32:03 sock xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:15.204.198.96:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8172024-08-12T22:32:14.869Z2024-08-12 22:32:14.857059190 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8182024-08-12T22:32:15.868Z2024-08-12 22:32:15.858282027 UTC: attempting to log into API
8192024-08-12T22:32:30.901Z2024-08-12 22:32:30.889947151 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8202024-08-12T22:32:31.725ZAug 12 22:32:31 sock ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
8212024-08-12T22:32:31.768ZAug 12 22:32:31 sock ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
 
8222024-08-12T22:32:31.901Z2024-08-12 22:32:31.891259421 UTC: attempting to log into API
 
8232024-08-12T22:32:32.163ZAug 12 22:32:31 sock ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
8242024-08-12T22:32:33.289ZAug 12 22:32:32 sock ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
8252024-08-12T22:32:33.326ZAug 12 22:32:32 sock ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
 
8262024-08-12T22:32:46.935Z2024-08-12 22:32:46.923959035 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8272024-08-12T22:32:47.935Z2024-08-12 22:32:47.925179382 UTC: attempting to log into API
8282024-08-12T22:33:02.967Z2024-08-12 22:33:02.956630618 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8292024-08-12T22:33:03.968Z2024-08-12 22:33:03.957849744 UTC: attempting to log into API
8302024-08-12T22:33:09.112Z2024-08-12 22:33:08.996987381 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: dns error: no record found for Query { name: Name("recovery.sys.oxide.test."), query_type: AAAA, query_class: IN }
8312024-08-12T22:33:10.009Z2024-08-12 22:33:09.998524457 UTC: attempting to log into API
8322024-08-12T22:33:10.778Z2024-08-12 22:33:10.766944462 UTC: login succeeded
8332024-08-12T22:33:10.809Zwaiting for nexus to come up...
8342024-08-12T22:33:10.874Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8352024-08-12T22:33:11.039Zsetting up quotas...
8362024-08-12T22:33:11.064Zensuring datasets are ready...
8372024-08-12T22:33:13.064Zlet's roll.
8382024-08-12T22:33:13.090Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8392024-08-12T22:33:13.090ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8402024-08-12T22:33:13.090ZOXIDE_TOKEN=oxide-token-ba96f85e571b1dd58b352f7504f56c2452371bea'
8412024-08-12T22:33:13.090Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8422024-08-12T22:33:13.090Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8432024-08-12T22:33:13.090Z++ OXIDE_TOKEN=oxide-token-ba96f85e571b1dd58b352f7504f56c2452371bea
8442024-08-12T22:33:13.090Z+ export OXIDE_HOST OXIDE_TOKEN
8452024-08-12T22:33:13.090Z+ retry=0
8462024-08-12T22:33:13.090Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8472024-08-12T22:33:13.090Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8482024-08-12T22:33:13.090Z+ [[ 0 -gt 60 ]]
8492024-08-12T22:33:13.090Z+ sleep 1
8502024-08-12T22:33:14.092Z+ retry=1
8512024-08-12T22:33:14.092Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8522024-08-12T22:33:14.118Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8532024-08-12T22:33:14.118Z+ [[ 1 -gt 60 ]]
8542024-08-12T22:33:14.118Z+ sleep 1
8552024-08-12T22:33:15.104Z+ retry=2
8562024-08-12T22:33:15.104Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8572024-08-12T22:33:15.130Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8582024-08-12T22:33:15.130Z+ [[ 2 -gt 60 ]]
8592024-08-12T22:33:15.130Z+ sleep 1
8602024-08-12T22:33:16.121Z+ retry=3
8612024-08-12T22:33:16.122Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8622024-08-12T22:33:16.146Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8632024-08-12T22:33:16.146Z+ [[ 3 -gt 60 ]]
8642024-08-12T22:33:16.147Z+ sleep 1
8652024-08-12T22:33:17.135Z+ retry=4
8662024-08-12T22:33:17.135Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8672024-08-12T22:33:17.171Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8682024-08-12T22:33:17.171Z+ [[ 4 -gt 60 ]]
8692024-08-12T22:33:17.171Z+ sleep 1
8702024-08-12T22:33:18.151Z+ retry=5
8712024-08-12T22:33:18.151Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8722024-08-12T22:33:18.184Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8732024-08-12T22:33:18.184Z+ [[ 5 -gt 60 ]]
8742024-08-12T22:33:18.184Z+ sleep 1
8752024-08-12T22:33:19.171Z+ retry=6
8762024-08-12T22:33:19.171Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8772024-08-12T22:33:19.214Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8782024-08-12T22:33:19.215Z+ [[ 6 -gt 60 ]]
8792024-08-12T22:33:19.215Z+ sleep 1
8802024-08-12T22:33:20.190Z+ retry=7
8812024-08-12T22:33:20.190Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8822024-08-12T22:33:23.320Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8832024-08-12T22:33:23.321Z+ [[ 7 -gt 60 ]]
8842024-08-12T22:33:23.321Z+ sleep 1
8852024-08-12T22:33:23.321Z+ retry=8
8862024-08-12T22:33:23.321Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8872024-08-12T22:33:23.321Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8882024-08-12T22:33:23.321Z+ [[ 8 -gt 60 ]]
8892024-08-12T22:33:23.321Z+ sleep 1
8902024-08-12T22:33:23.321Z+ retry=9
8912024-08-12T22:33:23.321Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8922024-08-12T22:33:23.321Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8932024-08-12T22:33:23.321Z+ [[ 9 -gt 60 ]]
8942024-08-12T22:33:23.321Z+ sleep 1
8952024-08-12T22:33:23.345Z+ retry=10
8962024-08-12T22:33:23.345Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8972024-08-12T22:33:23.345Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8982024-08-12T22:33:23.345Z+ [[ 10 -gt 60 ]]
8992024-08-12T22:33:23.345Z+ sleep 1
9002024-08-12T22:33:24.248Z+ retry=11
9012024-08-12T22:33:24.248Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9022024-08-12T22:33:24.273Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9032024-08-12T22:33:24.273Z+ [[ 11 -gt 60 ]]
9042024-08-12T22:33:24.273Z+ sleep 1
9052024-08-12T22:33:25.263Z+ retry=12
9062024-08-12T22:33:25.263Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9072024-08-12T22:33:25.287Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9082024-08-12T22:33:25.287Z+ [[ 12 -gt 60 ]]
9092024-08-12T22:33:25.287Z+ sleep 1
9102024-08-12T22:33:26.278Z+ retry=13
9112024-08-12T22:33:26.278Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9122024-08-12T22:33:26.302Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9132024-08-12T22:33:26.302Z+ [[ 13 -gt 60 ]]
9142024-08-12T22:33:26.302Z+ sleep 1
9152024-08-12T22:33:27.293Z+ retry=14
9162024-08-12T22:33:27.293Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9172024-08-12T22:33:27.317Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9182024-08-12T22:33:27.317Z+ [[ 14 -gt 60 ]]
9192024-08-12T22:33:27.317Z+ sleep 1
9202024-08-12T22:33:28.311Z+ retry=15
9212024-08-12T22:33:28.311Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9222024-08-12T22:33:28.335Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9232024-08-12T22:33:28.335Z+ [[ 15 -gt 60 ]]
9242024-08-12T22:33:28.335Z+ sleep 1
9252024-08-12T22:33:29.326Z+ retry=16
9262024-08-12T22:33:29.326Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9272024-08-12T22:33:29.350Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9282024-08-12T22:33:29.350Z+ [[ 16 -gt 60 ]]
9292024-08-12T22:33:29.350Z+ sleep 1
9302024-08-12T22:33:30.343Z+ retry=17
9312024-08-12T22:33:30.343Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9322024-08-12T22:33:30.366Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9332024-08-12T22:33:30.366Z+ [[ 17 -gt 60 ]]
9342024-08-12T22:33:30.366Z+ sleep 1
9352024-08-12T22:33:31.359Z+ retry=18
9362024-08-12T22:33:31.359Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9372024-08-12T22:33:31.382Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9382024-08-12T22:33:31.382Z+ [[ 18 -gt 60 ]]
9392024-08-12T22:33:31.382Z+ sleep 1
9402024-08-12T22:33:32.375Z+ retry=19
9412024-08-12T22:33:32.375Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9422024-08-12T22:33:32.398Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9432024-08-12T22:33:32.398Z+ [[ 19 -gt 60 ]]
9442024-08-12T22:33:32.399Z+ sleep 1
9452024-08-12T22:33:33.391Z+ retry=20
9462024-08-12T22:33:33.391Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9472024-08-12T22:33:33.415Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9482024-08-12T22:33:33.415Z+ [[ 20 -gt 60 ]]
9492024-08-12T22:33:33.415Z+ sleep 1
9502024-08-12T22:33:34.407Z+ retry=21
9512024-08-12T22:33:34.407Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9522024-08-12T22:33:34.430Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9532024-08-12T22:33:34.430Z+ [[ 21 -gt 60 ]]
9542024-08-12T22:33:34.431Z+ sleep 1
9552024-08-12T22:33:35.424Z+ retry=22
9562024-08-12T22:33:35.424Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9572024-08-12T22:33:35.447Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9582024-08-12T22:33:35.448Z+ [[ 22 -gt 60 ]]
9592024-08-12T22:33:35.448Z+ sleep 1
9602024-08-12T22:33:36.439Z+ retry=23
9612024-08-12T22:33:36.439Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9622024-08-12T22:33:36.462Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9632024-08-12T22:33:36.462Z+ [[ 23 -gt 60 ]]
9642024-08-12T22:33:36.462Z+ sleep 1
9652024-08-12T22:33:37.455Z+ retry=24
9662024-08-12T22:33:37.455Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9672024-08-12T22:33:37.534Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9682024-08-12T22:33:38.190Z{"status":"ok"}success
9692024-08-12T22:33:38.190ZProject {
9702024-08-12T22:33:38.190Z description: "some images",
9712024-08-12T22:33:38.190Z id: 5388df7c-9e58-47b1-b405-124440d8f01a,
9722024-08-12T22:33:38.214Z name: Name(
9732024-08-12T22:33:38.214Z "images",
9742024-08-12T22:33:38.214Z ),
9752024-08-12T22:33:38.214Z time_created: 2024-08-12T22:33:37.650869Z,
9762024-08-12T22:33:38.214Z time_modified: 2024-08-12T22:33:37.650869Z,
9772024-08-12T22:33:38.214Z}
9782024-08-12T22:33:38.214Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
9792024-08-12T22:37:03.091ZAug 12 22:37:02 sock xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:23.150.40.242:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
9802024-08-12T22:39:16.147Zdone!
9812024-08-12T22:39:16.241Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9822024-08-12T22:39:16.355Zsuccess
9832024-08-12T22:39:16.355ZImage {
9842024-08-12T22:39:16.355Z block_size: ByteCount(
9852024-08-12T22:39:16.355Z 512,
9862024-08-12T22:39:16.355Z ),
9872024-08-12T22:39:16.380Z description: "debian 11 original base image",
9882024-08-12T22:39:16.380Z digest: None,
9892024-08-12T22:39:16.380Z id: 9f4322fd-8e28-41dc-ae72-30cb4b9e1742,
9902024-08-12T22:39:16.380Z name: Name(
9912024-08-12T22:39:16.380Z "debian11",
9922024-08-12T22:39:16.380Z ),
9932024-08-12T22:39:16.380Z os: "debian",
9942024-08-12T22:39:16.380Z project_id: None,
9952024-08-12T22:39:16.380Z size: ByteCount(
9962024-08-12T22:39:16.380Z 2147483648,
9972024-08-12T22:39:16.380Z ),
9982024-08-12T22:39:16.380Z time_created: 2024-08-12T22:39:16.075455Z,
9992024-08-12T22:39:16.380Z time_modified: 2024-08-12T22:39:16.334637Z,
10002024-08-12T22:39:16.380Z url: None,
10012024-08-12T22:39:16.380Z version: "11",
10022024-08-12T22:39:16.380Z}
10032024-08-12T22:39:16.380Z+ for test_bin in tests/*
10042024-08-12T22:39:16.380Z+ ./tests/bootstrap-6959a528301c963e
10052024-08-12T22:39:16.404Z
10062024-08-12T22:39:16.404Zrunning 0 tests
10072024-08-12T22:39:16.404Z
10082024-08-12T22:39:16.404Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10092024-08-12T22:39:16.404Z
10102024-08-12T22:39:16.404Z+ for test_bin in tests/*
10112024-08-12T22:39:16.404Z+ ./tests/commtest-fe0e06aa62582c2e
10122024-08-12T22:39:16.427Z
10132024-08-12T22:39:16.427Zrunning 0 tests
10142024-08-12T22:39:16.428Z
10152024-08-12T22:39:16.428Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10162024-08-12T22:39:16.428Z
10172024-08-12T22:39:16.428Z+ for test_bin in tests/*
10182024-08-12T22:39:16.428Z+ ./tests/dhcp_server-b03c16178e50660f
10192024-08-12T22:39:16.470Z
10202024-08-12T22:39:16.470Zrunning 0 tests
10212024-08-12T22:39:16.493Z
10222024-08-12T22:39:16.493Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10232024-08-12T22:39:16.493Z
10242024-08-12T22:39:16.493Z+ for test_bin in tests/*
10252024-08-12T22:39:16.493Z+ ./tests/end_to_end_tests-31d997e80d2140bb
10262024-08-12T22:39:16.699Z
10272024-08-12T22:39:16.699Zrunning 2 tests
10282024-08-12T22:39:16.952Ztest no_spoof::no_spoof_here ... ok
10292024-08-12T22:39:44.913Ztest instance_launch::instance_launch ... ok
10302024-08-12T22:39:44.913Z
10312024-08-12T22:39:44.913Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 28.21s
10322024-08-12T22:39:44.913Z
10332024-08-12T22:39:44.937Z+ _exit_trap
10342024-08-12T22:39:44.937Z+ local status=0
10352024-08-12T22:39:44.937Z+ set +o errexit
10362024-08-12T22:39:44.937Z+ pfexec svcadm -Z disable -s cron
10372024-08-12T22:39:46.618Z+ [[ 0 -eq 0 ]]
10382024-08-12T22:39:46.618Z+ exit 0
10392024-08-12T22:39:46.642Zprocess exited: duration 608727 ms, exit code 0
 
10402024-08-12T22:39:46.716Zfound 107 output files
10412024-08-12T22:39:46.716Zuploading: /var/svc/log/oxide-sled-agent:default.log (1232111 bytes)
10422024-08-12T22:39:48.052Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10432024-08-12T22:39:48.052Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (4686571 bytes)
10442024-08-12T22:39:48.480Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 4686571 -> 4703104
10452024-08-12T22:39:49.550Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
10462024-08-12T22:39:49.550Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (33198 bytes)
10472024-08-12T22:39:50.707Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
10482024-08-12T22:39:50.707Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (186179 bytes)
10492024-08-12T22:39:50.883Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 186179 -> 187744
10502024-08-12T22:39:51.952Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
10512024-08-12T22:39:51.952Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (241768 bytes)
10522024-08-12T22:39:52.149Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 241768 -> 244114
10532024-08-12T22:39:53.218Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
10542024-08-12T22:39:53.242Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1420927 bytes)
10552024-08-12T22:39:53.512Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1420927 -> 1428108
10562024-08-12T22:39:54.585Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
10572024-08-12T22:39:54.586Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (756254 bytes)
10582024-08-12T22:39:54.874Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 756254 -> 769004
10592024-08-12T22:39:55.943Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10602024-08-12T22:39:55.943Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (3334 bytes)
10612024-08-12T22:39:57.034Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10622024-08-12T22:39:57.034Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (271535 bytes)
10632024-08-12T22:39:57.254Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 271535 -> 277228
10642024-08-12T22:39:58.322Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10652024-08-12T22:39:58.322Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (8756 bytes)
10662024-08-12T22:39:59.438Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10672024-08-12T22:39:59.438Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3975 bytes)
10682024-08-12T22:40:00.533Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10692024-08-12T22:40:00.533Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (8807 bytes)
10702024-08-12T22:40:01.652Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
10712024-08-12T22:40:01.652Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_cbd6df64-6ddb-46ea-8711-9dcf16a956e3/root/var/svc/log/oxide-crucible-agent:default.log (8485 bytes)
10722024-08-12T22:40:02.772Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_cbd6df64-6ddb-46ea-8711-9dcf16a956e3/root/var/svc/log/oxide-crucible-agent:default.log
10732024-08-12T22:40:02.772Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_cbd6df64-6ddb-46ea-8711-9dcf16a956e3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10742024-08-12T22:40:03.863Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_cbd6df64-6ddb-46ea-8711-9dcf16a956e3/root/var/svc/log/oxide-crucible-downstairs:default.log
10752024-08-12T22:40:03.887Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_cbd6df64-6ddb-46ea-8711-9dcf16a956e3/root/var/svc/log/oxide-crucible-downstairs:downstairs-4ad08cda-58f5-4bc2-b319-7a184a3bcf1e.log (3018 bytes)
10762024-08-12T22:40:04.954Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_cbd6df64-6ddb-46ea-8711-9dcf16a956e3/root/var/svc/log/oxide-crucible-downstairs:downstairs-4ad08cda-58f5-4bc2-b319-7a184a3bcf1e.log
10772024-08-12T22:40:04.954Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_cbd6df64-6ddb-46ea-8711-9dcf16a956e3/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
10782024-08-12T22:40:06.045Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_cbd6df64-6ddb-46ea-8711-9dcf16a956e3/root/var/svc/log/oxide-zone-network-setup:default.log
10792024-08-12T22:40:06.045Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_pantry_bf8f3dc7-bf47-4284-a733-d0439d4503a7/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
10802024-08-12T22:40:07.137Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_pantry_bf8f3dc7-bf47-4284-a733-d0439d4503a7/root/var/svc/log/oxide-crucible-pantry:default.log
10812024-08-12T22:40:07.137Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_pantry_bf8f3dc7-bf47-4284-a733-d0439d4503a7/root/var/svc/log/oxide-zone-network-setup:default.log (1717 bytes)
10822024-08-12T22:40:08.228Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_crucible_pantry_bf8f3dc7-bf47-4284-a733-d0439d4503a7/root/var/svc/log/oxide-zone-network-setup:default.log
10832024-08-12T22:40:08.228Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_nexus_8e5fb63d-011e-4f8e-b416-8713dac504ae/root/var/svc/log/oxide-nexus:default.log (2935190 bytes)
10842024-08-12T22:40:08.602Zupload warning: file "/pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_nexus_8e5fb63d-011e-4f8e-b416-8713dac504ae/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2935190 -> 3054221
10852024-08-12T22:40:09.670Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_nexus_8e5fb63d-011e-4f8e-b416-8713dac504ae/root/var/svc/log/oxide-nexus:default.log
10862024-08-12T22:40:09.670Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_nexus_8e5fb63d-011e-4f8e-b416-8713dac504ae/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
10872024-08-12T22:40:10.761Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_nexus_8e5fb63d-011e-4f8e-b416-8713dac504ae/root/var/svc/log/oxide-opte-interface-setup:default.log
10882024-08-12T22:40:10.761Zuploading: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_nexus_8e5fb63d-011e-4f8e-b416-8713dac504ae/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
10892024-08-12T22:40:11.855Zuploaded: /pool/ext/09108500-899b-4c15-aa1f-0c8295b5001c/crypt/zone/oxz_nexus_8e5fb63d-011e-4f8e-b416-8713dac504ae/root/var/svc/log/oxide-zone-network-setup:default.log
10902024-08-12T22:40:11.855Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_cockroachdb_f63ea97c-f4c7-446e-90a6-8dab7b9a2a8a/root/var/svc/log/oxide-cockroach-admin:default.log (4659 bytes)
10912024-08-12T22:40:13.075Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_cockroachdb_f63ea97c-f4c7-446e-90a6-8dab7b9a2a8a/root/var/svc/log/oxide-cockroach-admin:default.log
10922024-08-12T22:40:13.179Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_cockroachdb_f63ea97c-f4c7-446e-90a6-8dab7b9a2a8a/root/var/svc/log/oxide-cockroachdb:default.log (4313 bytes)
10932024-08-12T22:40:14.297Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_cockroachdb_f63ea97c-f4c7-446e-90a6-8dab7b9a2a8a/root/var/svc/log/oxide-cockroachdb:default.log
10942024-08-12T22:40:14.321Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_cockroachdb_f63ea97c-f4c7-446e-90a6-8dab7b9a2a8a/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
10952024-08-12T22:40:15.391Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_cockroachdb_f63ea97c-f4c7-446e-90a6-8dab7b9a2a8a/root/var/svc/log/oxide-zone-network-setup:default.log
10962024-08-12T22:40:15.391Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_crucible_0e3126d1-2dfd-4ff4-a12b-e331eecb3b8e/root/var/svc/log/oxide-crucible-agent:default.log (12506 bytes)
10972024-08-12T22:40:16.507Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_crucible_0e3126d1-2dfd-4ff4-a12b-e331eecb3b8e/root/var/svc/log/oxide-crucible-agent:default.log
10982024-08-12T22:40:16.507Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_crucible_0e3126d1-2dfd-4ff4-a12b-e331eecb3b8e/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10992024-08-12T22:40:17.601Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_crucible_0e3126d1-2dfd-4ff4-a12b-e331eecb3b8e/root/var/svc/log/oxide-crucible-downstairs:default.log
11002024-08-12T22:40:17.601Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_crucible_0e3126d1-2dfd-4ff4-a12b-e331eecb3b8e/root/var/svc/log/oxide-crucible-downstairs:downstairs-aca0a0c2-28de-4fdb-a646-db4616c6b83a.log (5993 bytes)
11012024-08-12T22:40:18.696Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_crucible_0e3126d1-2dfd-4ff4-a12b-e331eecb3b8e/root/var/svc/log/oxide-crucible-downstairs:downstairs-aca0a0c2-28de-4fdb-a646-db4616c6b83a.log
11022024-08-12T22:40:18.696Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_crucible_0e3126d1-2dfd-4ff4-a12b-e331eecb3b8e/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11032024-08-12T22:40:19.789Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_crucible_0e3126d1-2dfd-4ff4-a12b-e331eecb3b8e/root/var/svc/log/oxide-zone-network-setup:default.log
11042024-08-12T22:40:19.789Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_nexus_4c699543-0a26-420d-8b7a-4a0104f01339/root/var/svc/log/oxide-nexus:default.log (5325925 bytes)
11052024-08-12T22:40:20.221Zupload warning: file "/pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_nexus_4c699543-0a26-420d-8b7a-4a0104f01339/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5325925 -> 5529226
11062024-08-12T22:40:21.292Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_nexus_4c699543-0a26-420d-8b7a-4a0104f01339/root/var/svc/log/oxide-nexus:default.log
11072024-08-12T22:40:21.292Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_nexus_4c699543-0a26-420d-8b7a-4a0104f01339/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11082024-08-12T22:40:22.389Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_nexus_4c699543-0a26-420d-8b7a-4a0104f01339/root/var/svc/log/oxide-opte-interface-setup:default.log
11092024-08-12T22:40:22.412Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_nexus_4c699543-0a26-420d-8b7a-4a0104f01339/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
11102024-08-12T22:40:23.483Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_nexus_4c699543-0a26-420d-8b7a-4a0104f01339/root/var/svc/log/oxide-zone-network-setup:default.log
11112024-08-12T22:40:23.483Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_oximeter_a3cca9d9-445e-495c-bb4b-d68f7777b482/root/var/svc/log/oxide-oximeter:default.log (1723157 bytes)
11122024-08-12T22:40:23.829Zupload warning: file "/pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_oximeter_a3cca9d9-445e-495c-bb4b-d68f7777b482/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1723157 -> 1876734
11132024-08-12T22:40:24.900Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_oximeter_a3cca9d9-445e-495c-bb4b-d68f7777b482/root/var/svc/log/oxide-oximeter:default.log
11142024-08-12T22:40:24.900Zuploading: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_oximeter_a3cca9d9-445e-495c-bb4b-d68f7777b482/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
11152024-08-12T22:40:25.994Zuploaded: /pool/ext/37abb3ae-dbff-4acb-a865-55b4ed0374e9/crypt/zone/oxz_oximeter_a3cca9d9-445e-495c-bb4b-d68f7777b482/root/var/svc/log/oxide-zone-network-setup:default.log
11162024-08-12T22:40:25.994Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_clickhouse_edbbb800-f4c8-4980-a5c9-af163b96b017/root/var/svc/log/oxide-clickhouse:default.log (2639674 bytes)
11172024-08-12T22:40:26.351Zupload warning: file "/pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_clickhouse_edbbb800-f4c8-4980-a5c9-af163b96b017/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2639674 -> 2875811
11182024-08-12T22:40:27.422Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_clickhouse_edbbb800-f4c8-4980-a5c9-af163b96b017/root/var/svc/log/oxide-clickhouse:default.log
11192024-08-12T22:40:27.422Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_clickhouse_edbbb800-f4c8-4980-a5c9-af163b96b017/root/var/svc/log/oxide-zone-network-setup:default.log (1685 bytes)
11202024-08-12T22:40:28.516Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_clickhouse_edbbb800-f4c8-4980-a5c9-af163b96b017/root/var/svc/log/oxide-zone-network-setup:default.log
11212024-08-12T22:40:28.516Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_cockroachdb_6e18a319-e02f-4c83-a62c-8cd5eec5ac30/root/var/svc/log/oxide-cockroach-admin:default.log (4659 bytes)
11222024-08-12T22:40:29.609Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_cockroachdb_6e18a319-e02f-4c83-a62c-8cd5eec5ac30/root/var/svc/log/oxide-cockroach-admin:default.log
11232024-08-12T22:40:29.634Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_cockroachdb_6e18a319-e02f-4c83-a62c-8cd5eec5ac30/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
11242024-08-12T22:40:30.705Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_cockroachdb_6e18a319-e02f-4c83-a62c-8cd5eec5ac30/root/var/svc/log/oxide-cockroachdb:default.log
11252024-08-12T22:40:30.705Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_cockroachdb_6e18a319-e02f-4c83-a62c-8cd5eec5ac30/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11262024-08-12T22:40:31.799Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_cockroachdb_6e18a319-e02f-4c83-a62c-8cd5eec5ac30/root/var/svc/log/oxide-zone-network-setup:default.log
11272024-08-12T22:40:31.799Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-agent:default.log (35597 bytes)
11282024-08-12T22:40:32.958Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-agent:default.log
11292024-08-12T22:40:32.959Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11302024-08-12T22:40:34.054Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-downstairs:default.log
11312024-08-12T22:40:34.078Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-downstairs:downstairs-b754dae4-8dfb-4055-91cb-eacd8945042e.log (6075 bytes)
11322024-08-12T22:40:35.147Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-downstairs:downstairs-b754dae4-8dfb-4055-91cb-eacd8945042e.log
11332024-08-12T22:40:35.147Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-downstairs:downstairs-e86b1522-e9d2-4e32-9e6c-f281bda6ce88.log (5993 bytes)
11342024-08-12T22:40:36.241Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-downstairs:downstairs-e86b1522-e9d2-4e32-9e6c-f281bda6ce88.log
11352024-08-12T22:40:36.241Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-downstairs:snapshot-b754dae4-8dfb-4055-91cb-eacd8945042e-6ad175c4-d009-4baf-bcf4-40a5a6345162.log (5685 bytes)
11362024-08-12T22:40:37.334Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-crucible-downstairs:snapshot-b754dae4-8dfb-4055-91cb-eacd8945042e-6ad175c4-d009-4baf-bcf4-40a5a6345162.log
11372024-08-12T22:40:37.334Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11382024-08-12T22:40:38.428Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_crucible_b5dc5628-b92d-454b-bdaf-72d2635fbb46/root/var/svc/log/oxide-zone-network-setup:default.log
11392024-08-12T22:40:38.428Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_external_dns_d120a386-2706-4e01-bb8c-b5d65c0f637f/root/var/svc/log/oxide-external_dns:default.log (31433 bytes)
11402024-08-12T22:40:38.544Zupload warning: file "/pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_external_dns_d120a386-2706-4e01-bb8c-b5d65c0f637f/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 31433 -> 35211
11412024-08-12T22:40:39.621Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_external_dns_d120a386-2706-4e01-bb8c-b5d65c0f637f/root/var/svc/log/oxide-external_dns:default.log
11422024-08-12T22:40:39.621Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_external_dns_d120a386-2706-4e01-bb8c-b5d65c0f637f/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
11432024-08-12T22:40:40.716Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_external_dns_d120a386-2706-4e01-bb8c-b5d65c0f637f/root/var/svc/log/oxide-opte-interface-setup:default.log
11442024-08-12T22:40:40.716Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_external_dns_d120a386-2706-4e01-bb8c-b5d65c0f637f/root/var/svc/log/oxide-zone-network-setup:default.log (1695 bytes)
11452024-08-12T22:40:41.811Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_external_dns_d120a386-2706-4e01-bb8c-b5d65c0f637f/root/var/svc/log/oxide-zone-network-setup:default.log
11462024-08-12T22:40:41.835Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_internal_dns_3d896039-f4f3-4ec9-99e7-c74d19508504/root/var/svc/log/oxide-internal_dns:default.log (111144 bytes)
11472024-08-12T22:40:41.967Zupload warning: file "/pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_internal_dns_3d896039-f4f3-4ec9-99e7-c74d19508504/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 111144 -> 114897
11482024-08-12T22:40:43.038Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_internal_dns_3d896039-f4f3-4ec9-99e7-c74d19508504/root/var/svc/log/oxide-internal_dns:default.log
11492024-08-12T22:40:43.038Zuploading: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_internal_dns_3d896039-f4f3-4ec9-99e7-c74d19508504/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
11502024-08-12T22:40:44.132Zuploaded: /pool/ext/537dde5b-089b-4e20-9ef8-bf10127d7dce/crypt/zone/oxz_internal_dns_3d896039-f4f3-4ec9-99e7-c74d19508504/root/var/svc/log/oxide-zone-network-setup:default.log
11512024-08-12T22:40:44.132Zuploading: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_9d505dd0-fa65-4b6d-a5d4-fcd351438ace/root/var/svc/log/oxide-crucible-agent:default.log (8484 bytes)
11522024-08-12T22:40:45.248Zuploaded: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_9d505dd0-fa65-4b6d-a5d4-fcd351438ace/root/var/svc/log/oxide-crucible-agent:default.log
11532024-08-12T22:40:45.248Zuploading: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_9d505dd0-fa65-4b6d-a5d4-fcd351438ace/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11542024-08-12T22:40:46.343Zuploaded: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_9d505dd0-fa65-4b6d-a5d4-fcd351438ace/root/var/svc/log/oxide-crucible-downstairs:default.log
11552024-08-12T22:40:46.343Zuploading: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_9d505dd0-fa65-4b6d-a5d4-fcd351438ace/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab968911-6bc9-4012-8e94-ded1c8717af3.log (3017 bytes)
11562024-08-12T22:40:47.440Zuploaded: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_9d505dd0-fa65-4b6d-a5d4-fcd351438ace/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab968911-6bc9-4012-8e94-ded1c8717af3.log
11572024-08-12T22:40:47.440Zuploading: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_9d505dd0-fa65-4b6d-a5d4-fcd351438ace/root/var/svc/log/oxide-zone-network-setup:default.log (1672 bytes)
11582024-08-12T22:40:48.538Zuploaded: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_9d505dd0-fa65-4b6d-a5d4-fcd351438ace/root/var/svc/log/oxide-zone-network-setup:default.log
11592024-08-12T22:40:48.538Zuploading: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_pantry_36f128c9-08fe-4583-be21-fc48e81dffcb/root/var/svc/log/oxide-crucible-pantry:default.log (764217 bytes)
11602024-08-12T22:40:49.912Zuploaded: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_pantry_36f128c9-08fe-4583-be21-fc48e81dffcb/root/var/svc/log/oxide-crucible-pantry:default.log
11612024-08-12T22:40:49.912Zuploading: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_pantry_36f128c9-08fe-4583-be21-fc48e81dffcb/root/var/svc/log/oxide-zone-network-setup:default.log (1715 bytes)
11622024-08-12T22:40:51.039Zuploaded: /pool/ext/65eb96fa-5b90-4e6e-968e-0b7f2a4634d3/crypt/zone/oxz_crucible_pantry_36f128c9-08fe-4583-be21-fc48e81dffcb/root/var/svc/log/oxide-zone-network-setup:default.log
11632024-08-12T22:40:51.039Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_cockroachdb_ed89774a-25e8-48f6-b3ad-dcd6acb70983/root/var/svc/log/oxide-cockroach-admin:default.log (4658 bytes)
11642024-08-12T22:40:52.134Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_cockroachdb_ed89774a-25e8-48f6-b3ad-dcd6acb70983/root/var/svc/log/oxide-cockroach-admin:default.log
11652024-08-12T22:40:52.134Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_cockroachdb_ed89774a-25e8-48f6-b3ad-dcd6acb70983/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11662024-08-12T22:40:53.228Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_cockroachdb_ed89774a-25e8-48f6-b3ad-dcd6acb70983/root/var/svc/log/oxide-cockroachdb:default.log
11672024-08-12T22:40:53.252Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_cockroachdb_ed89774a-25e8-48f6-b3ad-dcd6acb70983/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11682024-08-12T22:40:54.323Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_cockroachdb_ed89774a-25e8-48f6-b3ad-dcd6acb70983/root/var/svc/log/oxide-zone-network-setup:default.log
11692024-08-12T22:40:54.347Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-crucible-agent:default.log (20604 bytes)
11702024-08-12T22:40:55.460Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-crucible-agent:default.log
11712024-08-12T22:40:55.461Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11722024-08-12T22:40:56.554Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-crucible-downstairs:default.log
11732024-08-12T22:40:56.578Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-crucible-downstairs:downstairs-cd291f47-641a-41fd-acbf-f2b1bd7da645.log (6075 bytes)
11742024-08-12T22:40:57.648Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-crucible-downstairs:downstairs-cd291f47-641a-41fd-acbf-f2b1bd7da645.log
11752024-08-12T22:40:57.648Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-crucible-downstairs:snapshot-cd291f47-641a-41fd-acbf-f2b1bd7da645-6ad175c4-d009-4baf-bcf4-40a5a6345162.log (5681 bytes)
11762024-08-12T22:40:58.742Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-crucible-downstairs:snapshot-cd291f47-641a-41fd-acbf-f2b1bd7da645-6ad175c4-d009-4baf-bcf4-40a5a6345162.log
11772024-08-12T22:40:58.742Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11782024-08-12T22:40:59.836Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_crucible_16576d37-bf1d-487a-91e1-85c50bec0856/root/var/svc/log/oxide-zone-network-setup:default.log
11792024-08-12T22:40:59.836Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_external_dns_0d8c5151-3b8f-4b66-b2ec-69426d844f51/root/var/svc/log/oxide-external_dns:default.log (30672 bytes)
11802024-08-12T22:40:59.927Zupload warning: file "/pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_external_dns_0d8c5151-3b8f-4b66-b2ec-69426d844f51/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 30672 -> 34446
11812024-08-12T22:41:00.998Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_external_dns_0d8c5151-3b8f-4b66-b2ec-69426d844f51/root/var/svc/log/oxide-external_dns:default.log
11822024-08-12T22:41:00.998Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_external_dns_0d8c5151-3b8f-4b66-b2ec-69426d844f51/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
11832024-08-12T22:41:02.242Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_external_dns_0d8c5151-3b8f-4b66-b2ec-69426d844f51/root/var/svc/log/oxide-opte-interface-setup:default.log
11842024-08-12T22:41:02.265Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_external_dns_0d8c5151-3b8f-4b66-b2ec-69426d844f51/root/var/svc/log/oxide-zone-network-setup:default.log (1696 bytes)
11852024-08-12T22:41:03.336Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_external_dns_0d8c5151-3b8f-4b66-b2ec-69426d844f51/root/var/svc/log/oxide-zone-network-setup:default.log
11862024-08-12T22:41:03.336Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_internal_dns_f4c5d120-d2bb-4d71-a0b6-86945be45b9f/root/var/svc/log/oxide-internal_dns:default.log (111158 bytes)
11872024-08-12T22:41:03.493Zupload warning: file "/pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_internal_dns_f4c5d120-d2bb-4d71-a0b6-86945be45b9f/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 111158 -> 114912
11882024-08-12T22:41:04.563Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_internal_dns_f4c5d120-d2bb-4d71-a0b6-86945be45b9f/root/var/svc/log/oxide-internal_dns:default.log
11892024-08-12T22:41:04.563Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_internal_dns_f4c5d120-d2bb-4d71-a0b6-86945be45b9f/root/var/svc/log/oxide-zone-network-setup:default.log (1679 bytes)
11902024-08-12T22:41:05.657Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_internal_dns_f4c5d120-d2bb-4d71-a0b6-86945be45b9f/root/var/svc/log/oxide-zone-network-setup:default.log
11912024-08-12T22:41:05.657Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_nexus_d512bf60-e3a1-492a-aa6e-6bf28969f94c/root/var/svc/log/oxide-nexus:default.log (36675069 bytes)
11922024-08-12T22:41:12.087Zupload warning: file "/pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_nexus_d512bf60-e3a1-492a-aa6e-6bf28969f94c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36675069 -> 37113108
11932024-08-12T22:41:13.157Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_nexus_d512bf60-e3a1-492a-aa6e-6bf28969f94c/root/var/svc/log/oxide-nexus:default.log
11942024-08-12T22:41:13.181Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_nexus_d512bf60-e3a1-492a-aa6e-6bf28969f94c/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11952024-08-12T22:41:14.252Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_nexus_d512bf60-e3a1-492a-aa6e-6bf28969f94c/root/var/svc/log/oxide-opte-interface-setup:default.log
11962024-08-12T22:41:14.252Zuploading: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_nexus_d512bf60-e3a1-492a-aa6e-6bf28969f94c/root/var/svc/log/oxide-zone-network-setup:default.log (1654 bytes)
11972024-08-12T22:41:15.350Zuploaded: /pool/ext/90f5d185-2468-460f-8d20-ecb50330e694/crypt/zone/oxz_nexus_d512bf60-e3a1-492a-aa6e-6bf28969f94c/root/var/svc/log/oxide-zone-network-setup:default.log
11982024-08-12T22:41:15.350Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_cockroachdb_1d05f4a7-d996-4766-bd87-c722a5eff018/root/var/svc/log/oxide-cockroach-admin:default.log (4658 bytes)
11992024-08-12T22:41:16.443Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_cockroachdb_1d05f4a7-d996-4766-bd87-c722a5eff018/root/var/svc/log/oxide-cockroach-admin:default.log
12002024-08-12T22:41:16.443Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_cockroachdb_1d05f4a7-d996-4766-bd87-c722a5eff018/root/var/svc/log/oxide-cockroachdb:default.log (4287 bytes)
12012024-08-12T22:41:17.537Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_cockroachdb_1d05f4a7-d996-4766-bd87-c722a5eff018/root/var/svc/log/oxide-cockroachdb:default.log
12022024-08-12T22:41:17.537Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_cockroachdb_1d05f4a7-d996-4766-bd87-c722a5eff018/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
12032024-08-12T22:41:18.630Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_cockroachdb_1d05f4a7-d996-4766-bd87-c722a5eff018/root/var/svc/log/oxide-zone-network-setup:default.log
12042024-08-12T22:41:18.630Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_crucible_05cbfbfe-6fa6-4f42-8318-0cc5d14fc1c5/root/var/svc/log/oxide-crucible-agent:default.log (12975 bytes)
12052024-08-12T22:41:19.747Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_crucible_05cbfbfe-6fa6-4f42-8318-0cc5d14fc1c5/root/var/svc/log/oxide-crucible-agent:default.log
12062024-08-12T22:41:19.747Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_crucible_05cbfbfe-6fa6-4f42-8318-0cc5d14fc1c5/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12072024-08-12T22:41:20.840Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_crucible_05cbfbfe-6fa6-4f42-8318-0cc5d14fc1c5/root/var/svc/log/oxide-crucible-downstairs:default.log
12082024-08-12T22:41:20.840Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_crucible_05cbfbfe-6fa6-4f42-8318-0cc5d14fc1c5/root/var/svc/log/oxide-crucible-downstairs:downstairs-03b1261d-34b1-4d66-b14f-7a478374bbea.log (5992 bytes)
12092024-08-12T22:41:21.931Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_crucible_05cbfbfe-6fa6-4f42-8318-0cc5d14fc1c5/root/var/svc/log/oxide-crucible-downstairs:downstairs-03b1261d-34b1-4d66-b14f-7a478374bbea.log
12102024-08-12T22:41:21.932Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_crucible_05cbfbfe-6fa6-4f42-8318-0cc5d14fc1c5/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
12112024-08-12T22:41:23.023Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_crucible_05cbfbfe-6fa6-4f42-8318-0cc5d14fc1c5/root/var/svc/log/oxide-zone-network-setup:default.log
12122024-08-12T22:41:23.023Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_internal_dns_c0f640e3-627c-4a08-96bc-34d0a8af670d/root/var/svc/log/oxide-internal_dns:default.log (111161 bytes)
12132024-08-12T22:41:23.176Zupload warning: file "/pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_internal_dns_c0f640e3-627c-4a08-96bc-34d0a8af670d/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 111161 -> 114915
12142024-08-12T22:41:24.244Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_internal_dns_c0f640e3-627c-4a08-96bc-34d0a8af670d/root/var/svc/log/oxide-internal_dns:default.log
12152024-08-12T22:41:24.244Zuploading: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_internal_dns_c0f640e3-627c-4a08-96bc-34d0a8af670d/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
12162024-08-12T22:41:25.336Zuploaded: /pool/ext/9ac4fc8d-4a30-4017-bbdc-a392e988e5c6/crypt/zone/oxz_internal_dns_c0f640e3-627c-4a08-96bc-34d0a8af670d/root/var/svc/log/oxide-zone-network-setup:default.log
12172024-08-12T22:41:25.336Zuploading: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-agent:default.log (28088 bytes)
12182024-08-12T22:41:26.470Zuploaded: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-agent:default.log
12192024-08-12T22:41:26.470Zuploading: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12202024-08-12T22:41:27.561Zuploaded: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-downstairs:default.log
12212024-08-12T22:41:27.561Zuploading: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-downstairs:downstairs-07cb78a6-a40f-4520-96ce-529cb230c853.log (6070 bytes)
12222024-08-12T22:41:28.652Zuploaded: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-downstairs:downstairs-07cb78a6-a40f-4520-96ce-529cb230c853.log
12232024-08-12T22:41:28.652Zuploading: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c6f2fce-c3fe-43a4-873c-7e752c871db6.log (3126 bytes)
12242024-08-12T22:41:29.746Zuploaded: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c6f2fce-c3fe-43a4-873c-7e752c871db6.log
12252024-08-12T22:41:29.746Zuploading: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-downstairs:snapshot-07cb78a6-a40f-4520-96ce-529cb230c853-6ad175c4-d009-4baf-bcf4-40a5a6345162.log (5685 bytes)
12262024-08-12T22:41:30.839Zuploaded: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-crucible-downstairs:snapshot-07cb78a6-a40f-4520-96ce-529cb230c853-6ad175c4-d009-4baf-bcf4-40a5a6345162.log
12272024-08-12T22:41:30.839Zuploading: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
12282024-08-12T22:41:31.932Zuploaded: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_29f4c7b7-f5fa-4187-a8a7-9146b88f3181/root/var/svc/log/oxide-zone-network-setup:default.log
12292024-08-12T22:41:31.956Zuploading: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_pantry_e41eb0e0-3766-4ece-a1f1-18626d27f03a/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
12302024-08-12T22:41:33.027Zuploaded: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_pantry_e41eb0e0-3766-4ece-a1f1-18626d27f03a/root/var/svc/log/oxide-crucible-pantry:default.log
12312024-08-12T22:41:33.051Zuploading: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_pantry_e41eb0e0-3766-4ece-a1f1-18626d27f03a/root/var/svc/log/oxide-zone-network-setup:default.log (1717 bytes)
12322024-08-12T22:41:34.121Zuploaded: /pool/ext/ca45bffe-f952-4bbd-bcc4-be5de210718a/crypt/zone/oxz_crucible_pantry_e41eb0e0-3766-4ece-a1f1-18626d27f03a/root/var/svc/log/oxide-zone-network-setup:default.log
12332024-08-12T22:41:34.121Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_crucible_623adf4c-10ae-489c-9ee8-4a585f5237df/root/var/svc/log/oxide-crucible-agent:default.log (12076 bytes)
12342024-08-12T22:41:35.237Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_crucible_623adf4c-10ae-489c-9ee8-4a585f5237df/root/var/svc/log/oxide-crucible-agent:default.log
12352024-08-12T22:41:35.237Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_crucible_623adf4c-10ae-489c-9ee8-4a585f5237df/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12362024-08-12T22:41:36.331Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_crucible_623adf4c-10ae-489c-9ee8-4a585f5237df/root/var/svc/log/oxide-crucible-downstairs:default.log
12372024-08-12T22:41:36.331Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_crucible_623adf4c-10ae-489c-9ee8-4a585f5237df/root/var/svc/log/oxide-crucible-downstairs:downstairs-f454fda7-e104-4d3e-92bf-f7f87e47b8da.log (3126 bytes)
12382024-08-12T22:41:37.425Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_crucible_623adf4c-10ae-489c-9ee8-4a585f5237df/root/var/svc/log/oxide-crucible-downstairs:downstairs-f454fda7-e104-4d3e-92bf-f7f87e47b8da.log
12392024-08-12T22:41:37.425Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_crucible_623adf4c-10ae-489c-9ee8-4a585f5237df/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
12402024-08-12T22:41:38.518Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_crucible_623adf4c-10ae-489c-9ee8-4a585f5237df/root/var/svc/log/oxide-zone-network-setup:default.log
12412024-08-12T22:41:38.518Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/svc/log/oxide-chrony-setup:default.log (14496 bytes)
12422024-08-12T22:41:39.656Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/svc/log/oxide-chrony-setup:default.log
12432024-08-12T22:41:39.656Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/svc/log/oxide-ntp:default.log (3203 bytes)
12442024-08-12T22:41:40.750Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/svc/log/oxide-ntp:default.log
12452024-08-12T22:41:40.750Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/svc/log/oxide-opte-interface-setup:default.log (1125 bytes)
12462024-08-12T22:41:41.841Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/svc/log/oxide-opte-interface-setup:default.log
12472024-08-12T22:41:41.864Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/svc/log/oxide-zone-network-setup:default.log (1634 bytes)
12482024-08-12T22:41:42.932Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/svc/log/oxide-zone-network-setup:default.log
12492024-08-12T22:41:42.932Zuploading: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_cockroachdb_70027bfb-5a03-4f63-ae74-d647fff67eb1/root/var/svc/log/oxide-cockroach-admin:default.log (4660 bytes)
12502024-08-12T22:41:44.024Zuploaded: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_cockroachdb_70027bfb-5a03-4f63-ae74-d647fff67eb1/root/var/svc/log/oxide-cockroach-admin:default.log
12512024-08-12T22:41:44.024Zuploading: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_cockroachdb_70027bfb-5a03-4f63-ae74-d647fff67eb1/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
12522024-08-12T22:41:45.116Zuploaded: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_cockroachdb_70027bfb-5a03-4f63-ae74-d647fff67eb1/root/var/svc/log/oxide-cockroachdb:default.log
12532024-08-12T22:41:45.116Zuploading: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_cockroachdb_70027bfb-5a03-4f63-ae74-d647fff67eb1/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
12542024-08-12T22:41:46.207Zuploaded: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_cockroachdb_70027bfb-5a03-4f63-ae74-d647fff67eb1/root/var/svc/log/oxide-zone-network-setup:default.log
12552024-08-12T22:41:46.207Zuploading: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-crucible-agent:default.log (19033 bytes)
12562024-08-12T22:41:47.341Zuploaded: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-crucible-agent:default.log
12572024-08-12T22:41:47.341Zuploading: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12582024-08-12T22:41:48.433Zuploaded: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-crucible-downstairs:default.log
12592024-08-12T22:41:48.433Zuploading: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-crucible-downstairs:downstairs-1182ed90-c8d1-40b8-8dd9-3aaa61cdc27c.log (3018 bytes)
12602024-08-12T22:41:49.524Zuploaded: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-crucible-downstairs:downstairs-1182ed90-c8d1-40b8-8dd9-3aaa61cdc27c.log
12612024-08-12T22:41:49.524Zuploading: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-crucible-downstairs:downstairs-269f8f6a-425f-4288-b325-49b7bc9b2d7f.log (3126 bytes)
12622024-08-12T22:41:50.616Zuploaded: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-crucible-downstairs:downstairs-269f8f6a-425f-4288-b325-49b7bc9b2d7f.log
12632024-08-12T22:41:50.616Zuploading: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
12642024-08-12T22:41:51.708Zuploaded: /pool/ext/fab24dee-2d14-4ad6-8dd1-967cd0dd455c/crypt/zone/oxz_crucible_1014862e-7c76-4226-a04a-ec71dd6d76fe/root/var/svc/log/oxide-zone-network-setup:default.log
12652024-08-12T22:41:51.708Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/measurements.log (153988 bytes)
12662024-08-12T22:41:51.883Zupload warning: file "/pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/measurements.log" changed size mid upload: 153988 -> 188238
12672024-08-12T22:41:52.952Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/measurements.log
12682024-08-12T22:41:52.953Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/statistics.log (98163 bytes)
12692024-08-12T22:41:53.104Zupload warning: file "/pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/statistics.log" changed size mid upload: 98163 -> 120744
12702024-08-12T22:41:54.172Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/statistics.log
12712024-08-12T22:41:54.196Zuploading: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/tracking.log (16907 bytes)
12722024-08-12T22:41:54.260Zupload warning: file "/pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/tracking.log" changed size mid upload: 16907 -> 19415
12732024-08-12T22:41:55.329Zuploaded: /pool/ext/ef93b2f7-5e79-4766-bedb-2c6d5ba93538/crypt/zone/oxz_ntp_14284e27-0c4a-4f5f-a1f7-0c6a1530f265/root/var/log/chrony/tracking.log