01J1G5S21MY1P42M289FESAZA0: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.32",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01J1G5SMF135GHX4ZVMGQ5TGEW

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-06-28T20:12:45.301Zjob dependencies complete; ready to run (waiting for 32 m 31 s)
22024-06-28T20:13:27.498Zjob assigned to worker 01J1G7N7JZYN5SBMPJVKMS6KCT (queued for 42 s)
32024-06-28T20:13:27.662Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-06-28T20:13:27.712Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-06-28T20:13:27.746Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-06-28T20:13:27.780Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-06-28T20:13:27.813Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-06-28T20:13:27.847ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-06-28T20:13:27.882Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d3
102024-06-28T20:13:27.919ZOxide Helios Version helios-2.0.22714 64-bit
112024-06-28T20:13:27.958ZConfiguring devices.
122024-06-28T20:13:27.991Z##################################################
132024-06-28T20:13:28.025Z#### ############# ##
142024-06-28T20:13:28.058Z### ### ############ ##
152024-06-28T20:13:28.092Z## ### # ## ### ## Oxide Computer Company ##
162024-06-28T20:13:28.125Z## ## ## ### # ### ##
172024-06-28T20:13:28.158Z## # ### #### #### This Station Under ##
182024-06-28T20:13:28.192Z### ### #### # ### Computer Control ##
192024-06-28T20:13:28.231Z#### #### ### ## ##
202024-06-28T20:13:28.264Z##################################################
212024-06-28T20:13:28.298ZHostname: sock
222024-06-28T20:13:28.337ZLoading smf(7) service descriptions:
232024-06-28T20:13:29.365Zdownloading input: /input/package/work/package.tar.gz
242024-06-28T20:17:28.864Zdownloaded input: /input/package/work/package.tar.gz
 
252024-06-28T20:17:28.889Zstarting task 0: "setup"
262024-06-28T20:17:28.889Z++ uname -s
272024-06-28T20:17:28.889Z+ kern=SunOS
282024-06-28T20:17:28.889Z+ case "$kern" in
292024-06-28T20:17:28.889Z+ groupadd -g 12345 build
302024-06-28T20:17:28.889Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-06-28T20:17:30.882Z+ zfs create -o mountpoint=/work rpool/work
322024-06-28T20:17:30.918Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-06-28T20:17:30.942Z+ home_fs=zfs
342024-06-28T20:17:30.942Z+ [[ zfs == autofs ]]
352024-06-28T20:17:30.942Z+ mkdir -p /home/build
362024-06-28T20:17:30.942Z+ chown build:build /home/build /work
372024-06-28T20:17:32.925Z+ chmod 0700 /home/build /work
382024-06-28T20:17:32.949Zprocess exited: duration 4063 ms, exit code 0
 
392024-06-28T20:17:33.002Zstarting task 1: "authentication"
402024-06-28T20:17:33.042Zprocess exited: duration 45 ms, exit code 0
 
412024-06-28T20:17:33.092Zstarting task 2: "build"
422024-06-28T20:17:33.117Z+ trap _exit_trap EXIT
432024-06-28T20:17:33.117Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-06-28T20:17:33.211Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-06-28T20:17:33.211Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-06-28T20:17:33.236Z+ [[ -d /opt/oxide ]]
562024-06-28T20:17:33.236Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-06-28T20:17:33.236Z+ pfexec mkdir /opt/oxide
582024-06-28T20:17:33.236Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-06-28T20:17:33.236Z+ [[ -d /opt/oxide-underneath ]]
602024-06-28T20:17:33.236Z+ cd /opt/oxide-underneath
612024-06-28T20:17:33.236Z+ pfexec tar ceEp@/f - .
622024-06-28T20:17:33.236Z+ cd /opt/oxide
632024-06-28T20:17:33.236Z+ pfexec tar xveEp@/f -
642024-06-28T20:17:33.338Zx ., 0 bytes, 0 tape blocks
652024-06-28T20:17:33.338Zx ./opte, 0 bytes, 0 tape blocks
662024-06-28T20:17:33.338Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-06-28T20:17:33.338Zx ./opte/bin/opteadm, 52533872 bytes, 102606 tape blocks
682024-06-28T20:17:33.363Z+ pfexec rm -rf /opt/oxide-underneath
692024-06-28T20:17:33.363Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-06-28T20:17:33.388Z+ pfexec mkdir /opt/oxide/work
712024-06-28T20:17:33.388Z+ pfexec chown build:build /opt/oxide/work
722024-06-28T20:17:33.388Z+ cd /opt/oxide/work
732024-06-28T20:17:33.388Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-06-28T20:17:45.570ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-06-28T20:17:45.570Zx out/target/test, 75 bytes, 1 tape blocks
762024-06-28T20:17:45.570Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-06-28T20:17:45.570Zx package-manifest.toml, 28818 bytes, 57 tape blocks
782024-06-28T20:17:45.570Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-06-28T20:17:45.570Zx target/release/omicron-package, 33215608 bytes, 64875 tape blocks
802024-06-28T20:17:45.570Zx target/release/xtask, 18565288 bytes, 36261 tape blocks
812024-06-28T20:17:45.570Zx target/debug/bootstrap, 367260840 bytes, 717307 tape blocks
822024-06-28T20:17:45.570Zx tests/bootstrap-2c43dc3184ff70d6, 24557312 bytes, 47964 tape blocks
832024-06-28T20:17:45.570Zx tests/commtest-3cf8c74a3ee51610, 24557896 bytes, 47965 tape blocks
842024-06-28T20:17:45.570Zx tests/dhcp_server-58fe6f7d1c0591dd, 24557320 bytes, 47964 tape blocks
852024-06-28T20:17:45.570Zx tests/end_to_end_tests-2e61df446185b8f0, 377659424 bytes, 737617 tape blocks
862024-06-28T20:17:45.570Zx out/clickhouse.tar.gz, 228421607 bytes, 446136 tape blocks
872024-06-28T20:17:45.570Zx out/clickhouse_keeper.tar.gz, 228403770 bytes, 446102 tape blocks
882024-06-28T20:17:45.570Zx out/cockroachdb.tar.gz, 134979381 bytes, 263632 tape blocks
892024-06-28T20:17:45.570Zx out/crucible-dtrace.tar, 85504 bytes, 167 tape blocks
902024-06-28T20:17:45.570Zx out/crucible-pantry-zone.tar.gz, 27717458 bytes, 54136 tape blocks
912024-06-28T20:17:45.570Zx out/crucible-zone.tar.gz, 38237067 bytes, 74682 tape blocks
922024-06-28T20:17:45.570Zx out/external-dns.tar.gz, 25734590 bytes, 50263 tape blocks
932024-06-28T20:17:45.570Zx out/internal-dns.tar.gz, 25733030 bytes, 50260 tape blocks
942024-06-28T20:17:45.570Zx out/mg-ddm-gz.tar, 62070784 bytes, 121232 tape blocks
952024-06-28T20:17:45.570Zx out/nexus.tar.gz, 86538000 bytes, 169020 tape blocks
962024-06-28T20:17:45.570Zx out/ntp.tar.gz, 9116570 bytes, 17806 tape blocks
972024-06-28T20:17:45.570Zx out/omicron-gateway-softnpu.tar.gz, 14127119 bytes, 27593 tape blocks
982024-06-28T20:17:45.570Zx out/omicron-sled-agent.tar, 96601088 bytes, 188674 tape blocks
992024-06-28T20:17:45.570Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1002024-06-28T20:17:45.570Zx out/oximeter.tar.gz, 42478461 bytes, 82966 tape blocks
1012024-06-28T20:17:45.570Zx out/oxlog.tar, 3025408 bytes, 5909 tape blocks
1022024-06-28T20:17:45.571Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1032024-06-28T20:17:45.571Zx out/propolis-server.tar.gz, 66204525 bytes, 129306 tape blocks
1042024-06-28T20:17:45.571Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1052024-06-28T20:17:45.571Zx out/switch-softnpu.tar.gz, 200829002 bytes, 392245 tape blocks
1062024-06-28T20:17:45.595Z
1072024-06-28T20:17:45.595Zreal 12.172472744
1082024-06-28T20:17:45.595Zuser 10.856325563
1092024-06-28T20:17:45.596Zsys 2.315075399
1102024-06-28T20:17:45.596Ztrap 0.000389960
1112024-06-28T20:17:45.596Ztflt 0.000000000
1122024-06-28T20:17:45.596Zdflt 0.000000000
1132024-06-28T20:17:45.596Zkflt 0.000000000
1142024-06-28T20:17:45.596Zlock 0.000000000
1152024-06-28T20:17:45.596Zslp 10.870022470
1162024-06-28T20:17:45.596Zlat 0.300879529
1172024-06-28T20:17:45.596Zstop 0.000125610
1182024-06-28T20:17:45.596Z+ bmat address ls
1192024-06-28T20:17:45.596ZNAME CIDR FIRST LAST COUNT
1202024-06-28T20:17:45.596Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1212024-06-28T20:17:45.596Z++ bmat address ls -f extra -Ho first,last,count
1222024-06-28T20:17:45.596Z+ set -- 10.151.2.164 10.151.2.227 64
1232024-06-28T20:17:45.596Z+ EXTRA_IP_START=10.151.2.164
1242024-06-28T20:17:45.596Z+ EXTRA_IP_END=10.151.2.227
1252024-06-28T20:17:45.596Z+ EXTRA_IP_COUNT=64
1262024-06-28T20:17:45.596Z+ (( EXTRA_IP_COUNT >= 32 ))
1272024-06-28T20:17:45.596Z+ EXTRA_IP_BASE=10.151.2
1282024-06-28T20:17:45.596Z+ EXTRA_IP_FOCTET=164
1292024-06-28T20:17:45.596Z+ EXTRA_IP_LOCTET=227
1302024-06-28T20:17:45.596Z+ SERVICE_IP_POOL_START=10.151.2.164
1312024-06-28T20:17:45.596Z+ SERVICE_IP_POOL_END=10.151.2.173
1322024-06-28T20:17:45.596Z+ DNS_IP1=10.151.2.164
1332024-06-28T20:17:45.596Z+ DNS_IP2=10.151.2.165
1342024-06-28T20:17:45.596Z+ UPLINK_IP=10.151.2.174
1352024-06-28T20:17:45.596Z+ IPPOOL_START=10.151.2.175
1362024-06-28T20:17:45.596Z+ IPPOOL_END=10.151.2.227
1372024-06-28T20:17:45.596Z++ ipadm show-addr -po type,addr
1382024-06-28T20:17:45.596Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1392024-06-28T20:17:45.596Z+ GATEWAY_IP=10.151.2.100
1402024-06-28T20:17:45.596Z+ [[ -n 10.151.2.100 ]]
1412024-06-28T20:17:45.596Z+ ping -s 10.151.2.100 56 1
1422024-06-28T20:17:45.596ZPING 10.151.2.100: 56 data bytes
1432024-06-28T20:17:45.596Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.012 ms
1442024-06-28T20:17:45.596Z
1452024-06-28T20:17:45.596Z----10.151.2.100 PING Statistics----
1462024-06-28T20:17:45.597Z1 packets transmitted, 1 packets received, 0% packet loss
1472024-06-28T20:17:45.597Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
1482024-06-28T20:17:45.597Z++ arp -an
1492024-06-28T20:17:45.597Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1502024-06-28T20:17:45.597Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1512024-06-28T20:17:45.597Z+ routeadm -e ipv4-forwarding -u
1522024-06-28T20:17:45.705Z+ PXA_START=10.151.2.164
1532024-06-28T20:17:45.705Z+ PXA_END=10.151.2.227
1542024-06-28T20:17:45.730Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1552024-06-28T20:17:45.829Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227
1562024-06-28T20:17:45.854ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1572024-06-28T20:17:45.914Zcreating virtual hardware
1582024-06-28T20:17:45.939Zcreating /scratch/m2_0.vdev
1592024-06-28T20:17:45.939Zcreating /scratch/m2_1.vdev
1602024-06-28T20:17:45.939Zcreating /scratch/u2_0.vdev
1612024-06-28T20:17:45.939Zcreating /scratch/u2_1.vdev
1622024-06-28T20:17:45.939Zcreating /scratch/u2_2.vdev
1632024-06-28T20:17:45.939Zcreating /scratch/u2_3.vdev
1642024-06-28T20:17:45.939Zcreating /scratch/u2_4.vdev
1652024-06-28T20:17:45.939Zcreating /scratch/u2_5.vdev
1662024-06-28T20:17:45.939Zcreating /scratch/u2_6.vdev
1672024-06-28T20:17:45.939Zcreating /scratch/u2_7.vdev
1682024-06-28T20:17:45.939Zcreating /scratch/u2_8.vdev
1692024-06-28T20:17:45.970ZSimnet net0/sc0_0 exists
1702024-06-28T20:17:45.998ZSimnet net1/sc1_0 exists
1712024-06-28T20:17:46.022ZVnic sc0_1 exists
1722024-06-28T20:17:58.427ZUsing 10.151.2.100 as gateway ip
1732024-06-28T20:17:58.427Zusing 18:C0:4D:0D:A0:2A as gateway mac
1742024-06-28T20:17:58.427Zconfiguring SoftNPU ARP entry
1752024-06-28T20:17:58.457Zconfiguring SoftNPU proxy ARP
1762024-06-28T20:17:58.515ZSoftNPU state:
1772024-06-28T20:17:58.515Z local v6:
1782024-06-28T20:17:58.515Z local v4:
1792024-06-28T20:17:58.515Z router v6:
1802024-06-28T20:17:58.515Z router v4_idx:
1812024-06-28T20:17:58.515Z router v4_routes:
1822024-06-28T20:17:58.515Z resolver v4:
1832024-06-28T20:17:58.515Z 10.151.2.100 -> 18:c0:4d:0d:a0:2a
1842024-06-28T20:17:58.515Z resolver v6:
1852024-06-28T20:17:58.515Z nat v4:
1862024-06-28T20:17:58.515Z nat_v6:
1872024-06-28T20:17:58.515Z port_mac:
1882024-06-28T20:17:58.515Z proxy arp:
1892024-06-28T20:17:58.515Z 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
1902024-06-28T20:17:58.516Zcreated virtual hardware
1912024-06-28T20:17:58.540Z
1922024-06-28T20:17:58.540Zreal 12.684232711
1932024-06-28T20:17:58.540Zuser 0.646119703
1942024-06-28T20:17:58.540Zsys 3.152713826
1952024-06-28T20:17:58.540Ztrap 0.000041456
1962024-06-28T20:17:58.540Ztflt 0.000166181
1972024-06-28T20:17:58.540Zdflt 0.000502109
1982024-06-28T20:17:58.540Zkflt 0.000000000
1992024-06-28T20:17:58.540Zlock 19:41.566763031
2002024-06-28T20:17:58.540Zslp 50.965547005
2012024-06-28T20:17:58.540Zlat 0.082443153
2022024-06-28T20:17:58.540Zstop 1.096474761
2032024-06-28T20:17:58.540Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2042024-06-28T20:17:58.588Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2052024-06-28T20:17:58.588Z+ diff -u pkg/config.toml~ pkg/config.toml
2062024-06-28T20:17:58.588Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2072024-06-28T20:17:58.588Z+++ pkg/config.toml Fri Jun 28 20:17:58 2024
2082024-06-28T20:17:58.588Z@@ -29,18 +29,18 @@
2092024-06-28T20:17:58.588Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2102024-06-28T20:17:58.588Z # followed by a string that is embedded into their fake serial values.
2112024-06-28T20:17:58.588Z vdevs = [
2122024-06-28T20:17:58.588Z- "m2_0.vdev",
2132024-06-28T20:17:58.588Z- "m2_1.vdev",
2142024-06-28T20:17:58.588Z+ "/scratch/m2_0.vdev",
2152024-06-28T20:17:58.588Z+ "/scratch/m2_1.vdev",
2162024-06-28T20:17:58.588Z
2172024-06-28T20:17:58.588Z- "u2_0.vdev",
2182024-06-28T20:17:58.588Z- "u2_1.vdev",
2192024-06-28T20:17:58.588Z- "u2_2.vdev",
2202024-06-28T20:17:58.588Z- "u2_3.vdev",
2212024-06-28T20:17:58.588Z- "u2_4.vdev",
2222024-06-28T20:17:58.588Z- "u2_5.vdev",
2232024-06-28T20:17:58.588Z- "u2_6.vdev",
2242024-06-28T20:17:58.588Z- "u2_7.vdev",
2252024-06-28T20:17:58.588Z- "u2_8.vdev",
2262024-06-28T20:17:58.588Z+ "/scratch/u2_0.vdev",
2272024-06-28T20:17:58.588Z+ "/scratch/u2_1.vdev",
2282024-06-28T20:17:58.588Z+ "/scratch/u2_2.vdev",
2292024-06-28T20:17:58.588Z+ "/scratch/u2_3.vdev",
2302024-06-28T20:17:58.588Z+ "/scratch/u2_4.vdev",
2312024-06-28T20:17:58.588Z+ "/scratch/u2_5.vdev",
2322024-06-28T20:17:58.588Z+ "/scratch/u2_6.vdev",
2332024-06-28T20:17:58.588Z+ "/scratch/u2_7.vdev",
2342024-06-28T20:17:58.588Z+ "/scratch/u2_8.vdev",
2352024-06-28T20:17:58.588Z ]
2362024-06-28T20:17:58.588Z
2372024-06-28T20:17:58.588Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2382024-06-28T20:17:58.588Z+ true
2392024-06-28T20:17:58.589Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2402024-06-28T20:17:58.589Z+ SILO_NAME=recovery
2412024-06-28T20:17:58.589Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2422024-06-28T20:17:58.589Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2432024-06-28T20:17:58.589Z+ sed -i~ '
2442024-06-28T20:17:58.589Z /^external_dns_ips/c\
2452024-06-28T20:17:58.589Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2462024-06-28T20:17:58.589Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2472024-06-28T20:17:58.589Z /^first/c\
2482024-06-28T20:17:58.589Zfirst = "10.151.2.164"
2492024-06-28T20:17:58.589Z /^last/c\
2502024-06-28T20:17:58.589Zlast = "10.151.2.173"
2512024-06-28T20:17:58.589Z }
2522024-06-28T20:17:58.589Z /^infra_ip_first/c\
2532024-06-28T20:17:58.589Zinfra_ip_first = "10.151.2.174"
2542024-06-28T20:17:58.589Z /^infra_ip_last/c\
2552024-06-28T20:17:58.589Zinfra_ip_last = "10.151.2.174"
2562024-06-28T20:17:58.589Z /^\[\[rack_network_config.ports/,/^$/ {
2572024-06-28T20:17:58.589Z /^routes/c\
2582024-06-28T20:17:58.589Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
2592024-06-28T20:17:58.589Z /^addresses/c\
2602024-06-28T20:17:58.589Zaddresses = \[{address = "10.151.2.174/24"} \]
2612024-06-28T20:17:58.589Z }
2622024-06-28T20:17:58.589Z' pkg/config-rss.toml
2632024-06-28T20:17:58.589Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2642024-06-28T20:17:58.589Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2652024-06-28T20:17:58.589Z+++ pkg/config-rss.toml Fri Jun 28 20:17:58 2024
2662024-06-28T20:17:58.589Z@@ -33,7 +33,7 @@
2672024-06-28T20:17:58.589Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2682024-06-28T20:17:58.589Z # must be contained in one of the "internal services" IP Pool ranges listed
2692024-06-28T20:17:58.589Z # below.
2702024-06-28T20:17:58.589Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2712024-06-28T20:17:58.589Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2722024-06-28T20:17:58.589Z
2732024-06-28T20:17:58.589Z # Initial TLS certificates for the external API
2742024-06-28T20:17:58.589Z #
2752024-06-28T20:17:58.589Z@@ -69,8 +69,8 @@
2762024-06-28T20:17:58.589Z #
2772024-06-28T20:17:58.590Z # For more on this and what to put here, see docs/how-to-run.adoc.
2782024-06-28T20:17:58.590Z [[internal_services_ip_pool_ranges]]
2792024-06-28T20:17:58.590Z-first = "192.168.1.20"
2802024-06-28T20:17:58.590Z-last = "192.168.1.29"
2812024-06-28T20:17:58.590Z+first = "10.151.2.164"
2822024-06-28T20:17:58.590Z+last = "10.151.2.173"
2832024-06-28T20:17:58.590Z
2842024-06-28T20:17:58.590Z # TODO - this configuration is subject to change going forward. Ultimately these
2852024-06-28T20:17:58.590Z # parameters should be provided to the control plane via wicket, but we need to
2862024-06-28T20:17:58.590Z@@ -91,8 +91,8 @@
2872024-06-28T20:17:58.590Z # A range of IP addresses used by Boundary Services on the external network. In
2882024-06-28T20:17:58.590Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2892024-06-28T20:17:58.590Z # With softnpu, only one address is used.
2902024-06-28T20:17:58.590Z-infra_ip_first = "192.168.1.30"
2912024-06-28T20:17:58.590Z-infra_ip_last = "192.168.1.30"
2922024-06-28T20:17:58.590Z+infra_ip_first = "10.151.2.174"
2932024-06-28T20:17:58.590Z+infra_ip_last = "10.151.2.174"
2942024-06-28T20:17:58.590Z
2952024-06-28T20:17:58.590Z # Configurations for BGP routers to run on the scrimlets.
2962024-06-28T20:17:58.590Z bgp = []
2972024-06-28T20:17:58.590Z@@ -100,9 +100,9 @@
2982024-06-28T20:17:58.590Z # You can configure multiple uplinks by repeating the following stanza
2992024-06-28T20:17:58.590Z [[rack_network_config.ports]]
3002024-06-28T20:17:58.590Z # Routes associated with this port.
3012024-06-28T20:17:58.590Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3022024-06-28T20:17:58.590Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
3032024-06-28T20:17:58.590Z # Addresses associated with this port.
3042024-06-28T20:17:58.615Z-addresses = [{address = "192.168.1.30/24"}]
3052024-06-28T20:17:58.615Z+addresses = [{address = "10.151.2.174/24"} ]
3062024-06-28T20:17:58.615Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3072024-06-28T20:17:58.615Z port = "qsfp0"
3082024-06-28T20:17:58.615Z # The speed of this port.
3092024-06-28T20:17:58.615Z+ true
3102024-06-28T20:17:58.615Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3112024-06-28T20:17:58.615Za pkg/config-rss.toml 7K
3122024-06-28T20:17:58.615Za pkg/config.toml 4K
3132024-06-28T20:17:58.615Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3142024-06-28T20:17:58.615Z+ TLS_NAME=recovery.sys.oxide.test
3152024-06-28T20:17:58.615Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3162024-06-28T20:17:58.735Z..+.+..+......................+.....+.+..+....+.....+...+.......+........+.+.................+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+....+.....+.+...+...........+....+.....+...............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+.....+...+...+......................+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-06-28T20:17:58.995Z..+...+.........+..+.+...+...........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..........+..+......+.+......+...+..+....+...+..+......+....+..............+......+......+.......+.....+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+........+...............+............+....+.....+......+....+...+...+........+......+...+.+.....+.+......+..+.......+...............+......+...+.........+..+..................+.+......+......+...............+..+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3182024-06-28T20:17:59.019Z-----
3192024-06-28T20:17:59.019Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3202024-06-28T20:17:59.044Za pkg/initial-tls-cert.pem 2K
3212024-06-28T20:17:59.044Za pkg/initial-tls-key.pem 4K
3222024-06-28T20:17:59.044Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3232024-06-28T20:17:59.044Z+ rmdir pkg
3242024-06-28T20:17:59.044Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3252024-06-28T20:17:59.044Z+ pfexec mkdir -p /usr/oxide
3262024-06-28T20:17:59.044Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3272024-06-28T20:17:59.936Z+ pfexec chmod +x /usr/oxide/oxide
3282024-06-28T20:17:59.936Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3292024-06-28T20:18:18.133Z+ OMICRON_NO_UNINSTALL=1
3302024-06-28T20:18:18.133Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3312024-06-28T20:18:18.158ZLogging to: /opt/oxide/work/out/LOG
3322024-06-28T20:18:18.712Z
3332024-06-28T20:18:18.737Zreal 0.574439152
3342024-06-28T20:18:18.737Zuser 0.118273021
3352024-06-28T20:18:18.737Zsys 2.677222620
3362024-06-28T20:18:18.737Ztrap 0.000000389
3372024-06-28T20:18:18.737Ztflt 0.000041799
3382024-06-28T20:18:18.737Zdflt 0.001100363
3392024-06-28T20:18:18.737Zkflt 0.000000000
3402024-06-28T20:18:18.737Zlock 51.923702224
3412024-06-28T20:18:18.737Zslp 0.793383837
3422024-06-28T20:18:18.737Zlat 0.003490839
3432024-06-28T20:18:18.737Zstop 0.214692119
3442024-06-28T20:18:18.737Z+ retry=0
3452024-06-28T20:18:18.737Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3462024-06-28T20:18:18.737Z+ [[ 0 -gt 30 ]]
3472024-06-28T20:18:18.737Z+ sleep 1
3482024-06-28T20:18:19.727Z+ retry=1
3492024-06-28T20:18:19.727Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3502024-06-28T20:18:19.752Z+ [[ 1 -gt 30 ]]
3512024-06-28T20:18:19.752Z+ sleep 1
3522024-06-28T20:18:20.742Z+ retry=2
3532024-06-28T20:18:20.742Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3542024-06-28T20:18:20.766Z+ [[ 2 -gt 30 ]]
3552024-06-28T20:18:20.767Z+ sleep 1
3562024-06-28T20:18:21.757Z+ retry=3
3572024-06-28T20:18:21.757Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3582024-06-28T20:18:46.929Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3592024-06-28T20:18:46.954Zlocal v6:
3602024-06-28T20:18:46.954Zfd1f:c362:526f:ed8e::1
3612024-06-28T20:18:46.955Zfe80::5868:7dff:fe5a:3bae
3622024-06-28T20:18:46.955Zlocal v4:
3632024-06-28T20:18:46.955Z10.151.2.174
3642024-06-28T20:18:46.955Zrouter v6:
3652024-06-28T20:18:46.955Zfd00:1122:3344:3::/64 -> fe80::b474:ceff:fef8:fc6e (1)
3662024-06-28T20:18:46.955Zfd00:1122:3344:1::/64 -> fe80::b474:ceff:fef8:fc6e (1)
3672024-06-28T20:18:46.955Zfd00:1122:3344:2::/64 -> fe80::b474:ceff:fef8:fc6e (1)
3682024-06-28T20:18:46.955Zfdb0:18c0:4d0d:a02a::/64 -> fe80::b474:ceff:fef8:fc6e (1)
3692024-06-28T20:18:46.955Zfd00:1122:3344:101::/64 -> fe80::b474:ceff:fef8:fc6e (1)
3702024-06-28T20:18:46.955Zrouter v4_idx:
3712024-06-28T20:18:46.955Z0.0.0.0/0 -> 0
3722024-06-28T20:18:46.955Zrouter v4_routes:
3732024-06-28T20:18:46.955Z0 -> 10.151.2.100 (2)
3742024-06-28T20:18:46.955Zresolver v4:
3752024-06-28T20:18:46.955Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
3762024-06-28T20:18:46.955Z10.151.2.174 -> 36:77:8c:6a:d1:b2
3772024-06-28T20:18:46.955Zresolver v6:
3782024-06-28T20:18:46.955Zfe80::5868:7dff:fe5a:3bae -> 5a:68:7d:5a:3b:ae
3792024-06-28T20:18:46.955Zfe80::b474:ceff:fef8:fc6e -> b6:74:ce:f8:fc:6e
3802024-06-28T20:18:46.955Znat v4:
3812024-06-28T20:18:46.955Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:f0:7e
3822024-06-28T20:18:46.955Znat_v6:
3832024-06-28T20:18:46.955Zport_mac:
3842024-06-28T20:18:46.955Z2: a8:40:25:43:03:db
3852024-06-28T20:18:46.955Z1000: a8:40:25:43:03:ba
3862024-06-28T20:18:46.955Z1: a8:40:25:43:03:bb
3872024-06-28T20:18:46.955Zproxy arp:
3882024-06-28T20:18:46.955Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
3892024-06-28T20:18:46.983Z+ retry=0
3902024-06-28T20:18:46.983Z+++ zoneadm list -n
3912024-06-28T20:18:46.983Z+++ grep oxz_ntp
3922024-06-28T20:18:46.983Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
3932024-06-28T20:18:46.983Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
3942024-06-28T20:18:46.983Z++ true
3952024-06-28T20:18:46.983Z+ [[ '' != online ]]
3962024-06-28T20:18:46.983Z+ [[ 0 -gt 60 ]]
3972024-06-28T20:18:46.983Z+ sleep 1
3982024-06-28T20:18:47.983Z+ retry=1
3992024-06-28T20:18:48.008Z+++ zoneadm list -n
4002024-06-28T20:18:48.008Z+++ grep oxz_ntp
4012024-06-28T20:18:48.008Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4022024-06-28T20:18:48.008Z+ [[ offline != online ]]
4032024-06-28T20:18:48.008Z+ [[ 1 -gt 60 ]]
4042024-06-28T20:18:48.008Z+ sleep 1
4052024-06-28T20:18:49.006Z+ retry=2
4062024-06-28T20:18:49.031Z+++ zoneadm list -n
4072024-06-28T20:18:49.031Z+++ grep oxz_ntp
4082024-06-28T20:18:49.031Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4092024-06-28T20:18:49.031Z+ [[ offline != online ]]
4102024-06-28T20:18:49.031Z+ [[ 2 -gt 60 ]]
4112024-06-28T20:18:49.031Z+ sleep 1
4122024-06-28T20:18:50.029Z+ retry=3
4132024-06-28T20:18:50.054Z+++ zoneadm list -n
4142024-06-28T20:18:50.054Z+++ grep oxz_ntp
4152024-06-28T20:18:50.054Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4162024-06-28T20:18:50.054Z+ [[ offline != online ]]
4172024-06-28T20:18:50.054Z+ [[ 3 -gt 60 ]]
4182024-06-28T20:18:50.054Z+ sleep 1
4192024-06-28T20:18:51.052Z+ retry=4
4202024-06-28T20:18:51.077Z+++ zoneadm list -n
4212024-06-28T20:18:51.077Z+++ grep oxz_ntp
4222024-06-28T20:18:51.077Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4232024-06-28T20:18:51.077Z+ [[ offline != online ]]
4242024-06-28T20:18:51.077Z+ [[ 4 -gt 60 ]]
4252024-06-28T20:18:51.077Z+ sleep 1
4262024-06-28T20:18:52.074Z+ retry=5
4272024-06-28T20:18:52.099Z+++ zoneadm list -n
4282024-06-28T20:18:52.099Z+++ grep oxz_ntp
4292024-06-28T20:18:52.099Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4302024-06-28T20:18:52.099Z+ [[ offline != online ]]
4312024-06-28T20:18:52.099Z+ [[ 5 -gt 60 ]]
4322024-06-28T20:18:52.099Z+ sleep 1
4332024-06-28T20:18:53.097Z+ retry=6
4342024-06-28T20:18:53.121Z+++ zoneadm list -n
4352024-06-28T20:18:53.121Z+++ grep oxz_ntp
4362024-06-28T20:18:53.121Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4372024-06-28T20:18:53.121Z+ [[ offline != online ]]
4382024-06-28T20:18:53.121Z+ [[ 6 -gt 60 ]]
4392024-06-28T20:18:53.121Z+ sleep 1
4402024-06-28T20:18:54.119Z+ retry=7
4412024-06-28T20:18:54.143Z+++ zoneadm list -n
4422024-06-28T20:18:54.143Z+++ grep oxz_ntp
4432024-06-28T20:18:54.143Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4442024-06-28T20:18:54.143Z+ [[ offline != online ]]
4452024-06-28T20:18:54.144Z+ [[ 7 -gt 60 ]]
4462024-06-28T20:18:54.144Z+ sleep 1
4472024-06-28T20:18:55.140Z+ retry=8
4482024-06-28T20:18:55.165Z+++ zoneadm list -n
4492024-06-28T20:18:55.165Z+++ grep oxz_ntp
4502024-06-28T20:18:55.165Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4512024-06-28T20:18:55.165Z+ [[ offline != online ]]
4522024-06-28T20:18:55.165Z+ [[ 8 -gt 60 ]]
4532024-06-28T20:18:55.165Z+ sleep 1
 
4542024-06-28T20:18:55.341Zsock console login: Jun 28 20:18:54 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
4552024-06-28T20:18:56.162Z+ retry=9
4562024-06-28T20:18:56.186Z+++ zoneadm list -n
4572024-06-28T20:18:56.186Z+++ grep oxz_ntp
4582024-06-28T20:18:56.186Z++ pfexec svcs -z oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 -Hostate oxide/ntp
4592024-06-28T20:18:56.186Z+ [[ online != online ]]
4602024-06-28T20:18:56.186Z+ echo 'Waited for chrony: 9s'
4612024-06-28T20:18:56.186Z+ retry=0
4622024-06-28T20:18:56.186ZWaited for chrony: 9s
4632024-06-28T20:18:56.186Z+ zoneadm list
4642024-06-28T20:18:56.186Z+ grep nexus
4652024-06-28T20:18:56.211Z+ [[ 0 -gt 300 ]]
4662024-06-28T20:18:56.211Z+ sleep 1
4672024-06-28T20:18:57.191Z+ retry=1
4682024-06-28T20:18:57.215Z+ zoneadm list
4692024-06-28T20:18:57.216Z+ grep nexus
4702024-06-28T20:18:57.216Z+ [[ 1 -gt 300 ]]
4712024-06-28T20:18:57.216Z+ sleep 1
4722024-06-28T20:18:58.201Z+ retry=2
4732024-06-28T20:18:58.225Z+ zoneadm list
4742024-06-28T20:18:58.225Z+ grep nexus
4752024-06-28T20:18:58.225Z+ [[ 2 -gt 300 ]]
4762024-06-28T20:18:58.225Z+ sleep 1
4772024-06-28T20:18:59.212Z+ retry=3
4782024-06-28T20:18:59.237Z+ zoneadm list
4792024-06-28T20:18:59.237Z+ grep nexus
4802024-06-28T20:18:59.237Z+ [[ 3 -gt 300 ]]
4812024-06-28T20:18:59.237Z+ sleep 1
4822024-06-28T20:19:00.222Z+ retry=4
4832024-06-28T20:19:00.247Z+ zoneadm list
4842024-06-28T20:19:00.247Z+ grep nexus
4852024-06-28T20:19:00.247Z+ [[ 4 -gt 300 ]]
4862024-06-28T20:19:00.247Z+ sleep 1
4872024-06-28T20:19:01.234Z+ retry=5
4882024-06-28T20:19:01.258Z+ zoneadm list
4892024-06-28T20:19:01.258Z+ grep nexus
4902024-06-28T20:19:01.259Z+ [[ 5 -gt 300 ]]
4912024-06-28T20:19:01.259Z+ sleep 1
4922024-06-28T20:19:02.247Z+ retry=6
4932024-06-28T20:19:02.272Z+ zoneadm list
4942024-06-28T20:19:02.272Z+ grep nexus
4952024-06-28T20:19:02.272Z+ [[ 6 -gt 300 ]]
4962024-06-28T20:19:02.272Z+ sleep 1
4972024-06-28T20:19:03.256Z+ retry=7
4982024-06-28T20:19:03.281Z+ zoneadm list
4992024-06-28T20:19:03.281Z+ grep nexus
5002024-06-28T20:19:03.281Z+ [[ 7 -gt 300 ]]
5012024-06-28T20:19:03.281Z+ sleep 1
5022024-06-28T20:19:04.267Z+ retry=8
5032024-06-28T20:19:04.292Z+ zoneadm list
5042024-06-28T20:19:04.292Z+ grep nexus
5052024-06-28T20:19:04.292Z+ [[ 8 -gt 300 ]]
5062024-06-28T20:19:04.292Z+ sleep 1
5072024-06-28T20:19:05.278Z+ retry=9
5082024-06-28T20:19:05.302Z+ zoneadm list
5092024-06-28T20:19:05.302Z+ grep nexus
5102024-06-28T20:19:05.302Z+ [[ 9 -gt 300 ]]
5112024-06-28T20:19:05.302Z+ sleep 1
5122024-06-28T20:19:06.288Z+ retry=10
5132024-06-28T20:19:06.313Z+ zoneadm list
5142024-06-28T20:19:06.313Z+ grep nexus
5152024-06-28T20:19:06.313Z+ [[ 10 -gt 300 ]]
5162024-06-28T20:19:06.313Z+ sleep 1
5172024-06-28T20:19:07.303Z+ retry=11
5182024-06-28T20:19:07.327Z+ zoneadm list
5192024-06-28T20:19:07.327Z+ grep nexus
5202024-06-28T20:19:07.328Z+ [[ 11 -gt 300 ]]
5212024-06-28T20:19:07.328Z+ sleep 1
5222024-06-28T20:19:08.314Z+ retry=12
5232024-06-28T20:19:08.338Z+ zoneadm list
5242024-06-28T20:19:08.338Z+ grep nexus
5252024-06-28T20:19:08.338Z+ [[ 12 -gt 300 ]]
5262024-06-28T20:19:08.338Z+ sleep 1
5272024-06-28T20:19:09.329Z+ retry=13
5282024-06-28T20:19:09.447Z+ zoneadm list
5292024-06-28T20:19:09.484Z+ grep nexus
5302024-06-28T20:19:09.570Z+ [[ 13 -gt 300 ]]
5312024-06-28T20:19:09.570Z+ sleep 1
5322024-06-28T20:19:10.593Z+ retry=14
5332024-06-28T20:19:10.634Z+ zoneadm list
5342024-06-28T20:19:10.634Z+ grep nexus
5352024-06-28T20:19:10.677Z+ [[ 14 -gt 300 ]]
5362024-06-28T20:19:10.677Z+ sleep 1
5372024-06-28T20:19:11.697Z+ retry=15
5382024-06-28T20:19:11.722Z+ zoneadm list
5392024-06-28T20:19:11.722Z+ grep nexus
5402024-06-28T20:19:11.722Z+ [[ 15 -gt 300 ]]
5412024-06-28T20:19:11.722Z+ sleep 1
5422024-06-28T20:19:12.714Z+ retry=16
5432024-06-28T20:19:12.739Z+ zoneadm list
5442024-06-28T20:19:12.739Z+ grep nexus
5452024-06-28T20:19:12.739Z+ [[ 16 -gt 300 ]]
5462024-06-28T20:19:12.739Z+ sleep 1
5472024-06-28T20:19:13.726Z+ retry=17
5482024-06-28T20:19:13.751Z+ zoneadm list
5492024-06-28T20:19:13.751Z+ grep nexus
5502024-06-28T20:19:13.751Z+ [[ 17 -gt 300 ]]
5512024-06-28T20:19:13.751Z+ sleep 1
5522024-06-28T20:19:14.738Z+ retry=18
5532024-06-28T20:19:14.763Z+ zoneadm list
5542024-06-28T20:19:14.763Z+ grep nexus
5552024-06-28T20:19:14.763Z+ [[ 18 -gt 300 ]]
5562024-06-28T20:19:14.763Z+ sleep 1
5572024-06-28T20:19:15.755Z+ retry=19
5582024-06-28T20:19:15.780Z+ zoneadm list
5592024-06-28T20:19:15.780Z+ grep nexus
5602024-06-28T20:19:15.780Z+ [[ 19 -gt 300 ]]
5612024-06-28T20:19:15.780Z+ sleep 1
5622024-06-28T20:19:16.772Z+ retry=20
5632024-06-28T20:19:16.797Z+ zoneadm list
5642024-06-28T20:19:16.797Z+ grep nexus
5652024-06-28T20:19:16.797Z+ [[ 20 -gt 300 ]]
5662024-06-28T20:19:16.797Z+ sleep 1
5672024-06-28T20:19:17.779Z+ retry=21
5682024-06-28T20:19:17.803Z+ zoneadm list
5692024-06-28T20:19:17.803Z+ grep nexus
5702024-06-28T20:19:17.803Z+ [[ 21 -gt 300 ]]
5712024-06-28T20:19:17.803Z+ sleep 1
5722024-06-28T20:19:18.791Z+ retry=22
5732024-06-28T20:19:18.816Z+ zoneadm list
5742024-06-28T20:19:18.816Z+ grep nexus
5752024-06-28T20:19:18.816Z+ [[ 22 -gt 300 ]]
5762024-06-28T20:19:18.816Z+ sleep 1
5772024-06-28T20:19:19.802Z+ retry=23
5782024-06-28T20:19:19.827Z+ zoneadm list
5792024-06-28T20:19:19.827Z+ grep nexus
5802024-06-28T20:19:19.827Z+ [[ 23 -gt 300 ]]
5812024-06-28T20:19:19.827Z+ sleep 1
5822024-06-28T20:19:20.820Z+ retry=24
5832024-06-28T20:19:20.845Z+ zoneadm list
5842024-06-28T20:19:20.845Z+ grep nexus
5852024-06-28T20:19:20.845Z+ [[ 24 -gt 300 ]]
5862024-06-28T20:19:20.845Z+ sleep 1
5872024-06-28T20:19:21.834Z+ retry=25
5882024-06-28T20:19:21.859Z+ zoneadm list
5892024-06-28T20:19:21.859Z+ grep nexus
5902024-06-28T20:19:21.859Z+ [[ 25 -gt 300 ]]
5912024-06-28T20:19:21.859Z+ sleep 1
5922024-06-28T20:19:22.850Z+ retry=26
5932024-06-28T20:19:22.875Z+ zoneadm list
5942024-06-28T20:19:22.875Z+ grep nexus
5952024-06-28T20:19:22.875Z+ [[ 26 -gt 300 ]]
5962024-06-28T20:19:22.875Z+ sleep 1
5972024-06-28T20:19:23.866Z+ retry=27
5982024-06-28T20:19:23.891Z+ zoneadm list
5992024-06-28T20:19:23.891Z+ grep nexus
6002024-06-28T20:19:23.891Z+ [[ 27 -gt 300 ]]
6012024-06-28T20:19:23.891Z+ sleep 1
6022024-06-28T20:19:24.877Z+ retry=28
6032024-06-28T20:19:24.902Z+ zoneadm list
6042024-06-28T20:19:24.902Z+ grep nexus
6052024-06-28T20:19:24.902Z+ [[ 28 -gt 300 ]]
6062024-06-28T20:19:24.903Z+ sleep 1
6072024-06-28T20:19:25.890Z+ retry=29
6082024-06-28T20:19:25.917Z+ zoneadm list
6092024-06-28T20:19:25.917Z+ grep nexus
6102024-06-28T20:19:25.917Z+ [[ 29 -gt 300 ]]
6112024-06-28T20:19:25.917Z+ sleep 1
6122024-06-28T20:19:26.901Z+ retry=30
6132024-06-28T20:19:26.926Z+ zoneadm list
6142024-06-28T20:19:26.926Z+ grep nexus
6152024-06-28T20:19:26.926Z+ [[ 30 -gt 300 ]]
6162024-06-28T20:19:26.926Z+ sleep 1
6172024-06-28T20:19:27.913Z+ retry=31
6182024-06-28T20:19:27.938Z+ zoneadm list
6192024-06-28T20:19:27.938Z+ grep nexus
6202024-06-28T20:19:27.938Z+ [[ 31 -gt 300 ]]
6212024-06-28T20:19:27.938Z+ sleep 1
6222024-06-28T20:19:28.924Z+ retry=32
6232024-06-28T20:19:28.949Z+ zoneadm list
6242024-06-28T20:19:28.949Z+ grep nexus
6252024-06-28T20:19:28.949Z+ [[ 32 -gt 300 ]]
6262024-06-28T20:19:28.949Z+ sleep 1
6272024-06-28T20:19:29.936Z+ retry=33
6282024-06-28T20:19:29.961Z+ zoneadm list
6292024-06-28T20:19:29.961Z+ grep nexus
6302024-06-28T20:19:29.961Z+ [[ 33 -gt 300 ]]
6312024-06-28T20:19:29.961Z+ sleep 1
6322024-06-28T20:19:30.954Z+ retry=34
6332024-06-28T20:19:30.981Z+ zoneadm list
6342024-06-28T20:19:30.981Z+ grep nexus
6352024-06-28T20:19:30.981Z+ [[ 34 -gt 300 ]]
6362024-06-28T20:19:30.981Z+ sleep 1
6372024-06-28T20:19:33.884Z+ retry=35
6382024-06-28T20:19:33.922Z+ zoneadm list
6392024-06-28T20:19:33.947Z+ grep nexus
6402024-06-28T20:19:33.981Z+ [[ 35 -gt 300 ]]
6412024-06-28T20:19:34.011Z+ sleep 1
6422024-06-28T20:19:34.995Z+ retry=36
6432024-06-28T20:19:35.019Z+ zoneadm list
6442024-06-28T20:19:35.020Z+ grep nexus
6452024-06-28T20:19:35.020Z+ [[ 36 -gt 300 ]]
6462024-06-28T20:19:35.020Z+ sleep 1
6472024-06-28T20:19:36.013Z+ retry=37
6482024-06-28T20:19:36.038Z+ zoneadm list
6492024-06-28T20:19:36.038Z+ grep nexus
6502024-06-28T20:19:36.038Z+ [[ 37 -gt 300 ]]
6512024-06-28T20:19:36.038Z+ sleep 1
6522024-06-28T20:19:37.033Z+ retry=38
6532024-06-28T20:19:37.058Z+ zoneadm list
6542024-06-28T20:19:37.059Z+ grep nexus
6552024-06-28T20:19:37.059Z+ [[ 38 -gt 300 ]]
6562024-06-28T20:19:37.059Z+ sleep 1
6572024-06-28T20:19:38.052Z+ retry=39
6582024-06-28T20:19:38.076Z+ zoneadm list
6592024-06-28T20:19:38.076Z+ grep nexus
6602024-06-28T20:19:38.076Z+ [[ 39 -gt 300 ]]
6612024-06-28T20:19:38.076Z+ sleep 1
6622024-06-28T20:19:39.064Z+ retry=40
6632024-06-28T20:19:39.089Z+ zoneadm list
6642024-06-28T20:19:39.089Z+ grep nexus
6652024-06-28T20:19:39.089Z+ [[ 40 -gt 300 ]]
6662024-06-28T20:19:39.089Z+ sleep 1
6672024-06-28T20:19:40.082Z+ retry=41
6682024-06-28T20:19:40.108Z+ zoneadm list
6692024-06-28T20:19:40.108Z+ grep nexus
6702024-06-28T20:19:40.108Z+ [[ 41 -gt 300 ]]
6712024-06-28T20:19:40.108Z+ sleep 1
6722024-06-28T20:19:41.089Z+ retry=42
6732024-06-28T20:19:41.116Z+ zoneadm list
6742024-06-28T20:19:41.116Z+ grep nexus
6752024-06-28T20:19:41.116Z+ [[ 42 -gt 300 ]]
6762024-06-28T20:19:41.116Z+ sleep 1
6772024-06-28T20:19:42.100Z+ retry=43
6782024-06-28T20:19:42.126Z+ zoneadm list
6792024-06-28T20:19:42.126Z+ grep nexus
6802024-06-28T20:19:42.126Z+ [[ 43 -gt 300 ]]
6812024-06-28T20:19:42.126Z+ sleep 1
6822024-06-28T20:19:43.112Z+ retry=44
6832024-06-28T20:19:43.137Z+ zoneadm list
6842024-06-28T20:19:43.137Z+ grep nexus
6852024-06-28T20:19:43.137Z+ [[ 44 -gt 300 ]]
6862024-06-28T20:19:43.137Z+ sleep 1
6872024-06-28T20:19:44.125Z+ retry=45
6882024-06-28T20:19:44.152Z+ zoneadm list
6892024-06-28T20:19:44.152Z+ grep nexus
6902024-06-28T20:19:44.152Z+ [[ 45 -gt 300 ]]
6912024-06-28T20:19:44.152Z+ sleep 1
6922024-06-28T20:19:45.167Z+ retry=46
6932024-06-28T20:19:45.208Z+ zoneadm list
6942024-06-28T20:19:45.208Z+ grep nexus
6952024-06-28T20:19:45.208Z+ [[ 46 -gt 300 ]]
6962024-06-28T20:19:45.208Z+ sleep 1
6972024-06-28T20:19:46.151Z+ retry=47
6982024-06-28T20:19:46.178Z+ zoneadm list
6992024-06-28T20:19:46.179Z+ grep nexus
7002024-06-28T20:19:46.179Z+ [[ 47 -gt 300 ]]
7012024-06-28T20:19:46.179Z+ sleep 1
7022024-06-28T20:19:47.162Z+ retry=48
7032024-06-28T20:19:47.187Z+ zoneadm list
7042024-06-28T20:19:47.187Z+ grep nexus
7052024-06-28T20:19:47.187Z+ [[ 48 -gt 300 ]]
7062024-06-28T20:19:47.187Z+ sleep 1
7072024-06-28T20:19:48.175Z+ retry=49
7082024-06-28T20:19:48.199Z+ zoneadm list
7092024-06-28T20:19:48.199Z+ grep nexus
7102024-06-28T20:19:48.200Z+ [[ 49 -gt 300 ]]
7112024-06-28T20:19:48.200Z+ sleep 1
7122024-06-28T20:19:49.187Z+ retry=50
7132024-06-28T20:19:49.212Z+ zoneadm list
7142024-06-28T20:19:49.212Z+ grep nexus
7152024-06-28T20:19:49.212Z+ [[ 50 -gt 300 ]]
7162024-06-28T20:19:49.212Z+ sleep 1
7172024-06-28T20:19:50.199Z+ retry=51
7182024-06-28T20:19:50.224Z+ zoneadm list
7192024-06-28T20:19:50.224Z+ grep nexus
7202024-06-28T20:19:50.224Z+ [[ 51 -gt 300 ]]
7212024-06-28T20:19:50.224Z+ sleep 1
7222024-06-28T20:19:51.211Z+ retry=52
7232024-06-28T20:19:51.235Z+ zoneadm list
7242024-06-28T20:19:51.235Z+ grep nexus
7252024-06-28T20:19:51.235Z+ [[ 52 -gt 300 ]]
7262024-06-28T20:19:51.235Z+ sleep 1
7272024-06-28T20:19:52.223Z+ retry=53
7282024-06-28T20:19:52.247Z+ zoneadm list
7292024-06-28T20:19:52.247Z+ grep nexus
7302024-06-28T20:19:52.247Z+ [[ 53 -gt 300 ]]
7312024-06-28T20:19:52.248Z+ sleep 1
7322024-06-28T20:19:53.235Z+ retry=54
7332024-06-28T20:19:53.260Z+ zoneadm list
7342024-06-28T20:19:53.260Z+ grep nexus
7352024-06-28T20:19:53.260Z+ [[ 54 -gt 300 ]]
7362024-06-28T20:19:53.260Z+ sleep 1
7372024-06-28T20:19:54.256Z+ retry=55
7382024-06-28T20:19:54.281Z+ zoneadm list
7392024-06-28T20:19:54.281Z+ grep nexus
7402024-06-28T20:19:54.281Z+ [[ 55 -gt 300 ]]
7412024-06-28T20:19:54.281Z+ sleep 1
7422024-06-28T20:19:55.275Z+ retry=56
7432024-06-28T20:19:55.300Z+ zoneadm list
7442024-06-28T20:19:55.300Z+ grep nexus
7452024-06-28T20:19:55.300Z+ [[ 56 -gt 300 ]]
7462024-06-28T20:19:55.300Z+ sleep 1
7472024-06-28T20:19:56.295Z+ retry=57
7482024-06-28T20:19:56.322Z+ zoneadm list
7492024-06-28T20:19:56.365Z+ grep nexus
7502024-06-28T20:19:56.365Z+ [[ 57 -gt 300 ]]
7512024-06-28T20:19:56.365Z+ sleep 1
7522024-06-28T20:19:59.640Z+ retry=58
7532024-06-28T20:19:59.665Z+ zoneadm list
7542024-06-28T20:19:59.665Z+ grep nexus
7552024-06-28T20:19:59.772Z+ [[ 58 -gt 300 ]]
7562024-06-28T20:19:59.797Z+ sleep 1
7572024-06-28T20:20:00.814Z+ retry=59
7582024-06-28T20:20:00.845Z+ zoneadm list
7592024-06-28T20:20:00.845Z+ grep nexus
7602024-06-28T20:20:00.845Z+ [[ 59 -gt 300 ]]
7612024-06-28T20:20:00.845Z+ sleep 1
7622024-06-28T20:20:01.845Z+ retry=60
7632024-06-28T20:20:01.871Z+ zoneadm list
7642024-06-28T20:20:01.871Z+ grep nexus
7652024-06-28T20:20:01.871Z+ [[ 60 -gt 300 ]]
7662024-06-28T20:20:01.871Z+ sleep 1
7672024-06-28T20:20:02.862Z+ retry=61
7682024-06-28T20:20:02.886Z+ zoneadm list
7692024-06-28T20:20:02.886Z+ grep nexus
7702024-06-28T20:20:02.886Z+ [[ 61 -gt 300 ]]
7712024-06-28T20:20:02.886Z+ sleep 1
7722024-06-28T20:20:03.884Z+ retry=62
7732024-06-28T20:20:03.909Z+ zoneadm list
7742024-06-28T20:20:03.909Z+ grep nexus
7752024-06-28T20:20:03.909Zoxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
7762024-06-28T20:20:03.909Zoxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
7772024-06-28T20:20:03.909Z+ echo 'Waited for nexus: 62s'
7782024-06-28T20:20:03.909ZWaited for nexus: 62s
7792024-06-28T20:20:03.909Z+ export RUST_BACKTRACE=1
7802024-06-28T20:20:03.909Z+ RUST_BACKTRACE=1
7812024-06-28T20:20:03.909Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
7822024-06-28T20:20:03.909Z++ ./target/debug/bootstrap
7832024-06-28T20:20:07.493ZUsing external DNS server at 10.151.2.164:53
7842024-06-28T20:20:07.673Z2024-06-28 20:20:07.661304352 UTC: attempting to log into API
7852024-06-28T20:20:22.757Z2024-06-28 20:20:22.744999526 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
7862024-06-28T20:20:23.758Z2024-06-28 20:20:23.746234904 UTC: attempting to log into API
 
7872024-06-28T20:20:27.926ZJun 28 20:20:26 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
7882024-06-28T20:20:28.845ZJun 28 20:20:28 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
7892024-06-28T20:20:29.228ZJun 28 20:20:28 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
7902024-06-28T20:20:29.266ZJun 28 20:20:28 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
7912024-06-28T20:20:29.304ZJun 28 20:20:28 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
7922024-06-28T20:20:38.813Z2024-06-28 20:20:38.802530479 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
7932024-06-28T20:20:39.813Z2024-06-28 20:20:39.803679811 UTC: attempting to log into API
7942024-06-28T20:20:54.845Z2024-06-28 20:20:54.835235043 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
7952024-06-28T20:20:55.846Z2024-06-28 20:20:55.836345304 UTC: attempting to log into API
7962024-06-28T20:21:10.999Z2024-06-28 20:21:10.867186704 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
7972024-06-28T20:21:11.878Z2024-06-28 20:21:11.868345816 UTC: attempting to log into API
7982024-06-28T20:21:12.680Z2024-06-28 20:21:12.670895256 UTC: login succeeded
7992024-06-28T20:21:12.714Zwaiting for nexus to come up...
8002024-06-28T20:21:12.794Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8012024-06-28T20:21:12.953Zsetting up quotas...
8022024-06-28T20:21:12.993Zensuring datasets are ready...
8032024-06-28T20:21:15.008Zlet's roll.
8042024-06-28T20:21:15.032Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8052024-06-28T20:21:15.032ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8062024-06-28T20:21:15.032ZOXIDE_TOKEN=oxide-token-78c9584b443789354ef676fdb2b0d05782922f24'
8072024-06-28T20:21:15.032Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8082024-06-28T20:21:15.032Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8092024-06-28T20:21:15.032Z++ OXIDE_TOKEN=oxide-token-78c9584b443789354ef676fdb2b0d05782922f24
8102024-06-28T20:21:15.032Z+ export OXIDE_HOST OXIDE_TOKEN
8112024-06-28T20:21:15.032Z+ retry=0
8122024-06-28T20:21:15.032Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8132024-06-28T20:21:15.057Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8142024-06-28T20:21:15.057Z+ [[ 0 -gt 60 ]]
8152024-06-28T20:21:15.057Z+ sleep 1
8162024-06-28T20:21:16.042Z+ retry=1
8172024-06-28T20:21:16.042Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8182024-06-28T20:21:16.068Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8192024-06-28T20:21:16.068Z+ [[ 1 -gt 60 ]]
8202024-06-28T20:21:16.068Z+ sleep 1
8212024-06-28T20:21:17.057Z+ retry=2
8222024-06-28T20:21:17.057Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8232024-06-28T20:21:17.082Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8242024-06-28T20:21:17.082Z+ [[ 2 -gt 60 ]]
8252024-06-28T20:21:17.082Z+ sleep 1
8262024-06-28T20:21:18.075Z+ retry=3
8272024-06-28T20:21:18.075Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8282024-06-28T20:21:18.100Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8292024-06-28T20:21:18.100Z+ [[ 3 -gt 60 ]]
8302024-06-28T20:21:18.101Z+ sleep 1
8312024-06-28T20:21:19.090Z+ retry=4
8322024-06-28T20:21:19.090Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8332024-06-28T20:21:19.114Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8342024-06-28T20:21:19.114Z+ [[ 4 -gt 60 ]]
8352024-06-28T20:21:19.114Z+ sleep 1
8362024-06-28T20:21:20.106Z+ retry=5
8372024-06-28T20:21:20.106Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8382024-06-28T20:21:20.131Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8392024-06-28T20:21:20.131Z+ [[ 5 -gt 60 ]]
8402024-06-28T20:21:20.131Z+ sleep 1
8412024-06-28T20:21:21.123Z+ retry=6
8422024-06-28T20:21:21.123Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8432024-06-28T20:21:21.148Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8442024-06-28T20:21:21.148Z+ [[ 6 -gt 60 ]]
8452024-06-28T20:21:21.148Z+ sleep 1
8462024-06-28T20:21:22.139Z+ retry=7
8472024-06-28T20:21:22.139Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8482024-06-28T20:21:22.165Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8492024-06-28T20:21:22.165Z+ [[ 7 -gt 60 ]]
8502024-06-28T20:21:22.165Z+ sleep 1
8512024-06-28T20:21:23.154Z+ retry=8
8522024-06-28T20:21:23.154Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8532024-06-28T20:21:23.179Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8542024-06-28T20:21:23.179Z+ [[ 8 -gt 60 ]]
8552024-06-28T20:21:23.179Z+ sleep 1
8562024-06-28T20:21:24.170Z+ retry=9
8572024-06-28T20:21:24.170Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8582024-06-28T20:21:24.194Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8592024-06-28T20:21:24.195Z+ [[ 9 -gt 60 ]]
8602024-06-28T20:21:24.195Z+ sleep 1
8612024-06-28T20:21:25.186Z+ retry=10
8622024-06-28T20:21:25.186Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8632024-06-28T20:21:25.210Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8642024-06-28T20:21:25.210Z+ [[ 10 -gt 60 ]]
8652024-06-28T20:21:25.210Z+ sleep 1
8662024-06-28T20:21:26.202Z+ retry=11
8672024-06-28T20:21:26.202Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8682024-06-28T20:21:26.227Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8692024-06-28T20:21:26.227Z+ [[ 11 -gt 60 ]]
8702024-06-28T20:21:26.227Z+ sleep 1
8712024-06-28T20:21:27.218Z+ retry=12
8722024-06-28T20:21:27.218Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8732024-06-28T20:21:27.242Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8742024-06-28T20:21:27.242Z+ [[ 12 -gt 60 ]]
8752024-06-28T20:21:27.242Z+ sleep 1
8762024-06-28T20:21:28.235Z+ retry=13
8772024-06-28T20:21:28.235Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8782024-06-28T20:21:28.260Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8792024-06-28T20:21:28.260Z+ [[ 13 -gt 60 ]]
8802024-06-28T20:21:28.260Z+ sleep 1
8812024-06-28T20:21:29.250Z+ retry=14
8822024-06-28T20:21:29.250Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8832024-06-28T20:21:29.275Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8842024-06-28T20:21:29.275Z+ [[ 14 -gt 60 ]]
8852024-06-28T20:21:29.275Z+ sleep 1
8862024-06-28T20:21:30.265Z+ retry=15
8872024-06-28T20:21:30.265Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8882024-06-28T20:21:30.289Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8892024-06-28T20:21:30.289Z+ [[ 15 -gt 60 ]]
8902024-06-28T20:21:30.289Z+ sleep 1
8912024-06-28T20:21:31.283Z+ retry=16
8922024-06-28T20:21:31.283Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8932024-06-28T20:21:31.317Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8942024-06-28T20:21:31.317Z+ [[ 16 -gt 60 ]]
8952024-06-28T20:21:31.317Z+ sleep 1
8962024-06-28T20:21:32.297Z+ retry=17
8972024-06-28T20:21:32.297Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8982024-06-28T20:21:32.322Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8992024-06-28T20:21:32.322Z+ [[ 17 -gt 60 ]]
9002024-06-28T20:21:32.322Z+ sleep 1
9012024-06-28T20:21:33.313Z+ retry=18
9022024-06-28T20:21:33.313Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9032024-06-28T20:21:33.338Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9042024-06-28T20:21:33.338Z+ [[ 18 -gt 60 ]]
9052024-06-28T20:21:33.338Z+ sleep 1
9062024-06-28T20:21:34.349Z+ retry=19
9072024-06-28T20:21:34.349Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9082024-06-28T20:21:34.409Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9092024-06-28T20:21:35.022Z{"status":"ok"}success
9102024-06-28T20:21:35.022ZProject {
9112024-06-28T20:21:35.022Z description: "some images",
9122024-06-28T20:21:35.022Z id: 970b3bd1-f07d-41f7-925f-032513b73aa7,
9132024-06-28T20:21:35.047Z name: Name(
9142024-06-28T20:21:35.047Z "images",
9152024-06-28T20:21:35.047Z ),
9162024-06-28T20:21:35.047Z time_created: 2024-06-28T20:21:34.537995Z,
9172024-06-28T20:21:35.047Z time_modified: 2024-06-28T20:21:34.537995Z,
9182024-06-28T20:21:35.047Z}
9192024-06-28T20:21:35.047Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
9202024-06-28T20:26:58.450Zdone!
9212024-06-28T20:26:58.546Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9222024-06-28T20:26:58.659Zsuccess
9232024-06-28T20:26:58.659ZImage {
9242024-06-28T20:26:58.683Z block_size: ByteCount(
9252024-06-28T20:26:58.683Z 512,
9262024-06-28T20:26:58.683Z ),
9272024-06-28T20:26:58.683Z description: "debian 11 original base image",
9282024-06-28T20:26:58.683Z digest: None,
9292024-06-28T20:26:58.683Z id: e25402cb-0885-4c29-8c19-ff26f696e752,
9302024-06-28T20:26:58.683Z name: Name(
9312024-06-28T20:26:58.683Z "debian11",
9322024-06-28T20:26:58.683Z ),
9332024-06-28T20:26:58.683Z os: "debian",
9342024-06-28T20:26:58.683Z project_id: None,
9352024-06-28T20:26:58.683Z size: ByteCount(
9362024-06-28T20:26:58.683Z 2147483648,
9372024-06-28T20:26:58.683Z ),
9382024-06-28T20:26:58.683Z time_created: 2024-06-28T20:26:58.394577Z,
9392024-06-28T20:26:58.683Z time_modified: 2024-06-28T20:26:58.641028Z,
9402024-06-28T20:26:58.683Z url: None,
9412024-06-28T20:26:58.683Z version: "11",
9422024-06-28T20:26:58.683Z}
9432024-06-28T20:26:58.683Z+ for test_bin in tests/*
9442024-06-28T20:26:58.683Z+ ./tests/bootstrap-2c43dc3184ff70d6
9452024-06-28T20:26:58.708Z
9462024-06-28T20:26:58.708Zrunning 0 tests
9472024-06-28T20:26:58.708Z
9482024-06-28T20:26:58.708Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9492024-06-28T20:26:58.708Z
9502024-06-28T20:26:58.708Z+ for test_bin in tests/*
9512024-06-28T20:26:58.708Z+ ./tests/commtest-3cf8c74a3ee51610
9522024-06-28T20:26:58.756Z
9532024-06-28T20:26:58.756Zrunning 0 tests
9542024-06-28T20:26:58.756Z
9552024-06-28T20:26:58.780Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9562024-06-28T20:26:58.780Z
9572024-06-28T20:26:58.780Z+ for test_bin in tests/*
9582024-06-28T20:26:58.780Z+ ./tests/dhcp_server-58fe6f7d1c0591dd
9592024-06-28T20:26:58.804Z
9602024-06-28T20:26:58.804Zrunning 0 tests
9612024-06-28T20:26:58.804Z
9622024-06-28T20:26:58.805Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9632024-06-28T20:26:58.805Z
9642024-06-28T20:26:58.805Z+ for test_bin in tests/*
9652024-06-28T20:26:58.805Z+ ./tests/end_to_end_tests-2e61df446185b8f0
9662024-06-28T20:26:59.066Z
9672024-06-28T20:26:59.066Zrunning 2 tests
9682024-06-28T20:26:59.353Ztest no_spoof::no_spoof_here ... ok
9692024-06-28T20:27:26.832Ztest instance_launch::instance_launch ... ok
9702024-06-28T20:27:26.832Z
9712024-06-28T20:27:26.832Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 27.77s
9722024-06-28T20:27:26.832Z
9732024-06-28T20:27:26.857Z+ _exit_trap
9742024-06-28T20:27:26.857Z+ local status=0
9752024-06-28T20:27:26.857Z+ set +o errexit
9762024-06-28T20:27:26.857Z+ pfexec svcadm -Z disable -s cron
9772024-06-28T20:27:28.772Z+ [[ 0 -eq 0 ]]
9782024-06-28T20:27:28.772Z+ exit 0
9792024-06-28T20:27:28.796Zprocess exited: duration 595672 ms, exit code 0
 
9802024-06-28T20:27:28.900Zfound 106 output files
9812024-06-28T20:27:28.900Zuploading: /var/svc/log/oxide-sled-agent:default.log (964040 bytes)
9822024-06-28T20:27:30.204Zuploaded: /var/svc/log/oxide-sled-agent:default.log
9832024-06-28T20:27:30.204Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (4494216 bytes)
9842024-06-28T20:27:30.606Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 4494216 -> 4509980
9852024-06-28T20:27:31.677Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
9862024-06-28T20:27:31.677Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52283 bytes)
9872024-06-28T20:27:32.861Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
9882024-06-28T20:27:32.861Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (176155 bytes)
9892024-06-28T20:27:33.042Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 176155 -> 177718
9902024-06-28T20:27:34.116Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
9912024-06-28T20:27:34.139Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (227231 bytes)
9922024-06-28T20:27:34.317Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 227231 -> 232662
9932024-06-28T20:27:35.397Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
9942024-06-28T20:27:35.398Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1358971 bytes)
9952024-06-28T20:27:35.702Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1358971 -> 1386209
9962024-06-28T20:27:36.781Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
9972024-06-28T20:27:36.781Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (721907 bytes)
9982024-06-28T20:27:37.071Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 721907 -> 734657
9992024-06-28T20:27:38.141Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10002024-06-28T20:27:38.141Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1678 bytes)
10012024-06-28T20:27:39.234Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10022024-06-28T20:27:39.234Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (265287 bytes)
10032024-06-28T20:27:39.433Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 265287 -> 270462
10042024-06-28T20:27:40.503Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10052024-06-28T20:27:40.503Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (7735 bytes)
10062024-06-28T20:27:40.574Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 7735 -> 8320
10072024-06-28T20:27:41.652Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10082024-06-28T20:27:41.652Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5393 bytes)
10092024-06-28T20:27:42.744Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10102024-06-28T20:27:42.777Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c/root/var/svc/log/oxide-clickhouse:default.log (2305827 bytes)
10112024-06-28T20:27:43.086Zupload warning: file "/pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2305827 -> 2386563
10122024-06-28T20:27:44.167Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c/root/var/svc/log/oxide-clickhouse:default.log
10132024-06-28T20:27:44.195Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c/root/var/svc/log/oxide-zone-network-setup:default.log (1693 bytes)
10142024-06-28T20:27:45.269Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c/root/var/svc/log/oxide-zone-network-setup:default.log
10152024-06-28T20:27:45.269Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825/root/var/svc/log/oxide-cockroach-admin:default.log (4661 bytes)
10162024-06-28T20:27:46.363Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825/root/var/svc/log/oxide-cockroach-admin:default.log
10172024-06-28T20:27:46.363Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
10182024-06-28T20:27:47.457Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825/root/var/svc/log/oxide-cockroachdb:default.log
10192024-06-28T20:27:47.457Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825/root/var/svc/log/oxide-zone-network-setup:default.log (1689 bytes)
10202024-06-28T20:27:48.549Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825/root/var/svc/log/oxide-zone-network-setup:default.log
10212024-06-28T20:27:48.549Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-agent:default.log (34547 bytes)
10222024-06-28T20:27:49.706Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-agent:default.log
10232024-06-28T20:27:49.706Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10242024-06-28T20:27:50.800Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-downstairs:default.log
10252024-06-28T20:27:50.800Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-downstairs:downstairs-5b9b7096-9b6d-4865-b16f-5b5429b3f257.log (6075 bytes)
10262024-06-28T20:27:51.892Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-downstairs:downstairs-5b9b7096-9b6d-4865-b16f-5b5429b3f257.log
10272024-06-28T20:27:51.893Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-downstairs:downstairs-9296fd53-220b-4817-9198-7cecfe4cef11.log (5994 bytes)
10282024-06-28T20:27:52.987Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-downstairs:downstairs-9296fd53-220b-4817-9198-7cecfe4cef11.log
10292024-06-28T20:27:52.987Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-downstairs:snapshot-5b9b7096-9b6d-4865-b16f-5b5429b3f257-19891c95-ff5a-4815-a720-829e6cd5a4f6.log (5686 bytes)
10302024-06-28T20:27:54.080Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-crucible-downstairs:snapshot-5b9b7096-9b6d-4865-b16f-5b5429b3f257-19891c95-ff5a-4815-a720-829e6cd5a4f6.log
10312024-06-28T20:27:54.080Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
10322024-06-28T20:27:55.173Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec/root/var/svc/log/oxide-zone-network-setup:default.log
10332024-06-28T20:27:55.173Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774/root/var/svc/log/oxide-crucible-pantry:default.log (780 bytes)
10342024-06-28T20:27:56.266Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774/root/var/svc/log/oxide-crucible-pantry:default.log
10352024-06-28T20:27:56.266Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774/root/var/svc/log/oxide-zone-network-setup:default.log (1723 bytes)
10362024-06-28T20:27:57.358Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774/root/var/svc/log/oxide-zone-network-setup:default.log
10372024-06-28T20:27:57.358Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194/root/var/svc/log/oxide-external_dns:default.log (26875 bytes)
10382024-06-28T20:27:57.468Zupload warning: file "/pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26875 -> 30652
10392024-06-28T20:27:58.538Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194/root/var/svc/log/oxide-external_dns:default.log
10402024-06-28T20:27:58.538Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194/root/var/svc/log/oxide-opte-interface-setup:default.log (1159 bytes)
10412024-06-28T20:27:59.634Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194/root/var/svc/log/oxide-opte-interface-setup:default.log
10422024-06-28T20:27:59.634Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194/root/var/svc/log/oxide-zone-network-setup:default.log (1705 bytes)
10432024-06-28T20:28:00.734Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194/root/var/svc/log/oxide-zone-network-setup:default.log
10442024-06-28T20:28:00.735Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066/root/var/svc/log/oxide-internal_dns:default.log (107381 bytes)
10452024-06-28T20:28:00.892Zupload warning: file "/pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107381 -> 111136
10462024-06-28T20:28:01.962Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066/root/var/svc/log/oxide-internal_dns:default.log
10472024-06-28T20:28:01.962Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
10482024-06-28T20:28:03.055Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066/root/var/svc/log/oxide-zone-network-setup:default.log
10492024-06-28T20:28:03.136Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8/root/var/svc/log/oxide-nexus:default.log (36263276 bytes)
10502024-06-28T20:28:04.534Zupload warning: file "/pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36263276 -> 36526821
10512024-06-28T20:28:05.602Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8/root/var/svc/log/oxide-nexus:default.log
10522024-06-28T20:28:05.602Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
10532024-06-28T20:28:06.695Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8/root/var/svc/log/oxide-opte-interface-setup:default.log
10542024-06-28T20:28:06.695Zuploading: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8/root/var/svc/log/oxide-zone-network-setup:default.log (1662 bytes)
10552024-06-28T20:28:07.788Zuploaded: /pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone/oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8/root/var/svc/log/oxide-zone-network-setup:default.log
10562024-06-28T20:28:07.788Zuploading: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-agent:default.log (36852 bytes)
10572024-06-28T20:28:08.948Zuploaded: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-agent:default.log
10582024-06-28T20:28:08.948Zuploading: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10592024-06-28T20:28:10.041Zuploaded: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:default.log
10602024-06-28T20:28:10.041Zuploading: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:downstairs-226e2e42-544b-4b87-b9d5-9eab3566ca9d.log (5990 bytes)
10612024-06-28T20:28:11.139Zuploaded: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:downstairs-226e2e42-544b-4b87-b9d5-9eab3566ca9d.log
10622024-06-28T20:28:11.167Zuploading: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:downstairs-d62722e3-8f34-470e-9573-767d29dd8041.log (6075 bytes)
10632024-06-28T20:28:12.265Zuploaded: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:downstairs-d62722e3-8f34-470e-9573-767d29dd8041.log
10642024-06-28T20:28:12.266Zuploading: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:downstairs-e329a71e-292d-450f-962e-04d8b14e5318.log (3124 bytes)
10652024-06-28T20:28:13.381Zuploaded: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:downstairs-e329a71e-292d-450f-962e-04d8b14e5318.log
10662024-06-28T20:28:13.381Zuploading: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:snapshot-d62722e3-8f34-470e-9573-767d29dd8041-19891c95-ff5a-4815-a720-829e6cd5a4f6.log (5686 bytes)
10672024-06-28T20:28:14.475Zuploaded: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-crucible-downstairs:snapshot-d62722e3-8f34-470e-9573-767d29dd8041-19891c95-ff5a-4815-a720-829e6cd5a4f6.log
10682024-06-28T20:28:14.475Zuploading: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
10692024-06-28T20:28:15.568Zuploaded: /pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone/oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482/root/var/svc/log/oxide-zone-network-setup:default.log
10702024-06-28T20:28:15.569Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
10712024-06-28T20:28:16.710Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e/root/var/svc/log/oxide-crucible-agent:default.log
10722024-06-28T20:28:16.710Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10732024-06-28T20:28:17.806Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e/root/var/svc/log/oxide-crucible-downstairs:default.log
10742024-06-28T20:28:17.806Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
10752024-06-28T20:28:18.901Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e/root/var/svc/log/oxide-zone-network-setup:default.log
10762024-06-28T20:28:18.901Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/svc/log/oxide-chrony-setup:default.log (14142 bytes)
10772024-06-28T20:28:20.019Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/svc/log/oxide-chrony-setup:default.log
10782024-06-28T20:28:20.019Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/svc/log/oxide-ntp:default.log (597 bytes)
10792024-06-28T20:28:21.279Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/svc/log/oxide-ntp:default.log
10802024-06-28T20:28:21.279Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/svc/log/oxide-opte-interface-setup:default.log (1129 bytes)
10812024-06-28T20:28:22.375Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/svc/log/oxide-opte-interface-setup:default.log
10822024-06-28T20:28:22.376Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/svc/log/oxide-zone-network-setup:default.log (1644 bytes)
10832024-06-28T20:28:23.469Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/svc/log/oxide-zone-network-setup:default.log
10842024-06-28T20:28:23.469Zuploading: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573/root/var/svc/log/oxide-crucible-agent:default.log (8485 bytes)
10852024-06-28T20:28:24.585Zuploaded: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573/root/var/svc/log/oxide-crucible-agent:default.log
10862024-06-28T20:28:24.585Zuploading: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10872024-06-28T20:28:25.679Zuploaded: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573/root/var/svc/log/oxide-crucible-downstairs:default.log
10882024-06-28T20:28:25.679Zuploading: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573/root/var/svc/log/oxide-crucible-downstairs:downstairs-bf0ee68c-3f38-4acf-9d6f-1e9ef43f16b8.log (3020 bytes)
10892024-06-28T20:28:26.774Zuploaded: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573/root/var/svc/log/oxide-crucible-downstairs:downstairs-bf0ee68c-3f38-4acf-9d6f-1e9ef43f16b8.log
10902024-06-28T20:28:26.774Zuploading: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
10912024-06-28T20:28:27.869Zuploaded: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573/root/var/svc/log/oxide-zone-network-setup:default.log
10922024-06-28T20:28:27.870Zuploading: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc/root/var/svc/log/oxide-crucible-pantry:default.log (766014 bytes)
10932024-06-28T20:28:29.186Zuploaded: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc/root/var/svc/log/oxide-crucible-pantry:default.log
10942024-06-28T20:28:29.186Zuploading: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
10952024-06-28T20:28:30.281Zuploaded: /pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone/oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc/root/var/svc/log/oxide-zone-network-setup:default.log
10962024-06-28T20:28:30.281Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f/root/var/svc/log/oxide-cockroach-admin:default.log (4662 bytes)
10972024-06-28T20:28:31.376Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f/root/var/svc/log/oxide-cockroach-admin:default.log
10982024-06-28T20:28:31.376Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
10992024-06-28T20:28:32.472Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f/root/var/svc/log/oxide-cockroachdb:default.log
11002024-06-28T20:28:32.472Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f/root/var/svc/log/oxide-zone-network-setup:default.log (1689 bytes)
11012024-06-28T20:28:33.565Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f/root/var/svc/log/oxide-zone-network-setup:default.log
11022024-06-28T20:28:33.565Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
11032024-06-28T20:28:34.657Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc/root/var/svc/log/oxide-crucible-agent:default.log
11042024-06-28T20:28:34.658Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11052024-06-28T20:28:35.751Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc/root/var/svc/log/oxide-crucible-downstairs:default.log
11062024-06-28T20:28:35.751Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
11072024-06-28T20:28:36.844Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc/root/var/svc/log/oxide-zone-network-setup:default.log
11082024-06-28T20:28:36.844Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
11092024-06-28T20:28:40.327Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3/root/var/svc/log/oxide-crucible-pantry:default.log
11102024-06-28T20:28:40.328Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
11112024-06-28T20:28:41.378Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3/root/var/svc/log/oxide-zone-network-setup:default.log
11122024-06-28T20:28:41.378Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a/root/var/svc/log/oxide-nexus:default.log (5164964 bytes)
11132024-06-28T20:28:41.862Zupload warning: file "/pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5164964 -> 5772790
11142024-06-28T20:28:42.950Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a/root/var/svc/log/oxide-nexus:default.log
11152024-06-28T20:28:42.950Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
11162024-06-28T20:28:44.069Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a/root/var/svc/log/oxide-opte-interface-setup:default.log
11172024-06-28T20:28:44.070Zuploading: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a/root/var/svc/log/oxide-zone-network-setup:default.log (1663 bytes)
11182024-06-28T20:28:45.163Zuploaded: /pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone/oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a/root/var/svc/log/oxide-zone-network-setup:default.log
11192024-06-28T20:28:45.163Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077/root/var/svc/log/oxide-cockroach-admin:default.log (4656 bytes)
11202024-06-28T20:28:46.258Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077/root/var/svc/log/oxide-cockroach-admin:default.log
11212024-06-28T20:28:46.258Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077/root/var/svc/log/oxide-cockroachdb:default.log (4289 bytes)
11222024-06-28T20:28:47.353Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077/root/var/svc/log/oxide-cockroachdb:default.log
11232024-06-28T20:28:47.354Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
11242024-06-28T20:28:48.447Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077/root/var/svc/log/oxide-zone-network-setup:default.log
11252024-06-28T20:28:48.447Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-crucible-agent:default.log (22597 bytes)
11262024-06-28T20:28:49.587Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-crucible-agent:default.log
11272024-06-28T20:28:49.587Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11282024-06-28T20:28:50.681Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-crucible-downstairs:default.log
11292024-06-28T20:28:50.681Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-crucible-downstairs:downstairs-54858ce7-2550-436b-82fd-89b2346ffa37.log (5989 bytes)
11302024-06-28T20:28:51.774Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-crucible-downstairs:downstairs-54858ce7-2550-436b-82fd-89b2346ffa37.log
11312024-06-28T20:28:51.774Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-crucible-downstairs:downstairs-8b67727a-3c0c-42dd-8d41-310e41f269af.log (3126 bytes)
11322024-06-28T20:28:52.870Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-crucible-downstairs:downstairs-8b67727a-3c0c-42dd-8d41-310e41f269af.log
11332024-06-28T20:28:52.870Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11342024-06-28T20:28:53.976Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d/root/var/svc/log/oxide-zone-network-setup:default.log
11352024-06-28T20:28:53.976Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4/root/var/svc/log/oxide-internal_dns:default.log (107379 bytes)
11362024-06-28T20:28:54.169Zupload warning: file "/pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107379 -> 114892
11372024-06-28T20:28:55.252Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4/root/var/svc/log/oxide-internal_dns:default.log
11382024-06-28T20:28:55.252Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
11392024-06-28T20:28:56.347Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4/root/var/svc/log/oxide-zone-network-setup:default.log
11402024-06-28T20:28:56.375Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476/root/var/svc/log/oxide-oximeter:default.log (1589899 bytes)
11412024-06-28T20:28:56.693Zupload warning: file "/pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1589899 -> 1932217
11422024-06-28T20:28:57.763Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476/root/var/svc/log/oxide-oximeter:default.log
11432024-06-28T20:28:57.763Zuploading: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
11442024-06-28T20:28:58.859Zuploaded: /pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone/oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476/root/var/svc/log/oxide-zone-network-setup:default.log
11452024-06-28T20:28:58.860Zuploading: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-agent:default.log (32830 bytes)
11462024-06-28T20:29:00.016Zuploaded: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-agent:default.log
11472024-06-28T20:29:00.017Zuploading: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11482024-06-28T20:29:01.109Zuploaded: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:default.log
11492024-06-28T20:29:01.109Zuploading: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:downstairs-82caae78-d4b6-4c9d-96e7-8226791126bf.log (3016 bytes)
11502024-06-28T20:29:02.202Zuploaded: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:downstairs-82caae78-d4b6-4c9d-96e7-8226791126bf.log
11512024-06-28T20:29:02.226Zuploading: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:downstairs-850c0a02-a853-41e4-b94e-17d0ce8634ab.log (3126 bytes)
11522024-06-28T20:29:03.295Zuploaded: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:downstairs-850c0a02-a853-41e4-b94e-17d0ce8634ab.log
11532024-06-28T20:29:03.319Zuploading: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:downstairs-e544b102-31b0-47ad-9d04-b454978faa9b.log (6077 bytes)
11542024-06-28T20:29:04.387Zuploaded: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:downstairs-e544b102-31b0-47ad-9d04-b454978faa9b.log
11552024-06-28T20:29:04.387Zuploading: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:snapshot-e544b102-31b0-47ad-9d04-b454978faa9b-19891c95-ff5a-4815-a720-829e6cd5a4f6.log (5683 bytes)
11562024-06-28T20:29:05.480Zuploaded: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-crucible-downstairs:snapshot-e544b102-31b0-47ad-9d04-b454978faa9b-19891c95-ff5a-4815-a720-829e6cd5a4f6.log
11572024-06-28T20:29:05.480Zuploading: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
11582024-06-28T20:29:06.572Zuploaded: /pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone/oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a/root/var/svc/log/oxide-zone-network-setup:default.log
11592024-06-28T20:29:06.597Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b/root/var/svc/log/oxide-cockroach-admin:default.log (4662 bytes)
11602024-06-28T20:29:07.668Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b/root/var/svc/log/oxide-cockroach-admin:default.log
11612024-06-28T20:29:07.668Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11622024-06-28T20:29:08.763Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b/root/var/svc/log/oxide-cockroachdb:default.log
11632024-06-28T20:29:08.763Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b/root/var/svc/log/oxide-zone-network-setup:default.log (1689 bytes)
11642024-06-28T20:29:09.857Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b/root/var/svc/log/oxide-zone-network-setup:default.log
11652024-06-28T20:29:09.857Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
11662024-06-28T20:29:10.948Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33/root/var/svc/log/oxide-crucible-agent:default.log
11672024-06-28T20:29:10.948Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11682024-06-28T20:29:12.040Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33/root/var/svc/log/oxide-crucible-downstairs:default.log
11692024-06-28T20:29:12.040Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
11702024-06-28T20:29:13.133Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33/root/var/svc/log/oxide-zone-network-setup:default.log
11712024-06-28T20:29:13.133Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390/root/var/svc/log/oxide-external_dns:default.log (26869 bytes)
11722024-06-28T20:29:13.243Zupload warning: file "/pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26869 -> 34423
11732024-06-28T20:29:14.313Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390/root/var/svc/log/oxide-external_dns:default.log
11742024-06-28T20:29:14.313Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390/root/var/svc/log/oxide-opte-interface-setup:default.log (1159 bytes)
11752024-06-28T20:29:15.411Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390/root/var/svc/log/oxide-opte-interface-setup:default.log
11762024-06-28T20:29:15.411Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
11772024-06-28T20:29:16.506Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390/root/var/svc/log/oxide-zone-network-setup:default.log
11782024-06-28T20:29:16.506Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00/root/var/svc/log/oxide-internal_dns:default.log (107373 bytes)
11792024-06-28T20:29:16.664Zupload warning: file "/pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107373 -> 114880
11802024-06-28T20:29:17.738Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00/root/var/svc/log/oxide-internal_dns:default.log
11812024-06-28T20:29:17.738Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00/root/var/svc/log/oxide-zone-network-setup:default.log (1687 bytes)
11822024-06-28T20:29:18.833Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00/root/var/svc/log/oxide-zone-network-setup:default.log
11832024-06-28T20:29:18.833Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d/root/var/svc/log/oxide-nexus:default.log (2739030 bytes)
11842024-06-28T20:29:19.200Zupload warning: file "/pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2739030 -> 3316122
11852024-06-28T20:29:20.270Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d/root/var/svc/log/oxide-nexus:default.log
11862024-06-28T20:29:20.270Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
11872024-06-28T20:29:21.364Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d/root/var/svc/log/oxide-opte-interface-setup:default.log
11882024-06-28T20:29:21.364Zuploading: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d/root/var/svc/log/oxide-zone-network-setup:default.log (1662 bytes)
11892024-06-28T20:29:22.459Zuploaded: /pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone/oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d/root/var/svc/log/oxide-zone-network-setup:default.log
11902024-06-28T20:29:22.459Zuploading: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2/root/var/svc/log/oxide-cockroach-admin:default.log (4662 bytes)
11912024-06-28T20:29:23.553Zuploaded: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2/root/var/svc/log/oxide-cockroach-admin:default.log
11922024-06-28T20:29:23.553Zuploading: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
11932024-06-28T20:29:24.648Zuploaded: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2/root/var/svc/log/oxide-cockroachdb:default.log
11942024-06-28T20:29:24.648Zuploading: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
11952024-06-28T20:29:25.743Zuploaded: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2/root/var/svc/log/oxide-zone-network-setup:default.log
11962024-06-28T20:29:25.743Zuploading: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36/root/var/svc/log/oxide-crucible-agent:default.log (8477 bytes)
11972024-06-28T20:29:26.860Zuploaded: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36/root/var/svc/log/oxide-crucible-agent:default.log
11982024-06-28T20:29:26.860Zuploading: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11992024-06-28T20:29:27.955Zuploaded: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36/root/var/svc/log/oxide-crucible-downstairs:default.log
12002024-06-28T20:29:27.955Zuploading: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36/root/var/svc/log/oxide-crucible-downstairs:downstairs-c5cd8c01-17d0-4320-9548-989073b45bd2.log (3019 bytes)
12012024-06-28T20:29:29.050Zuploaded: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36/root/var/svc/log/oxide-crucible-downstairs:downstairs-c5cd8c01-17d0-4320-9548-989073b45bd2.log
12022024-06-28T20:29:29.074Zuploading: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
12032024-06-28T20:29:30.144Zuploaded: /pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone/oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36/root/var/svc/log/oxide-zone-network-setup:default.log
12042024-06-28T20:29:30.144Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/measurements.log (19865 bytes)
12052024-06-28T20:29:30.236Zupload warning: file "/pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/measurements.log" changed size mid upload: 19865 -> 24660
12062024-06-28T20:29:31.306Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/measurements.log
12072024-06-28T20:29:31.306Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/statistics.log (12285 bytes)
12082024-06-28T20:29:31.397Zupload warning: file "/pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/statistics.log" changed size mid upload: 12285 -> 16146
12092024-06-28T20:29:32.470Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/statistics.log
12102024-06-28T20:29:32.470Zuploading: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/tracking.log (1849 bytes)
12112024-06-28T20:29:32.513Zupload warning: file "/pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/tracking.log" changed size mid upload: 1849 -> 2113
12122024-06-28T20:29:33.583Zuploaded: /pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone/oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98/root/var/log/chrony/tracking.log