01J56RT8FGYV11JG66N3KBPZDT: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.33",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01J56RV6XWJDWEV3B528RVM9KS

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-08-13T21:33:51.167Zjob dependencies complete; ready to run (waiting for 30 m 19 s)
22024-08-13T21:45:48.773Zjob assigned to worker 01J56V0W45BNBTX99792HR48CV (queued for 11 m 57 s)
32024-08-13T21:45:48.809Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-08-13T21:45:48.852Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-08-13T21:45:48.885Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-08-13T21:45:48.920Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-08-13T21:45:48.953Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-08-13T21:45:48.987ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-08-13T21:45:49.020Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d3
102024-08-13T21:45:49.053ZOxide Helios Version helios-2.0.22764 64-bit
112024-08-13T21:45:49.088ZConfiguring devices.
122024-08-13T21:45:49.120Z##################################################
132024-08-13T21:45:49.155Z#### ############# ##
142024-08-13T21:45:49.189Z### ### ############ ##
152024-08-13T21:45:49.223Z## ### # ## ### ## Oxide Computer Company ##
162024-08-13T21:45:49.256Z## ## ## ### # ### ##
172024-08-13T21:45:49.293Z## # ### #### #### This Station Under ##
182024-08-13T21:45:49.323Z### ### #### # ### Computer Control ##
192024-08-13T21:45:49.358Z#### #### ### ## ##
202024-08-13T21:45:49.389Z##################################################
212024-08-13T21:45:49.423ZHostname: buskin
222024-08-13T21:45:49.467ZLoading smf(7) service descriptions:
232024-08-13T21:45:49.730Zdownloading input: /input/package/work/package.tar.gz
242024-08-13T21:49:45.886Zdownloaded input: /input/package/work/package.tar.gz
 
252024-08-13T21:49:45.911Zstarting task 0: "setup"
262024-08-13T21:49:45.912Z++ uname -s
272024-08-13T21:49:45.912Z+ kern=SunOS
282024-08-13T21:49:45.912Z+ case "$kern" in
292024-08-13T21:49:45.912Z+ groupadd -g 12345 build
302024-08-13T21:49:45.912Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-08-13T21:49:47.864Z+ zfs create -o mountpoint=/work rpool/work
322024-08-13T21:49:47.908Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-08-13T21:49:47.932Z+ home_fs=zfs
342024-08-13T21:49:47.932Z+ [[ zfs == autofs ]]
352024-08-13T21:49:47.932Z+ mkdir -p /home/build
362024-08-13T21:49:47.932Z+ chown build:build /home/build /work
372024-08-13T21:49:49.916Z+ chmod 0700 /home/build /work
382024-08-13T21:49:49.940Zprocess exited: duration 4073 ms, exit code 0
 
392024-08-13T21:49:49.988Zstarting task 1: "authentication"
402024-08-13T21:49:50.030Zprocess exited: duration 42 ms, exit code 0
 
412024-08-13T21:49:50.076Zstarting task 2: "build"
422024-08-13T21:49:50.099Z+ trap _exit_trap EXIT
432024-08-13T21:49:50.099Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-08-13T21:49:50.196Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-08-13T21:49:50.196Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-08-13T21:49:50.196Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-08-13T21:49:50.220Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-08-13T21:49:50.220Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-08-13T21:49:50.220Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-08-13T21:49:50.220Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-08-13T21:49:50.220Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-08-13T21:49:50.220Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-08-13T21:49:50.220Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-08-13T21:49:50.220Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-08-13T21:49:50.220Z+ [[ -d /opt/oxide ]]
562024-08-13T21:49:50.220Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-08-13T21:49:50.220Z+ pfexec mkdir /opt/oxide
582024-08-13T21:49:50.220Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-08-13T21:49:50.220Z+ [[ -d /opt/oxide-underneath ]]
602024-08-13T21:49:50.220Z+ cd /opt/oxide-underneath
612024-08-13T21:49:50.220Z+ pfexec tar ceEp@/f - .
622024-08-13T21:49:50.220Z+ cd /opt/oxide
632024-08-13T21:49:50.220Z+ pfexec tar xveEp@/f -
642024-08-13T21:49:50.325Zx ., 0 bytes, 0 tape blocks
652024-08-13T21:49:50.325Zx ./opte, 0 bytes, 0 tape blocks
662024-08-13T21:49:50.325Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-08-13T21:49:50.325Zx ./opte/bin/opteadm, 53012184 bytes, 103540 tape blocks
682024-08-13T21:49:50.349Z+ pfexec rm -rf /opt/oxide-underneath
692024-08-13T21:49:50.349Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-08-13T21:49:50.372Z+ pfexec mkdir /opt/oxide/work
712024-08-13T21:49:50.372Z+ pfexec chown build:build /opt/oxide/work
722024-08-13T21:49:50.372Z+ cd /opt/oxide/work
732024-08-13T21:49:50.372Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-08-13T21:50:00.931ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-08-13T21:50:00.931Zx out/target/test, 75 bytes, 1 tape blocks
762024-08-13T21:50:00.931Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-08-13T21:50:00.931Zx package-manifest.toml, 30053 bytes, 59 tape blocks
782024-08-13T21:50:00.931Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-08-13T21:50:00.931Zx target/release/omicron-package, 33056752 bytes, 64564 tape blocks
802024-08-13T21:50:00.931Zx target/release/xtask, 11873992 bytes, 23192 tape blocks
812024-08-13T21:50:00.931Zx target/debug/bootstrap, 196040728 bytes, 382893 tape blocks
822024-08-13T21:50:00.931Zx tests/bootstrap-ad4024d5be614f9b, 24097456 bytes, 47066 tape blocks
832024-08-13T21:50:00.931Zx tests/commtest-4d19f22d943becd5, 25154816 bytes, 49131 tape blocks
842024-08-13T21:50:00.931Zx tests/dhcp_server-52e57b839620e6a8, 24097464 bytes, 47066 tape blocks
852024-08-13T21:50:00.931Zx tests/end_to_end_tests-e552280813eeb84d, 207111728 bytes, 404516 tape blocks
862024-08-13T21:50:00.931Zx out/clickhouse.tar.gz, 228513991 bytes, 446317 tape blocks
872024-08-13T21:50:00.931Zx out/clickhouse_keeper.tar.gz, 228495177 bytes, 446280 tape blocks
882024-08-13T21:50:00.931Zx out/cockroachdb.tar.gz, 134941795 bytes, 263559 tape blocks
892024-08-13T21:50:00.931Zx out/crucible-dtrace.tar, 85504 bytes, 167 tape blocks
902024-08-13T21:50:00.931Zx out/crucible-pantry-zone.tar.gz, 28495704 bytes, 55656 tape blocks
912024-08-13T21:50:00.931Zx out/crucible-zone.tar.gz, 39075987 bytes, 76321 tape blocks
922024-08-13T21:50:00.931Zx out/external-dns.tar.gz, 25763516 bytes, 50320 tape blocks
932024-08-13T21:50:00.931Zx out/internal-dns.tar.gz, 25764630 bytes, 50322 tape blocks
942024-08-13T21:50:00.931Zx out/mg-ddm-gz.tar, 63430656 bytes, 123888 tape blocks
952024-08-13T21:50:00.931Zx out/nexus.tar.gz, 88947107 bytes, 173725 tape blocks
962024-08-13T21:50:00.931Zx out/ntp.tar.gz, 9193211 bytes, 17956 tape blocks
972024-08-13T21:50:00.931Zx out/omicron-gateway-softnpu.tar.gz, 13906949 bytes, 27163 tape blocks
982024-08-13T21:50:00.931Zx out/omicron-sled-agent.tar, 98963968 bytes, 193289 tape blocks
992024-08-13T21:50:00.931Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1002024-08-13T21:50:00.932Zx out/oximeter.tar.gz, 43587925 bytes, 85133 tape blocks
1012024-08-13T21:50:00.932Zx out/oxlog.tar, 3016192 bytes, 5891 tape blocks
1022024-08-13T21:50:00.932Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1032024-08-13T21:50:00.932Zx out/propolis-server.tar.gz, 66857321 bytes, 130581 tape blocks
1042024-08-13T21:50:00.932Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1052024-08-13T21:50:00.932Zx out/switch-softnpu.tar.gz, 211178425 bytes, 412458 tape blocks
1062024-08-13T21:50:00.955Z
1072024-08-13T21:50:00.955Zreal 10.543238706
1082024-08-13T21:50:00.955Zuser 9.347593234
1092024-08-13T21:50:00.955Zsys 2.113384172
1102024-08-13T21:50:00.955Ztrap 0.000431858
1112024-08-13T21:50:00.955Ztflt 0.000000000
1122024-08-13T21:50:00.955Zdflt 0.000000000
1132024-08-13T21:50:00.955Zkflt 0.000000000
1142024-08-13T21:50:00.955Zlock 0.000000000
1152024-08-13T21:50:00.955Zslp 9.373176948
1162024-08-13T21:50:00.955Zlat 0.249887062
1172024-08-13T21:50:00.956Zstop 0.000121262
1182024-08-13T21:50:00.956Z+ bmat address ls
1192024-08-13T21:50:00.956ZNAME CIDR FIRST LAST COUNT
1202024-08-13T21:50:00.956Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1212024-08-13T21:50:00.956Z++ bmat address ls -f extra -Ho first,last,count
1222024-08-13T21:50:00.956Z+ set -- 10.151.1.164 10.151.1.227 64
1232024-08-13T21:50:00.956Z+ EXTRA_IP_START=10.151.1.164
1242024-08-13T21:50:00.956Z+ EXTRA_IP_END=10.151.1.227
1252024-08-13T21:50:00.956Z+ EXTRA_IP_COUNT=64
1262024-08-13T21:50:00.956Z+ (( EXTRA_IP_COUNT >= 32 ))
1272024-08-13T21:50:00.956Z+ EXTRA_IP_BASE=10.151.1
1282024-08-13T21:50:00.956Z+ EXTRA_IP_FOCTET=164
1292024-08-13T21:50:00.956Z+ EXTRA_IP_LOCTET=227
1302024-08-13T21:50:00.956Z+ SERVICE_IP_POOL_START=10.151.1.164
1312024-08-13T21:50:00.956Z+ SERVICE_IP_POOL_END=10.151.1.173
1322024-08-13T21:50:00.956Z+ DNS_IP1=10.151.1.164
1332024-08-13T21:50:00.956Z+ DNS_IP2=10.151.1.165
1342024-08-13T21:50:00.956Z+ UPLINK_IP=10.151.1.174
1352024-08-13T21:50:00.956Z+ IPPOOL_START=10.151.1.175
1362024-08-13T21:50:00.956Z+ IPPOOL_END=10.151.1.227
1372024-08-13T21:50:00.956Z++ ipadm show-addr -po type,addr
1382024-08-13T21:50:00.956Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1392024-08-13T21:50:00.956Z+ GATEWAY_IP=10.151.1.100
1402024-08-13T21:50:00.956Z+ [[ -n 10.151.1.100 ]]
1412024-08-13T21:50:00.956Z+ ping -s 10.151.1.100 56 1
1422024-08-13T21:50:00.956ZPING 10.151.1.100: 56 data bytes
1432024-08-13T21:50:00.956Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.026 ms
1442024-08-13T21:50:00.956Z
1452024-08-13T21:50:00.956Z----10.151.1.100 PING Statistics----
1462024-08-13T21:50:00.956Z1 packets transmitted, 1 packets received, 0% packet loss
1472024-08-13T21:50:00.956Zround-trip (ms) min/avg/max/stddev = 0.026/0.026/0.026/-nan
1482024-08-13T21:50:00.956Z++ arp -an
1492024-08-13T21:50:00.956Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1502024-08-13T21:50:00.980Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1512024-08-13T21:50:00.980Z+ routeadm -e ipv4-forwarding -u
1522024-08-13T21:50:01.073Z+ PXA_START=10.151.1.164
1532024-08-13T21:50:01.073Z+ PXA_END=10.151.1.227
1542024-08-13T21:50:01.096Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1552024-08-13T21:50:01.212Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1562024-08-13T21:50:01.236ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1572024-08-13T21:50:01.290Zcreating virtual hardware
1582024-08-13T21:50:01.313Zcreating /scratch/m2_0.vdev
1592024-08-13T21:50:01.313Zcreating /scratch/m2_1.vdev
1602024-08-13T21:50:01.313Zcreating /scratch/u2_0.vdev
1612024-08-13T21:50:01.313Zcreating /scratch/u2_1.vdev
1622024-08-13T21:50:01.313Zcreating /scratch/u2_2.vdev
1632024-08-13T21:50:01.313Zcreating /scratch/u2_3.vdev
1642024-08-13T21:50:01.313Zcreating /scratch/u2_4.vdev
1652024-08-13T21:50:01.313Zcreating /scratch/u2_5.vdev
1662024-08-13T21:50:01.313Zcreating /scratch/u2_6.vdev
1672024-08-13T21:50:01.313Zcreating /scratch/u2_7.vdev
1682024-08-13T21:50:01.313Zcreating /scratch/u2_8.vdev
1692024-08-13T21:50:01.337ZSimnet net0/sc0_0 exists
1702024-08-13T21:50:01.360ZSimnet net1/sc1_0 exists
1712024-08-13T21:50:01.383ZVnic sc0_1 exists
1722024-08-13T21:50:13.927ZUsing 10.151.1.100 as gateway ip
1732024-08-13T21:50:13.927Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1742024-08-13T21:50:13.927Zconfiguring SoftNPU ARP entry
1752024-08-13T21:50:13.954Zconfiguring SoftNPU proxy ARP
1762024-08-13T21:50:14.006ZSoftNPU state:
1772024-08-13T21:50:14.006Z local v6:
1782024-08-13T21:50:14.006Z local v4:
1792024-08-13T21:50:14.006Z router v6:
1802024-08-13T21:50:14.006Z router v4_idx:
1812024-08-13T21:50:14.006Z router v4_routes:
1822024-08-13T21:50:14.006Z resolver v4:
1832024-08-13T21:50:14.007Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1842024-08-13T21:50:14.007Z resolver v6:
1852024-08-13T21:50:14.007Z nat v4:
1862024-08-13T21:50:14.007Z nat_v6:
1872024-08-13T21:50:14.007Z port_mac:
1882024-08-13T21:50:14.007Z proxy arp:
1892024-08-13T21:50:14.007Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
1902024-08-13T21:50:14.007Zcreated virtual hardware
1912024-08-13T21:50:14.030Z
1922024-08-13T21:50:14.030Zreal 12.791090202
1932024-08-13T21:50:14.030Zuser 0.633822947
1942024-08-13T21:50:14.030Zsys 3.223960250
1952024-08-13T21:50:14.030Ztrap 0.000063491
1962024-08-13T21:50:14.030Ztflt 0.000341601
1972024-08-13T21:50:14.030Zdflt 0.000375569
1982024-08-13T21:50:14.030Zkflt 0.000008540
1992024-08-13T21:50:14.030Zlock 9:53.457364932
2002024-08-13T21:50:14.030Zslp 38.570063936
2012024-08-13T21:50:14.030Zlat 0.071246122
2022024-08-13T21:50:14.030Zstop 0.361811205
2032024-08-13T21:50:14.030Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2042024-08-13T21:50:14.075Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2052024-08-13T21:50:14.075Z+ diff -u pkg/config.toml~ pkg/config.toml
2062024-08-13T21:50:14.075Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2072024-08-13T21:50:14.075Z+++ pkg/config.toml Tue Aug 13 21:50:13 2024
2082024-08-13T21:50:14.075Z@@ -29,18 +29,18 @@
2092024-08-13T21:50:14.075Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2102024-08-13T21:50:14.075Z # followed by a string that is embedded into their fake serial values.
2112024-08-13T21:50:14.076Z vdevs = [
2122024-08-13T21:50:14.076Z- "m2_0.vdev",
2132024-08-13T21:50:14.076Z- "m2_1.vdev",
2142024-08-13T21:50:14.076Z+ "/scratch/m2_0.vdev",
2152024-08-13T21:50:14.076Z+ "/scratch/m2_1.vdev",
2162024-08-13T21:50:14.076Z
2172024-08-13T21:50:14.076Z- "u2_0.vdev",
2182024-08-13T21:50:14.076Z- "u2_1.vdev",
2192024-08-13T21:50:14.076Z- "u2_2.vdev",
2202024-08-13T21:50:14.076Z- "u2_3.vdev",
2212024-08-13T21:50:14.076Z- "u2_4.vdev",
2222024-08-13T21:50:14.076Z- "u2_5.vdev",
2232024-08-13T21:50:14.076Z- "u2_6.vdev",
2242024-08-13T21:50:14.076Z- "u2_7.vdev",
2252024-08-13T21:50:14.076Z- "u2_8.vdev",
2262024-08-13T21:50:14.076Z+ "/scratch/u2_0.vdev",
2272024-08-13T21:50:14.076Z+ "/scratch/u2_1.vdev",
2282024-08-13T21:50:14.076Z+ "/scratch/u2_2.vdev",
2292024-08-13T21:50:14.076Z+ "/scratch/u2_3.vdev",
2302024-08-13T21:50:14.076Z+ "/scratch/u2_4.vdev",
2312024-08-13T21:50:14.076Z+ "/scratch/u2_5.vdev",
2322024-08-13T21:50:14.076Z+ "/scratch/u2_6.vdev",
2332024-08-13T21:50:14.076Z+ "/scratch/u2_7.vdev",
2342024-08-13T21:50:14.076Z+ "/scratch/u2_8.vdev",
2352024-08-13T21:50:14.076Z ]
2362024-08-13T21:50:14.076Z
2372024-08-13T21:50:14.076Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2382024-08-13T21:50:14.076Z+ true
2392024-08-13T21:50:14.076Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2402024-08-13T21:50:14.076Z+ SILO_NAME=recovery
2412024-08-13T21:50:14.076Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2422024-08-13T21:50:14.076Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2432024-08-13T21:50:14.076Z+ sed -i~ '
2442024-08-13T21:50:14.076Z /^external_dns_ips/c\
2452024-08-13T21:50:14.076Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2462024-08-13T21:50:14.077Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2472024-08-13T21:50:14.077Z /^first/c\
2482024-08-13T21:50:14.077Zfirst = "10.151.1.164"
2492024-08-13T21:50:14.077Z /^last/c\
2502024-08-13T21:50:14.077Zlast = "10.151.1.173"
2512024-08-13T21:50:14.077Z }
2522024-08-13T21:50:14.077Z /^infra_ip_first/c\
2532024-08-13T21:50:14.077Zinfra_ip_first = "10.151.1.174"
2542024-08-13T21:50:14.077Z /^infra_ip_last/c\
2552024-08-13T21:50:14.077Zinfra_ip_last = "10.151.1.174"
2562024-08-13T21:50:14.077Z /^\[\[rack_network_config.ports/,/^$/ {
2572024-08-13T21:50:14.077Z /^routes/c\
2582024-08-13T21:50:14.077Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2592024-08-13T21:50:14.077Z /^addresses/c\
2602024-08-13T21:50:14.077Zaddresses = \[{address = "10.151.1.174/24"} \]
2612024-08-13T21:50:14.077Z }
2622024-08-13T21:50:14.077Z' pkg/config-rss.toml
2632024-08-13T21:50:14.077Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2642024-08-13T21:50:14.077Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2652024-08-13T21:50:14.077Z+++ pkg/config-rss.toml Tue Aug 13 21:50:13 2024
2662024-08-13T21:50:14.077Z@@ -33,7 +33,7 @@
2672024-08-13T21:50:14.077Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2682024-08-13T21:50:14.077Z # must be contained in one of the "internal services" IP Pool ranges listed
2692024-08-13T21:50:14.077Z # below.
2702024-08-13T21:50:14.077Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2712024-08-13T21:50:14.077Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2722024-08-13T21:50:14.077Z
2732024-08-13T21:50:14.077Z # Initial TLS certificates for the external API
2742024-08-13T21:50:14.077Z #
2752024-08-13T21:50:14.077Z@@ -69,8 +69,8 @@
2762024-08-13T21:50:14.077Z #
2772024-08-13T21:50:14.077Z # For more on this and what to put here, see docs/how-to-run.adoc.
2782024-08-13T21:50:14.077Z [[internal_services_ip_pool_ranges]]
2792024-08-13T21:50:14.077Z-first = "192.168.1.20"
2802024-08-13T21:50:14.077Z-last = "192.168.1.29"
2812024-08-13T21:50:14.077Z+first = "10.151.1.164"
2822024-08-13T21:50:14.078Z+last = "10.151.1.173"
2832024-08-13T21:50:14.078Z
2842024-08-13T21:50:14.078Z # TODO - this configuration is subject to change going forward. Ultimately these
2852024-08-13T21:50:14.078Z # parameters should be provided to the control plane via wicket, but we need to
2862024-08-13T21:50:14.078Z@@ -91,8 +91,8 @@
2872024-08-13T21:50:14.078Z # A range of IP addresses used by Boundary Services on the external network. In
2882024-08-13T21:50:14.078Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2892024-08-13T21:50:14.078Z # With softnpu, only one address is used.
2902024-08-13T21:50:14.078Z-infra_ip_first = "192.168.1.30"
2912024-08-13T21:50:14.078Z-infra_ip_last = "192.168.1.30"
2922024-08-13T21:50:14.078Z+infra_ip_first = "10.151.1.174"
2932024-08-13T21:50:14.078Z+infra_ip_last = "10.151.1.174"
2942024-08-13T21:50:14.078Z
2952024-08-13T21:50:14.078Z # Configurations for BGP routers to run on the scrimlets.
2962024-08-13T21:50:14.078Z bgp = []
2972024-08-13T21:50:14.078Z@@ -100,9 +100,9 @@
2982024-08-13T21:50:14.078Z # You can configure multiple uplinks by repeating the following stanza
2992024-08-13T21:50:14.078Z [[rack_network_config.ports]]
3002024-08-13T21:50:14.078Z # Routes associated with this port.
3012024-08-13T21:50:14.078Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3022024-08-13T21:50:14.078Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3032024-08-13T21:50:14.078Z # Addresses associated with this port.
3042024-08-13T21:50:14.103Z-addresses = [{address = "192.168.1.30/24"}]
3052024-08-13T21:50:14.103Z+addresses = [{address = "10.151.1.174/24"} ]
3062024-08-13T21:50:14.103Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3072024-08-13T21:50:14.103Z port = "qsfp0"
3082024-08-13T21:50:14.103Z # The speed of this port.
3092024-08-13T21:50:14.103Z+ true
3102024-08-13T21:50:14.103Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3112024-08-13T21:50:14.103Za pkg/config-rss.toml 7K
3122024-08-13T21:50:14.103Za pkg/config.toml 4K
3132024-08-13T21:50:14.103Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3142024-08-13T21:50:14.103Z+ TLS_NAME=recovery.sys.oxide.test
3152024-08-13T21:50:14.103Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3162024-08-13T21:50:15.512Z.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+......+.......+..+.+..+.+.........+......+..+.......+...+...+.....+......+.+........+................+...+...+..+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.................+.....+.+..+.............+......+..............+.+......+..+.............+...+....................+.......+............+......+..+....+.....+.............+...........+....+.....+...............+.+..+...+.....................+.+........+.......+..+.+....................+.+.........+......+..............................+........+..........+......+...........+.....................+...+.+...+.................+..........+......+..+...+...+....+...+........+......+.+........+......+.............+..+....+......+....................+.........+......+.+.....+.......+.....+...+....+...+..+.............+......+..+.........+...+......+....+...+...+......+.....+.........+.......+..+...+.................................+....+.....+...+............+......+.......+..+......+.....................+..........+...........+...+...............+....+..+...............+....+.........+...+...+..+...+....+..+...+................+.....+.+...............+...+...........+....+...+.........+.....+....+.....+.......+..+.+..+..................+.........+......+.+.....+......+.......+........+...+......+.............+......+.........+...............+......+...........+.+............+..+......+...+....+........+..........+..+...............+...+....+.........+.........+...........+.+..............+.+...+............+...+...........+.......+............+......+............+........+....+.....+............+.+...+...........................+...............+...+......+.....+....+............+..+...+...+......+.+........+.+..............+.+...+.....+...+....+......+.................+..........+...............+...+..+...+...+.......+..+.+............+..+...+.........+...+.......+...+.................+.............+............+...+............+....................+.+........+.......+...............+...+..+...+.......+..+.....................+................+......+...............+.....+....+...+...+..................+..+...+....+........+....+..............+....+.....+.+.....+....+..+....+......+.........+............+.....+...+.+.....+.............+........+....+..............+.........+.......+....................+.............+..+................+...+.........+..+....+..+.........+......+.............+..+...+..........+..............+......+.+...+..+...+......+.+...+...+.....+.........+...+.+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-08-13T21:50:15.743Z.+.......+...........+...+.......+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+...+.........+...+.....+......+.......+........+.+...+..................+..+.+..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.....+.+.........+...........+...+..........+.........+.....+.+......+.....+...+...+.............+..+............+.......+......+..+......+.......+........+..........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3182024-08-13T21:50:15.766Z-----
3192024-08-13T21:50:15.789Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3202024-08-13T21:50:15.789Za pkg/initial-tls-cert.pem 2K
3212024-08-13T21:50:15.790Za pkg/initial-tls-key.pem 4K
3222024-08-13T21:50:15.790Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3232024-08-13T21:50:15.790Z+ rmdir pkg
3242024-08-13T21:50:15.790Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3252024-08-13T21:50:15.790Z+ pfexec mkdir -p /usr/oxide
3262024-08-13T21:50:15.790Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3272024-08-13T21:50:16.519Z+ pfexec chmod +x /usr/oxide/oxide
3282024-08-13T21:50:16.544Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3292024-08-13T21:50:34.864Z+ OMICRON_NO_UNINSTALL=1
3302024-08-13T21:50:34.864Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3312024-08-13T21:50:34.887ZLogging to: /opt/oxide/work/out/LOG
3322024-08-13T21:50:35.454Z
3332024-08-13T21:50:35.479Zreal 0.584735644
3342024-08-13T21:50:35.479Zuser 0.118816657
3352024-08-13T21:50:35.479Zsys 2.637623309
3362024-08-13T21:50:35.479Ztrap 0.000005879
3372024-08-13T21:50:35.479Ztflt 0.000000000
3382024-08-13T21:50:35.479Zdflt 0.000562107
3392024-08-13T21:50:35.479Zkflt 0.000004410
3402024-08-13T21:50:35.479Zlock 52.876956994
3412024-08-13T21:50:35.479Zslp 0.867283133
3422024-08-13T21:50:35.479Zlat 0.002801959
3432024-08-13T21:50:35.479Zstop 0.198021961
3442024-08-13T21:50:35.479Z+ retry=0
3452024-08-13T21:50:35.479Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3462024-08-13T21:50:35.479Z+ [[ 0 -gt 30 ]]
3472024-08-13T21:50:35.479Z+ sleep 1
3482024-08-13T21:50:36.470Z+ retry=1
3492024-08-13T21:50:36.470Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3502024-08-13T21:50:36.493Z+ [[ 1 -gt 30 ]]
3512024-08-13T21:50:36.493Z+ sleep 1
3522024-08-13T21:50:37.485Z+ retry=2
3532024-08-13T21:50:37.486Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3542024-08-13T21:50:37.509Z+ [[ 2 -gt 30 ]]
3552024-08-13T21:50:37.509Z+ sleep 1
3562024-08-13T21:50:38.502Z+ retry=3
3572024-08-13T21:50:38.502Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3582024-08-13T21:50:56.940Z+ [[ 3 -gt 30 ]]
3592024-08-13T21:50:56.940Z+ sleep 1
3602024-08-13T21:50:57.944Z+ retry=4
3612024-08-13T21:50:57.944Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3622024-08-13T21:50:57.968Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3632024-08-13T21:50:57.992Zlocal v6:
3642024-08-13T21:50:57.992Zfe80::3047:76ff:fe52:d424
3652024-08-13T21:50:57.992Zlocal v4:
3662024-08-13T21:50:57.992Zrouter v6:
3672024-08-13T21:50:57.992Zrouter v4_idx:
3682024-08-13T21:50:57.992Zrouter v4_routes:
3692024-08-13T21:50:57.992Zresolver v4:
3702024-08-13T21:50:57.992Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3712024-08-13T21:50:57.992Zresolver v6:
3722024-08-13T21:50:57.992Zfe80::3047:76ff:fe52:d424 -> 32:47:76:52:d4:24
3732024-08-13T21:50:57.993Zfe80::8497:78ff:fe99:43ef -> 86:97:78:99:43:ef
3742024-08-13T21:50:57.993Znat v4:
3752024-08-13T21:50:57.993Znat_v6:
3762024-08-13T21:50:57.993Zport_mac:
3772024-08-13T21:50:57.993Z1: a8:40:25:22:53:d1
3782024-08-13T21:50:57.993Z1000: a8:40:25:22:53:d0
3792024-08-13T21:50:57.993Zproxy arp:
3802024-08-13T21:50:57.993Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
3812024-08-13T21:50:57.993Z+ retry=0
3822024-08-13T21:50:57.993Z+++ zoneadm list -n
3832024-08-13T21:50:57.993Z+++ grep oxz_ntp
3842024-08-13T21:50:58.016Z++ pfexec svcs -z -Hostate oxide/ntp
3852024-08-13T21:50:58.016Zsvcs: zone '-Hostate': entity not found
3862024-08-13T21:50:58.016Z++ true
3872024-08-13T21:50:58.016Z+ [[ '' != online ]]
3882024-08-13T21:50:58.016Z+ [[ 0 -gt 60 ]]
3892024-08-13T21:50:58.016Z+ sleep 1
3902024-08-13T21:50:59.003Z+ retry=1
3912024-08-13T21:50:59.027Z+++ zoneadm list -n
3922024-08-13T21:50:59.027Z+++ grep oxz_ntp
3932024-08-13T21:50:59.027Z++ pfexec svcs -z -Hostate oxide/ntp
3942024-08-13T21:50:59.027Zsvcs: zone '-Hostate': entity not found
3952024-08-13T21:50:59.027Z++ true
3962024-08-13T21:50:59.027Z+ [[ '' != online ]]
3972024-08-13T21:50:59.027Z+ [[ 1 -gt 60 ]]
3982024-08-13T21:50:59.027Z+ sleep 1
3992024-08-13T21:51:00.026Z+ retry=2
4002024-08-13T21:51:00.050Z+++ zoneadm list -n
4012024-08-13T21:51:00.050Z+++ grep oxz_ntp
4022024-08-13T21:51:00.050Z++ pfexec svcs -z -Hostate oxide/ntp
4032024-08-13T21:51:00.050Zsvcs: zone '-Hostate': entity not found
4042024-08-13T21:51:00.050Z++ true
4052024-08-13T21:51:00.050Z+ [[ '' != online ]]
4062024-08-13T21:51:00.050Z+ [[ 2 -gt 60 ]]
4072024-08-13T21:51:00.050Z+ sleep 1
4082024-08-13T21:51:01.047Z+ retry=3
4092024-08-13T21:51:01.070Z+++ zoneadm list -n
4102024-08-13T21:51:01.071Z+++ grep oxz_ntp
4112024-08-13T21:51:01.071Z++ pfexec svcs -z -Hostate oxide/ntp
4122024-08-13T21:51:01.071Zsvcs: zone '-Hostate': entity not found
4132024-08-13T21:51:01.071Z++ true
4142024-08-13T21:51:01.071Z+ [[ '' != online ]]
4152024-08-13T21:51:01.071Z+ [[ 3 -gt 60 ]]
4162024-08-13T21:51:01.071Z+ sleep 1
4172024-08-13T21:51:02.068Z+ retry=4
4182024-08-13T21:51:02.093Z+++ zoneadm list -n
4192024-08-13T21:51:02.093Z+++ grep oxz_ntp
4202024-08-13T21:51:02.093Z++ pfexec svcs -z -Hostate oxide/ntp
4212024-08-13T21:51:02.093Zsvcs: zone '-Hostate': entity not found
4222024-08-13T21:51:02.093Z++ true
4232024-08-13T21:51:02.093Z+ [[ '' != online ]]
4242024-08-13T21:51:02.093Z+ [[ 4 -gt 60 ]]
4252024-08-13T21:51:02.093Z+ sleep 1
4262024-08-13T21:51:03.090Z+ retry=5
4272024-08-13T21:51:03.113Z+++ zoneadm list -n
4282024-08-13T21:51:03.113Z+++ grep oxz_ntp
4292024-08-13T21:51:03.113Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4302024-08-13T21:51:03.136Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4312024-08-13T21:51:03.136Z++ true
4322024-08-13T21:51:03.136Z+ [[ '' != online ]]
4332024-08-13T21:51:03.136Z+ [[ 5 -gt 60 ]]
4342024-08-13T21:51:03.136Z+ sleep 1
4352024-08-13T21:51:04.122Z+ retry=6
4362024-08-13T21:51:04.145Z+++ zoneadm list -n
4372024-08-13T21:51:04.145Z+++ grep oxz_ntp
4382024-08-13T21:51:04.145Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4392024-08-13T21:51:04.170Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4402024-08-13T21:51:04.170Z++ true
4412024-08-13T21:51:04.170Z+ [[ '' != online ]]
4422024-08-13T21:51:04.170Z+ [[ 6 -gt 60 ]]
4432024-08-13T21:51:04.170Z+ sleep 1
4442024-08-13T21:51:05.155Z+ retry=7
4452024-08-13T21:51:05.179Z+++ zoneadm list -n
4462024-08-13T21:51:05.179Z+++ grep oxz_ntp
4472024-08-13T21:51:05.179Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4482024-08-13T21:51:05.202Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4492024-08-13T21:51:05.202Z++ true
4502024-08-13T21:51:05.202Z+ [[ '' != online ]]
4512024-08-13T21:51:05.202Z+ [[ 7 -gt 60 ]]
4522024-08-13T21:51:05.202Z+ sleep 1
4532024-08-13T21:51:06.183Z+ retry=8
4542024-08-13T21:51:06.206Z+++ zoneadm list -n
4552024-08-13T21:51:06.206Z+++ grep oxz_ntp
4562024-08-13T21:51:06.206Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4572024-08-13T21:51:06.229Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4582024-08-13T21:51:06.229Z++ true
4592024-08-13T21:51:06.229Z+ [[ '' != online ]]
4602024-08-13T21:51:06.229Z+ [[ 8 -gt 60 ]]
4612024-08-13T21:51:06.229Z+ sleep 1
4622024-08-13T21:51:07.216Z+ retry=9
4632024-08-13T21:51:07.239Z+++ zoneadm list -n
4642024-08-13T21:51:07.239Z+++ grep oxz_ntp
4652024-08-13T21:51:07.239Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4662024-08-13T21:51:07.239Z+ [[ offline != online ]]
4672024-08-13T21:51:07.239Z+ [[ 9 -gt 60 ]]
4682024-08-13T21:51:07.239Z+ sleep 1
4692024-08-13T21:51:08.238Z+ retry=10
4702024-08-13T21:51:08.261Z+++ zoneadm list -n
4712024-08-13T21:51:08.261Z+++ grep oxz_ntp
4722024-08-13T21:51:08.261Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4732024-08-13T21:51:08.261Z+ [[ offline != online ]]
4742024-08-13T21:51:08.261Z+ [[ 10 -gt 60 ]]
4752024-08-13T21:51:08.261Z+ sleep 1
4762024-08-13T21:51:09.261Z+ retry=11
4772024-08-13T21:51:09.284Z+++ zoneadm list -n
4782024-08-13T21:51:09.284Z+++ grep oxz_ntp
4792024-08-13T21:51:09.284Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4802024-08-13T21:51:09.284Z+ [[ offline != online ]]
4812024-08-13T21:51:09.284Z+ [[ 11 -gt 60 ]]
4822024-08-13T21:51:09.284Z+ sleep 1
4832024-08-13T21:51:10.282Z+ retry=12
4842024-08-13T21:51:10.307Z+++ zoneadm list -n
4852024-08-13T21:51:10.307Z+++ grep oxz_ntp
4862024-08-13T21:51:10.307Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4872024-08-13T21:51:10.307Z+ [[ offline != online ]]
4882024-08-13T21:51:10.307Z+ [[ 12 -gt 60 ]]
4892024-08-13T21:51:10.307Z+ sleep 1
4902024-08-13T21:51:11.304Z+ retry=13
4912024-08-13T21:51:11.327Z+++ zoneadm list -n
4922024-08-13T21:51:11.327Z+++ grep oxz_ntp
4932024-08-13T21:51:11.327Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
4942024-08-13T21:51:11.327Z+ [[ offline != online ]]
4952024-08-13T21:51:11.327Z+ [[ 13 -gt 60 ]]
4962024-08-13T21:51:11.327Z+ sleep 1
4972024-08-13T21:51:12.326Z+ retry=14
4982024-08-13T21:51:12.349Z+++ zoneadm list -n
4992024-08-13T21:51:12.349Z+++ grep oxz_ntp
5002024-08-13T21:51:12.349Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
5012024-08-13T21:51:12.349Z+ [[ offline != online ]]
5022024-08-13T21:51:12.349Z+ [[ 14 -gt 60 ]]
5032024-08-13T21:51:12.349Z+ sleep 1
5042024-08-13T21:51:13.349Z+ retry=15
5052024-08-13T21:51:13.372Z+++ zoneadm list -n
5062024-08-13T21:51:13.372Z+++ grep oxz_ntp
5072024-08-13T21:51:13.372Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
5082024-08-13T21:51:13.372Z+ [[ offline != online ]]
5092024-08-13T21:51:13.372Z+ [[ 15 -gt 60 ]]
5102024-08-13T21:51:13.372Z+ sleep 1
 
5112024-08-13T21:51:13.758Zbuskin console login: Aug 13 21:51:12 buskin ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5122024-08-13T21:51:14.371Z+ retry=16
5132024-08-13T21:51:14.396Z+++ zoneadm list -n
5142024-08-13T21:51:14.396Z+++ grep oxz_ntp
5152024-08-13T21:51:14.396Z++ pfexec svcs -z oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3 -Hostate oxide/ntp
5162024-08-13T21:51:14.396Z+ [[ online != online ]]
5172024-08-13T21:51:14.396Z+ echo 'Waited for chrony: 16s'
5182024-08-13T21:51:14.396ZWaited for chrony: 16s
5192024-08-13T21:51:14.396Z+ retry=0
5202024-08-13T21:51:14.396Z+ zoneadm list
5212024-08-13T21:51:14.396Z+ grep nexus
5222024-08-13T21:51:14.420Z+ [[ 0 -gt 300 ]]
5232024-08-13T21:51:14.420Z+ sleep 1
5242024-08-13T21:51:15.401Z+ retry=1
5252024-08-13T21:51:15.424Z+ zoneadm list
5262024-08-13T21:51:15.424Z+ grep nexus
5272024-08-13T21:51:15.424Z+ [[ 1 -gt 300 ]]
5282024-08-13T21:51:15.424Z+ sleep 1
5292024-08-13T21:51:16.412Z+ retry=2
5302024-08-13T21:51:16.435Z+ zoneadm list
5312024-08-13T21:51:16.435Z+ grep nexus
5322024-08-13T21:51:16.435Z+ [[ 2 -gt 300 ]]
5332024-08-13T21:51:16.435Z+ sleep 1
5342024-08-13T21:51:17.422Z+ retry=3
5352024-08-13T21:51:17.445Z+ zoneadm list
5362024-08-13T21:51:17.445Z+ grep nexus
5372024-08-13T21:51:17.445Z+ [[ 3 -gt 300 ]]
5382024-08-13T21:51:17.445Z+ sleep 1
5392024-08-13T21:51:18.432Z+ retry=4
5402024-08-13T21:51:18.456Z+ zoneadm list
5412024-08-13T21:51:18.456Z+ grep nexus
5422024-08-13T21:51:18.456Z+ [[ 4 -gt 300 ]]
5432024-08-13T21:51:18.456Z+ sleep 1
5442024-08-13T21:51:19.444Z+ retry=5
5452024-08-13T21:51:19.467Z+ zoneadm list
5462024-08-13T21:51:19.467Z+ grep nexus
5472024-08-13T21:51:19.468Z+ [[ 5 -gt 300 ]]
5482024-08-13T21:51:19.468Z+ sleep 1
5492024-08-13T21:51:20.454Z+ retry=6
5502024-08-13T21:51:20.477Z+ zoneadm list
5512024-08-13T21:51:20.477Z+ grep nexus
5522024-08-13T21:51:20.477Z+ [[ 6 -gt 300 ]]
5532024-08-13T21:51:20.477Z+ sleep 1
5542024-08-13T21:51:21.464Z+ retry=7
5552024-08-13T21:51:21.488Z+ zoneadm list
5562024-08-13T21:51:21.488Z+ grep nexus
5572024-08-13T21:51:21.488Z+ [[ 7 -gt 300 ]]
5582024-08-13T21:51:21.488Z+ sleep 1
5592024-08-13T21:51:22.475Z+ retry=8
5602024-08-13T21:51:22.498Z+ zoneadm list
5612024-08-13T21:51:22.498Z+ grep nexus
5622024-08-13T21:51:22.498Z+ [[ 8 -gt 300 ]]
5632024-08-13T21:51:22.498Z+ sleep 1
5642024-08-13T21:51:23.486Z+ retry=9
5652024-08-13T21:51:23.509Z+ zoneadm list
5662024-08-13T21:51:23.509Z+ grep nexus
5672024-08-13T21:51:23.509Z+ [[ 9 -gt 300 ]]
5682024-08-13T21:51:23.509Z+ sleep 1
5692024-08-13T21:51:24.497Z+ retry=10
5702024-08-13T21:51:24.522Z+ zoneadm list
5712024-08-13T21:51:24.522Z+ grep nexus
5722024-08-13T21:51:24.522Z+ [[ 10 -gt 300 ]]
5732024-08-13T21:51:24.522Z+ sleep 1
5742024-08-13T21:51:25.507Z+ retry=11
5752024-08-13T21:51:25.530Z+ zoneadm list
5762024-08-13T21:51:25.530Z+ grep nexus
5772024-08-13T21:51:25.530Z+ [[ 11 -gt 300 ]]
5782024-08-13T21:51:25.530Z+ sleep 1
5792024-08-13T21:51:26.517Z+ retry=12
5802024-08-13T21:51:26.541Z+ zoneadm list
5812024-08-13T21:51:26.541Z+ grep nexus
5822024-08-13T21:51:26.541Z+ [[ 12 -gt 300 ]]
5832024-08-13T21:51:26.541Z+ sleep 1
5842024-08-13T21:51:27.527Z+ retry=13
5852024-08-13T21:51:27.550Z+ zoneadm list
5862024-08-13T21:51:27.550Z+ grep nexus
5872024-08-13T21:51:27.550Z+ [[ 13 -gt 300 ]]
5882024-08-13T21:51:27.550Z+ sleep 1
5892024-08-13T21:51:28.540Z+ retry=14
5902024-08-13T21:51:28.563Z+ zoneadm list
5912024-08-13T21:51:28.563Z+ grep nexus
5922024-08-13T21:51:28.563Z+ [[ 14 -gt 300 ]]
5932024-08-13T21:51:28.563Z+ sleep 1
5942024-08-13T21:51:29.549Z+ retry=15
5952024-08-13T21:51:29.574Z+ zoneadm list
5962024-08-13T21:51:29.574Z+ grep nexus
5972024-08-13T21:51:29.575Z+ [[ 15 -gt 300 ]]
5982024-08-13T21:51:29.575Z+ sleep 1
5992024-08-13T21:51:30.559Z+ retry=16
6002024-08-13T21:51:30.584Z+ zoneadm list
6012024-08-13T21:51:30.584Z+ grep nexus
6022024-08-13T21:51:30.584Z+ [[ 16 -gt 300 ]]
6032024-08-13T21:51:30.584Z+ sleep 1
6042024-08-13T21:51:31.570Z+ retry=17
6052024-08-13T21:51:31.593Z+ zoneadm list
6062024-08-13T21:51:31.593Z+ grep nexus
6072024-08-13T21:51:31.593Z+ [[ 17 -gt 300 ]]
6082024-08-13T21:51:31.593Z+ sleep 1
6092024-08-13T21:51:32.580Z+ retry=18
6102024-08-13T21:51:32.603Z+ zoneadm list
6112024-08-13T21:51:32.603Z+ grep nexus
6122024-08-13T21:51:32.603Z+ [[ 18 -gt 300 ]]
6132024-08-13T21:51:32.604Z+ sleep 1
6142024-08-13T21:51:33.590Z+ retry=19
6152024-08-13T21:51:33.614Z+ zoneadm list
6162024-08-13T21:51:33.614Z+ grep nexus
6172024-08-13T21:51:33.614Z+ [[ 19 -gt 300 ]]
6182024-08-13T21:51:33.614Z+ sleep 1
6192024-08-13T21:51:34.601Z+ retry=20
6202024-08-13T21:51:34.624Z+ zoneadm list
6212024-08-13T21:51:34.624Z+ grep nexus
6222024-08-13T21:51:34.624Z+ [[ 20 -gt 300 ]]
6232024-08-13T21:51:34.624Z+ sleep 1
6242024-08-13T21:51:35.612Z+ retry=21
6252024-08-13T21:51:35.636Z+ zoneadm list
6262024-08-13T21:51:35.636Z+ grep nexus
6272024-08-13T21:51:35.636Z+ [[ 21 -gt 300 ]]
6282024-08-13T21:51:35.636Z+ sleep 1
6292024-08-13T21:51:36.624Z+ retry=22
6302024-08-13T21:51:36.647Z+ zoneadm list
6312024-08-13T21:51:36.647Z+ grep nexus
6322024-08-13T21:51:36.647Z+ [[ 22 -gt 300 ]]
6332024-08-13T21:51:36.647Z+ sleep 1
6342024-08-13T21:51:37.660Z+ retry=23
6352024-08-13T21:51:37.660Z+ zoneadm list
6362024-08-13T21:51:37.660Z+ grep nexus
6372024-08-13T21:51:37.683Z+ [[ 23 -gt 300 ]]
6382024-08-13T21:51:37.683Z+ sleep 1
6392024-08-13T21:51:38.686Z+ retry=24
6402024-08-13T21:51:38.715Z+ grep nexus
6412024-08-13T21:51:38.715Z+ zoneadm list
6422024-08-13T21:51:38.754Z+ [[ 24 -gt 300 ]]
6432024-08-13T21:51:38.754Z+ sleep 1
6442024-08-13T21:51:39.760Z+ retry=25
6452024-08-13T21:51:39.784Z+ zoneadm list
6462024-08-13T21:51:39.784Z+ grep nexus
6472024-08-13T21:51:39.784Z+ [[ 25 -gt 300 ]]
6482024-08-13T21:51:39.784Z+ sleep 1
6492024-08-13T21:51:40.772Z+ retry=26
6502024-08-13T21:51:40.795Z+ zoneadm list
6512024-08-13T21:51:40.795Z+ grep nexus
6522024-08-13T21:51:40.795Z+ [[ 26 -gt 300 ]]
6532024-08-13T21:51:40.795Z+ sleep 1
6542024-08-13T21:51:41.785Z+ retry=27
6552024-08-13T21:51:41.810Z+ zoneadm list
6562024-08-13T21:51:41.810Z+ grep nexus
6572024-08-13T21:51:41.810Z+ [[ 27 -gt 300 ]]
6582024-08-13T21:51:41.810Z+ sleep 1
6592024-08-13T21:51:42.797Z+ retry=28
6602024-08-13T21:51:42.820Z+ zoneadm list
6612024-08-13T21:51:42.820Z+ grep nexus
6622024-08-13T21:51:42.820Z+ [[ 28 -gt 300 ]]
6632024-08-13T21:51:42.820Z+ sleep 1
6642024-08-13T21:51:43.809Z+ retry=29
6652024-08-13T21:51:43.832Z+ zoneadm list
6662024-08-13T21:51:43.832Z+ grep nexus
6672024-08-13T21:51:43.832Z+ [[ 29 -gt 300 ]]
6682024-08-13T21:51:43.832Z+ sleep 1
6692024-08-13T21:51:44.821Z+ retry=30
6702024-08-13T21:51:44.844Z+ zoneadm list
6712024-08-13T21:51:44.845Z+ grep nexus
6722024-08-13T21:51:44.845Z+ [[ 30 -gt 300 ]]
6732024-08-13T21:51:44.845Z+ sleep 1
6742024-08-13T21:51:45.833Z+ retry=31
6752024-08-13T21:51:45.856Z+ zoneadm list
6762024-08-13T21:51:45.856Z+ grep nexus
6772024-08-13T21:51:45.856Z+ [[ 31 -gt 300 ]]
6782024-08-13T21:51:45.857Z+ sleep 1
6792024-08-13T21:51:46.845Z+ retry=32
6802024-08-13T21:51:46.868Z+ zoneadm list
6812024-08-13T21:51:46.868Z+ grep nexus
6822024-08-13T21:51:46.868Z+ [[ 32 -gt 300 ]]
6832024-08-13T21:51:46.868Z+ sleep 1
6842024-08-13T21:51:47.857Z+ retry=33
6852024-08-13T21:51:47.880Z+ zoneadm list
6862024-08-13T21:51:47.880Z+ grep nexus
6872024-08-13T21:51:47.880Z+ [[ 33 -gt 300 ]]
6882024-08-13T21:51:47.880Z+ sleep 1
6892024-08-13T21:51:48.869Z+ retry=34
6902024-08-13T21:51:48.893Z+ zoneadm list
6912024-08-13T21:51:48.893Z+ grep nexus
6922024-08-13T21:51:48.893Z+ [[ 34 -gt 300 ]]
6932024-08-13T21:51:48.893Z+ sleep 1
6942024-08-13T21:51:49.881Z+ retry=35
6952024-08-13T21:51:49.905Z+ zoneadm list
6962024-08-13T21:51:49.905Z+ grep nexus
6972024-08-13T21:51:49.905Z+ [[ 35 -gt 300 ]]
6982024-08-13T21:51:49.905Z+ sleep 1
6992024-08-13T21:51:50.894Z+ retry=36
7002024-08-13T21:51:50.918Z+ zoneadm list
7012024-08-13T21:51:50.918Z+ grep nexus
7022024-08-13T21:51:50.918Z+ [[ 36 -gt 300 ]]
7032024-08-13T21:51:50.918Z+ sleep 1
7042024-08-13T21:51:51.910Z+ retry=37
7052024-08-13T21:51:51.934Z+ zoneadm list
7062024-08-13T21:51:51.934Z+ grep nexus
7072024-08-13T21:51:51.934Z+ [[ 37 -gt 300 ]]
7082024-08-13T21:51:51.934Z+ sleep 1
7092024-08-13T21:51:52.922Z+ retry=38
7102024-08-13T21:51:52.945Z+ zoneadm list
7112024-08-13T21:51:52.945Z+ grep nexus
7122024-08-13T21:51:52.945Z+ [[ 38 -gt 300 ]]
7132024-08-13T21:51:52.945Z+ sleep 1
7142024-08-13T21:51:53.934Z+ retry=39
7152024-08-13T21:51:53.957Z+ zoneadm list
7162024-08-13T21:51:53.957Z+ grep nexus
7172024-08-13T21:51:53.957Z+ [[ 39 -gt 300 ]]
7182024-08-13T21:51:53.957Z+ sleep 1
7192024-08-13T21:51:54.945Z+ retry=40
7202024-08-13T21:51:54.969Z+ zoneadm list
7212024-08-13T21:51:54.969Z+ grep nexus
7222024-08-13T21:51:54.969Z+ [[ 40 -gt 300 ]]
7232024-08-13T21:51:54.970Z+ sleep 1
7242024-08-13T21:51:55.957Z+ retry=41
7252024-08-13T21:51:55.980Z+ zoneadm list
7262024-08-13T21:51:55.980Z+ grep nexus
7272024-08-13T21:51:55.980Z+ [[ 41 -gt 300 ]]
7282024-08-13T21:51:55.980Z+ sleep 1
7292024-08-13T21:51:56.970Z+ retry=42
7302024-08-13T21:51:56.993Z+ zoneadm list
7312024-08-13T21:51:56.993Z+ grep nexus
7322024-08-13T21:51:56.993Z+ [[ 42 -gt 300 ]]
7332024-08-13T21:51:56.993Z+ sleep 1
7342024-08-13T21:51:57.982Z+ retry=43
7352024-08-13T21:51:58.005Z+ zoneadm list
7362024-08-13T21:51:58.005Z+ grep nexus
7372024-08-13T21:51:58.005Z+ [[ 43 -gt 300 ]]
7382024-08-13T21:51:58.005Z+ sleep 1
7392024-08-13T21:51:58.999Z+ retry=44
7402024-08-13T21:51:59.022Z+ zoneadm list
7412024-08-13T21:51:59.022Z+ grep nexus
7422024-08-13T21:51:59.022Z+ [[ 44 -gt 300 ]]
7432024-08-13T21:51:59.022Z+ sleep 1
7442024-08-13T21:52:00.022Z+ retry=45
7452024-08-13T21:52:00.046Z+ zoneadm list
7462024-08-13T21:52:00.046Z+ grep nexus
7472024-08-13T21:52:00.046Z+ [[ 45 -gt 300 ]]
7482024-08-13T21:52:00.046Z+ sleep 1
7492024-08-13T21:52:01.041Z+ retry=46
7502024-08-13T21:52:01.064Z+ zoneadm list
7512024-08-13T21:52:01.064Z+ grep nexus
7522024-08-13T21:52:01.064Z+ [[ 46 -gt 300 ]]
7532024-08-13T21:52:01.064Z+ sleep 1
7542024-08-13T21:52:02.060Z+ retry=47
7552024-08-13T21:52:02.084Z+ zoneadm list
7562024-08-13T21:52:02.084Z+ grep nexus
7572024-08-13T21:52:02.084Z+ [[ 47 -gt 300 ]]
7582024-08-13T21:52:02.084Z+ sleep 1
7592024-08-13T21:52:03.078Z+ retry=48
7602024-08-13T21:52:03.102Z+ zoneadm list
7612024-08-13T21:52:03.102Z+ grep nexus
7622024-08-13T21:52:03.102Z+ [[ 48 -gt 300 ]]
7632024-08-13T21:52:03.102Z+ sleep 1
7642024-08-13T21:52:04.091Z+ retry=49
7652024-08-13T21:52:04.114Z+ zoneadm list
7662024-08-13T21:52:04.114Z+ grep nexus
7672024-08-13T21:52:04.114Z+ [[ 49 -gt 300 ]]
7682024-08-13T21:52:04.114Z+ sleep 1
7692024-08-13T21:52:05.105Z+ retry=50
7702024-08-13T21:52:05.129Z+ zoneadm list
7712024-08-13T21:52:05.129Z+ grep nexus
7722024-08-13T21:52:05.129Z+ [[ 50 -gt 300 ]]
7732024-08-13T21:52:05.129Z+ sleep 1
7742024-08-13T21:52:06.119Z+ retry=51
7752024-08-13T21:52:06.142Z+ zoneadm list
7762024-08-13T21:52:06.142Z+ grep nexus
7772024-08-13T21:52:06.142Z+ [[ 51 -gt 300 ]]
7782024-08-13T21:52:06.142Z+ sleep 1
7792024-08-13T21:52:07.132Z+ retry=52
7802024-08-13T21:52:07.155Z+ zoneadm list
7812024-08-13T21:52:07.155Z+ grep nexus
7822024-08-13T21:52:07.155Z+ [[ 52 -gt 300 ]]
7832024-08-13T21:52:07.155Z+ sleep 1
7842024-08-13T21:52:08.150Z+ retry=53
7852024-08-13T21:52:08.173Z+ zoneadm list
7862024-08-13T21:52:08.173Z+ grep nexus
7872024-08-13T21:52:08.173Z+ [[ 53 -gt 300 ]]
7882024-08-13T21:52:08.173Z+ sleep 1
7892024-08-13T21:52:09.163Z+ retry=54
7902024-08-13T21:52:09.186Z+ zoneadm list
7912024-08-13T21:52:09.186Z+ grep nexus
7922024-08-13T21:52:09.186Z+ [[ 54 -gt 300 ]]
7932024-08-13T21:52:09.186Z+ sleep 1
7942024-08-13T21:52:10.180Z+ retry=55
7952024-08-13T21:52:10.204Z+ zoneadm list
7962024-08-13T21:52:10.204Z+ grep nexus
7972024-08-13T21:52:10.204Z+ [[ 55 -gt 300 ]]
7982024-08-13T21:52:10.205Z+ sleep 1
7992024-08-13T21:52:11.190Z+ retry=56
8002024-08-13T21:52:11.215Z+ zoneadm list
8012024-08-13T21:52:11.215Z+ grep nexus
8022024-08-13T21:52:11.215Z+ [[ 56 -gt 300 ]]
8032024-08-13T21:52:11.215Z+ sleep 1
8042024-08-13T21:52:12.207Z+ retry=57
8052024-08-13T21:52:12.231Z+ zoneadm list
8062024-08-13T21:52:12.231Z+ grep nexus
8072024-08-13T21:52:12.231Z+ [[ 57 -gt 300 ]]
8082024-08-13T21:52:12.231Z+ sleep 1
8092024-08-13T21:52:13.242Z+ retry=58
8102024-08-13T21:52:13.287Z+ zoneadm list
8112024-08-13T21:52:13.310Z+ grep nexus
8122024-08-13T21:52:13.356Z+ [[ 58 -gt 300 ]]
8132024-08-13T21:52:13.356Z+ sleep 1
8142024-08-13T21:52:14.333Z+ retry=59
8152024-08-13T21:52:14.668Z+ zoneadm list
8162024-08-13T21:52:14.716Z+ grep nexus
8172024-08-13T21:52:14.716Z+ [[ 59 -gt 300 ]]
8182024-08-13T21:52:14.716Z+ sleep 1
8192024-08-13T21:52:17.186Z+ retry=60
8202024-08-13T21:52:17.211Z+ grep nexus
8212024-08-13T21:52:17.238Z+ zoneadm list
 
8222024-08-13T21:52:17.372ZAug 13 21:52:17 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:23.131.160.7:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8232024-08-13T21:52:17.404Z+ [[ 60 -gt 300 ]]
8242024-08-13T21:52:17.404Z+ sleep 1
8252024-08-13T21:52:18.734Z+ retry=61
8262024-08-13T21:52:18.913Z+ zoneadm list
8272024-08-13T21:52:18.936Z+ grep nexus
8282024-08-13T21:52:18.936Z+ [[ 61 -gt 300 ]]
8292024-08-13T21:52:18.936Z+ sleep 1
8302024-08-13T21:52:19.949Z+ retry=62
8312024-08-13T21:52:19.973Z+ zoneadm list
8322024-08-13T21:52:19.973Z+ grep nexus
8332024-08-13T21:52:19.973Z+ [[ 62 -gt 300 ]]
8342024-08-13T21:52:19.973Z+ sleep 1
8352024-08-13T21:52:20.966Z+ retry=63
8362024-08-13T21:52:20.991Z+ zoneadm list
8372024-08-13T21:52:20.991Z+ grep nexus
8382024-08-13T21:52:20.991Z+ [[ 63 -gt 300 ]]
8392024-08-13T21:52:20.991Z+ sleep 1
8402024-08-13T21:52:21.986Z+ retry=64
8412024-08-13T21:52:22.010Z+ zoneadm list
8422024-08-13T21:52:22.010Z+ grep nexus
8432024-08-13T21:52:22.010Z+ [[ 64 -gt 300 ]]
8442024-08-13T21:52:22.010Z+ sleep 1
8452024-08-13T21:52:23.005Z+ retry=65
8462024-08-13T21:52:23.029Z+ zoneadm list
8472024-08-13T21:52:23.029Z+ grep nexus
8482024-08-13T21:52:23.029Z+ [[ 65 -gt 300 ]]
8492024-08-13T21:52:23.029Z+ sleep 1
8502024-08-13T21:52:24.027Z+ retry=66
8512024-08-13T21:52:24.050Z+ zoneadm list
8522024-08-13T21:52:24.050Z+ grep nexus
8532024-08-13T21:52:24.050Z+ [[ 66 -gt 300 ]]
8542024-08-13T21:52:24.050Z+ sleep 1
8552024-08-13T21:52:25.047Z+ retry=67
8562024-08-13T21:52:25.071Z+ zoneadm list
8572024-08-13T21:52:25.071Z+ grep nexus
8582024-08-13T21:52:25.071Z+ [[ 67 -gt 300 ]]
8592024-08-13T21:52:25.071Z+ sleep 1
8602024-08-13T21:52:26.072Z+ retry=68
8612024-08-13T21:52:26.096Z+ zoneadm list
8622024-08-13T21:52:26.096Z+ grep nexus
8632024-08-13T21:52:26.119Z+ [[ 68 -gt 300 ]]
8642024-08-13T21:52:26.119Z+ sleep 1
8652024-08-13T21:52:27.100Z+ retry=69
8662024-08-13T21:52:27.123Z+ zoneadm list
8672024-08-13T21:52:27.123Z+ grep nexus
8682024-08-13T21:52:27.123Z+ [[ 69 -gt 300 ]]
8692024-08-13T21:52:27.123Z+ sleep 1
8702024-08-13T21:52:28.122Z+ retry=70
8712024-08-13T21:52:28.145Z+ zoneadm list
8722024-08-13T21:52:28.145Z+ grep nexus
8732024-08-13T21:52:28.169Z+ [[ 70 -gt 300 ]]
8742024-08-13T21:52:28.169Z+ sleep 1
8752024-08-13T21:52:29.163Z+ retry=71
8762024-08-13T21:52:29.187Z+ zoneadm list
8772024-08-13T21:52:29.187Z+ grep nexus
8782024-08-13T21:52:29.187Z+ [[ 71 -gt 300 ]]
8792024-08-13T21:52:29.187Z+ sleep 1
8802024-08-13T21:52:30.190Z+ retry=72
8812024-08-13T21:52:30.213Z+ zoneadm list
8822024-08-13T21:52:30.213Z+ grep nexus
8832024-08-13T21:52:30.237Zoxz_nexus_1efcbc40-81e4-46c8-9a18-0ae71ba0d085
8842024-08-13T21:52:30.237Zoxz_nexus_f2069be6-7a1d-4d3f-bc69-bac7b4be6993
8852024-08-13T21:52:30.237Zoxz_nexus_85baf6bb-677e-401e-9183-913bc3e78881
8862024-08-13T21:52:30.237Z+ echo 'Waited for nexus: 72s'
8872024-08-13T21:52:30.237Z+ export RUST_BACKTRACE=1
8882024-08-13T21:52:30.237Z+ RUST_BACKTRACE=1
8892024-08-13T21:52:30.237ZWaited for nexus: 72s
8902024-08-13T21:52:30.237Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8912024-08-13T21:52:30.237Z++ ./target/debug/bootstrap
8922024-08-13T21:52:30.926ZUsing external DNS server at 10.151.1.164:53
8932024-08-13T21:52:30.954Z2024-08-13 21:52:30.941825016 UTC: attempting to log into API
 
8942024-08-13T21:52:45.971ZAug 13 21:52:45 buskin ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
 
8952024-08-13T21:52:46.060Z2024-08-13 21:52:46.049119820 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8962024-08-13T21:52:47.064Z2024-08-13 21:52:47.051376740 UTC: attempting to log into API
 
8972024-08-13T21:52:47.105ZAug 13 21:52:46 buskin ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
8982024-08-13T21:52:47.687ZAug 13 21:52:46 buskin ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
8992024-08-13T21:52:47.720ZAug 13 21:52:47 buskin ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
9002024-08-13T21:52:48.564ZAug 13 21:52:47 buskin ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
 
9012024-08-13T21:53:02.093Z2024-08-13 21:53:02.082628637 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9022024-08-13T21:53:03.095Z2024-08-13 21:53:03.083915070 UTC: attempting to log into API
9032024-08-13T21:53:18.126Z2024-08-13 21:53:18.115309441 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9042024-08-13T21:53:19.127Z2024-08-13 21:53:19.116231484 UTC: attempting to log into API
9052024-08-13T21:53:29.914Z2024-08-13 21:53:29.903676349 UTC: login succeeded
9062024-08-13T21:53:29.950Zwaiting for nexus to come up...
9072024-08-13T21:53:30.015Zcreating IP pool... 10.151.1.175 - 10.151.1.227
9082024-08-13T21:53:30.176Zsetting up quotas...
9092024-08-13T21:53:30.212Zensuring datasets are ready...
9102024-08-13T21:53:32.853Zlet's roll.
9112024-08-13T21:53:32.877Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
9122024-08-13T21:53:32.877ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9132024-08-13T21:53:32.877ZOXIDE_TOKEN=oxide-token-9ea687aab576af8a4e5e846a3c20b16f0dcbda80'
9142024-08-13T21:53:32.877Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9152024-08-13T21:53:32.877Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9162024-08-13T21:53:32.877Z++ OXIDE_TOKEN=oxide-token-9ea687aab576af8a4e5e846a3c20b16f0dcbda80
9172024-08-13T21:53:32.877Z+ export OXIDE_HOST OXIDE_TOKEN
9182024-08-13T21:53:32.877Z+ retry=0
9192024-08-13T21:53:32.877Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9202024-08-13T21:53:32.877Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9212024-08-13T21:53:32.901Z+ [[ 0 -gt 60 ]]
9222024-08-13T21:53:32.901Z+ sleep 1
9232024-08-13T21:53:33.881Z+ retry=1
9242024-08-13T21:53:33.881Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9252024-08-13T21:53:33.905Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9262024-08-13T21:53:33.905Z+ [[ 1 -gt 60 ]]
9272024-08-13T21:53:33.905Z+ sleep 1
9282024-08-13T21:53:34.899Z+ retry=2
9292024-08-13T21:53:34.899Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9302024-08-13T21:53:34.923Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9312024-08-13T21:53:34.923Z+ [[ 2 -gt 60 ]]
9322024-08-13T21:53:34.923Z+ sleep 1
9332024-08-13T21:53:35.916Z+ retry=3
9342024-08-13T21:53:35.916Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9352024-08-13T21:53:35.939Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9362024-08-13T21:53:35.940Z+ [[ 3 -gt 60 ]]
9372024-08-13T21:53:35.940Z+ sleep 1
9382024-08-13T21:53:36.932Z+ retry=4
9392024-08-13T21:53:36.933Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9402024-08-13T21:53:36.956Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9412024-08-13T21:53:36.956Z+ [[ 4 -gt 60 ]]
9422024-08-13T21:53:36.956Z+ sleep 1
9432024-08-13T21:53:37.949Z+ retry=5
9442024-08-13T21:53:37.949Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9452024-08-13T21:53:37.972Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9462024-08-13T21:53:37.972Z+ [[ 5 -gt 60 ]]
9472024-08-13T21:53:37.972Z+ sleep 1
9482024-08-13T21:53:38.964Z+ retry=6
9492024-08-13T21:53:38.964Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9502024-08-13T21:53:38.987Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9512024-08-13T21:53:38.988Z+ [[ 6 -gt 60 ]]
9522024-08-13T21:53:38.988Z+ sleep 1
9532024-08-13T21:53:39.980Z+ retry=7
9542024-08-13T21:53:39.980Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9552024-08-13T21:53:40.003Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9562024-08-13T21:53:40.003Z+ [[ 7 -gt 60 ]]
9572024-08-13T21:53:40.003Z+ sleep 1
9582024-08-13T21:53:40.996Z+ retry=8
9592024-08-13T21:53:40.996Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9602024-08-13T21:53:41.019Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9612024-08-13T21:53:41.019Z+ [[ 8 -gt 60 ]]
9622024-08-13T21:53:41.019Z+ sleep 1
9632024-08-13T21:53:42.012Z+ retry=9
9642024-08-13T21:53:42.012Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9652024-08-13T21:53:42.036Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9662024-08-13T21:53:42.036Z+ [[ 9 -gt 60 ]]
9672024-08-13T21:53:42.036Z+ sleep 1
9682024-08-13T21:53:43.028Z+ retry=10
9692024-08-13T21:53:43.028Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9702024-08-13T21:53:43.051Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9712024-08-13T21:53:43.051Z+ [[ 10 -gt 60 ]]
9722024-08-13T21:53:43.051Z+ sleep 1
9732024-08-13T21:53:44.044Z+ retry=11
9742024-08-13T21:53:44.044Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9752024-08-13T21:53:44.067Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9762024-08-13T21:53:44.068Z+ [[ 11 -gt 60 ]]
9772024-08-13T21:53:44.068Z+ sleep 1
9782024-08-13T21:53:45.060Z+ retry=12
9792024-08-13T21:53:45.060Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9802024-08-13T21:53:45.084Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9812024-08-13T21:53:45.084Z+ [[ 12 -gt 60 ]]
9822024-08-13T21:53:45.084Z+ sleep 1
9832024-08-13T21:53:46.076Z+ retry=13
9842024-08-13T21:53:46.076Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9852024-08-13T21:53:46.101Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9862024-08-13T21:53:46.101Z+ [[ 13 -gt 60 ]]
9872024-08-13T21:53:46.101Z+ sleep 1
9882024-08-13T21:53:47.093Z+ retry=14
9892024-08-13T21:53:47.093Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9902024-08-13T21:53:47.117Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9912024-08-13T21:53:47.117Z+ [[ 14 -gt 60 ]]
9922024-08-13T21:53:47.117Z+ sleep 1
9932024-08-13T21:53:48.109Z+ retry=15
9942024-08-13T21:53:48.109Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9952024-08-13T21:53:48.132Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9962024-08-13T21:53:48.132Z+ [[ 15 -gt 60 ]]
9972024-08-13T21:53:48.132Z+ sleep 1
9982024-08-13T21:53:49.124Z+ retry=16
9992024-08-13T21:53:49.124Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10002024-08-13T21:53:49.149Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10012024-08-13T21:53:49.149Z+ [[ 16 -gt 60 ]]
10022024-08-13T21:53:49.149Z+ sleep 1
10032024-08-13T21:53:50.139Z+ retry=17
10042024-08-13T21:53:50.139Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10052024-08-13T21:53:50.163Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10062024-08-13T21:53:50.163Z+ [[ 17 -gt 60 ]]
10072024-08-13T21:53:50.163Z+ sleep 1
10082024-08-13T21:53:51.155Z+ retry=18
10092024-08-13T21:53:51.155Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10102024-08-13T21:53:51.178Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10112024-08-13T21:53:51.178Z+ [[ 18 -gt 60 ]]
10122024-08-13T21:53:51.179Z+ sleep 1
10132024-08-13T21:53:52.171Z+ retry=19
10142024-08-13T21:53:52.171Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10152024-08-13T21:53:52.195Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10162024-08-13T21:53:52.195Z+ [[ 19 -gt 60 ]]
10172024-08-13T21:53:52.195Z+ sleep 1
10182024-08-13T21:53:53.186Z+ retry=20
10192024-08-13T21:53:53.186Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10202024-08-13T21:53:53.209Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10212024-08-13T21:53:53.209Z+ [[ 20 -gt 60 ]]
10222024-08-13T21:53:53.209Z+ sleep 1
10232024-08-13T21:53:54.203Z+ retry=21
10242024-08-13T21:53:54.203Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10252024-08-13T21:53:54.285Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10262024-08-13T21:53:54.948Z{"status":"ok"}success
10272024-08-13T21:53:54.948ZProject {
10282024-08-13T21:53:54.948Z description: "some images",
10292024-08-13T21:53:54.948Z id: 3b867553-da40-49d7-93e9-5f4572d47ad9,
10302024-08-13T21:53:54.948Z name: Name(
10312024-08-13T21:53:54.948Z "images",
10322024-08-13T21:53:54.948Z ),
10332024-08-13T21:53:54.948Z time_created: 2024-08-13T21:53:54.428722Z,
10342024-08-13T21:53:54.948Z time_modified: 2024-08-13T21:53:54.428722Z,
10352024-08-13T21:53:54.948Z}
10362024-08-13T21:53:54.972Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
10372024-08-13T21:56:03.903ZAug 13 21:56:03 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:96.60.160.227:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
10382024-08-13T21:59:08.006Zdone!
10392024-08-13T21:59:08.102Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
10402024-08-13T21:59:08.217Zsuccess
10412024-08-13T21:59:08.217ZImage {
10422024-08-13T21:59:08.217Z block_size: ByteCount(
10432024-08-13T21:59:08.217Z 512,
10442024-08-13T21:59:08.218Z ),
10452024-08-13T21:59:08.218Z description: "debian 11 original base image",
10462024-08-13T21:59:08.218Z digest: None,
10472024-08-13T21:59:08.218Z id: e47a6108-9b92-47db-9a0f-f92b470f9f23,
10482024-08-13T21:59:08.218Z name: Name(
10492024-08-13T21:59:08.218Z "debian11",
10502024-08-13T21:59:08.218Z ),
10512024-08-13T21:59:08.218Z os: "debian",
10522024-08-13T21:59:08.218Z project_id: None,
10532024-08-13T21:59:08.218Z size: ByteCount(
10542024-08-13T21:59:08.218Z 2147483648,
10552024-08-13T21:59:08.218Z ),
10562024-08-13T21:59:08.218Z time_created: 2024-08-13T21:59:07.940859Z,
10572024-08-13T21:59:08.218Z time_modified: 2024-08-13T21:59:08.191165Z,
10582024-08-13T21:59:08.218Z url: None,
10592024-08-13T21:59:08.218Z version: "11",
10602024-08-13T21:59:08.218Z}
10612024-08-13T21:59:08.241Z+ for test_bin in tests/*
10622024-08-13T21:59:08.241Z+ ./tests/bootstrap-ad4024d5be614f9b
10632024-08-13T21:59:08.265Z
10642024-08-13T21:59:08.265Zrunning 0 tests
10652024-08-13T21:59:08.265Z
10662024-08-13T21:59:08.265Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10672024-08-13T21:59:08.265Z
10682024-08-13T21:59:08.265Z+ for test_bin in tests/*
10692024-08-13T21:59:08.265Z+ ./tests/commtest-4d19f22d943becd5
10702024-08-13T21:59:08.289Z
10712024-08-13T21:59:08.289Zrunning 0 tests
10722024-08-13T21:59:08.289Z
10732024-08-13T21:59:08.289Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10742024-08-13T21:59:08.289Z
10752024-08-13T21:59:08.289Z+ for test_bin in tests/*
10762024-08-13T21:59:08.289Z+ ./tests/dhcp_server-52e57b839620e6a8
10772024-08-13T21:59:08.316Z
10782024-08-13T21:59:08.316Zrunning 0 tests
10792024-08-13T21:59:08.316Z
10802024-08-13T21:59:08.339Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10812024-08-13T21:59:08.339Z
10822024-08-13T21:59:08.339Z+ for test_bin in tests/*
10832024-08-13T21:59:08.339Z+ ./tests/end_to_end_tests-e552280813eeb84d
10842024-08-13T21:59:08.493Z
10852024-08-13T21:59:08.493Zrunning 2 tests
10862024-08-13T21:59:08.746Ztest no_spoof::no_spoof_here ... ok
10872024-08-13T21:59:36.536Ztest instance_launch::instance_launch ... ok
10882024-08-13T21:59:36.536Z
10892024-08-13T21:59:36.536Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 28.04s
10902024-08-13T21:59:36.536Z
10912024-08-13T21:59:36.560Z+ _exit_trap
10922024-08-13T21:59:36.560Z+ local status=0
10932024-08-13T21:59:36.560Z+ set +o errexit
10942024-08-13T21:59:36.560Z+ pfexec svcadm -Z disable -s cron
10952024-08-13T21:59:38.434Z+ [[ 0 -eq 0 ]]
10962024-08-13T21:59:38.434Z+ exit 0
10972024-08-13T21:59:38.457Zprocess exited: duration 588358 ms, exit code 0
 
10982024-08-13T21:59:38.565Zfound 107 output files
10992024-08-13T21:59:38.566Zuploading: /var/svc/log/oxide-sled-agent:default.log (967995 bytes)
11002024-08-13T21:59:39.859Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11012024-08-13T21:59:39.859Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (4486288 bytes)
11022024-08-13T21:59:40.263Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 4486288 -> 4498270
11032024-08-13T21:59:41.331Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11042024-08-13T21:59:41.331Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (33199 bytes)
11052024-08-13T21:59:42.487Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
11062024-08-13T21:59:42.487Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (141085 bytes)
11072024-08-13T21:59:42.663Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 141085 -> 145125
11082024-08-13T21:59:43.731Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11092024-08-13T21:59:43.731Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (216839 bytes)
11102024-08-13T21:59:43.928Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 216839 -> 218794
11112024-08-13T21:59:44.997Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11122024-08-13T21:59:44.997Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1356004 bytes)
11132024-08-13T21:59:45.286Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1356004 -> 1376833
11142024-08-13T21:59:46.356Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11152024-08-13T21:59:46.380Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (722540 bytes)
11162024-08-13T21:59:46.855Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 722540 -> 735290
11172024-08-13T21:59:47.923Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11182024-08-13T21:59:47.923Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (3338 bytes)
11192024-08-13T21:59:49.015Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11202024-08-13T21:59:49.015Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (259610 bytes)
11212024-08-13T21:59:49.215Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 259610 -> 264788
11222024-08-13T21:59:50.284Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11232024-08-13T21:59:50.284Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (8171 bytes)
11242024-08-13T21:59:51.398Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11252024-08-13T21:59:51.422Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3975 bytes)
11262024-08-13T21:59:52.490Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11272024-08-13T21:59:52.514Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (8811 bytes)
11282024-08-13T21:59:53.604Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
11292024-08-13T21:59:53.604Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_cockroachdb_9b8e486d-283c-4896-9400-56021801046e/root/var/svc/log/oxide-cockroach-admin:default.log (4660 bytes)
11302024-08-13T21:59:54.732Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_cockroachdb_9b8e486d-283c-4896-9400-56021801046e/root/var/svc/log/oxide-cockroach-admin:default.log
11312024-08-13T21:59:54.732Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_cockroachdb_9b8e486d-283c-4896-9400-56021801046e/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11322024-08-13T21:59:55.786Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_cockroachdb_9b8e486d-283c-4896-9400-56021801046e/root/var/svc/log/oxide-cockroachdb:default.log
11332024-08-13T21:59:55.786Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_cockroachdb_9b8e486d-283c-4896-9400-56021801046e/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
11342024-08-13T21:59:56.879Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_cockroachdb_9b8e486d-283c-4896-9400-56021801046e/root/var/svc/log/oxide-zone-network-setup:default.log
11352024-08-13T21:59:56.879Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-agent:default.log (38311 bytes)
11362024-08-13T21:59:58.035Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-agent:default.log
11372024-08-13T21:59:58.035Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11382024-08-13T21:59:59.126Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:default.log
11392024-08-13T21:59:59.150Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:downstairs-41a946c4-40d1-419b-b20f-288a3ab18e0e.log (6074 bytes)
11402024-08-13T22:00:00.218Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:downstairs-41a946c4-40d1-419b-b20f-288a3ab18e0e.log
11412024-08-13T22:00:00.218Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:downstairs-cdd267c8-9ffa-4f65-ac76-5b72ce3804b0.log (3125 bytes)
11422024-08-13T22:00:01.310Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:downstairs-cdd267c8-9ffa-4f65-ac76-5b72ce3804b0.log
11432024-08-13T22:00:01.310Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:downstairs-fa65c82f-1043-45d6-a80f-8904cdde0c1d.log (5988 bytes)
11442024-08-13T22:00:02.401Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:downstairs-fa65c82f-1043-45d6-a80f-8904cdde0c1d.log
11452024-08-13T22:00:02.401Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:snapshot-41a946c4-40d1-419b-b20f-288a3ab18e0e-ef063040-922f-4200-9f82-dd234bf13093.log (5685 bytes)
11462024-08-13T22:00:03.493Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-crucible-downstairs:snapshot-41a946c4-40d1-419b-b20f-288a3ab18e0e-ef063040-922f-4200-9f82-dd234bf13093.log
11472024-08-13T22:00:03.493Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11482024-08-13T22:00:04.584Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_crucible_96ae8375-942a-4e0a-b533-95209a48dc78/root/var/svc/log/oxide-zone-network-setup:default.log
11492024-08-13T22:00:04.584Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_internal_dns_e637d680-4167-490f-998a-85ef468ee9ba/root/var/svc/log/oxide-internal_dns:default.log (107400 bytes)
11502024-08-13T22:00:04.739Zupload warning: file "/pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_internal_dns_e637d680-4167-490f-998a-85ef468ee9ba/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107400 -> 111155
11512024-08-13T22:00:05.808Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_internal_dns_e637d680-4167-490f-998a-85ef468ee9ba/root/var/svc/log/oxide-internal_dns:default.log
11522024-08-13T22:00:05.808Zuploading: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_internal_dns_e637d680-4167-490f-998a-85ef468ee9ba/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
11532024-08-13T22:00:06.898Zuploaded: /pool/ext/248f90f8-f7ad-47ac-bc77-ddd18aa7168b/crypt/zone/oxz_internal_dns_e637d680-4167-490f-998a-85ef468ee9ba/root/var/svc/log/oxide-zone-network-setup:default.log
11542024-08-13T22:00:06.923Zuploading: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-crucible-agent:default.log (20607 bytes)
11552024-08-13T22:00:08.034Zuploaded: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-crucible-agent:default.log
11562024-08-13T22:00:08.034Zuploading: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11572024-08-13T22:00:09.127Zuploaded: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-crucible-downstairs:default.log
11582024-08-13T22:00:09.127Zuploading: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc6fccb9-2095-4e7c-a8fc-f118359ba099.log (6076 bytes)
11592024-08-13T22:00:10.217Zuploaded: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc6fccb9-2095-4e7c-a8fc-f118359ba099.log
11602024-08-13T22:00:10.217Zuploading: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-crucible-downstairs:snapshot-cc6fccb9-2095-4e7c-a8fc-f118359ba099-ef063040-922f-4200-9f82-dd234bf13093.log (5683 bytes)
11612024-08-13T22:00:11.309Zuploaded: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-crucible-downstairs:snapshot-cc6fccb9-2095-4e7c-a8fc-f118359ba099-ef063040-922f-4200-9f82-dd234bf13093.log
11622024-08-13T22:00:11.309Zuploading: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11632024-08-13T22:00:12.400Zuploaded: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_f7883b19-aaa1-4bd6-b3f3-21a6f1744704/root/var/svc/log/oxide-zone-network-setup:default.log
11642024-08-13T22:00:12.400Zuploading: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_pantry_d7de897e-63ce-4917-a0c9-17c0fb1fb2f5/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
11652024-08-13T22:00:13.493Zuploaded: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_pantry_d7de897e-63ce-4917-a0c9-17c0fb1fb2f5/root/var/svc/log/oxide-crucible-pantry:default.log
11662024-08-13T22:00:13.493Zuploading: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_pantry_d7de897e-63ce-4917-a0c9-17c0fb1fb2f5/root/var/svc/log/oxide-zone-network-setup:default.log (1717 bytes)
11672024-08-13T22:00:14.585Zuploaded: /pool/ext/2a7bbf04-54e8-4c36-aefa-7fcbeed85759/crypt/zone/oxz_crucible_pantry_d7de897e-63ce-4917-a0c9-17c0fb1fb2f5/root/var/svc/log/oxide-zone-network-setup:default.log
11682024-08-13T22:00:14.585Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_cockroachdb_ab58ca9d-ce7f-4bee-980e-c1555fcf2257/root/var/svc/log/oxide-cockroach-admin:default.log (4661 bytes)
11692024-08-13T22:00:15.677Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_cockroachdb_ab58ca9d-ce7f-4bee-980e-c1555fcf2257/root/var/svc/log/oxide-cockroach-admin:default.log
11702024-08-13T22:00:15.677Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_cockroachdb_ab58ca9d-ce7f-4bee-980e-c1555fcf2257/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11712024-08-13T22:00:16.769Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_cockroachdb_ab58ca9d-ce7f-4bee-980e-c1555fcf2257/root/var/svc/log/oxide-cockroachdb:default.log
11722024-08-13T22:00:16.769Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_cockroachdb_ab58ca9d-ce7f-4bee-980e-c1555fcf2257/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11732024-08-13T22:00:17.860Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_cockroachdb_ab58ca9d-ce7f-4bee-980e-c1555fcf2257/root/var/svc/log/oxide-zone-network-setup:default.log
11742024-08-13T22:00:17.884Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_crucible_10106c78-85bb-4f37-b254-24b8489a754a/root/var/svc/log/oxide-crucible-agent:default.log (12505 bytes)
11752024-08-13T22:00:18.974Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_crucible_10106c78-85bb-4f37-b254-24b8489a754a/root/var/svc/log/oxide-crucible-agent:default.log
11762024-08-13T22:00:18.998Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_crucible_10106c78-85bb-4f37-b254-24b8489a754a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11772024-08-13T22:00:20.066Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_crucible_10106c78-85bb-4f37-b254-24b8489a754a/root/var/svc/log/oxide-crucible-downstairs:default.log
11782024-08-13T22:00:20.066Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_crucible_10106c78-85bb-4f37-b254-24b8489a754a/root/var/svc/log/oxide-crucible-downstairs:downstairs-8d9f7f78-9a86-450d-b985-1f1c019dda19.log (5993 bytes)
11792024-08-13T22:00:21.158Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_crucible_10106c78-85bb-4f37-b254-24b8489a754a/root/var/svc/log/oxide-crucible-downstairs:downstairs-8d9f7f78-9a86-450d-b985-1f1c019dda19.log
11802024-08-13T22:00:21.158Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_crucible_10106c78-85bb-4f37-b254-24b8489a754a/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
11812024-08-13T22:00:22.248Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_crucible_10106c78-85bb-4f37-b254-24b8489a754a/root/var/svc/log/oxide-zone-network-setup:default.log
11822024-08-13T22:00:22.249Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-chrony-setup:default.log (14495 bytes)
11832024-08-13T22:00:23.362Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-chrony-setup:default.log
11842024-08-13T22:00:23.362Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-ntp:default.log (1798 bytes)
11852024-08-13T22:00:23.408Zupload warning: file "/pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 1798 -> 2030
11862024-08-13T22:00:24.477Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-ntp:default.log
11872024-08-13T22:00:24.477Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
11882024-08-13T22:00:25.568Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-opte-interface-setup:default.log
11892024-08-13T22:00:25.568Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-zone-network-setup:default.log (1635 bytes)
11902024-08-13T22:00:26.660Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/svc/log/oxide-zone-network-setup:default.log
11912024-08-13T22:00:26.660Zuploading: /pool/ext/40023fb2-83e0-4ec8-b13b-72bc31693bda/crypt/zone/oxz_crucible_9a9030c7-4ec7-4d68-b7fc-8a13b7472620/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
11922024-08-13T22:00:27.751Zuploaded: /pool/ext/40023fb2-83e0-4ec8-b13b-72bc31693bda/crypt/zone/oxz_crucible_9a9030c7-4ec7-4d68-b7fc-8a13b7472620/root/var/svc/log/oxide-crucible-agent:default.log
11932024-08-13T22:00:27.775Zuploading: /pool/ext/40023fb2-83e0-4ec8-b13b-72bc31693bda/crypt/zone/oxz_crucible_9a9030c7-4ec7-4d68-b7fc-8a13b7472620/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11942024-08-13T22:00:28.842Zuploaded: /pool/ext/40023fb2-83e0-4ec8-b13b-72bc31693bda/crypt/zone/oxz_crucible_9a9030c7-4ec7-4d68-b7fc-8a13b7472620/root/var/svc/log/oxide-crucible-downstairs:default.log
11952024-08-13T22:00:28.842Zuploading: /pool/ext/40023fb2-83e0-4ec8-b13b-72bc31693bda/crypt/zone/oxz_crucible_9a9030c7-4ec7-4d68-b7fc-8a13b7472620/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11962024-08-13T22:00:29.935Zuploaded: /pool/ext/40023fb2-83e0-4ec8-b13b-72bc31693bda/crypt/zone/oxz_crucible_9a9030c7-4ec7-4d68-b7fc-8a13b7472620/root/var/svc/log/oxide-zone-network-setup:default.log
11972024-08-13T22:00:29.935Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-agent:default.log (29224 bytes)
11982024-08-13T22:00:31.069Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-agent:default.log
11992024-08-13T22:00:31.069Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12002024-08-13T22:00:32.161Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-downstairs:default.log
12012024-08-13T22:00:32.161Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-downstairs:downstairs-40895043-3fd2-450e-aa80-6e724e0edd7f.log (5991 bytes)
12022024-08-13T22:00:33.253Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-downstairs:downstairs-40895043-3fd2-450e-aa80-6e724e0edd7f.log
12032024-08-13T22:00:33.253Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-downstairs:downstairs-4dc7a4f4-258a-4e5f-b561-00ca9a4029ac.log (3125 bytes)
12042024-08-13T22:00:34.344Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-downstairs:downstairs-4dc7a4f4-258a-4e5f-b561-00ca9a4029ac.log
12052024-08-13T22:00:34.344Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ffa6d45-2a34-4819-a109-eaa8e182636c.log (3018 bytes)
12062024-08-13T22:00:35.435Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ffa6d45-2a34-4819-a109-eaa8e182636c.log
12072024-08-13T22:00:35.435Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
12082024-08-13T22:00:36.529Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_crucible_4248eaa9-f7b0-464c-9f70-a3dc82830acf/root/var/svc/log/oxide-zone-network-setup:default.log
12092024-08-13T22:00:36.529Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_nexus_f2069be6-7a1d-4d3f-bc69-bac7b4be6993/root/var/svc/log/oxide-nexus:default.log (36497061 bytes)
12102024-08-13T22:00:41.152Zupload warning: file "/pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_nexus_f2069be6-7a1d-4d3f-bc69-bac7b4be6993/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36497061 -> 36807647
12112024-08-13T22:00:42.221Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_nexus_f2069be6-7a1d-4d3f-bc69-bac7b4be6993/root/var/svc/log/oxide-nexus:default.log
12122024-08-13T22:00:42.221Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_nexus_f2069be6-7a1d-4d3f-bc69-bac7b4be6993/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
12132024-08-13T22:00:43.312Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_nexus_f2069be6-7a1d-4d3f-bc69-bac7b4be6993/root/var/svc/log/oxide-opte-interface-setup:default.log
12142024-08-13T22:00:43.312Zuploading: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_nexus_f2069be6-7a1d-4d3f-bc69-bac7b4be6993/root/var/svc/log/oxide-zone-network-setup:default.log (1654 bytes)
12152024-08-13T22:00:44.404Zuploaded: /pool/ext/430bb6f1-41e2-404f-9116-24ccfd3bb2d1/crypt/zone/oxz_nexus_f2069be6-7a1d-4d3f-bc69-bac7b4be6993/root/var/svc/log/oxide-zone-network-setup:default.log
12162024-08-13T22:00:44.428Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_crucible_d5cf9eb8-e059-49df-ab85-bfe043ef8c65/root/var/svc/log/oxide-crucible-agent:default.log (12503 bytes)
12172024-08-13T22:00:45.521Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_crucible_d5cf9eb8-e059-49df-ab85-bfe043ef8c65/root/var/svc/log/oxide-crucible-agent:default.log
12182024-08-13T22:00:45.522Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_crucible_d5cf9eb8-e059-49df-ab85-bfe043ef8c65/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12192024-08-13T22:00:46.615Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_crucible_d5cf9eb8-e059-49df-ab85-bfe043ef8c65/root/var/svc/log/oxide-crucible-downstairs:default.log
12202024-08-13T22:00:46.615Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_crucible_d5cf9eb8-e059-49df-ab85-bfe043ef8c65/root/var/svc/log/oxide-crucible-downstairs:downstairs-85f5c106-f605-41a1-84cf-671e677a2074.log (3125 bytes)
12212024-08-13T22:00:47.707Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_crucible_d5cf9eb8-e059-49df-ab85-bfe043ef8c65/root/var/svc/log/oxide-crucible-downstairs:downstairs-85f5c106-f605-41a1-84cf-671e677a2074.log
12222024-08-13T22:00:47.708Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_crucible_d5cf9eb8-e059-49df-ab85-bfe043ef8c65/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
12232024-08-13T22:00:48.799Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_crucible_d5cf9eb8-e059-49df-ab85-bfe043ef8c65/root/var/svc/log/oxide-zone-network-setup:default.log
12242024-08-13T22:00:48.799Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_nexus_85baf6bb-677e-401e-9183-913bc3e78881/root/var/svc/log/oxide-nexus:default.log (2727147 bytes)
12252024-08-13T22:00:50.793Zupload warning: file "/pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_nexus_85baf6bb-677e-401e-9183-913bc3e78881/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2727147 -> 3048591
12262024-08-13T22:00:51.861Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_nexus_85baf6bb-677e-401e-9183-913bc3e78881/root/var/svc/log/oxide-nexus:default.log
12272024-08-13T22:00:51.885Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_nexus_85baf6bb-677e-401e-9183-913bc3e78881/root/var/svc/log/oxide-opte-interface-setup:default.log (1134 bytes)
12282024-08-13T22:00:52.951Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_nexus_85baf6bb-677e-401e-9183-913bc3e78881/root/var/svc/log/oxide-opte-interface-setup:default.log
12292024-08-13T22:00:52.951Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_nexus_85baf6bb-677e-401e-9183-913bc3e78881/root/var/svc/log/oxide-zone-network-setup:default.log (1653 bytes)
12302024-08-13T22:00:54.043Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_nexus_85baf6bb-677e-401e-9183-913bc3e78881/root/var/svc/log/oxide-zone-network-setup:default.log
12312024-08-13T22:00:54.043Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_oximeter_4667ac97-4cae-4347-ae52-c07912e7297a/root/var/svc/log/oxide-oximeter:default.log (1485716 bytes)
12322024-08-13T22:00:55.559Zupload warning: file "/pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_oximeter_4667ac97-4cae-4347-ae52-c07912e7297a/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1485716 -> 1793040
12332024-08-13T22:00:56.628Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_oximeter_4667ac97-4cae-4347-ae52-c07912e7297a/root/var/svc/log/oxide-oximeter:default.log
12342024-08-13T22:00:56.628Zuploading: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_oximeter_4667ac97-4cae-4347-ae52-c07912e7297a/root/var/svc/log/oxide-zone-network-setup:default.log (1670 bytes)
12352024-08-13T22:00:57.720Zuploaded: /pool/ext/8dd5376a-184d-4d01-8597-b50a33f54493/crypt/zone/oxz_oximeter_4667ac97-4cae-4347-ae52-c07912e7297a/root/var/svc/log/oxide-zone-network-setup:default.log
12362024-08-13T22:00:57.720Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_cockroachdb_9d2a51d2-efb8-4815-b587-4c37ddf32934/root/var/svc/log/oxide-cockroach-admin:default.log (4660 bytes)
12372024-08-13T22:00:58.811Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_cockroachdb_9d2a51d2-efb8-4815-b587-4c37ddf32934/root/var/svc/log/oxide-cockroach-admin:default.log
12382024-08-13T22:00:58.811Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_cockroachdb_9d2a51d2-efb8-4815-b587-4c37ddf32934/root/var/svc/log/oxide-cockroachdb:default.log (4313 bytes)
12392024-08-13T22:00:59.902Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_cockroachdb_9d2a51d2-efb8-4815-b587-4c37ddf32934/root/var/svc/log/oxide-cockroachdb:default.log
12402024-08-13T22:00:59.902Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_cockroachdb_9d2a51d2-efb8-4815-b587-4c37ddf32934/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
12412024-08-13T22:01:00.993Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_cockroachdb_9d2a51d2-efb8-4815-b587-4c37ddf32934/root/var/svc/log/oxide-zone-network-setup:default.log
12422024-08-13T22:01:00.993Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-agent:default.log (29403 bytes)
12432024-08-13T22:01:02.171Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-agent:default.log
12442024-08-13T22:01:02.171Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12452024-08-13T22:01:03.263Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-downstairs:default.log
12462024-08-13T22:01:03.287Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-downstairs:downstairs-15a61961-3bbb-4bc0-8c8b-04854e384b6f.log (6076 bytes)
12472024-08-13T22:01:04.355Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-downstairs:downstairs-15a61961-3bbb-4bc0-8c8b-04854e384b6f.log
12482024-08-13T22:01:04.356Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-downstairs:downstairs-718045bc-c722-4037-80b6-8aebc2e2514c.log (3020 bytes)
12492024-08-13T22:01:05.447Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-downstairs:downstairs-718045bc-c722-4037-80b6-8aebc2e2514c.log
12502024-08-13T22:01:05.447Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-downstairs:snapshot-15a61961-3bbb-4bc0-8c8b-04854e384b6f-ef063040-922f-4200-9f82-dd234bf13093.log (5685 bytes)
12512024-08-13T22:01:06.540Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-crucible-downstairs:snapshot-15a61961-3bbb-4bc0-8c8b-04854e384b6f-ef063040-922f-4200-9f82-dd234bf13093.log
12522024-08-13T22:01:06.541Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
12532024-08-13T22:01:07.632Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_7e4154ea-3565-4b7c-b78a-0d61f3e90c87/root/var/svc/log/oxide-zone-network-setup:default.log
12542024-08-13T22:01:07.632Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_pantry_2a392e7f-0f9f-4861-ac95-42c60b617479/root/var/svc/log/oxide-crucible-pantry:default.log (763902 bytes)
12552024-08-13T22:01:09.641Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_pantry_2a392e7f-0f9f-4861-ac95-42c60b617479/root/var/svc/log/oxide-crucible-pantry:default.log
12562024-08-13T22:01:09.665Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_pantry_2a392e7f-0f9f-4861-ac95-42c60b617479/root/var/svc/log/oxide-zone-network-setup:default.log (1714 bytes)
12572024-08-13T22:01:10.736Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_crucible_pantry_2a392e7f-0f9f-4861-ac95-42c60b617479/root/var/svc/log/oxide-zone-network-setup:default.log
12582024-08-13T22:01:10.736Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_external_dns_e9757fa4-7e1e-4a06-822a-c01210a71727/root/var/svc/log/oxide-external_dns:default.log (26896 bytes)
12592024-08-13T22:01:10.846Zupload warning: file "/pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_external_dns_e9757fa4-7e1e-4a06-822a-c01210a71727/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26896 -> 34447
12602024-08-13T22:01:11.915Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_external_dns_e9757fa4-7e1e-4a06-822a-c01210a71727/root/var/svc/log/oxide-external_dns:default.log
12612024-08-13T22:01:11.915Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_external_dns_e9757fa4-7e1e-4a06-822a-c01210a71727/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
12622024-08-13T22:01:13.008Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_external_dns_e9757fa4-7e1e-4a06-822a-c01210a71727/root/var/svc/log/oxide-opte-interface-setup:default.log
12632024-08-13T22:01:13.008Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_external_dns_e9757fa4-7e1e-4a06-822a-c01210a71727/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
12642024-08-13T22:01:14.100Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_external_dns_e9757fa4-7e1e-4a06-822a-c01210a71727/root/var/svc/log/oxide-zone-network-setup:default.log
12652024-08-13T22:01:14.100Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_internal_dns_c165d0af-a69b-4988-a7f4-d6b536b0ba3a/root/var/svc/log/oxide-internal_dns:default.log (107407 bytes)
12662024-08-13T22:01:14.255Zupload warning: file "/pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_internal_dns_c165d0af-a69b-4988-a7f4-d6b536b0ba3a/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107407 -> 114919
12672024-08-13T22:01:15.323Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_internal_dns_c165d0af-a69b-4988-a7f4-d6b536b0ba3a/root/var/svc/log/oxide-internal_dns:default.log
12682024-08-13T22:01:15.323Zuploading: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_internal_dns_c165d0af-a69b-4988-a7f4-d6b536b0ba3a/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
12692024-08-13T22:01:16.415Zuploaded: /pool/ext/92b960f4-fb0e-42d5-982c-4b6ab5f95e84/crypt/zone/oxz_internal_dns_c165d0af-a69b-4988-a7f4-d6b536b0ba3a/root/var/svc/log/oxide-zone-network-setup:default.log
12702024-08-13T22:01:16.438Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_cockroachdb_e3c29e89-945e-405b-87b6-5b3002697996/root/var/svc/log/oxide-cockroach-admin:default.log (4661 bytes)
12712024-08-13T22:01:17.507Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_cockroachdb_e3c29e89-945e-405b-87b6-5b3002697996/root/var/svc/log/oxide-cockroach-admin:default.log
12722024-08-13T22:01:17.507Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_cockroachdb_e3c29e89-945e-405b-87b6-5b3002697996/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
12732024-08-13T22:01:18.600Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_cockroachdb_e3c29e89-945e-405b-87b6-5b3002697996/root/var/svc/log/oxide-cockroachdb:default.log
12742024-08-13T22:01:18.600Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_cockroachdb_e3c29e89-945e-405b-87b6-5b3002697996/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
12752024-08-13T22:01:19.729Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_cockroachdb_e3c29e89-945e-405b-87b6-5b3002697996/root/var/svc/log/oxide-zone-network-setup:default.log
12762024-08-13T22:01:19.730Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_18431b1d-82cd-4a49-b0a6-3fd5aee4888a/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
12772024-08-13T22:01:20.782Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_18431b1d-82cd-4a49-b0a6-3fd5aee4888a/root/var/svc/log/oxide-crucible-agent:default.log
12782024-08-13T22:01:20.782Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_18431b1d-82cd-4a49-b0a6-3fd5aee4888a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12792024-08-13T22:01:21.874Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_18431b1d-82cd-4a49-b0a6-3fd5aee4888a/root/var/svc/log/oxide-crucible-downstairs:default.log
12802024-08-13T22:01:21.874Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_18431b1d-82cd-4a49-b0a6-3fd5aee4888a/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
12812024-08-13T22:01:22.965Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_18431b1d-82cd-4a49-b0a6-3fd5aee4888a/root/var/svc/log/oxide-zone-network-setup:default.log
12822024-08-13T22:01:22.965Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_pantry_95a14ee7-5530-4d1f-978c-36e41c9a52e9/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
12832024-08-13T22:01:24.058Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_pantry_95a14ee7-5530-4d1f-978c-36e41c9a52e9/root/var/svc/log/oxide-crucible-pantry:default.log
12842024-08-13T22:01:24.058Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_pantry_95a14ee7-5530-4d1f-978c-36e41c9a52e9/root/var/svc/log/oxide-zone-network-setup:default.log (1716 bytes)
12852024-08-13T22:01:25.149Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_crucible_pantry_95a14ee7-5530-4d1f-978c-36e41c9a52e9/root/var/svc/log/oxide-zone-network-setup:default.log
12862024-08-13T22:01:25.149Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_nexus_1efcbc40-81e4-46c8-9a18-0ae71ba0d085/root/var/svc/log/oxide-nexus:default.log (5168477 bytes)
12872024-08-13T22:01:25.595Zupload warning: file "/pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_nexus_1efcbc40-81e4-46c8-9a18-0ae71ba0d085/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5168477 -> 6002392
12882024-08-13T22:01:26.662Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_nexus_1efcbc40-81e4-46c8-9a18-0ae71ba0d085/root/var/svc/log/oxide-nexus:default.log
12892024-08-13T22:01:26.662Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_nexus_1efcbc40-81e4-46c8-9a18-0ae71ba0d085/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
12902024-08-13T22:01:27.754Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_nexus_1efcbc40-81e4-46c8-9a18-0ae71ba0d085/root/var/svc/log/oxide-opte-interface-setup:default.log
12912024-08-13T22:01:27.778Zuploading: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_nexus_1efcbc40-81e4-46c8-9a18-0ae71ba0d085/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
12922024-08-13T22:01:28.846Zuploaded: /pool/ext/deddda0e-da19-4ad9-9ad8-e595727ed9c0/crypt/zone/oxz_nexus_1efcbc40-81e4-46c8-9a18-0ae71ba0d085/root/var/svc/log/oxide-zone-network-setup:default.log
12932024-08-13T22:01:28.846Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_clickhouse_af6e8cd2-b4a2-4da2-a8eb-6df55f1fca96/root/var/svc/log/oxide-clickhouse:default.log (2700818 bytes)
12942024-08-13T22:01:29.204Zupload warning: file "/pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_clickhouse_af6e8cd2-b4a2-4da2-a8eb-6df55f1fca96/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2700818 -> 3403517
12952024-08-13T22:01:30.271Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_clickhouse_af6e8cd2-b4a2-4da2-a8eb-6df55f1fca96/root/var/svc/log/oxide-clickhouse:default.log
12962024-08-13T22:01:30.272Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_clickhouse_af6e8cd2-b4a2-4da2-a8eb-6df55f1fca96/root/var/svc/log/oxide-zone-network-setup:default.log (1685 bytes)
12972024-08-13T22:01:31.363Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_clickhouse_af6e8cd2-b4a2-4da2-a8eb-6df55f1fca96/root/var/svc/log/oxide-zone-network-setup:default.log
12982024-08-13T22:01:31.363Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_cockroachdb_89147c28-69d1-48f3-a1cf-9a7e3b7c9818/root/var/svc/log/oxide-cockroach-admin:default.log (4660 bytes)
12992024-08-13T22:01:32.454Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_cockroachdb_89147c28-69d1-48f3-a1cf-9a7e3b7c9818/root/var/svc/log/oxide-cockroach-admin:default.log
13002024-08-13T22:01:32.454Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_cockroachdb_89147c28-69d1-48f3-a1cf-9a7e3b7c9818/root/var/svc/log/oxide-cockroachdb:default.log (4287 bytes)
13012024-08-13T22:01:33.546Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_cockroachdb_89147c28-69d1-48f3-a1cf-9a7e3b7c9818/root/var/svc/log/oxide-cockroachdb:default.log
13022024-08-13T22:01:33.546Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_cockroachdb_89147c28-69d1-48f3-a1cf-9a7e3b7c9818/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
13032024-08-13T22:01:34.637Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_cockroachdb_89147c28-69d1-48f3-a1cf-9a7e3b7c9818/root/var/svc/log/oxide-zone-network-setup:default.log
13042024-08-13T22:01:34.637Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_crucible_676b4f04-5eea-4cf2-91c0-7ed16b3db46f/root/var/svc/log/oxide-crucible-agent:default.log (8485 bytes)
13052024-08-13T22:01:35.750Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_crucible_676b4f04-5eea-4cf2-91c0-7ed16b3db46f/root/var/svc/log/oxide-crucible-agent:default.log
13062024-08-13T22:01:35.750Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_crucible_676b4f04-5eea-4cf2-91c0-7ed16b3db46f/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13072024-08-13T22:01:36.841Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_crucible_676b4f04-5eea-4cf2-91c0-7ed16b3db46f/root/var/svc/log/oxide-crucible-downstairs:default.log
13082024-08-13T22:01:36.841Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_crucible_676b4f04-5eea-4cf2-91c0-7ed16b3db46f/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c678715-5353-4c56-920e-93f2a91d6120.log (3018 bytes)
13092024-08-13T22:01:37.934Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_crucible_676b4f04-5eea-4cf2-91c0-7ed16b3db46f/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c678715-5353-4c56-920e-93f2a91d6120.log
13102024-08-13T22:01:37.934Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_crucible_676b4f04-5eea-4cf2-91c0-7ed16b3db46f/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
13112024-08-13T22:01:39.025Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_crucible_676b4f04-5eea-4cf2-91c0-7ed16b3db46f/root/var/svc/log/oxide-zone-network-setup:default.log
13122024-08-13T22:01:39.025Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_external_dns_a9d63628-f75d-4167-9f10-447059796aa3/root/var/svc/log/oxide-external_dns:default.log (26896 bytes)
13132024-08-13T22:01:39.135Zupload warning: file "/pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_external_dns_a9d63628-f75d-4167-9f10-447059796aa3/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26896 -> 34451
13142024-08-13T22:01:40.203Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_external_dns_a9d63628-f75d-4167-9f10-447059796aa3/root/var/svc/log/oxide-external_dns:default.log
13152024-08-13T22:01:40.203Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_external_dns_a9d63628-f75d-4167-9f10-447059796aa3/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
13162024-08-13T22:01:41.295Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_external_dns_a9d63628-f75d-4167-9f10-447059796aa3/root/var/svc/log/oxide-opte-interface-setup:default.log
13172024-08-13T22:01:41.295Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_external_dns_a9d63628-f75d-4167-9f10-447059796aa3/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
13182024-08-13T22:01:42.386Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_external_dns_a9d63628-f75d-4167-9f10-447059796aa3/root/var/svc/log/oxide-zone-network-setup:default.log
13192024-08-13T22:01:42.386Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_internal_dns_274f9905-0d90-473f-8a4a-c2c72b5f9262/root/var/svc/log/oxide-internal_dns:default.log (107405 bytes)
13202024-08-13T22:01:42.542Zupload warning: file "/pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_internal_dns_274f9905-0d90-473f-8a4a-c2c72b5f9262/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107405 -> 114915
13212024-08-13T22:01:43.610Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_internal_dns_274f9905-0d90-473f-8a4a-c2c72b5f9262/root/var/svc/log/oxide-internal_dns:default.log
13222024-08-13T22:01:43.610Zuploading: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_internal_dns_274f9905-0d90-473f-8a4a-c2c72b5f9262/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
13232024-08-13T22:01:44.712Zuploaded: /pool/ext/fdb33b68-df3d-44ca-9341-6a4eec7670ff/crypt/zone/oxz_internal_dns_274f9905-0d90-473f-8a4a-c2c72b5f9262/root/var/svc/log/oxide-zone-network-setup:default.log
13242024-08-13T22:01:44.712Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/measurements.log (98640 bytes)
13252024-08-13T22:01:44.858Zupload warning: file "/pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/measurements.log" changed size mid upload: 98640 -> 125218
13262024-08-13T22:01:45.926Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/measurements.log
13272024-08-13T22:01:45.926Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/statistics.log (78273 bytes)
13282024-08-13T22:01:46.080Zupload warning: file "/pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/statistics.log" changed size mid upload: 78273 -> 100854
13292024-08-13T22:01:47.149Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/statistics.log
13302024-08-13T22:01:47.149Zuploading: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/tracking.log (15057 bytes)
13312024-08-13T22:01:47.237Zupload warning: file "/pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/tracking.log" changed size mid upload: 15057 -> 17169
13322024-08-13T22:01:48.305Zuploaded: /pool/ext/3813b565-0c80-4aa9-986b-1dfd99c3d209/crypt/zone/oxz_ntp_938d25c7-23cc-4b70-b837-6f2ff405eca3/root/var/log/chrony/tracking.log