01HZ32JXVPNTG0SW7E18STCTKC: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HZ32KGR1NMAG0Z6J77CTKCVG

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-05-29T21:40:51.139Zjob dependencies complete; ready to run (waiting for 37 m 54 s)
22024-05-29T21:40:51.153Zjob assigned to worker 01HZ340FK39SRTQ16J1PB7ETN6 (queued for 0 s)
32024-05-29T21:40:51.364Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-05-29T21:40:51.414Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-05-29T21:40:51.447Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-05-29T21:40:51.480Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-05-29T21:40:51.513Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-05-29T21:40:51.547ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-05-29T21:40:51.580Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d3
102024-05-29T21:40:51.623ZOxide Helios Version helios-2.0.22656 64-bit
112024-05-29T21:40:51.671ZConfiguring devices.
122024-05-29T21:40:51.711Z##################################################
132024-05-29T21:40:51.755Z#### ############# ##
142024-05-29T21:40:51.797Z### ### ############ ##
152024-05-29T21:40:51.839Z## ### # ## ### ## Oxide Computer Company ##
162024-05-29T21:40:51.874Z## ## ## ### # ### ##
172024-05-29T21:40:51.920Z## # ### #### #### This Station Under ##
182024-05-29T21:40:51.963Z### ### #### # ### Computer Control ##
192024-05-29T21:40:52.008Z#### #### ### ## ##
202024-05-29T21:40:52.075Z##################################################
212024-05-29T21:40:52.149ZHostname: sock
222024-05-29T21:40:52.186ZLoading smf(7) service descriptions:
232024-05-29T21:40:53.434Zdownloading input: /input/package/work/package.tar.gz
242024-05-29T21:45:37.526Zdownloaded input: /input/package/work/package.tar.gz
 
252024-05-29T21:45:37.552Zstarting task 0: "setup"
262024-05-29T21:45:37.552Z++ uname -s
272024-05-29T21:45:37.552Z+ kern=SunOS
282024-05-29T21:45:37.552Z+ case "$kern" in
292024-05-29T21:45:37.552Z+ groupadd -g 12345 build
302024-05-29T21:45:37.552Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-05-29T21:45:39.545Z+ zfs create -o mountpoint=/work rpool/work
322024-05-29T21:45:39.570Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-05-29T21:45:39.596Z+ home_fs=zfs
342024-05-29T21:45:39.596Z+ [[ zfs == autofs ]]
352024-05-29T21:45:39.596Z+ mkdir -p /home/build
362024-05-29T21:45:39.596Z+ chown build:build /home/build /work
372024-05-29T21:45:41.583Z+ chmod 0700 /home/build /work
382024-05-29T21:45:41.614Zprocess exited: duration 4056 ms, exit code 0
 
392024-05-29T21:45:41.678Zstarting task 1: "authentication"
402024-05-29T21:45:41.727Zprocess exited: duration 47 ms, exit code 0
 
412024-05-29T21:45:41.781Zstarting task 2: "build"
422024-05-29T21:45:41.809Z+ trap _exit_trap EXIT
432024-05-29T21:45:41.809Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-05-29T21:45:41.902Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-05-29T21:45:41.902Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-05-29T21:45:41.902Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-05-29T21:45:41.902Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-05-29T21:45:41.902Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-05-29T21:45:41.902Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-05-29T21:45:41.902Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-05-29T21:45:41.903Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-05-29T21:45:41.903Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-05-29T21:45:41.903Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-05-29T21:45:41.903Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-05-29T21:45:41.931Z+ [[ -d /opt/oxide ]]
562024-05-29T21:45:41.931Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-05-29T21:45:41.931Z+ pfexec mkdir /opt/oxide
582024-05-29T21:45:41.931Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-05-29T21:45:41.931Z+ [[ -d /opt/oxide-underneath ]]
602024-05-29T21:45:41.931Z+ cd /opt/oxide-underneath
612024-05-29T21:45:41.931Z+ pfexec tar ceEp@/f - .
622024-05-29T21:45:41.931Z+ cd /opt/oxide
632024-05-29T21:45:41.931Z+ pfexec tar xveEp@/f -
642024-05-29T21:45:42.011Zx ., 0 bytes, 0 tape blocks
652024-05-29T21:45:42.011Zx ./opte, 0 bytes, 0 tape blocks
662024-05-29T21:45:42.011Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-05-29T21:45:42.011Zx ./opte/bin/opteadm, 43425608 bytes, 84816 tape blocks
682024-05-29T21:45:42.040Z+ pfexec rm -rf /opt/oxide-underneath
692024-05-29T21:45:42.040Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-05-29T21:45:42.040Z+ pfexec mkdir /opt/oxide/work
712024-05-29T21:45:42.066Z+ pfexec chown build:build /opt/oxide/work
722024-05-29T21:45:42.066Z+ cd /opt/oxide/work
732024-05-29T21:45:42.066Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-05-29T21:45:54.020ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-05-29T21:45:54.020Zx out/target/test, 75 bytes, 1 tape blocks
762024-05-29T21:45:54.020Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-05-29T21:45:54.020Zx package-manifest.toml, 27338 bytes, 54 tape blocks
782024-05-29T21:45:54.020Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-05-29T21:45:54.020Zx target/release/omicron-package, 32387088 bytes, 63257 tape blocks
802024-05-29T21:45:54.020Zx target/release/xtask, 6827248 bytes, 13335 tape blocks
812024-05-29T21:45:54.020Zx target/debug/bootstrap, 356004096 bytes, 695321 tape blocks
822024-05-29T21:45:54.020Zx tests/bootstrap-562ff04add60b960, 24584584 bytes, 48017 tape blocks
832024-05-29T21:45:54.020Zx tests/commtest-1ebd58e5c16d1891, 24585152 bytes, 48018 tape blocks
842024-05-29T21:45:54.020Zx tests/dhcp_server-d9caab43602819e6, 24584592 bytes, 48017 tape blocks
852024-05-29T21:45:54.020Zx tests/end_to_end_tests-fa93711239d79f99, 366292248 bytes, 715415 tape blocks
862024-05-29T21:45:54.020Zx out/clickhouse.tar.gz, 228168147 bytes, 445641 tape blocks
872024-05-29T21:45:54.020Zx out/clickhouse_keeper.tar.gz, 228153580 bytes, 445613 tape blocks
882024-05-29T21:45:54.020Zx out/cockroachdb.tar.gz, 123678689 bytes, 241560 tape blocks
892024-05-29T21:45:54.020Zx out/crucible-pantry-zone.tar.gz, 27840697 bytes, 54377 tape blocks
902024-05-29T21:45:54.020Zx out/crucible-zone.tar.gz, 38864929 bytes, 75909 tape blocks
912024-05-29T21:45:54.020Zx out/external-dns.tar.gz, 25438116 bytes, 49684 tape blocks
922024-05-29T21:45:54.021Zx out/internal-dns.tar.gz, 25437858 bytes, 49684 tape blocks
932024-05-29T21:45:54.021Zx out/mg-ddm-gz.tar, 61847040 bytes, 120795 tape blocks
942024-05-29T21:45:54.021Zx out/nexus.tar.gz, 83407679 bytes, 162906 tape blocks
952024-05-29T21:45:54.021Zx out/ntp.tar.gz, 8956843 bytes, 17494 tape blocks
962024-05-29T21:45:54.021Zx out/omicron-gateway-softnpu.tar.gz, 14793540 bytes, 28894 tape blocks
972024-05-29T21:45:54.021Zx out/omicron-sled-agent.tar, 94488064 bytes, 184547 tape blocks
982024-05-29T21:45:54.021Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
992024-05-29T21:45:54.021Zx out/oximeter.tar.gz, 40947672 bytes, 79976 tape blocks
1002024-05-29T21:45:54.021Zx out/oxlog.tar, 2967040 bytes, 5795 tape blocks
1012024-05-29T21:45:54.021Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1022024-05-29T21:45:54.021Zx out/propolis-server.tar.gz, 67005412 bytes, 130870 tape blocks
1032024-05-29T21:45:54.021Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1042024-05-29T21:45:54.021Zx out/switch-softnpu.tar.gz, 199648393 bytes, 389939 tape blocks
1052024-05-29T21:45:54.052Z
1062024-05-29T21:45:54.052Zreal 11.941966614
1072024-05-29T21:45:54.052Zuser 10.598946269
1082024-05-29T21:45:54.053Zsys 2.375502838
1092024-05-29T21:45:54.053Ztrap 0.000501974
1102024-05-29T21:45:54.053Ztflt 0.000000000
1112024-05-29T21:45:54.053Zdflt 0.000000000
1122024-05-29T21:45:54.053Zkflt 0.000000000
1132024-05-29T21:45:54.053Zlock 0.000000000
1142024-05-29T21:45:54.053Zslp 10.620659163
1152024-05-29T21:45:54.053Zlat 0.286376074
1162024-05-29T21:45:54.053Zstop 0.000118881
1172024-05-29T21:45:54.053Z+ bmat address ls
1182024-05-29T21:45:54.053ZNAME CIDR FIRST LAST COUNT
1192024-05-29T21:45:54.053Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1202024-05-29T21:45:54.053Z++ bmat address ls -f extra -Ho first,last,count
1212024-05-29T21:45:54.053Z+ set -- 10.151.2.164 10.151.2.227 64
1222024-05-29T21:45:54.053Z+ EXTRA_IP_START=10.151.2.164
1232024-05-29T21:45:54.053Z+ EXTRA_IP_END=10.151.2.227
1242024-05-29T21:45:54.053Z+ EXTRA_IP_COUNT=64
1252024-05-29T21:45:54.053Z+ (( EXTRA_IP_COUNT >= 32 ))
1262024-05-29T21:45:54.053Z+ EXTRA_IP_BASE=10.151.2
1272024-05-29T21:45:54.053Z+ EXTRA_IP_FOCTET=164
1282024-05-29T21:45:54.054Z+ EXTRA_IP_LOCTET=227
1292024-05-29T21:45:54.054Z+ SERVICE_IP_POOL_START=10.151.2.164
1302024-05-29T21:45:54.054Z+ SERVICE_IP_POOL_END=10.151.2.173
1312024-05-29T21:45:54.054Z+ DNS_IP1=10.151.2.164
1322024-05-29T21:45:54.054Z+ DNS_IP2=10.151.2.165
1332024-05-29T21:45:54.054Z+ UPLINK_IP=10.151.2.174
1342024-05-29T21:45:54.054Z+ IPPOOL_START=10.151.2.175
1352024-05-29T21:45:54.054Z+ IPPOOL_END=10.151.2.227
1362024-05-29T21:45:54.054Z++ ipadm show-addr -po type,addr
1372024-05-29T21:45:54.054Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1382024-05-29T21:45:54.054Z+ GATEWAY_IP=10.151.2.100
1392024-05-29T21:45:54.054Z+ [[ -n 10.151.2.100 ]]
1402024-05-29T21:45:54.054Z+ ping -s 10.151.2.100 56 1
1412024-05-29T21:45:54.054ZPING 10.151.2.100: 56 data bytes
1422024-05-29T21:45:54.054Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.012 ms
1432024-05-29T21:45:54.054Z
1442024-05-29T21:45:54.054Z----10.151.2.100 PING Statistics----
1452024-05-29T21:45:54.054Z1 packets transmitted, 1 packets received, 0% packet loss
1462024-05-29T21:45:54.054Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
1472024-05-29T21:45:54.054Z++ arp -an
1482024-05-29T21:45:54.054Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1492024-05-29T21:45:54.055Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1502024-05-29T21:45:54.055Z+ routeadm -e ipv4-forwarding -u
1512024-05-29T21:45:54.167Z+ PXA_START=10.151.2.164
1522024-05-29T21:45:54.167Z+ PXA_END=10.151.2.227
1532024-05-29T21:45:54.199Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1542024-05-29T21:45:54.338Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227
1552024-05-29T21:45:54.368ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1562024-05-29T21:45:54.411Zcreating virtual hardware
1572024-05-29T21:45:54.442Zcreating /scratch/m2_0.vdev
1582024-05-29T21:45:54.442Zcreating /scratch/m2_1.vdev
1592024-05-29T21:45:54.442Zcreating /scratch/u2_0.vdev
1602024-05-29T21:45:54.442Zcreating /scratch/u2_1.vdev
1612024-05-29T21:45:54.442Zcreating /scratch/u2_2.vdev
1622024-05-29T21:45:54.442Zcreating /scratch/u2_3.vdev
1632024-05-29T21:45:54.442Zcreating /scratch/u2_4.vdev
1642024-05-29T21:45:54.442Zcreating /scratch/u2_5.vdev
1652024-05-29T21:45:54.442Zcreating /scratch/u2_6.vdev
1662024-05-29T21:45:54.442Zcreating /scratch/u2_7.vdev
1672024-05-29T21:45:54.442Zcreating /scratch/u2_8.vdev
1682024-05-29T21:45:54.474ZSimnet net0/sc0_0 exists
1692024-05-29T21:45:54.509ZSimnet net1/sc1_0 exists
1702024-05-29T21:45:54.509ZVnic sc0_1 exists
1712024-05-29T21:46:22.763ZUsing 10.151.2.100 as gateway ip
1722024-05-29T21:46:22.763Zusing 18:C0:4D:0D:A0:2A as gateway mac
1732024-05-29T21:46:22.764Zconfiguring SoftNPU ARP entry
1742024-05-29T21:46:22.789Zconfiguring SoftNPU proxy ARP
1752024-05-29T21:46:22.842ZSoftNPU state:
1762024-05-29T21:46:22.842Z local v6:
1772024-05-29T21:46:22.842Z local v4:
1782024-05-29T21:46:22.842Z router v6:
1792024-05-29T21:46:22.842Z router v4_idx:
1802024-05-29T21:46:22.842Z router v4_routes:
1812024-05-29T21:46:22.842Z resolver v4:
1822024-05-29T21:46:22.842Z 10.151.2.100 -> 18:c0:4d:0d:a0:2a
1832024-05-29T21:46:22.842Z resolver v6:
1842024-05-29T21:46:22.842Z nat v4:
1852024-05-29T21:46:22.842Z nat_v6:
1862024-05-29T21:46:22.842Z port_mac:
1872024-05-29T21:46:22.842Z proxy arp:
1882024-05-29T21:46:22.842Z 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
1892024-05-29T21:46:22.842Zcreated virtual hardware
1902024-05-29T21:46:22.867Z
1912024-05-29T21:46:22.868Zreal 28.507345511
1922024-05-29T21:46:22.868Zuser 0.640103601
1932024-05-29T21:46:22.868Zsys 3.323050359
1942024-05-29T21:46:22.868Ztrap 0.000091106
1952024-05-29T21:46:22.868Ztflt 0.000246590
1962024-05-29T21:46:22.868Zdflt 0.001443819
1972024-05-29T21:46:22.868Zkflt 0.000000000
1982024-05-29T21:46:22.868Zlock 22:11.655571705
1992024-05-29T21:46:22.868Zslp 1:25.880324157
2002024-05-29T21:46:22.868Zlat 0.074013339
2012024-05-29T21:46:22.868Zstop 0.347298234
2022024-05-29T21:46:22.868Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2032024-05-29T21:46:22.919Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2042024-05-29T21:46:22.919Z+ diff -u pkg/config.toml~ pkg/config.toml
2052024-05-29T21:46:22.919Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2062024-05-29T21:46:22.919Z+++ pkg/config.toml Wed May 29 21:46:23 2024
2072024-05-29T21:46:22.919Z@@ -29,18 +29,18 @@
2082024-05-29T21:46:22.919Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2092024-05-29T21:46:22.919Z # followed by a string that is embedded into their fake serial values.
2102024-05-29T21:46:22.919Z vdevs = [
2112024-05-29T21:46:22.919Z- "m2_0.vdev",
2122024-05-29T21:46:22.920Z- "m2_1.vdev",
2132024-05-29T21:46:22.920Z+ "/scratch/m2_0.vdev",
2142024-05-29T21:46:22.920Z+ "/scratch/m2_1.vdev",
2152024-05-29T21:46:22.920Z
2162024-05-29T21:46:22.920Z- "u2_0.vdev",
2172024-05-29T21:46:22.920Z- "u2_1.vdev",
2182024-05-29T21:46:22.920Z- "u2_2.vdev",
2192024-05-29T21:46:22.920Z- "u2_3.vdev",
2202024-05-29T21:46:22.920Z- "u2_4.vdev",
2212024-05-29T21:46:22.920Z- "u2_5.vdev",
2222024-05-29T21:46:22.920Z- "u2_6.vdev",
2232024-05-29T21:46:22.920Z- "u2_7.vdev",
2242024-05-29T21:46:22.921Z- "u2_8.vdev",
2252024-05-29T21:46:22.921Z+ "/scratch/u2_0.vdev",
2262024-05-29T21:46:22.921Z+ "/scratch/u2_1.vdev",
2272024-05-29T21:46:22.921Z+ "/scratch/u2_2.vdev",
2282024-05-29T21:46:22.921Z+ "/scratch/u2_3.vdev",
2292024-05-29T21:46:22.921Z+ "/scratch/u2_4.vdev",
2302024-05-29T21:46:22.921Z+ "/scratch/u2_5.vdev",
2312024-05-29T21:46:22.921Z+ "/scratch/u2_6.vdev",
2322024-05-29T21:46:22.921Z+ "/scratch/u2_7.vdev",
2332024-05-29T21:46:22.921Z+ "/scratch/u2_8.vdev",
2342024-05-29T21:46:22.921Z ]
2352024-05-29T21:46:22.921Z
2362024-05-29T21:46:22.921Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2372024-05-29T21:46:22.922Z+ true
2382024-05-29T21:46:22.922Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2392024-05-29T21:46:22.922Z+ SILO_NAME=recovery
2402024-05-29T21:46:22.922Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2412024-05-29T21:46:22.922Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2422024-05-29T21:46:22.922Z+ sed -i~ '
2432024-05-29T21:46:22.922Z /^external_dns_ips/c\
2442024-05-29T21:46:22.922Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2452024-05-29T21:46:22.922Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2462024-05-29T21:46:22.922Z /^first/c\
2472024-05-29T21:46:22.922Zfirst = "10.151.2.164"
2482024-05-29T21:46:22.922Z /^last/c\
2492024-05-29T21:46:22.923Zlast = "10.151.2.173"
2502024-05-29T21:46:22.923Z }
2512024-05-29T21:46:22.923Z /^infra_ip_first/c\
2522024-05-29T21:46:22.923Zinfra_ip_first = "10.151.2.174"
2532024-05-29T21:46:22.923Z /^infra_ip_last/c\
2542024-05-29T21:46:22.923Zinfra_ip_last = "10.151.2.174"
2552024-05-29T21:46:22.923Z /^\[\[rack_network_config.ports/,/^$/ {
2562024-05-29T21:46:22.923Z /^routes/c\
2572024-05-29T21:46:22.923Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
2582024-05-29T21:46:22.923Z /^addresses/c\
2592024-05-29T21:46:22.923Zaddresses = \["10.151.2.174/24"\]
2602024-05-29T21:46:22.923Z }
2612024-05-29T21:46:22.924Z' pkg/config-rss.toml
2622024-05-29T21:46:22.924Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2632024-05-29T21:46:22.924Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2642024-05-29T21:46:22.924Z+++ pkg/config-rss.toml Wed May 29 21:46:23 2024
2652024-05-29T21:46:22.924Z@@ -33,7 +33,7 @@
2662024-05-29T21:46:22.924Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2672024-05-29T21:46:22.924Z # must be contained in one of the "internal services" IP Pool ranges listed
2682024-05-29T21:46:22.924Z # below.
2692024-05-29T21:46:22.924Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2702024-05-29T21:46:22.924Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2712024-05-29T21:46:22.924Z
2722024-05-29T21:46:22.924Z # Initial TLS certificates for the external API
2732024-05-29T21:46:22.924Z #
2742024-05-29T21:46:22.925Z@@ -69,8 +69,8 @@
2752024-05-29T21:46:22.925Z #
2762024-05-29T21:46:22.925Z # For more on this and what to put here, see docs/how-to-run.adoc.
2772024-05-29T21:46:22.925Z [[internal_services_ip_pool_ranges]]
2782024-05-29T21:46:22.925Z-first = "192.168.1.20"
2792024-05-29T21:46:22.925Z-last = "192.168.1.29"
2802024-05-29T21:46:22.925Z+first = "10.151.2.164"
2812024-05-29T21:46:22.925Z+last = "10.151.2.173"
2822024-05-29T21:46:22.925Z
2832024-05-29T21:46:22.925Z # TODO - this configuration is subject to change going forward. Ultimately these
2842024-05-29T21:46:22.925Z # parameters should be provided to the control plane via wicket, but we need to
2852024-05-29T21:46:22.925Z@@ -91,8 +91,8 @@
2862024-05-29T21:46:22.926Z # A range of IP addresses used by Boundary Services on the external network. In
2872024-05-29T21:46:22.926Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2882024-05-29T21:46:22.926Z # With softnpu, only one address is used.
2892024-05-29T21:46:22.926Z-infra_ip_first = "192.168.1.30"
2902024-05-29T21:46:22.926Z-infra_ip_last = "192.168.1.30"
2912024-05-29T21:46:22.926Z+infra_ip_first = "10.151.2.174"
2922024-05-29T21:46:22.926Z+infra_ip_last = "10.151.2.174"
2932024-05-29T21:46:22.926Z
2942024-05-29T21:46:22.926Z # Configurations for BGP routers to run on the scrimlets.
2952024-05-29T21:46:22.926Z bgp = []
2962024-05-29T21:46:22.926Z@@ -100,9 +100,9 @@
2972024-05-29T21:46:22.926Z # You can configure multiple uplinks by repeating the following stanza
2982024-05-29T21:46:22.926Z [[rack_network_config.ports]]
2992024-05-29T21:46:22.927Z # Routes associated with this port.
3002024-05-29T21:46:22.927Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3012024-05-29T21:46:22.927Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
3022024-05-29T21:46:22.927Z # Addresses associated with this port.
3032024-05-29T21:46:22.953Z-addresses = ["192.168.1.30/24"]
3042024-05-29T21:46:22.953Z+addresses = ["10.151.2.174/24"]
3052024-05-29T21:46:22.953Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3062024-05-29T21:46:22.953Z port = "qsfp0"
3072024-05-29T21:46:22.953Z # The speed of this port.
3082024-05-29T21:46:22.953Z+ true
3092024-05-29T21:46:22.953Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3102024-05-29T21:46:22.954Za pkg/config-rss.toml 7K
3112024-05-29T21:46:22.954Za pkg/config.toml 4K
3122024-05-29T21:46:22.954Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3132024-05-29T21:46:22.954Z+ TLS_NAME=recovery.sys.oxide.test
3142024-05-29T21:46:22.954Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3152024-05-29T21:46:23.490Z.....+.....+............+.+........+.......+..+.+..+.........+......+.......+...+...+......+.....+...+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.....+.+...+..+..........+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+........+...+.........+.............+..+.......+......+..+...+...............+........................+...+......+.........+...+..........+..+.......+........+.+..+............+.............+...+..+.......+........+...................+..............+......+.+..+.+......+.........+.....+...............+......+.+........+......+...+..........+.....+..................+...+......+...............+...+.+..............+................+...............+......+...+.....+.+..+....+..................+......+...................................+.+....................+......+.......+......+..............+......+.+...+..+....+............+..+.+.........+........+...+......+....+.....+.........+.+..+.......+........+....+....................+.+..+.............+...+.....+.+.....+...+..........+...........+.........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3162024-05-29T21:46:23.654Z...+.......+......+...+..+...+......+.+.....+....+......+.....+..........+..+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+..........+.......................+.+..+.........+....+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-05-29T21:46:23.679Z-----
3182024-05-29T21:46:23.704Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3192024-05-29T21:46:23.704Za pkg/initial-tls-cert.pem 2K
3202024-05-29T21:46:23.704Za pkg/initial-tls-key.pem 4K
3212024-05-29T21:46:23.704Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3222024-05-29T21:46:23.704Z+ rmdir pkg
3232024-05-29T21:46:23.704Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3242024-05-29T21:46:23.704Z+ pfexec mkdir -p /usr/oxide
3252024-05-29T21:46:23.704Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3262024-05-29T21:46:24.342Z+ pfexec chmod +x /usr/oxide/oxide
3272024-05-29T21:46:24.368Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3282024-05-29T21:46:42.739Z+ OMICRON_NO_UNINSTALL=1
3292024-05-29T21:46:42.740Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3302024-05-29T21:46:42.764ZLogging to: /opt/oxide/work/out/LOG
3312024-05-29T21:46:43.305Z
3322024-05-29T21:46:43.305Zreal 0.550820648
3332024-05-29T21:46:43.305Zuser 0.114838370
3342024-05-29T21:46:43.305Zsys 2.380618069
3352024-05-29T21:46:43.305Ztrap 0.000013719
3362024-05-29T21:46:43.305Ztflt 0.000028229
3372024-05-29T21:46:43.305Zdflt 0.001137915
3382024-05-29T21:46:43.305Zkflt 0.000000000
3392024-05-29T21:46:43.305Zlock 49.982373371
3402024-05-29T21:46:43.305Zslp 0.765529305
3412024-05-29T21:46:43.305Zlat 0.003132428
3422024-05-29T21:46:43.305Zstop 0.202734956
3432024-05-29T21:46:43.305Z+ retry=0
3442024-05-29T21:46:43.305Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3452024-05-29T21:46:43.332Z+ [[ 0 -gt 30 ]]
3462024-05-29T21:46:43.332Z+ sleep 1
3472024-05-29T21:46:44.309Z+ retry=1
3482024-05-29T21:46:44.309Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3492024-05-29T21:46:44.334Z+ [[ 1 -gt 30 ]]
3502024-05-29T21:46:44.334Z+ sleep 1
3512024-05-29T21:46:45.323Z+ retry=2
3522024-05-29T21:46:45.324Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3532024-05-29T21:46:45.350Z+ [[ 2 -gt 30 ]]
3542024-05-29T21:46:45.350Z+ sleep 1
3552024-05-29T21:46:46.337Z+ retry=3
3562024-05-29T21:46:46.337Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3572024-05-29T21:47:11.511Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3582024-05-29T21:47:11.536Zlocal v6:
3592024-05-29T21:47:11.537Zfe80::44bc:1dff:feda:ef22
3602024-05-29T21:47:11.537Zfd15:a7bc:ac0c:c341::1
3612024-05-29T21:47:11.537Zlocal v4:
3622024-05-29T21:47:11.537Z10.151.2.174
3632024-05-29T21:47:11.537Zrouter v6:
3642024-05-29T21:47:11.537Zfdb0:18c0:4d0d:a02a::/64 -> fe80::6059:2aff:fe8f:ae50 (1)
3652024-05-29T21:47:11.537Zfd00:1122:3344:101::/64 -> fe80::6059:2aff:fe8f:ae50 (1)
3662024-05-29T21:47:11.537Zfd00:1122:3344:1::/64 -> fe80::6059:2aff:fe8f:ae50 (1)
3672024-05-29T21:47:11.537Zfd00:1122:3344:2::/64 -> fe80::6059:2aff:fe8f:ae50 (1)
3682024-05-29T21:47:11.537Zfd00:1122:3344:3::/64 -> fe80::6059:2aff:fe8f:ae50 (1)
3692024-05-29T21:47:11.537Zrouter v4_idx:
3702024-05-29T21:47:11.537Z0.0.0.0/0 -> 0
3712024-05-29T21:47:11.537Zrouter v4_routes:
3722024-05-29T21:47:11.537Z0 -> 10.151.2.100 (2)
3732024-05-29T21:47:11.537Zresolver v4:
3742024-05-29T21:47:11.562Z10.151.2.174 -> 4a:bd:f7:50:54:e6
3752024-05-29T21:47:11.562Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
3762024-05-29T21:47:11.562Zresolver v6:
3772024-05-29T21:47:11.562Zfe80::44bc:1dff:feda:ef22 -> 46:bc:1d:da:ef:22
3782024-05-29T21:47:11.562Zfe80::6059:2aff:fe8f:ae50 -> 62:59:2a:8f:ae:50
3792024-05-29T21:47:11.562Znat v4:
3802024-05-29T21:47:11.562Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:bb:60
3812024-05-29T21:47:11.563Znat_v6:
3822024-05-29T21:47:11.563Zport_mac:
3832024-05-29T21:47:11.563Z2: a8:40:25:4a:ee:db
3842024-05-29T21:47:11.563Z1: a8:40:25:4a:ee:bb
3852024-05-29T21:47:11.563Z1000: a8:40:25:4a:ee:ba
3862024-05-29T21:47:11.563Zproxy arp:
3872024-05-29T21:47:11.563Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
3882024-05-29T21:47:11.563Z+ retry=0
3892024-05-29T21:47:11.563Z+++ zoneadm list -n
3902024-05-29T21:47:11.563Z+++ grep oxz_ntp
3912024-05-29T21:47:11.563Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
3922024-05-29T21:47:11.590Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
3932024-05-29T21:47:11.590Z++ true
3942024-05-29T21:47:11.590Z+ [[ '' != online ]]
3952024-05-29T21:47:11.590Z+ [[ 0 -gt 60 ]]
3962024-05-29T21:47:11.590Z+ sleep 1
3972024-05-29T21:47:12.569Z+ retry=1
3982024-05-29T21:47:12.595Z+++ zoneadm list -n
3992024-05-29T21:47:12.595Z+++ grep oxz_ntp
4002024-05-29T21:47:12.595Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
4012024-05-29T21:47:12.619Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4022024-05-29T21:47:12.619Z++ true
4032024-05-29T21:47:12.620Z+ [[ '' != online ]]
4042024-05-29T21:47:12.620Z+ [[ 1 -gt 60 ]]
4052024-05-29T21:47:12.620Z+ sleep 1
4062024-05-29T21:47:13.602Z+ retry=2
4072024-05-29T21:47:13.633Z+++ zoneadm list -n
4082024-05-29T21:47:13.633Z+++ grep oxz_ntp
4092024-05-29T21:47:13.633Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
4102024-05-29T21:47:13.634Z+ [[ offline != online ]]
4112024-05-29T21:47:13.634Z+ [[ 2 -gt 60 ]]
4122024-05-29T21:47:13.634Z+ sleep 1
4132024-05-29T21:47:14.630Z+ retry=3
4142024-05-29T21:47:14.666Z+++ zoneadm list -n
4152024-05-29T21:47:14.666Z+++ grep oxz_ntp
4162024-05-29T21:47:14.667Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
4172024-05-29T21:47:14.667Z+ [[ offline != online ]]
4182024-05-29T21:47:14.667Z+ [[ 3 -gt 60 ]]
4192024-05-29T21:47:14.667Z+ sleep 1
4202024-05-29T21:47:15.648Z+ retry=4
4212024-05-29T21:47:15.684Z+++ zoneadm list -n
4222024-05-29T21:47:15.684Z+++ grep oxz_ntp
4232024-05-29T21:47:15.685Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
4242024-05-29T21:47:15.685Z+ [[ offline != online ]]
4252024-05-29T21:47:15.685Z+ [[ 4 -gt 60 ]]
4262024-05-29T21:47:15.685Z+ sleep 1
4272024-05-29T21:47:16.673Z+ retry=5
4282024-05-29T21:47:16.712Z+++ zoneadm list -n
4292024-05-29T21:47:16.712Z+++ grep oxz_ntp
4302024-05-29T21:47:16.712Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
4312024-05-29T21:47:16.712Z+ [[ offline != online ]]
4322024-05-29T21:47:16.712Z+ [[ 5 -gt 60 ]]
4332024-05-29T21:47:16.713Z+ sleep 1
4342024-05-29T21:47:17.694Z+ retry=6
4352024-05-29T21:47:17.734Z+++ zoneadm list -n
4362024-05-29T21:47:17.734Z+++ grep oxz_ntp
4372024-05-29T21:47:17.734Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
4382024-05-29T21:47:17.734Z+ [[ offline != online ]]
4392024-05-29T21:47:17.735Z+ [[ 6 -gt 60 ]]
4402024-05-29T21:47:17.735Z+ sleep 1
4412024-05-29T21:47:18.723Z+ retry=7
4422024-05-29T21:47:18.758Z+++ zoneadm list -n
4432024-05-29T21:47:18.758Z+++ grep oxz_ntp
4442024-05-29T21:47:18.758Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
4452024-05-29T21:47:18.758Z+ [[ offline != online ]]
4462024-05-29T21:47:18.759Z+ [[ 7 -gt 60 ]]
4472024-05-29T21:47:18.759Z+ sleep 1
 
4482024-05-29T21:47:20.151Zsock console login: May 29 21:47:19 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
4492024-05-29T21:47:20.161Z+ retry=8
4502024-05-29T21:47:20.195Z+++ zoneadm list -n
4512024-05-29T21:47:20.195Z+++ grep oxz_ntp
4522024-05-29T21:47:20.196Z++ pfexec svcs -z oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575 -Hostate oxide/ntp
4532024-05-29T21:47:20.196Z+ [[ online != online ]]
4542024-05-29T21:47:20.196Z+ echo 'Waited for chrony: 8s'
4552024-05-29T21:47:20.196Z+ retry=0
4562024-05-29T21:47:20.196ZWaited for chrony: 8s
4572024-05-29T21:47:20.196Z+ zoneadm list
4582024-05-29T21:47:20.196Z+ grep nexus
4592024-05-29T21:47:20.196Z+ [[ 0 -gt 300 ]]
4602024-05-29T21:47:20.196Z+ sleep 1
4612024-05-29T21:47:20.765Z+ retry=1
4622024-05-29T21:47:20.795Z+ zoneadm list
4632024-05-29T21:47:20.796Z+ grep nexus
4642024-05-29T21:47:20.796Z+ [[ 1 -gt 300 ]]
4652024-05-29T21:47:20.796Z+ sleep 1
4662024-05-29T21:47:21.779Z+ retry=2
4672024-05-29T21:47:21.807Z+ zoneadm list
4682024-05-29T21:47:21.807Z+ grep nexus
4692024-05-29T21:47:21.807Z+ [[ 2 -gt 300 ]]
4702024-05-29T21:47:21.808Z+ sleep 1
4712024-05-29T21:47:22.787Z+ retry=3
4722024-05-29T21:47:22.812Z+ zoneadm list
4732024-05-29T21:47:22.812Z+ grep nexus
4742024-05-29T21:47:22.812Z+ [[ 3 -gt 300 ]]
4752024-05-29T21:47:22.813Z+ sleep 1
4762024-05-29T21:47:23.812Z+ retry=4
4772024-05-29T21:47:23.848Z+ zoneadm list
4782024-05-29T21:47:23.848Z+ grep nexus
4792024-05-29T21:47:23.849Z+ [[ 4 -gt 300 ]]
4802024-05-29T21:47:23.850Z+ sleep 1
4812024-05-29T21:47:24.809Z+ retry=5
4822024-05-29T21:47:24.842Z+ zoneadm list
4832024-05-29T21:47:24.842Z+ grep nexus
4842024-05-29T21:47:24.842Z+ [[ 5 -gt 300 ]]
4852024-05-29T21:47:24.842Z+ sleep 1
4862024-05-29T21:47:25.819Z+ retry=6
4872024-05-29T21:47:25.852Z+ zoneadm list
4882024-05-29T21:47:25.853Z+ grep nexus
4892024-05-29T21:47:25.853Z+ [[ 6 -gt 300 ]]
4902024-05-29T21:47:25.853Z+ sleep 1
4912024-05-29T21:47:26.836Z+ retry=7
4922024-05-29T21:47:26.874Z+ zoneadm list
4932024-05-29T21:47:26.874Z+ grep nexus
4942024-05-29T21:47:26.874Z+ [[ 7 -gt 300 ]]
4952024-05-29T21:47:26.875Z+ sleep 1
4962024-05-29T21:47:27.852Z+ retry=8
4972024-05-29T21:47:27.890Z+ zoneadm list
4982024-05-29T21:47:27.890Z+ grep nexus
4992024-05-29T21:47:27.890Z+ [[ 8 -gt 300 ]]
5002024-05-29T21:47:27.891Z+ sleep 1
5012024-05-29T21:47:28.847Z+ retry=9
5022024-05-29T21:47:28.876Z+ zoneadm list
5032024-05-29T21:47:28.876Z+ grep nexus
5042024-05-29T21:47:28.876Z+ [[ 9 -gt 300 ]]
5052024-05-29T21:47:28.876Z+ sleep 1
5062024-05-29T21:47:29.881Z+ retry=10
5072024-05-29T21:47:29.932Z+ zoneadm list
5082024-05-29T21:47:29.933Z+ grep nexus
5092024-05-29T21:47:29.933Z+ [[ 10 -gt 300 ]]
5102024-05-29T21:47:29.933Z+ sleep 1
5112024-05-29T21:47:30.880Z+ retry=11
5122024-05-29T21:47:30.942Z+ zoneadm list
5132024-05-29T21:47:30.943Z+ grep nexus
5142024-05-29T21:47:30.943Z+ [[ 11 -gt 300 ]]
5152024-05-29T21:47:30.943Z+ sleep 1
5162024-05-29T21:47:32.346Z+ retry=12
5172024-05-29T21:47:32.404Z+ zoneadm list
5182024-05-29T21:47:32.405Z+ grep nexus
5192024-05-29T21:47:32.405Z+ [[ 12 -gt 300 ]]
5202024-05-29T21:47:32.405Z+ sleep 1
5212024-05-29T21:47:32.896Z+ retry=13
5222024-05-29T21:47:32.933Z+ zoneadm list
5232024-05-29T21:47:32.933Z+ grep nexus
5242024-05-29T21:47:32.933Z+ [[ 13 -gt 300 ]]
5252024-05-29T21:47:32.933Z+ sleep 1
5262024-05-29T21:47:33.929Z+ retry=14
5272024-05-29T21:47:33.970Z+ zoneadm list
5282024-05-29T21:47:33.970Z+ grep nexus
5292024-05-29T21:47:33.970Z+ [[ 14 -gt 300 ]]
5302024-05-29T21:47:33.971Z+ sleep 1
5312024-05-29T21:47:34.924Z+ retry=15
5322024-05-29T21:47:34.963Z+ zoneadm list
5332024-05-29T21:47:34.964Z+ grep nexus
5342024-05-29T21:47:34.964Z+ [[ 15 -gt 300 ]]
5352024-05-29T21:47:34.964Z+ sleep 1
5362024-05-29T21:47:35.936Z+ retry=16
5372024-05-29T21:47:35.980Z+ zoneadm list
5382024-05-29T21:47:35.980Z+ grep nexus
5392024-05-29T21:47:35.980Z+ [[ 16 -gt 300 ]]
5402024-05-29T21:47:35.980Z+ sleep 1
5412024-05-29T21:47:36.931Z+ retry=17
5422024-05-29T21:47:36.963Z+ zoneadm list
5432024-05-29T21:47:36.964Z+ grep nexus
5442024-05-29T21:47:36.964Z+ [[ 17 -gt 300 ]]
5452024-05-29T21:47:36.964Z+ sleep 1
5462024-05-29T21:47:37.943Z+ retry=18
5472024-05-29T21:47:37.985Z+ zoneadm list
5482024-05-29T21:47:37.985Z+ grep nexus
5492024-05-29T21:47:37.986Z+ [[ 18 -gt 300 ]]
5502024-05-29T21:47:37.986Z+ sleep 1
5512024-05-29T21:47:38.953Z+ retry=19
5522024-05-29T21:47:38.980Z+ zoneadm list
5532024-05-29T21:47:38.981Z+ grep nexus
5542024-05-29T21:47:38.981Z+ [[ 19 -gt 300 ]]
5552024-05-29T21:47:38.981Z+ sleep 1
5562024-05-29T21:47:39.959Z+ retry=20
5572024-05-29T21:47:39.984Z+ zoneadm list
5582024-05-29T21:47:39.985Z+ grep nexus
5592024-05-29T21:47:39.985Z+ [[ 20 -gt 300 ]]
5602024-05-29T21:47:39.985Z+ sleep 1
5612024-05-29T21:47:40.975Z+ retry=21
5622024-05-29T21:47:41.006Z+ zoneadm list
5632024-05-29T21:47:41.006Z+ grep nexus
5642024-05-29T21:47:41.006Z+ [[ 21 -gt 300 ]]
5652024-05-29T21:47:41.006Z+ sleep 1
5662024-05-29T21:47:41.985Z+ retry=22
5672024-05-29T21:47:42.027Z+ zoneadm list
5682024-05-29T21:47:42.027Z+ grep nexus
5692024-05-29T21:47:42.027Z+ [[ 22 -gt 300 ]]
5702024-05-29T21:47:42.027Z+ sleep 1
5712024-05-29T21:47:42.997Z+ retry=23
5722024-05-29T21:47:43.037Z+ zoneadm list
5732024-05-29T21:47:43.037Z+ grep nexus
5742024-05-29T21:47:43.037Z+ [[ 23 -gt 300 ]]
5752024-05-29T21:47:43.037Z+ sleep 1
5762024-05-29T21:47:44.006Z+ retry=24
5772024-05-29T21:47:44.045Z+ zoneadm list
5782024-05-29T21:47:44.046Z+ grep nexus
5792024-05-29T21:47:44.046Z+ [[ 24 -gt 300 ]]
5802024-05-29T21:47:44.046Z+ sleep 1
5812024-05-29T21:47:45.022Z+ retry=25
5822024-05-29T21:47:45.069Z+ zoneadm list
5832024-05-29T21:47:45.069Z+ grep nexus
5842024-05-29T21:47:45.069Z+ [[ 25 -gt 300 ]]
5852024-05-29T21:47:45.070Z+ sleep 1
5862024-05-29T21:47:46.026Z+ retry=26
5872024-05-29T21:47:46.057Z+ zoneadm list
5882024-05-29T21:47:46.058Z+ grep nexus
5892024-05-29T21:47:46.058Z+ [[ 26 -gt 300 ]]
5902024-05-29T21:47:46.058Z+ sleep 1
5912024-05-29T21:47:47.033Z+ retry=27
5922024-05-29T21:47:47.059Z+ zoneadm list
5932024-05-29T21:47:47.060Z+ grep nexus
5942024-05-29T21:47:47.060Z+ [[ 27 -gt 300 ]]
5952024-05-29T21:47:47.060Z+ sleep 1
5962024-05-29T21:47:48.042Z+ retry=28
5972024-05-29T21:47:48.067Z+ zoneadm list
5982024-05-29T21:47:48.067Z+ grep nexus
5992024-05-29T21:47:48.067Z+ [[ 28 -gt 300 ]]
6002024-05-29T21:47:48.067Z+ sleep 1
6012024-05-29T21:47:49.060Z+ retry=29
6022024-05-29T21:47:49.090Z+ zoneadm list
6032024-05-29T21:47:49.090Z+ grep nexus
6042024-05-29T21:47:49.091Z+ [[ 29 -gt 300 ]]
6052024-05-29T21:47:49.091Z+ sleep 1
6062024-05-29T21:47:50.076Z+ retry=30
6072024-05-29T21:47:50.115Z+ zoneadm list
6082024-05-29T21:47:50.116Z+ grep nexus
6092024-05-29T21:47:50.116Z+ [[ 30 -gt 300 ]]
6102024-05-29T21:47:50.116Z+ sleep 1
6112024-05-29T21:47:51.079Z+ retry=31
6122024-05-29T21:47:51.142Z+ zoneadm list
6132024-05-29T21:47:51.142Z+ grep nexus
6142024-05-29T21:47:51.143Z+ [[ 31 -gt 300 ]]
6152024-05-29T21:47:51.143Z+ sleep 1
6162024-05-29T21:47:52.084Z+ retry=32
6172024-05-29T21:47:52.109Z+ zoneadm list
6182024-05-29T21:47:52.109Z+ grep nexus
6192024-05-29T21:47:52.109Z+ [[ 32 -gt 300 ]]
6202024-05-29T21:47:52.109Z+ sleep 1
6212024-05-29T21:47:53.096Z+ retry=33
6222024-05-29T21:47:53.125Z+ zoneadm list
6232024-05-29T21:47:53.125Z+ grep nexus
6242024-05-29T21:47:53.125Z+ [[ 33 -gt 300 ]]
6252024-05-29T21:47:53.125Z+ sleep 1
6262024-05-29T21:47:54.107Z+ retry=34
6272024-05-29T21:47:54.136Z+ zoneadm list
6282024-05-29T21:47:54.137Z+ grep nexus
6292024-05-29T21:47:54.137Z+ [[ 34 -gt 300 ]]
6302024-05-29T21:47:54.137Z+ sleep 1
6312024-05-29T21:47:55.116Z+ retry=35
6322024-05-29T21:47:55.141Z+ zoneadm list
6332024-05-29T21:47:55.142Z+ grep nexus
6342024-05-29T21:47:55.142Z+ [[ 35 -gt 300 ]]
6352024-05-29T21:47:55.142Z+ sleep 1
6362024-05-29T21:47:56.126Z+ retry=36
6372024-05-29T21:47:56.150Z+ zoneadm list
6382024-05-29T21:47:56.150Z+ grep nexus
6392024-05-29T21:47:56.150Z+ [[ 36 -gt 300 ]]
6402024-05-29T21:47:56.151Z+ sleep 1
6412024-05-29T21:47:57.157Z+ retry=37
6422024-05-29T21:47:57.192Z+ zoneadm list
6432024-05-29T21:47:57.192Z+ grep nexus
6442024-05-29T21:47:57.192Z+ [[ 37 -gt 300 ]]
6452024-05-29T21:47:57.192Z+ sleep 1
6462024-05-29T21:47:58.146Z+ retry=38
6472024-05-29T21:47:58.171Z+ zoneadm list
6482024-05-29T21:47:58.171Z+ grep nexus
6492024-05-29T21:47:58.171Z+ [[ 38 -gt 300 ]]
6502024-05-29T21:47:58.171Z+ sleep 1
6512024-05-29T21:47:59.157Z+ retry=39
6522024-05-29T21:47:59.183Z+ zoneadm list
6532024-05-29T21:47:59.183Z+ grep nexus
6542024-05-29T21:47:59.183Z+ [[ 39 -gt 300 ]]
6552024-05-29T21:47:59.183Z+ sleep 1
6562024-05-29T21:48:00.167Z+ retry=40
6572024-05-29T21:48:00.192Z+ zoneadm list
6582024-05-29T21:48:00.192Z+ grep nexus
6592024-05-29T21:48:00.192Z+ [[ 40 -gt 300 ]]
6602024-05-29T21:48:00.192Z+ sleep 1
6612024-05-29T21:48:01.178Z+ retry=41
6622024-05-29T21:48:01.202Z+ zoneadm list
6632024-05-29T21:48:01.203Z+ grep nexus
6642024-05-29T21:48:01.203Z+ [[ 41 -gt 300 ]]
6652024-05-29T21:48:01.203Z+ sleep 1
6662024-05-29T21:48:02.189Z+ retry=42
6672024-05-29T21:48:02.217Z+ zoneadm list
6682024-05-29T21:48:02.217Z+ grep nexus
6692024-05-29T21:48:02.217Z+ [[ 42 -gt 300 ]]
6702024-05-29T21:48:02.217Z+ sleep 1
6712024-05-29T21:48:03.197Z+ retry=43
6722024-05-29T21:48:03.223Z+ zoneadm list
6732024-05-29T21:48:03.223Z+ grep nexus
6742024-05-29T21:48:03.223Z+ [[ 43 -gt 300 ]]
6752024-05-29T21:48:03.223Z+ sleep 1
6762024-05-29T21:48:04.627Z+ retry=44
6772024-05-29T21:48:04.652Z+ zoneadm list
6782024-05-29T21:48:04.652Z+ grep nexus
6792024-05-29T21:48:04.652Z+ [[ 44 -gt 300 ]]
6802024-05-29T21:48:04.652Z+ sleep 1
6812024-05-29T21:48:05.218Z+ retry=45
6822024-05-29T21:48:05.243Z+ zoneadm list
6832024-05-29T21:48:05.243Z+ grep nexus
6842024-05-29T21:48:05.243Z+ [[ 45 -gt 300 ]]
6852024-05-29T21:48:05.243Z+ sleep 1
6862024-05-29T21:48:06.233Z+ retry=46
6872024-05-29T21:48:06.259Z+ zoneadm list
6882024-05-29T21:48:06.259Z+ grep nexus
6892024-05-29T21:48:06.259Z+ [[ 46 -gt 300 ]]
6902024-05-29T21:48:06.259Z+ sleep 1
6912024-05-29T21:48:07.538Z+ retry=47
6922024-05-29T21:48:07.578Z+ zoneadm list
6932024-05-29T21:48:07.578Z+ grep nexus
6942024-05-29T21:48:07.578Z+ [[ 47 -gt 300 ]]
6952024-05-29T21:48:07.578Z+ sleep 1
6962024-05-29T21:48:08.248Z+ retry=48
6972024-05-29T21:48:08.273Z+ zoneadm list
6982024-05-29T21:48:08.273Z+ grep nexus
6992024-05-29T21:48:08.273Z+ [[ 48 -gt 300 ]]
7002024-05-29T21:48:08.273Z+ sleep 1
7012024-05-29T21:48:09.258Z+ retry=49
7022024-05-29T21:48:09.283Z+ zoneadm list
7032024-05-29T21:48:09.283Z+ grep nexus
7042024-05-29T21:48:09.283Z+ [[ 49 -gt 300 ]]
7052024-05-29T21:48:09.283Z+ sleep 1
7062024-05-29T21:48:11.485Z+ retry=50
7072024-05-29T21:48:11.513Z+ zoneadm list
7082024-05-29T21:48:11.514Z+ grep nexus
7092024-05-29T21:48:11.514Z+ [[ 50 -gt 300 ]]
7102024-05-29T21:48:11.514Z+ sleep 1
7112024-05-29T21:48:11.514Z+ retry=51
7122024-05-29T21:48:11.514Z+ zoneadm list
7132024-05-29T21:48:11.514Z+ grep nexus
7142024-05-29T21:48:11.514Z+ [[ 51 -gt 300 ]]
7152024-05-29T21:48:11.515Z+ sleep 1
7162024-05-29T21:48:12.295Z+ retry=52
7172024-05-29T21:48:12.322Z+ zoneadm list
7182024-05-29T21:48:12.322Z+ grep nexus
7192024-05-29T21:48:12.323Z+ [[ 52 -gt 300 ]]
7202024-05-29T21:48:12.323Z+ sleep 1
7212024-05-29T21:48:13.363Z+ retry=53
7222024-05-29T21:48:13.363Z+ zoneadm list
7232024-05-29T21:48:13.364Z+ grep nexus
7242024-05-29T21:48:13.364Z+ [[ 53 -gt 300 ]]
7252024-05-29T21:48:13.364Z+ sleep 1
7262024-05-29T21:48:14.312Z+ retry=54
7272024-05-29T21:48:14.341Z+ zoneadm list
7282024-05-29T21:48:14.341Z+ grep nexus
7292024-05-29T21:48:14.341Z+ [[ 54 -gt 300 ]]
7302024-05-29T21:48:14.341Z+ sleep 1
7312024-05-29T21:48:15.321Z+ retry=55
7322024-05-29T21:48:15.350Z+ zoneadm list
7332024-05-29T21:48:15.350Z+ grep nexus
7342024-05-29T21:48:15.350Z+ [[ 55 -gt 300 ]]
7352024-05-29T21:48:15.350Z+ sleep 1
7362024-05-29T21:48:16.334Z+ retry=56
7372024-05-29T21:48:16.359Z+ zoneadm list
7382024-05-29T21:48:16.359Z+ grep nexus
7392024-05-29T21:48:16.359Z+ [[ 56 -gt 300 ]]
7402024-05-29T21:48:16.359Z+ sleep 1
7412024-05-29T21:48:17.346Z+ retry=57
7422024-05-29T21:48:17.373Z+ zoneadm list
7432024-05-29T21:48:17.373Z+ grep nexus
7442024-05-29T21:48:17.373Z+ [[ 57 -gt 300 ]]
7452024-05-29T21:48:17.373Z+ sleep 1
7462024-05-29T21:48:18.764Z+ retry=58
7472024-05-29T21:48:18.796Z+ zoneadm list
7482024-05-29T21:48:18.797Z+ grep nexus
7492024-05-29T21:48:18.797Z+ [[ 58 -gt 300 ]]
7502024-05-29T21:48:18.797Z+ sleep 1
7512024-05-29T21:48:19.363Z+ retry=59
7522024-05-29T21:48:19.400Z+ zoneadm list
7532024-05-29T21:48:19.400Z+ grep nexus
7542024-05-29T21:48:19.400Z+ [[ 59 -gt 300 ]]
7552024-05-29T21:48:19.400Z+ sleep 1
7562024-05-29T21:48:20.401Z+ retry=60
7572024-05-29T21:48:20.429Z+ zoneadm list
7582024-05-29T21:48:20.429Z+ grep nexus
7592024-05-29T21:48:20.430Z+ [[ 60 -gt 300 ]]
7602024-05-29T21:48:20.430Z+ sleep 1
7612024-05-29T21:48:21.382Z+ retry=61
7622024-05-29T21:48:21.409Z+ zoneadm list
7632024-05-29T21:48:21.409Z+ grep nexus
7642024-05-29T21:48:21.409Z+ [[ 61 -gt 300 ]]
7652024-05-29T21:48:21.409Z+ sleep 1
7662024-05-29T21:48:22.395Z+ retry=62
7672024-05-29T21:48:22.420Z+ zoneadm list
7682024-05-29T21:48:22.420Z+ grep nexus
7692024-05-29T21:48:22.420Z+ [[ 62 -gt 300 ]]
7702024-05-29T21:48:22.420Z+ sleep 1
7712024-05-29T21:48:23.407Z+ retry=63
7722024-05-29T21:48:23.443Z+ zoneadm list
7732024-05-29T21:48:23.444Z+ grep nexus
7742024-05-29T21:48:23.444Z+ [[ 63 -gt 300 ]]
7752024-05-29T21:48:23.444Z+ sleep 1
7762024-05-29T21:48:24.413Z+ retry=64
7772024-05-29T21:48:24.438Z+ zoneadm list
7782024-05-29T21:48:24.438Z+ grep nexus
7792024-05-29T21:48:24.438Z+ [[ 64 -gt 300 ]]
7802024-05-29T21:48:24.438Z+ sleep 1
7812024-05-29T21:48:25.425Z+ retry=65
7822024-05-29T21:48:25.451Z+ zoneadm list
7832024-05-29T21:48:25.451Z+ grep nexus
7842024-05-29T21:48:25.451Z+ [[ 65 -gt 300 ]]
7852024-05-29T21:48:25.451Z+ sleep 1
7862024-05-29T21:48:26.450Z+ retry=66
7872024-05-29T21:48:26.479Z+ zoneadm list
7882024-05-29T21:48:26.479Z+ grep nexus
7892024-05-29T21:48:26.479Z+ [[ 66 -gt 300 ]]
7902024-05-29T21:48:26.479Z+ sleep 1
7912024-05-29T21:48:27.448Z+ retry=67
7922024-05-29T21:48:27.478Z+ zoneadm list
7932024-05-29T21:48:27.478Z+ grep nexus
7942024-05-29T21:48:27.478Z+ [[ 67 -gt 300 ]]
7952024-05-29T21:48:27.478Z+ sleep 1
7962024-05-29T21:48:28.459Z+ retry=68
7972024-05-29T21:48:28.484Z+ zoneadm list
7982024-05-29T21:48:28.484Z+ grep nexus
7992024-05-29T21:48:28.484Z+ [[ 68 -gt 300 ]]
8002024-05-29T21:48:28.484Z+ sleep 1
8012024-05-29T21:48:29.471Z+ retry=69
8022024-05-29T21:48:29.507Z+ zoneadm list
8032024-05-29T21:48:29.507Z+ grep nexus
8042024-05-29T21:48:29.508Z+ [[ 69 -gt 300 ]]
8052024-05-29T21:48:29.508Z+ sleep 1
8062024-05-29T21:48:30.477Z+ retry=70
8072024-05-29T21:48:30.502Z+ zoneadm list
8082024-05-29T21:48:30.503Z+ grep nexus
8092024-05-29T21:48:30.503Z+ [[ 70 -gt 300 ]]
8102024-05-29T21:48:30.503Z+ sleep 1
8112024-05-29T21:48:31.488Z+ retry=71
8122024-05-29T21:48:31.514Z+ zoneadm list
8132024-05-29T21:48:31.514Z+ grep nexus
8142024-05-29T21:48:31.514Z+ [[ 71 -gt 300 ]]
8152024-05-29T21:48:31.514Z+ sleep 1
8162024-05-29T21:48:32.499Z+ retry=72
8172024-05-29T21:48:32.524Z+ zoneadm list
8182024-05-29T21:48:32.525Z+ grep nexus
8192024-05-29T21:48:32.525Z+ [[ 72 -gt 300 ]]
8202024-05-29T21:48:32.525Z+ sleep 1
8212024-05-29T21:48:33.509Z+ retry=73
8222024-05-29T21:48:33.534Z+ zoneadm list
8232024-05-29T21:48:33.534Z+ grep nexus
8242024-05-29T21:48:33.534Z+ [[ 73 -gt 300 ]]
8252024-05-29T21:48:33.534Z+ sleep 1
8262024-05-29T21:48:34.519Z+ retry=74
8272024-05-29T21:48:34.547Z+ zoneadm list
8282024-05-29T21:48:34.547Z+ grep nexus
8292024-05-29T21:48:34.547Z+ [[ 74 -gt 300 ]]
8302024-05-29T21:48:34.547Z+ sleep 1
8312024-05-29T21:48:35.530Z+ retry=75
8322024-05-29T21:48:35.559Z+ zoneadm list
8332024-05-29T21:48:35.559Z+ grep nexus
8342024-05-29T21:48:35.559Z+ [[ 75 -gt 300 ]]
8352024-05-29T21:48:35.559Z+ sleep 1
8362024-05-29T21:48:36.539Z+ retry=76
8372024-05-29T21:48:36.564Z+ zoneadm list
8382024-05-29T21:48:36.565Z+ grep nexus
8392024-05-29T21:48:36.565Z+ [[ 76 -gt 300 ]]
8402024-05-29T21:48:36.565Z+ sleep 1
8412024-05-29T21:48:37.552Z+ retry=77
8422024-05-29T21:48:37.577Z+ zoneadm list
8432024-05-29T21:48:37.577Z+ grep nexus
8442024-05-29T21:48:37.577Z+ [[ 77 -gt 300 ]]
8452024-05-29T21:48:37.577Z+ sleep 1
8462024-05-29T21:48:38.560Z+ retry=78
8472024-05-29T21:48:38.586Z+ zoneadm list
8482024-05-29T21:48:38.586Z+ grep nexus
8492024-05-29T21:48:38.586Z+ [[ 78 -gt 300 ]]
8502024-05-29T21:48:38.586Z+ sleep 1
8512024-05-29T21:48:39.575Z+ retry=79
8522024-05-29T21:48:39.610Z+ zoneadm list
8532024-05-29T21:48:39.610Z+ grep nexus
8542024-05-29T21:48:39.610Z+ [[ 79 -gt 300 ]]
8552024-05-29T21:48:39.610Z+ sleep 1
8562024-05-29T21:48:40.585Z+ retry=80
8572024-05-29T21:48:40.612Z+ zoneadm list
8582024-05-29T21:48:40.613Z+ grep nexus
8592024-05-29T21:48:40.613Z+ [[ 80 -gt 300 ]]
8602024-05-29T21:48:40.613Z+ sleep 1
8612024-05-29T21:48:41.596Z+ retry=81
8622024-05-29T21:48:41.629Z+ zoneadm list
8632024-05-29T21:48:41.629Z+ grep nexus
8642024-05-29T21:48:41.629Z+ [[ 81 -gt 300 ]]
8652024-05-29T21:48:41.630Z+ sleep 1
8662024-05-29T21:48:42.601Z+ retry=82
8672024-05-29T21:48:42.627Z+ zoneadm list
8682024-05-29T21:48:42.627Z+ grep nexus
8692024-05-29T21:48:42.627Z+ [[ 82 -gt 300 ]]
8702024-05-29T21:48:42.627Z+ sleep 1
8712024-05-29T21:48:43.612Z+ retry=83
8722024-05-29T21:48:43.637Z+ zoneadm list
8732024-05-29T21:48:43.637Z+ grep nexus
8742024-05-29T21:48:43.637Z+ [[ 83 -gt 300 ]]
8752024-05-29T21:48:43.637Z+ sleep 1
8762024-05-29T21:48:44.623Z+ retry=84
8772024-05-29T21:48:44.665Z+ zoneadm list
8782024-05-29T21:48:44.665Z+ grep nexus
8792024-05-29T21:48:44.666Z+ [[ 84 -gt 300 ]]
8802024-05-29T21:48:44.666Z+ sleep 1
8812024-05-29T21:48:45.633Z+ retry=85
8822024-05-29T21:48:45.660Z+ zoneadm list
8832024-05-29T21:48:45.660Z+ grep nexus
8842024-05-29T21:48:45.660Z+ [[ 85 -gt 300 ]]
8852024-05-29T21:48:45.660Z+ sleep 1
8862024-05-29T21:48:47.053Z+ retry=86
8872024-05-29T21:48:47.082Z+ zoneadm list
8882024-05-29T21:48:47.082Z+ grep nexus
8892024-05-29T21:48:47.082Z+ [[ 86 -gt 300 ]]
8902024-05-29T21:48:47.082Z+ sleep 1
8912024-05-29T21:48:47.656Z+ retry=87
8922024-05-29T21:48:47.689Z+ zoneadm list
8932024-05-29T21:48:47.689Z+ grep nexus
8942024-05-29T21:48:47.689Z+ [[ 87 -gt 300 ]]
8952024-05-29T21:48:47.690Z+ sleep 1
8962024-05-29T21:48:48.665Z+ retry=88
8972024-05-29T21:48:49.096Z+ zoneadm list
8982024-05-29T21:48:49.096Z+ grep nexus
8992024-05-29T21:48:49.096Z+ [[ 88 -gt 300 ]]
9002024-05-29T21:48:49.096Z+ sleep 1
9012024-05-29T21:48:49.674Z+ retry=89
9022024-05-29T21:48:49.706Z+ zoneadm list
9032024-05-29T21:48:49.706Z+ grep nexus
9042024-05-29T21:48:49.706Z+ [[ 89 -gt 300 ]]
9052024-05-29T21:48:49.706Z+ sleep 1
9062024-05-29T21:48:50.689Z+ retry=90
9072024-05-29T21:48:50.718Z+ zoneadm list
9082024-05-29T21:48:50.719Z+ grep nexus
9092024-05-29T21:48:50.719Z+ [[ 90 -gt 300 ]]
9102024-05-29T21:48:50.719Z+ sleep 1
9112024-05-29T21:48:51.695Z+ retry=91
9122024-05-29T21:48:51.720Z+ zoneadm list
9132024-05-29T21:48:51.720Z+ grep nexus
9142024-05-29T21:48:51.720Z+ [[ 91 -gt 300 ]]
9152024-05-29T21:48:51.720Z+ sleep 1
9162024-05-29T21:48:52.711Z+ retry=92
9172024-05-29T21:48:52.739Z+ zoneadm list
9182024-05-29T21:48:52.739Z+ grep nexus
9192024-05-29T21:48:52.739Z+ [[ 92 -gt 300 ]]
9202024-05-29T21:48:52.739Z+ sleep 1
9212024-05-29T21:48:54.126Z+ retry=93
9222024-05-29T21:48:54.161Z+ zoneadm list
9232024-05-29T21:48:54.161Z+ grep nexus
9242024-05-29T21:48:54.161Z+ [[ 93 -gt 300 ]]
9252024-05-29T21:48:54.162Z+ sleep 1
9262024-05-29T21:48:55.015Z+ retry=94
9272024-05-29T21:48:55.045Z+ zoneadm list
9282024-05-29T21:48:55.045Z+ grep nexus
9292024-05-29T21:48:55.045Z+ [[ 94 -gt 300 ]]
9302024-05-29T21:48:55.046Z+ sleep 1
9312024-05-29T21:48:55.735Z+ retry=95
9322024-05-29T21:48:55.760Z+ zoneadm list
9332024-05-29T21:48:55.760Z+ grep nexus
9342024-05-29T21:48:55.760Z+ [[ 95 -gt 300 ]]
9352024-05-29T21:48:55.760Z+ sleep 1
9362024-05-29T21:48:56.745Z+ retry=96
9372024-05-29T21:48:56.772Z+ zoneadm list
9382024-05-29T21:48:56.772Z+ grep nexus
9392024-05-29T21:48:56.772Z+ [[ 96 -gt 300 ]]
9402024-05-29T21:48:56.772Z+ sleep 1
9412024-05-29T21:48:57.756Z+ retry=97
9422024-05-29T21:48:57.781Z+ zoneadm list
9432024-05-29T21:48:57.781Z+ grep nexus
9442024-05-29T21:48:57.781Z+ [[ 97 -gt 300 ]]
9452024-05-29T21:48:57.781Z+ sleep 1
9462024-05-29T21:48:58.767Z+ retry=98
9472024-05-29T21:48:58.793Z+ zoneadm list
9482024-05-29T21:48:58.793Z+ grep nexus
9492024-05-29T21:48:58.793Z+ [[ 98 -gt 300 ]]
9502024-05-29T21:48:58.793Z+ sleep 1
9512024-05-29T21:48:59.784Z+ retry=99
9522024-05-29T21:48:59.814Z+ zoneadm list
9532024-05-29T21:48:59.814Z+ grep nexus
9542024-05-29T21:48:59.814Z+ [[ 99 -gt 300 ]]
9552024-05-29T21:48:59.814Z+ sleep 1
9562024-05-29T21:49:01.006Z+ retry=100
9572024-05-29T21:49:01.038Z+ zoneadm list
9582024-05-29T21:49:01.077Z+ grep nexus
9592024-05-29T21:49:01.135Z+ [[ 100 -gt 300 ]]
9602024-05-29T21:49:01.135Z+ sleep 1
9612024-05-29T21:49:02.629Z+ retry=101
9622024-05-29T21:49:02.629Z+ zoneadm list
9632024-05-29T21:49:02.629Z+ grep nexus
9642024-05-29T21:49:02.630Z+ [[ 101 -gt 300 ]]
9652024-05-29T21:49:02.630Z+ sleep 1
9662024-05-29T21:49:03.461Z+ retry=102
9672024-05-29T21:49:03.488Z+ zoneadm list
9682024-05-29T21:49:03.488Z+ grep nexus
9692024-05-29T21:49:03.488Z+ [[ 102 -gt 300 ]]
9702024-05-29T21:49:03.488Z+ sleep 1
9712024-05-29T21:49:04.478Z+ retry=103
9722024-05-29T21:49:04.506Z+ zoneadm list
9732024-05-29T21:49:04.506Z+ grep nexus
9742024-05-29T21:49:04.506Z+ [[ 103 -gt 300 ]]
9752024-05-29T21:49:04.506Z+ sleep 1
9762024-05-29T21:49:05.489Z+ retry=104
9772024-05-29T21:49:05.522Z+ zoneadm list
9782024-05-29T21:49:05.523Z+ grep nexus
9792024-05-29T21:49:05.523Z+ [[ 104 -gt 300 ]]
9802024-05-29T21:49:05.523Z+ sleep 1
9812024-05-29T21:49:06.508Z+ retry=105
9822024-05-29T21:49:06.543Z+ zoneadm list
9832024-05-29T21:49:06.544Z+ grep nexus
9842024-05-29T21:49:06.544Z+ [[ 105 -gt 300 ]]
9852024-05-29T21:49:06.545Z+ sleep 1
9862024-05-29T21:49:07.518Z+ retry=106
9872024-05-29T21:49:07.556Z+ zoneadm list
9882024-05-29T21:49:07.556Z+ grep nexus
9892024-05-29T21:49:07.556Z+ [[ 106 -gt 300 ]]
9902024-05-29T21:49:07.556Z+ sleep 1
9912024-05-29T21:49:08.523Z+ retry=107
9922024-05-29T21:49:08.552Z+ zoneadm list
9932024-05-29T21:49:08.552Z+ grep nexus
9942024-05-29T21:49:08.552Z+ [[ 107 -gt 300 ]]
9952024-05-29T21:49:08.552Z+ sleep 1
9962024-05-29T21:49:09.956Z+ retry=108
9972024-05-29T21:49:09.984Z+ zoneadm list
9982024-05-29T21:49:09.984Z+ grep nexus
9992024-05-29T21:49:09.984Z+ [[ 108 -gt 300 ]]
10002024-05-29T21:49:09.984Z+ sleep 1
10012024-05-29T21:49:10.558Z+ retry=109
10022024-05-29T21:49:10.583Z+ zoneadm list
10032024-05-29T21:49:10.583Z+ grep nexus
10042024-05-29T21:49:10.583Z+ [[ 109 -gt 300 ]]
10052024-05-29T21:49:10.583Z+ sleep 1
10062024-05-29T21:49:11.570Z+ retry=110
10072024-05-29T21:49:11.609Z+ zoneadm list
10082024-05-29T21:49:11.609Z+ grep nexus
10092024-05-29T21:49:11.609Z+ [[ 110 -gt 300 ]]
10102024-05-29T21:49:11.610Z+ sleep 1
10112024-05-29T21:49:12.576Z+ retry=111
10122024-05-29T21:49:12.601Z+ zoneadm list
10132024-05-29T21:49:12.601Z+ grep nexus
10142024-05-29T21:49:12.601Z+ [[ 111 -gt 300 ]]
10152024-05-29T21:49:12.601Z+ sleep 1
10162024-05-29T21:49:14.223Z+ retry=112
10172024-05-29T21:49:14.255Z+ zoneadm list
10182024-05-29T21:49:14.255Z+ grep nexus
10192024-05-29T21:49:14.255Z+ [[ 112 -gt 300 ]]
10202024-05-29T21:49:14.255Z+ sleep 1
10212024-05-29T21:49:15.242Z+ retry=113
10222024-05-29T21:49:15.277Z+ zoneadm list
10232024-05-29T21:49:15.277Z+ grep nexus
10242024-05-29T21:49:15.277Z+ [[ 113 -gt 300 ]]
10252024-05-29T21:49:15.278Z+ sleep 1
10262024-05-29T21:49:16.257Z+ retry=114
10272024-05-29T21:49:16.285Z+ zoneadm list
10282024-05-29T21:49:16.285Z+ grep nexus
10292024-05-29T21:49:16.285Z+ [[ 114 -gt 300 ]]
10302024-05-29T21:49:16.285Z+ sleep 1
10312024-05-29T21:49:17.275Z+ retry=115
10322024-05-29T21:49:17.302Z+ zoneadm list
10332024-05-29T21:49:17.302Z+ grep nexus
10342024-05-29T21:49:17.302Z+ [[ 115 -gt 300 ]]
10352024-05-29T21:49:17.302Z+ sleep 1
10362024-05-29T21:49:18.304Z+ retry=116
10372024-05-29T21:49:18.304Z+ zoneadm list
10382024-05-29T21:49:18.304Z+ grep nexus
10392024-05-29T21:49:18.304Z+ [[ 116 -gt 300 ]]
10402024-05-29T21:49:18.304Z+ sleep 1
10412024-05-29T21:49:19.292Z+ retry=117
10422024-05-29T21:49:19.319Z+ zoneadm list
10432024-05-29T21:49:19.319Z+ grep nexus
10442024-05-29T21:49:19.319Z+ [[ 117 -gt 300 ]]
10452024-05-29T21:49:19.319Z+ sleep 1
10462024-05-29T21:49:20.302Z+ retry=118
10472024-05-29T21:49:20.328Z+ zoneadm list
10482024-05-29T21:49:20.328Z+ grep nexus
10492024-05-29T21:49:20.328Z+ [[ 118 -gt 300 ]]
10502024-05-29T21:49:20.328Z+ sleep 1
10512024-05-29T21:49:21.313Z+ retry=119
10522024-05-29T21:49:21.341Z+ zoneadm list
10532024-05-29T21:49:21.341Z+ grep nexus
10542024-05-29T21:49:21.341Z+ [[ 119 -gt 300 ]]
10552024-05-29T21:49:21.341Z+ sleep 1
10562024-05-29T21:49:22.326Z+ retry=120
10572024-05-29T21:49:22.351Z+ zoneadm list
10582024-05-29T21:49:22.351Z+ grep nexus
10592024-05-29T21:49:22.351Z+ [[ 120 -gt 300 ]]
10602024-05-29T21:49:22.351Z+ sleep 1
10612024-05-29T21:49:23.342Z+ retry=121
10622024-05-29T21:49:23.374Z+ zoneadm list
10632024-05-29T21:49:23.374Z+ grep nexus
10642024-05-29T21:49:23.374Z+ [[ 121 -gt 300 ]]
10652024-05-29T21:49:23.374Z+ sleep 1
10662024-05-29T21:49:24.348Z+ retry=122
10672024-05-29T21:49:24.373Z+ zoneadm list
10682024-05-29T21:49:24.373Z+ grep nexus
10692024-05-29T21:49:24.373Z+ [[ 122 -gt 300 ]]
10702024-05-29T21:49:24.373Z+ sleep 1
10712024-05-29T21:49:25.361Z+ retry=123
10722024-05-29T21:49:25.386Z+ zoneadm list
10732024-05-29T21:49:25.386Z+ grep nexus
10742024-05-29T21:49:25.386Z+ [[ 123 -gt 300 ]]
10752024-05-29T21:49:25.386Z+ sleep 1
10762024-05-29T21:49:26.371Z+ retry=124
10772024-05-29T21:49:26.396Z+ zoneadm list
10782024-05-29T21:49:26.396Z+ grep nexus
10792024-05-29T21:49:26.396Z+ [[ 124 -gt 300 ]]
10802024-05-29T21:49:26.396Z+ sleep 1
10812024-05-29T21:49:27.392Z+ retry=125
10822024-05-29T21:49:27.426Z+ zoneadm list
10832024-05-29T21:49:27.426Z+ grep nexus
10842024-05-29T21:49:27.426Z+ [[ 125 -gt 300 ]]
10852024-05-29T21:49:27.426Z+ sleep 1
10862024-05-29T21:49:28.401Z+ retry=126
10872024-05-29T21:49:28.426Z+ zoneadm list
10882024-05-29T21:49:28.426Z+ grep nexus
10892024-05-29T21:49:28.426Z+ [[ 126 -gt 300 ]]
10902024-05-29T21:49:28.427Z+ sleep 1
10912024-05-29T21:49:29.413Z+ retry=127
10922024-05-29T21:49:29.438Z+ zoneadm list
10932024-05-29T21:49:29.438Z+ grep nexus
10942024-05-29T21:49:29.438Z+ [[ 127 -gt 300 ]]
10952024-05-29T21:49:29.438Z+ sleep 1
10962024-05-29T21:49:30.425Z+ retry=128
10972024-05-29T21:49:30.450Z+ zoneadm list
10982024-05-29T21:49:30.450Z+ grep nexus
10992024-05-29T21:49:30.450Z+ [[ 128 -gt 300 ]]
11002024-05-29T21:49:30.451Z+ sleep 1
11012024-05-29T21:49:31.440Z+ retry=129
11022024-05-29T21:49:31.467Z+ zoneadm list
11032024-05-29T21:49:31.467Z+ grep nexus
11042024-05-29T21:49:31.467Z+ [[ 129 -gt 300 ]]
11052024-05-29T21:49:31.467Z+ sleep 1
11062024-05-29T21:49:32.455Z+ retry=130
11072024-05-29T21:49:32.455Z+ zoneadm list
11082024-05-29T21:49:32.479Z+ grep nexus
11092024-05-29T21:49:32.480Z+ [[ 130 -gt 300 ]]
11102024-05-29T21:49:32.480Z+ sleep 1
11112024-05-29T21:49:33.470Z+ retry=131
11122024-05-29T21:49:33.496Z+ zoneadm list
11132024-05-29T21:49:33.497Z+ grep nexus
11142024-05-29T21:49:33.497Z+ [[ 131 -gt 300 ]]
11152024-05-29T21:49:33.497Z+ sleep 1
11162024-05-29T21:49:34.482Z+ retry=132
11172024-05-29T21:49:34.507Z+ zoneadm list
11182024-05-29T21:49:34.507Z+ grep nexus
11192024-05-29T21:49:34.508Z+ [[ 132 -gt 300 ]]
11202024-05-29T21:49:34.508Z+ sleep 1
11212024-05-29T21:49:35.494Z+ retry=133
11222024-05-29T21:49:35.519Z+ zoneadm list
11232024-05-29T21:49:35.519Z+ grep nexus
11242024-05-29T21:49:35.519Z+ [[ 133 -gt 300 ]]
11252024-05-29T21:49:35.519Z+ sleep 1
11262024-05-29T21:49:36.510Z+ retry=134
11272024-05-29T21:49:36.535Z+ zoneadm list
11282024-05-29T21:49:36.536Z+ grep nexus
11292024-05-29T21:49:36.536Z+ [[ 134 -gt 300 ]]
11302024-05-29T21:49:36.536Z+ sleep 1
11312024-05-29T21:49:37.520Z+ retry=135
11322024-05-29T21:49:37.545Z+ zoneadm list
11332024-05-29T21:49:37.545Z+ grep nexus
11342024-05-29T21:49:37.545Z+ [[ 135 -gt 300 ]]
11352024-05-29T21:49:37.545Z+ sleep 1
11362024-05-29T21:49:38.529Z+ retry=136
11372024-05-29T21:49:38.553Z+ zoneadm list
11382024-05-29T21:49:38.553Z+ grep nexus
11392024-05-29T21:49:38.553Z+ [[ 136 -gt 300 ]]
11402024-05-29T21:49:38.553Z+ sleep 1
11412024-05-29T21:49:39.955Z+ retry=137
11422024-05-29T21:49:39.984Z+ zoneadm list
11432024-05-29T21:49:39.984Z+ grep nexus
11442024-05-29T21:49:39.984Z+ [[ 137 -gt 300 ]]
11452024-05-29T21:49:39.984Z+ sleep 1
11462024-05-29T21:49:40.554Z+ retry=138
11472024-05-29T21:49:40.580Z+ zoneadm list
11482024-05-29T21:49:40.580Z+ grep nexus
11492024-05-29T21:49:40.580Z+ [[ 138 -gt 300 ]]
11502024-05-29T21:49:40.580Z+ sleep 1
11512024-05-29T21:49:41.570Z+ retry=139
11522024-05-29T21:49:41.600Z+ zoneadm list
11532024-05-29T21:49:41.600Z+ grep nexus
11542024-05-29T21:49:41.600Z+ [[ 139 -gt 300 ]]
11552024-05-29T21:49:41.600Z+ sleep 1
11562024-05-29T21:49:42.583Z+ retry=140
11572024-05-29T21:49:42.613Z+ zoneadm list
11582024-05-29T21:49:42.614Z+ grep nexus
11592024-05-29T21:49:42.614Z+ [[ 140 -gt 300 ]]
11602024-05-29T21:49:42.614Z+ sleep 1
11612024-05-29T21:49:43.599Z+ retry=141
11622024-05-29T21:49:43.624Z+ zoneadm list
11632024-05-29T21:49:43.624Z+ grep nexus
11642024-05-29T21:49:43.624Z+ [[ 141 -gt 300 ]]
11652024-05-29T21:49:43.624Z+ sleep 1
11662024-05-29T21:49:44.603Z+ retry=142
11672024-05-29T21:49:44.631Z+ zoneadm list
11682024-05-29T21:49:44.631Z+ grep nexus
11692024-05-29T21:49:44.631Z+ [[ 142 -gt 300 ]]
11702024-05-29T21:49:44.631Z+ sleep 1
11712024-05-29T21:49:45.638Z+ retry=143
11722024-05-29T21:49:45.665Z+ zoneadm list
11732024-05-29T21:49:45.665Z+ grep nexus
11742024-05-29T21:49:45.698Z+ [[ 143 -gt 300 ]]
11752024-05-29T21:49:45.698Z+ sleep 1
11762024-05-29T21:49:46.882Z+ retry=144
11772024-05-29T21:49:46.910Z+ zoneadm list
11782024-05-29T21:49:46.910Z+ grep nexus
11792024-05-29T21:49:46.910Z+ [[ 144 -gt 300 ]]
11802024-05-29T21:49:46.910Z+ sleep 1
11812024-05-29T21:49:47.911Z+ retry=145
11822024-05-29T21:49:47.953Z+ zoneadm list
11832024-05-29T21:49:47.953Z+ grep nexus
11842024-05-29T21:49:47.954Z+ [[ 145 -gt 300 ]]
11852024-05-29T21:49:47.954Z+ sleep 1
11862024-05-29T21:49:49.164Z+ retry=146
11872024-05-29T21:49:49.189Z+ zoneadm list
11882024-05-29T21:49:49.189Z+ grep nexus
11892024-05-29T21:49:49.213Z+ [[ 146 -gt 300 ]]
11902024-05-29T21:49:49.213Z+ sleep 1
11912024-05-29T21:49:50.542Z+ retry=147
11922024-05-29T21:49:50.611Z+ zoneadm list
11932024-05-29T21:49:50.644Z+ grep nexus
11942024-05-29T21:49:50.679Z+ [[ 147 -gt 300 ]]
11952024-05-29T21:49:50.680Z+ sleep 1
11962024-05-29T21:49:51.654Z+ retry=148
11972024-05-29T21:49:51.682Z+ zoneadm list
11982024-05-29T21:49:51.682Z+ grep nexus
11992024-05-29T21:49:51.682Z+ [[ 148 -gt 300 ]]
12002024-05-29T21:49:51.682Z+ sleep 1
12012024-05-29T21:49:52.676Z+ retry=149
12022024-05-29T21:49:52.704Z+ zoneadm list
12032024-05-29T21:49:52.704Z+ grep nexus
12042024-05-29T21:49:52.704Z+ [[ 149 -gt 300 ]]
12052024-05-29T21:49:52.704Z+ sleep 1
12062024-05-29T21:49:56.677Z+ retry=150
12072024-05-29T21:49:56.709Z+ zoneadm list
12082024-05-29T21:49:56.709Z+ grep nexus
12092024-05-29T21:49:56.756Z+ [[ 150 -gt 300 ]]
12102024-05-29T21:49:56.756Z+ sleep 1
12112024-05-29T21:49:57.769Z+ retry=151
12122024-05-29T21:49:57.794Z+ zoneadm list
12132024-05-29T21:49:57.794Z+ grep nexus
12142024-05-29T21:49:57.794Z+ [[ 151 -gt 300 ]]
12152024-05-29T21:49:57.794Z+ sleep 1
12162024-05-29T21:49:58.806Z+ retry=152
12172024-05-29T21:49:58.834Z+ zoneadm list
12182024-05-29T21:49:58.834Z+ grep nexus
12192024-05-29T21:49:58.834Z+ [[ 152 -gt 300 ]]
12202024-05-29T21:49:58.835Z+ sleep 1
12212024-05-29T21:49:59.811Z+ retry=153
12222024-05-29T21:49:59.839Z+ zoneadm list
12232024-05-29T21:49:59.839Z+ grep nexus
12242024-05-29T21:49:59.839Z+ [[ 153 -gt 300 ]]
12252024-05-29T21:49:59.839Z+ sleep 1
12262024-05-29T21:50:00.835Z+ retry=154
12272024-05-29T21:50:00.872Z+ zoneadm list
12282024-05-29T21:50:00.872Z+ grep nexus
12292024-05-29T21:50:00.873Z+ [[ 154 -gt 300 ]]
12302024-05-29T21:50:00.873Z+ sleep 1
12312024-05-29T21:50:01.844Z+ retry=155
12322024-05-29T21:50:01.873Z+ zoneadm list
12332024-05-29T21:50:01.873Z+ grep nexus
12342024-05-29T21:50:01.873Z+ [[ 155 -gt 300 ]]
12352024-05-29T21:50:01.873Z+ sleep 1
12362024-05-29T21:50:02.862Z+ retry=156
12372024-05-29T21:50:02.889Z+ zoneadm list
12382024-05-29T21:50:02.889Z+ grep nexus
12392024-05-29T21:50:02.889Z+ [[ 156 -gt 300 ]]
12402024-05-29T21:50:02.889Z+ sleep 1
12412024-05-29T21:50:03.876Z+ retry=157
12422024-05-29T21:50:03.902Z+ zoneadm list
12432024-05-29T21:50:03.903Z+ grep nexus
12442024-05-29T21:50:03.903Z+ [[ 157 -gt 300 ]]
12452024-05-29T21:50:03.903Z+ sleep 1
12462024-05-29T21:50:04.891Z+ retry=158
12472024-05-29T21:50:04.919Z+ zoneadm list
12482024-05-29T21:50:04.919Z+ grep nexus
12492024-05-29T21:50:04.919Z+ [[ 158 -gt 300 ]]
12502024-05-29T21:50:04.919Z+ sleep 1
12512024-05-29T21:50:05.918Z+ retry=159
12522024-05-29T21:50:05.951Z+ zoneadm list
12532024-05-29T21:50:05.951Z+ grep nexus
12542024-05-29T21:50:05.951Z+ [[ 159 -gt 300 ]]
12552024-05-29T21:50:05.951Z+ sleep 1
12562024-05-29T21:50:06.940Z+ retry=160
12572024-05-29T21:50:06.970Z+ zoneadm list
12582024-05-29T21:50:06.970Z+ grep nexus
12592024-05-29T21:50:06.970Z+ [[ 160 -gt 300 ]]
12602024-05-29T21:50:06.970Z+ sleep 1
12612024-05-29T21:50:07.962Z+ retry=161
12622024-05-29T21:50:08.025Z+ zoneadm list
12632024-05-29T21:50:08.025Z+ grep nexus
12642024-05-29T21:50:08.025Zoxz_nexus_73fd9e9c-3929-404c-966e-fc226ac774de
12652024-05-29T21:50:08.025Zoxz_nexus_2965e03f-f8ef-4bac-89e9-8a71eac94e2c
12662024-05-29T21:50:08.025Zoxz_nexus_217665ab-21f9-40d6-8a7e-9bfc61dd5ddd
12672024-05-29T21:50:08.025ZWaited for nexus: 161s
12682024-05-29T21:50:08.025Z+ echo 'Waited for nexus: 161s'
12692024-05-29T21:50:08.026Z+ export RUST_BACKTRACE=1
12702024-05-29T21:50:08.026Z+ RUST_BACKTRACE=1
12712024-05-29T21:50:08.026Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
12722024-05-29T21:50:08.143Z++ ./target/debug/bootstrap
12732024-05-29T21:50:08.665ZUsing external DNS server at 10.151.2.164:53
12742024-05-29T21:50:08.697Z2024-05-29 21:50:08.674019782 UTC: attempting to log into API
 
12752024-05-29T21:50:24.008ZMay 29 21:50:23 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
12762024-05-29T21:50:24.047ZMay 29 21:50:23 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
12772024-05-29T21:50:24.325Z2024-05-29 21:50:23.717579139 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
12782024-05-29T21:50:24.648ZMay 29 21:50:23 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
12792024-05-29T21:50:24.699ZMay 29 21:50:23 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
12802024-05-29T21:50:24.735Z2024-05-29 21:50:24.718798817 UTC: attempting to log into API
 
12812024-05-29T21:50:25.155ZMay 29 21:50:23 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
12822024-05-29T21:50:35.520Z2024-05-29 21:50:35.514256146 UTC: login succeeded
12832024-05-29T21:50:35.553Zwaiting for nexus to come up...
12842024-05-29T21:50:35.623Zcreating IP pool... 10.151.2.175 - 10.151.2.227
12852024-05-29T21:50:35.820Zsetting up quotas...
12862024-05-29T21:50:35.855Zensuring datasets are ready...
12872024-05-29T21:50:38.812Zlet's roll.
12882024-05-29T21:50:38.840Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
12892024-05-29T21:50:38.840ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
12902024-05-29T21:50:38.840ZOXIDE_TOKEN=oxide-token-64366ff70548428dfe2911f03b1be62a886b8479'
12912024-05-29T21:50:38.840Z++ OXIDE_HOST=https://recovery.sys.oxide.test
12922024-05-29T21:50:38.840Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
12932024-05-29T21:50:38.840Z++ OXIDE_TOKEN=oxide-token-64366ff70548428dfe2911f03b1be62a886b8479
12942024-05-29T21:50:38.841Z+ export OXIDE_HOST OXIDE_TOKEN
12952024-05-29T21:50:38.841Z+ retry=0
12962024-05-29T21:50:38.841Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12972024-05-29T21:50:38.921Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
12982024-05-29T21:50:39.363Z{"status":"ok"}success
12992024-05-29T21:50:39.364ZProject {
13002024-05-29T21:50:39.364Z description: "some images",
13012024-05-29T21:50:39.364Z id: 6dc786d3-4c59-48cd-9aa5-dc046cefe460,
13022024-05-29T21:50:39.364Z name: Name(
13032024-05-29T21:50:39.364Z "images",
13042024-05-29T21:50:39.364Z ),
13052024-05-29T21:50:39.364Z time_created: 2024-05-29T21:50:38.983376Z,
13062024-05-29T21:50:39.364Z time_modified: 2024-05-29T21:50:38.983376Z,
13072024-05-29T21:50:39.364Z}
13082024-05-29T21:50:39.397Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
13092024-05-29T21:55:56.820Zdone!
13102024-05-29T21:55:56.932Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
13112024-05-29T21:55:57.026Zsuccess
13122024-05-29T21:55:57.026ZImage {
13132024-05-29T21:55:57.026Z block_size: ByteCount(
13142024-05-29T21:55:57.026Z 512,
13152024-05-29T21:55:57.026Z ),
13162024-05-29T21:55:57.026Z description: "debian 11 original base image",
13172024-05-29T21:55:57.026Z digest: None,
13182024-05-29T21:55:57.026Z id: 3588012c-74e8-4ff3-8880-7f7604febdd5,
13192024-05-29T21:55:57.026Z name: Name(
13202024-05-29T21:55:57.026Z "debian11",
13212024-05-29T21:55:57.026Z ),
13222024-05-29T21:55:57.026Z os: "debian",
13232024-05-29T21:55:57.051Z project_id: None,
13242024-05-29T21:55:57.051Z size: ByteCount(
13252024-05-29T21:55:57.051Z 2147483648,
13262024-05-29T21:55:57.051Z ),
13272024-05-29T21:55:57.051Z time_created: 2024-05-29T21:55:56.767974Z,
13282024-05-29T21:55:57.052Z time_modified: 2024-05-29T21:55:57.010784Z,
13292024-05-29T21:55:57.052Z url: None,
13302024-05-29T21:55:57.052Z version: "11",
13312024-05-29T21:55:57.052Z}
13322024-05-29T21:55:57.052Z+ for test_bin in tests/*
13332024-05-29T21:55:57.052Z+ ./tests/bootstrap-562ff04add60b960
13342024-05-29T21:55:57.052Z
13352024-05-29T21:55:57.052Zrunning 0 tests
13362024-05-29T21:55:57.052Z
13372024-05-29T21:55:57.052Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13382024-05-29T21:55:57.052Z
13392024-05-29T21:55:57.052Z+ for test_bin in tests/*
13402024-05-29T21:55:57.052Z+ ./tests/commtest-1ebd58e5c16d1891
13412024-05-29T21:55:57.077Z
13422024-05-29T21:55:57.077Zrunning 0 tests
13432024-05-29T21:55:57.077Z
13442024-05-29T21:55:57.077Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13452024-05-29T21:55:57.077Z
13462024-05-29T21:55:57.077Z+ for test_bin in tests/*
13472024-05-29T21:55:57.077Z+ ./tests/dhcp_server-d9caab43602819e6
13482024-05-29T21:55:57.106Z
13492024-05-29T21:55:57.106Zrunning 0 tests
13502024-05-29T21:55:57.106Z
13512024-05-29T21:55:57.106Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13522024-05-29T21:55:57.106Z
13532024-05-29T21:55:57.107Z+ for test_bin in tests/*
13542024-05-29T21:55:57.107Z+ ./tests/end_to_end_tests-fa93711239d79f99
13552024-05-29T21:55:57.231Z
13562024-05-29T21:55:57.231Zrunning 2 tests
13572024-05-29T21:55:57.477Ztest no_spoof::no_spoof_here ... ok
13582024-05-29T21:56:23.259Ztest instance_launch::instance_launch ... ok
13592024-05-29T21:56:23.259Z
13602024-05-29T21:56:23.259Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 26.02s
13612024-05-29T21:56:23.259Z
13622024-05-29T21:56:23.286Z+ _exit_trap
13632024-05-29T21:56:23.286Z+ local status=0
13642024-05-29T21:56:23.286Z+ [[ 0 -eq 0 ]]
13652024-05-29T21:56:23.286Z+ exit 0
13662024-05-29T21:56:23.286Zprocess exited: duration 641480 ms, exit code 0
 
13672024-05-29T21:56:23.388Zfound 101 output files
13682024-05-29T21:56:23.388Zuploading: /var/svc/log/oxide-sled-agent:default.log (1275811 bytes)
13692024-05-29T21:56:25.225Zupload warning: file "/var/svc/log/oxide-sled-agent:default.log" changed size mid upload: 1275811 -> 1276544
13702024-05-29T21:56:26.312Zuploaded: /var/svc/log/oxide-sled-agent:default.log
13712024-05-29T21:56:26.340Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (3933363 bytes)
13722024-05-29T21:56:30.951Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 3933363 -> 3988164
13732024-05-29T21:56:32.073Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
13742024-05-29T21:56:32.073Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52276 bytes)
13752024-05-29T21:56:33.736Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
13762024-05-29T21:56:33.736Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (133131 bytes)
13772024-05-29T21:56:34.350Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 133131 -> 138588
13782024-05-29T21:56:35.071Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
13792024-05-29T21:56:35.071Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (181241 bytes)
13802024-05-29T21:56:35.389Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 181241 -> 190861
13812024-05-29T21:56:37.751Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
13822024-05-29T21:56:37.751Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1283248 bytes)
13832024-05-29T21:56:40.319Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1283248 -> 1323210
13842024-05-29T21:56:41.857Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
13852024-05-29T21:56:41.857Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (736089 bytes)
13862024-05-29T21:56:43.417Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 736089 -> 761703
13872024-05-29T21:56:44.459Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
13882024-05-29T21:56:44.459Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1678 bytes)
13892024-05-29T21:56:47.678Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
13902024-05-29T21:56:47.678Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (271383 bytes)
13912024-05-29T21:56:49.003Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 271383 -> 283997
13922024-05-29T21:56:50.140Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
13932024-05-29T21:56:50.140Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (7108 bytes)
13942024-05-29T21:56:51.022Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 7108 -> 7693
13952024-05-29T21:56:52.564Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
13962024-05-29T21:56:52.564Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5393 bytes)
13972024-05-29T21:56:53.859Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
13982024-05-29T21:56:53.859Zuploading: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_cockroachdb_f75c1225-4251-4b27-8dea-29b8679e435a/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
13992024-05-29T21:56:54.900Zuploaded: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_cockroachdb_f75c1225-4251-4b27-8dea-29b8679e435a/root/var/svc/log/oxide-cockroachdb:default.log
14002024-05-29T21:56:54.900Zuploading: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_cockroachdb_f75c1225-4251-4b27-8dea-29b8679e435a/root/var/svc/log/oxide-zone-network-setup:default.log (1695 bytes)
14012024-05-29T21:56:56.501Zuploaded: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_cockroachdb_f75c1225-4251-4b27-8dea-29b8679e435a/root/var/svc/log/oxide-zone-network-setup:default.log
14022024-05-29T21:56:56.501Zuploading: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-agent:default.log (29686 bytes)
14032024-05-29T21:56:58.398Zuploaded: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-agent:default.log
14042024-05-29T21:56:58.398Zuploading: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14052024-05-29T21:56:59.471Zuploaded: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-downstairs:default.log
14062024-05-29T21:56:59.471Zuploading: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f69781c-fbfc-4f93-ae89-6c52eafd2ce5.log (3016 bytes)
14072024-05-29T21:57:00.597Zuploaded: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f69781c-fbfc-4f93-ae89-6c52eafd2ce5.log
14082024-05-29T21:57:00.622Zuploading: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-downstairs:downstairs-b2e7b96a-39f5-4be2-b3fc-4087ab070e2c.log (5610 bytes)
14092024-05-29T21:57:01.701Zuploaded: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-downstairs:downstairs-b2e7b96a-39f5-4be2-b3fc-4087ab070e2c.log
14102024-05-29T21:57:01.738Zuploading: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-downstairs:downstairs-f5fd9614-d492-4ae8-b529-66dba89a195a.log (3126 bytes)
14112024-05-29T21:57:02.866Zuploaded: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-crucible-downstairs:downstairs-f5fd9614-d492-4ae8-b529-66dba89a195a.log
14122024-05-29T21:57:02.866Zuploading: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
14132024-05-29T21:57:05.611Zuploaded: /pool/ext/020b43a6-e481-4304-8596-25774e86f14b/crypt/zone/oxz_crucible_1651e1ef-46f8-46cf-a194-eed8a22e18b8/root/var/svc/log/oxide-zone-network-setup:default.log
14142024-05-29T21:57:05.611Zuploading: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-agent:default.log (29217 bytes)
14152024-05-29T21:57:06.817Zuploaded: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-agent:default.log
14162024-05-29T21:57:06.818Zuploading: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14172024-05-29T21:57:07.959Zuploaded: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-downstairs:default.log
14182024-05-29T21:57:07.959Zuploading: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-downstairs:downstairs-0ffe140c-4246-4a1d-924f-5aba7658b0e1.log (3124 bytes)
14192024-05-29T21:57:09.157Zuploaded: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-downstairs:downstairs-0ffe140c-4246-4a1d-924f-5aba7658b0e1.log
14202024-05-29T21:57:09.157Zuploading: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-downstairs:downstairs-b114bdb5-7a6f-4ad1-beb2-9052131227a6.log (3020 bytes)
14212024-05-29T21:57:10.283Zuploaded: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-downstairs:downstairs-b114bdb5-7a6f-4ad1-beb2-9052131227a6.log
14222024-05-29T21:57:10.284Zuploading: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-downstairs:downstairs-eb5bface-8c9f-46a3-ae87-773bf8f62441.log (5611 bytes)
14232024-05-29T21:57:11.807Zuploaded: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-crucible-downstairs:downstairs-eb5bface-8c9f-46a3-ae87-773bf8f62441.log
14242024-05-29T21:57:11.808Zuploading: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
14252024-05-29T21:57:13.332Zuploaded: /pool/ext/4532d18b-4909-4537-9ce6-98b74fb663f5/crypt/zone/oxz_crucible_5de4c38e-911d-46b7-beee-a39576f2ce66/root/var/svc/log/oxide-zone-network-setup:default.log
14262024-05-29T21:57:13.332Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-agent:default.log (42927 bytes)
14272024-05-29T21:57:15.012Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-agent:default.log
14282024-05-29T21:57:15.012Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14292024-05-29T21:57:16.132Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:default.log
14302024-05-29T21:57:16.132Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:downstairs-0affeabf-ac5e-409e-9079-4d7c5fe95e70.log (5610 bytes)
14312024-05-29T21:57:17.895Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:downstairs-0affeabf-ac5e-409e-9079-4d7c5fe95e70.log
14322024-05-29T21:57:17.921Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:downstairs-53d058f5-f40b-424c-bab5-5a799c3c7dbc.log (3020 bytes)
14332024-05-29T21:57:19.038Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:downstairs-53d058f5-f40b-424c-bab5-5a799c3c7dbc.log
14342024-05-29T21:57:19.038Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:downstairs-62d3c1e6-8907-4400-8994-bfb6bc675db2.log (5695 bytes)
14352024-05-29T21:57:20.176Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:downstairs-62d3c1e6-8907-4400-8994-bfb6bc675db2.log
14362024-05-29T21:57:20.176Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:snapshot-62d3c1e6-8907-4400-8994-bfb6bc675db2-61a6668b-d30e-4ad8-b5b4-2668f0f727ec.log (5303 bytes)
14372024-05-29T21:57:21.288Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-crucible-downstairs:snapshot-62d3c1e6-8907-4400-8994-bfb6bc675db2-61a6668b-d30e-4ad8-b5b4-2668f0f727ec.log
14382024-05-29T21:57:21.288Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
14392024-05-29T21:57:22.389Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_210fd0f2-c8d5-4a6d-a520-1ba68096679b/root/var/svc/log/oxide-zone-network-setup:default.log
14402024-05-29T21:57:22.389Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_pantry_4287d8cf-0565-4f0e-abd8-12de702d3848/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
14412024-05-29T21:57:23.507Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_pantry_4287d8cf-0565-4f0e-abd8-12de702d3848/root/var/svc/log/oxide-crucible-pantry:default.log
14422024-05-29T21:57:23.508Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_pantry_4287d8cf-0565-4f0e-abd8-12de702d3848/root/var/svc/log/oxide-zone-network-setup:default.log (1724 bytes)
14432024-05-29T21:57:24.641Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_pantry_4287d8cf-0565-4f0e-abd8-12de702d3848/root/var/svc/log/oxide-zone-network-setup:default.log
14442024-05-29T21:57:24.642Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_pantry_91d995f5-4121-4031-8f6b-37b0a19cd7a2/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
14452024-05-29T21:57:25.753Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_pantry_91d995f5-4121-4031-8f6b-37b0a19cd7a2/root/var/svc/log/oxide-crucible-pantry:default.log
14462024-05-29T21:57:25.753Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_pantry_91d995f5-4121-4031-8f6b-37b0a19cd7a2/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
14472024-05-29T21:57:27.336Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_crucible_pantry_91d995f5-4121-4031-8f6b-37b0a19cd7a2/root/var/svc/log/oxide-zone-network-setup:default.log
14482024-05-29T21:57:27.336Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_nexus_217665ab-21f9-40d6-8a7e-9bfc61dd5ddd/root/var/svc/log/oxide-nexus:default.log (37166652 bytes)
14492024-05-29T21:57:55.853Zupload warning: file "/pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_nexus_217665ab-21f9-40d6-8a7e-9bfc61dd5ddd/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 37166652 -> 37730301
14502024-05-29T21:57:56.942Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_nexus_217665ab-21f9-40d6-8a7e-9bfc61dd5ddd/root/var/svc/log/oxide-nexus:default.log
14512024-05-29T21:57:56.942Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_nexus_217665ab-21f9-40d6-8a7e-9bfc61dd5ddd/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
14522024-05-29T21:57:58.071Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_nexus_217665ab-21f9-40d6-8a7e-9bfc61dd5ddd/root/var/svc/log/oxide-opte-interface-setup:default.log
14532024-05-29T21:57:58.072Zuploading: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_nexus_217665ab-21f9-40d6-8a7e-9bfc61dd5ddd/root/var/svc/log/oxide-zone-network-setup:default.log (1662 bytes)
14542024-05-29T21:57:59.186Zuploaded: /pool/ext/59fcaf06-997c-43d9-9256-26a5eda3000f/crypt/zone/oxz_nexus_217665ab-21f9-40d6-8a7e-9bfc61dd5ddd/root/var/svc/log/oxide-zone-network-setup:default.log
14552024-05-29T21:57:59.186Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_crucible_d3e79ddb-29ef-48e6-9b00-cd52126fcc80/root/var/svc/log/oxide-crucible-agent:default.log (12541 bytes)
14562024-05-29T21:58:00.326Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_crucible_d3e79ddb-29ef-48e6-9b00-cd52126fcc80/root/var/svc/log/oxide-crucible-agent:default.log
14572024-05-29T21:58:00.326Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_crucible_d3e79ddb-29ef-48e6-9b00-cd52126fcc80/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14582024-05-29T21:58:01.962Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_crucible_d3e79ddb-29ef-48e6-9b00-cd52126fcc80/root/var/svc/log/oxide-crucible-downstairs:default.log
14592024-05-29T21:58:01.962Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_crucible_d3e79ddb-29ef-48e6-9b00-cd52126fcc80/root/var/svc/log/oxide-crucible-downstairs:downstairs-3219a191-fe67-4082-8c95-dcd078b7e8fa.log (3126 bytes)
14602024-05-29T21:58:03.086Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_crucible_d3e79ddb-29ef-48e6-9b00-cd52126fcc80/root/var/svc/log/oxide-crucible-downstairs:downstairs-3219a191-fe67-4082-8c95-dcd078b7e8fa.log
14612024-05-29T21:58:03.087Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_crucible_d3e79ddb-29ef-48e6-9b00-cd52126fcc80/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
14622024-05-29T21:58:04.193Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_crucible_d3e79ddb-29ef-48e6-9b00-cd52126fcc80/root/var/svc/log/oxide-zone-network-setup:default.log
14632024-05-29T21:58:04.193Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_nexus_73fd9e9c-3929-404c-966e-fc226ac774de/root/var/svc/log/oxide-nexus:default.log (1700786 bytes)
14642024-05-29T21:58:06.243Zupload warning: file "/pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_nexus_73fd9e9c-3929-404c-966e-fc226ac774de/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1700786 -> 2137428
14652024-05-29T21:58:07.325Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_nexus_73fd9e9c-3929-404c-966e-fc226ac774de/root/var/svc/log/oxide-nexus:default.log
14662024-05-29T21:58:07.326Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_nexus_73fd9e9c-3929-404c-966e-fc226ac774de/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
14672024-05-29T21:58:08.889Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_nexus_73fd9e9c-3929-404c-966e-fc226ac774de/root/var/svc/log/oxide-opte-interface-setup:default.log
14682024-05-29T21:58:08.889Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_nexus_73fd9e9c-3929-404c-966e-fc226ac774de/root/var/svc/log/oxide-zone-network-setup:default.log (1663 bytes)
14692024-05-29T21:58:10.003Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_nexus_73fd9e9c-3929-404c-966e-fc226ac774de/root/var/svc/log/oxide-zone-network-setup:default.log
14702024-05-29T21:58:10.003Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_oximeter_b0594198-29c3-400f-bbd5-0154b6bd4027/root/var/svc/log/oxide-oximeter:default.log (1179629 bytes)
14712024-05-29T21:58:12.058Zupload warning: file "/pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_oximeter_b0594198-29c3-400f-bbd5-0154b6bd4027/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1179629 -> 1595978
14722024-05-29T21:58:13.153Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_oximeter_b0594198-29c3-400f-bbd5-0154b6bd4027/root/var/svc/log/oxide-oximeter:default.log
14732024-05-29T21:58:13.153Zuploading: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_oximeter_b0594198-29c3-400f-bbd5-0154b6bd4027/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
14742024-05-29T21:58:14.259Zuploaded: /pool/ext/6b416693-d467-424a-86a1-703b05ad3101/crypt/zone/oxz_oximeter_b0594198-29c3-400f-bbd5-0154b6bd4027/root/var/svc/log/oxide-zone-network-setup:default.log
14752024-05-29T21:58:14.259Zuploading: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_2b73c1d9-c688-4821-bfd4-1080d5b2eea5/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
14762024-05-29T21:58:15.390Zuploaded: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_2b73c1d9-c688-4821-bfd4-1080d5b2eea5/root/var/svc/log/oxide-crucible-agent:default.log
14772024-05-29T21:58:15.390Zuploading: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_2b73c1d9-c688-4821-bfd4-1080d5b2eea5/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14782024-05-29T21:58:16.512Zuploaded: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_2b73c1d9-c688-4821-bfd4-1080d5b2eea5/root/var/svc/log/oxide-crucible-downstairs:default.log
14792024-05-29T21:58:16.513Zuploading: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_2b73c1d9-c688-4821-bfd4-1080d5b2eea5/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
14802024-05-29T21:58:17.630Zuploaded: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_2b73c1d9-c688-4821-bfd4-1080d5b2eea5/root/var/svc/log/oxide-zone-network-setup:default.log
14812024-05-29T21:58:17.630Zuploading: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_pantry_03b95682-bf8e-4d86-bca9-1c8acc0d4e8c/root/var/svc/log/oxide-crucible-pantry:default.log (763913 bytes)
14822024-05-29T21:58:20.176Zuploaded: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_pantry_03b95682-bf8e-4d86-bca9-1c8acc0d4e8c/root/var/svc/log/oxide-crucible-pantry:default.log
14832024-05-29T21:58:20.176Zuploading: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_pantry_03b95682-bf8e-4d86-bca9-1c8acc0d4e8c/root/var/svc/log/oxide-zone-network-setup:default.log (1723 bytes)
14842024-05-29T21:58:21.311Zuploaded: /pool/ext/8d81843f-0d2d-4c69-8d17-45004d7cf484/crypt/zone/oxz_crucible_pantry_03b95682-bf8e-4d86-bca9-1c8acc0d4e8c/root/var/svc/log/oxide-zone-network-setup:default.log
14852024-05-29T21:58:21.311Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_cockroachdb_c89b5943-b498-418a-8384-b86d007c01fe/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
14862024-05-29T21:58:22.483Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_cockroachdb_c89b5943-b498-418a-8384-b86d007c01fe/root/var/svc/log/oxide-cockroachdb:default.log
14872024-05-29T21:58:22.920Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_cockroachdb_c89b5943-b498-418a-8384-b86d007c01fe/root/var/svc/log/oxide-zone-network-setup:default.log (1694 bytes)
14882024-05-29T21:58:23.785Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_cockroachdb_c89b5943-b498-418a-8384-b86d007c01fe/root/var/svc/log/oxide-zone-network-setup:default.log
14892024-05-29T21:58:23.786Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-crucible-agent:default.log (15815 bytes)
14902024-05-29T21:58:24.959Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-crucible-agent:default.log
14912024-05-29T21:58:24.959Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14922024-05-29T21:58:26.246Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-crucible-downstairs:default.log
14932024-05-29T21:58:26.247Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-crucible-downstairs:downstairs-b6825550-bd82-4e6c-9ace-1362825bcd89.log (5696 bytes)
14942024-05-29T21:58:27.816Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-crucible-downstairs:downstairs-b6825550-bd82-4e6c-9ace-1362825bcd89.log
14952024-05-29T21:58:27.816Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-crucible-downstairs:snapshot-b6825550-bd82-4e6c-9ace-1362825bcd89-61a6668b-d30e-4ad8-b5b4-2668f0f727ec.log (5305 bytes)
14962024-05-29T21:58:29.567Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-crucible-downstairs:snapshot-b6825550-bd82-4e6c-9ace-1362825bcd89-61a6668b-d30e-4ad8-b5b4-2668f0f727ec.log
14972024-05-29T21:58:29.568Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
14982024-05-29T21:58:30.670Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_crucible_d462ebe6-9d90-445d-bf8a-7c34338191d9/root/var/svc/log/oxide-zone-network-setup:default.log
14992024-05-29T21:58:30.671Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_external_dns_cf9ddcb1-80ea-4c0a-9bfd-9007b54df2a7/root/var/svc/log/oxide-external_dns:default.log (23088 bytes)
15002024-05-29T21:58:30.830Zupload warning: file "/pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_external_dns_cf9ddcb1-80ea-4c0a-9bfd-9007b54df2a7/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 23088 -> 34421
15012024-05-29T21:58:34.868Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_external_dns_cf9ddcb1-80ea-4c0a-9bfd-9007b54df2a7/root/var/svc/log/oxide-external_dns:default.log
15022024-05-29T21:58:34.868Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_external_dns_cf9ddcb1-80ea-4c0a-9bfd-9007b54df2a7/root/var/svc/log/oxide-opte-interface-setup:default.log (1158 bytes)
15032024-05-29T21:58:35.922Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_external_dns_cf9ddcb1-80ea-4c0a-9bfd-9007b54df2a7/root/var/svc/log/oxide-opte-interface-setup:default.log
15042024-05-29T21:58:35.922Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_external_dns_cf9ddcb1-80ea-4c0a-9bfd-9007b54df2a7/root/var/svc/log/oxide-zone-network-setup:default.log (1705 bytes)
15052024-05-29T21:58:37.058Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_external_dns_cf9ddcb1-80ea-4c0a-9bfd-9007b54df2a7/root/var/svc/log/oxide-zone-network-setup:default.log
15062024-05-29T21:58:37.058Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_internal_dns_1e385359-7c92-410b-be48-08df0fa9ebc3/root/var/svc/log/oxide-internal_dns:default.log (103620 bytes)
15072024-05-29T21:58:37.835Zupload warning: file "/pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_internal_dns_1e385359-7c92-410b-be48-08df0fa9ebc3/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 103620 -> 114881
15082024-05-29T21:58:38.910Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_internal_dns_1e385359-7c92-410b-be48-08df0fa9ebc3/root/var/svc/log/oxide-internal_dns:default.log
15092024-05-29T21:58:38.910Zuploading: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_internal_dns_1e385359-7c92-410b-be48-08df0fa9ebc3/root/var/svc/log/oxide-zone-network-setup:default.log (1686 bytes)
15102024-05-29T21:58:40.036Zuploaded: /pool/ext/8f301520-a970-47c3-90c3-bd3006e5615c/crypt/zone/oxz_internal_dns_1e385359-7c92-410b-be48-08df0fa9ebc3/root/var/svc/log/oxide-zone-network-setup:default.log
15112024-05-29T21:58:40.036Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_clickhouse_01234475-c550-4426-ba63-e228db75b110/root/var/svc/log/oxide-clickhouse:default.log (1803498 bytes)
15122024-05-29T21:58:43.673Zupload warning: file "/pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_clickhouse_01234475-c550-4426-ba63-e228db75b110/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1803498 -> 2506917
15132024-05-29T21:58:44.751Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_clickhouse_01234475-c550-4426-ba63-e228db75b110/root/var/svc/log/oxide-clickhouse:default.log
15142024-05-29T21:58:44.751Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_clickhouse_01234475-c550-4426-ba63-e228db75b110/root/var/svc/log/oxide-zone-network-setup:default.log (1693 bytes)
15152024-05-29T21:58:46.312Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_clickhouse_01234475-c550-4426-ba63-e228db75b110/root/var/svc/log/oxide-zone-network-setup:default.log
15162024-05-29T21:58:46.312Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_cockroachdb_786ee988-6273-42be-9cf0-925b90724c54/root/var/svc/log/oxide-cockroachdb:default.log (4482 bytes)
15172024-05-29T21:58:47.436Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_cockroachdb_786ee988-6273-42be-9cf0-925b90724c54/root/var/svc/log/oxide-cockroachdb:default.log
15182024-05-29T21:58:47.436Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_cockroachdb_786ee988-6273-42be-9cf0-925b90724c54/root/var/svc/log/oxide-zone-network-setup:default.log (1693 bytes)
15192024-05-29T21:58:48.539Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_cockroachdb_786ee988-6273-42be-9cf0-925b90724c54/root/var/svc/log/oxide-zone-network-setup:default.log
15202024-05-29T21:58:48.540Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_crucible_9982d53a-69ab-47ac-b36a-154a6b0da765/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
15212024-05-29T21:58:49.678Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_crucible_9982d53a-69ab-47ac-b36a-154a6b0da765/root/var/svc/log/oxide-crucible-agent:default.log
15222024-05-29T21:58:49.678Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_crucible_9982d53a-69ab-47ac-b36a-154a6b0da765/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15232024-05-29T21:58:51.205Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_crucible_9982d53a-69ab-47ac-b36a-154a6b0da765/root/var/svc/log/oxide-crucible-downstairs:default.log
15242024-05-29T21:58:51.205Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_crucible_9982d53a-69ab-47ac-b36a-154a6b0da765/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
15252024-05-29T21:58:52.303Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_crucible_9982d53a-69ab-47ac-b36a-154a6b0da765/root/var/svc/log/oxide-zone-network-setup:default.log
15262024-05-29T21:58:52.303Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_external_dns_ce802882-5f60-4fa0-8546-381dc464eec5/root/var/svc/log/oxide-external_dns:default.log (23093 bytes)
15272024-05-29T21:58:52.468Zupload warning: file "/pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_external_dns_ce802882-5f60-4fa0-8546-381dc464eec5/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 23093 -> 34427
15282024-05-29T21:58:53.548Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_external_dns_ce802882-5f60-4fa0-8546-381dc464eec5/root/var/svc/log/oxide-external_dns:default.log
15292024-05-29T21:58:53.548Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_external_dns_ce802882-5f60-4fa0-8546-381dc464eec5/root/var/svc/log/oxide-opte-interface-setup:default.log (1159 bytes)
15302024-05-29T21:58:54.656Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_external_dns_ce802882-5f60-4fa0-8546-381dc464eec5/root/var/svc/log/oxide-opte-interface-setup:default.log
15312024-05-29T21:58:54.688Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_external_dns_ce802882-5f60-4fa0-8546-381dc464eec5/root/var/svc/log/oxide-zone-network-setup:default.log (1705 bytes)
15322024-05-29T21:58:55.775Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_external_dns_ce802882-5f60-4fa0-8546-381dc464eec5/root/var/svc/log/oxide-zone-network-setup:default.log
15332024-05-29T21:58:55.775Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_internal_dns_fcefb7d0-f4d6-4f75-8c6c-6ee2d2710c4f/root/var/svc/log/oxide-internal_dns:default.log (104018 bytes)
15342024-05-29T21:58:56.132Zupload warning: file "/pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_internal_dns_fcefb7d0-f4d6-4f75-8c6c-6ee2d2710c4f/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 104018 -> 115286
15352024-05-29T21:58:57.198Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_internal_dns_fcefb7d0-f4d6-4f75-8c6c-6ee2d2710c4f/root/var/svc/log/oxide-internal_dns:default.log
15362024-05-29T21:58:57.199Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_internal_dns_fcefb7d0-f4d6-4f75-8c6c-6ee2d2710c4f/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
15372024-05-29T21:58:58.319Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_internal_dns_fcefb7d0-f4d6-4f75-8c6c-6ee2d2710c4f/root/var/svc/log/oxide-zone-network-setup:default.log
15382024-05-29T21:58:58.319Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/svc/log/oxide-chrony-setup:default.log (14142 bytes)
15392024-05-29T21:58:59.485Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/svc/log/oxide-chrony-setup:default.log
15402024-05-29T21:58:59.486Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/svc/log/oxide-ntp:default.log (1132 bytes)
15412024-05-29T21:59:00.599Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/svc/log/oxide-ntp:default.log
15422024-05-29T21:59:00.599Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/svc/log/oxide-opte-interface-setup:default.log (1129 bytes)
15432024-05-29T21:59:01.706Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/svc/log/oxide-opte-interface-setup:default.log
15442024-05-29T21:59:01.706Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/svc/log/oxide-zone-network-setup:default.log (1642 bytes)
15452024-05-29T21:59:03.278Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/svc/log/oxide-zone-network-setup:default.log
15462024-05-29T21:59:03.278Zuploading: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_cockroachdb_24aeb804-b94d-490c-a3ab-e1e642240014/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
15472024-05-29T21:59:04.381Zuploaded: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_cockroachdb_24aeb804-b94d-490c-a3ab-e1e642240014/root/var/svc/log/oxide-cockroachdb:default.log
15482024-05-29T21:59:04.382Zuploading: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_cockroachdb_24aeb804-b94d-490c-a3ab-e1e642240014/root/var/svc/log/oxide-zone-network-setup:default.log (1692 bytes)
15492024-05-29T21:59:05.488Zuploaded: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_cockroachdb_24aeb804-b94d-490c-a3ab-e1e642240014/root/var/svc/log/oxide-zone-network-setup:default.log
15502024-05-29T21:59:05.489Zuploading: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_crucible_a9a35d48-4126-4b06-b5c7-ee36d97697af/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
15512024-05-29T21:59:06.602Zuploaded: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_crucible_a9a35d48-4126-4b06-b5c7-ee36d97697af/root/var/svc/log/oxide-crucible-agent:default.log
15522024-05-29T21:59:06.602Zuploading: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_crucible_a9a35d48-4126-4b06-b5c7-ee36d97697af/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15532024-05-29T21:59:07.714Zuploaded: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_crucible_a9a35d48-4126-4b06-b5c7-ee36d97697af/root/var/svc/log/oxide-crucible-downstairs:default.log
15542024-05-29T21:59:07.714Zuploading: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_crucible_a9a35d48-4126-4b06-b5c7-ee36d97697af/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
15552024-05-29T21:59:08.833Zuploaded: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_crucible_a9a35d48-4126-4b06-b5c7-ee36d97697af/root/var/svc/log/oxide-zone-network-setup:default.log
15562024-05-29T21:59:08.833Zuploading: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_nexus_2965e03f-f8ef-4bac-89e9-8a71eac94e2c/root/var/svc/log/oxide-nexus:default.log (1680541 bytes)
15572024-05-29T21:59:09.671Zupload warning: file "/pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_nexus_2965e03f-f8ef-4bac-89e9-8a71eac94e2c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1680541 -> 2346608
15582024-05-29T21:59:10.751Zuploaded: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_nexus_2965e03f-f8ef-4bac-89e9-8a71eac94e2c/root/var/svc/log/oxide-nexus:default.log
15592024-05-29T21:59:10.751Zuploading: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_nexus_2965e03f-f8ef-4bac-89e9-8a71eac94e2c/root/var/svc/log/oxide-opte-interface-setup:default.log (1137 bytes)
15602024-05-29T21:59:11.858Zuploaded: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_nexus_2965e03f-f8ef-4bac-89e9-8a71eac94e2c/root/var/svc/log/oxide-opte-interface-setup:default.log
15612024-05-29T21:59:11.858Zuploading: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_nexus_2965e03f-f8ef-4bac-89e9-8a71eac94e2c/root/var/svc/log/oxide-zone-network-setup:default.log (1663 bytes)
15622024-05-29T21:59:12.965Zuploaded: /pool/ext/b5814935-58c2-4e3c-9137-4cbaa1ee9fab/crypt/zone/oxz_nexus_2965e03f-f8ef-4bac-89e9-8a71eac94e2c/root/var/svc/log/oxide-zone-network-setup:default.log
15632024-05-29T21:59:12.965Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_cockroachdb_1f1e65f0-d4fc-47d6-875a-be69c36e708b/root/var/svc/log/oxide-cockroachdb:default.log (4381 bytes)
15642024-05-29T21:59:14.076Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_cockroachdb_1f1e65f0-d4fc-47d6-875a-be69c36e708b/root/var/svc/log/oxide-cockroachdb:default.log
15652024-05-29T21:59:14.077Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_cockroachdb_1f1e65f0-d4fc-47d6-875a-be69c36e708b/root/var/svc/log/oxide-zone-network-setup:default.log (1695 bytes)
15662024-05-29T21:59:15.179Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_cockroachdb_1f1e65f0-d4fc-47d6-875a-be69c36e708b/root/var/svc/log/oxide-zone-network-setup:default.log
15672024-05-29T21:59:15.179Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-crucible-agent:default.log (15811 bytes)
15682024-05-29T21:59:16.345Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-crucible-agent:default.log
15692024-05-29T21:59:16.369Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15702024-05-29T21:59:17.473Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-crucible-downstairs:default.log
15712024-05-29T21:59:17.474Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-crucible-downstairs:downstairs-2134ad3a-815e-411a-ad06-f0b49a22a048.log (5691 bytes)
15722024-05-29T21:59:18.580Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-crucible-downstairs:downstairs-2134ad3a-815e-411a-ad06-f0b49a22a048.log
15732024-05-29T21:59:18.580Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-crucible-downstairs:snapshot-2134ad3a-815e-411a-ad06-f0b49a22a048-61a6668b-d30e-4ad8-b5b4-2668f0f727ec.log (5306 bytes)
15742024-05-29T21:59:19.680Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-crucible-downstairs:snapshot-2134ad3a-815e-411a-ad06-f0b49a22a048-61a6668b-d30e-4ad8-b5b4-2668f0f727ec.log
15752024-05-29T21:59:19.681Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
15762024-05-29T21:59:20.784Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_crucible_d7e9ce69-0abf-4995-ace8-8f9a44bb9c50/root/var/svc/log/oxide-zone-network-setup:default.log
15772024-05-29T21:59:20.784Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_internal_dns_a650c55b-039c-4ca8-a067-787cab718ce3/root/var/svc/log/oxide-internal_dns:default.log (103621 bytes)
15782024-05-29T21:59:20.949Zupload warning: file "/pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_internal_dns_a650c55b-039c-4ca8-a067-787cab718ce3/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 103621 -> 114886
15792024-05-29T21:59:22.024Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_internal_dns_a650c55b-039c-4ca8-a067-787cab718ce3/root/var/svc/log/oxide-internal_dns:default.log
15802024-05-29T21:59:22.024Zuploading: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_internal_dns_a650c55b-039c-4ca8-a067-787cab718ce3/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
15812024-05-29T21:59:23.120Zuploaded: /pool/ext/cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crypt/zone/oxz_internal_dns_a650c55b-039c-4ca8-a067-787cab718ce3/root/var/svc/log/oxide-zone-network-setup:default.log
15822024-05-29T21:59:23.144Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/measurements.log (21372 bytes)
15832024-05-29T21:59:23.215Zupload warning: file "/pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/measurements.log" changed size mid upload: 21372 -> 28359
15842024-05-29T21:59:24.291Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/measurements.log
15852024-05-29T21:59:24.292Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/statistics.log (13689 bytes)
15862024-05-29T21:59:24.388Zupload warning: file "/pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/statistics.log" changed size mid upload: 13689 -> 19539
15872024-05-29T21:59:25.468Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/statistics.log
15882024-05-29T21:59:25.468Zuploading: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/tracking.log (2119 bytes)
15892024-05-29T21:59:25.519Zupload warning: file "/pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/tracking.log" changed size mid upload: 2119 -> 2515
15902024-05-29T21:59:26.602Zuploaded: /pool/ext/aeaf2c17-7b7a-4447-8f2e-63b0c87bf54c/crypt/zone/oxz_ntp_b6538e8d-59bc-4ef4-b2c8-220ca3e6d575/root/var/log/chrony/tracking.log