01HZQKSHS9HJWQMSF248P4804B: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.31",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HZQKT94VATW7BPZPFWK6KPGM

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-06-06T21:06:24.802Zjob dependencies complete; ready to run (waiting for 37 m 52 s)
22024-06-06T21:11:33.077Zjob assigned to worker 01HZQNZTVHX5DHKB009EZ1V8EX (queued for 5 m 8 s)
32024-06-06T21:11:33.209Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-06-06T21:11:33.259Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-06-06T21:11:33.294Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-06-06T21:11:33.341Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-06-06T21:11:33.382Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-06-06T21:11:33.419ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-06-06T21:11:33.454Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d3
102024-06-06T21:11:33.488ZOxide Helios Version helios-2.0.22694 64-bit
112024-06-06T21:11:33.525ZConfiguring devices.
122024-06-06T21:11:33.558Z##################################################
132024-06-06T21:11:33.592Z#### ############# ##
142024-06-06T21:11:33.625Z### ### ############ ##
152024-06-06T21:11:33.660Z## ### # ## ### ## Oxide Computer Company ##
162024-06-06T21:11:33.725Z## ## ## ### # ### ##
172024-06-06T21:11:34.167Z## # ### #### #### This Station Under ##
182024-06-06T21:11:34.367Z### ### #### # ### Computer Control ##
192024-06-06T21:11:34.425Z#### #### ### ## ##
202024-06-06T21:11:34.459Z##################################################
212024-06-06T21:11:34.493ZHostname: sock
222024-06-06T21:11:34.527ZLoading smf(7) service descriptions:
232024-06-06T21:11:35.101Zdownloading input: /input/package/work/package.tar.gz
242024-06-06T21:16:32.183Zdownloaded input: /input/package/work/package.tar.gz
 
252024-06-06T21:16:32.215Zstarting task 0: "setup"
262024-06-06T21:16:32.215Z++ uname -s
272024-06-06T21:16:32.215Z+ kern=SunOS
282024-06-06T21:16:32.215Z+ case "$kern" in
292024-06-06T21:16:32.215Z+ groupadd -g 12345 build
302024-06-06T21:16:32.216Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-06-06T21:16:33.997Z+ zfs create -o mountpoint=/work rpool/work
322024-06-06T21:16:34.023Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-06-06T21:16:34.023Z+ home_fs=zfs
342024-06-06T21:16:34.023Z+ [[ zfs == autofs ]]
352024-06-06T21:16:34.023Z+ mkdir -p /home/build
362024-06-06T21:16:34.023Z+ chown build:build /home/build /work
372024-06-06T21:16:36.026Z+ chmod 0700 /home/build /work
382024-06-06T21:16:36.051Zprocess exited: duration 4050 ms, exit code 0
 
392024-06-06T21:16:36.104Zstarting task 1: "authentication"
402024-06-06T21:16:36.148Zprocess exited: duration 44 ms, exit code 0
 
412024-06-06T21:16:36.199Zstarting task 2: "build"
422024-06-06T21:16:36.225Z+ trap _exit_trap EXIT
432024-06-06T21:16:36.225Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-06-06T21:16:36.318Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-06-06T21:16:36.318Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-06-06T21:16:36.318Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-06-06T21:16:36.318Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-06-06T21:16:36.318Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-06-06T21:16:36.318Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-06-06T21:16:36.318Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-06-06T21:16:36.357Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-06-06T21:16:36.357Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-06-06T21:16:36.357Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-06-06T21:16:36.357Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-06-06T21:16:36.357Z+ [[ -d /opt/oxide ]]
562024-06-06T21:16:36.358Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-06-06T21:16:36.358Z+ pfexec mkdir /opt/oxide
582024-06-06T21:16:36.358Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-06-06T21:16:36.358Z+ [[ -d /opt/oxide-underneath ]]
602024-06-06T21:16:36.358Z+ cd /opt/oxide-underneath
612024-06-06T21:16:36.358Z+ pfexec tar ceEp@/f - .
622024-06-06T21:16:36.358Z+ cd /opt/oxide
632024-06-06T21:16:36.358Z+ pfexec tar xveEp@/f -
642024-06-06T21:16:36.429Zx ., 0 bytes, 0 tape blocks
652024-06-06T21:16:36.430Zx ./opte, 0 bytes, 0 tape blocks
662024-06-06T21:16:36.430Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-06-06T21:16:36.430Zx ./opte/bin/opteadm, 44782952 bytes, 87467 tape blocks
682024-06-06T21:16:36.462Z+ pfexec rm -rf /opt/oxide-underneath
692024-06-06T21:16:36.463Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-06-06T21:16:36.463Z+ pfexec mkdir /opt/oxide/work
712024-06-06T21:16:36.489Z+ pfexec chown build:build /opt/oxide/work
722024-06-06T21:16:36.489Z+ cd /opt/oxide/work
732024-06-06T21:16:36.489Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-06-06T21:16:48.583ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-06-06T21:16:48.583Zx out/target/test, 75 bytes, 1 tape blocks
762024-06-06T21:16:48.584Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-06-06T21:16:48.584Zx package-manifest.toml, 27966 bytes, 55 tape blocks
782024-06-06T21:16:48.584Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-06-06T21:16:48.584Zx target/release/omicron-package, 32574800 bytes, 63623 tape blocks
802024-06-06T21:16:48.584Zx target/release/xtask, 14187160 bytes, 27710 tape blocks
812024-06-06T21:16:48.584Zx target/debug/bootstrap, 359743024 bytes, 702624 tape blocks
822024-06-06T21:16:48.584Zx tests/bootstrap-2270a52303570def, 24564360 bytes, 47978 tape blocks
832024-06-06T21:16:48.584Zx tests/commtest-f1c1ef60903c5ff6, 24564944 bytes, 47979 tape blocks
842024-06-06T21:16:48.584Zx tests/dhcp_server-887c232f20c28b82, 24564368 bytes, 47978 tape blocks
852024-06-06T21:16:48.584Zx tests/end_to_end_tests-4abd980bc7707df5, 369516624 bytes, 721713 tape blocks
862024-06-06T21:16:48.584Zx out/clickhouse.tar.gz, 228346314 bytes, 445989 tape blocks
872024-06-06T21:16:48.584Zx out/clickhouse_keeper.tar.gz, 228333659 bytes, 445965 tape blocks
882024-06-06T21:16:48.584Zx out/cockroachdb.tar.gz, 134264231 bytes, 262235 tape blocks
892024-06-06T21:16:48.584Zx out/crucible-pantry-zone.tar.gz, 27949485 bytes, 54589 tape blocks
902024-06-06T21:16:48.584Zx out/crucible-zone.tar.gz, 38967367 bytes, 76109 tape blocks
912024-06-06T21:16:48.584Zx out/external-dns.tar.gz, 25687713 bytes, 50172 tape blocks
922024-06-06T21:16:48.584Zx out/internal-dns.tar.gz, 25687531 bytes, 50171 tape blocks
932024-06-06T21:16:48.584Zx out/mg-ddm-gz.tar, 62731776 bytes, 122523 tape blocks
942024-06-06T21:16:48.584Zx out/nexus.tar.gz, 84480684 bytes, 165002 tape blocks
952024-06-06T21:16:48.584Zx out/ntp.tar.gz, 9054278 bytes, 17685 tape blocks
962024-06-06T21:16:48.584Zx out/omicron-gateway-softnpu.tar.gz, 14071509 bytes, 27484 tape blocks
972024-06-06T21:16:48.585Zx out/omicron-sled-agent.tar, 94892032 bytes, 185336 tape blocks
982024-06-06T21:16:48.585Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
992024-06-06T21:16:48.585Zx out/oximeter.tar.gz, 41312726 bytes, 80689 tape blocks
1002024-06-06T21:16:48.585Zx out/oxlog.tar, 3024896 bytes, 5908 tape blocks
1012024-06-06T21:16:48.585Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1022024-06-06T21:16:48.585Zx out/propolis-server.tar.gz, 67005412 bytes, 130870 tape blocks
1032024-06-06T21:16:48.585Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1042024-06-06T21:16:48.585Zx out/switch-softnpu.tar.gz, 200305635 bytes, 391222 tape blocks
1052024-06-06T21:16:48.611Z
1062024-06-06T21:16:48.611Zreal 12.094495387
1072024-06-06T21:16:48.611Zuser 10.740976332
1082024-06-06T21:16:48.611Zsys 2.377747572
1092024-06-06T21:16:48.611Ztrap 0.000393866
1102024-06-06T21:16:48.611Ztflt 0.000000000
1112024-06-06T21:16:48.611Zdflt 0.000000000
1122024-06-06T21:16:48.611Zkflt 0.000000000
1132024-06-06T21:16:48.611Zlock 0.000000000
1142024-06-06T21:16:48.611Zslp 10.770415434
1152024-06-06T21:16:48.612Zlat 0.297332078
1162024-06-06T21:16:48.612Zstop 0.000118181
1172024-06-06T21:16:48.612Z+ bmat address ls
1182024-06-06T21:16:48.612ZNAME CIDR FIRST LAST COUNT
1192024-06-06T21:16:48.612Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1202024-06-06T21:16:48.612Z++ bmat address ls -f extra -Ho first,last,count
1212024-06-06T21:16:48.612Z+ set -- 10.151.2.164 10.151.2.227 64
1222024-06-06T21:16:48.612Z+ EXTRA_IP_START=10.151.2.164
1232024-06-06T21:16:48.612Z+ EXTRA_IP_END=10.151.2.227
1242024-06-06T21:16:48.612Z+ EXTRA_IP_COUNT=64
1252024-06-06T21:16:48.612Z+ (( EXTRA_IP_COUNT >= 32 ))
1262024-06-06T21:16:48.612Z+ EXTRA_IP_BASE=10.151.2
1272024-06-06T21:16:48.612Z+ EXTRA_IP_FOCTET=164
1282024-06-06T21:16:48.612Z+ EXTRA_IP_LOCTET=227
1292024-06-06T21:16:48.612Z+ SERVICE_IP_POOL_START=10.151.2.164
1302024-06-06T21:16:48.612Z+ SERVICE_IP_POOL_END=10.151.2.173
1312024-06-06T21:16:48.612Z+ DNS_IP1=10.151.2.164
1322024-06-06T21:16:48.612Z+ DNS_IP2=10.151.2.165
1332024-06-06T21:16:48.612Z+ UPLINK_IP=10.151.2.174
1342024-06-06T21:16:48.612Z+ IPPOOL_START=10.151.2.175
1352024-06-06T21:16:48.613Z+ IPPOOL_END=10.151.2.227
1362024-06-06T21:16:48.613Z++ ipadm show-addr -po type,addr
1372024-06-06T21:16:48.613Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1382024-06-06T21:16:48.613Z+ GATEWAY_IP=10.151.2.100
1392024-06-06T21:16:48.613Z+ [[ -n 10.151.2.100 ]]
1402024-06-06T21:16:48.613Z+ ping -s 10.151.2.100 56 1
1412024-06-06T21:16:48.613ZPING 10.151.2.100: 56 data bytes
1422024-06-06T21:16:48.613Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
1432024-06-06T21:16:48.613Z
1442024-06-06T21:16:48.613Z----10.151.2.100 PING Statistics----
1452024-06-06T21:16:48.613Z1 packets transmitted, 1 packets received, 0% packet loss
1462024-06-06T21:16:48.613Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
1472024-06-06T21:16:48.613Z++ arp -an
1482024-06-06T21:16:48.613Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1492024-06-06T21:16:48.613Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1502024-06-06T21:16:48.613Z+ routeadm -e ipv4-forwarding -u
1512024-06-06T21:16:48.717Z+ PXA_START=10.151.2.164
1522024-06-06T21:16:48.717Z+ PXA_END=10.151.2.227
1532024-06-06T21:16:48.717Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1542024-06-06T21:16:48.852Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227
1552024-06-06T21:16:48.876ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1562024-06-06T21:16:48.935Zcreating virtual hardware
1572024-06-06T21:16:48.962Zcreating /scratch/m2_0.vdev
1582024-06-06T21:16:48.962Zcreating /scratch/m2_1.vdev
1592024-06-06T21:16:48.962Zcreating /scratch/u2_0.vdev
1602024-06-06T21:16:48.962Zcreating /scratch/u2_1.vdev
1612024-06-06T21:16:48.962Zcreating /scratch/u2_2.vdev
1622024-06-06T21:16:48.962Zcreating /scratch/u2_3.vdev
1632024-06-06T21:16:48.962Zcreating /scratch/u2_4.vdev
1642024-06-06T21:16:48.962Zcreating /scratch/u2_5.vdev
1652024-06-06T21:16:48.962Zcreating /scratch/u2_6.vdev
1662024-06-06T21:16:48.962Zcreating /scratch/u2_7.vdev
1672024-06-06T21:16:48.962Zcreating /scratch/u2_8.vdev
1682024-06-06T21:16:48.993ZSimnet net0/sc0_0 exists
1692024-06-06T21:16:49.022ZSimnet net1/sc1_0 exists
1702024-06-06T21:16:49.047ZVnic sc0_1 exists
1712024-06-06T21:17:04.738ZUsing 10.151.2.100 as gateway ip
1722024-06-06T21:17:04.738Zusing 18:C0:4D:0D:A0:2A as gateway mac
1732024-06-06T21:17:04.738Zconfiguring SoftNPU ARP entry
1742024-06-06T21:17:04.767Zconfiguring SoftNPU proxy ARP
1752024-06-06T21:17:04.825ZSoftNPU state:
1762024-06-06T21:17:04.825Z local v6:
1772024-06-06T21:17:04.825Z local v4:
1782024-06-06T21:17:04.825Z router v6:
1792024-06-06T21:17:04.825Z router v4_idx:
1802024-06-06T21:17:04.826Z router v4_routes:
1812024-06-06T21:17:04.826Z resolver v4:
1822024-06-06T21:17:04.826Z 10.151.2.100 -> 18:c0:4d:0d:a0:2a
1832024-06-06T21:17:04.826Z resolver v6:
1842024-06-06T21:17:04.826Z nat v4:
1852024-06-06T21:17:04.826Z nat_v6:
1862024-06-06T21:17:04.826Z port_mac:
1872024-06-06T21:17:04.826Z proxy arp:
1882024-06-06T21:17:04.826Z 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
1892024-06-06T21:17:04.826Zcreated virtual hardware
1902024-06-06T21:17:04.853Z
1912024-06-06T21:17:04.853Zreal 15.972448614
1922024-06-06T21:17:04.853Zuser 0.654417870
1932024-06-06T21:17:04.853Zsys 3.418685416
1942024-06-06T21:17:04.853Ztrap 0.000062818
1952024-06-06T21:17:04.853Ztflt 0.000197605
1962024-06-06T21:17:04.853Zdflt 0.002213692
1972024-06-06T21:17:04.853Zkflt 0.000000000
1982024-06-06T21:17:04.853Zlock 24:50.504704365
1992024-06-06T21:17:04.853Zslp 1:04.066766799
2002024-06-06T21:17:04.853Zlat 0.080033420
2012024-06-06T21:17:04.853Zstop 1.095605288
2022024-06-06T21:17:04.854Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2032024-06-06T21:17:04.902Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2042024-06-06T21:17:04.903Z+ diff -u pkg/config.toml~ pkg/config.toml
2052024-06-06T21:17:04.903Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2062024-06-06T21:17:04.903Z+++ pkg/config.toml Thu Jun 6 21:17:04 2024
2072024-06-06T21:17:04.903Z@@ -29,18 +29,18 @@
2082024-06-06T21:17:04.903Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2092024-06-06T21:17:04.903Z # followed by a string that is embedded into their fake serial values.
2102024-06-06T21:17:04.904Z vdevs = [
2112024-06-06T21:17:04.904Z- "m2_0.vdev",
2122024-06-06T21:17:04.904Z- "m2_1.vdev",
2132024-06-06T21:17:04.904Z+ "/scratch/m2_0.vdev",
2142024-06-06T21:17:04.904Z+ "/scratch/m2_1.vdev",
2152024-06-06T21:17:04.905Z
2162024-06-06T21:17:04.905Z- "u2_0.vdev",
2172024-06-06T21:17:04.905Z- "u2_1.vdev",
2182024-06-06T21:17:04.905Z- "u2_2.vdev",
2192024-06-06T21:17:04.905Z- "u2_3.vdev",
2202024-06-06T21:17:04.905Z- "u2_4.vdev",
2212024-06-06T21:17:04.905Z- "u2_5.vdev",
2222024-06-06T21:17:04.906Z- "u2_6.vdev",
2232024-06-06T21:17:04.906Z- "u2_7.vdev",
2242024-06-06T21:17:04.906Z- "u2_8.vdev",
2252024-06-06T21:17:04.906Z+ "/scratch/u2_0.vdev",
2262024-06-06T21:17:04.906Z+ "/scratch/u2_1.vdev",
2272024-06-06T21:17:04.906Z+ "/scratch/u2_2.vdev",
2282024-06-06T21:17:04.906Z+ "/scratch/u2_3.vdev",
2292024-06-06T21:17:04.906Z+ "/scratch/u2_4.vdev",
2302024-06-06T21:17:04.906Z+ "/scratch/u2_5.vdev",
2312024-06-06T21:17:04.907Z+ "/scratch/u2_6.vdev",
2322024-06-06T21:17:04.907Z+ "/scratch/u2_7.vdev",
2332024-06-06T21:17:04.907Z+ "/scratch/u2_8.vdev",
2342024-06-06T21:17:04.907Z ]
2352024-06-06T21:17:04.907Z
2362024-06-06T21:17:04.907Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2372024-06-06T21:17:04.907Z+ true
2382024-06-06T21:17:04.907Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2392024-06-06T21:17:04.908Z+ SILO_NAME=recovery
2402024-06-06T21:17:04.908Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2412024-06-06T21:17:04.908Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2422024-06-06T21:17:04.908Z+ sed -i~ '
2432024-06-06T21:17:04.908Z /^external_dns_ips/c\
2442024-06-06T21:17:04.908Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2452024-06-06T21:17:04.908Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2462024-06-06T21:17:04.908Z /^first/c\
2472024-06-06T21:17:04.908Zfirst = "10.151.2.164"
2482024-06-06T21:17:04.908Z /^last/c\
2492024-06-06T21:17:04.909Zlast = "10.151.2.173"
2502024-06-06T21:17:04.909Z }
2512024-06-06T21:17:04.909Z /^infra_ip_first/c\
2522024-06-06T21:17:04.909Zinfra_ip_first = "10.151.2.174"
2532024-06-06T21:17:04.909Z /^infra_ip_last/c\
2542024-06-06T21:17:04.909Zinfra_ip_last = "10.151.2.174"
2552024-06-06T21:17:04.909Z /^\[\[rack_network_config.ports/,/^$/ {
2562024-06-06T21:17:04.909Z /^routes/c\
2572024-06-06T21:17:04.910Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
2582024-06-06T21:17:04.910Z /^addresses/c\
2592024-06-06T21:17:04.910Zaddresses = \["10.151.2.174/24"\]
2602024-06-06T21:17:04.910Z }
2612024-06-06T21:17:04.910Z' pkg/config-rss.toml
2622024-06-06T21:17:04.910Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2632024-06-06T21:17:04.910Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2642024-06-06T21:17:04.910Z+++ pkg/config-rss.toml Thu Jun 6 21:17:04 2024
2652024-06-06T21:17:04.910Z@@ -33,7 +33,7 @@
2662024-06-06T21:17:04.910Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2672024-06-06T21:17:04.910Z # must be contained in one of the "internal services" IP Pool ranges listed
2682024-06-06T21:17:04.910Z # below.
2692024-06-06T21:17:04.910Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2702024-06-06T21:17:04.910Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2712024-06-06T21:17:04.910Z
2722024-06-06T21:17:04.910Z # Initial TLS certificates for the external API
2732024-06-06T21:17:04.910Z #
2742024-06-06T21:17:04.911Z@@ -69,8 +69,8 @@
2752024-06-06T21:17:04.911Z #
2762024-06-06T21:17:04.911Z # For more on this and what to put here, see docs/how-to-run.adoc.
2772024-06-06T21:17:04.911Z [[internal_services_ip_pool_ranges]]
2782024-06-06T21:17:04.911Z-first = "192.168.1.20"
2792024-06-06T21:17:04.911Z-last = "192.168.1.29"
2802024-06-06T21:17:04.911Z+first = "10.151.2.164"
2812024-06-06T21:17:04.911Z+last = "10.151.2.173"
2822024-06-06T21:17:04.911Z
2832024-06-06T21:17:04.911Z # TODO - this configuration is subject to change going forward. Ultimately these
2842024-06-06T21:17:04.911Z # parameters should be provided to the control plane via wicket, but we need to
2852024-06-06T21:17:04.911Z@@ -91,8 +91,8 @@
2862024-06-06T21:17:04.911Z # A range of IP addresses used by Boundary Services on the external network. In
2872024-06-06T21:17:04.911Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2882024-06-06T21:17:04.911Z # With softnpu, only one address is used.
2892024-06-06T21:17:04.911Z-infra_ip_first = "192.168.1.30"
2902024-06-06T21:17:04.911Z-infra_ip_last = "192.168.1.30"
2912024-06-06T21:17:04.911Z+infra_ip_first = "10.151.2.174"
2922024-06-06T21:17:04.911Z+infra_ip_last = "10.151.2.174"
2932024-06-06T21:17:04.911Z
2942024-06-06T21:17:04.911Z # Configurations for BGP routers to run on the scrimlets.
2952024-06-06T21:17:04.911Z bgp = []
2962024-06-06T21:17:04.912Z@@ -100,9 +100,9 @@
2972024-06-06T21:17:04.912Z # You can configure multiple uplinks by repeating the following stanza
2982024-06-06T21:17:04.912Z [[rack_network_config.ports]]
2992024-06-06T21:17:04.912Z # Routes associated with this port.
3002024-06-06T21:17:04.912Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3012024-06-06T21:17:04.912Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
3022024-06-06T21:17:04.912Z # Addresses associated with this port.
3032024-06-06T21:17:04.943Z-addresses = ["192.168.1.30/24"]
3042024-06-06T21:17:04.943Z+addresses = ["10.151.2.174/24"]
3052024-06-06T21:17:04.943Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3062024-06-06T21:17:04.943Z port = "qsfp0"
3072024-06-06T21:17:04.943Z # The speed of this port.
3082024-06-06T21:17:04.943Z+ true
3092024-06-06T21:17:04.943Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3102024-06-06T21:17:04.944Za pkg/config-rss.toml 7K
3112024-06-06T21:17:04.944Za pkg/config.toml 4K
3122024-06-06T21:17:04.944Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3132024-06-06T21:17:04.944Z+ TLS_NAME=recovery.sys.oxide.test
3142024-06-06T21:17:04.944Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3152024-06-06T21:17:05.336Z.+....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.......+...........+....+......+.................+......+.......+.....+.......+..+......+.......+..+.+...+..+...+....+...+.....+..................+....+...+..+...+.........+...+.+...................................+.+.....+.........+.........................+.....+..........+...............+......+.....+....+.........+..+.........+.+......+.....+...+..........+...............+......+...........+.............+...........+...+..........+..................+...+.....................+..............+.......+..+.+......+........+............+.+..+.......+...+.....................+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3162024-06-06T21:17:05.706Z.......+......+.....+.+.....+....+......+.....+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+....+...+.........+.....+....+..+...............+....+.....+...+.+.....+.+.....+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+........................+..+...+.+...............+......+......+.....+..................+............+....+........+......+....+........+...+.+........+...............+......+.+...+........+....+......+.....+...+......+..........+.....................+..+.+.........+............+...............+.....+......+....+...+...+...............+...+..............+..........+...+...+.....+......+.+...............+..+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-06-06T21:17:05.732Z-----
3182024-06-06T21:17:05.732Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3192024-06-06T21:17:05.757Za pkg/initial-tls-cert.pem 2K
3202024-06-06T21:17:05.758Za pkg/initial-tls-key.pem 4K
3212024-06-06T21:17:05.758Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3222024-06-06T21:17:05.758Z+ rmdir pkg
3232024-06-06T21:17:05.758Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3242024-06-06T21:17:05.758Z+ pfexec mkdir -p /usr/oxide
3252024-06-06T21:17:05.758Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3262024-06-06T21:17:06.365Z+ pfexec chmod +x /usr/oxide/oxide
3272024-06-06T21:17:06.391Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3282024-06-06T21:17:24.748Z+ OMICRON_NO_UNINSTALL=1
3292024-06-06T21:17:24.748Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3302024-06-06T21:17:24.774ZLogging to: /opt/oxide/work/out/LOG
3312024-06-06T21:17:25.297Z
3322024-06-06T21:17:25.322Zreal 0.546389802
3332024-06-06T21:17:25.322Zuser 0.115770948
3342024-06-06T21:17:25.322Zsys 2.390524603
3352024-06-06T21:17:25.322Ztrap 0.000004668
3362024-06-06T21:17:25.322Ztflt 0.000022999
3372024-06-06T21:17:25.323Zdflt 0.000951896
3382024-06-06T21:17:25.323Zkflt 0.000003440
3392024-06-06T21:17:25.323Zlock 49.505821561
3402024-06-06T21:17:25.323Zslp 0.755812997
3412024-06-06T21:17:25.323Zlat 0.003168790
3422024-06-06T21:17:25.323Zstop 0.212085339
3432024-06-06T21:17:25.323Z+ retry=0
3442024-06-06T21:17:25.323Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3452024-06-06T21:17:25.323Z+ [[ 0 -gt 30 ]]
3462024-06-06T21:17:25.323Z+ sleep 1
3472024-06-06T21:17:26.311Z+ retry=1
3482024-06-06T21:17:26.311Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3492024-06-06T21:17:26.353Z+ [[ 1 -gt 30 ]]
3502024-06-06T21:17:26.353Z+ sleep 1
3512024-06-06T21:17:27.325Z+ retry=2
3522024-06-06T21:17:27.326Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3532024-06-06T21:17:27.351Z+ [[ 2 -gt 30 ]]
3542024-06-06T21:17:27.351Z+ sleep 1
3552024-06-06T21:17:28.341Z+ retry=3
3562024-06-06T21:17:28.341Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3572024-06-06T21:17:54.055Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3582024-06-06T21:17:54.082Zlocal v6:
3592024-06-06T21:17:54.082Zfd51:e074:15c4:2438::1
3602024-06-06T21:17:54.082Zfe80::fc5a:79ff:fecb:75be
3612024-06-06T21:17:54.082Zlocal v4:
3622024-06-06T21:17:54.082Z10.151.2.174
3632024-06-06T21:17:54.082Zrouter v6:
3642024-06-06T21:17:54.082Zfd00:1122:3344:1::/64 -> fe80::c826:c7ff:fec6:5b4 (1)
3652024-06-06T21:17:54.082Zfd00:1122:3344:3::/64 -> fe80::c826:c7ff:fec6:5b4 (1)
3662024-06-06T21:17:54.082Zfd00:1122:3344:2::/64 -> fe80::c826:c7ff:fec6:5b4 (1)
3672024-06-06T21:17:54.082Zfd00:1122:3344:101::/64 -> fe80::c826:c7ff:fec6:5b4 (1)
3682024-06-06T21:17:54.082Zfdb0:18c0:4d0d:a02a::/64 -> fe80::c826:c7ff:fec6:5b4 (1)
3692024-06-06T21:17:54.083Zrouter v4_idx:
3702024-06-06T21:17:54.083Z0.0.0.0/0 -> 0
3712024-06-06T21:17:54.083Zrouter v4_routes:
3722024-06-06T21:17:54.083Z0 -> 10.151.2.100 (2)
3732024-06-06T21:17:54.083Zresolver v4:
3742024-06-06T21:17:54.083Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
3752024-06-06T21:17:54.083Z10.151.2.174 -> f6:d0:0e:da:93:95
3762024-06-06T21:17:54.083Zresolver v6:
3772024-06-06T21:17:54.083Zfe80::fc5a:79ff:fecb:75be -> fe:5a:79:cb:75:be
3782024-06-06T21:17:54.083Zfe80::c826:c7ff:fec6:5b4 -> ca:26:c7:c6:05:b4
3792024-06-06T21:17:54.083Znat v4:
3802024-06-06T21:17:54.083Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:c8:88
3812024-06-06T21:17:54.083Znat_v6:
3822024-06-06T21:17:54.083Zport_mac:
3832024-06-06T21:17:54.083Z1: a8:40:25:5d:a3:7a
3842024-06-06T21:17:54.083Z1000: a8:40:25:5d:a3:79
3852024-06-06T21:17:54.083Z2: a8:40:25:5d:a3:9a
3862024-06-06T21:17:54.083Zproxy arp:
3872024-06-06T21:17:54.083Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
3882024-06-06T21:17:54.083Z+ retry=0
3892024-06-06T21:17:54.083Z+++ zoneadm list -n
3902024-06-06T21:17:54.083Z+++ grep oxz_ntp
3912024-06-06T21:17:54.083Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
3922024-06-06T21:17:54.084Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
3932024-06-06T21:17:54.084Z++ true
3942024-06-06T21:17:54.084Z+ [[ '' != online ]]
3952024-06-06T21:17:54.084Z+ [[ 0 -gt 60 ]]
3962024-06-06T21:17:54.084Z+ sleep 1
3972024-06-06T21:17:54.574Z+ retry=1
3982024-06-06T21:17:54.613Z+++ zoneadm list -n
3992024-06-06T21:17:54.613Z+++ grep oxz_ntp
4002024-06-06T21:17:54.613Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
4012024-06-06T21:17:54.613Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4022024-06-06T21:17:54.613Z++ true
4032024-06-06T21:17:54.613Z+ [[ '' != online ]]
4042024-06-06T21:17:54.613Z+ [[ 1 -gt 60 ]]
4052024-06-06T21:17:54.613Z+ sleep 1
4062024-06-06T21:17:55.607Z+ retry=2
4072024-06-06T21:17:55.637Z+++ zoneadm list -n
4082024-06-06T21:17:55.637Z+++ grep oxz_ntp
4092024-06-06T21:17:55.637Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
4102024-06-06T21:17:55.638Z+ [[ offline != online ]]
4112024-06-06T21:17:55.638Z+ [[ 2 -gt 60 ]]
4122024-06-06T21:17:55.638Z+ sleep 1
4132024-06-06T21:17:56.633Z+ retry=3
4142024-06-06T21:17:56.657Z+++ zoneadm list -n
4152024-06-06T21:17:56.657Z+++ grep oxz_ntp
4162024-06-06T21:17:56.658Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
4172024-06-06T21:17:56.658Z+ [[ offline != online ]]
4182024-06-06T21:17:56.658Z+ [[ 3 -gt 60 ]]
4192024-06-06T21:17:56.658Z+ sleep 1
4202024-06-06T21:17:57.654Z+ retry=4
4212024-06-06T21:17:57.683Z+++ zoneadm list -n
4222024-06-06T21:17:57.683Z+++ grep oxz_ntp
4232024-06-06T21:17:57.683Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
4242024-06-06T21:17:57.683Z+ [[ offline != online ]]
4252024-06-06T21:17:57.683Z+ [[ 4 -gt 60 ]]
4262024-06-06T21:17:57.683Z+ sleep 1
4272024-06-06T21:17:58.678Z+ retry=5
4282024-06-06T21:17:58.702Z+++ zoneadm list -n
4292024-06-06T21:17:58.702Z+++ grep oxz_ntp
4302024-06-06T21:17:58.702Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
4312024-06-06T21:17:58.702Z+ [[ offline != online ]]
4322024-06-06T21:17:58.702Z+ [[ 5 -gt 60 ]]
4332024-06-06T21:17:58.702Z+ sleep 1
4342024-06-06T21:17:59.702Z+ retry=6
4352024-06-06T21:17:59.727Z+++ zoneadm list -n
4362024-06-06T21:17:59.727Z+++ grep oxz_ntp
4372024-06-06T21:17:59.728Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
4382024-06-06T21:17:59.728Z+ [[ offline != online ]]
4392024-06-06T21:17:59.728Z+ [[ 6 -gt 60 ]]
4402024-06-06T21:17:59.728Z+ sleep 1
4412024-06-06T21:18:00.723Z+ retry=7
4422024-06-06T21:18:00.747Z+++ zoneadm list -n
4432024-06-06T21:18:00.747Z+++ grep oxz_ntp
4442024-06-06T21:18:00.747Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
4452024-06-06T21:18:00.747Z+ [[ offline != online ]]
4462024-06-06T21:18:00.747Z+ [[ 7 -gt 60 ]]
4472024-06-06T21:18:00.747Z+ sleep 1
4482024-06-06T21:18:01.747Z+ retry=8
4492024-06-06T21:18:01.772Z+++ zoneadm list -n
4502024-06-06T21:18:01.772Z+++ grep oxz_ntp
4512024-06-06T21:18:01.772Z++ pfexec svcs -z oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 -Hostate oxide/ntp
4522024-06-06T21:18:01.772Z+ [[ online != online ]]
4532024-06-06T21:18:01.772Z+ echo 'Waited for chrony: 8s'
4542024-06-06T21:18:01.773Z+ retry=0
4552024-06-06T21:18:01.773ZWaited for chrony: 8s
4562024-06-06T21:18:01.773Z+ zoneadm list
4572024-06-06T21:18:01.773Z+ grep nexus
4582024-06-06T21:18:01.798Z+ [[ 0 -gt 300 ]]
4592024-06-06T21:18:01.798Z+ sleep 1
 
4602024-06-06T21:18:01.824Zsock console login: Jun 6 21:18:01 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
4612024-06-06T21:18:02.776Z+ retry=1
4622024-06-06T21:18:02.802Z+ zoneadm list
4632024-06-06T21:18:02.802Z+ grep nexus
4642024-06-06T21:18:02.802Z+ [[ 1 -gt 300 ]]
4652024-06-06T21:18:02.802Z+ sleep 1
4662024-06-06T21:18:03.787Z+ retry=2
4672024-06-06T21:18:03.813Z+ zoneadm list
4682024-06-06T21:18:03.813Z+ grep nexus
4692024-06-06T21:18:03.813Z+ [[ 2 -gt 300 ]]
4702024-06-06T21:18:03.814Z+ sleep 1
4712024-06-06T21:18:04.798Z+ retry=3
4722024-06-06T21:18:04.824Z+ zoneadm list
4732024-06-06T21:18:04.824Z+ grep nexus
4742024-06-06T21:18:04.824Z+ [[ 3 -gt 300 ]]
4752024-06-06T21:18:04.824Z+ sleep 1
4762024-06-06T21:18:05.808Z+ retry=4
4772024-06-06T21:18:05.835Z+ zoneadm list
4782024-06-06T21:18:05.835Z+ grep nexus
4792024-06-06T21:18:05.835Z+ [[ 4 -gt 300 ]]
4802024-06-06T21:18:05.835Z+ sleep 1
4812024-06-06T21:18:06.818Z+ retry=5
4822024-06-06T21:18:06.845Z+ zoneadm list
4832024-06-06T21:18:06.845Z+ grep nexus
4842024-06-06T21:18:06.845Z+ [[ 5 -gt 300 ]]
4852024-06-06T21:18:06.845Z+ sleep 1
4862024-06-06T21:18:07.830Z+ retry=6
4872024-06-06T21:18:07.854Z+ zoneadm list
4882024-06-06T21:18:07.854Z+ grep nexus
4892024-06-06T21:18:07.854Z+ [[ 6 -gt 300 ]]
4902024-06-06T21:18:07.854Z+ sleep 1
4912024-06-06T21:18:08.840Z+ retry=7
4922024-06-06T21:18:08.866Z+ zoneadm list
4932024-06-06T21:18:08.866Z+ grep nexus
4942024-06-06T21:18:08.866Z+ [[ 7 -gt 300 ]]
4952024-06-06T21:18:08.867Z+ sleep 1
4962024-06-06T21:18:09.850Z+ retry=8
4972024-06-06T21:18:09.875Z+ zoneadm list
4982024-06-06T21:18:09.875Z+ grep nexus
4992024-06-06T21:18:09.875Z+ [[ 8 -gt 300 ]]
5002024-06-06T21:18:09.875Z+ sleep 1
5012024-06-06T21:18:10.860Z+ retry=9
5022024-06-06T21:18:10.884Z+ zoneadm list
5032024-06-06T21:18:10.885Z+ grep nexus
5042024-06-06T21:18:10.885Z+ [[ 9 -gt 300 ]]
5052024-06-06T21:18:10.885Z+ sleep 1
5062024-06-06T21:18:11.871Z+ retry=10
5072024-06-06T21:18:11.896Z+ zoneadm list
5082024-06-06T21:18:11.896Z+ grep nexus
5092024-06-06T21:18:11.896Z+ [[ 10 -gt 300 ]]
5102024-06-06T21:18:11.896Z+ sleep 1
5112024-06-06T21:18:12.882Z+ retry=11
5122024-06-06T21:18:12.907Z+ zoneadm list
5132024-06-06T21:18:12.907Z+ grep nexus
5142024-06-06T21:18:12.907Z+ [[ 11 -gt 300 ]]
5152024-06-06T21:18:12.907Z+ sleep 1
5162024-06-06T21:18:13.892Z+ retry=12
5172024-06-06T21:18:13.917Z+ zoneadm list
5182024-06-06T21:18:13.917Z+ grep nexus
5192024-06-06T21:18:13.917Z+ [[ 12 -gt 300 ]]
5202024-06-06T21:18:13.917Z+ sleep 1
5212024-06-06T21:18:14.903Z+ retry=13
5222024-06-06T21:18:14.929Z+ zoneadm list
5232024-06-06T21:18:14.929Z+ grep nexus
5242024-06-06T21:18:14.929Z+ [[ 13 -gt 300 ]]
5252024-06-06T21:18:14.929Z+ sleep 1
5262024-06-06T21:18:15.914Z+ retry=14
5272024-06-06T21:18:15.938Z+ zoneadm list
5282024-06-06T21:18:15.938Z+ grep nexus
5292024-06-06T21:18:15.938Z+ [[ 14 -gt 300 ]]
5302024-06-06T21:18:15.938Z+ sleep 1
5312024-06-06T21:18:16.924Z+ retry=15
5322024-06-06T21:18:16.951Z+ zoneadm list
5332024-06-06T21:18:16.951Z+ grep nexus
5342024-06-06T21:18:16.951Z+ [[ 15 -gt 300 ]]
5352024-06-06T21:18:16.951Z+ sleep 1
5362024-06-06T21:18:17.938Z+ retry=16
5372024-06-06T21:18:17.963Z+ zoneadm list
5382024-06-06T21:18:17.963Z+ grep nexus
5392024-06-06T21:18:17.964Z+ [[ 16 -gt 300 ]]
5402024-06-06T21:18:17.964Z+ sleep 1
5412024-06-06T21:18:18.946Z+ retry=17
5422024-06-06T21:18:18.971Z+ zoneadm list
5432024-06-06T21:18:18.971Z+ grep nexus
5442024-06-06T21:18:18.971Z+ [[ 17 -gt 300 ]]
5452024-06-06T21:18:18.971Z+ sleep 1
5462024-06-06T21:18:19.957Z+ retry=18
5472024-06-06T21:18:19.981Z+ zoneadm list
5482024-06-06T21:18:19.981Z+ grep nexus
5492024-06-06T21:18:19.981Z+ [[ 18 -gt 300 ]]
5502024-06-06T21:18:19.981Z+ sleep 1
5512024-06-06T21:18:20.967Z+ retry=19
5522024-06-06T21:18:20.992Z+ zoneadm list
5532024-06-06T21:18:20.992Z+ grep nexus
5542024-06-06T21:18:20.992Z+ [[ 19 -gt 300 ]]
5552024-06-06T21:18:20.992Z+ sleep 1
5562024-06-06T21:18:21.978Z+ retry=20
5572024-06-06T21:18:22.003Z+ zoneadm list
5582024-06-06T21:18:22.003Z+ grep nexus
5592024-06-06T21:18:22.003Z+ [[ 20 -gt 300 ]]
5602024-06-06T21:18:22.003Z+ sleep 1
5612024-06-06T21:18:22.988Z+ retry=21
5622024-06-06T21:18:23.013Z+ zoneadm list
5632024-06-06T21:18:23.013Z+ grep nexus
5642024-06-06T21:18:23.013Z+ [[ 21 -gt 300 ]]
5652024-06-06T21:18:23.013Z+ sleep 1
5662024-06-06T21:18:23.998Z+ retry=22
5672024-06-06T21:18:24.025Z+ zoneadm list
5682024-06-06T21:18:24.025Z+ grep nexus
5692024-06-06T21:18:24.025Z+ [[ 22 -gt 300 ]]
5702024-06-06T21:18:24.025Z+ sleep 1
5712024-06-06T21:18:25.009Z+ retry=23
5722024-06-06T21:18:25.033Z+ zoneadm list
5732024-06-06T21:18:25.033Z+ grep nexus
5742024-06-06T21:18:25.033Z+ [[ 23 -gt 300 ]]
5752024-06-06T21:18:25.033Z+ sleep 1
5762024-06-06T21:18:26.019Z+ retry=24
5772024-06-06T21:18:26.044Z+ zoneadm list
5782024-06-06T21:18:26.044Z+ grep nexus
5792024-06-06T21:18:26.044Z+ [[ 24 -gt 300 ]]
5802024-06-06T21:18:26.044Z+ sleep 1
5812024-06-06T21:18:27.029Z+ retry=25
5822024-06-06T21:18:27.058Z+ zoneadm list
5832024-06-06T21:18:27.058Z+ grep nexus
5842024-06-06T21:18:27.058Z+ [[ 25 -gt 300 ]]
5852024-06-06T21:18:27.058Z+ sleep 1
5862024-06-06T21:18:28.040Z+ retry=26
5872024-06-06T21:18:28.064Z+ zoneadm list
5882024-06-06T21:18:28.064Z+ grep nexus
5892024-06-06T21:18:28.064Z+ [[ 26 -gt 300 ]]
5902024-06-06T21:18:28.064Z+ sleep 1
5912024-06-06T21:18:29.052Z+ retry=27
5922024-06-06T21:18:29.076Z+ zoneadm list
5932024-06-06T21:18:29.076Z+ grep nexus
5942024-06-06T21:18:29.076Z+ [[ 27 -gt 300 ]]
5952024-06-06T21:18:29.076Z+ sleep 1
5962024-06-06T21:18:30.105Z+ retry=28
5972024-06-06T21:18:30.105Z+ zoneadm list
5982024-06-06T21:18:30.105Z+ grep nexus
5992024-06-06T21:18:30.105Z+ [[ 28 -gt 300 ]]
6002024-06-06T21:18:30.105Z+ sleep 1
6012024-06-06T21:18:31.073Z+ retry=29
6022024-06-06T21:18:31.097Z+ zoneadm list
6032024-06-06T21:18:31.097Z+ grep nexus
6042024-06-06T21:18:31.098Z+ [[ 29 -gt 300 ]]
6052024-06-06T21:18:31.098Z+ sleep 1
6062024-06-06T21:18:32.083Z+ retry=30
6072024-06-06T21:18:32.107Z+ zoneadm list
6082024-06-06T21:18:32.107Z+ grep nexus
6092024-06-06T21:18:32.107Z+ [[ 30 -gt 300 ]]
6102024-06-06T21:18:32.107Z+ sleep 1
6112024-06-06T21:18:33.093Z+ retry=31
6122024-06-06T21:18:33.117Z+ zoneadm list
6132024-06-06T21:18:33.117Z+ grep nexus
6142024-06-06T21:18:33.117Z+ [[ 31 -gt 300 ]]
6152024-06-06T21:18:33.117Z+ sleep 1
6162024-06-06T21:18:34.103Z+ retry=32
6172024-06-06T21:18:34.129Z+ zoneadm list
6182024-06-06T21:18:34.130Z+ grep nexus
6192024-06-06T21:18:34.130Z+ [[ 32 -gt 300 ]]
6202024-06-06T21:18:34.130Z+ sleep 1
6212024-06-06T21:18:35.114Z+ retry=33
6222024-06-06T21:18:35.140Z+ zoneadm list
6232024-06-06T21:18:35.140Z+ grep nexus
6242024-06-06T21:18:35.140Z+ [[ 33 -gt 300 ]]
6252024-06-06T21:18:35.140Z+ sleep 1
6262024-06-06T21:18:36.127Z+ retry=34
6272024-06-06T21:18:36.153Z+ zoneadm list
6282024-06-06T21:18:36.153Z+ grep nexus
6292024-06-06T21:18:36.153Z+ [[ 34 -gt 300 ]]
6302024-06-06T21:18:36.153Z+ sleep 1
6312024-06-06T21:18:37.136Z+ retry=35
6322024-06-06T21:18:37.161Z+ zoneadm list
6332024-06-06T21:18:37.162Z+ grep nexus
6342024-06-06T21:18:37.162Z+ [[ 35 -gt 300 ]]
6352024-06-06T21:18:37.162Z+ sleep 1
6362024-06-06T21:18:38.145Z+ retry=36
6372024-06-06T21:18:38.171Z+ zoneadm list
6382024-06-06T21:18:38.171Z+ grep nexus
6392024-06-06T21:18:38.171Z+ [[ 36 -gt 300 ]]
6402024-06-06T21:18:38.171Z+ sleep 1
6412024-06-06T21:18:39.156Z+ retry=37
6422024-06-06T21:18:39.182Z+ zoneadm list
6432024-06-06T21:18:39.182Z+ grep nexus
6442024-06-06T21:18:39.182Z+ [[ 37 -gt 300 ]]
6452024-06-06T21:18:39.182Z+ sleep 1
6462024-06-06T21:18:40.167Z+ retry=38
6472024-06-06T21:18:40.192Z+ zoneadm list
6482024-06-06T21:18:40.193Z+ grep nexus
6492024-06-06T21:18:40.193Z+ [[ 38 -gt 300 ]]
6502024-06-06T21:18:40.193Z+ sleep 1
6512024-06-06T21:18:41.178Z+ retry=39
6522024-06-06T21:18:41.205Z+ zoneadm list
6532024-06-06T21:18:41.205Z+ grep nexus
6542024-06-06T21:18:41.205Z+ [[ 39 -gt 300 ]]
6552024-06-06T21:18:41.205Z+ sleep 1
6562024-06-06T21:18:42.192Z+ retry=40
6572024-06-06T21:18:42.226Z+ zoneadm list
6582024-06-06T21:18:42.226Z+ grep nexus
6592024-06-06T21:18:42.226Z+ [[ 40 -gt 300 ]]
6602024-06-06T21:18:42.227Z+ sleep 1
6612024-06-06T21:18:43.200Z+ retry=41
6622024-06-06T21:18:43.225Z+ zoneadm list
6632024-06-06T21:18:43.225Z+ grep nexus
6642024-06-06T21:18:43.225Z+ [[ 41 -gt 300 ]]
6652024-06-06T21:18:43.226Z+ sleep 1
6662024-06-06T21:18:44.209Z+ retry=42
6672024-06-06T21:18:44.234Z+ zoneadm list
6682024-06-06T21:18:44.235Z+ grep nexus
6692024-06-06T21:18:44.235Z+ [[ 42 -gt 300 ]]
6702024-06-06T21:18:44.235Z+ sleep 1
6712024-06-06T21:18:45.219Z+ retry=43
6722024-06-06T21:18:45.245Z+ zoneadm list
6732024-06-06T21:18:45.245Z+ grep nexus
6742024-06-06T21:18:45.245Z+ [[ 43 -gt 300 ]]
6752024-06-06T21:18:45.245Z+ sleep 1
6762024-06-06T21:18:46.231Z+ retry=44
6772024-06-06T21:18:46.257Z+ zoneadm list
6782024-06-06T21:18:46.257Z+ grep nexus
6792024-06-06T21:18:46.258Z+ [[ 44 -gt 300 ]]
6802024-06-06T21:18:46.258Z+ sleep 1
6812024-06-06T21:18:47.307Z+ retry=45
6822024-06-06T21:18:47.332Z+ zoneadm list
6832024-06-06T21:18:47.332Z+ grep nexus
6842024-06-06T21:18:47.333Z+ [[ 45 -gt 300 ]]
6852024-06-06T21:18:47.333Z+ sleep 1
6862024-06-06T21:18:48.252Z+ retry=46
6872024-06-06T21:18:48.278Z+ zoneadm list
6882024-06-06T21:18:48.278Z+ grep nexus
6892024-06-06T21:18:48.278Z+ [[ 46 -gt 300 ]]
6902024-06-06T21:18:48.278Z+ sleep 1
6912024-06-06T21:18:49.265Z+ retry=47
6922024-06-06T21:18:49.290Z+ zoneadm list
6932024-06-06T21:18:49.290Z+ grep nexus
6942024-06-06T21:18:49.290Z+ [[ 47 -gt 300 ]]
6952024-06-06T21:18:49.290Z+ sleep 1
6962024-06-06T21:18:50.273Z+ retry=48
6972024-06-06T21:18:50.297Z+ zoneadm list
6982024-06-06T21:18:50.297Z+ grep nexus
6992024-06-06T21:18:50.297Z+ [[ 48 -gt 300 ]]
7002024-06-06T21:18:50.297Z+ sleep 1
7012024-06-06T21:18:51.294Z+ retry=49
7022024-06-06T21:18:51.319Z+ zoneadm list
7032024-06-06T21:18:51.319Z+ grep nexus
7042024-06-06T21:18:51.319Z+ [[ 49 -gt 300 ]]
7052024-06-06T21:18:51.319Z+ sleep 1
7062024-06-06T21:18:52.297Z+ retry=50
7072024-06-06T21:18:52.333Z+ zoneadm list
7082024-06-06T21:18:52.333Z+ grep nexus
7092024-06-06T21:18:52.333Z+ [[ 50 -gt 300 ]]
7102024-06-06T21:18:52.334Z+ sleep 1
7112024-06-06T21:18:53.304Z+ retry=51
7122024-06-06T21:18:53.332Z+ zoneadm list
7132024-06-06T21:18:53.333Z+ grep nexus
7142024-06-06T21:18:53.333Z+ [[ 51 -gt 300 ]]
7152024-06-06T21:18:53.333Z+ sleep 1
7162024-06-06T21:18:54.314Z+ retry=52
7172024-06-06T21:18:54.345Z+ zoneadm list
7182024-06-06T21:18:54.345Z+ grep nexus
7192024-06-06T21:18:54.345Z+ [[ 52 -gt 300 ]]
7202024-06-06T21:18:54.345Z+ sleep 1
7212024-06-06T21:18:55.324Z+ retry=53
7222024-06-06T21:18:55.348Z+ zoneadm list
7232024-06-06T21:18:55.349Z+ grep nexus
7242024-06-06T21:18:55.349Z+ [[ 53 -gt 300 ]]
7252024-06-06T21:18:55.349Z+ sleep 1
7262024-06-06T21:18:56.334Z+ retry=54
7272024-06-06T21:18:56.359Z+ zoneadm list
7282024-06-06T21:18:56.359Z+ grep nexus
7292024-06-06T21:18:56.359Z+ [[ 54 -gt 300 ]]
7302024-06-06T21:18:56.359Z+ sleep 1
7312024-06-06T21:18:57.345Z+ retry=55
7322024-06-06T21:18:57.370Z+ zoneadm list
7332024-06-06T21:18:57.370Z+ grep nexus
7342024-06-06T21:18:57.370Z+ [[ 55 -gt 300 ]]
7352024-06-06T21:18:57.370Z+ sleep 1
7362024-06-06T21:18:58.356Z+ retry=56
7372024-06-06T21:18:58.382Z+ zoneadm list
7382024-06-06T21:18:58.382Z+ grep nexus
7392024-06-06T21:18:58.382Z+ [[ 56 -gt 300 ]]
7402024-06-06T21:18:58.382Z+ sleep 1
7412024-06-06T21:18:59.382Z+ retry=57
7422024-06-06T21:18:59.421Z+ zoneadm list
7432024-06-06T21:18:59.421Z+ grep nexus
7442024-06-06T21:18:59.421Z+ [[ 57 -gt 300 ]]
7452024-06-06T21:18:59.421Z+ sleep 1
7462024-06-06T21:19:00.376Z+ retry=58
7472024-06-06T21:19:00.403Z+ zoneadm list
7482024-06-06T21:19:00.403Z+ grep nexus
7492024-06-06T21:19:00.403Z+ [[ 58 -gt 300 ]]
7502024-06-06T21:19:00.403Z+ sleep 1
7512024-06-06T21:19:01.390Z+ retry=59
7522024-06-06T21:19:01.415Z+ zoneadm list
7532024-06-06T21:19:01.416Z+ grep nexus
7542024-06-06T21:19:01.416Z+ [[ 59 -gt 300 ]]
7552024-06-06T21:19:01.416Z+ sleep 1
7562024-06-06T21:19:02.402Z+ retry=60
7572024-06-06T21:19:02.428Z+ zoneadm list
7582024-06-06T21:19:02.428Z+ grep nexus
7592024-06-06T21:19:02.428Z+ [[ 60 -gt 300 ]]
7602024-06-06T21:19:02.429Z+ sleep 1
7612024-06-06T21:19:03.409Z+ retry=61
7622024-06-06T21:19:03.436Z+ zoneadm list
7632024-06-06T21:19:03.436Z+ grep nexus
7642024-06-06T21:19:03.437Z+ [[ 61 -gt 300 ]]
7652024-06-06T21:19:03.437Z+ sleep 1
7662024-06-06T21:19:04.419Z+ retry=62
7672024-06-06T21:19:04.445Z+ zoneadm list
7682024-06-06T21:19:04.445Z+ grep nexus
7692024-06-06T21:19:04.446Z+ [[ 62 -gt 300 ]]
7702024-06-06T21:19:04.446Z+ sleep 1
7712024-06-06T21:19:05.428Z+ retry=63
7722024-06-06T21:19:05.456Z+ zoneadm list
7732024-06-06T21:19:05.456Z+ grep nexus
7742024-06-06T21:19:05.456Z+ [[ 63 -gt 300 ]]
7752024-06-06T21:19:05.456Z+ sleep 1
7762024-06-06T21:19:06.439Z+ retry=64
7772024-06-06T21:19:06.463Z+ zoneadm list
7782024-06-06T21:19:06.463Z+ grep nexus
7792024-06-06T21:19:06.463Z+ [[ 64 -gt 300 ]]
7802024-06-06T21:19:06.463Z+ sleep 1
7812024-06-06T21:19:07.449Z+ retry=65
7822024-06-06T21:19:07.474Z+ zoneadm list
7832024-06-06T21:19:07.474Z+ grep nexus
7842024-06-06T21:19:07.474Z+ [[ 65 -gt 300 ]]
7852024-06-06T21:19:07.474Z+ sleep 1
7862024-06-06T21:19:08.461Z+ retry=66
7872024-06-06T21:19:08.486Z+ zoneadm list
7882024-06-06T21:19:08.487Z+ grep nexus
7892024-06-06T21:19:08.487Z+ [[ 66 -gt 300 ]]
7902024-06-06T21:19:08.487Z+ sleep 1
7912024-06-06T21:19:09.471Z+ retry=67
7922024-06-06T21:19:09.497Z+ zoneadm list
7932024-06-06T21:19:09.497Z+ grep nexus
7942024-06-06T21:19:09.497Z+ [[ 67 -gt 300 ]]
7952024-06-06T21:19:09.498Z+ sleep 1
7962024-06-06T21:19:10.481Z+ retry=68
7972024-06-06T21:19:10.508Z+ zoneadm list
7982024-06-06T21:19:10.508Z+ grep nexus
7992024-06-06T21:19:10.508Z+ [[ 68 -gt 300 ]]
8002024-06-06T21:19:10.508Z+ sleep 1
8012024-06-06T21:19:11.491Z+ retry=69
8022024-06-06T21:19:11.518Z+ zoneadm list
8032024-06-06T21:19:11.518Z+ grep nexus
8042024-06-06T21:19:11.518Z+ [[ 69 -gt 300 ]]
8052024-06-06T21:19:11.518Z+ sleep 1
8062024-06-06T21:19:12.502Z+ retry=70
8072024-06-06T21:19:12.531Z+ zoneadm list
8082024-06-06T21:19:12.531Z+ grep nexus
8092024-06-06T21:19:12.531Z+ [[ 70 -gt 300 ]]
8102024-06-06T21:19:12.532Z+ sleep 1
8112024-06-06T21:19:13.519Z+ retry=71
8122024-06-06T21:19:13.549Z+ zoneadm list
8132024-06-06T21:19:13.549Z+ grep nexus
8142024-06-06T21:19:13.549Z+ [[ 71 -gt 300 ]]
8152024-06-06T21:19:13.549Z+ sleep 1
8162024-06-06T21:19:14.529Z+ retry=72
8172024-06-06T21:19:14.556Z+ zoneadm list
8182024-06-06T21:19:14.556Z+ grep nexus
8192024-06-06T21:19:14.556Z+ [[ 72 -gt 300 ]]
8202024-06-06T21:19:14.556Z+ sleep 1
8212024-06-06T21:19:15.533Z+ retry=73
8222024-06-06T21:19:15.559Z+ zoneadm list
8232024-06-06T21:19:15.559Z+ grep nexus
8242024-06-06T21:19:15.559Z+ [[ 73 -gt 300 ]]
8252024-06-06T21:19:15.559Z+ sleep 1
8262024-06-06T21:19:16.545Z+ retry=74
8272024-06-06T21:19:16.578Z+ zoneadm list
8282024-06-06T21:19:16.578Z+ grep nexus
8292024-06-06T21:19:16.579Z+ [[ 74 -gt 300 ]]
8302024-06-06T21:19:16.579Z+ sleep 1
8312024-06-06T21:19:17.554Z+ retry=75
8322024-06-06T21:19:17.580Z+ zoneadm list
8332024-06-06T21:19:17.580Z+ grep nexus
8342024-06-06T21:19:17.580Z+ [[ 75 -gt 300 ]]
8352024-06-06T21:19:17.580Z+ sleep 1
8362024-06-06T21:19:18.564Z+ retry=76
8372024-06-06T21:19:18.588Z+ zoneadm list
8382024-06-06T21:19:18.588Z+ grep nexus
8392024-06-06T21:19:18.589Z+ [[ 76 -gt 300 ]]
8402024-06-06T21:19:18.589Z+ sleep 1
8412024-06-06T21:19:19.575Z+ retry=77
8422024-06-06T21:19:19.599Z+ zoneadm list
8432024-06-06T21:19:19.599Z+ grep nexus
8442024-06-06T21:19:19.599Z+ [[ 77 -gt 300 ]]
8452024-06-06T21:19:19.599Z+ sleep 1
8462024-06-06T21:19:20.596Z+ retry=78
8472024-06-06T21:19:20.634Z+ zoneadm list
8482024-06-06T21:19:20.634Z+ grep nexus
8492024-06-06T21:19:20.634Z+ [[ 78 -gt 300 ]]
8502024-06-06T21:19:20.634Z+ sleep 1
8512024-06-06T21:19:21.596Z+ retry=79
8522024-06-06T21:19:21.627Z+ zoneadm list
8532024-06-06T21:19:21.628Z+ grep nexus
8542024-06-06T21:19:21.628Z+ [[ 79 -gt 300 ]]
8552024-06-06T21:19:21.628Z+ sleep 1
8562024-06-06T21:19:22.610Z+ retry=80
8572024-06-06T21:19:22.638Z+ zoneadm list
8582024-06-06T21:19:22.638Z+ grep nexus
8592024-06-06T21:19:22.638Z+ [[ 80 -gt 300 ]]
8602024-06-06T21:19:22.638Z+ sleep 1
8612024-06-06T21:19:23.620Z+ retry=81
8622024-06-06T21:19:23.645Z+ zoneadm list
8632024-06-06T21:19:23.645Z+ grep nexus
8642024-06-06T21:19:23.645Z+ [[ 81 -gt 300 ]]
8652024-06-06T21:19:23.645Z+ sleep 1
8662024-06-06T21:19:24.630Z+ retry=82
8672024-06-06T21:19:24.656Z+ zoneadm list
8682024-06-06T21:19:24.656Z+ grep nexus
8692024-06-06T21:19:24.657Z+ [[ 82 -gt 300 ]]
8702024-06-06T21:19:24.657Z+ sleep 1
8712024-06-06T21:19:25.640Z+ retry=83
8722024-06-06T21:19:25.670Z+ zoneadm list
8732024-06-06T21:19:25.670Z+ grep nexus
8742024-06-06T21:19:25.670Z+ [[ 83 -gt 300 ]]
8752024-06-06T21:19:25.670Z+ sleep 1
8762024-06-06T21:19:26.650Z+ retry=84
8772024-06-06T21:19:26.678Z+ zoneadm list
8782024-06-06T21:19:26.678Z+ grep nexus
8792024-06-06T21:19:26.678Z+ [[ 84 -gt 300 ]]
8802024-06-06T21:19:26.678Z+ sleep 1
8812024-06-06T21:19:27.667Z+ retry=85
8822024-06-06T21:19:27.695Z+ zoneadm list
8832024-06-06T21:19:27.695Z+ grep nexus
8842024-06-06T21:19:27.696Z+ [[ 85 -gt 300 ]]
8852024-06-06T21:19:27.696Z+ sleep 1
8862024-06-06T21:19:28.677Z+ retry=86
8872024-06-06T21:19:28.714Z+ zoneadm list
8882024-06-06T21:19:28.715Z+ grep nexus
8892024-06-06T21:19:28.715Z+ [[ 86 -gt 300 ]]
8902024-06-06T21:19:28.715Z+ sleep 1
8912024-06-06T21:19:30.170Z+ retry=87
8922024-06-06T21:19:30.619Z+ zoneadm list
8932024-06-06T21:19:30.619Z+ grep nexus
8942024-06-06T21:19:30.619Z+ [[ 87 -gt 300 ]]
8952024-06-06T21:19:30.620Z+ sleep 1
8962024-06-06T21:19:30.767Z+ retry=88
8972024-06-06T21:19:30.794Z+ zoneadm list
8982024-06-06T21:19:30.794Z+ grep nexus
8992024-06-06T21:19:30.794Z+ [[ 88 -gt 300 ]]
9002024-06-06T21:19:30.794Z+ sleep 1
9012024-06-06T21:19:31.783Z+ retry=89
9022024-06-06T21:19:31.817Z+ zoneadm list
9032024-06-06T21:19:31.817Z+ grep nexus
9042024-06-06T21:19:31.818Z+ [[ 89 -gt 300 ]]
9052024-06-06T21:19:31.818Z+ sleep 1
9062024-06-06T21:19:32.797Z+ retry=90
9072024-06-06T21:19:32.833Z+ zoneadm list
9082024-06-06T21:19:32.834Z+ grep nexus
9092024-06-06T21:19:32.834Z+ [[ 90 -gt 300 ]]
9102024-06-06T21:19:32.834Z+ sleep 1
9112024-06-06T21:19:33.808Z+ retry=91
9122024-06-06T21:19:33.845Z+ zoneadm list
9132024-06-06T21:19:33.845Z+ grep nexus
9142024-06-06T21:19:33.845Z+ [[ 91 -gt 300 ]]
9152024-06-06T21:19:33.846Z+ sleep 1
9162024-06-06T21:19:34.830Z+ retry=92
9172024-06-06T21:19:34.869Z+ zoneadm list
9182024-06-06T21:19:34.869Z+ grep nexus
9192024-06-06T21:19:34.869Z+ [[ 92 -gt 300 ]]
9202024-06-06T21:19:34.869Z+ sleep 1
9212024-06-06T21:19:35.858Z+ retry=93
9222024-06-06T21:19:35.900Z+ zoneadm list
9232024-06-06T21:19:35.900Z+ grep nexus
9242024-06-06T21:19:35.900Z+ [[ 93 -gt 300 ]]
9252024-06-06T21:19:35.901Z+ sleep 1
9262024-06-06T21:19:36.847Z+ retry=94
9272024-06-06T21:19:36.883Z+ zoneadm list
9282024-06-06T21:19:36.884Z+ grep nexus
9292024-06-06T21:19:36.884Z+ [[ 94 -gt 300 ]]
9302024-06-06T21:19:36.884Z+ sleep 1
9312024-06-06T21:19:37.851Z+ retry=95
9322024-06-06T21:19:37.876Z+ zoneadm list
9332024-06-06T21:19:37.876Z+ grep nexus
9342024-06-06T21:19:37.876Z+ [[ 95 -gt 300 ]]
9352024-06-06T21:19:37.876Z+ sleep 1
9362024-06-06T21:19:38.865Z+ retry=96
9372024-06-06T21:19:38.899Z+ zoneadm list
9382024-06-06T21:19:38.899Z+ grep nexus
9392024-06-06T21:19:38.899Z+ [[ 96 -gt 300 ]]
9402024-06-06T21:19:38.900Z+ sleep 1
9412024-06-06T21:19:39.875Z+ retry=97
9422024-06-06T21:19:39.904Z+ zoneadm list
9432024-06-06T21:19:39.905Z+ grep nexus
9442024-06-06T21:19:39.905Z+ [[ 97 -gt 300 ]]
9452024-06-06T21:19:39.905Z+ sleep 1
9462024-06-06T21:19:40.888Z+ retry=98
9472024-06-06T21:19:40.913Z+ zoneadm list
9482024-06-06T21:19:40.913Z+ grep nexus
9492024-06-06T21:19:40.913Z+ [[ 98 -gt 300 ]]
9502024-06-06T21:19:40.913Z+ sleep 1
9512024-06-06T21:19:41.900Z+ retry=99
9522024-06-06T21:19:41.925Z+ zoneadm list
9532024-06-06T21:19:41.925Z+ grep nexus
9542024-06-06T21:19:41.926Z+ [[ 99 -gt 300 ]]
9552024-06-06T21:19:41.926Z+ sleep 1
9562024-06-06T21:19:42.913Z+ retry=100
9572024-06-06T21:19:42.940Z+ zoneadm list
9582024-06-06T21:19:42.940Z+ grep nexus
9592024-06-06T21:19:42.940Z+ [[ 100 -gt 300 ]]
9602024-06-06T21:19:42.940Z+ sleep 1
9612024-06-06T21:19:43.921Z+ retry=101
9622024-06-06T21:19:43.945Z+ zoneadm list
9632024-06-06T21:19:43.945Z+ grep nexus
9642024-06-06T21:19:43.946Z+ [[ 101 -gt 300 ]]
9652024-06-06T21:19:43.946Z+ sleep 1
9662024-06-06T21:19:44.932Z+ retry=102
9672024-06-06T21:19:44.956Z+ zoneadm list
9682024-06-06T21:19:44.956Z+ grep nexus
9692024-06-06T21:19:44.956Z+ [[ 102 -gt 300 ]]
9702024-06-06T21:19:44.956Z+ sleep 1
9712024-06-06T21:19:45.944Z+ retry=103
9722024-06-06T21:19:45.974Z+ zoneadm list
9732024-06-06T21:19:45.974Z+ grep nexus
9742024-06-06T21:19:45.974Z+ [[ 103 -gt 300 ]]
9752024-06-06T21:19:45.974Z+ sleep 1
9762024-06-06T21:19:46.956Z+ retry=104
9772024-06-06T21:19:46.981Z+ zoneadm list
9782024-06-06T21:19:46.981Z+ grep nexus
9792024-06-06T21:19:46.981Z+ [[ 104 -gt 300 ]]
9802024-06-06T21:19:46.981Z+ sleep 1
9812024-06-06T21:19:47.979Z+ retry=105
9822024-06-06T21:19:48.014Z+ zoneadm list
9832024-06-06T21:19:48.014Z+ grep nexus
9842024-06-06T21:19:48.014Z+ [[ 105 -gt 300 ]]
9852024-06-06T21:19:48.015Z+ sleep 1
9862024-06-06T21:19:48.986Z+ retry=106
9872024-06-06T21:19:49.014Z+ zoneadm list
9882024-06-06T21:19:49.014Z+ grep nexus
9892024-06-06T21:19:51.325Z+ [[ 106 -gt 300 ]]
9902024-06-06T21:19:51.326Z+ sleep 1
9912024-06-06T21:19:52.305Z+ retry=107
9922024-06-06T21:19:52.330Z+ zoneadm list
9932024-06-06T21:19:52.330Z+ grep nexus
9942024-06-06T21:19:52.330Z+ [[ 107 -gt 300 ]]
9952024-06-06T21:19:52.330Z+ sleep 1
9962024-06-06T21:19:53.323Z+ retry=108
9972024-06-06T21:19:53.349Z+ zoneadm list
9982024-06-06T21:19:53.349Z+ grep nexus
9992024-06-06T21:19:53.349Z+ [[ 108 -gt 300 ]]
10002024-06-06T21:19:53.349Z+ sleep 1
10012024-06-06T21:19:54.346Z+ retry=109
10022024-06-06T21:19:54.374Z+ zoneadm list
10032024-06-06T21:19:54.374Z+ grep nexus
10042024-06-06T21:19:54.374Z+ [[ 109 -gt 300 ]]
10052024-06-06T21:19:54.375Z+ sleep 1
10062024-06-06T21:19:55.356Z+ retry=110
10072024-06-06T21:19:55.381Z+ zoneadm list
10082024-06-06T21:19:55.381Z+ grep nexus
10092024-06-06T21:19:55.381Z+ [[ 110 -gt 300 ]]
10102024-06-06T21:19:55.381Z+ sleep 1
10112024-06-06T21:19:56.370Z+ retry=111
10122024-06-06T21:19:56.403Z+ zoneadm list
10132024-06-06T21:19:56.403Z+ grep nexus
10142024-06-06T21:19:56.403Z+ [[ 111 -gt 300 ]]
10152024-06-06T21:19:56.404Z+ sleep 1
10162024-06-06T21:19:57.381Z+ retry=112
10172024-06-06T21:19:57.406Z+ zoneadm list
10182024-06-06T21:19:57.406Z+ grep nexus
10192024-06-06T21:19:57.407Z+ [[ 112 -gt 300 ]]
10202024-06-06T21:19:57.407Z+ sleep 1
10212024-06-06T21:19:58.403Z+ retry=113
10222024-06-06T21:19:58.429Z+ zoneadm list
10232024-06-06T21:19:58.429Z+ grep nexus
10242024-06-06T21:19:58.429Z+ [[ 113 -gt 300 ]]
10252024-06-06T21:19:58.429Z+ sleep 1
10262024-06-06T21:19:59.404Z+ retry=114
10272024-06-06T21:19:59.428Z+ zoneadm list
10282024-06-06T21:19:59.428Z+ grep nexus
10292024-06-06T21:19:59.428Z+ [[ 114 -gt 300 ]]
10302024-06-06T21:19:59.428Z+ sleep 1
10312024-06-06T21:20:00.419Z+ retry=115
10322024-06-06T21:20:00.915Z+ zoneadm list
10332024-06-06T21:20:00.915Z+ grep nexus
10342024-06-06T21:20:00.915Z+ [[ 115 -gt 300 ]]
10352024-06-06T21:20:00.915Z+ sleep 1
10362024-06-06T21:20:01.427Z+ retry=116
10372024-06-06T21:20:01.455Z+ zoneadm list
10382024-06-06T21:20:01.455Z+ grep nexus
10392024-06-06T21:20:01.455Z+ [[ 116 -gt 300 ]]
10402024-06-06T21:20:01.456Z+ sleep 1
10412024-06-06T21:20:02.440Z+ retry=117
10422024-06-06T21:20:02.466Z+ zoneadm list
10432024-06-06T21:20:02.466Z+ grep nexus
10442024-06-06T21:20:02.466Z+ [[ 117 -gt 300 ]]
10452024-06-06T21:20:02.466Z+ sleep 1
10462024-06-06T21:20:03.449Z+ retry=118
10472024-06-06T21:20:03.484Z+ zoneadm list
10482024-06-06T21:20:03.484Z+ grep nexus
10492024-06-06T21:20:03.484Z+ [[ 118 -gt 300 ]]
10502024-06-06T21:20:03.484Z+ sleep 1
10512024-06-06T21:20:04.462Z+ retry=119
10522024-06-06T21:20:04.491Z+ zoneadm list
10532024-06-06T21:20:04.491Z+ grep nexus
10542024-06-06T21:20:04.491Z+ [[ 119 -gt 300 ]]
10552024-06-06T21:20:04.492Z+ sleep 1
10562024-06-06T21:20:05.472Z+ retry=120
10572024-06-06T21:20:05.496Z+ zoneadm list
10582024-06-06T21:20:05.496Z+ grep nexus
10592024-06-06T21:20:05.496Z+ [[ 120 -gt 300 ]]
10602024-06-06T21:20:05.496Z+ sleep 1
10612024-06-06T21:20:06.484Z+ retry=121
10622024-06-06T21:20:06.509Z+ zoneadm list
10632024-06-06T21:20:06.509Z+ grep nexus
10642024-06-06T21:20:06.509Z+ [[ 121 -gt 300 ]]
10652024-06-06T21:20:06.509Z+ sleep 1
10662024-06-06T21:20:07.498Z+ retry=122
10672024-06-06T21:20:07.523Z+ zoneadm list
10682024-06-06T21:20:07.523Z+ grep nexus
10692024-06-06T21:20:07.523Z+ [[ 122 -gt 300 ]]
10702024-06-06T21:20:07.523Z+ sleep 1
10712024-06-06T21:20:08.516Z+ retry=123
10722024-06-06T21:20:08.547Z+ zoneadm list
10732024-06-06T21:20:08.548Z+ grep nexus
10742024-06-06T21:20:08.548Z+ [[ 123 -gt 300 ]]
10752024-06-06T21:20:08.548Z+ sleep 1
10762024-06-06T21:20:09.520Z+ retry=124
10772024-06-06T21:20:09.545Z+ zoneadm list
10782024-06-06T21:20:09.545Z+ grep nexus
10792024-06-06T21:20:09.545Z+ [[ 124 -gt 300 ]]
10802024-06-06T21:20:09.545Z+ sleep 1
10812024-06-06T21:20:10.533Z+ retry=125
10822024-06-06T21:20:10.558Z+ zoneadm list
10832024-06-06T21:20:10.559Z+ grep nexus
10842024-06-06T21:20:10.559Z+ [[ 125 -gt 300 ]]
10852024-06-06T21:20:10.559Z+ sleep 1
10862024-06-06T21:20:11.552Z+ retry=126
10872024-06-06T21:20:11.600Z+ zoneadm list
10882024-06-06T21:20:11.687Z+ grep nexus
10892024-06-06T21:20:11.762Z+ [[ 126 -gt 300 ]]
10902024-06-06T21:20:11.762Z+ sleep 1
10912024-06-06T21:20:13.404Z+ retry=127
10922024-06-06T21:20:13.435Z+ zoneadm list
10932024-06-06T21:20:13.473Z+ grep nexus
10942024-06-06T21:20:13.473Z+ [[ 127 -gt 300 ]]
10952024-06-06T21:20:13.474Z+ sleep 1
10962024-06-06T21:20:14.479Z+ retry=128
10972024-06-06T21:20:14.480Z+ zoneadm list
10982024-06-06T21:20:14.511Z+ grep nexus
10992024-06-06T21:20:14.511Z+ [[ 128 -gt 300 ]]
11002024-06-06T21:20:14.511Z+ sleep 1
11012024-06-06T21:20:15.904Z+ retry=129
11022024-06-06T21:20:15.942Z+ zoneadm list
11032024-06-06T21:20:15.943Z+ grep nexus
11042024-06-06T21:20:15.943Z+ [[ 129 -gt 300 ]]
11052024-06-06T21:20:15.943Z+ sleep 1
11062024-06-06T21:20:16.555Z+ retry=130
11072024-06-06T21:20:16.804Z+ zoneadm list
11082024-06-06T21:20:16.870Z+ grep nexus
11092024-06-06T21:20:16.901Z+ [[ 130 -gt 300 ]]
11102024-06-06T21:20:16.901Z+ sleep 1
11112024-06-06T21:20:18.627Z+ retry=131
11122024-06-06T21:20:18.662Z+ zoneadm list
11132024-06-06T21:20:18.663Z+ grep nexus
11142024-06-06T21:20:18.663Z+ [[ 131 -gt 300 ]]
11152024-06-06T21:20:18.663Z+ sleep 1
11162024-06-06T21:20:19.679Z+ retry=132
11172024-06-06T21:20:19.706Z+ zoneadm list
11182024-06-06T21:20:19.706Z+ grep nexus
11192024-06-06T21:20:19.706Z+ [[ 132 -gt 300 ]]
11202024-06-06T21:20:19.706Z+ sleep 1
11212024-06-06T21:20:20.707Z+ retry=133
11222024-06-06T21:20:20.731Z+ zoneadm list
11232024-06-06T21:20:20.731Z+ grep nexus
11242024-06-06T21:20:20.731Z+ [[ 133 -gt 300 ]]
11252024-06-06T21:20:20.731Z+ sleep 1
11262024-06-06T21:20:21.731Z+ retry=134
11272024-06-06T21:20:21.756Z+ zoneadm list
11282024-06-06T21:20:21.756Z+ grep nexus
11292024-06-06T21:20:21.756Z+ [[ 134 -gt 300 ]]
11302024-06-06T21:20:21.756Z+ sleep 1
11312024-06-06T21:20:22.749Z+ retry=135
11322024-06-06T21:20:22.777Z+ zoneadm list
11332024-06-06T21:20:22.777Z+ grep nexus
11342024-06-06T21:20:22.777Zoxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
11352024-06-06T21:20:22.777Zoxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
11362024-06-06T21:20:22.777Zoxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
11372024-06-06T21:20:22.813Z+ echo 'Waited for nexus: 135s'
11382024-06-06T21:20:22.839ZWaited for nexus: 135s
11392024-06-06T21:20:22.839Z+ export RUST_BACKTRACE=1
11402024-06-06T21:20:22.839Z+ RUST_BACKTRACE=1
11412024-06-06T21:20:22.839Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
11422024-06-06T21:20:22.839Z++ ./target/debug/bootstrap
11432024-06-06T21:20:24.804ZUsing external DNS server at 10.151.2.164:53
11442024-06-06T21:20:24.867Z2024-06-06 21:20:24.855346070 UTC: attempting to log into API
11452024-06-06T21:20:39.927Z2024-06-06 21:20:39.910750679 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
11462024-06-06T21:20:40.932Z2024-06-06 21:20:40.917172795 UTC: attempting to log into API
 
11472024-06-06T21:20:46.673ZJun 6 21:20:45 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
11482024-06-06T21:20:46.723ZJun 6 21:20:45 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
11492024-06-06T21:20:47.036ZJun 6 21:20:46 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
11502024-06-06T21:20:47.087ZJun 6 21:20:46 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
11512024-06-06T21:20:48.207ZJun 6 21:20:47 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
 
11522024-06-06T21:20:55.969Z2024-06-06 21:20:55.957477834 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
11532024-06-06T21:20:56.975Z2024-06-06 21:20:56.958568931 UTC: attempting to log into API
11542024-06-06T21:21:12.002Z2024-06-06 21:21:11.991274779 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
11552024-06-06T21:21:13.003Z2024-06-06 21:21:12.992343837 UTC: attempting to log into API
11562024-06-06T21:21:13.756Z2024-06-06 21:21:13.745937273 UTC: login succeeded
11572024-06-06T21:21:13.788Zwaiting for nexus to come up...
11582024-06-06T21:21:13.855Zcreating IP pool... 10.151.2.175 - 10.151.2.227
11592024-06-06T21:21:14.038Zsetting up quotas...
11602024-06-06T21:21:14.074Zensuring datasets are ready...
11612024-06-06T21:21:16.219Zlet's roll.
11622024-06-06T21:21:16.244Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
11632024-06-06T21:21:16.244ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
11642024-06-06T21:21:16.244ZOXIDE_TOKEN=oxide-token-2907a23cb87fb1ecf87228d706ca037bad1456b5'
11652024-06-06T21:21:16.244Z++ OXIDE_HOST=https://recovery.sys.oxide.test
11662024-06-06T21:21:16.244Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
11672024-06-06T21:21:16.244Z++ OXIDE_TOKEN=oxide-token-2907a23cb87fb1ecf87228d706ca037bad1456b5
11682024-06-06T21:21:16.244Z+ export OXIDE_HOST OXIDE_TOKEN
11692024-06-06T21:21:16.244Z+ retry=0
11702024-06-06T21:21:16.244Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11712024-06-06T21:21:16.307Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
11722024-06-06T21:21:16.648Z{"status":"ok"}success
11732024-06-06T21:21:16.648ZProject {
11742024-06-06T21:21:16.648Z description: "some images",
11752024-06-06T21:21:16.648Z id: a967fc12-2e5e-45e7-8652-c90074f9ce31,
11762024-06-06T21:21:16.648Z name: Name(
11772024-06-06T21:21:16.648Z "images",
11782024-06-06T21:21:16.648Z ),
11792024-06-06T21:21:16.648Z time_created: 2024-06-06T21:21:16.366592Z,
11802024-06-06T21:21:16.648Z time_modified: 2024-06-06T21:21:16.366592Z,
11812024-06-06T21:21:16.648Z}
11822024-06-06T21:21:16.672Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
11832024-06-06T21:26:28.612Zdone!
11842024-06-06T21:26:28.712Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
11852024-06-06T21:26:28.810Zsuccess
11862024-06-06T21:26:28.810ZImage {
11872024-06-06T21:26:28.810Z block_size: ByteCount(
11882024-06-06T21:26:28.810Z 512,
11892024-06-06T21:26:28.810Z ),
11902024-06-06T21:26:28.835Z description: "debian 11 original base image",
11912024-06-06T21:26:28.835Z digest: None,
11922024-06-06T21:26:28.835Z id: a73b3331-e4d1-4c78-aa52-58acd42d842a,
11932024-06-06T21:26:28.835Z name: Name(
11942024-06-06T21:26:28.835Z "debian11",
11952024-06-06T21:26:28.835Z ),
11962024-06-06T21:26:28.835Z os: "debian",
11972024-06-06T21:26:28.835Z project_id: None,
11982024-06-06T21:26:28.835Z size: ByteCount(
11992024-06-06T21:26:28.835Z 2147483648,
12002024-06-06T21:26:28.835Z ),
12012024-06-06T21:26:28.835Z time_created: 2024-06-06T21:26:28.559547Z,
12022024-06-06T21:26:28.835Z time_modified: 2024-06-06T21:26:28.795667Z,
12032024-06-06T21:26:28.835Z url: None,
12042024-06-06T21:26:28.835Z version: "11",
12052024-06-06T21:26:28.835Z}
12062024-06-06T21:26:28.835Z+ for test_bin in tests/*
12072024-06-06T21:26:28.835Z+ ./tests/bootstrap-2270a52303570def
12082024-06-06T21:26:28.860Z
12092024-06-06T21:26:28.860Zrunning 0 tests
12102024-06-06T21:26:28.860Z
12112024-06-06T21:26:28.860Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
12122024-06-06T21:26:28.860Z
12132024-06-06T21:26:28.860Z+ for test_bin in tests/*
12142024-06-06T21:26:28.860Z+ ./tests/commtest-f1c1ef60903c5ff6
12152024-06-06T21:26:28.860Z
12162024-06-06T21:26:28.860Zrunning 0 tests
12172024-06-06T21:26:28.860Z
12182024-06-06T21:26:28.860Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
12192024-06-06T21:26:28.860Z
12202024-06-06T21:26:28.860Z+ for test_bin in tests/*
12212024-06-06T21:26:28.861Z+ ./tests/dhcp_server-887c232f20c28b82
12222024-06-06T21:26:28.885Z
12232024-06-06T21:26:28.885Zrunning 0 tests
12242024-06-06T21:26:28.885Z
12252024-06-06T21:26:28.885Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
12262024-06-06T21:26:28.885Z
12272024-06-06T21:26:28.885Z+ for test_bin in tests/*
12282024-06-06T21:26:28.885Z+ ./tests/end_to_end_tests-4abd980bc7707df5
12292024-06-06T21:26:29.104Z
12302024-06-06T21:26:29.104Zrunning 2 tests
12312024-06-06T21:26:29.381Ztest no_spoof::no_spoof_here ... ok
12322024-06-06T21:26:55.272Ztest instance_launch::instance_launch ... ok
12332024-06-06T21:26:55.272Z
12342024-06-06T21:26:55.272Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 26.17s
12352024-06-06T21:26:55.272Z
12362024-06-06T21:26:55.297Z+ _exit_trap
12372024-06-06T21:26:55.297Z+ local status=0
12382024-06-06T21:26:55.297Z+ [[ 0 -eq 0 ]]
12392024-06-06T21:26:55.297Z+ exit 0
12402024-06-06T21:26:55.297Zprocess exited: duration 619078 ms, exit code 0
 
12412024-06-06T21:26:55.423Zfound 106 output files
12422024-06-06T21:26:55.423Zuploading: /var/svc/log/oxide-sled-agent:default.log (903469 bytes)
12432024-06-06T21:26:57.554Zuploaded: /var/svc/log/oxide-sled-agent:default.log
12442024-06-06T21:26:57.554Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (3857309 bytes)
12452024-06-06T21:27:01.659Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 3857309 -> 3899450
12462024-06-06T21:27:02.730Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
12472024-06-06T21:27:02.730Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52285 bytes)
12482024-06-06T21:27:03.995Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
12492024-06-06T21:27:03.995Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (134499 bytes)
12502024-06-06T21:27:04.391Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 134499 -> 139173
12512024-06-06T21:27:05.471Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
12522024-06-06T21:27:05.471Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (208679 bytes)
12532024-06-06T21:27:05.984Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 208679 -> 212970
12542024-06-06T21:27:07.056Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
12552024-06-06T21:27:07.056Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1433270 bytes)
12562024-06-06T21:27:08.885Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1433270 -> 1454099
12572024-06-06T21:27:09.955Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
12582024-06-06T21:27:09.956Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (766673 bytes)
12592024-06-06T21:27:11.386Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 766673 -> 786647
12602024-06-06T21:27:12.457Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
12612024-06-06T21:27:12.457Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1678 bytes)
12622024-06-06T21:27:13.552Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
12632024-06-06T21:27:13.552Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (264323 bytes)
12642024-06-06T21:27:14.133Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 264323 -> 273402
12652024-06-06T21:27:15.205Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
12662024-06-06T21:27:15.205Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (7637 bytes)
12672024-06-06T21:27:16.324Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
12682024-06-06T21:27:16.324Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5393 bytes)
12692024-06-06T21:27:17.432Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
12702024-06-06T21:27:17.433Zuploading: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-crucible-agent:default.log (18848 bytes)
12712024-06-06T21:27:18.594Zuploaded: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-crucible-agent:default.log
12722024-06-06T21:27:18.594Zuploading: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12732024-06-06T21:27:19.689Zuploaded: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-crucible-downstairs:default.log
12742024-06-06T21:27:19.690Zuploading: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-crucible-downstairs:downstairs-52ac5d00-0954-4ff1-ade9-688826ba89e1.log (5697 bytes)
12752024-06-06T21:27:20.807Zuploaded: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-crucible-downstairs:downstairs-52ac5d00-0954-4ff1-ade9-688826ba89e1.log
12762024-06-06T21:27:20.808Zuploading: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-crucible-downstairs:snapshot-52ac5d00-0954-4ff1-ade9-688826ba89e1-27859697-321f-424e-9e1f-d1933ca35976.log (5305 bytes)
12772024-06-06T21:27:21.906Zuploaded: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-crucible-downstairs:snapshot-52ac5d00-0954-4ff1-ade9-688826ba89e1-27859697-321f-424e-9e1f-d1933ca35976.log
12782024-06-06T21:27:21.906Zuploading: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
12792024-06-06T21:27:23.016Zuploaded: /pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone/oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a/root/var/svc/log/oxide-zone-network-setup:default.log
12802024-06-06T21:27:23.016Zuploading: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc/root/var/svc/log/oxide-crucible-agent:default.log (8057 bytes)
12812024-06-06T21:27:24.134Zuploaded: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc/root/var/svc/log/oxide-crucible-agent:default.log
12822024-06-06T21:27:24.134Zuploading: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12832024-06-06T21:27:25.229Zuploaded: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc/root/var/svc/log/oxide-crucible-downstairs:default.log
12842024-06-06T21:27:25.229Zuploading: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc/root/var/svc/log/oxide-crucible-downstairs:downstairs-59a153b1-964e-440e-9a5b-71b72165b694.log (3020 bytes)
12852024-06-06T21:27:26.331Zuploaded: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc/root/var/svc/log/oxide-crucible-downstairs:downstairs-59a153b1-964e-440e-9a5b-71b72165b694.log
12862024-06-06T21:27:26.331Zuploading: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
12872024-06-06T21:27:34.078Zuploaded: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc/root/var/svc/log/oxide-zone-network-setup:default.log
12882024-06-06T21:27:34.078Zuploading: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e/root/var/svc/log/oxide-nexus:default.log (36911383 bytes)
12892024-06-06T21:27:50.002Zupload warning: file "/pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36911383 -> 37023357
12902024-06-06T21:27:51.073Zuploaded: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e/root/var/svc/log/oxide-nexus:default.log
12912024-06-06T21:27:51.073Zuploading: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e/root/var/svc/log/oxide-opte-interface-setup:default.log (1137 bytes)
12922024-06-06T21:27:52.171Zuploaded: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e/root/var/svc/log/oxide-opte-interface-setup:default.log
12932024-06-06T21:27:52.171Zuploading: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e/root/var/svc/log/oxide-zone-network-setup:default.log (1662 bytes)
12942024-06-06T21:27:53.261Zuploaded: /pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone/oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e/root/var/svc/log/oxide-zone-network-setup:default.log
12952024-06-06T21:27:53.261Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4/root/var/svc/log/oxide-cockroach-admin:default.log (1680 bytes)
12962024-06-06T21:27:54.359Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4/root/var/svc/log/oxide-cockroach-admin:default.log
12972024-06-06T21:27:54.359Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
12982024-06-06T21:27:55.463Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4/root/var/svc/log/oxide-cockroachdb:default.log
12992024-06-06T21:27:55.463Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
13002024-06-06T21:27:56.561Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4/root/var/svc/log/oxide-zone-network-setup:default.log
13012024-06-06T21:27:56.561Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-crucible-agent:default.log (23899 bytes)
13022024-06-06T21:27:57.723Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-crucible-agent:default.log
13032024-06-06T21:27:57.724Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13042024-06-06T21:27:58.821Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-crucible-downstairs:default.log
13052024-06-06T21:27:58.821Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-crucible-downstairs:downstairs-bb8e5ef3-9317-43d7-be7b-e125ad2b4dd1.log (3020 bytes)
13062024-06-06T21:27:59.914Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-crucible-downstairs:downstairs-bb8e5ef3-9317-43d7-be7b-e125ad2b4dd1.log
13072024-06-06T21:27:59.914Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-crucible-downstairs:downstairs-c548e732-3d79-4076-ac3f-8c541df681a7.log (5612 bytes)
13082024-06-06T21:28:01.031Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-crucible-downstairs:downstairs-c548e732-3d79-4076-ac3f-8c541df681a7.log
13092024-06-06T21:28:01.031Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
13102024-06-06T21:28:02.129Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697/root/var/svc/log/oxide-zone-network-setup:default.log
13112024-06-06T21:28:02.129Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
13122024-06-06T21:28:03.227Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6/root/var/svc/log/oxide-crucible-pantry:default.log
13132024-06-06T21:28:03.228Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
13142024-06-06T21:28:04.324Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6/root/var/svc/log/oxide-zone-network-setup:default.log
13152024-06-06T21:28:04.325Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83/root/var/svc/log/oxide-external_dns:default.log (26856 bytes)
13162024-06-06T21:28:04.485Zupload warning: file "/pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26856 -> 30633
13172024-06-06T21:28:05.559Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83/root/var/svc/log/oxide-external_dns:default.log
13182024-06-06T21:28:05.559Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83/root/var/svc/log/oxide-opte-interface-setup:default.log (1159 bytes)
13192024-06-06T21:28:06.663Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83/root/var/svc/log/oxide-opte-interface-setup:default.log
13202024-06-06T21:28:06.663Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83/root/var/svc/log/oxide-zone-network-setup:default.log (1705 bytes)
13212024-06-06T21:28:07.761Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83/root/var/svc/log/oxide-zone-network-setup:default.log
13222024-06-06T21:28:07.762Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d/root/var/svc/log/oxide-internal_dns:default.log (107389 bytes)
13232024-06-06T21:28:08.098Zupload warning: file "/pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107389 -> 111147
13242024-06-06T21:28:09.170Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d/root/var/svc/log/oxide-internal_dns:default.log
13252024-06-06T21:28:09.170Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d/root/var/svc/log/oxide-zone-network-setup:default.log (1687 bytes)
13262024-06-06T21:28:10.279Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d/root/var/svc/log/oxide-zone-network-setup:default.log
13272024-06-06T21:28:10.279Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/svc/log/oxide-chrony-setup:default.log (14141 bytes)
13282024-06-06T21:28:11.419Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/svc/log/oxide-chrony-setup:default.log
13292024-06-06T21:28:11.419Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/svc/log/oxide-ntp:default.log (526 bytes)
13302024-06-06T21:28:12.517Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/svc/log/oxide-ntp:default.log
13312024-06-06T21:28:12.517Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/svc/log/oxide-opte-interface-setup:default.log (1129 bytes)
13322024-06-06T21:28:13.614Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/svc/log/oxide-opte-interface-setup:default.log
13332024-06-06T21:28:13.614Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/svc/log/oxide-zone-network-setup:default.log (1644 bytes)
13342024-06-06T21:28:14.711Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/svc/log/oxide-zone-network-setup:default.log
13352024-06-06T21:28:14.711Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2/root/var/svc/log/oxide-cockroach-admin:default.log (1680 bytes)
13362024-06-06T21:28:15.811Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2/root/var/svc/log/oxide-cockroach-admin:default.log
13372024-06-06T21:28:15.811Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2/root/var/svc/log/oxide-cockroachdb:default.log (4313 bytes)
13382024-06-06T21:28:16.908Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2/root/var/svc/log/oxide-cockroachdb:default.log
13392024-06-06T21:28:16.908Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
13402024-06-06T21:28:18.427Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2/root/var/svc/log/oxide-zone-network-setup:default.log
13412024-06-06T21:28:18.428Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-agent:default.log (29215 bytes)
13422024-06-06T21:28:19.611Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-agent:default.log
13432024-06-06T21:28:19.612Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13442024-06-06T21:28:20.715Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-downstairs:default.log
13452024-06-06T21:28:20.715Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-downstairs:downstairs-479991a1-9a6a-444b-a1a9-711bb5ee121b.log (3126 bytes)
13462024-06-06T21:28:21.813Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-downstairs:downstairs-479991a1-9a6a-444b-a1a9-711bb5ee121b.log
13472024-06-06T21:28:21.813Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-downstairs:downstairs-63f5cdd9-dfc9-4874-b4f7-0e5de72cee19.log (3014 bytes)
13482024-06-06T21:28:22.909Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-downstairs:downstairs-63f5cdd9-dfc9-4874-b4f7-0e5de72cee19.log
13492024-06-06T21:28:22.936Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-downstairs:downstairs-d34a7a92-bb9f-4da6-912d-8ca95572d68a.log (5613 bytes)
13502024-06-06T21:28:24.030Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-crucible-downstairs:downstairs-d34a7a92-bb9f-4da6-912d-8ca95572d68a.log
13512024-06-06T21:28:24.031Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
13522024-06-06T21:28:25.127Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9/root/var/svc/log/oxide-zone-network-setup:default.log
13532024-06-06T21:28:25.127Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb/root/var/svc/log/oxide-crucible-pantry:default.log (765703 bytes)
13542024-06-06T21:28:27.185Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb/root/var/svc/log/oxide-crucible-pantry:default.log
13552024-06-06T21:28:27.210Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
13562024-06-06T21:28:28.282Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb/root/var/svc/log/oxide-zone-network-setup:default.log
13572024-06-06T21:28:28.282Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053/root/var/svc/log/oxide-nexus:default.log (2267154 bytes)
13582024-06-06T21:28:31.414Zupload warning: file "/pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2267154 -> 2605604
13592024-06-06T21:28:32.490Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053/root/var/svc/log/oxide-nexus:default.log
13602024-06-06T21:28:32.490Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
13612024-06-06T21:28:33.588Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053/root/var/svc/log/oxide-opte-interface-setup:default.log
13622024-06-06T21:28:33.589Zuploading: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053/root/var/svc/log/oxide-zone-network-setup:default.log (1663 bytes)
13632024-06-06T21:28:34.685Zuploaded: /pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone/oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053/root/var/svc/log/oxide-zone-network-setup:default.log
13642024-06-06T21:28:34.685Zuploading: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538/root/var/svc/log/oxide-cockroach-admin:default.log (1679 bytes)
13652024-06-06T21:28:35.781Zuploaded: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538/root/var/svc/log/oxide-cockroach-admin:default.log
13662024-06-06T21:28:35.781Zuploading: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
13672024-06-06T21:28:36.878Zuploaded: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538/root/var/svc/log/oxide-cockroachdb:default.log
13682024-06-06T21:28:36.904Zuploading: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
13692024-06-06T21:28:37.977Zuploaded: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538/root/var/svc/log/oxide-zone-network-setup:default.log
13702024-06-06T21:28:37.977Zuploading: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-crucible-agent:default.log (18838 bytes)
13712024-06-06T21:28:39.138Zuploaded: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-crucible-agent:default.log
13722024-06-06T21:28:39.138Zuploading: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13732024-06-06T21:28:40.234Zuploaded: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-crucible-downstairs:default.log
13742024-06-06T21:28:40.234Zuploading: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-crucible-downstairs:downstairs-25c8872b-4d18-4236-a56c-508dcee088af.log (5695 bytes)
13752024-06-06T21:28:41.350Zuploaded: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-crucible-downstairs:downstairs-25c8872b-4d18-4236-a56c-508dcee088af.log
13762024-06-06T21:28:41.375Zuploading: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-crucible-downstairs:snapshot-25c8872b-4d18-4236-a56c-508dcee088af-27859697-321f-424e-9e1f-d1933ca35976.log (5304 bytes)
13772024-06-06T21:28:42.447Zuploaded: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-crucible-downstairs:snapshot-25c8872b-4d18-4236-a56c-508dcee088af-27859697-321f-424e-9e1f-d1933ca35976.log
13782024-06-06T21:28:42.447Zuploading: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
13792024-06-06T21:28:43.543Zuploaded: /pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone/oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f/root/var/svc/log/oxide-zone-network-setup:default.log
13802024-06-06T21:28:43.544Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4/root/var/svc/log/oxide-clickhouse:default.log (1819397 bytes)
13812024-06-06T21:28:46.564Zupload warning: file "/pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1819397 -> 2315513
13822024-06-06T21:28:47.644Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4/root/var/svc/log/oxide-clickhouse:default.log
13832024-06-06T21:28:47.644Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4/root/var/svc/log/oxide-zone-network-setup:default.log (1692 bytes)
13842024-06-06T21:28:48.741Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4/root/var/svc/log/oxide-zone-network-setup:default.log
13852024-06-06T21:28:48.742Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948/root/var/svc/log/oxide-cockroach-admin:default.log (1680 bytes)
13862024-06-06T21:28:49.838Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948/root/var/svc/log/oxide-cockroach-admin:default.log
13872024-06-06T21:28:49.863Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948/root/var/svc/log/oxide-cockroachdb:default.log (4288 bytes)
13882024-06-06T21:28:50.934Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948/root/var/svc/log/oxide-cockroachdb:default.log
13892024-06-06T21:28:50.934Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948/root/var/svc/log/oxide-zone-network-setup:default.log (1689 bytes)
13902024-06-06T21:28:52.031Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948/root/var/svc/log/oxide-zone-network-setup:default.log
13912024-06-06T21:28:52.031Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741/root/var/svc/log/oxide-crucible-agent:default.log (12502 bytes)
13922024-06-06T21:28:53.170Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741/root/var/svc/log/oxide-crucible-agent:default.log
13932024-06-06T21:28:53.171Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13942024-06-06T21:28:54.264Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741/root/var/svc/log/oxide-crucible-downstairs:default.log
13952024-06-06T21:28:54.264Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741/root/var/svc/log/oxide-crucible-downstairs:downstairs-7f308517-c399-4898-ab25-4ddfa3e75630.log (3126 bytes)
13962024-06-06T21:28:55.360Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741/root/var/svc/log/oxide-crucible-downstairs:downstairs-7f308517-c399-4898-ab25-4ddfa3e75630.log
13972024-06-06T21:28:55.360Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
13982024-06-06T21:28:56.455Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741/root/var/svc/log/oxide-zone-network-setup:default.log
13992024-06-06T21:28:56.455Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e/root/var/svc/log/oxide-external_dns:default.log (26866 bytes)
14002024-06-06T21:28:56.613Zupload warning: file "/pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26866 -> 34423
14012024-06-06T21:28:57.682Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e/root/var/svc/log/oxide-external_dns:default.log
14022024-06-06T21:28:57.682Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e/root/var/svc/log/oxide-opte-interface-setup:default.log (1159 bytes)
14032024-06-06T21:28:58.775Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e/root/var/svc/log/oxide-opte-interface-setup:default.log
14042024-06-06T21:28:58.775Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e/root/var/svc/log/oxide-zone-network-setup:default.log (1705 bytes)
14052024-06-06T21:28:59.870Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e/root/var/svc/log/oxide-zone-network-setup:default.log
14062024-06-06T21:28:59.870Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461/root/var/svc/log/oxide-internal_dns:default.log (106977 bytes)
14072024-06-06T21:29:00.203Zupload warning: file "/pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 106977 -> 114489
14082024-06-06T21:29:01.274Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461/root/var/svc/log/oxide-internal_dns:default.log
14092024-06-06T21:29:01.274Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461/root/var/svc/log/oxide-zone-network-setup:default.log (1686 bytes)
14102024-06-06T21:29:02.370Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461/root/var/svc/log/oxide-zone-network-setup:default.log
14112024-06-06T21:29:02.370Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b/root/var/svc/log/oxide-oximeter:default.log (1321219 bytes)
14122024-06-06T21:29:04.377Zupload warning: file "/pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1321219 -> 1801891
14132024-06-06T21:29:05.447Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b/root/var/svc/log/oxide-oximeter:default.log
14142024-06-06T21:29:05.447Zuploading: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
14152024-06-06T21:29:06.542Zuploaded: /pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone/oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b/root/var/svc/log/oxide-zone-network-setup:default.log
14162024-06-06T21:29:06.542Zuploading: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
14172024-06-06T21:29:07.636Zuploaded: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3/root/var/svc/log/oxide-crucible-agent:default.log
14182024-06-06T21:29:07.637Zuploading: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14192024-06-06T21:29:08.733Zuploaded: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3/root/var/svc/log/oxide-crucible-downstairs:default.log
14202024-06-06T21:29:08.733Zuploading: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
14212024-06-06T21:29:09.829Zuploaded: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3/root/var/svc/log/oxide-zone-network-setup:default.log
14222024-06-06T21:29:09.829Zuploading: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8/root/var/svc/log/oxide-crucible-pantry:default.log (780 bytes)
14232024-06-06T21:29:10.926Zuploaded: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8/root/var/svc/log/oxide-crucible-pantry:default.log
14242024-06-06T21:29:10.927Zuploading: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8/root/var/svc/log/oxide-zone-network-setup:default.log (1722 bytes)
14252024-06-06T21:29:12.021Zuploaded: /pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone/oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8/root/var/svc/log/oxide-zone-network-setup:default.log
14262024-06-06T21:29:12.021Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb/root/var/svc/log/oxide-cockroach-admin:default.log (1680 bytes)
14272024-06-06T21:29:13.116Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb/root/var/svc/log/oxide-cockroach-admin:default.log
14282024-06-06T21:29:13.141Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
14292024-06-06T21:29:14.212Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb/root/var/svc/log/oxide-cockroachdb:default.log
14302024-06-06T21:29:14.213Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
14312024-06-06T21:29:15.311Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb/root/var/svc/log/oxide-zone-network-setup:default.log
14322024-06-06T21:29:15.311Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-agent:default.log (26448 bytes)
14332024-06-06T21:29:16.494Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-agent:default.log
14342024-06-06T21:29:16.494Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14352024-06-06T21:29:17.588Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-downstairs:default.log
14362024-06-06T21:29:17.588Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-downstairs:downstairs-86f126eb-5895-4b9a-8a53-268b84ad7252.log (3126 bytes)
14372024-06-06T21:29:18.682Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-downstairs:downstairs-86f126eb-5895-4b9a-8a53-268b84ad7252.log
14382024-06-06T21:29:18.707Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-downstairs:downstairs-d2c9a70b-1263-46e5-bd70-450f8d8b0bd9.log (5696 bytes)
14392024-06-06T21:29:19.798Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-downstairs:downstairs-d2c9a70b-1263-46e5-bd70-450f8d8b0bd9.log
14402024-06-06T21:29:19.799Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-downstairs:snapshot-d2c9a70b-1263-46e5-bd70-450f8d8b0bd9-27859697-321f-424e-9e1f-d1933ca35976.log (5298 bytes)
14412024-06-06T21:29:20.894Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-crucible-downstairs:snapshot-d2c9a70b-1263-46e5-bd70-450f8d8b0bd9-27859697-321f-424e-9e1f-d1933ca35976.log
14422024-06-06T21:29:20.894Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
14432024-06-06T21:29:21.989Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c/root/var/svc/log/oxide-zone-network-setup:default.log
14442024-06-06T21:29:21.989Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464/root/var/svc/log/oxide-internal_dns:default.log (106972 bytes)
14452024-06-06T21:29:22.321Zupload warning: file "/pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 106972 -> 114479
14462024-06-06T21:29:23.392Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464/root/var/svc/log/oxide-internal_dns:default.log
14472024-06-06T21:29:23.392Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
14482024-06-06T21:29:24.486Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464/root/var/svc/log/oxide-zone-network-setup:default.log
14492024-06-06T21:29:24.486Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0/root/var/svc/log/oxide-nexus:default.log (2884361 bytes)
14502024-06-06T21:29:28.379Zupload warning: file "/pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2884361 -> 3760145
14512024-06-06T21:29:29.452Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0/root/var/svc/log/oxide-nexus:default.log
14522024-06-06T21:29:29.453Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0/root/var/svc/log/oxide-opte-interface-setup:default.log (1137 bytes)
14532024-06-06T21:29:30.544Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0/root/var/svc/log/oxide-opte-interface-setup:default.log
14542024-06-06T21:29:30.544Zuploading: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0/root/var/svc/log/oxide-zone-network-setup:default.log (1663 bytes)
14552024-06-06T21:29:31.638Zuploaded: /pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone/oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0/root/var/svc/log/oxide-zone-network-setup:default.log
14562024-06-06T21:29:31.639Zuploading: /pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone/oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13/root/var/svc/log/oxide-crucible-agent:default.log (12507 bytes)
14572024-06-06T21:29:32.777Zuploaded: /pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone/oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13/root/var/svc/log/oxide-crucible-agent:default.log
14582024-06-06T21:29:32.777Zuploading: /pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone/oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14592024-06-06T21:29:33.871Zuploaded: /pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone/oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13/root/var/svc/log/oxide-crucible-downstairs:default.log
14602024-06-06T21:29:33.871Zuploading: /pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone/oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13/root/var/svc/log/oxide-crucible-downstairs:downstairs-a5dd7e17-d9fa-4d76-9dfe-fc01932f4854.log (5614 bytes)
14612024-06-06T21:29:34.988Zuploaded: /pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone/oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13/root/var/svc/log/oxide-crucible-downstairs:downstairs-a5dd7e17-d9fa-4d76-9dfe-fc01932f4854.log
14622024-06-06T21:29:34.988Zuploading: /pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone/oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
14632024-06-06T21:29:36.082Zuploaded: /pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone/oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13/root/var/svc/log/oxide-zone-network-setup:default.log
14642024-06-06T21:29:36.082Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/measurements.log (18906 bytes)
14652024-06-06T21:29:36.218Zupload warning: file "/pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/measurements.log" changed size mid upload: 18906 -> 24660
14662024-06-06T21:29:37.288Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/measurements.log
14672024-06-06T21:29:37.288Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/statistics.log (12285 bytes)
14682024-06-06T21:29:37.383Zupload warning: file "/pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/statistics.log" changed size mid upload: 12285 -> 17199
14692024-06-06T21:29:38.454Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/statistics.log
14702024-06-06T21:29:38.454Zuploading: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/tracking.log (1719 bytes)
14712024-06-06T21:29:38.501Zupload warning: file "/pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/tracking.log" changed size mid upload: 1719 -> 1983
14722024-06-06T21:29:39.572Zuploaded: /pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone/oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8/root/var/log/chrony/tracking.log