01JA8MP60RP7NP725H50MDCJA0: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
        "/tmp/kstat/*.kstat",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.33",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01JA8MQMBPRKSBF5BQVWDV934S

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-10-15T18:21:42.407Zjob dependencies complete; ready to run (waiting for 33 m 4 s)
22024-10-15T18:26:08.754Zjob assigned to worker 01JA8PMD00TG72684PGJAW8FYN (queued for 4 m 26 s)
32024-10-15T18:26:08.897Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-10-15T18:26:08.951Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-10-15T18:26:08.986Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-10-15T18:26:09.018Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-10-15T18:26:09.052Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-10-15T18:26:09.097ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-10-15T18:26:09.130Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102024-10-15T18:26:09.164ZOxide Helios Version helios-2.0.22827 64-bit
112024-10-15T18:26:09.197ZConfiguring devices.
122024-10-15T18:26:09.231Z##################################################
132024-10-15T18:26:09.265Z#### ############# ##
142024-10-15T18:26:09.298Z### ### ############ ##
152024-10-15T18:26:09.332Z## ### # ## ### ## Oxide Computer Company ##
162024-10-15T18:26:09.367Z## ## ## ### # ### ##
172024-10-15T18:26:09.398Z## # ### #### #### This Station Under ##
182024-10-15T18:26:09.432Z### ### #### # ### Computer Control ##
192024-10-15T18:26:09.465Z#### #### ### ## ##
202024-10-15T18:26:09.499Z##################################################
212024-10-15T18:26:09.532ZHostname: sock
222024-10-15T18:26:09.566ZLoading smf(7) service descriptions:
232024-10-15T18:26:10.103Zdownloading input: /input/package/work/package.tar.gz
242024-10-15T18:30:52.324Zdownloaded input: /input/package/work/package.tar.gz
 
252024-10-15T18:30:52.324Zstarting task 0: "setup"
262024-10-15T18:30:52.348Z++ uname -s
272024-10-15T18:30:52.348Z+ kern=SunOS
282024-10-15T18:30:52.349Z+ case "$kern" in
292024-10-15T18:30:52.349Z+ groupadd -g 12345 build
302024-10-15T18:30:52.349Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-10-15T18:30:54.336Z+ zfs create -o mountpoint=/work rpool/work
322024-10-15T18:30:54.359Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-10-15T18:30:54.359Z+ home_fs=zfs
342024-10-15T18:30:54.359Z+ [[ zfs == autofs ]]
352024-10-15T18:30:54.359Z+ mkdir -p /home/build
362024-10-15T18:30:54.359Z+ chown build:build /home/build /work
372024-10-15T18:30:56.359Z+ chmod 0700 /home/build /work
382024-10-15T18:30:56.383Zprocess exited: duration 4046 ms, exit code 0
 
392024-10-15T18:30:56.430Zstarting task 1: "authentication"
402024-10-15T18:30:56.476Zprocess exited: duration 44 ms, exit code 0
 
412024-10-15T18:30:56.523Zstarting task 2: "build"
422024-10-15T18:30:56.547Z+ trap _exit_trap EXIT
432024-10-15T18:30:56.547Z+ OPTE_COMMIT=f3002b356da7d0e4ca15beb66a5566a92919baaa
442024-10-15T18:30:56.547Z+ [[ xf3002b356da7d0e4ca15beb66a5566a92919baaa != \x ]]
452024-10-15T18:30:56.547Z+ curl -sSfOL https://buildomat.eng.oxide.computer/public/file/oxidecomputer/opte/module/f3002b356da7d0e4ca15beb66a5566a92919baaa/xde
462024-10-15T18:31:07.557Z+ pfexec rem_drv xde
472024-10-15T18:31:07.581Z+ pfexec mv xde /kernel/drv/amd64/xde
482024-10-15T18:31:07.649Z+ pfexec add_drv xde
492024-10-15T18:31:07.757Z+ curl -sSfOL https://buildomat.eng.oxide.computer/public/file/oxidecomputer/opte/release/f3002b356da7d0e4ca15beb66a5566a92919baaa/opteadm
502024-10-15T18:31:17.632Z+ chmod +x opteadm
512024-10-15T18:31:17.657Z+ cp opteadm /tmp/opteadm
522024-10-15T18:31:17.684Z+ pfexec mv opteadm /opt/oxide/opte/bin/opteadm
532024-10-15T18:31:17.759Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
542024-10-15T18:31:17.891Zsecpolicy_fs_linkdir: 0x55 = 0x55
552024-10-15T18:31:17.891Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
562024-10-15T18:31:17.891Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
572024-10-15T18:31:17.891Zsecpolicy_fs_linkdir+3: 0 = 0xe5
582024-10-15T18:31:17.891Zsecpolicy_fs_linkdir+4: 0 = 0xb8
592024-10-15T18:31:17.891Zsecpolicy_fs_linkdir+5: 0 = 0x1
602024-10-15T18:31:17.914Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
612024-10-15T18:31:17.914Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
622024-10-15T18:31:17.914Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
632024-10-15T18:31:17.914Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
642024-10-15T18:31:17.914Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
652024-10-15T18:31:17.915Z+ [[ -d /opt/oxide ]]
662024-10-15T18:31:17.915Z+ pfexec mv /opt/oxide /opt/oxide-underneath
672024-10-15T18:31:17.915Z+ pfexec mkdir /opt/oxide
682024-10-15T18:31:17.915Z+ pfexec mount -F tmpfs -O swap /opt/oxide
692024-10-15T18:31:17.915Z+ [[ -d /opt/oxide-underneath ]]
702024-10-15T18:31:17.915Z+ cd /opt/oxide-underneath
712024-10-15T18:31:17.915Z+ pfexec tar ceEp@/f - .
722024-10-15T18:31:17.915Z+ cd /opt/oxide
732024-10-15T18:31:17.915Z+ pfexec tar xveEp@/f -
742024-10-15T18:31:17.957Zx ., 0 bytes, 0 tape blocks
752024-10-15T18:31:17.957Zx ./opte, 0 bytes, 0 tape blocks
762024-10-15T18:31:17.957Zx ./opte/bin, 0 bytes, 0 tape blocks
772024-10-15T18:31:17.957Zx ./opte/bin/opteadm, 55763696 bytes, 108914 tape blocks
782024-10-15T18:31:17.980Z+ pfexec rm -rf /opt/oxide-underneath
792024-10-15T18:31:17.980Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
802024-10-15T18:31:18.004Z+ pfexec mkdir /opt/oxide/work
812024-10-15T18:31:18.004Z+ pfexec chown build:build /opt/oxide/work
822024-10-15T18:31:18.004Z+ cd /opt/oxide/work
832024-10-15T18:31:18.004Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
842024-10-15T18:31:30.610ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
852024-10-15T18:31:30.611Zx .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks
862024-10-15T18:31:30.611Zx out/target/test, 107 bytes, 1 tape blocks
872024-10-15T18:31:30.611Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
882024-10-15T18:31:30.611Zx package-manifest.toml, 32239 bytes, 63 tape blocks
892024-10-15T18:31:30.611Zx smf/sled-agent/non-gimlet/config.toml, 3569 bytes, 7 tape blocks
902024-10-15T18:31:30.611Zx target/release/omicron-package, 33684200 bytes, 65790 tape blocks
912024-10-15T18:31:30.611Zx target/release/xtask, 12390392 bytes, 24200 tape blocks
922024-10-15T18:31:30.611Zx target/debug/bootstrap, 203432584 bytes, 397330 tape blocks
932024-10-15T18:31:30.611Zx tests/bootstrap-ea4c653164c89ba6, 24350072 bytes, 47559 tape blocks
942024-10-15T18:31:30.611Zx tests/commtest-97870a8881adccd9, 24840592 bytes, 48517 tape blocks
952024-10-15T18:31:30.611Zx tests/dhcp_server-0952d33d035a67a9, 24350088 bytes, 47559 tape blocks
962024-10-15T18:31:30.611Zx tests/end_to_end_tests-2736cc1341c5714d, 221345600 bytes, 432316 tape blocks
972024-10-15T18:31:30.611Zx out/clickhouse.tar.gz, 250574151 bytes, 489403 tape blocks
982024-10-15T18:31:30.611Zx out/clickhouse_keeper.tar.gz, 250578475 bytes, 489412 tape blocks
992024-10-15T18:31:30.611Zx out/clickhouse_server.tar.gz, 250577425 bytes, 489410 tape blocks
1002024-10-15T18:31:30.611Zx out/cockroachdb.tar.gz, 136076716 bytes, 265775 tape blocks
1012024-10-15T18:31:30.611Zx out/crucible-dtrace.tar, 83456 bytes, 163 tape blocks
1022024-10-15T18:31:30.611Zx out/crucible-pantry-zone.tar.gz, 27638965 bytes, 53983 tape blocks
1032024-10-15T18:31:30.611Zx out/crucible-zone.tar.gz, 36031263 bytes, 70374 tape blocks
1042024-10-15T18:31:30.611Zx out/external-dns.tar.gz, 27765842 bytes, 54231 tape blocks
1052024-10-15T18:31:30.611Zx out/internal-dns.tar.gz, 27767378 bytes, 54234 tape blocks
1062024-10-15T18:31:30.611Zx out/mg-ddm-gz.tar, 64164864 bytes, 125322 tape blocks
1072024-10-15T18:31:30.611Zx out/nexus.tar.gz, 96825430 bytes, 189113 tape blocks
1082024-10-15T18:31:30.611Zx out/ntp.tar.gz, 9361392 bytes, 18284 tape blocks
1092024-10-15T18:31:30.611Zx out/omicron-gateway-softnpu.tar.gz, 22033026 bytes, 43034 tape blocks
1102024-10-15T18:31:30.611Zx out/omicron-sled-agent.tar, 106085376 bytes, 207198 tape blocks
1112024-10-15T18:31:30.611Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1122024-10-15T18:31:30.611Zx out/oximeter.tar.gz, 46611412 bytes, 91038 tape blocks
1132024-10-15T18:31:30.611Zx out/oxlog.tar, 3110400 bytes, 6075 tape blocks
1142024-10-15T18:31:30.611Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1152024-10-15T18:31:30.611Zx out/propolis-server.tar.gz, 68085710 bytes, 132980 tape blocks
1162024-10-15T18:31:30.611Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1172024-10-15T18:31:30.611Zx out/switch-softnpu.tar.gz, 227943147 bytes, 445202 tape blocks
1182024-10-15T18:31:30.636Z
1192024-10-15T18:31:30.636Zreal 12.587700396
1202024-10-15T18:31:30.636Zuser 11.140543898
1212024-10-15T18:31:30.636Zsys 2.491539428
1222024-10-15T18:31:30.636Ztrap 0.000500033
1232024-10-15T18:31:30.636Ztflt 0.000000000
1242024-10-15T18:31:30.636Zdflt 0.000000000
1252024-10-15T18:31:30.636Zkflt 0.000000000
1262024-10-15T18:31:30.637Zlock 0.000000000
1272024-10-15T18:31:30.637Zslp 11.233354122
1282024-10-15T18:31:30.637Zlat 0.307036545
1292024-10-15T18:31:30.637Zstop 0.000137961
1302024-10-15T18:31:30.637Z+ source .github/buildomat/ci-env.sh
1312024-10-15T18:31:30.637Z++ export CARGO_TERM_COLOR=always
1322024-10-15T18:31:30.637Z++ CARGO_TERM_COLOR=always
1332024-10-15T18:31:30.637Z+ bmat address ls
1342024-10-15T18:31:30.637ZNAME CIDR FIRST LAST COUNT
1352024-10-15T18:31:30.637Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1362024-10-15T18:31:30.637Z++ bmat address ls -f extra -Ho first,last,count
1372024-10-15T18:31:30.637Z+ set -- 10.151.2.164 10.151.2.227 64
1382024-10-15T18:31:30.637Z+ EXTRA_IP_START=10.151.2.164
1392024-10-15T18:31:30.637Z+ EXTRA_IP_END=10.151.2.227
1402024-10-15T18:31:30.637Z+ EXTRA_IP_COUNT=64
1412024-10-15T18:31:30.637Z+ (( EXTRA_IP_COUNT >= 32 ))
1422024-10-15T18:31:30.637Z+ EXTRA_IP_BASE=10.151.2
1432024-10-15T18:31:30.637Z+ EXTRA_IP_FOCTET=164
1442024-10-15T18:31:30.637Z+ EXTRA_IP_LOCTET=227
1452024-10-15T18:31:30.637Z+ SERVICE_IP_POOL_START=10.151.2.164
1462024-10-15T18:31:30.637Z+ SERVICE_IP_POOL_END=10.151.2.173
1472024-10-15T18:31:30.637Z+ DNS_IP1=10.151.2.164
1482024-10-15T18:31:30.637Z+ DNS_IP2=10.151.2.165
1492024-10-15T18:31:30.637Z+ UPLINK_IP=10.151.2.174
1502024-10-15T18:31:30.637Z+ IPPOOL_START=10.151.2.175
1512024-10-15T18:31:30.637Z+ IPPOOL_END=10.151.2.227
1522024-10-15T18:31:30.637Z++ ipadm show-addr -po type,addr
1532024-10-15T18:31:30.637Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1542024-10-15T18:31:30.637Z+ GATEWAY_IP=10.151.2.100
1552024-10-15T18:31:30.637Z+ [[ -n 10.151.2.100 ]]
1562024-10-15T18:31:30.637Z+ ping -s 10.151.2.100 56 1
1572024-10-15T18:31:30.637ZPING 10.151.2.100: 56 data bytes
1582024-10-15T18:31:30.637Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.012 ms
1592024-10-15T18:31:30.637Z
1602024-10-15T18:31:30.638Z----10.151.2.100 PING Statistics----
1612024-10-15T18:31:30.638Z1 packets transmitted, 1 packets received, 0% packet loss
1622024-10-15T18:31:30.638Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
1632024-10-15T18:31:30.638Z++ arp -an
1642024-10-15T18:31:30.638Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1652024-10-15T18:31:30.638Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1662024-10-15T18:31:30.638Z+ routeadm -e ipv4-forwarding -u
1672024-10-15T18:31:30.745Z+ PXA_START=10.151.2.164
1682024-10-15T18:31:30.745Z+ PXA_END=10.151.2.227
1692024-10-15T18:31:30.768Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1702024-10-15T18:31:30.944Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227
1712024-10-15T18:31:30.968ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1722024-10-15T18:31:30.968Zcreating virtual hardware
1732024-10-15T18:31:30.968Zcreating /scratch/m2_0.vdev
1742024-10-15T18:31:30.968Zcreating /scratch/m2_1.vdev
1752024-10-15T18:31:30.968Zcreating /scratch/u2_0.vdev
1762024-10-15T18:31:30.968Zcreating /scratch/u2_1.vdev
1772024-10-15T18:31:30.968Zcreating /scratch/u2_2.vdev
1782024-10-15T18:31:30.968Zcreating /scratch/u2_3.vdev
1792024-10-15T18:31:30.968Zcreating /scratch/u2_4.vdev
1802024-10-15T18:31:30.968Zcreating /scratch/u2_5.vdev
1812024-10-15T18:31:30.968Zcreating /scratch/u2_6.vdev
1822024-10-15T18:31:30.968Zcreating /scratch/u2_7.vdev
1832024-10-15T18:31:30.968Zcreating /scratch/u2_8.vdev
1842024-10-15T18:31:30.992ZSimnet net0/sc0_0 exists
1852024-10-15T18:31:31.016ZSimnet net1/sc1_0 exists
1862024-10-15T18:31:31.016ZVnic sc0_1 exists
1872024-10-15T18:31:43.339ZUsing 10.151.2.100 as gateway ip
1882024-10-15T18:31:43.339Zusing 18:C0:4D:0D:A0:2A as gateway mac
1892024-10-15T18:31:43.339Zconfiguring SoftNPU ARP entry
1902024-10-15T18:31:43.368Zconfiguring SoftNPU proxy ARP
1912024-10-15T18:31:43.423ZSoftNPU state:
1922024-10-15T18:31:43.423Z local v6:
1932024-10-15T18:31:43.423Z local v4:
1942024-10-15T18:31:43.423Z router v6:
1952024-10-15T18:31:43.423Z router v4_idx:
1962024-10-15T18:31:43.423Z router v4_routes:
1972024-10-15T18:31:43.423Z resolver v4:
1982024-10-15T18:31:43.423Z 10.151.2.100 -> 18:c0:4d:0d:a0:2a
1992024-10-15T18:31:43.423Z resolver v6:
2002024-10-15T18:31:43.423Z nat v4:
2012024-10-15T18:31:43.423Z nat_v6:
2022024-10-15T18:31:43.423Z port_mac:
2032024-10-15T18:31:43.423Z proxy arp:
2042024-10-15T18:31:43.423Z 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
2052024-10-15T18:31:43.423Zcreated virtual hardware
2062024-10-15T18:31:43.447Z
2072024-10-15T18:31:43.447Zreal 12.475081240
2082024-10-15T18:31:43.447Zuser 0.687639897
2092024-10-15T18:31:43.447Zsys 3.041564059
2102024-10-15T18:31:43.447Ztrap 0.000051638
2112024-10-15T18:31:43.447Ztflt 0.000293867
2122024-10-15T18:31:43.447Zdflt 0.000618258
2132024-10-15T18:31:43.447Zkflt 0.000008000
2142024-10-15T18:31:43.447Zlock 9:42.352742502
2152024-10-15T18:31:43.447Zslp 37.619269938
2162024-10-15T18:31:43.447Zlat 0.081678460
2172024-10-15T18:31:43.447Zstop 0.326253216
2182024-10-15T18:31:43.447Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2192024-10-15T18:31:43.471Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2202024-10-15T18:31:43.471Z+ diff -u pkg/config.toml~ pkg/config.toml
2212024-10-15T18:31:43.471Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2222024-10-15T18:31:43.471Z+++ pkg/config.toml Tue Oct 15 18:31:43 2024
2232024-10-15T18:31:43.471Z@@ -29,18 +29,18 @@
2242024-10-15T18:31:43.471Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2252024-10-15T18:31:43.471Z # followed by a string that is embedded into their fake serial values.
2262024-10-15T18:31:43.471Z vdevs = [
2272024-10-15T18:31:43.471Z- "m2_0.vdev",
2282024-10-15T18:31:43.471Z- "m2_1.vdev",
2292024-10-15T18:31:43.471Z+ "/scratch/m2_0.vdev",
2302024-10-15T18:31:43.471Z+ "/scratch/m2_1.vdev",
2312024-10-15T18:31:43.471Z
2322024-10-15T18:31:43.471Z- "u2_0.vdev",
2332024-10-15T18:31:43.471Z- "u2_1.vdev",
2342024-10-15T18:31:43.471Z- "u2_2.vdev",
2352024-10-15T18:31:43.471Z- "u2_3.vdev",
2362024-10-15T18:31:43.471Z- "u2_4.vdev",
2372024-10-15T18:31:43.471Z- "u2_5.vdev",
2382024-10-15T18:31:43.471Z- "u2_6.vdev",
2392024-10-15T18:31:43.471Z- "u2_7.vdev",
2402024-10-15T18:31:43.471Z- "u2_8.vdev",
2412024-10-15T18:31:43.471Z+ "/scratch/u2_0.vdev",
2422024-10-15T18:31:43.471Z+ "/scratch/u2_1.vdev",
2432024-10-15T18:31:43.471Z+ "/scratch/u2_2.vdev",
2442024-10-15T18:31:43.471Z+ "/scratch/u2_3.vdev",
2452024-10-15T18:31:43.471Z+ "/scratch/u2_4.vdev",
2462024-10-15T18:31:43.471Z+ "/scratch/u2_5.vdev",
2472024-10-15T18:31:43.471Z+ "/scratch/u2_6.vdev",
2482024-10-15T18:31:43.471Z+ "/scratch/u2_7.vdev",
2492024-10-15T18:31:43.471Z+ "/scratch/u2_8.vdev",
2502024-10-15T18:31:43.472Z ]
2512024-10-15T18:31:43.472Z
2522024-10-15T18:31:43.472Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2532024-10-15T18:31:43.472Z+ true
2542024-10-15T18:31:43.472Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2552024-10-15T18:31:43.472Z+ SILO_NAME=recovery
2562024-10-15T18:31:43.472Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2572024-10-15T18:31:43.472Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2582024-10-15T18:31:43.472Z+ sed -i~ '
2592024-10-15T18:31:43.472Z /^external_dns_ips/c\
2602024-10-15T18:31:43.472Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2612024-10-15T18:31:43.472Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2622024-10-15T18:31:43.472Z /^first/c\
2632024-10-15T18:31:43.472Zfirst = "10.151.2.164"
2642024-10-15T18:31:43.472Z /^last/c\
2652024-10-15T18:31:43.473Zlast = "10.151.2.173"
2662024-10-15T18:31:43.473Z }
2672024-10-15T18:31:43.473Z /^infra_ip_first/c\
2682024-10-15T18:31:43.473Zinfra_ip_first = "10.151.2.174"
2692024-10-15T18:31:43.473Z /^infra_ip_last/c\
2702024-10-15T18:31:43.473Zinfra_ip_last = "10.151.2.174"
2712024-10-15T18:31:43.473Z /^\[\[rack_network_config.ports/,/^$/ {
2722024-10-15T18:31:43.473Z /^routes/c\
2732024-10-15T18:31:43.473Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
2742024-10-15T18:31:43.473Z /^addresses/c\
2752024-10-15T18:31:43.473Zaddresses = \[{address = "10.151.2.174/24"} \]
2762024-10-15T18:31:43.473Z }
2772024-10-15T18:31:43.473Z' pkg/config-rss.toml
2782024-10-15T18:31:43.496Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2792024-10-15T18:31:43.496Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2802024-10-15T18:31:43.496Z+++ pkg/config-rss.toml Tue Oct 15 18:31:43 2024
2812024-10-15T18:31:43.496Z@@ -33,7 +33,7 @@
2822024-10-15T18:31:43.496Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2832024-10-15T18:31:43.496Z # must be contained in one of the "internal services" IP Pool ranges listed
2842024-10-15T18:31:43.497Z # below.
2852024-10-15T18:31:43.497Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2862024-10-15T18:31:43.497Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2872024-10-15T18:31:43.497Z
2882024-10-15T18:31:43.497Z # Initial TLS certificates for the external API
2892024-10-15T18:31:43.497Z #
2902024-10-15T18:31:43.497Z@@ -69,8 +69,8 @@
2912024-10-15T18:31:43.497Z #
2922024-10-15T18:31:43.497Z # For more on this and what to put here, see docs/how-to-run.adoc.
2932024-10-15T18:31:43.497Z [[internal_services_ip_pool_ranges]]
2942024-10-15T18:31:43.497Z-first = "192.168.1.20"
2952024-10-15T18:31:43.497Z-last = "192.168.1.29"
2962024-10-15T18:31:43.497Z+first = "10.151.2.164"
2972024-10-15T18:31:43.497Z+last = "10.151.2.173"
2982024-10-15T18:31:43.497Z
2992024-10-15T18:31:43.497Z # TODO - this configuration is subject to change going forward. Ultimately these
3002024-10-15T18:31:43.497Z # parameters should be provided to the control plane via wicket, but we need to
3012024-10-15T18:31:43.497Z@@ -91,8 +91,8 @@
3022024-10-15T18:31:43.497Z # A range of IP addresses used by Boundary Services on the external network. In
3032024-10-15T18:31:43.497Z # a real system, these would be addresses of the uplink ports on the Sidecar.
3042024-10-15T18:31:43.498Z # With softnpu, only one address is used.
3052024-10-15T18:31:43.498Z-infra_ip_first = "192.168.1.30"
3062024-10-15T18:31:43.498Z-infra_ip_last = "192.168.1.30"
3072024-10-15T18:31:43.498Z+infra_ip_first = "10.151.2.174"
3082024-10-15T18:31:43.498Z+infra_ip_last = "10.151.2.174"
3092024-10-15T18:31:43.498Z
3102024-10-15T18:31:43.498Z # Configurations for BGP routers to run on the scrimlets.
3112024-10-15T18:31:43.498Z bgp = []
3122024-10-15T18:31:43.498Z@@ -100,9 +100,9 @@
3132024-10-15T18:31:43.498Z # You can configure multiple uplinks by repeating the following stanza
3142024-10-15T18:31:43.498Z [[rack_network_config.ports]]
3152024-10-15T18:31:43.498Z # Routes associated with this port.
3162024-10-15T18:31:43.498Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3172024-10-15T18:31:43.498Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
3182024-10-15T18:31:43.498Z # Addresses associated with this port.
3192024-10-15T18:31:43.498Z-addresses = [{address = "192.168.1.30/24"}]
3202024-10-15T18:31:43.498Z+addresses = [{address = "10.151.2.174/24"} ]
3212024-10-15T18:31:43.498Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3222024-10-15T18:31:43.498Z port = "qsfp0"
3232024-10-15T18:31:43.498Z # The speed of this port.
3242024-10-15T18:31:43.498Z+ true
3252024-10-15T18:31:43.498Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3262024-10-15T18:31:43.498Za pkg/config-rss.toml 8K
3272024-10-15T18:31:43.498Za pkg/config.toml 4K
3282024-10-15T18:31:43.498Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3292024-10-15T18:31:43.498Z+ TLS_NAME=recovery.sys.oxide.test
3302024-10-15T18:31:43.498Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3312024-10-15T18:31:44.089Z..+.+...+...........+......+.+..+...+.......+........+....+...+...........+.+...+.....+......+.......+.....+...+............+.........+.............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+.........+...+...+...+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+....+.....+...+....+.....+..........+...+.....+..........+..+...+......+.........+.+............+.....+.............+..+.............+...........+.............+........+...+...............+............+...............+.........+.............+............+.....+......+...+.........+.......+......+..+.............+........+....+..+..........+...........+.......+...........................+..................+..+...+......+............+.......+...+..............+.........+.........+..........+..+...+.......+...+........+.........+................+.........+......+..............+.........................+........+..................+....+.....+...+......+.......+..+......+.+......+..+......+.+...+...+.....+......................+......+......+......+..+.......+........+............+.............+...............+..+...............+.............+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3322024-10-15T18:31:44.289Z....+...+..+...+...+...+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..+...+....+......+..+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+........+....+.....+............+.............+..+....+......+...+..+...+.+.........+.....+.+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3332024-10-15T18:31:44.312Z-----
3342024-10-15T18:31:44.312Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3352024-10-15T18:31:44.336Za pkg/initial-tls-cert.pem 2K
3362024-10-15T18:31:44.336Za pkg/initial-tls-key.pem 4K
3372024-10-15T18:31:44.336Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3382024-10-15T18:31:44.336Z+ rmdir pkg
3392024-10-15T18:31:44.336Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3402024-10-15T18:31:44.336Z+ pfexec mkdir -p /usr/oxide
3412024-10-15T18:31:44.336Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3422024-10-15T18:31:45.053Z+ pfexec chmod +x /usr/oxide/oxide
3432024-10-15T18:31:45.078Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3442024-10-15T18:32:03.356Z+ OMICRON_NO_UNINSTALL=1
3452024-10-15T18:32:03.356Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3462024-10-15T18:32:03.381ZLogging to: /opt/oxide/work/out/LOG
3472024-10-15T18:32:03.948Z
3482024-10-15T18:32:03.972Zreal 0.586602031
3492024-10-15T18:32:03.972Zuser 0.138606629
3502024-10-15T18:32:03.972Zsys 3.010030533
3512024-10-15T18:32:03.972Ztrap 0.000000800
3522024-10-15T18:32:03.972Ztflt 0.000003318
3532024-10-15T18:32:03.975Zdflt 0.000855206
3542024-10-15T18:32:03.975Zkflt 0.000012000
3552024-10-15T18:32:03.975Zlock 52.824874036
3562024-10-15T18:32:03.975Zslp 0.772538854
3572024-10-15T18:32:03.975Zlat 0.003163274
3582024-10-15T18:32:03.975Zstop 0.202473200
3592024-10-15T18:32:03.975Z+ retry=0
3602024-10-15T18:32:03.975Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3612024-10-15T18:32:03.975Z+ [[ 0 -gt 30 ]]
3622024-10-15T18:32:03.975Z+ sleep 1
3632024-10-15T18:32:04.962Z+ retry=1
3642024-10-15T18:32:04.962Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3652024-10-15T18:32:04.987Z+ [[ 1 -gt 30 ]]
3662024-10-15T18:32:04.987Z+ sleep 1
3672024-10-15T18:32:05.977Z+ retry=2
3682024-10-15T18:32:05.977Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3692024-10-15T18:32:06.001Z+ [[ 2 -gt 30 ]]
3702024-10-15T18:32:06.001Z+ sleep 1
3712024-10-15T18:32:06.991Z+ retry=3
3722024-10-15T18:32:06.991Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3732024-10-15T18:32:26.898Z+ [[ 3 -gt 30 ]]
3742024-10-15T18:32:26.898Z+ sleep 1
3752024-10-15T18:32:27.903Z+ retry=4
3762024-10-15T18:32:27.903Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3772024-10-15T18:32:27.926Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3782024-10-15T18:32:27.951Zlocal v6:
3792024-10-15T18:32:27.951Zfd28:4d4e:40a9:54a::1
3802024-10-15T18:32:27.951Zfe80::dccc:96ff:feec:5d6d
3812024-10-15T18:32:27.951Zlocal v4:
3822024-10-15T18:32:27.951Z10.151.2.174
3832024-10-15T18:32:27.951Zrouter v6:
3842024-10-15T18:32:27.951Zrouter v4_idx:
3852024-10-15T18:32:27.951Z0.0.0.0/0 -> 0
3862024-10-15T18:32:27.951Zrouter v4_routes:
3872024-10-15T18:32:27.951Z0 -> 10.151.2.100 (2)
3882024-10-15T18:32:27.951Zresolver v4:
3892024-10-15T18:32:27.975Z10.151.2.174 -> 96:c1:3d:22:92:c5
3902024-10-15T18:32:27.975Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
3912024-10-15T18:32:27.975Zresolver v6:
3922024-10-15T18:32:27.975Zfe80::5c13:c0ff:fe6b:8ea8 -> 5e:13:c0:6b:8e:a8
3932024-10-15T18:32:27.975Zfe80::dccc:96ff:feec:5d6d -> de:cc:96:ec:5d:6d
3942024-10-15T18:32:27.975Znat v4:
3952024-10-15T18:32:27.975Znat_v6:
3962024-10-15T18:32:27.975Zport_mac:
3972024-10-15T18:32:27.975Z2: a8:40:25:57:16:0f
3982024-10-15T18:32:27.975Z1000: a8:40:25:57:15:ee
3992024-10-15T18:32:27.975Z1: a8:40:25:57:15:ef
4002024-10-15T18:32:27.975Zproxy arp:
4012024-10-15T18:32:27.975Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
4022024-10-15T18:32:27.975Z+ retry=0
4032024-10-15T18:32:27.975Z+++ zoneadm list -n
4042024-10-15T18:32:27.975Z+++ grep oxz_ntp
4052024-10-15T18:32:27.975Z++ pfexec svcs -z -Hostate oxide/ntp
4062024-10-15T18:32:27.975Zsvcs: zone '-Hostate': entity not found
4072024-10-15T18:32:27.999Z++ true
4082024-10-15T18:32:27.999Z+ [[ '' != online ]]
4092024-10-15T18:32:27.999Z+ [[ 0 -gt 60 ]]
4102024-10-15T18:32:27.999Z+ sleep 1
4112024-10-15T18:32:28.980Z+ retry=1
4122024-10-15T18:32:29.003Z+++ zoneadm list -n
4132024-10-15T18:32:29.004Z+++ grep oxz_ntp
4142024-10-15T18:32:29.004Z++ pfexec svcs -z -Hostate oxide/ntp
4152024-10-15T18:32:29.004Zsvcs: zone '-Hostate': entity not found
4162024-10-15T18:32:29.004Z++ true
4172024-10-15T18:32:29.004Z+ [[ '' != online ]]
4182024-10-15T18:32:29.004Z+ [[ 1 -gt 60 ]]
4192024-10-15T18:32:29.004Z+ sleep 1
4202024-10-15T18:32:30.002Z+ retry=2
4212024-10-15T18:32:30.026Z+++ zoneadm list -n
4222024-10-15T18:32:30.026Z+++ grep oxz_ntp
4232024-10-15T18:32:30.026Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4242024-10-15T18:32:30.083Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4252024-10-15T18:32:30.083Z++ true
4262024-10-15T18:32:30.083Z+ [[ '' != online ]]
4272024-10-15T18:32:30.083Z+ [[ 2 -gt 60 ]]
4282024-10-15T18:32:30.083Z+ sleep 1
4292024-10-15T18:32:31.070Z+ retry=3
4302024-10-15T18:32:31.093Z+++ zoneadm list -n
4312024-10-15T18:32:31.093Z+++ grep oxz_ntp
4322024-10-15T18:32:31.093Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4332024-10-15T18:32:31.117Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4342024-10-15T18:32:31.117Z++ true
4352024-10-15T18:32:31.117Z+ [[ '' != online ]]
4362024-10-15T18:32:31.117Z+ [[ 3 -gt 60 ]]
4372024-10-15T18:32:31.117Z+ sleep 1
4382024-10-15T18:32:32.103Z+ retry=4
4392024-10-15T18:32:32.126Z+++ zoneadm list -n
4402024-10-15T18:32:32.126Z+++ grep oxz_ntp
4412024-10-15T18:32:32.126Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4422024-10-15T18:32:32.150Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4432024-10-15T18:32:32.150Z++ true
4442024-10-15T18:32:32.150Z+ [[ '' != online ]]
4452024-10-15T18:32:32.150Z+ [[ 4 -gt 60 ]]
4462024-10-15T18:32:32.150Z+ sleep 1
4472024-10-15T18:32:33.133Z+ retry=5
4482024-10-15T18:32:33.157Z+++ zoneadm list -n
4492024-10-15T18:32:33.157Z+++ grep oxz_ntp
4502024-10-15T18:32:33.157Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4512024-10-15T18:32:33.181Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4522024-10-15T18:32:33.181Z++ true
4532024-10-15T18:32:33.181Z+ [[ '' != online ]]
4542024-10-15T18:32:33.181Z+ [[ 5 -gt 60 ]]
4552024-10-15T18:32:33.181Z+ sleep 1
4562024-10-15T18:32:34.163Z+ retry=6
4572024-10-15T18:32:34.186Z+++ zoneadm list -n
4582024-10-15T18:32:34.186Z+++ grep oxz_ntp
4592024-10-15T18:32:34.186Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4602024-10-15T18:32:34.186Z+ [[ offline != online ]]
4612024-10-15T18:32:34.186Z+ [[ 6 -gt 60 ]]
4622024-10-15T18:32:34.186Z+ sleep 1
4632024-10-15T18:32:35.185Z+ retry=7
4642024-10-15T18:32:35.208Z+++ zoneadm list -n
4652024-10-15T18:32:35.208Z+++ grep oxz_ntp
4662024-10-15T18:32:35.208Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4672024-10-15T18:32:35.208Z+ [[ offline != online ]]
4682024-10-15T18:32:35.208Z+ [[ 7 -gt 60 ]]
4692024-10-15T18:32:35.208Z+ sleep 1
4702024-10-15T18:32:36.206Z+ retry=8
4712024-10-15T18:32:36.230Z+++ zoneadm list -n
4722024-10-15T18:32:36.230Z+++ grep oxz_ntp
4732024-10-15T18:32:36.230Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4742024-10-15T18:32:36.230Z+ [[ offline != online ]]
4752024-10-15T18:32:36.230Z+ [[ 8 -gt 60 ]]
4762024-10-15T18:32:36.230Z+ sleep 1
4772024-10-15T18:32:37.229Z+ retry=9
4782024-10-15T18:32:37.252Z+++ zoneadm list -n
4792024-10-15T18:32:37.252Z+++ grep oxz_ntp
4802024-10-15T18:32:37.252Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4812024-10-15T18:32:37.252Z+ [[ offline != online ]]
4822024-10-15T18:32:37.252Z+ [[ 9 -gt 60 ]]
4832024-10-15T18:32:37.252Z+ sleep 1
4842024-10-15T18:32:38.251Z+ retry=10
4852024-10-15T18:32:38.275Z+++ zoneadm list -n
4862024-10-15T18:32:38.275Z+++ grep oxz_ntp
4872024-10-15T18:32:38.275Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4882024-10-15T18:32:38.275Z+ [[ offline != online ]]
4892024-10-15T18:32:38.275Z+ [[ 10 -gt 60 ]]
4902024-10-15T18:32:38.275Z+ sleep 1
4912024-10-15T18:32:39.273Z+ retry=11
4922024-10-15T18:32:39.297Z+++ zoneadm list -n
4932024-10-15T18:32:39.297Z+++ grep oxz_ntp
4942024-10-15T18:32:39.297Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
4952024-10-15T18:32:39.297Z+ [[ offline != online ]]
4962024-10-15T18:32:39.297Z+ [[ 11 -gt 60 ]]
4972024-10-15T18:32:39.298Z+ sleep 1
 
4982024-10-15T18:32:39.612Zsock console login: Oct 15 18:32:39 sock ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
4992024-10-15T18:32:40.297Z+ retry=12
5002024-10-15T18:32:40.320Z+++ zoneadm list -n
5012024-10-15T18:32:40.320Z+++ grep oxz_ntp
5022024-10-15T18:32:40.320Z++ pfexec svcs -z oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310 -Hostate oxide/ntp
5032024-10-15T18:32:40.320Z+ [[ online != online ]]
5042024-10-15T18:32:40.320Z+ echo 'Waited for chrony: 12s'
5052024-10-15T18:32:40.320Z+ retry=0
5062024-10-15T18:32:40.320ZWaited for chrony: 12s
5072024-10-15T18:32:40.320Z+ zoneadm list
5082024-10-15T18:32:40.320Z+ grep nexus
5092024-10-15T18:32:40.343Z+ [[ 0 -gt 300 ]]
5102024-10-15T18:32:40.344Z+ sleep 1
5112024-10-15T18:32:41.327Z+ retry=1
5122024-10-15T18:32:41.350Z+ zoneadm list
5132024-10-15T18:32:41.350Z+ grep nexus
5142024-10-15T18:32:41.350Z+ [[ 1 -gt 300 ]]
5152024-10-15T18:32:41.350Z+ sleep 1
5162024-10-15T18:32:42.338Z+ retry=2
5172024-10-15T18:32:42.361Z+ zoneadm list
5182024-10-15T18:32:42.361Z+ grep nexus
5192024-10-15T18:32:42.361Z+ [[ 2 -gt 300 ]]
5202024-10-15T18:32:42.361Z+ sleep 1
5212024-10-15T18:32:43.353Z+ retry=3
5222024-10-15T18:32:43.376Z+ zoneadm list
5232024-10-15T18:32:43.376Z+ grep nexus
5242024-10-15T18:32:43.376Z+ [[ 3 -gt 300 ]]
5252024-10-15T18:32:43.376Z+ sleep 1
5262024-10-15T18:32:44.366Z+ retry=4
5272024-10-15T18:32:44.389Z+ zoneadm list
5282024-10-15T18:32:44.389Z+ grep nexus
5292024-10-15T18:32:44.389Z+ [[ 4 -gt 300 ]]
5302024-10-15T18:32:44.389Z+ sleep 1
5312024-10-15T18:32:45.379Z+ retry=5
5322024-10-15T18:32:45.403Z+ zoneadm list
5332024-10-15T18:32:45.403Z+ grep nexus
5342024-10-15T18:32:45.403Z+ [[ 5 -gt 300 ]]
5352024-10-15T18:32:45.403Z+ sleep 1
5362024-10-15T18:32:46.399Z+ retry=6
5372024-10-15T18:32:46.422Z+ zoneadm list
5382024-10-15T18:32:46.422Z+ grep nexus
5392024-10-15T18:32:46.422Z+ [[ 6 -gt 300 ]]
5402024-10-15T18:32:46.422Z+ sleep 1
5412024-10-15T18:32:47.415Z+ retry=7
5422024-10-15T18:32:47.439Z+ zoneadm list
5432024-10-15T18:32:47.439Z+ grep nexus
5442024-10-15T18:32:47.439Z+ [[ 7 -gt 300 ]]
5452024-10-15T18:32:47.439Z+ sleep 1
5462024-10-15T18:32:48.433Z+ retry=8
5472024-10-15T18:32:48.456Z+ zoneadm list
5482024-10-15T18:32:48.456Z+ grep nexus
5492024-10-15T18:32:48.456Z+ [[ 8 -gt 300 ]]
5502024-10-15T18:32:48.457Z+ sleep 1
5512024-10-15T18:32:49.463Z+ retry=9
5522024-10-15T18:32:49.487Z+ zoneadm list
5532024-10-15T18:32:49.487Z+ grep nexus
5542024-10-15T18:32:49.512Z+ [[ 9 -gt 300 ]]
5552024-10-15T18:32:49.512Z+ sleep 1
5562024-10-15T18:32:50.645Z+ retry=10
5572024-10-15T18:32:50.645Z+ zoneadm list
5582024-10-15T18:32:50.645Z+ grep nexus
5592024-10-15T18:32:50.645Z+ [[ 10 -gt 300 ]]
5602024-10-15T18:32:50.645Z+ sleep 1
5612024-10-15T18:32:51.636Z+ retry=11
5622024-10-15T18:32:51.659Z+ zoneadm list
5632024-10-15T18:32:51.659Z+ grep nexus
5642024-10-15T18:32:51.659Z+ [[ 11 -gt 300 ]]
5652024-10-15T18:32:51.659Z+ sleep 1
5662024-10-15T18:32:52.651Z+ retry=12
5672024-10-15T18:32:52.675Z+ zoneadm list
5682024-10-15T18:32:52.675Z+ grep nexus
5692024-10-15T18:32:52.675Z+ [[ 12 -gt 300 ]]
5702024-10-15T18:32:52.675Z+ sleep 1
5712024-10-15T18:32:53.666Z+ retry=13
5722024-10-15T18:32:53.690Z+ zoneadm list
5732024-10-15T18:32:53.690Z+ grep nexus
5742024-10-15T18:32:53.691Z+ [[ 13 -gt 300 ]]
5752024-10-15T18:32:53.691Z+ sleep 1
5762024-10-15T18:32:54.692Z+ retry=14
5772024-10-15T18:32:54.715Z+ zoneadm list
5782024-10-15T18:32:54.716Z+ grep nexus
5792024-10-15T18:32:54.716Z+ [[ 14 -gt 300 ]]
5802024-10-15T18:32:54.716Z+ sleep 1
5812024-10-15T18:32:55.703Z+ retry=15
5822024-10-15T18:32:55.727Z+ zoneadm list
5832024-10-15T18:32:55.727Z+ grep nexus
5842024-10-15T18:32:55.727Z+ [[ 15 -gt 300 ]]
5852024-10-15T18:32:55.727Z+ sleep 1
5862024-10-15T18:32:56.714Z+ retry=16
5872024-10-15T18:32:56.737Z+ zoneadm list
5882024-10-15T18:32:56.738Z+ grep nexus
5892024-10-15T18:32:56.738Z+ [[ 16 -gt 300 ]]
5902024-10-15T18:32:56.738Z+ sleep 1
5912024-10-15T18:32:57.726Z+ retry=17
5922024-10-15T18:32:57.750Z+ zoneadm list
5932024-10-15T18:32:57.750Z+ grep nexus
5942024-10-15T18:32:57.750Z+ [[ 17 -gt 300 ]]
5952024-10-15T18:32:57.750Z+ sleep 1
5962024-10-15T18:32:58.741Z+ retry=18
5972024-10-15T18:32:58.765Z+ zoneadm list
5982024-10-15T18:32:58.765Z+ grep nexus
5992024-10-15T18:32:58.765Z+ [[ 18 -gt 300 ]]
6002024-10-15T18:32:58.765Z+ sleep 1
6012024-10-15T18:32:59.754Z+ retry=19
6022024-10-15T18:32:59.778Z+ zoneadm list
6032024-10-15T18:32:59.778Z+ grep nexus
6042024-10-15T18:32:59.778Z+ [[ 19 -gt 300 ]]
6052024-10-15T18:32:59.778Z+ sleep 1
6062024-10-15T18:33:00.779Z+ retry=20
6072024-10-15T18:33:00.780Z+ zoneadm list
6082024-10-15T18:33:00.780Z+ grep nexus
6092024-10-15T18:33:00.804Z+ [[ 20 -gt 300 ]]
6102024-10-15T18:33:00.805Z+ sleep 1
6112024-10-15T18:33:01.797Z+ retry=21
6122024-10-15T18:33:01.820Z+ zoneadm list
6132024-10-15T18:33:01.820Z+ grep nexus
6142024-10-15T18:33:01.820Z+ [[ 21 -gt 300 ]]
6152024-10-15T18:33:01.820Z+ sleep 1
6162024-10-15T18:33:02.810Z+ retry=22
6172024-10-15T18:33:02.834Z+ zoneadm list
6182024-10-15T18:33:02.834Z+ grep nexus
6192024-10-15T18:33:02.834Z+ [[ 22 -gt 300 ]]
6202024-10-15T18:33:02.834Z+ sleep 1
6212024-10-15T18:33:03.828Z+ retry=23
6222024-10-15T18:33:03.852Z+ zoneadm list
6232024-10-15T18:33:03.852Z+ grep nexus
6242024-10-15T18:33:03.852Z+ [[ 23 -gt 300 ]]
6252024-10-15T18:33:03.852Z+ sleep 1
6262024-10-15T18:33:04.842Z+ retry=24
6272024-10-15T18:33:04.865Z+ zoneadm list
6282024-10-15T18:33:04.865Z+ grep nexus
6292024-10-15T18:33:04.865Z+ [[ 24 -gt 300 ]]
6302024-10-15T18:33:04.865Z+ sleep 1
6312024-10-15T18:33:05.854Z+ retry=25
6322024-10-15T18:33:05.878Z+ zoneadm list
6332024-10-15T18:33:05.878Z+ grep nexus
6342024-10-15T18:33:05.878Z+ [[ 25 -gt 300 ]]
6352024-10-15T18:33:05.878Z+ sleep 1
6362024-10-15T18:33:06.866Z+ retry=26
6372024-10-15T18:33:06.891Z+ zoneadm list
6382024-10-15T18:33:06.891Z+ grep nexus
6392024-10-15T18:33:06.891Z+ [[ 26 -gt 300 ]]
6402024-10-15T18:33:06.891Z+ sleep 1
6412024-10-15T18:33:07.880Z+ retry=27
6422024-10-15T18:33:07.903Z+ zoneadm list
6432024-10-15T18:33:07.903Z+ grep nexus
6442024-10-15T18:33:07.903Z+ [[ 27 -gt 300 ]]
6452024-10-15T18:33:07.903Z+ sleep 1
6462024-10-15T18:33:08.891Z+ retry=28
6472024-10-15T18:33:08.915Z+ zoneadm list
6482024-10-15T18:33:08.915Z+ grep nexus
6492024-10-15T18:33:08.915Z+ [[ 28 -gt 300 ]]
6502024-10-15T18:33:08.915Z+ sleep 1
6512024-10-15T18:33:09.903Z+ retry=29
6522024-10-15T18:33:09.927Z+ zoneadm list
6532024-10-15T18:33:09.927Z+ grep nexus
6542024-10-15T18:33:09.927Z+ [[ 29 -gt 300 ]]
6552024-10-15T18:33:09.927Z+ sleep 1
6562024-10-15T18:33:10.915Z+ retry=30
6572024-10-15T18:33:10.940Z+ zoneadm list
6582024-10-15T18:33:10.940Z+ grep nexus
6592024-10-15T18:33:10.941Z+ [[ 30 -gt 300 ]]
6602024-10-15T18:33:10.941Z+ sleep 1
6612024-10-15T18:33:11.928Z+ retry=31
6622024-10-15T18:33:11.951Z+ zoneadm list
6632024-10-15T18:33:11.951Z+ grep nexus
6642024-10-15T18:33:11.951Z+ [[ 31 -gt 300 ]]
6652024-10-15T18:33:11.951Z+ sleep 1
6662024-10-15T18:33:12.941Z+ retry=32
6672024-10-15T18:33:12.965Z+ zoneadm list
6682024-10-15T18:33:12.965Z+ grep nexus
6692024-10-15T18:33:12.965Z+ [[ 32 -gt 300 ]]
6702024-10-15T18:33:12.965Z+ sleep 1
6712024-10-15T18:33:13.953Z+ retry=33
6722024-10-15T18:33:13.977Z+ zoneadm list
6732024-10-15T18:33:13.977Z+ grep nexus
6742024-10-15T18:33:13.977Z+ [[ 33 -gt 300 ]]
6752024-10-15T18:33:13.977Z+ sleep 1
6762024-10-15T18:33:14.968Z+ retry=34
6772024-10-15T18:33:14.992Z+ zoneadm list
6782024-10-15T18:33:14.992Z+ grep nexus
6792024-10-15T18:33:14.992Z+ [[ 34 -gt 300 ]]
6802024-10-15T18:33:14.992Z+ sleep 1
6812024-10-15T18:33:15.982Z+ retry=35
6822024-10-15T18:33:16.006Z+ zoneadm list
6832024-10-15T18:33:16.006Z+ grep nexus
6842024-10-15T18:33:16.006Z+ [[ 35 -gt 300 ]]
6852024-10-15T18:33:16.006Z+ sleep 1
6862024-10-15T18:33:16.993Z+ retry=36
6872024-10-15T18:33:17.017Z+ zoneadm list
6882024-10-15T18:33:17.017Z+ grep nexus
6892024-10-15T18:33:17.017Z+ [[ 36 -gt 300 ]]
6902024-10-15T18:33:17.017Z+ sleep 1
6912024-10-15T18:33:18.007Z+ retry=37
6922024-10-15T18:33:18.032Z+ zoneadm list
6932024-10-15T18:33:18.032Z+ grep nexus
6942024-10-15T18:33:18.032Z+ [[ 37 -gt 300 ]]
6952024-10-15T18:33:18.032Z+ sleep 1
6962024-10-15T18:33:19.018Z+ retry=38
6972024-10-15T18:33:19.041Z+ zoneadm list
6982024-10-15T18:33:19.041Z+ grep nexus
6992024-10-15T18:33:19.041Z+ [[ 38 -gt 300 ]]
7002024-10-15T18:33:19.041Z+ sleep 1
7012024-10-15T18:33:20.029Z+ retry=39
7022024-10-15T18:33:20.055Z+ zoneadm list
7032024-10-15T18:33:20.055Z+ grep nexus
7042024-10-15T18:33:20.055Z+ [[ 39 -gt 300 ]]
7052024-10-15T18:33:20.055Z+ sleep 1
7062024-10-15T18:33:21.042Z+ retry=40
7072024-10-15T18:33:21.066Z+ zoneadm list
7082024-10-15T18:33:21.066Z+ grep nexus
7092024-10-15T18:33:21.066Z+ [[ 40 -gt 300 ]]
7102024-10-15T18:33:21.066Z+ sleep 1
7112024-10-15T18:33:22.053Z+ retry=41
7122024-10-15T18:33:22.077Z+ zoneadm list
7132024-10-15T18:33:22.077Z+ grep nexus
7142024-10-15T18:33:22.077Z+ [[ 41 -gt 300 ]]
7152024-10-15T18:33:22.077Z+ sleep 1
7162024-10-15T18:33:23.064Z+ retry=42
7172024-10-15T18:33:23.089Z+ zoneadm list
7182024-10-15T18:33:23.089Z+ grep nexus
7192024-10-15T18:33:23.089Z+ [[ 42 -gt 300 ]]
7202024-10-15T18:33:23.089Z+ sleep 1
7212024-10-15T18:33:24.077Z+ retry=43
7222024-10-15T18:33:24.101Z+ zoneadm list
7232024-10-15T18:33:24.101Z+ grep nexus
7242024-10-15T18:33:24.101Z+ [[ 43 -gt 300 ]]
7252024-10-15T18:33:24.101Z+ sleep 1
7262024-10-15T18:33:25.107Z+ retry=44
7272024-10-15T18:33:25.107Z+ zoneadm list
7282024-10-15T18:33:25.107Z+ grep nexus
7292024-10-15T18:33:25.107Z+ [[ 44 -gt 300 ]]
7302024-10-15T18:33:25.107Z+ sleep 1
7312024-10-15T18:33:26.101Z+ retry=45
7322024-10-15T18:33:26.130Z+ zoneadm list
7332024-10-15T18:33:26.131Z+ grep nexus
7342024-10-15T18:33:26.131Z+ [[ 45 -gt 300 ]]
7352024-10-15T18:33:26.131Z+ sleep 1
7362024-10-15T18:33:27.112Z+ retry=46
7372024-10-15T18:33:27.137Z+ zoneadm list
7382024-10-15T18:33:27.137Z+ grep nexus
7392024-10-15T18:33:27.137Z+ [[ 46 -gt 300 ]]
7402024-10-15T18:33:27.137Z+ sleep 1
7412024-10-15T18:33:28.125Z+ retry=47
7422024-10-15T18:33:28.150Z+ zoneadm list
7432024-10-15T18:33:28.150Z+ grep nexus
7442024-10-15T18:33:28.150Z+ [[ 47 -gt 300 ]]
7452024-10-15T18:33:28.150Z+ sleep 1
7462024-10-15T18:33:29.149Z+ retry=48
7472024-10-15T18:33:29.192Z+ zoneadm list
7482024-10-15T18:33:29.192Z+ grep nexus
7492024-10-15T18:33:29.192Z+ [[ 48 -gt 300 ]]
7502024-10-15T18:33:29.193Z+ sleep 1
7512024-10-15T18:33:30.149Z+ retry=49
7522024-10-15T18:33:30.174Z+ zoneadm list
7532024-10-15T18:33:30.174Z+ grep nexus
7542024-10-15T18:33:30.174Z+ [[ 49 -gt 300 ]]
7552024-10-15T18:33:30.174Z+ sleep 1
7562024-10-15T18:33:31.163Z+ retry=50
7572024-10-15T18:33:31.188Z+ zoneadm list
7582024-10-15T18:33:31.188Z+ grep nexus
7592024-10-15T18:33:31.188Z+ [[ 50 -gt 300 ]]
7602024-10-15T18:33:31.188Z+ sleep 1
7612024-10-15T18:33:32.176Z+ retry=51
7622024-10-15T18:33:32.202Z+ zoneadm list
7632024-10-15T18:33:32.202Z+ grep nexus
7642024-10-15T18:33:32.202Z+ [[ 51 -gt 300 ]]
7652024-10-15T18:33:32.202Z+ sleep 1
7662024-10-15T18:33:33.186Z+ retry=52
7672024-10-15T18:33:33.211Z+ zoneadm list
7682024-10-15T18:33:33.211Z+ grep nexus
7692024-10-15T18:33:33.211Z+ [[ 52 -gt 300 ]]
7702024-10-15T18:33:33.211Z+ sleep 1
7712024-10-15T18:33:34.199Z+ retry=53
7722024-10-15T18:33:34.224Z+ zoneadm list
7732024-10-15T18:33:34.224Z+ grep nexus
7742024-10-15T18:33:34.224Z+ [[ 53 -gt 300 ]]
7752024-10-15T18:33:34.224Z+ sleep 1
7762024-10-15T18:33:35.218Z+ retry=54
7772024-10-15T18:33:35.242Z+ zoneadm list
7782024-10-15T18:33:35.242Z+ grep nexus
7792024-10-15T18:33:35.269Z+ [[ 54 -gt 300 ]]
7802024-10-15T18:33:35.269Z+ sleep 1
7812024-10-15T18:33:36.278Z+ retry=55
7822024-10-15T18:33:36.303Z+ zoneadm list
7832024-10-15T18:33:36.303Z+ grep nexus
7842024-10-15T18:33:36.303Z+ [[ 55 -gt 300 ]]
7852024-10-15T18:33:36.303Z+ sleep 1
7862024-10-15T18:33:37.299Z+ retry=56
7872024-10-15T18:33:37.324Z+ zoneadm list
7882024-10-15T18:33:37.324Z+ grep nexus
7892024-10-15T18:33:37.324Z+ [[ 56 -gt 300 ]]
7902024-10-15T18:33:37.324Z+ sleep 1
7912024-10-15T18:33:38.342Z+ retry=57
7922024-10-15T18:33:38.342Z+ zoneadm list
7932024-10-15T18:33:38.342Z+ grep nexus
7942024-10-15T18:33:38.369Z+ [[ 57 -gt 300 ]]
7952024-10-15T18:33:38.369Z+ sleep 1
7962024-10-15T18:33:39.350Z+ retry=58
7972024-10-15T18:33:39.374Z+ zoneadm list
7982024-10-15T18:33:39.374Z+ grep nexus
7992024-10-15T18:33:39.374Z+ [[ 58 -gt 300 ]]
8002024-10-15T18:33:39.374Z+ sleep 1
8012024-10-15T18:33:40.384Z+ retry=59
8022024-10-15T18:33:40.417Z+ zoneadm list
8032024-10-15T18:33:40.417Z+ grep nexus
8042024-10-15T18:33:40.418Zoxz_nexus_543f63f0-ceb2-4804-8c76-8af5affedc82
8052024-10-15T18:33:40.418Z+ echo 'Waited for nexus: 59s'
8062024-10-15T18:33:40.418ZWaited for nexus: 59s
8072024-10-15T18:33:40.418Z+ export RUST_BACKTRACE=1
8082024-10-15T18:33:40.418Z+ RUST_BACKTRACE=1
8092024-10-15T18:33:40.419Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8102024-10-15T18:33:40.419Z++ ./target/debug/bootstrap
8112024-10-15T18:33:40.598ZUsing external DNS server at 10.151.2.164:53
8122024-10-15T18:33:40.778Z2024-10-15 18:33:40.764453445 UTC: attempting to log into API
8132024-10-15T18:33:55.924Z2024-10-15 18:33:55.909392958 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8142024-10-15T18:33:56.927Z2024-10-15 18:33:56.914078538 UTC: attempting to log into API
 
8152024-10-15T18:33:57.219ZOct 15 18:33:56 sock ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
8162024-10-15T18:33:57.253ZOct 15 18:33:56 sock ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
8172024-10-15T18:33:57.851ZOct 15 18:33:57 sock ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
8182024-10-15T18:33:58.435ZOct 15 18:33:57 sock ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
8192024-10-15T18:33:58.746ZOct 15 18:33:58 sock ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
 
8202024-10-15T18:34:11.964Z2024-10-15 18:34:11.947807864 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8212024-10-15T18:34:12.962Z2024-10-15 18:34:12.948984275 UTC: attempting to log into API
8222024-10-15T18:34:28.013Z2024-10-15 18:34:27.982601679 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8232024-10-15T18:34:33.261Z2024-10-15 18:34:28.983853960 UTC: attempting to log into API
8242024-10-15T18:34:44.029Z2024-10-15 18:34:44.017242641 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8252024-10-15T18:34:45.139Z2024-10-15 18:34:45.018522551 UTC: attempting to log into API
8262024-10-15T18:34:50.947Z2024-10-15 18:34:50.935994980 UTC: login succeeded
8272024-10-15T18:34:50.980Zwaiting for nexus to come up...
8282024-10-15T18:34:51.183Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8292024-10-15T18:34:51.478Zsetting up quotas...
8302024-10-15T18:34:51.545Zensuring datasets are ready...
8312024-10-15T18:34:55.425Zlet's roll.
8322024-10-15T18:34:55.450Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8332024-10-15T18:34:55.450ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8342024-10-15T18:34:55.450ZOXIDE_TOKEN=oxide-token-85f48664db72d0a944fcf8a2102463162a17ac17'
8352024-10-15T18:34:55.450Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8362024-10-15T18:34:55.450Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8372024-10-15T18:34:55.450Z++ OXIDE_TOKEN=oxide-token-85f48664db72d0a944fcf8a2102463162a17ac17
8382024-10-15T18:34:55.450Z+ export OXIDE_HOST OXIDE_TOKEN
8392024-10-15T18:34:55.450Z+ retry=0
8402024-10-15T18:34:55.450Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8412024-10-15T18:34:55.474Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8422024-10-15T18:34:55.474Z+ [[ 0 -gt 60 ]]
8432024-10-15T18:34:55.474Z+ sleep 1
8442024-10-15T18:34:56.456Z+ retry=1
8452024-10-15T18:34:56.456Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8462024-10-15T18:34:56.480Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8472024-10-15T18:34:56.480Z+ [[ 1 -gt 60 ]]
8482024-10-15T18:34:56.480Z+ sleep 1
8492024-10-15T18:34:57.473Z+ retry=2
8502024-10-15T18:34:57.473Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8512024-10-15T18:34:57.497Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8522024-10-15T18:34:57.497Z+ [[ 2 -gt 60 ]]
8532024-10-15T18:34:57.497Z+ sleep 1
8542024-10-15T18:34:58.489Z+ retry=3
8552024-10-15T18:34:58.489Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8562024-10-15T18:34:58.513Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8572024-10-15T18:34:58.513Z+ [[ 3 -gt 60 ]]
8582024-10-15T18:34:58.513Z+ sleep 1
8592024-10-15T18:34:59.505Z+ retry=4
8602024-10-15T18:34:59.505Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8612024-10-15T18:34:59.529Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8622024-10-15T18:34:59.529Z+ [[ 4 -gt 60 ]]
8632024-10-15T18:34:59.529Z+ sleep 1
8642024-10-15T18:35:00.521Z+ retry=5
8652024-10-15T18:35:00.521Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8662024-10-15T18:35:00.545Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8672024-10-15T18:35:00.545Z+ [[ 5 -gt 60 ]]
8682024-10-15T18:35:00.545Z+ sleep 1
8692024-10-15T18:35:01.536Z+ retry=6
8702024-10-15T18:35:01.536Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8712024-10-15T18:35:01.568Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8722024-10-15T18:35:01.568Z+ [[ 6 -gt 60 ]]
8732024-10-15T18:35:01.568Z+ sleep 1
8742024-10-15T18:35:02.553Z+ retry=7
8752024-10-15T18:35:02.553Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8762024-10-15T18:35:02.577Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8772024-10-15T18:35:02.577Z+ [[ 7 -gt 60 ]]
8782024-10-15T18:35:02.577Z+ sleep 1
8792024-10-15T18:35:03.569Z+ retry=8
8802024-10-15T18:35:03.569Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8812024-10-15T18:35:03.593Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8822024-10-15T18:35:03.593Z+ [[ 8 -gt 60 ]]
8832024-10-15T18:35:03.593Z+ sleep 1
8842024-10-15T18:35:04.585Z+ retry=9
8852024-10-15T18:35:04.585Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8862024-10-15T18:35:04.609Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8872024-10-15T18:35:04.609Z+ [[ 9 -gt 60 ]]
8882024-10-15T18:35:04.609Z+ sleep 1
8892024-10-15T18:35:05.600Z+ retry=10
8902024-10-15T18:35:05.600Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8912024-10-15T18:35:05.624Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8922024-10-15T18:35:05.624Z+ [[ 10 -gt 60 ]]
8932024-10-15T18:35:05.624Z+ sleep 1
8942024-10-15T18:35:06.616Z+ retry=11
8952024-10-15T18:35:06.616Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8962024-10-15T18:35:06.641Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8972024-10-15T18:35:06.641Z+ [[ 11 -gt 60 ]]
8982024-10-15T18:35:06.641Z+ sleep 1
8992024-10-15T18:35:07.631Z+ retry=12
9002024-10-15T18:35:07.631Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9012024-10-15T18:35:07.655Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9022024-10-15T18:35:07.655Z+ [[ 12 -gt 60 ]]
9032024-10-15T18:35:07.655Z+ sleep 1
9042024-10-15T18:35:08.648Z+ retry=13
9052024-10-15T18:35:08.648Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9062024-10-15T18:35:08.730Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9072024-10-15T18:35:09.725Z{"status":"ok"}success
9082024-10-15T18:35:09.725ZProject {
9092024-10-15T18:35:09.750Z description: "some images",
9102024-10-15T18:35:09.750Z id: bf102cdb-2d64-4cd6-b1ec-1a0b79c1fc66,
9112024-10-15T18:35:09.750Z name: Name(
9122024-10-15T18:35:09.750Z "images",
9132024-10-15T18:35:09.750Z ),
9142024-10-15T18:35:09.750Z time_created: 2024-10-15T18:35:08.917949Z,
9152024-10-15T18:35:09.750Z time_modified: 2024-10-15T18:35:08.917949Z,
9162024-10-15T18:35:09.750Z}
9172024-10-15T18:35:09.750Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
9182024-10-15T18:38:11.849ZOct 15 18:38:11 sock xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:23.150.40.242:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
9192024-10-15T18:38:36.552Zdone!
9202024-10-15T18:38:36.655Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9212024-10-15T18:38:36.832Zsuccess
9222024-10-15T18:38:36.832ZImage {
9232024-10-15T18:38:36.832Z block_size: ByteCount(
9242024-10-15T18:38:36.856Z 512,
9252024-10-15T18:38:36.856Z ),
9262024-10-15T18:38:36.856Z description: "debian 11 original base image",
9272024-10-15T18:38:36.856Z digest: None,
9282024-10-15T18:38:36.857Z id: edf305e0-34ac-4a27-8fe7-04d559dc3f84,
9292024-10-15T18:38:36.857Z name: Name(
9302024-10-15T18:38:36.857Z "debian11",
9312024-10-15T18:38:36.857Z ),
9322024-10-15T18:38:36.857Z os: "debian",
9332024-10-15T18:38:36.858Z project_id: None,
9342024-10-15T18:38:36.858Z size: ByteCount(
9352024-10-15T18:38:36.858Z 2147483648,
9362024-10-15T18:38:36.858Z ),
9372024-10-15T18:38:36.858Z time_created: 2024-10-15T18:38:36.448457Z,
9382024-10-15T18:38:36.858Z time_modified: 2024-10-15T18:38:36.806007Z,
9392024-10-15T18:38:36.858Z url: None,
9402024-10-15T18:38:36.858Z version: "11",
9412024-10-15T18:38:36.858Z}
9422024-10-15T18:38:36.858Z+ for test_bin in tests/*
9432024-10-15T18:38:36.858Z+ ./tests/bootstrap-ea4c653164c89ba6
9442024-10-15T18:38:36.858Z
9452024-10-15T18:38:36.858Zrunning 0 tests
9462024-10-15T18:38:36.858Z
9472024-10-15T18:38:36.858Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9482024-10-15T18:38:36.858Z
9492024-10-15T18:38:36.858Z+ for test_bin in tests/*
9502024-10-15T18:38:36.858Z+ ./tests/commtest-97870a8881adccd9
9512024-10-15T18:38:36.883Z
9522024-10-15T18:38:36.883Zrunning 0 tests
9532024-10-15T18:38:36.883Z
9542024-10-15T18:38:36.883Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9552024-10-15T18:38:36.883Z
9562024-10-15T18:38:36.883Z+ for test_bin in tests/*
9572024-10-15T18:38:36.883Z+ ./tests/dhcp_server-0952d33d035a67a9
9582024-10-15T18:38:36.907Z
9592024-10-15T18:38:36.908Zrunning 0 tests
9602024-10-15T18:38:36.909Z
9612024-10-15T18:38:36.909Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9622024-10-15T18:38:36.909Z
9632024-10-15T18:38:36.909Z+ for test_bin in tests/*
9642024-10-15T18:38:36.909Z+ ./tests/end_to_end_tests-2736cc1341c5714d
9652024-10-15T18:38:36.952Z
9662024-10-15T18:38:36.952Zrunning 2 tests
9672024-10-15T18:38:37.202Ztest no_spoof::no_spoof_here ... ok
9682024-10-15T18:39:09.082Ztest instance_launch::instance_launch ... ok
9692024-10-15T18:39:09.082Z
9702024-10-15T18:39:09.106Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 32.13s
9712024-10-15T18:39:09.106Z
9722024-10-15T18:39:09.106Z+ _exit_trap
9732024-10-15T18:39:09.106Z+ local status=0
9742024-10-15T18:39:09.106Z+ set +o errexit
9752024-10-15T18:39:09.106Z+ [[ xf3002b356da7d0e4ca15beb66a5566a92919baaa != \x ]]
9762024-10-15T18:39:09.106Z+ pfexec cp /tmp/opteadm /opt/oxide/opte/bin/opteadm
9772024-10-15T18:39:09.436Z+ pfexec svcadm -Z disable -s cron
9782024-10-15T18:39:11.313Z+ [[ 0 -eq 0 ]]
9792024-10-15T18:39:11.313Z+ exit 0
9802024-10-15T18:39:11.374Zprocess exited: duration 494787 ms, exit code 0
 
9812024-10-15T18:39:11.482Zfound 109 output files
9822024-10-15T18:39:11.482Zuploading: /var/svc/log/oxide-sled-agent:default.log (813251 bytes)
9832024-10-15T18:39:12.773Zuploaded: /var/svc/log/oxide-sled-agent:default.log
9842024-10-15T18:39:12.773Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (3819167 bytes)
9852024-10-15T18:39:13.200Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 3819167 -> 3833339
9862024-10-15T18:39:14.270Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
9872024-10-15T18:39:14.270Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (36289 bytes)
9882024-10-15T18:39:15.439Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
9892024-10-15T18:39:15.439Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (141570 bytes)
9902024-10-15T18:39:15.603Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 141570 -> 145496
9912024-10-15T18:39:16.673Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
9922024-10-15T18:39:16.673Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (202512 bytes)
9932024-10-15T18:39:16.880Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 202512 -> 204492
9942024-10-15T18:39:17.950Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
9952024-10-15T18:39:17.950Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1135632 bytes)
9962024-10-15T18:39:18.248Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1135632 -> 1157279
9972024-10-15T18:39:19.319Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
9982024-10-15T18:39:19.319Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (2666100 bytes)
9992024-10-15T18:39:19.672Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 2666100 -> 2720194
10002024-10-15T18:39:20.742Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10012024-10-15T18:39:20.742Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (3334 bytes)
10022024-10-15T18:39:21.837Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10032024-10-15T18:39:21.837Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (206289 bytes)
10042024-10-15T18:39:22.042Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 206289 -> 210948
10052024-10-15T18:39:23.113Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10062024-10-15T18:39:23.113Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (6100 bytes)
10072024-10-15T18:39:24.206Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10082024-10-15T18:39:24.206Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3833 bytes)
10092024-10-15T18:39:25.300Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10102024-10-15T18:39:25.300Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (8456 bytes)
10112024-10-15T18:39:26.416Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
10122024-10-15T18:39:26.416Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-crucible-agent:default.log (20612 bytes)
10132024-10-15T18:39:27.555Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-crucible-agent:default.log
10142024-10-15T18:39:27.555Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10152024-10-15T18:39:28.649Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-crucible-downstairs:default.log
10162024-10-15T18:39:28.649Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-crucible-downstairs:downstairs-07c62893-3d15-47a6-baa5-425a07183091.log (6073 bytes)
10172024-10-15T18:39:29.747Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-crucible-downstairs:downstairs-07c62893-3d15-47a6-baa5-425a07183091.log
10182024-10-15T18:39:29.747Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-crucible-downstairs:snapshot-07c62893-3d15-47a6-baa5-425a07183091-ce2f6fef-bd4d-47ae-91f4-0278e1dbca27.log (5689 bytes)
10192024-10-15T18:39:30.841Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-crucible-downstairs:snapshot-07c62893-3d15-47a6-baa5-425a07183091-ce2f6fef-bd4d-47ae-91f4-0278e1dbca27.log
10202024-10-15T18:39:30.841Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
10212024-10-15T18:39:31.940Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_cd2495c2-7503-45e3-b094-f2eb6de109f1/root/var/svc/log/oxide-zone-network-setup:default.log
10222024-10-15T18:39:31.940Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_1d443571-957b-4845-a9b1-0ed09303cf8e/root/var/svc/log/oxide-crucible-pantry:default.log (42721 bytes)
10232024-10-15T18:39:33.101Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_1d443571-957b-4845-a9b1-0ed09303cf8e/root/var/svc/log/oxide-crucible-pantry:default.log
10242024-10-15T18:39:33.101Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_1d443571-957b-4845-a9b1-0ed09303cf8e/root/var/svc/log/oxide-zone-network-setup:default.log (2139 bytes)
10252024-10-15T18:39:34.199Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_1d443571-957b-4845-a9b1-0ed09303cf8e/root/var/svc/log/oxide-zone-network-setup:default.log
10262024-10-15T18:39:34.199Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_35a99cfe-7ea8-4221-86a7-963387b90d09/root/var/svc/log/oxide-crucible-pantry:default.log (42724 bytes)
10272024-10-15T18:39:34.312Zupload warning: file "/pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_35a99cfe-7ea8-4221-86a7-963387b90d09/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 42724 -> 45768
10282024-10-15T18:39:35.382Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_35a99cfe-7ea8-4221-86a7-963387b90d09/root/var/svc/log/oxide-crucible-pantry:default.log
10292024-10-15T18:39:35.382Zuploading: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_35a99cfe-7ea8-4221-86a7-963387b90d09/root/var/svc/log/oxide-zone-network-setup:default.log (2139 bytes)
10302024-10-15T18:39:36.476Zuploaded: /pool/ext/08eb30ef-f106-403d-980b-fe3c401faf27/crypt/zone/oxz_crucible_pantry_35a99cfe-7ea8-4221-86a7-963387b90d09/root/var/svc/log/oxide-zone-network-setup:default.log
10312024-10-15T18:39:36.476Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_cockroachdb_9eca9035-3561-4f2a-b35c-90493a0315af/root/var/svc/log/oxide-cockroach-admin:default.log (3754 bytes)
10322024-10-15T18:39:37.570Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_cockroachdb_9eca9035-3561-4f2a-b35c-90493a0315af/root/var/svc/log/oxide-cockroach-admin:default.log
10332024-10-15T18:39:37.570Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_cockroachdb_9eca9035-3561-4f2a-b35c-90493a0315af/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
10342024-10-15T18:39:38.665Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_cockroachdb_9eca9035-3561-4f2a-b35c-90493a0315af/root/var/svc/log/oxide-cockroachdb:default.log
10352024-10-15T18:39:38.665Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_cockroachdb_9eca9035-3561-4f2a-b35c-90493a0315af/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
10362024-10-15T18:39:39.760Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_cockroachdb_9eca9035-3561-4f2a-b35c-90493a0315af/root/var/svc/log/oxide-zone-network-setup:default.log
10372024-10-15T18:39:39.760Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_crucible_a372449f-a2b0-4d65-8db5-c7348064f145/root/var/svc/log/oxide-crucible-agent:default.log (12971 bytes)
10382024-10-15T18:39:40.877Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_crucible_a372449f-a2b0-4d65-8db5-c7348064f145/root/var/svc/log/oxide-crucible-agent:default.log
10392024-10-15T18:39:40.877Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_crucible_a372449f-a2b0-4d65-8db5-c7348064f145/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10402024-10-15T18:39:41.973Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_crucible_a372449f-a2b0-4d65-8db5-c7348064f145/root/var/svc/log/oxide-crucible-downstairs:default.log
10412024-10-15T18:39:41.973Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_crucible_a372449f-a2b0-4d65-8db5-c7348064f145/root/var/svc/log/oxide-crucible-downstairs:downstairs-524c49ec-f48e-4d3a-a4d1-850696ee5961.log (3126 bytes)
10422024-10-15T18:39:43.067Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_crucible_a372449f-a2b0-4d65-8db5-c7348064f145/root/var/svc/log/oxide-crucible-downstairs:downstairs-524c49ec-f48e-4d3a-a4d1-850696ee5961.log
10432024-10-15T18:39:43.067Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_crucible_a372449f-a2b0-4d65-8db5-c7348064f145/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
10442024-10-15T18:39:44.162Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_crucible_a372449f-a2b0-4d65-8db5-c7348064f145/root/var/svc/log/oxide-zone-network-setup:default.log
10452024-10-15T18:39:44.162Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_internal_dns_46cd17b2-bb3e-410a-8d30-acf5a013c4f8/root/var/svc/log/oxide-internal_dns:default.log (416961 bytes)
10462024-10-15T18:39:45.445Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_internal_dns_46cd17b2-bb3e-410a-8d30-acf5a013c4f8/root/var/svc/log/oxide-internal_dns:default.log
10472024-10-15T18:39:45.446Zuploading: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_internal_dns_46cd17b2-bb3e-410a-8d30-acf5a013c4f8/root/var/svc/log/oxide-zone-network-setup:default.log (2092 bytes)
10482024-10-15T18:39:46.539Zuploaded: /pool/ext/16c9b9f3-ec41-4058-9aa6-27bbfb9792d3/crypt/zone/oxz_internal_dns_46cd17b2-bb3e-410a-8d30-acf5a013c4f8/root/var/svc/log/oxide-zone-network-setup:default.log
10492024-10-15T18:39:46.539Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-clickhouse-admin-keeper:default.log (2205 bytes)
10502024-10-15T18:39:47.633Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-clickhouse-admin-keeper:default.log
10512024-10-15T18:39:47.633Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-clickhouse-admin-server:default.log (2201 bytes)
10522024-10-15T18:39:48.729Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-clickhouse-admin-server:default.log
10532024-10-15T18:39:48.729Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-clickhouse:default.log (2607716 bytes)
10542024-10-15T18:39:49.089Zupload warning: file "/pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2607716 -> 2865448
10552024-10-15T18:39:50.159Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-clickhouse:default.log
10562024-10-15T18:39:50.159Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-zone-network-setup:default.log (2095 bytes)
10572024-10-15T18:39:51.254Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_clickhouse_16bf0823-c152-4c47-9aac-7ae5fc8ce0e5/root/var/svc/log/oxide-zone-network-setup:default.log
10582024-10-15T18:39:51.254Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_cockroachdb_bb218f6d-d8d4-40f0-95dd-699da11ad83c/root/var/svc/log/oxide-cockroach-admin:default.log (3754 bytes)
10592024-10-15T18:39:52.347Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_cockroachdb_bb218f6d-d8d4-40f0-95dd-699da11ad83c/root/var/svc/log/oxide-cockroach-admin:default.log
10602024-10-15T18:39:52.347Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_cockroachdb_bb218f6d-d8d4-40f0-95dd-699da11ad83c/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
10612024-10-15T18:39:53.445Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_cockroachdb_bb218f6d-d8d4-40f0-95dd-699da11ad83c/root/var/svc/log/oxide-cockroachdb:default.log
10622024-10-15T18:39:53.445Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_cockroachdb_bb218f6d-d8d4-40f0-95dd-699da11ad83c/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
10632024-10-15T18:39:54.538Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_cockroachdb_bb218f6d-d8d4-40f0-95dd-699da11ad83c/root/var/svc/log/oxide-zone-network-setup:default.log
10642024-10-15T18:39:54.538Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_crucible_f0098391-e25f-47ce-98db-0c870c28a2ec/root/var/svc/log/oxide-crucible-agent:default.log (12970 bytes)
10652024-10-15T18:39:55.660Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_crucible_f0098391-e25f-47ce-98db-0c870c28a2ec/root/var/svc/log/oxide-crucible-agent:default.log
10662024-10-15T18:39:55.660Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_crucible_f0098391-e25f-47ce-98db-0c870c28a2ec/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10672024-10-15T18:39:56.754Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_crucible_f0098391-e25f-47ce-98db-0c870c28a2ec/root/var/svc/log/oxide-crucible-downstairs:default.log
10682024-10-15T18:39:56.754Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_crucible_f0098391-e25f-47ce-98db-0c870c28a2ec/root/var/svc/log/oxide-crucible-downstairs:downstairs-06a6c74f-c875-4b1f-92df-ddbbcade942f.log (5997 bytes)
10692024-10-15T18:39:57.848Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_crucible_f0098391-e25f-47ce-98db-0c870c28a2ec/root/var/svc/log/oxide-crucible-downstairs:downstairs-06a6c74f-c875-4b1f-92df-ddbbcade942f.log
10702024-10-15T18:39:57.848Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_crucible_f0098391-e25f-47ce-98db-0c870c28a2ec/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
10712024-10-15T18:39:58.941Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_crucible_f0098391-e25f-47ce-98db-0c870c28a2ec/root/var/svc/log/oxide-zone-network-setup:default.log
10722024-10-15T18:39:58.943Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_external_dns_4579e4d4-788a-4a55-991f-cbafedaed68f/root/var/svc/log/oxide-external_dns:default.log (23130 bytes)
10732024-10-15T18:40:00.109Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_external_dns_4579e4d4-788a-4a55-991f-cbafedaed68f/root/var/svc/log/oxide-external_dns:default.log
10742024-10-15T18:40:00.109Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_external_dns_4579e4d4-788a-4a55-991f-cbafedaed68f/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
10752024-10-15T18:40:01.174Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_external_dns_4579e4d4-788a-4a55-991f-cbafedaed68f/root/var/svc/log/oxide-opte-interface-setup:default.log
10762024-10-15T18:40:01.174Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_external_dns_4579e4d4-788a-4a55-991f-cbafedaed68f/root/var/svc/log/oxide-zone-network-setup:default.log (2113 bytes)
10772024-10-15T18:40:02.270Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_external_dns_4579e4d4-788a-4a55-991f-cbafedaed68f/root/var/svc/log/oxide-zone-network-setup:default.log
10782024-10-15T18:40:02.270Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_internal_dns_492daba3-c202-426b-8bba-704896cf06ae/root/var/svc/log/oxide-internal_dns:default.log (419368 bytes)
10792024-10-15T18:40:03.551Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_internal_dns_492daba3-c202-426b-8bba-704896cf06ae/root/var/svc/log/oxide-internal_dns:default.log
10802024-10-15T18:40:03.551Zuploading: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_internal_dns_492daba3-c202-426b-8bba-704896cf06ae/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
10812024-10-15T18:40:04.646Zuploaded: /pool/ext/2de1de63-916d-41a7-aad9-8c2c422d0bf1/crypt/zone/oxz_internal_dns_492daba3-c202-426b-8bba-704896cf06ae/root/var/svc/log/oxide-zone-network-setup:default.log
10822024-10-15T18:40:04.669Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_cockroachdb_7ed6d2d2-f1d8-435a-ad23-3a0a60a5b750/root/var/svc/log/oxide-cockroach-admin:default.log (3754 bytes)
10832024-10-15T18:40:05.738Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_cockroachdb_7ed6d2d2-f1d8-435a-ad23-3a0a60a5b750/root/var/svc/log/oxide-cockroach-admin:default.log
10842024-10-15T18:40:05.738Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_cockroachdb_7ed6d2d2-f1d8-435a-ad23-3a0a60a5b750/root/var/svc/log/oxide-cockroachdb:default.log (4289 bytes)
10852024-10-15T18:40:06.831Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_cockroachdb_7ed6d2d2-f1d8-435a-ad23-3a0a60a5b750/root/var/svc/log/oxide-cockroachdb:default.log
10862024-10-15T18:40:06.832Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_cockroachdb_7ed6d2d2-f1d8-435a-ad23-3a0a60a5b750/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
10872024-10-15T18:40:07.925Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_cockroachdb_7ed6d2d2-f1d8-435a-ad23-3a0a60a5b750/root/var/svc/log/oxide-zone-network-setup:default.log
10882024-10-15T18:40:07.925Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_crucible_75f63bf7-5178-47ce-8ca3-c68f56c3c3c3/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
10892024-10-15T18:40:09.024Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_crucible_75f63bf7-5178-47ce-8ca3-c68f56c3c3c3/root/var/svc/log/oxide-crucible-agent:default.log
10902024-10-15T18:40:09.024Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_crucible_75f63bf7-5178-47ce-8ca3-c68f56c3c3c3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10912024-10-15T18:40:10.118Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_crucible_75f63bf7-5178-47ce-8ca3-c68f56c3c3c3/root/var/svc/log/oxide-crucible-downstairs:default.log
10922024-10-15T18:40:10.118Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_crucible_75f63bf7-5178-47ce-8ca3-c68f56c3c3c3/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
10932024-10-15T18:40:11.210Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_crucible_75f63bf7-5178-47ce-8ca3-c68f56c3c3c3/root/var/svc/log/oxide-zone-network-setup:default.log
10942024-10-15T18:40:11.210Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_external_dns_02029ee5-f1fa-40e2-92b6-2f5d379b3f3a/root/var/svc/log/oxide-external_dns:default.log (23132 bytes)
10952024-10-15T18:40:11.300Zupload warning: file "/pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_external_dns_02029ee5-f1fa-40e2-92b6-2f5d379b3f3a/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 23132 -> 26911
10962024-10-15T18:40:12.368Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_external_dns_02029ee5-f1fa-40e2-92b6-2f5d379b3f3a/root/var/svc/log/oxide-external_dns:default.log
10972024-10-15T18:40:12.368Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_external_dns_02029ee5-f1fa-40e2-92b6-2f5d379b3f3a/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
10982024-10-15T18:40:13.460Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_external_dns_02029ee5-f1fa-40e2-92b6-2f5d379b3f3a/root/var/svc/log/oxide-opte-interface-setup:default.log
10992024-10-15T18:40:13.460Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_external_dns_02029ee5-f1fa-40e2-92b6-2f5d379b3f3a/root/var/svc/log/oxide-zone-network-setup:default.log (2112 bytes)
11002024-10-15T18:40:14.554Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_external_dns_02029ee5-f1fa-40e2-92b6-2f5d379b3f3a/root/var/svc/log/oxide-zone-network-setup:default.log
11012024-10-15T18:40:14.554Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_internal_dns_5f30594e-7d42-4c59-9ee3-8b012d9634c1/root/var/svc/log/oxide-internal_dns:default.log (416965 bytes)
11022024-10-15T18:40:14.785Zupload warning: file "/pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_internal_dns_5f30594e-7d42-4c59-9ee3-8b012d9634c1/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 416965 -> 420721
11032024-10-15T18:40:15.853Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_internal_dns_5f30594e-7d42-4c59-9ee3-8b012d9634c1/root/var/svc/log/oxide-internal_dns:default.log
11042024-10-15T18:40:15.853Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_internal_dns_5f30594e-7d42-4c59-9ee3-8b012d9634c1/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
11052024-10-15T18:40:16.945Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_internal_dns_5f30594e-7d42-4c59-9ee3-8b012d9634c1/root/var/svc/log/oxide-zone-network-setup:default.log
11062024-10-15T18:40:16.945Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_nexus_543f63f0-ceb2-4804-8c76-8af5affedc82/root/var/svc/log/oxide-nexus:default.log (4584519 bytes)
11072024-10-15T18:40:17.536Zupload warning: file "/pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_nexus_543f63f0-ceb2-4804-8c76-8af5affedc82/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 4584519 -> 5057764
11082024-10-15T18:40:18.604Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_nexus_543f63f0-ceb2-4804-8c76-8af5affedc82/root/var/svc/log/oxide-nexus:default.log
11092024-10-15T18:40:18.605Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_nexus_543f63f0-ceb2-4804-8c76-8af5affedc82/root/var/svc/log/oxide-opte-interface-setup:default.log (1133 bytes)
11102024-10-15T18:40:19.698Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_nexus_543f63f0-ceb2-4804-8c76-8af5affedc82/root/var/svc/log/oxide-opte-interface-setup:default.log
11112024-10-15T18:40:19.698Zuploading: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_nexus_543f63f0-ceb2-4804-8c76-8af5affedc82/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
11122024-10-15T18:40:20.790Zuploaded: /pool/ext/43046e3c-d342-412d-8595-be6594352e05/crypt/zone/oxz_nexus_543f63f0-ceb2-4804-8c76-8af5affedc82/root/var/svc/log/oxide-zone-network-setup:default.log
11132024-10-15T18:40:20.790Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_cockroachdb_e43b6c8a-5b90-442b-ab00-346e8c71a07c/root/var/svc/log/oxide-cockroach-admin:default.log (3754 bytes)
11142024-10-15T18:40:21.881Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_cockroachdb_e43b6c8a-5b90-442b-ab00-346e8c71a07c/root/var/svc/log/oxide-cockroach-admin:default.log
11152024-10-15T18:40:21.881Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_cockroachdb_e43b6c8a-5b90-442b-ab00-346e8c71a07c/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11162024-10-15T18:40:22.976Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_cockroachdb_e43b6c8a-5b90-442b-ab00-346e8c71a07c/root/var/svc/log/oxide-cockroachdb:default.log
11172024-10-15T18:40:22.976Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_cockroachdb_e43b6c8a-5b90-442b-ab00-346e8c71a07c/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
11182024-10-15T18:40:24.068Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_cockroachdb_e43b6c8a-5b90-442b-ab00-346e8c71a07c/root/var/svc/log/oxide-zone-network-setup:default.log
11192024-10-15T18:40:24.068Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-crucible-agent:default.log (23450 bytes)
11202024-10-15T18:40:25.203Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-crucible-agent:default.log
11212024-10-15T18:40:25.203Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11222024-10-15T18:40:26.296Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-crucible-downstairs:default.log
11232024-10-15T18:40:26.297Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-crucible-downstairs:downstairs-50b4de23-9df0-4bdd-8928-d4ce27591b8b.log (3125 bytes)
11242024-10-15T18:40:27.390Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-crucible-downstairs:downstairs-50b4de23-9df0-4bdd-8928-d4ce27591b8b.log
11252024-10-15T18:40:27.390Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-crucible-downstairs:downstairs-bf13b549-39e4-4977-9930-538d9ee165c5.log (5995 bytes)
11262024-10-15T18:40:28.482Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-crucible-downstairs:downstairs-bf13b549-39e4-4977-9930-538d9ee165c5.log
11272024-10-15T18:40:28.482Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
11282024-10-15T18:40:29.574Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_crucible_85d16807-bc95-4323-aebc-e85081957c18/root/var/svc/log/oxide-zone-network-setup:default.log
11292024-10-15T18:40:29.574Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_nexus_ce9e6131-8cf6-4afe-a294-67fe2ffcf1a6/root/var/svc/log/oxide-nexus:default.log (36230526 bytes)
11302024-10-15T18:40:32.141Zupload warning: file "/pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_nexus_ce9e6131-8cf6-4afe-a294-67fe2ffcf1a6/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36230526 -> 36593129
11312024-10-15T18:40:33.210Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_nexus_ce9e6131-8cf6-4afe-a294-67fe2ffcf1a6/root/var/svc/log/oxide-nexus:default.log
11322024-10-15T18:40:33.210Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_nexus_ce9e6131-8cf6-4afe-a294-67fe2ffcf1a6/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11332024-10-15T18:40:34.304Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_nexus_ce9e6131-8cf6-4afe-a294-67fe2ffcf1a6/root/var/svc/log/oxide-opte-interface-setup:default.log
11342024-10-15T18:40:34.304Zuploading: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_nexus_ce9e6131-8cf6-4afe-a294-67fe2ffcf1a6/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
11352024-10-15T18:40:35.396Zuploaded: /pool/ext/5a14f3e2-c2af-4439-98e4-764b2dbe5d6c/crypt/zone/oxz_nexus_ce9e6131-8cf6-4afe-a294-67fe2ffcf1a6/root/var/svc/log/oxide-zone-network-setup:default.log
11362024-10-15T18:40:35.396Zuploading: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-crucible-agent:default.log (20605 bytes)
11372024-10-15T18:40:36.511Zuploaded: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-crucible-agent:default.log
11382024-10-15T18:40:36.511Zuploading: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11392024-10-15T18:40:37.602Zuploaded: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-crucible-downstairs:default.log
11402024-10-15T18:40:37.603Zuploading: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-crucible-downstairs:downstairs-84433a4a-64de-4ea7-b7b1-4ee002bc06e5.log (6078 bytes)
11412024-10-15T18:40:38.695Zuploaded: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-crucible-downstairs:downstairs-84433a4a-64de-4ea7-b7b1-4ee002bc06e5.log
11422024-10-15T18:40:38.695Zuploading: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-crucible-downstairs:snapshot-84433a4a-64de-4ea7-b7b1-4ee002bc06e5-ce2f6fef-bd4d-47ae-91f4-0278e1dbca27.log (5686 bytes)
11432024-10-15T18:40:39.786Zuploaded: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-crucible-downstairs:snapshot-84433a4a-64de-4ea7-b7b1-4ee002bc06e5-ce2f6fef-bd4d-47ae-91f4-0278e1dbca27.log
11442024-10-15T18:40:39.786Zuploading: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
11452024-10-15T18:40:40.881Zuploaded: /pool/ext/685f5a45-4fc5-4ec3-8da1-0d9c8cfa22da/crypt/zone/oxz_crucible_1718551d-48ce-44f3-9f75-998e9bf8e926/root/var/svc/log/oxide-zone-network-setup:default.log
11462024-10-15T18:40:40.881Zuploading: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-agent:default.log (29654 bytes)
11472024-10-15T18:40:42.037Zuploaded: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-agent:default.log
11482024-10-15T18:40:42.037Zuploading: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11492024-10-15T18:40:43.130Zuploaded: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-downstairs:default.log
11502024-10-15T18:40:43.130Zuploading: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-downstairs:downstairs-9407ffbc-e27b-462e-a669-68c452ed3456.log (5992 bytes)
11512024-10-15T18:40:44.223Zuploaded: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-downstairs:downstairs-9407ffbc-e27b-462e-a669-68c452ed3456.log
11522024-10-15T18:40:44.248Zuploading: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1eef669-032f-46cc-9786-442d12f8ae27.log (3020 bytes)
11532024-10-15T18:40:45.316Zuploaded: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1eef669-032f-46cc-9786-442d12f8ae27.log
11542024-10-15T18:40:45.316Zuploading: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-downstairs:downstairs-d6e84208-a5b9-4095-b717-71b3b8786bb1.log (3127 bytes)
11552024-10-15T18:40:46.408Zuploaded: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-crucible-downstairs:downstairs-d6e84208-a5b9-4095-b717-71b3b8786bb1.log
11562024-10-15T18:40:46.408Zuploading: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
11572024-10-15T18:40:47.499Zuploaded: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_67cfc8df-64be-4793-9f4a-667ce37c834c/root/var/svc/log/oxide-zone-network-setup:default.log
11582024-10-15T18:40:47.500Zuploading: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_pantry_b935ad03-4ed8-498a-8581-60fb45d57592/root/var/svc/log/oxide-crucible-pantry:default.log (806615 bytes)
11592024-10-15T18:40:47.769Zupload warning: file "/pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_pantry_b935ad03-4ed8-498a-8581-60fb45d57592/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 806615 -> 818336
11602024-10-15T18:40:48.838Zuploaded: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_pantry_b935ad03-4ed8-498a-8581-60fb45d57592/root/var/svc/log/oxide-crucible-pantry:default.log
11612024-10-15T18:40:48.838Zuploading: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_pantry_b935ad03-4ed8-498a-8581-60fb45d57592/root/var/svc/log/oxide-zone-network-setup:default.log (2134 bytes)
11622024-10-15T18:40:49.930Zuploaded: /pool/ext/a2a6c8c1-72e6-4543-bb10-d6a1d37b5f0e/crypt/zone/oxz_crucible_pantry_b935ad03-4ed8-498a-8581-60fb45d57592/root/var/svc/log/oxide-zone-network-setup:default.log
11632024-10-15T18:40:49.931Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_crucible_00778b41-1442-4511-a1dc-6883be758bc9/root/var/svc/log/oxide-crucible-agent:default.log (8487 bytes)
11642024-10-15T18:40:51.046Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_crucible_00778b41-1442-4511-a1dc-6883be758bc9/root/var/svc/log/oxide-crucible-agent:default.log
11652024-10-15T18:40:51.046Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_crucible_00778b41-1442-4511-a1dc-6883be758bc9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11662024-10-15T18:40:52.138Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_crucible_00778b41-1442-4511-a1dc-6883be758bc9/root/var/svc/log/oxide-crucible-downstairs:default.log
11672024-10-15T18:40:52.138Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_crucible_00778b41-1442-4511-a1dc-6883be758bc9/root/var/svc/log/oxide-crucible-downstairs:downstairs-df14ef85-1f6f-49f6-9d16-6703209385a3.log (3020 bytes)
11682024-10-15T18:40:53.229Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_crucible_00778b41-1442-4511-a1dc-6883be758bc9/root/var/svc/log/oxide-crucible-downstairs:downstairs-df14ef85-1f6f-49f6-9d16-6703209385a3.log
11692024-10-15T18:40:53.230Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_crucible_00778b41-1442-4511-a1dc-6883be758bc9/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
11702024-10-15T18:40:54.321Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_crucible_00778b41-1442-4511-a1dc-6883be758bc9/root/var/svc/log/oxide-zone-network-setup:default.log
11712024-10-15T18:40:54.321Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_nexus_9a77fa79-e714-4617-aabe-73c3184f8017/root/var/svc/log/oxide-nexus:default.log (2263320 bytes)
11722024-10-15T18:40:54.715Zupload warning: file "/pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_nexus_9a77fa79-e714-4617-aabe-73c3184f8017/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2263320 -> 2741019
11732024-10-15T18:40:55.783Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_nexus_9a77fa79-e714-4617-aabe-73c3184f8017/root/var/svc/log/oxide-nexus:default.log
11742024-10-15T18:40:55.783Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_nexus_9a77fa79-e714-4617-aabe-73c3184f8017/root/var/svc/log/oxide-opte-interface-setup:default.log (1134 bytes)
11752024-10-15T18:40:56.877Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_nexus_9a77fa79-e714-4617-aabe-73c3184f8017/root/var/svc/log/oxide-opte-interface-setup:default.log
11762024-10-15T18:40:56.877Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_nexus_9a77fa79-e714-4617-aabe-73c3184f8017/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
11772024-10-15T18:40:57.970Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_nexus_9a77fa79-e714-4617-aabe-73c3184f8017/root/var/svc/log/oxide-zone-network-setup:default.log
11782024-10-15T18:40:57.970Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-chrony-setup:default.log (14495 bytes)
11792024-10-15T18:40:59.089Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-chrony-setup:default.log
11802024-10-15T18:40:59.089Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-ntp:default.log (1297 bytes)
11812024-10-15T18:40:59.135Zupload warning: file "/pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 1297 -> 1707
11822024-10-15T18:41:00.204Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-ntp:default.log
11832024-10-15T18:41:00.204Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
11842024-10-15T18:41:01.295Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-opte-interface-setup:default.log
11852024-10-15T18:41:01.295Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-zone-network-setup:default.log (2032 bytes)
11862024-10-15T18:41:02.390Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/svc/log/oxide-zone-network-setup:default.log
11872024-10-15T18:41:02.418Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_cockroachdb_a5b17f86-e544-43ed-8637-784d4f6a61e6/root/var/svc/log/oxide-cockroach-admin:default.log (3754 bytes)
11882024-10-15T18:41:03.482Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_cockroachdb_a5b17f86-e544-43ed-8637-784d4f6a61e6/root/var/svc/log/oxide-cockroach-admin:default.log
11892024-10-15T18:41:03.482Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_cockroachdb_a5b17f86-e544-43ed-8637-784d4f6a61e6/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11902024-10-15T18:41:04.813Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_cockroachdb_a5b17f86-e544-43ed-8637-784d4f6a61e6/root/var/svc/log/oxide-cockroachdb:default.log
11912024-10-15T18:41:04.813Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_cockroachdb_a5b17f86-e544-43ed-8637-784d4f6a61e6/root/var/svc/log/oxide-zone-network-setup:default.log (2091 bytes)
11922024-10-15T18:41:05.907Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_cockroachdb_a5b17f86-e544-43ed-8637-784d4f6a61e6/root/var/svc/log/oxide-zone-network-setup:default.log
11932024-10-15T18:41:05.907Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-agent:default.log (29406 bytes)
11942024-10-15T18:41:07.067Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-agent:default.log
11952024-10-15T18:41:07.067Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11962024-10-15T18:41:08.162Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-downstairs:default.log
11972024-10-15T18:41:08.162Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-downstairs:downstairs-16f770df-d63b-48ec-9cee-ca51c5947119.log (6078 bytes)
11982024-10-15T18:41:09.256Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-downstairs:downstairs-16f770df-d63b-48ec-9cee-ca51c5947119.log
11992024-10-15T18:41:09.256Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-downstairs:downstairs-5d3414ae-517c-46f7-aad1-ea204c88720f.log (3019 bytes)
12002024-10-15T18:41:10.350Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-downstairs:downstairs-5d3414ae-517c-46f7-aad1-ea204c88720f.log
12012024-10-15T18:41:10.350Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-downstairs:snapshot-16f770df-d63b-48ec-9cee-ca51c5947119-ce2f6fef-bd4d-47ae-91f4-0278e1dbca27.log (5688 bytes)
12022024-10-15T18:41:11.445Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-crucible-downstairs:snapshot-16f770df-d63b-48ec-9cee-ca51c5947119-ce2f6fef-bd4d-47ae-91f4-0278e1dbca27.log
12032024-10-15T18:41:11.445Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
12042024-10-15T18:41:12.539Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_crucible_446e22e6-78fd-41e4-9da9-7c72a0ee6fd8/root/var/svc/log/oxide-zone-network-setup:default.log
12052024-10-15T18:41:12.539Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_oximeter_6597cc32-a4a4-4757-980d-3f8ce6876e20/root/var/svc/log/oxide-oximeter:default.log (1328039 bytes)
12062024-10-15T18:41:12.908Zupload warning: file "/pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_oximeter_6597cc32-a4a4-4757-980d-3f8ce6876e20/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1328039 -> 1836086
12072024-10-15T18:41:13.978Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_oximeter_6597cc32-a4a4-4757-980d-3f8ce6876e20/root/var/svc/log/oxide-oximeter:default.log
12082024-10-15T18:41:13.978Zuploading: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_oximeter_6597cc32-a4a4-4757-980d-3f8ce6876e20/root/var/svc/log/oxide-zone-network-setup:default.log (2079 bytes)
12092024-10-15T18:41:15.088Zuploaded: /pool/ext/e03affdc-b808-46e9-a0e9-f0b8804942c1/crypt/zone/oxz_oximeter_6597cc32-a4a4-4757-980d-3f8ce6876e20/root/var/svc/log/oxide-zone-network-setup:default.log
12102024-10-15T18:41:15.088Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/measurements.log (93434 bytes)
12112024-10-15T18:41:15.261Zupload warning: file "/pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/measurements.log" changed size mid upload: 93434 -> 127136
12122024-10-15T18:41:16.333Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/measurements.log
12132024-10-15T18:41:16.333Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/statistics.log (72657 bytes)
12142024-10-15T18:41:16.514Zupload warning: file "/pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/statistics.log" changed size mid upload: 72657 -> 100503
12152024-10-15T18:41:17.585Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/statistics.log
12162024-10-15T18:41:17.608Zuploading: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/tracking.log (11884 bytes)
12172024-10-15T18:41:17.654Zupload warning: file "/pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/tracking.log" changed size mid upload: 11884 -> 13864
12182024-10-15T18:41:18.724Zuploaded: /pool/ext/ca5b1e9a-5313-4445-8bbf-189983f36e1c/crypt/zone/oxz_ntp_25176ef8-7c65-4373-a9b3-59dc59937310/root/var/log/chrony/tracking.log