01J92W517W90T1327PV3DYWFGP: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.33",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01J92W5P1D24CF9JJ5MGSFZPD7

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-10-01T02:19:35.910Zjob dependencies complete; ready to run (waiting for 32 m 5 s)
22024-10-01T02:24:26.610Zjob assigned to worker 01J92Y0MNWCSF9EZAV5C6E7ABF (queued for 4 m 50 s)
32024-10-01T02:24:26.625Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-10-01T02:24:26.667Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-10-01T02:24:26.703Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-10-01T02:24:26.737Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-10-01T02:24:26.771Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-10-01T02:24:26.804ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-10-01T02:24:26.838Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102024-10-01T02:24:26.871ZOxide Helios Version helios-2.0.22827 64-bit
112024-10-01T02:24:26.905ZConfiguring devices.
122024-10-01T02:24:26.940Z##################################################
132024-10-01T02:24:26.974Z#### ############# ##
142024-10-01T02:24:27.007Z### ### ############ ##
152024-10-01T02:24:27.041Z## ### # ## ### ## Oxide Computer Company ##
162024-10-01T02:24:27.074Z## ## ## ### # ### ##
172024-10-01T02:24:27.108Z## # ### #### #### This Station Under ##
182024-10-01T02:24:27.142Z### ### #### # ### Computer Control ##
192024-10-01T02:24:27.176Z#### #### ### ## ##
202024-10-01T02:24:27.209Z##################################################
212024-10-01T02:24:27.242ZHostname: buskin
222024-10-01T02:24:27.276ZLoading smf(7) service descriptions:
232024-10-01T02:24:28.210Zdownloading input: /input/package/work/package.tar.gz
242024-10-01T02:29:13.041Zdownloaded input: /input/package/work/package.tar.gz
 
252024-10-01T02:29:13.041Zstarting task 0: "setup"
262024-10-01T02:29:13.070Z++ uname -s
272024-10-01T02:29:13.070Z+ kern=SunOS
282024-10-01T02:29:13.070Z+ case "$kern" in
292024-10-01T02:29:13.070Z+ groupadd -g 12345 build
302024-10-01T02:29:13.070Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-10-01T02:29:15.024Z+ zfs create -o mountpoint=/work rpool/work
322024-10-01T02:29:15.067Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-10-01T02:29:15.091Z+ home_fs=zfs
342024-10-01T02:29:15.091Z+ [[ zfs == autofs ]]
352024-10-01T02:29:15.091Z+ mkdir -p /home/build
362024-10-01T02:29:15.092Z+ chown build:build /home/build /work
372024-10-01T02:29:17.074Z+ chmod 0700 /home/build /work
382024-10-01T02:29:17.100Zprocess exited: duration 4070 ms, exit code 0
 
392024-10-01T02:29:17.150Zstarting task 1: "authentication"
402024-10-01T02:29:17.193Zprocess exited: duration 44 ms, exit code 0
 
412024-10-01T02:29:17.242Zstarting task 2: "build"
422024-10-01T02:29:17.266Z+ trap _exit_trap EXIT
432024-10-01T02:29:17.266Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-10-01T02:29:17.362Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-10-01T02:29:17.362Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-10-01T02:29:17.362Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-10-01T02:29:17.362Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-10-01T02:29:17.362Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-10-01T02:29:17.362Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-10-01T02:29:17.362Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-10-01T02:29:17.362Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-10-01T02:29:17.362Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-10-01T02:29:17.387Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-10-01T02:29:17.387Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-10-01T02:29:17.387Z+ [[ -d /opt/oxide ]]
562024-10-01T02:29:17.387Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-10-01T02:29:17.387Z+ pfexec mkdir /opt/oxide
582024-10-01T02:29:17.387Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-10-01T02:29:17.387Z+ [[ -d /opt/oxide-underneath ]]
602024-10-01T02:29:17.387Z+ cd /opt/oxide-underneath
612024-10-01T02:29:17.387Z+ pfexec tar ceEp@/f - .
622024-10-01T02:29:17.387Z+ cd /opt/oxide
632024-10-01T02:29:17.387Z+ pfexec tar xveEp@/f -
642024-10-01T02:29:17.492Zx ., 0 bytes, 0 tape blocks
652024-10-01T02:29:17.492Zx ./opte, 0 bytes, 0 tape blocks
662024-10-01T02:29:17.492Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-10-01T02:29:17.492Zx ./opte/bin/opteadm, 52693888 bytes, 102918 tape blocks
682024-10-01T02:29:17.516Z+ pfexec rm -rf /opt/oxide-underneath
692024-10-01T02:29:17.516Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-10-01T02:29:17.540Z+ pfexec mkdir /opt/oxide/work
712024-10-01T02:29:17.540Z+ pfexec chown build:build /opt/oxide/work
722024-10-01T02:29:17.540Z+ cd /opt/oxide/work
732024-10-01T02:29:17.540Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-10-01T02:29:29.891ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-10-01T02:29:29.891Zx out/target/test, 107 bytes, 1 tape blocks
762024-10-01T02:29:29.891Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-10-01T02:29:29.891Zx package-manifest.toml, 32001 bytes, 63 tape blocks
782024-10-01T02:29:29.891Zx smf/sled-agent/non-gimlet/config.toml, 3569 bytes, 7 tape blocks
792024-10-01T02:29:29.891Zx target/release/omicron-package, 33493528 bytes, 65418 tape blocks
802024-10-01T02:29:29.891Zx target/release/xtask, 12344728 bytes, 24111 tape blocks
812024-10-01T02:29:29.891Zx target/debug/bootstrap, 201942184 bytes, 394419 tape blocks
822024-10-01T02:29:29.891Zx tests/bootstrap-298787b429772676, 24349840 bytes, 47559 tape blocks
832024-10-01T02:29:29.891Zx tests/commtest-b693414e4ee4c465, 24582256 bytes, 48013 tape blocks
842024-10-01T02:29:29.891Zx tests/dhcp_server-85b4b8d3d0132374, 24349856 bytes, 47559 tape blocks
852024-10-01T02:29:29.891Zx tests/end_to_end_tests-e1dbd8465b82db80, 219834344 bytes, 429364 tape blocks
862024-10-01T02:29:29.891Zx out/clickhouse.tar.gz, 239275846 bytes, 467336 tape blocks
872024-10-01T02:29:29.891Zx out/clickhouse_keeper.tar.gz, 239267744 bytes, 467320 tape blocks
882024-10-01T02:29:29.891Zx out/clickhouse_server.tar.gz, 239266296 bytes, 467317 tape blocks
892024-10-01T02:29:29.891Zx out/cockroachdb.tar.gz, 135262534 bytes, 264185 tape blocks
902024-10-01T02:29:29.892Zx out/crucible-dtrace.tar, 83456 bytes, 163 tape blocks
912024-10-01T02:29:29.892Zx out/crucible-pantry-zone.tar.gz, 27570870 bytes, 53850 tape blocks
922024-10-01T02:29:29.892Zx out/crucible-zone.tar.gz, 35947589 bytes, 70211 tape blocks
932024-10-01T02:29:29.892Zx out/external-dns.tar.gz, 25772213 bytes, 50337 tape blocks
942024-10-01T02:29:29.892Zx out/internal-dns.tar.gz, 25771534 bytes, 50336 tape blocks
952024-10-01T02:29:29.892Zx out/mg-ddm-gz.tar, 63651840 bytes, 124320 tape blocks
962024-10-01T02:29:29.892Zx out/nexus.tar.gz, 97092690 bytes, 189635 tape blocks
972024-10-01T02:29:29.892Zx out/ntp.tar.gz, 9275859 bytes, 18117 tape blocks
982024-10-01T02:29:29.892Zx out/omicron-gateway-softnpu.tar.gz, 21494590 bytes, 41982 tape blocks
992024-10-01T02:29:29.892Zx out/omicron-sled-agent.tar, 103432704 bytes, 202017 tape blocks
1002024-10-01T02:29:29.892Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1012024-10-01T02:29:29.892Zx out/oximeter.tar.gz, 44662693 bytes, 87232 tape blocks
1022024-10-01T02:29:29.892Zx out/oxlog.tar, 3109376 bytes, 6073 tape blocks
1032024-10-01T02:29:29.892Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1042024-10-01T02:29:29.892Zx out/propolis-server.tar.gz, 68040545 bytes, 132892 tape blocks
1052024-10-01T02:29:29.892Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1062024-10-01T02:29:29.892Zx out/switch-softnpu.tar.gz, 225546130 bytes, 440520 tape blocks
1072024-10-01T02:29:29.919Z
1082024-10-01T02:29:29.919Zreal 12.337188364
1092024-10-01T02:29:29.920Zuser 10.929099723
1102024-10-01T02:29:29.920Zsys 2.451562068
1112024-10-01T02:29:29.920Ztrap 0.000414699
1122024-10-01T02:29:29.920Ztflt 0.000000000
1132024-10-01T02:29:29.920Zdflt 0.000000000
1142024-10-01T02:29:29.920Zkflt 0.000000000
1152024-10-01T02:29:29.920Zlock 0.000000000
1162024-10-01T02:29:29.920Zslp 10.988767144
1172024-10-01T02:29:29.920Zlat 0.302393457
1182024-10-01T02:29:29.920Zstop 0.000122921
1192024-10-01T02:29:29.920Z+ bmat address ls
1202024-10-01T02:29:29.920ZNAME CIDR FIRST LAST COUNT
1212024-10-01T02:29:29.920Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1222024-10-01T02:29:29.920Z++ bmat address ls -f extra -Ho first,last,count
1232024-10-01T02:29:29.920Z+ set -- 10.151.1.164 10.151.1.227 64
1242024-10-01T02:29:29.920Z+ EXTRA_IP_START=10.151.1.164
1252024-10-01T02:29:29.920Z+ EXTRA_IP_END=10.151.1.227
1262024-10-01T02:29:29.920Z+ EXTRA_IP_COUNT=64
1272024-10-01T02:29:29.920Z+ (( EXTRA_IP_COUNT >= 32 ))
1282024-10-01T02:29:29.920Z+ EXTRA_IP_BASE=10.151.1
1292024-10-01T02:29:29.921Z+ EXTRA_IP_FOCTET=164
1302024-10-01T02:29:29.921Z+ EXTRA_IP_LOCTET=227
1312024-10-01T02:29:29.921Z+ SERVICE_IP_POOL_START=10.151.1.164
1322024-10-01T02:29:29.921Z+ SERVICE_IP_POOL_END=10.151.1.173
1332024-10-01T02:29:29.921Z+ DNS_IP1=10.151.1.164
1342024-10-01T02:29:29.921Z+ DNS_IP2=10.151.1.165
1352024-10-01T02:29:29.921Z+ UPLINK_IP=10.151.1.174
1362024-10-01T02:29:29.921Z+ IPPOOL_START=10.151.1.175
1372024-10-01T02:29:29.921Z+ IPPOOL_END=10.151.1.227
1382024-10-01T02:29:29.921Z++ ipadm show-addr -po type,addr
1392024-10-01T02:29:29.921Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1402024-10-01T02:29:29.921Z+ GATEWAY_IP=10.151.1.100
1412024-10-01T02:29:29.921Z+ [[ -n 10.151.1.100 ]]
1422024-10-01T02:29:29.921Z+ ping -s 10.151.1.100 56 1
1432024-10-01T02:29:29.921ZPING 10.151.1.100: 56 data bytes
1442024-10-01T02:29:29.921Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.012 ms
1452024-10-01T02:29:29.921Z
1462024-10-01T02:29:29.921Z----10.151.1.100 PING Statistics----
1472024-10-01T02:29:29.921Z1 packets transmitted, 1 packets received, 0% packet loss
1482024-10-01T02:29:29.921Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
1492024-10-01T02:29:29.921Z++ arp -an
1502024-10-01T02:29:29.922Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1512024-10-01T02:29:29.922Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1522024-10-01T02:29:29.922Z+ routeadm -e ipv4-forwarding -u
1532024-10-01T02:29:30.025Z+ PXA_START=10.151.1.164
1542024-10-01T02:29:30.025Z+ PXA_END=10.151.1.227
1552024-10-01T02:29:30.049Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1562024-10-01T02:29:30.151Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1572024-10-01T02:29:30.177ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1582024-10-01T02:29:30.227Zcreating virtual hardware
1592024-10-01T02:29:30.256Zcreating /scratch/m2_0.vdev
1602024-10-01T02:29:30.256Zcreating /scratch/m2_1.vdev
1612024-10-01T02:29:30.256Zcreating /scratch/u2_0.vdev
1622024-10-01T02:29:30.256Zcreating /scratch/u2_1.vdev
1632024-10-01T02:29:30.256Zcreating /scratch/u2_2.vdev
1642024-10-01T02:29:30.256Zcreating /scratch/u2_3.vdev
1652024-10-01T02:29:30.256Zcreating /scratch/u2_4.vdev
1662024-10-01T02:29:30.256Zcreating /scratch/u2_5.vdev
1672024-10-01T02:29:30.256Zcreating /scratch/u2_6.vdev
1682024-10-01T02:29:30.256Zcreating /scratch/u2_7.vdev
1692024-10-01T02:29:30.256Zcreating /scratch/u2_8.vdev
1702024-10-01T02:29:30.287ZSimnet net0/sc0_0 exists
1712024-10-01T02:29:30.316ZSimnet net1/sc1_0 exists
1722024-10-01T02:29:30.347ZVnic sc0_1 exists
1732024-10-01T02:29:46.554ZUsing 10.151.1.100 as gateway ip
1742024-10-01T02:29:46.554Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1752024-10-01T02:29:46.554Zconfiguring SoftNPU ARP entry
1762024-10-01T02:29:46.581Zconfiguring SoftNPU proxy ARP
1772024-10-01T02:29:46.635ZSoftNPU state:
1782024-10-01T02:29:46.635Z local v6:
1792024-10-01T02:29:46.635Z local v4:
1802024-10-01T02:29:46.635Z router v6:
1812024-10-01T02:29:46.635Z router v4_idx:
1822024-10-01T02:29:46.635Z router v4_routes:
1832024-10-01T02:29:46.635Z resolver v4:
1842024-10-01T02:29:46.635Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1852024-10-01T02:29:46.635Z resolver v6:
1862024-10-01T02:29:46.635Z nat v4:
1872024-10-01T02:29:46.635Z nat_v6:
1882024-10-01T02:29:46.635Z port_mac:
1892024-10-01T02:29:46.635Z proxy arp:
1902024-10-01T02:29:46.635Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
1912024-10-01T02:29:46.635Zcreated virtual hardware
1922024-10-01T02:29:46.659Z
1932024-10-01T02:29:46.659Zreal 16.481960078
1942024-10-01T02:29:46.659Zuser 0.663829623
1952024-10-01T02:29:46.659Zsys 3.334588135
1962024-10-01T02:29:46.659Ztrap 0.000050503
1972024-10-01T02:29:46.659Ztflt 0.000311144
1982024-10-01T02:29:46.659Zdflt 0.000561264
1992024-10-01T02:29:46.659Zkflt 0.000004570
2002024-10-01T02:29:46.659Zlock 12:46.066488796
2012024-10-01T02:29:46.659Zslp 49.691615743
2022024-10-01T02:29:46.659Zlat 0.080328102
2032024-10-01T02:29:46.659Zstop 0.352783254
2042024-10-01T02:29:46.659Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2052024-10-01T02:29:46.684Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2062024-10-01T02:29:46.684Z+ diff -u pkg/config.toml~ pkg/config.toml
2072024-10-01T02:29:46.684Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2082024-10-01T02:29:46.684Z+++ pkg/config.toml Tue Oct 1 02:29:47 2024
2092024-10-01T02:29:46.684Z@@ -29,18 +29,18 @@
2102024-10-01T02:29:46.684Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2112024-10-01T02:29:46.684Z # followed by a string that is embedded into their fake serial values.
2122024-10-01T02:29:46.684Z vdevs = [
2132024-10-01T02:29:46.684Z- "m2_0.vdev",
2142024-10-01T02:29:46.684Z- "m2_1.vdev",
2152024-10-01T02:29:46.684Z+ "/scratch/m2_0.vdev",
2162024-10-01T02:29:46.684Z+ "/scratch/m2_1.vdev",
2172024-10-01T02:29:46.684Z
2182024-10-01T02:29:46.685Z- "u2_0.vdev",
2192024-10-01T02:29:46.685Z- "u2_1.vdev",
2202024-10-01T02:29:46.685Z- "u2_2.vdev",
2212024-10-01T02:29:46.685Z- "u2_3.vdev",
2222024-10-01T02:29:46.685Z- "u2_4.vdev",
2232024-10-01T02:29:46.685Z- "u2_5.vdev",
2242024-10-01T02:29:46.685Z- "u2_6.vdev",
2252024-10-01T02:29:46.685Z- "u2_7.vdev",
2262024-10-01T02:29:46.685Z- "u2_8.vdev",
2272024-10-01T02:29:46.685Z+ "/scratch/u2_0.vdev",
2282024-10-01T02:29:46.685Z+ "/scratch/u2_1.vdev",
2292024-10-01T02:29:46.685Z+ "/scratch/u2_2.vdev",
2302024-10-01T02:29:46.685Z+ "/scratch/u2_3.vdev",
2312024-10-01T02:29:46.685Z+ "/scratch/u2_4.vdev",
2322024-10-01T02:29:46.685Z+ "/scratch/u2_5.vdev",
2332024-10-01T02:29:46.685Z+ "/scratch/u2_6.vdev",
2342024-10-01T02:29:46.685Z+ "/scratch/u2_7.vdev",
2352024-10-01T02:29:46.685Z+ "/scratch/u2_8.vdev",
2362024-10-01T02:29:46.685Z ]
2372024-10-01T02:29:46.685Z
2382024-10-01T02:29:46.685Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2392024-10-01T02:29:46.685Z+ true
2402024-10-01T02:29:46.685Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2412024-10-01T02:29:46.685Z+ SILO_NAME=recovery
2422024-10-01T02:29:46.685Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2432024-10-01T02:29:46.685Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2442024-10-01T02:29:46.685Z+ sed -i~ '
2452024-10-01T02:29:46.685Z /^external_dns_ips/c\
2462024-10-01T02:29:46.685Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2472024-10-01T02:29:46.685Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2482024-10-01T02:29:46.685Z /^first/c\
2492024-10-01T02:29:46.685Zfirst = "10.151.1.164"
2502024-10-01T02:29:46.685Z /^last/c\
2512024-10-01T02:29:46.685Zlast = "10.151.1.173"
2522024-10-01T02:29:46.685Z }
2532024-10-01T02:29:46.685Z /^infra_ip_first/c\
2542024-10-01T02:29:46.685Zinfra_ip_first = "10.151.1.174"
2552024-10-01T02:29:46.685Z /^infra_ip_last/c\
2562024-10-01T02:29:46.685Zinfra_ip_last = "10.151.1.174"
2572024-10-01T02:29:46.686Z /^\[\[rack_network_config.ports/,/^$/ {
2582024-10-01T02:29:46.686Z /^routes/c\
2592024-10-01T02:29:46.686Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2602024-10-01T02:29:46.686Z /^addresses/c\
2612024-10-01T02:29:46.686Zaddresses = \[{address = "10.151.1.174/24"} \]
2622024-10-01T02:29:46.686Z }
2632024-10-01T02:29:46.686Z' pkg/config-rss.toml
2642024-10-01T02:29:46.686Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2652024-10-01T02:29:46.709Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2662024-10-01T02:29:46.710Z+++ pkg/config-rss.toml Tue Oct 1 02:29:47 2024
2672024-10-01T02:29:46.710Z@@ -33,7 +33,7 @@
2682024-10-01T02:29:46.710Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2692024-10-01T02:29:46.710Z # must be contained in one of the "internal services" IP Pool ranges listed
2702024-10-01T02:29:46.710Z # below.
2712024-10-01T02:29:46.710Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2722024-10-01T02:29:46.710Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2732024-10-01T02:29:46.710Z
2742024-10-01T02:29:46.710Z # Initial TLS certificates for the external API
2752024-10-01T02:29:46.710Z #
2762024-10-01T02:29:46.710Z@@ -69,8 +69,8 @@
2772024-10-01T02:29:46.710Z #
2782024-10-01T02:29:46.710Z # For more on this and what to put here, see docs/how-to-run.adoc.
2792024-10-01T02:29:46.710Z [[internal_services_ip_pool_ranges]]
2802024-10-01T02:29:46.710Z-first = "192.168.1.20"
2812024-10-01T02:29:46.710Z-last = "192.168.1.29"
2822024-10-01T02:29:46.710Z+first = "10.151.1.164"
2832024-10-01T02:29:46.710Z+last = "10.151.1.173"
2842024-10-01T02:29:46.710Z
2852024-10-01T02:29:46.710Z # TODO - this configuration is subject to change going forward. Ultimately these
2862024-10-01T02:29:46.710Z # parameters should be provided to the control plane via wicket, but we need to
2872024-10-01T02:29:46.710Z@@ -91,8 +91,8 @@
2882024-10-01T02:29:46.710Z # A range of IP addresses used by Boundary Services on the external network. In
2892024-10-01T02:29:46.710Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2902024-10-01T02:29:46.710Z # With softnpu, only one address is used.
2912024-10-01T02:29:46.710Z-infra_ip_first = "192.168.1.30"
2922024-10-01T02:29:46.710Z-infra_ip_last = "192.168.1.30"
2932024-10-01T02:29:46.710Z+infra_ip_first = "10.151.1.174"
2942024-10-01T02:29:46.710Z+infra_ip_last = "10.151.1.174"
2952024-10-01T02:29:46.710Z
2962024-10-01T02:29:46.710Z # Configurations for BGP routers to run on the scrimlets.
2972024-10-01T02:29:46.710Z bgp = []
2982024-10-01T02:29:46.710Z@@ -100,9 +100,9 @@
2992024-10-01T02:29:46.710Z # You can configure multiple uplinks by repeating the following stanza
3002024-10-01T02:29:46.710Z [[rack_network_config.ports]]
3012024-10-01T02:29:46.710Z # Routes associated with this port.
3022024-10-01T02:29:46.710Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3032024-10-01T02:29:46.710Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3042024-10-01T02:29:46.710Z # Addresses associated with this port.
3052024-10-01T02:29:46.711Z-addresses = [{address = "192.168.1.30/24"}]
3062024-10-01T02:29:46.711Z+addresses = [{address = "10.151.1.174/24"} ]
3072024-10-01T02:29:46.711Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3082024-10-01T02:29:46.711Z port = "qsfp0"
3092024-10-01T02:29:46.711Z # The speed of this port.
3102024-10-01T02:29:46.711Z+ true
3112024-10-01T02:29:46.711Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3122024-10-01T02:29:46.711Za pkg/config-rss.toml 8K
3132024-10-01T02:29:46.711Za pkg/config.toml 4K
3142024-10-01T02:29:46.711Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3152024-10-01T02:29:46.711Z+ TLS_NAME=recovery.sys.oxide.test
3162024-10-01T02:29:46.711Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3172024-10-01T02:29:47.863Z.......+.........+....+...........+......+...+...............+.......+..+.......+......+..+.+..+...+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+......................+..+.+..+............+............+....+..+............+...+.........+....+......+.......................+.......+.....+.+..+.......+.....+......+.......+...+...+..............+.......+........+...+.......+.....+.......+...+............+.....+...+.+.....+...........................+.........+.+..+............+.........+...............+..........+......+......+............+...+...............+...+.........+...+.....+.............+..+............+......+......+.........+......+...+...+....+.............................+......+....+..+....+.....+...+..........+.....+.+..+..........+..................+..+...+...................+.................+..........+........+.............+........+.+...+......+......+........+...+.........+...+.............+.....+...+......+...+...+.......+..+....+.....+.......+.....+...+....+.....+.+......+.....+....+.....+.+......+..+...+....+...........+............+.+......+.........+............+..+..........+...+...+......+........+...+.........+.........+....+......+..+.......+..+...............+......+............+.......+...+...+...+...........................+.....+..........+........+.......+..+...+.................................+....+..+....+...........+..........+...+........+...+.+.....+......+.......+...+.................+.+.....+.........+.+.........+...+..+...............+......+.+...+........+...+..........+..+.........+...+...+.......+............+........+.+.....+......+.+.................+.+..+............+...+.......+..+.........+.........+..........+......+..............+...+....+.....................+..+.+...........+.+.........+.....+...............+.+..+.+.........+..+...+...+....+...+......+.....+......+..........+...........+.......+...............+...........+....+...............+...........+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3182024-10-01T02:29:50.150Z..+...+.+..+....+......+............+..+.+........+................+...+.....+.+..+...+..........+..+.......+.....+......+......+....+.....+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+.+...+......+......+.........+.........+..+.......+..+......+.......+......+.....+....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+...........+.+..+.......+......+.........+.....+.....................+....+.....+......+...+.......+.....+...+.......+...+......+......+.....+...+.........................+..+.........+...+.......+........+...+.............+.........+..+.........+...............................+...+..+................+..+................+............+...............+........................+...+...+..+......+.+.....+....+.....................+........+..........+..........................+.+...........+....+...+.....+..........+...+...+.........+...+...+..+.......+.....+.+.............................+.......+...........+...+.+........+...+...+..........+............+..+..........+........+...+.+...+............+.....+..........+.....+.........+.......+............+...+.....+...................+........+...+...+.+...........+...+....+.....+.+...........+.........+............+.............+.....+....+............+.........+.........+...........+.+......+..+.........................+.....................+..............+..........+........+.......+.....+.+......+.....+.........+.+...........+....+.....+......+...+......+.........+....+...+...+..............+.....................+....+...........+..........+..+..........+....................+...+......+...+...+...................+......+..+............................+...+..+....+...........+....+.....+....+..+...+......+....+...........+......+....+...+...+............+.....+.+...........................+.....+.......+..+.+...............+..+..................+..........+..+.+..+.......+..+..........+........+..........+...+.....+.........+......+...+....+...+..+.+...........+................+.....+...+.+...+.....+.+.....+................+........+...+...............+............+.+...........+....+............+..............+...+......+................+.....+......+.......+..+.+.....+.......+..+.............+..+..........+...+...+..+.+..............+............+...+.......+...+........+...+...............+....+........+..................+.+...+...+..+.+.........+......+..............+......+....+...+..................+..+............+.+..+.............+.....+................+.........+.....+.......+..+...+......................+..+.+............+...+...+...............+..+.......+...........+..........+.................+.........+.+.....+.......+......+.........+..+....+......+...+..+..................+......+.......+..+............+.+.........+.....+.............+..+.+............+..+.+.........+.....+.....................+...+.+.....+.....................+...+....+.....+.......+.....................+............+........+...+.....................+.+..+.............+..............+.+.........+...+......+..+...+............+....+........+.............+........+.......+..+.+.....+.....................+.+............+...........+......+.+..+.+..............+.+..+...+.+......+...+..+.........+........................+......+...+..........+...+.....+.......+.....+............+....+..+....+..............+....+...+..+......+......+...+..........+..+.+........+.+.........+..+.......+......+..+.............+.........+............+.....+...+.....................+......+......+...+.+........................+..+.........+....+............+..+.+.....+.+.....+.+...........................+.....+.......+......+...+.....+.......+..+.......+.........+.........+.....+...+....+...+..............................+.....+............+.+........+..........+..+.......+....................+......+.......+........+.+.....+.+..+...+..........+........+.+.....+...............+..........+........+.+..+..........+........+.+...+...+.........+........+.......+...+..+.+.....+...+.+.....+....+..+.........+...+.+..+....+...+.....+..........+.....+.......+...+......+......+..............+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3192024-10-01T02:29:50.174Z-----
3202024-10-01T02:29:50.174Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3212024-10-01T02:29:50.174Za pkg/initial-tls-cert.pem 2K
3222024-10-01T02:29:50.174Za pkg/initial-tls-key.pem 4K
3232024-10-01T02:29:50.174Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3242024-10-01T02:29:50.174Z+ rmdir pkg
3252024-10-01T02:29:50.174Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3262024-10-01T02:29:50.174Z+ pfexec mkdir -p /usr/oxide
3272024-10-01T02:29:50.174Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3282024-10-01T02:29:50.886Z+ pfexec chmod +x /usr/oxide/oxide
3292024-10-01T02:29:50.910Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3302024-10-01T02:30:09.252Z+ OMICRON_NO_UNINSTALL=1
3312024-10-01T02:30:09.252Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3322024-10-01T02:30:09.276ZLogging to: /opt/oxide/work/out/LOG
3332024-10-01T02:30:09.857Z
3342024-10-01T02:30:09.881Zreal 0.600705165
3352024-10-01T02:30:09.881Zuser 0.136384366
3362024-10-01T02:30:09.881Zsys 3.164971747
3372024-10-01T02:30:09.881Ztrap 0.000002480
3382024-10-01T02:30:09.882Ztflt 0.000030339
3392024-10-01T02:30:09.882Zdflt 0.000605019
3402024-10-01T02:30:09.882Zkflt 0.000019020
3412024-10-01T02:30:09.882Zlock 54.077685027
3422024-10-01T02:30:09.882Zslp 0.786570569
3432024-10-01T02:30:09.882Zlat 0.003370243
3442024-10-01T02:30:09.882Zstop 0.197825675
3452024-10-01T02:30:09.882Z+ retry=0
3462024-10-01T02:30:09.882Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3472024-10-01T02:30:09.882Z+ [[ 0 -gt 30 ]]
3482024-10-01T02:30:09.882Z+ sleep 1
3492024-10-01T02:30:10.872Z+ retry=1
3502024-10-01T02:30:10.872Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3512024-10-01T02:30:10.896Z+ [[ 1 -gt 30 ]]
3522024-10-01T02:30:10.896Z+ sleep 1
3532024-10-01T02:30:11.888Z+ retry=2
3542024-10-01T02:30:11.888Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3552024-10-01T02:30:11.912Z+ [[ 2 -gt 30 ]]
3562024-10-01T02:30:11.912Z+ sleep 1
3572024-10-01T02:30:12.903Z+ retry=3
3582024-10-01T02:30:12.903Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3592024-10-01T02:30:32.915Z+ [[ 3 -gt 30 ]]
3602024-10-01T02:30:32.915Z+ sleep 1
3612024-10-01T02:30:33.918Z+ retry=4
3622024-10-01T02:30:33.919Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3632024-10-01T02:30:33.942Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3642024-10-01T02:30:33.966Zlocal v6:
3652024-10-01T02:30:33.966Zfe80::f464:f0ff:fe52:cf5d
3662024-10-01T02:30:33.967Zfd39:ce05:b46b:1138::1
3672024-10-01T02:30:33.967Zlocal v4:
3682024-10-01T02:30:33.967Z10.151.1.174
3692024-10-01T02:30:33.967Zrouter v6:
3702024-10-01T02:30:33.967Zrouter v4_idx:
3712024-10-01T02:30:33.967Z0.0.0.0/0 -> 0
3722024-10-01T02:30:33.967Zrouter v4_routes:
3732024-10-01T02:30:33.967Z0 -> 10.151.1.100 (2)
3742024-10-01T02:30:33.967Zresolver v4:
3752024-10-01T02:30:33.967Z10.151.1.174 -> 9e:33:50:72:11:5d
3762024-10-01T02:30:33.967Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3772024-10-01T02:30:33.967Zresolver v6:
3782024-10-01T02:30:33.967Zfe80::e87b:2dff:fe93:c27d -> ea:7b:2d:93:c2:7d
3792024-10-01T02:30:33.967Zfe80::f464:f0ff:fe52:cf5d -> f6:64:f0:52:cf:5d
3802024-10-01T02:30:33.968Znat v4:
3812024-10-01T02:30:33.968Znat_v6:
3822024-10-01T02:30:33.968Zport_mac:
3832024-10-01T02:30:33.968Z1: a8:40:25:38:2c:27
3842024-10-01T02:30:33.968Z1000: a8:40:25:38:2c:26
3852024-10-01T02:30:33.968Z2: a8:40:25:38:2c:47
3862024-10-01T02:30:33.968Zproxy arp:
3872024-10-01T02:30:33.968Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
3882024-10-01T02:30:33.968Z+ retry=0
3892024-10-01T02:30:33.993Z+++ zoneadm list -n
3902024-10-01T02:30:33.993Z+++ grep oxz_ntp
3912024-10-01T02:30:33.993Z++ pfexec svcs -z -Hostate oxide/ntp
3922024-10-01T02:30:33.993Zsvcs: zone '-Hostate': entity not found
3932024-10-01T02:30:33.993Z++ true
3942024-10-01T02:30:33.993Z+ [[ '' != online ]]
3952024-10-01T02:30:33.993Z+ [[ 0 -gt 60 ]]
3962024-10-01T02:30:33.993Z+ sleep 1
3972024-10-01T02:30:34.986Z+ retry=1
3982024-10-01T02:30:35.011Z+++ zoneadm list -n
3992024-10-01T02:30:35.011Z+++ grep oxz_ntp
4002024-10-01T02:30:35.011Z++ pfexec svcs -z -Hostate oxide/ntp
4012024-10-01T02:30:35.011Zsvcs: zone '-Hostate': entity not found
4022024-10-01T02:30:35.011Z++ true
4032024-10-01T02:30:35.011Z+ [[ '' != online ]]
4042024-10-01T02:30:35.011Z+ [[ 1 -gt 60 ]]
4052024-10-01T02:30:35.011Z+ sleep 1
4062024-10-01T02:30:36.007Z+ retry=2
4072024-10-01T02:30:36.032Z+++ zoneadm list -n
4082024-10-01T02:30:36.032Z+++ grep oxz_ntp
4092024-10-01T02:30:36.032Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4102024-10-01T02:30:36.032Zsvcs: Could not bind to repository server for zone oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82: repository server unavailable
4112024-10-01T02:30:36.032Z++ true
4122024-10-01T02:30:36.032Z+ [[ '' != online ]]
4132024-10-01T02:30:36.032Z+ [[ 2 -gt 60 ]]
4142024-10-01T02:30:36.032Z+ sleep 1
4152024-10-01T02:30:37.029Z+ retry=3
4162024-10-01T02:30:37.054Z+++ zoneadm list -n
4172024-10-01T02:30:37.054Z+++ grep oxz_ntp
4182024-10-01T02:30:37.054Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4192024-10-01T02:30:37.078Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4202024-10-01T02:30:37.079Z++ true
4212024-10-01T02:30:37.079Z+ [[ '' != online ]]
4222024-10-01T02:30:37.079Z+ [[ 3 -gt 60 ]]
4232024-10-01T02:30:37.079Z+ sleep 1
4242024-10-01T02:30:38.057Z+ retry=4
4252024-10-01T02:30:38.081Z+++ zoneadm list -n
4262024-10-01T02:30:38.081Z+++ grep oxz_ntp
4272024-10-01T02:30:38.081Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4282024-10-01T02:30:38.105Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4292024-10-01T02:30:38.105Z++ true
4302024-10-01T02:30:38.105Z+ [[ '' != online ]]
4312024-10-01T02:30:38.105Z+ [[ 4 -gt 60 ]]
4322024-10-01T02:30:38.105Z+ sleep 1
4332024-10-01T02:30:39.086Z+ retry=5
4342024-10-01T02:30:39.110Z+++ zoneadm list -n
4352024-10-01T02:30:39.110Z+++ grep oxz_ntp
4362024-10-01T02:30:39.110Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4372024-10-01T02:30:39.134Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4382024-10-01T02:30:39.134Z++ true
4392024-10-01T02:30:39.134Z+ [[ '' != online ]]
4402024-10-01T02:30:39.134Z+ [[ 5 -gt 60 ]]
4412024-10-01T02:30:39.134Z+ sleep 1
4422024-10-01T02:30:40.117Z+ retry=6
4432024-10-01T02:30:40.141Z+++ zoneadm list -n
4442024-10-01T02:30:40.141Z+++ grep oxz_ntp
4452024-10-01T02:30:40.141Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4462024-10-01T02:30:40.141Z+ [[ offline != online ]]
4472024-10-01T02:30:40.141Z+ [[ 6 -gt 60 ]]
4482024-10-01T02:30:40.141Z+ sleep 1
4492024-10-01T02:30:41.141Z+ retry=7
4502024-10-01T02:30:41.165Z+++ zoneadm list -n
4512024-10-01T02:30:41.165Z+++ grep oxz_ntp
4522024-10-01T02:30:41.165Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4532024-10-01T02:30:41.165Z+ [[ offline != online ]]
4542024-10-01T02:30:41.165Z+ [[ 7 -gt 60 ]]
4552024-10-01T02:30:41.165Z+ sleep 1
4562024-10-01T02:30:42.165Z+ retry=8
4572024-10-01T02:30:42.188Z+++ zoneadm list -n
4582024-10-01T02:30:42.188Z+++ grep oxz_ntp
4592024-10-01T02:30:42.188Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4602024-10-01T02:30:42.188Z+ [[ offline != online ]]
4612024-10-01T02:30:42.189Z+ [[ 8 -gt 60 ]]
4622024-10-01T02:30:42.189Z+ sleep 1
4632024-10-01T02:30:43.192Z+ retry=9
4642024-10-01T02:30:43.215Z+++ zoneadm list -n
4652024-10-01T02:30:43.215Z+++ grep oxz_ntp
4662024-10-01T02:30:43.215Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4672024-10-01T02:30:43.215Z+ [[ offline != online ]]
4682024-10-01T02:30:43.215Z+ [[ 9 -gt 60 ]]
4692024-10-01T02:30:43.215Z+ sleep 1
4702024-10-01T02:30:44.211Z+ retry=10
4712024-10-01T02:30:44.235Z+++ zoneadm list -n
4722024-10-01T02:30:44.235Z+++ grep oxz_ntp
4732024-10-01T02:30:44.235Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4742024-10-01T02:30:44.235Z+ [[ offline != online ]]
4752024-10-01T02:30:44.235Z+ [[ 10 -gt 60 ]]
4762024-10-01T02:30:44.235Z+ sleep 1
4772024-10-01T02:30:45.234Z+ retry=11
4782024-10-01T02:30:45.258Z+++ zoneadm list -n
4792024-10-01T02:30:45.258Z+++ grep oxz_ntp
4802024-10-01T02:30:45.258Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4812024-10-01T02:30:45.258Z+ [[ offline != online ]]
4822024-10-01T02:30:45.258Z+ [[ 11 -gt 60 ]]
4832024-10-01T02:30:45.258Z+ sleep 1
 
4842024-10-01T02:30:46.129Zbuskin console login: Oct 1 02:30:46 buskin ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
4852024-10-01T02:30:46.258Z+ retry=12
4862024-10-01T02:30:46.282Z+++ zoneadm list -n
4872024-10-01T02:30:46.282Z+++ grep oxz_ntp
4882024-10-01T02:30:46.282Z++ pfexec svcs -z oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82 -Hostate oxide/ntp
4892024-10-01T02:30:46.282Z+ [[ online != online ]]
4902024-10-01T02:30:46.282Z+ echo 'Waited for chrony: 12s'
4912024-10-01T02:30:46.282Z+ retry=0
4922024-10-01T02:30:46.282ZWaited for chrony: 12s
4932024-10-01T02:30:46.282Z+ zoneadm list
4942024-10-01T02:30:46.306Z+ grep nexus
4952024-10-01T02:30:46.306Z+ [[ 0 -gt 300 ]]
4962024-10-01T02:30:46.306Z+ sleep 1
4972024-10-01T02:30:47.290Z+ retry=1
4982024-10-01T02:30:47.313Z+ zoneadm list
4992024-10-01T02:30:47.313Z+ grep nexus
5002024-10-01T02:30:47.313Z+ [[ 1 -gt 300 ]]
5012024-10-01T02:30:47.313Z+ sleep 1
5022024-10-01T02:30:48.299Z+ retry=2
5032024-10-01T02:30:48.323Z+ zoneadm list
5042024-10-01T02:30:48.323Z+ grep nexus
5052024-10-01T02:30:48.323Z+ [[ 2 -gt 300 ]]
5062024-10-01T02:30:48.323Z+ sleep 1
5072024-10-01T02:30:49.310Z+ retry=3
5082024-10-01T02:30:49.334Z+ zoneadm list
5092024-10-01T02:30:49.334Z+ grep nexus
5102024-10-01T02:30:49.334Z+ [[ 3 -gt 300 ]]
5112024-10-01T02:30:49.334Z+ sleep 1
5122024-10-01T02:30:50.321Z+ retry=4
5132024-10-01T02:30:50.345Z+ zoneadm list
5142024-10-01T02:30:50.345Z+ grep nexus
5152024-10-01T02:30:50.345Z+ [[ 4 -gt 300 ]]
5162024-10-01T02:30:50.345Z+ sleep 1
5172024-10-01T02:30:51.332Z+ retry=5
5182024-10-01T02:30:51.356Z+ zoneadm list
5192024-10-01T02:30:51.356Z+ grep nexus
5202024-10-01T02:30:51.356Z+ [[ 5 -gt 300 ]]
5212024-10-01T02:30:51.356Z+ sleep 1
5222024-10-01T02:30:52.345Z+ retry=6
5232024-10-01T02:30:52.368Z+ zoneadm list
5242024-10-01T02:30:52.368Z+ grep nexus
5252024-10-01T02:30:52.368Z+ [[ 6 -gt 300 ]]
5262024-10-01T02:30:52.368Z+ sleep 1
5272024-10-01T02:30:53.354Z+ retry=7
5282024-10-01T02:30:53.377Z+ zoneadm list
5292024-10-01T02:30:53.377Z+ grep nexus
5302024-10-01T02:30:53.377Z+ [[ 7 -gt 300 ]]
5312024-10-01T02:30:53.377Z+ sleep 1
5322024-10-01T02:30:54.365Z+ retry=8
5332024-10-01T02:30:54.389Z+ zoneadm list
5342024-10-01T02:30:54.389Z+ grep nexus
5352024-10-01T02:30:54.389Z+ [[ 8 -gt 300 ]]
5362024-10-01T02:30:54.389Z+ sleep 1
5372024-10-01T02:30:55.376Z+ retry=9
5382024-10-01T02:30:55.400Z+ zoneadm list
5392024-10-01T02:30:55.400Z+ grep nexus
5402024-10-01T02:30:55.400Z+ [[ 9 -gt 300 ]]
5412024-10-01T02:30:55.400Z+ sleep 1
5422024-10-01T02:30:56.388Z+ retry=10
5432024-10-01T02:30:56.412Z+ zoneadm list
5442024-10-01T02:30:56.412Z+ grep nexus
5452024-10-01T02:30:56.412Z+ [[ 10 -gt 300 ]]
5462024-10-01T02:30:56.412Z+ sleep 1
5472024-10-01T02:30:57.399Z+ retry=11
5482024-10-01T02:30:57.423Z+ zoneadm list
5492024-10-01T02:30:57.423Z+ grep nexus
5502024-10-01T02:30:57.423Z+ [[ 11 -gt 300 ]]
5512024-10-01T02:30:57.423Z+ sleep 1
5522024-10-01T02:30:58.411Z+ retry=12
5532024-10-01T02:30:58.434Z+ zoneadm list
5542024-10-01T02:30:58.434Z+ grep nexus
5552024-10-01T02:30:58.434Z+ [[ 12 -gt 300 ]]
5562024-10-01T02:30:58.434Z+ sleep 1
5572024-10-01T02:30:59.421Z+ retry=13
5582024-10-01T02:30:59.445Z+ zoneadm list
5592024-10-01T02:30:59.445Z+ grep nexus
5602024-10-01T02:30:59.445Z+ [[ 13 -gt 300 ]]
5612024-10-01T02:30:59.445Z+ sleep 1
5622024-10-01T02:31:00.432Z+ retry=14
5632024-10-01T02:31:00.456Z+ zoneadm list
5642024-10-01T02:31:00.456Z+ grep nexus
5652024-10-01T02:31:00.456Z+ [[ 14 -gt 300 ]]
5662024-10-01T02:31:00.456Z+ sleep 1
5672024-10-01T02:31:01.443Z+ retry=15
5682024-10-01T02:31:01.467Z+ zoneadm list
5692024-10-01T02:31:01.467Z+ grep nexus
5702024-10-01T02:31:01.468Z+ [[ 15 -gt 300 ]]
5712024-10-01T02:31:01.468Z+ sleep 1
5722024-10-01T02:31:02.454Z+ retry=16
5732024-10-01T02:31:02.478Z+ zoneadm list
5742024-10-01T02:31:02.478Z+ grep nexus
5752024-10-01T02:31:02.478Z+ [[ 16 -gt 300 ]]
5762024-10-01T02:31:02.478Z+ sleep 1
5772024-10-01T02:31:03.464Z+ retry=17
5782024-10-01T02:31:03.488Z+ zoneadm list
5792024-10-01T02:31:03.488Z+ grep nexus
5802024-10-01T02:31:03.488Z+ [[ 17 -gt 300 ]]
5812024-10-01T02:31:03.488Z+ sleep 1
5822024-10-01T02:31:04.475Z+ retry=18
5832024-10-01T02:31:04.499Z+ zoneadm list
5842024-10-01T02:31:04.499Z+ grep nexus
5852024-10-01T02:31:04.499Z+ [[ 18 -gt 300 ]]
5862024-10-01T02:31:04.499Z+ sleep 1
5872024-10-01T02:31:05.486Z+ retry=19
5882024-10-01T02:31:05.510Z+ zoneadm list
5892024-10-01T02:31:05.510Z+ grep nexus
5902024-10-01T02:31:05.510Z+ [[ 19 -gt 300 ]]
5912024-10-01T02:31:05.510Z+ sleep 1
5922024-10-01T02:31:06.497Z+ retry=20
5932024-10-01T02:31:06.521Z+ zoneadm list
5942024-10-01T02:31:06.521Z+ grep nexus
5952024-10-01T02:31:06.521Z+ [[ 20 -gt 300 ]]
5962024-10-01T02:31:06.521Z+ sleep 1
5972024-10-01T02:31:07.508Z+ retry=21
5982024-10-01T02:31:07.532Z+ zoneadm list
5992024-10-01T02:31:07.532Z+ grep nexus
6002024-10-01T02:31:07.532Z+ [[ 21 -gt 300 ]]
6012024-10-01T02:31:07.532Z+ sleep 1
6022024-10-01T02:31:08.520Z+ retry=22
6032024-10-01T02:31:08.543Z+ zoneadm list
6042024-10-01T02:31:08.543Z+ grep nexus
6052024-10-01T02:31:08.543Z+ [[ 22 -gt 300 ]]
6062024-10-01T02:31:08.543Z+ sleep 1
6072024-10-01T02:31:09.531Z+ retry=23
6082024-10-01T02:31:09.555Z+ zoneadm list
6092024-10-01T02:31:09.555Z+ grep nexus
6102024-10-01T02:31:09.555Z+ [[ 23 -gt 300 ]]
6112024-10-01T02:31:09.555Z+ sleep 1
6122024-10-01T02:31:10.541Z+ retry=24
6132024-10-01T02:31:10.565Z+ zoneadm list
6142024-10-01T02:31:10.565Z+ grep nexus
6152024-10-01T02:31:10.565Z+ [[ 24 -gt 300 ]]
6162024-10-01T02:31:10.565Z+ sleep 1
6172024-10-01T02:31:11.554Z+ retry=25
6182024-10-01T02:31:11.580Z+ zoneadm list
6192024-10-01T02:31:11.580Z+ grep nexus
6202024-10-01T02:31:11.580Z+ [[ 25 -gt 300 ]]
6212024-10-01T02:31:11.580Z+ sleep 1
6222024-10-01T02:31:12.563Z+ retry=26
6232024-10-01T02:31:12.586Z+ zoneadm list
6242024-10-01T02:31:12.586Z+ grep nexus
6252024-10-01T02:31:12.586Z+ [[ 26 -gt 300 ]]
6262024-10-01T02:31:12.586Z+ sleep 1
6272024-10-01T02:31:13.573Z+ retry=27
6282024-10-01T02:31:13.597Z+ zoneadm list
6292024-10-01T02:31:13.597Z+ grep nexus
6302024-10-01T02:31:13.597Z+ [[ 27 -gt 300 ]]
6312024-10-01T02:31:13.597Z+ sleep 1
6322024-10-01T02:31:14.585Z+ retry=28
6332024-10-01T02:31:14.609Z+ zoneadm list
6342024-10-01T02:31:14.609Z+ grep nexus
6352024-10-01T02:31:14.609Z+ [[ 28 -gt 300 ]]
6362024-10-01T02:31:14.609Z+ sleep 1
6372024-10-01T02:31:15.595Z+ retry=29
6382024-10-01T02:31:15.619Z+ zoneadm list
6392024-10-01T02:31:15.619Z+ grep nexus
6402024-10-01T02:31:15.619Z+ [[ 29 -gt 300 ]]
6412024-10-01T02:31:15.619Z+ sleep 1
6422024-10-01T02:31:16.606Z+ retry=30
6432024-10-01T02:31:16.631Z+ zoneadm list
6442024-10-01T02:31:16.631Z+ grep nexus
6452024-10-01T02:31:16.631Z+ [[ 30 -gt 300 ]]
6462024-10-01T02:31:16.631Z+ sleep 1
6472024-10-01T02:31:17.616Z+ retry=31
6482024-10-01T02:31:17.640Z+ zoneadm list
6492024-10-01T02:31:17.640Z+ grep nexus
6502024-10-01T02:31:17.640Z+ [[ 31 -gt 300 ]]
6512024-10-01T02:31:17.640Z+ sleep 1
6522024-10-01T02:31:18.627Z+ retry=32
6532024-10-01T02:31:18.650Z+ zoneadm list
6542024-10-01T02:31:18.650Z+ grep nexus
6552024-10-01T02:31:18.651Z+ [[ 32 -gt 300 ]]
6562024-10-01T02:31:18.651Z+ sleep 1
6572024-10-01T02:31:19.638Z+ retry=33
6582024-10-01T02:31:19.662Z+ zoneadm list
6592024-10-01T02:31:19.662Z+ grep nexus
6602024-10-01T02:31:19.662Z+ [[ 33 -gt 300 ]]
6612024-10-01T02:31:19.662Z+ sleep 1
6622024-10-01T02:31:20.649Z+ retry=34
6632024-10-01T02:31:20.672Z+ zoneadm list
6642024-10-01T02:31:20.672Z+ grep nexus
6652024-10-01T02:31:20.672Z+ [[ 34 -gt 300 ]]
6662024-10-01T02:31:20.672Z+ sleep 1
6672024-10-01T02:31:21.660Z+ retry=35
6682024-10-01T02:31:21.683Z+ zoneadm list
6692024-10-01T02:31:21.683Z+ grep nexus
6702024-10-01T02:31:21.683Z+ [[ 35 -gt 300 ]]
6712024-10-01T02:31:21.683Z+ sleep 1
6722024-10-01T02:31:22.674Z+ retry=36
6732024-10-01T02:31:22.698Z+ zoneadm list
6742024-10-01T02:31:22.698Z+ grep nexus
6752024-10-01T02:31:22.698Z+ [[ 36 -gt 300 ]]
6762024-10-01T02:31:22.698Z+ sleep 1
6772024-10-01T02:31:23.686Z+ retry=37
6782024-10-01T02:31:23.710Z+ zoneadm list
6792024-10-01T02:31:23.710Z+ grep nexus
6802024-10-01T02:31:23.710Z+ [[ 37 -gt 300 ]]
6812024-10-01T02:31:23.710Z+ sleep 1
6822024-10-01T02:31:24.748Z+ retry=38
6832024-10-01T02:31:24.787Z+ zoneadm list
6842024-10-01T02:31:24.787Z+ grep nexus
6852024-10-01T02:31:24.946Z+ [[ 38 -gt 300 ]]
6862024-10-01T02:31:24.946Z+ sleep 1
6872024-10-01T02:31:26.208Z+ retry=39
6882024-10-01T02:31:26.208Z+ zoneadm list
6892024-10-01T02:31:26.208Z+ grep nexus
6902024-10-01T02:31:26.276Z+ [[ 39 -gt 300 ]]
6912024-10-01T02:31:26.276Z+ sleep 1
6922024-10-01T02:31:27.295Z+ retry=40
6932024-10-01T02:31:27.319Z+ zoneadm list
6942024-10-01T02:31:27.319Z+ grep nexus
6952024-10-01T02:31:27.319Z+ [[ 40 -gt 300 ]]
6962024-10-01T02:31:27.319Z+ sleep 1
6972024-10-01T02:31:28.311Z+ retry=41
6982024-10-01T02:31:28.335Z+ zoneadm list
6992024-10-01T02:31:28.335Z+ grep nexus
7002024-10-01T02:31:28.335Z+ [[ 41 -gt 300 ]]
7012024-10-01T02:31:28.335Z+ sleep 1
7022024-10-01T02:31:29.325Z+ retry=42
7032024-10-01T02:31:29.348Z+ zoneadm list
7042024-10-01T02:31:29.348Z+ grep nexus
7052024-10-01T02:31:29.349Z+ [[ 42 -gt 300 ]]
7062024-10-01T02:31:29.349Z+ sleep 1
7072024-10-01T02:31:30.337Z+ retry=43
7082024-10-01T02:31:30.361Z+ zoneadm list
7092024-10-01T02:31:30.361Z+ grep nexus
7102024-10-01T02:31:30.361Z+ [[ 43 -gt 300 ]]
7112024-10-01T02:31:30.361Z+ sleep 1
7122024-10-01T02:31:31.351Z+ retry=44
7132024-10-01T02:31:31.375Z+ zoneadm list
7142024-10-01T02:31:31.376Z+ grep nexus
7152024-10-01T02:31:31.376Z+ [[ 44 -gt 300 ]]
7162024-10-01T02:31:31.376Z+ sleep 1
7172024-10-01T02:31:32.363Z+ retry=45
7182024-10-01T02:31:32.388Z+ zoneadm list
7192024-10-01T02:31:32.388Z+ grep nexus
7202024-10-01T02:31:32.388Z+ [[ 45 -gt 300 ]]
7212024-10-01T02:31:32.388Z+ sleep 1
7222024-10-01T02:31:33.375Z+ retry=46
7232024-10-01T02:31:33.399Z+ zoneadm list
7242024-10-01T02:31:33.399Z+ grep nexus
7252024-10-01T02:31:33.399Z+ [[ 46 -gt 300 ]]
7262024-10-01T02:31:33.399Z+ sleep 1
7272024-10-01T02:31:34.387Z+ retry=47
7282024-10-01T02:31:34.411Z+ zoneadm list
7292024-10-01T02:31:34.411Z+ grep nexus
7302024-10-01T02:31:34.411Z+ [[ 47 -gt 300 ]]
7312024-10-01T02:31:34.411Z+ sleep 1
7322024-10-01T02:31:35.400Z+ retry=48
7332024-10-01T02:31:35.423Z+ zoneadm list
7342024-10-01T02:31:35.423Z+ grep nexus
7352024-10-01T02:31:35.423Z+ [[ 48 -gt 300 ]]
7362024-10-01T02:31:35.424Z+ sleep 1
7372024-10-01T02:31:36.416Z+ retry=49
7382024-10-01T02:31:36.440Z+ zoneadm list
7392024-10-01T02:31:36.674Z+ grep nexus
7402024-10-01T02:31:36.697Z+ [[ 49 -gt 300 ]]
7412024-10-01T02:31:36.697Z+ sleep 1
7422024-10-01T02:31:37.682Z+ retry=50
7432024-10-01T02:31:37.706Z+ zoneadm list
7442024-10-01T02:31:37.706Z+ grep nexus
7452024-10-01T02:31:37.706Z+ [[ 50 -gt 300 ]]
7462024-10-01T02:31:37.706Z+ sleep 1
7472024-10-01T02:31:38.698Z+ retry=51
7482024-10-01T02:31:38.722Z+ zoneadm list
7492024-10-01T02:31:38.722Z+ grep nexus
7502024-10-01T02:31:38.722Z+ [[ 51 -gt 300 ]]
7512024-10-01T02:31:38.722Z+ sleep 1
7522024-10-01T02:31:39.710Z+ retry=52
7532024-10-01T02:31:39.735Z+ zoneadm list
7542024-10-01T02:31:39.735Z+ grep nexus
7552024-10-01T02:31:39.735Z+ [[ 52 -gt 300 ]]
7562024-10-01T02:31:39.735Z+ sleep 1
7572024-10-01T02:31:40.723Z+ retry=53
7582024-10-01T02:31:40.747Z+ zoneadm list
7592024-10-01T02:31:40.747Z+ grep nexus
7602024-10-01T02:31:40.747Z+ [[ 53 -gt 300 ]]
7612024-10-01T02:31:40.747Z+ sleep 1
7622024-10-01T02:31:41.736Z+ retry=54
7632024-10-01T02:31:41.760Z+ zoneadm list
7642024-10-01T02:31:41.760Z+ grep nexus
7652024-10-01T02:31:41.760Z+ [[ 54 -gt 300 ]]
7662024-10-01T02:31:41.760Z+ sleep 1
7672024-10-01T02:31:42.748Z+ retry=55
7682024-10-01T02:31:42.772Z+ zoneadm list
7692024-10-01T02:31:42.772Z+ grep nexus
7702024-10-01T02:31:42.772Z+ [[ 55 -gt 300 ]]
7712024-10-01T02:31:42.772Z+ sleep 1
7722024-10-01T02:31:43.762Z+ retry=56
7732024-10-01T02:31:43.785Z+ zoneadm list
7742024-10-01T02:31:43.785Z+ grep nexus
7752024-10-01T02:31:43.785Z+ [[ 56 -gt 300 ]]
7762024-10-01T02:31:43.785Z+ sleep 1
7772024-10-01T02:31:44.775Z+ retry=57
7782024-10-01T02:31:44.799Z+ zoneadm list
7792024-10-01T02:31:44.799Z+ grep nexus
7802024-10-01T02:31:44.799Z+ [[ 57 -gt 300 ]]
7812024-10-01T02:31:44.799Z+ sleep 1
7822024-10-01T02:31:45.789Z+ retry=58
7832024-10-01T02:31:45.814Z+ zoneadm list
7842024-10-01T02:31:45.814Z+ grep nexus
7852024-10-01T02:31:45.814Z+ [[ 58 -gt 300 ]]
7862024-10-01T02:31:45.814Z+ sleep 1
7872024-10-01T02:31:46.807Z+ retry=59
7882024-10-01T02:31:52.418Z+ zoneadm list
7892024-10-01T02:31:52.443Z+ grep nexus
7902024-10-01T02:31:52.443Z+ [[ 59 -gt 300 ]]
7912024-10-01T02:31:52.443Z+ sleep 1
 
7922024-10-01T02:31:52.999ZOct 1 02:31:52 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:162.159.200.1:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
7932024-10-01T02:31:53.450Z+ retry=60
7942024-10-01T02:31:53.473Z+ zoneadm list
7952024-10-01T02:31:53.474Z+ grep nexus
7962024-10-01T02:31:53.474Z+ [[ 60 -gt 300 ]]
7972024-10-01T02:31:53.474Z+ sleep 1
7982024-10-01T02:31:54.468Z+ retry=61
7992024-10-01T02:31:54.492Z+ zoneadm list
8002024-10-01T02:31:54.492Z+ grep nexus
8012024-10-01T02:31:54.492Z+ [[ 61 -gt 300 ]]
8022024-10-01T02:31:54.492Z+ sleep 1
8032024-10-01T02:31:55.486Z+ retry=62
8042024-10-01T02:31:55.510Z+ zoneadm list
8052024-10-01T02:31:55.510Z+ grep nexus
8062024-10-01T02:31:55.510Z+ [[ 62 -gt 300 ]]
8072024-10-01T02:31:55.510Z+ sleep 1
8082024-10-01T02:31:56.498Z+ retry=63
8092024-10-01T02:31:56.522Z+ zoneadm list
8102024-10-01T02:31:56.522Z+ grep nexus
8112024-10-01T02:31:56.522Z+ [[ 63 -gt 300 ]]
8122024-10-01T02:31:56.522Z+ sleep 1
8132024-10-01T02:31:57.510Z+ retry=64
8142024-10-01T02:31:57.534Z+ zoneadm list
8152024-10-01T02:31:57.534Z+ grep nexus
8162024-10-01T02:31:57.534Z+ [[ 64 -gt 300 ]]
8172024-10-01T02:31:57.534Z+ sleep 1
8182024-10-01T02:31:58.522Z+ retry=65
8192024-10-01T02:31:58.545Z+ zoneadm list
8202024-10-01T02:31:58.545Z+ grep nexus
8212024-10-01T02:31:58.545Z+ [[ 65 -gt 300 ]]
8222024-10-01T02:31:58.545Z+ sleep 1
8232024-10-01T02:31:59.534Z+ retry=66
8242024-10-01T02:31:59.558Z+ zoneadm list
8252024-10-01T02:31:59.558Z+ grep nexus
8262024-10-01T02:31:59.558Z+ [[ 66 -gt 300 ]]
8272024-10-01T02:31:59.558Z+ sleep 1
8282024-10-01T02:32:00.546Z+ retry=67
8292024-10-01T02:32:00.570Z+ zoneadm list
8302024-10-01T02:32:00.570Z+ grep nexus
8312024-10-01T02:32:00.570Z+ [[ 67 -gt 300 ]]
8322024-10-01T02:32:00.570Z+ sleep 1
8332024-10-01T02:32:01.558Z+ retry=68
8342024-10-01T02:32:01.582Z+ zoneadm list
8352024-10-01T02:32:01.582Z+ grep nexus
8362024-10-01T02:32:01.582Z+ [[ 68 -gt 300 ]]
8372024-10-01T02:32:01.582Z+ sleep 1
8382024-10-01T02:32:02.575Z+ retry=69
8392024-10-01T02:32:02.599Z+ zoneadm list
8402024-10-01T02:32:02.599Z+ grep nexus
8412024-10-01T02:32:02.599Z+ [[ 69 -gt 300 ]]
8422024-10-01T02:32:02.599Z+ sleep 1
8432024-10-01T02:32:03.591Z+ retry=70
8442024-10-01T02:32:03.615Z+ zoneadm list
8452024-10-01T02:32:03.615Z+ grep nexus
8462024-10-01T02:32:03.615Z+ [[ 70 -gt 300 ]]
8472024-10-01T02:32:03.615Z+ sleep 1
8482024-10-01T02:32:04.602Z+ retry=71
8492024-10-01T02:32:04.625Z+ zoneadm list
8502024-10-01T02:32:04.626Z+ grep nexus
8512024-10-01T02:32:04.626Z+ [[ 71 -gt 300 ]]
8522024-10-01T02:32:04.626Z+ sleep 1
8532024-10-01T02:32:05.613Z+ retry=72
8542024-10-01T02:32:05.638Z+ zoneadm list
8552024-10-01T02:32:05.639Z+ grep nexus
8562024-10-01T02:32:05.639Z+ [[ 72 -gt 300 ]]
8572024-10-01T02:32:05.639Z+ sleep 1
8582024-10-01T02:32:06.626Z+ retry=73
8592024-10-01T02:32:06.650Z+ zoneadm list
8602024-10-01T02:32:06.650Z+ grep nexus
8612024-10-01T02:32:06.650Z+ [[ 73 -gt 300 ]]
8622024-10-01T02:32:06.650Z+ sleep 1
8632024-10-01T02:32:07.639Z+ retry=74
8642024-10-01T02:32:07.662Z+ zoneadm list
8652024-10-01T02:32:07.662Z+ grep nexus
8662024-10-01T02:32:07.663Z+ [[ 74 -gt 300 ]]
8672024-10-01T02:32:07.663Z+ sleep 1
8682024-10-01T02:32:08.653Z+ retry=75
8692024-10-01T02:32:08.677Z+ zoneadm list
8702024-10-01T02:32:08.677Z+ grep nexus
8712024-10-01T02:32:08.677Z+ [[ 75 -gt 300 ]]
8722024-10-01T02:32:08.677Z+ sleep 1
8732024-10-01T02:32:09.665Z+ retry=76
8742024-10-01T02:32:09.689Z+ zoneadm list
8752024-10-01T02:32:09.689Z+ grep nexus
8762024-10-01T02:32:09.689Z+ [[ 76 -gt 300 ]]
8772024-10-01T02:32:09.689Z+ sleep 1
8782024-10-01T02:32:10.677Z+ retry=77
8792024-10-01T02:32:10.701Z+ zoneadm list
8802024-10-01T02:32:10.701Z+ grep nexus
8812024-10-01T02:32:10.701Z+ [[ 77 -gt 300 ]]
8822024-10-01T02:32:10.701Z+ sleep 1
8832024-10-01T02:32:11.688Z+ retry=78
8842024-10-01T02:32:11.712Z+ zoneadm list
8852024-10-01T02:32:11.712Z+ grep nexus
8862024-10-01T02:32:11.712Z+ [[ 78 -gt 300 ]]
8872024-10-01T02:32:11.712Z+ sleep 1
8882024-10-01T02:32:12.700Z+ retry=79
8892024-10-01T02:32:12.724Z+ zoneadm list
8902024-10-01T02:32:12.724Z+ grep nexus
8912024-10-01T02:32:12.724Z+ [[ 79 -gt 300 ]]
8922024-10-01T02:32:12.724Z+ sleep 1
8932024-10-01T02:32:13.712Z+ retry=80
8942024-10-01T02:32:13.735Z+ zoneadm list
8952024-10-01T02:32:13.735Z+ grep nexus
8962024-10-01T02:32:13.735Z+ [[ 80 -gt 300 ]]
8972024-10-01T02:32:13.736Z+ sleep 1
8982024-10-01T02:32:14.726Z+ retry=81
8992024-10-01T02:32:14.750Z+ zoneadm list
9002024-10-01T02:32:14.750Z+ grep nexus
9012024-10-01T02:32:14.750Z+ [[ 81 -gt 300 ]]
9022024-10-01T02:32:14.750Z+ sleep 1
9032024-10-01T02:32:15.740Z+ retry=82
9042024-10-01T02:32:15.764Z+ zoneadm list
9052024-10-01T02:32:15.764Z+ grep nexus
9062024-10-01T02:32:15.764Z+ [[ 82 -gt 300 ]]
9072024-10-01T02:32:15.764Z+ sleep 1
9082024-10-01T02:32:16.752Z+ retry=83
9092024-10-01T02:32:16.775Z+ zoneadm list
9102024-10-01T02:32:16.775Z+ grep nexus
9112024-10-01T02:32:16.775Z+ [[ 83 -gt 300 ]]
9122024-10-01T02:32:16.776Z+ sleep 1
9132024-10-01T02:32:17.764Z+ retry=84
9142024-10-01T02:32:17.787Z+ zoneadm list
9152024-10-01T02:32:17.787Z+ grep nexus
9162024-10-01T02:32:17.787Z+ [[ 84 -gt 300 ]]
9172024-10-01T02:32:17.788Z+ sleep 1
9182024-10-01T02:32:18.782Z+ retry=85
9192024-10-01T02:32:18.806Z+ zoneadm list
9202024-10-01T02:32:18.806Z+ grep nexus
9212024-10-01T02:32:18.806Z+ [[ 85 -gt 300 ]]
9222024-10-01T02:32:18.806Z+ sleep 1
9232024-10-01T02:32:19.803Z+ retry=86
9242024-10-01T02:32:19.827Z+ zoneadm list
9252024-10-01T02:32:19.827Z+ grep nexus
9262024-10-01T02:32:19.827Z+ [[ 86 -gt 300 ]]
9272024-10-01T02:32:19.827Z+ sleep 1
9282024-10-01T02:32:20.823Z+ retry=87
9292024-10-01T02:32:20.846Z+ zoneadm list
9302024-10-01T02:32:20.846Z+ grep nexus
9312024-10-01T02:32:20.846Z+ [[ 87 -gt 300 ]]
9322024-10-01T02:32:20.846Z+ sleep 1
9332024-10-01T02:32:27.632Z+ retry=88
9342024-10-01T02:32:27.632Z+ zoneadm list
9352024-10-01T02:32:27.632Z+ grep nexus
9362024-10-01T02:32:27.811Z+ [[ 88 -gt 300 ]]
9372024-10-01T02:32:27.836Z+ sleep 1
9382024-10-01T02:32:28.884Z+ retry=89
9392024-10-01T02:32:28.908Z+ zoneadm list
9402024-10-01T02:32:28.908Z+ grep nexus
9412024-10-01T02:32:28.908Z+ [[ 89 -gt 300 ]]
9422024-10-01T02:32:28.908Z+ sleep 1
9432024-10-01T02:32:29.907Z+ retry=90
9442024-10-01T02:32:29.931Z+ zoneadm list
9452024-10-01T02:32:29.931Z+ grep nexus
9462024-10-01T02:32:29.931Z+ [[ 90 -gt 300 ]]
9472024-10-01T02:32:29.931Z+ sleep 1
9482024-10-01T02:32:30.930Z+ retry=91
9492024-10-01T02:32:30.964Z+ zoneadm list
9502024-10-01T02:32:30.965Z+ grep nexus
9512024-10-01T02:32:30.965Zoxz_nexus_3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
9522024-10-01T02:32:30.965Zoxz_nexus_e9e4c757-e076-4386-92e2-8217b8bb307d
9532024-10-01T02:32:30.965Zoxz_nexus_772acfa5-ee20-4a17-a053-c207ffa50ed6
9542024-10-01T02:32:30.965Z+ echo 'Waited for nexus: 91s'
9552024-10-01T02:32:30.965ZWaited for nexus: 91s
9562024-10-01T02:32:30.965Z+ export RUST_BACKTRACE=1
9572024-10-01T02:32:30.965Z+ RUST_BACKTRACE=1
9582024-10-01T02:32:30.965Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
9592024-10-01T02:32:30.965Z++ ./target/debug/bootstrap
9602024-10-01T02:32:31.739ZUsing external DNS server at 10.151.1.164:53
9612024-10-01T02:32:31.815Z2024-10-01 02:32:31.804108969 UTC: attempting to log into API
9622024-10-01T02:32:47.267Z2024-10-01 02:32:47.256417980 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
9632024-10-01T02:32:48.267Z2024-10-01 02:32:48.257079518 UTC: attempting to log into API
 
9642024-10-01T02:32:51.291ZOct 1 02:32:50 buskin ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
9652024-10-01T02:32:51.596ZOct 1 02:32:50 buskin ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
9662024-10-01T02:32:51.633ZOct 1 02:32:51 buskin ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
9672024-10-01T02:32:51.666ZOct 1 02:32:51 buskin ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
9682024-10-01T02:32:52.822ZOct 1 02:32:52 buskin ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
9692024-10-01T02:33:01.402ZOct 1 02:33:00 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:108.181.201.22:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
9702024-10-01T02:33:03.300Z2024-10-01 02:33:03.290161925 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
9712024-10-01T02:33:04.301Z2024-10-01 02:33:04.291470994 UTC: attempting to log into API
9722024-10-01T02:33:14.355Z2024-10-01 02:33:14.344815597 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
9732024-10-01T02:33:15.355Z2024-10-01 02:33:15.345159209 UTC: attempting to log into API
9742024-10-01T02:33:16.239Z2024-10-01 02:33:16.229814743 UTC: login succeeded
9752024-10-01T02:33:16.273Zwaiting for nexus to come up...
9762024-10-01T02:33:16.403Zcreating IP pool... 10.151.1.175 - 10.151.1.227
9772024-10-01T02:33:16.761Zsetting up quotas...
9782024-10-01T02:33:16.827Zensuring datasets are ready...
9792024-10-01T02:33:20.623Zlet's roll.
9802024-10-01T02:33:20.647Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
9812024-10-01T02:33:20.647ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9822024-10-01T02:33:20.647ZOXIDE_TOKEN=oxide-token-28be1f2df650558c950fb31f463d83d43d3b8160'
9832024-10-01T02:33:20.647Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9842024-10-01T02:33:20.647Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9852024-10-01T02:33:20.647Z++ OXIDE_TOKEN=oxide-token-28be1f2df650558c950fb31f463d83d43d3b8160
9862024-10-01T02:33:20.647Z+ export OXIDE_HOST OXIDE_TOKEN
9872024-10-01T02:33:20.647Z+ retry=0
9882024-10-01T02:33:20.647Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9892024-10-01T02:33:20.671Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9902024-10-01T02:33:20.671Z+ [[ 0 -gt 60 ]]
9912024-10-01T02:33:20.671Z+ sleep 1
9922024-10-01T02:33:21.656Z+ retry=1
9932024-10-01T02:33:21.656Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9942024-10-01T02:33:21.680Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9952024-10-01T02:33:21.680Z+ [[ 1 -gt 60 ]]
9962024-10-01T02:33:21.680Z+ sleep 1
9972024-10-01T02:33:22.673Z+ retry=2
9982024-10-01T02:33:22.673Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9992024-10-01T02:33:22.697Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10002024-10-01T02:33:22.697Z+ [[ 2 -gt 60 ]]
10012024-10-01T02:33:22.697Z+ sleep 1
10022024-10-01T02:33:23.689Z+ retry=3
10032024-10-01T02:33:23.690Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10042024-10-01T02:33:23.713Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10052024-10-01T02:33:23.713Z+ [[ 3 -gt 60 ]]
10062024-10-01T02:33:23.713Z+ sleep 1
10072024-10-01T02:33:24.706Z+ retry=4
10082024-10-01T02:33:24.706Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10092024-10-01T02:33:24.730Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10102024-10-01T02:33:24.730Z+ [[ 4 -gt 60 ]]
10112024-10-01T02:33:24.730Z+ sleep 1
10122024-10-01T02:33:25.723Z+ retry=5
10132024-10-01T02:33:25.747Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10142024-10-01T02:33:25.747Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10152024-10-01T02:33:25.747Z+ [[ 5 -gt 60 ]]
10162024-10-01T02:33:25.747Z+ sleep 1
10172024-10-01T02:33:26.739Z+ retry=6
10182024-10-01T02:33:26.739Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10192024-10-01T02:33:26.763Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10202024-10-01T02:33:26.763Z+ [[ 6 -gt 60 ]]
10212024-10-01T02:33:26.763Z+ sleep 1
10222024-10-01T02:33:27.757Z+ retry=7
10232024-10-01T02:33:27.757Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10242024-10-01T02:33:27.781Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10252024-10-01T02:33:27.781Z+ [[ 7 -gt 60 ]]
10262024-10-01T02:33:27.781Z+ sleep 1
10272024-10-01T02:33:28.773Z+ retry=8
10282024-10-01T02:33:28.773Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10292024-10-01T02:33:28.797Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10302024-10-01T02:33:28.797Z+ [[ 8 -gt 60 ]]
10312024-10-01T02:33:28.797Z+ sleep 1
10322024-10-01T02:33:29.788Z+ retry=9
10332024-10-01T02:33:29.788Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10342024-10-01T02:33:29.812Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10352024-10-01T02:33:29.812Z+ [[ 9 -gt 60 ]]
10362024-10-01T02:33:29.812Z+ sleep 1
10372024-10-01T02:33:30.804Z+ retry=10
10382024-10-01T02:33:30.804Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10392024-10-01T02:33:30.828Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10402024-10-01T02:33:30.828Z+ [[ 10 -gt 60 ]]
10412024-10-01T02:33:30.828Z+ sleep 1
10422024-10-01T02:33:31.820Z+ retry=11
10432024-10-01T02:33:31.820Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10442024-10-01T02:33:31.844Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10452024-10-01T02:33:31.844Z+ [[ 11 -gt 60 ]]
10462024-10-01T02:33:31.844Z+ sleep 1
10472024-10-01T02:33:32.837Z+ retry=12
10482024-10-01T02:33:32.837Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10492024-10-01T02:33:32.867Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10502024-10-01T02:33:32.867Z+ [[ 12 -gt 60 ]]
10512024-10-01T02:33:32.867Z+ sleep 1
10522024-10-01T02:33:33.852Z+ retry=13
10532024-10-01T02:33:33.852Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10542024-10-01T02:33:33.875Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10552024-10-01T02:33:33.875Z+ [[ 13 -gt 60 ]]
10562024-10-01T02:33:33.875Z+ sleep 1
10572024-10-01T02:33:34.867Z+ retry=14
10582024-10-01T02:33:34.867Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10592024-10-01T02:33:34.891Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10602024-10-01T02:33:34.891Z+ [[ 14 -gt 60 ]]
10612024-10-01T02:33:34.891Z+ sleep 1
10622024-10-01T02:33:35.884Z+ retry=15
10632024-10-01T02:33:35.884Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10642024-10-01T02:33:35.908Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10652024-10-01T02:33:35.908Z+ [[ 15 -gt 60 ]]
10662024-10-01T02:33:35.908Z+ sleep 1
10672024-10-01T02:33:36.900Z+ retry=16
10682024-10-01T02:33:36.900Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10692024-10-01T02:33:36.924Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10702024-10-01T02:33:36.924Z+ [[ 16 -gt 60 ]]
10712024-10-01T02:33:36.924Z+ sleep 1
10722024-10-01T02:33:37.915Z+ retry=17
10732024-10-01T02:33:37.915Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10742024-10-01T02:33:37.939Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10752024-10-01T02:33:37.939Z+ [[ 17 -gt 60 ]]
10762024-10-01T02:33:37.939Z+ sleep 1
10772024-10-01T02:33:38.930Z+ retry=18
10782024-10-01T02:33:38.931Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10792024-10-01T02:33:38.955Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10802024-10-01T02:33:38.955Z+ [[ 18 -gt 60 ]]
10812024-10-01T02:33:38.955Z+ sleep 1
10822024-10-01T02:33:39.946Z+ retry=19
10832024-10-01T02:33:39.946Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10842024-10-01T02:33:39.970Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10852024-10-01T02:33:39.970Z+ [[ 19 -gt 60 ]]
10862024-10-01T02:33:39.970Z+ sleep 1
10872024-10-01T02:33:40.962Z+ retry=20
10882024-10-01T02:33:40.962Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10892024-10-01T02:33:40.986Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10902024-10-01T02:33:40.986Z+ [[ 20 -gt 60 ]]
10912024-10-01T02:33:40.986Z+ sleep 1
10922024-10-01T02:33:41.978Z+ retry=21
10932024-10-01T02:33:41.978Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10942024-10-01T02:33:42.002Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
10952024-10-01T02:33:42.002Z+ [[ 21 -gt 60 ]]
10962024-10-01T02:33:42.002Z+ sleep 1
10972024-10-01T02:33:42.993Z+ retry=22
10982024-10-01T02:33:42.993Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10992024-10-01T02:33:43.017Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11002024-10-01T02:33:43.017Z+ [[ 22 -gt 60 ]]
11012024-10-01T02:33:43.017Z+ sleep 1
11022024-10-01T02:33:44.008Z+ retry=23
11032024-10-01T02:33:44.008Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11042024-10-01T02:33:44.032Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11052024-10-01T02:33:44.032Z+ [[ 23 -gt 60 ]]
11062024-10-01T02:33:44.032Z+ sleep 1
11072024-10-01T02:33:45.024Z+ retry=24
11082024-10-01T02:33:45.024Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11092024-10-01T02:33:45.048Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11102024-10-01T02:33:45.048Z+ [[ 24 -gt 60 ]]
11112024-10-01T02:33:45.048Z+ sleep 1
11122024-10-01T02:33:46.040Z+ retry=25
11132024-10-01T02:33:46.040Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11142024-10-01T02:33:46.064Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11152024-10-01T02:33:46.064Z+ [[ 25 -gt 60 ]]
11162024-10-01T02:33:46.064Z+ sleep 1
11172024-10-01T02:33:47.057Z+ retry=26
11182024-10-01T02:33:47.057Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11192024-10-01T02:33:47.080Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11202024-10-01T02:33:47.080Z+ [[ 26 -gt 60 ]]
11212024-10-01T02:33:47.080Z+ sleep 1
11222024-10-01T02:33:48.073Z+ retry=27
11232024-10-01T02:33:48.073Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11242024-10-01T02:33:48.096Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11252024-10-01T02:33:48.097Z+ [[ 27 -gt 60 ]]
11262024-10-01T02:33:48.097Z+ sleep 1
11272024-10-01T02:33:49.090Z+ retry=28
11282024-10-01T02:33:49.090Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11292024-10-01T02:33:49.114Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11302024-10-01T02:33:49.114Z+ [[ 28 -gt 60 ]]
11312024-10-01T02:33:49.114Z+ sleep 1
11322024-10-01T02:33:50.106Z+ retry=29
11332024-10-01T02:33:50.106Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11342024-10-01T02:33:50.129Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11352024-10-01T02:33:50.129Z+ [[ 29 -gt 60 ]]
11362024-10-01T02:33:50.129Z+ sleep 1
11372024-10-01T02:33:51.121Z+ retry=30
11382024-10-01T02:33:51.121Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11392024-10-01T02:33:51.145Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11402024-10-01T02:33:51.145Z+ [[ 30 -gt 60 ]]
11412024-10-01T02:33:51.145Z+ sleep 1
11422024-10-01T02:33:52.138Z+ retry=31
11432024-10-01T02:33:52.138Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11442024-10-01T02:33:52.162Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11452024-10-01T02:33:52.162Z+ [[ 31 -gt 60 ]]
11462024-10-01T02:33:52.162Z+ sleep 1
11472024-10-01T02:33:53.154Z+ retry=32
11482024-10-01T02:33:53.154Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11492024-10-01T02:33:53.203Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11502024-10-01T02:33:53.203Z+ [[ 32 -gt 60 ]]
11512024-10-01T02:33:53.203Z+ sleep 1
11522024-10-01T02:33:54.170Z+ retry=33
11532024-10-01T02:33:54.170Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11542024-10-01T02:33:54.195Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11552024-10-01T02:33:54.195Z+ [[ 33 -gt 60 ]]
11562024-10-01T02:33:54.195Z+ sleep 1
11572024-10-01T02:33:55.186Z+ retry=34
11582024-10-01T02:33:55.186Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11592024-10-01T02:33:55.210Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11602024-10-01T02:33:55.210Z+ [[ 34 -gt 60 ]]
11612024-10-01T02:33:55.210Z+ sleep 1
11622024-10-01T02:33:56.201Z+ retry=35
11632024-10-01T02:33:56.201Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11642024-10-01T02:33:56.225Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11652024-10-01T02:33:56.225Z+ [[ 35 -gt 60 ]]
11662024-10-01T02:33:56.225Z+ sleep 1
11672024-10-01T02:33:57.216Z+ retry=36
11682024-10-01T02:33:57.216Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11692024-10-01T02:33:57.240Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11702024-10-01T02:33:57.240Z+ [[ 36 -gt 60 ]]
11712024-10-01T02:33:57.240Z+ sleep 1
11722024-10-01T02:33:58.232Z+ retry=37
11732024-10-01T02:33:58.232Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11742024-10-01T02:33:58.256Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11752024-10-01T02:33:58.256Z+ [[ 37 -gt 60 ]]
11762024-10-01T02:33:58.256Z+ sleep 1
11772024-10-01T02:33:59.248Z+ retry=38
11782024-10-01T02:33:59.248Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11792024-10-01T02:33:59.272Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11802024-10-01T02:33:59.272Z+ [[ 38 -gt 60 ]]
11812024-10-01T02:33:59.272Z+ sleep 1
11822024-10-01T02:34:00.265Z+ retry=39
11832024-10-01T02:34:00.265Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11842024-10-01T02:34:00.289Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11852024-10-01T02:34:00.289Z+ [[ 39 -gt 60 ]]
11862024-10-01T02:34:00.289Z+ sleep 1
11872024-10-01T02:34:01.280Z+ retry=40
11882024-10-01T02:34:01.280Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11892024-10-01T02:34:01.304Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11902024-10-01T02:34:01.304Z+ [[ 40 -gt 60 ]]
11912024-10-01T02:34:01.304Z+ sleep 1
11922024-10-01T02:34:02.295Z+ retry=41
11932024-10-01T02:34:02.295Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11942024-10-01T02:34:02.320Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
11952024-10-01T02:34:02.320Z+ [[ 41 -gt 60 ]]
11962024-10-01T02:34:02.320Z+ sleep 1
11972024-10-01T02:34:03.311Z+ retry=42
11982024-10-01T02:34:03.311Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11992024-10-01T02:34:03.335Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
12002024-10-01T02:34:03.335Z+ [[ 42 -gt 60 ]]
12012024-10-01T02:34:03.335Z+ sleep 1
12022024-10-01T02:34:04.327Z+ retry=43
12032024-10-01T02:34:04.327Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12042024-10-01T02:34:04.351Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
12052024-10-01T02:34:04.351Z+ [[ 43 -gt 60 ]]
12062024-10-01T02:34:04.351Z+ sleep 1
12072024-10-01T02:34:05.342Z+ retry=44
12082024-10-01T02:34:05.342Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12092024-10-01T02:34:05.366Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
12102024-10-01T02:34:05.366Z+ [[ 44 -gt 60 ]]
12112024-10-01T02:34:05.366Z+ sleep 1
12122024-10-01T02:34:06.358Z+ retry=45
12132024-10-01T02:34:06.358Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12142024-10-01T02:34:06.383Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
12152024-10-01T02:34:06.383Z+ [[ 45 -gt 60 ]]
12162024-10-01T02:34:06.383Z+ sleep 1
12172024-10-01T02:34:07.374Z+ retry=46
12182024-10-01T02:34:07.398Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12192024-10-01T02:34:07.398Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
12202024-10-01T02:34:07.398Z+ [[ 46 -gt 60 ]]
12212024-10-01T02:34:07.398Z+ sleep 1
12222024-10-01T02:34:08.391Z+ retry=47
12232024-10-01T02:34:08.391Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12242024-10-01T02:34:08.415Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
12252024-10-01T02:34:08.415Z+ [[ 47 -gt 60 ]]
12262024-10-01T02:34:08.415Z+ sleep 1
12272024-10-01T02:34:09.406Z+ retry=48
12282024-10-01T02:34:09.406Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12292024-10-01T02:34:09.430Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
12302024-10-01T02:34:09.430Z+ [[ 48 -gt 60 ]]
12312024-10-01T02:34:09.430Z+ sleep 1
12322024-10-01T02:34:10.421Z+ retry=49
12332024-10-01T02:34:10.421Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12342024-10-01T02:34:10.445Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
12352024-10-01T02:34:10.445Z+ [[ 49 -gt 60 ]]
12362024-10-01T02:34:10.445Z+ sleep 1
12372024-10-01T02:34:11.437Z+ retry=50
12382024-10-01T02:34:11.437Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12392024-10-01T02:34:11.521Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
12402024-10-01T02:34:12.603Z{"status":"ok"}success
12412024-10-01T02:34:12.603ZProject {
12422024-10-01T02:34:12.627Z description: "some images",
12432024-10-01T02:34:12.627Z id: 0601b8ef-179c-4dbe-b84a-3649142937d2,
12442024-10-01T02:34:12.627Z name: Name(
12452024-10-01T02:34:12.627Z "images",
12462024-10-01T02:34:12.627Z ),
12472024-10-01T02:34:12.627Z time_created: 2024-10-01T02:34:11.837576Z,
12482024-10-01T02:34:12.627Z time_modified: 2024-10-01T02:34:11.837576Z,
12492024-10-01T02:34:12.627Z}
12502024-10-01T02:34:12.627Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
12512024-10-01T02:39:32.926Zdone!
12522024-10-01T02:39:33.034Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
12532024-10-01T02:39:33.166Zsuccess
12542024-10-01T02:39:33.166ZImage {
12552024-10-01T02:39:33.166Z block_size: ByteCount(
12562024-10-01T02:39:33.166Z 512,
12572024-10-01T02:39:33.166Z ),
12582024-10-01T02:39:33.215Z description: "debian 11 original base image",
12592024-10-01T02:39:33.215Z digest: None,
12602024-10-01T02:39:33.216Z id: 963e88c6-0afc-4444-baea-ce59fb691cee,
12612024-10-01T02:39:33.216Z name: Name(
12622024-10-01T02:39:33.216Z "debian11",
12632024-10-01T02:39:33.216Z ),
12642024-10-01T02:39:33.216Z os: "debian",
12652024-10-01T02:39:33.216Z project_id: None,
12662024-10-01T02:39:33.216Z size: ByteCount(
12672024-10-01T02:39:33.216Z 2147483648,
12682024-10-01T02:39:33.216Z ),
12692024-10-01T02:39:33.216Z time_created: 2024-10-01T02:39:32.858852Z,
12702024-10-01T02:39:33.216Z time_modified: 2024-10-01T02:39:33.141289Z,
12712024-10-01T02:39:33.216Z url: None,
12722024-10-01T02:39:33.216Z version: "11",
12732024-10-01T02:39:33.216Z}
12742024-10-01T02:39:33.216Z+ for test_bin in tests/*
12752024-10-01T02:39:33.216Z+ ./tests/bootstrap-298787b429772676
12762024-10-01T02:39:33.240Z
12772024-10-01T02:39:33.240Zrunning 0 tests
12782024-10-01T02:39:33.240Z
12792024-10-01T02:39:33.240Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
12802024-10-01T02:39:33.240Z
12812024-10-01T02:39:33.240Z+ for test_bin in tests/*
12822024-10-01T02:39:33.240Z+ ./tests/commtest-b693414e4ee4c465
12832024-10-01T02:39:33.264Z
12842024-10-01T02:39:33.264Zrunning 0 tests
12852024-10-01T02:39:33.265Z
12862024-10-01T02:39:33.265Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
12872024-10-01T02:39:33.265Z
12882024-10-01T02:39:33.265Z+ for test_bin in tests/*
12892024-10-01T02:39:33.265Z+ ./tests/dhcp_server-85b4b8d3d0132374
12902024-10-01T02:39:33.289Z
12912024-10-01T02:39:33.289Zrunning 0 tests
12922024-10-01T02:39:33.289Z
12932024-10-01T02:39:33.289Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
12942024-10-01T02:39:33.289Z
12952024-10-01T02:39:33.289Z+ for test_bin in tests/*
12962024-10-01T02:39:33.289Z+ ./tests/end_to_end_tests-e1dbd8465b82db80
12972024-10-01T02:39:33.514Z
12982024-10-01T02:39:33.514Zrunning 2 tests
12992024-10-01T02:39:33.784Ztest no_spoof::no_spoof_here ... ok
13002024-10-01T02:40:01.114Ztest instance_launch::instance_launch ... ok
13012024-10-01T02:40:01.114Z
13022024-10-01T02:40:01.114Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 27.60s
13032024-10-01T02:40:01.114Z
13042024-10-01T02:40:01.139Z+ _exit_trap
13052024-10-01T02:40:01.139Z+ local status=0
13062024-10-01T02:40:01.139Z+ set +o errexit
13072024-10-01T02:40:01.139Z+ pfexec svcadm -Z disable -s cron
13082024-10-01T02:40:03.462Z+ [[ 0 -eq 0 ]]
13092024-10-01T02:40:03.462Z+ exit 0
13102024-10-01T02:40:03.486Zprocess exited: duration 646213 ms, exit code 0
 
13112024-10-01T02:40:03.569Zfound 108 output files
13122024-10-01T02:40:03.594Zuploading: /var/svc/log/oxide-sled-agent:default.log (924092 bytes)
13132024-10-01T02:40:04.875Zuploaded: /var/svc/log/oxide-sled-agent:default.log
13142024-10-01T02:40:04.898Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (5045703 bytes)
13152024-10-01T02:40:05.312Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 5045703 -> 5059200
13162024-10-01T02:40:06.384Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
13172024-10-01T02:40:06.384Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (37837 bytes)
13182024-10-01T02:40:07.545Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
13192024-10-01T02:40:07.546Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (187661 bytes)
13202024-10-01T02:40:07.728Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 187661 -> 189225
13212024-10-01T02:40:08.799Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
13222024-10-01T02:40:08.799Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (236836 bytes)
13232024-10-01T02:40:09.003Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 236836 -> 239182
13242024-10-01T02:40:10.074Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
13252024-10-01T02:40:10.074Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1524918 bytes)
13262024-10-01T02:40:10.385Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1524918 -> 1538654
13272024-10-01T02:40:11.456Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
13282024-10-01T02:40:11.456Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (3742120 bytes)
13292024-10-01T02:40:11.831Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 3742120 -> 3790720
13302024-10-01T02:40:12.901Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
13312024-10-01T02:40:12.902Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (3339 bytes)
13322024-10-01T02:40:13.998Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
13332024-10-01T02:40:14.022Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (282754 bytes)
13342024-10-01T02:40:14.204Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 282754 -> 287930
13352024-10-01T02:40:15.275Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
13362024-10-01T02:40:15.275Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (8440 bytes)
13372024-10-01T02:40:15.345Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 8440 -> 9025
13382024-10-01T02:40:16.416Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
13392024-10-01T02:40:16.416Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3918 bytes)
13402024-10-01T02:40:17.511Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
13412024-10-01T02:40:17.511Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (7451 bytes)
13422024-10-01T02:40:18.627Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
13432024-10-01T02:40:18.627Zuploading: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_3ae874d1-bf62-481b-aa5f-911ac7586252/root/var/svc/log/oxide-crucible-agent:default.log (12540 bytes)
13442024-10-01T02:40:19.744Zuploaded: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_3ae874d1-bf62-481b-aa5f-911ac7586252/root/var/svc/log/oxide-crucible-agent:default.log
13452024-10-01T02:40:19.744Zuploading: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_3ae874d1-bf62-481b-aa5f-911ac7586252/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13462024-10-01T02:40:20.843Zuploaded: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_3ae874d1-bf62-481b-aa5f-911ac7586252/root/var/svc/log/oxide-crucible-downstairs:default.log
13472024-10-01T02:40:20.843Zuploading: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_3ae874d1-bf62-481b-aa5f-911ac7586252/root/var/svc/log/oxide-crucible-downstairs:downstairs-28d06100-4e68-474d-b873-deb6fdd61240.log (3127 bytes)
13482024-10-01T02:40:21.938Zuploaded: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_3ae874d1-bf62-481b-aa5f-911ac7586252/root/var/svc/log/oxide-crucible-downstairs:downstairs-28d06100-4e68-474d-b873-deb6fdd61240.log
13492024-10-01T02:40:21.938Zuploading: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_3ae874d1-bf62-481b-aa5f-911ac7586252/root/var/svc/log/oxide-zone-network-setup:default.log (1673 bytes)
13502024-10-01T02:40:23.033Zuploaded: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_3ae874d1-bf62-481b-aa5f-911ac7586252/root/var/svc/log/oxide-zone-network-setup:default.log
13512024-10-01T02:40:23.033Zuploading: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_pantry_5ee3adc6-bb70-4180-8a0e-1e58aba9f807/root/var/svc/log/oxide-crucible-pantry:default.log (780 bytes)
13522024-10-01T02:40:24.128Zuploaded: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_pantry_5ee3adc6-bb70-4180-8a0e-1e58aba9f807/root/var/svc/log/oxide-crucible-pantry:default.log
13532024-10-01T02:40:24.128Zuploading: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_pantry_5ee3adc6-bb70-4180-8a0e-1e58aba9f807/root/var/svc/log/oxide-zone-network-setup:default.log (1715 bytes)
13542024-10-01T02:40:25.225Zuploaded: /pool/ext/4b58fe92-3fb4-46b4-9ea6-d620062bf2a1/crypt/zone/oxz_crucible_pantry_5ee3adc6-bb70-4180-8a0e-1e58aba9f807/root/var/svc/log/oxide-zone-network-setup:default.log
13552024-10-01T02:40:25.225Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_clickhouse_9df68fe6-52e1-420d-8e69-ae187fac2b5f/root/var/svc/log/oxide-clickhouse-admin:default.log (876 bytes)
13562024-10-01T02:40:26.317Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_clickhouse_9df68fe6-52e1-420d-8e69-ae187fac2b5f/root/var/svc/log/oxide-clickhouse-admin:default.log
13572024-10-01T02:40:26.317Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_clickhouse_9df68fe6-52e1-420d-8e69-ae187fac2b5f/root/var/svc/log/oxide-clickhouse:default.log (3315324 bytes)
13582024-10-01T02:40:26.686Zupload warning: file "/pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_clickhouse_9df68fe6-52e1-420d-8e69-ae187fac2b5f/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 3315324 -> 3489536
13592024-10-01T02:40:27.758Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_clickhouse_9df68fe6-52e1-420d-8e69-ae187fac2b5f/root/var/svc/log/oxide-clickhouse:default.log
13602024-10-01T02:40:27.758Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_clickhouse_9df68fe6-52e1-420d-8e69-ae187fac2b5f/root/var/svc/log/oxide-zone-network-setup:default.log (1685 bytes)
13612024-10-01T02:40:28.853Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_clickhouse_9df68fe6-52e1-420d-8e69-ae187fac2b5f/root/var/svc/log/oxide-zone-network-setup:default.log
13622024-10-01T02:40:28.854Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_cockroachdb_8ebcccef-2535-4e87-a7f6-0d24490b581d/root/var/svc/log/oxide-cockroach-admin:default.log (4697 bytes)
13632024-10-01T02:40:29.948Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_cockroachdb_8ebcccef-2535-4e87-a7f6-0d24490b581d/root/var/svc/log/oxide-cockroach-admin:default.log
13642024-10-01T02:40:29.949Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_cockroachdb_8ebcccef-2535-4e87-a7f6-0d24490b581d/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
13652024-10-01T02:40:31.044Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_cockroachdb_8ebcccef-2535-4e87-a7f6-0d24490b581d/root/var/svc/log/oxide-cockroachdb:default.log
13662024-10-01T02:40:31.044Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_cockroachdb_8ebcccef-2535-4e87-a7f6-0d24490b581d/root/var/svc/log/oxide-zone-network-setup:default.log (1679 bytes)
13672024-10-01T02:40:32.138Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_cockroachdb_8ebcccef-2535-4e87-a7f6-0d24490b581d/root/var/svc/log/oxide-zone-network-setup:default.log
13682024-10-01T02:40:32.138Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-agent:default.log (36458 bytes)
13692024-10-01T02:40:33.302Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-agent:default.log
13702024-10-01T02:40:33.302Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
13712024-10-01T02:40:34.396Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-downstairs:default.log
13722024-10-01T02:40:34.396Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-downstairs:downstairs-4a0dbfef-57b3-4ebe-bc0c-a309584f4b88.log (5996 bytes)
13732024-10-01T02:40:35.492Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-downstairs:downstairs-4a0dbfef-57b3-4ebe-bc0c-a309584f4b88.log
13742024-10-01T02:40:35.492Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-downstairs:downstairs-e31596f0-9e28-472c-bf45-2116a8bb9e5f.log (6081 bytes)
13752024-10-01T02:40:36.587Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-downstairs:downstairs-e31596f0-9e28-472c-bf45-2116a8bb9e5f.log
13762024-10-01T02:40:36.587Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-downstairs:snapshot-e31596f0-9e28-472c-bf45-2116a8bb9e5f-62030984-2228-41c5-afca-3401c3481b3f.log (5686 bytes)
13772024-10-01T02:40:37.682Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-crucible-downstairs:snapshot-e31596f0-9e28-472c-bf45-2116a8bb9e5f-62030984-2228-41c5-afca-3401c3481b3f.log
13782024-10-01T02:40:37.682Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
13792024-10-01T02:40:38.777Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_crucible_44dd83be-d555-4f7e-91d1-342fa869f697/root/var/svc/log/oxide-zone-network-setup:default.log
13802024-10-01T02:40:38.777Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_external_dns_eb937866-c779-4a9e-aec4-cc18302d4ce1/root/var/svc/log/oxide-external_dns:default.log (31000 bytes)
13812024-10-01T02:40:38.891Zupload warning: file "/pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_external_dns_eb937866-c779-4a9e-aec4-cc18302d4ce1/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 31000 -> 34776
13822024-10-01T02:40:39.962Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_external_dns_eb937866-c779-4a9e-aec4-cc18302d4ce1/root/var/svc/log/oxide-external_dns:default.log
13832024-10-01T02:40:39.962Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_external_dns_eb937866-c779-4a9e-aec4-cc18302d4ce1/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
13842024-10-01T02:40:41.058Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_external_dns_eb937866-c779-4a9e-aec4-cc18302d4ce1/root/var/svc/log/oxide-opte-interface-setup:default.log
13852024-10-01T02:40:41.058Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_external_dns_eb937866-c779-4a9e-aec4-cc18302d4ce1/root/var/svc/log/oxide-zone-network-setup:default.log (1696 bytes)
13862024-10-01T02:40:42.154Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_external_dns_eb937866-c779-4a9e-aec4-cc18302d4ce1/root/var/svc/log/oxide-zone-network-setup:default.log
13872024-10-01T02:40:42.154Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_internal_dns_293e78c2-b712-4c13-b502-e2be11a76306/root/var/svc/log/oxide-internal_dns:default.log (406844 bytes)
13882024-10-01T02:40:42.385Zupload warning: file "/pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_internal_dns_293e78c2-b712-4c13-b502-e2be11a76306/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 406844 -> 410600
13892024-10-01T02:40:43.456Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_internal_dns_293e78c2-b712-4c13-b502-e2be11a76306/root/var/svc/log/oxide-internal_dns:default.log
13902024-10-01T02:40:43.456Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_internal_dns_293e78c2-b712-4c13-b502-e2be11a76306/root/var/svc/log/oxide-zone-network-setup:default.log (1679 bytes)
13912024-10-01T02:40:44.551Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_internal_dns_293e78c2-b712-4c13-b502-e2be11a76306/root/var/svc/log/oxide-zone-network-setup:default.log
13922024-10-01T02:40:44.551Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/svc/log/oxide-chrony-setup:default.log (14495 bytes)
13932024-10-01T02:40:45.668Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/svc/log/oxide-chrony-setup:default.log
13942024-10-01T02:40:45.692Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/svc/log/oxide-ntp:default.log (1237 bytes)
13952024-10-01T02:40:46.764Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/svc/log/oxide-ntp:default.log
13962024-10-01T02:40:46.764Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
13972024-10-01T02:40:47.858Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/svc/log/oxide-opte-interface-setup:default.log
13982024-10-01T02:40:47.858Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/svc/log/oxide-zone-network-setup:default.log (1636 bytes)
13992024-10-01T02:40:48.953Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/svc/log/oxide-zone-network-setup:default.log
14002024-10-01T02:40:48.953Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-agent:default.log (28523 bytes)
14012024-10-01T02:40:50.092Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-agent:default.log
14022024-10-01T02:40:50.093Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14032024-10-01T02:40:51.187Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-downstairs:default.log
14042024-10-01T02:40:51.211Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-downstairs:downstairs-9193435e-d260-4517-998a-b4da858a6e75.log (6077 bytes)
14052024-10-01T02:40:52.282Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-downstairs:downstairs-9193435e-d260-4517-998a-b4da858a6e75.log
14062024-10-01T02:40:52.282Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-downstairs:downstairs-d8cee27b-e338-458d-aea5-933a14aa9c1f.log (3124 bytes)
14072024-10-01T02:40:53.377Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-downstairs:downstairs-d8cee27b-e338-458d-aea5-933a14aa9c1f.log
14082024-10-01T02:40:53.377Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-downstairs:snapshot-9193435e-d260-4517-998a-b4da858a6e75-62030984-2228-41c5-afca-3401c3481b3f.log (5687 bytes)
14092024-10-01T02:40:54.472Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-crucible-downstairs:snapshot-9193435e-d260-4517-998a-b4da858a6e75-62030984-2228-41c5-afca-3401c3481b3f.log
14102024-10-01T02:40:54.472Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
14112024-10-01T02:40:55.566Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_crucible_99df6194-3c68-48e6-a934-d49d19c5c7ee/root/var/svc/log/oxide-zone-network-setup:default.log
14122024-10-01T02:40:55.567Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_nexus_3dfd7033-71d8-4eb9-bb97-49dae3b5cd35/root/var/svc/log/oxide-nexus:default.log (4033560 bytes)
14132024-10-01T02:40:55.969Zupload warning: file "/pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_nexus_3dfd7033-71d8-4eb9-bb97-49dae3b5cd35/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 4033560 -> 4380531
14142024-10-01T02:40:57.039Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_nexus_3dfd7033-71d8-4eb9-bb97-49dae3b5cd35/root/var/svc/log/oxide-nexus:default.log
14152024-10-01T02:40:57.039Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_nexus_3dfd7033-71d8-4eb9-bb97-49dae3b5cd35/root/var/svc/log/oxide-opte-interface-setup:default.log (1133 bytes)
14162024-10-01T02:40:58.134Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_nexus_3dfd7033-71d8-4eb9-bb97-49dae3b5cd35/root/var/svc/log/oxide-opte-interface-setup:default.log
14172024-10-01T02:40:58.134Zuploading: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_nexus_3dfd7033-71d8-4eb9-bb97-49dae3b5cd35/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
14182024-10-01T02:40:59.229Zuploaded: /pool/ext/841bd0ff-a375-452e-9289-601e29937aad/crypt/zone/oxz_nexus_3dfd7033-71d8-4eb9-bb97-49dae3b5cd35/root/var/svc/log/oxide-zone-network-setup:default.log
14192024-10-01T02:40:59.229Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_cockroachdb_37fee788-a460-4bbc-94b7-6cac019067a8/root/var/svc/log/oxide-cockroach-admin:default.log (4699 bytes)
14202024-10-01T02:41:00.324Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_cockroachdb_37fee788-a460-4bbc-94b7-6cac019067a8/root/var/svc/log/oxide-cockroach-admin:default.log
14212024-10-01T02:41:00.324Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_cockroachdb_37fee788-a460-4bbc-94b7-6cac019067a8/root/var/svc/log/oxide-cockroachdb:default.log (4288 bytes)
14222024-10-01T02:41:01.418Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_cockroachdb_37fee788-a460-4bbc-94b7-6cac019067a8/root/var/svc/log/oxide-cockroachdb:default.log
14232024-10-01T02:41:01.418Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_cockroachdb_37fee788-a460-4bbc-94b7-6cac019067a8/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
14242024-10-01T02:41:02.514Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_cockroachdb_37fee788-a460-4bbc-94b7-6cac019067a8/root/var/svc/log/oxide-zone-network-setup:default.log
14252024-10-01T02:41:02.514Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_crucible_0abff335-deb2-4991-b5b4-a3ef2f565fa9/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
14262024-10-01T02:41:03.607Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_crucible_0abff335-deb2-4991-b5b4-a3ef2f565fa9/root/var/svc/log/oxide-crucible-agent:default.log
14272024-10-01T02:41:03.607Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_crucible_0abff335-deb2-4991-b5b4-a3ef2f565fa9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14282024-10-01T02:41:04.702Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_crucible_0abff335-deb2-4991-b5b4-a3ef2f565fa9/root/var/svc/log/oxide-crucible-downstairs:default.log
14292024-10-01T02:41:04.702Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_crucible_0abff335-deb2-4991-b5b4-a3ef2f565fa9/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
14302024-10-01T02:41:05.795Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_crucible_0abff335-deb2-4991-b5b4-a3ef2f565fa9/root/var/svc/log/oxide-zone-network-setup:default.log
14312024-10-01T02:41:05.795Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_external_dns_0a1ed896-5078-4267-b636-10151376f015/root/var/svc/log/oxide-external_dns:default.log (26907 bytes)
14322024-10-01T02:41:05.911Zupload warning: file "/pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_external_dns_0a1ed896-5078-4267-b636-10151376f015/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26907 -> 30682
14332024-10-01T02:41:06.980Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_external_dns_0a1ed896-5078-4267-b636-10151376f015/root/var/svc/log/oxide-external_dns:default.log
14342024-10-01T02:41:06.980Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_external_dns_0a1ed896-5078-4267-b636-10151376f015/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
14352024-10-01T02:41:08.075Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_external_dns_0a1ed896-5078-4267-b636-10151376f015/root/var/svc/log/oxide-opte-interface-setup:default.log
14362024-10-01T02:41:08.075Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_external_dns_0a1ed896-5078-4267-b636-10151376f015/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
14372024-10-01T02:41:09.170Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_external_dns_0a1ed896-5078-4267-b636-10151376f015/root/var/svc/log/oxide-zone-network-setup:default.log
14382024-10-01T02:41:09.170Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_internal_dns_1af5fb25-d768-4bc6-915c-0b4c59e1f0ef/root/var/svc/log/oxide-internal_dns:default.log (406860 bytes)
14392024-10-01T02:41:09.401Zupload warning: file "/pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_internal_dns_1af5fb25-d768-4bc6-915c-0b4c59e1f0ef/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 406860 -> 410616
14402024-10-01T02:41:10.472Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_internal_dns_1af5fb25-d768-4bc6-915c-0b4c59e1f0ef/root/var/svc/log/oxide-internal_dns:default.log
14412024-10-01T02:41:10.472Zuploading: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_internal_dns_1af5fb25-d768-4bc6-915c-0b4c59e1f0ef/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
14422024-10-01T02:41:11.567Zuploaded: /pool/ext/924badcc-07d3-4192-87c0-257ed1dc2017/crypt/zone/oxz_internal_dns_1af5fb25-d768-4bc6-915c-0b4c59e1f0ef/root/var/svc/log/oxide-zone-network-setup:default.log
14432024-10-01T02:41:11.567Zuploading: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_crucible_7f46a1e4-9d58-499a-94fb-494a9375a290/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
14442024-10-01T02:41:12.661Zuploaded: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_crucible_7f46a1e4-9d58-499a-94fb-494a9375a290/root/var/svc/log/oxide-crucible-agent:default.log
14452024-10-01T02:41:12.661Zuploading: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_crucible_7f46a1e4-9d58-499a-94fb-494a9375a290/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14462024-10-01T02:41:13.756Zuploaded: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_crucible_7f46a1e4-9d58-499a-94fb-494a9375a290/root/var/svc/log/oxide-crucible-downstairs:default.log
14472024-10-01T02:41:13.756Zuploading: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_crucible_7f46a1e4-9d58-499a-94fb-494a9375a290/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
14482024-10-01T02:41:14.851Zuploaded: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_crucible_7f46a1e4-9d58-499a-94fb-494a9375a290/root/var/svc/log/oxide-zone-network-setup:default.log
14492024-10-01T02:41:14.851Zuploading: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_nexus_772acfa5-ee20-4a17-a053-c207ffa50ed6/root/var/svc/log/oxide-nexus:default.log (3783463 bytes)
14502024-10-01T02:41:15.252Zupload warning: file "/pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_nexus_772acfa5-ee20-4a17-a053-c207ffa50ed6/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 3783463 -> 4409816
14512024-10-01T02:41:16.323Zuploaded: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_nexus_772acfa5-ee20-4a17-a053-c207ffa50ed6/root/var/svc/log/oxide-nexus:default.log
14522024-10-01T02:41:16.323Zuploading: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_nexus_772acfa5-ee20-4a17-a053-c207ffa50ed6/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
14532024-10-01T02:41:17.417Zuploaded: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_nexus_772acfa5-ee20-4a17-a053-c207ffa50ed6/root/var/svc/log/oxide-opte-interface-setup:default.log
14542024-10-01T02:41:17.417Zuploading: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_nexus_772acfa5-ee20-4a17-a053-c207ffa50ed6/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
14552024-10-01T02:41:18.511Zuploaded: /pool/ext/a04e4a42-059d-4585-a24d-8ec28aa914e5/crypt/zone/oxz_nexus_772acfa5-ee20-4a17-a053-c207ffa50ed6/root/var/svc/log/oxide-zone-network-setup:default.log
14562024-10-01T02:41:18.512Zuploading: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_cockroachdb_e5b107ef-c7bd-453d-bcf6-3c79332eac2d/root/var/svc/log/oxide-cockroach-admin:default.log (4695 bytes)
14572024-10-01T02:41:19.606Zuploaded: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_cockroachdb_e5b107ef-c7bd-453d-bcf6-3c79332eac2d/root/var/svc/log/oxide-cockroach-admin:default.log
14582024-10-01T02:41:19.606Zuploading: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_cockroachdb_e5b107ef-c7bd-453d-bcf6-3c79332eac2d/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
14592024-10-01T02:41:20.701Zuploaded: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_cockroachdb_e5b107ef-c7bd-453d-bcf6-3c79332eac2d/root/var/svc/log/oxide-cockroachdb:default.log
14602024-10-01T02:41:20.701Zuploading: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_cockroachdb_e5b107ef-c7bd-453d-bcf6-3c79332eac2d/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
14612024-10-01T02:41:21.797Zuploaded: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_cockroachdb_e5b107ef-c7bd-453d-bcf6-3c79332eac2d/root/var/svc/log/oxide-zone-network-setup:default.log
14622024-10-01T02:41:21.797Zuploading: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_46e1cda7-578a-4867-bb73-b6c56c6231af/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
14632024-10-01T02:41:22.892Zuploaded: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_46e1cda7-578a-4867-bb73-b6c56c6231af/root/var/svc/log/oxide-crucible-agent:default.log
14642024-10-01T02:41:22.892Zuploading: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_46e1cda7-578a-4867-bb73-b6c56c6231af/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14652024-10-01T02:41:23.987Zuploaded: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_46e1cda7-578a-4867-bb73-b6c56c6231af/root/var/svc/log/oxide-crucible-downstairs:default.log
14662024-10-01T02:41:23.987Zuploading: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_46e1cda7-578a-4867-bb73-b6c56c6231af/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
14672024-10-01T02:41:25.082Zuploaded: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_46e1cda7-578a-4867-bb73-b6c56c6231af/root/var/svc/log/oxide-zone-network-setup:default.log
14682024-10-01T02:41:25.082Zuploading: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_pantry_5ab93dca-3349-4e95-8adc-97fe1d9e5049/root/var/svc/log/oxide-crucible-pantry:default.log (766330 bytes)
14692024-10-01T02:41:26.406Zuploaded: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_pantry_5ab93dca-3349-4e95-8adc-97fe1d9e5049/root/var/svc/log/oxide-crucible-pantry:default.log
14702024-10-01T02:41:26.406Zuploading: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_pantry_5ab93dca-3349-4e95-8adc-97fe1d9e5049/root/var/svc/log/oxide-zone-network-setup:default.log (1716 bytes)
14712024-10-01T02:41:27.500Zuploaded: /pool/ext/a0b3d8f3-189e-4ea5-a742-9dc63f4ac87d/crypt/zone/oxz_crucible_pantry_5ab93dca-3349-4e95-8adc-97fe1d9e5049/root/var/svc/log/oxide-zone-network-setup:default.log
14722024-10-01T02:41:27.500Zuploading: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-agent:default.log (30153 bytes)
14732024-10-01T02:41:28.662Zuploaded: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-agent:default.log
14742024-10-01T02:41:28.662Zuploading: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14752024-10-01T02:41:29.756Zuploaded: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-downstairs:default.log
14762024-10-01T02:41:29.757Zuploading: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-downstairs:downstairs-02ec91fc-0164-464a-b618-4ccc908bd42e.log (3125 bytes)
14772024-10-01T02:41:30.851Zuploaded: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-downstairs:downstairs-02ec91fc-0164-464a-b618-4ccc908bd42e.log
14782024-10-01T02:41:30.851Zuploading: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-downstairs:downstairs-434cf4f7-cce1-4bc5-9c04-a230519fad92.log (5997 bytes)
14792024-10-01T02:41:31.949Zuploaded: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-downstairs:downstairs-434cf4f7-cce1-4bc5-9c04-a230519fad92.log
14802024-10-01T02:41:31.972Zuploading: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-downstairs:downstairs-83e6fd1e-c4e0-40fc-ad69-f87ef216f5fc.log (3019 bytes)
14812024-10-01T02:41:33.044Zuploaded: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-crucible-downstairs:downstairs-83e6fd1e-c4e0-40fc-ad69-f87ef216f5fc.log
14822024-10-01T02:41:33.044Zuploading: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
14832024-10-01T02:41:34.139Zuploaded: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_crucible_9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a/root/var/svc/log/oxide-zone-network-setup:default.log
14842024-10-01T02:41:34.139Zuploading: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_oximeter_41f2943e-6041-44c9-a47a-3cf5fb012644/root/var/svc/log/oxide-oximeter:default.log (1813556 bytes)
14852024-10-01T02:41:34.543Zupload warning: file "/pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_oximeter_41f2943e-6041-44c9-a47a-3cf5fb012644/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1813556 -> 2211168
14862024-10-01T02:41:35.613Zuploaded: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_oximeter_41f2943e-6041-44c9-a47a-3cf5fb012644/root/var/svc/log/oxide-oximeter:default.log
14872024-10-01T02:41:35.636Zuploading: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_oximeter_41f2943e-6041-44c9-a47a-3cf5fb012644/root/var/svc/log/oxide-zone-network-setup:default.log (1672 bytes)
14882024-10-01T02:41:36.708Zuploaded: /pool/ext/ee22443f-adfe-4fb0-bef1-d9b053b6a9d8/crypt/zone/oxz_oximeter_41f2943e-6041-44c9-a47a-3cf5fb012644/root/var/svc/log/oxide-zone-network-setup:default.log
14892024-10-01T02:41:36.708Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_cockroachdb_9005d6ef-ee79-47ee-a6b3-2b98a04766d6/root/var/svc/log/oxide-cockroach-admin:default.log (4699 bytes)
14902024-10-01T02:41:37.803Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_cockroachdb_9005d6ef-ee79-47ee-a6b3-2b98a04766d6/root/var/svc/log/oxide-cockroach-admin:default.log
14912024-10-01T02:41:37.803Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_cockroachdb_9005d6ef-ee79-47ee-a6b3-2b98a04766d6/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
14922024-10-01T02:41:38.897Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_cockroachdb_9005d6ef-ee79-47ee-a6b3-2b98a04766d6/root/var/svc/log/oxide-cockroachdb:default.log
14932024-10-01T02:41:38.897Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_cockroachdb_9005d6ef-ee79-47ee-a6b3-2b98a04766d6/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
14942024-10-01T02:41:39.992Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_cockroachdb_9005d6ef-ee79-47ee-a6b3-2b98a04766d6/root/var/svc/log/oxide-zone-network-setup:default.log
14952024-10-01T02:41:39.993Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-agent:default.log (45290 bytes)
14962024-10-01T02:41:41.154Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-agent:default.log
14972024-10-01T02:41:41.154Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
14982024-10-01T02:41:42.247Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:default.log
14992024-10-01T02:41:42.247Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:downstairs-a72f292e-5a18-470e-93d7-197e83c8cdf4.log (6080 bytes)
15002024-10-01T02:41:43.342Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:downstairs-a72f292e-5a18-470e-93d7-197e83c8cdf4.log
15012024-10-01T02:41:43.342Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1f8d847-fd42-49d2-bb47-7fa1e41516f4.log (3019 bytes)
15022024-10-01T02:41:44.436Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1f8d847-fd42-49d2-bb47-7fa1e41516f4.log
15032024-10-01T02:41:44.436Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:downstairs-e1836339-13cf-4f8e-b5cb-a5e3f1a78390.log (5992 bytes)
15042024-10-01T02:41:45.532Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:downstairs-e1836339-13cf-4f8e-b5cb-a5e3f1a78390.log
15052024-10-01T02:41:45.532Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:snapshot-a72f292e-5a18-470e-93d7-197e83c8cdf4-62030984-2228-41c5-afca-3401c3481b3f.log (5689 bytes)
15062024-10-01T02:41:46.626Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-crucible-downstairs:snapshot-a72f292e-5a18-470e-93d7-197e83c8cdf4-62030984-2228-41c5-afca-3401c3481b3f.log
15072024-10-01T02:41:46.626Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
15082024-10-01T02:41:47.720Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_b4924e44-5dc5-45e0-a39b-c430868b3e63/root/var/svc/log/oxide-zone-network-setup:default.log
15092024-10-01T02:41:47.720Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_pantry_cdeda3ef-54c4-466c-bcd2-15530c779f17/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
15102024-10-01T02:41:48.814Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_pantry_cdeda3ef-54c4-466c-bcd2-15530c779f17/root/var/svc/log/oxide-crucible-pantry:default.log
15112024-10-01T02:41:48.814Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_pantry_cdeda3ef-54c4-466c-bcd2-15530c779f17/root/var/svc/log/oxide-zone-network-setup:default.log (1717 bytes)
15122024-10-01T02:41:49.910Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_crucible_pantry_cdeda3ef-54c4-466c-bcd2-15530c779f17/root/var/svc/log/oxide-zone-network-setup:default.log
15132024-10-01T02:41:49.910Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_nexus_e9e4c757-e076-4386-92e2-8217b8bb307d/root/var/svc/log/oxide-nexus:default.log (36581281 bytes)
15142024-10-01T02:41:51.433Zupload warning: file "/pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_nexus_e9e4c757-e076-4386-92e2-8217b8bb307d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36581281 -> 37220533
15152024-10-01T02:41:52.504Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_nexus_e9e4c757-e076-4386-92e2-8217b8bb307d/root/var/svc/log/oxide-nexus:default.log
15162024-10-01T02:41:52.504Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_nexus_e9e4c757-e076-4386-92e2-8217b8bb307d/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
15172024-10-01T02:41:53.599Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_nexus_e9e4c757-e076-4386-92e2-8217b8bb307d/root/var/svc/log/oxide-opte-interface-setup:default.log
15182024-10-01T02:41:53.599Zuploading: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_nexus_e9e4c757-e076-4386-92e2-8217b8bb307d/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
15192024-10-01T02:41:54.695Zuploaded: /pool/ext/efd83ea1-94bf-48aa-a059-ed387b79a77f/crypt/zone/oxz_nexus_e9e4c757-e076-4386-92e2-8217b8bb307d/root/var/svc/log/oxide-zone-network-setup:default.log
15202024-10-01T02:41:54.695Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_cockroachdb_4e5dd850-e7b4-444d-b7d0-264651e57d4a/root/var/svc/log/oxide-cockroach-admin:default.log (4699 bytes)
15212024-10-01T02:41:55.789Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_cockroachdb_4e5dd850-e7b4-444d-b7d0-264651e57d4a/root/var/svc/log/oxide-cockroach-admin:default.log
15222024-10-01T02:41:55.789Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_cockroachdb_4e5dd850-e7b4-444d-b7d0-264651e57d4a/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
15232024-10-01T02:41:56.883Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_cockroachdb_4e5dd850-e7b4-444d-b7d0-264651e57d4a/root/var/svc/log/oxide-cockroachdb:default.log
15242024-10-01T02:41:56.883Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_cockroachdb_4e5dd850-e7b4-444d-b7d0-264651e57d4a/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
15252024-10-01T02:41:57.977Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_cockroachdb_4e5dd850-e7b4-444d-b7d0-264651e57d4a/root/var/svc/log/oxide-zone-network-setup:default.log
15262024-10-01T02:41:58.001Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_crucible_c516b690-7599-4aaa-8432-aa06ded5383a/root/var/svc/log/oxide-crucible-agent:default.log (8485 bytes)
15272024-10-01T02:41:59.094Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_crucible_c516b690-7599-4aaa-8432-aa06ded5383a/root/var/svc/log/oxide-crucible-agent:default.log
15282024-10-01T02:41:59.094Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_crucible_c516b690-7599-4aaa-8432-aa06ded5383a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
15292024-10-01T02:42:00.189Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_crucible_c516b690-7599-4aaa-8432-aa06ded5383a/root/var/svc/log/oxide-crucible-downstairs:default.log
15302024-10-01T02:42:00.189Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_crucible_c516b690-7599-4aaa-8432-aa06ded5383a/root/var/svc/log/oxide-crucible-downstairs:downstairs-9a0dc6ff-9af9-4f78-ac85-c7fd3e538cfc.log (3019 bytes)
15312024-10-01T02:42:01.283Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_crucible_c516b690-7599-4aaa-8432-aa06ded5383a/root/var/svc/log/oxide-crucible-downstairs:downstairs-9a0dc6ff-9af9-4f78-ac85-c7fd3e538cfc.log
15322024-10-01T02:42:01.283Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_crucible_c516b690-7599-4aaa-8432-aa06ded5383a/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
15332024-10-01T02:42:02.377Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_crucible_c516b690-7599-4aaa-8432-aa06ded5383a/root/var/svc/log/oxide-zone-network-setup:default.log
15342024-10-01T02:42:02.377Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_internal_dns_71ea2e4f-4772-4ce7-8093-48597fd7fd92/root/var/svc/log/oxide-internal_dns:default.log (406847 bytes)
15352024-10-01T02:42:02.609Zupload warning: file "/pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_internal_dns_71ea2e4f-4772-4ce7-8093-48597fd7fd92/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 406847 -> 414358
15362024-10-01T02:42:03.679Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_internal_dns_71ea2e4f-4772-4ce7-8093-48597fd7fd92/root/var/svc/log/oxide-internal_dns:default.log
15372024-10-01T02:42:03.679Zuploading: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_internal_dns_71ea2e4f-4772-4ce7-8093-48597fd7fd92/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
15382024-10-01T02:42:04.774Zuploaded: /pool/ext/ff4b0e2e-bb96-457c-a345-9f8b3478a5a8/crypt/zone/oxz_internal_dns_71ea2e4f-4772-4ce7-8093-48597fd7fd92/root/var/svc/log/oxide-zone-network-setup:default.log
15392024-10-01T02:42:04.774Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/measurements.log (169606 bytes)
15402024-10-01T02:42:05.002Zupload warning: file "/pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/measurements.log" changed size mid upload: 169606 -> 204541
15412024-10-01T02:42:06.073Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/measurements.log
15422024-10-01T02:42:06.073Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/statistics.log (126711 bytes)
15432024-10-01T02:42:06.255Zupload warning: file "/pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/statistics.log" changed size mid upload: 126711 -> 155025
15442024-10-01T02:42:07.326Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/statistics.log
15452024-10-01T02:42:07.326Zuploading: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/tracking.log (21129 bytes)
15462024-10-01T02:42:07.419Zupload warning: file "/pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/tracking.log" changed size mid upload: 21129 -> 23109
15472024-10-01T02:42:08.490Zuploaded: /pool/ext/52791279-0328-47f2-8641-652f421a0533/crypt/zone/oxz_ntp_4ffac138-75e0-477f-9e50-a3eaaace5f82/root/var/log/chrony/tracking.log