01J74RP72NYBNJ8V256JMTDP8T: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.33",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01J74RPXQW0RWMHKHZXXN7EB50

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-09-06T23:25:01.811Zjob dependencies complete; ready to run (waiting for 30 m 55 s)
22024-09-06T23:29:27.440Zjob assigned to worker 01J74TFR2BA9PCZWTWZ99NBV52 (queued for 4 m 25 s)
32024-09-06T23:29:27.553Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-09-06T23:29:27.590Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-09-06T23:29:27.624Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-09-06T23:29:27.657Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-09-06T23:29:27.691Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-09-06T23:29:27.725ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-09-06T23:29:27.758Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102024-09-06T23:29:27.792ZOxide Helios Version helios-2.0.22827 64-bit
112024-09-06T23:29:27.825ZConfiguring devices.
122024-09-06T23:29:27.859Z##################################################
132024-09-06T23:29:27.892Z#### ############# ##
142024-09-06T23:29:27.926Z### ### ############ ##
152024-09-06T23:29:27.960Z## ### # ## ### ## Oxide Computer Company ##
162024-09-06T23:29:27.993Z## ## ## ### # ### ##
172024-09-06T23:29:28.027Z## # ### #### #### This Station Under ##
182024-09-06T23:29:28.061Z### ### #### # ### Computer Control ##
192024-09-06T23:29:28.094Z#### #### ### ## ##
202024-09-06T23:29:28.127Z##################################################
212024-09-06T23:29:28.160ZHostname: sock
222024-09-06T23:29:28.194ZLoading smf(7) service descriptions:
232024-09-06T23:29:28.632Zdownloading input: /input/package/work/package.tar.gz
242024-09-06T23:34:06.544Zdownloaded input: /input/package/work/package.tar.gz
 
252024-09-06T23:34:06.544Zstarting task 0: "setup"
262024-09-06T23:34:06.568Z++ uname -s
272024-09-06T23:34:06.569Z+ kern=SunOS
282024-09-06T23:34:06.569Z+ case "$kern" in
292024-09-06T23:34:06.569Z+ groupadd -g 12345 build
302024-09-06T23:34:06.569Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-09-06T23:34:08.563Z+ zfs create -o mountpoint=/work rpool/work
322024-09-06T23:34:08.610Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-09-06T23:34:08.610Z+ home_fs=zfs
342024-09-06T23:34:08.610Z+ [[ zfs == autofs ]]
352024-09-06T23:34:08.610Z+ mkdir -p /home/build
362024-09-06T23:34:08.611Z+ chown build:build /home/build /work
372024-09-06T23:34:10.594Z+ chmod 0700 /home/build /work
382024-09-06T23:34:10.618Zprocess exited: duration 4052 ms, exit code 0
 
392024-09-06T23:34:10.665Zstarting task 1: "authentication"
402024-09-06T23:34:10.709Zprocess exited: duration 43 ms, exit code 0
 
412024-09-06T23:34:10.756Zstarting task 2: "build"
422024-09-06T23:34:10.780Z+ trap _exit_trap EXIT
432024-09-06T23:34:10.780Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-09-06T23:34:10.873Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-09-06T23:34:10.873Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-09-06T23:34:10.874Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-09-06T23:34:10.874Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-09-06T23:34:10.874Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-09-06T23:34:10.874Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-09-06T23:34:10.874Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-09-06T23:34:10.874Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-09-06T23:34:10.898Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-09-06T23:34:10.898Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-09-06T23:34:10.898Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-09-06T23:34:10.898Z+ [[ -d /opt/oxide ]]
562024-09-06T23:34:10.898Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-09-06T23:34:10.898Z+ pfexec mkdir /opt/oxide
582024-09-06T23:34:10.898Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-09-06T23:34:10.898Z+ [[ -d /opt/oxide-underneath ]]
602024-09-06T23:34:10.898Z+ cd /opt/oxide-underneath
612024-09-06T23:34:10.898Z+ pfexec tar ceEp@/f - .
622024-09-06T23:34:10.898Z+ cd /opt/oxide
632024-09-06T23:34:10.898Z+ pfexec tar xveEp@/f -
642024-09-06T23:34:11.004Zx ., 0 bytes, 0 tape blocks
652024-09-06T23:34:11.004Zx ./opte, 0 bytes, 0 tape blocks
662024-09-06T23:34:11.004Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-09-06T23:34:11.004Zx ./opte/bin/opteadm, 52693888 bytes, 102918 tape blocks
682024-09-06T23:34:11.028Z+ pfexec rm -rf /opt/oxide-underneath
692024-09-06T23:34:11.028Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-09-06T23:34:11.052Z+ pfexec mkdir /opt/oxide/work
712024-09-06T23:34:11.052Z+ pfexec chown build:build /opt/oxide/work
722024-09-06T23:34:11.052Z+ cd /opt/oxide/work
732024-09-06T23:34:11.052Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-09-06T23:34:22.720ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-09-06T23:34:22.720Zx out/target/test, 107 bytes, 1 tape blocks
762024-09-06T23:34:22.720Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-09-06T23:34:22.720Zx package-manifest.toml, 32042 bytes, 63 tape blocks
782024-09-06T23:34:22.720Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-09-06T23:34:22.720Zx target/release/omicron-package, 33213176 bytes, 64870 tape blocks
802024-09-06T23:34:22.720Zx target/release/xtask, 12274400 bytes, 23974 tape blocks
812024-09-06T23:34:22.720Zx target/debug/bootstrap, 198042448 bytes, 386802 tape blocks
822024-09-06T23:34:22.720Zx tests/bootstrap-0676bd204cf6427d, 24309312 bytes, 47480 tape blocks
832024-09-06T23:34:22.720Zx tests/commtest-102495187f1f9712, 24577288 bytes, 48003 tape blocks
842024-09-06T23:34:22.720Zx tests/dhcp_server-1cbab5baa51fbb92, 24309320 bytes, 47480 tape blocks
852024-09-06T23:34:22.720Zx tests/end_to_end_tests-0dfb1f3db11988e5, 210530688 bytes, 411193 tape blocks
862024-09-06T23:34:22.721Zx out/clickhouse.tar.gz, 238247314 bytes, 465327 tape blocks
872024-09-06T23:34:22.721Zx out/clickhouse_keeper.tar.gz, 238240123 bytes, 465313 tape blocks
882024-09-06T23:34:22.721Zx out/clickhouse_server.tar.gz, 238240836 bytes, 465315 tape blocks
892024-09-06T23:34:22.721Zx out/cockroachdb.tar.gz, 135188829 bytes, 264041 tape blocks
902024-09-06T23:34:22.721Zx out/crucible-dtrace.tar, 85504 bytes, 167 tape blocks
912024-09-06T23:34:22.721Zx out/crucible-pantry-zone.tar.gz, 26548598 bytes, 51853 tape blocks
922024-09-06T23:34:22.721Zx out/crucible-zone.tar.gz, 35020331 bytes, 68400 tape blocks
932024-09-06T23:34:22.721Zx out/external-dns.tar.gz, 25529830 bytes, 49863 tape blocks
942024-09-06T23:34:22.721Zx out/internal-dns.tar.gz, 25529590 bytes, 49863 tape blocks
952024-09-06T23:34:22.721Zx out/mg-ddm-gz.tar, 63651840 bytes, 124320 tape blocks
962024-09-06T23:34:22.721Zx out/nexus.tar.gz, 93994540 bytes, 183584 tape blocks
972024-09-06T23:34:22.721Zx out/ntp.tar.gz, 9227561 bytes, 18023 tape blocks
982024-09-06T23:34:22.721Zx out/omicron-gateway-softnpu.tar.gz, 21168845 bytes, 41346 tape blocks
992024-09-06T23:34:22.721Zx out/omicron-sled-agent.tar, 100706816 bytes, 196693 tape blocks
1002024-09-06T23:34:22.721Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1012024-09-06T23:34:22.721Zx out/oximeter.tar.gz, 43317115 bytes, 84604 tape blocks
1022024-09-06T23:34:22.721Zx out/oxlog.tar, 3016704 bytes, 5892 tape blocks
1032024-09-06T23:34:22.721Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1042024-09-06T23:34:22.721Zx out/propolis-server.tar.gz, 67240128 bytes, 131329 tape blocks
1052024-09-06T23:34:22.721Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1062024-09-06T23:34:22.721Zx out/switch-softnpu.tar.gz, 222577035 bytes, 434721 tape blocks
1072024-09-06T23:34:22.745Z
1082024-09-06T23:34:22.745Zreal 11.657241409
1092024-09-06T23:34:22.745Zuser 10.729995452
1102024-09-06T23:34:22.745Zsys 1.598295005
1112024-09-06T23:34:22.745Ztrap 0.000462269
1122024-09-06T23:34:22.745Ztflt 0.000000000
1132024-09-06T23:34:22.746Zdflt 0.000000000
1142024-09-06T23:34:22.746Zkflt 0.000000000
1152024-09-06T23:34:22.746Zlock 0.000000000
1162024-09-06T23:34:22.746Zslp 10.778617087
1172024-09-06T23:34:22.746Zlat 0.205126950
1182024-09-06T23:34:22.746Zstop 0.000132061
1192024-09-06T23:34:22.746Z+ bmat address ls
1202024-09-06T23:34:22.746ZNAME CIDR FIRST LAST COUNT
1212024-09-06T23:34:22.746Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1222024-09-06T23:34:22.746Z++ bmat address ls -f extra -Ho first,last,count
1232024-09-06T23:34:22.746Z+ set -- 10.151.2.164 10.151.2.227 64
1242024-09-06T23:34:22.746Z+ EXTRA_IP_START=10.151.2.164
1252024-09-06T23:34:22.746Z+ EXTRA_IP_END=10.151.2.227
1262024-09-06T23:34:22.746Z+ EXTRA_IP_COUNT=64
1272024-09-06T23:34:22.746Z+ (( EXTRA_IP_COUNT >= 32 ))
1282024-09-06T23:34:22.746Z+ EXTRA_IP_BASE=10.151.2
1292024-09-06T23:34:22.746Z+ EXTRA_IP_FOCTET=164
1302024-09-06T23:34:22.746Z+ EXTRA_IP_LOCTET=227
1312024-09-06T23:34:22.746Z+ SERVICE_IP_POOL_START=10.151.2.164
1322024-09-06T23:34:22.746Z+ SERVICE_IP_POOL_END=10.151.2.173
1332024-09-06T23:34:22.746Z+ DNS_IP1=10.151.2.164
1342024-09-06T23:34:22.746Z+ DNS_IP2=10.151.2.165
1352024-09-06T23:34:22.746Z+ UPLINK_IP=10.151.2.174
1362024-09-06T23:34:22.746Z+ IPPOOL_START=10.151.2.175
1372024-09-06T23:34:22.746Z+ IPPOOL_END=10.151.2.227
1382024-09-06T23:34:22.746Z++ ipadm show-addr -po type,addr
1392024-09-06T23:34:22.746Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1402024-09-06T23:34:22.746Z+ GATEWAY_IP=10.151.2.100
1412024-09-06T23:34:22.746Z+ [[ -n 10.151.2.100 ]]
1422024-09-06T23:34:22.746Z+ ping -s 10.151.2.100 56 1
1432024-09-06T23:34:22.746ZPING 10.151.2.100: 56 data bytes
1442024-09-06T23:34:22.746Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.012 ms
1452024-09-06T23:34:22.746Z
1462024-09-06T23:34:22.746Z----10.151.2.100 PING Statistics----
1472024-09-06T23:34:22.746Z1 packets transmitted, 1 packets received, 0% packet loss
1482024-09-06T23:34:22.746Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
1492024-09-06T23:34:22.746Z++ arp -an
1502024-09-06T23:34:22.747Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1512024-09-06T23:34:22.747Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1522024-09-06T23:34:22.747Z+ routeadm -e ipv4-forwarding -u
1532024-09-06T23:34:22.858Z+ PXA_START=10.151.2.164
1542024-09-06T23:34:22.858Z+ PXA_END=10.151.2.227
1552024-09-06T23:34:22.881Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1562024-09-06T23:34:22.993Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227
1572024-09-06T23:34:23.016ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1582024-09-06T23:34:23.072Zcreating virtual hardware
1592024-09-06T23:34:23.096Zcreating /scratch/m2_0.vdev
1602024-09-06T23:34:23.096Zcreating /scratch/m2_1.vdev
1612024-09-06T23:34:23.096Zcreating /scratch/u2_0.vdev
1622024-09-06T23:34:23.096Zcreating /scratch/u2_1.vdev
1632024-09-06T23:34:23.096Zcreating /scratch/u2_2.vdev
1642024-09-06T23:34:23.096Zcreating /scratch/u2_3.vdev
1652024-09-06T23:34:23.096Zcreating /scratch/u2_4.vdev
1662024-09-06T23:34:23.096Zcreating /scratch/u2_5.vdev
1672024-09-06T23:34:23.097Zcreating /scratch/u2_6.vdev
1682024-09-06T23:34:23.097Zcreating /scratch/u2_7.vdev
1692024-09-06T23:34:23.097Zcreating /scratch/u2_8.vdev
1702024-09-06T23:34:23.120ZSimnet net0/sc0_0 exists
1712024-09-06T23:34:23.144ZSimnet net1/sc1_0 exists
1722024-09-06T23:34:23.167ZVnic sc0_1 exists
1732024-09-06T23:34:35.688ZUsing 10.151.2.100 as gateway ip
1742024-09-06T23:34:35.688Zusing 18:C0:4D:0D:A0:2A as gateway mac
1752024-09-06T23:34:35.688Zconfiguring SoftNPU ARP entry
1762024-09-06T23:34:35.715Zconfiguring SoftNPU proxy ARP
1772024-09-06T23:34:35.770ZSoftNPU state:
1782024-09-06T23:34:35.770Z local v6:
1792024-09-06T23:34:35.770Z local v4:
1802024-09-06T23:34:35.770Z router v6:
1812024-09-06T23:34:35.770Z router v4_idx:
1822024-09-06T23:34:35.770Z router v4_routes:
1832024-09-06T23:34:35.770Z resolver v4:
1842024-09-06T23:34:35.770Z 10.151.2.100 -> 18:c0:4d:0d:a0:2a
1852024-09-06T23:34:35.770Z resolver v6:
1862024-09-06T23:34:35.770Z nat v4:
1872024-09-06T23:34:35.770Z nat_v6:
1882024-09-06T23:34:35.770Z port_mac:
1892024-09-06T23:34:35.770Z proxy arp:
1902024-09-06T23:34:35.770Z 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
1912024-09-06T23:34:35.770Zcreated virtual hardware
1922024-09-06T23:34:35.795Z
1932024-09-06T23:34:35.795Zreal 12.773947739
1942024-09-06T23:34:35.795Zuser 0.685685826
1952024-09-06T23:34:35.795Zsys 3.141655933
1962024-09-06T23:34:35.795Ztrap 0.000055026
1972024-09-06T23:34:35.795Ztflt 0.000196773
1982024-09-06T23:34:35.795Zdflt 0.000390028
1992024-09-06T23:34:35.795Zkflt 0.000000000
2002024-09-06T23:34:35.795Zlock 9:52.159918236
2012024-09-06T23:34:35.795Zslp 38.591406320
2022024-09-06T23:34:35.795Zlat 0.072796398
2032024-09-06T23:34:35.795Zstop 0.366949990
2042024-09-06T23:34:35.796Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2052024-09-06T23:34:35.842Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2062024-09-06T23:34:35.842Z+ diff -u pkg/config.toml~ pkg/config.toml
2072024-09-06T23:34:35.842Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2082024-09-06T23:34:35.842Z+++ pkg/config.toml Fri Sep 6 23:34:35 2024
2092024-09-06T23:34:35.842Z@@ -29,18 +29,18 @@
2102024-09-06T23:34:35.842Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2112024-09-06T23:34:35.842Z # followed by a string that is embedded into their fake serial values.
2122024-09-06T23:34:35.842Z vdevs = [
2132024-09-06T23:34:35.842Z- "m2_0.vdev",
2142024-09-06T23:34:35.842Z- "m2_1.vdev",
2152024-09-06T23:34:35.842Z+ "/scratch/m2_0.vdev",
2162024-09-06T23:34:35.842Z+ "/scratch/m2_1.vdev",
2172024-09-06T23:34:35.842Z
2182024-09-06T23:34:35.842Z- "u2_0.vdev",
2192024-09-06T23:34:35.842Z- "u2_1.vdev",
2202024-09-06T23:34:35.842Z- "u2_2.vdev",
2212024-09-06T23:34:35.842Z- "u2_3.vdev",
2222024-09-06T23:34:35.842Z- "u2_4.vdev",
2232024-09-06T23:34:35.842Z- "u2_5.vdev",
2242024-09-06T23:34:35.842Z- "u2_6.vdev",
2252024-09-06T23:34:35.842Z- "u2_7.vdev",
2262024-09-06T23:34:35.842Z- "u2_8.vdev",
2272024-09-06T23:34:35.842Z+ "/scratch/u2_0.vdev",
2282024-09-06T23:34:35.842Z+ "/scratch/u2_1.vdev",
2292024-09-06T23:34:35.842Z+ "/scratch/u2_2.vdev",
2302024-09-06T23:34:35.842Z+ "/scratch/u2_3.vdev",
2312024-09-06T23:34:35.842Z+ "/scratch/u2_4.vdev",
2322024-09-06T23:34:35.842Z+ "/scratch/u2_5.vdev",
2332024-09-06T23:34:35.843Z+ "/scratch/u2_6.vdev",
2342024-09-06T23:34:35.843Z+ "/scratch/u2_7.vdev",
2352024-09-06T23:34:35.843Z+ "/scratch/u2_8.vdev",
2362024-09-06T23:34:35.843Z ]
2372024-09-06T23:34:35.843Z
2382024-09-06T23:34:35.843Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2392024-09-06T23:34:35.843Z+ true
2402024-09-06T23:34:35.843Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2412024-09-06T23:34:35.843Z+ SILO_NAME=recovery
2422024-09-06T23:34:35.843Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2432024-09-06T23:34:35.843Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2442024-09-06T23:34:35.843Z+ sed -i~ '
2452024-09-06T23:34:35.843Z /^external_dns_ips/c\
2462024-09-06T23:34:35.843Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2472024-09-06T23:34:35.843Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2482024-09-06T23:34:35.843Z /^first/c\
2492024-09-06T23:34:35.843Zfirst = "10.151.2.164"
2502024-09-06T23:34:35.843Z /^last/c\
2512024-09-06T23:34:35.843Zlast = "10.151.2.173"
2522024-09-06T23:34:35.843Z }
2532024-09-06T23:34:35.843Z /^infra_ip_first/c\
2542024-09-06T23:34:35.843Zinfra_ip_first = "10.151.2.174"
2552024-09-06T23:34:35.843Z /^infra_ip_last/c\
2562024-09-06T23:34:35.843Zinfra_ip_last = "10.151.2.174"
2572024-09-06T23:34:35.843Z /^\[\[rack_network_config.ports/,/^$/ {
2582024-09-06T23:34:35.843Z /^routes/c\
2592024-09-06T23:34:35.843Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
2602024-09-06T23:34:35.843Z /^addresses/c\
2612024-09-06T23:34:35.843Zaddresses = \[{address = "10.151.2.174/24"} \]
2622024-09-06T23:34:35.843Z }
2632024-09-06T23:34:35.843Z' pkg/config-rss.toml
2642024-09-06T23:34:35.843Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2652024-09-06T23:34:35.843Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2662024-09-06T23:34:35.843Z+++ pkg/config-rss.toml Fri Sep 6 23:34:35 2024
2672024-09-06T23:34:35.843Z@@ -33,7 +33,7 @@
2682024-09-06T23:34:35.843Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2692024-09-06T23:34:35.843Z # must be contained in one of the "internal services" IP Pool ranges listed
2702024-09-06T23:34:35.843Z # below.
2712024-09-06T23:34:35.844Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2722024-09-06T23:34:35.844Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2732024-09-06T23:34:35.844Z
2742024-09-06T23:34:35.844Z # Initial TLS certificates for the external API
2752024-09-06T23:34:35.844Z #
2762024-09-06T23:34:35.844Z@@ -69,8 +69,8 @@
2772024-09-06T23:34:35.844Z #
2782024-09-06T23:34:35.844Z # For more on this and what to put here, see docs/how-to-run.adoc.
2792024-09-06T23:34:35.844Z [[internal_services_ip_pool_ranges]]
2802024-09-06T23:34:35.844Z-first = "192.168.1.20"
2812024-09-06T23:34:35.844Z-last = "192.168.1.29"
2822024-09-06T23:34:35.844Z+first = "10.151.2.164"
2832024-09-06T23:34:35.844Z+last = "10.151.2.173"
2842024-09-06T23:34:35.844Z
2852024-09-06T23:34:35.844Z # TODO - this configuration is subject to change going forward. Ultimately these
2862024-09-06T23:34:35.844Z # parameters should be provided to the control plane via wicket, but we need to
2872024-09-06T23:34:35.844Z@@ -91,8 +91,8 @@
2882024-09-06T23:34:35.844Z # A range of IP addresses used by Boundary Services on the external network. In
2892024-09-06T23:34:35.844Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2902024-09-06T23:34:35.844Z # With softnpu, only one address is used.
2912024-09-06T23:34:35.844Z-infra_ip_first = "192.168.1.30"
2922024-09-06T23:34:35.844Z-infra_ip_last = "192.168.1.30"
2932024-09-06T23:34:35.844Z+infra_ip_first = "10.151.2.174"
2942024-09-06T23:34:35.844Z+infra_ip_last = "10.151.2.174"
2952024-09-06T23:34:35.844Z
2962024-09-06T23:34:35.844Z # Configurations for BGP routers to run on the scrimlets.
2972024-09-06T23:34:35.844Z bgp = []
2982024-09-06T23:34:35.844Z@@ -100,9 +100,9 @@
2992024-09-06T23:34:35.844Z # You can configure multiple uplinks by repeating the following stanza
3002024-09-06T23:34:35.844Z [[rack_network_config.ports]]
3012024-09-06T23:34:35.844Z # Routes associated with this port.
3022024-09-06T23:34:35.844Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3032024-09-06T23:34:35.844Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
3042024-09-06T23:34:35.844Z # Addresses associated with this port.
3052024-09-06T23:34:35.868Z-addresses = [{address = "192.168.1.30/24"}]
3062024-09-06T23:34:35.869Z+addresses = [{address = "10.151.2.174/24"} ]
3072024-09-06T23:34:35.869Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3082024-09-06T23:34:35.869Z port = "qsfp0"
3092024-09-06T23:34:35.869Z # The speed of this port.
3102024-09-06T23:34:35.869Z+ true
3112024-09-06T23:34:35.869Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3122024-09-06T23:34:35.869Za pkg/config-rss.toml 8K
3132024-09-06T23:34:35.869Za pkg/config.toml 4K
3142024-09-06T23:34:35.869Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3152024-09-06T23:34:35.869Z+ TLS_NAME=recovery.sys.oxide.test
3162024-09-06T23:34:35.869Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3172024-09-06T23:34:36.236Z......+.....+......+.+.....+.+.....+...+....+...+............+...........+....+...+............+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+......+.....+.+......+..+...+.......+............+........+......+.+...+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+......+...............+.....+................+..+.......+........+...+...+....+.....+.+..+...+.......+.........+..............+.........+..........+...........+......+....+...........+...+...+............+.+..............+..................+....+...........+.......+......+............+............+......+..+...+.+...+...........+....+............+......+.....+...............+.............+.....+....+......+...........+...+.+............+..+.....................+......+...+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3182024-09-06T23:34:38.576Z..+...+....+...+..+...+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+..+....+........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+.......+.....+.+..+.+..+.......+........+...........................+..........+.....+.+..+...+.+.........+..+....+......+........+......+...+.......+...+..+...+......+......+......+............+.+..+....+...............+...........+..........+.................+.......+......+.....+...+.......+............+......+......+.........+..+.......+......+.....+......+...+......+...............+.+.....+...+...+.......+......+..+.........+.+..............+...+.......+...+...+.................+.+...............+......+.....+...+.......+..............+.......+..+..........+........+...+....+......+....................+.+.....+.+.....+...+.......+..+.......+...+..+.........+................+.........+......+..............+.+.....+.+..+.+............+.....+..........+...............+..................+........................+.....+.+...........+...+............+.............+.....+..........+........+.......+.....+...+............+......+.+......+..+...+...+.+...............+..................+........+.......+......+...............+...............+......+...+.....+.+.....+..........+............+............+...+.........+..................+.....+................+.....+............+.......+..+....+..............+.+..+..............................+.......+.....+...+....+.....+......+.......+............+...+...+...+......+.....+...+..........+..+.+........+....+...+..............+.....................+...............+....+...+..+.+.......................+....+........+....+.....+......+...+............+............+.+......+...+......+.....+.+..............+..........+............+.....+....+.....+......+.........+......+.............+..+.......+.....+......+.+.....+..........+........+...+.........+...+.........................+..+.+............+...........+.+........+......+......+.+..+...............+......................+...+...............+...............+.....+.+..+...+.+......+...+..+....+...+............+.....+.+..+..........+..+.........+......+....+.....+.........+............+...+......+.+........+...+.......+...+...+............+........+....+.....................+...........+.+....................+...+....+.....+................+.....+.......+...+...........+...+...+...+...............................+.....+...+...+............+.+.....+.........+.+......+...............+...+.....+...+...+.......+...+...........+.................................+.......+.........+.....+.......+..+.......+..................+...+.....+...+.......+...+......+...+..................+.............................+...+.+..+...............+....+...........+............+.+...........+.........+.+..............+.....................+.+..+.+.........+........+.............+..+...+.......+..+.+..............+.............+..............+..................+.......+......+.......................+....+...+...+..+.........+...+.............+........+.+.........+.....+.........+..........+..+...+......+.+........................+..+.............+.........+...+..+.+..+............+.......+.........+.....+...............+.+......+............+..+.+...+.........+..+..................+...............+................+.....+.+...+.....+......+.......+...+.........+..+.+..+.......+...+......+.....+.......+............+..+....+...........+.........+.......+.........+.........+.....+.........+......................+........+......+......+.+..+.+............+.........+........+......+.+......+..............+.+...+..+.............+.........+...+............+............+......+...+......+........+...+...+....+...........+................+...+..+..................+.......+...+.....+......+........................+..........+......+.........+..+...+.+..+....+...........+............+...+.........+....+......+...........+..........+...............+..............+.............+..+....+......+...+.....+.+............+..+......+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3192024-09-06T23:34:38.601Z-----
3202024-09-06T23:34:38.602Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3212024-09-06T23:34:38.602Za pkg/initial-tls-cert.pem 2K
3222024-09-06T23:34:38.602Za pkg/initial-tls-key.pem 4K
3232024-09-06T23:34:38.602Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3242024-09-06T23:34:38.602Z+ rmdir pkg
3252024-09-06T23:34:38.626Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3262024-09-06T23:34:38.626Z+ pfexec mkdir -p /usr/oxide
3272024-09-06T23:34:38.626Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3282024-09-06T23:34:39.321Z+ pfexec chmod +x /usr/oxide/oxide
3292024-09-06T23:34:39.346Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3302024-09-06T23:34:57.629Z+ OMICRON_NO_UNINSTALL=1
3312024-09-06T23:34:57.629Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3322024-09-06T23:34:57.657ZLogging to: /opt/oxide/work/out/LOG
3332024-09-06T23:34:58.225Z
3342024-09-06T23:34:58.252Zreal 0.591225346
3352024-09-06T23:34:58.252Zuser 0.132689645
3362024-09-06T23:34:58.252Zsys 3.022231027
3372024-09-06T23:34:58.252Ztrap 0.000014959
3382024-09-06T23:34:58.252Ztflt 0.000003520
3392024-09-06T23:34:58.252Zdflt 0.000635789
3402024-09-06T23:34:58.252Zkflt 0.000000000
3412024-09-06T23:34:58.252Zlock 53.198066039
3422024-09-06T23:34:58.252Zslp 0.779238819
3432024-09-06T23:34:58.252Zlat 0.003366609
3442024-09-06T23:34:58.252Zstop 0.201955357
3452024-09-06T23:34:58.252Z+ retry=0
3462024-09-06T23:34:58.252Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3472024-09-06T23:34:58.253Z+ [[ 0 -gt 30 ]]
3482024-09-06T23:34:58.253Z+ sleep 1
3492024-09-06T23:34:59.240Z+ retry=1
3502024-09-06T23:34:59.240Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3512024-09-06T23:34:59.278Z+ [[ 1 -gt 30 ]]
3522024-09-06T23:34:59.278Z+ sleep 1
3532024-09-06T23:35:00.256Z+ retry=2
3542024-09-06T23:35:00.256Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3552024-09-06T23:35:00.287Z+ [[ 2 -gt 30 ]]
3562024-09-06T23:35:00.287Z+ sleep 1
3572024-09-06T23:35:01.270Z+ retry=3
3582024-09-06T23:35:01.270Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3592024-09-06T23:35:21.282Z+ [[ 3 -gt 30 ]]
3602024-09-06T23:35:21.282Z+ sleep 1
3612024-09-06T23:35:22.285Z+ retry=4
3622024-09-06T23:35:22.285Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3632024-09-06T23:35:22.309Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3642024-09-06T23:35:22.332Zlocal v6:
3652024-09-06T23:35:22.332Zfe80::18cd:2dff:fe84:e49b
3662024-09-06T23:35:22.333Zlocal v4:
3672024-09-06T23:35:22.333Z10.151.2.174
3682024-09-06T23:35:22.333Zrouter v6:
3692024-09-06T23:35:22.333Zrouter v4_idx:
3702024-09-06T23:35:22.333Zrouter v4_routes:
3712024-09-06T23:35:22.333Zresolver v4:
3722024-09-06T23:35:22.333Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
3732024-09-06T23:35:22.333Zresolver v6:
3742024-09-06T23:35:22.333Zfe80::dc44:8aff:fe40:932b -> de:44:8a:40:93:2b
3752024-09-06T23:35:22.333Zfe80::18cd:2dff:fe84:e49b -> 1a:cd:2d:84:e4:9b
3762024-09-06T23:35:22.333Znat v4:
3772024-09-06T23:35:22.333Znat_v6:
3782024-09-06T23:35:22.333Zport_mac:
3792024-09-06T23:35:22.333Z1: a8:40:25:3f:67:ed
3802024-09-06T23:35:22.333Z1000: a8:40:25:3f:67:ec
3812024-09-06T23:35:22.333Z2: a8:40:25:3f:68:0d
3822024-09-06T23:35:22.333Zproxy arp:
3832024-09-06T23:35:22.333Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
3842024-09-06T23:35:22.333Z+ retry=0
3852024-09-06T23:35:22.333Z+++ zoneadm list -n
3862024-09-06T23:35:22.333Z+++ grep oxz_ntp
3872024-09-06T23:35:22.357Z++ pfexec svcs -z -Hostate oxide/ntp
3882024-09-06T23:35:22.357Zsvcs: zone '-Hostate': entity not found
3892024-09-06T23:35:22.357Z++ true
3902024-09-06T23:35:22.357Z+ [[ '' != online ]]
3912024-09-06T23:35:22.357Z+ [[ 0 -gt 60 ]]
3922024-09-06T23:35:22.357Z+ sleep 1
3932024-09-06T23:35:23.345Z+ retry=1
3942024-09-06T23:35:23.369Z+++ zoneadm list -n
3952024-09-06T23:35:23.369Z+++ grep oxz_ntp
3962024-09-06T23:35:23.369Z++ pfexec svcs -z -Hostate oxide/ntp
3972024-09-06T23:35:23.369Zsvcs: zone '-Hostate': entity not found
3982024-09-06T23:35:23.369Z++ true
3992024-09-06T23:35:23.369Z+ [[ '' != online ]]
4002024-09-06T23:35:23.369Z+ [[ 1 -gt 60 ]]
4012024-09-06T23:35:23.369Z+ sleep 1
4022024-09-06T23:35:24.366Z+ retry=2
4032024-09-06T23:35:24.390Z+++ zoneadm list -n
4042024-09-06T23:35:24.390Z+++ grep oxz_ntp
4052024-09-06T23:35:24.390Z++ pfexec svcs -z -Hostate oxide/ntp
4062024-09-06T23:35:24.390Zsvcs: zone '-Hostate': entity not found
4072024-09-06T23:35:24.390Z++ true
4082024-09-06T23:35:24.390Z+ [[ '' != online ]]
4092024-09-06T23:35:24.390Z+ [[ 2 -gt 60 ]]
4102024-09-06T23:35:24.390Z+ sleep 1
4112024-09-06T23:35:25.390Z+ retry=3
4122024-09-06T23:35:25.413Z+++ zoneadm list -n
4132024-09-06T23:35:25.413Z+++ grep oxz_ntp
4142024-09-06T23:35:25.413Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4152024-09-06T23:35:25.437Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4162024-09-06T23:35:25.437Z++ true
4172024-09-06T23:35:25.437Z+ [[ '' != online ]]
4182024-09-06T23:35:25.437Z+ [[ 3 -gt 60 ]]
4192024-09-06T23:35:25.437Z+ sleep 1
4202024-09-06T23:35:26.421Z+ retry=4
4212024-09-06T23:35:26.445Z+++ zoneadm list -n
4222024-09-06T23:35:26.445Z+++ grep oxz_ntp
4232024-09-06T23:35:26.445Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4242024-09-06T23:35:26.468Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4252024-09-06T23:35:26.468Z++ true
4262024-09-06T23:35:26.468Z+ [[ '' != online ]]
4272024-09-06T23:35:26.468Z+ [[ 4 -gt 60 ]]
4282024-09-06T23:35:26.468Z+ sleep 1
4292024-09-06T23:35:27.454Z+ retry=5
4302024-09-06T23:35:27.477Z+++ zoneadm list -n
4312024-09-06T23:35:27.477Z+++ grep oxz_ntp
4322024-09-06T23:35:27.477Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4332024-09-06T23:35:27.501Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4342024-09-06T23:35:27.501Z++ true
4352024-09-06T23:35:27.501Z+ [[ '' != online ]]
4362024-09-06T23:35:27.501Z+ [[ 5 -gt 60 ]]
4372024-09-06T23:35:27.501Z+ sleep 1
4382024-09-06T23:35:28.484Z+ retry=6
4392024-09-06T23:35:28.508Z+++ zoneadm list -n
4402024-09-06T23:35:28.508Z+++ grep oxz_ntp
4412024-09-06T23:35:28.508Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4422024-09-06T23:35:28.532Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4432024-09-06T23:35:28.532Z++ true
4442024-09-06T23:35:28.532Z+ [[ '' != online ]]
4452024-09-06T23:35:28.532Z+ [[ 6 -gt 60 ]]
4462024-09-06T23:35:28.532Z+ sleep 1
4472024-09-06T23:35:29.515Z+ retry=7
4482024-09-06T23:35:29.539Z+++ zoneadm list -n
4492024-09-06T23:35:29.539Z+++ grep oxz_ntp
4502024-09-06T23:35:29.539Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4512024-09-06T23:35:29.539Z+ [[ offline != online ]]
4522024-09-06T23:35:29.539Z+ [[ 7 -gt 60 ]]
4532024-09-06T23:35:29.539Z+ sleep 1
4542024-09-06T23:35:30.539Z+ retry=8
4552024-09-06T23:35:30.562Z+++ zoneadm list -n
4562024-09-06T23:35:30.562Z+++ grep oxz_ntp
4572024-09-06T23:35:30.562Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4582024-09-06T23:35:30.562Z+ [[ offline != online ]]
4592024-09-06T23:35:30.562Z+ [[ 8 -gt 60 ]]
4602024-09-06T23:35:30.563Z+ sleep 1
4612024-09-06T23:35:31.560Z+ retry=9
4622024-09-06T23:35:31.584Z+++ zoneadm list -n
4632024-09-06T23:35:31.584Z+++ grep oxz_ntp
4642024-09-06T23:35:31.584Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4652024-09-06T23:35:31.584Z+ [[ offline != online ]]
4662024-09-06T23:35:31.584Z+ [[ 9 -gt 60 ]]
4672024-09-06T23:35:31.584Z+ sleep 1
4682024-09-06T23:35:32.583Z+ retry=10
4692024-09-06T23:35:32.606Z+++ zoneadm list -n
4702024-09-06T23:35:32.606Z+++ grep oxz_ntp
4712024-09-06T23:35:32.606Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4722024-09-06T23:35:32.606Z+ [[ offline != online ]]
4732024-09-06T23:35:32.606Z+ [[ 10 -gt 60 ]]
4742024-09-06T23:35:32.606Z+ sleep 1
4752024-09-06T23:35:33.610Z+ retry=11
4762024-09-06T23:35:33.610Z+++ zoneadm list -n
4772024-09-06T23:35:33.634Z+++ grep oxz_ntp
4782024-09-06T23:35:33.634Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4792024-09-06T23:35:33.634Z+ [[ offline != online ]]
4802024-09-06T23:35:33.634Z+ [[ 11 -gt 60 ]]
4812024-09-06T23:35:33.634Z+ sleep 1
4822024-09-06T23:35:34.627Z+ retry=12
4832024-09-06T23:35:34.651Z+++ zoneadm list -n
4842024-09-06T23:35:34.651Z+++ grep oxz_ntp
4852024-09-06T23:35:34.651Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4862024-09-06T23:35:34.651Z+ [[ offline != online ]]
4872024-09-06T23:35:34.651Z+ [[ 12 -gt 60 ]]
4882024-09-06T23:35:34.651Z+ sleep 1
 
4892024-09-06T23:35:35.415Zsock console login: Sep 6 23:35:34 sock ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
4902024-09-06T23:35:35.650Z+ retry=13
4912024-09-06T23:35:35.674Z+++ zoneadm list -n
4922024-09-06T23:35:35.674Z+++ grep oxz_ntp
4932024-09-06T23:35:35.674Z++ pfexec svcs -z oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314 -Hostate oxide/ntp
4942024-09-06T23:35:35.674Z+ [[ online != online ]]
4952024-09-06T23:35:35.674Z+ echo 'Waited for chrony: 13s'
4962024-09-06T23:35:35.674Z+ retry=0
4972024-09-06T23:35:35.674ZWaited for chrony: 13s
4982024-09-06T23:35:35.674Z+ zoneadm list
4992024-09-06T23:35:35.674Z+ grep nexus
5002024-09-06T23:35:35.698Z+ [[ 0 -gt 300 ]]
5012024-09-06T23:35:35.698Z+ sleep 1
5022024-09-06T23:35:36.680Z+ retry=1
5032024-09-06T23:35:36.703Z+ zoneadm list
5042024-09-06T23:35:36.703Z+ grep nexus
5052024-09-06T23:35:36.703Z+ [[ 1 -gt 300 ]]
5062024-09-06T23:35:36.703Z+ sleep 1
 
5072024-09-06T23:35:36.926ZSep 6 23:35:36 sock xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:24.111.79.186:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
5082024-09-06T23:35:37.690Z+ retry=2
5092024-09-06T23:35:37.713Z+ zoneadm list
5102024-09-06T23:35:37.713Z+ grep nexus
5112024-09-06T23:35:37.714Z+ [[ 2 -gt 300 ]]
5122024-09-06T23:35:37.714Z+ sleep 1
5132024-09-06T23:35:38.703Z+ retry=3
5142024-09-06T23:35:38.726Z+ zoneadm list
5152024-09-06T23:35:38.726Z+ grep nexus
5162024-09-06T23:35:38.726Z+ [[ 3 -gt 300 ]]
5172024-09-06T23:35:38.726Z+ sleep 1
5182024-09-06T23:35:39.717Z+ retry=4
5192024-09-06T23:35:39.740Z+ zoneadm list
5202024-09-06T23:35:39.740Z+ grep nexus
5212024-09-06T23:35:39.740Z+ [[ 4 -gt 300 ]]
5222024-09-06T23:35:39.740Z+ sleep 1
5232024-09-06T23:35:40.731Z+ retry=5
5242024-09-06T23:35:40.759Z+ zoneadm list
5252024-09-06T23:35:40.759Z+ grep nexus
5262024-09-06T23:35:40.759Z+ [[ 5 -gt 300 ]]
5272024-09-06T23:35:40.759Z+ sleep 1
5282024-09-06T23:35:41.746Z+ retry=6
5292024-09-06T23:35:41.770Z+ zoneadm list
5302024-09-06T23:35:41.770Z+ grep nexus
5312024-09-06T23:35:41.770Z+ [[ 6 -gt 300 ]]
5322024-09-06T23:35:41.770Z+ sleep 1
5332024-09-06T23:35:42.763Z+ retry=7
5342024-09-06T23:35:42.787Z+ zoneadm list
5352024-09-06T23:35:42.787Z+ grep nexus
5362024-09-06T23:35:42.787Z+ [[ 7 -gt 300 ]]
5372024-09-06T23:35:42.787Z+ sleep 1
5382024-09-06T23:35:43.775Z+ retry=8
5392024-09-06T23:35:43.799Z+ zoneadm list
5402024-09-06T23:35:43.799Z+ grep nexus
5412024-09-06T23:35:43.799Z+ [[ 8 -gt 300 ]]
5422024-09-06T23:35:43.799Z+ sleep 1
5432024-09-06T23:35:44.792Z+ retry=9
5442024-09-06T23:35:44.827Z+ zoneadm list
5452024-09-06T23:35:44.827Z+ grep nexus
5462024-09-06T23:35:44.874Z+ [[ 9 -gt 300 ]]
5472024-09-06T23:35:44.874Z+ sleep 1
5482024-09-06T23:35:45.978Z+ retry=10
5492024-09-06T23:35:46.002Z+ grep nexus
5502024-09-06T23:35:46.120Z+ zoneadm list
5512024-09-06T23:35:46.174Z+ [[ 10 -gt 300 ]]
5522024-09-06T23:35:46.174Z+ sleep 1
5532024-09-06T23:35:47.171Z+ retry=11
5542024-09-06T23:35:47.195Z+ zoneadm list
5552024-09-06T23:35:47.196Z+ grep nexus
5562024-09-06T23:35:47.196Z+ [[ 11 -gt 300 ]]
5572024-09-06T23:35:47.196Z+ sleep 1
5582024-09-06T23:35:48.185Z+ retry=12
5592024-09-06T23:35:48.209Z+ zoneadm list
5602024-09-06T23:35:48.209Z+ grep nexus
5612024-09-06T23:35:48.209Z+ [[ 12 -gt 300 ]]
5622024-09-06T23:35:48.209Z+ sleep 1
5632024-09-06T23:35:49.198Z+ retry=13
5642024-09-06T23:35:49.222Z+ zoneadm list
5652024-09-06T23:35:49.222Z+ grep nexus
5662024-09-06T23:35:49.222Z+ [[ 13 -gt 300 ]]
5672024-09-06T23:35:49.222Z+ sleep 1
5682024-09-06T23:35:50.211Z+ retry=14
5692024-09-06T23:35:50.235Z+ zoneadm list
5702024-09-06T23:35:50.235Z+ grep nexus
5712024-09-06T23:35:50.236Z+ [[ 14 -gt 300 ]]
5722024-09-06T23:35:50.236Z+ sleep 1
5732024-09-06T23:35:51.223Z+ retry=15
5742024-09-06T23:35:51.247Z+ zoneadm list
5752024-09-06T23:35:51.247Z+ grep nexus
5762024-09-06T23:35:51.247Z+ [[ 15 -gt 300 ]]
5772024-09-06T23:35:51.247Z+ sleep 1
5782024-09-06T23:35:52.236Z+ retry=16
5792024-09-06T23:35:52.261Z+ zoneadm list
5802024-09-06T23:35:52.261Z+ grep nexus
5812024-09-06T23:35:52.261Z+ [[ 16 -gt 300 ]]
5822024-09-06T23:35:52.261Z+ sleep 1
5832024-09-06T23:35:53.248Z+ retry=17
5842024-09-06T23:35:53.272Z+ zoneadm list
5852024-09-06T23:35:53.272Z+ grep nexus
5862024-09-06T23:35:53.272Z+ [[ 17 -gt 300 ]]
5872024-09-06T23:35:53.272Z+ sleep 1
5882024-09-06T23:35:54.260Z+ retry=18
5892024-09-06T23:35:54.284Z+ zoneadm list
5902024-09-06T23:35:54.284Z+ grep nexus
5912024-09-06T23:35:54.284Z+ [[ 18 -gt 300 ]]
5922024-09-06T23:35:54.284Z+ sleep 1
5932024-09-06T23:35:55.273Z+ retry=19
5942024-09-06T23:35:55.297Z+ zoneadm list
5952024-09-06T23:35:55.297Z+ grep nexus
5962024-09-06T23:35:55.297Z+ [[ 19 -gt 300 ]]
5972024-09-06T23:35:55.297Z+ sleep 1
5982024-09-06T23:35:56.287Z+ retry=20
5992024-09-06T23:35:56.311Z+ zoneadm list
6002024-09-06T23:35:56.311Z+ grep nexus
6012024-09-06T23:35:56.311Z+ [[ 20 -gt 300 ]]
6022024-09-06T23:35:56.311Z+ sleep 1
6032024-09-06T23:35:57.301Z+ retry=21
6042024-09-06T23:35:57.325Z+ zoneadm list
6052024-09-06T23:35:57.325Z+ grep nexus
6062024-09-06T23:35:57.325Z+ [[ 21 -gt 300 ]]
6072024-09-06T23:35:57.325Z+ sleep 1
6082024-09-06T23:35:58.315Z+ retry=22
6092024-09-06T23:35:58.339Z+ zoneadm list
6102024-09-06T23:35:58.339Z+ grep nexus
6112024-09-06T23:35:58.339Z+ [[ 22 -gt 300 ]]
6122024-09-06T23:35:58.339Z+ sleep 1
6132024-09-06T23:35:59.559Z+ retry=23
6142024-09-06T23:35:59.583Z+ zoneadm list
6152024-09-06T23:35:59.584Z+ grep nexus
6162024-09-06T23:35:59.584Z+ [[ 23 -gt 300 ]]
6172024-09-06T23:35:59.584Z+ sleep 1
6182024-09-06T23:36:00.577Z+ retry=24
6192024-09-06T23:36:00.601Z+ zoneadm list
6202024-09-06T23:36:00.601Z+ grep nexus
6212024-09-06T23:36:00.601Z+ [[ 24 -gt 300 ]]
6222024-09-06T23:36:00.601Z+ sleep 1
 
6232024-09-06T23:36:01.205ZSep 6 23:35:37 sock last message repeated 3 times
 
6242024-09-06T23:36:01.589Z+ retry=25
6252024-09-06T23:36:01.612Z+ zoneadm list
6262024-09-06T23:36:01.612Z+ grep nexus
6272024-09-06T23:36:01.612Z+ [[ 25 -gt 300 ]]
6282024-09-06T23:36:01.612Z+ sleep 1
6292024-09-06T23:36:02.600Z+ retry=26
6302024-09-06T23:36:02.625Z+ zoneadm list
6312024-09-06T23:36:02.625Z+ grep nexus
6322024-09-06T23:36:02.625Z+ [[ 26 -gt 300 ]]
6332024-09-06T23:36:02.625Z+ sleep 1
6342024-09-06T23:36:03.612Z+ retry=27
6352024-09-06T23:36:03.635Z+ zoneadm list
6362024-09-06T23:36:03.636Z+ grep nexus
6372024-09-06T23:36:03.636Z+ [[ 27 -gt 300 ]]
6382024-09-06T23:36:03.636Z+ sleep 1
6392024-09-06T23:36:04.625Z+ retry=28
6402024-09-06T23:36:04.648Z+ zoneadm list
6412024-09-06T23:36:04.648Z+ grep nexus
6422024-09-06T23:36:04.648Z+ [[ 28 -gt 300 ]]
6432024-09-06T23:36:04.648Z+ sleep 1
6442024-09-06T23:36:05.636Z+ retry=29
6452024-09-06T23:36:05.660Z+ zoneadm list
6462024-09-06T23:36:05.660Z+ grep nexus
6472024-09-06T23:36:05.660Z+ [[ 29 -gt 300 ]]
6482024-09-06T23:36:05.660Z+ sleep 1
6492024-09-06T23:36:06.652Z+ retry=30
6502024-09-06T23:36:06.676Z+ zoneadm list
6512024-09-06T23:36:06.676Z+ grep nexus
6522024-09-06T23:36:06.676Z+ [[ 30 -gt 300 ]]
6532024-09-06T23:36:06.676Z+ sleep 1
6542024-09-06T23:36:07.661Z+ retry=31
6552024-09-06T23:36:07.685Z+ zoneadm list
6562024-09-06T23:36:07.685Z+ grep nexus
6572024-09-06T23:36:07.685Z+ [[ 31 -gt 300 ]]
6582024-09-06T23:36:07.685Z+ sleep 1
6592024-09-06T23:36:08.672Z+ retry=32
6602024-09-06T23:36:08.696Z+ zoneadm list
6612024-09-06T23:36:08.696Z+ grep nexus
6622024-09-06T23:36:08.696Z+ [[ 32 -gt 300 ]]
6632024-09-06T23:36:08.696Z+ sleep 1
6642024-09-06T23:36:09.684Z+ retry=33
6652024-09-06T23:36:09.708Z+ zoneadm list
6662024-09-06T23:36:09.708Z+ grep nexus
6672024-09-06T23:36:09.708Z+ [[ 33 -gt 300 ]]
6682024-09-06T23:36:09.708Z+ sleep 1
6692024-09-06T23:36:10.697Z+ retry=34
6702024-09-06T23:36:10.721Z+ zoneadm list
6712024-09-06T23:36:10.721Z+ grep nexus
6722024-09-06T23:36:10.721Z+ [[ 34 -gt 300 ]]
6732024-09-06T23:36:10.721Z+ sleep 1
6742024-09-06T23:36:11.709Z+ retry=35
6752024-09-06T23:36:11.733Z+ zoneadm list
6762024-09-06T23:36:11.733Z+ grep nexus
6772024-09-06T23:36:11.733Z+ [[ 35 -gt 300 ]]
6782024-09-06T23:36:11.733Z+ sleep 1
6792024-09-06T23:36:12.725Z+ retry=36
6802024-09-06T23:36:12.749Z+ zoneadm list
6812024-09-06T23:36:12.749Z+ grep nexus
6822024-09-06T23:36:12.749Z+ [[ 36 -gt 300 ]]
6832024-09-06T23:36:12.749Z+ sleep 1
6842024-09-06T23:36:13.745Z+ retry=37
6852024-09-06T23:36:13.745Z+ zoneadm list
6862024-09-06T23:36:13.789Z+ grep nexus
6872024-09-06T23:36:13.789Z+ [[ 37 -gt 300 ]]
6882024-09-06T23:36:13.789Z+ sleep 1
6892024-09-06T23:36:14.757Z+ retry=38
6902024-09-06T23:36:14.781Z+ zoneadm list
6912024-09-06T23:36:14.781Z+ grep nexus
6922024-09-06T23:36:14.781Z+ [[ 38 -gt 300 ]]
6932024-09-06T23:36:14.781Z+ sleep 1
6942024-09-06T23:36:15.769Z+ retry=39
6952024-09-06T23:36:15.793Z+ zoneadm list
6962024-09-06T23:36:15.793Z+ grep nexus
6972024-09-06T23:36:15.793Z+ [[ 39 -gt 300 ]]
6982024-09-06T23:36:15.793Z+ sleep 1
6992024-09-06T23:36:16.781Z+ retry=40
7002024-09-06T23:36:16.805Z+ zoneadm list
7012024-09-06T23:36:16.805Z+ grep nexus
7022024-09-06T23:36:16.805Z+ [[ 40 -gt 300 ]]
7032024-09-06T23:36:16.805Z+ sleep 1
7042024-09-06T23:36:17.793Z+ retry=41
7052024-09-06T23:36:17.817Z+ zoneadm list
7062024-09-06T23:36:17.817Z+ grep nexus
7072024-09-06T23:36:17.817Z+ [[ 41 -gt 300 ]]
7082024-09-06T23:36:17.817Z+ sleep 1
7092024-09-06T23:36:18.806Z+ retry=42
7102024-09-06T23:36:18.831Z+ zoneadm list
7112024-09-06T23:36:18.831Z+ grep nexus
7122024-09-06T23:36:18.831Z+ [[ 42 -gt 300 ]]
7132024-09-06T23:36:18.831Z+ sleep 1
7142024-09-06T23:36:19.817Z+ retry=43
7152024-09-06T23:36:19.841Z+ zoneadm list
7162024-09-06T23:36:19.841Z+ grep nexus
7172024-09-06T23:36:19.841Z+ [[ 43 -gt 300 ]]
7182024-09-06T23:36:19.841Z+ sleep 1
7192024-09-06T23:36:20.829Z+ retry=44
7202024-09-06T23:36:20.852Z+ zoneadm list
7212024-09-06T23:36:20.853Z+ grep nexus
7222024-09-06T23:36:20.853Z+ [[ 44 -gt 300 ]]
7232024-09-06T23:36:20.853Z+ sleep 1
7242024-09-06T23:36:21.841Z+ retry=45
7252024-09-06T23:36:21.865Z+ zoneadm list
7262024-09-06T23:36:21.865Z+ grep nexus
7272024-09-06T23:36:21.865Z+ [[ 45 -gt 300 ]]
7282024-09-06T23:36:21.865Z+ sleep 1
7292024-09-06T23:36:22.855Z+ retry=46
7302024-09-06T23:36:22.879Z+ zoneadm list
7312024-09-06T23:36:22.880Z+ grep nexus
7322024-09-06T23:36:22.880Z+ [[ 46 -gt 300 ]]
7332024-09-06T23:36:22.880Z+ sleep 1
7342024-09-06T23:36:23.867Z+ retry=47
7352024-09-06T23:36:23.891Z+ zoneadm list
7362024-09-06T23:36:23.891Z+ grep nexus
7372024-09-06T23:36:23.891Z+ [[ 47 -gt 300 ]]
7382024-09-06T23:36:23.891Z+ sleep 1
7392024-09-06T23:36:24.879Z+ retry=48
7402024-09-06T23:36:24.903Z+ zoneadm list
7412024-09-06T23:36:24.903Z+ grep nexus
7422024-09-06T23:36:24.903Z+ [[ 48 -gt 300 ]]
7432024-09-06T23:36:24.903Z+ sleep 1
7442024-09-06T23:36:25.891Z+ retry=49
7452024-09-06T23:36:25.915Z+ zoneadm list
7462024-09-06T23:36:25.915Z+ grep nexus
7472024-09-06T23:36:25.915Z+ [[ 49 -gt 300 ]]
7482024-09-06T23:36:25.915Z+ sleep 1
7492024-09-06T23:36:26.904Z+ retry=50
7502024-09-06T23:36:26.928Z+ zoneadm list
7512024-09-06T23:36:26.928Z+ grep nexus
7522024-09-06T23:36:26.928Z+ [[ 50 -gt 300 ]]
7532024-09-06T23:36:26.928Z+ sleep 1
7542024-09-06T23:36:27.917Z+ retry=51
7552024-09-06T23:36:27.944Z+ zoneadm list
7562024-09-06T23:36:27.944Z+ grep nexus
7572024-09-06T23:36:27.944Z+ [[ 51 -gt 300 ]]
7582024-09-06T23:36:27.944Z+ sleep 1
7592024-09-06T23:36:28.934Z+ retry=52
7602024-09-06T23:36:28.958Z+ zoneadm list
7612024-09-06T23:36:28.958Z+ grep nexus
7622024-09-06T23:36:28.958Z+ [[ 52 -gt 300 ]]
7632024-09-06T23:36:28.958Z+ sleep 1
7642024-09-06T23:36:29.966Z+ retry=53
7652024-09-06T23:36:30.086Z+ zoneadm list
7662024-09-06T23:36:30.086Z+ grep nexus
7672024-09-06T23:36:30.110Z+ [[ 53 -gt 300 ]]
7682024-09-06T23:36:30.110Z+ sleep 1
7692024-09-06T23:36:31.210Z+ retry=54
7702024-09-06T23:36:31.233Z+ zoneadm list
7712024-09-06T23:36:31.234Z+ grep nexus
7722024-09-06T23:36:31.234Z+ [[ 54 -gt 300 ]]
7732024-09-06T23:36:31.234Z+ sleep 1
7742024-09-06T23:36:32.245Z+ retry=55
7752024-09-06T23:36:32.269Z+ zoneadm list
7762024-09-06T23:36:32.269Z+ grep nexus
7772024-09-06T23:36:32.269Z+ [[ 55 -gt 300 ]]
7782024-09-06T23:36:32.269Z+ sleep 1
7792024-09-06T23:36:33.268Z+ retry=56
7802024-09-06T23:36:33.292Z+ zoneadm list
7812024-09-06T23:36:33.292Z+ grep nexus
7822024-09-06T23:36:33.292Z+ [[ 56 -gt 300 ]]
7832024-09-06T23:36:33.292Z+ sleep 1
7842024-09-06T23:36:34.288Z+ retry=57
7852024-09-06T23:36:34.312Z+ zoneadm list
7862024-09-06T23:36:34.312Z+ grep nexus
7872024-09-06T23:36:34.335Z+ [[ 57 -gt 300 ]]
7882024-09-06T23:36:34.335Z+ sleep 1
7892024-09-06T23:36:35.319Z+ retry=58
7902024-09-06T23:36:35.342Z+ zoneadm list
7912024-09-06T23:36:35.342Z+ grep nexus
7922024-09-06T23:36:35.343Zoxz_nexus_9ad0f243-aeb1-455d-97ad-7dc9ca9c417c
7932024-09-06T23:36:35.343Z+ echo 'Waited for nexus: 58s'
7942024-09-06T23:36:35.343ZWaited for nexus: 58s
7952024-09-06T23:36:35.343Z+ export RUST_BACKTRACE=1
7962024-09-06T23:36:35.343Z+ RUST_BACKTRACE=1
7972024-09-06T23:36:35.343Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
7982024-09-06T23:36:35.343Z++ ./target/debug/bootstrap
7992024-09-06T23:36:35.366ZUsing external DNS server at 10.151.2.164:53
8002024-09-06T23:36:35.390Z2024-09-06 23:36:35.365840951 UTC: attempting to log into API
8012024-09-06T23:36:50.423Z2024-09-06 23:36:50.411346778 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8022024-09-06T23:36:51.424Z2024-09-06 23:36:51.412710015 UTC: attempting to log into API
 
8032024-09-06T23:36:53.419ZSep 6 23:36:52 sock ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
8042024-09-06T23:36:53.958ZSep 6 23:36:53 sock ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
8052024-09-06T23:36:54.019ZSep 6 23:36:53 sock ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
8062024-09-06T23:36:54.347ZSep 6 23:36:53 sock ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
8072024-09-06T23:36:54.376ZSep 6 23:36:53 sock ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
8082024-09-06T23:37:00.887ZSep 6 23:37:00 sock xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:104.156.246.53:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8092024-09-06T23:37:06.458Z2024-09-06 23:37:06.445998436 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8102024-09-06T23:37:07.459Z2024-09-06 23:37:07.447310232 UTC: attempting to log into API
8112024-09-06T23:37:22.492Z2024-09-06 23:37:22.480763104 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8122024-09-06T23:37:23.494Z2024-09-06 23:37:23.482066501 UTC: attempting to log into API
 
8132024-09-06T23:37:35.667ZSep 6 23:37:34 sock xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:208.113.130.146:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8142024-09-06T23:37:38.528Z2024-09-06 23:37:38.517039784 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8152024-09-06T23:37:39.529Z2024-09-06 23:37:39.518432421 UTC: attempting to log into API
8162024-09-06T23:37:45.341Z2024-09-06 23:37:45.330563432 UTC: login succeeded
8172024-09-06T23:37:45.374Zwaiting for nexus to come up...
8182024-09-06T23:37:45.441Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8192024-09-06T23:37:45.656Zsetting up quotas...
8202024-09-06T23:37:45.710Zensuring datasets are ready...
8212024-09-06T23:37:48.926Zlet's roll.
8222024-09-06T23:37:48.949Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8232024-09-06T23:37:48.949ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8242024-09-06T23:37:48.950ZOXIDE_TOKEN=oxide-token-4c31ac53c1bf0abe4cdf8f405c95433a7b337ee1'
8252024-09-06T23:37:48.950Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8262024-09-06T23:37:48.950Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8272024-09-06T23:37:48.950Z++ OXIDE_TOKEN=oxide-token-4c31ac53c1bf0abe4cdf8f405c95433a7b337ee1
8282024-09-06T23:37:48.950Z+ export OXIDE_HOST OXIDE_TOKEN
8292024-09-06T23:37:48.950Z+ retry=0
8302024-09-06T23:37:48.950Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8312024-09-06T23:37:48.950Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8322024-09-06T23:37:48.973Z+ [[ 0 -gt 60 ]]
8332024-09-06T23:37:48.973Z+ sleep 1
8342024-09-06T23:37:49.954Z+ retry=1
8352024-09-06T23:37:49.954Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8362024-09-06T23:37:49.978Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8372024-09-06T23:37:49.978Z+ [[ 1 -gt 60 ]]
8382024-09-06T23:37:49.978Z+ sleep 1
8392024-09-06T23:37:50.972Z+ retry=2
8402024-09-06T23:37:50.972Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8412024-09-06T23:37:50.996Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8422024-09-06T23:37:50.996Z+ [[ 2 -gt 60 ]]
8432024-09-06T23:37:50.996Z+ sleep 1
8442024-09-06T23:37:51.988Z+ retry=3
8452024-09-06T23:37:51.988Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8462024-09-06T23:37:52.012Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8472024-09-06T23:37:52.012Z+ [[ 3 -gt 60 ]]
8482024-09-06T23:37:52.012Z+ sleep 1
8492024-09-06T23:37:53.005Z+ retry=4
8502024-09-06T23:37:53.005Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8512024-09-06T23:37:53.030Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8522024-09-06T23:37:53.030Z+ [[ 4 -gt 60 ]]
8532024-09-06T23:37:53.030Z+ sleep 1
8542024-09-06T23:37:54.023Z+ retry=5
8552024-09-06T23:37:54.023Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8562024-09-06T23:37:54.047Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8572024-09-06T23:37:54.047Z+ [[ 5 -gt 60 ]]
8582024-09-06T23:37:54.047Z+ sleep 1
8592024-09-06T23:37:55.040Z+ retry=6
8602024-09-06T23:37:55.040Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8612024-09-06T23:37:55.064Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8622024-09-06T23:37:55.064Z+ [[ 6 -gt 60 ]]
8632024-09-06T23:37:55.064Z+ sleep 1
8642024-09-06T23:37:56.057Z+ retry=7
8652024-09-06T23:37:56.057Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8662024-09-06T23:37:56.081Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8672024-09-06T23:37:56.081Z+ [[ 7 -gt 60 ]]
8682024-09-06T23:37:56.081Z+ sleep 1
8692024-09-06T23:37:57.075Z+ retry=8
8702024-09-06T23:37:57.075Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8712024-09-06T23:37:57.099Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8722024-09-06T23:37:57.099Z+ [[ 8 -gt 60 ]]
8732024-09-06T23:37:57.099Z+ sleep 1
8742024-09-06T23:37:58.093Z+ retry=9
8752024-09-06T23:37:58.093Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8762024-09-06T23:37:58.117Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8772024-09-06T23:37:58.117Z+ [[ 9 -gt 60 ]]
8782024-09-06T23:37:58.117Z+ sleep 1
8792024-09-06T23:37:59.110Z+ retry=10
8802024-09-06T23:37:59.110Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8812024-09-06T23:37:59.133Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8822024-09-06T23:37:59.133Z+ [[ 10 -gt 60 ]]
8832024-09-06T23:37:59.133Z+ sleep 1
8842024-09-06T23:38:00.126Z+ retry=11
8852024-09-06T23:38:00.126Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8862024-09-06T23:38:00.150Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8872024-09-06T23:38:00.150Z+ [[ 11 -gt 60 ]]
8882024-09-06T23:38:00.150Z+ sleep 1
8892024-09-06T23:38:01.144Z+ retry=12
8902024-09-06T23:38:01.144Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8912024-09-06T23:38:01.168Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8922024-09-06T23:38:01.168Z+ [[ 12 -gt 60 ]]
8932024-09-06T23:38:01.168Z+ sleep 1
8942024-09-06T23:38:02.162Z+ retry=13
8952024-09-06T23:38:02.162Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8962024-09-06T23:38:02.185Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
8972024-09-06T23:38:02.185Z+ [[ 13 -gt 60 ]]
8982024-09-06T23:38:02.185Z+ sleep 1
8992024-09-06T23:38:03.179Z+ retry=14
9002024-09-06T23:38:03.179Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9012024-09-06T23:38:03.203Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9022024-09-06T23:38:03.203Z+ [[ 14 -gt 60 ]]
9032024-09-06T23:38:03.203Z+ sleep 1
9042024-09-06T23:38:04.196Z+ retry=15
9052024-09-06T23:38:04.196Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9062024-09-06T23:38:04.220Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9072024-09-06T23:38:04.220Z+ [[ 15 -gt 60 ]]
9082024-09-06T23:38:04.220Z+ sleep 1
9092024-09-06T23:38:05.211Z+ retry=16
9102024-09-06T23:38:05.211Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9112024-09-06T23:38:05.235Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9122024-09-06T23:38:05.235Z+ [[ 16 -gt 60 ]]
9132024-09-06T23:38:05.235Z+ sleep 1
9142024-09-06T23:38:06.227Z+ retry=17
9152024-09-06T23:38:06.228Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9162024-09-06T23:38:06.252Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9172024-09-06T23:38:06.252Z+ [[ 17 -gt 60 ]]
9182024-09-06T23:38:06.252Z+ sleep 1
9192024-09-06T23:38:07.245Z+ retry=18
9202024-09-06T23:38:07.245Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9212024-09-06T23:38:07.270Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9222024-09-06T23:38:07.270Z+ [[ 18 -gt 60 ]]
9232024-09-06T23:38:07.270Z+ sleep 1
9242024-09-06T23:38:08.262Z+ retry=19
9252024-09-06T23:38:08.262Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9262024-09-06T23:38:08.286Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9272024-09-06T23:38:08.286Z+ [[ 19 -gt 60 ]]
9282024-09-06T23:38:08.286Z+ sleep 1
9292024-09-06T23:38:09.279Z+ retry=20
9302024-09-06T23:38:09.280Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9312024-09-06T23:38:09.303Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9322024-09-06T23:38:09.303Z+ [[ 20 -gt 60 ]]
9332024-09-06T23:38:09.303Z+ sleep 1
9342024-09-06T23:38:10.297Z+ retry=21
9352024-09-06T23:38:10.297Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9362024-09-06T23:38:10.321Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9372024-09-06T23:38:10.321Z+ [[ 21 -gt 60 ]]
9382024-09-06T23:38:10.321Z+ sleep 1
9392024-09-06T23:38:11.313Z+ retry=22
9402024-09-06T23:38:11.313Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9412024-09-06T23:38:11.337Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9422024-09-06T23:38:11.337Z+ [[ 22 -gt 60 ]]
9432024-09-06T23:38:11.337Z+ sleep 1
9442024-09-06T23:38:12.330Z+ retry=23
9452024-09-06T23:38:12.330Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9462024-09-06T23:38:12.354Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9472024-09-06T23:38:12.354Z+ [[ 23 -gt 60 ]]
9482024-09-06T23:38:12.354Z+ sleep 1
9492024-09-06T23:38:13.347Z+ retry=24
9502024-09-06T23:38:13.347Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9512024-09-06T23:38:13.434Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9522024-09-06T23:38:14.191Z{"status":"ok"}success
9532024-09-06T23:38:14.191ZProject {
9542024-09-06T23:38:14.191Z description: "some images",
9552024-09-06T23:38:14.191Z id: c6ea6565-dbdc-4c11-8075-86a534beed0c,
9562024-09-06T23:38:14.191Z name: Name(
9572024-09-06T23:38:14.191Z "images",
9582024-09-06T23:38:14.191Z ),
9592024-09-06T23:38:14.215Z time_created: 2024-09-06T23:38:13.607412Z,
9602024-09-06T23:38:14.215Z time_modified: 2024-09-06T23:38:13.607412Z,
9612024-09-06T23:38:14.215Z}
9622024-09-06T23:38:14.215Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
9632024-09-06T23:38:49.113ZSep 6 23:38:48 sock xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:24.111.79.186:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
9642024-09-06T23:42:41.321ZSep 6 23:40:33 sock last message repeated 1 time
 
9652024-09-06T23:43:39.570Zdone!
9662024-09-06T23:43:39.668Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9672024-09-06T23:43:39.792Zsuccess
9682024-09-06T23:43:39.792ZImage {
9692024-09-06T23:43:39.792Z block_size: ByteCount(
9702024-09-06T23:43:39.792Z 512,
9712024-09-06T23:43:39.792Z ),
9722024-09-06T23:43:39.816Z description: "debian 11 original base image",
9732024-09-06T23:43:39.816Z digest: None,
9742024-09-06T23:43:39.816Z id: 1f444bc5-8004-409d-9f5a-9c617052a452,
9752024-09-06T23:43:39.816Z name: Name(
9762024-09-06T23:43:39.816Z "debian11",
9772024-09-06T23:43:39.816Z ),
9782024-09-06T23:43:39.816Z os: "debian",
9792024-09-06T23:43:39.816Z project_id: None,
9802024-09-06T23:43:39.816Z size: ByteCount(
9812024-09-06T23:43:39.816Z 2147483648,
9822024-09-06T23:43:39.816Z ),
9832024-09-06T23:43:39.816Z time_created: 2024-09-06T23:43:39.508517Z,
9842024-09-06T23:43:39.816Z time_modified: 2024-09-06T23:43:39.769631Z,
9852024-09-06T23:43:39.816Z url: None,
9862024-09-06T23:43:39.816Z version: "11",
9872024-09-06T23:43:39.816Z}
9882024-09-06T23:43:39.816Z+ for test_bin in tests/*
9892024-09-06T23:43:39.816Z+ ./tests/bootstrap-0676bd204cf6427d
9902024-09-06T23:43:39.816Z
9912024-09-06T23:43:39.816Zrunning 0 tests
9922024-09-06T23:43:39.816Z
9932024-09-06T23:43:39.816Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9942024-09-06T23:43:39.816Z
9952024-09-06T23:43:39.816Z+ for test_bin in tests/*
9962024-09-06T23:43:39.816Z+ ./tests/commtest-102495187f1f9712
9972024-09-06T23:43:39.816Z
9982024-09-06T23:43:39.816Zrunning 0 tests
9992024-09-06T23:43:39.817Z
10002024-09-06T23:43:39.817Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10012024-09-06T23:43:39.817Z
10022024-09-06T23:43:39.817Z+ for test_bin in tests/*
10032024-09-06T23:43:39.817Z+ ./tests/dhcp_server-1cbab5baa51fbb92
10042024-09-06T23:43:39.840Z
10052024-09-06T23:43:39.840Zrunning 0 tests
10062024-09-06T23:43:39.840Z
10072024-09-06T23:43:39.840Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10082024-09-06T23:43:39.840Z
10092024-09-06T23:43:39.840Z+ for test_bin in tests/*
10102024-09-06T23:43:39.840Z+ ./tests/end_to_end_tests-0dfb1f3db11988e5
10112024-09-06T23:43:39.840Z
10122024-09-06T23:43:39.841Zrunning 2 tests
10132024-09-06T23:43:40.055Ztest no_spoof::no_spoof_here ... ok
10142024-09-06T23:44:26.030Ztest instance_launch::instance_launch ... ok
10152024-09-06T23:44:26.030Z
10162024-09-06T23:44:26.030Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 46.20s
10172024-09-06T23:44:26.030Z
10182024-09-06T23:44:26.055Z+ _exit_trap
10192024-09-06T23:44:26.055Z+ local status=0
10202024-09-06T23:44:26.055Z+ set +o errexit
10212024-09-06T23:44:26.055Z+ pfexec svcadm -Z disable -s cron
10222024-09-06T23:44:27.440Z+ [[ 0 -eq 0 ]]
10232024-09-06T23:44:27.440Z+ exit 0
10242024-09-06T23:44:27.464Zprocess exited: duration 616681 ms, exit code 0
 
10252024-09-06T23:44:27.564Zfound 108 output files
10262024-09-06T23:44:27.564Zuploading: /var/svc/log/oxide-sled-agent:default.log (844559 bytes)
10272024-09-06T23:44:28.838Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10282024-09-06T23:44:28.838Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (4955843 bytes)
10292024-09-06T23:44:29.248Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 4955843 -> 4969252
10302024-09-06T23:44:30.317Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
10312024-09-06T23:44:30.341Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (37475 bytes)
10322024-09-06T23:44:31.475Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
10332024-09-06T23:44:31.475Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (192099 bytes)
10342024-09-06T23:44:31.676Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 192099 -> 194054
10352024-09-06T23:44:32.744Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
10362024-09-06T23:44:32.744Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (249175 bytes)
10372024-09-06T23:44:32.944Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 249175 -> 251130
10382024-09-06T23:44:34.013Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
10392024-09-06T23:44:34.013Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1480866 bytes)
10402024-09-06T23:44:34.307Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1480866 -> 1495230
10412024-09-06T23:44:35.375Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
10422024-09-06T23:44:35.375Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (3702452 bytes)
10432024-09-06T23:44:35.743Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 3702452 -> 3752684
10442024-09-06T23:44:36.812Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10452024-09-06T23:44:36.812Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (3335 bytes)
10462024-09-06T23:44:37.905Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10472024-09-06T23:44:37.905Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (283955 bytes)
10482024-09-06T23:44:38.105Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 283955 -> 288614
10492024-09-06T23:44:39.174Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10502024-09-06T23:44:39.174Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (8440 bytes)
10512024-09-06T23:44:40.286Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10522024-09-06T23:44:40.286Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3977 bytes)
10532024-09-06T23:44:41.378Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10542024-09-06T23:44:41.379Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (8130 bytes)
10552024-09-06T23:44:42.492Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
10562024-09-06T23:44:42.492Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_cockroachdb_d878e8a1-acf2-4658-8ef3-2a29f89a5643/root/var/svc/log/oxide-cockroach-admin:default.log (4653 bytes)
10572024-09-06T23:44:43.584Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_cockroachdb_d878e8a1-acf2-4658-8ef3-2a29f89a5643/root/var/svc/log/oxide-cockroach-admin:default.log
10582024-09-06T23:44:43.608Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_cockroachdb_d878e8a1-acf2-4658-8ef3-2a29f89a5643/root/var/svc/log/oxide-cockroachdb:default.log (4313 bytes)
10592024-09-06T23:44:44.676Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_cockroachdb_d878e8a1-acf2-4658-8ef3-2a29f89a5643/root/var/svc/log/oxide-cockroachdb:default.log
10602024-09-06T23:44:44.677Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_cockroachdb_d878e8a1-acf2-4658-8ef3-2a29f89a5643/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
10612024-09-06T23:44:45.769Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_cockroachdb_d878e8a1-acf2-4658-8ef3-2a29f89a5643/root/var/svc/log/oxide-zone-network-setup:default.log
10622024-09-06T23:44:45.769Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_crucible_2adfe4a1-4baf-4cb8-a3d2-e6907b84545a/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
10632024-09-06T23:44:46.861Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_crucible_2adfe4a1-4baf-4cb8-a3d2-e6907b84545a/root/var/svc/log/oxide-crucible-agent:default.log
10642024-09-06T23:44:46.885Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_crucible_2adfe4a1-4baf-4cb8-a3d2-e6907b84545a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10652024-09-06T23:44:47.953Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_crucible_2adfe4a1-4baf-4cb8-a3d2-e6907b84545a/root/var/svc/log/oxide-crucible-downstairs:default.log
10662024-09-06T23:44:47.977Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_crucible_2adfe4a1-4baf-4cb8-a3d2-e6907b84545a/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
10672024-09-06T23:44:49.046Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_crucible_2adfe4a1-4baf-4cb8-a3d2-e6907b84545a/root/var/svc/log/oxide-zone-network-setup:default.log
10682024-09-06T23:44:49.046Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_external_dns_195e4e82-1cc4-4f3b-a893-c1474bd26575/root/var/svc/log/oxide-external_dns:default.log (30688 bytes)
10692024-09-06T23:44:50.182Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_external_dns_195e4e82-1cc4-4f3b-a893-c1474bd26575/root/var/svc/log/oxide-external_dns:default.log
10702024-09-06T23:44:50.182Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_external_dns_195e4e82-1cc4-4f3b-a893-c1474bd26575/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
10712024-09-06T23:44:51.274Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_external_dns_195e4e82-1cc4-4f3b-a893-c1474bd26575/root/var/svc/log/oxide-opte-interface-setup:default.log
10722024-09-06T23:44:51.297Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_external_dns_195e4e82-1cc4-4f3b-a893-c1474bd26575/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
10732024-09-06T23:44:52.368Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_external_dns_195e4e82-1cc4-4f3b-a893-c1474bd26575/root/var/svc/log/oxide-zone-network-setup:default.log
10742024-09-06T23:44:52.368Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_internal_dns_fcc84a23-e14a-4383-9764-158f0d5fc6c9/root/var/svc/log/oxide-internal_dns:default.log (410599 bytes)
10752024-09-06T23:44:53.640Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_internal_dns_fcc84a23-e14a-4383-9764-158f0d5fc6c9/root/var/svc/log/oxide-internal_dns:default.log
10762024-09-06T23:44:53.640Zuploading: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_internal_dns_fcc84a23-e14a-4383-9764-158f0d5fc6c9/root/var/svc/log/oxide-zone-network-setup:default.log (1679 bytes)
10772024-09-06T23:44:54.732Zuploaded: /pool/ext/1bae97fb-c4f0-4d17-b41c-409574fb9e6e/crypt/zone/oxz_internal_dns_fcc84a23-e14a-4383-9764-158f0d5fc6c9/root/var/svc/log/oxide-zone-network-setup:default.log
10782024-09-06T23:44:54.755Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_clickhouse_2ac4364c-7933-4568-bbab-cf3f9ec0ff29/root/var/svc/log/oxide-clickhouse-admin:default.log (791 bytes)
10792024-09-06T23:44:55.824Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_clickhouse_2ac4364c-7933-4568-bbab-cf3f9ec0ff29/root/var/svc/log/oxide-clickhouse-admin:default.log
10802024-09-06T23:44:55.824Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_clickhouse_2ac4364c-7933-4568-bbab-cf3f9ec0ff29/root/var/svc/log/oxide-clickhouse:default.log (3392877 bytes)
10812024-09-06T23:44:56.204Zupload warning: file "/pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_clickhouse_2ac4364c-7933-4568-bbab-cf3f9ec0ff29/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 3392877 -> 3598567
10822024-09-06T23:44:57.273Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_clickhouse_2ac4364c-7933-4568-bbab-cf3f9ec0ff29/root/var/svc/log/oxide-clickhouse:default.log
10832024-09-06T23:44:57.296Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_clickhouse_2ac4364c-7933-4568-bbab-cf3f9ec0ff29/root/var/svc/log/oxide-zone-network-setup:default.log (1685 bytes)
10842024-09-06T23:44:58.365Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_clickhouse_2ac4364c-7933-4568-bbab-cf3f9ec0ff29/root/var/svc/log/oxide-zone-network-setup:default.log
10852024-09-06T23:44:58.389Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_cockroachdb_f36b391d-1566-4909-bff8-8297bfb4c166/root/var/svc/log/oxide-cockroach-admin:default.log (4657 bytes)
10862024-09-06T23:44:59.458Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_cockroachdb_f36b391d-1566-4909-bff8-8297bfb4c166/root/var/svc/log/oxide-cockroach-admin:default.log
10872024-09-06T23:44:59.482Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_cockroachdb_f36b391d-1566-4909-bff8-8297bfb4c166/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
10882024-09-06T23:45:00.552Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_cockroachdb_f36b391d-1566-4909-bff8-8297bfb4c166/root/var/svc/log/oxide-cockroachdb:default.log
10892024-09-06T23:45:00.552Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_cockroachdb_f36b391d-1566-4909-bff8-8297bfb4c166/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
10902024-09-06T23:45:01.644Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_cockroachdb_f36b391d-1566-4909-bff8-8297bfb4c166/root/var/svc/log/oxide-zone-network-setup:default.log
10912024-09-06T23:45:01.644Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_crucible_e273cca1-6e0d-4509-842e-40a51b28e236/root/var/svc/log/oxide-crucible-agent:default.log (1553 bytes)
10922024-09-06T23:45:02.736Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_crucible_e273cca1-6e0d-4509-842e-40a51b28e236/root/var/svc/log/oxide-crucible-agent:default.log
10932024-09-06T23:45:02.736Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_crucible_e273cca1-6e0d-4509-842e-40a51b28e236/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10942024-09-06T23:45:03.829Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_crucible_e273cca1-6e0d-4509-842e-40a51b28e236/root/var/svc/log/oxide-crucible-downstairs:default.log
10952024-09-06T23:45:03.829Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_crucible_e273cca1-6e0d-4509-842e-40a51b28e236/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
10962024-09-06T23:45:04.921Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_crucible_e273cca1-6e0d-4509-842e-40a51b28e236/root/var/svc/log/oxide-zone-network-setup:default.log
10972024-09-06T23:45:04.945Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_external_dns_5ed76b33-815e-4ee8-8f4d-39d8e83f1fb6/root/var/svc/log/oxide-external_dns:default.log (30677 bytes)
10982024-09-06T23:45:06.078Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_external_dns_5ed76b33-815e-4ee8-8f4d-39d8e83f1fb6/root/var/svc/log/oxide-external_dns:default.log
10992024-09-06T23:45:06.102Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_external_dns_5ed76b33-815e-4ee8-8f4d-39d8e83f1fb6/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
11002024-09-06T23:45:07.168Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_external_dns_5ed76b33-815e-4ee8-8f4d-39d8e83f1fb6/root/var/svc/log/oxide-opte-interface-setup:default.log
11012024-09-06T23:45:07.192Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_external_dns_5ed76b33-815e-4ee8-8f4d-39d8e83f1fb6/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes)
11022024-09-06T23:45:08.258Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_external_dns_5ed76b33-815e-4ee8-8f4d-39d8e83f1fb6/root/var/svc/log/oxide-zone-network-setup:default.log
11032024-09-06T23:45:08.259Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_internal_dns_26e8255e-2d98-41fa-b877-69c2893c27d0/root/var/svc/log/oxide-internal_dns:default.log (410613 bytes)
11042024-09-06T23:45:09.524Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_internal_dns_26e8255e-2d98-41fa-b877-69c2893c27d0/root/var/svc/log/oxide-internal_dns:default.log
11052024-09-06T23:45:09.548Zuploading: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_internal_dns_26e8255e-2d98-41fa-b877-69c2893c27d0/root/var/svc/log/oxide-zone-network-setup:default.log (1679 bytes)
11062024-09-06T23:45:10.618Zuploaded: /pool/ext/652da97e-d553-4457-bc42-d10c0c455967/crypt/zone/oxz_internal_dns_26e8255e-2d98-41fa-b877-69c2893c27d0/root/var/svc/log/oxide-zone-network-setup:default.log
11072024-09-06T23:45:10.642Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-agent:default.log (28979 bytes)
11082024-09-06T23:45:11.772Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-agent:default.log
11092024-09-06T23:45:11.796Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11102024-09-06T23:45:12.862Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-downstairs:default.log
11112024-09-06T23:45:12.862Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-downstairs:downstairs-241c30d5-ab33-454a-9f15-354dd698e198.log (3021 bytes)
11122024-09-06T23:45:13.953Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-downstairs:downstairs-241c30d5-ab33-454a-9f15-354dd698e198.log
11132024-09-06T23:45:13.953Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-downstairs:downstairs-80ece28c-963c-4f46-ba65-3e8252c092e6.log (6077 bytes)
11142024-09-06T23:45:15.044Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-downstairs:downstairs-80ece28c-963c-4f46-ba65-3e8252c092e6.log
11152024-09-06T23:45:15.067Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-downstairs:snapshot-80ece28c-963c-4f46-ba65-3e8252c092e6-14f123e0-b5bf-4d3d-81ae-5bb566e4e4ed.log (5688 bytes)
11162024-09-06T23:45:16.134Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-crucible-downstairs:snapshot-80ece28c-963c-4f46-ba65-3e8252c092e6-14f123e0-b5bf-4d3d-81ae-5bb566e4e4ed.log
11172024-09-06T23:45:16.134Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11182024-09-06T23:45:17.224Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_c1d2ae9b-e921-4256-b95c-a29d6126fd66/root/var/svc/log/oxide-zone-network-setup:default.log
11192024-09-06T23:45:17.247Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_pantry_764a9699-9635-421f-88c6-7f14971487fe/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
11202024-09-06T23:45:18.314Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_pantry_764a9699-9635-421f-88c6-7f14971487fe/root/var/svc/log/oxide-crucible-pantry:default.log
11212024-09-06T23:45:18.337Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_pantry_764a9699-9635-421f-88c6-7f14971487fe/root/var/svc/log/oxide-zone-network-setup:default.log (1717 bytes)
11222024-09-06T23:45:19.403Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_pantry_764a9699-9635-421f-88c6-7f14971487fe/root/var/svc/log/oxide-zone-network-setup:default.log
11232024-09-06T23:45:19.404Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_pantry_b047cd23-d622-477e-885d-d1b3824512de/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
11242024-09-06T23:45:20.493Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_pantry_b047cd23-d622-477e-885d-d1b3824512de/root/var/svc/log/oxide-crucible-pantry:default.log
11252024-09-06T23:45:20.493Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_pantry_b047cd23-d622-477e-885d-d1b3824512de/root/var/svc/log/oxide-zone-network-setup:default.log (1716 bytes)
11262024-09-06T23:45:21.583Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_crucible_pantry_b047cd23-d622-477e-885d-d1b3824512de/root/var/svc/log/oxide-zone-network-setup:default.log
11272024-09-06T23:45:21.583Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_nexus_cb51aad1-b6ab-44e1-8492-82c028d74c7f/root/var/svc/log/oxide-nexus:default.log (3033488 bytes)
11282024-09-06T23:45:21.936Zupload warning: file "/pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_nexus_cb51aad1-b6ab-44e1-8492-82c028d74c7f/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 3033488 -> 3345985
11292024-09-06T23:45:23.004Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_nexus_cb51aad1-b6ab-44e1-8492-82c028d74c7f/root/var/svc/log/oxide-nexus:default.log
11302024-09-06T23:45:23.004Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_nexus_cb51aad1-b6ab-44e1-8492-82c028d74c7f/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11312024-09-06T23:45:24.093Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_nexus_cb51aad1-b6ab-44e1-8492-82c028d74c7f/root/var/svc/log/oxide-opte-interface-setup:default.log
11322024-09-06T23:45:24.093Zuploading: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_nexus_cb51aad1-b6ab-44e1-8492-82c028d74c7f/root/var/svc/log/oxide-zone-network-setup:default.log (1654 bytes)
11332024-09-06T23:45:25.183Zuploaded: /pool/ext/907237be-faec-4233-8c3e-1918ec810764/crypt/zone/oxz_nexus_cb51aad1-b6ab-44e1-8492-82c028d74c7f/root/var/svc/log/oxide-zone-network-setup:default.log
11342024-09-06T23:45:25.183Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_cockroachdb_50d89311-4ddf-44e9-94f4-8f8b68421caf/root/var/svc/log/oxide-cockroach-admin:default.log (4654 bytes)
11352024-09-06T23:45:26.273Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_cockroachdb_50d89311-4ddf-44e9-94f4-8f8b68421caf/root/var/svc/log/oxide-cockroach-admin:default.log
11362024-09-06T23:45:26.297Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_cockroachdb_50d89311-4ddf-44e9-94f4-8f8b68421caf/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11372024-09-06T23:45:27.364Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_cockroachdb_50d89311-4ddf-44e9-94f4-8f8b68421caf/root/var/svc/log/oxide-cockroachdb:default.log
11382024-09-06T23:45:27.388Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_cockroachdb_50d89311-4ddf-44e9-94f4-8f8b68421caf/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11392024-09-06T23:45:28.454Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_cockroachdb_50d89311-4ddf-44e9-94f4-8f8b68421caf/root/var/svc/log/oxide-zone-network-setup:default.log
11402024-09-06T23:45:28.454Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-agent:default.log (36026 bytes)
11412024-09-06T23:45:29.609Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-agent:default.log
11422024-09-06T23:45:29.632Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11432024-09-06T23:45:30.705Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-downstairs:default.log
11442024-09-06T23:45:30.705Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-downstairs:downstairs-f6ee60d9-84fc-40a6-863c-0787247df677.log (5996 bytes)
11452024-09-06T23:45:31.795Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-downstairs:downstairs-f6ee60d9-84fc-40a6-863c-0787247df677.log
11462024-09-06T23:45:31.795Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-downstairs:downstairs-f826107b-a5dc-4ec9-9656-6ef226e74767.log (6077 bytes)
11472024-09-06T23:45:32.885Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-downstairs:downstairs-f826107b-a5dc-4ec9-9656-6ef226e74767.log
11482024-09-06T23:45:32.908Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-downstairs:snapshot-f826107b-a5dc-4ec9-9656-6ef226e74767-14f123e0-b5bf-4d3d-81ae-5bb566e4e4ed.log (5688 bytes)
11492024-09-06T23:45:33.974Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-crucible-downstairs:snapshot-f826107b-a5dc-4ec9-9656-6ef226e74767-14f123e0-b5bf-4d3d-81ae-5bb566e4e4ed.log
11502024-09-06T23:45:33.974Zuploading: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
11512024-09-06T23:45:35.064Zuploaded: /pool/ext/ab9a060c-a3d5-48de-ba57-beaa10d18520/crypt/zone/oxz_crucible_0a5539c1-7e26-4e50-b26a-60a137388ce1/root/var/svc/log/oxide-zone-network-setup:default.log
11522024-09-06T23:45:35.064Zuploading: /pool/ext/b79af253-dd33-4fe7-98c1-790c50e27394/crypt/zone/oxz_crucible_ebce0088-396f-4300-91e9-19979170faa6/root/var/svc/log/oxide-crucible-agent:default.log (12504 bytes)
11532024-09-06T23:45:36.176Zuploaded: /pool/ext/b79af253-dd33-4fe7-98c1-790c50e27394/crypt/zone/oxz_crucible_ebce0088-396f-4300-91e9-19979170faa6/root/var/svc/log/oxide-crucible-agent:default.log
11542024-09-06T23:45:36.176Zuploading: /pool/ext/b79af253-dd33-4fe7-98c1-790c50e27394/crypt/zone/oxz_crucible_ebce0088-396f-4300-91e9-19979170faa6/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11552024-09-06T23:45:37.266Zuploaded: /pool/ext/b79af253-dd33-4fe7-98c1-790c50e27394/crypt/zone/oxz_crucible_ebce0088-396f-4300-91e9-19979170faa6/root/var/svc/log/oxide-crucible-downstairs:default.log
11562024-09-06T23:45:37.266Zuploading: /pool/ext/b79af253-dd33-4fe7-98c1-790c50e27394/crypt/zone/oxz_crucible_ebce0088-396f-4300-91e9-19979170faa6/root/var/svc/log/oxide-crucible-downstairs:downstairs-9a5aacce-e65b-4f99-82cf-6f6aab20aa37.log (5992 bytes)
11572024-09-06T23:45:38.355Zuploaded: /pool/ext/b79af253-dd33-4fe7-98c1-790c50e27394/crypt/zone/oxz_crucible_ebce0088-396f-4300-91e9-19979170faa6/root/var/svc/log/oxide-crucible-downstairs:downstairs-9a5aacce-e65b-4f99-82cf-6f6aab20aa37.log
11582024-09-06T23:45:38.356Zuploading: /pool/ext/b79af253-dd33-4fe7-98c1-790c50e27394/crypt/zone/oxz_crucible_ebce0088-396f-4300-91e9-19979170faa6/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11592024-09-06T23:45:39.446Zuploaded: /pool/ext/b79af253-dd33-4fe7-98c1-790c50e27394/crypt/zone/oxz_crucible_ebce0088-396f-4300-91e9-19979170faa6/root/var/svc/log/oxide-zone-network-setup:default.log
11602024-09-06T23:45:39.446Zuploading: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-crucible-agent:default.log (19006 bytes)
11612024-09-06T23:45:40.577Zuploaded: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-crucible-agent:default.log
11622024-09-06T23:45:40.577Zuploading: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11632024-09-06T23:45:41.668Zuploaded: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-crucible-downstairs:default.log
11642024-09-06T23:45:41.668Zuploading: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c5eb39c-611c-4510-871e-26f9826e99d6.log (3018 bytes)
11652024-09-06T23:45:42.758Zuploaded: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c5eb39c-611c-4510-871e-26f9826e99d6.log
11662024-09-06T23:45:42.782Zuploading: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-crucible-downstairs:downstairs-97e6dbe9-aeac-4be1-aefa-d3af357d3a13.log (3127 bytes)
11672024-09-06T23:45:43.848Zuploaded: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-crucible-downstairs:downstairs-97e6dbe9-aeac-4be1-aefa-d3af357d3a13.log
11682024-09-06T23:45:43.848Zuploading: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
11692024-09-06T23:45:44.938Zuploaded: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_crucible_fa9373bc-3206-40d0-b421-9f54e256513c/root/var/svc/log/oxide-zone-network-setup:default.log
11702024-09-06T23:45:44.938Zuploading: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_nexus_9ad0f243-aeb1-455d-97ad-7dc9ca9c417c/root/var/svc/log/oxide-nexus:default.log (36897178 bytes)
11712024-09-06T23:45:46.412Zupload warning: file "/pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_nexus_9ad0f243-aeb1-455d-97ad-7dc9ca9c417c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 36897178 -> 37343586
11722024-09-06T23:45:47.479Zuploaded: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_nexus_9ad0f243-aeb1-455d-97ad-7dc9ca9c417c/root/var/svc/log/oxide-nexus:default.log
11732024-09-06T23:45:47.479Zuploading: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_nexus_9ad0f243-aeb1-455d-97ad-7dc9ca9c417c/root/var/svc/log/oxide-opte-interface-setup:default.log (1134 bytes)
11742024-09-06T23:45:48.569Zuploaded: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_nexus_9ad0f243-aeb1-455d-97ad-7dc9ca9c417c/root/var/svc/log/oxide-opte-interface-setup:default.log
11752024-09-06T23:45:48.592Zuploading: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_nexus_9ad0f243-aeb1-455d-97ad-7dc9ca9c417c/root/var/svc/log/oxide-zone-network-setup:default.log (1653 bytes)
11762024-09-06T23:45:49.659Zuploaded: /pool/ext/cc3f0ccd-963c-4d0c-843d-e8810b230566/crypt/zone/oxz_nexus_9ad0f243-aeb1-455d-97ad-7dc9ca9c417c/root/var/svc/log/oxide-zone-network-setup:default.log
11772024-09-06T23:45:49.682Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_cockroachdb_4fbe9fe2-68ea-45d4-ae9a-4765a236983f/root/var/svc/log/oxide-cockroach-admin:default.log (4657 bytes)
11782024-09-06T23:45:50.749Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_cockroachdb_4fbe9fe2-68ea-45d4-ae9a-4765a236983f/root/var/svc/log/oxide-cockroach-admin:default.log
11792024-09-06T23:45:50.749Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_cockroachdb_4fbe9fe2-68ea-45d4-ae9a-4765a236983f/root/var/svc/log/oxide-cockroachdb:default.log (4313 bytes)
11802024-09-06T23:45:51.841Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_cockroachdb_4fbe9fe2-68ea-45d4-ae9a-4765a236983f/root/var/svc/log/oxide-cockroachdb:default.log
11812024-09-06T23:45:51.866Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_cockroachdb_4fbe9fe2-68ea-45d4-ae9a-4765a236983f/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
11822024-09-06T23:45:52.933Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_cockroachdb_4fbe9fe2-68ea-45d4-ae9a-4765a236983f/root/var/svc/log/oxide-zone-network-setup:default.log
11832024-09-06T23:45:52.934Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-crucible-agent:default.log (23906 bytes)
11842024-09-06T23:45:54.066Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-crucible-agent:default.log
11852024-09-06T23:45:54.066Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11862024-09-06T23:45:55.156Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-crucible-downstairs:default.log
11872024-09-06T23:45:55.179Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-crucible-downstairs:downstairs-006cb426-99e3-48d7-9e6a-19cede58a070.log (5995 bytes)
11882024-09-06T23:45:56.246Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-crucible-downstairs:downstairs-006cb426-99e3-48d7-9e6a-19cede58a070.log
11892024-09-06T23:45:56.269Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-crucible-downstairs:downstairs-e6154900-b3af-40ec-bf76-98c1e4de64b9.log (3021 bytes)
11902024-09-06T23:45:57.336Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-crucible-downstairs:downstairs-e6154900-b3af-40ec-bf76-98c1e4de64b9.log
11912024-09-06T23:45:57.336Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
11922024-09-06T23:45:58.425Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_crucible_dbf82130-678a-44d4-9dd9-8a8be286ccf6/root/var/svc/log/oxide-zone-network-setup:default.log
11932024-09-06T23:45:58.450Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_internal_dns_a717f03d-27a8-4fde-9656-972b10665736/root/var/svc/log/oxide-internal_dns:default.log (410607 bytes)
11942024-09-06T23:45:58.648Zupload warning: file "/pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_internal_dns_a717f03d-27a8-4fde-9656-972b10665736/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 410607 -> 414356
11952024-09-06T23:45:59.715Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_internal_dns_a717f03d-27a8-4fde-9656-972b10665736/root/var/svc/log/oxide-internal_dns:default.log
11962024-09-06T23:45:59.715Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_internal_dns_a717f03d-27a8-4fde-9656-972b10665736/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
11972024-09-06T23:46:00.806Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_internal_dns_a717f03d-27a8-4fde-9656-972b10665736/root/var/svc/log/oxide-zone-network-setup:default.log
11982024-09-06T23:46:00.806Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-chrony-setup:default.log (14495 bytes)
11992024-09-06T23:46:01.918Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-chrony-setup:default.log
12002024-09-06T23:46:01.918Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-ntp:default.log (785 bytes)
12012024-09-06T23:46:01.962Zupload warning: file "/pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 785 -> 843
12022024-09-06T23:46:03.030Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-ntp:default.log
12032024-09-06T23:46:03.030Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
12042024-09-06T23:46:04.120Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-opte-interface-setup:default.log
12052024-09-06T23:46:04.120Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-zone-network-setup:default.log (1634 bytes)
12062024-09-06T23:46:05.210Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/svc/log/oxide-zone-network-setup:default.log
12072024-09-06T23:46:05.210Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_crucible_6bc5dbb5-a884-4ae2-af09-70bc587bd76b/root/var/svc/log/oxide-crucible-agent:default.log (12077 bytes)
12082024-09-06T23:46:06.320Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_crucible_6bc5dbb5-a884-4ae2-af09-70bc587bd76b/root/var/svc/log/oxide-crucible-agent:default.log
12092024-09-06T23:46:06.320Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_crucible_6bc5dbb5-a884-4ae2-af09-70bc587bd76b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12102024-09-06T23:46:07.410Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_crucible_6bc5dbb5-a884-4ae2-af09-70bc587bd76b/root/var/svc/log/oxide-crucible-downstairs:default.log
12112024-09-06T23:46:07.410Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_crucible_6bc5dbb5-a884-4ae2-af09-70bc587bd76b/root/var/svc/log/oxide-crucible-downstairs:downstairs-29061f2b-fa75-4439-8550-5b4ca00d40f4.log (3127 bytes)
12122024-09-06T23:46:08.500Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_crucible_6bc5dbb5-a884-4ae2-af09-70bc587bd76b/root/var/svc/log/oxide-crucible-downstairs:downstairs-29061f2b-fa75-4439-8550-5b4ca00d40f4.log
12132024-09-06T23:46:08.500Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_crucible_6bc5dbb5-a884-4ae2-af09-70bc587bd76b/root/var/svc/log/oxide-zone-network-setup:default.log (1675 bytes)
12142024-09-06T23:46:09.589Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_crucible_6bc5dbb5-a884-4ae2-af09-70bc587bd76b/root/var/svc/log/oxide-zone-network-setup:default.log
12152024-09-06T23:46:09.589Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_nexus_6c363cb4-229c-47a8-9d81-abd1714293f2/root/var/svc/log/oxide-nexus:default.log (5425261 bytes)
12162024-09-06T23:46:10.038Zupload warning: file "/pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_nexus_6c363cb4-229c-47a8-9d81-abd1714293f2/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5425261 -> 6111557
12172024-09-06T23:46:11.105Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_nexus_6c363cb4-229c-47a8-9d81-abd1714293f2/root/var/svc/log/oxide-nexus:default.log
12182024-09-06T23:46:11.105Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_nexus_6c363cb4-229c-47a8-9d81-abd1714293f2/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
12192024-09-06T23:46:12.195Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_nexus_6c363cb4-229c-47a8-9d81-abd1714293f2/root/var/svc/log/oxide-opte-interface-setup:default.log
12202024-09-06T23:46:12.218Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_nexus_6c363cb4-229c-47a8-9d81-abd1714293f2/root/var/svc/log/oxide-zone-network-setup:default.log (1655 bytes)
12212024-09-06T23:46:13.285Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_nexus_6c363cb4-229c-47a8-9d81-abd1714293f2/root/var/svc/log/oxide-zone-network-setup:default.log
12222024-09-06T23:46:13.315Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_oximeter_bc144d23-6ff5-421e-a179-41beb5b46c0f/root/var/svc/log/oxide-oximeter:default.log (1912530 bytes)
12232024-09-06T23:46:13.631Zupload warning: file "/pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_oximeter_bc144d23-6ff5-421e-a179-41beb5b46c0f/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1912530 -> 2367073
12242024-09-06T23:46:14.698Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_oximeter_bc144d23-6ff5-421e-a179-41beb5b46c0f/root/var/svc/log/oxide-oximeter:default.log
12252024-09-06T23:46:14.721Zuploading: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_oximeter_bc144d23-6ff5-421e-a179-41beb5b46c0f/root/var/svc/log/oxide-zone-network-setup:default.log (1672 bytes)
12262024-09-06T23:46:15.788Zuploaded: /pool/ext/f8e03f3f-0403-4c51-926a-d5ce11d8408e/crypt/zone/oxz_oximeter_bc144d23-6ff5-421e-a179-41beb5b46c0f/root/var/svc/log/oxide-zone-network-setup:default.log
12272024-09-06T23:46:15.788Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_cockroachdb_4b4f9d05-21f6-4b48-9ca1-3f388ea217ce/root/var/svc/log/oxide-cockroach-admin:default.log (4653 bytes)
12282024-09-06T23:46:16.878Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_cockroachdb_4b4f9d05-21f6-4b48-9ca1-3f388ea217ce/root/var/svc/log/oxide-cockroach-admin:default.log
12292024-09-06T23:46:16.879Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_cockroachdb_4b4f9d05-21f6-4b48-9ca1-3f388ea217ce/root/var/svc/log/oxide-cockroachdb:default.log (4287 bytes)
12302024-09-06T23:46:17.971Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_cockroachdb_4b4f9d05-21f6-4b48-9ca1-3f388ea217ce/root/var/svc/log/oxide-cockroachdb:default.log
12312024-09-06T23:46:17.971Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_cockroachdb_4b4f9d05-21f6-4b48-9ca1-3f388ea217ce/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
12322024-09-06T23:46:19.059Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_cockroachdb_4b4f9d05-21f6-4b48-9ca1-3f388ea217ce/root/var/svc/log/oxide-zone-network-setup:default.log
12332024-09-06T23:46:19.060Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-agent:default.log (28524 bytes)
12342024-09-06T23:46:20.193Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-agent:default.log
12352024-09-06T23:46:20.193Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12362024-09-06T23:46:21.283Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-downstairs:default.log
12372024-09-06T23:46:21.283Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-downstairs:downstairs-2081b84d-1bdf-494a-9089-74fb454e64dc.log (3126 bytes)
12382024-09-06T23:46:22.373Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-downstairs:downstairs-2081b84d-1bdf-494a-9089-74fb454e64dc.log
12392024-09-06T23:46:22.373Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-downstairs:downstairs-ce855c04-116f-4b06-b0f9-1006ece489ed.log (6077 bytes)
12402024-09-06T23:46:23.463Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-downstairs:downstairs-ce855c04-116f-4b06-b0f9-1006ece489ed.log
12412024-09-06T23:46:23.487Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-downstairs:snapshot-ce855c04-116f-4b06-b0f9-1006ece489ed-14f123e0-b5bf-4d3d-81ae-5bb566e4e4ed.log (5688 bytes)
12422024-09-06T23:46:24.554Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-crucible-downstairs:snapshot-ce855c04-116f-4b06-b0f9-1006ece489ed-14f123e0-b5bf-4d3d-81ae-5bb566e4e4ed.log
12432024-09-06T23:46:24.554Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-zone-network-setup:default.log (1674 bytes)
12442024-09-06T23:46:25.644Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_cea6def4-eb13-4381-bb48-7596d86978d4/root/var/svc/log/oxide-zone-network-setup:default.log
12452024-09-06T23:46:25.670Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_pantry_072c2fe9-5a06-4344-a93a-991a46098bd3/root/var/svc/log/oxide-crucible-pantry:default.log (763937 bytes)
12462024-09-06T23:46:26.954Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_pantry_072c2fe9-5a06-4344-a93a-991a46098bd3/root/var/svc/log/oxide-crucible-pantry:default.log
12472024-09-06T23:46:26.954Zuploading: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_pantry_072c2fe9-5a06-4344-a93a-991a46098bd3/root/var/svc/log/oxide-zone-network-setup:default.log (1715 bytes)
12482024-09-06T23:46:28.044Zuploaded: /pool/ext/fd8d5a1e-9723-41c1-aa2b-460a6959d6c7/crypt/zone/oxz_crucible_pantry_072c2fe9-5a06-4344-a93a-991a46098bd3/root/var/svc/log/oxide-zone-network-setup:default.log
12492024-09-06T23:46:28.067Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/measurements.log (121382 bytes)
12502024-09-06T23:46:28.217Zupload warning: file "/pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/measurements.log" changed size mid upload: 121382 -> 152892
12512024-09-06T23:46:29.285Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/measurements.log
12522024-09-06T23:46:29.285Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/statistics.log (74412 bytes)
12532024-09-06T23:46:29.436Zupload warning: file "/pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/statistics.log" changed size mid upload: 74412 -> 93015
12542024-09-06T23:46:30.503Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/statistics.log
12552024-09-06T23:46:30.503Zuploading: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/tracking.log (17429 bytes)
12562024-09-06T23:46:30.590Zupload warning: file "/pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/tracking.log" changed size mid upload: 17429 -> 20861
12572024-09-06T23:46:31.657Zuploaded: /pool/ext/eae5bedf-a363-4cf3-b83a-efcb44445301/crypt/zone/oxz_ntp_563f2b19-0f47-40c0-8fff-c29b65f02314/root/var/log/chrony/tracking.log