01HZMSGDAA6GZ8KF82HKNZ19JB: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.31",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HZMSHJHH3MYVH8DHFXZXKG6B

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-06-05T18:49:37.662Zjob dependencies complete; ready to run (waiting for 38 m 41 s)
22024-06-05T19:43:11.595Zjob assigned to worker 01HZMYGF3QWNVA2Q25689VPQMG (queued for 53 m 33 s)
32024-06-05T19:43:11.703Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-06-05T19:43:11.749Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-06-05T19:43:11.783Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-06-05T19:43:11.817Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-06-05T19:43:11.851Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-06-05T19:43:11.888ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-06-05T19:43:11.920Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d3
102024-06-05T19:43:11.952ZOxide Helios Version helios-2.0.22694 64-bit
112024-06-05T19:43:11.985ZConfiguring devices.
122024-06-05T19:43:12.020Z##################################################
132024-06-05T19:43:12.055Z#### ############# ##
142024-06-05T19:43:12.109Z### ### ############ ##
152024-06-05T19:43:12.142Z## ### # ## ### ## Oxide Computer Company ##
162024-06-05T19:43:12.176Z## ## ## ### # ### ##
172024-06-05T19:43:12.209Z## # ### #### #### This Station Under ##
182024-06-05T19:43:12.243Z### ### #### # ### Computer Control ##
192024-06-05T19:43:12.277Z#### #### ### ## ##
202024-06-05T19:43:12.312Z##################################################
212024-06-05T19:43:12.344ZHostname: buskin
222024-06-05T19:43:12.377ZLoading smf(7) service descriptions:
232024-06-05T19:43:13.129Zdownloading input: /input/package/work/package.tar.gz
242024-06-05T19:47:28.747Zdownloaded input: /input/package/work/package.tar.gz
 
252024-06-05T19:47:28.772Zstarting task 0: "setup"
262024-06-05T19:47:28.772Z++ uname -s
272024-06-05T19:47:28.772Z+ kern=SunOS
282024-06-05T19:47:28.772Z+ case "$kern" in
292024-06-05T19:47:28.773Z+ groupadd -g 12345 build
302024-06-05T19:47:28.773Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-06-05T19:47:30.569Z+ zfs create -o mountpoint=/work rpool/work
322024-06-05T19:47:30.613Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-06-05T19:47:30.639Z+ home_fs=zfs
342024-06-05T19:47:30.639Z+ [[ zfs == autofs ]]
352024-06-05T19:47:30.639Z+ mkdir -p /home/build
362024-06-05T19:47:30.639Z+ chown build:build /home/build /work
372024-06-05T19:47:32.622Z+ chmod 0700 /home/build /work
382024-06-05T19:47:32.649Zprocess exited: duration 4075 ms, exit code 0
 
392024-06-05T19:47:32.702Zstarting task 1: "authentication"
402024-06-05T19:47:32.746Zprocess exited: duration 44 ms, exit code 0
 
412024-06-05T19:47:32.796Zstarting task 2: "build"
422024-06-05T19:47:32.820Z+ trap _exit_trap EXIT
432024-06-05T19:47:32.821Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-06-05T19:47:32.913Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-06-05T19:47:32.914Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-06-05T19:47:32.914Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-06-05T19:47:32.914Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-06-05T19:47:32.914Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-06-05T19:47:32.914Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-06-05T19:47:32.914Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-06-05T19:47:32.939Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-06-05T19:47:32.939Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-06-05T19:47:32.939Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-06-05T19:47:32.939Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-06-05T19:47:32.939Z+ [[ -d /opt/oxide ]]
562024-06-05T19:47:32.939Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-06-05T19:47:32.939Z+ pfexec mkdir /opt/oxide
582024-06-05T19:47:32.939Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-06-05T19:47:32.939Z+ [[ -d /opt/oxide-underneath ]]
602024-06-05T19:47:32.939Z+ cd /opt/oxide-underneath
612024-06-05T19:47:32.939Z+ pfexec tar ceEp@/f - .
622024-06-05T19:47:32.939Z+ cd /opt/oxide
632024-06-05T19:47:32.939Z+ pfexec tar xveEp@/f -
642024-06-05T19:47:33.027Zx ., 0 bytes, 0 tape blocks
652024-06-05T19:47:33.027Zx ./opte, 0 bytes, 0 tape blocks
662024-06-05T19:47:33.027Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-06-05T19:47:33.027Zx ./opte/bin/opteadm, 44782952 bytes, 87467 tape blocks
682024-06-05T19:47:33.052Z+ pfexec rm -rf /opt/oxide-underneath
692024-06-05T19:47:33.052Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-06-05T19:47:33.077Z+ pfexec mkdir /opt/oxide/work
712024-06-05T19:47:33.077Z+ pfexec chown build:build /opt/oxide/work
722024-06-05T19:47:33.077Z+ cd /opt/oxide/work
732024-06-05T19:47:33.077Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-06-05T19:47:45.188ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-06-05T19:47:45.188Zx out/target/test, 75 bytes, 1 tape blocks
762024-06-05T19:47:45.188Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-06-05T19:47:45.188Zx package-manifest.toml, 27966 bytes, 55 tape blocks
782024-06-05T19:47:45.188Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-06-05T19:47:45.188Zx target/release/omicron-package, 32569648 bytes, 63613 tape blocks
802024-06-05T19:47:45.188Zx target/release/xtask, 14187160 bytes, 27710 tape blocks
812024-06-05T19:47:45.188Zx target/debug/bootstrap, 359735440 bytes, 702609 tape blocks
822024-06-05T19:47:45.188Zx tests/bootstrap-f9f03874decddf45, 24564360 bytes, 47978 tape blocks
832024-06-05T19:47:45.188Zx tests/commtest-3a6ffb54f41f3cf2, 24564944 bytes, 47979 tape blocks
842024-06-05T19:47:45.188Zx tests/dhcp_server-464cb48f2c4503d8, 24564368 bytes, 47978 tape blocks
852024-06-05T19:47:45.188Zx tests/end_to_end_tests-0b0a517b73fe1ae3, 369512816 bytes, 721705 tape blocks
862024-06-05T19:47:45.189Zx out/clickhouse.tar.gz, 228346806 bytes, 445990 tape blocks
872024-06-05T19:47:45.189Zx out/clickhouse_keeper.tar.gz, 228328846 bytes, 445955 tape blocks
882024-06-05T19:47:45.189Zx out/cockroachdb.tar.gz, 134247862 bytes, 262203 tape blocks
892024-06-05T19:47:45.189Zx out/crucible-pantry-zone.tar.gz, 27948119 bytes, 54587 tape blocks
902024-06-05T19:47:45.189Zx out/crucible-zone.tar.gz, 38968330 bytes, 76111 tape blocks
912024-06-05T19:47:45.189Zx out/external-dns.tar.gz, 25688865 bytes, 50174 tape blocks
922024-06-05T19:47:45.189Zx out/internal-dns.tar.gz, 25689538 bytes, 50175 tape blocks
932024-06-05T19:47:45.189Zx out/mg-ddm-gz.tar, 62731776 bytes, 122523 tape blocks
942024-06-05T19:47:45.189Zx out/nexus.tar.gz, 84429337 bytes, 164902 tape blocks
952024-06-05T19:47:45.189Zx out/ntp.tar.gz, 9055851 bytes, 17688 tape blocks
962024-06-05T19:47:45.189Zx out/omicron-gateway-softnpu.tar.gz, 14074322 bytes, 27489 tape blocks
972024-06-05T19:47:45.189Zx out/omicron-sled-agent.tar, 94901760 bytes, 185355 tape blocks
982024-06-05T19:47:45.189Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
992024-06-05T19:47:45.189Zx out/oximeter.tar.gz, 41308138 bytes, 80680 tape blocks
1002024-06-05T19:47:45.189Zx out/oxlog.tar, 3024896 bytes, 5908 tape blocks
1012024-06-05T19:47:45.189Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1022024-06-05T19:47:45.189Zx out/propolis-server.tar.gz, 67005412 bytes, 130870 tape blocks
1032024-06-05T19:47:45.189Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1042024-06-05T19:47:45.189Zx out/switch-softnpu.tar.gz, 200253194 bytes, 391120 tape blocks
1052024-06-05T19:47:45.216Z
1062024-06-05T19:47:45.216Zreal 12.097327864
1072024-06-05T19:47:45.216Zuser 10.721860956
1082024-06-05T19:47:45.216Zsys 2.385439534
1092024-06-05T19:47:45.216Ztrap 0.000471625
1102024-06-05T19:47:45.216Ztflt 0.000000000
1112024-06-05T19:47:45.216Zdflt 0.000000000
1122024-06-05T19:47:45.216Zkflt 0.000000000
1132024-06-05T19:47:45.217Zlock 0.000000000
1142024-06-05T19:47:45.217Zslp 10.778099299
1152024-06-05T19:47:45.217Zlat 0.306794822
1162024-06-05T19:47:45.217Zstop 0.000125602
1172024-06-05T19:47:45.217Z+ bmat address ls
1182024-06-05T19:47:45.217ZNAME CIDR FIRST LAST COUNT
1192024-06-05T19:47:45.217Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1202024-06-05T19:47:45.217Z++ bmat address ls -f extra -Ho first,last,count
1212024-06-05T19:47:45.217Z+ set -- 10.151.1.164 10.151.1.227 64
1222024-06-05T19:47:45.217Z+ EXTRA_IP_START=10.151.1.164
1232024-06-05T19:47:45.217Z+ EXTRA_IP_END=10.151.1.227
1242024-06-05T19:47:45.217Z+ EXTRA_IP_COUNT=64
1252024-06-05T19:47:45.217Z+ (( EXTRA_IP_COUNT >= 32 ))
1262024-06-05T19:47:45.217Z+ EXTRA_IP_BASE=10.151.1
1272024-06-05T19:47:45.217Z+ EXTRA_IP_FOCTET=164
1282024-06-05T19:47:45.217Z+ EXTRA_IP_LOCTET=227
1292024-06-05T19:47:45.217Z+ SERVICE_IP_POOL_START=10.151.1.164
1302024-06-05T19:47:45.217Z+ SERVICE_IP_POOL_END=10.151.1.173
1312024-06-05T19:47:45.217Z+ DNS_IP1=10.151.1.164
1322024-06-05T19:47:45.217Z+ DNS_IP2=10.151.1.165
1332024-06-05T19:47:45.217Z+ UPLINK_IP=10.151.1.174
1342024-06-05T19:47:45.217Z+ IPPOOL_START=10.151.1.175
1352024-06-05T19:47:45.217Z+ IPPOOL_END=10.151.1.227
1362024-06-05T19:47:45.218Z++ ipadm show-addr -po type,addr
1372024-06-05T19:47:45.218Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1382024-06-05T19:47:45.218Z+ GATEWAY_IP=10.151.1.100
1392024-06-05T19:47:45.218Z+ [[ -n 10.151.1.100 ]]
1402024-06-05T19:47:45.218Z+ ping -s 10.151.1.100 56 1
1412024-06-05T19:47:45.218ZPING 10.151.1.100: 56 data bytes
1422024-06-05T19:47:45.218Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.012 ms
1432024-06-05T19:47:45.218Z
1442024-06-05T19:47:45.218Z----10.151.1.100 PING Statistics----
1452024-06-05T19:47:45.218Z1 packets transmitted, 1 packets received, 0% packet loss
1462024-06-05T19:47:45.218Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
1472024-06-05T19:47:45.218Z++ arp -an
1482024-06-05T19:47:45.218Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1492024-06-05T19:47:45.218Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1502024-06-05T19:47:45.218Z+ routeadm -e ipv4-forwarding -u
1512024-06-05T19:47:45.324Z+ PXA_START=10.151.1.164
1522024-06-05T19:47:45.324Z+ PXA_END=10.151.1.227
1532024-06-05T19:47:45.350Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1542024-06-05T19:47:45.452Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1552024-06-05T19:47:45.478ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1562024-06-05T19:47:45.534Zcreating virtual hardware
1572024-06-05T19:47:45.559Zcreating /scratch/m2_0.vdev
1582024-06-05T19:47:45.560Zcreating /scratch/m2_1.vdev
1592024-06-05T19:47:45.560Zcreating /scratch/u2_0.vdev
1602024-06-05T19:47:45.560Zcreating /scratch/u2_1.vdev
1612024-06-05T19:47:45.560Zcreating /scratch/u2_2.vdev
1622024-06-05T19:47:45.560Zcreating /scratch/u2_3.vdev
1632024-06-05T19:47:45.560Zcreating /scratch/u2_4.vdev
1642024-06-05T19:47:45.560Zcreating /scratch/u2_5.vdev
1652024-06-05T19:47:45.560Zcreating /scratch/u2_6.vdev
1662024-06-05T19:47:45.560Zcreating /scratch/u2_7.vdev
1672024-06-05T19:47:45.560Zcreating /scratch/u2_8.vdev
1682024-06-05T19:47:45.591ZSimnet net0/sc0_0 exists
1692024-06-05T19:47:45.617ZSimnet net1/sc1_0 exists
1702024-06-05T19:47:45.643ZVnic sc0_1 exists
1712024-06-05T19:48:00.238ZUsing 10.151.1.100 as gateway ip
1722024-06-05T19:48:00.238Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1732024-06-05T19:48:00.238Zconfiguring SoftNPU ARP entry
1742024-06-05T19:48:00.265Zconfiguring SoftNPU proxy ARP
1752024-06-05T19:48:00.323ZSoftNPU state:
1762024-06-05T19:48:00.323Z local v6:
1772024-06-05T19:48:00.323Z local v4:
1782024-06-05T19:48:00.323Z router v6:
1792024-06-05T19:48:00.323Z router v4_idx:
1802024-06-05T19:48:00.323Z router v4_routes:
1812024-06-05T19:48:00.323Z resolver v4:
1822024-06-05T19:48:00.323Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1832024-06-05T19:48:00.323Z resolver v6:
1842024-06-05T19:48:00.323Z nat v4:
1852024-06-05T19:48:00.323Z nat_v6:
1862024-06-05T19:48:00.323Z port_mac:
1872024-06-05T19:48:00.323Z proxy arp:
1882024-06-05T19:48:00.323Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
1892024-06-05T19:48:00.323Zcreated virtual hardware
1902024-06-05T19:48:00.349Z
1912024-06-05T19:48:00.349Zreal 14.870473212
1922024-06-05T19:48:00.349Zuser 0.653270553
1932024-06-05T19:48:00.349Zsys 3.517858398
1942024-06-05T19:48:00.349Ztrap 0.000087047
1952024-06-05T19:48:00.349Ztflt 0.000262757
1962024-06-05T19:48:00.349Zdflt 0.002709592
1972024-06-05T19:48:00.349Zkflt 0.000006170
1982024-06-05T19:48:00.349Zlock 23:07.121922462
1992024-06-05T19:48:00.349Zslp 59.646822118
2002024-06-05T19:48:00.349Zlat 0.086928305
2012024-06-05T19:48:00.349Zstop 1.078731436
2022024-06-05T19:48:00.349Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2032024-06-05T19:48:00.399Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2042024-06-05T19:48:00.399Z+ diff -u pkg/config.toml~ pkg/config.toml
2052024-06-05T19:48:00.399Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2062024-06-05T19:48:00.400Z+++ pkg/config.toml Wed Jun 5 19:48:00 2024
2072024-06-05T19:48:00.400Z@@ -29,18 +29,18 @@
2082024-06-05T19:48:00.400Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2092024-06-05T19:48:00.400Z # followed by a string that is embedded into their fake serial values.
2102024-06-05T19:48:00.400Z vdevs = [
2112024-06-05T19:48:00.400Z- "m2_0.vdev",
2122024-06-05T19:48:00.400Z- "m2_1.vdev",
2132024-06-05T19:48:00.400Z+ "/scratch/m2_0.vdev",
2142024-06-05T19:48:00.400Z+ "/scratch/m2_1.vdev",
2152024-06-05T19:48:00.400Z
2162024-06-05T19:48:00.400Z- "u2_0.vdev",
2172024-06-05T19:48:00.400Z- "u2_1.vdev",
2182024-06-05T19:48:00.400Z- "u2_2.vdev",
2192024-06-05T19:48:00.400Z- "u2_3.vdev",
2202024-06-05T19:48:00.400Z- "u2_4.vdev",
2212024-06-05T19:48:00.400Z- "u2_5.vdev",
2222024-06-05T19:48:00.400Z- "u2_6.vdev",
2232024-06-05T19:48:00.400Z- "u2_7.vdev",
2242024-06-05T19:48:00.400Z- "u2_8.vdev",
2252024-06-05T19:48:00.400Z+ "/scratch/u2_0.vdev",
2262024-06-05T19:48:00.400Z+ "/scratch/u2_1.vdev",
2272024-06-05T19:48:00.400Z+ "/scratch/u2_2.vdev",
2282024-06-05T19:48:00.400Z+ "/scratch/u2_3.vdev",
2292024-06-05T19:48:00.401Z+ "/scratch/u2_4.vdev",
2302024-06-05T19:48:00.401Z+ "/scratch/u2_5.vdev",
2312024-06-05T19:48:00.401Z+ "/scratch/u2_6.vdev",
2322024-06-05T19:48:00.401Z+ "/scratch/u2_7.vdev",
2332024-06-05T19:48:00.401Z+ "/scratch/u2_8.vdev",
2342024-06-05T19:48:00.401Z ]
2352024-06-05T19:48:00.401Z
2362024-06-05T19:48:00.401Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2372024-06-05T19:48:00.401Z+ true
2382024-06-05T19:48:00.401Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2392024-06-05T19:48:00.401Z+ SILO_NAME=recovery
2402024-06-05T19:48:00.401Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2412024-06-05T19:48:00.401Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2422024-06-05T19:48:00.401Z+ sed -i~ '
2432024-06-05T19:48:00.401Z /^external_dns_ips/c\
2442024-06-05T19:48:00.401Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2452024-06-05T19:48:00.401Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2462024-06-05T19:48:00.401Z /^first/c\
2472024-06-05T19:48:00.401Zfirst = "10.151.1.164"
2482024-06-05T19:48:00.401Z /^last/c\
2492024-06-05T19:48:00.401Zlast = "10.151.1.173"
2502024-06-05T19:48:00.401Z }
2512024-06-05T19:48:00.401Z /^infra_ip_first/c\
2522024-06-05T19:48:00.402Zinfra_ip_first = "10.151.1.174"
2532024-06-05T19:48:00.402Z /^infra_ip_last/c\
2542024-06-05T19:48:00.402Zinfra_ip_last = "10.151.1.174"
2552024-06-05T19:48:00.402Z /^\[\[rack_network_config.ports/,/^$/ {
2562024-06-05T19:48:00.402Z /^routes/c\
2572024-06-05T19:48:00.402Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2582024-06-05T19:48:00.402Z /^addresses/c\
2592024-06-05T19:48:00.402Zaddresses = \["10.151.1.174/24"\]
2602024-06-05T19:48:00.402Z }
2612024-06-05T19:48:00.402Z' pkg/config-rss.toml
2622024-06-05T19:48:00.402Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2632024-06-05T19:48:00.402Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2642024-06-05T19:48:00.402Z+++ pkg/config-rss.toml Wed Jun 5 19:48:00 2024
2652024-06-05T19:48:00.402Z@@ -33,7 +33,7 @@
2662024-06-05T19:48:00.402Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2672024-06-05T19:48:00.402Z # must be contained in one of the "internal services" IP Pool ranges listed
2682024-06-05T19:48:00.402Z # below.
2692024-06-05T19:48:00.402Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2702024-06-05T19:48:00.402Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2712024-06-05T19:48:00.402Z
2722024-06-05T19:48:00.402Z # Initial TLS certificates for the external API
2732024-06-05T19:48:00.402Z #
2742024-06-05T19:48:00.403Z@@ -69,8 +69,8 @@
2752024-06-05T19:48:00.403Z #
2762024-06-05T19:48:00.403Z # For more on this and what to put here, see docs/how-to-run.adoc.
2772024-06-05T19:48:00.403Z [[internal_services_ip_pool_ranges]]
2782024-06-05T19:48:00.403Z-first = "192.168.1.20"
2792024-06-05T19:48:00.403Z-last = "192.168.1.29"
2802024-06-05T19:48:00.403Z+first = "10.151.1.164"
2812024-06-05T19:48:00.403Z+last = "10.151.1.173"
2822024-06-05T19:48:00.403Z
2832024-06-05T19:48:00.403Z # TODO - this configuration is subject to change going forward. Ultimately these
2842024-06-05T19:48:00.403Z # parameters should be provided to the control plane via wicket, but we need to
2852024-06-05T19:48:00.403Z@@ -91,8 +91,8 @@
2862024-06-05T19:48:00.403Z # A range of IP addresses used by Boundary Services on the external network. In
2872024-06-05T19:48:00.403Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2882024-06-05T19:48:00.403Z # With softnpu, only one address is used.
2892024-06-05T19:48:00.403Z-infra_ip_first = "192.168.1.30"
2902024-06-05T19:48:00.403Z-infra_ip_last = "192.168.1.30"
2912024-06-05T19:48:00.403Z+infra_ip_first = "10.151.1.174"
2922024-06-05T19:48:00.403Z+infra_ip_last = "10.151.1.174"
2932024-06-05T19:48:00.403Z
2942024-06-05T19:48:00.403Z # Configurations for BGP routers to run on the scrimlets.
2952024-06-05T19:48:00.403Z bgp = []
2962024-06-05T19:48:00.403Z@@ -100,9 +100,9 @@
2972024-06-05T19:48:00.403Z # You can configure multiple uplinks by repeating the following stanza
2982024-06-05T19:48:00.404Z [[rack_network_config.ports]]
2992024-06-05T19:48:00.404Z # Routes associated with this port.
3002024-06-05T19:48:00.404Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3012024-06-05T19:48:00.404Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3022024-06-05T19:48:00.404Z # Addresses associated with this port.
3032024-06-05T19:48:00.431Z-addresses = ["192.168.1.30/24"]
3042024-06-05T19:48:00.431Z+addresses = ["10.151.1.174/24"]
3052024-06-05T19:48:00.431Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3062024-06-05T19:48:00.431Z port = "qsfp0"
3072024-06-05T19:48:00.431Z # The speed of this port.
3082024-06-05T19:48:00.431Z+ true
3092024-06-05T19:48:00.431Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3102024-06-05T19:48:00.431Za pkg/config-rss.toml 7K
3112024-06-05T19:48:00.431Za pkg/config.toml 4K
3122024-06-05T19:48:00.431Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3132024-06-05T19:48:00.431Z+ TLS_NAME=recovery.sys.oxide.test
3142024-06-05T19:48:00.431Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3152024-06-05T19:48:00.690Z....+........+.+.....+......+...+.............+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.................+......+.......+..............+....+.................+.........+.+...+.........+..+...+.+...........+..........+.....................+..+......+.+......+.....+.......+...+.......................+....+......+..............+.+..+....+..................+..+.........+.+...........+.........+.+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3162024-06-05T19:48:00.874Z.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.....+.........+...+.+.....+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+.....+......+....+...+...+.................+.......+...+.............................+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-06-05T19:48:00.900Z-----
3182024-06-05T19:48:00.900Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3192024-06-05T19:48:00.926Za pkg/initial-tls-cert.pem 2K
3202024-06-05T19:48:00.926Za pkg/initial-tls-key.pem 4K
3212024-06-05T19:48:00.926Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3222024-06-05T19:48:00.926Z+ rmdir pkg
3232024-06-05T19:48:00.926Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3242024-06-05T19:48:00.926Z+ pfexec mkdir -p /usr/oxide
3252024-06-05T19:48:00.926Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3262024-06-05T19:48:01.622Z+ pfexec chmod +x /usr/oxide/oxide
3272024-06-05T19:48:01.650Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3282024-06-05T19:48:19.927Z+ OMICRON_NO_UNINSTALL=1
3292024-06-05T19:48:19.927Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3302024-06-05T19:48:19.953ZLogging to: /opt/oxide/work/out/LOG
3312024-06-05T19:48:20.466Z
3322024-06-05T19:48:20.492Zreal 0.532232304
3332024-06-05T19:48:20.492Zuser 0.116220074
3342024-06-05T19:48:20.492Zsys 2.330310095
3352024-06-05T19:48:20.492Ztrap 0.000000780
3362024-06-05T19:48:20.492Ztflt 0.000028499
3372024-06-05T19:48:20.492Zdflt 0.001139065
3382024-06-05T19:48:20.492Zkflt 0.000003380
3392024-06-05T19:48:20.492Zlock 48.165223844
3402024-06-05T19:48:20.492Zslp 0.741429404
3412024-06-05T19:48:20.492Zlat 0.003212372
3422024-06-05T19:48:20.492Zstop 0.202442512
3432024-06-05T19:48:20.492Z+ retry=0
3442024-06-05T19:48:20.492Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3452024-06-05T19:48:20.492Z+ [[ 0 -gt 30 ]]
3462024-06-05T19:48:20.492Z+ sleep 1
3472024-06-05T19:48:21.479Z+ retry=1
3482024-06-05T19:48:21.479Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3492024-06-05T19:48:21.506Z+ [[ 1 -gt 30 ]]
3502024-06-05T19:48:21.506Z+ sleep 1
3512024-06-05T19:48:22.494Z+ retry=2
3522024-06-05T19:48:22.495Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3532024-06-05T19:48:22.520Z+ [[ 2 -gt 30 ]]
3542024-06-05T19:48:22.521Z+ sleep 1
3552024-06-05T19:48:23.508Z+ retry=3
3562024-06-05T19:48:23.508Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3572024-06-05T19:48:48.678Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3582024-06-05T19:48:48.704Zlocal v6:
3592024-06-05T19:48:48.704Zfdd7:8fa0:bde1:d17::1
3602024-06-05T19:48:48.704Zfe80::eca4:efff:fe34:7b09
3612024-06-05T19:48:48.704Zlocal v4:
3622024-06-05T19:48:48.704Z10.151.1.174
3632024-06-05T19:48:48.704Zrouter v6:
3642024-06-05T19:48:48.704Zfd00:1122:3344:3::/64 -> fe80::acfe:96ff:fe61:711e (1)
3652024-06-05T19:48:48.704Zfd00:1122:3344:1::/64 -> fe80::acfe:96ff:fe61:711e (1)
3662024-06-05T19:48:48.704Zfd00:1122:3344:101::/64 -> fe80::acfe:96ff:fe61:711e (1)
3672024-06-05T19:48:48.705Zfd00:1122:3344:2::/64 -> fe80::acfe:96ff:fe61:711e (1)
3682024-06-05T19:48:48.705Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::acfe:96ff:fe61:711e (1)
3692024-06-05T19:48:48.705Zrouter v4_idx:
3702024-06-05T19:48:48.705Z0.0.0.0/0 -> 0
3712024-06-05T19:48:48.705Zrouter v4_routes:
3722024-06-05T19:48:48.705Z0 -> 10.151.1.100 (2)
3732024-06-05T19:48:48.705Zresolver v4:
3742024-06-05T19:48:48.705Z10.151.1.174 -> d2:b4:f2:59:d2:91
3752024-06-05T19:48:48.705Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3762024-06-05T19:48:48.705Zresolver v6:
3772024-06-05T19:48:48.705Zfe80::acfe:96ff:fe61:711e -> ae:fe:96:61:71:1e
3782024-06-05T19:48:48.705Zfe80::eca4:efff:fe34:7b09 -> ee:a4:ef:34:7b:09
3792024-06-05T19:48:48.705Znat v4:
3802024-06-05T19:48:48.705Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:fa:74
3812024-06-05T19:48:48.705Znat_v6:
3822024-06-05T19:48:48.705Zport_mac:
3832024-06-05T19:48:48.705Z2: a8:40:25:37:80:a5
3842024-06-05T19:48:48.705Z1: a8:40:25:37:80:85
3852024-06-05T19:48:48.705Z1000: a8:40:25:37:80:84
3862024-06-05T19:48:48.705Zproxy arp:
3872024-06-05T19:48:48.705Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
3882024-06-05T19:48:48.731Z+ retry=0
3892024-06-05T19:48:48.731Z+++ zoneadm list -n
3902024-06-05T19:48:48.731Z+++ grep oxz_ntp
3912024-06-05T19:48:48.731Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
3922024-06-05T19:48:48.757Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
3932024-06-05T19:48:48.758Z++ true
3942024-06-05T19:48:48.758Z+ [[ '' != online ]]
3952024-06-05T19:48:48.758Z+ [[ 0 -gt 60 ]]
3962024-06-05T19:48:48.758Z+ sleep 1
3972024-06-05T19:48:49.739Z+ retry=1
3982024-06-05T19:48:49.765Z+++ zoneadm list -n
3992024-06-05T19:48:49.765Z+++ grep oxz_ntp
4002024-06-05T19:48:49.765Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
4012024-06-05T19:48:49.765Z+ [[ offline != online ]]
4022024-06-05T19:48:49.765Z+ [[ 1 -gt 60 ]]
4032024-06-05T19:48:49.765Z+ sleep 1
4042024-06-05T19:48:50.762Z+ retry=2
4052024-06-05T19:48:50.787Z+++ zoneadm list -n
4062024-06-05T19:48:50.787Z+++ grep oxz_ntp
4072024-06-05T19:48:50.787Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
4082024-06-05T19:48:50.788Z+ [[ offline != online ]]
4092024-06-05T19:48:50.788Z+ [[ 2 -gt 60 ]]
4102024-06-05T19:48:50.788Z+ sleep 1
4112024-06-05T19:48:51.782Z+ retry=3
4122024-06-05T19:48:51.808Z+++ zoneadm list -n
4132024-06-05T19:48:51.808Z+++ grep oxz_ntp
4142024-06-05T19:48:51.808Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
4152024-06-05T19:48:51.808Z+ [[ offline != online ]]
4162024-06-05T19:48:51.808Z+ [[ 3 -gt 60 ]]
4172024-06-05T19:48:51.808Z+ sleep 1
4182024-06-05T19:48:52.804Z+ retry=4
4192024-06-05T19:48:52.829Z+++ zoneadm list -n
4202024-06-05T19:48:52.830Z+++ grep oxz_ntp
4212024-06-05T19:48:52.830Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
4222024-06-05T19:48:52.830Z+ [[ offline != online ]]
4232024-06-05T19:48:52.830Z+ [[ 4 -gt 60 ]]
4242024-06-05T19:48:52.830Z+ sleep 1
4252024-06-05T19:48:53.826Z+ retry=5
4262024-06-05T19:48:53.853Z+++ zoneadm list -n
4272024-06-05T19:48:53.853Z+++ grep oxz_ntp
4282024-06-05T19:48:53.853Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
4292024-06-05T19:48:53.853Z+ [[ offline != online ]]
4302024-06-05T19:48:53.853Z+ [[ 5 -gt 60 ]]
4312024-06-05T19:48:53.853Z+ sleep 1
4322024-06-05T19:48:54.849Z+ retry=6
4332024-06-05T19:48:54.875Z+++ zoneadm list -n
4342024-06-05T19:48:54.875Z+++ grep oxz_ntp
4352024-06-05T19:48:54.875Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
4362024-06-05T19:48:54.875Z+ [[ offline != online ]]
4372024-06-05T19:48:54.875Z+ [[ 6 -gt 60 ]]
4382024-06-05T19:48:54.875Z+ sleep 1
4392024-06-05T19:48:55.870Z+ retry=7
4402024-06-05T19:48:55.895Z+++ zoneadm list -n
4412024-06-05T19:48:55.895Z+++ grep oxz_ntp
4422024-06-05T19:48:55.895Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
4432024-06-05T19:48:55.896Z+ [[ offline != online ]]
4442024-06-05T19:48:55.896Z+ [[ 7 -gt 60 ]]
4452024-06-05T19:48:55.896Z+ sleep 1
 
4462024-06-05T19:48:56.349Zbuskin console login: Jun 5 19:48:55 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
4472024-06-05T19:48:56.891Z+ retry=8
4482024-06-05T19:48:56.917Z+++ zoneadm list -n
4492024-06-05T19:48:56.917Z+++ grep oxz_ntp
4502024-06-05T19:48:56.917Z++ pfexec svcs -z oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee -Hostate oxide/ntp
4512024-06-05T19:48:56.917Z+ [[ online != online ]]
4522024-06-05T19:48:56.917Z+ echo 'Waited for chrony: 8s'
4532024-06-05T19:48:56.917Z+ retry=0
4542024-06-05T19:48:56.917ZWaited for chrony: 8s
4552024-06-05T19:48:56.917Z+ zoneadm list
4562024-06-05T19:48:56.917Z+ grep nexus
4572024-06-05T19:48:56.943Z+ [[ 0 -gt 300 ]]
4582024-06-05T19:48:56.943Z+ sleep 1
4592024-06-05T19:48:57.921Z+ retry=1
4602024-06-05T19:48:57.946Z+ zoneadm list
4612024-06-05T19:48:57.946Z+ grep nexus
4622024-06-05T19:48:57.946Z+ [[ 1 -gt 300 ]]
4632024-06-05T19:48:57.947Z+ sleep 1
4642024-06-05T19:48:58.932Z+ retry=2
4652024-06-05T19:48:58.957Z+ zoneadm list
4662024-06-05T19:48:58.957Z+ grep nexus
4672024-06-05T19:48:58.957Z+ [[ 2 -gt 300 ]]
4682024-06-05T19:48:58.957Z+ sleep 1
4692024-06-05T19:48:59.943Z+ retry=3
4702024-06-05T19:48:59.968Z+ zoneadm list
4712024-06-05T19:48:59.968Z+ grep nexus
4722024-06-05T19:48:59.968Z+ [[ 3 -gt 300 ]]
4732024-06-05T19:48:59.968Z+ sleep 1
4742024-06-05T19:49:00.954Z+ retry=4
4752024-06-05T19:49:00.983Z+ zoneadm list
4762024-06-05T19:49:00.983Z+ grep nexus
4772024-06-05T19:49:00.983Z+ [[ 4 -gt 300 ]]
4782024-06-05T19:49:00.983Z+ sleep 1
4792024-06-05T19:49:01.963Z+ retry=5
4802024-06-05T19:49:01.991Z+ zoneadm list
4812024-06-05T19:49:01.991Z+ grep nexus
4822024-06-05T19:49:01.991Z+ [[ 5 -gt 300 ]]
4832024-06-05T19:49:01.991Z+ sleep 1
4842024-06-05T19:49:02.973Z+ retry=6
4852024-06-05T19:49:03.001Z+ zoneadm list
4862024-06-05T19:49:03.001Z+ grep nexus
4872024-06-05T19:49:03.001Z+ [[ 6 -gt 300 ]]
4882024-06-05T19:49:03.002Z+ sleep 1
4892024-06-05T19:49:03.985Z+ retry=7
4902024-06-05T19:49:04.012Z+ zoneadm list
4912024-06-05T19:49:04.012Z+ grep nexus
4922024-06-05T19:49:04.012Z+ [[ 7 -gt 300 ]]
4932024-06-05T19:49:04.012Z+ sleep 1
4942024-06-05T19:49:05.003Z+ retry=8
4952024-06-05T19:49:05.030Z+ zoneadm list
4962024-06-05T19:49:05.030Z+ grep nexus
4972024-06-05T19:49:05.030Z+ [[ 8 -gt 300 ]]
4982024-06-05T19:49:05.030Z+ sleep 1
4992024-06-05T19:49:06.055Z+ retry=9
5002024-06-05T19:49:06.175Z+ grep nexus
5012024-06-05T19:49:06.201Z+ zoneadm list
5022024-06-05T19:49:06.325Z+ [[ 9 -gt 300 ]]
5032024-06-05T19:49:06.325Z+ sleep 1
5042024-06-05T19:49:07.334Z+ retry=10
5052024-06-05T19:49:07.334Z+ zoneadm list
5062024-06-05T19:49:07.371Z+ grep nexus
5072024-06-05T19:49:07.397Z+ [[ 10 -gt 300 ]]
5082024-06-05T19:49:07.397Z+ sleep 1
5092024-06-05T19:49:08.389Z+ retry=11
5102024-06-05T19:49:08.415Z+ zoneadm list
5112024-06-05T19:49:08.415Z+ grep nexus
5122024-06-05T19:49:08.415Z+ [[ 11 -gt 300 ]]
5132024-06-05T19:49:08.415Z+ sleep 1
5142024-06-05T19:49:09.401Z+ retry=12
5152024-06-05T19:49:09.427Z+ zoneadm list
5162024-06-05T19:49:09.427Z+ grep nexus
5172024-06-05T19:49:09.427Z+ [[ 12 -gt 300 ]]
5182024-06-05T19:49:09.427Z+ sleep 1
5192024-06-05T19:49:10.414Z+ retry=13
5202024-06-05T19:49:10.440Z+ zoneadm list
5212024-06-05T19:49:10.440Z+ grep nexus
5222024-06-05T19:49:10.440Z+ [[ 13 -gt 300 ]]
5232024-06-05T19:49:10.440Z+ sleep 1
5242024-06-05T19:49:11.425Z+ retry=14
5252024-06-05T19:49:11.450Z+ zoneadm list
5262024-06-05T19:49:11.451Z+ grep nexus
5272024-06-05T19:49:11.451Z+ [[ 14 -gt 300 ]]
5282024-06-05T19:49:11.451Z+ sleep 1
5292024-06-05T19:49:12.438Z+ retry=15
5302024-06-05T19:49:12.464Z+ zoneadm list
5312024-06-05T19:49:12.464Z+ grep nexus
5322024-06-05T19:49:12.464Z+ [[ 15 -gt 300 ]]
5332024-06-05T19:49:12.464Z+ sleep 1
5342024-06-05T19:49:13.450Z+ retry=16
5352024-06-05T19:49:13.476Z+ zoneadm list
5362024-06-05T19:49:13.476Z+ grep nexus
5372024-06-05T19:49:13.476Z+ [[ 16 -gt 300 ]]
5382024-06-05T19:49:13.476Z+ sleep 1
5392024-06-05T19:49:14.462Z+ retry=17
5402024-06-05T19:49:14.487Z+ zoneadm list
5412024-06-05T19:49:14.487Z+ grep nexus
5422024-06-05T19:49:14.487Z+ [[ 17 -gt 300 ]]
5432024-06-05T19:49:14.487Z+ sleep 1
5442024-06-05T19:49:15.478Z+ retry=18
5452024-06-05T19:49:15.479Z+ zoneadm list
5462024-06-05T19:49:15.504Z+ grep nexus
5472024-06-05T19:49:15.504Z+ [[ 18 -gt 300 ]]
5482024-06-05T19:49:15.504Z+ sleep 1
5492024-06-05T19:49:16.492Z+ retry=19
5502024-06-05T19:49:16.517Z+ zoneadm list
5512024-06-05T19:49:16.517Z+ grep nexus
5522024-06-05T19:49:16.517Z+ [[ 19 -gt 300 ]]
5532024-06-05T19:49:16.517Z+ sleep 1
5542024-06-05T19:49:17.509Z+ retry=20
5552024-06-05T19:49:17.534Z+ zoneadm list
5562024-06-05T19:49:17.534Z+ grep nexus
5572024-06-05T19:49:17.535Z+ [[ 20 -gt 300 ]]
5582024-06-05T19:49:17.535Z+ sleep 1
5592024-06-05T19:49:18.528Z+ retry=21
5602024-06-05T19:49:18.553Z+ zoneadm list
5612024-06-05T19:49:18.553Z+ grep nexus
5622024-06-05T19:49:18.553Z+ [[ 21 -gt 300 ]]
5632024-06-05T19:49:18.554Z+ sleep 1
5642024-06-05T19:49:19.543Z+ retry=22
5652024-06-05T19:49:19.568Z+ zoneadm list
5662024-06-05T19:49:19.568Z+ grep nexus
5672024-06-05T19:49:19.568Z+ [[ 22 -gt 300 ]]
5682024-06-05T19:49:19.568Z+ sleep 1
5692024-06-05T19:49:20.557Z+ retry=23
5702024-06-05T19:49:20.583Z+ zoneadm list
5712024-06-05T19:49:20.583Z+ grep nexus
5722024-06-05T19:49:20.583Z+ [[ 23 -gt 300 ]]
5732024-06-05T19:49:20.583Z+ sleep 1
5742024-06-05T19:49:21.569Z+ retry=24
5752024-06-05T19:49:21.595Z+ zoneadm list
5762024-06-05T19:49:21.595Z+ grep nexus
5772024-06-05T19:49:21.595Z+ [[ 24 -gt 300 ]]
5782024-06-05T19:49:21.595Z+ sleep 1
5792024-06-05T19:49:22.580Z+ retry=25
5802024-06-05T19:49:22.606Z+ zoneadm list
5812024-06-05T19:49:22.606Z+ grep nexus
5822024-06-05T19:49:22.606Z+ [[ 25 -gt 300 ]]
5832024-06-05T19:49:22.606Z+ sleep 1
5842024-06-05T19:49:23.593Z+ retry=26
5852024-06-05T19:49:23.618Z+ zoneadm list
5862024-06-05T19:49:23.618Z+ grep nexus
5872024-06-05T19:49:23.618Z+ [[ 26 -gt 300 ]]
5882024-06-05T19:49:23.618Z+ sleep 1
5892024-06-05T19:49:24.605Z+ retry=27
5902024-06-05T19:49:24.631Z+ zoneadm list
5912024-06-05T19:49:24.631Z+ grep nexus
5922024-06-05T19:49:24.631Z+ [[ 27 -gt 300 ]]
5932024-06-05T19:49:24.631Z+ sleep 1
5942024-06-05T19:49:25.617Z+ retry=28
5952024-06-05T19:49:25.642Z+ zoneadm list
5962024-06-05T19:49:25.642Z+ grep nexus
5972024-06-05T19:49:25.642Z+ [[ 28 -gt 300 ]]
5982024-06-05T19:49:25.642Z+ sleep 1
5992024-06-05T19:49:26.629Z+ retry=29
6002024-06-05T19:49:26.655Z+ zoneadm list
6012024-06-05T19:49:26.655Z+ grep nexus
6022024-06-05T19:49:26.655Z+ [[ 29 -gt 300 ]]
6032024-06-05T19:49:26.655Z+ sleep 1
6042024-06-05T19:49:29.420Z+ retry=30
6052024-06-05T19:49:29.445Z+ zoneadm list
6062024-06-05T19:49:29.445Z+ grep nexus
6072024-06-05T19:49:29.445Z+ [[ 30 -gt 300 ]]
6082024-06-05T19:49:29.445Z+ sleep 1
6092024-06-05T19:49:30.446Z+ retry=31
6102024-06-05T19:49:30.472Z+ zoneadm list
6112024-06-05T19:49:30.472Z+ grep nexus
6122024-06-05T19:49:30.472Z+ [[ 31 -gt 300 ]]
6132024-06-05T19:49:30.472Z+ sleep 1
6142024-06-05T19:49:31.463Z+ retry=32
6152024-06-05T19:49:31.488Z+ zoneadm list
6162024-06-05T19:49:31.488Z+ grep nexus
6172024-06-05T19:49:31.488Z+ [[ 32 -gt 300 ]]
6182024-06-05T19:49:31.488Z+ sleep 1
6192024-06-05T19:49:32.475Z+ retry=33
6202024-06-05T19:49:32.501Z+ zoneadm list
6212024-06-05T19:49:32.501Z+ grep nexus
6222024-06-05T19:49:32.501Z+ [[ 33 -gt 300 ]]
6232024-06-05T19:49:32.501Z+ sleep 1
6242024-06-05T19:49:33.487Z+ retry=34
6252024-06-05T19:49:33.512Z+ zoneadm list
6262024-06-05T19:49:33.512Z+ grep nexus
6272024-06-05T19:49:33.512Z+ [[ 34 -gt 300 ]]
6282024-06-05T19:49:33.512Z+ sleep 1
6292024-06-05T19:49:34.501Z+ retry=35
6302024-06-05T19:49:34.527Z+ zoneadm list
6312024-06-05T19:49:34.527Z+ grep nexus
6322024-06-05T19:49:34.527Z+ [[ 35 -gt 300 ]]
6332024-06-05T19:49:34.527Z+ sleep 1
6342024-06-05T19:49:35.512Z+ retry=36
6352024-06-05T19:49:35.537Z+ zoneadm list
6362024-06-05T19:49:35.537Z+ grep nexus
6372024-06-05T19:49:35.537Z+ [[ 36 -gt 300 ]]
6382024-06-05T19:49:35.537Z+ sleep 1
6392024-06-05T19:49:36.523Z+ retry=37
6402024-06-05T19:49:36.550Z+ zoneadm list
6412024-06-05T19:49:36.550Z+ grep nexus
6422024-06-05T19:49:36.550Z+ [[ 37 -gt 300 ]]
6432024-06-05T19:49:36.550Z+ sleep 1
6442024-06-05T19:49:37.535Z+ retry=38
6452024-06-05T19:49:37.561Z+ zoneadm list
6462024-06-05T19:49:37.561Z+ grep nexus
6472024-06-05T19:49:37.561Z+ [[ 38 -gt 300 ]]
6482024-06-05T19:49:37.562Z+ sleep 1
6492024-06-05T19:49:38.547Z+ retry=39
6502024-06-05T19:49:38.572Z+ zoneadm list
6512024-06-05T19:49:38.572Z+ grep nexus
6522024-06-05T19:49:38.572Z+ [[ 39 -gt 300 ]]
6532024-06-05T19:49:38.572Z+ sleep 1
6542024-06-05T19:49:39.560Z+ retry=40
6552024-06-05T19:49:39.585Z+ zoneadm list
6562024-06-05T19:49:39.585Z+ grep nexus
6572024-06-05T19:49:39.585Z+ [[ 40 -gt 300 ]]
6582024-06-05T19:49:39.586Z+ sleep 1
6592024-06-05T19:49:40.572Z+ retry=41
6602024-06-05T19:49:40.600Z+ zoneadm list
6612024-06-05T19:49:40.601Z+ grep nexus
6622024-06-05T19:49:40.601Z+ [[ 41 -gt 300 ]]
6632024-06-05T19:49:40.601Z+ sleep 1
6642024-06-05T19:49:41.585Z+ retry=42
6652024-06-05T19:49:41.610Z+ zoneadm list
6662024-06-05T19:49:41.610Z+ grep nexus
6672024-06-05T19:49:41.610Z+ [[ 42 -gt 300 ]]
6682024-06-05T19:49:41.610Z+ sleep 1
6692024-06-05T19:49:42.602Z+ retry=43
6702024-06-05T19:49:42.627Z+ zoneadm list
6712024-06-05T19:49:42.627Z+ grep nexus
6722024-06-05T19:49:42.627Z+ [[ 43 -gt 300 ]]
6732024-06-05T19:49:42.627Z+ sleep 1
6742024-06-05T19:49:43.612Z+ retry=44
6752024-06-05T19:49:43.637Z+ zoneadm list
6762024-06-05T19:49:43.637Z+ grep nexus
6772024-06-05T19:49:43.637Z+ [[ 44 -gt 300 ]]
6782024-06-05T19:49:43.637Z+ sleep 1
6792024-06-05T19:49:44.623Z+ retry=45
6802024-06-05T19:49:44.648Z+ zoneadm list
6812024-06-05T19:49:44.649Z+ grep nexus
6822024-06-05T19:49:44.649Z+ [[ 45 -gt 300 ]]
6832024-06-05T19:49:44.649Z+ sleep 1
6842024-06-05T19:49:45.636Z+ retry=46
6852024-06-05T19:49:45.661Z+ zoneadm list
6862024-06-05T19:49:45.661Z+ grep nexus
6872024-06-05T19:49:45.661Z+ [[ 46 -gt 300 ]]
6882024-06-05T19:49:45.661Z+ sleep 1
6892024-06-05T19:49:46.647Z+ retry=47
6902024-06-05T19:49:46.673Z+ zoneadm list
6912024-06-05T19:49:46.673Z+ grep nexus
6922024-06-05T19:49:46.673Z+ [[ 47 -gt 300 ]]
6932024-06-05T19:49:46.673Z+ sleep 1
6942024-06-05T19:49:47.659Z+ retry=48
6952024-06-05T19:49:47.684Z+ zoneadm list
6962024-06-05T19:49:47.684Z+ grep nexus
6972024-06-05T19:49:47.684Z+ [[ 48 -gt 300 ]]
6982024-06-05T19:49:47.684Z+ sleep 1
6992024-06-05T19:49:48.672Z+ retry=49
7002024-06-05T19:49:48.697Z+ zoneadm list
7012024-06-05T19:49:48.697Z+ grep nexus
7022024-06-05T19:49:48.697Z+ [[ 49 -gt 300 ]]
7032024-06-05T19:49:48.697Z+ sleep 1
7042024-06-05T19:49:49.683Z+ retry=50
7052024-06-05T19:49:49.708Z+ zoneadm list
7062024-06-05T19:49:49.708Z+ grep nexus
7072024-06-05T19:49:49.708Z+ [[ 50 -gt 300 ]]
7082024-06-05T19:49:49.708Z+ sleep 1
7092024-06-05T19:49:50.696Z+ retry=51
7102024-06-05T19:49:50.722Z+ zoneadm list
7112024-06-05T19:49:50.722Z+ grep nexus
7122024-06-05T19:49:50.722Z+ [[ 51 -gt 300 ]]
7132024-06-05T19:49:50.722Z+ sleep 1
7142024-06-05T19:49:51.708Z+ retry=52
7152024-06-05T19:49:51.733Z+ zoneadm list
7162024-06-05T19:49:51.733Z+ grep nexus
7172024-06-05T19:49:51.733Z+ [[ 52 -gt 300 ]]
7182024-06-05T19:49:51.733Z+ sleep 1
7192024-06-05T19:49:52.720Z+ retry=53
7202024-06-05T19:49:52.745Z+ zoneadm list
7212024-06-05T19:49:52.745Z+ grep nexus
7222024-06-05T19:49:52.745Z+ [[ 53 -gt 300 ]]
7232024-06-05T19:49:52.745Z+ sleep 1
7242024-06-05T19:49:53.731Z+ retry=54
7252024-06-05T19:49:53.756Z+ zoneadm list
7262024-06-05T19:49:53.756Z+ grep nexus
7272024-06-05T19:49:53.756Z+ [[ 54 -gt 300 ]]
7282024-06-05T19:49:53.756Z+ sleep 1
7292024-06-05T19:49:54.743Z+ retry=55
7302024-06-05T19:49:54.768Z+ zoneadm list
7312024-06-05T19:49:54.768Z+ grep nexus
7322024-06-05T19:49:54.768Z+ [[ 55 -gt 300 ]]
7332024-06-05T19:49:54.768Z+ sleep 1
7342024-06-05T19:49:55.754Z+ retry=56
7352024-06-05T19:49:55.779Z+ zoneadm list
7362024-06-05T19:49:55.779Z+ grep nexus
7372024-06-05T19:49:55.779Z+ [[ 56 -gt 300 ]]
7382024-06-05T19:49:55.779Z+ sleep 1
7392024-06-05T19:49:56.765Z+ retry=57
7402024-06-05T19:49:56.790Z+ zoneadm list
7412024-06-05T19:49:56.790Z+ grep nexus
7422024-06-05T19:49:56.791Z+ [[ 57 -gt 300 ]]
7432024-06-05T19:49:56.791Z+ sleep 1
7442024-06-05T19:49:57.778Z+ retry=58
7452024-06-05T19:49:57.803Z+ zoneadm list
7462024-06-05T19:49:57.804Z+ grep nexus
7472024-06-05T19:49:57.804Z+ [[ 58 -gt 300 ]]
7482024-06-05T19:49:57.804Z+ sleep 1
7492024-06-05T19:49:58.789Z+ retry=59
7502024-06-05T19:49:58.814Z+ zoneadm list
7512024-06-05T19:49:58.814Z+ grep nexus
7522024-06-05T19:49:58.814Z+ [[ 59 -gt 300 ]]
7532024-06-05T19:49:58.815Z+ sleep 1
7542024-06-05T19:49:59.801Z+ retry=60
7552024-06-05T19:49:59.827Z+ zoneadm list
7562024-06-05T19:49:59.827Z+ grep nexus
7572024-06-05T19:49:59.827Z+ [[ 60 -gt 300 ]]
7582024-06-05T19:49:59.827Z+ sleep 1
7592024-06-05T19:50:00.813Z+ retry=61
7602024-06-05T19:50:00.838Z+ zoneadm list
7612024-06-05T19:50:00.838Z+ grep nexus
7622024-06-05T19:50:00.838Z+ [[ 61 -gt 300 ]]
7632024-06-05T19:50:00.838Z+ sleep 1
7642024-06-05T19:50:01.824Z+ retry=62
7652024-06-05T19:50:01.862Z+ zoneadm list
7662024-06-05T19:50:01.862Z+ grep nexus
7672024-06-05T19:50:01.862Z+ [[ 62 -gt 300 ]]
7682024-06-05T19:50:01.862Z+ sleep 1
7692024-06-05T19:50:02.836Z+ retry=63
7702024-06-05T19:50:02.861Z+ zoneadm list
7712024-06-05T19:50:02.862Z+ grep nexus
7722024-06-05T19:50:02.862Z+ [[ 63 -gt 300 ]]
7732024-06-05T19:50:02.862Z+ sleep 1
7742024-06-05T19:50:03.847Z+ retry=64
7752024-06-05T19:50:03.873Z+ zoneadm list
7762024-06-05T19:50:03.873Z+ grep nexus
7772024-06-05T19:50:03.873Z+ [[ 64 -gt 300 ]]
7782024-06-05T19:50:03.873Z+ sleep 1
7792024-06-05T19:50:04.860Z+ retry=65
7802024-06-05T19:50:04.886Z+ zoneadm list
7812024-06-05T19:50:04.886Z+ grep nexus
7822024-06-05T19:50:04.886Z+ [[ 65 -gt 300 ]]
7832024-06-05T19:50:04.886Z+ sleep 1
7842024-06-05T19:50:05.874Z+ retry=66
7852024-06-05T19:50:05.899Z+ zoneadm list
7862024-06-05T19:50:05.899Z+ grep nexus
7872024-06-05T19:50:05.899Z+ [[ 66 -gt 300 ]]
7882024-06-05T19:50:05.899Z+ sleep 1
7892024-06-05T19:50:06.883Z+ retry=67
7902024-06-05T19:50:06.909Z+ zoneadm list
7912024-06-05T19:50:06.909Z+ grep nexus
7922024-06-05T19:50:06.909Z+ [[ 67 -gt 300 ]]
7932024-06-05T19:50:06.909Z+ sleep 1
7942024-06-05T19:50:07.895Z+ retry=68
7952024-06-05T19:50:07.920Z+ zoneadm list
7962024-06-05T19:50:07.920Z+ grep nexus
7972024-06-05T19:50:07.921Z+ [[ 68 -gt 300 ]]
7982024-06-05T19:50:07.921Z+ sleep 1
7992024-06-05T19:50:08.907Z+ retry=69
8002024-06-05T19:50:08.932Z+ zoneadm list
8012024-06-05T19:50:08.932Z+ grep nexus
8022024-06-05T19:50:08.932Z+ [[ 69 -gt 300 ]]
8032024-06-05T19:50:08.932Z+ sleep 1
8042024-06-05T19:50:09.919Z+ retry=70
8052024-06-05T19:50:09.944Z+ zoneadm list
8062024-06-05T19:50:09.944Z+ grep nexus
8072024-06-05T19:50:09.944Z+ [[ 70 -gt 300 ]]
8082024-06-05T19:50:09.944Z+ sleep 1
8092024-06-05T19:50:10.931Z+ retry=71
8102024-06-05T19:50:10.957Z+ zoneadm list
8112024-06-05T19:50:10.957Z+ grep nexus
8122024-06-05T19:50:10.957Z+ [[ 71 -gt 300 ]]
8132024-06-05T19:50:10.957Z+ sleep 1
8142024-06-05T19:50:11.945Z+ retry=72
8152024-06-05T19:50:11.971Z+ zoneadm list
8162024-06-05T19:50:11.971Z+ grep nexus
8172024-06-05T19:50:11.971Z+ [[ 72 -gt 300 ]]
8182024-06-05T19:50:11.971Z+ sleep 1
8192024-06-05T19:50:12.956Z+ retry=73
8202024-06-05T19:50:12.981Z+ zoneadm list
8212024-06-05T19:50:12.981Z+ grep nexus
8222024-06-05T19:50:12.981Z+ [[ 73 -gt 300 ]]
8232024-06-05T19:50:12.981Z+ sleep 1
8242024-06-05T19:50:13.967Z+ retry=74
8252024-06-05T19:50:13.993Z+ zoneadm list
8262024-06-05T19:50:13.993Z+ grep nexus
8272024-06-05T19:50:13.993Z+ [[ 74 -gt 300 ]]
8282024-06-05T19:50:13.993Z+ sleep 1
8292024-06-05T19:50:14.983Z+ retry=75
8302024-06-05T19:50:15.008Z+ zoneadm list
8312024-06-05T19:50:15.008Z+ grep nexus
8322024-06-05T19:50:15.008Z+ [[ 75 -gt 300 ]]
8332024-06-05T19:50:15.009Z+ sleep 1
8342024-06-05T19:50:15.993Z+ retry=76
8352024-06-05T19:50:16.018Z+ zoneadm list
8362024-06-05T19:50:16.018Z+ grep nexus
8372024-06-05T19:50:16.018Z+ [[ 76 -gt 300 ]]
8382024-06-05T19:50:16.018Z+ sleep 1
8392024-06-05T19:50:17.004Z+ retry=77
8402024-06-05T19:50:17.029Z+ zoneadm list
8412024-06-05T19:50:17.029Z+ grep nexus
8422024-06-05T19:50:17.029Z+ [[ 77 -gt 300 ]]
8432024-06-05T19:50:17.029Z+ sleep 1
8442024-06-05T19:50:18.016Z+ retry=78
8452024-06-05T19:50:18.041Z+ zoneadm list
8462024-06-05T19:50:18.042Z+ grep nexus
8472024-06-05T19:50:18.042Z+ [[ 78 -gt 300 ]]
8482024-06-05T19:50:18.042Z+ sleep 1
8492024-06-05T19:50:19.028Z+ retry=79
8502024-06-05T19:50:19.053Z+ zoneadm list
8512024-06-05T19:50:19.053Z+ grep nexus
8522024-06-05T19:50:19.053Z+ [[ 79 -gt 300 ]]
8532024-06-05T19:50:19.053Z+ sleep 1
8542024-06-05T19:50:20.040Z+ retry=80
8552024-06-05T19:50:20.065Z+ zoneadm list
8562024-06-05T19:50:20.065Z+ grep nexus
8572024-06-05T19:50:20.065Z+ [[ 80 -gt 300 ]]
8582024-06-05T19:50:20.065Z+ sleep 1
8592024-06-05T19:50:21.052Z+ retry=81
8602024-06-05T19:50:21.077Z+ zoneadm list
8612024-06-05T19:50:21.077Z+ grep nexus
8622024-06-05T19:50:21.077Z+ [[ 81 -gt 300 ]]
8632024-06-05T19:50:21.077Z+ sleep 1
8642024-06-05T19:50:22.066Z+ retry=82
8652024-06-05T19:50:22.091Z+ zoneadm list
8662024-06-05T19:50:22.091Z+ grep nexus
8672024-06-05T19:50:22.091Z+ [[ 82 -gt 300 ]]
8682024-06-05T19:50:22.091Z+ sleep 1
8692024-06-05T19:50:23.105Z+ retry=83
8702024-06-05T19:50:23.141Z+ zoneadm list
8712024-06-05T19:50:23.166Z+ grep nexus
8722024-06-05T19:50:23.166Z+ [[ 83 -gt 300 ]]
8732024-06-05T19:50:23.167Z+ sleep 1
8742024-06-05T19:50:24.155Z+ retry=84
8752024-06-05T19:50:24.182Z+ zoneadm list
8762024-06-05T19:50:24.182Z+ grep nexus
8772024-06-05T19:50:24.183Z+ [[ 84 -gt 300 ]]
8782024-06-05T19:50:24.183Z+ sleep 1
8792024-06-05T19:50:25.460Z+ retry=85
8802024-06-05T19:50:25.523Z+ zoneadm list
8812024-06-05T19:50:25.548Z+ grep nexus
8822024-06-05T19:50:25.573Z+ [[ 85 -gt 300 ]]
8832024-06-05T19:50:25.573Z+ sleep 1
8842024-06-05T19:50:26.907Z+ retry=86
8852024-06-05T19:50:26.941Z+ zoneadm list
8862024-06-05T19:50:26.941Z+ grep nexus
8872024-06-05T19:50:26.967Z+ [[ 86 -gt 300 ]]
8882024-06-05T19:50:26.967Z+ sleep 1
8892024-06-05T19:50:27.972Z+ retry=87
8902024-06-05T19:50:28.008Z+ zoneadm list
8912024-06-05T19:50:28.033Z+ grep nexus
8922024-06-05T19:50:28.057Z+ [[ 87 -gt 300 ]]
8932024-06-05T19:50:28.058Z+ sleep 1
8942024-06-05T19:50:29.120Z+ retry=88
8952024-06-05T19:50:29.145Z+ zoneadm list
8962024-06-05T19:50:29.145Z+ grep nexus
8972024-06-05T19:50:29.170Z+ [[ 88 -gt 300 ]]
8982024-06-05T19:50:29.170Z+ sleep 1
8992024-06-05T19:50:30.272Z+ retry=89
9002024-06-05T19:50:30.297Z+ zoneadm list
9012024-06-05T19:50:30.297Z+ grep nexus
9022024-06-05T19:50:30.297Z+ [[ 89 -gt 300 ]]
9032024-06-05T19:50:30.298Z+ sleep 1
9042024-06-05T19:50:31.303Z+ retry=90
9052024-06-05T19:50:31.328Z+ zoneadm list
9062024-06-05T19:50:31.328Z+ grep nexus
9072024-06-05T19:50:31.328Z+ [[ 90 -gt 300 ]]
9082024-06-05T19:50:31.329Z+ sleep 1
9092024-06-05T19:50:32.331Z+ retry=91
9102024-06-05T19:50:32.356Z+ zoneadm list
9112024-06-05T19:50:32.356Z+ grep nexus
9122024-06-05T19:50:32.356Z+ [[ 91 -gt 300 ]]
9132024-06-05T19:50:32.356Z+ sleep 1
9142024-06-05T19:50:33.426Z+ retry=92
9152024-06-05T19:50:33.426Z+ zoneadm list
9162024-06-05T19:50:33.599Z+ grep nexus
9172024-06-05T19:50:33.599Zoxz_nexus_73e067cf-cfe8-480d-9d5d-fff7aeec0599
9182024-06-05T19:50:33.599Zoxz_nexus_50145656-8d32-471a-8a33-3c47dc24d267
9192024-06-05T19:50:33.599Zoxz_nexus_35af6b86-fd74-4104-b900-7a3edf8d03dc
9202024-06-05T19:50:33.599Z+ echo 'Waited for nexus: 92s'
9212024-06-05T19:50:33.599Z+ export RUST_BACKTRACE=1
9222024-06-05T19:50:33.599Z+ RUST_BACKTRACE=1
9232024-06-05T19:50:33.599Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
9242024-06-05T19:50:33.599ZWaited for nexus: 92s
9252024-06-05T19:50:33.600Z++ ./target/debug/bootstrap
9262024-06-05T19:50:36.283ZUsing external DNS server at 10.151.1.164:53
9272024-06-05T19:50:36.344Z2024-06-05 19:50:36.326966082 UTC: attempting to log into API
9282024-06-05T19:50:51.387Z2024-06-05 19:50:51.380383206 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9292024-06-05T19:50:52.389Z2024-06-05 19:50:52.382543174 UTC: attempting to log into API
 
9302024-06-05T19:50:57.278ZJun 5 19:50:56 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
9312024-06-05T19:50:58.756ZJun 5 19:50:58 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
9322024-06-05T19:50:59.663ZJun 5 19:50:58 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
9332024-06-05T19:50:59.697ZJun 5 19:50:58 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
9342024-06-05T19:50:59.731ZJun 5 19:50:59 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
9352024-06-05T19:51:07.439Z2024-06-05 19:51:07.432066893 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9362024-06-05T19:51:08.440Z2024-06-05 19:51:08.433143196 UTC: attempting to log into API
9372024-06-05T19:51:14.204Z2024-06-05 19:51:14.196241638 UTC: login succeeded
9382024-06-05T19:51:14.237Zwaiting for nexus to come up...
9392024-06-05T19:51:14.309Zcreating IP pool... 10.151.1.175 - 10.151.1.227
9402024-06-05T19:51:14.462Zsetting up quotas...
9412024-06-05T19:51:14.505Zensuring datasets are ready...
9422024-06-05T19:51:16.867Zlet's roll.
9432024-06-05T19:51:16.891Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
9442024-06-05T19:51:16.891ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9452024-06-05T19:51:16.891ZOXIDE_TOKEN=oxide-token-5e203c555c42a6eafbb8fe5fbdd386a62a6da7e7'
9462024-06-05T19:51:16.891Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9472024-06-05T19:51:16.891Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9482024-06-05T19:51:16.891Z++ OXIDE_TOKEN=oxide-token-5e203c555c42a6eafbb8fe5fbdd386a62a6da7e7
9492024-06-05T19:51:16.892Z+ export OXIDE_HOST OXIDE_TOKEN
9502024-06-05T19:51:16.892Z+ retry=0
9512024-06-05T19:51:16.892Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9522024-06-05T19:51:16.959Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9532024-06-05T19:51:17.370Z{"status":"ok"}success
9542024-06-05T19:51:17.370ZProject {
9552024-06-05T19:51:17.370Z description: "some images",
9562024-06-05T19:51:17.370Z id: 2c5b89e2-8cb9-448d-9b0b-02ab0aa3e187,
9572024-06-05T19:51:17.370Z name: Name(
9582024-06-05T19:51:17.370Z "images",
9592024-06-05T19:51:17.370Z ),
9602024-06-05T19:51:17.395Z time_created: 2024-06-05T19:51:17.043526Z,
9612024-06-05T19:51:17.395Z time_modified: 2024-06-05T19:51:17.043526Z,
9622024-06-05T19:51:17.395Z}
9632024-06-05T19:51:17.395Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
9642024-06-05T19:56:40.839Zdone!
9652024-06-05T19:56:40.944Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9662024-06-05T19:56:41.053Zsuccess
9672024-06-05T19:56:41.053ZImage {
9682024-06-05T19:56:41.053Z block_size: ByteCount(
9692024-06-05T19:56:41.054Z 512,
9702024-06-05T19:56:41.054Z ),
9712024-06-05T19:56:41.078Z description: "debian 11 original base image",
9722024-06-05T19:56:41.079Z digest: None,
9732024-06-05T19:56:41.079Z id: fdf8416d-e29e-4bcd-b03e-4352e2175e00,
9742024-06-05T19:56:41.079Z name: Name(
9752024-06-05T19:56:41.079Z "debian11",
9762024-06-05T19:56:41.079Z ),
9772024-06-05T19:56:41.079Z os: "debian",
9782024-06-05T19:56:41.079Z project_id: None,
9792024-06-05T19:56:41.079Z size: ByteCount(
9802024-06-05T19:56:41.079Z 2147483648,
9812024-06-05T19:56:41.079Z ),
9822024-06-05T19:56:41.079Z time_created: 2024-06-05T19:56:40.785629Z,
9832024-06-05T19:56:41.079Z time_modified: 2024-06-05T19:56:41.038372Z,
9842024-06-05T19:56:41.079Z url: None,
9852024-06-05T19:56:41.079Z version: "11",
9862024-06-05T19:56:41.079Z}
9872024-06-05T19:56:41.079Z+ for test_bin in tests/*
9882024-06-05T19:56:41.079Z+ ./tests/bootstrap-f9f03874decddf45
9892024-06-05T19:56:41.104Z
9902024-06-05T19:56:41.104Zrunning 0 tests
9912024-06-05T19:56:41.104Z
9922024-06-05T19:56:41.104Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9932024-06-05T19:56:41.104Z
9942024-06-05T19:56:41.104Z+ for test_bin in tests/*
9952024-06-05T19:56:41.104Z+ ./tests/commtest-3a6ffb54f41f3cf2
9962024-06-05T19:56:41.132Z
9972024-06-05T19:56:41.132Zrunning 0 tests
9982024-06-05T19:56:41.132Z
9992024-06-05T19:56:41.157Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10002024-06-05T19:56:41.157Z
10012024-06-05T19:56:41.157Z+ for test_bin in tests/*
10022024-06-05T19:56:41.157Z+ ./tests/dhcp_server-464cb48f2c4503d8
10032024-06-05T19:56:41.182Z
10042024-06-05T19:56:41.182Zrunning 0 tests
10052024-06-05T19:56:41.182Z
10062024-06-05T19:56:41.182Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10072024-06-05T19:56:41.182Z
10082024-06-05T19:56:41.182Z+ for test_bin in tests/*
10092024-06-05T19:56:41.182Z+ ./tests/end_to_end_tests-0b0a517b73fe1ae3
10102024-06-05T19:56:41.522Z
10112024-06-05T19:56:41.522Zrunning 2 tests
10122024-06-05T19:56:41.842Ztest no_spoof::no_spoof_here ... ok
10132024-06-05T19:57:09.115Ztest instance_launch::instance_launch ... ok
10142024-06-05T19:57:09.115Z
10152024-06-05T19:57:09.139Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 27.59s
10162024-06-05T19:57:09.139Z
10172024-06-05T19:57:09.140Z+ _exit_trap
10182024-06-05T19:57:09.140Z+ local status=0
10192024-06-05T19:57:09.140Z+ [[ 0 -eq 0 ]]
10202024-06-05T19:57:09.140Z+ exit 0
10212024-06-05T19:57:09.140Zprocess exited: duration 576327 ms, exit code 0
 
10222024-06-05T19:57:09.253Zfound 106 output files
10232024-06-05T19:57:09.349Zuploading: /var/svc/log/oxide-sled-agent:default.log (1290021 bytes)
10242024-06-05T19:57:11.089Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10252024-06-05T19:57:11.089Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (3592871 bytes)
10262024-06-05T19:57:12.725Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 3592871 -> 3614690
10272024-06-05T19:57:13.796Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
10282024-06-05T19:57:13.796Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52296 bytes)
10292024-06-05T19:57:14.980Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
10302024-06-05T19:57:14.980Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (145247 bytes)
10312024-06-05T19:57:15.186Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 145247 -> 147590
10322024-06-05T19:57:16.256Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
10332024-06-05T19:57:16.256Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (212384 bytes)
10342024-06-05T19:57:16.483Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 212384 -> 215505
10352024-06-05T19:57:17.553Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
10362024-06-05T19:57:17.577Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1305544 bytes)
10372024-06-05T19:57:18.271Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1305544 -> 1329590
10382024-06-05T19:57:19.342Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
10392024-06-05T19:57:19.342Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (694427 bytes)
10402024-06-05T19:57:20.155Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 694427 -> 713693
10412024-06-05T19:57:21.226Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10422024-06-05T19:57:21.226Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1678 bytes)
10432024-06-05T19:57:22.321Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10442024-06-05T19:57:22.321Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (248092 bytes)
10452024-06-05T19:57:22.534Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 248092 -> 254656
10462024-06-05T19:57:23.626Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10472024-06-05T19:57:23.626Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (7773 bytes)
10482024-06-05T19:57:24.778Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10492024-06-05T19:57:24.807Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5759 bytes)
10502024-06-05T19:57:25.876Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10512024-06-05T19:57:25.876Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_cockroachdb_b46b9748-75d3-4248-95bb-b19942b724b7/root/var/svc/log/oxide-cockroach-admin:default.log (1678 bytes)
10522024-06-05T19:57:26.975Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_cockroachdb_b46b9748-75d3-4248-95bb-b19942b724b7/root/var/svc/log/oxide-cockroach-admin:default.log
10532024-06-05T19:57:26.975Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_cockroachdb_b46b9748-75d3-4248-95bb-b19942b724b7/root/var/svc/log/oxide-cockroachdb:default.log (4289 bytes)
10542024-06-05T19:57:28.076Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_cockroachdb_b46b9748-75d3-4248-95bb-b19942b724b7/root/var/svc/log/oxide-cockroachdb:default.log
10552024-06-05T19:57:28.076Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_cockroachdb_b46b9748-75d3-4248-95bb-b19942b724b7/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
10562024-06-05T19:57:29.172Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_cockroachdb_b46b9748-75d3-4248-95bb-b19942b724b7/root/var/svc/log/oxide-zone-network-setup:default.log
10572024-06-05T19:57:29.196Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_524c932e-94cf-424b-b974-cd7c6d21eda9/root/var/svc/log/oxide-crucible-agent:default.log (8484 bytes)
10582024-06-05T19:57:30.297Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_524c932e-94cf-424b-b974-cd7c6d21eda9/root/var/svc/log/oxide-crucible-agent:default.log
10592024-06-05T19:57:30.332Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_524c932e-94cf-424b-b974-cd7c6d21eda9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10602024-06-05T19:57:31.830Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_524c932e-94cf-424b-b974-cd7c6d21eda9/root/var/svc/log/oxide-crucible-downstairs:default.log
10612024-06-05T19:57:31.831Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_524c932e-94cf-424b-b974-cd7c6d21eda9/root/var/svc/log/oxide-crucible-downstairs:downstairs-b634abad-1c22-441b-a596-840e7ceb5434.log (3019 bytes)
10622024-06-05T19:57:32.932Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_524c932e-94cf-424b-b974-cd7c6d21eda9/root/var/svc/log/oxide-crucible-downstairs:downstairs-b634abad-1c22-441b-a596-840e7ceb5434.log
10632024-06-05T19:57:32.932Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_524c932e-94cf-424b-b974-cd7c6d21eda9/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
10642024-06-05T19:57:34.027Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_524c932e-94cf-424b-b974-cd7c6d21eda9/root/var/svc/log/oxide-zone-network-setup:default.log
10652024-06-05T19:57:34.027Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_pantry_2e05c51a-6602-4ef4-bc51-8d51552f353c/root/var/svc/log/oxide-crucible-pantry:default.log (779 bytes)
10662024-06-05T19:57:35.121Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_pantry_2e05c51a-6602-4ef4-bc51-8d51552f353c/root/var/svc/log/oxide-crucible-pantry:default.log
10672024-06-05T19:57:35.121Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_pantry_2e05c51a-6602-4ef4-bc51-8d51552f353c/root/var/svc/log/oxide-zone-network-setup:default.log (1722 bytes)
10682024-06-05T19:57:36.216Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_crucible_pantry_2e05c51a-6602-4ef4-bc51-8d51552f353c/root/var/svc/log/oxide-zone-network-setup:default.log
10692024-06-05T19:57:36.216Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/svc/log/oxide-chrony-setup:default.log (14141 bytes)
10702024-06-05T19:57:37.342Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/svc/log/oxide-chrony-setup:default.log
10712024-06-05T19:57:37.342Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/svc/log/oxide-ntp:default.log (1062 bytes)
10722024-06-05T19:57:38.440Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/svc/log/oxide-ntp:default.log
10732024-06-05T19:57:38.440Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/svc/log/oxide-opte-interface-setup:default.log (1129 bytes)
10742024-06-05T19:57:39.543Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/svc/log/oxide-opte-interface-setup:default.log
10752024-06-05T19:57:39.574Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/svc/log/oxide-zone-network-setup:default.log (1644 bytes)
10762024-06-05T19:57:40.660Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/svc/log/oxide-zone-network-setup:default.log
10772024-06-05T19:57:40.661Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_cockroachdb_f6c2c6c4-927e-496d-873b-0e47ead3c40a/root/var/svc/log/oxide-cockroach-admin:default.log (1678 bytes)
10782024-06-05T19:57:41.776Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_cockroachdb_f6c2c6c4-927e-496d-873b-0e47ead3c40a/root/var/svc/log/oxide-cockroach-admin:default.log
10792024-06-05T19:57:41.777Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_cockroachdb_f6c2c6c4-927e-496d-873b-0e47ead3c40a/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
10802024-06-05T19:57:42.886Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_cockroachdb_f6c2c6c4-927e-496d-873b-0e47ead3c40a/root/var/svc/log/oxide-cockroachdb:default.log
10812024-06-05T19:57:42.886Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_cockroachdb_f6c2c6c4-927e-496d-873b-0e47ead3c40a/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
10822024-06-05T19:57:43.982Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_cockroachdb_f6c2c6c4-927e-496d-873b-0e47ead3c40a/root/var/svc/log/oxide-zone-network-setup:default.log
10832024-06-05T19:57:43.982Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-agent:default.log (26761 bytes)
10842024-06-05T19:57:45.121Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-agent:default.log
10852024-06-05T19:57:45.145Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10862024-06-05T19:57:46.215Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-downstairs:default.log
10872024-06-05T19:57:46.215Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-downstairs:downstairs-3853a095-ac3c-4263-9c3b-e7dc35a51a4d.log (5611 bytes)
10882024-06-05T19:57:47.313Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-downstairs:downstairs-3853a095-ac3c-4263-9c3b-e7dc35a51a4d.log
10892024-06-05T19:57:47.338Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-downstairs:downstairs-bf70363e-8c4f-45e9-a0a6-1e80f2627bf4.log (5698 bytes)
10902024-06-05T19:57:48.420Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-downstairs:downstairs-bf70363e-8c4f-45e9-a0a6-1e80f2627bf4.log
10912024-06-05T19:57:48.420Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-downstairs:snapshot-bf70363e-8c4f-45e9-a0a6-1e80f2627bf4-2758d653-a18c-46dd-89b5-047a8476dd7a.log (5305 bytes)
10922024-06-05T19:57:49.551Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-crucible-downstairs:snapshot-bf70363e-8c4f-45e9-a0a6-1e80f2627bf4-2758d653-a18c-46dd-89b5-047a8476dd7a.log
10932024-06-05T19:57:49.552Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
10942024-06-05T19:57:50.667Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_crucible_cfb2e53c-9d55-4204-bc22-ea2aa48b7c80/root/var/svc/log/oxide-zone-network-setup:default.log
10952024-06-05T19:57:50.667Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_internal_dns_6d2b94d3-980a-43a1-8e8f-0973dee40a75/root/var/svc/log/oxide-internal_dns:default.log (109910 bytes)
10962024-06-05T19:57:52.331Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_internal_dns_6d2b94d3-980a-43a1-8e8f-0973dee40a75/root/var/svc/log/oxide-internal_dns:default.log
10972024-06-05T19:57:52.331Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_internal_dns_6d2b94d3-980a-43a1-8e8f-0973dee40a75/root/var/svc/log/oxide-zone-network-setup:default.log (1686 bytes)
10982024-06-05T19:57:53.440Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_internal_dns_6d2b94d3-980a-43a1-8e8f-0973dee40a75/root/var/svc/log/oxide-zone-network-setup:default.log
10992024-06-05T19:57:53.440Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_nexus_50145656-8d32-471a-8a33-3c47dc24d267/root/var/svc/log/oxide-nexus:default.log (1950151 bytes)
11002024-06-05T19:57:54.180Zupload warning: file "/pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_nexus_50145656-8d32-471a-8a33-3c47dc24d267/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1950151 -> 2046977
11012024-06-05T19:57:55.251Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_nexus_50145656-8d32-471a-8a33-3c47dc24d267/root/var/svc/log/oxide-nexus:default.log
11022024-06-05T19:57:55.251Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_nexus_50145656-8d32-471a-8a33-3c47dc24d267/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
11032024-06-05T19:57:56.358Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_nexus_50145656-8d32-471a-8a33-3c47dc24d267/root/var/svc/log/oxide-opte-interface-setup:default.log
11042024-06-05T19:57:56.358Zuploading: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_nexus_50145656-8d32-471a-8a33-3c47dc24d267/root/var/svc/log/oxide-zone-network-setup:default.log (1663 bytes)
11052024-06-05T19:57:57.468Zuploaded: /pool/ext/8e7826e7-938b-4b78-bd9b-c82573a27350/crypt/zone/oxz_nexus_50145656-8d32-471a-8a33-3c47dc24d267/root/var/svc/log/oxide-zone-network-setup:default.log
11062024-06-05T19:57:57.492Zuploading: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_cockroachdb_be258c33-8299-48b4-94e9-f6c15d8dd8a3/root/var/svc/log/oxide-cockroach-admin:default.log (1679 bytes)
11072024-06-05T19:57:58.980Zuploaded: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_cockroachdb_be258c33-8299-48b4-94e9-f6c15d8dd8a3/root/var/svc/log/oxide-cockroach-admin:default.log
11082024-06-05T19:57:58.980Zuploading: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_cockroachdb_be258c33-8299-48b4-94e9-f6c15d8dd8a3/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
11092024-06-05T19:58:00.091Zuploaded: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_cockroachdb_be258c33-8299-48b4-94e9-f6c15d8dd8a3/root/var/svc/log/oxide-cockroachdb:default.log
11102024-06-05T19:58:00.091Zuploading: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_cockroachdb_be258c33-8299-48b4-94e9-f6c15d8dd8a3/root/var/svc/log/oxide-zone-network-setup:default.log (1689 bytes)
11112024-06-05T19:58:01.601Zuploaded: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_cockroachdb_be258c33-8299-48b4-94e9-f6c15d8dd8a3/root/var/svc/log/oxide-zone-network-setup:default.log
11122024-06-05T19:58:01.601Zuploading: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_4ac7506c-90ad-45f4-a164-7c6617f8d09a/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
11132024-06-05T19:58:02.304Zuploaded: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_4ac7506c-90ad-45f4-a164-7c6617f8d09a/root/var/svc/log/oxide-crucible-agent:default.log
11142024-06-05T19:58:02.305Zuploading: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_4ac7506c-90ad-45f4-a164-7c6617f8d09a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11152024-06-05T19:58:03.411Zuploaded: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_4ac7506c-90ad-45f4-a164-7c6617f8d09a/root/var/svc/log/oxide-crucible-downstairs:default.log
11162024-06-05T19:58:03.411Zuploading: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_4ac7506c-90ad-45f4-a164-7c6617f8d09a/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
11172024-06-05T19:58:04.521Zuploaded: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_4ac7506c-90ad-45f4-a164-7c6617f8d09a/root/var/svc/log/oxide-zone-network-setup:default.log
11182024-06-05T19:58:04.521Zuploading: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_pantry_5f758d69-a06e-4648-b5fe-686e96c65857/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
11192024-06-05T19:58:05.616Zuploaded: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_pantry_5f758d69-a06e-4648-b5fe-686e96c65857/root/var/svc/log/oxide-crucible-pantry:default.log
11202024-06-05T19:58:05.645Zuploading: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_pantry_5f758d69-a06e-4648-b5fe-686e96c65857/root/var/svc/log/oxide-zone-network-setup:default.log (1724 bytes)
11212024-06-05T19:58:06.742Zuploaded: /pool/ext/906c0a61-9cfc-4b51-be6b-6990f707b063/crypt/zone/oxz_crucible_pantry_5f758d69-a06e-4648-b5fe-686e96c65857/root/var/svc/log/oxide-zone-network-setup:default.log
11222024-06-05T19:58:06.742Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_clickhouse_d2ace9c3-4702-4590-a5f2-70e552e5ff4e/root/var/svc/log/oxide-clickhouse:default.log (1812502 bytes)
11232024-06-05T19:58:08.966Zupload warning: file "/pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_clickhouse_d2ace9c3-4702-4590-a5f2-70e552e5ff4e/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1812502 -> 2104235
11242024-06-05T19:58:10.042Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_clickhouse_d2ace9c3-4702-4590-a5f2-70e552e5ff4e/root/var/svc/log/oxide-clickhouse:default.log
11252024-06-05T19:58:10.042Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_clickhouse_d2ace9c3-4702-4590-a5f2-70e552e5ff4e/root/var/svc/log/oxide-zone-network-setup:default.log (1693 bytes)
11262024-06-05T19:58:11.153Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_clickhouse_d2ace9c3-4702-4590-a5f2-70e552e5ff4e/root/var/svc/log/oxide-zone-network-setup:default.log
11272024-06-05T19:58:11.153Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_cockroachdb_bb4b3cdb-0d2e-44b8-994b-0908726ddaeb/root/var/svc/log/oxide-cockroach-admin:default.log (1679 bytes)
11282024-06-05T19:58:12.256Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_cockroachdb_bb4b3cdb-0d2e-44b8-994b-0908726ddaeb/root/var/svc/log/oxide-cockroach-admin:default.log
11292024-06-05T19:58:12.256Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_cockroachdb_bb4b3cdb-0d2e-44b8-994b-0908726ddaeb/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
11302024-06-05T19:58:13.366Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_cockroachdb_bb4b3cdb-0d2e-44b8-994b-0908726ddaeb/root/var/svc/log/oxide-cockroachdb:default.log
11312024-06-05T19:58:13.366Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_cockroachdb_bb4b3cdb-0d2e-44b8-994b-0908726ddaeb/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
11322024-06-05T19:58:14.909Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_cockroachdb_bb4b3cdb-0d2e-44b8-994b-0908726ddaeb/root/var/svc/log/oxide-zone-network-setup:default.log
11332024-06-05T19:58:14.909Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_crucible_faeb0dce-f737-4f16-9e7f-1e9a288f9712/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
11342024-06-05T19:58:16.006Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_crucible_faeb0dce-f737-4f16-9e7f-1e9a288f9712/root/var/svc/log/oxide-crucible-agent:default.log
11352024-06-05T19:58:16.006Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_crucible_faeb0dce-f737-4f16-9e7f-1e9a288f9712/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11362024-06-05T19:58:17.122Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_crucible_faeb0dce-f737-4f16-9e7f-1e9a288f9712/root/var/svc/log/oxide-crucible-downstairs:default.log
11372024-06-05T19:58:17.122Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_crucible_faeb0dce-f737-4f16-9e7f-1e9a288f9712/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
11382024-06-05T19:58:18.230Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_crucible_faeb0dce-f737-4f16-9e7f-1e9a288f9712/root/var/svc/log/oxide-zone-network-setup:default.log
11392024-06-05T19:58:18.231Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_external_dns_4ab1258a-9fc9-4e50-a387-e0cecec3f175/root/var/svc/log/oxide-external_dns:default.log (26868 bytes)
11402024-06-05T19:58:18.389Zupload warning: file "/pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_external_dns_4ab1258a-9fc9-4e50-a387-e0cecec3f175/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26868 -> 30645
11412024-06-05T19:58:19.459Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_external_dns_4ab1258a-9fc9-4e50-a387-e0cecec3f175/root/var/svc/log/oxide-external_dns:default.log
11422024-06-05T19:58:19.459Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_external_dns_4ab1258a-9fc9-4e50-a387-e0cecec3f175/root/var/svc/log/oxide-opte-interface-setup:default.log (1159 bytes)
11432024-06-05T19:58:20.566Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_external_dns_4ab1258a-9fc9-4e50-a387-e0cecec3f175/root/var/svc/log/oxide-opte-interface-setup:default.log
11442024-06-05T19:58:20.566Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_external_dns_4ab1258a-9fc9-4e50-a387-e0cecec3f175/root/var/svc/log/oxide-zone-network-setup:default.log (1705 bytes)
11452024-06-05T19:58:21.665Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_external_dns_4ab1258a-9fc9-4e50-a387-e0cecec3f175/root/var/svc/log/oxide-zone-network-setup:default.log
11462024-06-05T19:58:21.665Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_internal_dns_05f414eb-1b07-4b76-9d7c-27a7db52ad4b/root/var/svc/log/oxide-internal_dns:default.log (107356 bytes)
11472024-06-05T19:58:22.015Zupload warning: file "/pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_internal_dns_05f414eb-1b07-4b76-9d7c-27a7db52ad4b/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107356 -> 111112
11482024-06-05T19:58:23.125Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_internal_dns_05f414eb-1b07-4b76-9d7c-27a7db52ad4b/root/var/svc/log/oxide-internal_dns:default.log
11492024-06-05T19:58:23.125Zuploading: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_internal_dns_05f414eb-1b07-4b76-9d7c-27a7db52ad4b/root/var/svc/log/oxide-zone-network-setup:default.log (1687 bytes)
11502024-06-05T19:58:24.195Zuploaded: /pool/ext/906c9449-467f-496f-ae4c-f2197a847844/crypt/zone/oxz_internal_dns_05f414eb-1b07-4b76-9d7c-27a7db52ad4b/root/var/svc/log/oxide-zone-network-setup:default.log
11512024-06-05T19:58:24.195Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-agent:default.log (32987 bytes)
11522024-06-05T19:58:25.404Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-agent:default.log
11532024-06-05T19:58:25.404Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11542024-06-05T19:58:26.498Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:default.log
11552024-06-05T19:58:26.498Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:downstairs-8f864039-4da8-44c6-a9a9-0207b29613f7.log (5695 bytes)
11562024-06-05T19:58:27.616Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:downstairs-8f864039-4da8-44c6-a9a9-0207b29613f7.log
11572024-06-05T19:58:27.616Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:downstairs-92282b53-d738-4b57-9ff8-943cce88ee7e.log (3015 bytes)
11582024-06-05T19:58:29.124Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:downstairs-92282b53-d738-4b57-9ff8-943cce88ee7e.log
11592024-06-05T19:58:29.124Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:downstairs-ddb9438a-3da6-4601-807d-70ef9d667e20.log (3125 bytes)
11602024-06-05T19:58:30.229Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:downstairs-ddb9438a-3da6-4601-807d-70ef9d667e20.log
11612024-06-05T19:58:30.229Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:snapshot-8f864039-4da8-44c6-a9a9-0207b29613f7-2758d653-a18c-46dd-89b5-047a8476dd7a.log (5301 bytes)
11622024-06-05T19:58:31.327Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-crucible-downstairs:snapshot-8f864039-4da8-44c6-a9a9-0207b29613f7-2758d653-a18c-46dd-89b5-047a8476dd7a.log
11632024-06-05T19:58:31.327Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11642024-06-05T19:58:32.433Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_crucible_3d9237cb-2717-48f0-8bd3-23d4bf504717/root/var/svc/log/oxide-zone-network-setup:default.log
11652024-06-05T19:58:32.433Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_nexus_73e067cf-cfe8-480d-9d5d-fff7aeec0599/root/var/svc/log/oxide-nexus:default.log (2207972 bytes)
11662024-06-05T19:58:35.418Zupload warning: file "/pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_nexus_73e067cf-cfe8-480d-9d5d-fff7aeec0599/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2207972 -> 2546434
11672024-06-05T19:58:36.488Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_nexus_73e067cf-cfe8-480d-9d5d-fff7aeec0599/root/var/svc/log/oxide-nexus:default.log
11682024-06-05T19:58:36.512Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_nexus_73e067cf-cfe8-480d-9d5d-fff7aeec0599/root/var/svc/log/oxide-opte-interface-setup:default.log (1137 bytes)
11692024-06-05T19:58:37.595Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_nexus_73e067cf-cfe8-480d-9d5d-fff7aeec0599/root/var/svc/log/oxide-opte-interface-setup:default.log
11702024-06-05T19:58:37.595Zuploading: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_nexus_73e067cf-cfe8-480d-9d5d-fff7aeec0599/root/var/svc/log/oxide-zone-network-setup:default.log (1662 bytes)
11712024-06-05T19:58:38.689Zuploaded: /pool/ext/9fef4b9e-a443-49fc-b47e-d8cdc87127ad/crypt/zone/oxz_nexus_73e067cf-cfe8-480d-9d5d-fff7aeec0599/root/var/svc/log/oxide-zone-network-setup:default.log
11722024-06-05T19:58:38.689Zuploading: /pool/ext/c495d42b-321e-4420-8635-102c37b30fb2/crypt/zone/oxz_crucible_6ff0fc90-2090-4f92-b269-bbfcff3f2db6/root/var/svc/log/oxide-crucible-agent:default.log (8486 bytes)
11732024-06-05T19:58:39.805Zuploaded: /pool/ext/c495d42b-321e-4420-8635-102c37b30fb2/crypt/zone/oxz_crucible_6ff0fc90-2090-4f92-b269-bbfcff3f2db6/root/var/svc/log/oxide-crucible-agent:default.log
11742024-06-05T19:58:39.805Zuploading: /pool/ext/c495d42b-321e-4420-8635-102c37b30fb2/crypt/zone/oxz_crucible_6ff0fc90-2090-4f92-b269-bbfcff3f2db6/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11752024-06-05T19:58:40.899Zuploaded: /pool/ext/c495d42b-321e-4420-8635-102c37b30fb2/crypt/zone/oxz_crucible_6ff0fc90-2090-4f92-b269-bbfcff3f2db6/root/var/svc/log/oxide-crucible-downstairs:default.log
11762024-06-05T19:58:40.899Zuploading: /pool/ext/c495d42b-321e-4420-8635-102c37b30fb2/crypt/zone/oxz_crucible_6ff0fc90-2090-4f92-b269-bbfcff3f2db6/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d676f3f-1aad-4ef0-ba52-d725ab892b22.log (3019 bytes)
11772024-06-05T19:58:41.994Zuploaded: /pool/ext/c495d42b-321e-4420-8635-102c37b30fb2/crypt/zone/oxz_crucible_6ff0fc90-2090-4f92-b269-bbfcff3f2db6/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d676f3f-1aad-4ef0-ba52-d725ab892b22.log
11782024-06-05T19:58:41.994Zuploading: /pool/ext/c495d42b-321e-4420-8635-102c37b30fb2/crypt/zone/oxz_crucible_6ff0fc90-2090-4f92-b269-bbfcff3f2db6/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11792024-06-05T19:58:43.113Zuploaded: /pool/ext/c495d42b-321e-4420-8635-102c37b30fb2/crypt/zone/oxz_crucible_6ff0fc90-2090-4f92-b269-bbfcff3f2db6/root/var/svc/log/oxide-zone-network-setup:default.log
11802024-06-05T19:58:43.113Zuploading: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_3a330eff-2e60-4b6c-95a2-192e89df3181/root/var/svc/log/oxide-crucible-agent:default.log (12503 bytes)
11812024-06-05T19:58:44.208Zuploaded: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_3a330eff-2e60-4b6c-95a2-192e89df3181/root/var/svc/log/oxide-crucible-agent:default.log
11822024-06-05T19:58:44.208Zuploading: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_3a330eff-2e60-4b6c-95a2-192e89df3181/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11832024-06-05T19:58:45.313Zuploaded: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_3a330eff-2e60-4b6c-95a2-192e89df3181/root/var/svc/log/oxide-crucible-downstairs:default.log
11842024-06-05T19:58:45.313Zuploading: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_3a330eff-2e60-4b6c-95a2-192e89df3181/root/var/svc/log/oxide-crucible-downstairs:downstairs-e398592a-d816-4a75-ac99-63cfea624042.log (5613 bytes)
11852024-06-05T19:58:46.841Zuploaded: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_3a330eff-2e60-4b6c-95a2-192e89df3181/root/var/svc/log/oxide-crucible-downstairs:downstairs-e398592a-d816-4a75-ac99-63cfea624042.log
11862024-06-05T19:58:46.841Zuploading: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_3a330eff-2e60-4b6c-95a2-192e89df3181/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11872024-06-05T19:58:47.945Zuploaded: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_3a330eff-2e60-4b6c-95a2-192e89df3181/root/var/svc/log/oxide-zone-network-setup:default.log
11882024-06-05T19:58:47.945Zuploading: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_pantry_0e996ca7-157f-4df1-ab30-04eac3863eb1/root/var/svc/log/oxide-crucible-pantry:default.log (766019 bytes)
11892024-06-05T19:58:50.416Zuploaded: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_pantry_0e996ca7-157f-4df1-ab30-04eac3863eb1/root/var/svc/log/oxide-crucible-pantry:default.log
11902024-06-05T19:58:50.416Zuploading: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_pantry_0e996ca7-157f-4df1-ab30-04eac3863eb1/root/var/svc/log/oxide-zone-network-setup:default.log (1724 bytes)
11912024-06-05T19:58:51.536Zuploaded: /pool/ext/ca57da68-282d-4e81-9a3e-bfb822551ad8/crypt/zone/oxz_crucible_pantry_0e996ca7-157f-4df1-ab30-04eac3863eb1/root/var/svc/log/oxide-zone-network-setup:default.log
11922024-06-05T19:58:51.536Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_cockroachdb_d6f58b5e-cabb-496a-9b02-c2e904c1eb7e/root/var/svc/log/oxide-cockroach-admin:default.log (1678 bytes)
11932024-06-05T19:58:52.708Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_cockroachdb_d6f58b5e-cabb-496a-9b02-c2e904c1eb7e/root/var/svc/log/oxide-cockroach-admin:default.log
11942024-06-05T19:58:52.745Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_cockroachdb_d6f58b5e-cabb-496a-9b02-c2e904c1eb7e/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
11952024-06-05T19:58:53.824Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_cockroachdb_d6f58b5e-cabb-496a-9b02-c2e904c1eb7e/root/var/svc/log/oxide-cockroachdb:default.log
11962024-06-05T19:58:53.824Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_cockroachdb_d6f58b5e-cabb-496a-9b02-c2e904c1eb7e/root/var/svc/log/oxide-zone-network-setup:default.log (1689 bytes)
11972024-06-05T19:58:54.918Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_cockroachdb_d6f58b5e-cabb-496a-9b02-c2e904c1eb7e/root/var/svc/log/oxide-zone-network-setup:default.log
11982024-06-05T19:58:54.918Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_crucible_c2bf92da-7b65-405c-8e55-ebbcd5c7fed9/root/var/svc/log/oxide-crucible-agent:default.log (12076 bytes)
11992024-06-05T19:58:56.036Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_crucible_c2bf92da-7b65-405c-8e55-ebbcd5c7fed9/root/var/svc/log/oxide-crucible-agent:default.log
12002024-06-05T19:58:56.036Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_crucible_c2bf92da-7b65-405c-8e55-ebbcd5c7fed9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12012024-06-05T19:58:57.154Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_crucible_c2bf92da-7b65-405c-8e55-ebbcd5c7fed9/root/var/svc/log/oxide-crucible-downstairs:default.log
12022024-06-05T19:58:57.155Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_crucible_c2bf92da-7b65-405c-8e55-ebbcd5c7fed9/root/var/svc/log/oxide-crucible-downstairs:downstairs-9246aff3-8afd-4190-aa7d-f62a477e8e6b.log (3124 bytes)
12032024-06-05T19:58:58.265Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_crucible_c2bf92da-7b65-405c-8e55-ebbcd5c7fed9/root/var/svc/log/oxide-crucible-downstairs:downstairs-9246aff3-8afd-4190-aa7d-f62a477e8e6b.log
12042024-06-05T19:58:58.265Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_crucible_c2bf92da-7b65-405c-8e55-ebbcd5c7fed9/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
12052024-06-05T19:58:59.413Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_crucible_c2bf92da-7b65-405c-8e55-ebbcd5c7fed9/root/var/svc/log/oxide-zone-network-setup:default.log
12062024-06-05T19:58:59.414Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_external_dns_55f61404-8e20-4047-a779-ffe87d352f7e/root/var/svc/log/oxide-external_dns:default.log (26866 bytes)
12072024-06-05T19:58:59.539Zupload warning: file "/pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_external_dns_55f61404-8e20-4047-a779-ffe87d352f7e/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26866 -> 30641
12082024-06-05T19:59:00.609Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_external_dns_55f61404-8e20-4047-a779-ffe87d352f7e/root/var/svc/log/oxide-external_dns:default.log
12092024-06-05T19:59:00.609Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_external_dns_55f61404-8e20-4047-a779-ffe87d352f7e/root/var/svc/log/oxide-opte-interface-setup:default.log (1159 bytes)
12102024-06-05T19:59:01.710Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_external_dns_55f61404-8e20-4047-a779-ffe87d352f7e/root/var/svc/log/oxide-opte-interface-setup:default.log
12112024-06-05T19:59:01.710Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_external_dns_55f61404-8e20-4047-a779-ffe87d352f7e/root/var/svc/log/oxide-zone-network-setup:default.log (1705 bytes)
12122024-06-05T19:59:02.839Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_external_dns_55f61404-8e20-4047-a779-ffe87d352f7e/root/var/svc/log/oxide-zone-network-setup:default.log
12132024-06-05T19:59:02.840Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_internal_dns_46dff9fe-33a8-4272-a4b9-397eefbef96d/root/var/svc/log/oxide-internal_dns:default.log (109094 bytes)
12142024-06-05T19:59:03.159Zupload warning: file "/pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_internal_dns_46dff9fe-33a8-4272-a4b9-397eefbef96d/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 109094 -> 112848
12152024-06-05T19:59:04.249Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_internal_dns_46dff9fe-33a8-4272-a4b9-397eefbef96d/root/var/svc/log/oxide-internal_dns:default.log
12162024-06-05T19:59:04.250Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_internal_dns_46dff9fe-33a8-4272-a4b9-397eefbef96d/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
12172024-06-05T19:59:05.369Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_internal_dns_46dff9fe-33a8-4272-a4b9-397eefbef96d/root/var/svc/log/oxide-zone-network-setup:default.log
12182024-06-05T19:59:05.369Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_nexus_35af6b86-fd74-4104-b900-7a3edf8d03dc/root/var/svc/log/oxide-nexus:default.log (37691918 bytes)
12192024-06-05T19:59:29.591Zupload warning: file "/pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_nexus_35af6b86-fd74-4104-b900-7a3edf8d03dc/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 37691918 -> 38487614
12202024-06-05T19:59:30.663Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_nexus_35af6b86-fd74-4104-b900-7a3edf8d03dc/root/var/svc/log/oxide-nexus:default.log
12212024-06-05T19:59:30.663Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_nexus_35af6b86-fd74-4104-b900-7a3edf8d03dc/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
12222024-06-05T19:59:31.759Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_nexus_35af6b86-fd74-4104-b900-7a3edf8d03dc/root/var/svc/log/oxide-opte-interface-setup:default.log
12232024-06-05T19:59:31.759Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_nexus_35af6b86-fd74-4104-b900-7a3edf8d03dc/root/var/svc/log/oxide-zone-network-setup:default.log (1663 bytes)
12242024-06-05T19:59:32.854Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_nexus_35af6b86-fd74-4104-b900-7a3edf8d03dc/root/var/svc/log/oxide-zone-network-setup:default.log
12252024-06-05T19:59:32.878Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_oximeter_470307fd-e881-437d-ad9f-f54f87acee44/root/var/svc/log/oxide-oximeter:default.log (1364464 bytes)
12262024-06-05T19:59:34.270Zupload warning: file "/pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_oximeter_470307fd-e881-437d-ad9f-f54f87acee44/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1364464 -> 1907101
12272024-06-05T19:59:35.341Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_oximeter_470307fd-e881-437d-ad9f-f54f87acee44/root/var/svc/log/oxide-oximeter:default.log
12282024-06-05T19:59:35.341Zuploading: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_oximeter_470307fd-e881-437d-ad9f-f54f87acee44/root/var/svc/log/oxide-zone-network-setup:default.log (1681 bytes)
12292024-06-05T19:59:36.436Zuploaded: /pool/ext/d69c4ddc-54d3-4718-a115-7582c8252249/crypt/zone/oxz_oximeter_470307fd-e881-437d-ad9f-f54f87acee44/root/var/svc/log/oxide-zone-network-setup:default.log
12302024-06-05T19:59:36.437Zuploading: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-agent:default.log (36976 bytes)
12312024-06-05T19:59:37.597Zuploaded: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-agent:default.log
12322024-06-05T19:59:37.598Zuploading: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12332024-06-05T19:59:38.692Zuploaded: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:default.log
12342024-06-05T19:59:38.716Zuploading: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:downstairs-7d19e8b4-a333-4a22-b987-9b954ded1938.log (3125 bytes)
12352024-06-05T19:59:39.787Zuploaded: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:downstairs-7d19e8b4-a333-4a22-b987-9b954ded1938.log
12362024-06-05T19:59:39.787Zuploading: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:downstairs-f51dc4f2-186c-4e34-bbe3-90b4a5c65995.log (5614 bytes)
12372024-06-05T19:59:40.882Zuploaded: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:downstairs-f51dc4f2-186c-4e34-bbe3-90b4a5c65995.log
12382024-06-05T19:59:40.882Zuploading: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:downstairs-fe07e78c-8741-41b8-83ab-211e9fc8e2ea.log (5695 bytes)
12392024-06-05T19:59:41.978Zuploaded: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:downstairs-fe07e78c-8741-41b8-83ab-211e9fc8e2ea.log
12402024-06-05T19:59:41.978Zuploading: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:snapshot-fe07e78c-8741-41b8-83ab-211e9fc8e2ea-2758d653-a18c-46dd-89b5-047a8476dd7a.log (5305 bytes)
12412024-06-05T19:59:43.073Zuploaded: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-crucible-downstairs:snapshot-fe07e78c-8741-41b8-83ab-211e9fc8e2ea-2758d653-a18c-46dd-89b5-047a8476dd7a.log
12422024-06-05T19:59:43.073Zuploading: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
12432024-06-05T19:59:44.169Zuploaded: /pool/ext/df264fcd-b75d-4ee3-9b2e-e281836815f9/crypt/zone/oxz_crucible_bc50e194-c3e3-4fbb-a14d-26741c36b466/root/var/svc/log/oxide-zone-network-setup:default.log
12442024-06-05T19:59:44.169Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/measurements.log (20139 bytes)
12452024-06-05T19:59:44.262Zupload warning: file "/pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/measurements.log" changed size mid upload: 20139 -> 25345
12462024-06-05T19:59:45.335Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/measurements.log
12472024-06-05T19:59:45.336Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/statistics.log (12753 bytes)
12482024-06-05T19:59:45.429Zupload warning: file "/pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/statistics.log" changed size mid upload: 12753 -> 17199
12492024-06-05T19:59:46.511Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/statistics.log
12502024-06-05T19:59:46.511Zuploading: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/tracking.log (2245 bytes)
12512024-06-05T19:59:46.558Zupload warning: file "/pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/tracking.log" changed size mid upload: 2245 -> 2509
12522024-06-05T19:59:47.632Zuploaded: /pool/ext/87fce040-2c58-4185-8fd5-7dfb9378086a/crypt/zone/oxz_ntp_f73788bd-d6b7-4d17-b028-bd04b6dd3aee/root/var/log/chrony/tracking.log