01J1DRNECKB9G70KQ9948RXHRK: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.32",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01J1DRP5GVB5N9H5Y2N1WG8EV5

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-06-27T21:43:24.588Zjob dependencies complete; ready to run (waiting for 30 m 44 s)
22024-06-27T21:43:24.590Zjob assigned to worker 01J1DSECP4FTM83PZ4AT5M396C (queued for 0 s)
32024-06-27T21:43:24.809Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-06-27T21:43:24.852Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-06-27T21:43:24.887Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-06-27T21:43:24.921Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-06-27T21:43:24.954Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-06-27T21:43:24.988ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-06-27T21:43:25.022Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d3
102024-06-27T21:43:25.057ZOxide Helios Version helios-2.0.22714 64-bit
112024-06-27T21:43:25.089ZConfiguring devices.
122024-06-27T21:43:25.122Z##################################################
132024-06-27T21:43:25.156Z#### ############# ##
142024-06-27T21:43:25.191Z### ### ############ ##
152024-06-27T21:43:25.224Z## ### # ## ### ## Oxide Computer Company ##
162024-06-27T21:43:25.258Z## ## ## ### # ### ##
172024-06-27T21:43:25.292Z## # ### #### #### This Station Under ##
182024-06-27T21:43:25.325Z### ### #### # ### Computer Control ##
192024-06-27T21:43:25.358Z#### #### ### ## ##
202024-06-27T21:43:25.392Z##################################################
212024-06-27T21:43:25.425ZHostname: sock
222024-06-27T21:43:25.459ZLoading smf(7) service descriptions:
232024-06-27T21:43:26.056Zdownloading input: /input/package/work/package.tar.gz
242024-06-27T21:47:25.318Zdownloaded input: /input/package/work/package.tar.gz
 
252024-06-27T21:47:25.343Zstarting task 0: "setup"
262024-06-27T21:47:25.343Z++ uname -s
272024-06-27T21:47:25.343Z+ kern=SunOS
282024-06-27T21:47:25.343Z+ case "$kern" in
292024-06-27T21:47:25.343Z+ groupadd -g 12345 build
302024-06-27T21:47:25.343Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-06-27T21:47:27.320Z+ zfs create -o mountpoint=/work rpool/work
322024-06-27T21:47:27.368Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-06-27T21:47:27.392Z+ home_fs=zfs
342024-06-27T21:47:27.392Z+ [[ zfs == autofs ]]
352024-06-27T21:47:27.392Z+ mkdir -p /home/build
362024-06-27T21:47:27.392Z+ chown build:build /home/build /work
372024-06-27T21:47:29.375Z+ chmod 0700 /home/build /work
382024-06-27T21:47:29.399Zprocess exited: duration 4075 ms, exit code 0
 
392024-06-27T21:47:29.447Zstarting task 1: "authentication"
402024-06-27T21:47:29.492Zprocess exited: duration 44 ms, exit code 0
 
412024-06-27T21:47:29.540Zstarting task 2: "build"
422024-06-27T21:47:29.566Z+ trap _exit_trap EXIT
432024-06-27T21:47:29.566Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
442024-06-27T21:47:29.659Zsecpolicy_fs_linkdir: 0x55 = 0x55
452024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
462024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
472024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+3: 0 = 0xe5
482024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+4: 0 = 0xb8
492024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+5: 0 = 0x1
502024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
512024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
522024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
532024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
542024-06-27T21:47:29.659Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
552024-06-27T21:47:29.683Z+ [[ -d /opt/oxide ]]
562024-06-27T21:47:29.683Z+ pfexec mv /opt/oxide /opt/oxide-underneath
572024-06-27T21:47:29.683Z+ pfexec mkdir /opt/oxide
582024-06-27T21:47:29.683Z+ pfexec mount -F tmpfs -O swap /opt/oxide
592024-06-27T21:47:29.683Z+ [[ -d /opt/oxide-underneath ]]
602024-06-27T21:47:29.683Z+ cd /opt/oxide-underneath
612024-06-27T21:47:29.683Z+ pfexec tar ceEp@/f - .
622024-06-27T21:47:29.683Z+ cd /opt/oxide
632024-06-27T21:47:29.683Z+ pfexec tar xveEp@/f -
642024-06-27T21:47:29.792Zx ., 0 bytes, 0 tape blocks
652024-06-27T21:47:29.792Zx ./opte, 0 bytes, 0 tape blocks
662024-06-27T21:47:29.792Zx ./opte/bin, 0 bytes, 0 tape blocks
672024-06-27T21:47:29.792Zx ./opte/bin/opteadm, 52533872 bytes, 102606 tape blocks
682024-06-27T21:47:29.815Z+ pfexec rm -rf /opt/oxide-underneath
692024-06-27T21:47:29.815Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
702024-06-27T21:47:29.839Z+ pfexec mkdir /opt/oxide/work
712024-06-27T21:47:29.839Z+ pfexec chown build:build /opt/oxide/work
722024-06-27T21:47:29.839Z+ cd /opt/oxide/work
732024-06-27T21:47:29.839Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
742024-06-27T21:47:42.071ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
752024-06-27T21:47:42.071Zx out/target/test, 75 bytes, 1 tape blocks
762024-06-27T21:47:42.071Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
772024-06-27T21:47:42.071Zx package-manifest.toml, 28818 bytes, 57 tape blocks
782024-06-27T21:47:42.071Zx smf/sled-agent/non-gimlet/config.toml, 3154 bytes, 7 tape blocks
792024-06-27T21:47:42.071Zx target/release/omicron-package, 33215064 bytes, 64874 tape blocks
802024-06-27T21:47:42.071Zx target/release/xtask, 18565288 bytes, 36261 tape blocks
812024-06-27T21:47:42.071Zx target/debug/bootstrap, 365999944 bytes, 714844 tape blocks
822024-06-27T21:47:42.071Zx tests/bootstrap-68af68459d33b286, 24557312 bytes, 47964 tape blocks
832024-06-27T21:47:42.071Zx tests/commtest-dd2be214ce0b5ee1, 24557896 bytes, 47965 tape blocks
842024-06-27T21:47:42.071Zx tests/dhcp_server-3eaffd129bbf2971, 24557320 bytes, 47964 tape blocks
852024-06-27T21:47:42.071Zx tests/end_to_end_tests-365d14f3a8bfd02b, 377659528 bytes, 737617 tape blocks
862024-06-27T21:47:42.071Zx out/clickhouse.tar.gz, 228417369 bytes, 446128 tape blocks
872024-06-27T21:47:42.071Zx out/clickhouse_keeper.tar.gz, 228400044 bytes, 446094 tape blocks
882024-06-27T21:47:42.071Zx out/cockroachdb.tar.gz, 134974474 bytes, 263623 tape blocks
892024-06-27T21:47:42.071Zx out/crucible-dtrace.tar, 85504 bytes, 167 tape blocks
902024-06-27T21:47:42.071Zx out/crucible-pantry-zone.tar.gz, 27717266 bytes, 54136 tape blocks
912024-06-27T21:47:42.071Zx out/crucible-zone.tar.gz, 38235580 bytes, 74679 tape blocks
922024-06-27T21:47:42.071Zx out/external-dns.tar.gz, 25730478 bytes, 50255 tape blocks
932024-06-27T21:47:42.071Zx out/internal-dns.tar.gz, 25730000 bytes, 50254 tape blocks
942024-06-27T21:47:42.071Zx out/mg-ddm-gz.tar, 61819392 bytes, 120741 tape blocks
952024-06-27T21:47:42.071Zx out/nexus.tar.gz, 86400167 bytes, 168751 tape blocks
962024-06-27T21:47:42.071Zx out/ntp.tar.gz, 9113504 bytes, 17800 tape blocks
972024-06-27T21:47:42.071Zx out/omicron-gateway-softnpu.tar.gz, 14122355 bytes, 27583 tape blocks
982024-06-27T21:47:42.071Zx out/omicron-sled-agent.tar, 96606208 bytes, 188684 tape blocks
992024-06-27T21:47:42.071Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1002024-06-27T21:47:42.072Zx out/oximeter.tar.gz, 42476048 bytes, 82962 tape blocks
1012024-06-27T21:47:42.072Zx out/oxlog.tar, 3025408 bytes, 5909 tape blocks
1022024-06-27T21:47:42.072Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1032024-06-27T21:47:42.072Zx out/propolis-server.tar.gz, 66204525 bytes, 129306 tape blocks
1042024-06-27T21:47:42.072Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1052024-06-27T21:47:42.072Zx out/switch-softnpu.tar.gz, 200732999 bytes, 392057 tape blocks
1062024-06-27T21:47:42.096Z
1072024-06-27T21:47:42.096Zreal 12.222394800
1082024-06-27T21:47:42.096Zuser 10.847294599
1092024-06-27T21:47:42.096Zsys 2.418866604
1102024-06-27T21:47:42.096Ztrap 0.000378610
1112024-06-27T21:47:42.096Ztflt 0.000000000
1122024-06-27T21:47:42.096Zdflt 0.000000000
1132024-06-27T21:47:42.096Zkflt 0.000000000
1142024-06-27T21:47:42.096Zlock 0.000000000
1152024-06-27T21:47:42.096Zslp 10.882852178
1162024-06-27T21:47:42.096Zlat 0.293075055
1172024-06-27T21:47:42.096Zstop 0.000128662
1182024-06-27T21:47:42.096Z+ bmat address ls
1192024-06-27T21:47:42.096ZNAME CIDR FIRST LAST COUNT
1202024-06-27T21:47:42.096Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1212024-06-27T21:47:42.096Z++ bmat address ls -f extra -Ho first,last,count
1222024-06-27T21:47:42.096Z+ set -- 10.151.2.164 10.151.2.227 64
1232024-06-27T21:47:42.096Z+ EXTRA_IP_START=10.151.2.164
1242024-06-27T21:47:42.096Z+ EXTRA_IP_END=10.151.2.227
1252024-06-27T21:47:42.096Z+ EXTRA_IP_COUNT=64
1262024-06-27T21:47:42.096Z+ (( EXTRA_IP_COUNT >= 32 ))
1272024-06-27T21:47:42.096Z+ EXTRA_IP_BASE=10.151.2
1282024-06-27T21:47:42.096Z+ EXTRA_IP_FOCTET=164
1292024-06-27T21:47:42.096Z+ EXTRA_IP_LOCTET=227
1302024-06-27T21:47:42.096Z+ SERVICE_IP_POOL_START=10.151.2.164
1312024-06-27T21:47:42.096Z+ SERVICE_IP_POOL_END=10.151.2.173
1322024-06-27T21:47:42.096Z+ DNS_IP1=10.151.2.164
1332024-06-27T21:47:42.096Z+ DNS_IP2=10.151.2.165
1342024-06-27T21:47:42.097Z+ UPLINK_IP=10.151.2.174
1352024-06-27T21:47:42.097Z+ IPPOOL_START=10.151.2.175
1362024-06-27T21:47:42.097Z+ IPPOOL_END=10.151.2.227
1372024-06-27T21:47:42.097Z++ ipadm show-addr -po type,addr
1382024-06-27T21:47:42.097Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1392024-06-27T21:47:42.097Z+ GATEWAY_IP=10.151.2.100
1402024-06-27T21:47:42.097Z+ [[ -n 10.151.2.100 ]]
1412024-06-27T21:47:42.097Z+ ping -s 10.151.2.100 56 1
1422024-06-27T21:47:42.097ZPING 10.151.2.100: 56 data bytes
1432024-06-27T21:47:42.097Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.012 ms
1442024-06-27T21:47:42.097Z
1452024-06-27T21:47:42.097Z----10.151.2.100 PING Statistics----
1462024-06-27T21:47:42.097Z1 packets transmitted, 1 packets received, 0% packet loss
1472024-06-27T21:47:42.097Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
1482024-06-27T21:47:42.097Z++ arp -an
1492024-06-27T21:47:42.097Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1502024-06-27T21:47:42.121Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1512024-06-27T21:47:42.121Z+ routeadm -e ipv4-forwarding -u
1522024-06-27T21:47:42.209Z+ PXA_START=10.151.2.164
1532024-06-27T21:47:42.209Z+ PXA_END=10.151.2.227
1542024-06-27T21:47:42.233Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1552024-06-27T21:47:42.343Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227
1562024-06-27T21:47:42.367ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1572024-06-27T21:47:42.425Zcreating virtual hardware
1582024-06-27T21:47:42.449Zcreating /scratch/m2_0.vdev
1592024-06-27T21:47:42.449Zcreating /scratch/m2_1.vdev
1602024-06-27T21:47:42.449Zcreating /scratch/u2_0.vdev
1612024-06-27T21:47:42.449Zcreating /scratch/u2_1.vdev
1622024-06-27T21:47:42.449Zcreating /scratch/u2_2.vdev
1632024-06-27T21:47:42.449Zcreating /scratch/u2_3.vdev
1642024-06-27T21:47:42.449Zcreating /scratch/u2_4.vdev
1652024-06-27T21:47:42.450Zcreating /scratch/u2_5.vdev
1662024-06-27T21:47:42.450Zcreating /scratch/u2_6.vdev
1672024-06-27T21:47:42.450Zcreating /scratch/u2_7.vdev
1682024-06-27T21:47:42.450Zcreating /scratch/u2_8.vdev
1692024-06-27T21:47:42.484ZSimnet net0/sc0_0 exists
1702024-06-27T21:47:42.513ZSimnet net1/sc1_0 exists
1712024-06-27T21:47:42.537ZVnic sc0_1 exists
1722024-06-27T21:47:55.143ZUsing 10.151.2.100 as gateway ip
1732024-06-27T21:47:55.143Zusing 18:C0:4D:0D:A0:2A as gateway mac
1742024-06-27T21:47:55.143Zconfiguring SoftNPU ARP entry
1752024-06-27T21:47:55.172Zconfiguring SoftNPU proxy ARP
1762024-06-27T21:47:55.229ZSoftNPU state:
1772024-06-27T21:47:55.229Z local v6:
1782024-06-27T21:47:55.229Z local v4:
1792024-06-27T21:47:55.229Z router v6:
1802024-06-27T21:47:55.229Z router v4_idx:
1812024-06-27T21:47:55.229Z router v4_routes:
1822024-06-27T21:47:55.229Z resolver v4:
1832024-06-27T21:47:55.229Z 10.151.2.100 -> 18:c0:4d:0d:a0:2a
1842024-06-27T21:47:55.253Z resolver v6:
1852024-06-27T21:47:55.253Z nat v4:
1862024-06-27T21:47:55.253Z nat_v6:
1872024-06-27T21:47:55.253Z port_mac:
1882024-06-27T21:47:55.253Z proxy arp:
1892024-06-27T21:47:55.253Z 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
1902024-06-27T21:47:55.253Zcreated virtual hardware
1912024-06-27T21:47:55.254Z
1922024-06-27T21:47:55.254Zreal 12.884930712
1932024-06-27T21:47:55.254Zuser 0.651210611
1942024-06-27T21:47:55.254Zsys 3.179749319
1952024-06-27T21:47:55.254Ztrap 0.000055721
1962024-06-27T21:47:55.254Ztflt 0.000222726
1972024-06-27T21:47:55.254Zdflt 0.000673738
1982024-06-27T21:47:55.254Zkflt 0.000002280
1992024-06-27T21:47:55.254Zlock 20:00.508195872
2002024-06-27T21:47:55.254Zslp 51.841473633
2012024-06-27T21:47:55.254Zlat 0.081540200
2022024-06-27T21:47:55.254Zstop 1.052503331
2032024-06-27T21:47:55.254Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2042024-06-27T21:47:55.278Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2052024-06-27T21:47:55.278Z+ diff -u pkg/config.toml~ pkg/config.toml
2062024-06-27T21:47:55.278Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2072024-06-27T21:47:55.278Z+++ pkg/config.toml Thu Jun 27 21:47:55 2024
2082024-06-27T21:47:55.278Z@@ -29,18 +29,18 @@
2092024-06-27T21:47:55.278Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2102024-06-27T21:47:55.278Z # followed by a string that is embedded into their fake serial values.
2112024-06-27T21:47:55.278Z vdevs = [
2122024-06-27T21:47:55.278Z- "m2_0.vdev",
2132024-06-27T21:47:55.279Z- "m2_1.vdev",
2142024-06-27T21:47:55.279Z+ "/scratch/m2_0.vdev",
2152024-06-27T21:47:55.279Z+ "/scratch/m2_1.vdev",
2162024-06-27T21:47:55.279Z
2172024-06-27T21:47:55.279Z- "u2_0.vdev",
2182024-06-27T21:47:55.279Z- "u2_1.vdev",
2192024-06-27T21:47:55.279Z- "u2_2.vdev",
2202024-06-27T21:47:55.279Z- "u2_3.vdev",
2212024-06-27T21:47:55.279Z- "u2_4.vdev",
2222024-06-27T21:47:55.279Z- "u2_5.vdev",
2232024-06-27T21:47:55.279Z- "u2_6.vdev",
2242024-06-27T21:47:55.279Z- "u2_7.vdev",
2252024-06-27T21:47:55.279Z- "u2_8.vdev",
2262024-06-27T21:47:55.279Z+ "/scratch/u2_0.vdev",
2272024-06-27T21:47:55.279Z+ "/scratch/u2_1.vdev",
2282024-06-27T21:47:55.279Z+ "/scratch/u2_2.vdev",
2292024-06-27T21:47:55.279Z+ "/scratch/u2_3.vdev",
2302024-06-27T21:47:55.279Z+ "/scratch/u2_4.vdev",
2312024-06-27T21:47:55.279Z+ "/scratch/u2_5.vdev",
2322024-06-27T21:47:55.279Z+ "/scratch/u2_6.vdev",
2332024-06-27T21:47:55.279Z+ "/scratch/u2_7.vdev",
2342024-06-27T21:47:55.279Z+ "/scratch/u2_8.vdev",
2352024-06-27T21:47:55.279Z ]
2362024-06-27T21:47:55.279Z
2372024-06-27T21:47:55.279Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2382024-06-27T21:47:55.279Z+ true
2392024-06-27T21:47:55.279Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2402024-06-27T21:47:55.279Z+ SILO_NAME=recovery
2412024-06-27T21:47:55.279Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2422024-06-27T21:47:55.279Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2432024-06-27T21:47:55.279Z+ sed -i~ '
2442024-06-27T21:47:55.279Z /^external_dns_ips/c\
2452024-06-27T21:47:55.279Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2462024-06-27T21:47:55.279Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2472024-06-27T21:47:55.279Z /^first/c\
2482024-06-27T21:47:55.279Zfirst = "10.151.2.164"
2492024-06-27T21:47:55.279Z /^last/c\
2502024-06-27T21:47:55.279Zlast = "10.151.2.173"
2512024-06-27T21:47:55.279Z }
2522024-06-27T21:47:55.280Z /^infra_ip_first/c\
2532024-06-27T21:47:55.280Zinfra_ip_first = "10.151.2.174"
2542024-06-27T21:47:55.280Z /^infra_ip_last/c\
2552024-06-27T21:47:55.280Zinfra_ip_last = "10.151.2.174"
2562024-06-27T21:47:55.280Z /^\[\[rack_network_config.ports/,/^$/ {
2572024-06-27T21:47:55.280Z /^routes/c\
2582024-06-27T21:47:55.280Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
2592024-06-27T21:47:55.280Z /^addresses/c\
2602024-06-27T21:47:55.280Zaddresses = \[{address = "10.151.2.174/24"} \]
2612024-06-27T21:47:55.280Z }
2622024-06-27T21:47:55.280Z' pkg/config-rss.toml
2632024-06-27T21:47:55.280Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2642024-06-27T21:47:55.304Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2652024-06-27T21:47:55.304Z+++ pkg/config-rss.toml Thu Jun 27 21:47:55 2024
2662024-06-27T21:47:55.304Z@@ -33,7 +33,7 @@
2672024-06-27T21:47:55.304Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2682024-06-27T21:47:55.304Z # must be contained in one of the "internal services" IP Pool ranges listed
2692024-06-27T21:47:55.304Z # below.
2702024-06-27T21:47:55.304Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2712024-06-27T21:47:55.304Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
2722024-06-27T21:47:55.304Z
2732024-06-27T21:47:55.304Z # Initial TLS certificates for the external API
2742024-06-27T21:47:55.304Z #
2752024-06-27T21:47:55.304Z@@ -69,8 +69,8 @@
2762024-06-27T21:47:55.304Z #
2772024-06-27T21:47:55.304Z # For more on this and what to put here, see docs/how-to-run.adoc.
2782024-06-27T21:47:55.304Z [[internal_services_ip_pool_ranges]]
2792024-06-27T21:47:55.304Z-first = "192.168.1.20"
2802024-06-27T21:47:55.304Z-last = "192.168.1.29"
2812024-06-27T21:47:55.304Z+first = "10.151.2.164"
2822024-06-27T21:47:55.305Z+last = "10.151.2.173"
2832024-06-27T21:47:55.305Z
2842024-06-27T21:47:55.305Z # TODO - this configuration is subject to change going forward. Ultimately these
2852024-06-27T21:47:55.305Z # parameters should be provided to the control plane via wicket, but we need to
2862024-06-27T21:47:55.305Z@@ -91,8 +91,8 @@
2872024-06-27T21:47:55.305Z # A range of IP addresses used by Boundary Services on the external network. In
2882024-06-27T21:47:55.305Z # a real system, these would be addresses of the uplink ports on the Sidecar.
2892024-06-27T21:47:55.305Z # With softnpu, only one address is used.
2902024-06-27T21:47:55.305Z-infra_ip_first = "192.168.1.30"
2912024-06-27T21:47:55.305Z-infra_ip_last = "192.168.1.30"
2922024-06-27T21:47:55.305Z+infra_ip_first = "10.151.2.174"
2932024-06-27T21:47:55.305Z+infra_ip_last = "10.151.2.174"
2942024-06-27T21:47:55.305Z
2952024-06-27T21:47:55.305Z # Configurations for BGP routers to run on the scrimlets.
2962024-06-27T21:47:55.305Z bgp = []
2972024-06-27T21:47:55.305Z@@ -100,9 +100,9 @@
2982024-06-27T21:47:55.305Z # You can configure multiple uplinks by repeating the following stanza
2992024-06-27T21:47:55.305Z [[rack_network_config.ports]]
3002024-06-27T21:47:55.305Z # Routes associated with this port.
3012024-06-27T21:47:55.305Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3022024-06-27T21:47:55.305Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
3032024-06-27T21:47:55.305Z # Addresses associated with this port.
3042024-06-27T21:47:55.305Z-addresses = [{address = "192.168.1.30/24"}]
3052024-06-27T21:47:55.305Z+addresses = [{address = "10.151.2.174/24"} ]
3062024-06-27T21:47:55.305Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3072024-06-27T21:47:55.305Z port = "qsfp0"
3082024-06-27T21:47:55.305Z # The speed of this port.
3092024-06-27T21:47:55.305Z+ true
3102024-06-27T21:47:55.305Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3112024-06-27T21:47:55.305Za pkg/config-rss.toml 7K
3122024-06-27T21:47:55.305Za pkg/config.toml 4K
3132024-06-27T21:47:55.305Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3142024-06-27T21:47:55.305Z+ TLS_NAME=recovery.sys.oxide.test
3152024-06-27T21:47:55.305Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3162024-06-27T21:47:55.727Z.+..........+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+....+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+..........+.....+...................+.........+.....+....+............+...+..+.+...+.....+.......+..+.+..+.......+..+...........................................+..+................+..+...+...+.......+........+......+....+.........+.....+..........+...+...+.....+......+....+..+............................+..+...+....+.................+.............+.......................+..........+..................+......+...........+.......+......+...............+.....+................+.....+.+...+...........+......+....+.....+.........+.......+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3172024-06-27T21:47:56.234Z.+...+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+...+.+......+...+..+......+..........+..+...+....+......+..+............+.+..+.+.........+...+............+..+....+.....+......+...................+.....+.+...........+.......+..+.........+.+.........+.........+.....+...+...+....+..+.+........+.......+.........+.........+.....+.+...+...+.....+...+.+........+.+.....+......+..........+...+...+.....+....+......+...+..+.........+......+.......+..+......+....+...+............+.....+..................+...+...+....+.....+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.................+............+.+.....+....+...+.................+...+...+......+.....................+.............+..+.......+.....+.+.....+..........+...............+......+......+..+.+..+....+........+...+....+......+.....+...+.........+..........+......+............+.....+...+......+.........+..........+.....+....+..+...+......+.......+.....+.............+..............+......+....+.....+.......+...............+......+..+......+................+...+........+.......+............+...+........+..................+.........+.+.....+.....................+.........+.+...+....................+...+.........+.............+...+.....+...+.+......+..+.......+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3182024-06-27T21:47:56.258Z-----
3192024-06-27T21:47:56.282Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3202024-06-27T21:47:56.282Za pkg/initial-tls-cert.pem 2K
3212024-06-27T21:47:56.282Za pkg/initial-tls-key.pem 4K
3222024-06-27T21:47:56.282Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3232024-06-27T21:47:56.282Z+ rmdir pkg
3242024-06-27T21:47:56.282Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3252024-06-27T21:47:56.282Z+ pfexec mkdir -p /usr/oxide
3262024-06-27T21:47:56.282Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
3272024-06-27T21:47:56.888Z+ pfexec chmod +x /usr/oxide/oxide
3282024-06-27T21:47:56.911Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3292024-06-27T21:48:15.193Z+ OMICRON_NO_UNINSTALL=1
3302024-06-27T21:48:15.193Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3312024-06-27T21:48:15.217ZLogging to: /opt/oxide/work/out/LOG
3322024-06-27T21:48:15.735Z
3332024-06-27T21:48:15.760Zreal 0.537480149
3342024-06-27T21:48:15.760Zuser 0.117138788
3352024-06-27T21:48:15.760Zsys 2.384263430
3362024-06-27T21:48:15.760Ztrap 0.000004210
3372024-06-27T21:48:15.760Ztflt 0.000038310
3382024-06-27T21:48:15.760Zdflt 0.000918733
3392024-06-27T21:48:15.760Zkflt 0.000000000
3402024-06-27T21:48:15.760Zlock 48.657281853
3412024-06-27T21:48:15.760Zslp 0.742703511
3422024-06-27T21:48:15.760Zlat 0.003265041
3432024-06-27T21:48:15.760Zstop 0.203016247
3442024-06-27T21:48:15.760Z+ retry=0
3452024-06-27T21:48:15.760Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3462024-06-27T21:48:15.760Z+ [[ 0 -gt 30 ]]
3472024-06-27T21:48:15.760Z+ sleep 1
3482024-06-27T21:48:16.749Z+ retry=1
3492024-06-27T21:48:16.749Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3502024-06-27T21:48:16.773Z+ [[ 1 -gt 30 ]]
3512024-06-27T21:48:16.773Z+ sleep 1
3522024-06-27T21:48:17.764Z+ retry=2
3532024-06-27T21:48:17.764Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3542024-06-27T21:48:17.788Z+ [[ 2 -gt 30 ]]
3552024-06-27T21:48:17.788Z+ sleep 1
3562024-06-27T21:48:18.779Z+ retry=3
3572024-06-27T21:48:18.779Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3582024-06-27T21:48:43.957Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3592024-06-27T21:48:43.983Zlocal v6:
3602024-06-27T21:48:43.983Zfe80::a4bd:18ff:fe7f:74a8
3612024-06-27T21:48:43.983Zfd99:f4cc:ab86:d00a::1
3622024-06-27T21:48:43.983Zlocal v4:
3632024-06-27T21:48:43.983Z10.151.2.174
3642024-06-27T21:48:43.983Zrouter v6:
3652024-06-27T21:48:43.984Zfd00:1122:3344:2::/64 -> fe80::f047:cbff:fe47:4a2a (1)
3662024-06-27T21:48:43.984Zfdb0:18c0:4d0d:a02a::/64 -> fe80::f047:cbff:fe47:4a2a (1)
3672024-06-27T21:48:43.984Zfd00:1122:3344:1::/64 -> fe80::f047:cbff:fe47:4a2a (1)
3682024-06-27T21:48:43.984Zfd00:1122:3344:3::/64 -> fe80::f047:cbff:fe47:4a2a (1)
3692024-06-27T21:48:43.984Zfd00:1122:3344:101::/64 -> fe80::f047:cbff:fe47:4a2a (1)
3702024-06-27T21:48:43.984Zrouter v4_idx:
3712024-06-27T21:48:43.984Z0.0.0.0/0 -> 0
3722024-06-27T21:48:43.984Zrouter v4_routes:
3732024-06-27T21:48:44.008Z0 -> 10.151.2.100 (2)
3742024-06-27T21:48:44.008Zresolver v4:
3752024-06-27T21:48:44.008Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
3762024-06-27T21:48:44.008Z10.151.2.174 -> 8a:19:fd:6f:3f:2b
3772024-06-27T21:48:44.008Zresolver v6:
3782024-06-27T21:48:44.008Zfe80::f047:cbff:fe47:4a2a -> f2:47:cb:47:4a:2a
3792024-06-27T21:48:44.008Zfe80::a4bd:18ff:fe7f:74a8 -> a6:bd:18:7f:74:a8
3802024-06-27T21:48:44.008Znat v4:
3812024-06-27T21:48:44.008Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:a9:c4
3822024-06-27T21:48:44.008Znat_v6:
3832024-06-27T21:48:44.008Zport_mac:
3842024-06-27T21:48:44.008Z1: a8:40:25:7b:6e:60
3852024-06-27T21:48:44.008Z2: a8:40:25:7b:6e:80
3862024-06-27T21:48:44.008Z1000: a8:40:25:7b:6e:5f
3872024-06-27T21:48:44.008Zproxy arp:
3882024-06-27T21:48:44.008Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
3892024-06-27T21:48:44.008Z+ retry=0
3902024-06-27T21:48:44.008Z+++ zoneadm list -n
3912024-06-27T21:48:44.008Z+++ grep oxz_ntp
3922024-06-27T21:48:44.008Z++ pfexec svcs -z oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6 -Hostate oxide/ntp
3932024-06-27T21:48:44.033Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
3942024-06-27T21:48:44.033Z++ true
3952024-06-27T21:48:44.033Z+ [[ '' != online ]]
3962024-06-27T21:48:44.033Z+ [[ 0 -gt 60 ]]
3972024-06-27T21:48:44.033Z+ sleep 1
3982024-06-27T21:48:45.016Z+ retry=1
3992024-06-27T21:48:45.039Z+++ zoneadm list -n
4002024-06-27T21:48:45.039Z+++ grep oxz_ntp
4012024-06-27T21:48:45.039Z++ pfexec svcs -z oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6 -Hostate oxide/ntp
4022024-06-27T21:48:45.039Z+ [[ offline != online ]]
4032024-06-27T21:48:45.039Z+ [[ 1 -gt 60 ]]
4042024-06-27T21:48:45.039Z+ sleep 1
4052024-06-27T21:48:46.038Z+ retry=2
4062024-06-27T21:48:46.062Z+++ zoneadm list -n
4072024-06-27T21:48:46.062Z+++ grep oxz_ntp
4082024-06-27T21:48:46.062Z++ pfexec svcs -z oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6 -Hostate oxide/ntp
4092024-06-27T21:48:46.062Z+ [[ offline != online ]]
4102024-06-27T21:48:46.062Z+ [[ 2 -gt 60 ]]
4112024-06-27T21:48:46.062Z+ sleep 1
4122024-06-27T21:48:47.061Z+ retry=3
4132024-06-27T21:48:47.085Z+++ zoneadm list -n
4142024-06-27T21:48:47.085Z+++ grep oxz_ntp
4152024-06-27T21:48:47.085Z++ pfexec svcs -z oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6 -Hostate oxide/ntp
4162024-06-27T21:48:47.085Z+ [[ offline != online ]]
4172024-06-27T21:48:47.085Z+ [[ 3 -gt 60 ]]
4182024-06-27T21:48:47.085Z+ sleep 1
4192024-06-27T21:48:48.083Z+ retry=4
4202024-06-27T21:48:48.106Z+++ zoneadm list -n
4212024-06-27T21:48:48.106Z+++ grep oxz_ntp
4222024-06-27T21:48:48.106Z++ pfexec svcs -z oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6 -Hostate oxide/ntp
4232024-06-27T21:48:48.106Z+ [[ offline != online ]]
4242024-06-27T21:48:48.106Z+ [[ 4 -gt 60 ]]
4252024-06-27T21:48:48.106Z+ sleep 1
4262024-06-27T21:48:49.104Z+ retry=5
4272024-06-27T21:48:49.128Z+++ zoneadm list -n
4282024-06-27T21:48:49.128Z+++ grep oxz_ntp
4292024-06-27T21:48:49.128Z++ pfexec svcs -z oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6 -Hostate oxide/ntp
4302024-06-27T21:48:49.128Z+ [[ offline != online ]]
4312024-06-27T21:48:49.128Z+ [[ 5 -gt 60 ]]
4322024-06-27T21:48:49.128Z+ sleep 1
4332024-06-27T21:48:50.125Z+ retry=6
4342024-06-27T21:48:50.149Z+++ zoneadm list -n
4352024-06-27T21:48:50.149Z+++ grep oxz_ntp
4362024-06-27T21:48:50.149Z++ pfexec svcs -z oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6 -Hostate oxide/ntp
4372024-06-27T21:48:50.149Z+ [[ offline != online ]]
4382024-06-27T21:48:50.149Z+ [[ 6 -gt 60 ]]
4392024-06-27T21:48:50.149Z+ sleep 1
 
4402024-06-27T21:48:50.609Zsock console login: Jun 27 21:48:50 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
4412024-06-27T21:48:51.147Z+ retry=7
4422024-06-27T21:48:51.171Z+++ zoneadm list -n
4432024-06-27T21:48:51.171Z+++ grep oxz_ntp
4442024-06-27T21:48:51.171Z++ pfexec svcs -z oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6 -Hostate oxide/ntp
4452024-06-27T21:48:51.171Z+ [[ online != online ]]
4462024-06-27T21:48:51.171Z+ echo 'Waited for chrony: 7s'
4472024-06-27T21:48:51.171Z+ retry=0
4482024-06-27T21:48:51.171ZWaited for chrony: 7s
4492024-06-27T21:48:51.171Z+ zoneadm list
4502024-06-27T21:48:51.171Z+ grep nexus
4512024-06-27T21:48:51.197Z+ [[ 0 -gt 300 ]]
4522024-06-27T21:48:51.197Z+ sleep 1
4532024-06-27T21:48:52.177Z+ retry=1
4542024-06-27T21:48:52.202Z+ zoneadm list
4552024-06-27T21:48:52.202Z+ grep nexus
4562024-06-27T21:48:52.202Z+ [[ 1 -gt 300 ]]
4572024-06-27T21:48:52.202Z+ sleep 1
4582024-06-27T21:48:53.187Z+ retry=2
4592024-06-27T21:48:53.211Z+ zoneadm list
4602024-06-27T21:48:53.211Z+ grep nexus
4612024-06-27T21:48:53.211Z+ [[ 2 -gt 300 ]]
4622024-06-27T21:48:53.211Z+ sleep 1
4632024-06-27T21:48:54.198Z+ retry=3
4642024-06-27T21:48:54.221Z+ zoneadm list
4652024-06-27T21:48:54.222Z+ grep nexus
4662024-06-27T21:48:54.222Z+ [[ 3 -gt 300 ]]
4672024-06-27T21:48:54.222Z+ sleep 1
4682024-06-27T21:48:55.209Z+ retry=4
4692024-06-27T21:48:55.233Z+ zoneadm list
4702024-06-27T21:48:55.233Z+ grep nexus
4712024-06-27T21:48:55.233Z+ [[ 4 -gt 300 ]]
4722024-06-27T21:48:55.233Z+ sleep 1
4732024-06-27T21:48:56.219Z+ retry=5
4742024-06-27T21:48:56.243Z+ zoneadm list
4752024-06-27T21:48:56.243Z+ grep nexus
4762024-06-27T21:48:56.243Z+ [[ 5 -gt 300 ]]
4772024-06-27T21:48:56.243Z+ sleep 1
4782024-06-27T21:48:57.232Z+ retry=6
4792024-06-27T21:48:57.256Z+ zoneadm list
4802024-06-27T21:48:57.256Z+ grep nexus
4812024-06-27T21:48:57.256Z+ [[ 6 -gt 300 ]]
4822024-06-27T21:48:57.256Z+ sleep 1
4832024-06-27T21:48:58.247Z+ retry=7
4842024-06-27T21:48:58.271Z+ zoneadm list
4852024-06-27T21:48:58.271Z+ grep nexus
4862024-06-27T21:48:58.271Z+ [[ 7 -gt 300 ]]
4872024-06-27T21:48:58.271Z+ sleep 1
4882024-06-27T21:48:59.261Z+ retry=8
4892024-06-27T21:48:59.286Z+ zoneadm list
4902024-06-27T21:48:59.286Z+ grep nexus
4912024-06-27T21:48:59.286Z+ [[ 8 -gt 300 ]]
4922024-06-27T21:48:59.287Z+ sleep 1
4932024-06-27T21:49:00.276Z+ retry=9
4942024-06-27T21:49:00.300Z+ zoneadm list
4952024-06-27T21:49:00.300Z+ grep nexus
4962024-06-27T21:49:00.300Z+ [[ 9 -gt 300 ]]
4972024-06-27T21:49:00.300Z+ sleep 1
4982024-06-27T21:49:01.291Z+ retry=10
4992024-06-27T21:49:01.315Z+ zoneadm list
5002024-06-27T21:49:01.315Z+ grep nexus
5012024-06-27T21:49:01.315Z+ [[ 10 -gt 300 ]]
5022024-06-27T21:49:01.315Z+ sleep 1
5032024-06-27T21:49:02.307Z+ retry=11
5042024-06-27T21:49:02.405Z+ zoneadm list
5052024-06-27T21:49:02.405Z+ grep nexus
5062024-06-27T21:49:02.584Z+ [[ 11 -gt 300 ]]
5072024-06-27T21:49:02.584Z+ sleep 1
5082024-06-27T21:49:03.650Z+ retry=12
5092024-06-27T21:49:03.674Z+ zoneadm list
5102024-06-27T21:49:04.672Z+ grep nexus
5112024-06-27T21:49:04.673Z+ [[ 12 -gt 300 ]]
5122024-06-27T21:49:04.673Z+ sleep 1
5132024-06-27T21:49:04.870Z+ retry=13
5142024-06-27T21:49:04.894Z+ zoneadm list
5152024-06-27T21:49:04.894Z+ grep nexus
5162024-06-27T21:49:04.895Z+ [[ 13 -gt 300 ]]
5172024-06-27T21:49:04.895Z+ sleep 1
5182024-06-27T21:49:05.887Z+ retry=14
5192024-06-27T21:49:05.912Z+ zoneadm list
5202024-06-27T21:49:05.912Z+ grep nexus
5212024-06-27T21:49:05.912Z+ [[ 14 -gt 300 ]]
5222024-06-27T21:49:05.912Z+ sleep 1
5232024-06-27T21:49:06.902Z+ retry=15
5242024-06-27T21:49:06.927Z+ zoneadm list
5252024-06-27T21:49:06.927Z+ grep nexus
5262024-06-27T21:49:06.927Z+ [[ 15 -gt 300 ]]
5272024-06-27T21:49:06.927Z+ sleep 1
5282024-06-27T21:49:07.917Z+ retry=16
5292024-06-27T21:49:07.944Z+ zoneadm list
5302024-06-27T21:49:07.944Z+ grep nexus
5312024-06-27T21:49:07.944Z+ [[ 16 -gt 300 ]]
5322024-06-27T21:49:07.944Z+ sleep 1
5332024-06-27T21:49:08.933Z+ retry=17
5342024-06-27T21:49:08.957Z+ zoneadm list
5352024-06-27T21:49:08.958Z+ grep nexus
5362024-06-27T21:49:08.958Z+ [[ 17 -gt 300 ]]
5372024-06-27T21:49:08.958Z+ sleep 1
5382024-06-27T21:49:09.946Z+ retry=18
5392024-06-27T21:49:09.970Z+ zoneadm list
5402024-06-27T21:49:09.970Z+ grep nexus
5412024-06-27T21:49:09.970Z+ [[ 18 -gt 300 ]]
5422024-06-27T21:49:09.970Z+ sleep 1
5432024-06-27T21:49:10.959Z+ retry=19
5442024-06-27T21:49:10.984Z+ zoneadm list
5452024-06-27T21:49:10.984Z+ grep nexus
5462024-06-27T21:49:10.984Z+ [[ 19 -gt 300 ]]
5472024-06-27T21:49:10.984Z+ sleep 1
5482024-06-27T21:49:11.976Z+ retry=20
5492024-06-27T21:49:12.000Z+ zoneadm list
5502024-06-27T21:49:12.000Z+ grep nexus
5512024-06-27T21:49:12.000Z+ [[ 20 -gt 300 ]]
5522024-06-27T21:49:12.002Z+ sleep 1
5532024-06-27T21:49:12.989Z+ retry=21
5542024-06-27T21:49:13.016Z+ zoneadm list
5552024-06-27T21:49:13.016Z+ grep nexus
5562024-06-27T21:49:13.016Z+ [[ 21 -gt 300 ]]
5572024-06-27T21:49:13.016Z+ sleep 1
5582024-06-27T21:49:14.041Z+ retry=22
5592024-06-27T21:49:14.041Z+ grep nexus
5602024-06-27T21:49:14.326Z+ zoneadm list
5612024-06-27T21:49:14.385Z+ [[ 22 -gt 300 ]]
5622024-06-27T21:49:14.385Z+ sleep 1
5632024-06-27T21:49:15.392Z+ retry=23
5642024-06-27T21:49:15.416Z+ zoneadm list
5652024-06-27T21:49:15.416Z+ grep nexus
5662024-06-27T21:49:15.416Z+ [[ 23 -gt 300 ]]
5672024-06-27T21:49:15.416Z+ sleep 1
5682024-06-27T21:49:16.409Z+ retry=24
5692024-06-27T21:49:16.433Z+ zoneadm list
5702024-06-27T21:49:16.433Z+ grep nexus
5712024-06-27T21:49:16.433Z+ [[ 24 -gt 300 ]]
5722024-06-27T21:49:16.433Z+ sleep 1
5732024-06-27T21:49:17.425Z+ retry=25
5742024-06-27T21:49:17.450Z+ zoneadm list
5752024-06-27T21:49:17.450Z+ grep nexus
5762024-06-27T21:49:17.450Z+ [[ 25 -gt 300 ]]
5772024-06-27T21:49:17.450Z+ sleep 1
5782024-06-27T21:49:18.438Z+ retry=26
5792024-06-27T21:49:18.463Z+ zoneadm list
5802024-06-27T21:49:18.463Z+ grep nexus
5812024-06-27T21:49:18.463Z+ [[ 26 -gt 300 ]]
5822024-06-27T21:49:18.463Z+ sleep 1
5832024-06-27T21:49:19.449Z+ retry=27
5842024-06-27T21:49:19.474Z+ zoneadm list
5852024-06-27T21:49:19.474Z+ grep nexus
5862024-06-27T21:49:19.474Z+ [[ 27 -gt 300 ]]
5872024-06-27T21:49:19.474Z+ sleep 1
5882024-06-27T21:49:20.463Z+ retry=28
5892024-06-27T21:49:20.487Z+ zoneadm list
5902024-06-27T21:49:20.487Z+ grep nexus
5912024-06-27T21:49:20.487Z+ [[ 28 -gt 300 ]]
5922024-06-27T21:49:20.487Z+ sleep 1
5932024-06-27T21:49:21.475Z+ retry=29
5942024-06-27T21:49:21.501Z+ zoneadm list
5952024-06-27T21:49:21.501Z+ grep nexus
5962024-06-27T21:49:21.501Z+ [[ 29 -gt 300 ]]
5972024-06-27T21:49:21.501Z+ sleep 1
5982024-06-27T21:49:22.489Z+ retry=30
5992024-06-27T21:49:22.515Z+ zoneadm list
6002024-06-27T21:49:22.515Z+ grep nexus
6012024-06-27T21:49:22.515Z+ [[ 30 -gt 300 ]]
6022024-06-27T21:49:22.515Z+ sleep 1
6032024-06-27T21:49:23.502Z+ retry=31
6042024-06-27T21:49:23.527Z+ zoneadm list
6052024-06-27T21:49:23.527Z+ grep nexus
6062024-06-27T21:49:23.527Z+ [[ 31 -gt 300 ]]
6072024-06-27T21:49:23.527Z+ sleep 1
6082024-06-27T21:49:24.517Z+ retry=32
6092024-06-27T21:49:24.543Z+ zoneadm list
6102024-06-27T21:49:24.543Z+ grep nexus
6112024-06-27T21:49:24.544Z+ [[ 32 -gt 300 ]]
6122024-06-27T21:49:24.544Z+ sleep 1
6132024-06-27T21:49:25.535Z+ retry=33
6142024-06-27T21:49:25.560Z+ zoneadm list
6152024-06-27T21:49:25.560Z+ grep nexus
6162024-06-27T21:49:25.560Z+ [[ 33 -gt 300 ]]
6172024-06-27T21:49:25.560Z+ sleep 1
6182024-06-27T21:49:26.547Z+ retry=34
6192024-06-27T21:49:26.575Z+ zoneadm list
6202024-06-27T21:49:26.575Z+ grep nexus
6212024-06-27T21:49:26.575Z+ [[ 34 -gt 300 ]]
6222024-06-27T21:49:26.575Z+ sleep 1
6232024-06-27T21:49:27.610Z+ retry=35
6242024-06-27T21:49:27.647Z+ zoneadm list
6252024-06-27T21:49:27.647Z+ grep nexus
6262024-06-27T21:49:27.647Z+ [[ 35 -gt 300 ]]
6272024-06-27T21:49:27.647Z+ sleep 1
6282024-06-27T21:49:28.580Z+ retry=36
6292024-06-27T21:49:28.609Z+ zoneadm list
6302024-06-27T21:49:28.609Z+ grep nexus
6312024-06-27T21:49:28.609Z+ [[ 36 -gt 300 ]]
6322024-06-27T21:49:28.609Z+ sleep 1
6332024-06-27T21:49:29.586Z+ retry=37
6342024-06-27T21:49:29.618Z+ zoneadm list
6352024-06-27T21:49:29.618Z+ grep nexus
6362024-06-27T21:49:29.618Z+ [[ 37 -gt 300 ]]
6372024-06-27T21:49:29.618Z+ sleep 1
6382024-06-27T21:49:30.597Z+ retry=38
6392024-06-27T21:49:30.632Z+ zoneadm list
6402024-06-27T21:49:30.632Z+ grep nexus
6412024-06-27T21:49:30.632Z+ [[ 38 -gt 300 ]]
6422024-06-27T21:49:30.632Z+ sleep 1
6432024-06-27T21:49:31.610Z+ retry=39
6442024-06-27T21:49:31.638Z+ zoneadm list
6452024-06-27T21:49:31.638Z+ grep nexus
6462024-06-27T21:49:31.638Z+ [[ 39 -gt 300 ]]
6472024-06-27T21:49:31.639Z+ sleep 1
6482024-06-27T21:49:34.969Z+ retry=40
6492024-06-27T21:49:34.994Z+ zoneadm list
6502024-06-27T21:49:34.995Z+ grep nexus
6512024-06-27T21:49:34.995Z+ [[ 40 -gt 300 ]]
6522024-06-27T21:49:34.995Z+ sleep 1
6532024-06-27T21:49:34.995Z+ retry=41
6542024-06-27T21:49:34.995Z+ zoneadm list
6552024-06-27T21:49:34.995Z+ grep nexus
6562024-06-27T21:49:34.995Z+ [[ 41 -gt 300 ]]
6572024-06-27T21:49:34.995Z+ sleep 1
6582024-06-27T21:49:34.995Z+ retry=42
6592024-06-27T21:49:34.995Z+ zoneadm list
6602024-06-27T21:49:34.995Z+ grep nexus
6612024-06-27T21:49:34.995Z+ [[ 42 -gt 300 ]]
6622024-06-27T21:49:34.995Z+ sleep 1
6632024-06-27T21:49:35.661Z+ retry=43
6642024-06-27T21:49:35.685Z+ zoneadm list
6652024-06-27T21:49:35.685Z+ grep nexus
6662024-06-27T21:49:35.685Z+ [[ 43 -gt 300 ]]
6672024-06-27T21:49:35.685Z+ sleep 1
6682024-06-27T21:49:36.673Z+ retry=44
6692024-06-27T21:49:36.696Z+ zoneadm list
6702024-06-27T21:49:36.696Z+ grep nexus
6712024-06-27T21:49:36.696Z+ [[ 44 -gt 300 ]]
6722024-06-27T21:49:36.696Z+ sleep 1
6732024-06-27T21:49:37.685Z+ retry=45
6742024-06-27T21:49:37.709Z+ zoneadm list
6752024-06-27T21:49:37.709Z+ grep nexus
6762024-06-27T21:49:37.709Z+ [[ 45 -gt 300 ]]
6772024-06-27T21:49:37.709Z+ sleep 1
6782024-06-27T21:49:39.394Z+ retry=46
6792024-06-27T21:49:39.419Z+ zoneadm list
6802024-06-27T21:49:39.419Z+ grep nexus
6812024-06-27T21:49:39.419Z+ [[ 46 -gt 300 ]]
6822024-06-27T21:49:39.419Z+ sleep 1
6832024-06-27T21:49:40.416Z+ retry=47
6842024-06-27T21:49:40.440Z+ zoneadm list
6852024-06-27T21:49:40.440Z+ grep nexus
6862024-06-27T21:49:40.440Z+ [[ 47 -gt 300 ]]
6872024-06-27T21:49:40.440Z+ sleep 1
6882024-06-27T21:49:41.435Z+ retry=48
6892024-06-27T21:49:41.459Z+ zoneadm list
6902024-06-27T21:49:41.459Z+ grep nexus
6912024-06-27T21:49:41.482Z+ [[ 48 -gt 300 ]]
6922024-06-27T21:49:41.483Z+ sleep 1
6932024-06-27T21:49:43.882Z+ retry=49
6942024-06-27T21:49:44.289Z+ zoneadm list
6952024-06-27T21:49:44.325Z+ grep nexus
6962024-06-27T21:49:44.436Z+ [[ 49 -gt 300 ]]
6972024-06-27T21:49:44.460Z+ sleep 1
6982024-06-27T21:49:45.458Z+ retry=50
6992024-06-27T21:49:45.481Z+ zoneadm list
7002024-06-27T21:49:45.481Z+ grep nexus
7012024-06-27T21:49:45.482Z+ [[ 50 -gt 300 ]]
7022024-06-27T21:49:45.482Z+ sleep 1
7032024-06-27T21:49:46.481Z+ retry=51
7042024-06-27T21:49:46.505Z+ zoneadm list
7052024-06-27T21:49:46.505Z+ grep nexus
7062024-06-27T21:49:46.505Z+ [[ 51 -gt 300 ]]
7072024-06-27T21:49:46.505Z+ sleep 1
7082024-06-27T21:49:47.505Z+ retry=52
7092024-06-27T21:49:47.529Z+ zoneadm list
7102024-06-27T21:49:47.529Z+ grep nexus
7112024-06-27T21:49:47.529Z+ [[ 52 -gt 300 ]]
7122024-06-27T21:49:47.529Z+ sleep 1
7132024-06-27T21:49:48.528Z+ retry=53
7142024-06-27T21:49:48.553Z+ zoneadm list
7152024-06-27T21:49:48.553Z+ grep nexus
7162024-06-27T21:49:48.553Z+ [[ 53 -gt 300 ]]
7172024-06-27T21:49:48.553Z+ sleep 1
7182024-06-27T21:49:49.557Z+ retry=54
7192024-06-27T21:49:49.582Z+ zoneadm list
7202024-06-27T21:49:49.582Z+ grep nexus
7212024-06-27T21:49:49.605Z+ [[ 54 -gt 300 ]]
7222024-06-27T21:49:49.605Z+ sleep 1
7232024-06-27T21:49:50.610Z+ retry=55
7242024-06-27T21:49:50.634Z+ zoneadm list
7252024-06-27T21:49:50.634Z+ grep nexus
7262024-06-27T21:49:50.634Z+ echo 'Waited for nexus: 55s'
7272024-06-27T21:49:50.634Z+ export RUST_BACKTRACE=1
7282024-06-27T21:49:50.634Z+ RUST_BACKTRACE=1
7292024-06-27T21:49:50.634Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
7302024-06-27T21:49:50.710Z++ ./target/debug/bootstrap
7312024-06-27T21:49:50.710Zoxz_nexus_bd627fc3-4ded-4844-a604-cef35ec5c7d1
7322024-06-27T21:49:50.711Zoxz_nexus_d678efd8-4911-40fa-bbcb-fd0c410b070e
7332024-06-27T21:49:50.711Zoxz_nexus_55245028-681c-41bf-9e25-364cbb22b701
7342024-06-27T21:49:50.711ZWaited for nexus: 55s
7352024-06-27T21:49:51.441ZUsing external DNS server at 10.151.2.164:53
7362024-06-27T21:49:51.465Z2024-06-27 21:49:51.440546674 UTC: attempting to log into API
7372024-06-27T21:50:06.560Z2024-06-27 21:50:06.549100164 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
7382024-06-27T21:50:07.562Z2024-06-27 21:50:07.550156664 UTC: attempting to log into API
 
7392024-06-27T21:50:11.675ZJun 27 21:50:10 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
7402024-06-27T21:50:12.294ZJun 27 21:50:11 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
7412024-06-27T21:50:12.642ZJun 27 21:50:12 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
7422024-06-27T21:50:12.679ZJun 27 21:50:12 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
7432024-06-27T21:50:13.303ZJun 27 21:50:12 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
7442024-06-27T21:50:22.593Z2024-06-27 21:50:22.581504643 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
7452024-06-27T21:50:23.594Z2024-06-27 21:50:23.582658056 UTC: attempting to log into API
7462024-06-27T21:50:38.625Z2024-06-27 21:50:38.614437147 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
7472024-06-27T21:50:39.627Z2024-06-27 21:50:39.615593390 UTC: attempting to log into API
7482024-06-27T21:50:54.658Z2024-06-27 21:50:54.647232656 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
7492024-06-27T21:50:55.660Z2024-06-27 21:50:55.648407570 UTC: attempting to log into API
7502024-06-27T21:51:06.449Z2024-06-27 21:51:06.438868473 UTC: login succeeded
7512024-06-27T21:51:06.485Zwaiting for nexus to come up...
7522024-06-27T21:51:06.556Zcreating IP pool... 10.151.2.175 - 10.151.2.227
7532024-06-27T21:51:06.748Zsetting up quotas...
7542024-06-27T21:51:06.799Zensuring datasets are ready...
7552024-06-27T21:51:09.550Zlet's roll.
7562024-06-27T21:51:09.574Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
7572024-06-27T21:51:09.574ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
7582024-06-27T21:51:09.574ZOXIDE_TOKEN=oxide-token-d12f72549d5b04c0316d1a2931de0e215f5d8cbe'
7592024-06-27T21:51:09.574Z++ OXIDE_HOST=https://recovery.sys.oxide.test
7602024-06-27T21:51:09.574Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
7612024-06-27T21:51:09.574Z++ OXIDE_TOKEN=oxide-token-d12f72549d5b04c0316d1a2931de0e215f5d8cbe
7622024-06-27T21:51:09.574Z+ export OXIDE_HOST OXIDE_TOKEN
7632024-06-27T21:51:09.575Z+ retry=0
7642024-06-27T21:51:09.575Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
7652024-06-27T21:51:09.645Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
7662024-06-27T21:51:10.108Z{"status":"ok"}success
7672024-06-27T21:51:10.108ZProject {
7682024-06-27T21:51:10.108Z description: "some images",
7692024-06-27T21:51:10.108Z id: 515f3055-9eed-457d-b991-9f42a4d7c583,
7702024-06-27T21:51:10.108Z name: Name(
7712024-06-27T21:51:10.108Z "images",
7722024-06-27T21:51:10.108Z ),
7732024-06-27T21:51:10.132Z time_created: 2024-06-27T21:51:09.705658Z,
7742024-06-27T21:51:10.132Z time_modified: 2024-06-27T21:51:09.705658Z,
7752024-06-27T21:51:10.132Z}
7762024-06-27T21:51:10.132Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
7772024-06-27T21:56:39.109Zdone!
7782024-06-27T21:56:39.208Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
7792024-06-27T21:56:39.307Zsuccess
7802024-06-27T21:56:39.307ZImage {
7812024-06-27T21:56:39.307Z block_size: ByteCount(
7822024-06-27T21:56:39.307Z 512,
7832024-06-27T21:56:39.307Z ),
7842024-06-27T21:56:39.333Z description: "debian 11 original base image",
7852024-06-27T21:56:39.333Z digest: None,
7862024-06-27T21:56:39.334Z id: 0759867b-7c4b-44c6-8cba-c608283eb6ab,
7872024-06-27T21:56:39.334Z name: Name(
7882024-06-27T21:56:39.334Z "debian11",
7892024-06-27T21:56:39.334Z ),
7902024-06-27T21:56:39.334Z os: "debian",
7912024-06-27T21:56:39.334Z project_id: None,
7922024-06-27T21:56:39.334Z size: ByteCount(
7932024-06-27T21:56:39.334Z 2147483648,
7942024-06-27T21:56:39.334Z ),
7952024-06-27T21:56:39.334Z time_created: 2024-06-27T21:56:39.039796Z,
7962024-06-27T21:56:39.334Z time_modified: 2024-06-27T21:56:39.290227Z,
7972024-06-27T21:56:39.334Z url: None,
7982024-06-27T21:56:39.334Z version: "11",
7992024-06-27T21:56:39.334Z}
8002024-06-27T21:56:39.334Z+ for test_bin in tests/*
8012024-06-27T21:56:39.334Z+ ./tests/bootstrap-68af68459d33b286
8022024-06-27T21:56:39.334Z
8032024-06-27T21:56:39.334Zrunning 0 tests
8042024-06-27T21:56:39.334Z
8052024-06-27T21:56:39.334Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8062024-06-27T21:56:39.334Z
8072024-06-27T21:56:39.334Z+ for test_bin in tests/*
8082024-06-27T21:56:39.334Z+ ./tests/commtest-dd2be214ce0b5ee1
8092024-06-27T21:56:39.358Z
8102024-06-27T21:56:39.358Zrunning 0 tests
8112024-06-27T21:56:39.382Z
8122024-06-27T21:56:39.382Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8132024-06-27T21:56:39.382Z
8142024-06-27T21:56:39.382Z+ for test_bin in tests/*
8152024-06-27T21:56:39.382Z+ ./tests/dhcp_server-3eaffd129bbf2971
8162024-06-27T21:56:39.382Z
8172024-06-27T21:56:39.382Zrunning 0 tests
8182024-06-27T21:56:39.382Z
8192024-06-27T21:56:39.382Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
8202024-06-27T21:56:39.382Z
8212024-06-27T21:56:39.382Z+ for test_bin in tests/*
8222024-06-27T21:56:39.382Z+ ./tests/end_to_end_tests-365d14f3a8bfd02b
8232024-06-27T21:56:39.597Z
8242024-06-27T21:56:39.597Zrunning 2 tests
8252024-06-27T21:56:39.884Ztest no_spoof::no_spoof_here ... ok
8262024-06-27T21:57:06.255Ztest instance_launch::instance_launch ... ok
8272024-06-27T21:57:06.255Z
8282024-06-27T21:57:06.255Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 26.66s
8292024-06-27T21:57:06.255Z
8302024-06-27T21:57:06.279Z+ _exit_trap
8312024-06-27T21:57:06.279Z+ local status=0
8322024-06-27T21:57:06.279Z+ set +o errexit
8332024-06-27T21:57:06.279Z+ pfexec svcadm -Z disable -s cron
8342024-06-27T21:57:07.915Z+ [[ 0 -eq 0 ]]
8352024-06-27T21:57:07.915Z+ exit 0
8362024-06-27T21:57:07.939Zprocess exited: duration 578381 ms, exit code 0
 
8372024-06-27T21:57:08.021Zfound 106 output files
8382024-06-27T21:57:08.075Zuploading: /var/svc/log/oxide-sled-agent:default.log (928368 bytes)
8392024-06-27T21:57:09.389Zuploaded: /var/svc/log/oxide-sled-agent:default.log
8402024-06-27T21:57:09.390Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (4373720 bytes)
8412024-06-27T21:57:09.813Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 4373720 -> 4390997
8422024-06-27T21:57:10.886Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
8432024-06-27T21:57:10.886Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52288 bytes)
8442024-06-27T21:57:12.051Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
8452024-06-27T21:57:12.075Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (174443 bytes)
8462024-06-27T21:57:12.236Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 174443 -> 176004
8472024-06-27T21:57:13.308Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
8482024-06-27T21:57:13.309Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (222080 bytes)
8492024-06-27T21:57:13.516Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 222080 -> 224425
8502024-06-27T21:57:14.588Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
8512024-06-27T21:57:14.588Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1301303 bytes)
8522024-06-27T21:57:14.896Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1301303 -> 1318176
8532024-06-27T21:57:15.968Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
8542024-06-27T21:57:15.968Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (693719 bytes)
8552024-06-27T21:57:16.223Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 693719 -> 707459
8562024-06-27T21:57:17.296Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
8572024-06-27T21:57:17.296Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1678 bytes)
8582024-06-27T21:57:18.392Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
8592024-06-27T21:57:18.393Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (258141 bytes)
8602024-06-27T21:57:18.625Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 258141 -> 264354
8612024-06-27T21:57:19.697Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
8622024-06-27T21:57:19.698Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (7735 bytes)
8632024-06-27T21:57:19.768Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 7735 -> 8320
8642024-06-27T21:57:20.840Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
8652024-06-27T21:57:20.840Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5391 bytes)
8662024-06-27T21:57:21.937Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
8672024-06-27T21:57:21.961Zuploading: /pool/ext/0c8a1506-92f8-47f9-bf19-87d5fddc97aa/crypt/zone/oxz_crucible_609b023a-f0db-4bc5-b3e3-395c7ebd6de9/root/var/svc/log/oxide-crucible-agent:default.log (12500 bytes)
8682024-06-27T21:57:23.056Zuploaded: /pool/ext/0c8a1506-92f8-47f9-bf19-87d5fddc97aa/crypt/zone/oxz_crucible_609b023a-f0db-4bc5-b3e3-395c7ebd6de9/root/var/svc/log/oxide-crucible-agent:default.log
8692024-06-27T21:57:23.056Zuploading: /pool/ext/0c8a1506-92f8-47f9-bf19-87d5fddc97aa/crypt/zone/oxz_crucible_609b023a-f0db-4bc5-b3e3-395c7ebd6de9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
8702024-06-27T21:57:24.156Zuploaded: /pool/ext/0c8a1506-92f8-47f9-bf19-87d5fddc97aa/crypt/zone/oxz_crucible_609b023a-f0db-4bc5-b3e3-395c7ebd6de9/root/var/svc/log/oxide-crucible-downstairs:default.log
8712024-06-27T21:57:24.156Zuploading: /pool/ext/0c8a1506-92f8-47f9-bf19-87d5fddc97aa/crypt/zone/oxz_crucible_609b023a-f0db-4bc5-b3e3-395c7ebd6de9/root/var/svc/log/oxide-crucible-downstairs:downstairs-481ab2d7-9b63-489e-90fa-1767823bc469.log (5993 bytes)
8722024-06-27T21:57:25.253Zuploaded: /pool/ext/0c8a1506-92f8-47f9-bf19-87d5fddc97aa/crypt/zone/oxz_crucible_609b023a-f0db-4bc5-b3e3-395c7ebd6de9/root/var/svc/log/oxide-crucible-downstairs:downstairs-481ab2d7-9b63-489e-90fa-1767823bc469.log
8732024-06-27T21:57:25.253Zuploading: /pool/ext/0c8a1506-92f8-47f9-bf19-87d5fddc97aa/crypt/zone/oxz_crucible_609b023a-f0db-4bc5-b3e3-395c7ebd6de9/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
8742024-06-27T21:57:26.349Zuploaded: /pool/ext/0c8a1506-92f8-47f9-bf19-87d5fddc97aa/crypt/zone/oxz_crucible_609b023a-f0db-4bc5-b3e3-395c7ebd6de9/root/var/svc/log/oxide-zone-network-setup:default.log
8752024-06-27T21:57:26.349Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-crucible-agent:default.log (18574 bytes)
8762024-06-27T21:57:27.491Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-crucible-agent:default.log
8772024-06-27T21:57:27.491Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
8782024-06-27T21:57:28.587Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-crucible-downstairs:default.log
8792024-06-27T21:57:28.587Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-crucible-downstairs:downstairs-269c83be-17c8-460b-b156-1fced2e8fd5c.log (3126 bytes)
8802024-06-27T21:57:29.683Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-crucible-downstairs:downstairs-269c83be-17c8-460b-b156-1fced2e8fd5c.log
8812024-06-27T21:57:29.683Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-crucible-downstairs:downstairs-514ec236-50c0-4aac-8335-7ceb53a7aeb3.log (3018 bytes)
8822024-06-27T21:57:30.781Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-crucible-downstairs:downstairs-514ec236-50c0-4aac-8335-7ceb53a7aeb3.log
8832024-06-27T21:57:30.781Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
8842024-06-27T21:57:31.878Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_d5b563b4-5133-4427-9b03-ac003155b154/root/var/svc/log/oxide-zone-network-setup:default.log
8852024-06-27T21:57:31.878Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_pantry_f449a297-ab33-4fdb-895f-7eddde3e04f0/root/var/svc/log/oxide-crucible-pantry:default.log (780 bytes)
8862024-06-27T21:57:32.980Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_pantry_f449a297-ab33-4fdb-895f-7eddde3e04f0/root/var/svc/log/oxide-crucible-pantry:default.log
8872024-06-27T21:57:33.007Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_pantry_f449a297-ab33-4fdb-895f-7eddde3e04f0/root/var/svc/log/oxide-zone-network-setup:default.log (1722 bytes)
8882024-06-27T21:57:34.082Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_crucible_pantry_f449a297-ab33-4fdb-895f-7eddde3e04f0/root/var/svc/log/oxide-zone-network-setup:default.log
8892024-06-27T21:57:34.082Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_nexus_55245028-681c-41bf-9e25-364cbb22b701/root/var/svc/log/oxide-nexus:default.log (39006333 bytes)
8902024-06-27T21:57:35.726Zupload warning: file "/pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_nexus_55245028-681c-41bf-9e25-364cbb22b701/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 39006333 -> 39225569
8912024-06-27T21:57:36.799Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_nexus_55245028-681c-41bf-9e25-364cbb22b701/root/var/svc/log/oxide-nexus:default.log
8922024-06-27T21:57:36.799Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_nexus_55245028-681c-41bf-9e25-364cbb22b701/root/var/svc/log/oxide-opte-interface-setup:default.log (1137 bytes)
8932024-06-27T21:57:37.900Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_nexus_55245028-681c-41bf-9e25-364cbb22b701/root/var/svc/log/oxide-opte-interface-setup:default.log
8942024-06-27T21:57:37.924Zuploading: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_nexus_55245028-681c-41bf-9e25-364cbb22b701/root/var/svc/log/oxide-zone-network-setup:default.log (1661 bytes)
8952024-06-27T21:57:39.002Zuploaded: /pool/ext/0cc0be54-6e3b-407b-b3e5-d1dfef78b065/crypt/zone/oxz_nexus_55245028-681c-41bf-9e25-364cbb22b701/root/var/svc/log/oxide-zone-network-setup:default.log
8962024-06-27T21:57:39.028Zuploading: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_cockroachdb_22c2d21b-f5a1-42c6-902e-4a4ae9d64e11/root/var/svc/log/oxide-cockroach-admin:default.log (4660 bytes)
8972024-06-27T21:57:40.101Zuploaded: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_cockroachdb_22c2d21b-f5a1-42c6-902e-4a4ae9d64e11/root/var/svc/log/oxide-cockroach-admin:default.log
8982024-06-27T21:57:40.101Zuploading: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_cockroachdb_22c2d21b-f5a1-42c6-902e-4a4ae9d64e11/root/var/svc/log/oxide-cockroachdb:default.log (4287 bytes)
8992024-06-27T21:57:41.199Zuploaded: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_cockroachdb_22c2d21b-f5a1-42c6-902e-4a4ae9d64e11/root/var/svc/log/oxide-cockroachdb:default.log
9002024-06-27T21:57:41.199Zuploading: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_cockroachdb_22c2d21b-f5a1-42c6-902e-4a4ae9d64e11/root/var/svc/log/oxide-zone-network-setup:default.log (1689 bytes)
9012024-06-27T21:57:42.296Zuploaded: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_cockroachdb_22c2d21b-f5a1-42c6-902e-4a4ae9d64e11/root/var/svc/log/oxide-zone-network-setup:default.log
9022024-06-27T21:57:42.320Zuploading: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_crucible_633fc376-b890-46c9-b4e8-3fc7a5a7441d/root/var/svc/log/oxide-crucible-agent:default.log (12505 bytes)
9032024-06-27T21:57:43.415Zuploaded: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_crucible_633fc376-b890-46c9-b4e8-3fc7a5a7441d/root/var/svc/log/oxide-crucible-agent:default.log
9042024-06-27T21:57:43.416Zuploading: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_crucible_633fc376-b890-46c9-b4e8-3fc7a5a7441d/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9052024-06-27T21:57:44.513Zuploaded: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_crucible_633fc376-b890-46c9-b4e8-3fc7a5a7441d/root/var/svc/log/oxide-crucible-downstairs:default.log
9062024-06-27T21:57:44.536Zuploading: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_crucible_633fc376-b890-46c9-b4e8-3fc7a5a7441d/root/var/svc/log/oxide-crucible-downstairs:downstairs-61eae3b8-501c-40df-8583-2cdcccdc248d.log (5992 bytes)
9072024-06-27T21:57:45.614Zuploaded: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_crucible_633fc376-b890-46c9-b4e8-3fc7a5a7441d/root/var/svc/log/oxide-crucible-downstairs:downstairs-61eae3b8-501c-40df-8583-2cdcccdc248d.log
9082024-06-27T21:57:45.614Zuploading: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_crucible_633fc376-b890-46c9-b4e8-3fc7a5a7441d/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
9092024-06-27T21:57:46.711Zuploaded: /pool/ext/178c402e-25fa-4170-b7e6-2f9c775c5896/crypt/zone/oxz_crucible_633fc376-b890-46c9-b4e8-3fc7a5a7441d/root/var/svc/log/oxide-zone-network-setup:default.log
9102024-06-27T21:57:46.711Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_clickhouse_f6853b6b-bc83-47aa-af90-807c0f3549ac/root/var/svc/log/oxide-clickhouse:default.log (2277040 bytes)
9112024-06-27T21:57:47.072Zupload warning: file "/pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_clickhouse_f6853b6b-bc83-47aa-af90-807c0f3549ac/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2277040 -> 2514446
9122024-06-27T21:57:48.146Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_clickhouse_f6853b6b-bc83-47aa-af90-807c0f3549ac/root/var/svc/log/oxide-clickhouse:default.log
9132024-06-27T21:57:48.169Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_clickhouse_f6853b6b-bc83-47aa-af90-807c0f3549ac/root/var/svc/log/oxide-zone-network-setup:default.log (1692 bytes)
9142024-06-27T21:57:49.244Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_clickhouse_f6853b6b-bc83-47aa-af90-807c0f3549ac/root/var/svc/log/oxide-zone-network-setup:default.log
9152024-06-27T21:57:49.267Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_cockroachdb_996b85d0-538f-4b7c-9eb0-8c5463f909ba/root/var/svc/log/oxide-cockroach-admin:default.log (4662 bytes)
9162024-06-27T21:57:50.341Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_cockroachdb_996b85d0-538f-4b7c-9eb0-8c5463f909ba/root/var/svc/log/oxide-cockroach-admin:default.log
9172024-06-27T21:57:50.341Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_cockroachdb_996b85d0-538f-4b7c-9eb0-8c5463f909ba/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
9182024-06-27T21:57:51.438Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_cockroachdb_996b85d0-538f-4b7c-9eb0-8c5463f909ba/root/var/svc/log/oxide-cockroachdb:default.log
9192024-06-27T21:57:51.438Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_cockroachdb_996b85d0-538f-4b7c-9eb0-8c5463f909ba/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
9202024-06-27T21:57:52.536Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_cockroachdb_996b85d0-538f-4b7c-9eb0-8c5463f909ba/root/var/svc/log/oxide-zone-network-setup:default.log
9212024-06-27T21:57:52.536Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_crucible_c020b9ba-c327-492c-bd89-f5a2451452f7/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
9222024-06-27T21:57:53.634Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_crucible_c020b9ba-c327-492c-bd89-f5a2451452f7/root/var/svc/log/oxide-crucible-agent:default.log
9232024-06-27T21:57:53.634Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_crucible_c020b9ba-c327-492c-bd89-f5a2451452f7/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9242024-06-27T21:57:54.732Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_crucible_c020b9ba-c327-492c-bd89-f5a2451452f7/root/var/svc/log/oxide-crucible-downstairs:default.log
9252024-06-27T21:57:54.732Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_crucible_c020b9ba-c327-492c-bd89-f5a2451452f7/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
9262024-06-27T21:57:55.830Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_crucible_c020b9ba-c327-492c-bd89-f5a2451452f7/root/var/svc/log/oxide-zone-network-setup:default.log
9272024-06-27T21:57:55.830Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_external_dns_9f5b2399-1d56-4f76-9be2-92c93d620e4f/root/var/svc/log/oxide-external_dns:default.log (26872 bytes)
9282024-06-27T21:57:55.943Zupload warning: file "/pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_external_dns_9f5b2399-1d56-4f76-9be2-92c93d620e4f/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26872 -> 30649
9292024-06-27T21:57:57.012Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_external_dns_9f5b2399-1d56-4f76-9be2-92c93d620e4f/root/var/svc/log/oxide-external_dns:default.log
9302024-06-27T21:57:57.013Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_external_dns_9f5b2399-1d56-4f76-9be2-92c93d620e4f/root/var/svc/log/oxide-opte-interface-setup:default.log (1158 bytes)
9312024-06-27T21:57:58.105Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_external_dns_9f5b2399-1d56-4f76-9be2-92c93d620e4f/root/var/svc/log/oxide-opte-interface-setup:default.log
9322024-06-27T21:57:58.130Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_external_dns_9f5b2399-1d56-4f76-9be2-92c93d620e4f/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
9332024-06-27T21:57:59.198Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_external_dns_9f5b2399-1d56-4f76-9be2-92c93d620e4f/root/var/svc/log/oxide-zone-network-setup:default.log
9342024-06-27T21:57:59.198Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_internal_dns_ced5291f-5534-4721-b9f4-4d7062005e46/root/var/svc/log/oxide-internal_dns:default.log (107366 bytes)
9352024-06-27T21:57:59.351Zupload warning: file "/pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_internal_dns_ced5291f-5534-4721-b9f4-4d7062005e46/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107366 -> 111120
9362024-06-27T21:58:00.420Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_internal_dns_ced5291f-5534-4721-b9f4-4d7062005e46/root/var/svc/log/oxide-internal_dns:default.log
9372024-06-27T21:58:00.420Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_internal_dns_ced5291f-5534-4721-b9f4-4d7062005e46/root/var/svc/log/oxide-zone-network-setup:default.log (1686 bytes)
9382024-06-27T21:58:01.519Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_internal_dns_ced5291f-5534-4721-b9f4-4d7062005e46/root/var/svc/log/oxide-zone-network-setup:default.log
9392024-06-27T21:58:01.519Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/svc/log/oxide-chrony-setup:default.log (14141 bytes)
9402024-06-27T21:58:02.634Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/svc/log/oxide-chrony-setup:default.log
9412024-06-27T21:58:02.634Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/svc/log/oxide-ntp:default.log (529 bytes)
9422024-06-27T21:58:03.726Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/svc/log/oxide-ntp:default.log
9432024-06-27T21:58:03.751Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/svc/log/oxide-opte-interface-setup:default.log (1129 bytes)
9442024-06-27T21:58:04.819Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/svc/log/oxide-opte-interface-setup:default.log
9452024-06-27T21:58:04.819Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/svc/log/oxide-zone-network-setup:default.log (1644 bytes)
9462024-06-27T21:58:05.912Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/svc/log/oxide-zone-network-setup:default.log
9472024-06-27T21:58:05.912Zuploading: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-agent:default.log (29223 bytes)
9482024-06-27T21:58:07.047Zuploaded: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-agent:default.log
9492024-06-27T21:58:07.047Zuploading: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9502024-06-27T21:58:08.139Zuploaded: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-downstairs:default.log
9512024-06-27T21:58:08.139Zuploading: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-downstairs:downstairs-09b77253-3f2b-4864-aff9-f9d22ef18a05.log (5988 bytes)
9522024-06-27T21:58:09.232Zuploaded: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-downstairs:downstairs-09b77253-3f2b-4864-aff9-f9d22ef18a05.log
9532024-06-27T21:58:09.232Zuploading: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-downstairs:downstairs-862632e5-055a-44a4-8e01-af543797736c.log (3017 bytes)
9542024-06-27T21:58:10.324Zuploaded: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-downstairs:downstairs-862632e5-055a-44a4-8e01-af543797736c.log
9552024-06-27T21:58:10.324Zuploading: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-downstairs:downstairs-e15a04b4-1e59-411d-8cf2-aa0a5c595899.log (3126 bytes)
9562024-06-27T21:58:11.417Zuploaded: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-crucible-downstairs:downstairs-e15a04b4-1e59-411d-8cf2-aa0a5c595899.log
9572024-06-27T21:58:11.417Zuploading: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
9582024-06-27T21:58:12.509Zuploaded: /pool/ext/18ff0a95-366c-46ab-9151-131c11e73408/crypt/zone/oxz_crucible_a546cca3-8896-4338-b28d-d1382ed36ec9/root/var/svc/log/oxide-zone-network-setup:default.log
9592024-06-27T21:58:12.509Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_cockroachdb_339d7365-f2f1-4842-a6a8-37d669debe50/root/var/svc/log/oxide-cockroach-admin:default.log (4662 bytes)
9602024-06-27T21:58:13.602Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_cockroachdb_339d7365-f2f1-4842-a6a8-37d669debe50/root/var/svc/log/oxide-cockroach-admin:default.log
9612024-06-27T21:58:13.602Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_cockroachdb_339d7365-f2f1-4842-a6a8-37d669debe50/root/var/svc/log/oxide-cockroachdb:default.log (4314 bytes)
9622024-06-27T21:58:14.701Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_cockroachdb_339d7365-f2f1-4842-a6a8-37d669debe50/root/var/svc/log/oxide-cockroachdb:default.log
9632024-06-27T21:58:14.725Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_cockroachdb_339d7365-f2f1-4842-a6a8-37d669debe50/root/var/svc/log/oxide-zone-network-setup:default.log (1689 bytes)
9642024-06-27T21:58:15.806Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_cockroachdb_339d7365-f2f1-4842-a6a8-37d669debe50/root/var/svc/log/oxide-zone-network-setup:default.log
9652024-06-27T21:58:15.807Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-crucible-agent:default.log (18844 bytes)
9662024-06-27T21:58:16.930Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-crucible-agent:default.log
9672024-06-27T21:58:16.930Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
9682024-06-27T21:58:18.021Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-crucible-downstairs:default.log
9692024-06-27T21:58:18.021Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-crucible-downstairs:downstairs-a56d1f68-6ba3-4585-bade-9d484e60561b.log (6072 bytes)
9702024-06-27T21:58:19.112Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-crucible-downstairs:downstairs-a56d1f68-6ba3-4585-bade-9d484e60561b.log
9712024-06-27T21:58:19.112Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-crucible-downstairs:snapshot-a56d1f68-6ba3-4585-bade-9d484e60561b-bd357839-a321-4a4a-b806-b5f3cf68741c.log (5680 bytes)
9722024-06-27T21:58:20.204Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-crucible-downstairs:snapshot-a56d1f68-6ba3-4585-bade-9d484e60561b-bd357839-a321-4a4a-b806-b5f3cf68741c.log
9732024-06-27T21:58:20.204Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
9742024-06-27T21:58:21.298Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_9fd209f8-91e6-48f0-834c-8c355a85a772/root/var/svc/log/oxide-zone-network-setup:default.log
9752024-06-27T21:58:21.298Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_pantry_71bc30df-1df8-4ef9-83b3-20620cd83994/root/var/svc/log/oxide-crucible-pantry:default.log (765382 bytes)
9762024-06-27T21:58:22.623Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_pantry_71bc30df-1df8-4ef9-83b3-20620cd83994/root/var/svc/log/oxide-crucible-pantry:default.log
9772024-06-27T21:58:22.623Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_pantry_71bc30df-1df8-4ef9-83b3-20620cd83994/root/var/svc/log/oxide-zone-network-setup:default.log (1724 bytes)
9782024-06-27T21:58:23.714Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_pantry_71bc30df-1df8-4ef9-83b3-20620cd83994/root/var/svc/log/oxide-zone-network-setup:default.log
9792024-06-27T21:58:23.739Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_pantry_c2508341-ec19-466a-ac6a-224d24d68ceb/root/var/svc/log/oxide-crucible-pantry:default.log (782 bytes)
9802024-06-27T21:58:24.807Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_pantry_c2508341-ec19-466a-ac6a-224d24d68ceb/root/var/svc/log/oxide-crucible-pantry:default.log
9812024-06-27T21:58:24.832Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_pantry_c2508341-ec19-466a-ac6a-224d24d68ceb/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
9822024-06-27T21:58:25.900Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_crucible_pantry_c2508341-ec19-466a-ac6a-224d24d68ceb/root/var/svc/log/oxide-zone-network-setup:default.log
9832024-06-27T21:58:25.900Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_internal_dns_ea40e74c-2f3c-408e-9464-e0b50adef59f/root/var/svc/log/oxide-internal_dns:default.log (107382 bytes)
9842024-06-27T21:58:26.054Zupload warning: file "/pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_internal_dns_ea40e74c-2f3c-408e-9464-e0b50adef59f/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107382 -> 114893
9852024-06-27T21:58:27.123Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_internal_dns_ea40e74c-2f3c-408e-9464-e0b50adef59f/root/var/svc/log/oxide-internal_dns:default.log
9862024-06-27T21:58:27.123Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_internal_dns_ea40e74c-2f3c-408e-9464-e0b50adef59f/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
9872024-06-27T21:58:28.217Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_internal_dns_ea40e74c-2f3c-408e-9464-e0b50adef59f/root/var/svc/log/oxide-zone-network-setup:default.log
9882024-06-27T21:58:28.217Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_nexus_d678efd8-4911-40fa-bbcb-fd0c410b070e/root/var/svc/log/oxide-nexus:default.log (2460886 bytes)
9892024-06-27T21:58:28.568Zupload warning: file "/pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_nexus_d678efd8-4911-40fa-bbcb-fd0c410b070e/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2460886 -> 2908605
9902024-06-27T21:58:29.641Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_nexus_d678efd8-4911-40fa-bbcb-fd0c410b070e/root/var/svc/log/oxide-nexus:default.log
9912024-06-27T21:58:29.641Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_nexus_d678efd8-4911-40fa-bbcb-fd0c410b070e/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
9922024-06-27T21:58:30.734Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_nexus_d678efd8-4911-40fa-bbcb-fd0c410b070e/root/var/svc/log/oxide-opte-interface-setup:default.log
9932024-06-27T21:58:30.734Zuploading: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_nexus_d678efd8-4911-40fa-bbcb-fd0c410b070e/root/var/svc/log/oxide-zone-network-setup:default.log (1663 bytes)
9942024-06-27T21:58:31.827Zuploaded: /pool/ext/4db0587d-1565-4619-9442-03fd011ad4d4/crypt/zone/oxz_nexus_d678efd8-4911-40fa-bbcb-fd0c410b070e/root/var/svc/log/oxide-zone-network-setup:default.log
9952024-06-27T21:58:31.827Zuploading: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_cockroachdb_e53adb0b-ba71-4da2-a2c5-92cc09852285/root/var/svc/log/oxide-cockroach-admin:default.log (4662 bytes)
9962024-06-27T21:58:32.930Zuploaded: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_cockroachdb_e53adb0b-ba71-4da2-a2c5-92cc09852285/root/var/svc/log/oxide-cockroach-admin:default.log
9972024-06-27T21:58:32.930Zuploading: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_cockroachdb_e53adb0b-ba71-4da2-a2c5-92cc09852285/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
9982024-06-27T21:58:34.028Zuploaded: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_cockroachdb_e53adb0b-ba71-4da2-a2c5-92cc09852285/root/var/svc/log/oxide-cockroachdb:default.log
9992024-06-27T21:58:34.052Zuploading: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_cockroachdb_e53adb0b-ba71-4da2-a2c5-92cc09852285/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
10002024-06-27T21:58:35.125Zuploaded: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_cockroachdb_e53adb0b-ba71-4da2-a2c5-92cc09852285/root/var/svc/log/oxide-zone-network-setup:default.log
10012024-06-27T21:58:35.125Zuploading: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_crucible_f5fbc241-460d-4975-92b3-798d07aefba5/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
10022024-06-27T21:58:36.223Zuploaded: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_crucible_f5fbc241-460d-4975-92b3-798d07aefba5/root/var/svc/log/oxide-crucible-agent:default.log
10032024-06-27T21:58:36.223Zuploading: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_crucible_f5fbc241-460d-4975-92b3-798d07aefba5/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10042024-06-27T21:58:37.320Zuploaded: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_crucible_f5fbc241-460d-4975-92b3-798d07aefba5/root/var/svc/log/oxide-crucible-downstairs:default.log
10052024-06-27T21:58:37.320Zuploading: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_crucible_f5fbc241-460d-4975-92b3-798d07aefba5/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
10062024-06-27T21:58:38.418Zuploaded: /pool/ext/724d1f8c-abf5-4905-a33d-2529f098934e/crypt/zone/oxz_crucible_f5fbc241-460d-4975-92b3-798d07aefba5/root/var/svc/log/oxide-zone-network-setup:default.log
10072024-06-27T21:58:38.418Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_cockroachdb_cd6a1ee5-2fa9-43f0-aeaf-52dfac866d69/root/var/svc/log/oxide-cockroach-admin:default.log (4662 bytes)
10082024-06-27T21:58:39.514Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_cockroachdb_cd6a1ee5-2fa9-43f0-aeaf-52dfac866d69/root/var/svc/log/oxide-cockroach-admin:default.log
10092024-06-27T21:58:39.514Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_cockroachdb_cd6a1ee5-2fa9-43f0-aeaf-52dfac866d69/root/var/svc/log/oxide-cockroachdb:default.log (4315 bytes)
10102024-06-27T21:58:40.612Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_cockroachdb_cd6a1ee5-2fa9-43f0-aeaf-52dfac866d69/root/var/svc/log/oxide-cockroachdb:default.log
10112024-06-27T21:58:40.612Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_cockroachdb_cd6a1ee5-2fa9-43f0-aeaf-52dfac866d69/root/var/svc/log/oxide-zone-network-setup:default.log (1690 bytes)
10122024-06-27T21:58:41.712Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_cockroachdb_cd6a1ee5-2fa9-43f0-aeaf-52dfac866d69/root/var/svc/log/oxide-zone-network-setup:default.log
10132024-06-27T21:58:41.712Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-crucible-agent:default.log (18841 bytes)
10142024-06-27T21:58:42.856Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-crucible-agent:default.log
10152024-06-27T21:58:42.856Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10162024-06-27T21:58:43.957Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-crucible-downstairs:default.log
10172024-06-27T21:58:43.957Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-crucible-downstairs:downstairs-7fc03687-2071-46d3-97d0-fe6de249260d.log (6075 bytes)
10182024-06-27T21:58:45.056Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-crucible-downstairs:downstairs-7fc03687-2071-46d3-97d0-fe6de249260d.log
10192024-06-27T21:58:45.056Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-crucible-downstairs:snapshot-7fc03687-2071-46d3-97d0-fe6de249260d-bd357839-a321-4a4a-b806-b5f3cf68741c.log (5684 bytes)
10202024-06-27T21:58:46.154Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-crucible-downstairs:snapshot-7fc03687-2071-46d3-97d0-fe6de249260d-bd357839-a321-4a4a-b806-b5f3cf68741c.log
10212024-06-27T21:58:46.178Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
10222024-06-27T21:58:47.252Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_crucible_82bcabb1-9d96-4c85-a0af-10305a7a0ac1/root/var/svc/log/oxide-zone-network-setup:default.log
10232024-06-27T21:58:47.252Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_external_dns_4f2572c8-3b18-4eb7-8e8f-1095e95e4e17/root/var/svc/log/oxide-external_dns:default.log (26874 bytes)
10242024-06-27T21:58:47.368Zupload warning: file "/pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_external_dns_4f2572c8-3b18-4eb7-8e8f-1095e95e4e17/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26874 -> 34426
10252024-06-27T21:58:48.441Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_external_dns_4f2572c8-3b18-4eb7-8e8f-1095e95e4e17/root/var/svc/log/oxide-external_dns:default.log
10262024-06-27T21:58:48.441Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_external_dns_4f2572c8-3b18-4eb7-8e8f-1095e95e4e17/root/var/svc/log/oxide-opte-interface-setup:default.log (1159 bytes)
10272024-06-27T21:58:49.538Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_external_dns_4f2572c8-3b18-4eb7-8e8f-1095e95e4e17/root/var/svc/log/oxide-opte-interface-setup:default.log
10282024-06-27T21:58:49.538Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_external_dns_4f2572c8-3b18-4eb7-8e8f-1095e95e4e17/root/var/svc/log/oxide-zone-network-setup:default.log (1705 bytes)
10292024-06-27T21:58:50.636Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_external_dns_4f2572c8-3b18-4eb7-8e8f-1095e95e4e17/root/var/svc/log/oxide-zone-network-setup:default.log
10302024-06-27T21:58:50.636Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_internal_dns_84d53826-1ebf-46ec-a79c-f54806540a7d/root/var/svc/log/oxide-internal_dns:default.log (108182 bytes)
10312024-06-27T21:58:50.807Zupload warning: file "/pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_internal_dns_84d53826-1ebf-46ec-a79c-f54806540a7d/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 108182 -> 115694
10322024-06-27T21:58:51.875Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_internal_dns_84d53826-1ebf-46ec-a79c-f54806540a7d/root/var/svc/log/oxide-internal_dns:default.log
10332024-06-27T21:58:51.875Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_internal_dns_84d53826-1ebf-46ec-a79c-f54806540a7d/root/var/svc/log/oxide-zone-network-setup:default.log (1688 bytes)
10342024-06-27T21:58:52.973Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_internal_dns_84d53826-1ebf-46ec-a79c-f54806540a7d/root/var/svc/log/oxide-zone-network-setup:default.log
10352024-06-27T21:58:52.973Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_oximeter_8d1b5b63-4d66-4bad-a0b8-e0b727e631d6/root/var/svc/log/oxide-oximeter:default.log (1545731 bytes)
10362024-06-27T21:58:53.333Zupload warning: file "/pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_oximeter_8d1b5b63-4d66-4bad-a0b8-e0b727e631d6/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1545731 -> 1953546
10372024-06-27T21:58:54.406Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_oximeter_8d1b5b63-4d66-4bad-a0b8-e0b727e631d6/root/var/svc/log/oxide-oximeter:default.log
10382024-06-27T21:58:54.406Zuploading: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_oximeter_8d1b5b63-4d66-4bad-a0b8-e0b727e631d6/root/var/svc/log/oxide-zone-network-setup:default.log (1680 bytes)
10392024-06-27T21:58:55.506Zuploaded: /pool/ext/e3d2ef40-7433-4305-912d-ec76a9b15c1d/crypt/zone/oxz_oximeter_8d1b5b63-4d66-4bad-a0b8-e0b727e631d6/root/var/svc/log/oxide-zone-network-setup:default.log
10402024-06-27T21:58:55.506Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-agent:default.log (32955 bytes)
10412024-06-27T21:58:56.671Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-agent:default.log
10422024-06-27T21:58:56.671Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10432024-06-27T21:58:57.769Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:default.log
10442024-06-27T21:58:57.769Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:downstairs-2ab3593d-c760-43b8-a461-f585a7b2dfed.log (3126 bytes)
10452024-06-27T21:58:58.866Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:downstairs-2ab3593d-c760-43b8-a461-f585a7b2dfed.log
10462024-06-27T21:58:58.867Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:downstairs-a165be3c-2dc9-4e51-a247-96660f2a91ef.log (6077 bytes)
10472024-06-27T21:58:59.965Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:downstairs-a165be3c-2dc9-4e51-a247-96660f2a91ef.log
10482024-06-27T21:58:59.965Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:downstairs-f311d1d5-5bbc-40aa-9816-920626e6637e.log (3019 bytes)
10492024-06-27T21:59:01.063Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:downstairs-f311d1d5-5bbc-40aa-9816-920626e6637e.log
10502024-06-27T21:59:01.063Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:snapshot-a165be3c-2dc9-4e51-a247-96660f2a91ef-bd357839-a321-4a4a-b806-b5f3cf68741c.log (5684 bytes)
10512024-06-27T21:59:02.160Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-crucible-downstairs:snapshot-a165be3c-2dc9-4e51-a247-96660f2a91ef-bd357839-a321-4a4a-b806-b5f3cf68741c.log
10522024-06-27T21:59:02.160Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
10532024-06-27T21:59:03.258Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_crucible_9ef26a0e-ea1c-4ec7-8e58-ecb23473ac6f/root/var/svc/log/oxide-zone-network-setup:default.log
10542024-06-27T21:59:03.258Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_nexus_bd627fc3-4ded-4844-a604-cef35ec5c7d1/root/var/svc/log/oxide-nexus:default.log (2731190 bytes)
10552024-06-27T21:59:03.632Zupload warning: file "/pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_nexus_bd627fc3-4ded-4844-a604-cef35ec5c7d1/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2731190 -> 3308293
10562024-06-27T21:59:04.705Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_nexus_bd627fc3-4ded-4844-a604-cef35ec5c7d1/root/var/svc/log/oxide-nexus:default.log
10572024-06-27T21:59:04.729Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_nexus_bd627fc3-4ded-4844-a604-cef35ec5c7d1/root/var/svc/log/oxide-opte-interface-setup:default.log (1138 bytes)
10582024-06-27T21:59:05.804Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_nexus_bd627fc3-4ded-4844-a604-cef35ec5c7d1/root/var/svc/log/oxide-opte-interface-setup:default.log
10592024-06-27T21:59:05.804Zuploading: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_nexus_bd627fc3-4ded-4844-a604-cef35ec5c7d1/root/var/svc/log/oxide-zone-network-setup:default.log (1660 bytes)
10602024-06-27T21:59:06.901Zuploaded: /pool/ext/f8b5491e-78ae-4725-a4e0-5d2f23407448/crypt/zone/oxz_nexus_bd627fc3-4ded-4844-a604-cef35ec5c7d1/root/var/svc/log/oxide-zone-network-setup:default.log
10612024-06-27T21:59:06.901Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/measurements.log (20276 bytes)
10622024-06-27T21:59:06.995Zupload warning: file "/pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/measurements.log" changed size mid upload: 20276 -> 24523
10632024-06-27T21:59:08.068Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/measurements.log
10642024-06-27T21:59:08.095Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/statistics.log (13104 bytes)
10652024-06-27T21:59:08.163Zupload warning: file "/pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/statistics.log" changed size mid upload: 13104 -> 16263
10662024-06-27T21:59:09.236Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/statistics.log
10672024-06-27T21:59:09.236Zuploading: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/tracking.log (1850 bytes)
10682024-06-27T21:59:09.285Zupload warning: file "/pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/tracking.log" changed size mid upload: 1850 -> 2114
10692024-06-27T21:59:10.362Zuploaded: /pool/ext/182c8b69-8eb8-448b-8138-5463656cb8fb/crypt/zone/oxz_ntp_3abc83dd-8408-45a5-a400-b72aa3d9dfb6/root/var/log/chrony/tracking.log