01JD3GB6N94KKRSZS13T62PDRB: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
        "/tmp/kstat/*.kstat",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.33",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01JD3GCNS45J9J16FP67HV518Z

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-11-20T01:19:05.420Zjob dependencies complete; ready to run (waiting for 35 m 27 s)
22024-11-20T02:08:50.218Zjob assigned to worker 01JD3MYTY1ZZ3CWRN7ZTVFTBM4 [factory lab, buskin/12502] (queued for 49 m 44 s)
32024-11-20T02:08:50.481Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-11-20T02:08:50.529Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-11-20T02:08:50.566Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-11-20T02:08:50.601Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-11-20T02:08:50.634Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-11-20T02:08:50.668ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-11-20T02:08:50.701Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
102024-11-20T02:08:50.735ZOxide Helios Version helios-2.0.22827 64-bit
112024-11-20T02:08:50.769ZConfiguring devices.
122024-11-20T02:08:50.802Z##################################################
132024-11-20T02:08:50.835Z#### ############# ##
142024-11-20T02:08:50.869Z### ### ############ ##
152024-11-20T02:08:50.902Z## ### # ## ### ## Oxide Computer Company ##
162024-11-20T02:08:50.936Z## ## ## ### # ### ##
172024-11-20T02:08:50.969Z## # ### #### #### This Station Under ##
182024-11-20T02:08:51.002Z### ### #### # ### Computer Control ##
192024-11-20T02:08:51.036Z#### #### ### ## ##
202024-11-20T02:08:51.069Z##################################################
212024-11-20T02:08:51.103ZHostname: buskin
222024-11-20T02:08:51.136ZLoading smf(7) service descriptions:
232024-11-20T02:08:51.601Zdownloading input: /input/package/work/package.tar.gz
242024-11-20T02:14:08.242Zdownloaded input: /input/package/work/package.tar.gz
 
252024-11-20T02:14:08.242Zstarting task 0: "setup"
262024-11-20T02:14:08.266Z++ uname -s
272024-11-20T02:14:08.266Z+ kern=SunOS
282024-11-20T02:14:08.266Z+ case "$kern" in
292024-11-20T02:14:08.266Z+ groupadd -g 12345 build
302024-11-20T02:14:08.266Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
312024-11-20T02:14:10.261Z+ zfs create -o mountpoint=/work rpool/work
322024-11-20T02:14:10.286Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
332024-11-20T02:14:10.286Z+ home_fs=zfs
342024-11-20T02:14:10.286Z+ [[ zfs == autofs ]]
352024-11-20T02:14:10.286Z+ mkdir -p /home/build
362024-11-20T02:14:10.286Z+ chown build:build /home/build /work
372024-11-20T02:14:12.289Z+ chmod 0700 /home/build /work
382024-11-20T02:14:12.312Zprocess exited: duration 4050 ms, exit code 0
 
392024-11-20T02:14:12.359Zstarting task 1: "authentication"
402024-11-20T02:14:12.402Zprocess exited: duration 43 ms, exit code 0
 
412024-11-20T02:14:12.448Zstarting task 2: "build"
422024-11-20T02:14:12.473Z+ trap _exit_trap EXIT
432024-11-20T02:14:12.473Z+ OPTE_COMMIT=f3002b356da7d0e4ca15beb66a5566a92919baaa
442024-11-20T02:14:12.473Z+ [[ xf3002b356da7d0e4ca15beb66a5566a92919baaa != \x ]]
452024-11-20T02:14:12.474Z+ curl -sSfOL https://buildomat.eng.oxide.computer/public/file/oxidecomputer/opte/module/f3002b356da7d0e4ca15beb66a5566a92919baaa/xde
462024-11-20T02:14:23.115Z+ pfexec rem_drv xde
472024-11-20T02:14:23.138Z+ pfexec mv xde /kernel/drv/amd64/xde
482024-11-20T02:14:23.208Z+ pfexec add_drv xde
492024-11-20T02:14:23.331Z+ curl -sSfOL https://buildomat.eng.oxide.computer/public/file/oxidecomputer/opte/release/f3002b356da7d0e4ca15beb66a5566a92919baaa/opteadm
502024-11-20T02:14:33.143Z+ chmod +x opteadm
512024-11-20T02:14:33.166Z+ cp opteadm /tmp/opteadm
522024-11-20T02:14:33.194Z+ pfexec mv opteadm /opt/oxide/opte/bin/opteadm
532024-11-20T02:14:33.267Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
542024-11-20T02:14:33.401Zsecpolicy_fs_linkdir: 0x55 = 0x55
552024-11-20T02:14:33.401Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
562024-11-20T02:14:33.401Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
572024-11-20T02:14:33.401Zsecpolicy_fs_linkdir+3: 0 = 0xe5
582024-11-20T02:14:33.401Zsecpolicy_fs_linkdir+4: 0 = 0xb8
592024-11-20T02:14:33.401Zsecpolicy_fs_linkdir+5: 0 = 0x1
602024-11-20T02:14:33.401Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
612024-11-20T02:14:33.401Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
622024-11-20T02:14:33.424Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
632024-11-20T02:14:33.424Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
642024-11-20T02:14:33.424Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
652024-11-20T02:14:33.424Z+ [[ -d /opt/oxide ]]
662024-11-20T02:14:33.424Z+ pfexec mv /opt/oxide /opt/oxide-underneath
672024-11-20T02:14:33.424Z+ pfexec mkdir /opt/oxide
682024-11-20T02:14:33.424Z+ pfexec mount -F tmpfs -O swap /opt/oxide
692024-11-20T02:14:33.424Z+ [[ -d /opt/oxide-underneath ]]
702024-11-20T02:14:33.425Z+ cd /opt/oxide-underneath
712024-11-20T02:14:33.425Z+ pfexec tar ceEp@/f - .
722024-11-20T02:14:33.425Z+ cd /opt/oxide
732024-11-20T02:14:33.425Z+ pfexec tar xveEp@/f -
742024-11-20T02:14:33.468Zx ., 0 bytes, 0 tape blocks
752024-11-20T02:14:33.469Zx ./opte, 0 bytes, 0 tape blocks
762024-11-20T02:14:33.469Zx ./opte/bin, 0 bytes, 0 tape blocks
772024-11-20T02:14:33.469Zx ./opte/bin/opteadm, 55763696 bytes, 108914 tape blocks
782024-11-20T02:14:33.491Z+ pfexec rm -rf /opt/oxide-underneath
792024-11-20T02:14:33.491Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
802024-11-20T02:14:33.514Z+ pfexec mkdir /opt/oxide/work
812024-11-20T02:14:33.514Z+ pfexec chown build:build /opt/oxide/work
822024-11-20T02:14:33.515Z+ cd /opt/oxide/work
832024-11-20T02:14:33.515Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
842024-11-20T02:14:47.314ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
852024-11-20T02:14:47.314Zx .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks
862024-11-20T02:14:47.314Zx out/target/test, 107 bytes, 1 tape blocks
872024-11-20T02:14:47.314Zx out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks
882024-11-20T02:14:47.314Zx package-manifest.toml, 32501 bytes, 64 tape blocks
892024-11-20T02:14:47.314Zx smf/sled-agent/non-gimlet/config.toml, 3569 bytes, 7 tape blocks
902024-11-20T02:14:47.314Zx target/release/omicron-package, 37188944 bytes, 72635 tape blocks
912024-11-20T02:14:47.314Zx target/release/xtask, 12031696 bytes, 23500 tape blocks
922024-11-20T02:14:47.314Zx target/debug/bootstrap, 214814184 bytes, 419559 tape blocks
932024-11-20T02:14:47.314Zx tests/bootstrap-f65635f2e4439db7, 24826920 bytes, 48491 tape blocks
942024-11-20T02:14:47.315Zx tests/commtest-42121a4e7222f4ec, 25621968 bytes, 50043 tape blocks
952024-11-20T02:14:47.315Zx tests/dhcp_server-9802ee68cc8d4054, 24826936 bytes, 48491 tape blocks
962024-11-20T02:14:47.315Zx tests/end_to_end_tests-4db006a8b6aa2348, 233352616 bytes, 455767 tape blocks
972024-11-20T02:14:47.315Zx out/clickhouse.tar.gz, 292902113 bytes, 572075 tape blocks
982024-11-20T02:14:47.316Zx out/clickhouse_keeper.tar.gz, 292888318 bytes, 572048 tape blocks
992024-11-20T02:14:47.316Zx out/clickhouse_server.tar.gz, 292891971 bytes, 572055 tape blocks
1002024-11-20T02:14:47.316Zx out/cockroachdb.tar.gz, 137768136 bytes, 269079 tape blocks
1012024-11-20T02:14:47.316Zx out/crucible-dtrace.tar, 84480 bytes, 165 tape blocks
1022024-11-20T02:14:47.316Zx out/crucible-pantry-zone.tar.gz, 28826711 bytes, 56303 tape blocks
1032024-11-20T02:14:47.316Zx out/crucible-zone.tar.gz, 37236556 bytes, 72728 tape blocks
1042024-11-20T02:14:47.316Zx out/external-dns.tar.gz, 36102680 bytes, 70514 tape blocks
1052024-11-20T02:14:47.316Zx out/internal-dns.tar.gz, 36105194 bytes, 70518 tape blocks
1062024-11-20T02:14:47.316Zx out/mg-ddm-gz.tar, 64164864 bytes, 125322 tape blocks
1072024-11-20T02:14:47.316Zx out/nexus.tar.gz, 102772896 bytes, 200729 tape blocks
1082024-11-20T02:14:47.340Zx out/ntp.tar.gz, 10587709 bytes, 20680 tape blocks
1092024-11-20T02:14:47.340Zx out/omicron-gateway-softnpu.tar.gz, 24446739 bytes, 47748 tape blocks
1102024-11-20T02:14:47.340Zx out/omicron-sled-agent.tar, 115551232 bytes, 225686 tape blocks
1112024-11-20T02:14:47.340Zx out/overlay.tar.gz, 2622 bytes, 6 tape blocks
1122024-11-20T02:14:47.340Zx out/oximeter.tar.gz, 52640714 bytes, 102814 tape blocks
1132024-11-20T02:14:47.340Zx out/oxlog.tar, 3162112 bytes, 6176 tape blocks
1142024-11-20T02:14:47.340Zx out/probe.tar.gz, 2829470 bytes, 5527 tape blocks
1152024-11-20T02:14:47.340Zx out/propolis-server.tar.gz, 68181717 bytes, 133168 tape blocks
1162024-11-20T02:14:47.340Zx out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks
1172024-11-20T02:14:47.340Zx out/switch-softnpu.tar.gz, 242784781 bytes, 474190 tape blocks
1182024-11-20T02:14:47.340Z
1192024-11-20T02:14:47.340Zreal 13.804849920
1202024-11-20T02:14:47.340Zuser 12.185220346
1212024-11-20T02:14:47.341Zsys 2.787865194
1222024-11-20T02:14:47.341Ztrap 0.000544658
1232024-11-20T02:14:47.341Ztflt 0.000000000
1242024-11-20T02:14:47.341Zdflt 0.000000000
1252024-11-20T02:14:47.341Zkflt 0.000000000
1262024-11-20T02:14:47.341Zlock 0.000000000
1272024-11-20T02:14:47.341Zslp 12.286460718
1282024-11-20T02:14:47.341Zlat 0.347369074
1292024-11-20T02:14:47.341Zstop 0.000140022
1302024-11-20T02:14:47.341Z+ source .github/buildomat/ci-env.sh
1312024-11-20T02:14:47.341Z++ export CARGO_TERM_COLOR=always
1322024-11-20T02:14:47.341Z++ CARGO_TERM_COLOR=always
1332024-11-20T02:14:47.341Z+ bmat address ls
1342024-11-20T02:14:47.341ZNAME CIDR FIRST LAST COUNT
1352024-11-20T02:14:47.341Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
1362024-11-20T02:14:47.341Z++ bmat address ls -f extra -Ho first,last,count
1372024-11-20T02:14:47.341Z+ set -- 10.151.1.164 10.151.1.227 64
1382024-11-20T02:14:47.341Z+ EXTRA_IP_START=10.151.1.164
1392024-11-20T02:14:47.341Z+ EXTRA_IP_END=10.151.1.227
1402024-11-20T02:14:47.341Z+ EXTRA_IP_COUNT=64
1412024-11-20T02:14:47.341Z+ (( EXTRA_IP_COUNT >= 32 ))
1422024-11-20T02:14:47.341Z+ EXTRA_IP_BASE=10.151.1
1432024-11-20T02:14:47.341Z+ EXTRA_IP_FOCTET=164
1442024-11-20T02:14:47.341Z+ EXTRA_IP_LOCTET=227
1452024-11-20T02:14:47.341Z+ SERVICE_IP_POOL_START=10.151.1.164
1462024-11-20T02:14:47.341Z+ SERVICE_IP_POOL_END=10.151.1.173
1472024-11-20T02:14:47.341Z+ DNS_IP1=10.151.1.164
1482024-11-20T02:14:47.341Z+ DNS_IP2=10.151.1.165
1492024-11-20T02:14:47.341Z+ UPLINK_IP=10.151.1.174
1502024-11-20T02:14:47.341Z+ IPPOOL_START=10.151.1.175
1512024-11-20T02:14:47.341Z+ IPPOOL_END=10.151.1.227
1522024-11-20T02:14:47.341Z++ ipadm show-addr -po type,addr
1532024-11-20T02:14:47.341Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1542024-11-20T02:14:47.364Z+ GATEWAY_IP=10.151.1.100
1552024-11-20T02:14:47.365Z+ [[ -n 10.151.1.100 ]]
1562024-11-20T02:14:47.365Z+ ping -s 10.151.1.100 56 1
1572024-11-20T02:14:47.365ZPING 10.151.1.100: 56 data bytes
1582024-11-20T02:14:47.365Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.020 ms
1592024-11-20T02:14:47.365Z
1602024-11-20T02:14:47.365Z----10.151.1.100 PING Statistics----
1612024-11-20T02:14:47.365Z1 packets transmitted, 1 packets received, 0% packet loss
1622024-11-20T02:14:47.365Zround-trip (ms) min/avg/max/stddev = 0.020/0.020/0.020/-nan
1632024-11-20T02:14:47.365Z++ arp -an
1642024-11-20T02:14:47.365Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
1652024-11-20T02:14:47.365Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
1662024-11-20T02:14:47.365Z+ routeadm -e ipv4-forwarding -u
1672024-11-20T02:14:47.467Z+ PXA_START=10.151.1.164
1682024-11-20T02:14:47.467Z+ PXA_END=10.151.1.227
1692024-11-20T02:14:47.467Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1702024-11-20T02:14:47.664Z+ ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.1.100 --gateway-mac 18:c0:4d:0d:9f:b2 --pxa-start 10.151.1.164 --pxa-end 10.151.1.227
1712024-11-20T02:14:47.687ZCouldn't find Cargo.toml, using /opt/oxide/work as workspace root
1722024-11-20T02:14:47.688Zcreating virtual hardware
1732024-11-20T02:14:47.688Zcreating /scratch/m2_0.vdev
1742024-11-20T02:14:47.688Zcreating /scratch/m2_1.vdev
1752024-11-20T02:14:47.688Zcreating /scratch/u2_0.vdev
1762024-11-20T02:14:47.688Zcreating /scratch/u2_1.vdev
1772024-11-20T02:14:47.688Zcreating /scratch/u2_2.vdev
1782024-11-20T02:14:47.688Zcreating /scratch/u2_3.vdev
1792024-11-20T02:14:47.688Zcreating /scratch/u2_4.vdev
1802024-11-20T02:14:47.688Zcreating /scratch/u2_5.vdev
1812024-11-20T02:14:47.688Zcreating /scratch/u2_6.vdev
1822024-11-20T02:14:47.688Zcreating /scratch/u2_7.vdev
1832024-11-20T02:14:47.688Zcreating /scratch/u2_8.vdev
1842024-11-20T02:14:47.711ZSimnet net0/sc0_0 exists
1852024-11-20T02:14:47.734ZSimnet net1/sc1_0 exists
1862024-11-20T02:14:47.734ZVnic sc0_1 exists
1872024-11-20T02:15:00.124ZUsing 10.151.1.100 as gateway ip
1882024-11-20T02:15:00.124Zusing 18:C0:4D:0D:9F:B2 as gateway mac
1892024-11-20T02:15:00.124Zconfiguring SoftNPU ARP entry
1902024-11-20T02:15:00.151Zconfiguring SoftNPU proxy ARP
1912024-11-20T02:15:00.206ZSoftNPU state:
1922024-11-20T02:15:00.206Z local v6:
1932024-11-20T02:15:00.206Z local v4:
1942024-11-20T02:15:00.206Z router v6:
1952024-11-20T02:15:00.206Z router v4_idx:
1962024-11-20T02:15:00.206Z router v4_routes:
1972024-11-20T02:15:00.206Z resolver v4:
1982024-11-20T02:15:00.206Z 10.151.1.100 -> 18:c0:4d:0d:9f:b2
1992024-11-20T02:15:00.229Z resolver v6:
2002024-11-20T02:15:00.229Z nat v4:
2012024-11-20T02:15:00.229Z nat_v6:
2022024-11-20T02:15:00.230Z port_mac:
2032024-11-20T02:15:00.230Z proxy arp:
2042024-11-20T02:15:00.230Z 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
2052024-11-20T02:15:00.230Zcreated virtual hardware
2062024-11-20T02:15:00.230Z
2072024-11-20T02:15:00.230Zreal 12.538666959
2082024-11-20T02:15:00.230Zuser 0.671346271
2092024-11-20T02:15:00.230Zsys 3.134736711
2102024-11-20T02:15:00.230Ztrap 0.000073048
2112024-11-20T02:15:00.230Ztflt 0.000153334
2122024-11-20T02:15:00.230Zdflt 0.000488818
2132024-11-20T02:15:00.230Zkflt 0.000016059
2142024-11-20T02:15:00.230Zlock 9:45.329632353
2152024-11-20T02:15:00.230Zslp 37.828836741
2162024-11-20T02:15:00.230Zlat 0.080861297
2172024-11-20T02:15:00.230Zstop 0.375800987
2182024-11-20T02:15:00.230Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
2192024-11-20T02:15:00.254Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
2202024-11-20T02:15:00.254Z+ diff -u pkg/config.toml~ pkg/config.toml
2212024-11-20T02:15:00.254Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
2222024-11-20T02:15:00.254Z+++ pkg/config.toml Wed Nov 20 02:15:00 2024
2232024-11-20T02:15:00.254Z@@ -29,18 +29,18 @@
2242024-11-20T02:15:00.254Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
2252024-11-20T02:15:00.254Z # followed by a string that is embedded into their fake serial values.
2262024-11-20T02:15:00.254Z vdevs = [
2272024-11-20T02:15:00.254Z- "m2_0.vdev",
2282024-11-20T02:15:00.254Z- "m2_1.vdev",
2292024-11-20T02:15:00.255Z+ "/scratch/m2_0.vdev",
2302024-11-20T02:15:00.255Z+ "/scratch/m2_1.vdev",
2312024-11-20T02:15:00.255Z
2322024-11-20T02:15:00.255Z- "u2_0.vdev",
2332024-11-20T02:15:00.255Z- "u2_1.vdev",
2342024-11-20T02:15:00.255Z- "u2_2.vdev",
2352024-11-20T02:15:00.255Z- "u2_3.vdev",
2362024-11-20T02:15:00.255Z- "u2_4.vdev",
2372024-11-20T02:15:00.255Z- "u2_5.vdev",
2382024-11-20T02:15:00.255Z- "u2_6.vdev",
2392024-11-20T02:15:00.255Z- "u2_7.vdev",
2402024-11-20T02:15:00.255Z- "u2_8.vdev",
2412024-11-20T02:15:00.255Z+ "/scratch/u2_0.vdev",
2422024-11-20T02:15:00.255Z+ "/scratch/u2_1.vdev",
2432024-11-20T02:15:00.255Z+ "/scratch/u2_2.vdev",
2442024-11-20T02:15:00.255Z+ "/scratch/u2_3.vdev",
2452024-11-20T02:15:00.255Z+ "/scratch/u2_4.vdev",
2462024-11-20T02:15:00.255Z+ "/scratch/u2_5.vdev",
2472024-11-20T02:15:00.255Z+ "/scratch/u2_6.vdev",
2482024-11-20T02:15:00.255Z+ "/scratch/u2_7.vdev",
2492024-11-20T02:15:00.255Z+ "/scratch/u2_8.vdev",
2502024-11-20T02:15:00.255Z ]
2512024-11-20T02:15:00.255Z
2522024-11-20T02:15:00.255Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
2532024-11-20T02:15:00.255Z+ true
2542024-11-20T02:15:00.255Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2552024-11-20T02:15:00.255Z+ SILO_NAME=recovery
2562024-11-20T02:15:00.255Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
2572024-11-20T02:15:00.255Z+ EXTERNAL_DNS_DOMAIN=oxide.test
2582024-11-20T02:15:00.255Z+ sed -i~ '
2592024-11-20T02:15:00.256Z /^external_dns_ips/c\
2602024-11-20T02:15:00.256Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2612024-11-20T02:15:00.256Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
2622024-11-20T02:15:00.256Z /^first/c\
2632024-11-20T02:15:00.256Zfirst = "10.151.1.164"
2642024-11-20T02:15:00.257Z /^last/c\
2652024-11-20T02:15:00.257Zlast = "10.151.1.173"
2662024-11-20T02:15:00.257Z }
2672024-11-20T02:15:00.257Z /^infra_ip_first/c\
2682024-11-20T02:15:00.257Zinfra_ip_first = "10.151.1.174"
2692024-11-20T02:15:00.257Z /^infra_ip_last/c\
2702024-11-20T02:15:00.257Zinfra_ip_last = "10.151.1.174"
2712024-11-20T02:15:00.257Z /^\[\[rack_network_config.ports/,/^$/ {
2722024-11-20T02:15:00.257Z /^routes/c\
2732024-11-20T02:15:00.257Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
2742024-11-20T02:15:00.257Z /^addresses/c\
2752024-11-20T02:15:00.257Zaddresses = \[{address = "10.151.1.174/24"} \]
2762024-11-20T02:15:00.257Z }
2772024-11-20T02:15:00.257Z' pkg/config-rss.toml
2782024-11-20T02:15:00.281Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
2792024-11-20T02:15:00.281Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
2802024-11-20T02:15:00.281Z+++ pkg/config-rss.toml Wed Nov 20 02:15:01 2024
2812024-11-20T02:15:00.281Z@@ -33,7 +33,7 @@
2822024-11-20T02:15:00.281Z # the DNS domain delegated to the rack by the customer. Each of these addresses
2832024-11-20T02:15:00.281Z # must be contained in one of the "internal services" IP Pool ranges listed
2842024-11-20T02:15:00.281Z # below.
2852024-11-20T02:15:00.281Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
2862024-11-20T02:15:00.281Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
2872024-11-20T02:15:00.282Z
2882024-11-20T02:15:00.282Z # Initial TLS certificates for the external API
2892024-11-20T02:15:00.282Z #
2902024-11-20T02:15:00.282Z@@ -69,8 +69,8 @@
2912024-11-20T02:15:00.282Z #
2922024-11-20T02:15:00.282Z # For more on this and what to put here, see docs/how-to-run.adoc.
2932024-11-20T02:15:00.282Z [[internal_services_ip_pool_ranges]]
2942024-11-20T02:15:00.282Z-first = "192.168.1.20"
2952024-11-20T02:15:00.282Z-last = "192.168.1.29"
2962024-11-20T02:15:00.282Z+first = "10.151.1.164"
2972024-11-20T02:15:00.282Z+last = "10.151.1.173"
2982024-11-20T02:15:00.283Z
2992024-11-20T02:15:00.283Z # TODO - this configuration is subject to change going forward. Ultimately these
3002024-11-20T02:15:00.283Z # parameters should be provided to the control plane via wicket, but we need to
3012024-11-20T02:15:00.283Z@@ -91,8 +91,8 @@
3022024-11-20T02:15:00.283Z # A range of IP addresses used by Boundary Services on the external network. In
3032024-11-20T02:15:00.283Z # a real system, these would be addresses of the uplink ports on the Sidecar.
3042024-11-20T02:15:00.283Z # With softnpu, only one address is used.
3052024-11-20T02:15:00.283Z-infra_ip_first = "192.168.1.30"
3062024-11-20T02:15:00.283Z-infra_ip_last = "192.168.1.30"
3072024-11-20T02:15:00.283Z+infra_ip_first = "10.151.1.174"
3082024-11-20T02:15:00.283Z+infra_ip_last = "10.151.1.174"
3092024-11-20T02:15:00.283Z
3102024-11-20T02:15:00.283Z # Configurations for BGP routers to run on the scrimlets.
3112024-11-20T02:15:00.283Z bgp = []
3122024-11-20T02:15:00.283Z@@ -100,9 +100,9 @@
3132024-11-20T02:15:00.283Z # You can configure multiple uplinks by repeating the following stanza
3142024-11-20T02:15:00.283Z [[rack_network_config.ports]]
3152024-11-20T02:15:00.283Z # Routes associated with this port.
3162024-11-20T02:15:00.283Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
3172024-11-20T02:15:00.283Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
3182024-11-20T02:15:00.283Z # Addresses associated with this port.
3192024-11-20T02:15:00.284Z-addresses = [{address = "192.168.1.30/24"}]
3202024-11-20T02:15:00.284Z+addresses = [{address = "10.151.1.174/24"} ]
3212024-11-20T02:15:00.284Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
3222024-11-20T02:15:00.284Z port = "qsfp0"
3232024-11-20T02:15:00.284Z # The speed of this port.
3242024-11-20T02:15:00.284Z+ true
3252024-11-20T02:15:00.284Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
3262024-11-20T02:15:00.284Za pkg/config-rss.toml 8K
3272024-11-20T02:15:00.284Za pkg/config.toml 4K
3282024-11-20T02:15:00.284Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
3292024-11-20T02:15:00.284Z+ TLS_NAME=recovery.sys.oxide.test
3302024-11-20T02:15:00.284Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
3312024-11-20T02:15:00.665Z........+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*............+.............+..+...+..........+..+...+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+....+..............+....+.....+......+.+......+..+.............+.........+...+..................+.....+...+....+..+.+...+..............+................+......+.....+.........+.........+...+....+....................+......+..........+..+...............+.+.....+.+......+...+......+........+............+...+..........+...........+.+....................+....+..+.........+...+.............+...+............+..+.............+........+.+.....+...+................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3322024-11-20T02:15:02.989Z...+...+....+...+..+......+...............+.......+.....+.......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+..+...+......+....+......+.....+.+..............+............+...+.........+......+.......+...+..+.............+......+...+..+......+...+.........+.......+......+..+.......+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+......+.........+...........+.......+...+.....+....+..+.........+.......+...+.........+........+.........+...+.......+.........+......+..............+.........+..........+.....+............+......+............+......................+...........+...+.....................+..........+...+........+...+....+........+.......+...........................+........+...+...+.......+...+............+..+.+..+...+.......+..+.............+...............+..+.+......+...+..+...+..........+...........+.+...+..+..........+......+..+...+...............+..................+..................................+......+......+...+......+...........+.+..+.......+...+........+.........................+.....+.........+.........+.+........+.+..+...+.+..........................+.......+..+.+..+...+...+....+..+.............+..+......+.........+......+............+.+...........+..........+.....+...+...+....+.....+......+...+.+...+...+...............+.........+...+..+....+.....+....+...............+..+...............+....+..+.........+...+..........+...........+......+....+.........+........+......................+.....+.+..............+......+............+.............+.....+....+.....+.......+........+.+......+.........+..+............+.+...........+....+......+...+............+...+...+...............+...+..+....+.....+...+.+..+...........................+.............+............+..+.........+.+.........+...........+.............+..+...+...+...+.........+.+.........+..+.+....................+....+..........................+..........+..................+.........+.....+...+....+......+.........+.........+..+............+.......+.....+....+.........+...+............+...........+.+......+...+.....+.+.....+.....................+..................+.+......+...+..............+.+.........+..+....+........................+......+......+........+...............+...+....+......+...+..+..........+.........+...+.....+.+.........+...+........................+........+.............+........+.+.........+..+........................+........................+.+...+..+.....................+.......+..+......+...+....+......+.....+....+..+....+..............+.......+...+........+...................+...........+...+.+.....+.+.....+....+...+...+........+.......+...+.........+..+......+............+.+..+.........+.+................................+...+.......+......+.........+............+........+......+............+.............+......+.....+...+..........+..................+.....+.......+............+...............+......+..+...+........................+..........+.....+...............+..................+.+...............+..+...............+....+.....+...............+.+...+......+...........+...+......+.+.....+............+.+..+....+........+...+...+.......+...+.....+....+...........+.......+........+.......+.........+...+..+....+............+..+.+..+.............+.....+.........+................+..............+.+......+..............+..........+.....+................+...+......+............+..+..........+...+........+............+...+......+.........+.+......+...+..+..........+..+.+......+...+........+....+...+.....+.+.....+.+...+............+......+........+............+...+.+.....+.+..................+..............+......+.......+........+....+..+...................+..+....+..........................+...+..........+..+...............+..........+.........+...+...+...+.....+.+.....+.........+.+........+...........................+....+..............+.+......+......+........+.+.....+...................+.....+.+.....+................+.....+...............+....+.....+............................+..+....+.....................+........+...+...............+.......+............+........+.......+...+...+................................+..........+............+.....+.+............+.................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
3332024-11-20T02:15:03.013Z-----
3342024-11-20T02:15:03.013Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3352024-11-20T02:15:03.013Za pkg/initial-tls-cert.pem 2K
3362024-11-20T02:15:03.013Za pkg/initial-tls-key.pem 4K
3372024-11-20T02:15:03.013Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
3382024-11-20T02:15:03.013Z+ rmdir pkg
3392024-11-20T02:15:03.013Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
3402024-11-20T02:15:03.013Z+ pfexec mkdir -p /usr/oxide
3412024-11-20T02:15:03.013Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.1
3422024-11-20T02:15:03.654Z+ pfexec chmod +x /usr/oxide/oxide
3432024-11-20T02:15:03.677Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
3442024-11-20T02:15:21.951Z+ OMICRON_NO_UNINSTALL=1
3452024-11-20T02:15:21.951Z+ ptime -m pfexec ./target/release/omicron-package -t test install
3462024-11-20T02:15:21.973ZLogging to: /opt/oxide/work/out/LOG
3472024-11-20T02:15:22.642Z
3482024-11-20T02:15:22.665Zreal 0.685528715
3492024-11-20T02:15:22.665Zuser 0.150300589
3502024-11-20T02:15:22.665Zsys 3.557666184
3512024-11-20T02:15:22.665Ztrap 0.000006549
3522024-11-20T02:15:22.665Ztflt 0.000009049
3532024-11-20T02:15:22.665Zdflt 0.000482926
3542024-11-20T02:15:22.665Zkflt 0.000000000
3552024-11-20T02:15:22.665Zlock 1:01.700690529
3562024-11-20T02:15:22.665Zslp 0.870772436
3572024-11-20T02:15:22.665Zlat 0.002902673
3582024-11-20T02:15:22.666Zstop 0.231719209
3592024-11-20T02:15:22.666Z+ retry=0
3602024-11-20T02:15:22.666Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3612024-11-20T02:15:22.666Z+ [[ 0 -gt 30 ]]
3622024-11-20T02:15:22.666Z+ sleep 1
3632024-11-20T02:15:23.656Z+ retry=1
3642024-11-20T02:15:23.657Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3652024-11-20T02:15:23.679Z+ [[ 1 -gt 30 ]]
3662024-11-20T02:15:23.679Z+ sleep 1
3672024-11-20T02:15:24.672Z+ retry=2
3682024-11-20T02:15:24.672Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3692024-11-20T02:15:24.694Z+ [[ 2 -gt 30 ]]
3702024-11-20T02:15:24.694Z+ sleep 1
3712024-11-20T02:15:25.686Z+ retry=3
3722024-11-20T02:15:25.686Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3732024-11-20T02:15:45.747Z+ [[ 3 -gt 30 ]]
3742024-11-20T02:15:45.747Z+ sleep 1
3752024-11-20T02:15:46.754Z+ retry=4
3762024-11-20T02:15:46.754Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
3772024-11-20T02:15:46.779Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3782024-11-20T02:15:46.819Zlocal v6:
3792024-11-20T02:15:46.819Zfd49:c048:7af1:222::1
3802024-11-20T02:15:46.819Zfe80::4c22:fff:fe56:2172
3812024-11-20T02:15:46.820Zlocal v4:
3822024-11-20T02:15:46.820Z10.151.1.174
3832024-11-20T02:15:46.820Zrouter v6:
3842024-11-20T02:15:46.820Zrouter v4_idx:
3852024-11-20T02:15:46.820Z0.0.0.0/0 -> 0
3862024-11-20T02:15:46.820Zrouter v4_routes:
3872024-11-20T02:15:46.820Z0 -> 10.151.1.100 (2)
3882024-11-20T02:15:46.820Zresolver v4:
3892024-11-20T02:15:46.820Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
3902024-11-20T02:15:46.820Z10.151.1.174 -> ca:94:42:d3:07:80
3912024-11-20T02:15:46.820Zresolver v6:
3922024-11-20T02:15:46.820Zfe80::4c22:fff:fe56:2172 -> 4e:22:0f:56:21:72
3932024-11-20T02:15:46.820Zfe80::c091:c7ff:fea0:ca06 -> c2:91:c7:a0:ca:06
3942024-11-20T02:15:46.820Znat v4:
3952024-11-20T02:15:46.822Znat_v6:
3962024-11-20T02:15:46.822Zport_mac:
3972024-11-20T02:15:46.846Z1: a8:40:25:2c:9f:e1
3982024-11-20T02:15:46.846Z2: a8:40:25:2c:a0:01
3992024-11-20T02:15:46.846Z1000: a8:40:25:2c:9f:e0
4002024-11-20T02:15:46.846Zproxy arp:
4012024-11-20T02:15:46.846Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
4022024-11-20T02:15:46.846Z+ retry=0
4032024-11-20T02:15:46.846Z+++ zoneadm list -n
4042024-11-20T02:15:46.847Z+++ grep oxz_ntp
4052024-11-20T02:15:46.847Z++ pfexec svcs -z -Hostate oxide/ntp
4062024-11-20T02:15:46.869Zsvcs: zone '-Hostate': entity not found
4072024-11-20T02:15:46.869Z++ true
4082024-11-20T02:15:46.870Z+ [[ '' != online ]]
4092024-11-20T02:15:46.870Z+ [[ 0 -gt 60 ]]
4102024-11-20T02:15:46.870Z+ sleep 1
4112024-11-20T02:15:47.899Z+ retry=1
4122024-11-20T02:15:47.899Z+++ zoneadm list -n
4132024-11-20T02:15:47.899Z+++ grep oxz_ntp
4142024-11-20T02:15:47.950Z++ pfexec svcs -z -Hostate oxide/ntp
4152024-11-20T02:15:47.973Zsvcs: zone '-Hostate': entity not found
4162024-11-20T02:15:47.997Z++ true
4172024-11-20T02:15:47.997Z+ [[ '' != online ]]
4182024-11-20T02:15:47.997Z+ [[ 1 -gt 60 ]]
4192024-11-20T02:15:47.997Z+ sleep 1
4202024-11-20T02:15:48.985Z+ retry=2
4212024-11-20T02:15:49.010Z+++ zoneadm list -n
4222024-11-20T02:15:49.010Z+++ grep oxz_ntp
4232024-11-20T02:15:49.010Z++ pfexec svcs -z -Hostate oxide/ntp
4242024-11-20T02:15:49.010Zsvcs: zone '-Hostate': entity not found
4252024-11-20T02:15:49.010Z++ true
4262024-11-20T02:15:49.010Z+ [[ '' != online ]]
4272024-11-20T02:15:49.010Z+ [[ 2 -gt 60 ]]
4282024-11-20T02:15:49.010Z+ sleep 1
4292024-11-20T02:15:50.008Z+ retry=3
4302024-11-20T02:15:50.031Z+++ zoneadm list -n
4312024-11-20T02:15:50.031Z+++ grep oxz_ntp
4322024-11-20T02:15:50.031Z++ pfexec svcs -z -Hostate oxide/ntp
4332024-11-20T02:15:50.031Zsvcs: zone '-Hostate': entity not found
4342024-11-20T02:15:50.031Z++ true
4352024-11-20T02:15:50.031Z+ [[ '' != online ]]
4362024-11-20T02:15:50.031Z+ [[ 3 -gt 60 ]]
4372024-11-20T02:15:50.031Z+ sleep 1
4382024-11-20T02:15:51.029Z+ retry=4
4392024-11-20T02:15:51.052Z+++ zoneadm list -n
4402024-11-20T02:15:51.052Z+++ grep oxz_ntp
4412024-11-20T02:15:51.052Z++ pfexec svcs -z -Hostate oxide/ntp
4422024-11-20T02:15:51.052Zsvcs: zone '-Hostate': entity not found
4432024-11-20T02:15:51.052Z++ true
4442024-11-20T02:15:51.052Z+ [[ '' != online ]]
4452024-11-20T02:15:51.052Z+ [[ 4 -gt 60 ]]
4462024-11-20T02:15:51.052Z+ sleep 1
4472024-11-20T02:15:52.050Z+ retry=5
4482024-11-20T02:15:52.074Z+++ zoneadm list -n
4492024-11-20T02:15:52.074Z+++ grep oxz_ntp
4502024-11-20T02:15:52.074Z++ pfexec svcs -z -Hostate oxide/ntp
4512024-11-20T02:15:52.074Zsvcs: zone '-Hostate': entity not found
4522024-11-20T02:15:52.074Z++ true
4532024-11-20T02:15:52.074Z+ [[ '' != online ]]
4542024-11-20T02:15:52.074Z+ [[ 5 -gt 60 ]]
4552024-11-20T02:15:52.074Z+ sleep 1
4562024-11-20T02:15:53.071Z+ retry=6
4572024-11-20T02:15:53.095Z+++ zoneadm list -n
4582024-11-20T02:15:53.095Z+++ grep oxz_ntp
4592024-11-20T02:15:53.095Z++ pfexec svcs -z -Hostate oxide/ntp
4602024-11-20T02:15:53.095Zsvcs: zone '-Hostate': entity not found
4612024-11-20T02:15:53.095Z++ true
4622024-11-20T02:15:53.095Z+ [[ '' != online ]]
4632024-11-20T02:15:53.095Z+ [[ 6 -gt 60 ]]
4642024-11-20T02:15:53.095Z+ sleep 1
4652024-11-20T02:15:54.094Z+ retry=7
4662024-11-20T02:15:54.118Z+++ zoneadm list -n
4672024-11-20T02:15:54.118Z+++ grep oxz_ntp
4682024-11-20T02:15:54.118Z++ pfexec svcs -z -Hostate oxide/ntp
4692024-11-20T02:15:54.118Zsvcs: zone '-Hostate': entity not found
4702024-11-20T02:15:54.118Z++ true
4712024-11-20T02:15:54.118Z+ [[ '' != online ]]
4722024-11-20T02:15:54.118Z+ [[ 7 -gt 60 ]]
4732024-11-20T02:15:54.118Z+ sleep 1
4742024-11-20T02:15:55.118Z+ retry=8
4752024-11-20T02:15:55.141Z+++ zoneadm list -n
4762024-11-20T02:15:55.141Z+++ grep oxz_ntp
4772024-11-20T02:15:55.141Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
4782024-11-20T02:15:55.164Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4792024-11-20T02:15:55.164Z++ true
4802024-11-20T02:15:55.191Z+ [[ '' != online ]]
4812024-11-20T02:15:55.191Z+ [[ 8 -gt 60 ]]
4822024-11-20T02:15:55.191Z+ sleep 1
4832024-11-20T02:15:56.168Z+ retry=9
4842024-11-20T02:15:56.198Z+++ zoneadm list -n
4852024-11-20T02:15:56.198Z+++ grep oxz_ntp
4862024-11-20T02:15:56.198Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
4872024-11-20T02:15:56.222Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4882024-11-20T02:15:56.223Z++ true
4892024-11-20T02:15:56.223Z+ [[ '' != online ]]
4902024-11-20T02:15:56.223Z+ [[ 9 -gt 60 ]]
4912024-11-20T02:15:56.224Z+ sleep 1
4922024-11-20T02:15:57.199Z+ retry=10
4932024-11-20T02:15:57.223Z+++ zoneadm list -n
4942024-11-20T02:15:57.223Z+++ grep oxz_ntp
4952024-11-20T02:15:57.223Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
4962024-11-20T02:15:57.247Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
4972024-11-20T02:15:57.248Z++ true
4982024-11-20T02:15:57.248Z+ [[ '' != online ]]
4992024-11-20T02:15:57.248Z+ [[ 10 -gt 60 ]]
5002024-11-20T02:15:57.248Z+ sleep 1
5012024-11-20T02:15:58.227Z+ retry=11
5022024-11-20T02:15:58.250Z+++ zoneadm list -n
5032024-11-20T02:15:58.250Z+++ grep oxz_ntp
5042024-11-20T02:15:58.250Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
5052024-11-20T02:15:58.273Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
5062024-11-20T02:15:58.273Z++ true
5072024-11-20T02:15:58.273Z+ [[ '' != online ]]
5082024-11-20T02:15:58.273Z+ [[ 11 -gt 60 ]]
5092024-11-20T02:15:58.273Z+ sleep 1
5102024-11-20T02:15:59.258Z+ retry=12
5112024-11-20T02:15:59.282Z+++ zoneadm list -n
5122024-11-20T02:15:59.282Z+++ grep oxz_ntp
5132024-11-20T02:15:59.282Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
5142024-11-20T02:15:59.282Z+ [[ offline != online ]]
5152024-11-20T02:15:59.282Z+ [[ 12 -gt 60 ]]
5162024-11-20T02:15:59.282Z+ sleep 1
5172024-11-20T02:16:00.280Z+ retry=13
5182024-11-20T02:16:00.303Z+++ zoneadm list -n
5192024-11-20T02:16:00.303Z+++ grep oxz_ntp
5202024-11-20T02:16:00.303Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
5212024-11-20T02:16:00.303Z+ [[ offline != online ]]
5222024-11-20T02:16:00.303Z+ [[ 13 -gt 60 ]]
5232024-11-20T02:16:00.303Z+ sleep 1
5242024-11-20T02:16:01.302Z+ retry=14
5252024-11-20T02:16:01.325Z+++ zoneadm list -n
5262024-11-20T02:16:01.325Z+++ grep oxz_ntp
5272024-11-20T02:16:01.325Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
5282024-11-20T02:16:01.325Z+ [[ offline != online ]]
5292024-11-20T02:16:01.325Z+ [[ 14 -gt 60 ]]
5302024-11-20T02:16:01.325Z+ sleep 1
5312024-11-20T02:16:02.326Z+ retry=15
5322024-11-20T02:16:02.349Z+++ zoneadm list -n
5332024-11-20T02:16:02.349Z+++ grep oxz_ntp
5342024-11-20T02:16:02.349Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
5352024-11-20T02:16:02.349Z+ [[ offline != online ]]
5362024-11-20T02:16:02.349Z+ [[ 15 -gt 60 ]]
5372024-11-20T02:16:02.349Z+ sleep 1
5382024-11-20T02:16:03.348Z+ retry=16
5392024-11-20T02:16:03.370Z+++ zoneadm list -n
5402024-11-20T02:16:03.370Z+++ grep oxz_ntp
5412024-11-20T02:16:03.370Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
5422024-11-20T02:16:03.371Z+ [[ offline != online ]]
5432024-11-20T02:16:03.371Z+ [[ 16 -gt 60 ]]
5442024-11-20T02:16:03.371Z+ sleep 1
5452024-11-20T02:16:04.369Z+ retry=17
5462024-11-20T02:16:04.392Z+++ zoneadm list -n
5472024-11-20T02:16:04.392Z+++ grep oxz_ntp
5482024-11-20T02:16:04.392Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
5492024-11-20T02:16:04.392Z+ [[ offline != online ]]
5502024-11-20T02:16:04.392Z+ [[ 17 -gt 60 ]]
5512024-11-20T02:16:04.392Z+ sleep 1
 
5522024-11-20T02:16:04.802Zbuskin console login: Nov 20 02:16:04 buskin ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast
 
5532024-11-20T02:16:05.391Z+ retry=18
5542024-11-20T02:16:05.414Z+++ zoneadm list -n
5552024-11-20T02:16:05.415Z+++ grep oxz_ntp
5562024-11-20T02:16:05.415Z++ pfexec svcs -z oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 -Hostate oxide/ntp
5572024-11-20T02:16:05.415Z+ [[ online != online ]]
5582024-11-20T02:16:05.415Z+ echo 'Waited for chrony: 18s'
5592024-11-20T02:16:05.415Z+ retry=0
5602024-11-20T02:16:05.415ZWaited for chrony: 18s
5612024-11-20T02:16:05.415Z+ zoneadm list
5622024-11-20T02:16:05.439Z+ grep nexus
5632024-11-20T02:16:05.439Z+ [[ 0 -gt 300 ]]
5642024-11-20T02:16:05.439Z+ sleep 1
5652024-11-20T02:16:06.423Z+ retry=1
5662024-11-20T02:16:06.446Z+ zoneadm list
5672024-11-20T02:16:06.446Z+ grep nexus
5682024-11-20T02:16:06.446Z+ [[ 1 -gt 300 ]]
5692024-11-20T02:16:06.446Z+ sleep 1
5702024-11-20T02:16:07.434Z+ retry=2
5712024-11-20T02:16:07.457Z+ zoneadm list
5722024-11-20T02:16:07.458Z+ grep nexus
5732024-11-20T02:16:07.458Z+ [[ 2 -gt 300 ]]
5742024-11-20T02:16:07.458Z+ sleep 1
5752024-11-20T02:16:08.444Z+ retry=3
5762024-11-20T02:16:08.467Z+ zoneadm list
5772024-11-20T02:16:08.468Z+ grep nexus
5782024-11-20T02:16:08.468Z+ [[ 3 -gt 300 ]]
5792024-11-20T02:16:08.468Z+ sleep 1
5802024-11-20T02:16:09.455Z+ retry=4
5812024-11-20T02:16:09.478Z+ zoneadm list
5822024-11-20T02:16:09.478Z+ grep nexus
5832024-11-20T02:16:09.478Z+ [[ 4 -gt 300 ]]
5842024-11-20T02:16:09.479Z+ sleep 1
5852024-11-20T02:16:10.465Z+ retry=5
5862024-11-20T02:16:10.488Z+ zoneadm list
5872024-11-20T02:16:10.489Z+ grep nexus
5882024-11-20T02:16:10.489Z+ [[ 5 -gt 300 ]]
5892024-11-20T02:16:10.489Z+ sleep 1
5902024-11-20T02:16:11.475Z+ retry=6
5912024-11-20T02:16:11.498Z+ zoneadm list
5922024-11-20T02:16:11.498Z+ grep nexus
5932024-11-20T02:16:11.498Z+ [[ 6 -gt 300 ]]
5942024-11-20T02:16:11.499Z+ sleep 1
5952024-11-20T02:16:12.486Z+ retry=7
5962024-11-20T02:16:12.510Z+ zoneadm list
5972024-11-20T02:16:12.510Z+ grep nexus
5982024-11-20T02:16:12.510Z+ [[ 7 -gt 300 ]]
5992024-11-20T02:16:12.510Z+ sleep 1
6002024-11-20T02:16:13.503Z+ retry=8
6012024-11-20T02:16:13.526Z+ zoneadm list
6022024-11-20T02:16:13.526Z+ grep nexus
6032024-11-20T02:16:13.526Z+ [[ 8 -gt 300 ]]
6042024-11-20T02:16:13.526Z+ sleep 1
6052024-11-20T02:16:14.517Z+ retry=9
6062024-11-20T02:16:14.540Z+ zoneadm list
6072024-11-20T02:16:14.540Z+ grep nexus
6082024-11-20T02:16:14.540Z+ [[ 9 -gt 300 ]]
6092024-11-20T02:16:14.540Z+ sleep 1
6102024-11-20T02:16:15.532Z+ retry=10
6112024-11-20T02:16:15.555Z+ zoneadm list
6122024-11-20T02:16:15.555Z+ grep nexus
6132024-11-20T02:16:15.555Z+ [[ 10 -gt 300 ]]
6142024-11-20T02:16:15.555Z+ sleep 1
6152024-11-20T02:16:16.549Z+ retry=11
6162024-11-20T02:16:16.716Z+ zoneadm list
6172024-11-20T02:16:16.717Z+ grep nexus
6182024-11-20T02:16:16.745Z+ [[ 11 -gt 300 ]]
6192024-11-20T02:16:16.745Z+ sleep 1
6202024-11-20T02:16:17.565Z+ retry=12
6212024-11-20T02:16:17.589Z+ zoneadm list
6222024-11-20T02:16:17.589Z+ grep nexus
6232024-11-20T02:16:17.589Z+ [[ 12 -gt 300 ]]
6242024-11-20T02:16:17.589Z+ sleep 1
6252024-11-20T02:16:18.582Z+ retry=13
6262024-11-20T02:16:18.605Z+ zoneadm list
6272024-11-20T02:16:18.605Z+ grep nexus
6282024-11-20T02:16:18.605Z+ [[ 13 -gt 300 ]]
6292024-11-20T02:16:18.605Z+ sleep 1
6302024-11-20T02:16:19.595Z+ retry=14
6312024-11-20T02:16:19.618Z+ zoneadm list
6322024-11-20T02:16:19.618Z+ grep nexus
6332024-11-20T02:16:19.619Z+ [[ 14 -gt 300 ]]
6342024-11-20T02:16:19.619Z+ sleep 1
6352024-11-20T02:16:20.609Z+ retry=15
6362024-11-20T02:16:20.632Z+ zoneadm list
6372024-11-20T02:16:20.632Z+ grep nexus
6382024-11-20T02:16:20.632Z+ [[ 15 -gt 300 ]]
6392024-11-20T02:16:20.632Z+ sleep 1
6402024-11-20T02:16:21.622Z+ retry=16
6412024-11-20T02:16:21.645Z+ zoneadm list
6422024-11-20T02:16:21.645Z+ grep nexus
6432024-11-20T02:16:21.645Z+ [[ 16 -gt 300 ]]
6442024-11-20T02:16:21.646Z+ sleep 1
6452024-11-20T02:16:22.635Z+ retry=17
6462024-11-20T02:16:22.658Z+ zoneadm list
6472024-11-20T02:16:22.658Z+ grep nexus
6482024-11-20T02:16:22.659Z+ [[ 17 -gt 300 ]]
6492024-11-20T02:16:22.659Z+ sleep 1
6502024-11-20T02:16:23.648Z+ retry=18
6512024-11-20T02:16:23.671Z+ zoneadm list
6522024-11-20T02:16:23.671Z+ grep nexus
6532024-11-20T02:16:23.671Z+ [[ 18 -gt 300 ]]
6542024-11-20T02:16:23.671Z+ sleep 1
6552024-11-20T02:16:24.660Z+ retry=19
6562024-11-20T02:16:24.683Z+ zoneadm list
6572024-11-20T02:16:24.683Z+ grep nexus
6582024-11-20T02:16:24.683Z+ [[ 19 -gt 300 ]]
6592024-11-20T02:16:24.683Z+ sleep 1
6602024-11-20T02:16:25.672Z+ retry=20
6612024-11-20T02:16:25.695Z+ zoneadm list
6622024-11-20T02:16:25.695Z+ grep nexus
6632024-11-20T02:16:25.695Z+ [[ 20 -gt 300 ]]
6642024-11-20T02:16:25.695Z+ sleep 1
6652024-11-20T02:16:26.683Z+ retry=21
6662024-11-20T02:16:26.706Z+ zoneadm list
6672024-11-20T02:16:26.706Z+ grep nexus
6682024-11-20T02:16:26.706Z+ [[ 21 -gt 300 ]]
6692024-11-20T02:16:26.707Z+ sleep 1
6702024-11-20T02:16:27.696Z+ retry=22
6712024-11-20T02:16:27.719Z+ zoneadm list
6722024-11-20T02:16:27.719Z+ grep nexus
6732024-11-20T02:16:27.719Z+ [[ 22 -gt 300 ]]
6742024-11-20T02:16:27.719Z+ sleep 1
6752024-11-20T02:16:28.707Z+ retry=23
6762024-11-20T02:16:28.732Z+ zoneadm list
6772024-11-20T02:16:28.732Z+ grep nexus
6782024-11-20T02:16:28.732Z+ [[ 23 -gt 300 ]]
6792024-11-20T02:16:28.732Z+ sleep 1
6802024-11-20T02:16:29.720Z+ retry=24
6812024-11-20T02:16:29.743Z+ zoneadm list
6822024-11-20T02:16:29.743Z+ grep nexus
6832024-11-20T02:16:29.744Z+ [[ 24 -gt 300 ]]
6842024-11-20T02:16:29.744Z+ sleep 1
6852024-11-20T02:16:30.731Z+ retry=25
6862024-11-20T02:16:30.754Z+ zoneadm list
6872024-11-20T02:16:30.754Z+ grep nexus
6882024-11-20T02:16:30.754Z+ [[ 25 -gt 300 ]]
6892024-11-20T02:16:30.754Z+ sleep 1
6902024-11-20T02:16:31.742Z+ retry=26
6912024-11-20T02:16:31.766Z+ zoneadm list
6922024-11-20T02:16:31.766Z+ grep nexus
6932024-11-20T02:16:31.766Z+ [[ 26 -gt 300 ]]
6942024-11-20T02:16:31.766Z+ sleep 1
6952024-11-20T02:16:32.756Z+ retry=27
6962024-11-20T02:16:32.779Z+ zoneadm list
6972024-11-20T02:16:32.779Z+ grep nexus
6982024-11-20T02:16:32.779Z+ [[ 27 -gt 300 ]]
6992024-11-20T02:16:32.779Z+ sleep 1
7002024-11-20T02:16:33.776Z+ retry=28
7012024-11-20T02:16:33.776Z+ zoneadm list
7022024-11-20T02:16:33.800Z+ grep nexus
7032024-11-20T02:16:33.800Z+ [[ 28 -gt 300 ]]
7042024-11-20T02:16:33.800Z+ sleep 1
7052024-11-20T02:16:34.787Z+ retry=29
7062024-11-20T02:16:34.811Z+ zoneadm list
7072024-11-20T02:16:34.811Z+ grep nexus
7082024-11-20T02:16:34.811Z+ [[ 29 -gt 300 ]]
7092024-11-20T02:16:34.811Z+ sleep 1
7102024-11-20T02:16:35.801Z+ retry=30
7112024-11-20T02:16:35.825Z+ zoneadm list
7122024-11-20T02:16:35.825Z+ grep nexus
7132024-11-20T02:16:35.825Z+ [[ 30 -gt 300 ]]
7142024-11-20T02:16:35.825Z+ sleep 1
7152024-11-20T02:16:36.814Z+ retry=31
7162024-11-20T02:16:36.838Z+ zoneadm list
7172024-11-20T02:16:36.838Z+ grep nexus
7182024-11-20T02:16:36.838Z+ [[ 31 -gt 300 ]]
7192024-11-20T02:16:36.838Z+ sleep 1
7202024-11-20T02:16:37.936Z+ retry=32
7212024-11-20T02:16:37.959Z+ zoneadm list
7222024-11-20T02:16:37.959Z+ grep nexus
7232024-11-20T02:16:37.959Z+ [[ 32 -gt 300 ]]
7242024-11-20T02:16:37.959Z+ sleep 1
7252024-11-20T02:16:38.838Z+ retry=33
7262024-11-20T02:16:38.861Z+ zoneadm list
7272024-11-20T02:16:38.862Z+ grep nexus
7282024-11-20T02:16:38.862Z+ [[ 33 -gt 300 ]]
7292024-11-20T02:16:38.862Z+ sleep 1
7302024-11-20T02:16:39.850Z+ retry=34
7312024-11-20T02:16:39.873Z+ zoneadm list
7322024-11-20T02:16:39.873Z+ grep nexus
7332024-11-20T02:16:39.874Z+ [[ 34 -gt 300 ]]
7342024-11-20T02:16:39.874Z+ sleep 1
7352024-11-20T02:16:40.862Z+ retry=35
7362024-11-20T02:16:40.885Z+ zoneadm list
7372024-11-20T02:16:40.885Z+ grep nexus
7382024-11-20T02:16:40.885Z+ [[ 35 -gt 300 ]]
7392024-11-20T02:16:40.885Z+ sleep 1
7402024-11-20T02:16:41.874Z+ retry=36
7412024-11-20T02:16:41.899Z+ zoneadm list
7422024-11-20T02:16:41.899Z+ grep nexus
7432024-11-20T02:16:41.900Z+ [[ 36 -gt 300 ]]
7442024-11-20T02:16:41.900Z+ sleep 1
7452024-11-20T02:16:42.888Z+ retry=37
7462024-11-20T02:16:42.911Z+ zoneadm list
7472024-11-20T02:16:42.911Z+ grep nexus
7482024-11-20T02:16:42.912Z+ [[ 37 -gt 300 ]]
7492024-11-20T02:16:42.912Z+ sleep 1
7502024-11-20T02:16:43.901Z+ retry=38
7512024-11-20T02:16:43.924Z+ zoneadm list
7522024-11-20T02:16:43.924Z+ grep nexus
7532024-11-20T02:16:43.924Z+ [[ 38 -gt 300 ]]
7542024-11-20T02:16:43.924Z+ sleep 1
7552024-11-20T02:16:44.911Z+ retry=39
7562024-11-20T02:16:44.935Z+ zoneadm list
7572024-11-20T02:16:44.935Z+ grep nexus
7582024-11-20T02:16:44.935Z+ [[ 39 -gt 300 ]]
7592024-11-20T02:16:44.935Z+ sleep 1
7602024-11-20T02:16:45.923Z+ retry=40
7612024-11-20T02:16:45.946Z+ zoneadm list
7622024-11-20T02:16:45.946Z+ grep nexus
7632024-11-20T02:16:45.946Z+ [[ 40 -gt 300 ]]
7642024-11-20T02:16:45.946Z+ sleep 1
7652024-11-20T02:16:47.922Z+ retry=41
7662024-11-20T02:16:47.945Z+ zoneadm list
7672024-11-20T02:16:47.945Z+ grep nexus
7682024-11-20T02:16:47.945Z+ [[ 41 -gt 300 ]]
7692024-11-20T02:16:47.945Z+ sleep 1
7702024-11-20T02:16:48.943Z+ retry=42
7712024-11-20T02:16:48.967Z+ zoneadm list
7722024-11-20T02:16:48.967Z+ grep nexus
7732024-11-20T02:16:48.967Z+ [[ 42 -gt 300 ]]
7742024-11-20T02:16:48.967Z+ sleep 1
7752024-11-20T02:16:49.961Z+ retry=43
7762024-11-20T02:16:49.985Z+ zoneadm list
7772024-11-20T02:16:49.985Z+ grep nexus
7782024-11-20T02:16:49.985Z+ [[ 43 -gt 300 ]]
7792024-11-20T02:16:49.986Z+ sleep 1
7802024-11-20T02:16:50.977Z+ retry=44
7812024-11-20T02:16:51.001Z+ zoneadm list
7822024-11-20T02:16:51.001Z+ grep nexus
7832024-11-20T02:16:51.002Z+ [[ 44 -gt 300 ]]
7842024-11-20T02:16:51.002Z+ sleep 1
7852024-11-20T02:16:51.991Z+ retry=45
7862024-11-20T02:16:52.014Z+ zoneadm list
7872024-11-20T02:16:52.014Z+ grep nexus
7882024-11-20T02:16:52.014Z+ [[ 45 -gt 300 ]]
7892024-11-20T02:16:52.014Z+ sleep 1
7902024-11-20T02:16:53.008Z+ retry=46
7912024-11-20T02:16:53.031Z+ zoneadm list
7922024-11-20T02:16:53.031Z+ grep nexus
7932024-11-20T02:16:53.031Z+ [[ 46 -gt 300 ]]
7942024-11-20T02:16:53.031Z+ sleep 1
7952024-11-20T02:16:54.020Z+ retry=47
7962024-11-20T02:16:54.043Z+ zoneadm list
7972024-11-20T02:16:54.044Z+ grep nexus
7982024-11-20T02:16:54.044Z+ [[ 47 -gt 300 ]]
7992024-11-20T02:16:54.044Z+ sleep 1
8002024-11-20T02:16:55.032Z+ retry=48
8012024-11-20T02:16:55.055Z+ zoneadm list
8022024-11-20T02:16:55.055Z+ grep nexus
8032024-11-20T02:16:55.055Z+ [[ 48 -gt 300 ]]
8042024-11-20T02:16:55.055Z+ sleep 1
8052024-11-20T02:16:56.043Z+ retry=49
8062024-11-20T02:16:56.067Z+ zoneadm list
8072024-11-20T02:16:56.067Z+ grep nexus
8082024-11-20T02:16:56.067Z+ [[ 49 -gt 300 ]]
8092024-11-20T02:16:56.067Z+ sleep 1
8102024-11-20T02:16:57.056Z+ retry=50
8112024-11-20T02:16:57.079Z+ zoneadm list
8122024-11-20T02:16:57.079Z+ grep nexus
8132024-11-20T02:16:57.079Z+ [[ 50 -gt 300 ]]
8142024-11-20T02:16:57.079Z+ sleep 1
8152024-11-20T02:16:58.068Z+ retry=51
8162024-11-20T02:16:58.091Z+ zoneadm list
8172024-11-20T02:16:58.092Z+ grep nexus
8182024-11-20T02:16:58.092Z+ [[ 51 -gt 300 ]]
8192024-11-20T02:16:58.092Z+ sleep 1
8202024-11-20T02:16:59.080Z+ retry=52
8212024-11-20T02:16:59.104Z+ zoneadm list
8222024-11-20T02:16:59.104Z+ grep nexus
8232024-11-20T02:16:59.128Z+ [[ 52 -gt 300 ]]
8242024-11-20T02:16:59.128Z+ sleep 1
8252024-11-20T02:17:00.118Z+ retry=53
8262024-11-20T02:17:00.142Z+ zoneadm list
8272024-11-20T02:17:00.142Z+ grep nexus
8282024-11-20T02:17:00.142Z+ [[ 53 -gt 300 ]]
8292024-11-20T02:17:00.142Z+ sleep 1
8302024-11-20T02:17:01.187Z+ retry=54
8312024-11-20T02:17:01.212Z+ zoneadm list
8322024-11-20T02:17:01.212Z+ grep nexus
8332024-11-20T02:17:01.212Z+ [[ 54 -gt 300 ]]
8342024-11-20T02:17:01.212Z+ sleep 1
8352024-11-20T02:17:02.338Z+ retry=55
8362024-11-20T02:17:02.338Z+ zoneadm list
8372024-11-20T02:17:02.338Z+ grep nexus
8382024-11-20T02:17:02.339Z+ [[ 55 -gt 300 ]]
8392024-11-20T02:17:02.339Z+ sleep 1
8402024-11-20T02:17:03.543Z+ retry=56
8412024-11-20T02:17:05.333Z+ zoneadm list
8422024-11-20T02:17:05.360Z+ grep nexus
8432024-11-20T02:17:05.546Z+ [[ 56 -gt 300 ]]
8442024-11-20T02:17:05.546Z+ sleep 1
8452024-11-20T02:17:06.681Z+ retry=57
8462024-11-20T02:17:06.705Z+ zoneadm list
8472024-11-20T02:17:06.729Z+ grep nexus
8482024-11-20T02:17:06.752Z+ [[ 57 -gt 300 ]]
8492024-11-20T02:17:06.752Z+ sleep 1
8502024-11-20T02:17:07.788Z+ retry=58
8512024-11-20T02:17:07.812Z+ zoneadm list
8522024-11-20T02:17:07.812Z+ grep nexus
8532024-11-20T02:17:07.837Z+ [[ 58 -gt 300 ]]
8542024-11-20T02:17:07.837Z+ sleep 1
8552024-11-20T02:17:08.819Z+ retry=59
8562024-11-20T02:17:08.843Z+ zoneadm list
8572024-11-20T02:17:08.843Z+ grep nexus
8582024-11-20T02:17:08.843Zoxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
8592024-11-20T02:17:08.843Zoxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
8602024-11-20T02:17:08.843Zoxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
8612024-11-20T02:17:08.843Z+ echo 'Waited for nexus: 59s'
8622024-11-20T02:17:08.843ZWaited for nexus: 59s
8632024-11-20T02:17:08.843Z+ export RUST_BACKTRACE=1
8642024-11-20T02:17:08.843Z+ RUST_BACKTRACE=1
8652024-11-20T02:17:08.843Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8662024-11-20T02:17:08.867Z++ ./target/debug/bootstrap
8672024-11-20T02:17:09.955ZUsing external DNS server at 10.151.1.164:53
8682024-11-20T02:17:10.026Z2024-11-20 02:17:10.013424127 UTC: attempting to log into API
 
8692024-11-20T02:17:15.655ZNov 20 02:17:15 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:192.48.105.15:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8702024-11-20T02:17:25.120Z2024-11-20 02:17:25.107235671 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8712024-11-20T02:17:26.122Z2024-11-20 02:17:26.109366300 UTC: attempting to log into API
 
8722024-11-20T02:17:30.806ZNov 20 02:17:30 buskin ip: ip: joining multicasts failed (4) on opte3 - will use link layer broadcasts for multicast
8732024-11-20T02:17:31.463ZNov 20 02:17:31 buskin ip: ip: joining multicasts failed (4) on opte4 - will use link layer broadcasts for multicast
8742024-11-20T02:17:32.350ZNov 20 02:17:31 buskin ip: ip: joining multicasts failed (4) on opte5 - will use link layer broadcasts for multicast
8752024-11-20T02:17:32.392ZNov 20 02:17:32 buskin ip: ip: joining multicasts failed (4) on opte2 - will use link layer broadcasts for multicast
8762024-11-20T02:17:33.547ZNov 20 02:17:33 buskin ip: ip: joining multicasts failed (4) on opte1 - will use link layer broadcasts for multicast
 
8772024-11-20T02:17:41.171Z2024-11-20 02:17:41.161514675 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8782024-11-20T02:17:42.172Z2024-11-20 02:17:42.162603722 UTC: attempting to log into API
 
8792024-11-20T02:17:55.865ZNov 20 02:17:55 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:192.48.105.15:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8802024-11-20T02:17:57.206Z2024-11-20 02:17:57.195349216 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8812024-11-20T02:17:58.207Z2024-11-20 02:17:58.197150849 UTC: attempting to log into API
8822024-11-20T02:18:13.240Z2024-11-20 02:18:13.230232127 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8832024-11-20T02:18:14.241Z2024-11-20 02:18:14.231331134 UTC: attempting to log into API
8842024-11-20T02:18:19.287Z2024-11-20 02:18:19.276993359 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8852024-11-20T02:18:20.288Z2024-11-20 02:18:20.278427652 UTC: attempting to log into API
8862024-11-20T02:18:20.327Z2024-11-20 02:18:20.317432279 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local)
8872024-11-20T02:18:21.329Z2024-11-20 02:18:21.318726210 UTC: attempting to log into API
8882024-11-20T02:18:22.109Z2024-11-20 02:18:22.099159915 UTC: login succeeded
8892024-11-20T02:18:22.142Zwaiting for nexus to come up...
8902024-11-20T02:18:22.217Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8912024-11-20T02:18:22.432Zsetting up quotas...
8922024-11-20T02:18:22.488Zensuring datasets are ready...
8932024-11-20T02:18:25.459Zlet's roll.
8942024-11-20T02:18:25.483Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8952024-11-20T02:18:25.483ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8962024-11-20T02:18:25.483ZOXIDE_TOKEN=oxide-token-0db4c2baee8f7e1da810f9f31a42450597066355'
8972024-11-20T02:18:25.483Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8982024-11-20T02:18:25.483Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8992024-11-20T02:18:25.483Z++ OXIDE_TOKEN=oxide-token-0db4c2baee8f7e1da810f9f31a42450597066355
9002024-11-20T02:18:25.483Z+ export OXIDE_HOST OXIDE_TOKEN
9012024-11-20T02:18:25.483Z+ retry=0
9022024-11-20T02:18:25.483Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9032024-11-20T02:18:25.507Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9042024-11-20T02:18:25.507Z+ [[ 0 -gt 60 ]]
9052024-11-20T02:18:25.507Z+ sleep 1
9062024-11-20T02:18:26.490Z+ retry=1
9072024-11-20T02:18:26.490Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9082024-11-20T02:18:26.513Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9092024-11-20T02:18:26.513Z+ [[ 1 -gt 60 ]]
9102024-11-20T02:18:26.514Z+ sleep 1
9112024-11-20T02:18:27.505Z+ retry=2
9122024-11-20T02:18:27.505Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9132024-11-20T02:18:27.528Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9142024-11-20T02:18:27.528Z+ [[ 2 -gt 60 ]]
9152024-11-20T02:18:27.528Z+ sleep 1
9162024-11-20T02:18:28.520Z+ retry=3
9172024-11-20T02:18:28.520Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9182024-11-20T02:18:28.543Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9192024-11-20T02:18:28.543Z+ [[ 3 -gt 60 ]]
9202024-11-20T02:18:28.543Z+ sleep 1
9212024-11-20T02:18:29.535Z+ retry=4
9222024-11-20T02:18:29.535Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9232024-11-20T02:18:29.559Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9242024-11-20T02:18:29.559Z+ [[ 4 -gt 60 ]]
9252024-11-20T02:18:29.559Z+ sleep 1
9262024-11-20T02:18:30.551Z+ retry=5
9272024-11-20T02:18:30.552Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9282024-11-20T02:18:30.576Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9292024-11-20T02:18:30.576Z+ [[ 5 -gt 60 ]]
9302024-11-20T02:18:30.576Z+ sleep 1
9312024-11-20T02:18:31.582Z+ retry=6
9322024-11-20T02:18:31.582Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9332024-11-20T02:18:31.582Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9342024-11-20T02:18:31.582Z+ [[ 6 -gt 60 ]]
9352024-11-20T02:18:31.582Z+ sleep 1
9362024-11-20T02:18:32.581Z+ retry=7
9372024-11-20T02:18:32.581Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9382024-11-20T02:18:32.604Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9392024-11-20T02:18:32.604Z+ [[ 7 -gt 60 ]]
9402024-11-20T02:18:32.604Z+ sleep 1
9412024-11-20T02:18:33.596Z+ retry=8
9422024-11-20T02:18:33.596Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9432024-11-20T02:18:33.619Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9442024-11-20T02:18:33.619Z+ [[ 8 -gt 60 ]]
9452024-11-20T02:18:33.619Z+ sleep 1
9462024-11-20T02:18:34.611Z+ retry=9
9472024-11-20T02:18:34.611Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9482024-11-20T02:18:34.634Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9492024-11-20T02:18:34.634Z+ [[ 9 -gt 60 ]]
9502024-11-20T02:18:34.634Z+ sleep 1
9512024-11-20T02:18:35.626Z+ retry=10
9522024-11-20T02:18:35.626Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9532024-11-20T02:18:35.649Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9542024-11-20T02:18:35.649Z+ [[ 10 -gt 60 ]]
9552024-11-20T02:18:35.649Z+ sleep 1
9562024-11-20T02:18:36.640Z+ retry=11
9572024-11-20T02:18:36.640Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9582024-11-20T02:18:36.664Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9592024-11-20T02:18:36.664Z+ [[ 11 -gt 60 ]]
9602024-11-20T02:18:36.664Z+ sleep 1
9612024-11-20T02:18:37.656Z+ retry=12
9622024-11-20T02:18:37.656Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9632024-11-20T02:18:37.680Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Could not connect to server
9642024-11-20T02:18:37.680Z+ [[ 12 -gt 60 ]]
9652024-11-20T02:18:37.680Z+ sleep 1
9662024-11-20T02:18:38.672Z+ retry=13
9672024-11-20T02:18:38.672Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9682024-11-20T02:18:38.765Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9692024-11-20T02:18:39.638Z{"status":"ok"}{
9702024-11-20T02:18:39.638Z "description": "some images",
9712024-11-20T02:18:39.638Z "id": "1dc21a32-c637-409a-a447-b8dfddd099b3",
9722024-11-20T02:18:39.638Z "name": "images",
9732024-11-20T02:18:39.638Z "time_created": "2024-11-20T02:18:38.953842Z",
9742024-11-20T02:18:39.638Z "time_modified": "2024-11-20T02:18:38.953842Z"
9752024-11-20T02:18:39.638Z}
9762024-11-20T02:18:39.662Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 --parallelism 1
 
9772024-11-20T02:20:31.029ZNov 20 02:18:03 buskin last message repeated 1 time
9782024-11-20T02:20:31.607ZNov 20 02:20:30 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:66.118.229.14:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
9792024-11-20T02:22:04.247ZNov 20 02:21:59 buskin last message repeated 4 times
9802024-11-20T02:25:27.875ZNov 20 02:25:27 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:66.118.228.14:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
9812024-11-20T02:28:44.269ZNov 20 02:25:31 buskin last message repeated 1 time
 
9822024-11-20T02:29:29.284ZDone!
9832024-11-20T02:29:29.308Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9842024-11-20T02:29:29.413Z{
9852024-11-20T02:29:29.413Z "block_size": 512,
9862024-11-20T02:29:29.413Z "description": "debian 11 original base image",
9872024-11-20T02:29:29.413Z "id": "b528b171-5405-4e31-bbc2-0a6b284c4047",
9882024-11-20T02:29:29.413Z "name": "debian11",
9892024-11-20T02:29:29.413Z "os": "debian",
9902024-11-20T02:29:29.413Z "size": 2147483648,
9912024-11-20T02:29:29.413Z "time_created": "2024-11-20T02:29:29.224504Z",
9922024-11-20T02:29:29.413Z "time_modified": "2024-11-20T02:29:29.395078Z",
9932024-11-20T02:29:29.413Z "version": "11"
9942024-11-20T02:29:29.413Z}
9952024-11-20T02:29:29.437Z+ for test_bin in tests/*
9962024-11-20T02:29:29.437Z+ ./tests/bootstrap-f65635f2e4439db7
9972024-11-20T02:29:29.460Z
9982024-11-20T02:29:29.460Zrunning 0 tests
9992024-11-20T02:29:29.460Z
10002024-11-20T02:29:29.460Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10012024-11-20T02:29:29.460Z
10022024-11-20T02:29:29.460Z+ for test_bin in tests/*
10032024-11-20T02:29:29.460Z+ ./tests/commtest-42121a4e7222f4ec
10042024-11-20T02:29:29.484Z
10052024-11-20T02:29:29.484Zrunning 0 tests
10062024-11-20T02:29:29.484Z
10072024-11-20T02:29:29.484Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10082024-11-20T02:29:29.484Z
10092024-11-20T02:29:29.484Z+ for test_bin in tests/*
10102024-11-20T02:29:29.484Z+ ./tests/dhcp_server-9802ee68cc8d4054
10112024-11-20T02:29:29.508Z
10122024-11-20T02:29:29.508Zrunning 0 tests
10132024-11-20T02:29:29.508Z
10142024-11-20T02:29:29.508Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10152024-11-20T02:29:29.508Z
10162024-11-20T02:29:29.508Z+ for test_bin in tests/*
10172024-11-20T02:29:29.508Z+ ./tests/end_to_end_tests-4db006a8b6aa2348
10182024-11-20T02:29:29.699Z
10192024-11-20T02:29:29.699Zrunning 2 tests
10202024-11-20T02:29:30.010Ztest no_spoof::no_spoof_here ... ok
10212024-11-20T02:29:57.678Ztest instance_launch::instance_launch ... ok
10222024-11-20T02:29:57.678Z
10232024-11-20T02:29:57.678Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 27.98s
10242024-11-20T02:29:57.678Z
10252024-11-20T02:29:57.703Z+ _exit_trap
10262024-11-20T02:29:57.703Z+ local status=0
10272024-11-20T02:29:57.703Z+ set +o errexit
10282024-11-20T02:29:57.703Z+ [[ xf3002b356da7d0e4ca15beb66a5566a92919baaa != \x ]]
10292024-11-20T02:29:57.703Z+ pfexec cp /tmp/opteadm /opt/oxide/opte/bin/opteadm
10302024-11-20T02:29:58.483Z+ pfexec svcadm -Z disable -s cron
10312024-11-20T02:30:00.646Z+ [[ 0 -eq 0 ]]
10322024-11-20T02:30:00.646Z+ exit 0
10332024-11-20T02:30:00.670Zprocess exited: duration 948193 ms, exit code 0
 
10342024-11-20T02:30:00.777Zfound 126 output files
10352024-11-20T02:30:00.777Zuploading: /var/svc/log/oxide-sled-agent:default.log (1450038 bytes)
10362024-11-20T02:30:02.112Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10372024-11-20T02:30:02.112Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (7957658 bytes)
10382024-11-20T02:30:02.640Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 7957658 -> 7972570
10392024-11-20T02:30:03.709Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
10402024-11-20T02:30:03.733Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (40448 bytes)
10412024-11-20T02:30:04.867Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
10422024-11-20T02:30:04.867Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (303620 bytes)
10432024-11-20T02:30:05.068Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 303620 -> 305204
10442024-11-20T02:30:06.137Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
10452024-11-20T02:30:06.161Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (435571 bytes)
10462024-11-20T02:30:06.390Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 435571 -> 437947
10472024-11-20T02:30:07.459Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
10482024-11-20T02:30:07.459Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (2289549 bytes)
10492024-11-20T02:30:07.784Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 2289549 -> 2311193
10502024-11-20T02:30:08.853Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
10512024-11-20T02:30:08.853Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (5609744 bytes)
10522024-11-20T02:30:09.296Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 5609744 -> 5663838
10532024-11-20T02:30:10.365Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10542024-11-20T02:30:10.389Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (3339 bytes)
10552024-11-20T02:30:11.457Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10562024-11-20T02:30:11.457Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (426979 bytes)
10572024-11-20T02:30:11.680Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 426979 -> 432145
10582024-11-20T02:30:12.748Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10592024-11-20T02:30:12.772Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (14290 bytes)
10602024-11-20T02:30:12.816Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 14290 -> 14875
10612024-11-20T02:30:13.885Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10622024-11-20T02:30:13.885Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (3834 bytes)
10632024-11-20T02:30:14.976Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10642024-11-20T02:30:14.976Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log (6415 bytes)
10652024-11-20T02:30:16.067Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-zone-network-setup:default.log
10662024-11-20T02:30:16.093Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-clickhouse-admin-single:default.log (936 bytes)
10672024-11-20T02:30:16.093Zupload warning: file "/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-clickhouse-admin-single:default.log" changed size mid upload: 936 -> 0
10682024-11-20T02:30:17.160Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-clickhouse-admin-single:default.log
10692024-11-20T02:30:17.184Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-clickhouse:default.log (0 bytes)
10702024-11-20T02:30:17.294Zupload warning: file "/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 0 -> 78165
10712024-11-20T02:30:18.363Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-clickhouse:default.log
10722024-11-20T02:30:18.363Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-clickhouse:default.log.0 (3420205 bytes)
10732024-11-20T02:30:19.762Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-clickhouse:default.log.0
10742024-11-20T02:30:19.787Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10752024-11-20T02:30:20.831Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-zone-network-setup:default.log
10762024-11-20T02:30:20.855Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2097 bytes)
10772024-11-20T02:30:21.930Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9/root/var/svc/log/oxide-zone-network-setup:default.log.0
10782024-11-20T02:30:21.930Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a/root/var/svc/log/oxide-cockroach-admin:default.log (4704 bytes)
10792024-11-20T02:30:23.025Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a/root/var/svc/log/oxide-cockroach-admin:default.log
10802024-11-20T02:30:23.059Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a/root/var/svc/log/oxide-cockroachdb:default.log (4325 bytes)
10812024-11-20T02:30:24.132Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a/root/var/svc/log/oxide-cockroachdb:default.log
10822024-11-20T02:30:24.132Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a/root/var/svc/log/oxide-zone-network-setup:default.log (2101 bytes)
10832024-11-20T02:30:25.227Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a/root/var/svc/log/oxide-zone-network-setup:default.log
10842024-11-20T02:30:25.252Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
10852024-11-20T02:30:26.324Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd/root/var/svc/log/oxide-crucible-agent:default.log
10862024-11-20T02:30:26.324Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10872024-11-20T02:30:27.420Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd/root/var/svc/log/oxide-crucible-downstairs:default.log
10882024-11-20T02:30:27.420Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
10892024-11-20T02:30:28.515Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd/root/var/svc/log/oxide-zone-network-setup:default.log
10902024-11-20T02:30:28.515Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-external_dns:default.log (0 bytes)
10912024-11-20T02:30:29.587Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-external_dns:default.log
10922024-11-20T02:30:29.587Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-external_dns:default.log.0 (53656 bytes)
10932024-11-20T02:30:30.771Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-external_dns:default.log.0
10942024-11-20T02:30:30.771Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-opte-interface-setup:default.log (1156 bytes)
10952024-11-20T02:30:30.795Zupload warning: file "/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1156 -> 0
10962024-11-20T02:30:31.868Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-opte-interface-setup:default.log
10972024-11-20T02:30:31.868Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10982024-11-20T02:30:32.939Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-zone-network-setup:default.log
10992024-11-20T02:30:32.939Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2112 bytes)
11002024-11-20T02:30:34.035Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015/root/var/svc/log/oxide-zone-network-setup:default.log.0
11012024-11-20T02:30:34.058Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226/root/var/svc/log/oxide-internal_dns:default.log (456360 bytes)
11022024-11-20T02:30:35.314Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226/root/var/svc/log/oxide-internal_dns:default.log
11032024-11-20T02:30:35.337Zuploading: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
11042024-11-20T02:30:36.410Zuploaded: /pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226/root/var/svc/log/oxide-zone-network-setup:default.log
11052024-11-20T02:30:36.410Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662/root/var/svc/log/oxide-cockroach-admin:default.log (4697 bytes)
11062024-11-20T02:30:37.505Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662/root/var/svc/log/oxide-cockroach-admin:default.log
11072024-11-20T02:30:37.505Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662/root/var/svc/log/oxide-cockroachdb:default.log (4325 bytes)
11082024-11-20T02:30:38.601Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662/root/var/svc/log/oxide-cockroachdb:default.log
11092024-11-20T02:30:38.601Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
11102024-11-20T02:30:39.696Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662/root/var/svc/log/oxide-zone-network-setup:default.log
11112024-11-20T02:30:39.720Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898/root/var/svc/log/oxide-crucible-agent:default.log (1556 bytes)
11122024-11-20T02:30:40.791Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898/root/var/svc/log/oxide-crucible-agent:default.log
11132024-11-20T02:30:40.815Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11142024-11-20T02:30:41.886Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898/root/var/svc/log/oxide-crucible-downstairs:default.log
11152024-11-20T02:30:41.886Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
11162024-11-20T02:30:42.981Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898/root/var/svc/log/oxide-zone-network-setup:default.log
11172024-11-20T02:30:42.981Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-external_dns:default.log (0 bytes)
11182024-11-20T02:30:43.029Zupload warning: file "/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 0 -> 3775
11192024-11-20T02:30:44.100Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-external_dns:default.log
11202024-11-20T02:30:44.124Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-external_dns:default.log.0 (49546 bytes)
11212024-11-20T02:30:45.262Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-external_dns:default.log.0
11222024-11-20T02:30:45.286Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
11232024-11-20T02:30:46.334Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-opte-interface-setup:default.log
11242024-11-20T02:30:46.334Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1155 bytes)
11252024-11-20T02:30:47.431Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-opte-interface-setup:default.log.0
11262024-11-20T02:30:47.431Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-zone-network-setup:default.log (2111 bytes)
11272024-11-20T02:30:47.455Zupload warning: file "/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 2111 -> 0
11282024-11-20T02:30:48.526Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c/root/var/svc/log/oxide-zone-network-setup:default.log
11292024-11-20T02:30:48.550Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f/root/var/svc/log/oxide-internal_dns:default.log (456367 bytes)
11302024-11-20T02:30:48.762Zupload warning: file "/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 456367 -> 460120
11312024-11-20T02:30:49.834Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f/root/var/svc/log/oxide-internal_dns:default.log
11322024-11-20T02:30:49.834Zuploading: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
11332024-11-20T02:30:50.928Zuploaded: /pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f/root/var/svc/log/oxide-zone-network-setup:default.log
11342024-11-20T02:30:50.953Zuploading: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c/root/var/svc/log/oxide-cockroach-admin:default.log (4703 bytes)
11352024-11-20T02:30:52.025Zuploaded: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c/root/var/svc/log/oxide-cockroach-admin:default.log
11362024-11-20T02:30:52.025Zuploading: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c/root/var/svc/log/oxide-cockroachdb:default.log (4325 bytes)
11372024-11-20T02:30:53.121Zuploaded: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c/root/var/svc/log/oxide-cockroachdb:default.log
11382024-11-20T02:30:53.121Zuploading: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c/root/var/svc/log/oxide-zone-network-setup:default.log (2091 bytes)
11392024-11-20T02:30:54.217Zuploaded: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c/root/var/svc/log/oxide-zone-network-setup:default.log
11402024-11-20T02:30:54.217Zuploading: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-crucible-agent:default.log (23903 bytes)
11412024-11-20T02:30:55.356Zuploaded: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-crucible-agent:default.log
11422024-11-20T02:30:55.380Zuploading: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11432024-11-20T02:30:56.451Zuploaded: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-crucible-downstairs:default.log
11442024-11-20T02:30:56.451Zuploading: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-crucible-downstairs:downstairs-ed77437f-5415-4f62-9660-4d81d45ef4fb.log (3007 bytes)
11452024-11-20T02:30:57.547Zuploaded: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-crucible-downstairs:downstairs-ed77437f-5415-4f62-9660-4d81d45ef4fb.log
11462024-11-20T02:30:57.571Zuploading: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-crucible-downstairs:downstairs-fd938055-c001-4941-b05f-a220f0b42f4d.log (5970 bytes)
11472024-11-20T02:30:58.642Zuploaded: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-crucible-downstairs:downstairs-fd938055-c001-4941-b05f-a220f0b42f4d.log
11482024-11-20T02:30:58.642Zuploading: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
11492024-11-20T02:30:59.738Zuploaded: /pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01/root/var/svc/log/oxide-zone-network-setup:default.log
11502024-11-20T02:30:59.762Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea/root/var/svc/log/oxide-crucible-agent:default.log (12507 bytes)
11512024-11-20T02:31:00.856Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea/root/var/svc/log/oxide-crucible-agent:default.log
11522024-11-20T02:31:00.880Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11532024-11-20T02:31:01.952Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea/root/var/svc/log/oxide-crucible-downstairs:default.log
11542024-11-20T02:31:01.953Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea/root/var/svc/log/oxide-crucible-downstairs:downstairs-148a0e06-d134-4a87-8c8f-c27e205f3e12.log (3127 bytes)
11552024-11-20T02:31:03.049Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea/root/var/svc/log/oxide-crucible-downstairs:downstairs-148a0e06-d134-4a87-8c8f-c27e205f3e12.log
11562024-11-20T02:31:03.050Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea/root/var/svc/log/oxide-zone-network-setup:default.log (2083 bytes)
11572024-11-20T02:31:04.145Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea/root/var/svc/log/oxide-zone-network-setup:default.log
11582024-11-20T02:31:04.145Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3/root/var/svc/log/oxide-crucible-pantry:default.log (865364 bytes)
11592024-11-20T02:31:04.446Zupload warning: file "/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 865364 -> 874913
11602024-11-20T02:31:05.517Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3/root/var/svc/log/oxide-crucible-pantry:default.log
11612024-11-20T02:31:05.517Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3/root/var/svc/log/oxide-zone-network-setup:default.log (2137 bytes)
11622024-11-20T02:31:06.612Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3/root/var/svc/log/oxide-zone-network-setup:default.log
11632024-11-20T02:31:06.613Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-nexus:default.log (5044601 bytes)
11642024-11-20T02:31:06.818Zupload warning: file "/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5044601 -> 342760
11652024-11-20T02:31:07.889Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-nexus:default.log
11662024-11-20T02:31:07.890Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
11672024-11-20T02:31:07.913Zupload warning: file "/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1135 -> 0
11682024-11-20T02:31:08.984Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-opte-interface-setup:default.log
11692024-11-20T02:31:08.984Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11702024-11-20T02:31:10.057Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-zone-network-setup:default.log
11712024-11-20T02:31:10.080Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2054 bytes)
11722024-11-20T02:31:11.151Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f/root/var/svc/log/oxide-zone-network-setup:default.log.0
11732024-11-20T02:31:11.174Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-nexus:default.log (38990373 bytes)
11742024-11-20T02:31:11.403Zupload warning: file "/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 38990373 -> 440511
11752024-11-20T02:31:12.475Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-nexus:default.log
11762024-11-20T02:31:12.498Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-nexus:default.log.0 (12058624 bytes)
11772024-11-20T02:31:19.277Zupload warning: file "/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-nexus:default.log.0" changed size mid upload: 12058624 -> 38990373
11782024-11-20T02:31:20.347Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-nexus:default.log.0
11792024-11-20T02:31:20.347Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-opte-interface-setup:default.log (1134 bytes)
11802024-11-20T02:31:20.372Zupload warning: file "/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1134 -> 0
11812024-11-20T02:31:21.442Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-opte-interface-setup:default.log
11822024-11-20T02:31:21.442Zuploading: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-zone-network-setup:default.log (2057 bytes)
11832024-11-20T02:31:21.466Zupload warning: file "/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 2057 -> 0
11842024-11-20T02:31:22.538Zuploaded: /pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369/root/var/svc/log/oxide-zone-network-setup:default.log
11852024-11-20T02:31:22.538Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5/root/var/svc/log/oxide-cockroach-admin:default.log (4696 bytes)
11862024-11-20T02:31:23.633Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5/root/var/svc/log/oxide-cockroach-admin:default.log
11872024-11-20T02:31:23.633Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5/root/var/svc/log/oxide-cockroachdb:default.log (4299 bytes)
11882024-11-20T02:31:24.727Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5/root/var/svc/log/oxide-cockroachdb:default.log
11892024-11-20T02:31:24.727Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5/root/var/svc/log/oxide-zone-network-setup:default.log (2093 bytes)
11902024-11-20T02:31:25.821Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5/root/var/svc/log/oxide-zone-network-setup:default.log
11912024-11-20T02:31:25.821Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
11922024-11-20T02:31:26.894Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-agent:default.log
11932024-11-20T02:31:26.894Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-agent:default.log.0 (44497 bytes)
11942024-11-20T02:31:28.057Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-agent:default.log.0
11952024-11-20T02:31:28.080Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11962024-11-20T02:31:29.129Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:default.log
11972024-11-20T02:31:29.129Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11982024-11-20T02:31:30.223Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11992024-11-20T02:31:30.246Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-1145fe67-7c4f-45dc-9ee2-4b7ac4d2b8c0.log (0 bytes)
12002024-11-20T02:31:31.294Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-1145fe67-7c4f-45dc-9ee2-4b7ac4d2b8c0.log
12012024-11-20T02:31:31.294Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-1145fe67-7c4f-45dc-9ee2-4b7ac4d2b8c0.log.0 (3006 bytes)
12022024-11-20T02:31:32.389Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-1145fe67-7c4f-45dc-9ee2-4b7ac4d2b8c0.log.0
12032024-11-20T02:31:32.389Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-1456371f-40ff-4afd-9113-8f8280f487b7.log (0 bytes)
12042024-11-20T02:31:33.459Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-1456371f-40ff-4afd-9113-8f8280f487b7.log
12052024-11-20T02:31:33.482Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-1456371f-40ff-4afd-9113-8f8280f487b7.log.0 (6075 bytes)
12062024-11-20T02:31:34.554Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-1456371f-40ff-4afd-9113-8f8280f487b7.log.0
12072024-11-20T02:31:34.554Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-31f57260-5a5a-41ee-bff3-ab7aefe87b66.log (0 bytes)
12082024-11-20T02:31:35.626Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-31f57260-5a5a-41ee-bff3-ab7aefe87b66.log
12092024-11-20T02:31:35.649Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-31f57260-5a5a-41ee-bff3-ab7aefe87b66.log.0 (3126 bytes)
12102024-11-20T02:31:36.721Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-31f57260-5a5a-41ee-bff3-ab7aefe87b66.log.0
12112024-11-20T02:31:36.721Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-d5833cdc-4c29-4435-b9c8-adbee493ffa1.log (0 bytes)
12122024-11-20T02:31:37.792Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-d5833cdc-4c29-4435-b9c8-adbee493ffa1.log
12132024-11-20T02:31:37.792Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-d5833cdc-4c29-4435-b9c8-adbee493ffa1.log.0 (5973 bytes)
12142024-11-20T02:31:38.886Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:downstairs-d5833cdc-4c29-4435-b9c8-adbee493ffa1.log.0
12152024-11-20T02:31:38.886Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:snapshot-1456371f-40ff-4afd-9113-8f8280f487b7-d4b65909-f53b-420f-a14a-b0fa6fade9ee.log (0 bytes)
12162024-11-20T02:31:39.957Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:snapshot-1456371f-40ff-4afd-9113-8f8280f487b7-d4b65909-f53b-420f-a14a-b0fa6fade9ee.log
12172024-11-20T02:31:39.980Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:snapshot-1456371f-40ff-4afd-9113-8f8280f487b7-d4b65909-f53b-420f-a14a-b0fa6fade9ee.log.0 (5667 bytes)
12182024-11-20T02:31:41.051Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-crucible-downstairs:snapshot-1456371f-40ff-4afd-9113-8f8280f487b7-d4b65909-f53b-420f-a14a-b0fa6fade9ee.log.0
12192024-11-20T02:31:41.052Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12202024-11-20T02:31:42.122Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-zone-network-setup:default.log
12212024-11-20T02:31:42.145Zuploading: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2078 bytes)
12222024-11-20T02:31:43.217Zuploaded: /pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c/root/var/svc/log/oxide-zone-network-setup:default.log.0
12232024-11-20T02:31:43.240Zuploading: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-crucible-agent:default.log (23902 bytes)
12242024-11-20T02:31:44.355Zuploaded: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-crucible-agent:default.log
12252024-11-20T02:31:44.355Zuploading: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12262024-11-20T02:31:45.453Zuploaded: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-crucible-downstairs:default.log
12272024-11-20T02:31:45.477Zuploading: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-crucible-downstairs:downstairs-0d114100-784f-4648-8b83-374ccc42d7c5.log (5972 bytes)
12282024-11-20T02:31:46.548Zuploaded: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-crucible-downstairs:downstairs-0d114100-784f-4648-8b83-374ccc42d7c5.log
12292024-11-20T02:31:46.548Zuploading: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-crucible-downstairs:downstairs-c7eb1528-8861-404f-9cb2-6a57f1a34082.log (3008 bytes)
12302024-11-20T02:31:47.643Zuploaded: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-crucible-downstairs:downstairs-c7eb1528-8861-404f-9cb2-6a57f1a34082.log
12312024-11-20T02:31:47.666Zuploading: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
12322024-11-20T02:31:48.737Zuploaded: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61/root/var/svc/log/oxide-zone-network-setup:default.log
12332024-11-20T02:31:48.737Zuploading: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c/root/var/svc/log/oxide-nexus:default.log (8233395 bytes)
12342024-11-20T02:31:51.664Zupload warning: file "/pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 8233395 -> 9129917
12352024-11-20T02:31:52.735Zuploaded: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c/root/var/svc/log/oxide-nexus:default.log
12362024-11-20T02:31:52.735Zuploading: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c/root/var/svc/log/oxide-opte-interface-setup:default.log (1135 bytes)
12372024-11-20T02:31:53.836Zuploaded: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c/root/var/svc/log/oxide-opte-interface-setup:default.log
12382024-11-20T02:31:53.836Zuploading: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c/root/var/svc/log/oxide-zone-network-setup:default.log (2055 bytes)
12392024-11-20T02:31:54.937Zuploaded: /pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c/root/var/svc/log/oxide-zone-network-setup:default.log
12402024-11-20T02:31:54.937Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4/root/var/svc/log/oxide-crucible-agent:default.log (1555 bytes)
12412024-11-20T02:31:56.035Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4/root/var/svc/log/oxide-crucible-agent:default.log
12422024-11-20T02:31:56.035Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12432024-11-20T02:31:57.129Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4/root/var/svc/log/oxide-crucible-downstairs:default.log
12442024-11-20T02:31:57.129Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
12452024-11-20T02:31:58.223Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4/root/var/svc/log/oxide-zone-network-setup:default.log
12462024-11-20T02:31:58.223Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-chrony-setup:default.log (14496 bytes)
12472024-11-20T02:31:59.342Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-chrony-setup:default.log
12482024-11-20T02:31:59.367Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-ntp:default.log (864 bytes)
12492024-11-20T02:31:59.391Zupload warning: file "/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 864 -> 932
12502024-11-20T02:32:00.463Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-ntp:default.log
12512024-11-20T02:32:00.463Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-opte-interface-setup:default.log (1126 bytes)
12522024-11-20T02:32:01.556Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-opte-interface-setup:default.log
12532024-11-20T02:32:01.580Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-zone-network-setup:default.log (2031 bytes)
12542024-11-20T02:32:02.652Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/svc/log/oxide-zone-network-setup:default.log
12552024-11-20T02:32:02.653Zuploading: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-crucible-agent:default.log (20601 bytes)
12562024-11-20T02:32:03.792Zuploaded: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-crucible-agent:default.log
12572024-11-20T02:32:03.792Zuploading: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12582024-11-20T02:32:04.889Zuploaded: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-crucible-downstairs:default.log
12592024-11-20T02:32:04.889Zuploading: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab32c74b-9736-4093-83f4-0bef4f436666.log (6075 bytes)
12602024-11-20T02:32:05.981Zuploaded: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab32c74b-9736-4093-83f4-0bef4f436666.log
12612024-11-20T02:32:06.004Zuploading: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-crucible-downstairs:snapshot-ab32c74b-9736-4093-83f4-0bef4f436666-d4b65909-f53b-420f-a14a-b0fa6fade9ee.log (5663 bytes)
12622024-11-20T02:32:07.076Zuploaded: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-crucible-downstairs:snapshot-ab32c74b-9736-4093-83f4-0bef4f436666-d4b65909-f53b-420f-a14a-b0fa6fade9ee.log
12632024-11-20T02:32:07.077Zuploading: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-zone-network-setup:default.log (2082 bytes)
12642024-11-20T02:32:08.172Zuploaded: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8/root/var/svc/log/oxide-zone-network-setup:default.log
12652024-11-20T02:32:08.172Zuploading: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab/root/var/svc/log/oxide-crucible-pantry:default.log (103599 bytes)
12662024-11-20T02:32:08.353Zupload warning: file "/pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 103599 -> 123174
12672024-11-20T02:32:09.424Zuploaded: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab/root/var/svc/log/oxide-crucible-pantry:default.log
12682024-11-20T02:32:09.447Zuploading: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab/root/var/svc/log/oxide-zone-network-setup:default.log (2139 bytes)
12692024-11-20T02:32:10.519Zuploaded: /pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab/root/var/svc/log/oxide-zone-network-setup:default.log
12702024-11-20T02:32:10.542Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40/root/var/svc/log/oxide-cockroach-admin:default.log (4704 bytes)
12712024-11-20T02:32:11.614Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40/root/var/svc/log/oxide-cockroach-admin:default.log
12722024-11-20T02:32:11.614Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40/root/var/svc/log/oxide-cockroachdb:default.log (4326 bytes)
12732024-11-20T02:32:12.709Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40/root/var/svc/log/oxide-cockroachdb:default.log
12742024-11-20T02:32:12.709Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40/root/var/svc/log/oxide-zone-network-setup:default.log (2092 bytes)
12752024-11-20T02:32:13.804Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40/root/var/svc/log/oxide-zone-network-setup:default.log
12762024-11-20T02:32:13.827Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-agent:default.log (28562 bytes)
12772024-11-20T02:32:14.941Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-agent:default.log
12782024-11-20T02:32:14.941Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12792024-11-20T02:32:16.038Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-downstairs:default.log
12802024-11-20T02:32:16.038Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-downstairs:downstairs-8a09146d-a3ad-4bdc-a085-ce9a451ca74e.log (3126 bytes)
12812024-11-20T02:32:17.133Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-downstairs:downstairs-8a09146d-a3ad-4bdc-a085-ce9a451ca74e.log
12822024-11-20T02:32:17.133Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-downstairs:downstairs-e3af2c81-de8a-413d-af5b-40ef369c9e0c.log (6073 bytes)
12832024-11-20T02:32:18.227Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-downstairs:downstairs-e3af2c81-de8a-413d-af5b-40ef369c9e0c.log
12842024-11-20T02:32:18.227Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-downstairs:snapshot-e3af2c81-de8a-413d-af5b-40ef369c9e0c-d4b65909-f53b-420f-a14a-b0fa6fade9ee.log (5665 bytes)
12852024-11-20T02:32:19.321Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-crucible-downstairs:snapshot-e3af2c81-de8a-413d-af5b-40ef369c9e0c-d4b65909-f53b-420f-a14a-b0fa6fade9ee.log
12862024-11-20T02:32:19.344Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-zone-network-setup:default.log (2080 bytes)
12872024-11-20T02:32:20.415Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26/root/var/svc/log/oxide-zone-network-setup:default.log
12882024-11-20T02:32:20.439Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
12892024-11-20T02:32:20.508Zupload warning: file "/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 0 -> 19575
12902024-11-20T02:32:21.588Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-crucible-pantry:default.log
12912024-11-20T02:32:21.588Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-crucible-pantry:default.log.0 (102052 bytes)
12922024-11-20T02:32:22.784Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-crucible-pantry:default.log.0
12932024-11-20T02:32:22.784Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12942024-11-20T02:32:23.855Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-zone-network-setup:default.log
12952024-11-20T02:32:23.855Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-zone-network-setup:default.log.0 (2139 bytes)
12962024-11-20T02:32:24.949Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079/root/var/svc/log/oxide-zone-network-setup:default.log.0
12972024-11-20T02:32:24.949Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82/root/var/svc/log/oxide-internal_dns:default.log (456364 bytes)
12982024-11-20T02:32:25.358Zupload warning: file "/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 456364 -> 463868
12992024-11-20T02:32:26.429Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82/root/var/svc/log/oxide-internal_dns:default.log
13002024-11-20T02:32:26.429Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82/root/var/svc/log/oxide-zone-network-setup:default.log (2094 bytes)
13012024-11-20T02:32:27.523Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82/root/var/svc/log/oxide-zone-network-setup:default.log
13022024-11-20T02:32:27.523Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76/root/var/svc/log/oxide-oximeter:default.log (3286095 bytes)
13032024-11-20T02:32:29.282Zupload warning: file "/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 3286095 -> 3949233
13042024-11-20T02:32:30.353Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76/root/var/svc/log/oxide-oximeter:default.log
13052024-11-20T02:32:30.353Zuploading: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76/root/var/svc/log/oxide-zone-network-setup:default.log (2081 bytes)
13062024-11-20T02:32:31.454Zuploaded: /pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76/root/var/svc/log/oxide-zone-network-setup:default.log
13072024-11-20T02:32:31.454Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/measurements.log (219611 bytes)
13082024-11-20T02:32:31.748Zupload warning: file "/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/measurements.log" changed size mid upload: 219611 -> 265917
13092024-11-20T02:32:32.819Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/measurements.log
13102024-11-20T02:32:32.819Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/statistics.log (152451 bytes)
13112024-11-20T02:32:33.048Zupload warning: file "/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/statistics.log" changed size mid upload: 152451 -> 185796
13122024-11-20T02:32:34.126Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/statistics.log
13132024-11-20T02:32:34.126Zuploading: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/tracking.log (22052 bytes)
13142024-11-20T02:32:34.217Zupload warning: file "/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/tracking.log" changed size mid upload: 22052 -> 24956
13152024-11-20T02:32:35.287Zuploaded: /pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661/root/var/log/chrony/tracking.log