01HPTTWRJW9K20TDTTTM642P0G: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HPTTY1BRRDAJ69PPQ5QEW11M

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-17T06:51:12.366Zjob dependencies complete; ready to run (waiting for 41 m 49 s)
22024-02-17T07:45:31.112Zjob assigned to worker 01HPV03ZHWC5WHPFV7GB383VQY (queued for 54 m 18 s)
32024-02-17T07:45:31.308Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-02-17T07:45:31.356Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-02-17T07:45:31.394Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-02-17T07:45:31.428Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-02-17T07:45:31.462Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-02-17T07:45:31.495ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-02-17T07:45:31.529Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-02-17T07:45:31.563ZOxide Helios Version helios-2.0.22451 64-bit
112024-02-17T07:45:31.596ZConfiguring devices.
122024-02-17T07:45:31.630Z##################################################
132024-02-17T07:45:31.664Z#### ############# ##
142024-02-17T07:45:31.697Z### ### ############ ##
152024-02-17T07:45:31.731Z## ### # ## ### ## Oxide Computer Company ##
162024-02-17T07:45:31.996Z## ## ## ### # ### ##
172024-02-17T07:45:32.120Z## # ### #### #### This Station Under ##
182024-02-17T07:45:32.177Z### ### #### # ### Computer Control ##
192024-02-17T07:45:32.211Z#### #### ### ## ##
202024-02-17T07:45:32.247Z##################################################
212024-02-17T07:45:32.278ZHostname: buskin
222024-02-17T07:45:32.311ZLoading smf(7) service descriptions:
232024-02-17T07:45:33.463Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-a5d624f8861e2451.gz
242024-02-17T07:45:35.348Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-a5d624f8861e2451.gz
252024-02-17T07:45:35.348Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-02-17T07:45:54.101Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-02-17T07:45:54.101Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-5baf5881dde70245.gz
282024-02-17T07:46:13.469Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-5baf5881dde70245.gz
292024-02-17T07:46:13.469Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-02-17T07:46:14.319Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-02-17T07:46:14.319Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-02-17T07:46:17.555Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-02-17T07:46:17.585Zdownloading input: /input/package/work/version.txt
342024-02-17T07:46:17.624Zdownloaded input: /input/package/work/version.txt
352024-02-17T07:46:17.624Zdownloading input: /input/package/work/package.tar.gz
362024-02-17T07:46:32.812Zdownloaded input: /input/package/work/package.tar.gz
372024-02-17T07:46:32.812Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-02-17T07:46:54.643Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-02-17T07:46:54.643Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-02-17T07:47:01.325Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-02-17T07:47:01.351Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-02-17T07:47:34.484Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-02-17T07:47:34.484Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-02-17T07:48:07.500Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-02-17T07:48:07.501Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-02-17T07:48:36.003Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-02-17T07:48:36.003Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
482024-02-17T07:48:38.602Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
492024-02-17T07:48:38.602Zdownloading input: /input/package/work/zones/crucible.tar.gz
502024-02-17T07:48:44.637Zdownloaded input: /input/package/work/zones/crucible.tar.gz
512024-02-17T07:48:44.637Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-02-17T07:48:53.421Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-02-17T07:48:53.421Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-02-17T07:48:59.479Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-02-17T07:48:59.479Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-02-17T07:48:59.539Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-02-17T07:48:59.539Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-02-17T07:49:03.030Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-02-17T07:49:03.030Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-02-17T07:49:06.483Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-02-17T07:49:06.483Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-02-17T07:49:21.447Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-02-17T07:49:21.447Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-02-17T07:49:36.404Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-02-17T07:49:36.404Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-02-17T07:49:36.512Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-02-17T07:49:36.536Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-02-17T07:49:46.039Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-02-17T07:49:46.039Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-02-17T07:49:57.306Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-02-17T07:49:57.306Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-02-17T07:50:45.675Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-02-17T07:50:45.675Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-02-17T07:51:21.278Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-02-17T07:51:21.302Zstarting task 0: "setup"
762024-02-17T07:51:21.302Z++ uname -s
772024-02-17T07:51:21.302Z+ kern=SunOS
782024-02-17T07:51:21.302Z+ case "$kern" in
792024-02-17T07:51:21.302Z+ groupadd -g 12345 build
802024-02-17T07:51:21.302Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-02-17T07:51:23.296Z+ zfs create -o mountpoint=/work rpool/work
822024-02-17T07:51:23.328Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-02-17T07:51:23.353Z+ home_fs=zfs
842024-02-17T07:51:23.353Z+ [[ zfs == autofs ]]
852024-02-17T07:51:23.353Z+ mkdir -p /home/build
862024-02-17T07:51:23.353Z+ chown build:build /home/build /work
872024-02-17T07:51:25.337Z+ chmod 0700 /home/build /work
882024-02-17T07:51:25.361Zprocess exited: duration 4063 ms, exit code 0
 
892024-02-17T07:51:25.410Zstarting task 1: "authentication"
902024-02-17T07:51:25.454Zprocess exited: duration 44 ms, exit code 0
 
912024-02-17T07:51:25.502Zstarting task 2: "build"
922024-02-17T07:51:25.529Z+ trap _exit_trap EXIT
932024-02-17T07:51:25.529Z+ set +x
942024-02-17T07:51:52.955Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-02-17T07:51:53.201Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-02-17T07:51:53.201Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-02-17T07:51:53.201Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-02-17T07:51:53.202Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-02-17T07:51:53.202Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-02-17T07:51:53.226Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-02-17T07:51:53.226Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-02-17T07:51:53.226Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-02-17T07:51:53.226Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-02-17T07:51:53.226Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-02-17T07:51:53.226Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-02-17T07:51:53.226Z+ [[ -d /opt/oxide ]]
1072024-02-17T07:51:53.226Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-02-17T07:51:53.226Z+ pfexec mkdir /opt/oxide
1092024-02-17T07:51:53.226Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-02-17T07:51:53.226Z+ [[ -d /opt/oxide-underneath ]]
1112024-02-17T07:51:53.226Z+ cd /opt/oxide-underneath
1122024-02-17T07:51:53.226Z+ pfexec tar ceEp@/f - .
1132024-02-17T07:51:53.226Z+ cd /opt/oxide
1142024-02-17T07:51:53.226Z+ pfexec tar xveEp@/f -
1152024-02-17T07:51:53.259Zx ., 0 bytes, 0 tape blocks
1162024-02-17T07:51:53.259Zx ./opte, 0 bytes, 0 tape blocks
1172024-02-17T07:51:53.259Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-02-17T07:51:53.259Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-02-17T07:51:53.283Z+ pfexec rm -rf /opt/oxide-underneath
1202024-02-17T07:51:53.283Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-02-17T07:51:53.308Z+ pfexec mkdir /opt/oxide/work
1222024-02-17T07:51:53.308Z+ pfexec chown build:build /opt/oxide/work
1232024-02-17T07:51:53.308Z+ cd /opt/oxide/work
1242024-02-17T07:51:53.308Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-02-17T07:51:55.018ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-02-17T07:51:55.018Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1272024-02-17T07:51:55.018Zx out/omicron-sled-agent.tar, 123008000 bytes, 240250 tape blocks
1282024-02-17T07:51:55.018Zx out/oxlog.tar, 8557568 bytes, 16714 tape blocks
1292024-02-17T07:51:55.018Zx out/target/test, 75 bytes, 1 tape blocks
1302024-02-17T07:51:55.018Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-02-17T07:51:55.018Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1322024-02-17T07:51:55.018Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-02-17T07:51:55.018Zx target/release/omicron-package, 45872112 bytes, 89594 tape blocks
1342024-02-17T07:51:55.018Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-02-17T07:51:55.019Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-02-17T07:51:55.019Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-02-17T07:51:55.019Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-02-17T07:51:55.019Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-02-17T07:51:55.019Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-02-17T07:51:55.019Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-02-17T07:51:55.043Z
1422024-02-17T07:51:55.043Zreal 1.717495326
1432024-02-17T07:51:55.043Zuser 1.541643968
1442024-02-17T07:51:55.043Zsys 0.313415153
1452024-02-17T07:51:55.043Ztrap 0.000073602
1462024-02-17T07:51:55.043Ztflt 0.000000000
1472024-02-17T07:51:55.043Zdflt 0.000000000
1482024-02-17T07:51:55.043Zkflt 0.000000000
1492024-02-17T07:51:55.043Zlock 0.000000000
1502024-02-17T07:51:55.043Zslp 1.539062084
1512024-02-17T07:51:55.043Zlat 0.038573431
1522024-02-17T07:51:55.043Zstop 0.000129633
1532024-02-17T07:51:55.043Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-02-17T07:51:56.246Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-02-17T07:51:56.270Z+ mkdir tests
1562024-02-17T07:51:56.270Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-02-17T07:51:56.270Z+ ptime -m gunzip
1582024-02-17T07:51:56.270Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-a5d624f8861e2451
1592024-02-17T07:51:56.497Z
1602024-02-17T07:51:56.521Zreal 0.232317213
1612024-02-17T07:51:56.521Zuser 0.213480327
1622024-02-17T07:51:56.522Zsys 0.018562439
1632024-02-17T07:51:56.522Ztrap 0.000023911
1642024-02-17T07:51:56.522Ztflt 0.000000000
1652024-02-17T07:51:56.522Zdflt 0.000000000
1662024-02-17T07:51:56.522Zkflt 0.000000000
1672024-02-17T07:51:56.522Zlock 0.000000000
1682024-02-17T07:51:56.522Zslp 0.000024510
1692024-02-17T07:51:56.522Zlat 0.000023520
1702024-02-17T07:51:56.522Zstop 0.000135072
1712024-02-17T07:51:56.522Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-a5d624f8861e2451
1722024-02-17T07:51:56.522Z+ chmod a+x tests/bootstrap-a5d624f8861e2451
1732024-02-17T07:51:56.522Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-02-17T07:51:56.522Z+ ptime -m gunzip
1752024-02-17T07:51:56.522Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-02-17T07:51:59.040Z
1772024-02-17T07:51:59.065Zreal 2.532480327
1782024-02-17T07:51:59.065Zuser 2.352093586
1792024-02-17T07:51:59.065Zsys 0.180052253
1802024-02-17T07:51:59.065Ztrap 0.000153653
1812024-02-17T07:51:59.065Ztflt 0.000000000
1822024-02-17T07:51:59.065Zdflt 0.000000000
1832024-02-17T07:51:59.065Zkflt 0.000000000
1842024-02-17T07:51:59.065Zlock 0.000000000
1852024-02-17T07:51:59.065Zslp 0.000019710
1862024-02-17T07:51:59.065Zlat 0.000012830
1872024-02-17T07:51:59.065Zstop 0.000096082
1882024-02-17T07:51:59.065Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-02-17T07:51:59.065Z+ chmod a+x tests/bootstrap
1902024-02-17T07:51:59.065Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-02-17T07:51:59.066Z+ ptime -m gunzip
1922024-02-17T07:51:59.066Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-5baf5881dde70245
1932024-02-17T07:52:01.635Z
1942024-02-17T07:52:01.660Zreal 2.582406247
1952024-02-17T07:52:01.660Zuser 2.415486728
1962024-02-17T07:52:01.660Zsys 0.166475920
1972024-02-17T07:52:01.660Ztrap 0.000206574
1982024-02-17T07:52:01.660Ztflt 0.000000000
1992024-02-17T07:52:01.660Zdflt 0.000000000
2002024-02-17T07:52:01.661Zkflt 0.000000000
2012024-02-17T07:52:01.661Zlock 0.000000000
2022024-02-17T07:52:01.661Zslp 0.000025080
2032024-02-17T07:52:01.661Zlat 0.000022660
2042024-02-17T07:52:01.661Zstop 0.000128813
2052024-02-17T07:52:01.661Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-5baf5881dde70245
2062024-02-17T07:52:01.661Z+ chmod a+x tests/end_to_end_tests-5baf5881dde70245
2072024-02-17T07:52:01.661Z+ bmat address ls
2082024-02-17T07:52:01.661ZNAME CIDR FIRST LAST COUNT
2092024-02-17T07:52:01.661Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-02-17T07:52:01.661Z++ bmat address ls -f extra -Ho first,last,count
2112024-02-17T07:52:01.686Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-02-17T07:52:01.686Z+ EXTRA_IP_START=10.151.1.164
2132024-02-17T07:52:01.686Z+ EXTRA_IP_END=10.151.1.227
2142024-02-17T07:52:01.686Z+ EXTRA_IP_COUNT=64
2152024-02-17T07:52:01.686Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-02-17T07:52:01.686Z+ EXTRA_IP_BASE=10.151.1
2172024-02-17T07:52:01.686Z+ EXTRA_IP_FOCTET=164
2182024-02-17T07:52:01.686Z+ EXTRA_IP_LOCTET=227
2192024-02-17T07:52:01.686Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-02-17T07:52:01.686Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-02-17T07:52:01.686Z+ DNS_IP1=10.151.1.164
2222024-02-17T07:52:01.686Z+ DNS_IP2=10.151.1.165
2232024-02-17T07:52:01.687Z+ UPLINK_IP=10.151.1.174
2242024-02-17T07:52:01.687Z+ IPPOOL_START=10.151.1.175
2252024-02-17T07:52:01.687Z+ IPPOOL_END=10.151.1.227
2262024-02-17T07:52:01.687Z++ ipadm show-addr -po type,addr
2272024-02-17T07:52:01.687Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-02-17T07:52:01.687Z+ GATEWAY_IP=10.151.1.100
2292024-02-17T07:52:01.687Z+ [[ -n 10.151.1.100 ]]
2302024-02-17T07:52:01.687Z+ ping -s 10.151.1.100 56 1
2312024-02-17T07:52:01.687ZPING 10.151.1.100: 56 data bytes
2322024-02-17T07:52:01.687Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2332024-02-17T07:52:01.687Z
2342024-02-17T07:52:01.687Z----10.151.1.100 PING Statistics----
2352024-02-17T07:52:01.687Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-02-17T07:52:01.687Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2372024-02-17T07:52:01.687Z++ arp -an
2382024-02-17T07:52:01.687Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-02-17T07:52:01.712Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-02-17T07:52:01.712Z+ routeadm -e ipv4-forwarding -u
2412024-02-17T07:52:01.801Z+ PXA_START=10.151.1.164
2422024-02-17T07:52:01.801Z+ PXA_END=10.151.1.227
2432024-02-17T07:52:01.801Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-02-17T07:52:01.826Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-02-17T07:52:01.999Z+ ZPOOL_VDEV_DIR=/scratch
2462024-02-17T07:52:02.000Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-02-17T07:52:02.025Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-02-17T07:52:02.025Z++ cd ./tools
2492024-02-17T07:52:02.025Z++ pwd
2502024-02-17T07:52:02.025Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-02-17T07:52:02.025Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-02-17T07:52:02.025Z+ SOFTNPU_MODE=zone
2532024-02-17T07:52:02.025Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-02-17T07:52:02.025Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-02-17T07:52:02.025Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-02-17T07:52:02.025Z++ dladm show-phys -p -o LINK
2572024-02-17T07:52:02.025Z++ head -1
2582024-02-17T07:52:02.025Z+ PHYSICAL_LINK=igb0
2592024-02-17T07:52:02.025Z+ echo 'Using igb0 as physical link'
2602024-02-17T07:52:02.025ZUsing igb0 as physical link
2612024-02-17T07:52:02.051Z+ ensure_run_as_root
2622024-02-17T07:52:02.051Z++ id -u
2632024-02-17T07:52:02.051Z+ [[ 0 -ne 0 ]]
2642024-02-17T07:52:02.051Z+ ensure_zpools
2652024-02-17T07:52:02.051Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-02-17T07:52:02.051Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-02-17T07:52:02.051Z+ readarray -t ZPOOLS
2682024-02-17T07:52:02.051Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-02-17T07:52:02.051Z++ sed 's/[ ",]//g'
2702024-02-17T07:52:02.051Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-02-17T07:52:02.051Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-02-17T07:52:02.051ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-02-17T07:52:02.051Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-02-17T07:52:02.051Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-02-17T07:52:02.051Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-02-17T07:52:02.051Z0+0 records in
2772024-02-17T07:52:02.052Z0+0 records out
2782024-02-17T07:52:02.052Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2792024-02-17T07:52:02.052Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-02-17T07:52:02.052Z+ set +x
2812024-02-17T07:52:02.052ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-02-17T07:52:02.052Z++ zpool list -o name
2832024-02-17T07:52:02.052Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-02-17T07:52:02.052Z+ [[ -z '' ]]
2852024-02-17T07:52:02.052Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-17T07:52:02.083Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-02-17T07:52:02.107Z+ set +x
2882024-02-17T07:52:02.108ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-02-17T07:52:02.108Z+ for ZPOOL in "${ZPOOLS[@]}"
2902024-02-17T07:52:02.108Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2912024-02-17T07:52:02.108Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2922024-02-17T07:52:02.108Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2932024-02-17T07:52:02.108ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2942024-02-17T07:52:02.108Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-02-17T07:52:02.108Z0+0 records in
2962024-02-17T07:52:02.108Z0+0 records out
2972024-02-17T07:52:02.108Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2982024-02-17T07:52:02.108Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-02-17T07:52:02.108Z+ set +x
3002024-02-17T07:52:02.108ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-02-17T07:52:02.108Z++ zpool list -o name
3022024-02-17T07:52:02.108Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-02-17T07:52:02.108Z+ [[ -z '' ]]
3042024-02-17T07:52:02.108Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-17T07:52:02.133Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-02-17T07:52:02.133Z+ set +x
3072024-02-17T07:52:02.133ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-02-17T07:52:02.133Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-02-17T07:52:02.133Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-02-17T07:52:02.134ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-02-17T07:52:02.134Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-02-17T07:52:02.134Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-02-17T07:52:02.134Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-02-17T07:52:02.134Z0+0 records in
3152024-02-17T07:52:02.134Z0+0 records out
3162024-02-17T07:52:02.134Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3172024-02-17T07:52:02.134Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-02-17T07:52:02.134Z+ set +x
3192024-02-17T07:52:02.134ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-02-17T07:52:02.134Z++ zpool list -o name
3212024-02-17T07:52:02.134Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-02-17T07:52:02.160Z+ [[ -z '' ]]
3232024-02-17T07:52:02.160Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-02-17T07:52:02.186Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-02-17T07:52:02.187Z+ set +x
3262024-02-17T07:52:02.187ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-02-17T07:52:02.187Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-02-17T07:52:02.187Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-02-17T07:52:02.187ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3302024-02-17T07:52:02.187Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3312024-02-17T07:52:02.187Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-02-17T07:52:02.187Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-02-17T07:52:02.187Z0+0 records in
3342024-02-17T07:52:02.187Z0+0 records out
3352024-02-17T07:52:02.187Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3362024-02-17T07:52:02.187Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-02-17T07:52:02.187Z+ set +x
3382024-02-17T07:52:02.187ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-02-17T07:52:02.187Z++ zpool list -o name
3402024-02-17T07:52:02.187Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-02-17T07:52:02.187Z+ [[ -z '' ]]
3422024-02-17T07:52:02.187Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-17T07:52:02.213Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-02-17T07:52:02.213Z+ set +x
3452024-02-17T07:52:02.213ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-02-17T07:52:02.213Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-02-17T07:52:02.213Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3482024-02-17T07:52:02.213ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3492024-02-17T07:52:02.213Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-02-17T07:52:02.213Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-02-17T07:52:02.213Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-02-17T07:52:02.213Z0+0 records in
3532024-02-17T07:52:02.213Z0+0 records out
3542024-02-17T07:52:02.213Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3552024-02-17T07:52:02.213Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-02-17T07:52:02.214Z+ set +x
3572024-02-17T07:52:02.214ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-02-17T07:52:02.214Z++ zpool list -o name
3592024-02-17T07:52:02.214Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-02-17T07:52:02.240Z+ [[ -z '' ]]
3612024-02-17T07:52:02.240Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-17T07:52:02.265Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-02-17T07:52:02.265Z+ set +x
3642024-02-17T07:52:02.266ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-02-17T07:52:02.266Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-02-17T07:52:02.266Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-02-17T07:52:02.266ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-02-17T07:52:02.266Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-02-17T07:52:02.266Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-02-17T07:52:02.266Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-02-17T07:52:02.266Z0+0 records in
3722024-02-17T07:52:02.266Z0+0 records out
3732024-02-17T07:52:02.266Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3742024-02-17T07:52:02.266Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-02-17T07:52:02.266Z+ set +x
3762024-02-17T07:52:02.266ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-02-17T07:52:02.266Z++ zpool list -o name
3782024-02-17T07:52:02.266Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-02-17T07:52:02.266Z+ [[ -z '' ]]
3802024-02-17T07:52:02.266Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-17T07:52:02.291Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-02-17T07:52:02.291Z+ set +x
3832024-02-17T07:52:02.291ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-02-17T07:52:02.291Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-02-17T07:52:02.292Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3862024-02-17T07:52:02.292ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3872024-02-17T07:52:02.292Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-02-17T07:52:02.292Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-02-17T07:52:02.292Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-02-17T07:52:02.292Z0+0 records in
3912024-02-17T07:52:02.292Z0+0 records out
3922024-02-17T07:52:02.292Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3932024-02-17T07:52:02.292Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-02-17T07:52:02.292Z+ set +x
3952024-02-17T07:52:02.292ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-02-17T07:52:02.317Z++ zpool list -o name
3972024-02-17T07:52:02.317Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-02-17T07:52:02.317Z+ [[ -z '' ]]
3992024-02-17T07:52:02.317Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-17T07:52:02.342Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-02-17T07:52:02.342Z+ set +x
4022024-02-17T07:52:02.342ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-02-17T07:52:02.342Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-02-17T07:52:02.342Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4052024-02-17T07:52:02.342ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4062024-02-17T07:52:02.342Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-02-17T07:52:02.343Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-02-17T07:52:02.343Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-02-17T07:52:02.343Z0+0 records in
4102024-02-17T07:52:02.343Z0+0 records out
4112024-02-17T07:52:02.343Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4122024-02-17T07:52:02.343Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-02-17T07:52:02.343Z+ set +x
4142024-02-17T07:52:02.343ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-02-17T07:52:02.343Z++ zpool list -o name
4162024-02-17T07:52:02.343Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-02-17T07:52:02.369Z+ [[ -z '' ]]
4182024-02-17T07:52:02.369Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-17T07:52:02.394Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-02-17T07:52:02.394Z+ set +x
4212024-02-17T07:52:02.394ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-02-17T07:52:02.394Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-02-17T07:52:02.394Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-02-17T07:52:02.394Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4252024-02-17T07:52:02.394ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4262024-02-17T07:52:02.394Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-02-17T07:52:02.394Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-02-17T07:52:02.394Z0+0 records in
4292024-02-17T07:52:02.394Z0+0 records out
4302024-02-17T07:52:02.394Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4312024-02-17T07:52:02.394Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-02-17T07:52:02.394Z+ set +x
4332024-02-17T07:52:02.394ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-02-17T07:52:02.394Z++ zpool list -o name
4352024-02-17T07:52:02.394Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-02-17T07:52:02.394Z+ [[ -z '' ]]
4372024-02-17T07:52:02.394Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-17T07:52:02.419Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-02-17T07:52:02.419Z+ set +x
4402024-02-17T07:52:02.419ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-02-17T07:52:02.419Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-02-17T07:52:02.420Z+ readarray -t ZPOOLS
4432024-02-17T07:52:02.420Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-02-17T07:52:02.445Z++ sed 's/[ ",]//g'
4452024-02-17T07:52:02.445Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-02-17T07:52:02.445Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-02-17T07:52:02.445ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-02-17T07:52:02.445Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-02-17T07:52:02.445Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-02-17T07:52:02.445Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-02-17T07:52:02.445Z0+0 records in
4522024-02-17T07:52:02.445Z0+0 records out
4532024-02-17T07:52:02.445Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4542024-02-17T07:52:02.445Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-02-17T07:52:02.445Z+ set +x
4562024-02-17T07:52:02.446ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-02-17T07:52:02.446Z++ zpool list -o name
4582024-02-17T07:52:02.446Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-02-17T07:52:02.446Z+ [[ -z '' ]]
4602024-02-17T07:52:02.446Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-17T07:52:02.482Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-02-17T07:52:02.482Z+ set +x
4632024-02-17T07:52:02.482ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4642024-02-17T07:52:02.482Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-02-17T07:52:02.482Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4662024-02-17T07:52:02.482ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4672024-02-17T07:52:02.483Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4682024-02-17T07:52:02.483Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4692024-02-17T07:52:02.483Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-02-17T07:52:02.483Z0+0 records in
4712024-02-17T07:52:02.483Z0+0 records out
4722024-02-17T07:52:02.483Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-02-17T07:52:02.483Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-02-17T07:52:02.483Z+ set +x
4752024-02-17T07:52:02.483ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-02-17T07:52:02.509Z++ zpool list -o name
4772024-02-17T07:52:02.509Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-02-17T07:52:02.509Z+ [[ -z '' ]]
4792024-02-17T07:52:02.509Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-17T07:52:02.533Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-02-17T07:52:02.534Z+ set +x
4822024-02-17T07:52:02.534ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-02-17T07:52:02.534Z+ [[ zone == \z\o\n\e ]]
4842024-02-17T07:52:02.534Z+ ensure_simulated_links igb0
4852024-02-17T07:52:02.534Z+ local PHYSICAL_LINK=igb0
4862024-02-17T07:52:02.534Z+ INDICES=("0" "1")
4872024-02-17T07:52:02.534Z+ for I in "${INDICES[@]}"
4882024-02-17T07:52:02.534Z++ get_simnet_name_if_exists net0
4892024-02-17T07:52:02.534Z++ dladm show-simnet -p -o LINK net0
4902024-02-17T07:52:02.534Z++ echo ''
4912024-02-17T07:52:02.534Z+ [[ -z '' ]]
4922024-02-17T07:52:02.535Z+ dladm create-simnet -t net0
4932024-02-17T07:52:02.535Z+ dladm create-simnet -t sc0_0
4942024-02-17T07:52:02.535Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-02-17T07:52:02.535Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-02-17T07:52:02.535Z+ success 'Simnet net0/sc0_0 exists'
4972024-02-17T07:52:02.535Z+ set +x
4982024-02-17T07:52:02.535ZSimnet net0/sc0_0 exists
4992024-02-17T07:52:02.535Z+ for I in "${INDICES[@]}"
5002024-02-17T07:52:02.560Z++ get_simnet_name_if_exists net1
5012024-02-17T07:52:02.561Z++ dladm show-simnet -p -o LINK net1
5022024-02-17T07:52:02.561Z++ echo ''
5032024-02-17T07:52:02.561Z+ [[ -z '' ]]
5042024-02-17T07:52:02.561Z+ dladm create-simnet -t net1
5052024-02-17T07:52:02.561Z+ dladm create-simnet -t sc1_0
5062024-02-17T07:52:02.561Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-02-17T07:52:02.561Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-02-17T07:52:02.561Z+ success 'Simnet net1/sc1_0 exists'
5092024-02-17T07:52:02.561Z+ set +x
5102024-02-17T07:52:02.561ZSimnet net1/sc1_0 exists
5112024-02-17T07:52:02.561Z++ get_vnic_name_if_exists sc0_1
5122024-02-17T07:52:02.561Z++ dladm show-vnic -p -o LINK sc0_1
5132024-02-17T07:52:02.587Z++ echo ''
5142024-02-17T07:52:02.587Z+ [[ -z '' ]]
5152024-02-17T07:52:02.587Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-02-17T07:52:02.587Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-02-17T07:52:02.587Z+ success 'Vnic sc0_1 exists'
5182024-02-17T07:52:02.587Z+ set +x
5192024-02-17T07:52:02.587ZVnic sc0_1 exists
5202024-02-17T07:52:02.587Z+ warn_if_no_proxy_arp
5212024-02-17T07:52:02.587Z+ [[ -v PXA_START ]]
5222024-02-17T07:52:02.587Z+ [[ -v PXA_END ]]
5232024-02-17T07:52:02.587Z+ ensure_softnpu_zone
5242024-02-17T07:52:02.587Z+ zoneadm list
5252024-02-17T07:52:02.587Z+ grep -q sidecar_softnpu
5262024-02-17T07:52:02.587Z+ [[ -f out/npuzone/npuzone ]]
5272024-02-17T07:52:02.587Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-02-17T07:52:02.613Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-02-17T07:52:07.635Zdownloading softnpu ...done
5302024-02-17T07:52:07.659Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-02-17T07:52:11.657Zdownloading asic_program.so ...done
5322024-02-17T07:52:11.681Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-02-17T07:52:18.613Zdownloading scadm ...done
5342024-02-17T07:52:18.637Zcreating port tfportrear0_0 for sc0_0
5352024-02-17T07:52:18.637Zcreating port tfportqsfp0_0 for sc0_1
5362024-02-17T07:52:18.661Zsoftnpu zone setup
5372024-02-17T07:52:18.662Zconfigure zone
5382024-02-17T07:52:18.685Zinstall zone
5392024-02-17T07:52:19.686Zboot zone
5402024-02-17T07:52:22.798Z[sidecar_softnpu] svcs milestone/network
5412024-02-17T07:52:22.825ZSTATE STIME FMRI
5422024-02-17T07:52:22.825Zonline 7:52:20 svc:/milestone/network:default
5432024-02-17T07:52:22.825Z[sidecar_softnpu] /softnpu/npu start
5442024-02-17T07:52:22.855Z
5452024-02-17T07:52:22.880Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-02-17T07:52:22.880Z+ GATEWAY_IP=10.151.1.100
5472024-02-17T07:52:22.880Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-02-17T07:52:22.880ZUsing 10.151.1.100 as gateway ip
5492024-02-17T07:52:22.880Z+ [[ ! -v GATEWAY_MAC ]]
5502024-02-17T07:52:22.880Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-02-17T07:52:22.880Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-02-17T07:52:22.880Z+++ echo 18:c0:4d:0d:9f:b2
5532024-02-17T07:52:22.880Z+ COUNT=1
5542024-02-17T07:52:22.880Z+ [[ 1 -ne 1 ]]
5552024-02-17T07:52:22.880Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-02-17T07:52:22.880ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-02-17T07:52:22.880Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-02-17T07:52:22.880Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-02-17T07:52:22.904Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-02-17T07:52:22.904Z+ [[ -v PXA_START ]]
5612024-02-17T07:52:22.904Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-02-17T07:52:22.904Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-02-17T07:52:22.928Z+ z_scadm dump-state
5642024-02-17T07:52:22.929Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-02-17T07:52:22.952Zlocal v6:
5662024-02-17T07:52:22.952Zlocal v4:
5672024-02-17T07:52:22.953Zrouter v6:
5682024-02-17T07:52:22.953Zrouter v4_idx:
5692024-02-17T07:52:22.953Zrouter v4_routes:
5702024-02-17T07:52:22.953Zresolver v4:
5712024-02-17T07:52:22.953Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-02-17T07:52:22.953Zresolver v6:
5732024-02-17T07:52:22.953Znat v4:
5742024-02-17T07:52:22.953Znat_v6:
5752024-02-17T07:52:22.953Zport_mac:
5762024-02-17T07:52:22.953Zproxy arp:
5772024-02-17T07:52:22.953Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-02-17T07:52:22.953Z+ success 'softnpu zone exists'
5792024-02-17T07:52:22.953Z+ set +x
5802024-02-17T07:52:22.953Zsoftnpu zone exists
5812024-02-17T07:52:22.977Z
5822024-02-17T07:52:22.977Zreal 20.950202605
5832024-02-17T07:52:22.977Zuser 0.711497266
5842024-02-17T07:52:22.977Zsys 1.513142464
5852024-02-17T07:52:22.977Ztrap 0.000075654
5862024-02-17T07:52:22.977Ztflt 0.000133176
5872024-02-17T07:52:22.977Zdflt 0.001616911
5882024-02-17T07:52:22.977Zkflt 0.000000000
5892024-02-17T07:52:22.977Zlock 16:11.660094656
5902024-02-17T07:52:22.977Zslp 1:02.581200624
5912024-02-17T07:52:22.978Zlat 0.054374357
5922024-02-17T07:52:22.978Zstop 0.364777886
5932024-02-17T07:52:22.978Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-02-17T07:52:23.002Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-02-17T07:52:23.002Z+ SILO_NAME=recovery
5962024-02-17T07:52:23.002Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-02-17T07:52:23.002Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-02-17T07:52:23.002Z+ sed -i~ '
5992024-02-17T07:52:23.003Z /^external_dns_ips/c\
6002024-02-17T07:52:23.003Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-02-17T07:52:23.003Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-02-17T07:52:23.003Z /^first/c\
6032024-02-17T07:52:23.003Zfirst = "10.151.1.164"
6042024-02-17T07:52:23.003Z /^last/c\
6052024-02-17T07:52:23.003Zlast = "10.151.1.173"
6062024-02-17T07:52:23.003Z }
6072024-02-17T07:52:23.003Z /^\[rack_network_config/,/^$/ {
6082024-02-17T07:52:23.003Z /^infra_ip_first/c\
6092024-02-17T07:52:23.003Zinfra_ip_first = "10.151.1.174"
6102024-02-17T07:52:23.003Z /^infra_ip_last/c\
6112024-02-17T07:52:23.003Zinfra_ip_last = "10.151.1.174"
6122024-02-17T07:52:23.003Z }
6132024-02-17T07:52:23.003Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-02-17T07:52:23.003Z /^routes/c\
6152024-02-17T07:52:23.003Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-02-17T07:52:23.003Z /^addresses/c\
6172024-02-17T07:52:23.003Zaddresses = \["10.151.1.174/24"\]
6182024-02-17T07:52:23.003Z }
6192024-02-17T07:52:23.003Z' pkg/config-rss.toml
6202024-02-17T07:52:23.003Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-02-17T07:52:23.003Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-02-17T07:52:23.003Z+++ pkg/config-rss.toml Sat Feb 17 07:52:22 2024
6232024-02-17T07:52:23.004Z@@ -33,7 +33,7 @@
6242024-02-17T07:52:23.004Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-02-17T07:52:23.004Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-02-17T07:52:23.004Z # below.
6272024-02-17T07:52:23.004Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-02-17T07:52:23.004Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-02-17T07:52:23.004Z
6302024-02-17T07:52:23.004Z # Initial TLS certificates for the external API
6312024-02-17T07:52:23.004Z #
6322024-02-17T07:52:23.004Z@@ -69,8 +69,8 @@
6332024-02-17T07:52:23.004Z #
6342024-02-17T07:52:23.004Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-02-17T07:52:23.004Z [[internal_services_ip_pool_ranges]]
6362024-02-17T07:52:23.004Z-first = "192.168.1.20"
6372024-02-17T07:52:23.004Z-last = "192.168.1.29"
6382024-02-17T07:52:23.004Z+first = "10.151.1.164"
6392024-02-17T07:52:23.004Z+last = "10.151.1.173"
6402024-02-17T07:52:23.004Z
6412024-02-17T07:52:23.004Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-02-17T07:52:23.004Z # parameters should be provided to the control plane via wicket, but we need to
6432024-02-17T07:52:23.004Z@@ -100,9 +100,9 @@
6442024-02-17T07:52:23.004Z # You can configure multiple uplinks by repeating the following stanza
6452024-02-17T07:52:23.004Z [[rack_network_config.ports]]
6462024-02-17T07:52:23.004Z # Routes associated with this port.
6472024-02-17T07:52:23.005Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6482024-02-17T07:52:23.005Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6492024-02-17T07:52:23.005Z # Addresses associated with this port.
6502024-02-17T07:52:23.005Z-addresses = ["192.168.1.30/24"]
6512024-02-17T07:52:23.005Z+addresses = ["10.151.1.174/24"]
6522024-02-17T07:52:23.005Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6532024-02-17T07:52:23.005Z port = "qsfp0"
6542024-02-17T07:52:23.005Z # The speed of this port.
6552024-02-17T07:52:23.005Z+ true
6562024-02-17T07:52:23.005Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6572024-02-17T07:52:23.029Za pkg/config-rss.toml 7K
6582024-02-17T07:52:23.029Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6592024-02-17T07:52:23.029Z+ TLS_NAME=recovery.sys.oxide.test
6602024-02-17T07:52:23.029Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6612024-02-17T07:52:23.340Z......+...+.+............+...+.....+.........+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+......+.....+.......+..+.+..............+.+............+..+.+..+....+.....+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..+.......+............+......+.....+..........+............+..+............................+...+........+...............+.......+..+.......+......+...+..+.......+..+.+.....+.........+.............+......+......+...+......+.....+.+.....+.+.................+...+.........+....+.....+...................+.....+......+............+............+............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6622024-02-17T07:52:24.453Z..+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+.....+.........+.....................+......+.......+......+.....+.......+..............+.+...............+.....+.......+...+.......................+................+...............+........+.+.........+.................+.+..+.......+........+...+...+....+...............+........+.......+..+....+....................+.....................+....+...........+......+...............+...+..........+.................+...+.+...+........+.......+......+......+..............+.+...+...+..............+.....................+............+...+............................+.....+.+.....+..........+........+..........+.....................+..+....+.........+..+..................+....+.....+................+..............+...+.........+...............+..................+.+.........+...+............+.....+......+.+......+.......................+.......+.....+...................+.........+..+...+.+......+..+...+.......+...+.................+.+.....+.........+......+.+...+...............+...+..+.+.........+..+...+......+....+...+........+.+.........+.............................+......+...................+.....+...+.........................+.........+...............+..................+..+...+...+.......+........+.........+.+...+.....................+......+.....+............+.+......+........+...+...+....+..+...+............+.+..............+...................+.....+...............+...............+......+...+.+.....+....+...+........+.+......+.................+...+....+........+..................+....+........+.......+.....+...+.......+...+..................+...+.........+...+.....+..................................+......+...+........................+...+..+.......+.....+......+.......+......+.................+..........+..+.+.....+.+......+.........+...............+...+...+.....+.............+.....................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6632024-02-17T07:52:24.496Z-----
6642024-02-17T07:52:24.496Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6652024-02-17T07:52:24.520Za pkg/initial-tls-cert.pem 2K
6662024-02-17T07:52:24.520Za pkg/initial-tls-key.pem 4K
6672024-02-17T07:52:24.520Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6682024-02-17T07:52:24.520Z+ rmdir pkg
6692024-02-17T07:52:24.520Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6702024-02-17T07:52:24.520Z+ pfexec mkdir -p /usr/oxide
6712024-02-17T07:52:24.520Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6722024-02-17T07:52:25.260Z+ pfexec chmod +x /usr/oxide/oxide
6732024-02-17T07:52:25.285Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6742024-02-17T07:52:43.533Z+ OMICRON_NO_UNINSTALL=1
6752024-02-17T07:52:43.533Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6762024-02-17T07:52:43.557ZLogging to: /opt/oxide/work/out/LOG
6772024-02-17T07:52:44.065Z
6782024-02-17T07:52:44.090Zreal 0.527070080
6792024-02-17T07:52:44.090Zuser 0.109672711
6802024-02-17T07:52:44.090Zsys 2.193023581
6812024-02-17T07:52:44.090Ztrap 0.000004029
6822024-02-17T07:52:44.090Ztflt 0.000027178
6832024-02-17T07:52:44.090Zdflt 0.001015211
6842024-02-17T07:52:44.090Zkflt 0.000004600
6852024-02-17T07:52:44.090Zlock 47.806933723
6862024-02-17T07:52:44.090Zslp 0.734623674
6872024-02-17T07:52:44.090Zlat 0.003345692
6882024-02-17T07:52:44.090Zstop 0.228549785
6892024-02-17T07:52:44.090Z+ retry=0
6902024-02-17T07:52:44.090Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6912024-02-17T07:52:44.090Z+ [[ 0 -gt 30 ]]
6922024-02-17T07:52:44.090Z+ sleep 1
6932024-02-17T07:52:45.081Z+ retry=1
6942024-02-17T07:52:45.081Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6952024-02-17T07:52:45.105Z+ [[ 1 -gt 30 ]]
6962024-02-17T07:52:45.105Z+ sleep 1
6972024-02-17T07:52:46.095Z+ retry=2
6982024-02-17T07:52:46.095Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6992024-02-17T07:52:46.119Z+ [[ 2 -gt 30 ]]
7002024-02-17T07:52:46.119Z+ sleep 1
7012024-02-17T07:52:47.110Z+ retry=3
7022024-02-17T07:52:47.110Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7032024-02-17T07:52:47.137Z+ [[ 3 -gt 30 ]]
7042024-02-17T07:52:47.137Z+ sleep 1
7052024-02-17T07:52:48.125Z+ retry=4
7062024-02-17T07:52:48.125Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-02-17T07:53:13.299Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7082024-02-17T07:53:13.327Zlocal v6:
7092024-02-17T07:53:13.327Zfe80::7419:54ff:fe95:6541
7102024-02-17T07:53:13.327Zfdeb:63e4:1d85:d0d8::1
7112024-02-17T07:53:13.327Zlocal v4:
7122024-02-17T07:53:13.327Z10.151.1.174
7132024-02-17T07:53:13.327Zrouter v6:
7142024-02-17T07:53:13.327Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::3458:f4ff:fe3a:cce8 (1)
7152024-02-17T07:53:13.328Zfd00:1122:3344:2::/64 -> fe80::3458:f4ff:fe3a:cce8 (1)
7162024-02-17T07:53:13.328Zfd00:1122:3344:101::/64 -> fe80::3458:f4ff:fe3a:cce8 (1)
7172024-02-17T07:53:13.328Zfd00:1122:3344:1::/64 -> fe80::3458:f4ff:fe3a:cce8 (1)
7182024-02-17T07:53:13.328Zfd00:1122:3344:3::/64 -> fe80::3458:f4ff:fe3a:cce8 (1)
7192024-02-17T07:53:13.328Zrouter v4_idx:
7202024-02-17T07:53:13.328Z0.0.0.0/0 -> 0
7212024-02-17T07:53:13.328Zrouter v4_routes:
7222024-02-17T07:53:13.328Z0 -> 10.151.1.100 (2)
7232024-02-17T07:53:13.328Zresolver v4:
7242024-02-17T07:53:13.352Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7252024-02-17T07:53:13.352Z10.151.1.174 -> 4e:28:61:d8:52:be
7262024-02-17T07:53:13.352Zresolver v6:
7272024-02-17T07:53:13.352Zfe80::7419:54ff:fe95:6541 -> 76:19:54:95:65:41
7282024-02-17T07:53:13.352Zfe80::3458:f4ff:fe3a:cce8 -> 36:58:f4:3a:cc:e8
7292024-02-17T07:53:13.352Znat v4:
7302024-02-17T07:53:13.352Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:80:d6
7312024-02-17T07:53:13.352Znat_v6:
7322024-02-17T07:53:13.352Zport_mac:
7332024-02-17T07:53:13.352Z1000: a8:40:25:23:02:4b
7342024-02-17T07:53:13.352Z1: a8:40:25:23:02:4c
7352024-02-17T07:53:13.353Z2: a8:40:25:23:02:6c
7362024-02-17T07:53:13.353Zproxy arp:
7372024-02-17T07:53:13.353Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7382024-02-17T07:53:13.353Z+ retry=0
7392024-02-17T07:53:13.353Z+++ zoneadm list -n
7402024-02-17T07:53:13.353Z+++ grep oxz_ntp
7412024-02-17T07:53:13.353Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
7422024-02-17T07:53:13.377Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7432024-02-17T07:53:13.377Z++ true
7442024-02-17T07:53:13.377Z+ [[ '' != online ]]
7452024-02-17T07:53:13.377Z+ [[ 0 -gt 60 ]]
7462024-02-17T07:53:13.377Z+ sleep 1
7472024-02-17T07:53:14.359Z+ retry=1
7482024-02-17T07:53:14.382Z+++ zoneadm list -n
7492024-02-17T07:53:14.383Z+++ grep oxz_ntp
7502024-02-17T07:53:14.383Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
7512024-02-17T07:53:14.406Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7522024-02-17T07:53:14.406Z++ true
7532024-02-17T07:53:14.406Z+ [[ '' != online ]]
7542024-02-17T07:53:14.406Z+ [[ 1 -gt 60 ]]
7552024-02-17T07:53:14.406Z+ sleep 1
7562024-02-17T07:53:15.389Z+ retry=2
7572024-02-17T07:53:15.412Z+++ zoneadm list -n
7582024-02-17T07:53:15.413Z+++ grep oxz_ntp
7592024-02-17T07:53:15.413Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
7602024-02-17T07:53:15.436Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7612024-02-17T07:53:15.436Z++ true
7622024-02-17T07:53:15.436Z+ [[ '' != online ]]
7632024-02-17T07:53:15.436Z+ [[ 2 -gt 60 ]]
7642024-02-17T07:53:15.436Z+ sleep 1
7652024-02-17T07:53:16.420Z+ retry=3
7662024-02-17T07:53:16.444Z+++ zoneadm list -n
7672024-02-17T07:53:16.444Z+++ grep oxz_ntp
7682024-02-17T07:53:16.444Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
7692024-02-17T07:53:16.444Z+ [[ disabled != online ]]
7702024-02-17T07:53:16.444Z+ [[ 3 -gt 60 ]]
7712024-02-17T07:53:16.444Z+ sleep 1
7722024-02-17T07:53:17.442Z+ retry=4
7732024-02-17T07:53:17.468Z+++ zoneadm list -n
7742024-02-17T07:53:17.468Z+++ grep oxz_ntp
7752024-02-17T07:53:17.469Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
7762024-02-17T07:53:17.469Z+ [[ disabled != online ]]
7772024-02-17T07:53:17.469Z+ [[ 4 -gt 60 ]]
7782024-02-17T07:53:17.469Z+ sleep 1
7792024-02-17T07:53:18.467Z+ retry=5
7802024-02-17T07:53:18.491Z+++ zoneadm list -n
7812024-02-17T07:53:18.491Z+++ grep oxz_ntp
7822024-02-17T07:53:18.491Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
7832024-02-17T07:53:18.491Z+ [[ disabled != online ]]
7842024-02-17T07:53:18.491Z+ [[ 5 -gt 60 ]]
7852024-02-17T07:53:18.491Z+ sleep 1
7862024-02-17T07:53:19.486Z+ retry=6
7872024-02-17T07:53:19.510Z+++ zoneadm list -n
7882024-02-17T07:53:19.510Z+++ grep oxz_ntp
7892024-02-17T07:53:19.510Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
7902024-02-17T07:53:19.510Z+ [[ disabled != online ]]
7912024-02-17T07:53:19.510Z+ [[ 6 -gt 60 ]]
7922024-02-17T07:53:19.510Z+ sleep 1
7932024-02-17T07:53:20.512Z+ retry=7
7942024-02-17T07:53:20.536Z+++ zoneadm list -n
7952024-02-17T07:53:20.536Z+++ grep oxz_ntp
7962024-02-17T07:53:20.536Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
7972024-02-17T07:53:20.536Z+ [[ disabled != online ]]
7982024-02-17T07:53:20.536Z+ [[ 7 -gt 60 ]]
7992024-02-17T07:53:20.537Z+ sleep 1
8002024-02-17T07:53:21.532Z+ retry=8
8012024-02-17T07:53:21.556Z+++ zoneadm list -n
8022024-02-17T07:53:21.556Z+++ grep oxz_ntp
8032024-02-17T07:53:21.556Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
8042024-02-17T07:53:21.556Z+ [[ disabled != online ]]
8052024-02-17T07:53:21.556Z+ [[ 8 -gt 60 ]]
8062024-02-17T07:53:21.556Z+ sleep 1
 
8072024-02-17T07:53:21.749Zbuskin console login: Feb 17 07:53:21 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8082024-02-17T07:53:22.554Z+ retry=9
8092024-02-17T07:53:22.577Z+++ zoneadm list -n
8102024-02-17T07:53:22.577Z+++ grep oxz_ntp
8112024-02-17T07:53:22.577Z++ pfexec svcs -z oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db -Hostate oxide/ntp
8122024-02-17T07:53:22.577Z+ [[ online != online ]]
8132024-02-17T07:53:22.577Z+ echo 'Waited for chrony: 9s'
8142024-02-17T07:53:22.578Z+ export RUST_BACKTRACE=1
8152024-02-17T07:53:22.578Z+ RUST_BACKTRACE=1
8162024-02-17T07:53:22.578ZWaited for chrony: 9s
8172024-02-17T07:53:22.578Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8182024-02-17T07:53:22.578Z++ ./tests/bootstrap
8192024-02-17T07:53:22.601ZUsing external DNS server at 10.151.1.164:53
8202024-02-17T07:53:22.625Z2024-02-17 07:53:22.244446414 UTC: attempting to log into API
8212024-02-17T07:53:37.639Z2024-02-17 07:53:37.889526794 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8222024-02-17T07:53:38.640Z2024-02-17 07:53:38.890576711 UTC: attempting to log into API
8232024-02-17T07:53:53.671Z2024-02-17 07:53:53.921579911 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8242024-02-17T07:53:54.672Z2024-02-17 07:53:54.922607267 UTC: attempting to log into API
8252024-02-17T07:54:09.704Z2024-02-17 07:54:09.953867693 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8262024-02-17T07:54:10.705Z2024-02-17 07:54:10.954946 UTC: attempting to log into API
8272024-02-17T07:54:25.738Z2024-02-17 07:54:25.988461407 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8282024-02-17T07:54:26.740Z2024-02-17 07:54:26.989515523 UTC: attempting to log into API
8292024-02-17T07:54:44.749Z2024-02-17 07:54:44.509574625 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8302024-02-17T07:54:44.906ZFeb 17 07:54:44 buskin xde: WARNING: failed to generate descriptor for stateful action: ICMP:172.30.3.5:0:138.68.201.49:0 Unexpected { msg: "Expected ICMP Echo Request, found: destination unreachable" }
 
8312024-02-17T07:54:45.743Z2024-02-17 07:54:45.555175343 UTC: attempting to log into API
8322024-02-17T07:55:00.958Z2024-02-17 07:55:00.801238926 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8332024-02-17T07:55:01.959Z2024-02-17 07:55:01.819661689 UTC: attempting to log into API
 
8342024-02-17T07:55:14.667ZFeb 17 07:55:14 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
8352024-02-17T07:55:17.015Z2024-02-17 07:55:16.917107189 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8362024-02-17T07:55:18.017Z2024-02-17 07:55:17.920895539 UTC: attempting to log into API
 
8372024-02-17T07:55:21.333ZFeb 17 07:55:20 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
8382024-02-17T07:55:27.480ZFeb 17 07:55:26 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
 
8392024-02-17T07:55:33.048Z2024-02-17 07:55:32.992959064 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8402024-02-17T07:55:33.067ZFeb 17 07:55:32 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
8412024-02-17T07:55:34.050Z2024-02-17 07:55:33.997716472 UTC: attempting to log into API
 
8422024-02-17T07:55:39.704ZFeb 17 07:55:39 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8432024-02-17T07:55:49.083Z2024-02-17 07:55:49.069816475 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8442024-02-17T07:55:50.082Z2024-02-17 07:55:50.073442369 UTC: attempting to log into API
8452024-02-17T07:56:00.887Z2024-02-17 07:56:00.877867615 UTC: login succeeded
8462024-02-17T07:56:00.919Zwaiting for nexus to come up...
8472024-02-17T07:56:00.988Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8482024-02-17T07:56:01.201Zsetting up quotas...
8492024-02-17T07:56:01.254Zensuring datasets are ready...
8502024-02-17T07:56:03.302Zlet's roll.
8512024-02-17T07:56:03.329Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8522024-02-17T07:56:03.329ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8532024-02-17T07:56:03.330ZOXIDE_TOKEN=oxide-token-5af0ce33a8da61bf92aad5ee52410dd9daa24edc'
8542024-02-17T07:56:03.330Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8552024-02-17T07:56:03.330Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8562024-02-17T07:56:03.330Z++ OXIDE_TOKEN=oxide-token-5af0ce33a8da61bf92aad5ee52410dd9daa24edc
8572024-02-17T07:56:03.330Z+ export OXIDE_HOST OXIDE_TOKEN
8582024-02-17T07:56:03.330Z+ retry=0
8592024-02-17T07:56:03.330Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8602024-02-17T07:56:03.354Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8612024-02-17T07:56:03.354Z+ [[ 0 -gt 60 ]]
8622024-02-17T07:56:03.354Z+ sleep 1
8632024-02-17T07:56:04.336Z+ retry=1
8642024-02-17T07:56:04.336Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8652024-02-17T07:56:04.360Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8662024-02-17T07:56:04.360Z+ [[ 1 -gt 60 ]]
8672024-02-17T07:56:04.360Z+ sleep 1
8682024-02-17T07:56:05.353Z+ retry=2
8692024-02-17T07:56:05.353Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8702024-02-17T07:56:05.377Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8712024-02-17T07:56:05.377Z+ [[ 2 -gt 60 ]]
8722024-02-17T07:56:05.377Z+ sleep 1
8732024-02-17T07:56:06.370Z+ retry=3
8742024-02-17T07:56:06.371Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8752024-02-17T07:56:06.394Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8762024-02-17T07:56:06.395Z+ [[ 3 -gt 60 ]]
8772024-02-17T07:56:06.395Z+ sleep 1
8782024-02-17T07:56:07.387Z+ retry=4
8792024-02-17T07:56:07.387Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8802024-02-17T07:56:07.411Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8812024-02-17T07:56:07.411Z+ [[ 4 -gt 60 ]]
8822024-02-17T07:56:07.411Z+ sleep 1
8832024-02-17T07:56:08.423Z+ retry=5
8842024-02-17T07:56:08.423Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8852024-02-17T07:56:08.423Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8862024-02-17T07:56:08.423Z+ [[ 5 -gt 60 ]]
8872024-02-17T07:56:08.423Z+ sleep 1
8882024-02-17T07:56:09.419Z+ retry=6
8892024-02-17T07:56:09.419Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8902024-02-17T07:56:09.446Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8912024-02-17T07:56:09.446Z+ [[ 6 -gt 60 ]]
8922024-02-17T07:56:09.446Z+ sleep 1
8932024-02-17T07:56:10.436Z+ retry=7
8942024-02-17T07:56:10.436Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8952024-02-17T07:56:10.460Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 1 ms: Couldn't connect to server
8962024-02-17T07:56:10.460Z+ [[ 7 -gt 60 ]]
8972024-02-17T07:56:10.460Z+ sleep 1
8982024-02-17T07:56:11.453Z+ retry=8
8992024-02-17T07:56:11.453Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9002024-02-17T07:56:11.477Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9012024-02-17T07:56:11.477Z+ [[ 8 -gt 60 ]]
9022024-02-17T07:56:11.477Z+ sleep 1
9032024-02-17T07:56:12.469Z+ retry=9
9042024-02-17T07:56:12.469Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9052024-02-17T07:56:12.493Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9062024-02-17T07:56:12.493Z+ [[ 9 -gt 60 ]]
9072024-02-17T07:56:12.493Z+ sleep 1
9082024-02-17T07:56:13.484Z+ retry=10
9092024-02-17T07:56:13.484Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9102024-02-17T07:56:13.508Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9112024-02-17T07:56:13.508Z+ [[ 10 -gt 60 ]]
9122024-02-17T07:56:13.508Z+ sleep 1
9132024-02-17T07:56:14.501Z+ retry=11
9142024-02-17T07:56:14.501Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9152024-02-17T07:56:14.525Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9162024-02-17T07:56:14.525Z+ [[ 11 -gt 60 ]]
9172024-02-17T07:56:14.525Z+ sleep 1
9182024-02-17T07:56:15.521Z+ retry=12
9192024-02-17T07:56:15.521Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9202024-02-17T07:56:15.544Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9212024-02-17T07:56:15.544Z+ [[ 12 -gt 60 ]]
9222024-02-17T07:56:15.544Z+ sleep 1
9232024-02-17T07:56:16.535Z+ retry=13
9242024-02-17T07:56:16.535Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9252024-02-17T07:56:16.559Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9262024-02-17T07:56:16.559Z+ [[ 13 -gt 60 ]]
9272024-02-17T07:56:16.559Z+ sleep 1
9282024-02-17T07:56:17.552Z+ retry=14
9292024-02-17T07:56:17.552Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9302024-02-17T07:56:17.576Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9312024-02-17T07:56:17.576Z+ [[ 14 -gt 60 ]]
9322024-02-17T07:56:17.576Z+ sleep 1
9332024-02-17T07:56:18.570Z+ retry=15
9342024-02-17T07:56:18.570Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9352024-02-17T07:56:18.594Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9362024-02-17T07:56:18.594Z+ [[ 15 -gt 60 ]]
9372024-02-17T07:56:18.594Z+ sleep 1
9382024-02-17T07:56:19.587Z+ retry=16
9392024-02-17T07:56:19.587Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9402024-02-17T07:56:19.611Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9412024-02-17T07:56:19.611Z+ [[ 16 -gt 60 ]]
9422024-02-17T07:56:19.611Z+ sleep 1
9432024-02-17T07:56:20.607Z+ retry=17
9442024-02-17T07:56:20.608Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9452024-02-17T07:56:20.631Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9462024-02-17T07:56:20.631Z+ [[ 17 -gt 60 ]]
9472024-02-17T07:56:20.632Z+ sleep 1
9482024-02-17T07:56:21.621Z+ retry=18
9492024-02-17T07:56:21.621Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9502024-02-17T07:56:21.648Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9512024-02-17T07:56:21.648Z+ [[ 18 -gt 60 ]]
9522024-02-17T07:56:21.648Z+ sleep 1
9532024-02-17T07:56:22.638Z+ retry=19
9542024-02-17T07:56:22.638Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9552024-02-17T07:56:22.662Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9562024-02-17T07:56:22.662Z+ [[ 19 -gt 60 ]]
9572024-02-17T07:56:22.662Z+ sleep 1
9582024-02-17T07:56:23.657Z+ retry=20
9592024-02-17T07:56:23.657Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9602024-02-17T07:56:23.681Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9612024-02-17T07:56:23.681Z+ [[ 20 -gt 60 ]]
9622024-02-17T07:56:23.681Z+ sleep 1
9632024-02-17T07:56:24.673Z+ retry=21
9642024-02-17T07:56:24.673Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9652024-02-17T07:56:24.697Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9662024-02-17T07:56:24.697Z+ [[ 21 -gt 60 ]]
9672024-02-17T07:56:24.697Z+ sleep 1
9682024-02-17T07:56:25.690Z+ retry=22
9692024-02-17T07:56:25.691Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9702024-02-17T07:56:25.714Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9712024-02-17T07:56:25.714Z+ [[ 22 -gt 60 ]]
9722024-02-17T07:56:25.714Z+ sleep 1
9732024-02-17T07:56:26.709Z+ retry=23
9742024-02-17T07:56:26.709Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9752024-02-17T07:56:26.733Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9762024-02-17T07:56:26.733Z+ [[ 23 -gt 60 ]]
9772024-02-17T07:56:26.733Z+ sleep 1
9782024-02-17T07:56:27.726Z+ retry=24
9792024-02-17T07:56:27.726Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9802024-02-17T07:56:27.749Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9812024-02-17T07:56:27.749Z+ [[ 24 -gt 60 ]]
9822024-02-17T07:56:27.749Z+ sleep 1
9832024-02-17T07:56:28.743Z+ retry=25
9842024-02-17T07:56:28.743Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9852024-02-17T07:56:28.766Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9862024-02-17T07:56:28.766Z+ [[ 25 -gt 60 ]]
9872024-02-17T07:56:28.766Z+ sleep 1
9882024-02-17T07:56:29.760Z+ retry=26
9892024-02-17T07:56:29.783Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9902024-02-17T07:56:29.783Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9912024-02-17T07:56:29.783Z+ [[ 26 -gt 60 ]]
9922024-02-17T07:56:29.783Z+ sleep 1
9932024-02-17T07:56:30.777Z+ retry=27
9942024-02-17T07:56:30.777Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9952024-02-17T07:56:30.801Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9962024-02-17T07:56:30.801Z+ [[ 27 -gt 60 ]]
9972024-02-17T07:56:30.801Z+ sleep 1
9982024-02-17T07:56:31.792Z+ retry=28
9992024-02-17T07:56:31.793Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10002024-02-17T07:56:31.816Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10012024-02-17T07:56:31.816Z+ [[ 28 -gt 60 ]]
10022024-02-17T07:56:31.816Z+ sleep 1
10032024-02-17T07:56:32.807Z+ retry=29
10042024-02-17T07:56:32.808Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10052024-02-17T07:56:32.831Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10062024-02-17T07:56:32.831Z+ [[ 29 -gt 60 ]]
10072024-02-17T07:56:32.831Z+ sleep 1
10082024-02-17T07:56:33.824Z+ retry=30
10092024-02-17T07:56:33.824Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10102024-02-17T07:56:33.848Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10112024-02-17T07:56:33.848Z+ [[ 30 -gt 60 ]]
10122024-02-17T07:56:33.848Z+ sleep 1
10132024-02-17T07:56:34.841Z+ retry=31
10142024-02-17T07:56:34.841Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10152024-02-17T07:56:34.865Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10162024-02-17T07:56:34.865Z+ [[ 31 -gt 60 ]]
10172024-02-17T07:56:34.865Z+ sleep 1
10182024-02-17T07:56:35.857Z+ retry=32
10192024-02-17T07:56:35.858Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10202024-02-17T07:56:35.881Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10212024-02-17T07:56:35.881Z+ [[ 32 -gt 60 ]]
10222024-02-17T07:56:35.881Z+ sleep 1
10232024-02-17T07:56:36.874Z+ retry=33
10242024-02-17T07:56:36.874Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10252024-02-17T07:56:36.898Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10262024-02-17T07:56:36.898Z+ [[ 33 -gt 60 ]]
10272024-02-17T07:56:36.898Z+ sleep 1
10282024-02-17T07:56:37.892Z+ retry=34
10292024-02-17T07:56:37.892Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10302024-02-17T07:56:37.916Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10312024-02-17T07:56:37.916Z+ [[ 34 -gt 60 ]]
10322024-02-17T07:56:37.916Z+ sleep 1
10332024-02-17T07:56:38.907Z+ retry=35
10342024-02-17T07:56:38.907Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10352024-02-17T07:56:38.931Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10362024-02-17T07:56:38.931Z+ [[ 35 -gt 60 ]]
10372024-02-17T07:56:38.931Z+ sleep 1
10382024-02-17T07:56:39.925Z+ retry=36
10392024-02-17T07:56:39.925Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10402024-02-17T07:56:39.951Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10412024-02-17T07:56:39.951Z+ [[ 36 -gt 60 ]]
10422024-02-17T07:56:39.952Z+ sleep 1
10432024-02-17T07:56:40.941Z+ retry=37
10442024-02-17T07:56:40.941Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10452024-02-17T07:56:41.020Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10462024-02-17T07:56:41.401Z{"status":"ok"}success
10472024-02-17T07:56:41.401ZProject {
10482024-02-17T07:56:41.401Z description: "some images",
10492024-02-17T07:56:41.401Z id: 5c59615e-b401-495c-9f02-89330c41b0b7,
10502024-02-17T07:56:41.401Z name: Name(
10512024-02-17T07:56:41.401Z "images",
10522024-02-17T07:56:41.401Z ),
10532024-02-17T07:56:41.402Z time_created: 2024-02-17T07:56:41.111392Z,
10542024-02-17T07:56:41.402Z time_modified: 2024-02-17T07:56:41.111392Z,
10552024-02-17T07:56:41.402Z}
10562024-02-17T07:56:41.425Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
10572024-02-17T08:01:44.264Zdone!
10582024-02-17T08:01:44.372Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
10592024-02-17T08:01:44.482Zsuccess
10602024-02-17T08:01:44.482ZImage {
10612024-02-17T08:01:44.482Z block_size: ByteCount(
10622024-02-17T08:01:44.482Z 512,
10632024-02-17T08:01:44.482Z ),
10642024-02-17T08:01:44.482Z description: "debian 11 original base image",
10652024-02-17T08:01:44.506Z digest: None,
10662024-02-17T08:01:44.506Z id: 004563a3-6b11-4dea-91c6-f7530ba520bd,
10672024-02-17T08:01:44.506Z name: Name(
10682024-02-17T08:01:44.506Z "debian11",
10692024-02-17T08:01:44.506Z ),
10702024-02-17T08:01:44.506Z os: "debian",
10712024-02-17T08:01:44.506Z project_id: None,
10722024-02-17T08:01:44.506Z size: ByteCount(
10732024-02-17T08:01:44.506Z 2147483648,
10742024-02-17T08:01:44.506Z ),
10752024-02-17T08:01:44.506Z time_created: 2024-02-17T08:01:44.214278Z,
10762024-02-17T08:01:44.506Z time_modified: 2024-02-17T08:01:44.463551Z,
10772024-02-17T08:01:44.506Z url: None,
10782024-02-17T08:01:44.506Z version: "11",
10792024-02-17T08:01:44.506Z}
10802024-02-17T08:01:44.507Z+ rm ./tests/bootstrap
10812024-02-17T08:01:44.546Z+ for test_bin in tests/*
10822024-02-17T08:01:44.546Z+ ./tests/bootstrap-a5d624f8861e2451
10832024-02-17T08:01:44.603Z
10842024-02-17T08:01:44.603Zrunning 0 tests
10852024-02-17T08:01:44.603Z
10862024-02-17T08:01:44.626Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10872024-02-17T08:01:44.626Z
10882024-02-17T08:01:44.626Z+ for test_bin in tests/*
10892024-02-17T08:01:44.626Z+ ./tests/end_to_end_tests-5baf5881dde70245
10902024-02-17T08:01:44.902Z
10912024-02-17T08:01:44.902Zrunning 2 tests
10922024-02-17T08:01:45.182Ztest no_spoof::no_spoof_here ... ok
10932024-02-17T08:02:21.718Ztest instance_launch::instance_launch ... ok
10942024-02-17T08:02:21.718Z
10952024-02-17T08:02:21.742Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 36.82s
10962024-02-17T08:02:21.742Z
10972024-02-17T08:02:21.742Z+ _exit_trap
10982024-02-17T08:02:21.742Z+ local status=0
10992024-02-17T08:02:21.742Z+ [[ 0 -eq 0 ]]
11002024-02-17T08:02:21.742Z+ exit 0
11012024-02-17T08:02:21.742Zprocess exited: duration 656220 ms, exit code 0
 
11022024-02-17T08:02:21.851Zfound 131 output files
11032024-02-17T08:02:21.851Zuploading: /var/svc/log/oxide-sled-agent:default.log (1582813 bytes)
11042024-02-17T08:02:23.198Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11052024-02-17T08:02:23.198Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (586931 bytes)
11062024-02-17T08:02:23.458Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 586931 -> 591035
11072024-02-17T08:02:24.533Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11082024-02-17T08:02:24.557Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (1802712 bytes)
11092024-02-17T08:02:26.351Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11102024-02-17T08:02:26.351Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
11112024-02-17T08:02:27.427Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11122024-02-17T08:02:27.427Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (4853 bytes)
11132024-02-17T08:02:28.524Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11142024-02-17T08:02:28.524Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (5228 bytes)
11152024-02-17T08:02:29.622Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11162024-02-17T08:02:29.622Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (19236 bytes)
11172024-02-17T08:02:30.763Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11182024-02-17T08:02:30.763Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (311018 bytes)
11192024-02-17T08:02:31.000Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 311018 -> 345526
11202024-02-17T08:02:32.073Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11212024-02-17T08:02:32.073Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1148776 bytes)
11222024-02-17T08:02:33.962Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11232024-02-17T08:02:33.962Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (191766 bytes)
11242024-02-17T08:02:34.170Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 191766 -> 211156
11252024-02-17T08:02:35.243Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11262024-02-17T08:02:35.244Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (656641 bytes)
11272024-02-17T08:02:36.685Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11282024-02-17T08:02:36.685Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11292024-02-17T08:02:37.761Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11302024-02-17T08:02:37.784Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11312024-02-17T08:02:38.858Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11322024-02-17T08:02:38.858Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (67118 bytes)
11332024-02-17T08:02:38.999Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 67118 -> 76199
11342024-02-17T08:02:40.072Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11352024-02-17T08:02:40.072Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (202769 bytes)
11362024-02-17T08:02:41.329Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11372024-02-17T08:02:41.329Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
11382024-02-17T08:02:42.402Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11392024-02-17T08:02:42.402Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
11402024-02-17T08:02:43.500Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
11412024-02-17T08:02:43.500Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
11422024-02-17T08:02:44.573Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11432024-02-17T08:02:44.573Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5391 bytes)
11442024-02-17T08:02:45.670Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
11452024-02-17T08:02:45.670Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-clickhouse:default.log (256852 bytes)
11462024-02-17T08:02:45.883Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 256852 -> 300673
11472024-02-17T08:02:46.956Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-clickhouse:default.log
11482024-02-17T08:02:46.956Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-clickhouse:default.log.0 (588510 bytes)
11492024-02-17T08:02:48.270Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-clickhouse:default.log.0
11502024-02-17T08:02:48.270Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11512024-02-17T08:02:49.343Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-zone-network-setup:default.log
11522024-02-17T08:02:49.368Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
11532024-02-17T08:02:50.441Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_1268ea00-ad4a-48a3-b838-a2f08a0dff69/root/var/svc/log/oxide-zone-network-setup:default.log.0
11542024-02-17T08:02:50.441Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_31cae6c3-ce24-4440-bb20-dafe052c133c/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11552024-02-17T08:02:51.514Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_31cae6c3-ce24-4440-bb20-dafe052c133c/root/var/svc/log/oxide-cockroachdb:default.log
11562024-02-17T08:02:51.514Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_31cae6c3-ce24-4440-bb20-dafe052c133c/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
11572024-02-17T08:02:52.612Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_31cae6c3-ce24-4440-bb20-dafe052c133c/root/var/svc/log/oxide-cockroachdb:default.log.0
11582024-02-17T08:02:52.612Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_31cae6c3-ce24-4440-bb20-dafe052c133c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11592024-02-17T08:02:53.685Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_31cae6c3-ce24-4440-bb20-dafe052c133c/root/var/svc/log/oxide-zone-network-setup:default.log
11602024-02-17T08:02:53.685Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_31cae6c3-ce24-4440-bb20-dafe052c133c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
11612024-02-17T08:02:54.782Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_31cae6c3-ce24-4440-bb20-dafe052c133c/root/var/svc/log/oxide-zone-network-setup:default.log.0
11622024-02-17T08:02:54.782Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-agent:default.log (10710 bytes)
11632024-02-17T08:02:55.902Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-agent:default.log
11642024-02-17T08:02:55.926Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-agent:default.log.0 (13687 bytes)
11652024-02-17T08:02:57.026Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-agent:default.log.0
11662024-02-17T08:02:57.049Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11672024-02-17T08:02:58.098Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:default.log
11682024-02-17T08:02:58.098Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11692024-02-17T08:02:59.198Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11702024-02-17T08:02:59.199Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:downstairs-5604e737-c144-4be1-a1b8-e3052d9f1d07.log (5610 bytes)
11712024-02-17T08:03:00.296Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:downstairs-5604e737-c144-4be1-a1b8-e3052d9f1d07.log
11722024-02-17T08:03:00.319Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:downstairs-a05007b3-0869-4ae2-9c03-ed3cdf293627.log (0 bytes)
11732024-02-17T08:03:01.372Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:downstairs-a05007b3-0869-4ae2-9c03-ed3cdf293627.log
11742024-02-17T08:03:01.396Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:downstairs-a05007b3-0869-4ae2-9c03-ed3cdf293627.log.0 (3126 bytes)
11752024-02-17T08:03:02.470Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_2cc290d2-ae32-4f01-80fb-a7c0eb02372d/root/var/svc/log/oxide-crucible-downstairs:downstairs-a05007b3-0869-4ae2-9c03-ed3cdf293627.log.0
11762024-02-17T08:03:02.470Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e3cd3ee0-d5f4-464f-817f-08b469bbc3f9/root/var/svc/log/oxide-external_dns:default.log (7555 bytes)
11772024-02-17T08:03:02.543Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e3cd3ee0-d5f4-464f-817f-08b469bbc3f9/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 7555 -> 11328
11782024-02-17T08:03:03.618Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e3cd3ee0-d5f4-464f-817f-08b469bbc3f9/root/var/svc/log/oxide-external_dns:default.log
11792024-02-17T08:03:03.619Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e3cd3ee0-d5f4-464f-817f-08b469bbc3f9/root/var/svc/log/oxide-external_dns:default.log.0 (19384 bytes)
11802024-02-17T08:03:04.741Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e3cd3ee0-d5f4-464f-817f-08b469bbc3f9/root/var/svc/log/oxide-external_dns:default.log.0
11812024-02-17T08:03:04.741Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e0349338-e070-437c-868a-331055236b1f/root/var/svc/log/oxide-internal_dns:default.log (8349 bytes)
11822024-02-17T08:03:04.823Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e0349338-e070-437c-868a-331055236b1f/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 8349 -> 12103
11832024-02-17T08:03:05.897Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e0349338-e070-437c-868a-331055236b1f/root/var/svc/log/oxide-internal_dns:default.log
11842024-02-17T08:03:05.921Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e0349338-e070-437c-868a-331055236b1f/root/var/svc/log/oxide-internal_dns:default.log.0 (111434 bytes)
11852024-02-17T08:03:07.108Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e0349338-e070-437c-868a-331055236b1f/root/var/svc/log/oxide-internal_dns:default.log.0
11862024-02-17T08:03:07.108Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_1aa7b748-d7ee-4248-9927-2e86ebd4d7f7/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11872024-02-17T08:03:08.181Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_1aa7b748-d7ee-4248-9927-2e86ebd4d7f7/root/var/svc/log/oxide-cockroachdb:default.log
11882024-02-17T08:03:08.181Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_1aa7b748-d7ee-4248-9927-2e86ebd4d7f7/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
11892024-02-17T08:03:09.280Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_1aa7b748-d7ee-4248-9927-2e86ebd4d7f7/root/var/svc/log/oxide-cockroachdb:default.log.0
11902024-02-17T08:03:09.303Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_1aa7b748-d7ee-4248-9927-2e86ebd4d7f7/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11912024-02-17T08:03:10.352Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_1aa7b748-d7ee-4248-9927-2e86ebd4d7f7/root/var/svc/log/oxide-zone-network-setup:default.log
11922024-02-17T08:03:10.353Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_1aa7b748-d7ee-4248-9927-2e86ebd4d7f7/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
11932024-02-17T08:03:11.451Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_1aa7b748-d7ee-4248-9927-2e86ebd4d7f7/root/var/svc/log/oxide-zone-network-setup:default.log.0
11942024-02-17T08:03:11.475Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-agent:default.log (7756 bytes)
11952024-02-17T08:03:12.573Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-agent:default.log
11962024-02-17T08:03:12.574Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-agent:default.log.0 (9795 bytes)
11972024-02-17T08:03:13.694Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-agent:default.log.0
11982024-02-17T08:03:13.694Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11992024-02-17T08:03:14.767Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:default.log
12002024-02-17T08:03:14.767Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12012024-02-17T08:03:15.867Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12022024-02-17T08:03:15.867Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-b9976855-fd68-4ac2-9865-7eb93bd5aa63.log (1091 bytes)
12032024-02-17T08:03:16.965Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-b9976855-fd68-4ac2-9865-7eb93bd5aa63.log
12042024-02-17T08:03:16.965Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-b9976855-fd68-4ac2-9865-7eb93bd5aa63.log.0 (4601 bytes)
12052024-02-17T08:03:18.063Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:downstairs-b9976855-fd68-4ac2-9865-7eb93bd5aa63.log.0
12062024-02-17T08:03:18.063Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:snapshot-b9976855-fd68-4ac2-9865-7eb93bd5aa63-bb027594-a45c-44ef-a162-d1dfbc9028f5.log (5285 bytes)
12072024-02-17T08:03:19.160Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf1c65bf-1cd2-4bac-9916-c928a77170ca/root/var/svc/log/oxide-crucible-downstairs:snapshot-b9976855-fd68-4ac2-9865-7eb93bd5aa63-bb027594-a45c-44ef-a162-d1dfbc9028f5.log
12082024-02-17T08:03:19.160Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_bcb92007-d8a7-4c9b-af34-792aa940209d/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
12092024-02-17T08:03:20.233Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_bcb92007-d8a7-4c9b-af34-792aa940209d/root/var/svc/log/oxide-crucible-pantry:default.log
12102024-02-17T08:03:20.233Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_bcb92007-d8a7-4c9b-af34-792aa940209d/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
12112024-02-17T08:03:21.330Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_bcb92007-d8a7-4c9b-af34-792aa940209d/root/var/svc/log/oxide-crucible-pantry:default.log.0
12122024-02-17T08:03:21.330Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6d4c8c5e-03e7-460c-86e4-f7a27e6b1840/root/var/svc/log/oxide-external_dns:default.log (7554 bytes)
12132024-02-17T08:03:21.402Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6d4c8c5e-03e7-460c-86e4-f7a27e6b1840/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 7554 -> 11327
12142024-02-17T08:03:22.478Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6d4c8c5e-03e7-460c-86e4-f7a27e6b1840/root/var/svc/log/oxide-external_dns:default.log
12152024-02-17T08:03:22.502Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6d4c8c5e-03e7-460c-86e4-f7a27e6b1840/root/var/svc/log/oxide-external_dns:default.log.0 (19389 bytes)
12162024-02-17T08:03:23.621Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6d4c8c5e-03e7-460c-86e4-f7a27e6b1840/root/var/svc/log/oxide-external_dns:default.log.0
12172024-02-17T08:03:23.621Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5a7f4b60-c1df-4f93-aaf2-ac5027696cfd/root/var/svc/log/oxide-internal_dns:default.log (7511 bytes)
12182024-02-17T08:03:23.692Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5a7f4b60-c1df-4f93-aaf2-ac5027696cfd/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7511 -> 11264
12192024-02-17T08:03:24.767Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5a7f4b60-c1df-4f93-aaf2-ac5027696cfd/root/var/svc/log/oxide-internal_dns:default.log
12202024-02-17T08:03:24.767Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5a7f4b60-c1df-4f93-aaf2-ac5027696cfd/root/var/svc/log/oxide-internal_dns:default.log.0 (107007 bytes)
12212024-02-17T08:03:25.978Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5a7f4b60-c1df-4f93-aaf2-ac5027696cfd/root/var/svc/log/oxide-internal_dns:default.log.0
12222024-02-17T08:03:25.978Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cfa707f1-5c6d-47fc-a532-eeea10fe3eef/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12232024-02-17T08:03:27.051Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cfa707f1-5c6d-47fc-a532-eeea10fe3eef/root/var/svc/log/oxide-cockroachdb:default.log
12242024-02-17T08:03:27.051Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cfa707f1-5c6d-47fc-a532-eeea10fe3eef/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
12252024-02-17T08:03:28.148Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cfa707f1-5c6d-47fc-a532-eeea10fe3eef/root/var/svc/log/oxide-cockroachdb:default.log.0
12262024-02-17T08:03:28.148Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cfa707f1-5c6d-47fc-a532-eeea10fe3eef/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12272024-02-17T08:03:29.224Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cfa707f1-5c6d-47fc-a532-eeea10fe3eef/root/var/svc/log/oxide-zone-network-setup:default.log
12282024-02-17T08:03:29.248Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cfa707f1-5c6d-47fc-a532-eeea10fe3eef/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
12292024-02-17T08:03:30.321Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_cfa707f1-5c6d-47fc-a532-eeea10fe3eef/root/var/svc/log/oxide-zone-network-setup:default.log.0
12302024-02-17T08:03:30.344Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_23aeb3c1-3472-4b25-9da1-b2beea99efd2/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12312024-02-17T08:03:31.397Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_23aeb3c1-3472-4b25-9da1-b2beea99efd2/root/var/svc/log/oxide-crucible-agent:default.log
12322024-02-17T08:03:31.397Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_23aeb3c1-3472-4b25-9da1-b2beea99efd2/root/var/svc/log/oxide-crucible-agent:default.log.0 (3434 bytes)
12332024-02-17T08:03:32.494Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_23aeb3c1-3472-4b25-9da1-b2beea99efd2/root/var/svc/log/oxide-crucible-agent:default.log.0
12342024-02-17T08:03:32.518Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_23aeb3c1-3472-4b25-9da1-b2beea99efd2/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12352024-02-17T08:03:33.567Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_23aeb3c1-3472-4b25-9da1-b2beea99efd2/root/var/svc/log/oxide-crucible-downstairs:default.log
12362024-02-17T08:03:33.567Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_23aeb3c1-3472-4b25-9da1-b2beea99efd2/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12372024-02-17T08:03:34.664Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_23aeb3c1-3472-4b25-9da1-b2beea99efd2/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12382024-02-17T08:03:34.664Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7d7c0ae4-0bc9-4889-b6b8-996eba6b25e1/root/var/svc/log/oxide-internal_dns:default.log (7509 bytes)
12392024-02-17T08:03:34.734Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7d7c0ae4-0bc9-4889-b6b8-996eba6b25e1/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7509 -> 11261
12402024-02-17T08:03:35.807Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7d7c0ae4-0bc9-4889-b6b8-996eba6b25e1/root/var/svc/log/oxide-internal_dns:default.log
12412024-02-17T08:03:35.808Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7d7c0ae4-0bc9-4889-b6b8-996eba6b25e1/root/var/svc/log/oxide-internal_dns:default.log.0 (108839 bytes)
12422024-02-17T08:03:37.019Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7d7c0ae4-0bc9-4889-b6b8-996eba6b25e1/root/var/svc/log/oxide-internal_dns:default.log.0
12432024-02-17T08:03:37.019Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_10e64787-8ea7-4230-a431-a3f18812c9f4/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12442024-02-17T08:03:38.095Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_10e64787-8ea7-4230-a431-a3f18812c9f4/root/var/svc/log/oxide-cockroachdb:default.log
12452024-02-17T08:03:38.095Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_10e64787-8ea7-4230-a431-a3f18812c9f4/root/var/svc/log/oxide-cockroachdb:default.log.0 (4381 bytes)
12462024-02-17T08:03:39.195Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_10e64787-8ea7-4230-a431-a3f18812c9f4/root/var/svc/log/oxide-cockroachdb:default.log.0
12472024-02-17T08:03:39.195Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_10e64787-8ea7-4230-a431-a3f18812c9f4/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12482024-02-17T08:03:40.268Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_10e64787-8ea7-4230-a431-a3f18812c9f4/root/var/svc/log/oxide-zone-network-setup:default.log
12492024-02-17T08:03:40.268Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_10e64787-8ea7-4230-a431-a3f18812c9f4/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
12502024-02-17T08:03:41.368Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_10e64787-8ea7-4230-a431-a3f18812c9f4/root/var/svc/log/oxide-zone-network-setup:default.log.0
12512024-02-17T08:03:41.393Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-agent:default.log (18902 bytes)
12522024-02-17T08:03:42.510Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-agent:default.log
12532024-02-17T08:03:42.533Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-agent:default.log.0 (19609 bytes)
12542024-02-17T08:03:43.652Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-agent:default.log.0
12552024-02-17T08:03:43.652Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12562024-02-17T08:03:44.725Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:default.log
12572024-02-17T08:03:44.725Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12582024-02-17T08:03:45.825Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12592024-02-17T08:03:45.825Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-3777279d-41e0-4114-a556-e384abc2091c.log (5610 bytes)
12602024-02-17T08:03:46.923Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-3777279d-41e0-4114-a556-e384abc2091c.log
12612024-02-17T08:03:46.923Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-54749b5a-978e-4e26-a2ae-03414b73ab02.log (0 bytes)
12622024-02-17T08:03:47.996Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-54749b5a-978e-4e26-a2ae-03414b73ab02.log
12632024-02-17T08:03:48.020Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-54749b5a-978e-4e26-a2ae-03414b73ab02.log.0 (3125 bytes)
12642024-02-17T08:03:49.093Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-54749b5a-978e-4e26-a2ae-03414b73ab02.log.0
12652024-02-17T08:03:49.093Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-96dc5abb-7c87-49c3-83c2-6e3c590f8010.log (1091 bytes)
12662024-02-17T08:03:50.190Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-96dc5abb-7c87-49c3-83c2-6e3c590f8010.log
12672024-02-17T08:03:50.190Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-96dc5abb-7c87-49c3-83c2-6e3c590f8010.log.0 (4605 bytes)
12682024-02-17T08:03:51.287Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:downstairs-96dc5abb-7c87-49c3-83c2-6e3c590f8010.log.0
12692024-02-17T08:03:51.287Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:snapshot-96dc5abb-7c87-49c3-83c2-6e3c590f8010-bb027594-a45c-44ef-a162-d1dfbc9028f5.log (5285 bytes)
12702024-02-17T08:03:52.384Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a500a93a-34aa-4604-a4fb-1aef58df122f/root/var/svc/log/oxide-crucible-downstairs:snapshot-96dc5abb-7c87-49c3-83c2-6e3c590f8010-bb027594-a45c-44ef-a162-d1dfbc9028f5.log
12712024-02-17T08:03:52.384Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-oximeter:default.log (87849 bytes)
12722024-02-17T08:03:52.569Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 87849 -> 142151
12732024-02-17T08:03:53.642Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-oximeter:default.log
12742024-02-17T08:03:53.642Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-oximeter:default.log.0 (174203 bytes)
12752024-02-17T08:03:54.881Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-oximeter:default.log.0
12762024-02-17T08:03:54.881Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12772024-02-17T08:03:55.954Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-zone-network-setup:default.log
12782024-02-17T08:03:55.954Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1696 bytes)
12792024-02-17T08:03:57.050Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_45c9c328-fa07-4bea-8126-41a5fad757f7/root/var/svc/log/oxide-zone-network-setup:default.log.0
12802024-02-17T08:03:57.074Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aec435d8-8eff-4c9d-b386-6a46f1b310b3/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12812024-02-17T08:03:58.126Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aec435d8-8eff-4c9d-b386-6a46f1b310b3/root/var/svc/log/oxide-cockroachdb:default.log
12822024-02-17T08:03:58.126Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aec435d8-8eff-4c9d-b386-6a46f1b310b3/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12832024-02-17T08:03:59.223Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aec435d8-8eff-4c9d-b386-6a46f1b310b3/root/var/svc/log/oxide-cockroachdb:default.log.0
12842024-02-17T08:03:59.223Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aec435d8-8eff-4c9d-b386-6a46f1b310b3/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12852024-02-17T08:04:00.296Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aec435d8-8eff-4c9d-b386-6a46f1b310b3/root/var/svc/log/oxide-zone-network-setup:default.log
12862024-02-17T08:04:00.296Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aec435d8-8eff-4c9d-b386-6a46f1b310b3/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
12872024-02-17T08:04:01.394Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aec435d8-8eff-4c9d-b386-6a46f1b310b3/root/var/svc/log/oxide-zone-network-setup:default.log.0
12882024-02-17T08:04:01.418Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-agent:default.log (17037 bytes)
12892024-02-17T08:04:02.539Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-agent:default.log
12902024-02-17T08:04:02.539Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12912024-02-17T08:04:03.642Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-agent:default.log.0
12922024-02-17T08:04:03.642Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12932024-02-17T08:04:04.715Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-downstairs:default.log
12942024-02-17T08:04:04.742Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12952024-02-17T08:04:05.814Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12962024-02-17T08:04:05.814Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-downstairs:downstairs-b61228f0-aae5-40ca-824f-70cd21dfd3f5.log (3008 bytes)
12972024-02-17T08:04:06.912Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-downstairs:downstairs-b61228f0-aae5-40ca-824f-70cd21dfd3f5.log
12982024-02-17T08:04:06.912Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-downstairs:downstairs-c9812616-7aec-4a55-b24f-6e8a9e8648f5.log (5611 bytes)
12992024-02-17T08:04:08.012Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_f9b75dbf-92e7-49b0-b1d4-a31e68c2b39b/root/var/svc/log/oxide-crucible-downstairs:downstairs-c9812616-7aec-4a55-b24f-6e8a9e8648f5.log
13002024-02-17T08:04:08.036Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_23a82044-5032-4a4c-aed8-df37a91ea3e8/root/var/svc/log/oxide-nexus:default.log (710618 bytes)
13012024-02-17T08:04:08.765Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_23a82044-5032-4a4c-aed8-df37a91ea3e8/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 710618 -> 1271230
13022024-02-17T08:04:09.838Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_23a82044-5032-4a4c-aed8-df37a91ea3e8/root/var/svc/log/oxide-nexus:default.log
13032024-02-17T08:04:09.838Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_23a82044-5032-4a4c-aed8-df37a91ea3e8/root/var/svc/log/oxide-nexus:default.log.0 (4922792 bytes)
13042024-02-17T08:04:11.803Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_23a82044-5032-4a4c-aed8-df37a91ea3e8/root/var/svc/log/oxide-nexus:default.log.0
13052024-02-17T08:04:11.827Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/svc/log/oxide-ntp:default.log (0 bytes)
13062024-02-17T08:04:12.877Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/svc/log/oxide-ntp:default.log
13072024-02-17T08:04:12.877Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/svc/log/oxide-ntp:default.log.0 (1186 bytes)
13082024-02-17T08:04:13.974Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/svc/log/oxide-ntp:default.log.0
13092024-02-17T08:04:13.974Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-agent:default.log (13680 bytes)
13102024-02-17T08:04:15.095Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-agent:default.log
13112024-02-17T08:04:15.118Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-agent:default.log.0 (9366 bytes)
13122024-02-17T08:04:16.217Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-agent:default.log.0
13132024-02-17T08:04:16.217Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13142024-02-17T08:04:17.290Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:default.log
13152024-02-17T08:04:17.290Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13162024-02-17T08:04:18.387Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13172024-02-17T08:04:18.413Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:downstairs-1a76427b-73d5-4122-a1ff-3809bb9654e2.log (3006 bytes)
13182024-02-17T08:04:19.508Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:downstairs-1a76427b-73d5-4122-a1ff-3809bb9654e2.log
13192024-02-17T08:04:19.508Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:downstairs-e59cc4dc-100e-48fd-a517-d724ce5ef484.log (1091 bytes)
13202024-02-17T08:04:20.603Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:downstairs-e59cc4dc-100e-48fd-a517-d724ce5ef484.log
13212024-02-17T08:04:20.603Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:downstairs-e59cc4dc-100e-48fd-a517-d724ce5ef484.log.0 (4605 bytes)
13222024-02-17T08:04:21.696Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:downstairs-e59cc4dc-100e-48fd-a517-d724ce5ef484.log.0
13232024-02-17T08:04:21.722Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:snapshot-e59cc4dc-100e-48fd-a517-d724ce5ef484-bb027594-a45c-44ef-a162-d1dfbc9028f5.log (5284 bytes)
13242024-02-17T08:04:22.788Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_be8aa2be-25b3-43f7-8702-9eb3a1feaa66/root/var/svc/log/oxide-crucible-downstairs:snapshot-e59cc4dc-100e-48fd-a517-d724ce5ef484-bb027594-a45c-44ef-a162-d1dfbc9028f5.log
13252024-02-17T08:04:22.815Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_c52bd359-b969-46c8-b1b3-99f005721594/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13262024-02-17T08:04:23.858Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_c52bd359-b969-46c8-b1b3-99f005721594/root/var/svc/log/oxide-crucible-pantry:default.log
13272024-02-17T08:04:23.858Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_c52bd359-b969-46c8-b1b3-99f005721594/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
13282024-02-17T08:04:24.951Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_c52bd359-b969-46c8-b1b3-99f005721594/root/var/svc/log/oxide-crucible-pantry:default.log.0
13292024-02-17T08:04:24.951Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_672d2230-a181-41c3-a95b-9bb12d3a729e/root/var/svc/log/oxide-nexus:default.log (256729 bytes)
13302024-02-17T08:04:25.203Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_672d2230-a181-41c3-a95b-9bb12d3a729e/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 256729 -> 485693
13312024-02-17T08:04:26.273Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_672d2230-a181-41c3-a95b-9bb12d3a729e/root/var/svc/log/oxide-nexus:default.log
13322024-02-17T08:04:26.274Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_672d2230-a181-41c3-a95b-9bb12d3a729e/root/var/svc/log/oxide-nexus:default.log.0 (954867 bytes)
13332024-02-17T08:04:27.610Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_672d2230-a181-41c3-a95b-9bb12d3a729e/root/var/svc/log/oxide-nexus:default.log.0
13342024-02-17T08:04:27.610Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-agent:default.log (6356 bytes)
13352024-02-17T08:04:28.706Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-agent:default.log
13362024-02-17T08:04:28.706Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13372024-02-17T08:04:29.800Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-agent:default.log.0
13382024-02-17T08:04:29.824Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13392024-02-17T08:04:30.875Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-downstairs:default.log
13402024-02-17T08:04:30.875Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13412024-02-17T08:04:31.970Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13422024-02-17T08:04:31.970Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-downstairs:downstairs-1368bf05-beb8-43ae-a747-0bc33d43db7c.log (3008 bytes)
13432024-02-17T08:04:33.067Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_94506081-529a-4404-a257-5a8524235b4b/root/var/svc/log/oxide-crucible-downstairs:downstairs-1368bf05-beb8-43ae-a747-0bc33d43db7c.log
13442024-02-17T08:04:33.091Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_343f8b87-27b6-4bb1-9614-207fba872b43/root/var/svc/log/oxide-crucible-pantry:default.log (407223 bytes)
13452024-02-17T08:04:34.351Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_343f8b87-27b6-4bb1-9614-207fba872b43/root/var/svc/log/oxide-crucible-pantry:default.log
13462024-02-17T08:04:34.375Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_343f8b87-27b6-4bb1-9614-207fba872b43/root/var/svc/log/oxide-crucible-pantry:default.log.0 (817759 bytes)
13472024-02-17T08:04:36.323Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_343f8b87-27b6-4bb1-9614-207fba872b43/root/var/svc/log/oxide-crucible-pantry:default.log.0
13482024-02-17T08:04:36.346Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_39f61093-3111-4810-84d4-25b719934088/root/var/svc/log/oxide-nexus:default.log (12463144 bytes)
13492024-02-17T08:04:38.519Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_39f61093-3111-4810-84d4-25b719934088/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 12463144 -> 12696027
13502024-02-17T08:04:39.590Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_39f61093-3111-4810-84d4-25b719934088/root/var/svc/log/oxide-nexus:default.log
13512024-02-17T08:04:39.590Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_39f61093-3111-4810-84d4-25b719934088/root/var/svc/log/oxide-nexus:default.log.0 (21990338 bytes)
13522024-02-17T08:04:44.416Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_39f61093-3111-4810-84d4-25b719934088/root/var/svc/log/oxide-nexus:default.log.0
13532024-02-17T08:04:44.416Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_453b0944-2963-4045-b079-bc42cc7b8d19/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13542024-02-17T08:04:45.487Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_453b0944-2963-4045-b079-bc42cc7b8d19/root/var/svc/log/oxide-crucible-agent:default.log
13552024-02-17T08:04:45.510Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_453b0944-2963-4045-b079-bc42cc7b8d19/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13562024-02-17T08:04:46.583Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_453b0944-2963-4045-b079-bc42cc7b8d19/root/var/svc/log/oxide-crucible-agent:default.log.0
13572024-02-17T08:04:46.583Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_453b0944-2963-4045-b079-bc42cc7b8d19/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13582024-02-17T08:04:47.655Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_453b0944-2963-4045-b079-bc42cc7b8d19/root/var/svc/log/oxide-crucible-downstairs:default.log
13592024-02-17T08:04:47.655Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_453b0944-2963-4045-b079-bc42cc7b8d19/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13602024-02-17T08:04:48.753Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_453b0944-2963-4045-b079-bc42cc7b8d19/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13612024-02-17T08:04:48.754Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13622024-02-17T08:04:49.823Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-agent:default.log
13632024-02-17T08:04:49.847Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-agent:default.log.0 (13686 bytes)
13642024-02-17T08:04:50.945Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-agent:default.log.0
13652024-02-17T08:04:50.945Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13662024-02-17T08:04:52.018Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-downstairs:default.log
13672024-02-17T08:04:52.018Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13682024-02-17T08:04:53.113Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13692024-02-17T08:04:53.114Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-downstairs:downstairs-6739eb23-1450-4c6a-8251-7bc5d0a690e7.log (0 bytes)
13702024-02-17T08:04:54.185Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-downstairs:downstairs-6739eb23-1450-4c6a-8251-7bc5d0a690e7.log
13712024-02-17T08:04:54.185Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-downstairs:downstairs-6739eb23-1450-4c6a-8251-7bc5d0a690e7.log.0 (3125 bytes)
13722024-02-17T08:04:55.280Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_22345437-2ea5-4c10-950c-fbe2c4caa998/root/var/svc/log/oxide-crucible-downstairs:downstairs-6739eb23-1450-4c6a-8251-7bc5d0a690e7.log.0
13732024-02-17T08:04:55.280Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/measurements.log (17947 bytes)
13742024-02-17T08:04:55.373Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/measurements.log" changed size mid upload: 17947 -> 22468
13752024-02-17T08:04:56.447Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/measurements.log
13762024-02-17T08:04:56.471Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/statistics.log (11700 bytes)
13772024-02-17T08:04:56.518Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/statistics.log" changed size mid upload: 11700 -> 15561
13782024-02-17T08:04:57.590Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/statistics.log
13792024-02-17T08:04:57.590Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/tracking.log (2113 bytes)
13802024-02-17T08:04:57.637Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/tracking.log" changed size mid upload: 2113 -> 2377
13812024-02-17T08:04:58.709Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_937fcc32-a4b2-44d5-bd44-d20b2576f5db/root/var/log/chrony/tracking.log