01HNS88XXZTSH96J6GJ78D64YK: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HNS8AGBMFET00ZM6DWYQNE25

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-04T18:10:23.521Zjob dependencies complete; ready to run (waiting for 13 h 1 m 11 s)
22024-02-04T18:13:43.510Zjob assigned to worker 01HNTN0YAZM8P9KQGSK29363QN (queued for 3 m 19 s)
32024-02-04T18:13:43.582Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-02-04T18:13:43.637Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-02-04T18:13:43.670Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-02-04T18:13:43.703Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-02-04T18:13:43.737Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-02-04T18:13:43.782ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-02-04T18:13:43.815Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-02-04T18:13:43.848ZOxide Helios Version helios-2.0.22418 64-bit
112024-02-04T18:13:43.882ZConfiguring devices.
122024-02-04T18:13:43.915Z##################################################
132024-02-04T18:13:43.949Z#### ############# ##
142024-02-04T18:13:43.982Z### ### ############ ##
152024-02-04T18:13:44.016Z## ### # ## ### ## Oxide Computer Company ##
162024-02-04T18:13:44.049Z## ## ## ### # ### ##
172024-02-04T18:13:44.083Z## # ### #### #### This Station Under ##
182024-02-04T18:13:44.116Z### ### #### # ### Computer Control ##
192024-02-04T18:13:44.149Z#### #### ### ## ##
202024-02-04T18:13:44.183Z##################################################
212024-02-04T18:13:44.216ZHostname: buskin
222024-02-04T18:13:44.250ZLoading smf(7) service descriptions:
232024-02-04T18:13:44.692Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-57f83304f4d2c95a.gz
242024-02-04T18:13:46.417Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-57f83304f4d2c95a.gz
252024-02-04T18:13:46.417Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-02-04T18:14:05.554Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-02-04T18:14:05.579Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-c0b0b6dcb564ad0e.gz
282024-02-04T18:14:27.545Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-c0b0b6dcb564ad0e.gz
292024-02-04T18:14:27.545Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-02-04T18:14:28.378Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-02-04T18:14:28.378Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-02-04T18:14:31.553Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-02-04T18:14:31.578Zdownloading input: /input/package/work/version.txt
342024-02-04T18:14:31.602Zdownloaded input: /input/package/work/version.txt
352024-02-04T18:14:31.603Zdownloading input: /input/package/work/package.tar.gz
362024-02-04T18:14:47.546Zdownloaded input: /input/package/work/package.tar.gz
372024-02-04T18:14:47.546Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-02-04T18:15:11.618Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-02-04T18:15:11.618Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-02-04T18:15:18.190Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-02-04T18:15:18.214Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-02-04T18:15:52.333Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-02-04T18:15:52.333Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-02-04T18:16:27.984Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-02-04T18:16:27.984Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-02-04T18:16:52.013Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-02-04T18:16:52.013Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
482024-02-04T18:16:55.176Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
492024-02-04T18:16:55.176Zdownloading input: /input/package/work/zones/crucible.tar.gz
502024-02-04T18:17:01.384Zdownloaded input: /input/package/work/zones/crucible.tar.gz
512024-02-04T18:17:01.384Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-02-04T18:17:06.164Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-02-04T18:17:06.189Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-02-04T18:17:10.892Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-02-04T18:17:10.917Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-02-04T18:17:10.941Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-02-04T18:17:10.941Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-02-04T18:17:14.571Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-02-04T18:17:15.010Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-02-04T18:17:18.149Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-02-04T18:17:18.149Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-02-04T18:17:33.756Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-02-04T18:17:33.756Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-02-04T18:17:49.645Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-02-04T18:17:49.645Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-02-04T18:17:49.716Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-02-04T18:17:49.741Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-02-04T18:17:59.866Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-02-04T18:17:59.894Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-02-04T18:18:13.067Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-02-04T18:18:13.067Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-02-04T18:19:08.556Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-02-04T18:19:08.556Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-02-04T18:19:46.877Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-02-04T18:19:46.877Zstarting task 0: "setup"
762024-02-04T18:19:46.903Z++ uname -s
772024-02-04T18:19:46.903Z+ kern=SunOS
782024-02-04T18:19:46.903Z+ case "$kern" in
792024-02-04T18:19:46.903Z+ groupadd -g 12345 build
802024-02-04T18:19:46.903Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-02-04T18:19:48.897Z+ zfs create -o mountpoint=/work rpool/work
822024-02-04T18:19:48.922Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-02-04T18:19:48.922Z+ home_fs=zfs
842024-02-04T18:19:48.922Z+ [[ zfs == autofs ]]
852024-02-04T18:19:48.922Z+ mkdir -p /home/build
862024-02-04T18:19:48.923Z+ chown build:build /home/build /work
872024-02-04T18:19:50.923Z+ chmod 0700 /home/build /work
882024-02-04T18:19:50.948Zprocess exited: duration 4050 ms, exit code 0
 
892024-02-04T18:19:50.998Zstarting task 1: "authentication"
902024-02-04T18:19:51.043Zprocess exited: duration 44 ms, exit code 0
 
912024-02-04T18:19:51.092Zstarting task 2: "build"
922024-02-04T18:19:51.117Z+ trap _exit_trap EXIT
932024-02-04T18:19:51.117Z+ set +x
942024-02-04T18:20:15.961Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-02-04T18:20:16.209Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-02-04T18:20:16.209Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-02-04T18:20:16.209Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-02-04T18:20:16.209Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-02-04T18:20:16.209Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-02-04T18:20:16.209Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-02-04T18:20:16.720Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-02-04T18:20:16.720Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-02-04T18:20:16.721Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-02-04T18:20:16.721Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-02-04T18:20:16.721Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-02-04T18:20:16.721Z+ [[ -d /opt/oxide ]]
1072024-02-04T18:20:16.721Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-02-04T18:20:16.721Z+ pfexec mkdir /opt/oxide
1092024-02-04T18:20:16.721Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-02-04T18:20:16.721Z+ [[ -d /opt/oxide-underneath ]]
1112024-02-04T18:20:16.721Z+ cd /opt/oxide-underneath
1122024-02-04T18:20:16.721Z+ pfexec tar ceEp@/f - .
1132024-02-04T18:20:16.721Z+ cd /opt/oxide
1142024-02-04T18:20:16.721Z+ pfexec tar xveEp@/f -
1152024-02-04T18:20:16.721Zx ., 0 bytes, 0 tape blocks
1162024-02-04T18:20:16.721Zx ./opte, 0 bytes, 0 tape blocks
1172024-02-04T18:20:16.721Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-02-04T18:20:16.721Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-02-04T18:20:16.721Z+ pfexec rm -rf /opt/oxide-underneath
1202024-02-04T18:20:16.721Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-02-04T18:20:16.721Z+ pfexec mkdir /opt/oxide/work
1222024-02-04T18:20:16.721Z+ pfexec chown build:build /opt/oxide/work
1232024-02-04T18:20:16.721Z+ cd /opt/oxide/work
1242024-02-04T18:20:16.721Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-02-04T18:20:17.977ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-02-04T18:20:17.978Zx out/mg-ddm-gz.tar, 63076864 bytes, 123197 tape blocks
1272024-02-04T18:20:17.978Zx out/omicron-sled-agent.tar, 122674176 bytes, 239598 tape blocks
1282024-02-04T18:20:17.978Zx out/oxlog.tar, 8382464 bytes, 16372 tape blocks
1292024-02-04T18:20:17.978Zx out/target/test, 75 bytes, 1 tape blocks
1302024-02-04T18:20:17.978Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-02-04T18:20:17.978Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1322024-02-04T18:20:17.978Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-02-04T18:20:17.978Zx target/release/omicron-package, 45720800 bytes, 89299 tape blocks
1342024-02-04T18:20:17.978Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-02-04T18:20:17.978Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-02-04T18:20:17.978Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-02-04T18:20:17.978Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-02-04T18:20:17.978Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-02-04T18:20:17.978Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-02-04T18:20:17.978Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-02-04T18:20:18.003Z
1422024-02-04T18:20:18.003Zreal 1.673078592
1432024-02-04T18:20:18.003Zuser 1.505747419
1442024-02-04T18:20:18.003Zsys 0.291937830
1452024-02-04T18:20:18.003Ztrap 0.000071481
1462024-02-04T18:20:18.003Ztflt 0.000000000
1472024-02-04T18:20:18.003Zdflt 0.000000000
1482024-02-04T18:20:18.003Zkflt 0.000000000
1492024-02-04T18:20:18.003Zlock 0.000000000
1502024-02-04T18:20:18.003Zslp 1.505858477
1512024-02-04T18:20:18.003Zlat 0.040584909
1522024-02-04T18:20:18.004Zstop 0.000122490
1532024-02-04T18:20:18.004Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-02-04T18:20:19.195Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-02-04T18:20:19.220Z+ mkdir tests
1562024-02-04T18:20:19.220Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-02-04T18:20:19.220Z+ ptime -m gunzip
1582024-02-04T18:20:19.220Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-57f83304f4d2c95a
1592024-02-04T18:20:19.612Z
1602024-02-04T18:20:19.612Zreal 0.231603336
1612024-02-04T18:20:19.613Zuser 0.214070691
1622024-02-04T18:20:19.613Zsys 0.017281309
1632024-02-04T18:20:19.613Ztrap 0.000018210
1642024-02-04T18:20:19.613Ztflt 0.000000000
1652024-02-04T18:20:19.613Zdflt 0.000000000
1662024-02-04T18:20:19.613Zkflt 0.000000000
1672024-02-04T18:20:19.613Zlock 0.000000000
1682024-02-04T18:20:19.613Zslp 0.000019940
1692024-02-04T18:20:19.613Zlat 0.000023070
1702024-02-04T18:20:19.613Zstop 0.000127901
1712024-02-04T18:20:19.613Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-57f83304f4d2c95a
1722024-02-04T18:20:19.613Z+ chmod a+x tests/bootstrap-57f83304f4d2c95a
1732024-02-04T18:20:19.614Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-02-04T18:20:19.614Z+ ptime -m gunzip
1752024-02-04T18:20:19.614Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-02-04T18:20:21.938Z
1772024-02-04T18:20:21.968Zreal 2.479553259
1782024-02-04T18:20:21.968Zuser 2.332043845
1792024-02-04T18:20:21.968Zsys 0.147110559
1802024-02-04T18:20:21.969Ztrap 0.000176321
1812024-02-04T18:20:21.969Ztflt 0.000000000
1822024-02-04T18:20:21.969Zdflt 0.000000000
1832024-02-04T18:20:21.969Zkflt 0.000000000
1842024-02-04T18:20:21.969Zlock 0.000000000
1852024-02-04T18:20:21.969Zslp 0.000023920
1862024-02-04T18:20:21.969Zlat 0.000018230
1872024-02-04T18:20:21.969Zstop 0.000125641
1882024-02-04T18:20:21.969Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-02-04T18:20:21.969Z+ chmod a+x tests/bootstrap
1902024-02-04T18:20:21.969Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-02-04T18:20:21.969Z+ ptime -m gunzip
1922024-02-04T18:20:21.969Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-c0b0b6dcb564ad0e
1932024-02-04T18:20:24.569Z
1942024-02-04T18:20:24.594Zreal 2.618169219
1952024-02-04T18:20:24.594Zuser 2.454708364
1962024-02-04T18:20:24.594Zsys 0.163015437
1972024-02-04T18:20:24.594Ztrap 0.000211444
1982024-02-04T18:20:24.594Ztflt 0.000000000
1992024-02-04T18:20:24.594Zdflt 0.000000000
2002024-02-04T18:20:24.594Zkflt 0.000000000
2012024-02-04T18:20:24.594Zlock 0.000000000
2022024-02-04T18:20:24.594Zslp 0.000019920
2032024-02-04T18:20:24.594Zlat 0.000025220
2042024-02-04T18:20:24.594Zstop 0.000123011
2052024-02-04T18:20:24.594Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-c0b0b6dcb564ad0e
2062024-02-04T18:20:24.594Z+ chmod a+x tests/end_to_end_tests-c0b0b6dcb564ad0e
2072024-02-04T18:20:24.595Z+ bmat address ls
2082024-02-04T18:20:24.595ZNAME CIDR FIRST LAST COUNT
2092024-02-04T18:20:24.595Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-02-04T18:20:24.595Z++ bmat address ls -f extra -Ho first,last,count
2112024-02-04T18:20:24.620Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-02-04T18:20:24.620Z+ EXTRA_IP_START=10.151.1.164
2132024-02-04T18:20:24.620Z+ EXTRA_IP_END=10.151.1.227
2142024-02-04T18:20:24.620Z+ EXTRA_IP_COUNT=64
2152024-02-04T18:20:24.620Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-02-04T18:20:24.620Z+ EXTRA_IP_BASE=10.151.1
2172024-02-04T18:20:24.620Z+ EXTRA_IP_FOCTET=164
2182024-02-04T18:20:24.620Z+ EXTRA_IP_LOCTET=227
2192024-02-04T18:20:24.620Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-02-04T18:20:24.620Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-02-04T18:20:24.620Z+ DNS_IP1=10.151.1.164
2222024-02-04T18:20:24.620Z+ DNS_IP2=10.151.1.165
2232024-02-04T18:20:24.620Z+ UPLINK_IP=10.151.1.174
2242024-02-04T18:20:24.620Z+ IPPOOL_START=10.151.1.175
2252024-02-04T18:20:24.620Z+ IPPOOL_END=10.151.1.227
2262024-02-04T18:20:24.620Z++ ipadm show-addr -po type,addr
2272024-02-04T18:20:24.620Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-02-04T18:20:24.620Z+ GATEWAY_IP=10.151.1.100
2292024-02-04T18:20:24.620Z+ [[ -n 10.151.1.100 ]]
2302024-02-04T18:20:24.620Z+ ping -s 10.151.1.100 56 1
2312024-02-04T18:20:24.620ZPING 10.151.1.100: 56 data bytes
2322024-02-04T18:20:24.620Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.012 ms
2332024-02-04T18:20:24.620Z
2342024-02-04T18:20:24.621Z----10.151.1.100 PING Statistics----
2352024-02-04T18:20:24.621Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-02-04T18:20:24.621Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
2372024-02-04T18:20:24.621Z++ arp -an
2382024-02-04T18:20:24.621Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-02-04T18:20:24.645Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-02-04T18:20:24.645Z+ routeadm -e ipv4-forwarding -u
2412024-02-04T18:20:24.729Z+ PXA_START=10.151.1.164
2422024-02-04T18:20:24.729Z+ PXA_END=10.151.1.227
2432024-02-04T18:20:24.729Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-02-04T18:20:24.755Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-02-04T18:20:24.933Z+ ZPOOL_VDEV_DIR=/scratch
2462024-02-04T18:20:24.933Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-02-04T18:20:24.957Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-02-04T18:20:24.958Z++ cd ./tools
2492024-02-04T18:20:24.958Z++ pwd
2502024-02-04T18:20:24.958Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-02-04T18:20:24.958Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-02-04T18:20:24.958Z+ SOFTNPU_MODE=zone
2532024-02-04T18:20:24.958Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-02-04T18:20:24.958Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-02-04T18:20:24.958Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-02-04T18:20:24.958Z++ dladm show-phys -p -o LINK
2572024-02-04T18:20:24.958Z++ head -1
2582024-02-04T18:20:24.958Z+ PHYSICAL_LINK=igb0
2592024-02-04T18:20:24.958Z+ echo 'Using igb0 as physical link'
2602024-02-04T18:20:24.958ZUsing igb0 as physical link
2612024-02-04T18:20:24.958Z+ ensure_run_as_root
2622024-02-04T18:20:24.985Z++ id -u
2632024-02-04T18:20:24.985Z+ [[ 0 -ne 0 ]]
2642024-02-04T18:20:24.985Z+ ensure_zpools
2652024-02-04T18:20:24.985Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-02-04T18:20:24.985Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-02-04T18:20:24.985Z+ readarray -t ZPOOLS
2682024-02-04T18:20:24.985Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-02-04T18:20:24.985Z++ sed 's/[ ",]//g'
2702024-02-04T18:20:24.985Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-02-04T18:20:24.985Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-02-04T18:20:24.985ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-02-04T18:20:24.985Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-02-04T18:20:24.985Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-02-04T18:20:24.985Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-02-04T18:20:24.986Z0+0 records in
2772024-02-04T18:20:24.986Z0+0 records out
2782024-02-04T18:20:24.986Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2792024-02-04T18:20:24.986Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-02-04T18:20:24.986Z+ set +x
2812024-02-04T18:20:24.986ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-02-04T18:20:24.986Z++ zpool list -o name
2832024-02-04T18:20:24.986Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-02-04T18:20:24.986Z+ [[ -z '' ]]
2852024-02-04T18:20:24.986Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-04T18:20:25.012Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-02-04T18:20:25.036Z+ set +x
2882024-02-04T18:20:25.036ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-02-04T18:20:25.036Z+ for ZPOOL in "${ZPOOLS[@]}"
2902024-02-04T18:20:25.037Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2912024-02-04T18:20:25.037Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2922024-02-04T18:20:25.037ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2932024-02-04T18:20:25.037Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2942024-02-04T18:20:25.037Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-02-04T18:20:25.037Z0+0 records in
2962024-02-04T18:20:25.037Z0+0 records out
2972024-02-04T18:20:25.037Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2982024-02-04T18:20:25.037Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-02-04T18:20:25.037Z+ set +x
3002024-02-04T18:20:25.037ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-02-04T18:20:25.037Z++ zpool list -o name
3022024-02-04T18:20:25.037Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-02-04T18:20:25.037Z+ [[ -z '' ]]
3042024-02-04T18:20:25.037Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-04T18:20:25.062Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-02-04T18:20:25.062Z+ set +x
3072024-02-04T18:20:25.062ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-02-04T18:20:25.062Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-02-04T18:20:25.062Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-02-04T18:20:25.062ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-02-04T18:20:25.062Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-02-04T18:20:25.062Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-02-04T18:20:25.062Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-02-04T18:20:25.063Z0+0 records in
3152024-02-04T18:20:25.063Z0+0 records out
3162024-02-04T18:20:25.063Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3172024-02-04T18:20:25.063Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-02-04T18:20:25.063Z+ set +x
3192024-02-04T18:20:25.063ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-02-04T18:20:25.063Z++ zpool list -o name
3212024-02-04T18:20:25.063Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-02-04T18:20:25.087Z+ [[ -z '' ]]
3232024-02-04T18:20:25.088Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-02-04T18:20:25.112Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-02-04T18:20:25.113Z+ set +x
3262024-02-04T18:20:25.113ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-02-04T18:20:25.113Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-02-04T18:20:25.113Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-02-04T18:20:25.113ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3302024-02-04T18:20:25.113Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3312024-02-04T18:20:25.113Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-02-04T18:20:25.113Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-02-04T18:20:25.113Z0+0 records in
3342024-02-04T18:20:25.113Z0+0 records out
3352024-02-04T18:20:25.113Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3362024-02-04T18:20:25.113Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-02-04T18:20:25.113Z+ set +x
3382024-02-04T18:20:25.113ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-02-04T18:20:25.113Z++ zpool list -o name
3402024-02-04T18:20:25.113Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-02-04T18:20:25.113Z+ [[ -z '' ]]
3422024-02-04T18:20:25.113Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-04T18:20:25.138Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-02-04T18:20:25.138Z+ set +x
3452024-02-04T18:20:25.138ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-02-04T18:20:25.138Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-02-04T18:20:25.138Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3482024-02-04T18:20:25.138ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3492024-02-04T18:20:25.138Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-02-04T18:20:25.138Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-02-04T18:20:25.139Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-02-04T18:20:25.139Z0+0 records in
3532024-02-04T18:20:25.139Z0+0 records out
3542024-02-04T18:20:25.139Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3552024-02-04T18:20:25.139Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-02-04T18:20:25.139Z+ set +x
3572024-02-04T18:20:25.139ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-02-04T18:20:25.164Z++ zpool list -o name
3592024-02-04T18:20:25.164Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-02-04T18:20:25.164Z+ [[ -z '' ]]
3612024-02-04T18:20:25.164Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-04T18:20:25.189Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-02-04T18:20:25.189Z+ set +x
3642024-02-04T18:20:25.189ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-02-04T18:20:25.189Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-02-04T18:20:25.189Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-02-04T18:20:25.189ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-02-04T18:20:25.189Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-02-04T18:20:25.189Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-02-04T18:20:25.189Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-02-04T18:20:25.189Z0+0 records in
3722024-02-04T18:20:25.190Z0+0 records out
3732024-02-04T18:20:25.190Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3742024-02-04T18:20:25.190Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-02-04T18:20:25.190Z+ set +x
3762024-02-04T18:20:25.190ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-02-04T18:20:25.190Z++ zpool list -o name
3782024-02-04T18:20:25.190Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-02-04T18:20:25.217Z+ [[ -z '' ]]
3802024-02-04T18:20:25.217Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-04T18:20:25.243Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-02-04T18:20:25.243Z+ set +x
3832024-02-04T18:20:25.243ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-02-04T18:20:25.243Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-02-04T18:20:25.243Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3862024-02-04T18:20:25.243ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3872024-02-04T18:20:25.243Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-02-04T18:20:25.243Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-02-04T18:20:25.243Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-02-04T18:20:25.243Z0+0 records in
3912024-02-04T18:20:25.243Z0+0 records out
3922024-02-04T18:20:25.243Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3932024-02-04T18:20:25.243Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-02-04T18:20:25.243Z+ set +x
3952024-02-04T18:20:25.243ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-02-04T18:20:25.243Z++ zpool list -o name
3972024-02-04T18:20:25.243Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-02-04T18:20:25.243Z+ [[ -z '' ]]
3992024-02-04T18:20:25.243Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-04T18:20:25.268Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-02-04T18:20:25.268Z+ set +x
4022024-02-04T18:20:25.268ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-02-04T18:20:25.268Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-02-04T18:20:25.268Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4052024-02-04T18:20:25.268ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4062024-02-04T18:20:25.268Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-02-04T18:20:25.269Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-02-04T18:20:25.269Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-02-04T18:20:25.269Z0+0 records in
4102024-02-04T18:20:25.269Z0+0 records out
4112024-02-04T18:20:25.269Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4122024-02-04T18:20:25.269Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-02-04T18:20:25.269Z+ set +x
4142024-02-04T18:20:25.269ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-02-04T18:20:25.269Z++ zpool list -o name
4162024-02-04T18:20:25.269Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-02-04T18:20:25.294Z+ [[ -z '' ]]
4182024-02-04T18:20:25.294Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-04T18:20:25.319Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-02-04T18:20:25.319Z+ set +x
4212024-02-04T18:20:25.319ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-02-04T18:20:25.319Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-02-04T18:20:25.319Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-02-04T18:20:25.319ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4252024-02-04T18:20:25.319Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4262024-02-04T18:20:25.319Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-02-04T18:20:25.319Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-02-04T18:20:25.319Z0+0 records in
4292024-02-04T18:20:25.319Z0+0 records out
4302024-02-04T18:20:25.319Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4312024-02-04T18:20:25.319Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-02-04T18:20:25.319Z+ set +x
4332024-02-04T18:20:25.319ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-02-04T18:20:25.319Z++ zpool list -o name
4352024-02-04T18:20:25.319Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-02-04T18:20:25.319Z+ [[ -z '' ]]
4372024-02-04T18:20:25.319Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-04T18:20:25.346Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-02-04T18:20:25.346Z+ set +x
4402024-02-04T18:20:25.346ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-02-04T18:20:25.346Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-02-04T18:20:25.346Z+ readarray -t ZPOOLS
4432024-02-04T18:20:25.375Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-02-04T18:20:25.375Z++ sed 's/[ ",]//g'
4452024-02-04T18:20:25.375Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-02-04T18:20:25.375Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-02-04T18:20:25.375ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-02-04T18:20:25.375Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-02-04T18:20:25.375Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-02-04T18:20:25.375Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-02-04T18:20:25.375Z0+0 records in
4522024-02-04T18:20:25.376Z0+0 records out
4532024-02-04T18:20:25.376Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4542024-02-04T18:20:25.376Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-02-04T18:20:25.376Z+ set +x
4562024-02-04T18:20:25.376ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-02-04T18:20:25.376Z++ zpool list -o name
4582024-02-04T18:20:25.376Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-02-04T18:20:25.376Z+ [[ -z '' ]]
4602024-02-04T18:20:25.376Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-04T18:20:25.401Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-02-04T18:20:25.401Z+ set +x
4632024-02-04T18:20:25.401ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4642024-02-04T18:20:25.401Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-02-04T18:20:25.401Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4662024-02-04T18:20:25.401ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4672024-02-04T18:20:25.401Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4682024-02-04T18:20:25.401Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4692024-02-04T18:20:25.401Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-02-04T18:20:25.401Z0+0 records in
4712024-02-04T18:20:25.401Z0+0 records out
4722024-02-04T18:20:25.401Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-02-04T18:20:25.401Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-02-04T18:20:25.401Z+ set +x
4752024-02-04T18:20:25.401ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-02-04T18:20:25.401Z++ zpool list -o name
4772024-02-04T18:20:25.401Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-02-04T18:20:25.426Z+ [[ -z '' ]]
4792024-02-04T18:20:25.426Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-04T18:20:25.451Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-02-04T18:20:25.451Z+ set +x
4822024-02-04T18:20:25.451ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-02-04T18:20:25.451Z+ [[ zone == \z\o\n\e ]]
4842024-02-04T18:20:25.451Z+ ensure_simulated_links igb0
4852024-02-04T18:20:25.451Z+ local PHYSICAL_LINK=igb0
4862024-02-04T18:20:25.451Z+ INDICES=("0" "1")
4872024-02-04T18:20:25.451Z+ for I in "${INDICES[@]}"
4882024-02-04T18:20:25.451Z++ get_simnet_name_if_exists net0
4892024-02-04T18:20:25.451Z++ dladm show-simnet -p -o LINK net0
4902024-02-04T18:20:25.452Z++ echo ''
4912024-02-04T18:20:25.452Z+ [[ -z '' ]]
4922024-02-04T18:20:25.452Z+ dladm create-simnet -t net0
4932024-02-04T18:20:25.452Z+ dladm create-simnet -t sc0_0
4942024-02-04T18:20:25.452Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-02-04T18:20:25.477Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-02-04T18:20:25.477Z+ success 'Simnet net0/sc0_0 exists'
4972024-02-04T18:20:25.477Z+ set +x
4982024-02-04T18:20:25.477ZSimnet net0/sc0_0 exists
4992024-02-04T18:20:25.477Z+ for I in "${INDICES[@]}"
5002024-02-04T18:20:25.477Z++ get_simnet_name_if_exists net1
5012024-02-04T18:20:25.477Z++ dladm show-simnet -p -o LINK net1
5022024-02-04T18:20:25.477Z++ echo ''
5032024-02-04T18:20:25.477Z+ [[ -z '' ]]
5042024-02-04T18:20:25.477Z+ dladm create-simnet -t net1
5052024-02-04T18:20:25.477Z+ dladm create-simnet -t sc1_0
5062024-02-04T18:20:25.477Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-02-04T18:20:25.502Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-02-04T18:20:25.502Z+ success 'Simnet net1/sc1_0 exists'
5092024-02-04T18:20:25.502Z+ set +x
5102024-02-04T18:20:25.502ZSimnet net1/sc1_0 exists
5112024-02-04T18:20:25.502Z++ get_vnic_name_if_exists sc0_1
5122024-02-04T18:20:25.502Z++ dladm show-vnic -p -o LINK sc0_1
5132024-02-04T18:20:25.502Z++ echo ''
5142024-02-04T18:20:25.502Z+ [[ -z '' ]]
5152024-02-04T18:20:25.503Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-02-04T18:20:25.503Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-02-04T18:20:25.503Z+ success 'Vnic sc0_1 exists'
5182024-02-04T18:20:25.503Z+ set +x
5192024-02-04T18:20:25.503ZVnic sc0_1 exists
5202024-02-04T18:20:25.503Z+ warn_if_no_proxy_arp
5212024-02-04T18:20:25.503Z+ [[ -v PXA_START ]]
5222024-02-04T18:20:25.503Z+ [[ -v PXA_END ]]
5232024-02-04T18:20:25.503Z+ ensure_softnpu_zone
5242024-02-04T18:20:25.503Z+ zoneadm list
5252024-02-04T18:20:25.503Z+ grep -q sidecar_softnpu
5262024-02-04T18:20:25.503Z+ [[ -f out/npuzone/npuzone ]]
5272024-02-04T18:20:25.503Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-02-04T18:20:25.528Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-02-04T18:20:31.342Zdownloading softnpu ...done
5302024-02-04T18:20:31.366Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-02-04T18:20:36.673Zdownloading asic_program.so ...done
5322024-02-04T18:20:36.703Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-02-04T18:20:41.440Zdownloading scadm ...done
5342024-02-04T18:20:41.464Zcreating port tfportrear0_0 for sc0_0
5352024-02-04T18:20:41.465Zcreating port tfportqsfp0_0 for sc0_1
5362024-02-04T18:20:41.489Zsoftnpu zone setup
5372024-02-04T18:20:41.489Zconfigure zone
5382024-02-04T18:20:41.489Zinstall zone
5392024-02-04T18:20:42.542Zboot zone
5402024-02-04T18:20:45.647Z[sidecar_softnpu] svcs milestone/network
5412024-02-04T18:20:45.674ZSTATE STIME FMRI
5422024-02-04T18:20:45.674Zonline 18:20:43 svc:/milestone/network:default
5432024-02-04T18:20:45.674Z[sidecar_softnpu] /softnpu/npu start
5442024-02-04T18:20:45.699Z
5452024-02-04T18:20:45.724Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-02-04T18:20:45.724Z+ GATEWAY_IP=10.151.1.100
5472024-02-04T18:20:45.724Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-02-04T18:20:45.724ZUsing 10.151.1.100 as gateway ip
5492024-02-04T18:20:45.724Z+ [[ ! -v GATEWAY_MAC ]]
5502024-02-04T18:20:45.724Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-02-04T18:20:45.724Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-02-04T18:20:45.724Z+++ echo 18:c0:4d:0d:9f:b2
5532024-02-04T18:20:45.724Z+ COUNT=1
5542024-02-04T18:20:45.724Z+ [[ 1 -ne 1 ]]
5552024-02-04T18:20:45.724Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-02-04T18:20:45.724ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-02-04T18:20:45.724Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-02-04T18:20:45.724Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-02-04T18:20:45.749Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-02-04T18:20:45.749Z+ [[ -v PXA_START ]]
5612024-02-04T18:20:45.749Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-02-04T18:20:45.749Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-02-04T18:20:45.774Z+ z_scadm dump-state
5642024-02-04T18:20:45.775Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-02-04T18:20:45.800Zlocal v6:
5662024-02-04T18:20:45.800Zlocal v4:
5672024-02-04T18:20:45.800Zrouter v6:
5682024-02-04T18:20:45.800Zrouter v4_idx:
5692024-02-04T18:20:45.800Zrouter v4_routes:
5702024-02-04T18:20:45.800Zresolver v4:
5712024-02-04T18:20:45.800Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-02-04T18:20:45.800Zresolver v6:
5732024-02-04T18:20:45.800Znat v4:
5742024-02-04T18:20:45.800Znat_v6:
5752024-02-04T18:20:45.800Zport_mac:
5762024-02-04T18:20:45.800Zproxy arp:
5772024-02-04T18:20:45.800Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-02-04T18:20:45.800Z+ success 'softnpu zone exists'
5792024-02-04T18:20:45.800Z+ set +x
5802024-02-04T18:20:45.800Zsoftnpu zone exists
5812024-02-04T18:20:45.800Z
5822024-02-04T18:20:45.800Zreal 20.861430877
5832024-02-04T18:20:45.800Zuser 0.709742171
5842024-02-04T18:20:45.800Zsys 1.577837928
5852024-02-04T18:20:45.800Ztrap 0.000096263
5862024-02-04T18:20:45.800Ztflt 0.000202410
5872024-02-04T18:20:45.800Zdflt 0.001130071
5882024-02-04T18:20:45.801Zkflt 0.000000000
5892024-02-04T18:20:45.801Zlock 16:08.040916139
5902024-02-04T18:20:45.801Zslp 1:02.275171065
5912024-02-04T18:20:45.801Zlat 0.086878063
5922024-02-04T18:20:45.801Zstop 0.358607472
5932024-02-04T18:20:45.801Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-02-04T18:20:45.834Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-02-04T18:20:45.881Z+ SILO_NAME=recovery
5962024-02-04T18:20:45.881Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-02-04T18:20:45.881Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-02-04T18:20:45.881Z+ sed -i~ '
5992024-02-04T18:20:45.881Z /^external_dns_ips/c\
6002024-02-04T18:20:45.882Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-02-04T18:20:45.882Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-02-04T18:20:45.882Z /^first/c\
6032024-02-04T18:20:45.882Zfirst = "10.151.1.164"
6042024-02-04T18:20:45.882Z /^last/c\
6052024-02-04T18:20:45.882Zlast = "10.151.1.173"
6062024-02-04T18:20:45.882Z }
6072024-02-04T18:20:45.882Z /^\[rack_network_config/,/^$/ {
6082024-02-04T18:20:45.882Z /^infra_ip_first/c\
6092024-02-04T18:20:45.882Zinfra_ip_first = "10.151.1.174"
6102024-02-04T18:20:45.882Z /^infra_ip_last/c\
6112024-02-04T18:20:45.882Zinfra_ip_last = "10.151.1.174"
6122024-02-04T18:20:45.882Z }
6132024-02-04T18:20:45.882Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-02-04T18:20:45.882Z /^routes/c\
6152024-02-04T18:20:45.882Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-02-04T18:20:45.882Z /^addresses/c\
6172024-02-04T18:20:45.882Zaddresses = \["10.151.1.174/24"\]
6182024-02-04T18:20:45.882Z }
6192024-02-04T18:20:45.882Z' pkg/config-rss.toml
6202024-02-04T18:20:45.882Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-02-04T18:20:45.882Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-02-04T18:20:45.882Z+++ pkg/config-rss.toml Sun Feb 4 18:20:45 2024
6232024-02-04T18:20:45.882Z@@ -41,7 +41,7 @@
6242024-02-04T18:20:45.883Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-02-04T18:20:45.883Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-02-04T18:20:45.883Z # below.
6272024-02-04T18:20:45.883Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-02-04T18:20:45.883Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-02-04T18:20:45.883Z
6302024-02-04T18:20:45.883Z # Initial TLS certificates for the external API
6312024-02-04T18:20:45.883Z #
6322024-02-04T18:20:45.883Z@@ -77,8 +77,8 @@
6332024-02-04T18:20:45.883Z #
6342024-02-04T18:20:45.883Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-02-04T18:20:45.883Z [[internal_services_ip_pool_ranges]]
6362024-02-04T18:20:45.883Z-first = "192.168.1.20"
6372024-02-04T18:20:45.883Z-last = "192.168.1.29"
6382024-02-04T18:20:45.883Z+first = "10.151.1.164"
6392024-02-04T18:20:45.883Z+last = "10.151.1.173"
6402024-02-04T18:20:45.883Z
6412024-02-04T18:20:45.883Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-02-04T18:20:45.883Z # parameters should be provided to the control plane via wicket, but we need to
6432024-02-04T18:20:45.883Z@@ -92,8 +92,8 @@
6442024-02-04T18:20:45.883Z # A range of IP addresses used by Boundary Services on the external network. In
6452024-02-04T18:20:45.883Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6462024-02-04T18:20:45.883Z # With softnpu, only one address is used.
6472024-02-04T18:20:45.883Z-infra_ip_first = "192.168.1.30"
6482024-02-04T18:20:45.883Z-infra_ip_last = "192.168.1.30"
6492024-02-04T18:20:45.884Z+infra_ip_first = "10.151.1.174"
6502024-02-04T18:20:45.884Z+infra_ip_last = "10.151.1.174"
6512024-02-04T18:20:45.884Z
6522024-02-04T18:20:45.884Z # Configurations for BGP routers to run on the scrimlets.
6532024-02-04T18:20:45.884Z bgp = []
6542024-02-04T18:20:45.884Z@@ -101,9 +101,9 @@
6552024-02-04T18:20:45.884Z # You can configure multiple uplinks by repeating the following stanza
6562024-02-04T18:20:45.884Z [[rack_network_config.ports]]
6572024-02-04T18:20:45.884Z # Routes associated with this port.
6582024-02-04T18:20:45.884Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6592024-02-04T18:20:45.884Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6602024-02-04T18:20:45.884Z # Addresses associated with this port.
6612024-02-04T18:20:45.884Z-addresses = ["192.168.1.30/24"]
6622024-02-04T18:20:45.884Z+addresses = ["10.151.1.174/24"]
6632024-02-04T18:20:45.884Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6642024-02-04T18:20:45.884Z port = "qsfp0"
6652024-02-04T18:20:45.884Z # The speed of this port.
6662024-02-04T18:20:45.884Z+ true
6672024-02-04T18:20:45.884Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6682024-02-04T18:20:45.884Za pkg/config-rss.toml 7K
6692024-02-04T18:20:45.884Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6702024-02-04T18:20:45.884Z+ TLS_NAME=recovery.sys.oxide.test
6712024-02-04T18:20:45.884Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6722024-02-04T18:20:46.131Z....+...+............+..+............+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+........+.+.....+....+...+..+...+.........+......+.........+.+...+.........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.................+...+...+........+......+...+......+............+...+......+.........+....+..................+...+.........+..+....+............+.....+....+........+.......+...............+........+...+...........................+.......+...............+...........+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6732024-02-04T18:20:46.762Z.+....+.....+...+.......+........+...+...+....+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+...............+...+..........+..+......+.............+..+.........+...+.+.....+.+.....+.+..+..........+.....+......+....+..+.+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..+.+..+.........+.+..+...............+.+...........+.+..+......+....+......+.....+..........+..+.........+...+.......+......+...+............+.........+........+.+.....+....+........+...+.+...+........+..............................+...+................+...+...+...+.....+.......+.....+......................+...+.....+...+.......+.........+.....+.........................+.........+.....+......+.+.........+........+..........+......+...........+.+...+..+.............+.........+...+........+....+.....+.......+.....+...+...+....+......+.....+.........+................+.........+...........+....+...+........+....+..............+.+.....+................+..+...+.......+..+.+...+.....+.........+.......+........+.+..............+.......+.....+.........................+...........+...............+............+.......+...+......+..+..........+...+.....+....+..................+.................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6742024-02-04T18:20:46.788Z-----
6752024-02-04T18:20:46.788Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6762024-02-04T18:20:46.813Za pkg/initial-tls-cert.pem 2K
6772024-02-04T18:20:46.813Za pkg/initial-tls-key.pem 4K
6782024-02-04T18:20:46.813Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6792024-02-04T18:20:46.813Z+ rmdir pkg
6802024-02-04T18:20:46.813Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6812024-02-04T18:20:46.813Z+ pfexec mkdir -p /usr/oxide
6822024-02-04T18:20:46.813Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6832024-02-04T18:20:47.563Z+ pfexec chmod +x /usr/oxide/oxide
6842024-02-04T18:20:47.588Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6852024-02-04T18:21:05.858Z+ OMICRON_NO_UNINSTALL=1
6862024-02-04T18:21:05.858Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6872024-02-04T18:21:05.883ZLogging to: /opt/oxide/work/out/LOG
6882024-02-04T18:21:06.402Z
6892024-02-04T18:21:06.430Zreal 0.539476974
6902024-02-04T18:21:06.430Zuser 0.109769753
6912024-02-04T18:21:06.431Zsys 2.308248281
6922024-02-04T18:21:06.431Ztrap 0.000013990
6932024-02-04T18:21:06.431Ztflt 0.000029726
6942024-02-04T18:21:06.431Zdflt 0.001079533
6952024-02-04T18:21:06.431Zkflt 0.000000000
6962024-02-04T18:21:06.431Zlock 48.911323277
6972024-02-04T18:21:06.431Zslp 0.754565836
6982024-02-04T18:21:06.431Zlat 0.003085767
6992024-02-04T18:21:06.431Zstop 0.210011615
7002024-02-04T18:21:06.431Z+ retry=0
7012024-02-04T18:21:06.431Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7022024-02-04T18:21:06.432Z+ [[ 0 -gt 30 ]]
7032024-02-04T18:21:06.432Z+ sleep 1
7042024-02-04T18:21:07.419Z+ retry=1
7052024-02-04T18:21:07.420Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7062024-02-04T18:21:07.447Z+ [[ 1 -gt 30 ]]
7072024-02-04T18:21:07.447Z+ sleep 1
7082024-02-04T18:21:08.433Z+ retry=2
7092024-02-04T18:21:08.433Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7102024-02-04T18:21:08.457Z+ [[ 2 -gt 30 ]]
7112024-02-04T18:21:08.457Z+ sleep 1
7122024-02-04T18:21:09.446Z+ retry=3
7132024-02-04T18:21:09.446Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7142024-02-04T18:21:09.472Z+ [[ 3 -gt 30 ]]
7152024-02-04T18:21:09.472Z+ sleep 1
7162024-02-04T18:21:10.464Z+ retry=4
7172024-02-04T18:21:10.464Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7182024-02-04T18:21:35.629Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7192024-02-04T18:21:35.658Zlocal v6:
7202024-02-04T18:21:35.658Zfd76:93f:d42f:63c5::1
7212024-02-04T18:21:35.658Zfe80::f4d0:31ff:fe32:9d73
7222024-02-04T18:21:35.659Zlocal v4:
7232024-02-04T18:21:35.659Z10.151.1.174
7242024-02-04T18:21:35.659Zrouter v6:
7252024-02-04T18:21:35.659Zfd00:1122:3344:2::/64 -> fe80::dc3a:34ff:fe87:443a (1)
7262024-02-04T18:21:35.659Zfd00:1122:3344:1::/64 -> fe80::dc3a:34ff:fe87:443a (1)
7272024-02-04T18:21:35.659Zfd00:1122:3344:3::/64 -> fe80::dc3a:34ff:fe87:443a (1)
7282024-02-04T18:21:35.659Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::dc3a:34ff:fe87:443a (1)
7292024-02-04T18:21:35.659Zfd00:1122:3344:101::/64 -> fe80::dc3a:34ff:fe87:443a (1)
7302024-02-04T18:21:35.659Zrouter v4_idx:
7312024-02-04T18:21:35.659Z0.0.0.0/0 -> 0
7322024-02-04T18:21:35.659Zrouter v4_routes:
7332024-02-04T18:21:35.659Z0 -> 10.151.1.100 (2)
7342024-02-04T18:21:35.659Zresolver v4:
7352024-02-04T18:21:35.685Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7362024-02-04T18:21:35.685Z10.151.1.174 -> 76:9a:77:92:2d:7d
7372024-02-04T18:21:35.685Zresolver v6:
7382024-02-04T18:21:35.685Zfe80::dc3a:34ff:fe87:443a -> de:3a:34:87:44:3a
7392024-02-04T18:21:35.685Zfe80::f4d0:31ff:fe32:9d73 -> f6:d0:31:32:9d:73
7402024-02-04T18:21:35.685Znat v4:
7412024-02-04T18:21:35.685Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:8a:85
7422024-02-04T18:21:35.685Znat_v6:
7432024-02-04T18:21:35.685Zport_mac:
7442024-02-04T18:21:35.685Z1: a8:40:25:57:20:bb
7452024-02-04T18:21:35.685Z1000: a8:40:25:57:20:ba
7462024-02-04T18:21:35.685Zproxy arp:
7472024-02-04T18:21:35.685Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7482024-02-04T18:21:35.685Z+ retry=0
7492024-02-04T18:21:35.685Z+++ zoneadm list -n
7502024-02-04T18:21:35.685Z+++ grep oxz_ntp
7512024-02-04T18:21:35.685Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
7522024-02-04T18:21:35.713Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7532024-02-04T18:21:35.713Z++ true
7542024-02-04T18:21:35.713Z+ [[ '' != online ]]
7552024-02-04T18:21:35.713Z+ [[ 0 -gt 60 ]]
7562024-02-04T18:21:35.714Z+ sleep 1
7572024-02-04T18:21:36.692Z+ retry=1
7582024-02-04T18:21:36.716Z+++ zoneadm list -n
7592024-02-04T18:21:36.716Z+++ grep oxz_ntp
7602024-02-04T18:21:36.717Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
7612024-02-04T18:21:36.717Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7622024-02-04T18:21:36.741Z++ true
7632024-02-04T18:21:36.742Z+ [[ '' != online ]]
7642024-02-04T18:21:36.742Z+ [[ 1 -gt 60 ]]
7652024-02-04T18:21:36.742Z+ sleep 1
7662024-02-04T18:21:37.720Z+ retry=2
7672024-02-04T18:21:37.745Z+++ zoneadm list -n
7682024-02-04T18:21:37.745Z+++ grep oxz_ntp
7692024-02-04T18:21:37.745Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
7702024-02-04T18:21:37.745Z+ [[ disabled != online ]]
7712024-02-04T18:21:37.745Z+ [[ 2 -gt 60 ]]
7722024-02-04T18:21:37.745Z+ sleep 1
7732024-02-04T18:21:38.744Z+ retry=3
7742024-02-04T18:21:38.769Z+++ zoneadm list -n
7752024-02-04T18:21:38.769Z+++ grep oxz_ntp
7762024-02-04T18:21:38.769Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
7772024-02-04T18:21:38.769Z+ [[ disabled != online ]]
7782024-02-04T18:21:38.769Z+ [[ 3 -gt 60 ]]
7792024-02-04T18:21:38.769Z+ sleep 1
7802024-02-04T18:21:39.765Z+ retry=4
7812024-02-04T18:21:39.790Z+++ zoneadm list -n
7822024-02-04T18:21:39.790Z+++ grep oxz_ntp
7832024-02-04T18:21:39.790Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
7842024-02-04T18:21:39.791Z+ [[ disabled != online ]]
7852024-02-04T18:21:39.791Z+ [[ 4 -gt 60 ]]
7862024-02-04T18:21:39.791Z+ sleep 1
7872024-02-04T18:21:40.789Z+ retry=5
7882024-02-04T18:21:40.814Z+++ zoneadm list -n
7892024-02-04T18:21:40.814Z+++ grep oxz_ntp
7902024-02-04T18:21:40.814Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
7912024-02-04T18:21:40.814Z+ [[ disabled != online ]]
7922024-02-04T18:21:40.814Z+ [[ 5 -gt 60 ]]
7932024-02-04T18:21:40.814Z+ sleep 1
7942024-02-04T18:21:41.809Z+ retry=6
7952024-02-04T18:21:41.836Z+++ zoneadm list -n
7962024-02-04T18:21:41.836Z+++ grep oxz_ntp
7972024-02-04T18:21:41.836Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
7982024-02-04T18:21:41.836Z+ [[ disabled != online ]]
7992024-02-04T18:21:41.836Z+ [[ 6 -gt 60 ]]
8002024-02-04T18:21:41.836Z+ sleep 1
8012024-02-04T18:21:42.831Z+ retry=7
8022024-02-04T18:21:42.855Z+++ zoneadm list -n
8032024-02-04T18:21:42.855Z+++ grep oxz_ntp
8042024-02-04T18:21:42.856Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
8052024-02-04T18:21:42.856Z+ [[ disabled != online ]]
8062024-02-04T18:21:42.856Z+ [[ 7 -gt 60 ]]
8072024-02-04T18:21:42.856Z+ sleep 1
8082024-02-04T18:21:43.853Z+ retry=8
8092024-02-04T18:21:43.877Z+++ zoneadm list -n
8102024-02-04T18:21:43.877Z+++ grep oxz_ntp
8112024-02-04T18:21:43.877Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
8122024-02-04T18:21:43.878Z+ [[ disabled != online ]]
8132024-02-04T18:21:43.878Z+ [[ 8 -gt 60 ]]
8142024-02-04T18:21:43.878Z+ sleep 1
8152024-02-04T18:21:44.876Z+ retry=9
8162024-02-04T18:21:44.900Z+++ zoneadm list -n
8172024-02-04T18:21:44.900Z+++ grep oxz_ntp
8182024-02-04T18:21:44.900Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
8192024-02-04T18:21:44.900Z+ [[ disabled != online ]]
8202024-02-04T18:21:44.900Z+ [[ 9 -gt 60 ]]
8212024-02-04T18:21:44.900Z+ sleep 1
 
8222024-02-04T18:21:45.870Zbuskin console login: Feb 4 18:21:45 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8232024-02-04T18:21:45.900Z+ retry=10
8242024-02-04T18:21:45.930Z+++ zoneadm list -n
8252024-02-04T18:21:45.931Z+++ grep oxz_ntp
8262024-02-04T18:21:45.931Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
8272024-02-04T18:21:45.931Z+ [[ offline != online ]]
8282024-02-04T18:21:45.931Z+ [[ 10 -gt 60 ]]
8292024-02-04T18:21:45.931Z+ sleep 1
8302024-02-04T18:21:46.920Z+ retry=11
8312024-02-04T18:21:46.945Z+++ zoneadm list -n
8322024-02-04T18:21:46.945Z+++ grep oxz_ntp
8332024-02-04T18:21:46.945Z++ pfexec svcs -z oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23 -Hostate oxide/ntp
8342024-02-04T18:21:46.945Z+ [[ online != online ]]
8352024-02-04T18:21:46.945Z+ echo 'Waited for chrony: 11s'
8362024-02-04T18:21:46.945Z+ export RUST_BACKTRACE=1
8372024-02-04T18:21:46.945ZWaited for chrony: 11s
8382024-02-04T18:21:46.945Z+ RUST_BACKTRACE=1
8392024-02-04T18:21:46.945Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8402024-02-04T18:21:46.945Z++ ./tests/bootstrap
8412024-02-04T18:21:46.972ZUsing external DNS server at 10.151.1.164:53
8422024-02-04T18:21:46.972Z2024-02-04 18:21:46.982657177 UTC: attempting to log into API
8432024-02-04T18:22:02.006Z2024-02-04 18:22:01.992729470 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8442024-02-04T18:22:03.009Z2024-02-04 18:22:02.993673893 UTC: attempting to log into API
8452024-02-04T18:22:18.226Z2024-02-04 18:22:18.026439581 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8462024-02-04T18:22:19.567Z2024-02-04 18:22:19.043352305 UTC: attempting to log into API
8472024-02-04T18:22:36.437Z2024-02-04 18:22:36.422944433 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8482024-02-04T18:22:37.438Z2024-02-04 18:22:37.424670435 UTC: attempting to log into API
8492024-02-04T18:22:52.472Z2024-02-04 18:22:52.458751105 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8502024-02-04T18:22:53.474Z2024-02-04 18:22:53.460521768 UTC: attempting to log into API
8512024-02-04T18:23:08.508Z2024-02-04 18:23:08.495182902 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8522024-02-04T18:23:09.510Z2024-02-04 18:23:09.496721462 UTC: attempting to log into API
8532024-02-04T18:23:24.547Z2024-02-04 18:23:24.534174748 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8542024-02-04T18:23:25.548Z2024-02-04 18:23:25.535262002 UTC: attempting to log into API
 
8552024-02-04T18:23:28.917ZFeb 4 18:23:28 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
8562024-02-04T18:23:35.667ZFeb 4 18:23:34 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
8572024-02-04T18:23:40.582Z2024-02-04 18:23:40.569485670 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8582024-02-04T18:23:41.582Z2024-02-04 18:23:41.570398541 UTC: attempting to log into API
 
8592024-02-04T18:23:42.766ZFeb 4 18:23:41 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8602024-02-04T18:23:48.956ZFeb 4 18:23:48 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
8612024-02-04T18:23:55.124ZFeb 4 18:23:54 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8622024-02-04T18:23:56.616Z2024-02-04 18:23:56.604748130 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8632024-02-04T18:23:57.617Z2024-02-04 18:23:57.605759073 UTC: attempting to log into API
8642024-02-04T18:24:13.283Z2024-02-04 18:24:12.640859714 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8652024-02-04T18:24:13.654Z2024-02-04 18:24:13.642893770 UTC: attempting to log into API
8662024-02-04T18:24:13.696Z2024-02-04 18:24:13.682264397 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: tcp connect error: Connection refused (os error 146)
8672024-02-04T18:24:14.695Z2024-02-04 18:24:14.683695636 UTC: attempting to log into API
8682024-02-04T18:24:15.462Z2024-02-04 18:24:15.450784115 UTC: login succeeded
8692024-02-04T18:24:15.495Zwaiting for nexus to come up...
8702024-02-04T18:24:15.562Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8712024-02-04T18:24:15.762Zsetting up quotas...
8722024-02-04T18:24:15.814Zensuring datasets are ready...
8732024-02-04T18:24:18.396Zlet's roll.
8742024-02-04T18:24:18.420Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8752024-02-04T18:24:18.421ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8762024-02-04T18:24:18.421ZOXIDE_TOKEN=oxide-token-86242b84f8787f616ea9d35e1829ec23ddad1f90'
8772024-02-04T18:24:18.421Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8782024-02-04T18:24:18.421Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8792024-02-04T18:24:18.421Z++ OXIDE_TOKEN=oxide-token-86242b84f8787f616ea9d35e1829ec23ddad1f90
8802024-02-04T18:24:18.421Z+ export OXIDE_HOST OXIDE_TOKEN
8812024-02-04T18:24:18.421Z+ retry=0
8822024-02-04T18:24:18.421Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8832024-02-04T18:24:18.421Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8842024-02-04T18:24:18.421Z+ [[ 0 -gt 60 ]]
8852024-02-04T18:24:18.421Z+ sleep 1
8862024-02-04T18:24:19.424Z+ retry=1
8872024-02-04T18:24:19.424Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8882024-02-04T18:24:19.449Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8892024-02-04T18:24:19.449Z+ [[ 1 -gt 60 ]]
8902024-02-04T18:24:19.449Z+ sleep 1
8912024-02-04T18:24:20.440Z+ retry=2
8922024-02-04T18:24:20.440Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8932024-02-04T18:24:20.464Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8942024-02-04T18:24:20.465Z+ [[ 2 -gt 60 ]]
8952024-02-04T18:24:20.465Z+ sleep 1
8962024-02-04T18:24:21.454Z+ retry=3
8972024-02-04T18:24:21.455Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8982024-02-04T18:24:21.479Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8992024-02-04T18:24:21.479Z+ [[ 3 -gt 60 ]]
9002024-02-04T18:24:21.479Z+ sleep 1
9012024-02-04T18:24:22.510Z+ retry=4
9022024-02-04T18:24:22.510Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9032024-02-04T18:24:22.572Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9042024-02-04T18:24:22.573Z+ [[ 4 -gt 60 ]]
9052024-02-04T18:24:22.573Z+ sleep 1
9062024-02-04T18:24:23.486Z+ retry=5
9072024-02-04T18:24:23.487Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9082024-02-04T18:24:23.513Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9092024-02-04T18:24:23.513Z+ [[ 5 -gt 60 ]]
9102024-02-04T18:24:23.513Z+ sleep 1
9112024-02-04T18:24:24.504Z+ retry=6
9122024-02-04T18:24:24.504Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9132024-02-04T18:24:24.530Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9142024-02-04T18:24:24.530Z+ [[ 6 -gt 60 ]]
9152024-02-04T18:24:24.531Z+ sleep 1
9162024-02-04T18:24:25.519Z+ retry=7
9172024-02-04T18:24:25.519Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9182024-02-04T18:24:25.545Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9192024-02-04T18:24:25.545Z+ [[ 7 -gt 60 ]]
9202024-02-04T18:24:25.545Z+ sleep 1
9212024-02-04T18:24:26.533Z+ retry=8
9222024-02-04T18:24:26.533Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9232024-02-04T18:24:26.566Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9242024-02-04T18:24:26.566Z+ [[ 8 -gt 60 ]]
9252024-02-04T18:24:26.566Z+ sleep 1
9262024-02-04T18:24:27.549Z+ retry=9
9272024-02-04T18:24:27.549Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9282024-02-04T18:24:27.574Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9292024-02-04T18:24:27.574Z+ [[ 9 -gt 60 ]]
9302024-02-04T18:24:27.574Z+ sleep 1
9312024-02-04T18:24:28.564Z+ retry=10
9322024-02-04T18:24:28.564Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9332024-02-04T18:24:28.588Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9342024-02-04T18:24:28.588Z+ [[ 10 -gt 60 ]]
9352024-02-04T18:24:28.588Z+ sleep 1
9362024-02-04T18:24:29.584Z+ retry=11
9372024-02-04T18:24:29.585Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9382024-02-04T18:24:29.613Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9392024-02-04T18:24:29.613Z+ [[ 11 -gt 60 ]]
9402024-02-04T18:24:29.613Z+ sleep 1
9412024-02-04T18:24:30.595Z+ retry=12
9422024-02-04T18:24:30.595Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9432024-02-04T18:24:30.620Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9442024-02-04T18:24:30.621Z+ [[ 12 -gt 60 ]]
9452024-02-04T18:24:30.621Z+ sleep 1
9462024-02-04T18:24:31.619Z+ retry=13
9472024-02-04T18:24:31.620Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9482024-02-04T18:24:31.652Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9492024-02-04T18:24:31.652Z+ [[ 13 -gt 60 ]]
9502024-02-04T18:24:31.652Z+ sleep 1
9512024-02-04T18:24:32.629Z+ retry=14
9522024-02-04T18:24:32.629Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9532024-02-04T18:24:32.661Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9542024-02-04T18:24:32.661Z+ [[ 14 -gt 60 ]]
9552024-02-04T18:24:32.661Z+ sleep 1
9562024-02-04T18:24:33.640Z+ retry=15
9572024-02-04T18:24:33.640Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9582024-02-04T18:24:33.671Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9592024-02-04T18:24:33.671Z+ [[ 15 -gt 60 ]]
9602024-02-04T18:24:33.671Z+ sleep 1
9612024-02-04T18:24:34.654Z+ retry=16
9622024-02-04T18:24:34.654Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9632024-02-04T18:24:34.678Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9642024-02-04T18:24:34.678Z+ [[ 16 -gt 60 ]]
9652024-02-04T18:24:34.678Z+ sleep 1
9662024-02-04T18:24:35.670Z+ retry=17
9672024-02-04T18:24:35.670Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9682024-02-04T18:24:35.696Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9692024-02-04T18:24:35.696Z+ [[ 17 -gt 60 ]]
9702024-02-04T18:24:35.696Z+ sleep 1
9712024-02-04T18:24:36.684Z+ retry=18
9722024-02-04T18:24:36.685Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9732024-02-04T18:24:36.712Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9742024-02-04T18:24:36.712Z+ [[ 18 -gt 60 ]]
9752024-02-04T18:24:36.712Z+ sleep 1
9762024-02-04T18:24:37.699Z+ retry=19
9772024-02-04T18:24:37.699Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9782024-02-04T18:24:37.724Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9792024-02-04T18:24:37.724Z+ [[ 19 -gt 60 ]]
9802024-02-04T18:24:37.724Z+ sleep 1
9812024-02-04T18:24:38.714Z+ retry=20
9822024-02-04T18:24:38.714Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9832024-02-04T18:24:38.738Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9842024-02-04T18:24:38.738Z+ [[ 20 -gt 60 ]]
9852024-02-04T18:24:38.738Z+ sleep 1
9862024-02-04T18:24:39.731Z+ retry=21
9872024-02-04T18:24:39.731Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9882024-02-04T18:24:39.757Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9892024-02-04T18:24:39.757Z+ [[ 21 -gt 60 ]]
9902024-02-04T18:24:39.757Z+ sleep 1
9912024-02-04T18:24:40.745Z+ retry=22
9922024-02-04T18:24:40.745Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9932024-02-04T18:24:40.770Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9942024-02-04T18:24:40.771Z+ [[ 22 -gt 60 ]]
9952024-02-04T18:24:40.771Z+ sleep 1
9962024-02-04T18:24:41.759Z+ retry=23
9972024-02-04T18:24:41.759Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9982024-02-04T18:24:41.789Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9992024-02-04T18:24:41.790Z+ [[ 23 -gt 60 ]]
10002024-02-04T18:24:41.790Z+ sleep 1
10012024-02-04T18:24:42.776Z+ retry=24
10022024-02-04T18:24:42.776Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10032024-02-04T18:24:42.804Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10042024-02-04T18:24:42.804Z+ [[ 24 -gt 60 ]]
10052024-02-04T18:24:42.804Z+ sleep 1
10062024-02-04T18:24:43.790Z+ retry=25
10072024-02-04T18:24:43.790Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10082024-02-04T18:24:43.814Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10092024-02-04T18:24:43.814Z+ [[ 25 -gt 60 ]]
10102024-02-04T18:24:43.814Z+ sleep 1
10112024-02-04T18:24:44.805Z+ retry=26
10122024-02-04T18:24:44.805Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10132024-02-04T18:24:44.830Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10142024-02-04T18:24:44.830Z+ [[ 26 -gt 60 ]]
10152024-02-04T18:24:44.830Z+ sleep 1
10162024-02-04T18:24:45.819Z+ retry=27
10172024-02-04T18:24:45.819Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10182024-02-04T18:24:45.847Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10192024-02-04T18:24:45.847Z+ [[ 27 -gt 60 ]]
10202024-02-04T18:24:45.847Z+ sleep 1
10212024-02-04T18:24:46.835Z+ retry=28
10222024-02-04T18:24:46.835Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10232024-02-04T18:24:46.859Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10242024-02-04T18:24:46.859Z+ [[ 28 -gt 60 ]]
10252024-02-04T18:24:46.859Z+ sleep 1
10262024-02-04T18:24:47.851Z+ retry=29
10272024-02-04T18:24:47.852Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10282024-02-04T18:24:47.877Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10292024-02-04T18:24:47.877Z+ [[ 29 -gt 60 ]]
10302024-02-04T18:24:47.877Z+ sleep 1
10312024-02-04T18:24:48.872Z+ retry=30
10322024-02-04T18:24:48.872Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10332024-02-04T18:24:48.896Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10342024-02-04T18:24:48.896Z+ [[ 30 -gt 60 ]]
10352024-02-04T18:24:48.896Z+ sleep 1
10362024-02-04T18:24:49.880Z+ retry=31
10372024-02-04T18:24:49.880Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10382024-02-04T18:24:49.904Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10392024-02-04T18:24:49.904Z+ [[ 31 -gt 60 ]]
10402024-02-04T18:24:49.904Z+ sleep 1
10412024-02-04T18:24:50.895Z+ retry=32
10422024-02-04T18:24:50.895Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10432024-02-04T18:24:50.925Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10442024-02-04T18:24:50.926Z+ [[ 32 -gt 60 ]]
10452024-02-04T18:24:50.926Z+ sleep 1
10462024-02-04T18:24:51.910Z+ retry=33
10472024-02-04T18:24:51.910Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10482024-02-04T18:24:51.935Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10492024-02-04T18:24:51.935Z+ [[ 33 -gt 60 ]]
10502024-02-04T18:24:51.935Z+ sleep 1
10512024-02-04T18:24:52.928Z+ retry=34
10522024-02-04T18:24:52.928Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10532024-02-04T18:24:52.952Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10542024-02-04T18:24:52.952Z+ [[ 34 -gt 60 ]]
10552024-02-04T18:24:52.952Z+ sleep 1
10562024-02-04T18:24:53.941Z+ retry=35
10572024-02-04T18:24:53.941Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10582024-02-04T18:24:53.967Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10592024-02-04T18:24:53.967Z+ [[ 35 -gt 60 ]]
10602024-02-04T18:24:53.967Z+ sleep 1
10612024-02-04T18:24:54.955Z+ retry=36
10622024-02-04T18:24:54.955Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10632024-02-04T18:24:54.979Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10642024-02-04T18:24:54.980Z+ [[ 36 -gt 60 ]]
10652024-02-04T18:24:54.980Z+ sleep 1
10662024-02-04T18:24:55.970Z+ retry=37
10672024-02-04T18:24:55.970Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10682024-02-04T18:24:56.052Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10692024-02-04T18:24:56.697Z{"status":"ok"}success
10702024-02-04T18:24:56.697ZProject {
10712024-02-04T18:24:56.697Z description: "some images",
10722024-02-04T18:24:56.698Z id: 9c939098-266e-4dee-9894-a8a279d44b91,
10732024-02-04T18:24:56.698Z name: Name(
10742024-02-04T18:24:56.698Z "images",
10752024-02-04T18:24:56.698Z ),
10762024-02-04T18:24:56.698Z time_created: 2024-02-04T18:24:56.134690Z,
10772024-02-04T18:24:56.698Z time_modified: 2024-02-04T18:24:56.134690Z,
10782024-02-04T18:24:56.698Z}
10792024-02-04T18:24:56.723Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
10802024-02-04T18:30:31.329Zdone!
10812024-02-04T18:30:31.427Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
10822024-02-04T18:30:31.533Zsuccess
10832024-02-04T18:30:31.533ZImage {
10842024-02-04T18:30:31.533Z block_size: ByteCount(
10852024-02-04T18:30:31.533Z 512,
10862024-02-04T18:30:31.533Z ),
10872024-02-04T18:30:31.533Z description: "debian 11 original base image",
10882024-02-04T18:30:31.533Z digest: None,
10892024-02-04T18:30:31.534Z id: 1752b320-1a43-4a0d-a1e7-28a9a1ff83e0,
10902024-02-04T18:30:31.534Z name: Name(
10912024-02-04T18:30:31.534Z "debian11",
10922024-02-04T18:30:31.534Z ),
10932024-02-04T18:30:31.534Z os: "debian",
10942024-02-04T18:30:31.534Z project_id: None,
10952024-02-04T18:30:31.534Z size: ByteCount(
10962024-02-04T18:30:31.559Z 2147483648,
10972024-02-04T18:30:31.559Z ),
10982024-02-04T18:30:31.559Z time_created: 2024-02-04T18:30:31.295237Z,
10992024-02-04T18:30:31.559Z time_modified: 2024-02-04T18:30:31.513977Z,
11002024-02-04T18:30:31.559Z url: None,
11012024-02-04T18:30:31.559Z version: "11",
11022024-02-04T18:30:31.559Z}
11032024-02-04T18:30:31.559Z+ rm ./tests/bootstrap
11042024-02-04T18:30:31.608Z+ for test_bin in tests/*
11052024-02-04T18:30:31.608Z+ ./tests/bootstrap-57f83304f4d2c95a
11062024-02-04T18:30:31.632Z
11072024-02-04T18:30:31.632Zrunning 0 tests
11082024-02-04T18:30:31.632Z
11092024-02-04T18:30:31.632Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11102024-02-04T18:30:31.633Z
11112024-02-04T18:30:31.633Z+ for test_bin in tests/*
11122024-02-04T18:30:31.633Z+ ./tests/end_to_end_tests-c0b0b6dcb564ad0e
11132024-02-04T18:30:31.713Z
11142024-02-04T18:30:31.713Zrunning 2 tests
11152024-02-04T18:30:31.937Ztest no_spoof::no_spoof_here ... ok
11162024-02-04T18:31:03.963Ztest instance_launch::instance_launch ... ok
11172024-02-04T18:31:03.963Z
11182024-02-04T18:31:03.963Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 32.25s
11192024-02-04T18:31:03.964Z
11202024-02-04T18:31:03.989Z+ _exit_trap
11212024-02-04T18:31:03.989Z+ local status=0
11222024-02-04T18:31:03.989Z+ [[ 0 -eq 0 ]]
11232024-02-04T18:31:03.989Z+ exit 0
11242024-02-04T18:31:03.989Zprocess exited: duration 672868 ms, exit code 0
 
11252024-02-04T18:31:04.111Zfound 131 output files
11262024-02-04T18:31:04.111Zuploading: /var/svc/log/oxide-sled-agent:default.log (1484311 bytes)
11272024-02-04T18:31:04.872Zupload warning: file "/var/svc/log/oxide-sled-agent:default.log" changed size mid upload: 1484311 -> 1484723
11282024-02-04T18:31:05.947Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11292024-02-04T18:31:05.972Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (271960 bytes)
11302024-02-04T18:31:06.185Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 271960 -> 281689
11312024-02-04T18:31:07.255Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11322024-02-04T18:31:07.256Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (2196993 bytes)
11332024-02-04T18:31:10.014Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11342024-02-04T18:31:10.014Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (8748 bytes)
11352024-02-04T18:31:10.083Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 8748 -> 9582
11362024-02-04T18:31:11.155Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11372024-02-04T18:31:11.155Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (76246 bytes)
11382024-02-04T18:31:12.341Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11392024-02-04T18:31:12.341Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (11322 bytes)
11402024-02-04T18:31:12.409Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 11322 -> 12662
11412024-02-04T18:31:13.479Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11422024-02-04T18:31:13.479Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (98664 bytes)
11432024-02-04T18:31:14.693Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11442024-02-04T18:31:14.694Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (134188 bytes)
11452024-02-04T18:31:14.913Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 134188 -> 153354
11462024-02-04T18:31:15.984Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11472024-02-04T18:31:15.984Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1102407 bytes)
11482024-02-04T18:31:17.832Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11492024-02-04T18:31:17.833Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (83774 bytes)
11502024-02-04T18:31:17.992Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 83774 -> 101758
11512024-02-04T18:31:19.060Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11522024-02-04T18:31:19.060Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (672403 bytes)
11532024-02-04T18:31:21.158Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11542024-02-04T18:31:21.158Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11552024-02-04T18:31:22.260Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11562024-02-04T18:31:22.260Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11572024-02-04T18:31:23.360Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11582024-02-04T18:31:23.387Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (31791 bytes)
11592024-02-04T18:31:23.476Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 31791 -> 41887
11602024-02-04T18:31:24.557Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11612024-02-04T18:31:24.557Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (246672 bytes)
11622024-02-04T18:31:25.875Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11632024-02-04T18:31:25.875Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
11642024-02-04T18:31:26.957Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11652024-02-04T18:31:26.957Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
11662024-02-04T18:31:28.054Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
11672024-02-04T18:31:28.054Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (1594 bytes)
11682024-02-04T18:31:28.101Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log" changed size mid upload: 1594 -> 2390
11692024-02-04T18:31:29.171Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11702024-02-04T18:31:29.171Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (18942 bytes)
11712024-02-04T18:31:30.310Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
11722024-02-04T18:31:30.310Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-clickhouse:default.log (89977 bytes)
11732024-02-04T18:31:30.513Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 89977 -> 141569
11742024-02-04T18:31:31.584Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-clickhouse:default.log
11752024-02-04T18:31:31.609Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-clickhouse:default.log.0 (669257 bytes)
11762024-02-04T18:31:33.199Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-clickhouse:default.log.0
11772024-02-04T18:31:33.225Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11782024-02-04T18:31:34.272Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-zone-network-setup:default.log
11792024-02-04T18:31:34.272Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
11802024-02-04T18:31:35.370Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_fecd0cdb-d7bc-4731-aa42-1015ab1d0ccc/root/var/svc/log/oxide-zone-network-setup:default.log.0
11812024-02-04T18:31:35.370Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3f4db039-c6ba-4f90-9396-e2e55fe7d299/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11822024-02-04T18:31:36.443Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3f4db039-c6ba-4f90-9396-e2e55fe7d299/root/var/svc/log/oxide-cockroachdb:default.log
11832024-02-04T18:31:36.443Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3f4db039-c6ba-4f90-9396-e2e55fe7d299/root/var/svc/log/oxide-cockroachdb:default.log.0 (4379 bytes)
11842024-02-04T18:31:37.553Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3f4db039-c6ba-4f90-9396-e2e55fe7d299/root/var/svc/log/oxide-cockroachdb:default.log.0
11852024-02-04T18:31:37.553Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3f4db039-c6ba-4f90-9396-e2e55fe7d299/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11862024-02-04T18:31:38.634Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3f4db039-c6ba-4f90-9396-e2e55fe7d299/root/var/svc/log/oxide-zone-network-setup:default.log
11872024-02-04T18:31:38.635Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3f4db039-c6ba-4f90-9396-e2e55fe7d299/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
11882024-02-04T18:31:39.746Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_3f4db039-c6ba-4f90-9396-e2e55fe7d299/root/var/svc/log/oxide-zone-network-setup:default.log.0
11892024-02-04T18:31:39.746Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-agent:default.log (10358 bytes)
11902024-02-04T18:31:40.872Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-agent:default.log
11912024-02-04T18:31:40.872Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-agent:default.log.0 (9364 bytes)
11922024-02-04T18:31:42.003Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-agent:default.log.0
11932024-02-04T18:31:42.028Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11942024-02-04T18:31:43.095Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:default.log
11952024-02-04T18:31:43.095Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11962024-02-04T18:31:44.206Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11972024-02-04T18:31:44.240Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:downstairs-42826f46-3335-46c6-a9f0-8491c4f192df.log (1092 bytes)
11982024-02-04T18:31:45.329Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:downstairs-42826f46-3335-46c6-a9f0-8491c4f192df.log
11992024-02-04T18:31:45.329Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:downstairs-42826f46-3335-46c6-a9f0-8491c4f192df.log.0 (4531 bytes)
12002024-02-04T18:31:46.425Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:downstairs-42826f46-3335-46c6-a9f0-8491c4f192df.log.0
12012024-02-04T18:31:46.449Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:snapshot-42826f46-3335-46c6-a9f0-8491c4f192df-a4ec9a18-f661-45e4-b717-edc4e9e22dcd.log (5159 bytes)
12022024-02-04T18:31:47.524Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_4d490882-1658-4a5f-926b-f3cfb1b96926/root/var/svc/log/oxide-crucible-downstairs:snapshot-42826f46-3335-46c6-a9f0-8491c4f192df-a4ec9a18-f661-45e4-b717-edc4e9e22dcd.log
12032024-02-04T18:31:47.548Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_609e4f3b-76ed-4418-bdfc-b67589deb6ce/root/var/svc/log/oxide-external_dns:default.log (3778 bytes)
12042024-02-04T18:31:48.620Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_609e4f3b-76ed-4418-bdfc-b67589deb6ce/root/var/svc/log/oxide-external_dns:default.log
12052024-02-04T18:31:48.621Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_609e4f3b-76ed-4418-bdfc-b67589deb6ce/root/var/svc/log/oxide-external_dns:default.log.0 (26948 bytes)
12062024-02-04T18:31:49.759Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_609e4f3b-76ed-4418-bdfc-b67589deb6ce/root/var/svc/log/oxide-external_dns:default.log.0
12072024-02-04T18:31:49.760Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_ccd7ef48-d06c-4d2c-83d6-be7fe852c0b5/root/var/svc/log/oxide-internal_dns:default.log (7954 bytes)
12082024-02-04T18:31:50.854Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_ccd7ef48-d06c-4d2c-83d6-be7fe852c0b5/root/var/svc/log/oxide-internal_dns:default.log
12092024-02-04T18:31:50.854Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_ccd7ef48-d06c-4d2c-83d6-be7fe852c0b5/root/var/svc/log/oxide-internal_dns:default.log.0 (110318 bytes)
12102024-02-04T18:31:52.099Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_ccd7ef48-d06c-4d2c-83d6-be7fe852c0b5/root/var/svc/log/oxide-internal_dns:default.log.0
12112024-02-04T18:31:52.126Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_43c46622-2dda-42e3-9d66-27bfc4cb8be9/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12122024-02-04T18:31:53.582Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_43c46622-2dda-42e3-9d66-27bfc4cb8be9/root/var/svc/log/oxide-cockroachdb:default.log
12132024-02-04T18:31:53.582Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_43c46622-2dda-42e3-9d66-27bfc4cb8be9/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12142024-02-04T18:31:54.683Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_43c46622-2dda-42e3-9d66-27bfc4cb8be9/root/var/svc/log/oxide-cockroachdb:default.log.0
12152024-02-04T18:31:54.683Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_43c46622-2dda-42e3-9d66-27bfc4cb8be9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12162024-02-04T18:31:55.755Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_43c46622-2dda-42e3-9d66-27bfc4cb8be9/root/var/svc/log/oxide-zone-network-setup:default.log
12172024-02-04T18:31:55.755Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_43c46622-2dda-42e3-9d66-27bfc4cb8be9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
12182024-02-04T18:31:56.851Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_43c46622-2dda-42e3-9d66-27bfc4cb8be9/root/var/svc/log/oxide-zone-network-setup:default.log.0
12192024-02-04T18:31:56.851Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-agent:default.log (21812 bytes)
12202024-02-04T18:31:58.002Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-agent:default.log
12212024-02-04T18:31:58.002Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12222024-02-04T18:31:59.101Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-agent:default.log.0
12232024-02-04T18:31:59.102Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12242024-02-04T18:32:00.174Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-downstairs:default.log
12252024-02-04T18:32:00.174Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12262024-02-04T18:32:01.270Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12272024-02-04T18:32:01.270Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-downstairs:downstairs-8f0005a4-2737-4716-812d-3bc5c674aed0.log (5537 bytes)
12282024-02-04T18:32:02.369Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-downstairs:downstairs-8f0005a4-2737-4716-812d-3bc5c674aed0.log
12292024-02-04T18:32:02.369Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-downstairs:downstairs-fbf44cad-01a3-4c17-978c-a7f4d892b8f7.log (2929 bytes)
12302024-02-04T18:32:03.469Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_209c800f-7855-4235-a339-4162be6a7023/root/var/svc/log/oxide-crucible-downstairs:downstairs-fbf44cad-01a3-4c17-978c-a7f4d892b8f7.log
12312024-02-04T18:32:03.469Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_d90bae9e-b543-42b1-9b3c-ae8997931bf6/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
12322024-02-04T18:32:04.542Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_d90bae9e-b543-42b1-9b3c-ae8997931bf6/root/var/svc/log/oxide-crucible-pantry:default.log
12332024-02-04T18:32:04.542Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_d90bae9e-b543-42b1-9b3c-ae8997931bf6/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
12342024-02-04T18:32:05.641Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_d90bae9e-b543-42b1-9b3c-ae8997931bf6/root/var/svc/log/oxide-crucible-pantry:default.log.0
12352024-02-04T18:32:05.641Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_284c9fde-0fb0-435f-86e5-c454c1fcab4f/root/var/svc/log/oxide-external_dns:default.log (3778 bytes)
12362024-02-04T18:32:05.711Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_284c9fde-0fb0-435f-86e5-c454c1fcab4f/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 3778 -> 7555
12372024-02-04T18:32:06.785Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_284c9fde-0fb0-435f-86e5-c454c1fcab4f/root/var/svc/log/oxide-external_dns:default.log
12382024-02-04T18:32:06.786Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_284c9fde-0fb0-435f-86e5-c454c1fcab4f/root/var/svc/log/oxide-external_dns:default.log.0 (26940 bytes)
12392024-02-04T18:32:07.927Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_284c9fde-0fb0-435f-86e5-c454c1fcab4f/root/var/svc/log/oxide-external_dns:default.log.0
12402024-02-04T18:32:07.951Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_9da978af-50e5-40ce-8f79-6b1fad62ed2a/root/var/svc/log/oxide-internal_dns:default.log (7951 bytes)
12412024-02-04T18:32:08.000Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_9da978af-50e5-40ce-8f79-6b1fad62ed2a/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7951 -> 11703
12422024-02-04T18:32:09.074Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_9da978af-50e5-40ce-8f79-6b1fad62ed2a/root/var/svc/log/oxide-internal_dns:default.log
12432024-02-04T18:32:09.098Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_9da978af-50e5-40ce-8f79-6b1fad62ed2a/root/var/svc/log/oxide-internal_dns:default.log.0 (116089 bytes)
12442024-02-04T18:32:10.289Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_9da978af-50e5-40ce-8f79-6b1fad62ed2a/root/var/svc/log/oxide-internal_dns:default.log.0
12452024-02-04T18:32:10.289Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e3a4cceb-e2b9-4ff0-8073-da277dc5e55f/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12462024-02-04T18:32:11.358Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e3a4cceb-e2b9-4ff0-8073-da277dc5e55f/root/var/svc/log/oxide-cockroachdb:default.log
12472024-02-04T18:32:11.359Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e3a4cceb-e2b9-4ff0-8073-da277dc5e55f/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
12482024-02-04T18:32:12.458Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e3a4cceb-e2b9-4ff0-8073-da277dc5e55f/root/var/svc/log/oxide-cockroachdb:default.log.0
12492024-02-04T18:32:12.458Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e3a4cceb-e2b9-4ff0-8073-da277dc5e55f/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12502024-02-04T18:32:13.535Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e3a4cceb-e2b9-4ff0-8073-da277dc5e55f/root/var/svc/log/oxide-zone-network-setup:default.log
12512024-02-04T18:32:13.535Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e3a4cceb-e2b9-4ff0-8073-da277dc5e55f/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
12522024-02-04T18:32:14.633Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_e3a4cceb-e2b9-4ff0-8073-da277dc5e55f/root/var/svc/log/oxide-zone-network-setup:default.log.0
12532024-02-04T18:32:14.633Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_f5bc89d8-4952-4894-a897-d79f4033483e/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12542024-02-04T18:32:15.712Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_f5bc89d8-4952-4894-a897-d79f4033483e/root/var/svc/log/oxide-crucible-agent:default.log
12552024-02-04T18:32:15.737Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_f5bc89d8-4952-4894-a897-d79f4033483e/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12562024-02-04T18:32:16.810Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_f5bc89d8-4952-4894-a897-d79f4033483e/root/var/svc/log/oxide-crucible-agent:default.log.0
12572024-02-04T18:32:16.810Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_f5bc89d8-4952-4894-a897-d79f4033483e/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12582024-02-04T18:32:17.887Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_f5bc89d8-4952-4894-a897-d79f4033483e/root/var/svc/log/oxide-crucible-downstairs:default.log
12592024-02-04T18:32:17.888Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_f5bc89d8-4952-4894-a897-d79f4033483e/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12602024-02-04T18:32:18.983Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_f5bc89d8-4952-4894-a897-d79f4033483e/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12612024-02-04T18:32:19.007Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_294d0f7f-7309-4f6b-965e-e2e6c67af5cd/root/var/svc/log/oxide-internal_dns:default.log (8790 bytes)
12622024-02-04T18:32:19.055Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_294d0f7f-7309-4f6b-965e-e2e6c67af5cd/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 8790 -> 12543
12632024-02-04T18:32:20.127Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_294d0f7f-7309-4f6b-965e-e2e6c67af5cd/root/var/svc/log/oxide-internal_dns:default.log
12642024-02-04T18:32:20.151Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_294d0f7f-7309-4f6b-965e-e2e6c67af5cd/root/var/svc/log/oxide-internal_dns:default.log.0 (109162 bytes)
12652024-02-04T18:32:21.339Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_294d0f7f-7309-4f6b-965e-e2e6c67af5cd/root/var/svc/log/oxide-internal_dns:default.log.0
12662024-02-04T18:32:21.339Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/svc/log/oxide-ntp:default.log (0 bytes)
12672024-02-04T18:32:22.409Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/svc/log/oxide-ntp:default.log
12682024-02-04T18:32:22.409Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/svc/log/oxide-ntp:default.log.0 (850 bytes)
12692024-02-04T18:32:23.511Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/svc/log/oxide-ntp:default.log.0
12702024-02-04T18:32:23.511Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e8071107-54c4-43cf-a4fb-70db96e8f74c/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12712024-02-04T18:32:24.582Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e8071107-54c4-43cf-a4fb-70db96e8f74c/root/var/svc/log/oxide-cockroachdb:default.log
12722024-02-04T18:32:24.582Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e8071107-54c4-43cf-a4fb-70db96e8f74c/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12732024-02-04T18:32:25.676Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e8071107-54c4-43cf-a4fb-70db96e8f74c/root/var/svc/log/oxide-cockroachdb:default.log.0
12742024-02-04T18:32:25.701Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e8071107-54c4-43cf-a4fb-70db96e8f74c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12752024-02-04T18:32:26.751Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e8071107-54c4-43cf-a4fb-70db96e8f74c/root/var/svc/log/oxide-zone-network-setup:default.log
12762024-02-04T18:32:26.751Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e8071107-54c4-43cf-a4fb-70db96e8f74c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
12772024-02-04T18:32:27.849Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e8071107-54c4-43cf-a4fb-70db96e8f74c/root/var/svc/log/oxide-zone-network-setup:default.log.0
12782024-02-04T18:32:27.849Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-agent:default.log (10250 bytes)
12792024-02-04T18:32:28.972Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-agent:default.log
12802024-02-04T18:32:28.973Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-agent:default.log.0 (14582 bytes)
12812024-02-04T18:32:30.091Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-agent:default.log.0
12822024-02-04T18:32:30.116Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12832024-02-04T18:32:31.163Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:default.log
12842024-02-04T18:32:31.163Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12852024-02-04T18:32:32.260Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12862024-02-04T18:32:32.260Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c0f2651-f0d3-4781-9bff-b0fe97ae508d.log (0 bytes)
12872024-02-04T18:32:33.330Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c0f2651-f0d3-4781-9bff-b0fe97ae508d.log
12882024-02-04T18:32:33.330Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c0f2651-f0d3-4781-9bff-b0fe97ae508d.log.0 (3051 bytes)
12892024-02-04T18:32:34.424Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c0f2651-f0d3-4781-9bff-b0fe97ae508d.log.0
12902024-02-04T18:32:34.424Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:downstairs-e7c839c6-1a77-49fc-8ca4-c4a0a24dd533.log (5538 bytes)
12912024-02-04T18:32:35.529Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_937edd39-4384-4a82-a99c-3f22e6c581a9/root/var/svc/log/oxide-crucible-downstairs:downstairs-e7c839c6-1a77-49fc-8ca4-c4a0a24dd533.log
12922024-02-04T18:32:35.553Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-oximeter:default.log (36891 bytes)
12932024-02-04T18:32:35.694Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 36891 -> 85300
12942024-02-04T18:32:36.767Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-oximeter:default.log
12952024-02-04T18:32:36.768Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-oximeter:default.log.0 (212543 bytes)
12962024-02-04T18:32:38.028Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-oximeter:default.log.0
12972024-02-04T18:32:38.029Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12982024-02-04T18:32:39.101Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-zone-network-setup:default.log
12992024-02-04T18:32:39.101Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes)
13002024-02-04T18:32:40.197Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_oximeter_77d82b3e-fc68-4fc7-99ae-c7df6c9287af/root/var/svc/log/oxide-zone-network-setup:default.log.0
13012024-02-04T18:32:40.197Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_dd058e98-c950-4b1d-9940-ad68d6a0e09c/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13022024-02-04T18:32:41.282Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_dd058e98-c950-4b1d-9940-ad68d6a0e09c/root/var/svc/log/oxide-cockroachdb:default.log
13032024-02-04T18:32:41.282Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_dd058e98-c950-4b1d-9940-ad68d6a0e09c/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
13042024-02-04T18:32:42.379Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_dd058e98-c950-4b1d-9940-ad68d6a0e09c/root/var/svc/log/oxide-cockroachdb:default.log.0
13052024-02-04T18:32:42.403Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_dd058e98-c950-4b1d-9940-ad68d6a0e09c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13062024-02-04T18:32:43.453Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_dd058e98-c950-4b1d-9940-ad68d6a0e09c/root/var/svc/log/oxide-zone-network-setup:default.log
13072024-02-04T18:32:43.453Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_dd058e98-c950-4b1d-9940-ad68d6a0e09c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
13082024-02-04T18:32:44.551Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_dd058e98-c950-4b1d-9940-ad68d6a0e09c/root/var/svc/log/oxide-zone-network-setup:default.log.0
13092024-02-04T18:32:44.551Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-agent:default.log (18887 bytes)
13102024-02-04T18:32:45.670Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-agent:default.log
13112024-02-04T18:32:45.670Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-agent:default.log.0 (9790 bytes)
13122024-02-04T18:32:46.790Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-agent:default.log.0
13132024-02-04T18:32:46.790Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13142024-02-04T18:32:47.866Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:default.log
13152024-02-04T18:32:47.866Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13162024-02-04T18:32:48.968Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13172024-02-04T18:32:48.969Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:downstairs-340a3223-2c66-4d5a-8f4d-cd21b7ec67fb.log (2931 bytes)
13182024-02-04T18:32:50.063Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:downstairs-340a3223-2c66-4d5a-8f4d-cd21b7ec67fb.log
13192024-02-04T18:32:50.063Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab2bf2a4-be12-44cf-adec-4504bf7fc864.log (1092 bytes)
13202024-02-04T18:32:51.164Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab2bf2a4-be12-44cf-adec-4504bf7fc864.log
13212024-02-04T18:32:51.164Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab2bf2a4-be12-44cf-adec-4504bf7fc864.log.0 (4531 bytes)
13222024-02-04T18:32:52.260Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab2bf2a4-be12-44cf-adec-4504bf7fc864.log.0
13232024-02-04T18:32:52.260Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:snapshot-ab2bf2a4-be12-44cf-adec-4504bf7fc864-a4ec9a18-f661-45e4-b717-edc4e9e22dcd.log (5158 bytes)
13242024-02-04T18:32:53.358Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_499a2009-dc25-4ac4-8d1e-a0b746adfd47/root/var/svc/log/oxide-crucible-downstairs:snapshot-ab2bf2a4-be12-44cf-adec-4504bf7fc864-a4ec9a18-f661-45e4-b717-edc4e9e22dcd.log
13252024-02-04T18:32:53.358Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_7933b61f-419e-460e-93d1-365f212ccd73/root/var/svc/log/oxide-crucible-pantry:default.log (107735 bytes)
13262024-02-04T18:32:54.568Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_7933b61f-419e-460e-93d1-365f212ccd73/root/var/svc/log/oxide-crucible-pantry:default.log
13272024-02-04T18:32:54.568Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_7933b61f-419e-460e-93d1-365f212ccd73/root/var/svc/log/oxide-crucible-pantry:default.log.0 (1118872 bytes)
13282024-02-04T18:32:55.914Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_7933b61f-419e-460e-93d1-365f212ccd73/root/var/svc/log/oxide-crucible-pantry:default.log.0
13292024-02-04T18:32:55.914Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_092d8721-ad83-4ea8-800d-5dfcaa02a610/root/var/svc/log/oxide-nexus:default.log (224548 bytes)
13302024-02-04T18:32:56.180Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_092d8721-ad83-4ea8-800d-5dfcaa02a610/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 224548 -> 457264
13312024-02-04T18:32:57.252Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_092d8721-ad83-4ea8-800d-5dfcaa02a610/root/var/svc/log/oxide-nexus:default.log
13322024-02-04T18:32:57.289Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_092d8721-ad83-4ea8-800d-5dfcaa02a610/root/var/svc/log/oxide-nexus:default.log.0 (2704298 bytes)
13332024-02-04T18:32:59.698Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_092d8721-ad83-4ea8-800d-5dfcaa02a610/root/var/svc/log/oxide-nexus:default.log.0
13342024-02-04T18:32:59.698Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-agent:default.log (5928 bytes)
13352024-02-04T18:33:00.794Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-agent:default.log
13362024-02-04T18:33:00.794Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-agent:default.log.0 (14118 bytes)
13372024-02-04T18:33:01.915Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-agent:default.log.0
13382024-02-04T18:33:01.916Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13392024-02-04T18:33:02.995Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:default.log
13402024-02-04T18:33:02.995Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13412024-02-04T18:33:04.093Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13422024-02-04T18:33:04.094Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:downstairs-598cae08-cf1c-45b4-9841-7396ca588cdd.log (2933 bytes)
13432024-02-04T18:33:05.190Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:downstairs-598cae08-cf1c-45b4-9841-7396ca588cdd.log
13442024-02-04T18:33:05.190Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:downstairs-a426e5b7-38f2-4a4e-bd38-452b6fec773e.log (0 bytes)
13452024-02-04T18:33:06.262Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:downstairs-a426e5b7-38f2-4a4e-bd38-452b6fec773e.log
13462024-02-04T18:33:06.289Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:downstairs-a426e5b7-38f2-4a4e-bd38-452b6fec773e.log.0 (3049 bytes)
13472024-02-04T18:33:07.364Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_61f65969-8cd7-442f-bf76-630442736cbe/root/var/svc/log/oxide-crucible-downstairs:downstairs-a426e5b7-38f2-4a4e-bd38-452b6fec773e.log.0
13482024-02-04T18:33:07.388Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-agent:default.log (10249 bytes)
13492024-02-04T18:33:08.489Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-agent:default.log
13502024-02-04T18:33:08.489Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-agent:default.log.0 (14114 bytes)
13512024-02-04T18:33:09.610Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-agent:default.log.0
13522024-02-04T18:33:09.610Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13532024-02-04T18:33:10.686Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:default.log
13542024-02-04T18:33:10.686Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13552024-02-04T18:33:11.783Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13562024-02-04T18:33:11.811Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4128451-9330-40e7-89fe-6f00607e54ee.log (0 bytes)
13572024-02-04T18:33:12.854Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4128451-9330-40e7-89fe-6f00607e54ee.log
13582024-02-04T18:33:12.878Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4128451-9330-40e7-89fe-6f00607e54ee.log.0 (3051 bytes)
13592024-02-04T18:33:13.948Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4128451-9330-40e7-89fe-6f00607e54ee.log.0
13602024-02-04T18:33:13.948Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:downstairs-bcd7c19b-3f37-4ea5-98d9-52ef6d854acb.log (5537 bytes)
13612024-02-04T18:33:15.044Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_972b380d-00bf-439a-b3c6-a66205c13b86/root/var/svc/log/oxide-crucible-downstairs:downstairs-bcd7c19b-3f37-4ea5-98d9-52ef6d854acb.log
13622024-02-04T18:33:15.069Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_843a6ef2-d51e-4408-ad23-918c99a52641/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13632024-02-04T18:33:16.112Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_843a6ef2-d51e-4408-ad23-918c99a52641/root/var/svc/log/oxide-crucible-pantry:default.log
13642024-02-04T18:33:16.112Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_843a6ef2-d51e-4408-ad23-918c99a52641/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2333 bytes)
13652024-02-04T18:33:17.206Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_843a6ef2-d51e-4408-ad23-918c99a52641/root/var/svc/log/oxide-crucible-pantry:default.log.0
13662024-02-04T18:33:17.235Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_19134b89-1d02-4f2f-b337-66e8f13e14d6/root/var/svc/log/oxide-nexus:default.log (114017 bytes)
13672024-02-04T18:33:17.438Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_19134b89-1d02-4f2f-b337-66e8f13e14d6/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 114017 -> 349755
13682024-02-04T18:33:18.510Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_19134b89-1d02-4f2f-b337-66e8f13e14d6/root/var/svc/log/oxide-nexus:default.log
13692024-02-04T18:33:18.510Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_19134b89-1d02-4f2f-b337-66e8f13e14d6/root/var/svc/log/oxide-nexus:default.log.0 (1026713 bytes)
13702024-02-04T18:33:19.850Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_19134b89-1d02-4f2f-b337-66e8f13e14d6/root/var/svc/log/oxide-nexus:default.log.0
13712024-02-04T18:33:19.850Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_66f78273-3756-4a21-9015-8086e86c069d/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13722024-02-04T18:33:20.922Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_66f78273-3756-4a21-9015-8086e86c069d/root/var/svc/log/oxide-crucible-agent:default.log
13732024-02-04T18:33:20.922Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_66f78273-3756-4a21-9015-8086e86c069d/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13742024-02-04T18:33:22.019Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_66f78273-3756-4a21-9015-8086e86c069d/root/var/svc/log/oxide-crucible-agent:default.log.0
13752024-02-04T18:33:22.044Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_66f78273-3756-4a21-9015-8086e86c069d/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13762024-02-04T18:33:23.091Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_66f78273-3756-4a21-9015-8086e86c069d/root/var/svc/log/oxide-crucible-downstairs:default.log
13772024-02-04T18:33:23.091Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_66f78273-3756-4a21-9015-8086e86c069d/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13782024-02-04T18:33:24.185Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_66f78273-3756-4a21-9015-8086e86c069d/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13792024-02-04T18:33:24.210Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-agent:default.log (10360 bytes)
13802024-02-04T18:33:25.422Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-agent:default.log
13812024-02-04T18:33:25.422Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-agent:default.log.0 (9793 bytes)
13822024-02-04T18:33:26.538Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-agent:default.log.0
13832024-02-04T18:33:26.538Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13842024-02-04T18:33:27.609Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:default.log
13852024-02-04T18:33:27.609Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13862024-02-04T18:33:28.703Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13872024-02-04T18:33:28.737Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f9d699c-200c-4664-9b25-d717833005a1.log (1092 bytes)
13882024-02-04T18:33:29.798Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f9d699c-200c-4664-9b25-d717833005a1.log
13892024-02-04T18:33:29.798Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f9d699c-200c-4664-9b25-d717833005a1.log.0 (4529 bytes)
13902024-02-04T18:33:30.893Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f9d699c-200c-4664-9b25-d717833005a1.log.0
13912024-02-04T18:33:30.893Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:snapshot-3f9d699c-200c-4664-9b25-d717833005a1-a4ec9a18-f661-45e4-b717-edc4e9e22dcd.log (5159 bytes)
13922024-02-04T18:33:31.988Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_da3cb22e-e9ae-409e-92e0-f8fa4fda1e68/root/var/svc/log/oxide-crucible-downstairs:snapshot-3f9d699c-200c-4664-9b25-d717833005a1-a4ec9a18-f661-45e4-b717-edc4e9e22dcd.log
13932024-02-04T18:33:31.988Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_c4e7e840-7a4c-4522-b3ec-9d7ef373a682/root/var/svc/log/oxide-nexus:default.log (4342310 bytes)
13942024-02-04T18:33:34.792Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_c4e7e840-7a4c-4522-b3ec-9d7ef373a682/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 4342310 -> 4597562
13952024-02-04T18:33:35.863Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_c4e7e840-7a4c-4522-b3ec-9d7ef373a682/root/var/svc/log/oxide-nexus:default.log
13962024-02-04T18:33:35.863Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_c4e7e840-7a4c-4522-b3ec-9d7ef373a682/root/var/svc/log/oxide-nexus:default.log.0 (30192911 bytes)
13972024-02-04T18:33:49.759Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_c4e7e840-7a4c-4522-b3ec-9d7ef373a682/root/var/svc/log/oxide-nexus:default.log.0
13982024-02-04T18:33:49.760Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/measurements.log (19728 bytes)
13992024-02-04T18:33:49.852Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/measurements.log" changed size mid upload: 19728 -> 25208
14002024-02-04T18:33:50.926Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/measurements.log
14012024-02-04T18:33:50.926Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/statistics.log (11583 bytes)
14022024-02-04T18:33:51.014Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/statistics.log" changed size mid upload: 11583 -> 16029
14032024-02-04T18:33:52.084Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/statistics.log
14042024-02-04T18:33:52.084Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/tracking.log (1851 bytes)
14052024-02-04T18:33:52.134Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/tracking.log" changed size mid upload: 1851 -> 2247
14062024-02-04T18:33:53.201Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_e21e60a7-ea67-4592-8fb7-91e303d7df23/root/var/log/chrony/tracking.log