01HPMV7W8YH51DDZRWVZ0YWZXA: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HPMV97WWG3FE34BHCTDDBS9Z

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-14T22:57:57.203Zjob dependencies complete; ready to run (waiting for 37 m 53 s)
22024-02-14T23:54:34.770Zjob assigned to worker 01HPN0FS9Y6RQ2RKFMV2C5W9MN (queued for 56 m 37 s)
32024-02-14T23:54:34.932Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-02-14T23:54:34.980Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-02-14T23:54:35.015Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... 44%Error: No response to keepalive - Terminating session
62024-02-14T23:54:35.048ZError: No response de-activating SOL payload
72024-02-14T23:54:35.082Z[SOL Session operational. Use ~? for help]
82024-02-14T23:54:35.115Z ok
92024-02-14T23:54:35.160Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
102024-02-14T23:54:35.205Zhttp://172.20.0.5:9969/postboot/sock... ok
112024-02-14T23:54:35.247ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
122024-02-14T23:54:35.729Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
132024-02-14T23:54:35.775ZOxide Helios Version helios-2.0.22451 64-bit
142024-02-14T23:54:35.845ZConfiguring devices.
152024-02-14T23:54:35.886Z##################################################
162024-02-14T23:54:35.929Z#### ############# ##
172024-02-14T23:54:35.963Z### ### ############ ##
182024-02-14T23:54:35.995Z## ### # ## ### ## Oxide Computer Company ##
192024-02-14T23:54:36.040Z## ## ## ### # ### ##
202024-02-14T23:54:36.073Z## # ### #### #### This Station Under ##
212024-02-14T23:54:36.106Z### ### #### # ### Computer Control ##
222024-02-14T23:54:36.150Z#### #### ### ## ##
232024-02-14T23:54:36.213Z##################################################
242024-02-14T23:54:36.282ZHostname: sock
252024-02-14T23:54:36.318ZLoading smf(7) service descriptions:
262024-02-14T23:54:43.834Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-814497ffe476019b.gz
272024-02-14T23:54:46.741Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-814497ffe476019b.gz
282024-02-14T23:54:46.765Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
292024-02-14T23:55:21.654Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
302024-02-14T23:55:21.654Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7c7bf8ffe79eb016.gz
312024-02-14T23:56:02.558Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7c7bf8ffe79eb016.gz
322024-02-14T23:56:02.559Zdownloading input: /input/ci-tools/work/caboose-util.gz
332024-02-14T23:56:03.631Zdownloaded input: /input/ci-tools/work/caboose-util.gz
342024-02-14T23:56:03.631Zdownloading input: /input/ci-tools/work/tufaceous.gz
352024-02-14T23:56:08.998Zdownloaded input: /input/ci-tools/work/tufaceous.gz
362024-02-14T23:56:09.025Zdownloading input: /input/package/work/version.txt
372024-02-14T23:56:09.051Zdownloaded input: /input/package/work/version.txt
382024-02-14T23:56:09.051Zdownloading input: /input/package/work/package.tar.gz
392024-02-14T23:56:28.119Zdownloaded input: /input/package/work/package.tar.gz
402024-02-14T23:56:28.119Zdownloading input: /input/package/work/global-zone-packages.tar.gz
412024-02-14T23:56:37.546Zsock console login: Error: No response to keepalive - Terminating session
422024-02-14T23:56:47.682ZError: No response de-activating SOL payload
432024-02-14T23:56:48.776Z[SOL Session operational. Use ~? for help]
442024-02-14T23:57:06.531Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
452024-02-14T23:57:06.531Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
462024-02-14T23:57:17.452Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
472024-02-14T23:57:17.476Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
482024-02-14T23:58:01.100Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
492024-02-14T23:58:01.127Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
502024-02-14T23:58:51.323Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
512024-02-14T23:58:51.355Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
522024-02-14T23:59:28.238Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
532024-02-14T23:59:28.238Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
542024-02-14T23:59:31.310Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
552024-02-14T23:59:31.311Zdownloading input: /input/package/work/zones/crucible.tar.gz
562024-02-14T23:59:37.541ZError: No response to keepalive - Terminating session
572024-02-14T23:59:37.957Zdownloaded input: /input/package/work/zones/crucible.tar.gz
582024-02-14T23:59:37.957Zdownloading input: /input/package/work/zones/external-dns.tar.gz
592024-02-14T23:59:45.514Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
602024-02-14T23:59:45.514Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
612024-02-14T23:59:47.666ZError: No response de-activating SOL payload
622024-02-14T23:59:48.785Z[SOL Session operational. Use ~? for help]
632024-02-14T23:59:51.723Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
642024-02-14T23:59:51.749Zdownloading input: /input/package/work/zones/ntp.tar.gz
652024-02-14T23:59:51.774Zdownloaded input: /input/package/work/zones/ntp.tar.gz
662024-02-14T23:59:51.775Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
672024-02-14T23:59:55.609Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
682024-02-14T23:59:55.609Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
692024-02-15T00:00:01.552Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
702024-02-15T00:00:01.552Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
712024-02-15T00:00:30.686Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
722024-02-15T00:00:30.686Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
732024-02-15T00:00:48.164Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
742024-02-15T00:00:48.212Zdownloading input: /input/package/work/zones/overlay.tar.gz
752024-02-15T00:00:48.661Zdownloaded input: /input/package/work/zones/overlay.tar.gz
762024-02-15T00:00:48.661Zdownloading input: /input/package/work/zones/oximeter.tar.gz
772024-02-15T00:01:00.343Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
782024-02-15T00:01:00.343Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
792024-02-15T00:01:22.980Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
802024-02-15T00:01:23.004Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
812024-02-15T00:02:31.908Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
822024-02-15T00:02:31.908Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
832024-02-15T00:02:53.602ZError: No response to keepalive - Terminating session
842024-02-15T00:03:03.701ZError: No response de-activating SOL payload
852024-02-15T00:03:04.801Z[SOL Session operational. Use ~? for help]
862024-02-15T00:03:40.824Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
872024-02-15T00:03:40.824Zstarting task 0: "setup"
882024-02-15T00:03:40.871Z++ uname -s
892024-02-15T00:03:40.871Z+ kern=SunOS
902024-02-15T00:03:40.871Z+ case "$kern" in
912024-02-15T00:03:40.872Z+ groupadd -g 12345 build
922024-02-15T00:03:40.872Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
932024-02-15T00:03:42.814Z+ zfs create -o mountpoint=/work rpool/work
942024-02-15T00:03:42.840Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
952024-02-15T00:03:42.840Z+ home_fs=zfs
962024-02-15T00:03:42.840Z+ [[ zfs == autofs ]]
972024-02-15T00:03:42.840Z+ mkdir -p /home/build
982024-02-15T00:03:42.840Z+ chown build:build /home/build /work
992024-02-15T00:03:44.838Z+ chmod 0700 /home/build /work
1002024-02-15T00:03:44.863Zprocess exited: duration 4045 ms, exit code 0
 
1012024-02-15T00:03:44.913Zstarting task 1: "authentication"
1022024-02-15T00:03:44.963Zprocess exited: duration 44 ms, exit code 0
 
1032024-02-15T00:03:45.021Zstarting task 2: "build"
1042024-02-15T00:03:45.485Z+ trap _exit_trap EXIT
1052024-02-15T00:03:45.485Z+ set +x
1062024-02-15T00:04:24.218Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1072024-02-15T00:04:24.459Zsecpolicy_fs_linkdir: 0x55 = 0x55
1082024-02-15T00:04:24.459Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1092024-02-15T00:04:24.459Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1102024-02-15T00:04:24.459Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1112024-02-15T00:04:24.486Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1122024-02-15T00:04:24.486Zsecpolicy_fs_linkdir+5: 0 = 0x1
1132024-02-15T00:04:24.486Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1142024-02-15T00:04:24.486Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1152024-02-15T00:04:24.486Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1162024-02-15T00:04:24.486Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1172024-02-15T00:04:24.486Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1182024-02-15T00:04:24.486Z+ [[ -d /opt/oxide ]]
1192024-02-15T00:04:24.486Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1202024-02-15T00:04:24.486Z+ pfexec mkdir /opt/oxide
1212024-02-15T00:04:24.486Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1222024-02-15T00:04:24.487Z+ [[ -d /opt/oxide-underneath ]]
1232024-02-15T00:04:24.487Z+ cd /opt/oxide-underneath
1242024-02-15T00:04:24.487Z+ pfexec tar ceEp@/f - .
1252024-02-15T00:04:24.487Z+ cd /opt/oxide
1262024-02-15T00:04:24.487Z+ pfexec tar xveEp@/f -
1272024-02-15T00:04:24.523Zx ., 0 bytes, 0 tape blocks
1282024-02-15T00:04:24.523Zx ./opte, 0 bytes, 0 tape blocks
1292024-02-15T00:04:24.523Zx ./opte/bin, 0 bytes, 0 tape blocks
1302024-02-15T00:04:24.523Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1312024-02-15T00:04:24.523Z+ pfexec rm -rf /opt/oxide-underneath
1322024-02-15T00:04:24.556Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1332024-02-15T00:04:24.581Z+ pfexec mkdir /opt/oxide/work
1342024-02-15T00:04:24.582Z+ pfexec chown build:build /opt/oxide/work
1352024-02-15T00:04:24.582Z+ cd /opt/oxide/work
1362024-02-15T00:04:24.582Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1372024-02-15T00:04:26.273ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1382024-02-15T00:04:26.273Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1392024-02-15T00:04:26.273Zx out/omicron-sled-agent.tar, 122801664 bytes, 239847 tape blocks
1402024-02-15T00:04:26.273Zx out/oxlog.tar, 8382464 bytes, 16372 tape blocks
1412024-02-15T00:04:26.273Zx out/target/test, 75 bytes, 1 tape blocks
1422024-02-15T00:04:26.273Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1432024-02-15T00:04:26.273Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1442024-02-15T00:04:26.273Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1452024-02-15T00:04:26.273Zx target/release/omicron-package, 45717632 bytes, 89293 tape blocks
1462024-02-15T00:04:26.273Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1472024-02-15T00:04:26.273Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1482024-02-15T00:04:26.273Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1492024-02-15T00:04:26.274Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1502024-02-15T00:04:26.274Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1512024-02-15T00:04:26.274Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1522024-02-15T00:04:26.274Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1532024-02-15T00:04:26.721Z
1542024-02-15T00:04:26.721Zreal 1.712418819
1552024-02-15T00:04:26.721Zuser 1.539253556
1562024-02-15T00:04:26.721Zsys 0.309159040
1572024-02-15T00:04:26.721Ztrap 0.000070169
1582024-02-15T00:04:26.721Ztflt 0.000000000
1592024-02-15T00:04:26.721Zdflt 0.000000000
1602024-02-15T00:04:26.721Zkflt 0.000000000
1612024-02-15T00:04:26.722Zlock 0.000000000
1622024-02-15T00:04:26.722Zslp 1.537559110
1632024-02-15T00:04:26.722Zlat 0.036744606
1642024-02-15T00:04:26.722Zstop 0.000127853
1652024-02-15T00:04:26.722Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1662024-02-15T00:04:27.466Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1672024-02-15T00:04:27.491Z+ mkdir tests
1682024-02-15T00:04:27.491Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1692024-02-15T00:04:27.491Z+ ptime -m gunzip
1702024-02-15T00:04:27.491Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-814497ffe476019b
1712024-02-15T00:04:27.760Z
1722024-02-15T00:04:27.812Zreal 0.230189429
1732024-02-15T00:04:27.812Zuser 0.214193972
1742024-02-15T00:04:27.813Zsys 0.015749391
1752024-02-15T00:04:27.813Ztrap 0.000018130
1762024-02-15T00:04:27.813Ztflt 0.000000000
1772024-02-15T00:04:27.813Zdflt 0.000000000
1782024-02-15T00:04:27.813Zkflt 0.000000000
1792024-02-15T00:04:27.813Zlock 0.000000000
1802024-02-15T00:04:27.813Zslp 0.000023430
1812024-02-15T00:04:27.813Zlat 0.000016320
1822024-02-15T00:04:27.813Zstop 0.000120442
1832024-02-15T00:04:27.813Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-814497ffe476019b
1842024-02-15T00:04:27.813Z+ chmod a+x tests/bootstrap-814497ffe476019b
1852024-02-15T00:04:27.813Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1862024-02-15T00:04:27.813Z+ ptime -m gunzip
1872024-02-15T00:04:27.813Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1882024-02-15T00:04:30.250Z
1892024-02-15T00:04:30.276Zreal 2.517173863
1902024-02-15T00:04:30.276Zuser 2.366764817
1912024-02-15T00:04:30.277Zsys 0.149975354
1922024-02-15T00:04:30.277Ztrap 0.000200425
1932024-02-15T00:04:30.277Ztflt 0.000000000
1942024-02-15T00:04:30.277Zdflt 0.000000000
1952024-02-15T00:04:30.277Zkflt 0.000000000
1962024-02-15T00:04:30.277Zlock 0.000000000
1972024-02-15T00:04:30.277Zslp 0.000020880
1982024-02-15T00:04:30.277Zlat 0.000024090
1992024-02-15T00:04:30.277Zstop 0.000130322
2002024-02-15T00:04:30.277Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
2012024-02-15T00:04:30.278Z+ chmod a+x tests/bootstrap
2022024-02-15T00:04:30.278Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2032024-02-15T00:04:30.278Z+ ptime -m gunzip
2042024-02-15T00:04:30.278Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7c7bf8ffe79eb016
2052024-02-15T00:04:32.816Z
2062024-02-15T00:04:32.841Zreal 2.551251982
2072024-02-15T00:04:32.841Zuser 2.400137873
2082024-02-15T00:04:32.841Zsys 0.150667158
2092024-02-15T00:04:32.841Ztrap 0.000197765
2102024-02-15T00:04:32.841Ztflt 0.000000000
2112024-02-15T00:04:32.842Zdflt 0.000000000
2122024-02-15T00:04:32.842Zkflt 0.000000000
2132024-02-15T00:04:32.842Zlock 0.000000000
2142024-02-15T00:04:32.842Zslp 0.000021040
2152024-02-15T00:04:32.842Zlat 0.000041200
2162024-02-15T00:04:32.842Zstop 0.000127572
2172024-02-15T00:04:32.842Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7c7bf8ffe79eb016
2182024-02-15T00:04:32.842Z+ chmod a+x tests/end_to_end_tests-7c7bf8ffe79eb016
2192024-02-15T00:04:32.842Z+ bmat address ls
2202024-02-15T00:04:32.842ZNAME CIDR FIRST LAST COUNT
2212024-02-15T00:04:32.842Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2222024-02-15T00:04:32.842Z++ bmat address ls -f extra -Ho first,last,count
2232024-02-15T00:04:32.842Z+ set -- 10.151.2.164 10.151.2.227 64
2242024-02-15T00:04:32.843Z+ EXTRA_IP_START=10.151.2.164
2252024-02-15T00:04:32.843Z+ EXTRA_IP_END=10.151.2.227
2262024-02-15T00:04:32.843Z+ EXTRA_IP_COUNT=64
2272024-02-15T00:04:32.843Z+ (( EXTRA_IP_COUNT >= 32 ))
2282024-02-15T00:04:32.843Z+ EXTRA_IP_BASE=10.151.2
2292024-02-15T00:04:32.843Z+ EXTRA_IP_FOCTET=164
2302024-02-15T00:04:32.843Z+ EXTRA_IP_LOCTET=227
2312024-02-15T00:04:32.843Z+ SERVICE_IP_POOL_START=10.151.2.164
2322024-02-15T00:04:32.843Z+ SERVICE_IP_POOL_END=10.151.2.173
2332024-02-15T00:04:32.843Z+ DNS_IP1=10.151.2.164
2342024-02-15T00:04:32.843Z+ DNS_IP2=10.151.2.165
2352024-02-15T00:04:32.843Z+ UPLINK_IP=10.151.2.174
2362024-02-15T00:04:32.843Z+ IPPOOL_START=10.151.2.175
2372024-02-15T00:04:32.843Z+ IPPOOL_END=10.151.2.227
2382024-02-15T00:04:32.843Z++ ipadm show-addr -po type,addr
2392024-02-15T00:04:32.868Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2402024-02-15T00:04:32.868Z+ GATEWAY_IP=10.151.2.100
2412024-02-15T00:04:32.868Z+ [[ -n 10.151.2.100 ]]
2422024-02-15T00:04:32.868Z+ ping -s 10.151.2.100 56 1
2432024-02-15T00:04:32.869ZPING 10.151.2.100: 56 data bytes
2442024-02-15T00:04:32.869Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
2452024-02-15T00:04:32.869Z
2462024-02-15T00:04:32.869Z----10.151.2.100 PING Statistics----
2472024-02-15T00:04:32.869Z1 packets transmitted, 1 packets received, 0% packet loss
2482024-02-15T00:04:32.869Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2492024-02-15T00:04:32.869Z++ arp -an
2502024-02-15T00:04:32.869Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2512024-02-15T00:04:32.869Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2522024-02-15T00:04:32.869Z+ routeadm -e ipv4-forwarding -u
2532024-02-15T00:04:32.976Z+ PXA_START=10.151.2.164
2542024-02-15T00:04:32.976Z+ PXA_END=10.151.2.227
2552024-02-15T00:04:33.008Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2562024-02-15T00:04:33.009Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2572024-02-15T00:04:33.175Z+ ZPOOL_VDEV_DIR=/scratch
2582024-02-15T00:04:33.175Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2592024-02-15T00:04:33.202Z+++ dirname ./tools/create_virtual_hardware.sh
2602024-02-15T00:04:33.202Z++ cd ./tools
2612024-02-15T00:04:33.202Z++ pwd
2622024-02-15T00:04:33.202Z+ SOURCE_DIR=/opt/oxide/work/tools
2632024-02-15T00:04:33.202Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2642024-02-15T00:04:33.202Z+ SOFTNPU_MODE=zone
2652024-02-15T00:04:33.202Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2662024-02-15T00:04:33.202Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2672024-02-15T00:04:33.202Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2682024-02-15T00:04:33.203Z++ dladm show-phys -p -o LINK
2692024-02-15T00:04:33.203Z++ head -1
2702024-02-15T00:04:33.203Z+ PHYSICAL_LINK=igb0
2712024-02-15T00:04:33.203Z+ echo 'Using igb0 as physical link'
2722024-02-15T00:04:33.231ZUsing igb0 as physical link
2732024-02-15T00:04:33.233Z+ ensure_run_as_root
2742024-02-15T00:04:33.234Z++ id -u
2752024-02-15T00:04:33.234Z+ [[ 0 -ne 0 ]]
2762024-02-15T00:04:33.234Z+ ensure_zpools
2772024-02-15T00:04:33.235Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2782024-02-15T00:04:33.235Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2792024-02-15T00:04:33.235Z+ readarray -t ZPOOLS
2802024-02-15T00:04:33.235Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2812024-02-15T00:04:33.236Z++ sed 's/[ ",]//g'
2822024-02-15T00:04:33.236Z+ for ZPOOL in "${ZPOOLS[@]}"
2832024-02-15T00:04:33.236Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2842024-02-15T00:04:33.236ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2852024-02-15T00:04:33.237Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-15T00:04:33.237Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2872024-02-15T00:04:33.237Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2882024-02-15T00:04:33.237Z0+0 records in
2892024-02-15T00:04:33.237Z0+0 records out
2902024-02-15T00:04:33.238Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2912024-02-15T00:04:33.238Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2922024-02-15T00:04:33.238Z+ set +x
2932024-02-15T00:04:33.238ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2942024-02-15T00:04:33.238Z++ zpool list -o name
2952024-02-15T00:04:33.238Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2962024-02-15T00:04:33.239Z+ [[ -z '' ]]
2972024-02-15T00:04:33.239Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2982024-02-15T00:04:33.810Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2992024-02-15T00:04:33.810Z+ set +x
3002024-02-15T00:04:33.810ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3012024-02-15T00:04:33.810Z+ for ZPOOL in "${ZPOOLS[@]}"
3022024-02-15T00:04:33.810Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3032024-02-15T00:04:33.810ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3042024-02-15T00:04:33.810Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-15T00:04:33.810Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3062024-02-15T00:04:33.810Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3072024-02-15T00:04:33.810Z0+0 records in
3082024-02-15T00:04:33.811Z0+0 records out
3092024-02-15T00:04:33.811Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3102024-02-15T00:04:33.811Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3112024-02-15T00:04:33.811Z+ set +x
3122024-02-15T00:04:33.811ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3132024-02-15T00:04:33.811Z++ zpool list -o name
3142024-02-15T00:04:33.811Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3152024-02-15T00:04:33.811Z+ [[ -z '' ]]
3162024-02-15T00:04:33.811Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3172024-02-15T00:04:33.811Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3182024-02-15T00:04:33.811ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3192024-02-15T00:04:33.812Z+ set +x
3202024-02-15T00:04:33.812Z+ for ZPOOL in "${ZPOOLS[@]}"
3212024-02-15T00:04:33.812Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3222024-02-15T00:04:33.812Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3232024-02-15T00:04:33.812ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3242024-02-15T00:04:33.812Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3252024-02-15T00:04:33.812Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3262024-02-15T00:04:33.812Z0+0 records in
3272024-02-15T00:04:33.812Z0+0 records out
3282024-02-15T00:04:33.812Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3292024-02-15T00:04:33.812Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3302024-02-15T00:04:33.812Z+ set +x
3312024-02-15T00:04:33.813ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3322024-02-15T00:04:33.813Z++ zpool list -o name
3332024-02-15T00:04:33.813Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3342024-02-15T00:04:33.813Z+ [[ -z '' ]]
3352024-02-15T00:04:33.813Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3362024-02-15T00:04:33.813Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3372024-02-15T00:04:33.813Z+ set +x
3382024-02-15T00:04:33.813ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3392024-02-15T00:04:33.813Z+ for ZPOOL in "${ZPOOLS[@]}"
3402024-02-15T00:04:33.813ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3412024-02-15T00:04:33.813Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3422024-02-15T00:04:33.813Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-15T00:04:33.813Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3442024-02-15T00:04:33.813Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3452024-02-15T00:04:33.813Z0+0 records in
3462024-02-15T00:04:33.813Z0+0 records out
3472024-02-15T00:04:33.813Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3482024-02-15T00:04:33.813Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3492024-02-15T00:04:33.813Z+ set +x
3502024-02-15T00:04:33.814ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3512024-02-15T00:04:33.814Z++ zpool list -o name
3522024-02-15T00:04:33.814Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3532024-02-15T00:04:33.814Z+ [[ -z '' ]]
3542024-02-15T00:04:33.814Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3552024-02-15T00:04:33.814Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3562024-02-15T00:04:33.814Z+ set +x
3572024-02-15T00:04:33.814ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3582024-02-15T00:04:33.814Z+ for ZPOOL in "${ZPOOLS[@]}"
3592024-02-15T00:04:33.814Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3602024-02-15T00:04:33.814ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3612024-02-15T00:04:33.814Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-15T00:04:33.814Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3632024-02-15T00:04:33.814Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3642024-02-15T00:04:33.814Z0+0 records in
3652024-02-15T00:04:33.814Z0+0 records out
3662024-02-15T00:04:33.814Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3672024-02-15T00:04:33.814Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3682024-02-15T00:04:33.814Z+ set +x
3692024-02-15T00:04:33.814ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3702024-02-15T00:04:33.814Z++ zpool list -o name
3712024-02-15T00:04:33.814Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3722024-02-15T00:04:33.814Z+ [[ -z '' ]]
3732024-02-15T00:04:33.815Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3742024-02-15T00:04:33.815Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3752024-02-15T00:04:33.815Z+ set +x
3762024-02-15T00:04:33.815ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3772024-02-15T00:04:33.815Z+ for ZPOOL in "${ZPOOLS[@]}"
3782024-02-15T00:04:33.815Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3792024-02-15T00:04:33.815ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3802024-02-15T00:04:33.815Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-15T00:04:33.815Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3822024-02-15T00:04:33.815Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3832024-02-15T00:04:33.815Z0+0 records in
3842024-02-15T00:04:33.815Z0+0 records out
3852024-02-15T00:04:33.815Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3862024-02-15T00:04:33.815Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3872024-02-15T00:04:33.815Z+ set +x
3882024-02-15T00:04:33.815ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3892024-02-15T00:04:33.815Z++ zpool list -o name
3902024-02-15T00:04:33.815Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3912024-02-15T00:04:33.815Z+ [[ -z '' ]]
3922024-02-15T00:04:33.815Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3932024-02-15T00:04:33.815Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3942024-02-15T00:04:33.815Z+ set +x
3952024-02-15T00:04:33.815ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3962024-02-15T00:04:33.815Z+ for ZPOOL in "${ZPOOLS[@]}"
3972024-02-15T00:04:33.815Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3982024-02-15T00:04:33.887ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3992024-02-15T00:04:33.887Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-15T00:04:33.887Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
4012024-02-15T00:04:33.887Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
4022024-02-15T00:04:33.887Z0+0 records in
4032024-02-15T00:04:33.887Z0+0 records out
4042024-02-15T00:04:33.887Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4052024-02-15T00:04:33.887Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4062024-02-15T00:04:33.887Z+ set +x
4072024-02-15T00:04:33.887ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
4082024-02-15T00:04:33.887Z++ zpool list -o name
4092024-02-15T00:04:33.887Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4102024-02-15T00:04:33.888Z+ [[ -z '' ]]
4112024-02-15T00:04:33.888Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4122024-02-15T00:04:33.888Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4132024-02-15T00:04:33.888Z+ set +x
4142024-02-15T00:04:33.888ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4152024-02-15T00:04:33.888Z+ for ZPOOL in "${ZPOOLS[@]}"
4162024-02-15T00:04:33.888Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4172024-02-15T00:04:33.888ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4182024-02-15T00:04:33.888Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-15T00:04:33.888Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4202024-02-15T00:04:33.888Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4212024-02-15T00:04:33.888Z0+0 records in
4222024-02-15T00:04:33.889Z0+0 records out
4232024-02-15T00:04:33.889Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4242024-02-15T00:04:33.889Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4252024-02-15T00:04:33.889Z+ set +x
4262024-02-15T00:04:33.889ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4272024-02-15T00:04:33.889Z++ zpool list -o name
4282024-02-15T00:04:33.889Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4292024-02-15T00:04:33.889Z+ [[ -z '' ]]
4302024-02-15T00:04:33.890Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4312024-02-15T00:04:33.890Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4322024-02-15T00:04:33.890Z+ set +x
4332024-02-15T00:04:33.890ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4342024-02-15T00:04:33.890Z+ for ZPOOL in "${ZPOOLS[@]}"
4352024-02-15T00:04:33.890Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4362024-02-15T00:04:33.890ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4372024-02-15T00:04:33.890Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-15T00:04:33.890Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4392024-02-15T00:04:33.890Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4402024-02-15T00:04:33.890Z0+0 records in
4412024-02-15T00:04:33.891Z0+0 records out
4422024-02-15T00:04:33.891Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4432024-02-15T00:04:33.891Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4442024-02-15T00:04:33.891Z+ set +x
4452024-02-15T00:04:33.891ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4462024-02-15T00:04:33.891Z++ zpool list -o name
4472024-02-15T00:04:33.891Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4482024-02-15T00:04:33.891Z+ [[ -z '' ]]
4492024-02-15T00:04:33.891Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4502024-02-15T00:04:33.891Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4512024-02-15T00:04:33.891Z+ set +x
4522024-02-15T00:04:33.891ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4532024-02-15T00:04:33.891Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4542024-02-15T00:04:33.892Z+ readarray -t ZPOOLS
4552024-02-15T00:04:33.892Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4562024-02-15T00:04:33.892Z++ sed 's/[ ",]//g'
4572024-02-15T00:04:33.892Z+ for ZPOOL in "${ZPOOLS[@]}"
4582024-02-15T00:04:33.892Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4592024-02-15T00:04:33.892ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4602024-02-15T00:04:33.892Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-15T00:04:33.892Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4622024-02-15T00:04:33.892Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4632024-02-15T00:04:33.892Z0+0 records in
4642024-02-15T00:04:33.892Z0+0 records out
4652024-02-15T00:04:33.892Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4662024-02-15T00:04:33.892Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4672024-02-15T00:04:33.892Z+ set +x
4682024-02-15T00:04:33.892ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4692024-02-15T00:04:33.893Z++ zpool list -o name
4702024-02-15T00:04:33.893Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4712024-02-15T00:04:33.893Z+ [[ -z '' ]]
4722024-02-15T00:04:33.893Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4732024-02-15T00:04:33.893Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4742024-02-15T00:04:33.893Z+ set +x
4752024-02-15T00:04:33.893ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4762024-02-15T00:04:33.893Z+ for ZPOOL in "${ZPOOLS[@]}"
4772024-02-15T00:04:33.893Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4782024-02-15T00:04:33.893ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4792024-02-15T00:04:33.893Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-15T00:04:33.893Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4812024-02-15T00:04:33.893Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4822024-02-15T00:04:33.893Z0+0 records in
4832024-02-15T00:04:33.893Z0+0 records out
4842024-02-15T00:04:33.893Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4852024-02-15T00:04:33.894Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4862024-02-15T00:04:33.894Z+ set +x
4872024-02-15T00:04:33.894ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4882024-02-15T00:04:33.894Z++ zpool list -o name
4892024-02-15T00:04:33.894Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4902024-02-15T00:04:33.894Z+ [[ -z '' ]]
4912024-02-15T00:04:33.894Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4922024-02-15T00:04:33.894Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4932024-02-15T00:04:33.894Z+ set +x
4942024-02-15T00:04:33.894ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4952024-02-15T00:04:33.894Z+ [[ zone == \z\o\n\e ]]
4962024-02-15T00:04:33.894Z+ ensure_simulated_links igb0
4972024-02-15T00:04:33.895Z+ local PHYSICAL_LINK=igb0
4982024-02-15T00:04:33.921Z+ INDICES=("0" "1")
4992024-02-15T00:04:33.921Z+ for I in "${INDICES[@]}"
5002024-02-15T00:04:33.921Z++ get_simnet_name_if_exists net0
5012024-02-15T00:04:33.921Z++ dladm show-simnet -p -o LINK net0
5022024-02-15T00:04:33.921Z++ echo ''
5032024-02-15T00:04:33.921Z+ [[ -z '' ]]
5042024-02-15T00:04:33.922Z+ dladm create-simnet -t net0
5052024-02-15T00:04:33.922Z+ dladm create-simnet -t sc0_0
5062024-02-15T00:04:33.922Z+ dladm modify-simnet -t -p net0 sc0_0
5072024-02-15T00:04:33.922Z+ dladm set-linkprop -p mtu=9000 sc0_0
5082024-02-15T00:04:33.922Z+ success 'Simnet net0/sc0_0 exists'
5092024-02-15T00:04:33.922Z+ set +x
5102024-02-15T00:04:33.922ZSimnet net0/sc0_0 exists
5112024-02-15T00:04:33.922Z+ for I in "${INDICES[@]}"
5122024-02-15T00:04:33.922Z++ get_simnet_name_if_exists net1
5132024-02-15T00:04:33.922Z++ dladm show-simnet -p -o LINK net1
5142024-02-15T00:04:33.922Z++ echo ''
5152024-02-15T00:04:33.922Z+ [[ -z '' ]]
5162024-02-15T00:04:33.922Z+ dladm create-simnet -t net1
5172024-02-15T00:04:33.922Z+ dladm create-simnet -t sc1_0
5182024-02-15T00:04:33.922Z+ dladm modify-simnet -t -p net1 sc1_0
5192024-02-15T00:04:33.922Z+ dladm set-linkprop -p mtu=9000 sc1_0
5202024-02-15T00:04:33.922Z+ success 'Simnet net1/sc1_0 exists'
5212024-02-15T00:04:33.922Z+ set +x
5222024-02-15T00:04:33.922ZSimnet net1/sc1_0 exists
5232024-02-15T00:04:33.922Z++ get_vnic_name_if_exists sc0_1
5242024-02-15T00:04:33.923Z++ dladm show-vnic -p -o LINK sc0_1
5252024-02-15T00:04:33.923Z++ echo ''
5262024-02-15T00:04:33.923Z+ [[ -z '' ]]
5272024-02-15T00:04:33.923Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5282024-02-15T00:04:33.923Z+ [[ -v PROMISC_FILT_OFF ]]
5292024-02-15T00:04:33.923Z+ success 'Vnic sc0_1 exists'
5302024-02-15T00:04:33.923Z+ set +x
5312024-02-15T00:04:33.923ZVnic sc0_1 exists
5322024-02-15T00:04:33.923Z+ warn_if_no_proxy_arp
5332024-02-15T00:04:33.923Z+ [[ -v PXA_START ]]
5342024-02-15T00:04:33.923Z+ [[ -v PXA_END ]]
5352024-02-15T00:04:33.923Z+ ensure_softnpu_zone
5362024-02-15T00:04:33.923Z+ zoneadm list
5372024-02-15T00:04:33.924Z+ grep -q sidecar_softnpu
5382024-02-15T00:04:33.924Z+ [[ -f out/npuzone/npuzone ]]
5392024-02-15T00:04:33.924Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5402024-02-15T00:04:33.924Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5412024-02-15T00:04:40.477Zdownloading softnpu ...done
5422024-02-15T00:04:40.503Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5432024-02-15T00:04:46.478Zdownloading asic_program.so ...done
5442024-02-15T00:04:46.509Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5452024-02-15T00:04:56.780Zdownloading scadm ...done
5462024-02-15T00:04:56.780Zcreating port tfportrear0_0 for sc0_0
5472024-02-15T00:04:56.780Zcreating port tfportqsfp0_0 for sc0_1
5482024-02-15T00:04:56.780Zsoftnpu zone setup
5492024-02-15T00:04:56.780Zconfigure zone
5502024-02-15T00:04:56.780Zinstall zone
5512024-02-15T00:04:56.780Zboot zone
5522024-02-15T00:04:59.866Z[sidecar_softnpu] svcs milestone/network
5532024-02-15T00:04:59.899ZSTATE STIME FMRI
5542024-02-15T00:04:59.899Zonline 0:04:57 svc:/milestone/network:default
5552024-02-15T00:04:59.899Z[sidecar_softnpu] /softnpu/npu start
5562024-02-15T00:04:59.926Z
5572024-02-15T00:04:59.926Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5582024-02-15T00:04:59.926Z+ GATEWAY_IP=10.151.2.100
5592024-02-15T00:04:59.926Z+ echo 'Using 10.151.2.100 as gateway ip'
5602024-02-15T00:04:59.926ZUsing 10.151.2.100 as gateway ip
5612024-02-15T00:04:59.926Z+ [[ ! -v GATEWAY_MAC ]]
5622024-02-15T00:04:59.926Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
5632024-02-15T00:04:59.926Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5642024-02-15T00:04:59.926Z+++ echo 18:c0:4d:0d:a0:2a
5652024-02-15T00:04:59.926Z+ COUNT=1
5662024-02-15T00:04:59.926Z+ [[ 1 -ne 1 ]]
5672024-02-15T00:04:59.927Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
5682024-02-15T00:04:59.927ZUsing 18:c0:4d:0d:a0:2a as gateway mac
5692024-02-15T00:04:59.927Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5702024-02-15T00:04:59.927Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5712024-02-15T00:04:59.952Z+ PXA_MAC=a8:e1:de:01:70:1d
5722024-02-15T00:04:59.952Z+ [[ -v PXA_START ]]
5732024-02-15T00:04:59.953Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5742024-02-15T00:04:59.953Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5752024-02-15T00:04:59.978Z+ z_scadm dump-state
5762024-02-15T00:05:00.004Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5772024-02-15T00:05:00.004Zlocal v6:
5782024-02-15T00:05:00.004Zlocal v4:
5792024-02-15T00:05:00.004Zrouter v6:
5802024-02-15T00:05:00.004Zrouter v4_idx:
5812024-02-15T00:05:00.004Zrouter v4_routes:
5822024-02-15T00:05:00.004Zresolver v4:
5832024-02-15T00:05:00.004Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
5842024-02-15T00:05:00.004Zresolver v6:
5852024-02-15T00:05:00.004Znat v4:
5862024-02-15T00:05:00.004Znat_v6:
5872024-02-15T00:05:00.004Zport_mac:
5882024-02-15T00:05:00.004Zproxy arp:
5892024-02-15T00:05:00.004Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
5902024-02-15T00:05:00.030Z+ success 'softnpu zone exists'
5912024-02-15T00:05:00.030Z+ set +x
5922024-02-15T00:05:00.030Zsoftnpu zone exists
5932024-02-15T00:05:00.030Z
5942024-02-15T00:05:00.030Zreal 26.828212777
5952024-02-15T00:05:00.030Zuser 0.686761349
5962024-02-15T00:05:00.030Zsys 1.506610793
5972024-02-15T00:05:00.030Ztrap 0.000073327
5982024-02-15T00:05:00.030Ztflt 0.000142853
5992024-02-15T00:05:00.030Zdflt 0.001464827
6002024-02-15T00:05:00.030Zkflt 0.000001609
6012024-02-15T00:05:00.030Zlock 20:52.954423246
6022024-02-15T00:05:00.030Zslp 1:20.210528664
6032024-02-15T00:05:00.030Zlat 0.073605849
6042024-02-15T00:05:00.030Zstop 0.336828579
6052024-02-15T00:05:00.031Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
6062024-02-15T00:05:00.055Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6072024-02-15T00:05:00.103Z+ SILO_NAME=recovery
6082024-02-15T00:05:00.103Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6092024-02-15T00:05:00.104Z+ EXTERNAL_DNS_DOMAIN=oxide.test
6102024-02-15T00:05:00.104Z+ sed -i~ '
6112024-02-15T00:05:00.104Z /^external_dns_ips/c\
6122024-02-15T00:05:00.104Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6132024-02-15T00:05:00.104Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6142024-02-15T00:05:00.104Z /^first/c\
6152024-02-15T00:05:00.104Zfirst = "10.151.2.164"
6162024-02-15T00:05:00.104Z /^last/c\
6172024-02-15T00:05:00.104Zlast = "10.151.2.173"
6182024-02-15T00:05:00.104Z }
6192024-02-15T00:05:00.104Z /^\[rack_network_config/,/^$/ {
6202024-02-15T00:05:00.104Z /^infra_ip_first/c\
6212024-02-15T00:05:00.104Zinfra_ip_first = "10.151.2.174"
6222024-02-15T00:05:00.105Z /^infra_ip_last/c\
6232024-02-15T00:05:00.105Zinfra_ip_last = "10.151.2.174"
6242024-02-15T00:05:00.105Z }
6252024-02-15T00:05:00.105Z /^\[\[rack_network_config.ports/,/^$/ {
6262024-02-15T00:05:00.105Z /^routes/c\
6272024-02-15T00:05:00.105Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
6282024-02-15T00:05:00.105Z /^addresses/c\
6292024-02-15T00:05:00.105Zaddresses = \["10.151.2.174/24"\]
6302024-02-15T00:05:00.105Z }
6312024-02-15T00:05:00.105Z' pkg/config-rss.toml
6322024-02-15T00:05:00.105Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6332024-02-15T00:05:00.105Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6342024-02-15T00:05:00.105Z+++ pkg/config-rss.toml Thu Feb 15 00:04:59 2024
6352024-02-15T00:05:00.105Z@@ -33,7 +33,7 @@
6362024-02-15T00:05:00.106Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6372024-02-15T00:05:00.106Z # must be contained in one of the "internal services" IP Pool ranges listed
6382024-02-15T00:05:00.106Z # below.
6392024-02-15T00:05:00.106Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6402024-02-15T00:05:00.106Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6412024-02-15T00:05:00.106Z
6422024-02-15T00:05:00.106Z # Initial TLS certificates for the external API
6432024-02-15T00:05:00.106Z #
6442024-02-15T00:05:00.106Z@@ -69,8 +69,8 @@
6452024-02-15T00:05:00.106Z #
6462024-02-15T00:05:00.107Z # For more on this and what to put here, see docs/how-to-run.adoc.
6472024-02-15T00:05:00.107Z [[internal_services_ip_pool_ranges]]
6482024-02-15T00:05:00.107Z-first = "192.168.1.20"
6492024-02-15T00:05:00.107Z-last = "192.168.1.29"
6502024-02-15T00:05:00.107Z+first = "10.151.2.164"
6512024-02-15T00:05:00.107Z+last = "10.151.2.173"
6522024-02-15T00:05:00.107Z
6532024-02-15T00:05:00.107Z # TODO - this configuration is subject to change going forward. Ultimately these
6542024-02-15T00:05:00.107Z # parameters should be provided to the control plane via wicket, but we need to
6552024-02-15T00:05:00.107Z@@ -100,9 +100,9 @@
6562024-02-15T00:05:00.108Z # You can configure multiple uplinks by repeating the following stanza
6572024-02-15T00:05:00.108Z [[rack_network_config.ports]]
6582024-02-15T00:05:00.108Z # Routes associated with this port.
6592024-02-15T00:05:00.108Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6602024-02-15T00:05:00.108Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
6612024-02-15T00:05:00.108Z # Addresses associated with this port.
6622024-02-15T00:05:00.108Z-addresses = ["192.168.1.30/24"]
6632024-02-15T00:05:00.108Z+addresses = ["10.151.2.174/24"]
6642024-02-15T00:05:00.108Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6652024-02-15T00:05:00.108Z port = "qsfp0"
6662024-02-15T00:05:00.108Z # The speed of this port.
6672024-02-15T00:05:00.108Z+ true
6682024-02-15T00:05:00.108Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6692024-02-15T00:05:00.108Za pkg/config-rss.toml 7K
6702024-02-15T00:05:00.108Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6712024-02-15T00:05:00.108Z+ TLS_NAME=recovery.sys.oxide.test
6722024-02-15T00:05:00.108Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6732024-02-15T00:05:00.286Z..+.....+.+............+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+..+.......+..+.+............+..+...............+....+..............+...+.......+.....+.+......+...+.....+.+.....+.......+..+.+...........+.........+.+...+...........+....+..+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....................+.....+......+...............+....+............+...+..+....+......+...+......+.........+.....+....+.....+......+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6742024-02-15T00:05:00.563Z...+........+.+.....................+...+..+....+.....+......+....+.....+.+...+..+...+..........+...+.....+...+......+.+..+...+....+...+......+.............................+.+...........+.+........+......+.+.......................+....+......+..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.+.....+......+...+.......+...+.........+...........+.+...+...+........................+......+..+...+...+.+.....+...+...+.........+...............+......+....+...+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..+.......+..+.........+............+...+......+...+......+.......+...+...........+....+...........+......+.................................+...........................+...+......+.+........+....+.................+.........+.........+.+.....+.........+...............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6752024-02-15T00:05:00.588Z-----
6762024-02-15T00:05:00.588Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6772024-02-15T00:05:00.613Za pkg/initial-tls-cert.pem 2K
6782024-02-15T00:05:00.613Za pkg/initial-tls-key.pem 4K
6792024-02-15T00:05:00.614Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6802024-02-15T00:05:00.614Z+ rmdir pkg
6812024-02-15T00:05:00.614Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6822024-02-15T00:05:00.614Z+ pfexec mkdir -p /usr/oxide
6832024-02-15T00:05:00.614Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6842024-02-15T00:05:01.350Z+ pfexec chmod +x /usr/oxide/oxide
6852024-02-15T00:05:01.378Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6862024-02-15T00:05:21.482Z+ OMICRON_NO_UNINSTALL=1
6872024-02-15T00:05:21.483Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6882024-02-15T00:05:21.524ZLogging to: /opt/oxide/work/out/LOG
6892024-02-15T00:05:21.992Z
6902024-02-15T00:05:22.028Zreal 0.503483748
6912024-02-15T00:05:22.028Zuser 0.109606055
6922024-02-15T00:05:22.029Zsys 2.171457068
6932024-02-15T00:05:22.029Ztrap 0.000014830
6942024-02-15T00:05:22.029Ztflt 0.000044307
6952024-02-15T00:05:22.029Zdflt 0.000365947
6962024-02-15T00:05:22.029Zkflt 0.000000000
6972024-02-15T00:05:22.029Zlock 45.566227432
6982024-02-15T00:05:22.030Zslp 0.718706206
6992024-02-15T00:05:22.030Zlat 0.003149064
7002024-02-15T00:05:22.030Zstop 0.204941671
7012024-02-15T00:05:22.030Z+ retry=0
7022024-02-15T00:05:22.030Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7032024-02-15T00:05:22.030Z+ [[ 0 -gt 30 ]]
7042024-02-15T00:05:22.030Z+ sleep 1
7052024-02-15T00:05:23.008Z+ retry=1
7062024-02-15T00:05:23.009Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-02-15T00:05:23.447Z+ [[ 1 -gt 30 ]]
7082024-02-15T00:05:23.447Z+ sleep 1
7092024-02-15T00:05:24.021Z+ retry=2
7102024-02-15T00:05:24.021Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7112024-02-15T00:05:24.051Z+ [[ 2 -gt 30 ]]
7122024-02-15T00:05:24.052Z+ sleep 1
7132024-02-15T00:05:25.033Z+ retry=3
7142024-02-15T00:05:25.033Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7152024-02-15T00:05:25.058Z+ [[ 3 -gt 30 ]]
7162024-02-15T00:05:25.058Z+ sleep 1
7172024-02-15T00:05:26.049Z+ retry=4
7182024-02-15T00:05:26.049Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7192024-02-15T00:05:51.217Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7202024-02-15T00:05:51.252Zlocal v6:
7212024-02-15T00:05:51.253Zfe80::1c49:7fff:fe22:d976
7222024-02-15T00:05:51.253Zfd2f:682c:3849:21cb::1
7232024-02-15T00:05:51.253Zlocal v4:
7242024-02-15T00:05:51.253Z10.151.2.174
7252024-02-15T00:05:51.253Zrouter v6:
7262024-02-15T00:05:51.254Zfd00:1122:3344:3::/64 -> fe80::1c1b:30ff:fe47:390e (1)
7272024-02-15T00:05:51.254Zfd00:1122:3344:101::/64 -> fe80::1c1b:30ff:fe47:390e (1)
7282024-02-15T00:05:51.254Zfdb0:18c0:4d0d:a02a::/64 -> fe80::1c1b:30ff:fe47:390e (1)
7292024-02-15T00:05:51.254Zfd00:1122:3344:1::/64 -> fe80::1c1b:30ff:fe47:390e (1)
7302024-02-15T00:05:51.254Zfd00:1122:3344:2::/64 -> fe80::1c1b:30ff:fe47:390e (1)
7312024-02-15T00:05:51.255Zrouter v4_idx:
7322024-02-15T00:05:51.287Z0.0.0.0/0 -> 0
7332024-02-15T00:05:51.287Zrouter v4_routes:
7342024-02-15T00:05:51.287Z0 -> 10.151.2.100 (2)
7352024-02-15T00:05:51.288Zresolver v4:
7362024-02-15T00:05:51.288Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7372024-02-15T00:05:51.288Z10.151.2.174 -> 62:49:d4:ce:23:9f
7382024-02-15T00:05:51.288Zresolver v6:
7392024-02-15T00:05:51.289Zfe80::1c49:7fff:fe22:d976 -> 1e:49:7f:22:d9:76
7402024-02-15T00:05:51.289Zfe80::1c1b:30ff:fe47:390e -> 1e:1b:30:47:39:0e
7412024-02-15T00:05:51.290Znat v4:
7422024-02-15T00:05:51.290Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:d6:7c
7432024-02-15T00:05:51.290Znat_v6:
7442024-02-15T00:05:51.291Zport_mac:
7452024-02-15T00:05:51.291Z1: a8:40:25:1f:bd:4e
7462024-02-15T00:05:51.291Z1000: a8:40:25:1f:bd:4d
7472024-02-15T00:05:51.292Z2: a8:40:25:1f:bd:6e
7482024-02-15T00:05:51.292Zproxy arp:
7492024-02-15T00:05:51.292Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7502024-02-15T00:05:51.292Z+ retry=0
7512024-02-15T00:05:51.292Z+++ zoneadm list -n
7522024-02-15T00:05:51.293Z+++ grep oxz_ntp
7532024-02-15T00:05:51.293Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
7542024-02-15T00:05:51.293Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7552024-02-15T00:05:51.294Z++ true
7562024-02-15T00:05:51.294Z+ [[ '' != online ]]
7572024-02-15T00:05:51.294Z+ [[ 0 -gt 60 ]]
7582024-02-15T00:05:51.294Z+ sleep 1
7592024-02-15T00:05:52.291Z+ retry=1
7602024-02-15T00:05:52.320Z+++ zoneadm list -n
7612024-02-15T00:05:52.321Z+++ grep oxz_ntp
7622024-02-15T00:05:52.321Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
7632024-02-15T00:05:52.321Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7642024-02-15T00:05:52.321Z++ true
7652024-02-15T00:05:52.321Z+ [[ '' != online ]]
7662024-02-15T00:05:52.321Z+ [[ 1 -gt 60 ]]
7672024-02-15T00:05:52.321Z+ sleep 1
7682024-02-15T00:05:53.315Z+ retry=2
7692024-02-15T00:05:53.343Z+++ zoneadm list -n
7702024-02-15T00:05:53.343Z+++ grep oxz_ntp
7712024-02-15T00:05:53.343Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
7722024-02-15T00:05:53.343Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7732024-02-15T00:05:53.343Z++ true
7742024-02-15T00:05:53.343Z+ [[ '' != online ]]
7752024-02-15T00:05:53.343Z+ [[ 2 -gt 60 ]]
7762024-02-15T00:05:53.344Z+ sleep 1
 
7772024-02-15T00:05:53.620ZError: No response to keepalive - Terminating session
 
7782024-02-15T00:05:54.343Z+ retry=3
7792024-02-15T00:05:54.373Z+++ zoneadm list -n
7802024-02-15T00:05:54.373Z+++ grep oxz_ntp
7812024-02-15T00:05:54.373Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
7822024-02-15T00:05:54.373Z+ [[ uninitialized != online ]]
7832024-02-15T00:05:54.373Z+ [[ 3 -gt 60 ]]
7842024-02-15T00:05:54.373Z+ sleep 1
7852024-02-15T00:05:55.372Z+ retry=4
7862024-02-15T00:05:55.411Z+++ zoneadm list -n
7872024-02-15T00:05:55.411Z+++ grep oxz_ntp
7882024-02-15T00:05:55.411Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
7892024-02-15T00:05:55.411Z+ [[ disabled != online ]]
7902024-02-15T00:05:55.411Z+ [[ 4 -gt 60 ]]
7912024-02-15T00:05:55.411Z+ sleep 1
7922024-02-15T00:05:56.394Z+ retry=5
7932024-02-15T00:05:56.427Z+++ zoneadm list -n
7942024-02-15T00:05:56.427Z+++ grep oxz_ntp
7952024-02-15T00:05:56.428Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
7962024-02-15T00:05:56.428Z+ [[ disabled != online ]]
7972024-02-15T00:05:56.428Z+ [[ 5 -gt 60 ]]
7982024-02-15T00:05:56.428Z+ sleep 1
7992024-02-15T00:05:57.417Z+ retry=6
8002024-02-15T00:05:57.448Z+++ zoneadm list -n
8012024-02-15T00:05:57.449Z+++ grep oxz_ntp
8022024-02-15T00:05:57.449Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
8032024-02-15T00:05:57.449Z+ [[ disabled != online ]]
8042024-02-15T00:05:57.449Z+ [[ 6 -gt 60 ]]
8052024-02-15T00:05:57.449Z+ sleep 1
8062024-02-15T00:05:58.430Z+ retry=7
8072024-02-15T00:05:58.458Z+++ zoneadm list -n
8082024-02-15T00:05:58.458Z+++ grep oxz_ntp
8092024-02-15T00:05:58.458Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
8102024-02-15T00:05:58.458Z+ [[ disabled != online ]]
8112024-02-15T00:05:58.458Z+ [[ 7 -gt 60 ]]
8122024-02-15T00:05:58.459Z+ sleep 1
8132024-02-15T00:05:59.467Z+ retry=8
8142024-02-15T00:05:59.498Z+++ zoneadm list -n
8152024-02-15T00:05:59.498Z+++ grep oxz_ntp
8162024-02-15T00:05:59.499Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
8172024-02-15T00:05:59.499Z+ [[ disabled != online ]]
8182024-02-15T00:05:59.499Z+ [[ 8 -gt 60 ]]
8192024-02-15T00:05:59.499Z+ sleep 1
8202024-02-15T00:06:00.477Z+ retry=9
8212024-02-15T00:06:00.508Z+++ zoneadm list -n
8222024-02-15T00:06:00.508Z+++ grep oxz_ntp
8232024-02-15T00:06:00.508Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
8242024-02-15T00:06:00.508Z+ [[ disabled != online ]]
8252024-02-15T00:06:00.508Z+ [[ 9 -gt 60 ]]
8262024-02-15T00:06:00.508Z+ sleep 1
8272024-02-15T00:06:01.498Z+ retry=10
8282024-02-15T00:06:01.526Z+++ zoneadm list -n
8292024-02-15T00:06:01.526Z+++ grep oxz_ntp
8302024-02-15T00:06:01.526Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
8312024-02-15T00:06:01.526Z+ [[ disabled != online ]]
8322024-02-15T00:06:01.526Z+ [[ 10 -gt 60 ]]
8332024-02-15T00:06:01.526Z+ sleep 1
8342024-02-15T00:06:02.591Z+ retry=11
8352024-02-15T00:06:02.628Z+++ zoneadm list -n
8362024-02-15T00:06:02.629Z+++ grep oxz_ntp
8372024-02-15T00:06:02.629Z++ pfexec svcs -z oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7 -Hostate oxide/ntp
8382024-02-15T00:06:02.629Z+ [[ online != online ]]
8392024-02-15T00:06:02.629Z+ echo 'Waited for chrony: 11s'
8402024-02-15T00:06:02.629Z+ export RUST_BACKTRACE=1
8412024-02-15T00:06:02.629ZWaited for chrony: 11s
8422024-02-15T00:06:02.629Z+ RUST_BACKTRACE=1
8432024-02-15T00:06:02.629Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8442024-02-15T00:06:02.629Z++ ./tests/bootstrap
8452024-02-15T00:06:02.630ZUsing external DNS server at 10.151.2.164:53
8462024-02-15T00:06:02.630Z2024-02-15 00:06:02.176130073 UTC: attempting to log into API
 
8472024-02-15T00:06:03.573ZError: No response de-activating SOL payload
8482024-02-15T00:06:04.985Z[SOL Session operational. Use ~? for help]
 
8492024-02-15T00:06:17.610Z2024-02-15 00:06:17.530209296 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8502024-02-15T00:06:18.611Z2024-02-15 00:06:18.534876996 UTC: attempting to log into API
8512024-02-15T00:06:33.642Z2024-02-15 00:06:33.607051579 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8522024-02-15T00:06:34.649Z2024-02-15 00:06:34.610649359 UTC: attempting to log into API
8532024-02-15T00:06:49.900Z2024-02-15 00:06:49.665046894 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8542024-02-15T00:06:50.678Z2024-02-15 00:06:50.666881847 UTC: attempting to log into API
8552024-02-15T00:07:05.713Z2024-02-15 00:07:05.698445106 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8562024-02-15T00:07:06.712Z2024-02-15 00:07:06.699439482 UTC: attempting to log into API
8572024-02-15T00:07:21.765Z2024-02-15 00:07:21.732151844 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8582024-02-15T00:07:22.747Z2024-02-15 00:07:22.733968726 UTC: attempting to log into API
8592024-02-15T00:07:37.779Z2024-02-15 00:07:37.767219960 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8602024-02-15T00:07:38.786Z2024-02-15 00:07:38.768151014 UTC: attempting to log into API
8612024-02-15T00:07:54.223Z2024-02-15 00:07:53.797852105 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8622024-02-15T00:07:54.810Z2024-02-15 00:07:54.798905422 UTC: attempting to log into API
8632024-02-15T00:08:09.857Z2024-02-15 00:08:09.834958078 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8642024-02-15T00:08:10.867Z2024-02-15 00:08:10.836689369 UTC: attempting to log into API
8652024-02-15T00:08:25.890Z2024-02-15 00:08:25.877181103 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8662024-02-15T00:08:26.892Z2024-02-15 00:08:26.877881874 UTC: attempting to log into API
8672024-02-15T00:08:42.392Z2024-02-15 00:08:42.018527225 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8682024-02-15T00:08:43.157Z2024-02-15 00:08:43.063085800 UTC: attempting to log into API
 
8692024-02-15T00:08:53.572ZError: No response to keepalive - Terminating session
 
8702024-02-15T00:08:58.681Z2024-02-15 00:08:58.233139392 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8712024-02-15T00:08:59.253Z2024-02-15 00:08:59.234241160 UTC: attempting to log into API
 
8722024-02-15T00:09:03.777ZError: No response de-activating SOL payload
8732024-02-15T00:09:04.892Z[SOL Session operational. Use ~? for help]
 
8742024-02-15T00:09:14.295Z2024-02-15 00:09:14.266585436 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8752024-02-15T00:09:14.841ZFeb 15 00:09:14 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
8762024-02-15T00:09:15.292Z2024-02-15 00:09:15.267606132 UTC: attempting to log into API
 
8772024-02-15T00:09:22.120ZFeb 15 00:09:21 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8782024-02-15T00:09:28.060ZFeb 15 00:09:27 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
8792024-02-15T00:09:30.460Z2024-02-15 00:09:30.299446118 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8802024-02-15T00:09:32.131Z2024-02-15 00:09:31.300531535 UTC: attempting to log into API
 
8812024-02-15T00:09:35.854ZFeb 15 00:09:35 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
8822024-02-15T00:09:41.503ZFeb 15 00:09:40 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8832024-02-15T00:09:46.345Z2024-02-15 00:09:46.331987394 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8842024-02-15T00:09:47.350Z2024-02-15 00:09:47.333088001 UTC: attempting to log into API
8852024-02-15T00:10:02.378Z2024-02-15 00:10:02.364615387 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8862024-02-15T00:10:03.380Z2024-02-15 00:10:03.365669474 UTC: attempting to log into API
8872024-02-15T00:10:09.172Z2024-02-15 00:10:09.151889408 UTC: login succeeded
8882024-02-15T00:10:09.213Zwaiting for nexus to come up...
8892024-02-15T00:10:09.270Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8902024-02-15T00:10:09.429Zsetting up quotas...
8912024-02-15T00:10:09.468Zensuring datasets are ready...
8922024-02-15T00:10:11.947Zlet's roll.
8932024-02-15T00:10:11.977Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8942024-02-15T00:10:11.978ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8952024-02-15T00:10:11.978ZOXIDE_TOKEN=oxide-token-ca73f3425c23ee8ddee60a213b69298a6cc79fcd'
8962024-02-15T00:10:11.978Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8972024-02-15T00:10:11.978Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8982024-02-15T00:10:11.978Z++ OXIDE_TOKEN=oxide-token-ca73f3425c23ee8ddee60a213b69298a6cc79fcd
8992024-02-15T00:10:11.978Z+ export OXIDE_HOST OXIDE_TOKEN
9002024-02-15T00:10:11.978Z+ retry=0
9012024-02-15T00:10:11.978Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9022024-02-15T00:10:12.007Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9032024-02-15T00:10:12.007Z+ [[ 0 -gt 60 ]]
9042024-02-15T00:10:12.007Z+ sleep 1
9052024-02-15T00:10:13.010Z+ retry=1
9062024-02-15T00:10:13.010Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9072024-02-15T00:10:13.051Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9082024-02-15T00:10:13.051Z+ [[ 1 -gt 60 ]]
9092024-02-15T00:10:13.051Z+ sleep 1
9102024-02-15T00:10:14.029Z+ retry=2
9112024-02-15T00:10:14.030Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9122024-02-15T00:10:14.059Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9132024-02-15T00:10:14.059Z+ [[ 2 -gt 60 ]]
9142024-02-15T00:10:14.059Z+ sleep 1
9152024-02-15T00:10:15.050Z+ retry=3
9162024-02-15T00:10:15.051Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9172024-02-15T00:10:15.096Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9182024-02-15T00:10:15.096Z+ [[ 3 -gt 60 ]]
9192024-02-15T00:10:15.096Z+ sleep 1
9202024-02-15T00:10:16.062Z+ retry=4
9212024-02-15T00:10:16.062Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9222024-02-15T00:10:16.098Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9232024-02-15T00:10:16.098Z+ [[ 4 -gt 60 ]]
9242024-02-15T00:10:16.099Z+ sleep 1
9252024-02-15T00:10:17.486Z+ retry=5
9262024-02-15T00:10:17.487Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9272024-02-15T00:10:17.519Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9282024-02-15T00:10:17.519Z+ [[ 5 -gt 60 ]]
9292024-02-15T00:10:17.519Z+ sleep 1
9302024-02-15T00:10:18.095Z+ retry=6
9312024-02-15T00:10:18.095Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9322024-02-15T00:10:19.079Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9332024-02-15T00:10:19.080Z+ [[ 6 -gt 60 ]]
9342024-02-15T00:10:19.080Z+ sleep 1
9352024-02-15T00:10:20.051Z+ retry=7
9362024-02-15T00:10:20.051Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9372024-02-15T00:10:20.051Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9382024-02-15T00:10:20.051Z+ [[ 7 -gt 60 ]]
9392024-02-15T00:10:20.051Z+ sleep 1
9402024-02-15T00:10:20.123Z+ retry=8
9412024-02-15T00:10:20.123Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9422024-02-15T00:10:20.157Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9432024-02-15T00:10:20.157Z+ [[ 8 -gt 60 ]]
9442024-02-15T00:10:20.157Z+ sleep 1
9452024-02-15T00:10:21.138Z+ retry=9
9462024-02-15T00:10:21.138Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9472024-02-15T00:10:21.162Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9482024-02-15T00:10:21.163Z+ [[ 9 -gt 60 ]]
9492024-02-15T00:10:21.163Z+ sleep 1
9502024-02-15T00:10:22.156Z+ retry=10
9512024-02-15T00:10:22.156Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9522024-02-15T00:10:22.198Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9532024-02-15T00:10:22.198Z+ [[ 10 -gt 60 ]]
9542024-02-15T00:10:22.198Z+ sleep 1
9552024-02-15T00:10:23.180Z+ retry=11
9562024-02-15T00:10:23.180Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9572024-02-15T00:10:23.210Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9582024-02-15T00:10:23.210Z+ [[ 11 -gt 60 ]]
9592024-02-15T00:10:23.210Z+ sleep 1
9602024-02-15T00:10:24.188Z+ retry=12
9612024-02-15T00:10:24.188Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9622024-02-15T00:10:24.217Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9632024-02-15T00:10:24.217Z+ [[ 12 -gt 60 ]]
9642024-02-15T00:10:24.217Z+ sleep 1
9652024-02-15T00:10:25.224Z+ retry=13
9662024-02-15T00:10:25.224Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9672024-02-15T00:10:25.262Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9682024-02-15T00:10:25.262Z+ [[ 13 -gt 60 ]]
9692024-02-15T00:10:25.262Z+ sleep 1
9702024-02-15T00:10:26.221Z+ retry=14
9712024-02-15T00:10:26.221Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9722024-02-15T00:10:26.252Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9732024-02-15T00:10:26.252Z+ [[ 14 -gt 60 ]]
9742024-02-15T00:10:26.252Z+ sleep 1
9752024-02-15T00:10:27.234Z+ retry=15
9762024-02-15T00:10:27.234Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9772024-02-15T00:10:27.261Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9782024-02-15T00:10:27.261Z+ [[ 15 -gt 60 ]]
9792024-02-15T00:10:27.261Z+ sleep 1
9802024-02-15T00:10:28.257Z+ retry=16
9812024-02-15T00:10:28.257Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9822024-02-15T00:10:28.290Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9832024-02-15T00:10:28.290Z+ [[ 16 -gt 60 ]]
9842024-02-15T00:10:28.290Z+ sleep 1
9852024-02-15T00:10:29.271Z+ retry=17
9862024-02-15T00:10:29.271Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9872024-02-15T00:10:29.309Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9882024-02-15T00:10:29.309Z+ [[ 17 -gt 60 ]]
9892024-02-15T00:10:29.309Z+ sleep 1
9902024-02-15T00:10:30.324Z+ retry=18
9912024-02-15T00:10:30.325Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9922024-02-15T00:10:30.351Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9932024-02-15T00:10:30.351Z+ [[ 18 -gt 60 ]]
9942024-02-15T00:10:30.351Z+ sleep 1
9952024-02-15T00:10:31.311Z+ retry=19
9962024-02-15T00:10:31.311Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9972024-02-15T00:10:31.355Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9982024-02-15T00:10:31.356Z+ [[ 19 -gt 60 ]]
9992024-02-15T00:10:31.356Z+ sleep 1
10002024-02-15T00:10:32.318Z+ retry=20
10012024-02-15T00:10:32.318Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10022024-02-15T00:10:32.351Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10032024-02-15T00:10:32.351Z+ [[ 20 -gt 60 ]]
10042024-02-15T00:10:32.351Z+ sleep 1
10052024-02-15T00:10:33.333Z+ retry=21
10062024-02-15T00:10:33.334Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10072024-02-15T00:10:33.365Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10082024-02-15T00:10:33.366Z+ [[ 21 -gt 60 ]]
10092024-02-15T00:10:33.366Z+ sleep 1
10102024-02-15T00:10:34.361Z+ retry=22
10112024-02-15T00:10:34.361Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10122024-02-15T00:10:34.396Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10132024-02-15T00:10:34.396Z+ [[ 22 -gt 60 ]]
10142024-02-15T00:10:34.396Z+ sleep 1
10152024-02-15T00:10:35.378Z+ retry=23
10162024-02-15T00:10:35.378Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10172024-02-15T00:10:35.455Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10182024-02-15T00:10:35.455Z+ [[ 23 -gt 60 ]]
10192024-02-15T00:10:35.455Z+ sleep 1
10202024-02-15T00:10:36.408Z+ retry=24
10212024-02-15T00:10:36.408Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10222024-02-15T00:10:36.441Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10232024-02-15T00:10:36.442Z+ [[ 24 -gt 60 ]]
10242024-02-15T00:10:36.442Z+ sleep 1
10252024-02-15T00:10:37.418Z+ retry=25
10262024-02-15T00:10:37.418Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10272024-02-15T00:10:37.507Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10282024-02-15T00:10:37.507Z+ [[ 25 -gt 60 ]]
10292024-02-15T00:10:37.508Z+ sleep 1
10302024-02-15T00:10:38.436Z+ retry=26
10312024-02-15T00:10:38.436Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10322024-02-15T00:10:38.463Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10332024-02-15T00:10:38.463Z+ [[ 26 -gt 60 ]]
10342024-02-15T00:10:38.463Z+ sleep 1
10352024-02-15T00:10:39.427Z+ retry=27
10362024-02-15T00:10:39.427Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10372024-02-15T00:10:39.453Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10382024-02-15T00:10:39.453Z+ [[ 27 -gt 60 ]]
10392024-02-15T00:10:39.454Z+ sleep 1
10402024-02-15T00:10:40.460Z+ retry=28
10412024-02-15T00:10:40.460Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10422024-02-15T00:10:40.502Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10432024-02-15T00:10:40.502Z+ [[ 28 -gt 60 ]]
10442024-02-15T00:10:40.502Z+ sleep 1
10452024-02-15T00:10:41.468Z+ retry=29
10462024-02-15T00:10:41.468Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10472024-02-15T00:10:41.520Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10482024-02-15T00:10:41.520Z+ [[ 29 -gt 60 ]]
10492024-02-15T00:10:41.520Z+ sleep 1
10502024-02-15T00:10:42.489Z+ retry=30
10512024-02-15T00:10:42.489Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10522024-02-15T00:10:42.554Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10532024-02-15T00:10:42.833Z{"status":"ok"}success
10542024-02-15T00:10:42.833ZProject {
10552024-02-15T00:10:42.833Z description: "some images",
10562024-02-15T00:10:42.863Z id: cdcdb006-37eb-496d-b479-7b2d18497b06,
10572024-02-15T00:10:42.863Z name: Name(
10582024-02-15T00:10:42.863Z "images",
10592024-02-15T00:10:42.863Z ),
10602024-02-15T00:10:42.863Z time_created: 2024-02-15T00:10:42.625686Z,
10612024-02-15T00:10:42.864Z time_modified: 2024-02-15T00:10:42.625686Z,
10622024-02-15T00:10:42.864Z}
10632024-02-15T00:10:42.864Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
10642024-02-15T00:12:09.765ZError: No response to keepalive - Terminating session
10652024-02-15T00:12:19.720ZError: No response de-activating SOL payload
10662024-02-15T00:12:20.831Z[SOL Session operational. Use ~? for help]
10672024-02-15T00:15:10.473ZError: No response to keepalive - Terminating session
10682024-02-15T00:15:19.610ZError: No response de-activating SOL payload
10692024-02-15T00:15:20.998Z[SOL Session operational. Use ~? for help]
 
10702024-02-15T00:16:23.088Zdone!
10712024-02-15T00:16:23.191Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
10722024-02-15T00:16:23.310Zsuccess
10732024-02-15T00:16:23.310ZImage {
10742024-02-15T00:16:23.338Z block_size: ByteCount(
10752024-02-15T00:16:23.338Z 512,
10762024-02-15T00:16:23.338Z ),
10772024-02-15T00:16:23.338Z description: "debian 11 original base image",
10782024-02-15T00:16:23.338Z digest: None,
10792024-02-15T00:16:23.338Z id: dcaab863-86e3-43fd-97c3-28133011336a,
10802024-02-15T00:16:23.339Z name: Name(
10812024-02-15T00:16:23.339Z "debian11",
10822024-02-15T00:16:23.339Z ),
10832024-02-15T00:16:23.339Z os: "debian",
10842024-02-15T00:16:23.340Z project_id: None,
10852024-02-15T00:16:23.340Z size: ByteCount(
10862024-02-15T00:16:23.340Z 2147483648,
10872024-02-15T00:16:23.340Z ),
10882024-02-15T00:16:23.340Z time_created: 2024-02-15T00:16:23.046524Z,
10892024-02-15T00:16:23.341Z time_modified: 2024-02-15T00:16:23.284315Z,
10902024-02-15T00:16:23.341Z url: None,
10912024-02-15T00:16:23.341Z version: "11",
10922024-02-15T00:16:23.341Z}
10932024-02-15T00:16:23.341Z+ rm ./tests/bootstrap
10942024-02-15T00:16:23.414Z+ for test_bin in tests/*
10952024-02-15T00:16:23.414Z+ ./tests/bootstrap-814497ffe476019b
10962024-02-15T00:16:23.458Z
10972024-02-15T00:16:23.459Zrunning 0 tests
10982024-02-15T00:16:23.459Z
10992024-02-15T00:16:23.484Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11002024-02-15T00:16:23.484Z
11012024-02-15T00:16:23.484Z+ for test_bin in tests/*
11022024-02-15T00:16:23.484Z+ ./tests/end_to_end_tests-7c7bf8ffe79eb016
11032024-02-15T00:16:23.696Z
11042024-02-15T00:16:23.696Zrunning 2 tests
11052024-02-15T00:16:23.936Ztest no_spoof::no_spoof_here ... ok
11062024-02-15T00:16:58.210Ztest instance_launch::instance_launch ... ok
11072024-02-15T00:16:58.210Z
11082024-02-15T00:16:58.211Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 34.52s
11092024-02-15T00:16:58.211Z
11102024-02-15T00:16:59.079Z+ _exit_trap
11112024-02-15T00:16:59.079Z+ local status=0
11122024-02-15T00:16:59.080Z+ [[ 0 -eq 0 ]]
11132024-02-15T00:16:59.080Z+ exit 0
11142024-02-15T00:16:59.080Zprocess exited: duration 793205 ms, exit code 0
 
11152024-02-15T00:16:59.271Zfound 131 output files
11162024-02-15T00:16:59.271Zuploading: /var/svc/log/oxide-sled-agent:default.log (1401493 bytes)
11172024-02-15T00:17:02.257Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11182024-02-15T00:17:02.257Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (503799 bytes)
11192024-02-15T00:17:03.093Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 503799 -> 517909
11202024-02-15T00:17:04.178Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11212024-02-15T00:17:04.178Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (2396401 bytes)
11222024-02-15T00:17:08.435Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11232024-02-15T00:17:08.435Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
11242024-02-15T00:17:09.515Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11252024-02-15T00:17:09.515Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (6195 bytes)
11262024-02-15T00:17:10.654Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11272024-02-15T00:17:10.654Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (4185 bytes)
11282024-02-15T00:17:11.754Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11292024-02-15T00:17:11.754Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (21313 bytes)
11302024-02-15T00:17:12.925Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11312024-02-15T00:17:12.925Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (270246 bytes)
11322024-02-15T00:17:13.557Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 270246 -> 296594
11332024-02-15T00:17:14.631Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11342024-02-15T00:17:14.631Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1425488 bytes)
11352024-02-15T00:17:18.367Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11362024-02-15T00:17:18.367Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (166152 bytes)
11372024-02-15T00:17:18.656Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 166152 -> 191766
11382024-02-15T00:17:19.730Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11392024-02-15T00:17:19.730Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (834543 bytes)
11402024-02-15T00:17:21.510Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11412024-02-15T00:17:21.510Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11422024-02-15T00:17:22.590Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11432024-02-15T00:17:22.590Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11442024-02-15T00:17:23.748Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11452024-02-15T00:17:23.748Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (59557 bytes)
11462024-02-15T00:17:23.819Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 59557 -> 70154
11472024-02-15T00:17:24.894Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11482024-02-15T00:17:24.894Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (272343 bytes)
11492024-02-15T00:17:26.173Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11502024-02-15T00:17:26.173Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
11512024-02-15T00:17:31.034Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11522024-02-15T00:17:31.034Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
11532024-02-15T00:17:32.313Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
11542024-02-15T00:17:32.314Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
11552024-02-15T00:17:33.382Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11562024-02-15T00:17:33.382Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5391 bytes)
11572024-02-15T00:17:34.505Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
11582024-02-15T00:17:34.505Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-clickhouse:default.log (351060 bytes)
11592024-02-15T00:17:34.746Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 351060 -> 447957
11602024-02-15T00:17:35.822Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-clickhouse:default.log
11612024-02-15T00:17:35.823Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-clickhouse:default.log.0 (912092 bytes)
11622024-02-15T00:17:37.247Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-clickhouse:default.log.0
11632024-02-15T00:17:37.248Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11642024-02-15T00:17:38.319Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-zone-network-setup:default.log
11652024-02-15T00:17:38.319Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
11662024-02-15T00:17:39.416Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_b2eaae1a-392a-411d-b8cc-0dff26ddef0c/root/var/svc/log/oxide-zone-network-setup:default.log.0
11672024-02-15T00:17:39.416Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b157dbbc-477a-46c1-937a-6d9e521e4b6e/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11682024-02-15T00:17:40.492Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b157dbbc-477a-46c1-937a-6d9e521e4b6e/root/var/svc/log/oxide-cockroachdb:default.log
11692024-02-15T00:17:40.492Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b157dbbc-477a-46c1-937a-6d9e521e4b6e/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
11702024-02-15T00:17:41.591Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b157dbbc-477a-46c1-937a-6d9e521e4b6e/root/var/svc/log/oxide-cockroachdb:default.log.0
11712024-02-15T00:17:41.591Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b157dbbc-477a-46c1-937a-6d9e521e4b6e/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11722024-02-15T00:17:42.687Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b157dbbc-477a-46c1-937a-6d9e521e4b6e/root/var/svc/log/oxide-zone-network-setup:default.log
11732024-02-15T00:17:42.687Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b157dbbc-477a-46c1-937a-6d9e521e4b6e/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
11742024-02-15T00:17:43.789Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b157dbbc-477a-46c1-937a-6d9e521e4b6e/root/var/svc/log/oxide-zone-network-setup:default.log.0
11752024-02-15T00:17:43.789Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-agent:default.log (7756 bytes)
11762024-02-15T00:17:44.888Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-agent:default.log
11772024-02-15T00:17:44.888Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-agent:default.log.0 (20470 bytes)
11782024-02-15T00:17:46.452Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-agent:default.log.0
11792024-02-15T00:17:46.452Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11802024-02-15T00:17:47.527Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:default.log
11812024-02-15T00:17:47.527Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11822024-02-15T00:17:48.644Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11832024-02-15T00:17:48.644Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:downstairs-40f1f60c-cb84-4050-a5e7-a35070a136a1.log (1092 bytes)
11842024-02-15T00:17:49.751Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:downstairs-40f1f60c-cb84-4050-a5e7-a35070a136a1.log
11852024-02-15T00:17:49.751Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:downstairs-40f1f60c-cb84-4050-a5e7-a35070a136a1.log.0 (4601 bytes)
11862024-02-15T00:17:50.858Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:downstairs-40f1f60c-cb84-4050-a5e7-a35070a136a1.log.0
11872024-02-15T00:17:50.858Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:downstairs-c31d2256-5ec2-4622-9e9b-df559e3f8930.log (0 bytes)
11882024-02-15T00:17:51.933Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:downstairs-c31d2256-5ec2-4622-9e9b-df559e3f8930.log
11892024-02-15T00:17:51.933Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:downstairs-c31d2256-5ec2-4622-9e9b-df559e3f8930.log.0 (3126 bytes)
11902024-02-15T00:17:53.027Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:downstairs-c31d2256-5ec2-4622-9e9b-df559e3f8930.log.0
11912024-02-15T00:17:53.051Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:snapshot-40f1f60c-cb84-4050-a5e7-a35070a136a1-6cd717ec-8b2b-47d7-95fb-5bbe8d1361df.log (5301 bytes)
11922024-02-15T00:17:54.133Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c22ce43b-b4c5-453b-9120-505102876329/root/var/svc/log/oxide-crucible-downstairs:snapshot-40f1f60c-cb84-4050-a5e7-a35070a136a1-6cd717ec-8b2b-47d7-95fb-5bbe8d1361df.log
11932024-02-15T00:17:54.133Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_7d74b4bc-c408-4088-9473-a933f16aef97/root/var/svc/log/oxide-crucible-pantry:default.log (259817 bytes)
11942024-02-15T00:17:55.520Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_7d74b4bc-c408-4088-9473-a933f16aef97/root/var/svc/log/oxide-crucible-pantry:default.log
11952024-02-15T00:17:55.551Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_7d74b4bc-c408-4088-9473-a933f16aef97/root/var/svc/log/oxide-crucible-pantry:default.log.0 (966505 bytes)
11962024-02-15T00:17:57.616Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_7d74b4bc-c408-4088-9473-a933f16aef97/root/var/svc/log/oxide-crucible-pantry:default.log.0
11972024-02-15T00:17:57.617Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1db31f1b-e3f9-47c5-a2c6-e5eba50ff1ab/root/var/svc/log/oxide-external_dns:default.log (7554 bytes)
11982024-02-15T00:17:57.692Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1db31f1b-e3f9-47c5-a2c6-e5eba50ff1ab/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 7554 -> 11331
11992024-02-15T00:17:58.781Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1db31f1b-e3f9-47c5-a2c6-e5eba50ff1ab/root/var/svc/log/oxide-external_dns:default.log
12002024-02-15T00:17:58.781Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1db31f1b-e3f9-47c5-a2c6-e5eba50ff1ab/root/var/svc/log/oxide-external_dns:default.log.0 (23160 bytes)
12012024-02-15T00:17:59.922Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1db31f1b-e3f9-47c5-a2c6-e5eba50ff1ab/root/var/svc/log/oxide-external_dns:default.log.0
12022024-02-15T00:17:59.922Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_eaa4434d-a6bd-48f6-beb2-151404cd7796/root/var/svc/log/oxide-internal_dns:default.log (7512 bytes)
12032024-02-15T00:17:59.994Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_eaa4434d-a6bd-48f6-beb2-151404cd7796/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7512 -> 11268
12042024-02-15T00:18:01.064Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_eaa4434d-a6bd-48f6-beb2-151404cd7796/root/var/svc/log/oxide-internal_dns:default.log
12052024-02-15T00:18:01.064Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_eaa4434d-a6bd-48f6-beb2-151404cd7796/root/var/svc/log/oxide-internal_dns:default.log.0 (114437 bytes)
12062024-02-15T00:18:02.326Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_eaa4434d-a6bd-48f6-beb2-151404cd7796/root/var/svc/log/oxide-internal_dns:default.log.0
12072024-02-15T00:18:02.351Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-oximeter:default.log (94192 bytes)
12082024-02-15T00:18:02.700Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 94192 -> 145388
12092024-02-15T00:18:04.112Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-oximeter:default.log
12102024-02-15T00:18:04.112Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-oximeter:default.log.0 (250533 bytes)
12112024-02-15T00:18:05.042Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-oximeter:default.log.0
12122024-02-15T00:18:05.066Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12132024-02-15T00:18:06.122Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-zone-network-setup:default.log
12142024-02-15T00:18:06.150Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes)
12152024-02-15T00:18:07.255Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a0570de6-fbf4-4073-9e84-a6e01264b6a9/root/var/svc/log/oxide-zone-network-setup:default.log.0
12162024-02-15T00:18:07.285Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b70f6ed6-97c6-48eb-aefa-25fab0f23c6b/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12172024-02-15T00:18:10.023Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b70f6ed6-97c6-48eb-aefa-25fab0f23c6b/root/var/svc/log/oxide-cockroachdb:default.log
12182024-02-15T00:18:10.023Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b70f6ed6-97c6-48eb-aefa-25fab0f23c6b/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12192024-02-15T00:18:10.140ZError: No response to keepalive - Terminating session
12202024-02-15T00:18:11.320Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b70f6ed6-97c6-48eb-aefa-25fab0f23c6b/root/var/svc/log/oxide-cockroachdb:default.log.0
12212024-02-15T00:18:11.320Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b70f6ed6-97c6-48eb-aefa-25fab0f23c6b/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12222024-02-15T00:18:19.250Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b70f6ed6-97c6-48eb-aefa-25fab0f23c6b/root/var/svc/log/oxide-zone-network-setup:default.log
12232024-02-15T00:18:19.250Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b70f6ed6-97c6-48eb-aefa-25fab0f23c6b/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12242024-02-15T00:18:19.568ZError: No response de-activating SOL payload
12252024-02-15T00:18:20.345Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b70f6ed6-97c6-48eb-aefa-25fab0f23c6b/root/var/svc/log/oxide-zone-network-setup:default.log.0
12262024-02-15T00:18:20.345Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-agent:default.log (10679 bytes)
12272024-02-15T00:18:20.984Z[SOL Session operational. Use ~? for help]
12282024-02-15T00:18:21.479Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-agent:default.log
12292024-02-15T00:18:21.521Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-agent:default.log.0 (13688 bytes)
12302024-02-15T00:18:22.601Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-agent:default.log.0
12312024-02-15T00:18:22.601Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12322024-02-15T00:18:23.835Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:default.log
12332024-02-15T00:18:23.835Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12342024-02-15T00:18:24.946Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12352024-02-15T00:18:24.946Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:downstairs-73df67b2-e6fd-4539-beca-76e47670d5f8.log (0 bytes)
12362024-02-15T00:18:26.028Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:downstairs-73df67b2-e6fd-4539-beca-76e47670d5f8.log
12372024-02-15T00:18:26.028Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:downstairs-73df67b2-e6fd-4539-beca-76e47670d5f8.log.0 (3125 bytes)
12382024-02-15T00:18:27.131Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:downstairs-73df67b2-e6fd-4539-beca-76e47670d5f8.log.0
12392024-02-15T00:18:27.131Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:downstairs-b2c84e47-75ad-443d-bb5f-93aaed6083ef.log (5612 bytes)
12402024-02-15T00:18:28.237Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1b32292f-6190-435a-87d8-7fdbe1a65f21/root/var/svc/log/oxide-crucible-downstairs:downstairs-b2c84e47-75ad-443d-bb5f-93aaed6083ef.log
12412024-02-15T00:18:28.237Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1999ec12-789c-40c8-83be-a68bad0fad69/root/var/svc/log/oxide-external_dns:default.log (7555 bytes)
12422024-02-15T00:18:28.319Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1999ec12-789c-40c8-83be-a68bad0fad69/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 7555 -> 11332
12432024-02-15T00:18:29.410Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1999ec12-789c-40c8-83be-a68bad0fad69/root/var/svc/log/oxide-external_dns:default.log
12442024-02-15T00:18:29.410Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1999ec12-789c-40c8-83be-a68bad0fad69/root/var/svc/log/oxide-external_dns:default.log.0 (23166 bytes)
12452024-02-15T00:18:30.555Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_1999ec12-789c-40c8-83be-a68bad0fad69/root/var/svc/log/oxide-external_dns:default.log.0
12462024-02-15T00:18:30.555Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a3944496-e534-42b6-afe3-78830d746249/root/var/svc/log/oxide-internal_dns:default.log (7509 bytes)
12472024-02-15T00:18:30.627Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a3944496-e534-42b6-afe3-78830d746249/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7509 -> 11266
12482024-02-15T00:18:32.101Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a3944496-e534-42b6-afe3-78830d746249/root/var/svc/log/oxide-internal_dns:default.log
12492024-02-15T00:18:32.101Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a3944496-e534-42b6-afe3-78830d746249/root/var/svc/log/oxide-internal_dns:default.log.0 (111185 bytes)
12502024-02-15T00:18:33.361Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a3944496-e534-42b6-afe3-78830d746249/root/var/svc/log/oxide-internal_dns:default.log.0
12512024-02-15T00:18:33.362Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_21b3ce97-9e15-423d-932c-6a0f94f9763e/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12522024-02-15T00:18:40.119Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_21b3ce97-9e15-423d-932c-6a0f94f9763e/root/var/svc/log/oxide-cockroachdb:default.log
12532024-02-15T00:18:40.119Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_21b3ce97-9e15-423d-932c-6a0f94f9763e/root/var/svc/log/oxide-cockroachdb:default.log.0 (4381 bytes)
12542024-02-15T00:18:41.227Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_21b3ce97-9e15-423d-932c-6a0f94f9763e/root/var/svc/log/oxide-cockroachdb:default.log.0
12552024-02-15T00:18:41.228Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_21b3ce97-9e15-423d-932c-6a0f94f9763e/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12562024-02-15T00:18:42.317Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_21b3ce97-9e15-423d-932c-6a0f94f9763e/root/var/svc/log/oxide-zone-network-setup:default.log
12572024-02-15T00:18:42.317Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_21b3ce97-9e15-423d-932c-6a0f94f9763e/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12582024-02-15T00:18:43.412Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_21b3ce97-9e15-423d-932c-6a0f94f9763e/root/var/svc/log/oxide-zone-network-setup:default.log.0
12592024-02-15T00:18:43.412Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-agent:default.log (7756 bytes)
12602024-02-15T00:18:44.546Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-agent:default.log
12612024-02-15T00:18:44.547Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-agent:default.log.0 (9364 bytes)
12622024-02-15T00:18:46.137Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-agent:default.log.0
12632024-02-15T00:18:46.137Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12642024-02-15T00:18:47.213Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:default.log
12652024-02-15T00:18:47.213Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12662024-02-15T00:18:48.339Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12672024-02-15T00:18:48.339Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc5caa45-2562-4cfc-b186-66d0fef068bb.log (1091 bytes)
12682024-02-15T00:18:49.433Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc5caa45-2562-4cfc-b186-66d0fef068bb.log
12692024-02-15T00:18:49.433Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc5caa45-2562-4cfc-b186-66d0fef068bb.log.0 (4603 bytes)
12702024-02-15T00:18:50.539Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc5caa45-2562-4cfc-b186-66d0fef068bb.log.0
12712024-02-15T00:18:50.539Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:snapshot-cc5caa45-2562-4cfc-b186-66d0fef068bb-6cd717ec-8b2b-47d7-95fb-5bbe8d1361df.log (5301 bytes)
12722024-02-15T00:18:51.643Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_661755cb-0b27-4b29-a851-a3a45274279d/root/var/svc/log/oxide-crucible-downstairs:snapshot-cc5caa45-2562-4cfc-b186-66d0fef068bb-6cd717ec-8b2b-47d7-95fb-5bbe8d1361df.log
12732024-02-15T00:18:51.643Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_5e4f48e8-b987-45c0-8c5b-523ef542f945/root/var/svc/log/oxide-internal_dns:default.log (7509 bytes)
12742024-02-15T00:18:51.722Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_5e4f48e8-b987-45c0-8c5b-523ef542f945/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7509 -> 15020
12752024-02-15T00:18:52.799Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_5e4f48e8-b987-45c0-8c5b-523ef542f945/root/var/svc/log/oxide-internal_dns:default.log
12762024-02-15T00:18:52.800Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_5e4f48e8-b987-45c0-8c5b-523ef542f945/root/var/svc/log/oxide-internal_dns:default.log.0 (112186 bytes)
12772024-02-15T00:18:54.066Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_5e4f48e8-b987-45c0-8c5b-523ef542f945/root/var/svc/log/oxide-internal_dns:default.log.0
12782024-02-15T00:18:54.066Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_42ed2c6e-2acb-4dbc-9b39-365d99de97d3/root/var/svc/log/oxide-nexus:default.log (231878 bytes)
12792024-02-15T00:18:54.578Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_42ed2c6e-2acb-4dbc-9b39-365d99de97d3/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 231878 -> 460831
12802024-02-15T00:18:55.658Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_42ed2c6e-2acb-4dbc-9b39-365d99de97d3/root/var/svc/log/oxide-nexus:default.log
12812024-02-15T00:18:55.658Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_42ed2c6e-2acb-4dbc-9b39-365d99de97d3/root/var/svc/log/oxide-nexus:default.log.0 (1066228 bytes)
12822024-02-15T00:18:58.173Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_42ed2c6e-2acb-4dbc-9b39-365d99de97d3/root/var/svc/log/oxide-nexus:default.log.0
12832024-02-15T00:18:58.173Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_f1f5bea5-c368-4f8f-82c1-780dc85b869d/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12842024-02-15T00:18:59.249Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_f1f5bea5-c368-4f8f-82c1-780dc85b869d/root/var/svc/log/oxide-cockroachdb:default.log
12852024-02-15T00:18:59.250Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_f1f5bea5-c368-4f8f-82c1-780dc85b869d/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
12862024-02-15T00:19:00.375Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_f1f5bea5-c368-4f8f-82c1-780dc85b869d/root/var/svc/log/oxide-cockroachdb:default.log.0
12872024-02-15T00:19:00.375Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_f1f5bea5-c368-4f8f-82c1-780dc85b869d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12882024-02-15T00:19:01.473Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_f1f5bea5-c368-4f8f-82c1-780dc85b869d/root/var/svc/log/oxide-zone-network-setup:default.log
12892024-02-15T00:19:01.502Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_f1f5bea5-c368-4f8f-82c1-780dc85b869d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12902024-02-15T00:19:02.569Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_f1f5bea5-c368-4f8f-82c1-780dc85b869d/root/var/svc/log/oxide-zone-network-setup:default.log.0
12912024-02-15T00:19:02.569Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-agent:default.log (10680 bytes)
12922024-02-15T00:19:03.712Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-agent:default.log
12932024-02-15T00:19:03.712Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12942024-02-15T00:19:04.801Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-agent:default.log.0
12952024-02-15T00:19:04.802Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12962024-02-15T00:19:06.295Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-downstairs:default.log
12972024-02-15T00:19:06.295Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12982024-02-15T00:19:07.388Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12992024-02-15T00:19:07.388Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-downstairs:downstairs-a7255352-f21d-4958-b24f-aa21538b3722.log (5606 bytes)
13002024-02-15T00:19:08.496Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_83fba088-495e-4423-abe6-b30a70233d4c/root/var/svc/log/oxide-crucible-downstairs:downstairs-a7255352-f21d-4958-b24f-aa21538b3722.log
13012024-02-15T00:19:08.496Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_9324d491-c0d2-436b-aafc-efea5edebe21/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13022024-02-15T00:19:09.569Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_9324d491-c0d2-436b-aafc-efea5edebe21/root/var/svc/log/oxide-crucible-pantry:default.log
13032024-02-15T00:19:09.569Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_9324d491-c0d2-436b-aafc-efea5edebe21/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2331 bytes)
13042024-02-15T00:19:10.676Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_9324d491-c0d2-436b-aafc-efea5edebe21/root/var/svc/log/oxide-crucible-pantry:default.log.0
13052024-02-15T00:19:10.676Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_527b0aec-e82d-4a9d-bb6e-b3e5df1899a0/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13062024-02-15T00:19:11.751Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_527b0aec-e82d-4a9d-bb6e-b3e5df1899a0/root/var/svc/log/oxide-cockroachdb:default.log
13072024-02-15T00:19:11.751Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_527b0aec-e82d-4a9d-bb6e-b3e5df1899a0/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
13082024-02-15T00:19:12.861Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_527b0aec-e82d-4a9d-bb6e-b3e5df1899a0/root/var/svc/log/oxide-cockroachdb:default.log.0
13092024-02-15T00:19:13.435Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_527b0aec-e82d-4a9d-bb6e-b3e5df1899a0/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13102024-02-15T00:19:14.380Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_527b0aec-e82d-4a9d-bb6e-b3e5df1899a0/root/var/svc/log/oxide-zone-network-setup:default.log
13112024-02-15T00:19:14.381Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_527b0aec-e82d-4a9d-bb6e-b3e5df1899a0/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
13122024-02-15T00:19:15.512Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_527b0aec-e82d-4a9d-bb6e-b3e5df1899a0/root/var/svc/log/oxide-zone-network-setup:default.log.0
13132024-02-15T00:19:15.512Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-agent:default.log (6358 bytes)
13142024-02-15T00:19:17.078Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-agent:default.log
13152024-02-15T00:19:17.078Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13162024-02-15T00:19:18.180Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-agent:default.log.0
13172024-02-15T00:19:18.180Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13182024-02-15T00:19:19.267Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-downstairs:default.log
13192024-02-15T00:19:19.267Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13202024-02-15T00:19:21.189Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13212024-02-15T00:19:21.189Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-downstairs:downstairs-52c1c55c-35b8-4d2a-a22d-104878792491.log (3016 bytes)
13222024-02-15T00:19:22.303Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_c7373a32-5911-4b61-b967-b9351fe9441e/root/var/svc/log/oxide-crucible-downstairs:downstairs-52c1c55c-35b8-4d2a-a22d-104878792491.log
13232024-02-15T00:19:22.330Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-agent:default.log (7756 bytes)
13242024-02-15T00:19:23.449Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-agent:default.log
13252024-02-15T00:19:23.449Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-agent:default.log.0 (9793 bytes)
13262024-02-15T00:19:28.713Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-agent:default.log.0
13272024-02-15T00:19:28.713Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13282024-02-15T00:19:29.956Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:default.log
13292024-02-15T00:19:29.956Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13302024-02-15T00:19:31.220Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13312024-02-15T00:19:31.220Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-ebe073ca-a97d-452a-8176-fd68e05c39cc.log (1091 bytes)
13322024-02-15T00:19:32.752Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-ebe073ca-a97d-452a-8176-fd68e05c39cc.log
13332024-02-15T00:19:32.753Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-ebe073ca-a97d-452a-8176-fd68e05c39cc.log.0 (4603 bytes)
13342024-02-15T00:19:33.851Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-ebe073ca-a97d-452a-8176-fd68e05c39cc.log.0
13352024-02-15T00:19:33.851Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:snapshot-ebe073ca-a97d-452a-8176-fd68e05c39cc-6cd717ec-8b2b-47d7-95fb-5bbe8d1361df.log (5301 bytes)
13362024-02-15T00:19:34.950Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_475bc82c-0c96-4f51-8fdf-e66178c8f3fa/root/var/svc/log/oxide-crucible-downstairs:snapshot-ebe073ca-a97d-452a-8176-fd68e05c39cc-6cd717ec-8b2b-47d7-95fb-5bbe8d1361df.log
13372024-02-15T00:19:34.950Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_052b5be3-98fd-4823-9614-96d5055e333c/root/var/svc/log/oxide-nexus:default.log (681164 bytes)
13382024-02-15T00:19:36.203Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_052b5be3-98fd-4823-9614-96d5055e333c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 681164 -> 1127429
13392024-02-15T00:19:37.275Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_052b5be3-98fd-4823-9614-96d5055e333c/root/var/svc/log/oxide-nexus:default.log
13402024-02-15T00:19:37.275Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_052b5be3-98fd-4823-9614-96d5055e333c/root/var/svc/log/oxide-nexus:default.log.0 (4899329 bytes)
13412024-02-15T00:19:43.294Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_052b5be3-98fd-4823-9614-96d5055e333c/root/var/svc/log/oxide-nexus:default.log.0
13422024-02-15T00:19:43.295Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cad70807-3779-4dbd-b5e8-a3a0e7563ca7/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13432024-02-15T00:19:48.995Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cad70807-3779-4dbd-b5e8-a3a0e7563ca7/root/var/svc/log/oxide-crucible-agent:default.log
13442024-02-15T00:19:48.995Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cad70807-3779-4dbd-b5e8-a3a0e7563ca7/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13452024-02-15T00:19:50.103Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cad70807-3779-4dbd-b5e8-a3a0e7563ca7/root/var/svc/log/oxide-crucible-agent:default.log.0
13462024-02-15T00:19:50.103Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cad70807-3779-4dbd-b5e8-a3a0e7563ca7/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13472024-02-15T00:19:51.189Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cad70807-3779-4dbd-b5e8-a3a0e7563ca7/root/var/svc/log/oxide-crucible-downstairs:default.log
13482024-02-15T00:19:51.189Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cad70807-3779-4dbd-b5e8-a3a0e7563ca7/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13492024-02-15T00:19:52.285Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cad70807-3779-4dbd-b5e8-a3a0e7563ca7/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13502024-02-15T00:19:52.285Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_ad7ed868-02d0-452d-8c54-23c7ef814af4/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13512024-02-15T00:19:53.361Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_ad7ed868-02d0-452d-8c54-23c7ef814af4/root/var/svc/log/oxide-crucible-pantry:default.log
13522024-02-15T00:19:53.361Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_ad7ed868-02d0-452d-8c54-23c7ef814af4/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
13532024-02-15T00:19:54.714Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_ad7ed868-02d0-452d-8c54-23c7ef814af4/root/var/svc/log/oxide-crucible-pantry:default.log.0
13542024-02-15T00:19:54.714Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/svc/log/oxide-ntp:default.log (0 bytes)
13552024-02-15T00:19:55.829Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/svc/log/oxide-ntp:default.log
13562024-02-15T00:19:55.830Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/svc/log/oxide-ntp:default.log.0 (1239 bytes)
13572024-02-15T00:19:57.015Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/svc/log/oxide-ntp:default.log.0
13582024-02-15T00:19:57.015Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-agent:default.log (16175 bytes)
13592024-02-15T00:19:58.157Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-agent:default.log
13602024-02-15T00:19:58.157Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-agent:default.log.0 (14152 bytes)
13612024-02-15T00:19:59.276Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-agent:default.log.0
13622024-02-15T00:19:59.277Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13632024-02-15T00:20:00.351Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:default.log
13642024-02-15T00:20:00.376Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13652024-02-15T00:20:01.450Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13662024-02-15T00:20:01.450Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:downstairs-2b16f97a-0047-41ad-8bde-e0c768c3c0a9.log (5611 bytes)
13672024-02-15T00:20:02.551Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:downstairs-2b16f97a-0047-41ad-8bde-e0c768c3c0a9.log
13682024-02-15T00:20:02.551Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:downstairs-51b86717-556d-4ea0-a796-888782d8891a.log (0 bytes)
13692024-02-15T00:20:03.623Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:downstairs-51b86717-556d-4ea0-a796-888782d8891a.log
13702024-02-15T00:20:03.623Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:downstairs-51b86717-556d-4ea0-a796-888782d8891a.log.0 (3126 bytes)
13712024-02-15T00:20:04.728Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:downstairs-51b86717-556d-4ea0-a796-888782d8891a.log.0
13722024-02-15T00:20:04.728Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:downstairs-df515cee-ca4a-4481-b2f0-c67e20d6c2a0.log (3020 bytes)
13732024-02-15T00:20:05.832Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1234f77-5c34-4c96-bce0-c457facfb566/root/var/svc/log/oxide-crucible-downstairs:downstairs-df515cee-ca4a-4481-b2f0-c67e20d6c2a0.log
13742024-02-15T00:20:05.833Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-agent:default.log (6357 bytes)
13752024-02-15T00:20:06.929Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-agent:default.log
13762024-02-15T00:20:06.929Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13772024-02-15T00:20:08.051Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-agent:default.log.0
13782024-02-15T00:20:08.052Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13792024-02-15T00:20:09.128Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-downstairs:default.log
13802024-02-15T00:20:09.129Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13812024-02-15T00:20:10.260Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13822024-02-15T00:20:10.260Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-downstairs:downstairs-5549831d-c7b7-4aa6-b9d8-48b186ff6bac.log (3020 bytes)
13832024-02-15T00:20:11.383Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3773d36c-8002-400f-9f73-719a40bd0f35/root/var/svc/log/oxide-crucible-downstairs:downstairs-5549831d-c7b7-4aa6-b9d8-48b186ff6bac.log
13842024-02-15T00:20:11.383Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_38b5bd68-0c71-49cc-854d-e90d9972a6f5/root/var/svc/log/oxide-nexus:default.log (8495635 bytes)
13852024-02-15T00:20:13.251Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_38b5bd68-0c71-49cc-854d-e90d9972a6f5/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 8495635 -> 8907254
13862024-02-15T00:20:14.385Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_38b5bd68-0c71-49cc-854d-e90d9972a6f5/root/var/svc/log/oxide-nexus:default.log
13872024-02-15T00:20:14.385Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_38b5bd68-0c71-49cc-854d-e90d9972a6f5/root/var/svc/log/oxide-nexus:default.log.0 (26046556 bytes)
13882024-02-15T00:20:21.447Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_38b5bd68-0c71-49cc-854d-e90d9972a6f5/root/var/svc/log/oxide-nexus:default.log.0
13892024-02-15T00:20:21.448Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/measurements.log (25345 bytes)
13902024-02-15T00:20:21.563Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/measurements.log" changed size mid upload: 25345 -> 32880
13912024-02-15T00:20:23.970Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/measurements.log
13922024-02-15T00:20:23.970Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/statistics.log (17550 bytes)
13932024-02-15T00:20:24.134Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/statistics.log" changed size mid upload: 17550 -> 23751
13942024-02-15T00:20:25.231Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/statistics.log
13952024-02-15T00:20:25.231Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/tracking.log (2514 bytes)
13962024-02-15T00:20:25.278Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/tracking.log" changed size mid upload: 2514 -> 2910
13972024-02-15T00:20:26.349Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_06e1927a-c14e-4e46-8691-4b4ad6c57bc7/root/var/log/chrony/tracking.log