01HPPQ9X3YDSBT7WSGJSX0197G: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HPPQAF948NE3XF4ATXXEVG2E

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-15T16:23:42.311Zjob dependencies complete; ready to run (waiting for 34 m 24 s)
22024-02-15T16:23:42.336Zjob assigned to worker 01HPPRS7Y84S9F9MPSHKN9DNVB (queued for 0 s)
32024-02-15T16:23:42.474ZError: No response to keepalive - Terminating session
42024-02-15T16:23:42.524ZError: No response de-activating SOL payload
52024-02-15T16:23:42.566Z[SOL Session operational. Use ~? for help]
62024-02-15T16:23:42.604Z ok
72024-02-15T16:23:42.645Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
82024-02-15T16:23:42.680Zhttp://172.20.0.5:9969/postboot/sock... ok
92024-02-15T16:23:42.715ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
102024-02-15T16:23:42.749Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
112024-02-15T16:23:42.808ZOxide Helios Version helios-2.0.22451 64-bit
122024-02-15T16:23:42.852ZConfiguring devices.
132024-02-15T16:23:42.893Z##################################################
142024-02-15T16:23:42.937Z#### ############# ##
152024-02-15T16:23:42.983Z### ### ############ ##
162024-02-15T16:23:43.016Z## ### # ## ### ## Oxide Computer Company ##
172024-02-15T16:23:43.049Z## ## ## ### # ### ##
182024-02-15T16:23:43.083Z## # ### #### #### This Station Under ##
192024-02-15T16:23:43.127Z### ### #### # ### Computer Control ##
202024-02-15T16:23:43.161Z#### #### ### ## ##
212024-02-15T16:23:43.194Z##################################################
222024-02-15T16:23:43.252ZHostname: sock
232024-02-15T16:23:43.314ZLoading smf(7) service descriptions:
242024-02-15T16:23:43.551Zsock console login: Error: No response to keepalive - Terminating session
252024-02-15T16:23:43.620ZError: No response de-activating SOL payload
262024-02-15T16:23:43.661Z[SOL Session operational. Use ~? for help]
272024-02-15T16:23:43.703ZError: No response to keepalive - Terminating session
282024-02-15T16:23:43.739ZError: No response de-activating SOL payload
292024-02-15T16:23:43.781Z[SOL Session operational. Use ~? for help]
302024-02-15T16:23:44.717Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-3966c2a0b12b48d6.gz
312024-02-15T16:23:48.599Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-3966c2a0b12b48d6.gz
322024-02-15T16:23:48.599Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
332024-02-15T16:24:13.096Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
342024-02-15T16:24:13.097Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-d84f307ab23cd754.gz
352024-02-15T16:24:35.885Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-d84f307ab23cd754.gz
362024-02-15T16:24:35.914Zdownloading input: /input/ci-tools/work/caboose-util.gz
372024-02-15T16:24:36.919Zdownloaded input: /input/ci-tools/work/caboose-util.gz
382024-02-15T16:24:36.919Zdownloading input: /input/ci-tools/work/tufaceous.gz
392024-02-15T16:24:43.833Zdownloaded input: /input/ci-tools/work/tufaceous.gz
402024-02-15T16:24:43.858Zdownloading input: /input/package/work/version.txt
412024-02-15T16:24:43.859Zdownloaded input: /input/package/work/version.txt
422024-02-15T16:24:43.859Zdownloading input: /input/package/work/package.tar.gz
432024-02-15T16:25:21.505Zdownloaded input: /input/package/work/package.tar.gz
442024-02-15T16:25:21.506Zdownloading input: /input/package/work/global-zone-packages.tar.gz
452024-02-15T16:25:24.739ZError: No response to keepalive - Terminating session
462024-02-15T16:25:34.842ZError: No response de-activating SOL payload
472024-02-15T16:25:35.952Z[SOL Session operational. Use ~? for help]
482024-02-15T16:26:09.010Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
492024-02-15T16:26:09.046Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
502024-02-15T16:26:18.760Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
512024-02-15T16:26:18.793Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
522024-02-15T16:27:11.483Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
532024-02-15T16:27:11.483Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
542024-02-15T16:27:51.942Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
552024-02-15T16:27:51.942Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
562024-02-15T16:28:22.712Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
572024-02-15T16:28:22.712Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
582024-02-15T16:28:24.868ZError: No response to keepalive - Terminating session
592024-02-15T16:28:25.326Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
602024-02-15T16:28:25.326Zdownloading input: /input/package/work/zones/crucible.tar.gz
612024-02-15T16:28:30.935Zdownloaded input: /input/package/work/zones/crucible.tar.gz
622024-02-15T16:28:30.935Zdownloading input: /input/package/work/zones/external-dns.tar.gz
632024-02-15T16:28:34.762ZError: No response de-activating SOL payload
642024-02-15T16:28:35.230Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
652024-02-15T16:28:35.230Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
662024-02-15T16:28:36.123Z[SOL Session operational. Use ~? for help]
672024-02-15T16:28:39.389Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
682024-02-15T16:28:39.389Zdownloading input: /input/package/work/zones/ntp.tar.gz
692024-02-15T16:28:39.426Zdownloaded input: /input/package/work/zones/ntp.tar.gz
702024-02-15T16:28:39.450Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
712024-02-15T16:28:43.110Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
722024-02-15T16:28:43.110Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
732024-02-15T16:28:46.854Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
742024-02-15T16:28:46.854Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
752024-02-15T16:29:01.544Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
762024-02-15T16:29:01.544Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
772024-02-15T16:29:16.391Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
782024-02-15T16:29:16.391Zdownloading input: /input/package/work/zones/overlay.tar.gz
792024-02-15T16:29:16.460Zdownloaded input: /input/package/work/zones/overlay.tar.gz
802024-02-15T16:29:16.485Zdownloading input: /input/package/work/zones/oximeter.tar.gz
812024-02-15T16:29:27.212Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
822024-02-15T16:29:27.212Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
832024-02-15T16:29:38.393Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
842024-02-15T16:29:38.394Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
852024-02-15T16:30:25.657Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
862024-02-15T16:30:25.657Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
872024-02-15T16:31:00.493Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
882024-02-15T16:31:00.494Zstarting task 0: "setup"
892024-02-15T16:31:00.518Z++ uname -s
902024-02-15T16:31:00.518Z+ kern=SunOS
912024-02-15T16:31:00.518Z+ case "$kern" in
922024-02-15T16:31:00.518Z+ groupadd -g 12345 build
932024-02-15T16:31:00.518Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
942024-02-15T16:31:02.512Z+ zfs create -o mountpoint=/work rpool/work
952024-02-15T16:31:02.547Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
962024-02-15T16:31:02.572Z+ home_fs=zfs
972024-02-15T16:31:02.572Z+ [[ zfs == autofs ]]
982024-02-15T16:31:02.572Z+ mkdir -p /home/build
992024-02-15T16:31:02.572Z+ chown build:build /home/build /work
1002024-02-15T16:31:04.555Z+ chmod 0700 /home/build /work
1012024-02-15T16:31:04.578Zprocess exited: duration 4064 ms, exit code 0
 
1022024-02-15T16:31:04.627Zstarting task 1: "authentication"
1032024-02-15T16:31:04.672Zprocess exited: duration 44 ms, exit code 0
 
1042024-02-15T16:31:04.726Zstarting task 2: "build"
1052024-02-15T16:31:04.751Z+ trap _exit_trap EXIT
1062024-02-15T16:31:04.751Z+ set +x
 
1072024-02-15T16:31:24.726ZError: No response to keepalive - Terminating session
 
1082024-02-15T16:31:31.079Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1092024-02-15T16:31:31.324Zsecpolicy_fs_linkdir: 0x55 = 0x55
1102024-02-15T16:31:31.324Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1112024-02-15T16:31:31.324Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1122024-02-15T16:31:31.324Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1132024-02-15T16:31:31.348Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1142024-02-15T16:31:31.348Zsecpolicy_fs_linkdir+5: 0 = 0x1
1152024-02-15T16:31:31.348Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1162024-02-15T16:31:31.348Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1172024-02-15T16:31:31.348Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1182024-02-15T16:31:31.349Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1192024-02-15T16:31:31.349Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1202024-02-15T16:31:31.349Z+ [[ -d /opt/oxide ]]
1212024-02-15T16:31:31.349Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1222024-02-15T16:31:31.349Z+ pfexec mkdir /opt/oxide
1232024-02-15T16:31:31.349Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1242024-02-15T16:31:31.349Z+ [[ -d /opt/oxide-underneath ]]
1252024-02-15T16:31:31.349Z+ cd /opt/oxide-underneath
1262024-02-15T16:31:31.349Z+ pfexec tar ceEp@/f - .
1272024-02-15T16:31:31.349Z+ cd /opt/oxide
1282024-02-15T16:31:31.349Z+ pfexec tar xveEp@/f -
1292024-02-15T16:31:31.385Zx ., 0 bytes, 0 tape blocks
1302024-02-15T16:31:31.385Zx ./opte, 0 bytes, 0 tape blocks
1312024-02-15T16:31:31.385Zx ./opte/bin, 0 bytes, 0 tape blocks
1322024-02-15T16:31:31.385Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1332024-02-15T16:31:31.413Z+ pfexec rm -rf /opt/oxide-underneath
1342024-02-15T16:31:31.413Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1352024-02-15T16:31:31.437Z+ pfexec mkdir /opt/oxide/work
1362024-02-15T16:31:31.437Z+ pfexec chown build:build /opt/oxide/work
1372024-02-15T16:31:31.437Z+ cd /opt/oxide/work
1382024-02-15T16:31:31.437Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1392024-02-15T16:31:33.150ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1402024-02-15T16:31:33.150Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1412024-02-15T16:31:33.150Zx out/omicron-sled-agent.tar, 122871808 bytes, 239984 tape blocks
1422024-02-15T16:31:33.150Zx out/oxlog.tar, 8382464 bytes, 16372 tape blocks
1432024-02-15T16:31:33.150Zx out/target/test, 75 bytes, 1 tape blocks
1442024-02-15T16:31:33.150Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1452024-02-15T16:31:33.150Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1462024-02-15T16:31:33.150Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1472024-02-15T16:31:33.150Zx target/release/omicron-package, 45839216 bytes, 89530 tape blocks
1482024-02-15T16:31:33.150Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1492024-02-15T16:31:33.150Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1502024-02-15T16:31:33.150Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1512024-02-15T16:31:33.150Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1522024-02-15T16:31:33.151Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1532024-02-15T16:31:33.151Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1542024-02-15T16:31:33.151Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1552024-02-15T16:31:33.176Z
1562024-02-15T16:31:33.176Zreal 1.721885650
1572024-02-15T16:31:33.176Zuser 1.541512045
1582024-02-15T16:31:33.176Zsys 0.314474975
1592024-02-15T16:31:33.176Ztrap 0.000058890
1602024-02-15T16:31:33.176Ztflt 0.000000000
1612024-02-15T16:31:33.176Zdflt 0.000000000
1622024-02-15T16:31:33.176Zkflt 0.000000000
1632024-02-15T16:31:33.176Zlock 0.000000000
1642024-02-15T16:31:33.176Zslp 1.544850845
1652024-02-15T16:31:33.176Zlat 0.040666985
1662024-02-15T16:31:33.177Zstop 0.000127800
1672024-02-15T16:31:33.177Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1682024-02-15T16:31:34.397Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1692024-02-15T16:31:34.422Z+ mkdir tests
1702024-02-15T16:31:34.422Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1712024-02-15T16:31:34.422Z+ ptime -m gunzip
1722024-02-15T16:31:34.422Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-3966c2a0b12b48d6
1732024-02-15T16:31:34.652Z
1742024-02-15T16:31:34.677Zreal 0.232064223
1752024-02-15T16:31:34.677Zuser 0.215997528
1762024-02-15T16:31:34.677Zsys 0.015817333
1772024-02-15T16:31:34.677Ztrap 0.000019879
1782024-02-15T16:31:34.677Ztflt 0.000000000
1792024-02-15T16:31:34.677Zdflt 0.000000000
1802024-02-15T16:31:34.677Zkflt 0.000000000
1812024-02-15T16:31:34.677Zlock 0.000000000
1822024-02-15T16:31:34.677Zslp 0.000020660
1832024-02-15T16:31:34.677Zlat 0.000017429
1842024-02-15T16:31:34.677Zstop 0.000121991
1852024-02-15T16:31:34.677Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-3966c2a0b12b48d6
1862024-02-15T16:31:34.677Z+ chmod a+x tests/bootstrap-3966c2a0b12b48d6
1872024-02-15T16:31:34.677Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1882024-02-15T16:31:34.677Z+ ptime -m gunzip
1892024-02-15T16:31:34.677Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
 
1902024-02-15T16:31:34.914ZError: No response de-activating SOL payload
1912024-02-15T16:31:36.013Z[SOL Session operational. Use ~? for help]
 
1922024-02-15T16:31:37.214Z
1932024-02-15T16:31:37.214Zreal 2.550624235
1942024-02-15T16:31:37.214Zuser 2.391249850
1952024-02-15T16:31:37.214Zsys 0.158955791
1962024-02-15T16:31:37.239Ztrap 0.000183741
1972024-02-15T16:31:37.239Ztflt 0.000000000
1982024-02-15T16:31:37.239Zdflt 0.000000000
1992024-02-15T16:31:37.239Zkflt 0.000000000
2002024-02-15T16:31:37.239Zlock 0.000000000
2012024-02-15T16:31:37.239Zslp 0.000019480
2022024-02-15T16:31:37.239Zlat 0.000030950
2032024-02-15T16:31:37.239Zstop 0.000116500
2042024-02-15T16:31:37.239Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
2052024-02-15T16:31:37.239Z+ chmod a+x tests/bootstrap
2062024-02-15T16:31:37.239Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2072024-02-15T16:31:37.239Z+ ptime -m gunzip
2082024-02-15T16:31:37.239Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-d84f307ab23cd754
2092024-02-15T16:31:39.828Z
2102024-02-15T16:31:39.852Zreal 2.602849611
2112024-02-15T16:31:39.852Zuser 2.451792413
2122024-02-15T16:31:39.852Zsys 0.150591536
2132024-02-15T16:31:39.853Ztrap 0.000200950
2142024-02-15T16:31:39.853Ztflt 0.000000000
2152024-02-15T16:31:39.853Zdflt 0.000000000
2162024-02-15T16:31:39.853Zkflt 0.000000000
2172024-02-15T16:31:39.853Zlock 0.000000000
2182024-02-15T16:31:39.853Zslp 0.000022340
2192024-02-15T16:31:39.853Zlat 0.000041019
2202024-02-15T16:31:39.853Zstop 0.000121980
2212024-02-15T16:31:39.853Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-d84f307ab23cd754
2222024-02-15T16:31:39.853Z+ chmod a+x tests/end_to_end_tests-d84f307ab23cd754
2232024-02-15T16:31:39.853Z+ bmat address ls
2242024-02-15T16:31:39.853ZNAME CIDR FIRST LAST COUNT
2252024-02-15T16:31:39.853Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2262024-02-15T16:31:39.853Z++ bmat address ls -f extra -Ho first,last,count
2272024-02-15T16:31:39.878Z+ set -- 10.151.2.164 10.151.2.227 64
2282024-02-15T16:31:39.878Z+ EXTRA_IP_START=10.151.2.164
2292024-02-15T16:31:39.878Z+ EXTRA_IP_END=10.151.2.227
2302024-02-15T16:31:39.878Z+ EXTRA_IP_COUNT=64
2312024-02-15T16:31:39.878Z+ (( EXTRA_IP_COUNT >= 32 ))
2322024-02-15T16:31:39.878Z+ EXTRA_IP_BASE=10.151.2
2332024-02-15T16:31:39.878Z+ EXTRA_IP_FOCTET=164
2342024-02-15T16:31:39.878Z+ EXTRA_IP_LOCTET=227
2352024-02-15T16:31:39.878Z+ SERVICE_IP_POOL_START=10.151.2.164
2362024-02-15T16:31:39.879Z+ SERVICE_IP_POOL_END=10.151.2.173
2372024-02-15T16:31:39.879Z+ DNS_IP1=10.151.2.164
2382024-02-15T16:31:39.879Z+ DNS_IP2=10.151.2.165
2392024-02-15T16:31:39.879Z+ UPLINK_IP=10.151.2.174
2402024-02-15T16:31:39.879Z+ IPPOOL_START=10.151.2.175
2412024-02-15T16:31:39.879Z+ IPPOOL_END=10.151.2.227
2422024-02-15T16:31:39.879Z++ ipadm show-addr -po type,addr
2432024-02-15T16:31:39.879Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2442024-02-15T16:31:39.879Z+ GATEWAY_IP=10.151.2.100
2452024-02-15T16:31:39.879Z+ [[ -n 10.151.2.100 ]]
2462024-02-15T16:31:39.879Z+ ping -s 10.151.2.100 56 1
2472024-02-15T16:31:39.879ZPING 10.151.2.100: 56 data bytes
2482024-02-15T16:31:39.879Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
2492024-02-15T16:31:39.879Z
2502024-02-15T16:31:39.879Z----10.151.2.100 PING Statistics----
2512024-02-15T16:31:39.879Z1 packets transmitted, 1 packets received, 0% packet loss
2522024-02-15T16:31:39.879Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2532024-02-15T16:31:39.879Z++ arp -an
2542024-02-15T16:31:39.879Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2552024-02-15T16:31:39.904Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2562024-02-15T16:31:39.904Z+ routeadm -e ipv4-forwarding -u
2572024-02-15T16:31:39.991Z+ PXA_START=10.151.2.164
2582024-02-15T16:31:39.991Z+ PXA_END=10.151.2.227
2592024-02-15T16:31:40.016Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2602024-02-15T16:31:40.016Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2612024-02-15T16:31:40.187Z+ ZPOOL_VDEV_DIR=/scratch
2622024-02-15T16:31:40.187Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2632024-02-15T16:31:40.212Z+++ dirname ./tools/create_virtual_hardware.sh
2642024-02-15T16:31:40.212Z++ cd ./tools
2652024-02-15T16:31:40.212Z++ pwd
2662024-02-15T16:31:40.212Z+ SOURCE_DIR=/opt/oxide/work/tools
2672024-02-15T16:31:40.212Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2682024-02-15T16:31:40.212Z+ SOFTNPU_MODE=zone
2692024-02-15T16:31:40.212Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2702024-02-15T16:31:40.212Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2712024-02-15T16:31:40.212Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2722024-02-15T16:31:40.212Z++ dladm show-phys -p -o LINK
2732024-02-15T16:31:40.212Z++ head -1
2742024-02-15T16:31:40.237Z+ PHYSICAL_LINK=igb0
2752024-02-15T16:31:40.237Z+ echo 'Using igb0 as physical link'
2762024-02-15T16:31:40.237ZUsing igb0 as physical link
2772024-02-15T16:31:40.237Z+ ensure_run_as_root
2782024-02-15T16:31:40.238Z++ id -u
2792024-02-15T16:31:40.238Z+ [[ 0 -ne 0 ]]
2802024-02-15T16:31:40.238Z+ ensure_zpools
2812024-02-15T16:31:40.238Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2822024-02-15T16:31:40.238Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2832024-02-15T16:31:40.238Z+ readarray -t ZPOOLS
2842024-02-15T16:31:40.238Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2852024-02-15T16:31:40.238Z++ sed 's/[ ",]//g'
2862024-02-15T16:31:40.238Z+ for ZPOOL in "${ZPOOLS[@]}"
2872024-02-15T16:31:40.238Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2882024-02-15T16:31:40.238ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2892024-02-15T16:31:40.238Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2902024-02-15T16:31:40.238Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2912024-02-15T16:31:40.238Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2922024-02-15T16:31:40.238Z0+0 records in
2932024-02-15T16:31:40.238Z0+0 records out
2942024-02-15T16:31:40.238Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2952024-02-15T16:31:40.238Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2962024-02-15T16:31:40.238Z+ set +x
2972024-02-15T16:31:40.238ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2982024-02-15T16:31:40.238Z++ zpool list -o name
2992024-02-15T16:31:40.238Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
3002024-02-15T16:31:40.238Z+ [[ -z '' ]]
3012024-02-15T16:31:40.238Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3022024-02-15T16:31:40.269Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
3032024-02-15T16:31:40.297Z+ set +x
3042024-02-15T16:31:40.297ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3052024-02-15T16:31:40.297Z+ for ZPOOL in "${ZPOOLS[@]}"
3062024-02-15T16:31:40.297Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3072024-02-15T16:31:40.297ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3082024-02-15T16:31:40.297Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3092024-02-15T16:31:40.297Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3102024-02-15T16:31:40.297Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3112024-02-15T16:31:40.297Z0+0 records in
3122024-02-15T16:31:40.297Z0+0 records out
3132024-02-15T16:31:40.297Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3142024-02-15T16:31:40.297Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3152024-02-15T16:31:40.297Z+ set +x
3162024-02-15T16:31:40.297ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3172024-02-15T16:31:40.298Z++ zpool list -o name
3182024-02-15T16:31:40.298Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3192024-02-15T16:31:40.298Z+ [[ -z '' ]]
3202024-02-15T16:31:40.298Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3212024-02-15T16:31:40.323Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3222024-02-15T16:31:40.323Z+ set +x
3232024-02-15T16:31:40.323ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3242024-02-15T16:31:40.323Z+ for ZPOOL in "${ZPOOLS[@]}"
3252024-02-15T16:31:40.323Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3262024-02-15T16:31:40.323ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3272024-02-15T16:31:40.323Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3282024-02-15T16:31:40.323Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3292024-02-15T16:31:40.323Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3302024-02-15T16:31:40.323Z0+0 records in
3312024-02-15T16:31:40.323Z0+0 records out
3322024-02-15T16:31:40.323Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3332024-02-15T16:31:40.323Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3342024-02-15T16:31:40.323Z+ set +x
3352024-02-15T16:31:40.323ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3362024-02-15T16:31:40.323Z++ zpool list -o name
3372024-02-15T16:31:40.323Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3382024-02-15T16:31:40.348Z+ [[ -z '' ]]
3392024-02-15T16:31:40.349Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3402024-02-15T16:31:40.375Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3412024-02-15T16:31:40.375Z+ set +x
3422024-02-15T16:31:40.375ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3432024-02-15T16:31:40.375Z+ for ZPOOL in "${ZPOOLS[@]}"
3442024-02-15T16:31:40.375Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3452024-02-15T16:31:40.375ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3462024-02-15T16:31:40.375Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3472024-02-15T16:31:40.375Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3482024-02-15T16:31:40.375Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3492024-02-15T16:31:40.375Z0+0 records in
3502024-02-15T16:31:40.375Z0+0 records out
3512024-02-15T16:31:40.375Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3522024-02-15T16:31:40.375Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3532024-02-15T16:31:40.375Z+ set +x
3542024-02-15T16:31:40.375ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3552024-02-15T16:31:40.376Z++ zpool list -o name
3562024-02-15T16:31:40.376Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3572024-02-15T16:31:40.376Z+ [[ -z '' ]]
3582024-02-15T16:31:40.376Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3592024-02-15T16:31:40.401Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3602024-02-15T16:31:40.401Z+ set +x
3612024-02-15T16:31:40.402ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3622024-02-15T16:31:40.402Z+ for ZPOOL in "${ZPOOLS[@]}"
3632024-02-15T16:31:40.402Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3642024-02-15T16:31:40.402ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3652024-02-15T16:31:40.402Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3662024-02-15T16:31:40.402Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3672024-02-15T16:31:40.402Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3682024-02-15T16:31:40.402Z0+0 records in
3692024-02-15T16:31:40.402Z0+0 records out
3702024-02-15T16:31:40.402Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3712024-02-15T16:31:40.402Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3722024-02-15T16:31:40.402Z+ set +x
3732024-02-15T16:31:40.402ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3742024-02-15T16:31:40.427Z++ zpool list -o name
3752024-02-15T16:31:40.427Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3762024-02-15T16:31:40.427Z+ [[ -z '' ]]
3772024-02-15T16:31:40.427Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3782024-02-15T16:31:40.452Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3792024-02-15T16:31:40.452Z+ set +x
3802024-02-15T16:31:40.452ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3812024-02-15T16:31:40.452Z+ for ZPOOL in "${ZPOOLS[@]}"
3822024-02-15T16:31:40.452Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3832024-02-15T16:31:40.452ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3842024-02-15T16:31:40.452Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3852024-02-15T16:31:40.452Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3862024-02-15T16:31:40.453Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3872024-02-15T16:31:40.453Z0+0 records in
3882024-02-15T16:31:40.453Z0+0 records out
3892024-02-15T16:31:40.453Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3902024-02-15T16:31:40.453Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3912024-02-15T16:31:40.453Z+ set +x
3922024-02-15T16:31:40.453ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3932024-02-15T16:31:40.453Z++ zpool list -o name
3942024-02-15T16:31:40.453Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3952024-02-15T16:31:40.478Z+ [[ -z '' ]]
3962024-02-15T16:31:40.478Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3972024-02-15T16:31:40.503Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3982024-02-15T16:31:40.503Z+ set +x
3992024-02-15T16:31:40.503ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
4002024-02-15T16:31:40.503Z+ for ZPOOL in "${ZPOOLS[@]}"
4012024-02-15T16:31:40.503Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
4022024-02-15T16:31:40.503ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
4032024-02-15T16:31:40.503Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4042024-02-15T16:31:40.503Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
4052024-02-15T16:31:40.503Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
4062024-02-15T16:31:40.503Z0+0 records in
4072024-02-15T16:31:40.503Z0+0 records out
4082024-02-15T16:31:40.503Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4092024-02-15T16:31:40.503Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4102024-02-15T16:31:40.503Z+ set +x
4112024-02-15T16:31:40.503ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
4122024-02-15T16:31:40.503Z++ zpool list -o name
4132024-02-15T16:31:40.503Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4142024-02-15T16:31:40.503Z+ [[ -z '' ]]
4152024-02-15T16:31:40.503Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4162024-02-15T16:31:40.528Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4172024-02-15T16:31:40.528Z+ set +x
4182024-02-15T16:31:40.529ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4192024-02-15T16:31:40.529Z+ for ZPOOL in "${ZPOOLS[@]}"
4202024-02-15T16:31:40.529Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4212024-02-15T16:31:40.529ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4222024-02-15T16:31:40.529Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4232024-02-15T16:31:40.529Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4242024-02-15T16:31:40.529Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4252024-02-15T16:31:40.529Z0+0 records in
4262024-02-15T16:31:40.529Z0+0 records out
4272024-02-15T16:31:40.529Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4282024-02-15T16:31:40.529Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4292024-02-15T16:31:40.529Z+ set +x
4302024-02-15T16:31:40.529ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4312024-02-15T16:31:40.529Z++ zpool list -o name
4322024-02-15T16:31:40.529Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4332024-02-15T16:31:40.554Z+ [[ -z '' ]]
4342024-02-15T16:31:40.554Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4352024-02-15T16:31:40.578Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4362024-02-15T16:31:40.578Z+ set +x
4372024-02-15T16:31:40.578ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4382024-02-15T16:31:40.579Z+ for ZPOOL in "${ZPOOLS[@]}"
4392024-02-15T16:31:40.579Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4402024-02-15T16:31:40.579ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4412024-02-15T16:31:40.579Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4422024-02-15T16:31:40.579Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4432024-02-15T16:31:40.579Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4442024-02-15T16:31:40.579Z0+0 records in
4452024-02-15T16:31:40.579Z0+0 records out
4462024-02-15T16:31:40.579Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4472024-02-15T16:31:40.579Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4482024-02-15T16:31:40.579Z+ set +x
4492024-02-15T16:31:40.579ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4502024-02-15T16:31:40.579Z++ zpool list -o name
4512024-02-15T16:31:40.579Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4522024-02-15T16:31:40.604Z+ [[ -z '' ]]
4532024-02-15T16:31:40.604Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4542024-02-15T16:31:40.629Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4552024-02-15T16:31:40.629Z+ set +x
4562024-02-15T16:31:40.629ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4572024-02-15T16:31:40.629Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4582024-02-15T16:31:40.629Z+ readarray -t ZPOOLS
4592024-02-15T16:31:40.629Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4602024-02-15T16:31:40.629Z++ sed 's/[ ",]//g'
4612024-02-15T16:31:40.629Z+ for ZPOOL in "${ZPOOLS[@]}"
4622024-02-15T16:31:40.629Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4632024-02-15T16:31:40.629ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4642024-02-15T16:31:40.629Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4652024-02-15T16:31:40.629Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4662024-02-15T16:31:40.629Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4672024-02-15T16:31:40.630Z0+0 records in
4682024-02-15T16:31:40.630Z0+0 records out
4692024-02-15T16:31:40.630Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4702024-02-15T16:31:40.630Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4712024-02-15T16:31:40.630Z+ set +x
4722024-02-15T16:31:40.630ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4732024-02-15T16:31:40.630Z++ zpool list -o name
4742024-02-15T16:31:40.630Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4752024-02-15T16:31:40.630Z+ [[ -z '' ]]
4762024-02-15T16:31:40.630Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4772024-02-15T16:31:40.654Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4782024-02-15T16:31:40.679Z+ set +x
4792024-02-15T16:31:40.679ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4802024-02-15T16:31:40.679Z+ for ZPOOL in "${ZPOOLS[@]}"
4812024-02-15T16:31:40.679Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4822024-02-15T16:31:40.679ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4832024-02-15T16:31:40.679Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4842024-02-15T16:31:40.679Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4852024-02-15T16:31:40.679Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4862024-02-15T16:31:40.679Z0+0 records in
4872024-02-15T16:31:40.679Z0+0 records out
4882024-02-15T16:31:40.680Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4892024-02-15T16:31:40.680Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4902024-02-15T16:31:40.680Z+ set +x
4912024-02-15T16:31:40.680ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4922024-02-15T16:31:40.680Z++ zpool list -o name
4932024-02-15T16:31:40.680Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4942024-02-15T16:31:40.680Z+ [[ -z '' ]]
4952024-02-15T16:31:40.680Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4962024-02-15T16:31:40.708Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4972024-02-15T16:31:40.708Z+ set +x
4982024-02-15T16:31:40.708ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4992024-02-15T16:31:40.708Z+ [[ zone == \z\o\n\e ]]
5002024-02-15T16:31:40.708Z+ ensure_simulated_links igb0
5012024-02-15T16:31:40.708Z+ local PHYSICAL_LINK=igb0
5022024-02-15T16:31:40.708Z+ INDICES=("0" "1")
5032024-02-15T16:31:40.708Z+ for I in "${INDICES[@]}"
5042024-02-15T16:31:40.708Z++ get_simnet_name_if_exists net0
5052024-02-15T16:31:40.708Z++ dladm show-simnet -p -o LINK net0
5062024-02-15T16:31:40.733Z++ echo ''
5072024-02-15T16:31:40.733Z+ [[ -z '' ]]
5082024-02-15T16:31:40.733Z+ dladm create-simnet -t net0
5092024-02-15T16:31:40.733Z+ dladm create-simnet -t sc0_0
5102024-02-15T16:31:40.733Z+ dladm modify-simnet -t -p net0 sc0_0
5112024-02-15T16:31:40.733Z+ dladm set-linkprop -p mtu=9000 sc0_0
5122024-02-15T16:31:40.734Z+ success 'Simnet net0/sc0_0 exists'
5132024-02-15T16:31:40.734Z+ set +x
5142024-02-15T16:31:40.734ZSimnet net0/sc0_0 exists
5152024-02-15T16:31:40.734Z+ for I in "${INDICES[@]}"
5162024-02-15T16:31:40.734Z++ get_simnet_name_if_exists net1
5172024-02-15T16:31:40.734Z++ dladm show-simnet -p -o LINK net1
5182024-02-15T16:31:40.734Z++ echo ''
5192024-02-15T16:31:40.734Z+ [[ -z '' ]]
5202024-02-15T16:31:40.734Z+ dladm create-simnet -t net1
5212024-02-15T16:31:40.734Z+ dladm create-simnet -t sc1_0
5222024-02-15T16:31:40.759Z+ dladm modify-simnet -t -p net1 sc1_0
5232024-02-15T16:31:40.759Z+ dladm set-linkprop -p mtu=9000 sc1_0
5242024-02-15T16:31:40.759Z+ success 'Simnet net1/sc1_0 exists'
5252024-02-15T16:31:40.759Z+ set +x
5262024-02-15T16:31:40.759ZSimnet net1/sc1_0 exists
5272024-02-15T16:31:40.759Z++ get_vnic_name_if_exists sc0_1
5282024-02-15T16:31:40.759Z++ dladm show-vnic -p -o LINK sc0_1
5292024-02-15T16:31:40.759Z++ echo ''
5302024-02-15T16:31:40.759Z+ [[ -z '' ]]
5312024-02-15T16:31:40.759Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5322024-02-15T16:31:40.760Z+ [[ -v PROMISC_FILT_OFF ]]
5332024-02-15T16:31:40.760Z+ success 'Vnic sc0_1 exists'
5342024-02-15T16:31:40.760Z+ set +x
5352024-02-15T16:31:40.760ZVnic sc0_1 exists
5362024-02-15T16:31:40.760Z+ warn_if_no_proxy_arp
5372024-02-15T16:31:40.760Z+ [[ -v PXA_START ]]
5382024-02-15T16:31:40.760Z+ [[ -v PXA_END ]]
5392024-02-15T16:31:40.760Z+ ensure_softnpu_zone
5402024-02-15T16:31:40.760Z+ zoneadm list
5412024-02-15T16:31:40.760Z+ grep -q sidecar_softnpu
5422024-02-15T16:31:40.785Z+ [[ -f out/npuzone/npuzone ]]
5432024-02-15T16:31:40.785Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5442024-02-15T16:31:40.785Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5452024-02-15T16:31:45.294Zdownloading softnpu ...done
5462024-02-15T16:31:45.318Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5472024-02-15T16:31:50.236Zdownloading asic_program.so ...done
5482024-02-15T16:31:50.261Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5492024-02-15T16:31:56.929Zdownloading scadm ...done
5502024-02-15T16:31:56.953Zcreating port tfportrear0_0 for sc0_0
5512024-02-15T16:31:56.953Zcreating port tfportqsfp0_0 for sc0_1
5522024-02-15T16:31:56.954Zsoftnpu zone setup
5532024-02-15T16:31:56.954Zconfigure zone
5542024-02-15T16:31:56.978Zinstall zone
5552024-02-15T16:31:57.998Zboot zone
5562024-02-15T16:32:01.106Z[sidecar_softnpu] svcs milestone/network
5572024-02-15T16:32:01.133ZSTATE STIME FMRI
5582024-02-15T16:32:01.133Zonline 16:31:59 svc:/milestone/network:default
5592024-02-15T16:32:01.133Z[sidecar_softnpu] /softnpu/npu start
5602024-02-15T16:32:01.158Z
5612024-02-15T16:32:01.186Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5622024-02-15T16:32:01.186Z+ GATEWAY_IP=10.151.2.100
5632024-02-15T16:32:01.186Z+ echo 'Using 10.151.2.100 as gateway ip'
5642024-02-15T16:32:01.186ZUsing 10.151.2.100 as gateway ip
5652024-02-15T16:32:01.186Z+ [[ ! -v GATEWAY_MAC ]]
5662024-02-15T16:32:01.186Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
5672024-02-15T16:32:01.186Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5682024-02-15T16:32:01.186Z+++ echo 18:c0:4d:0d:a0:2a
5692024-02-15T16:32:01.186Z+ COUNT=1
5702024-02-15T16:32:01.186Z+ [[ 1 -ne 1 ]]
5712024-02-15T16:32:01.186Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
5722024-02-15T16:32:01.187ZUsing 18:c0:4d:0d:a0:2a as gateway mac
5732024-02-15T16:32:01.187Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5742024-02-15T16:32:01.187Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5752024-02-15T16:32:01.213Z+ PXA_MAC=a8:e1:de:01:70:1d
5762024-02-15T16:32:01.213Z+ [[ -v PXA_START ]]
5772024-02-15T16:32:01.213Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5782024-02-15T16:32:01.213Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5792024-02-15T16:32:01.238Z+ z_scadm dump-state
5802024-02-15T16:32:01.238Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5812024-02-15T16:32:01.263Zlocal v6:
5822024-02-15T16:32:01.263Zlocal v4:
5832024-02-15T16:32:01.263Zrouter v6:
5842024-02-15T16:32:01.263Zrouter v4_idx:
5852024-02-15T16:32:01.263Zrouter v4_routes:
5862024-02-15T16:32:01.263Zresolver v4:
5872024-02-15T16:32:01.263Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
5882024-02-15T16:32:01.263Zresolver v6:
5892024-02-15T16:32:01.263Znat v4:
5902024-02-15T16:32:01.263Znat_v6:
5912024-02-15T16:32:01.263Zport_mac:
5922024-02-15T16:32:01.263Zproxy arp:
5932024-02-15T16:32:01.263Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
5942024-02-15T16:32:01.263Z+ success 'softnpu zone exists'
5952024-02-15T16:32:01.263Z+ set +x
5962024-02-15T16:32:01.263Zsoftnpu zone exists
5972024-02-15T16:32:01.263Z
5982024-02-15T16:32:01.263Zreal 21.068196474
5992024-02-15T16:32:01.263Zuser 0.687734461
6002024-02-15T16:32:01.264Zsys 1.526660023
6012024-02-15T16:32:01.264Ztrap 0.000070649
6022024-02-15T16:32:01.264Ztflt 0.000156751
6032024-02-15T16:32:01.264Zdflt 0.000874139
6042024-02-15T16:32:01.264Zkflt 0.000002880
6052024-02-15T16:32:01.264Zlock 16:17.558019287
6062024-02-15T16:32:01.264Zslp 1:02.926096306
6072024-02-15T16:32:01.264Zlat 0.077234710
6082024-02-15T16:32:01.264Zstop 0.331695162
6092024-02-15T16:32:01.264Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
6102024-02-15T16:32:01.300Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6112024-02-15T16:32:01.326Z+ SILO_NAME=recovery
6122024-02-15T16:32:01.326Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6132024-02-15T16:32:01.326Z+ EXTERNAL_DNS_DOMAIN=oxide.test
6142024-02-15T16:32:01.326Z+ sed -i~ '
6152024-02-15T16:32:01.326Z /^external_dns_ips/c\
6162024-02-15T16:32:01.326Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6172024-02-15T16:32:01.326Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6182024-02-15T16:32:01.326Z /^first/c\
6192024-02-15T16:32:01.326Zfirst = "10.151.2.164"
6202024-02-15T16:32:01.326Z /^last/c\
6212024-02-15T16:32:01.326Zlast = "10.151.2.173"
6222024-02-15T16:32:01.326Z }
6232024-02-15T16:32:01.326Z /^\[rack_network_config/,/^$/ {
6242024-02-15T16:32:01.326Z /^infra_ip_first/c\
6252024-02-15T16:32:01.326Zinfra_ip_first = "10.151.2.174"
6262024-02-15T16:32:01.326Z /^infra_ip_last/c\
6272024-02-15T16:32:01.326Zinfra_ip_last = "10.151.2.174"
6282024-02-15T16:32:01.326Z }
6292024-02-15T16:32:01.327Z /^\[\[rack_network_config.ports/,/^$/ {
6302024-02-15T16:32:01.327Z /^routes/c\
6312024-02-15T16:32:01.327Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
6322024-02-15T16:32:01.327Z /^addresses/c\
6332024-02-15T16:32:01.327Zaddresses = \["10.151.2.174/24"\]
6342024-02-15T16:32:01.327Z }
6352024-02-15T16:32:01.327Z' pkg/config-rss.toml
6362024-02-15T16:32:01.327Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6372024-02-15T16:32:01.327Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6382024-02-15T16:32:01.327Z+++ pkg/config-rss.toml Thu Feb 15 16:32:01 2024
6392024-02-15T16:32:01.327Z@@ -33,7 +33,7 @@
6402024-02-15T16:32:01.327Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6412024-02-15T16:32:01.327Z # must be contained in one of the "internal services" IP Pool ranges listed
6422024-02-15T16:32:01.327Z # below.
6432024-02-15T16:32:01.327Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6442024-02-15T16:32:01.327Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6452024-02-15T16:32:01.327Z
6462024-02-15T16:32:01.327Z # Initial TLS certificates for the external API
6472024-02-15T16:32:01.327Z #
6482024-02-15T16:32:01.327Z@@ -69,8 +69,8 @@
6492024-02-15T16:32:01.327Z #
6502024-02-15T16:32:01.327Z # For more on this and what to put here, see docs/how-to-run.adoc.
6512024-02-15T16:32:01.327Z [[internal_services_ip_pool_ranges]]
6522024-02-15T16:32:01.328Z-first = "192.168.1.20"
6532024-02-15T16:32:01.328Z-last = "192.168.1.29"
6542024-02-15T16:32:01.328Z+first = "10.151.2.164"
6552024-02-15T16:32:01.328Z+last = "10.151.2.173"
6562024-02-15T16:32:01.328Z
6572024-02-15T16:32:01.328Z # TODO - this configuration is subject to change going forward. Ultimately these
6582024-02-15T16:32:01.328Z # parameters should be provided to the control plane via wicket, but we need to
6592024-02-15T16:32:01.328Z@@ -100,9 +100,9 @@
6602024-02-15T16:32:01.328Z # You can configure multiple uplinks by repeating the following stanza
6612024-02-15T16:32:01.328Z [[rack_network_config.ports]]
6622024-02-15T16:32:01.328Z # Routes associated with this port.
6632024-02-15T16:32:01.328Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6642024-02-15T16:32:01.328Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
6652024-02-15T16:32:01.328Z # Addresses associated with this port.
6662024-02-15T16:32:01.328Z-addresses = ["192.168.1.30/24"]
6672024-02-15T16:32:01.328Z+addresses = ["10.151.2.174/24"]
6682024-02-15T16:32:01.328Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6692024-02-15T16:32:01.328Z port = "qsfp0"
6702024-02-15T16:32:01.328Z # The speed of this port.
6712024-02-15T16:32:01.328Z+ true
6722024-02-15T16:32:01.328Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6732024-02-15T16:32:01.328Za pkg/config-rss.toml 7K
6742024-02-15T16:32:01.328Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6752024-02-15T16:32:01.329Z+ TLS_NAME=recovery.sys.oxide.test
6762024-02-15T16:32:01.329Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6772024-02-15T16:32:01.897Z..+.........+.....+......+.+......+........+.+......+.....+....+......+........+.+...+......+..+.........+...+.+......+...+.....+.+.....+.+.........+......+...+..+..........+.....+...+.......+......+..+...+...+.......+........+.......+..+..........+..+......+.......+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+.....+..........+......+..+....+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+......+.+..+.+...............+..+.............+.....+.+...+.................+.+............+...+..+......+....+...........+.........+............+......+...+.+...+...+..+......................+......+..+......+.+........+.......+.....+.+.....+..............................+............+..........+...........+.+.....+....+.....+......+......+...+..........+.....+...................+......+..+.............+..+....+......+..+.+...........+......+...............+.....................................+..+..........+...+...........+...............+......+....+.....+....+.......................+.........+.....................+...+....+.....+............................+.....+....+......+..+...+.........+.+...+.........+...+..+.+..+.......+..+.........+.+........+.+..+..........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6782024-02-15T16:32:02.497Z.......+.+...+.....+.........+.+..+..........+.....+....+...+..+.+...+...........+...+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+........+...+.+...+........+...+..........+.....+.......+..+......+.+......+..............+....+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..........+..................+.................+............+......+......+.+........+................+.........+.........+...+.........+...+.....+.+.....+.......+........+......+.+.....+....+........................+......+...+............+...+..........................+.+........+...+..........+.....+.........+.+.....+...+......+.............+..........................+.......+.........+.....+.+...+..+...................+..................+.....+................+......+........+..........+..+.+........+......+...+...+..................+....+..+.+.................+.....................+............+............+.+..............+...+...............+....+...+......+.....+......+...................+.........+...............+...........................+..............+............+...+....+.....+..........+............+........+...+...+.......+..............+.........+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6792024-02-15T16:32:02.523Z-----
6802024-02-15T16:32:02.523Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6812024-02-15T16:32:02.523Za pkg/initial-tls-cert.pem 2K
6822024-02-15T16:32:02.523Za pkg/initial-tls-key.pem 4K
6832024-02-15T16:32:02.523Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6842024-02-15T16:32:02.549Z+ rmdir pkg
6852024-02-15T16:32:02.549Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6862024-02-15T16:32:02.549Z+ pfexec mkdir -p /usr/oxide
6872024-02-15T16:32:02.549Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6882024-02-15T16:32:03.248Z+ pfexec chmod +x /usr/oxide/oxide
6892024-02-15T16:32:03.274Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6902024-02-15T16:32:21.562Z+ OMICRON_NO_UNINSTALL=1
6912024-02-15T16:32:21.562Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6922024-02-15T16:32:21.586ZLogging to: /opt/oxide/work/out/LOG
6932024-02-15T16:32:22.115Z
6942024-02-15T16:32:22.139Zreal 0.548264875
6952024-02-15T16:32:22.139Zuser 0.109792066
6962024-02-15T16:32:22.140Zsys 2.302055523
6972024-02-15T16:32:22.140Ztrap 0.000018858
6982024-02-15T16:32:22.140Ztflt 0.000095289
6992024-02-15T16:32:22.140Zdflt 0.001642332
7002024-02-15T16:32:22.140Zkflt 0.000001180
7012024-02-15T16:32:22.140Zlock 49.725807204
7022024-02-15T16:32:22.140Zslp 0.840642908
7032024-02-15T16:32:22.140Zlat 0.003803328
7042024-02-15T16:32:22.140Zstop 0.214911193
7052024-02-15T16:32:22.140Z+ retry=0
7062024-02-15T16:32:22.140Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-02-15T16:32:22.140Z+ [[ 0 -gt 30 ]]
7082024-02-15T16:32:22.140Z+ sleep 1
7092024-02-15T16:32:23.131Z+ retry=1
7102024-02-15T16:32:23.131Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7112024-02-15T16:32:23.156Z+ [[ 1 -gt 30 ]]
7122024-02-15T16:32:23.156Z+ sleep 1
7132024-02-15T16:32:24.146Z+ retry=2
7142024-02-15T16:32:24.146Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7152024-02-15T16:32:24.171Z+ [[ 2 -gt 30 ]]
7162024-02-15T16:32:24.171Z+ sleep 1
7172024-02-15T16:32:25.163Z+ retry=3
7182024-02-15T16:32:25.163Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7192024-02-15T16:32:25.188Z+ [[ 3 -gt 30 ]]
7202024-02-15T16:32:25.188Z+ sleep 1
7212024-02-15T16:32:26.174Z+ retry=4
7222024-02-15T16:32:26.174Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7232024-02-15T16:32:51.349Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7242024-02-15T16:32:51.378Zlocal v6:
7252024-02-15T16:32:51.378Zfda2:4dcf:e395:6880::1
7262024-02-15T16:32:51.378Zfe80::851:d4ff:fec0:d0a8
7272024-02-15T16:32:51.378Zlocal v4:
7282024-02-15T16:32:51.378Z10.151.2.174
7292024-02-15T16:32:51.378Zrouter v6:
7302024-02-15T16:32:51.378Zfd00:1122:3344:2::/64 -> fe80::5440:71ff:fe2c:e2b0 (1)
7312024-02-15T16:32:51.378Zfd00:1122:3344:3::/64 -> fe80::5440:71ff:fe2c:e2b0 (1)
7322024-02-15T16:32:51.378Zfd00:1122:3344:101::/64 -> fe80::5440:71ff:fe2c:e2b0 (1)
7332024-02-15T16:32:51.378Zfdb0:18c0:4d0d:a02a::/64 -> fe80::5440:71ff:fe2c:e2b0 (1)
7342024-02-15T16:32:51.378Zfd00:1122:3344:1::/64 -> fe80::5440:71ff:fe2c:e2b0 (1)
7352024-02-15T16:32:51.378Zrouter v4_idx:
7362024-02-15T16:32:51.378Z0.0.0.0/0 -> 0
7372024-02-15T16:32:51.378Zrouter v4_routes:
7382024-02-15T16:32:51.378Z0 -> 10.151.2.100 (2)
7392024-02-15T16:32:51.378Zresolver v4:
7402024-02-15T16:32:51.403Z10.151.2.174 -> 96:5c:ae:31:a8:40
7412024-02-15T16:32:51.403Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7422024-02-15T16:32:51.403Zresolver v6:
7432024-02-15T16:32:51.403Zfe80::851:d4ff:fec0:d0a8 -> 0a:51:d4:c0:d0:a8
7442024-02-15T16:32:51.403Zfe80::5440:71ff:fe2c:e2b0 -> 56:40:71:2c:e2:b0
7452024-02-15T16:32:51.403Znat v4:
7462024-02-15T16:32:51.403Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:dc:04
7472024-02-15T16:32:51.403Znat_v6:
7482024-02-15T16:32:51.403Zport_mac:
7492024-02-15T16:32:51.404Z2: a8:40:25:24:18:f7
7502024-02-15T16:32:51.404Z1: a8:40:25:24:18:d7
7512024-02-15T16:32:51.404Z1000: a8:40:25:24:18:d6
7522024-02-15T16:32:51.404Zproxy arp:
7532024-02-15T16:32:51.404Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7542024-02-15T16:32:51.404Z+ retry=0
7552024-02-15T16:32:51.404Z+++ zoneadm list -n
7562024-02-15T16:32:51.404Z+++ grep oxz_ntp
7572024-02-15T16:32:51.404Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
7582024-02-15T16:32:51.431Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7592024-02-15T16:32:51.431Z++ true
7602024-02-15T16:32:51.431Z+ [[ '' != online ]]
7612024-02-15T16:32:51.431Z+ [[ 0 -gt 60 ]]
7622024-02-15T16:32:51.431Z+ sleep 1
7632024-02-15T16:32:52.410Z+ retry=1
7642024-02-15T16:32:52.435Z+++ zoneadm list -n
7652024-02-15T16:32:52.435Z+++ grep oxz_ntp
7662024-02-15T16:32:52.435Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
7672024-02-15T16:32:52.459Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7682024-02-15T16:32:52.459Z++ true
7692024-02-15T16:32:52.459Z+ [[ '' != online ]]
7702024-02-15T16:32:52.459Z+ [[ 1 -gt 60 ]]
7712024-02-15T16:32:52.459Z+ sleep 1
7722024-02-15T16:32:53.440Z+ retry=2
7732024-02-15T16:32:53.465Z+++ zoneadm list -n
7742024-02-15T16:32:53.465Z+++ grep oxz_ntp
7752024-02-15T16:32:53.465Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
7762024-02-15T16:32:53.465Z+ [[ disabled != online ]]
7772024-02-15T16:32:53.465Z+ [[ 2 -gt 60 ]]
7782024-02-15T16:32:53.465Z+ sleep 1
7792024-02-15T16:32:54.542Z+ retry=3
7802024-02-15T16:32:54.595Z+++ zoneadm list -n
7812024-02-15T16:32:54.595Z+++ grep oxz_ntp
7822024-02-15T16:32:54.595Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
7832024-02-15T16:32:54.595Z+ [[ disabled != online ]]
7842024-02-15T16:32:54.595Z+ [[ 3 -gt 60 ]]
7852024-02-15T16:32:54.595Z+ sleep 1
7862024-02-15T16:32:55.487Z+ retry=4
7872024-02-15T16:32:55.512Z+++ zoneadm list -n
7882024-02-15T16:32:55.512Z+++ grep oxz_ntp
7892024-02-15T16:32:55.512Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
7902024-02-15T16:32:55.512Z+ [[ disabled != online ]]
7912024-02-15T16:32:55.512Z+ [[ 4 -gt 60 ]]
7922024-02-15T16:32:55.512Z+ sleep 1
7932024-02-15T16:32:56.510Z+ retry=5
7942024-02-15T16:32:56.537Z+++ zoneadm list -n
7952024-02-15T16:32:56.537Z+++ grep oxz_ntp
7962024-02-15T16:32:56.538Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
7972024-02-15T16:32:56.538Z+ [[ disabled != online ]]
7982024-02-15T16:32:56.538Z+ [[ 5 -gt 60 ]]
7992024-02-15T16:32:56.538Z+ sleep 1
8002024-02-15T16:32:57.532Z+ retry=6
8012024-02-15T16:32:57.557Z+++ zoneadm list -n
8022024-02-15T16:32:57.557Z+++ grep oxz_ntp
8032024-02-15T16:32:57.557Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
8042024-02-15T16:32:57.557Z+ [[ disabled != online ]]
8052024-02-15T16:32:57.557Z+ [[ 6 -gt 60 ]]
8062024-02-15T16:32:57.557Z+ sleep 1
8072024-02-15T16:32:58.554Z+ retry=7
8082024-02-15T16:32:58.579Z+++ zoneadm list -n
8092024-02-15T16:32:58.579Z+++ grep oxz_ntp
8102024-02-15T16:32:58.579Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
8112024-02-15T16:32:58.579Z+ [[ disabled != online ]]
8122024-02-15T16:32:58.579Z+ [[ 7 -gt 60 ]]
8132024-02-15T16:32:58.579Z+ sleep 1
8142024-02-15T16:32:59.575Z+ retry=8
8152024-02-15T16:32:59.600Z+++ zoneadm list -n
8162024-02-15T16:32:59.600Z+++ grep oxz_ntp
8172024-02-15T16:32:59.600Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
8182024-02-15T16:32:59.600Z+ [[ disabled != online ]]
8192024-02-15T16:32:59.600Z+ [[ 8 -gt 60 ]]
8202024-02-15T16:32:59.600Z+ sleep 1
 
8212024-02-15T16:33:00.546ZFeb 15 16:32:59 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8222024-02-15T16:33:00.599Z+ retry=9
8232024-02-15T16:33:00.623Z+++ zoneadm list -n
8242024-02-15T16:33:00.623Z+++ grep oxz_ntp
8252024-02-15T16:33:00.623Z++ pfexec svcs -z oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d -Hostate oxide/ntp
8262024-02-15T16:33:00.623Z+ [[ online != online ]]
8272024-02-15T16:33:00.623Z+ echo 'Waited for chrony: 9s'
8282024-02-15T16:33:00.623ZWaited for chrony: 9s
8292024-02-15T16:33:00.624Z+ export RUST_BACKTRACE=1
8302024-02-15T16:33:00.624Z+ RUST_BACKTRACE=1
8312024-02-15T16:33:00.624Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8322024-02-15T16:33:00.624Z++ ./tests/bootstrap
8332024-02-15T16:33:00.648ZUsing external DNS server at 10.151.2.164:53
8342024-02-15T16:33:00.673Z2024-02-15 16:33:00.360616158 UTC: attempting to log into API
8352024-02-15T16:33:15.686Z2024-02-15 16:33:15.406041699 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8362024-02-15T16:33:16.691Z2024-02-15 16:33:16.407158383 UTC: attempting to log into API
8372024-02-15T16:33:31.718Z2024-02-15 16:33:31.437942517 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8382024-02-15T16:33:32.719Z2024-02-15 16:33:32.438878410 UTC: attempting to log into API
8392024-02-15T16:33:47.752Z2024-02-15 16:33:47.471520198 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8402024-02-15T16:33:48.754Z2024-02-15 16:33:48.473220427 UTC: attempting to log into API
8412024-02-15T16:34:03.786Z2024-02-15 16:34:03.504447244 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8422024-02-15T16:34:04.786Z2024-02-15 16:34:04.505322507 UTC: attempting to log into API
8432024-02-15T16:34:30.656Z2024-02-15 16:34:19.557649968 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8442024-02-15T16:34:30.656Z2024-02-15 16:34:20.562198933 UTC: attempting to log into API
8452024-02-15T16:34:35.865Z2024-02-15 16:34:35.635450317 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8462024-02-15T16:34:36.854Z2024-02-15 16:34:36.638858333 UTC: attempting to log into API
 
8472024-02-15T16:34:40.626ZError: No response to keepalive - Terminating session
8482024-02-15T16:34:51.190ZError: No response de-activating SOL payload
 
8492024-02-15T16:34:51.886Z2024-02-15 16:34:51.711445064 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8502024-02-15T16:34:52.018Z[SOL Session operational. Use ~? for help]
 
8512024-02-15T16:34:52.888Z2024-02-15 16:34:52.715865688 UTC: attempting to log into API
8522024-02-15T16:35:07.921Z2024-02-15 16:35:07.789012503 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8532024-02-15T16:35:08.922Z2024-02-15 16:35:08.793464974 UTC: attempting to log into API
8542024-02-15T16:35:23.954Z2024-02-15 16:35:23.866026121 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8552024-02-15T16:35:24.954Z2024-02-15 16:35:24.869654773 UTC: attempting to log into API
8562024-02-15T16:35:39.986Z2024-02-15 16:35:39.942074058 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8572024-02-15T16:35:40.987Z2024-02-15 16:35:40.945640550 UTC: attempting to log into API
8582024-02-15T16:35:56.022Z2024-02-15 16:35:56.007229046 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8592024-02-15T16:35:57.020Z2024-02-15 16:35:57.008930655 UTC: attempting to log into API
8602024-02-15T16:36:12.135Z2024-02-15 16:36:12.117167946 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8612024-02-15T16:36:13.136Z2024-02-15 16:36:13.117817406 UTC: attempting to log into API
8622024-02-15T16:36:28.160Z2024-02-15 16:36:28.148944365 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8632024-02-15T16:36:29.164Z2024-02-15 16:36:29.149906008 UTC: attempting to log into API
8642024-02-15T16:36:44.196Z2024-02-15 16:36:44.182365994 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8652024-02-15T16:36:45.205Z2024-02-15 16:36:45.183441198 UTC: attempting to log into API
8662024-02-15T16:37:00.263Z2024-02-15 16:37:00.249849100 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8672024-02-15T16:37:01.275Z2024-02-15 16:37:01.252398716 UTC: attempting to log into API
8682024-02-15T16:37:16.332Z2024-02-15 16:37:16.317371848 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8692024-02-15T16:37:17.333Z2024-02-15 16:37:17.318471172 UTC: attempting to log into API
8702024-02-15T16:37:32.366Z2024-02-15 16:37:32.350318413 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8712024-02-15T16:37:33.363Z2024-02-15 16:37:33.351364007 UTC: attempting to log into API
 
8722024-02-15T16:37:40.696ZError: No response to keepalive - Terminating session
 
8732024-02-15T16:37:48.396Z2024-02-15 16:37:48.383476679 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8742024-02-15T16:37:49.396Z2024-02-15 16:37:49.384559553 UTC: attempting to log into API
 
8752024-02-15T16:37:50.852ZError: No response de-activating SOL payload
8762024-02-15T16:37:51.946Z[SOL Session operational. Use ~? for help]
 
8772024-02-15T16:38:04.429Z2024-02-15 16:38:04.416641646 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8782024-02-15T16:38:05.429Z2024-02-15 16:38:05.417733280 UTC: attempting to log into API
8792024-02-15T16:38:06.222Z2024-02-15 16:38:06.210925915 UTC: login succeeded
8802024-02-15T16:38:06.254Zwaiting for nexus to come up...
8812024-02-15T16:38:06.334Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8822024-02-15T16:38:06.517Zsetting up quotas...
8832024-02-15T16:38:06.562Zensuring datasets are ready...
8842024-02-15T16:38:09.145Zlet's roll.
8852024-02-15T16:38:09.169Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8862024-02-15T16:38:09.169ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8872024-02-15T16:38:09.169ZOXIDE_TOKEN=oxide-token-3f8699a2fd976a4a555736b11980e0983ed9a38a'
8882024-02-15T16:38:09.169Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8892024-02-15T16:38:09.169Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8902024-02-15T16:38:09.169Z++ OXIDE_TOKEN=oxide-token-3f8699a2fd976a4a555736b11980e0983ed9a38a
8912024-02-15T16:38:09.170Z+ export OXIDE_HOST OXIDE_TOKEN
8922024-02-15T16:38:09.170Z+ retry=0
8932024-02-15T16:38:09.170Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8942024-02-15T16:38:09.194Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8952024-02-15T16:38:09.194Z+ [[ 0 -gt 60 ]]
8962024-02-15T16:38:09.194Z+ sleep 1
8972024-02-15T16:38:10.184Z+ retry=1
8982024-02-15T16:38:10.184Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8992024-02-15T16:38:10.209Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9002024-02-15T16:38:10.209Z+ [[ 1 -gt 60 ]]
9012024-02-15T16:38:10.209Z+ sleep 1
9022024-02-15T16:38:11.199Z+ retry=2
9032024-02-15T16:38:11.199Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9042024-02-15T16:38:11.223Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9052024-02-15T16:38:11.223Z+ [[ 2 -gt 60 ]]
9062024-02-15T16:38:11.223Z+ sleep 1
9072024-02-15T16:38:12.220Z+ retry=3
9082024-02-15T16:38:12.220Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9092024-02-15T16:38:12.244Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9102024-02-15T16:38:12.244Z+ [[ 3 -gt 60 ]]
9112024-02-15T16:38:12.244Z+ sleep 1
9122024-02-15T16:38:13.231Z+ retry=4
9132024-02-15T16:38:13.231Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9142024-02-15T16:38:13.255Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9152024-02-15T16:38:13.255Z+ [[ 4 -gt 60 ]]
9162024-02-15T16:38:13.255Z+ sleep 1
9172024-02-15T16:38:14.246Z+ retry=5
9182024-02-15T16:38:14.246Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9192024-02-15T16:38:14.270Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9202024-02-15T16:38:14.271Z+ [[ 5 -gt 60 ]]
9212024-02-15T16:38:14.271Z+ sleep 1
9222024-02-15T16:38:15.260Z+ retry=6
9232024-02-15T16:38:15.260Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9242024-02-15T16:38:15.285Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9252024-02-15T16:38:15.285Z+ [[ 6 -gt 60 ]]
9262024-02-15T16:38:15.285Z+ sleep 1
9272024-02-15T16:38:16.277Z+ retry=7
9282024-02-15T16:38:16.277Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9292024-02-15T16:38:16.302Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9302024-02-15T16:38:16.302Z+ [[ 7 -gt 60 ]]
9312024-02-15T16:38:16.303Z+ sleep 1
9322024-02-15T16:38:17.293Z+ retry=8
9332024-02-15T16:38:17.293Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9342024-02-15T16:38:17.317Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9352024-02-15T16:38:17.317Z+ [[ 8 -gt 60 ]]
9362024-02-15T16:38:17.318Z+ sleep 1
9372024-02-15T16:38:18.309Z+ retry=9
9382024-02-15T16:38:18.309Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9392024-02-15T16:38:18.334Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9402024-02-15T16:38:18.334Z+ [[ 9 -gt 60 ]]
9412024-02-15T16:38:18.334Z+ sleep 1
9422024-02-15T16:38:19.325Z+ retry=10
9432024-02-15T16:38:19.325Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9442024-02-15T16:38:19.350Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9452024-02-15T16:38:19.351Z+ [[ 10 -gt 60 ]]
9462024-02-15T16:38:19.351Z+ sleep 1
9472024-02-15T16:38:20.341Z+ retry=11
9482024-02-15T16:38:20.341Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9492024-02-15T16:38:20.365Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9502024-02-15T16:38:20.365Z+ [[ 11 -gt 60 ]]
9512024-02-15T16:38:20.365Z+ sleep 1
9522024-02-15T16:38:21.355Z+ retry=12
9532024-02-15T16:38:21.379Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9542024-02-15T16:38:21.379Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9552024-02-15T16:38:21.379Z+ [[ 12 -gt 60 ]]
9562024-02-15T16:38:21.379Z+ sleep 1
9572024-02-15T16:38:22.373Z+ retry=13
9582024-02-15T16:38:22.373Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9592024-02-15T16:38:22.398Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9602024-02-15T16:38:22.398Z+ [[ 13 -gt 60 ]]
9612024-02-15T16:38:22.398Z+ sleep 1
9622024-02-15T16:38:23.387Z+ retry=14
9632024-02-15T16:38:23.387Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9642024-02-15T16:38:23.411Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9652024-02-15T16:38:23.412Z+ [[ 14 -gt 60 ]]
9662024-02-15T16:38:23.412Z+ sleep 1
9672024-02-15T16:38:24.404Z+ retry=15
9682024-02-15T16:38:24.404Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9692024-02-15T16:38:24.428Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9702024-02-15T16:38:24.429Z+ [[ 15 -gt 60 ]]
9712024-02-15T16:38:24.429Z+ sleep 1
9722024-02-15T16:38:25.419Z+ retry=16
9732024-02-15T16:38:25.419Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9742024-02-15T16:38:25.443Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9752024-02-15T16:38:25.443Z+ [[ 16 -gt 60 ]]
9762024-02-15T16:38:25.443Z+ sleep 1
9772024-02-15T16:38:26.434Z+ retry=17
9782024-02-15T16:38:26.434Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9792024-02-15T16:38:26.458Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9802024-02-15T16:38:26.458Z+ [[ 17 -gt 60 ]]
9812024-02-15T16:38:26.458Z+ sleep 1
9822024-02-15T16:38:27.449Z+ retry=18
9832024-02-15T16:38:27.449Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9842024-02-15T16:38:27.473Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9852024-02-15T16:38:27.473Z+ [[ 18 -gt 60 ]]
9862024-02-15T16:38:27.473Z+ sleep 1
9872024-02-15T16:38:28.463Z+ retry=19
9882024-02-15T16:38:28.463Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9892024-02-15T16:38:28.487Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9902024-02-15T16:38:28.488Z+ [[ 19 -gt 60 ]]
9912024-02-15T16:38:28.488Z+ sleep 1
9922024-02-15T16:38:29.498Z+ retry=20
9932024-02-15T16:38:29.498Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9942024-02-15T16:38:29.498Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9952024-02-15T16:38:29.498Z+ [[ 20 -gt 60 ]]
9962024-02-15T16:38:29.498Z+ sleep 1
9972024-02-15T16:38:30.497Z+ retry=21
9982024-02-15T16:38:30.497Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9992024-02-15T16:38:30.521Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10002024-02-15T16:38:30.521Z+ [[ 21 -gt 60 ]]
10012024-02-15T16:38:30.521Z+ sleep 1
10022024-02-15T16:38:31.510Z+ retry=22
10032024-02-15T16:38:31.510Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10042024-02-15T16:38:31.534Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10052024-02-15T16:38:31.534Z+ [[ 22 -gt 60 ]]
10062024-02-15T16:38:31.534Z+ sleep 1
10072024-02-15T16:38:32.525Z+ retry=23
10082024-02-15T16:38:32.525Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10092024-02-15T16:38:32.549Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10102024-02-15T16:38:32.549Z+ [[ 23 -gt 60 ]]
10112024-02-15T16:38:32.549Z+ sleep 1
10122024-02-15T16:38:33.540Z+ retry=24
10132024-02-15T16:38:33.540Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10142024-02-15T16:38:33.565Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10152024-02-15T16:38:33.565Z+ [[ 24 -gt 60 ]]
10162024-02-15T16:38:33.565Z+ sleep 1
10172024-02-15T16:38:34.557Z+ retry=25
10182024-02-15T16:38:34.557Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10192024-02-15T16:38:34.582Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10202024-02-15T16:38:34.582Z+ [[ 25 -gt 60 ]]
10212024-02-15T16:38:34.582Z+ sleep 1
10222024-02-15T16:38:35.572Z+ retry=26
10232024-02-15T16:38:35.572Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10242024-02-15T16:38:35.598Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10252024-02-15T16:38:35.598Z+ [[ 26 -gt 60 ]]
10262024-02-15T16:38:35.598Z+ sleep 1
10272024-02-15T16:38:36.587Z+ retry=27
10282024-02-15T16:38:36.587Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10292024-02-15T16:38:36.611Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10302024-02-15T16:38:36.611Z+ [[ 27 -gt 60 ]]
10312024-02-15T16:38:36.611Z+ sleep 1
10322024-02-15T16:38:37.605Z+ retry=28
10332024-02-15T16:38:37.606Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10342024-02-15T16:38:37.630Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10352024-02-15T16:38:37.630Z+ [[ 28 -gt 60 ]]
10362024-02-15T16:38:37.630Z+ sleep 1
10372024-02-15T16:38:38.618Z+ retry=29
10382024-02-15T16:38:38.619Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10392024-02-15T16:38:38.644Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10402024-02-15T16:38:38.644Z+ [[ 29 -gt 60 ]]
10412024-02-15T16:38:38.644Z+ sleep 1
10422024-02-15T16:38:39.633Z+ retry=30
10432024-02-15T16:38:39.633Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10442024-02-15T16:38:39.658Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10452024-02-15T16:38:39.659Z+ [[ 30 -gt 60 ]]
10462024-02-15T16:38:39.659Z+ sleep 1
10472024-02-15T16:38:40.648Z+ retry=31
10482024-02-15T16:38:40.648Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10492024-02-15T16:38:40.674Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10502024-02-15T16:38:40.674Z+ [[ 31 -gt 60 ]]
10512024-02-15T16:38:40.674Z+ sleep 1
10522024-02-15T16:38:41.663Z+ retry=32
10532024-02-15T16:38:41.664Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10542024-02-15T16:38:41.688Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10552024-02-15T16:38:41.688Z+ [[ 32 -gt 60 ]]
10562024-02-15T16:38:41.688Z+ sleep 1
10572024-02-15T16:38:42.679Z+ retry=33
10582024-02-15T16:38:42.679Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10592024-02-15T16:38:42.703Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10602024-02-15T16:38:42.703Z+ [[ 33 -gt 60 ]]
10612024-02-15T16:38:42.703Z+ sleep 1
10622024-02-15T16:38:43.694Z+ retry=34
10632024-02-15T16:38:43.695Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10642024-02-15T16:38:43.719Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10652024-02-15T16:38:43.719Z+ [[ 34 -gt 60 ]]
10662024-02-15T16:38:43.719Z+ sleep 1
10672024-02-15T16:38:44.710Z+ retry=35
10682024-02-15T16:38:44.710Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10692024-02-15T16:38:44.735Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10702024-02-15T16:38:44.735Z+ [[ 35 -gt 60 ]]
10712024-02-15T16:38:44.735Z+ sleep 1
10722024-02-15T16:38:45.724Z+ retry=36
10732024-02-15T16:38:45.724Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10742024-02-15T16:38:45.749Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10752024-02-15T16:38:45.749Z+ [[ 36 -gt 60 ]]
10762024-02-15T16:38:45.749Z+ sleep 1
10772024-02-15T16:38:46.740Z+ retry=37
10782024-02-15T16:38:46.740Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10792024-02-15T16:38:46.764Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10802024-02-15T16:38:46.764Z+ [[ 37 -gt 60 ]]
10812024-02-15T16:38:46.765Z+ sleep 1
10822024-02-15T16:38:47.755Z+ retry=38
10832024-02-15T16:38:47.755Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10842024-02-15T16:38:47.779Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10852024-02-15T16:38:47.779Z+ [[ 38 -gt 60 ]]
10862024-02-15T16:38:47.779Z+ sleep 1
10872024-02-15T16:38:48.771Z+ retry=39
10882024-02-15T16:38:48.771Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10892024-02-15T16:38:48.854Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10902024-02-15T16:38:49.209Z{"status":"ok"}success
10912024-02-15T16:38:49.209ZProject {
10922024-02-15T16:38:49.209Z description: "some images",
10932024-02-15T16:38:49.210Z id: ad961509-c270-4dc7-b469-6d291b7882dc,
10942024-02-15T16:38:49.210Z name: Name(
10952024-02-15T16:38:49.210Z "images",
10962024-02-15T16:38:49.210Z ),
10972024-02-15T16:38:49.210Z time_created: 2024-02-15T16:38:48.940483Z,
10982024-02-15T16:38:49.210Z time_modified: 2024-02-15T16:38:48.940483Z,
10992024-02-15T16:38:49.210Z}
11002024-02-15T16:38:49.234Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
11012024-02-15T16:40:40.752ZError: No response to keepalive - Terminating session
11022024-02-15T16:40:50.825ZError: No response de-activating SOL payload
11032024-02-15T16:40:51.919Z[SOL Session operational. Use ~? for help]
11042024-02-15T16:43:40.813ZError: No response to keepalive - Terminating session
11052024-02-15T16:43:50.749ZError: No response de-activating SOL payload
11062024-02-15T16:43:51.870Z[SOL Session operational. Use ~? for help]
 
11072024-02-15T16:44:13.395Zdone!
11082024-02-15T16:44:13.495Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
11092024-02-15T16:44:13.600Zsuccess
11102024-02-15T16:44:13.600ZImage {
11112024-02-15T16:44:13.600Z block_size: ByteCount(
11122024-02-15T16:44:13.600Z 512,
11132024-02-15T16:44:13.600Z ),
11142024-02-15T16:44:13.600Z description: "debian 11 original base image",
11152024-02-15T16:44:13.600Z digest: None,
11162024-02-15T16:44:13.600Z id: 04ef5a48-a29d-4c64-aeed-7bb0d1b1166a,
11172024-02-15T16:44:13.600Z name: Name(
11182024-02-15T16:44:13.625Z "debian11",
11192024-02-15T16:44:13.625Z ),
11202024-02-15T16:44:13.625Z os: "debian",
11212024-02-15T16:44:13.625Z project_id: None,
11222024-02-15T16:44:13.625Z size: ByteCount(
11232024-02-15T16:44:13.626Z 2147483648,
11242024-02-15T16:44:13.626Z ),
11252024-02-15T16:44:13.626Z time_created: 2024-02-15T16:44:13.360641Z,
11262024-02-15T16:44:13.626Z time_modified: 2024-02-15T16:44:13.579122Z,
11272024-02-15T16:44:13.626Z url: None,
11282024-02-15T16:44:13.626Z version: "11",
11292024-02-15T16:44:13.626Z}
11302024-02-15T16:44:13.626Z+ rm ./tests/bootstrap
11312024-02-15T16:44:13.669Z+ for test_bin in tests/*
11322024-02-15T16:44:13.669Z+ ./tests/bootstrap-3966c2a0b12b48d6
11332024-02-15T16:44:13.713Z
11342024-02-15T16:44:13.713Zrunning 0 tests
11352024-02-15T16:44:13.713Z
11362024-02-15T16:44:13.713Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11372024-02-15T16:44:13.713Z
11382024-02-15T16:44:13.713Z+ for test_bin in tests/*
11392024-02-15T16:44:13.713Z+ ./tests/end_to_end_tests-d84f307ab23cd754
11402024-02-15T16:44:13.902Z
11412024-02-15T16:44:13.903Zrunning 2 tests
11422024-02-15T16:44:14.150Ztest no_spoof::no_spoof_here ... ok
11432024-02-15T16:45:05.384Ztest instance_launch::instance_launch ... ok
11442024-02-15T16:45:05.384Z
11452024-02-15T16:45:05.413Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 51.49s
11462024-02-15T16:45:05.413Z
11472024-02-15T16:45:05.413Z+ _exit_trap
11482024-02-15T16:45:05.413Z+ local status=0
11492024-02-15T16:45:05.413Z+ [[ 0 -eq 0 ]]
11502024-02-15T16:45:05.413Z+ exit 0
11512024-02-15T16:45:05.413Zprocess exited: duration 840660 ms, exit code 0
 
11522024-02-15T16:45:06.198Zfound 140 output files
11532024-02-15T16:45:06.198Zuploading: /var/svc/log/oxide-sled-agent:default.log (865811 bytes)
11542024-02-15T16:45:07.787Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11552024-02-15T16:45:07.787Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (17154 bytes)
11562024-02-15T16:45:07.879Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 17154 -> 26865
11572024-02-15T16:45:08.969Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11582024-02-15T16:45:08.993Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (3143353 bytes)
11592024-02-15T16:45:11.334Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11602024-02-15T16:45:11.334Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
11612024-02-15T16:45:12.406Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11622024-02-15T16:45:12.406Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (4845 bytes)
11632024-02-15T16:45:13.504Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11642024-02-15T16:45:13.504Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (0 bytes)
11652024-02-15T16:45:14.576Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11662024-02-15T16:45:14.576Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (25512 bytes)
11672024-02-15T16:45:15.718Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11682024-02-15T16:45:15.718Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (7181 bytes)
11692024-02-15T16:45:15.822Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 7181 -> 26345
11702024-02-15T16:45:16.904Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11712024-02-15T16:45:16.929Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1876834 bytes)
11722024-02-15T16:45:18.944Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11732024-02-15T16:45:18.944Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (5526 bytes)
11742024-02-15T16:45:19.040Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 5526 -> 25614
11752024-02-15T16:45:20.114Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11762024-02-15T16:45:20.114Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (1104567 bytes)
11772024-02-15T16:45:22.101Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11782024-02-15T16:45:22.101Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11792024-02-15T16:45:23.174Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11802024-02-15T16:45:23.174Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11812024-02-15T16:45:25.073Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11822024-02-15T16:45:25.073Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (2520 bytes)
11832024-02-15T16:45:25.073Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 2520 -> 13095
11842024-02-15T16:45:25.844Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11852024-02-15T16:45:25.869Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (361527 bytes)
11862024-02-15T16:45:28.504Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11872024-02-15T16:45:28.504Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
11882024-02-15T16:45:29.573Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11892024-02-15T16:45:29.573Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
11902024-02-15T16:45:31.506Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
11912024-02-15T16:45:31.506Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
11922024-02-15T16:45:32.579Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11932024-02-15T16:45:32.603Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5393 bytes)
11942024-02-15T16:45:33.677Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
11952024-02-15T16:45:33.677Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-clickhouse:default.log (21912 bytes)
11962024-02-15T16:45:34.577Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 21912 -> 70382
11972024-02-15T16:45:35.652Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-clickhouse:default.log
11982024-02-15T16:45:35.652Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-clickhouse:default.log.0 (891071 bytes)
11992024-02-15T16:45:39.944Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-clickhouse:default.log.0
12002024-02-15T16:45:39.944Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12012024-02-15T16:45:41.038Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-zone-network-setup:default.log
12022024-02-15T16:45:41.038Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1707 bytes)
12032024-02-15T16:45:42.134Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_64de92ae-98f9-470e-a709-d035682f39ca/root/var/svc/log/oxide-zone-network-setup:default.log.0
12042024-02-15T16:45:42.134Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_90fa581a-ec7a-4c79-ba24-07875b0cb06e/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12052024-02-15T16:45:43.616Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_90fa581a-ec7a-4c79-ba24-07875b0cb06e/root/var/svc/log/oxide-cockroachdb:default.log
12062024-02-15T16:45:43.616Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_90fa581a-ec7a-4c79-ba24-07875b0cb06e/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
12072024-02-15T16:45:44.951Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_90fa581a-ec7a-4c79-ba24-07875b0cb06e/root/var/svc/log/oxide-cockroachdb:default.log.0
12082024-02-15T16:45:44.951Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_90fa581a-ec7a-4c79-ba24-07875b0cb06e/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12092024-02-15T16:45:45.781Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_90fa581a-ec7a-4c79-ba24-07875b0cb06e/root/var/svc/log/oxide-zone-network-setup:default.log
12102024-02-15T16:45:45.781Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_90fa581a-ec7a-4c79-ba24-07875b0cb06e/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12112024-02-15T16:45:46.894Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_90fa581a-ec7a-4c79-ba24-07875b0cb06e/root/var/svc/log/oxide-zone-network-setup:default.log.0
12122024-02-15T16:45:46.894Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12132024-02-15T16:45:47.970Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-agent:default.log
12142024-02-15T16:45:47.970Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-agent:default.log.0 (23477 bytes)
12152024-02-15T16:45:49.148Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-agent:default.log.0
12162024-02-15T16:45:49.148Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12172024-02-15T16:45:50.222Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:default.log
12182024-02-15T16:45:50.246Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12192024-02-15T16:45:51.737Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12202024-02-15T16:45:51.738Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:downstairs-26d5a01b-eacf-4a0a-af34-0cb4e8c918f8.log (0 bytes)
12212024-02-15T16:45:52.831Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:downstairs-26d5a01b-eacf-4a0a-af34-0cb4e8c918f8.log
12222024-02-15T16:45:52.831Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:downstairs-26d5a01b-eacf-4a0a-af34-0cb4e8c918f8.log.0 (5698 bytes)
12232024-02-15T16:45:53.949Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:downstairs-26d5a01b-eacf-4a0a-af34-0cb4e8c918f8.log.0
12242024-02-15T16:45:53.950Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:downstairs-d2c5a195-e4b6-46e2-b189-cad988215b4c.log (0 bytes)
12252024-02-15T16:45:55.022Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:downstairs-d2c5a195-e4b6-46e2-b189-cad988215b4c.log
12262024-02-15T16:45:55.022Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:downstairs-d2c5a195-e4b6-46e2-b189-cad988215b4c.log.0 (3017 bytes)
12272024-02-15T16:45:56.117Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:downstairs-d2c5a195-e4b6-46e2-b189-cad988215b4c.log.0
12282024-02-15T16:45:56.141Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:snapshot-26d5a01b-eacf-4a0a-af34-0cb4e8c918f8-691386a4-01c2-41b7-9527-f4760ea16e6c.log (901 bytes)
12292024-02-15T16:45:57.215Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:snapshot-26d5a01b-eacf-4a0a-af34-0cb4e8c918f8-691386a4-01c2-41b7-9527-f4760ea16e6c.log
12302024-02-15T16:45:57.215Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:snapshot-26d5a01b-eacf-4a0a-af34-0cb4e8c918f8-691386a4-01c2-41b7-9527-f4760ea16e6c.log.0 (4405 bytes)
12312024-02-15T16:45:58.311Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_419a2179-5541-4565-8381-2df99315d287/root/var/svc/log/oxide-crucible-downstairs:snapshot-26d5a01b-eacf-4a0a-af34-0cb4e8c918f8-691386a4-01c2-41b7-9527-f4760ea16e6c.log.0
12322024-02-15T16:45:58.311Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_321191e5-7e1e-4e4b-b512-eb17800e62b1/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
12332024-02-15T16:45:59.828Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_321191e5-7e1e-4e4b-b512-eb17800e62b1/root/var/svc/log/oxide-crucible-pantry:default.log
12342024-02-15T16:45:59.828Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_321191e5-7e1e-4e4b-b512-eb17800e62b1/root/var/svc/log/oxide-crucible-pantry:default.log.0 (1218203 bytes)
12352024-02-15T16:46:02.250Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_321191e5-7e1e-4e4b-b512-eb17800e62b1/root/var/svc/log/oxide-crucible-pantry:default.log.0
12362024-02-15T16:46:02.250Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_83074f3b-fe5f-403d-8b71-cbad2a3b9058/root/var/svc/log/oxide-external_dns:default.log (0 bytes)
12372024-02-15T16:46:02.312Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_83074f3b-fe5f-403d-8b71-cbad2a3b9058/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 0 -> 3777
12382024-02-15T16:46:03.386Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_83074f3b-fe5f-403d-8b71-cbad2a3b9058/root/var/svc/log/oxide-external_dns:default.log
12392024-02-15T16:46:03.386Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_83074f3b-fe5f-403d-8b71-cbad2a3b9058/root/var/svc/log/oxide-external_dns:default.log.0 (30719 bytes)
12402024-02-15T16:46:13.405Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_83074f3b-fe5f-403d-8b71-cbad2a3b9058/root/var/svc/log/oxide-external_dns:default.log.0
12412024-02-15T16:46:13.405Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_636029a1-3b2c-48a9-a79e-bf129ce16fed/root/var/svc/log/oxide-internal_dns:default.log (0 bytes)
12422024-02-15T16:46:13.406Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_636029a1-3b2c-48a9-a79e-bf129ce16fed/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 0 -> 3757
12432024-02-15T16:46:14.890Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_636029a1-3b2c-48a9-a79e-bf129ce16fed/root/var/svc/log/oxide-internal_dns:default.log
12442024-02-15T16:46:14.890Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_636029a1-3b2c-48a9-a79e-bf129ce16fed/root/var/svc/log/oxide-internal_dns:default.log.0 (121109 bytes)
12452024-02-15T16:46:16.097Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_636029a1-3b2c-48a9-a79e-bf129ce16fed/root/var/svc/log/oxide-internal_dns:default.log.0
12462024-02-15T16:46:16.097Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-oximeter:default.log (5396 bytes)
12472024-02-15T16:46:16.207Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 5396 -> 45808
12482024-02-15T16:46:17.276Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-oximeter:default.log
12492024-02-15T16:46:17.276Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-oximeter:default.log.0 (273375 bytes)
12502024-02-15T16:46:18.543Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-oximeter:default.log.0
12512024-02-15T16:46:18.543Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12522024-02-15T16:46:19.611Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-zone-network-setup:default.log
12532024-02-15T16:46:19.611Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes)
12542024-02-15T16:46:20.721Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_7f392cb8-cec1-45fc-ab2e-b6b6d6974999/root/var/svc/log/oxide-zone-network-setup:default.log.0
12552024-02-15T16:46:20.721Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d13fe5a9-7428-4b1a-8dda-fe00bc45ec6d/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12562024-02-15T16:46:21.798Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d13fe5a9-7428-4b1a-8dda-fe00bc45ec6d/root/var/svc/log/oxide-cockroachdb:default.log
12572024-02-15T16:46:21.799Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d13fe5a9-7428-4b1a-8dda-fe00bc45ec6d/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12582024-02-15T16:46:23.727Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d13fe5a9-7428-4b1a-8dda-fe00bc45ec6d/root/var/svc/log/oxide-cockroachdb:default.log.0
12592024-02-15T16:46:23.727Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d13fe5a9-7428-4b1a-8dda-fe00bc45ec6d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12602024-02-15T16:46:24.812Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d13fe5a9-7428-4b1a-8dda-fe00bc45ec6d/root/var/svc/log/oxide-zone-network-setup:default.log
12612024-02-15T16:46:24.813Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d13fe5a9-7428-4b1a-8dda-fe00bc45ec6d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
12622024-02-15T16:46:25.920Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d13fe5a9-7428-4b1a-8dda-fe00bc45ec6d/root/var/svc/log/oxide-zone-network-setup:default.log.0
12632024-02-15T16:46:25.920Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_df500125-3a34-4b40-a813-f8f3fc154981/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12642024-02-15T16:46:27.402Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_df500125-3a34-4b40-a813-f8f3fc154981/root/var/svc/log/oxide-crucible-agent:default.log
12652024-02-15T16:46:27.403Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_df500125-3a34-4b40-a813-f8f3fc154981/root/var/svc/log/oxide-crucible-agent:default.log.0 (3435 bytes)
12662024-02-15T16:46:28.495Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_df500125-3a34-4b40-a813-f8f3fc154981/root/var/svc/log/oxide-crucible-agent:default.log.0
12672024-02-15T16:46:28.495Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_df500125-3a34-4b40-a813-f8f3fc154981/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12682024-02-15T16:46:29.564Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_df500125-3a34-4b40-a813-f8f3fc154981/root/var/svc/log/oxide-crucible-downstairs:default.log
12692024-02-15T16:46:29.565Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_df500125-3a34-4b40-a813-f8f3fc154981/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12702024-02-15T16:46:30.656Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_df500125-3a34-4b40-a813-f8f3fc154981/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12712024-02-15T16:46:30.656Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_893d91b3-72fd-431e-a4cb-c545470e0407/root/var/svc/log/oxide-external_dns:default.log (0 bytes)
12722024-02-15T16:46:30.702Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_893d91b3-72fd-431e-a4cb-c545470e0407/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 0 -> 3778
12732024-02-15T16:46:31.787Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_893d91b3-72fd-431e-a4cb-c545470e0407/root/var/svc/log/oxide-external_dns:default.log
12742024-02-15T16:46:31.812Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_893d91b3-72fd-431e-a4cb-c545470e0407/root/var/svc/log/oxide-external_dns:default.log.0 (30719 bytes)
12752024-02-15T16:46:34.649Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_893d91b3-72fd-431e-a4cb-c545470e0407/root/var/svc/log/oxide-external_dns:default.log.0
12762024-02-15T16:46:34.649Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7f4e7a5c-2b73-440b-8385-d70d639299b7/root/var/svc/log/oxide-internal_dns:default.log (0 bytes)
12772024-02-15T16:46:34.686Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7f4e7a5c-2b73-440b-8385-d70d639299b7/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 0 -> 3757
12782024-02-15T16:46:36.172Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7f4e7a5c-2b73-440b-8385-d70d639299b7/root/var/svc/log/oxide-internal_dns:default.log
12792024-02-15T16:46:36.172Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7f4e7a5c-2b73-440b-8385-d70d639299b7/root/var/svc/log/oxide-internal_dns:default.log.0 (118285 bytes)
12802024-02-15T16:46:37.801Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7f4e7a5c-2b73-440b-8385-d70d639299b7/root/var/svc/log/oxide-internal_dns:default.log.0
12812024-02-15T16:46:37.827Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_0a6dc1a5-6583-447e-aee8-34ec867be802/root/var/svc/log/oxide-nexus:default.log (64308 bytes)
12822024-02-15T16:46:38.075Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_0a6dc1a5-6583-447e-aee8-34ec867be802/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 64308 -> 556885
12832024-02-15T16:46:39.156Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_0a6dc1a5-6583-447e-aee8-34ec867be802/root/var/svc/log/oxide-nexus:default.log
12842024-02-15T16:46:39.156Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_0a6dc1a5-6583-447e-aee8-34ec867be802/root/var/svc/log/oxide-nexus:default.log.0 (6080083 bytes)
12852024-02-15T16:46:41.113Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_0a6dc1a5-6583-447e-aee8-34ec867be802/root/var/svc/log/oxide-nexus:default.log.0
12862024-02-15T16:46:41.113Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_25d9515e-e3d4-4a24-aee1-24a1f98b2728/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12872024-02-15T16:46:42.211Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_25d9515e-e3d4-4a24-aee1-24a1f98b2728/root/var/svc/log/oxide-cockroachdb:default.log
12882024-02-15T16:46:42.212Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_25d9515e-e3d4-4a24-aee1-24a1f98b2728/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
12892024-02-15T16:46:43.718Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_25d9515e-e3d4-4a24-aee1-24a1f98b2728/root/var/svc/log/oxide-cockroachdb:default.log.0
12902024-02-15T16:46:43.718Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_25d9515e-e3d4-4a24-aee1-24a1f98b2728/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12912024-02-15T16:46:44.786Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_25d9515e-e3d4-4a24-aee1-24a1f98b2728/root/var/svc/log/oxide-zone-network-setup:default.log
12922024-02-15T16:46:44.787Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_25d9515e-e3d4-4a24-aee1-24a1f98b2728/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12932024-02-15T16:46:45.880Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_25d9515e-e3d4-4a24-aee1-24a1f98b2728/root/var/svc/log/oxide-zone-network-setup:default.log.0
12942024-02-15T16:46:45.880Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12952024-02-15T16:46:46.950Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-agent:default.log
12962024-02-15T16:46:46.975Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-agent:default.log.0 (17550 bytes)
12972024-02-15T16:46:48.095Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-agent:default.log.0
12982024-02-15T16:46:48.095Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12992024-02-15T16:46:49.175Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:default.log
13002024-02-15T16:46:49.175Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13012024-02-15T16:46:50.300Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13022024-02-15T16:46:50.301Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:downstairs-60c4c3b2-cc2d-4771-a0a5-115b28dc22af.log (0 bytes)
13032024-02-15T16:46:51.392Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:downstairs-60c4c3b2-cc2d-4771-a0a5-115b28dc22af.log
13042024-02-15T16:46:51.417Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:downstairs-60c4c3b2-cc2d-4771-a0a5-115b28dc22af.log.0 (5696 bytes)
13052024-02-15T16:46:52.494Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:downstairs-60c4c3b2-cc2d-4771-a0a5-115b28dc22af.log.0
13062024-02-15T16:46:52.495Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:snapshot-60c4c3b2-cc2d-4771-a0a5-115b28dc22af-691386a4-01c2-41b7-9527-f4760ea16e6c.log (901 bytes)
13072024-02-15T16:46:53.645Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:snapshot-60c4c3b2-cc2d-4771-a0a5-115b28dc22af-691386a4-01c2-41b7-9527-f4760ea16e6c.log
13082024-02-15T16:46:53.646Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:snapshot-60c4c3b2-cc2d-4771-a0a5-115b28dc22af-691386a4-01c2-41b7-9527-f4760ea16e6c.log.0 (4404 bytes)
13092024-02-15T16:46:54.741Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_6195d47a-904b-47ed-a5fb-704028cf3dfc/root/var/svc/log/oxide-crucible-downstairs:snapshot-60c4c3b2-cc2d-4771-a0a5-115b28dc22af-691386a4-01c2-41b7-9527-f4760ea16e6c.log.0
13102024-02-15T16:46:54.741Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_54be15f2-a16b-47f6-a4cf-d4fc807e2616/root/var/svc/log/oxide-internal_dns:default.log (3360 bytes)
13112024-02-15T16:46:54.821Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_54be15f2-a16b-47f6-a4cf-d4fc807e2616/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 3360 -> 10870
13122024-02-15T16:46:55.917Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_54be15f2-a16b-47f6-a4cf-d4fc807e2616/root/var/svc/log/oxide-internal_dns:default.log
13132024-02-15T16:46:55.917Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_54be15f2-a16b-47f6-a4cf-d4fc807e2616/root/var/svc/log/oxide-internal_dns:default.log.0 (114596 bytes)
13142024-02-15T16:46:56.703ZError: No response to keepalive - Terminating session
13152024-02-15T16:46:57.171Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_54be15f2-a16b-47f6-a4cf-d4fc807e2616/root/var/svc/log/oxide-internal_dns:default.log.0
13162024-02-15T16:46:57.171Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_201b14fe-1336-41c8-8da4-0a6dda73e049/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13172024-02-15T16:46:58.258Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_201b14fe-1336-41c8-8da4-0a6dda73e049/root/var/svc/log/oxide-cockroachdb:default.log
13182024-02-15T16:46:58.313Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_201b14fe-1336-41c8-8da4-0a6dda73e049/root/var/svc/log/oxide-cockroachdb:default.log.0 (4382 bytes)
13192024-02-15T16:46:59.374Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_201b14fe-1336-41c8-8da4-0a6dda73e049/root/var/svc/log/oxide-cockroachdb:default.log.0
13202024-02-15T16:46:59.374Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_201b14fe-1336-41c8-8da4-0a6dda73e049/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13212024-02-15T16:47:00.474Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_201b14fe-1336-41c8-8da4-0a6dda73e049/root/var/svc/log/oxide-zone-network-setup:default.log
13222024-02-15T16:47:00.474Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_201b14fe-1336-41c8-8da4-0a6dda73e049/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
13232024-02-15T16:47:01.582Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_201b14fe-1336-41c8-8da4-0a6dda73e049/root/var/svc/log/oxide-zone-network-setup:default.log.0
13242024-02-15T16:47:01.607Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-agent:default.log (4320 bytes)
13252024-02-15T16:47:02.678Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-agent:default.log
13262024-02-15T16:47:02.678Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-agent:default.log.0 (26860 bytes)
13272024-02-15T16:47:04.288Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-agent:default.log.0
13282024-02-15T16:47:04.289Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13292024-02-15T16:47:05.793Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:default.log
13302024-02-15T16:47:05.793Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13312024-02-15T16:47:06.893ZError: No response de-activating SOL payload
13322024-02-15T16:47:06.924Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13332024-02-15T16:47:06.925Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d4ec64c-ca1c-40f5-a763-ed7e7edf9a7d.log (0 bytes)
13342024-02-15T16:47:08.010Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d4ec64c-ca1c-40f5-a763-ed7e7edf9a7d.log
13352024-02-15T16:47:08.011Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d4ec64c-ca1c-40f5-a763-ed7e7edf9a7d.log.0 (3020 bytes)
13362024-02-15T16:47:08.051Z[SOL Session operational. Use ~? for help]
13372024-02-15T16:47:09.167Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d4ec64c-ca1c-40f5-a763-ed7e7edf9a7d.log.0
13382024-02-15T16:47:09.167Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-282bc06f-7a59-45be-b0cf-434699f5e668.log (0 bytes)
13392024-02-15T16:47:10.279Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-282bc06f-7a59-45be-b0cf-434699f5e668.log
13402024-02-15T16:47:10.279Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-282bc06f-7a59-45be-b0cf-434699f5e668.log.0 (3125 bytes)
13412024-02-15T16:47:11.404Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-282bc06f-7a59-45be-b0cf-434699f5e668.log.0
13422024-02-15T16:47:11.404Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-424277b4-4b6c-40a0-8810-d13b16f1d3ac.log (1007 bytes)
13432024-02-15T16:47:12.522Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-424277b4-4b6c-40a0-8810-d13b16f1d3ac.log
13442024-02-15T16:47:12.522Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-424277b4-4b6c-40a0-8810-d13b16f1d3ac.log.0 (4607 bytes)
13452024-02-15T16:47:13.620Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_8e6dc3b7-b1dd-4c6c-a1bb-aa361b98f81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-424277b4-4b6c-40a0-8810-d13b16f1d3ac.log.0
13462024-02-15T16:47:13.620Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_bab76d5a-bcda-4cfe-af22-bc1ddcf26412/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13472024-02-15T16:47:14.693Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_bab76d5a-bcda-4cfe-af22-bc1ddcf26412/root/var/svc/log/oxide-crucible-pantry:default.log
13482024-02-15T16:47:14.693Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_bab76d5a-bcda-4cfe-af22-bc1ddcf26412/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2332 bytes)
13492024-02-15T16:47:15.789Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_bab76d5a-bcda-4cfe-af22-bc1ddcf26412/root/var/svc/log/oxide-crucible-pantry:default.log.0
13502024-02-15T16:47:15.790Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9ad690f6-bb9f-4724-9a52-e45d84185380/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13512024-02-15T16:47:17.580Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9ad690f6-bb9f-4724-9a52-e45d84185380/root/var/svc/log/oxide-cockroachdb:default.log
13522024-02-15T16:47:17.580Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9ad690f6-bb9f-4724-9a52-e45d84185380/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
13532024-02-15T16:47:19.116Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9ad690f6-bb9f-4724-9a52-e45d84185380/root/var/svc/log/oxide-cockroachdb:default.log.0
13542024-02-15T16:47:19.117Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9ad690f6-bb9f-4724-9a52-e45d84185380/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13552024-02-15T16:47:20.186Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9ad690f6-bb9f-4724-9a52-e45d84185380/root/var/svc/log/oxide-zone-network-setup:default.log
13562024-02-15T16:47:20.187Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9ad690f6-bb9f-4724-9a52-e45d84185380/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
13572024-02-15T16:47:21.294Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9ad690f6-bb9f-4724-9a52-e45d84185380/root/var/svc/log/oxide-zone-network-setup:default.log.0
13582024-02-15T16:47:21.294Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13592024-02-15T16:47:22.366Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-agent:default.log
13602024-02-15T16:47:22.367Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-agent:default.log.0 (14109 bytes)
13612024-02-15T16:47:23.941Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-agent:default.log.0
13622024-02-15T16:47:23.941Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13632024-02-15T16:47:25.471Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-downstairs:default.log
13642024-02-15T16:47:25.472Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13652024-02-15T16:47:26.575Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13662024-02-15T16:47:26.575Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ee4555a-850b-4bd8-9021-1aad4dabd00d.log (0 bytes)
13672024-02-15T16:47:27.649Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ee4555a-850b-4bd8-9021-1aad4dabd00d.log
13682024-02-15T16:47:27.649Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ee4555a-850b-4bd8-9021-1aad4dabd00d.log.0 (3123 bytes)
13692024-02-15T16:47:28.745Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_11e067e4-235c-4890-bf5e-fe9438c8ddfd/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ee4555a-850b-4bd8-9021-1aad4dabd00d.log.0
13702024-02-15T16:47:28.745Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-agent:default.log (4323 bytes)
13712024-02-15T16:47:29.840Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-agent:default.log
13722024-02-15T16:47:29.840Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-agent:default.log.0 (9795 bytes)
13732024-02-15T16:47:31.384Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-agent:default.log.0
13742024-02-15T16:47:31.384Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13752024-02-15T16:47:32.060Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-downstairs:default.log
13762024-02-15T16:47:32.084Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13772024-02-15T16:47:33.177Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13782024-02-15T16:47:33.177Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cec0088-c838-4749-9b4a-73b08eb7b7f3.log (1007 bytes)
13792024-02-15T16:47:34.285Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cec0088-c838-4749-9b4a-73b08eb7b7f3.log
13802024-02-15T16:47:34.285Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cec0088-c838-4749-9b4a-73b08eb7b7f3.log.0 (4607 bytes)
13812024-02-15T16:47:35.382Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d409b018-0147-426d-ac59-42de7f60b002/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cec0088-c838-4749-9b4a-73b08eb7b7f3.log.0
13822024-02-15T16:47:35.414Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_1ed86a04-89af-4f41-991c-c5d48e2d2cd5/root/var/svc/log/oxide-nexus:default.log (0 bytes)
13832024-02-15T16:47:35.591Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_1ed86a04-89af-4f41-991c-c5d48e2d2cd5/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 0 -> 257783
13842024-02-15T16:47:36.659Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_1ed86a04-89af-4f41-991c-c5d48e2d2cd5/root/var/svc/log/oxide-nexus:default.log
13852024-02-15T16:47:36.659Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_1ed86a04-89af-4f41-991c-c5d48e2d2cd5/root/var/svc/log/oxide-nexus:default.log.0 (1266435 bytes)
13862024-02-15T16:47:38.180Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_1ed86a04-89af-4f41-991c-c5d48e2d2cd5/root/var/svc/log/oxide-nexus:default.log.0
13872024-02-15T16:47:38.180Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_4dfa2b2b-5523-4156-81cc-bf5062600a1b/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13882024-02-15T16:47:39.248Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_4dfa2b2b-5523-4156-81cc-bf5062600a1b/root/var/svc/log/oxide-crucible-agent:default.log
13892024-02-15T16:47:39.248Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_4dfa2b2b-5523-4156-81cc-bf5062600a1b/root/var/svc/log/oxide-crucible-agent:default.log.0 (3435 bytes)
13902024-02-15T16:47:40.340Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_4dfa2b2b-5523-4156-81cc-bf5062600a1b/root/var/svc/log/oxide-crucible-agent:default.log.0
13912024-02-15T16:47:40.340Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_4dfa2b2b-5523-4156-81cc-bf5062600a1b/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13922024-02-15T16:47:41.833Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_4dfa2b2b-5523-4156-81cc-bf5062600a1b/root/var/svc/log/oxide-crucible-downstairs:default.log
13932024-02-15T16:47:41.833Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_4dfa2b2b-5523-4156-81cc-bf5062600a1b/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13942024-02-15T16:47:42.560Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_4dfa2b2b-5523-4156-81cc-bf5062600a1b/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13952024-02-15T16:47:42.560Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e3684ed-a8b3-4eae-b613-b3fdfdfd16cf/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13962024-02-15T16:47:43.643Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e3684ed-a8b3-4eae-b613-b3fdfdfd16cf/root/var/svc/log/oxide-crucible-agent:default.log
13972024-02-15T16:47:43.643Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e3684ed-a8b3-4eae-b613-b3fdfdfd16cf/root/var/svc/log/oxide-crucible-agent:default.log.0 (3435 bytes)
13982024-02-15T16:47:44.739Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e3684ed-a8b3-4eae-b613-b3fdfdfd16cf/root/var/svc/log/oxide-crucible-agent:default.log.0
13992024-02-15T16:47:44.739Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e3684ed-a8b3-4eae-b613-b3fdfdfd16cf/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14002024-02-15T16:47:45.827Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e3684ed-a8b3-4eae-b613-b3fdfdfd16cf/root/var/svc/log/oxide-crucible-downstairs:default.log
14012024-02-15T16:47:45.827Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e3684ed-a8b3-4eae-b613-b3fdfdfd16cf/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14022024-02-15T16:47:46.926Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e3684ed-a8b3-4eae-b613-b3fdfdfd16cf/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14032024-02-15T16:47:46.926Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_a9748876-f4b5-42f9-9202-a7ed54e7e39b/root/var/svc/log/oxide-nexus:default.log (406730 bytes)
14042024-02-15T16:47:48.033Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_a9748876-f4b5-42f9-9202-a7ed54e7e39b/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 406730 -> 679200
14052024-02-15T16:47:49.126Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_a9748876-f4b5-42f9-9202-a7ed54e7e39b/root/var/svc/log/oxide-nexus:default.log
14062024-02-15T16:47:49.126Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_a9748876-f4b5-42f9-9202-a7ed54e7e39b/root/var/svc/log/oxide-nexus:default.log.0 (34271309 bytes)
14072024-02-15T16:48:07.692Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_a9748876-f4b5-42f9-9202-a7ed54e7e39b/root/var/svc/log/oxide-nexus:default.log.0
14082024-02-15T16:48:07.692Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/svc/log/oxide-ntp:default.log (0 bytes)
14092024-02-15T16:48:08.769Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/svc/log/oxide-ntp:default.log
14102024-02-15T16:48:08.769Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/svc/log/oxide-ntp:default.log.0 (1186 bytes)
14112024-02-15T16:48:09.869Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/svc/log/oxide-ntp:default.log.0
14122024-02-15T16:48:09.870Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-agent:default.log (4320 bytes)
14132024-02-15T16:48:10.975Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-agent:default.log
14142024-02-15T16:48:11.016Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-agent:default.log.0 (39653 bytes)
14152024-02-15T16:48:13.025Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-agent:default.log.0
14162024-02-15T16:48:13.025Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14172024-02-15T16:48:14.134Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:default.log
14182024-02-15T16:48:14.135Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14192024-02-15T16:48:15.234Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14202024-02-15T16:48:15.234Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-396e50ff-fd16-4b0c-8471-4bb4325cd037.log (0 bytes)
14212024-02-15T16:48:16.325Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-396e50ff-fd16-4b0c-8471-4bb4325cd037.log
14222024-02-15T16:48:16.325Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-396e50ff-fd16-4b0c-8471-4bb4325cd037.log.0 (5698 bytes)
14232024-02-15T16:48:17.448Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-396e50ff-fd16-4b0c-8471-4bb4325cd037.log.0
14242024-02-15T16:48:17.448Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-72f4880e-0b44-4273-a92e-2ed517f0d315.log (1007 bytes)
14252024-02-15T16:48:18.597Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-72f4880e-0b44-4273-a92e-2ed517f0d315.log
14262024-02-15T16:48:18.597Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-72f4880e-0b44-4273-a92e-2ed517f0d315.log.0 (4601 bytes)
14272024-02-15T16:48:19.960Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-72f4880e-0b44-4273-a92e-2ed517f0d315.log.0
14282024-02-15T16:48:19.961Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-8e4a8046-3f75-48a7-aebf-62cf8898ecda.log (0 bytes)
14292024-02-15T16:48:20.792Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-8e4a8046-3f75-48a7-aebf-62cf8898ecda.log
14302024-02-15T16:48:20.792Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-8e4a8046-3f75-48a7-aebf-62cf8898ecda.log.0 (3020 bytes)
14312024-02-15T16:48:21.894Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-8e4a8046-3f75-48a7-aebf-62cf8898ecda.log.0
14322024-02-15T16:48:21.894Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-a6c7a1d6-45be-41fd-93b9-d709bdcfb2d4.log (0 bytes)
14332024-02-15T16:48:22.974Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-a6c7a1d6-45be-41fd-93b9-d709bdcfb2d4.log
14342024-02-15T16:48:22.974Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-a6c7a1d6-45be-41fd-93b9-d709bdcfb2d4.log.0 (3126 bytes)
14352024-02-15T16:48:24.085Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:downstairs-a6c7a1d6-45be-41fd-93b9-d709bdcfb2d4.log.0
14362024-02-15T16:48:24.085Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:snapshot-396e50ff-fd16-4b0c-8471-4bb4325cd037-691386a4-01c2-41b7-9527-f4760ea16e6c.log (901 bytes)
14372024-02-15T16:48:25.201Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:snapshot-396e50ff-fd16-4b0c-8471-4bb4325cd037-691386a4-01c2-41b7-9527-f4760ea16e6c.log
14382024-02-15T16:48:25.201Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:snapshot-396e50ff-fd16-4b0c-8471-4bb4325cd037-691386a4-01c2-41b7-9527-f4760ea16e6c.log.0 (4405 bytes)
14392024-02-15T16:48:26.317Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_1f86c126-bea1-4134-bc07-f4f6ce85ef5b/root/var/svc/log/oxide-crucible-downstairs:snapshot-396e50ff-fd16-4b0c-8471-4bb4325cd037-691386a4-01c2-41b7-9527-f4760ea16e6c.log.0
14402024-02-15T16:48:26.317Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_9ee66f30-23b3-4577-9e1a-5fa95f7f9ab5/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
14412024-02-15T16:48:27.407Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_9ee66f30-23b3-4577-9e1a-5fa95f7f9ab5/root/var/svc/log/oxide-crucible-pantry:default.log
14422024-02-15T16:48:27.408Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_9ee66f30-23b3-4577-9e1a-5fa95f7f9ab5/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2337 bytes)
14432024-02-15T16:48:28.508Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_9ee66f30-23b3-4577-9e1a-5fa95f7f9ab5/root/var/svc/log/oxide-crucible-pantry:default.log.0
14442024-02-15T16:48:28.508Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/measurements.log (24797 bytes)
14452024-02-15T16:48:28.643Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/measurements.log" changed size mid upload: 24797 -> 33017
14462024-02-15T16:48:30.559Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/measurements.log
14472024-02-15T16:48:30.560Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/statistics.log (15561 bytes)
14482024-02-15T16:48:30.590Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/statistics.log" changed size mid upload: 15561 -> 21177
14492024-02-15T16:48:31.339Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/statistics.log
14502024-02-15T16:48:31.377Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/tracking.log (2382 bytes)
14512024-02-15T16:48:32.219Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/tracking.log" changed size mid upload: 2382 -> 2778
14522024-02-15T16:48:33.377Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_b133f123-2edb-46a9-9b6e-2f1c9b31992d/root/var/log/chrony/tracking.log