01HP7RFX7695HX2CQVTVEZH5Z3: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HP7RGMJKP9004CX81AFH0FZ6

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-09T20:59:08.321Zjob dependencies complete; ready to run (waiting for 37 m 35 s)
22024-02-09T21:03:20.426Zjob assigned to worker 01HP7TNXB91NJP82ZMWAB5ZPX1 (queued for 4 m 12 s)
32024-02-09T21:03:20.589Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-02-09T21:03:20.642Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-02-09T21:03:20.676Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... 59%Error: No response to keepalive - Terminating session
62024-02-09T21:03:20.711ZError: No response de-activating SOL payload
72024-02-09T21:03:20.764Z[SOL Session operational. Use ~? for help]
82024-02-09T21:03:20.801Z ok
92024-02-09T21:03:20.835Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
102024-02-09T21:03:20.869Zhttp://172.20.0.5:9969/postboot/sock... ok
112024-02-09T21:03:20.907ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
122024-02-09T21:03:20.947Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
132024-02-09T21:03:20.985ZOxide Helios Version helios-2.0.22451 64-bit
142024-02-09T21:03:21.025ZConfiguring devices.
152024-02-09T21:03:21.063Z##################################################
162024-02-09T21:03:21.102Z#### ############# ##
172024-02-09T21:03:21.142Z### ### ############ ##
182024-02-09T21:03:21.186Z## ### # ## ### ## Oxide Computer Company ##
192024-02-09T21:03:21.225Z## ## ## ### # ### ##
202024-02-09T21:03:21.258Z## # ### #### #### This Station Under ##
212024-02-09T21:03:21.292Z### ### #### # ### Computer Control ##
222024-02-09T21:03:21.325Z#### #### ### ## ##
232024-02-09T21:03:21.359Z##################################################
242024-02-09T21:03:21.392ZHostname: sock
252024-02-09T21:03:21.431ZLoading smf(7) service descriptions:
262024-02-09T21:03:21.908Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-000e38cfb9ecff29.gz
272024-02-09T21:03:24.212Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-000e38cfb9ecff29.gz
282024-02-09T21:03:24.212Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
292024-02-09T21:03:44.987Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
302024-02-09T21:03:44.987Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a157f2ab3f0f1a11.gz
312024-02-09T21:04:06.795Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a157f2ab3f0f1a11.gz
322024-02-09T21:04:06.822Zdownloading input: /input/ci-tools/work/caboose-util.gz
332024-02-09T21:04:07.801Zdownloaded input: /input/ci-tools/work/caboose-util.gz
342024-02-09T21:04:07.801Zdownloading input: /input/ci-tools/work/tufaceous.gz
352024-02-09T21:04:10.844Zdownloaded input: /input/ci-tools/work/tufaceous.gz
362024-02-09T21:04:10.869Zdownloading input: /input/package/work/version.txt
372024-02-09T21:04:10.894Zdownloaded input: /input/package/work/version.txt
382024-02-09T21:04:10.894Zdownloading input: /input/package/work/package.tar.gz
392024-02-09T21:04:27.005Zdownloaded input: /input/package/work/package.tar.gz
402024-02-09T21:04:27.030Zdownloading input: /input/package/work/global-zone-packages.tar.gz
412024-02-09T21:04:51.462Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
422024-02-09T21:04:51.462Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
432024-02-09T21:04:59.391Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
442024-02-09T21:04:59.416Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
452024-02-09T21:05:02.624Zsock console login: Error: No response to keepalive - Terminating session
462024-02-09T21:05:12.569ZError: No response de-activating SOL payload
472024-02-09T21:05:13.950Z[SOL Session operational. Use ~? for help]
482024-02-09T21:05:36.644Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
492024-02-09T21:05:36.670Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
502024-02-09T21:06:11.070Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
512024-02-09T21:06:11.070Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
522024-02-09T21:06:37.851Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
532024-02-09T21:06:37.876Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
542024-02-09T21:06:40.993Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
552024-02-09T21:06:40.993Zdownloading input: /input/package/work/zones/crucible.tar.gz
562024-02-09T21:06:47.196Zdownloaded input: /input/package/work/zones/crucible.tar.gz
572024-02-09T21:06:47.196Zdownloading input: /input/package/work/zones/external-dns.tar.gz
582024-02-09T21:06:51.621Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
592024-02-09T21:06:51.646Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
602024-02-09T21:06:55.950Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
612024-02-09T21:06:55.950Zdownloading input: /input/package/work/zones/ntp.tar.gz
622024-02-09T21:06:56.407Zdownloaded input: /input/package/work/zones/ntp.tar.gz
632024-02-09T21:06:56.407Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
642024-02-09T21:06:59.541Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
652024-02-09T21:06:59.541Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
662024-02-09T21:07:03.129Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
672024-02-09T21:07:03.129Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
682024-02-09T21:07:18.983Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
692024-02-09T21:07:18.983Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
702024-02-09T21:07:36.865Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
712024-02-09T21:07:36.865Zdownloading input: /input/package/work/zones/overlay.tar.gz
722024-02-09T21:07:36.913Zdownloaded input: /input/package/work/zones/overlay.tar.gz
732024-02-09T21:07:36.938Zdownloading input: /input/package/work/zones/oximeter.tar.gz
742024-02-09T21:07:49.598Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
752024-02-09T21:07:49.598Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
762024-02-09T21:08:02.947Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
772024-02-09T21:08:02.948Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
782024-02-09T21:08:18.566ZError: No response to keepalive - Terminating session
792024-02-09T21:08:28.693ZError: No response de-activating SOL payload
802024-02-09T21:08:29.851Z[SOL Session operational. Use ~? for help]
812024-02-09T21:09:00.364Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
822024-02-09T21:09:00.365Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
832024-02-09T21:09:40.962Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
842024-02-09T21:09:40.962Zstarting task 0: "setup"
852024-02-09T21:09:40.989Z++ uname -s
862024-02-09T21:09:40.989Z+ kern=SunOS
872024-02-09T21:09:40.989Z+ case "$kern" in
882024-02-09T21:09:40.989Z+ groupadd -g 12345 build
892024-02-09T21:09:40.989Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
902024-02-09T21:09:42.975Z+ zfs create -o mountpoint=/work rpool/work
912024-02-09T21:09:43.008Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
922024-02-09T21:09:43.034Z+ home_fs=zfs
932024-02-09T21:09:43.034Z+ [[ zfs == autofs ]]
942024-02-09T21:09:43.034Z+ mkdir -p /home/build
952024-02-09T21:09:43.034Z+ chown build:build /home/build /work
962024-02-09T21:09:45.021Z+ chmod 0700 /home/build /work
972024-02-09T21:09:45.046Zprocess exited: duration 4063 ms, exit code 0
 
982024-02-09T21:09:45.096Zstarting task 1: "authentication"
992024-02-09T21:09:45.142Zprocess exited: duration 45 ms, exit code 0
 
1002024-02-09T21:09:45.192Zstarting task 2: "build"
1012024-02-09T21:09:45.217Z+ trap _exit_trap EXIT
1022024-02-09T21:09:45.217Z+ set +x
1032024-02-09T21:10:14.129Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1042024-02-09T21:10:14.369Zsecpolicy_fs_linkdir: 0x55 = 0x55
1052024-02-09T21:10:14.369Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1062024-02-09T21:10:14.369Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1072024-02-09T21:10:14.370Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1082024-02-09T21:10:14.395Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1092024-02-09T21:10:14.395Zsecpolicy_fs_linkdir+5: 0 = 0x1
1102024-02-09T21:10:14.395Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1112024-02-09T21:10:14.395Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1122024-02-09T21:10:14.395Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1132024-02-09T21:10:14.395Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1142024-02-09T21:10:14.395Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1152024-02-09T21:10:14.395Z+ [[ -d /opt/oxide ]]
1162024-02-09T21:10:14.395Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1172024-02-09T21:10:14.396Z+ pfexec mkdir /opt/oxide
1182024-02-09T21:10:14.396Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1192024-02-09T21:10:14.396Z+ [[ -d /opt/oxide-underneath ]]
1202024-02-09T21:10:14.396Z+ cd /opt/oxide-underneath
1212024-02-09T21:10:14.396Z+ pfexec tar ceEp@/f - .
1222024-02-09T21:10:14.396Z+ cd /opt/oxide
1232024-02-09T21:10:14.396Z+ pfexec tar xveEp@/f -
1242024-02-09T21:10:14.430Zx ., 0 bytes, 0 tape blocks
1252024-02-09T21:10:14.431Zx ./opte, 0 bytes, 0 tape blocks
1262024-02-09T21:10:14.431Zx ./opte/bin, 0 bytes, 0 tape blocks
1272024-02-09T21:10:14.431Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1282024-02-09T21:10:14.456Z+ pfexec rm -rf /opt/oxide-underneath
1292024-02-09T21:10:14.456Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1302024-02-09T21:10:14.481Z+ pfexec mkdir /opt/oxide/work
1312024-02-09T21:10:14.481Z+ pfexec chown build:build /opt/oxide/work
1322024-02-09T21:10:14.481Z+ cd /opt/oxide/work
1332024-02-09T21:10:14.481Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1342024-02-09T21:10:16.184ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1352024-02-09T21:10:16.184Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1362024-02-09T21:10:16.184Zx out/omicron-sled-agent.tar, 122564608 bytes, 239384 tape blocks
1372024-02-09T21:10:16.184Zx out/oxlog.tar, 8382464 bytes, 16372 tape blocks
1382024-02-09T21:10:16.184Zx out/target/test, 75 bytes, 1 tape blocks
1392024-02-09T21:10:16.184Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1402024-02-09T21:10:16.184Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1412024-02-09T21:10:16.184Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1422024-02-09T21:10:16.184Zx target/release/omicron-package, 45713312 bytes, 89284 tape blocks
1432024-02-09T21:10:16.185Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1442024-02-09T21:10:16.185Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1452024-02-09T21:10:16.185Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1462024-02-09T21:10:16.185Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1472024-02-09T21:10:16.185Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1482024-02-09T21:10:16.185Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1492024-02-09T21:10:16.185Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1502024-02-09T21:10:16.212Z
1512024-02-09T21:10:16.212Zreal 1.711160080
1522024-02-09T21:10:16.212Zuser 1.537346031
1532024-02-09T21:10:16.212Zsys 0.303673028
1542024-02-09T21:10:16.212Ztrap 0.000074041
1552024-02-09T21:10:16.213Ztflt 0.000000000
1562024-02-09T21:10:16.213Zdflt 0.000000000
1572024-02-09T21:10:16.213Zkflt 0.000000000
1582024-02-09T21:10:16.213Zlock 0.000000000
1592024-02-09T21:10:16.213Zslp 1.538871910
1602024-02-09T21:10:16.213Zlat 0.040092245
1612024-02-09T21:10:16.213Zstop 0.000129882
1622024-02-09T21:10:16.213Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1632024-02-09T21:10:17.381Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1642024-02-09T21:10:17.411Z+ mkdir tests
1652024-02-09T21:10:17.411Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1662024-02-09T21:10:17.412Z+ ptime -m gunzip
1672024-02-09T21:10:17.412Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-000e38cfb9ecff29
1682024-02-09T21:10:17.632Z
1692024-02-09T21:10:17.658Zreal 0.231871536
1702024-02-09T21:10:17.658Zuser 0.214184323
1712024-02-09T21:10:17.659Zsys 0.017444948
1722024-02-09T21:10:17.659Ztrap 0.000018340
1732024-02-09T21:10:17.659Ztflt 0.000000000
1742024-02-09T21:10:17.659Zdflt 0.000000000
1752024-02-09T21:10:17.659Zkflt 0.000000000
1762024-02-09T21:10:17.659Zlock 0.000000000
1772024-02-09T21:10:17.659Zslp 0.000020210
1782024-02-09T21:10:17.659Zlat 0.000015460
1792024-02-09T21:10:17.659Zstop 0.000120602
1802024-02-09T21:10:17.659Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-000e38cfb9ecff29
1812024-02-09T21:10:17.660Z+ chmod a+x tests/bootstrap-000e38cfb9ecff29
1822024-02-09T21:10:17.660Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1832024-02-09T21:10:17.660Z+ ptime -m gunzip
1842024-02-09T21:10:17.660Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1852024-02-09T21:10:20.135Z
1862024-02-09T21:10:20.161Zreal 2.491810459
1872024-02-09T21:10:20.161Zuser 2.336694896
1882024-02-09T21:10:20.161Zsys 0.154679325
1892024-02-09T21:10:20.161Ztrap 0.000192574
1902024-02-09T21:10:20.162Ztflt 0.000000000
1912024-02-09T21:10:20.162Zdflt 0.000000000
1922024-02-09T21:10:20.162Zkflt 0.000000000
1932024-02-09T21:10:20.162Zlock 0.000000000
1942024-02-09T21:10:20.162Zslp 0.000020510
1952024-02-09T21:10:20.162Zlat 0.000022830
1962024-02-09T21:10:20.162Zstop 0.000132692
1972024-02-09T21:10:20.163Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1982024-02-09T21:10:20.163Z+ chmod a+x tests/bootstrap
1992024-02-09T21:10:20.163Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2002024-02-09T21:10:20.163Z+ ptime -m gunzip
2012024-02-09T21:10:20.163Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a157f2ab3f0f1a11
2022024-02-09T21:10:22.726Z
2032024-02-09T21:10:22.751Zreal 2.579099782
2042024-02-09T21:10:22.752Zuser 2.404316612
2052024-02-09T21:10:22.752Zsys 0.174392834
2062024-02-09T21:10:22.752Ztrap 0.000173123
2072024-02-09T21:10:22.752Ztflt 0.000000000
2082024-02-09T21:10:22.752Zdflt 0.000000000
2092024-02-09T21:10:22.752Zkflt 0.000000000
2102024-02-09T21:10:22.752Zlock 0.000000000
2112024-02-09T21:10:22.753Zslp 0.000020370
2122024-02-09T21:10:22.753Zlat 0.000022960
2132024-02-09T21:10:22.753Zstop 0.000114751
2142024-02-09T21:10:22.753Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a157f2ab3f0f1a11
2152024-02-09T21:10:22.753Z+ chmod a+x tests/end_to_end_tests-a157f2ab3f0f1a11
2162024-02-09T21:10:22.753Z+ bmat address ls
2172024-02-09T21:10:22.753ZNAME CIDR FIRST LAST COUNT
2182024-02-09T21:10:22.754Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2192024-02-09T21:10:22.754Z++ bmat address ls -f extra -Ho first,last,count
2202024-02-09T21:10:22.780Z+ set -- 10.151.2.164 10.151.2.227 64
2212024-02-09T21:10:22.780Z+ EXTRA_IP_START=10.151.2.164
2222024-02-09T21:10:22.780Z+ EXTRA_IP_END=10.151.2.227
2232024-02-09T21:10:22.780Z+ EXTRA_IP_COUNT=64
2242024-02-09T21:10:22.781Z+ (( EXTRA_IP_COUNT >= 32 ))
2252024-02-09T21:10:22.781Z+ EXTRA_IP_BASE=10.151.2
2262024-02-09T21:10:22.781Z+ EXTRA_IP_FOCTET=164
2272024-02-09T21:10:22.781Z+ EXTRA_IP_LOCTET=227
2282024-02-09T21:10:22.781Z+ SERVICE_IP_POOL_START=10.151.2.164
2292024-02-09T21:10:22.781Z+ SERVICE_IP_POOL_END=10.151.2.173
2302024-02-09T21:10:22.781Z+ DNS_IP1=10.151.2.164
2312024-02-09T21:10:22.781Z+ DNS_IP2=10.151.2.165
2322024-02-09T21:10:22.781Z+ UPLINK_IP=10.151.2.174
2332024-02-09T21:10:22.781Z+ IPPOOL_START=10.151.2.175
2342024-02-09T21:10:22.781Z+ IPPOOL_END=10.151.2.227
2352024-02-09T21:10:22.781Z++ ipadm show-addr -po type,addr
2362024-02-09T21:10:22.781Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2372024-02-09T21:10:22.781Z+ GATEWAY_IP=10.151.2.100
2382024-02-09T21:10:22.781Z+ [[ -n 10.151.2.100 ]]
2392024-02-09T21:10:22.781Z+ ping -s 10.151.2.100 56 1
2402024-02-09T21:10:22.781ZPING 10.151.2.100: 56 data bytes
2412024-02-09T21:10:22.782Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
2422024-02-09T21:10:22.782Z
2432024-02-09T21:10:22.782Z----10.151.2.100 PING Statistics----
2442024-02-09T21:10:22.782Z1 packets transmitted, 1 packets received, 0% packet loss
2452024-02-09T21:10:22.782Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2462024-02-09T21:10:22.782Z++ arp -an
2472024-02-09T21:10:22.782Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2482024-02-09T21:10:22.782Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2492024-02-09T21:10:22.782Z+ routeadm -e ipv4-forwarding -u
2502024-02-09T21:10:22.890Z+ PXA_START=10.151.2.164
2512024-02-09T21:10:22.890Z+ PXA_END=10.151.2.227
2522024-02-09T21:10:22.890Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2532024-02-09T21:10:22.920Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2542024-02-09T21:10:23.088Z+ ZPOOL_VDEV_DIR=/scratch
2552024-02-09T21:10:23.088Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2562024-02-09T21:10:23.114Z+++ dirname ./tools/create_virtual_hardware.sh
2572024-02-09T21:10:23.114Z++ cd ./tools
2582024-02-09T21:10:23.114Z++ pwd
2592024-02-09T21:10:23.114Z+ SOURCE_DIR=/opt/oxide/work/tools
2602024-02-09T21:10:23.114Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2612024-02-09T21:10:23.114Z+ SOFTNPU_MODE=zone
2622024-02-09T21:10:23.114Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2632024-02-09T21:10:23.114Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2642024-02-09T21:10:23.114Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2652024-02-09T21:10:23.114Z++ dladm show-phys -p -o LINK
2662024-02-09T21:10:23.115Z++ head -1
2672024-02-09T21:10:23.115Z+ PHYSICAL_LINK=igb0
2682024-02-09T21:10:23.115Z+ echo 'Using igb0 as physical link'
2692024-02-09T21:10:23.115ZUsing igb0 as physical link
2702024-02-09T21:10:23.141Z+ ensure_run_as_root
2712024-02-09T21:10:23.141Z++ id -u
2722024-02-09T21:10:23.141Z+ [[ 0 -ne 0 ]]
2732024-02-09T21:10:23.141Z+ ensure_zpools
2742024-02-09T21:10:23.141Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2752024-02-09T21:10:23.141Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2762024-02-09T21:10:23.141Z+ readarray -t ZPOOLS
2772024-02-09T21:10:23.141Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2782024-02-09T21:10:23.142Z++ sed 's/[ ",]//g'
2792024-02-09T21:10:23.142Z+ for ZPOOL in "${ZPOOLS[@]}"
2802024-02-09T21:10:23.142Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2812024-02-09T21:10:23.142ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2822024-02-09T21:10:23.142Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2832024-02-09T21:10:23.142Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2842024-02-09T21:10:23.142Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2852024-02-09T21:10:23.142Z0+0 records in
2862024-02-09T21:10:23.142Z0+0 records out
2872024-02-09T21:10:23.142Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2882024-02-09T21:10:23.142Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2892024-02-09T21:10:23.142Z+ set +x
2902024-02-09T21:10:23.142ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2912024-02-09T21:10:23.142Z++ zpool list -o name
2922024-02-09T21:10:23.142Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2932024-02-09T21:10:23.142Z+ [[ -z '' ]]
2942024-02-09T21:10:23.142Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2952024-02-09T21:10:23.169Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2962024-02-09T21:10:23.195Z+ set +x
2972024-02-09T21:10:23.195ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2982024-02-09T21:10:23.195Z+ for ZPOOL in "${ZPOOLS[@]}"
2992024-02-09T21:10:23.195Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3002024-02-09T21:10:23.195ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3012024-02-09T21:10:23.195Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3022024-02-09T21:10:23.196Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3032024-02-09T21:10:23.196Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3042024-02-09T21:10:23.196Z0+0 records in
3052024-02-09T21:10:23.196Z0+0 records out
3062024-02-09T21:10:23.196Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3072024-02-09T21:10:23.196Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3082024-02-09T21:10:23.196Z+ set +x
3092024-02-09T21:10:23.196ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3102024-02-09T21:10:23.196Z++ zpool list -o name
3112024-02-09T21:10:23.197Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3122024-02-09T21:10:23.197Z+ [[ -z '' ]]
3132024-02-09T21:10:23.197Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3142024-02-09T21:10:23.222Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3152024-02-09T21:10:23.223Z+ set +x
3162024-02-09T21:10:23.223ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3172024-02-09T21:10:23.223Z+ for ZPOOL in "${ZPOOLS[@]}"
3182024-02-09T21:10:23.223Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3192024-02-09T21:10:23.223Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3202024-02-09T21:10:23.223ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3212024-02-09T21:10:23.223Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3222024-02-09T21:10:23.223Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3232024-02-09T21:10:23.223Z0+0 records in
3242024-02-09T21:10:23.224Z0+0 records out
3252024-02-09T21:10:23.224Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3262024-02-09T21:10:23.224Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3272024-02-09T21:10:23.224Z+ set +x
3282024-02-09T21:10:23.224ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3292024-02-09T21:10:23.224Z++ zpool list -o name
3302024-02-09T21:10:23.224Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3312024-02-09T21:10:23.224Z+ [[ -z '' ]]
3322024-02-09T21:10:23.224Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3332024-02-09T21:10:23.255Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3342024-02-09T21:10:23.255Z+ set +x
3352024-02-09T21:10:23.281ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3362024-02-09T21:10:23.281Z+ for ZPOOL in "${ZPOOLS[@]}"
3372024-02-09T21:10:23.281Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3382024-02-09T21:10:23.281ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3392024-02-09T21:10:23.282Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3402024-02-09T21:10:23.282Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3412024-02-09T21:10:23.282Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3422024-02-09T21:10:23.282Z0+0 records in
3432024-02-09T21:10:23.282Z0+0 records out
3442024-02-09T21:10:23.283Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3452024-02-09T21:10:23.283Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3462024-02-09T21:10:23.283Z+ set +x
3472024-02-09T21:10:23.283ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3482024-02-09T21:10:23.283Z++ zpool list -o name
3492024-02-09T21:10:23.283Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3502024-02-09T21:10:23.283Z+ [[ -z '' ]]
3512024-02-09T21:10:23.284Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3522024-02-09T21:10:23.309Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3532024-02-09T21:10:23.309Z+ set +x
3542024-02-09T21:10:23.309ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3552024-02-09T21:10:23.309ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3562024-02-09T21:10:23.309Z+ for ZPOOL in "${ZPOOLS[@]}"
3572024-02-09T21:10:23.309Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3582024-02-09T21:10:23.309Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3592024-02-09T21:10:23.309Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3602024-02-09T21:10:23.310Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3612024-02-09T21:10:23.310Z0+0 records in
3622024-02-09T21:10:23.310Z0+0 records out
3632024-02-09T21:10:23.310Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3642024-02-09T21:10:23.310Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3652024-02-09T21:10:23.310Z+ set +x
3662024-02-09T21:10:23.310ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3672024-02-09T21:10:23.310Z++ zpool list -o name
3682024-02-09T21:10:23.310Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3692024-02-09T21:10:23.310Z+ [[ -z '' ]]
3702024-02-09T21:10:23.310Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3712024-02-09T21:10:23.336Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3722024-02-09T21:10:23.336Z+ set +x
3732024-02-09T21:10:23.362ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3742024-02-09T21:10:23.362Z+ for ZPOOL in "${ZPOOLS[@]}"
3752024-02-09T21:10:23.362Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3762024-02-09T21:10:23.362ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3772024-02-09T21:10:23.362Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3782024-02-09T21:10:23.362Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3792024-02-09T21:10:23.362Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3802024-02-09T21:10:23.362Z0+0 records in
3812024-02-09T21:10:23.363Z0+0 records out
3822024-02-09T21:10:23.363Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3832024-02-09T21:10:23.363Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3842024-02-09T21:10:23.363Z+ set +x
3852024-02-09T21:10:23.363ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3862024-02-09T21:10:23.363Z++ zpool list -o name
3872024-02-09T21:10:23.363Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3882024-02-09T21:10:23.363Z+ [[ -z '' ]]
3892024-02-09T21:10:23.363Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3902024-02-09T21:10:23.396Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3912024-02-09T21:10:23.396Z+ set +x
3922024-02-09T21:10:23.397ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3932024-02-09T21:10:23.397Z+ for ZPOOL in "${ZPOOLS[@]}"
3942024-02-09T21:10:23.397Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3952024-02-09T21:10:23.397ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3962024-02-09T21:10:23.397Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3972024-02-09T21:10:23.397Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3982024-02-09T21:10:23.397Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3992024-02-09T21:10:23.398Z0+0 records in
4002024-02-09T21:10:23.398Z0+0 records out
4012024-02-09T21:10:23.398Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4022024-02-09T21:10:23.398Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4032024-02-09T21:10:23.398Z+ set +x
4042024-02-09T21:10:23.398ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
4052024-02-09T21:10:23.399Z++ zpool list -o name
4062024-02-09T21:10:23.399Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4072024-02-09T21:10:23.430Z+ [[ -z '' ]]
4082024-02-09T21:10:23.430Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4092024-02-09T21:10:23.430Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4102024-02-09T21:10:23.430Z+ set +x
4112024-02-09T21:10:23.431ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4122024-02-09T21:10:23.431Z+ for ZPOOL in "${ZPOOLS[@]}"
4132024-02-09T21:10:23.431Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4142024-02-09T21:10:23.431ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4152024-02-09T21:10:23.431Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4162024-02-09T21:10:23.431Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4172024-02-09T21:10:23.431Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4182024-02-09T21:10:23.432Z0+0 records in
4192024-02-09T21:10:23.432Z0+0 records out
4202024-02-09T21:10:23.432Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4212024-02-09T21:10:23.432Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4222024-02-09T21:10:23.432Z+ set +x
4232024-02-09T21:10:23.432ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4242024-02-09T21:10:23.433Z++ zpool list -o name
4252024-02-09T21:10:23.433Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4262024-02-09T21:10:23.462Z+ [[ -z '' ]]
4272024-02-09T21:10:23.462Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4282024-02-09T21:10:23.462Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4292024-02-09T21:10:23.462Z+ set +x
4302024-02-09T21:10:23.462ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4312024-02-09T21:10:23.462Z+ for ZPOOL in "${ZPOOLS[@]}"
4322024-02-09T21:10:23.462Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4332024-02-09T21:10:23.462ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4342024-02-09T21:10:23.463Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4352024-02-09T21:10:23.463Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4362024-02-09T21:10:23.463Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4372024-02-09T21:10:23.488Z0+0 records in
4382024-02-09T21:10:23.488Z0+0 records out
4392024-02-09T21:10:23.488Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4402024-02-09T21:10:23.488Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4412024-02-09T21:10:23.488Z+ set +x
4422024-02-09T21:10:23.488ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4432024-02-09T21:10:23.489Z++ zpool list -o name
4442024-02-09T21:10:23.489Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4452024-02-09T21:10:23.489Z+ [[ -z '' ]]
4462024-02-09T21:10:23.489Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4472024-02-09T21:10:23.514Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4482024-02-09T21:10:23.514Z+ set +x
4492024-02-09T21:10:23.515Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4502024-02-09T21:10:23.515ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4512024-02-09T21:10:23.515Z+ readarray -t ZPOOLS
4522024-02-09T21:10:23.515Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4532024-02-09T21:10:23.515Z++ sed 's/[ ",]//g'
4542024-02-09T21:10:23.515Z+ for ZPOOL in "${ZPOOLS[@]}"
4552024-02-09T21:10:23.515Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4562024-02-09T21:10:23.515ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4572024-02-09T21:10:23.516Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4582024-02-09T21:10:23.516Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4592024-02-09T21:10:23.516Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4602024-02-09T21:10:23.516Z0+0 records in
4612024-02-09T21:10:23.516Z0+0 records out
4622024-02-09T21:10:23.517Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4632024-02-09T21:10:23.517Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4642024-02-09T21:10:23.517Z+ set +x
4652024-02-09T21:10:23.517ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4662024-02-09T21:10:23.543Z++ zpool list -o name
4672024-02-09T21:10:23.543Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4682024-02-09T21:10:23.543Z+ [[ -z '' ]]
4692024-02-09T21:10:23.543Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4702024-02-09T21:10:23.569Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4712024-02-09T21:10:23.569Z+ set +x
4722024-02-09T21:10:23.569ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4732024-02-09T21:10:23.569Z+ for ZPOOL in "${ZPOOLS[@]}"
4742024-02-09T21:10:23.569Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4752024-02-09T21:10:23.569ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4762024-02-09T21:10:23.570Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4772024-02-09T21:10:23.570Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4782024-02-09T21:10:23.570Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4792024-02-09T21:10:23.570Z0+0 records in
4802024-02-09T21:10:23.570Z0+0 records out
4812024-02-09T21:10:23.570Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4822024-02-09T21:10:23.570Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4832024-02-09T21:10:23.570Z+ set +x
4842024-02-09T21:10:23.570ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4852024-02-09T21:10:23.570Z++ zpool list -o name
4862024-02-09T21:10:23.570Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4872024-02-09T21:10:23.596Z+ [[ -z '' ]]
4882024-02-09T21:10:23.596Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4892024-02-09T21:10:23.622Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4902024-02-09T21:10:23.622ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4912024-02-09T21:10:23.622Z+ set +x
4922024-02-09T21:10:23.622Z+ [[ zone == \z\o\n\e ]]
4932024-02-09T21:10:23.622Z+ ensure_simulated_links igb0
4942024-02-09T21:10:23.623Z+ local PHYSICAL_LINK=igb0
4952024-02-09T21:10:23.623Z+ INDICES=("0" "1")
4962024-02-09T21:10:23.623Z+ for I in "${INDICES[@]}"
4972024-02-09T21:10:23.623Z++ get_simnet_name_if_exists net0
4982024-02-09T21:10:23.623Z++ dladm show-simnet -p -o LINK net0
4992024-02-09T21:10:23.623Z++ echo ''
5002024-02-09T21:10:23.623Z+ [[ -z '' ]]
5012024-02-09T21:10:23.624Z+ dladm create-simnet -t net0
5022024-02-09T21:10:23.624Z+ dladm create-simnet -t sc0_0
5032024-02-09T21:10:23.624Z+ dladm modify-simnet -t -p net0 sc0_0
5042024-02-09T21:10:23.624Z+ dladm set-linkprop -p mtu=9000 sc0_0
5052024-02-09T21:10:23.650Z+ success 'Simnet net0/sc0_0 exists'
5062024-02-09T21:10:23.650Z+ set +x
5072024-02-09T21:10:23.650Z+ for I in "${INDICES[@]}"
5082024-02-09T21:10:23.650ZSimnet net0/sc0_0 exists
5092024-02-09T21:10:23.650Z++ get_simnet_name_if_exists net1
5102024-02-09T21:10:23.650Z++ dladm show-simnet -p -o LINK net1
5112024-02-09T21:10:23.650Z++ echo ''
5122024-02-09T21:10:23.650Z+ [[ -z '' ]]
5132024-02-09T21:10:23.651Z+ dladm create-simnet -t net1
5142024-02-09T21:10:23.651Z+ dladm create-simnet -t sc1_0
5152024-02-09T21:10:23.651Z+ dladm modify-simnet -t -p net1 sc1_0
5162024-02-09T21:10:23.651Z+ dladm set-linkprop -p mtu=9000 sc1_0
5172024-02-09T21:10:23.651Z+ success 'Simnet net1/sc1_0 exists'
5182024-02-09T21:10:23.651Z+ set +x
5192024-02-09T21:10:23.651ZSimnet net1/sc1_0 exists
5202024-02-09T21:10:23.651Z++ get_vnic_name_if_exists sc0_1
5212024-02-09T21:10:23.651Z++ dladm show-vnic -p -o LINK sc0_1
5222024-02-09T21:10:23.651Z++ echo ''
5232024-02-09T21:10:23.651Z+ [[ -z '' ]]
5242024-02-09T21:10:23.652Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5252024-02-09T21:10:23.678Z+ [[ -v PROMISC_FILT_OFF ]]
5262024-02-09T21:10:23.678Z+ success 'Vnic sc0_1 exists'
5272024-02-09T21:10:23.678Z+ set +x
5282024-02-09T21:10:23.678ZVnic sc0_1 exists
5292024-02-09T21:10:23.679Z+ warn_if_no_proxy_arp
5302024-02-09T21:10:23.679Z+ [[ -v PXA_START ]]
5312024-02-09T21:10:23.679Z+ [[ -v PXA_END ]]
5322024-02-09T21:10:23.679Z+ ensure_softnpu_zone
5332024-02-09T21:10:23.679Z+ zoneadm list
5342024-02-09T21:10:23.679Z+ grep -q sidecar_softnpu
5352024-02-09T21:10:23.679Z+ [[ -f out/npuzone/npuzone ]]
5362024-02-09T21:10:23.679Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5372024-02-09T21:10:23.680Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5382024-02-09T21:10:31.206Zdownloading softnpu ...done
5392024-02-09T21:10:31.233Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5402024-02-09T21:10:38.102Zdownloading asic_program.so ...done
5412024-02-09T21:10:38.128Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5422024-02-09T21:10:47.823Zdownloading scadm ...done
5432024-02-09T21:10:47.849Zcreating port tfportrear0_0 for sc0_0
5442024-02-09T21:10:47.849Zcreating port tfportqsfp0_0 for sc0_1
5452024-02-09T21:10:47.874Zsoftnpu zone setup
5462024-02-09T21:10:47.874Zconfigure zone
5472024-02-09T21:10:47.874Zinstall zone
5482024-02-09T21:10:48.898Zboot zone
5492024-02-09T21:10:51.999Z[sidecar_softnpu] svcs milestone/network
5502024-02-09T21:10:52.026ZSTATE STIME FMRI
5512024-02-09T21:10:52.026Zonline 21:10:49 svc:/milestone/network:default
5522024-02-09T21:10:52.027Z[sidecar_softnpu] /softnpu/npu start
5532024-02-09T21:10:52.053Z
5542024-02-09T21:10:52.079Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5552024-02-09T21:10:52.079Z+ GATEWAY_IP=10.151.2.100
5562024-02-09T21:10:52.079Z+ echo 'Using 10.151.2.100 as gateway ip'
5572024-02-09T21:10:52.079ZUsing 10.151.2.100 as gateway ip
5582024-02-09T21:10:52.080Z+ [[ ! -v GATEWAY_MAC ]]
5592024-02-09T21:10:52.080Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
5602024-02-09T21:10:52.080Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5612024-02-09T21:10:52.080Z+++ echo 18:c0:4d:0d:a0:2a
5622024-02-09T21:10:52.080Z+ COUNT=1
5632024-02-09T21:10:52.080Z+ [[ 1 -ne 1 ]]
5642024-02-09T21:10:52.080Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
5652024-02-09T21:10:52.080ZUsing 18:c0:4d:0d:a0:2a as gateway mac
5662024-02-09T21:10:52.080Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5672024-02-09T21:10:52.081Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5682024-02-09T21:10:52.111Z+ PXA_MAC=a8:e1:de:01:70:1d
5692024-02-09T21:10:52.111Z+ [[ -v PXA_START ]]
5702024-02-09T21:10:52.111Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5712024-02-09T21:10:52.111Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5722024-02-09T21:10:52.139Z+ z_scadm dump-state
5732024-02-09T21:10:52.139Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5742024-02-09T21:10:52.165Zlocal v6:
5752024-02-09T21:10:52.165Zlocal v4:
5762024-02-09T21:10:52.166Zrouter v6:
5772024-02-09T21:10:52.166Zrouter v4_idx:
5782024-02-09T21:10:52.166Zrouter v4_routes:
5792024-02-09T21:10:52.166Zresolver v4:
5802024-02-09T21:10:52.166Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
5812024-02-09T21:10:52.166Zresolver v6:
5822024-02-09T21:10:52.166Znat v4:
5832024-02-09T21:10:52.166Znat_v6:
5842024-02-09T21:10:52.167Zport_mac:
5852024-02-09T21:10:52.167Zproxy arp:
5862024-02-09T21:10:52.167Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
5872024-02-09T21:10:52.167Z+ success 'softnpu zone exists'
5882024-02-09T21:10:52.167Z+ set +x
5892024-02-09T21:10:52.167Zsoftnpu zone exists
5902024-02-09T21:10:52.167Z
5912024-02-09T21:10:52.167Zreal 29.061610645
5922024-02-09T21:10:52.168Zuser 0.695552977
5932024-02-09T21:10:52.168Zsys 1.478365583
5942024-02-09T21:10:52.168Ztrap 0.000081307
5952024-02-09T21:10:52.168Ztflt 0.000181466
5962024-02-09T21:10:52.168Zdflt 0.001183601
5972024-02-09T21:10:52.168Zkflt 0.000000000
5982024-02-09T21:10:52.168Zlock 22:35.135901721
5992024-02-09T21:10:52.168Zslp 1:26.954524825
6002024-02-09T21:10:52.169Zlat 0.053891666
6012024-02-09T21:10:52.169Zstop 0.340848206
6022024-02-09T21:10:52.169Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
6032024-02-09T21:10:52.195Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6042024-02-09T21:10:52.221Z+ SILO_NAME=recovery
6052024-02-09T21:10:52.222Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6062024-02-09T21:10:52.222Z+ EXTERNAL_DNS_DOMAIN=oxide.test
6072024-02-09T21:10:52.222Z+ sed -i~ '
6082024-02-09T21:10:52.222Z /^external_dns_ips/c\
6092024-02-09T21:10:52.222Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6102024-02-09T21:10:52.222Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6112024-02-09T21:10:52.222Z /^first/c\
6122024-02-09T21:10:52.222Zfirst = "10.151.2.164"
6132024-02-09T21:10:52.222Z /^last/c\
6142024-02-09T21:10:52.222Zlast = "10.151.2.173"
6152024-02-09T21:10:52.222Z }
6162024-02-09T21:10:52.223Z /^\[rack_network_config/,/^$/ {
6172024-02-09T21:10:52.223Z /^infra_ip_first/c\
6182024-02-09T21:10:52.223Zinfra_ip_first = "10.151.2.174"
6192024-02-09T21:10:52.223Z /^infra_ip_last/c\
6202024-02-09T21:10:52.223Zinfra_ip_last = "10.151.2.174"
6212024-02-09T21:10:52.223Z }
6222024-02-09T21:10:52.223Z /^\[\[rack_network_config.ports/,/^$/ {
6232024-02-09T21:10:52.223Z /^routes/c\
6242024-02-09T21:10:52.224Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
6252024-02-09T21:10:52.224Z /^addresses/c\
6262024-02-09T21:10:52.224Zaddresses = \["10.151.2.174/24"\]
6272024-02-09T21:10:52.224Z }
6282024-02-09T21:10:52.224Z' pkg/config-rss.toml
6292024-02-09T21:10:52.224Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6302024-02-09T21:10:52.224Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6312024-02-09T21:10:52.224Z+++ pkg/config-rss.toml Fri Feb 9 21:10:51 2024
6322024-02-09T21:10:52.224Z@@ -33,7 +33,7 @@
6332024-02-09T21:10:52.224Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6342024-02-09T21:10:52.224Z # must be contained in one of the "internal services" IP Pool ranges listed
6352024-02-09T21:10:52.224Z # below.
6362024-02-09T21:10:52.225Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6372024-02-09T21:10:52.225Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6382024-02-09T21:10:52.225Z
6392024-02-09T21:10:52.225Z # Initial TLS certificates for the external API
6402024-02-09T21:10:52.225Z #
6412024-02-09T21:10:52.225Z@@ -69,8 +69,8 @@
6422024-02-09T21:10:52.225Z #
6432024-02-09T21:10:52.225Z # For more on this and what to put here, see docs/how-to-run.adoc.
6442024-02-09T21:10:52.225Z [[internal_services_ip_pool_ranges]]
6452024-02-09T21:10:52.225Z-first = "192.168.1.20"
6462024-02-09T21:10:52.226Z-last = "192.168.1.29"
6472024-02-09T21:10:52.226Z+first = "10.151.2.164"
6482024-02-09T21:10:52.226Z+last = "10.151.2.173"
6492024-02-09T21:10:52.226Z
6502024-02-09T21:10:52.226Z # TODO - this configuration is subject to change going forward. Ultimately these
6512024-02-09T21:10:52.226Z # parameters should be provided to the control plane via wicket, but we need to
6522024-02-09T21:10:52.226Z@@ -100,9 +100,9 @@
6532024-02-09T21:10:52.226Z # You can configure multiple uplinks by repeating the following stanza
6542024-02-09T21:10:52.226Z [[rack_network_config.ports]]
6552024-02-09T21:10:52.226Z # Routes associated with this port.
6562024-02-09T21:10:52.227Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6572024-02-09T21:10:52.227Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
6582024-02-09T21:10:52.227Z # Addresses associated with this port.
6592024-02-09T21:10:52.227Z-addresses = ["192.168.1.30/24"]
6602024-02-09T21:10:52.227Z+addresses = ["10.151.2.174/24"]
6612024-02-09T21:10:52.227Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6622024-02-09T21:10:52.227Z port = "qsfp0"
6632024-02-09T21:10:52.227Z # The speed of this port.
6642024-02-09T21:10:52.227Z+ true
6652024-02-09T21:10:52.227Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6662024-02-09T21:10:52.228Za pkg/config-rss.toml 7K
6672024-02-09T21:10:52.228Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6682024-02-09T21:10:52.228Z+ TLS_NAME=recovery.sys.oxide.test
6692024-02-09T21:10:52.228Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6702024-02-09T21:10:52.735Z...+..................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+..+.+..+...+...+.+......+.....+.............+..+....+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+......+...+.....+......+..........+......+.....+......+.......+.....+...+.........+....+............+.........+........+.+.....+.......+........+....+...+...+..............+.+.....+......+.+........+.......+...+..+..........+.........+...............+..............+......+....+.....+.+..............+.+......+........+..........+.........+...+.........+...+.....+...+...+................+......+...+.....+.+.....+.+...+.................+.............+.........+..+...+...+.......+..+...................+..............+.+.....+......+.............+..+.+.....+.......+...........+....+...+.....+.........+...+..........+...+..+.+.....+.+........+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6712024-02-09T21:10:53.857Z..+..+............+.+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+.....+....+......+..+.........+.........+.......+..+.+.........+...+........+.+.....+...+...+...+.........+...+.........+....+.....+....+..+....+..+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...........+......+.+..+............+.+.....+...+............+......................+.....+...+....+...........+....+.....+...+.+......+...............+...............+...+..+.+...............+...+..+.............+.........+......+.........+..+................+.........+...+...+........+..........+..+.......+..+....+.........................................+.+.........+...........+..........+.....+....+...+......+..+...+.....................+....+............+..+...+...................+.......................+...+...+............+......................+......+......+.........+..+.........+....+.....+.........+.+..+...+....+..+...+......+......+....+...........+....+........................+.....+.............+........+............+.......+...+..+.......+...+..+.....................+....+...........+......................+.................+...+.+.........+.....+...+.........+...............+...+.......+...+.....+...+.............+.....+......+...+.+......+......+..............+...+..........+..+.+...+.........+..+.+....................+....+...+...+..+...+............+......+.......+..+...+....+...+.....+......+.+..................+...+..+..........+...........+.........+...+.......+......+...........+.+...+.....+.+......+.....+.............+.....+..........+...........+...+..........+...............+...+..............+...+............+.........+............+...+.......+.........+........+.+......+........+.......+......+...+......+........+...+...+...............+....+........+...+............+............+.+.....+....+........+.........+..................+.......+......+..+......+............+.........+....+......+........+...+...................+...+...........+.+......+...+..+...+.+...+..+...+.......+.....+.+............+..+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6722024-02-09T21:10:53.883Z-----
6732024-02-09T21:10:53.883Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6742024-02-09T21:10:53.909Za pkg/initial-tls-cert.pem 2K
6752024-02-09T21:10:53.909Za pkg/initial-tls-key.pem 4K
6762024-02-09T21:10:53.909Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6772024-02-09T21:10:53.909Z+ rmdir pkg
6782024-02-09T21:10:53.910Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6792024-02-09T21:10:53.910Z+ pfexec mkdir -p /usr/oxide
6802024-02-09T21:10:53.910Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6812024-02-09T21:10:54.681Z+ pfexec chmod +x /usr/oxide/oxide
6822024-02-09T21:10:54.706Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6832024-02-09T21:11:12.969Z+ OMICRON_NO_UNINSTALL=1
6842024-02-09T21:11:12.969Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6852024-02-09T21:11:12.994ZLogging to: /opt/oxide/work/out/LOG
6862024-02-09T21:11:13.497Z
6872024-02-09T21:11:13.531Zreal 0.523150943
6882024-02-09T21:11:13.531Zuser 0.109344802
6892024-02-09T21:11:13.531Zsys 2.081224187
6902024-02-09T21:11:13.532Ztrap 0.000000400
6912024-02-09T21:11:13.532Ztflt 0.000533806
6922024-02-09T21:11:13.532Zdflt 0.000403045
6932024-02-09T21:11:13.532Zkflt 0.000003240
6942024-02-09T21:11:13.532Zlock 47.559829895
6952024-02-09T21:11:13.532Zslp 0.734862411
6962024-02-09T21:11:13.532Zlat 0.002989061
6972024-02-09T21:11:13.532Zstop 0.228887111
6982024-02-09T21:11:13.532Z+ retry=0
6992024-02-09T21:11:13.532Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7002024-02-09T21:11:13.533Z+ [[ 0 -gt 30 ]]
7012024-02-09T21:11:13.533Z+ sleep 1
7022024-02-09T21:11:14.513Z+ retry=1
7032024-02-09T21:11:14.513Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7042024-02-09T21:11:14.538Z+ [[ 1 -gt 30 ]]
7052024-02-09T21:11:14.538Z+ sleep 1
7062024-02-09T21:11:15.531Z+ retry=2
7072024-02-09T21:11:15.532Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7082024-02-09T21:11:15.562Z+ [[ 2 -gt 30 ]]
7092024-02-09T21:11:15.562Z+ sleep 1
7102024-02-09T21:11:16.552Z+ retry=3
7112024-02-09T21:11:16.552Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7122024-02-09T21:11:16.578Z+ [[ 3 -gt 30 ]]
7132024-02-09T21:11:16.578Z+ sleep 1
7142024-02-09T21:11:17.561Z+ retry=4
7152024-02-09T21:11:17.561Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
 
7162024-02-09T21:11:18.710ZError: No response to keepalive - Terminating session
7172024-02-09T21:11:28.741ZError: No response de-activating SOL payload
7182024-02-09T21:11:29.892Z[SOL Session operational. Use ~? for help]
 
7192024-02-09T21:11:42.734Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7202024-02-09T21:11:42.784Zlocal v6:
7212024-02-09T21:11:42.784Zfe80::889d:d0ff:fed2:3591
7222024-02-09T21:11:42.784Zfd97:68f3:9e36:74e3::1
7232024-02-09T21:11:42.784Zlocal v4:
7242024-02-09T21:11:42.784Z10.151.2.174
7252024-02-09T21:11:42.785Zrouter v6:
7262024-02-09T21:11:42.785Zfd00:1122:3344:101::/64 -> fe80::34f8:ff:feb3:217b (1)
7272024-02-09T21:11:42.785Zfdb0:18c0:4d0d:a02a::/64 -> fe80::34f8:ff:feb3:217b (1)
7282024-02-09T21:11:42.785Zfd00:1122:3344:1::/64 -> fe80::34f8:ff:feb3:217b (1)
7292024-02-09T21:11:42.785Zfd00:1122:3344:2::/64 -> fe80::34f8:ff:feb3:217b (1)
7302024-02-09T21:11:42.785Zfd00:1122:3344:3::/64 -> fe80::34f8:ff:feb3:217b (1)
7312024-02-09T21:11:42.785Zrouter v4_idx:
7322024-02-09T21:11:42.786Z0.0.0.0/0 -> 0
7332024-02-09T21:11:42.786Zrouter v4_routes:
7342024-02-09T21:11:42.786Z0 -> 10.151.2.100 (2)
7352024-02-09T21:11:42.786Zresolver v4:
7362024-02-09T21:11:42.786Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7372024-02-09T21:11:42.786Z10.151.2.174 -> de:dd:bc:ed:02:1c
7382024-02-09T21:11:42.786Zresolver v6:
7392024-02-09T21:11:42.787Zfe80::889d:d0ff:fed2:3591 -> 8a:9d:d0:d2:35:91
7402024-02-09T21:11:42.787Zfe80::34f8:ff:feb3:217b -> 36:f8:00:b3:21:7b
7412024-02-09T21:11:42.787Znat v4:
7422024-02-09T21:11:42.787Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:ae:b8
7432024-02-09T21:11:42.787Znat_v6:
7442024-02-09T21:11:42.787Zport_mac:
7452024-02-09T21:11:42.787Z1: a8:40:25:0a:ed:30
7462024-02-09T21:11:42.788Z1000: a8:40:25:0a:ed:2f
7472024-02-09T21:11:42.788Zproxy arp:
7482024-02-09T21:11:42.788Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7492024-02-09T21:11:42.814Z+ retry=0
7502024-02-09T21:11:42.814Z+++ zoneadm list -n
7512024-02-09T21:11:42.815Z+++ grep oxz_ntp
7522024-02-09T21:11:42.842Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
7532024-02-09T21:11:42.842Zsvcs: Could not bind to repository server for zone oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14: repository server unavailable
7542024-02-09T21:11:42.842Z++ true
7552024-02-09T21:11:42.842Z+ [[ '' != online ]]
7562024-02-09T21:11:42.843Z+ [[ 0 -gt 60 ]]
7572024-02-09T21:11:42.843Z+ sleep 1
7582024-02-09T21:11:43.835Z+ retry=1
7592024-02-09T21:11:43.881Z+++ zoneadm list -n
7602024-02-09T21:11:43.881Z+++ grep oxz_ntp
7612024-02-09T21:11:43.881Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
7622024-02-09T21:11:43.881Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7632024-02-09T21:11:43.882Z++ true
7642024-02-09T21:11:43.918Z+ [[ '' != online ]]
7652024-02-09T21:11:43.918Z+ [[ 1 -gt 60 ]]
7662024-02-09T21:11:43.918Z+ sleep 1
7672024-02-09T21:11:44.864Z+ retry=2
7682024-02-09T21:11:44.890Z+++ zoneadm list -n
7692024-02-09T21:11:44.891Z+++ grep oxz_ntp
7702024-02-09T21:11:44.891Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
7712024-02-09T21:11:44.917Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7722024-02-09T21:11:44.917Z++ true
7732024-02-09T21:11:44.917Z+ [[ '' != online ]]
7742024-02-09T21:11:44.918Z+ [[ 2 -gt 60 ]]
7752024-02-09T21:11:44.918Z+ sleep 1
7762024-02-09T21:11:45.896Z+ retry=3
7772024-02-09T21:11:45.922Z+++ zoneadm list -n
7782024-02-09T21:11:45.922Z+++ grep oxz_ntp
7792024-02-09T21:11:45.922Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
7802024-02-09T21:11:45.922Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7812024-02-09T21:11:45.923Z++ true
7822024-02-09T21:11:45.948Z+ [[ '' != online ]]
7832024-02-09T21:11:45.948Z+ [[ 3 -gt 60 ]]
7842024-02-09T21:11:45.949Z+ sleep 1
7852024-02-09T21:11:46.927Z+ retry=4
7862024-02-09T21:11:46.952Z+++ zoneadm list -n
7872024-02-09T21:11:46.952Z+++ grep oxz_ntp
7882024-02-09T21:11:46.952Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
7892024-02-09T21:11:46.953Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7902024-02-09T21:11:46.953Z++ true
7912024-02-09T21:11:46.986Z+ [[ '' != online ]]
7922024-02-09T21:11:46.986Z+ [[ 4 -gt 60 ]]
7932024-02-09T21:11:46.986Z+ sleep 1
7942024-02-09T21:11:47.956Z+ retry=5
7952024-02-09T21:11:47.980Z+++ zoneadm list -n
7962024-02-09T21:11:47.981Z+++ grep oxz_ntp
7972024-02-09T21:11:47.981Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
7982024-02-09T21:11:47.981Z+ [[ disabled != online ]]
7992024-02-09T21:11:47.981Z+ [[ 5 -gt 60 ]]
8002024-02-09T21:11:47.981Z+ sleep 1
8012024-02-09T21:11:48.979Z+ retry=6
8022024-02-09T21:11:49.005Z+++ zoneadm list -n
8032024-02-09T21:11:49.006Z+++ grep oxz_ntp
8042024-02-09T21:11:49.006Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
8052024-02-09T21:11:49.006Z+ [[ disabled != online ]]
8062024-02-09T21:11:49.006Z+ [[ 6 -gt 60 ]]
8072024-02-09T21:11:49.006Z+ sleep 1
8082024-02-09T21:11:50.003Z+ retry=7
8092024-02-09T21:11:50.029Z+++ zoneadm list -n
8102024-02-09T21:11:50.029Z+++ grep oxz_ntp
8112024-02-09T21:11:50.029Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
8122024-02-09T21:11:50.029Z+ [[ disabled != online ]]
8132024-02-09T21:11:50.030Z+ [[ 7 -gt 60 ]]
8142024-02-09T21:11:50.030Z+ sleep 1
8152024-02-09T21:11:51.043Z+ retry=8
8162024-02-09T21:11:51.484Z+++ zoneadm list -n
8172024-02-09T21:11:51.484Z+++ grep oxz_ntp
8182024-02-09T21:11:51.484Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
8192024-02-09T21:11:51.484Z+ [[ disabled != online ]]
8202024-02-09T21:11:51.484Z+ [[ 8 -gt 60 ]]
8212024-02-09T21:11:51.484Z+ sleep 1
8222024-02-09T21:11:52.046Z+ retry=9
8232024-02-09T21:11:52.078Z+++ zoneadm list -n
8242024-02-09T21:11:52.078Z+++ grep oxz_ntp
8252024-02-09T21:11:52.078Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
8262024-02-09T21:11:52.078Z+ [[ disabled != online ]]
8272024-02-09T21:11:52.078Z+ [[ 9 -gt 60 ]]
8282024-02-09T21:11:52.079Z+ sleep 1
8292024-02-09T21:11:53.070Z+ retry=10
8302024-02-09T21:11:53.096Z+++ zoneadm list -n
8312024-02-09T21:11:53.096Z+++ grep oxz_ntp
8322024-02-09T21:11:53.096Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
8332024-02-09T21:11:53.096Z+ [[ disabled != online ]]
8342024-02-09T21:11:53.097Z+ [[ 10 -gt 60 ]]
8352024-02-09T21:11:53.097Z+ sleep 1
8362024-02-09T21:11:54.094Z+ retry=11
8372024-02-09T21:11:54.121Z+++ zoneadm list -n
8382024-02-09T21:11:54.121Z+++ grep oxz_ntp
8392024-02-09T21:11:54.121Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
8402024-02-09T21:11:54.121Z+ [[ disabled != online ]]
8412024-02-09T21:11:54.122Z+ [[ 11 -gt 60 ]]
8422024-02-09T21:11:54.122Z+ sleep 1
8432024-02-09T21:11:55.115Z+ retry=12
8442024-02-09T21:11:55.141Z+++ zoneadm list -n
8452024-02-09T21:11:55.141Z+++ grep oxz_ntp
8462024-02-09T21:11:55.141Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
8472024-02-09T21:11:55.141Z+ [[ disabled != online ]]
8482024-02-09T21:11:55.141Z+ [[ 12 -gt 60 ]]
8492024-02-09T21:11:55.142Z+ sleep 1
8502024-02-09T21:11:56.143Z+ retry=13
 
8512024-02-09T21:11:56.148ZFeb 9 21:11:54 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8522024-02-09T21:11:56.169Z+++ zoneadm list -n
8532024-02-09T21:11:56.169Z+++ grep oxz_ntp
8542024-02-09T21:11:56.169Z++ pfexec svcs -z oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14 -Hostate oxide/ntp
8552024-02-09T21:11:56.169Z+ [[ online != online ]]
8562024-02-09T21:11:56.170Z+ echo 'Waited for chrony: 13s'
8572024-02-09T21:11:56.170ZWaited for chrony: 13s
8582024-02-09T21:11:56.170Z+ export RUST_BACKTRACE=1
8592024-02-09T21:11:56.170Z+ RUST_BACKTRACE=1
8602024-02-09T21:11:56.170Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8612024-02-09T21:11:56.170Z++ ./tests/bootstrap
8622024-02-09T21:11:56.197ZUsing external DNS server at 10.151.2.164:53
8632024-02-09T21:11:56.198Z2024-02-09 21:11:55.673481405 UTC: attempting to log into API
8642024-02-09T21:12:11.228Z2024-02-09 21:12:11.271539012 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8652024-02-09T21:12:12.228Z2024-02-09 21:12:12.272603198 UTC: attempting to log into API
8662024-02-09T21:12:27.261Z2024-02-09 21:12:27.305221817 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8672024-02-09T21:12:28.261Z2024-02-09 21:12:28.306185340 UTC: attempting to log into API
8682024-02-09T21:12:43.292Z2024-02-09 21:12:43.337321702 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8692024-02-09T21:12:44.294Z2024-02-09 21:12:44.338389367 UTC: attempting to log into API
8702024-02-09T21:12:59.328Z2024-02-09 21:12:59.369530389 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8712024-02-09T21:13:00.336Z2024-02-09 21:13:00.370511913 UTC: attempting to log into API
8722024-02-09T21:13:15.359Z2024-02-09 21:13:15.381410961 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8732024-02-09T21:13:16.359Z2024-02-09 21:13:16.379760867 UTC: attempting to log into API
8742024-02-09T21:13:31.390Z2024-02-09 21:13:31.380347557 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8752024-02-09T21:13:32.398Z2024-02-09 21:13:32.381421153 UTC: attempting to log into API
8762024-02-09T21:13:47.431Z2024-02-09 21:13:47.412970702 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8772024-02-09T21:13:48.424Z2024-02-09 21:13:48.414008837 UTC: attempting to log into API
8782024-02-09T21:14:03.456Z2024-02-09 21:14:03.445967374 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8792024-02-09T21:14:04.457Z2024-02-09 21:14:04.447063650 UTC: attempting to log into API
8802024-02-09T21:14:19.499Z2024-02-09 21:14:19.475760682 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8812024-02-09T21:14:20.496Z2024-02-09 21:14:20.476739966 UTC: attempting to log into API
 
8822024-02-09T21:14:34.316ZError: No response to keepalive - Terminating session
 
8832024-02-09T21:14:37.086Z2024-02-09 21:14:36.943521800 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8842024-02-09T21:14:37.962Z2024-02-09 21:14:37.946255117 UTC: attempting to log into API
 
8852024-02-09T21:14:44.549ZError: No response de-activating SOL payload
8862024-02-09T21:14:45.687Z[SOL Session operational. Use ~? for help]
 
8872024-02-09T21:14:53.014Z2024-02-09 21:14:52.995960439 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8882024-02-09T21:14:54.010Z2024-02-09 21:14:53.997234049 UTC: attempting to log into API
8892024-02-09T21:15:09.044Z2024-02-09 21:15:09.030110961 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8902024-02-09T21:15:10.045Z2024-02-09 21:15:10.031094796 UTC: attempting to log into API
 
8912024-02-09T21:15:11.910ZFeb 9 21:15:11 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
8922024-02-09T21:15:18.940ZFeb 9 21:15:18 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
 
8932024-02-09T21:15:25.076Z2024-02-09 21:15:25.063872122 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8942024-02-09T21:15:26.077Z2024-02-09 21:15:26.064987618 UTC: attempting to log into API
 
8952024-02-09T21:15:26.723ZFeb 9 21:15:26 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
8962024-02-09T21:15:33.741ZFeb 9 21:15:33 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
8972024-02-09T21:15:40.450ZFeb 9 21:15:39 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8982024-02-09T21:15:41.107Z2024-02-09 21:15:41.095783594 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8992024-02-09T21:15:42.109Z2024-02-09 21:15:42.096864040 UTC: attempting to log into API
9002024-02-09T21:15:47.905Z2024-02-09 21:15:47.893494633 UTC: login succeeded
9012024-02-09T21:15:47.937Zwaiting for nexus to come up...
9022024-02-09T21:15:48.000Zcreating IP pool... 10.151.2.175 - 10.151.2.227
9032024-02-09T21:15:48.194Zsetting up quotas...
9042024-02-09T21:15:48.245Zensuring datasets are ready...
9052024-02-09T21:15:50.804Zlet's roll.
9062024-02-09T21:15:50.829Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
9072024-02-09T21:15:50.829ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
9082024-02-09T21:15:50.829ZOXIDE_TOKEN=oxide-token-7b4986d5f1f6d2dfcd87245f12c36f6a5bb34923'
9092024-02-09T21:15:50.830Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9102024-02-09T21:15:50.830Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
9112024-02-09T21:15:50.830Z++ OXIDE_TOKEN=oxide-token-7b4986d5f1f6d2dfcd87245f12c36f6a5bb34923
9122024-02-09T21:15:50.830Z+ export OXIDE_HOST OXIDE_TOKEN
9132024-02-09T21:15:50.830Z+ retry=0
9142024-02-09T21:15:50.830Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9152024-02-09T21:15:50.912Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9162024-02-09T21:15:51.209Z{"status":"ok"}success
9172024-02-09T21:15:51.209ZProject {
9182024-02-09T21:15:51.209Z description: "some images",
9192024-02-09T21:15:51.209Z id: 98388907-b4f7-43af-83c1-51fcbf1993f0,
9202024-02-09T21:15:51.209Z name: Name(
9212024-02-09T21:15:51.209Z "images",
9222024-02-09T21:15:51.209Z ),
9232024-02-09T21:15:51.234Z time_created: 2024-02-09T21:15:50.979490Z,
9242024-02-09T21:15:51.234Z time_modified: 2024-02-09T21:15:50.979490Z,
9252024-02-09T21:15:51.234Z}
9262024-02-09T21:15:51.234Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
9272024-02-09T21:17:34.803ZError: No response to keepalive - Terminating session
9282024-02-09T21:17:44.760ZError: No response de-activating SOL payload
9292024-02-09T21:17:45.872Z[SOL Session operational. Use ~? for help]
9302024-02-09T21:20:34.650ZError: No response to keepalive - Terminating session
9312024-02-09T21:20:44.595ZError: No response de-activating SOL payload
9322024-02-09T21:20:45.963Z[SOL Session operational. Use ~? for help]
 
9332024-02-09T21:21:10.984Zdone!
9342024-02-09T21:21:11.083Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9352024-02-09T21:21:11.195Zsuccess
9362024-02-09T21:21:11.195ZImage {
9372024-02-09T21:21:11.195Z block_size: ByteCount(
9382024-02-09T21:21:11.195Z 512,
9392024-02-09T21:21:11.195Z ),
9402024-02-09T21:21:11.220Z description: "debian 11 original base image",
9412024-02-09T21:21:11.221Z digest: None,
9422024-02-09T21:21:11.221Z id: fceccaf6-0b1f-4ec2-9bd4-5c9c3a725f00,
9432024-02-09T21:21:11.221Z name: Name(
9442024-02-09T21:21:11.221Z "debian11",
9452024-02-09T21:21:11.221Z ),
9462024-02-09T21:21:11.221Z os: "debian",
9472024-02-09T21:21:11.221Z project_id: None,
9482024-02-09T21:21:11.221Z size: ByteCount(
9492024-02-09T21:21:11.221Z 2147483648,
9502024-02-09T21:21:11.221Z ),
9512024-02-09T21:21:11.221Z time_created: 2024-02-09T21:21:10.950023Z,
9522024-02-09T21:21:11.221Z time_modified: 2024-02-09T21:21:11.174359Z,
9532024-02-09T21:21:11.221Z url: None,
9542024-02-09T21:21:11.221Z version: "11",
9552024-02-09T21:21:11.221Z}
9562024-02-09T21:21:11.221Z+ rm ./tests/bootstrap
9572024-02-09T21:21:11.295Z+ for test_bin in tests/*
9582024-02-09T21:21:11.295Z+ ./tests/bootstrap-000e38cfb9ecff29
9592024-02-09T21:21:11.356Z
9602024-02-09T21:21:11.356Zrunning 0 tests
9612024-02-09T21:21:11.356Z
9622024-02-09T21:21:11.383Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9632024-02-09T21:21:11.384Z
9642024-02-09T21:21:11.384Z+ for test_bin in tests/*
9652024-02-09T21:21:11.384Z+ ./tests/end_to_end_tests-a157f2ab3f0f1a11
9662024-02-09T21:21:11.491Z
9672024-02-09T21:21:11.492Zrunning 2 tests
9682024-02-09T21:21:11.723Ztest no_spoof::no_spoof_here ... ok
9692024-02-09T21:21:54.887Ztest instance_launch::instance_launch ... ok
9702024-02-09T21:21:54.887Z
9712024-02-09T21:21:54.887Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 43.40s
9722024-02-09T21:21:54.888Z
9732024-02-09T21:21:54.913Z+ _exit_trap
9742024-02-09T21:21:54.913Z+ local status=0
9752024-02-09T21:21:54.913Z+ [[ 0 -eq 0 ]]
9762024-02-09T21:21:54.913Z+ exit 0
9772024-02-09T21:21:54.947Zprocess exited: duration 729705 ms, exit code 0
 
9782024-02-09T21:21:55.051Zfound 125 output files
9792024-02-09T21:21:55.114Zuploading: /var/svc/log/oxide-sled-agent:default.log (2223374 bytes)
9802024-02-09T21:21:57.115Zuploaded: /var/svc/log/oxide-sled-agent:default.log
9812024-02-09T21:21:57.115Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (1755641 bytes)
9822024-02-09T21:21:58.180Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 1755641 -> 1769224
9832024-02-09T21:21:59.261Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
9842024-02-09T21:21:59.261Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (881273 bytes)
9852024-02-09T21:22:00.733Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
9862024-02-09T21:22:00.733Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
9872024-02-09T21:22:01.808Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
9882024-02-09T21:22:01.808Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (9188 bytes)
9892024-02-09T21:22:02.938Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
9902024-02-09T21:22:02.938Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (15314 bytes)
9912024-02-09T21:22:03.032Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 15314 -> 15662
9922024-02-09T21:22:04.106Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
9932024-02-09T21:22:04.106Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (8071 bytes)
9942024-02-09T21:22:05.651Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
9952024-02-09T21:22:05.651Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1329842 bytes)
9962024-02-09T21:22:07.135Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1329842 -> 1360999
9972024-02-09T21:22:08.209Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
9982024-02-09T21:22:08.209Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (433458 bytes)
9992024-02-09T21:22:09.763Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
10002024-02-09T21:22:09.763Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (754832 bytes)
10012024-02-09T21:22:11.158Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 754832 -> 774920
10022024-02-09T21:22:12.234Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10032024-02-09T21:22:12.234Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (252903 bytes)
10042024-02-09T21:22:13.622Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
10052024-02-09T21:22:13.623Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
10062024-02-09T21:22:14.704Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10072024-02-09T21:22:14.704Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
10082024-02-09T21:22:15.813Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
10092024-02-09T21:22:15.813Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (200849 bytes)
10102024-02-09T21:22:16.139Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 200849 -> 211955
10112024-02-09T21:22:17.212Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10122024-02-09T21:22:17.212Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (95184 bytes)
10132024-02-09T21:22:18.445Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
10142024-02-09T21:22:18.445Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
10152024-02-09T21:22:19.943Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10162024-02-09T21:22:19.943Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
10172024-02-09T21:22:21.050Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
10182024-02-09T21:22:21.088Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
10192024-02-09T21:22:22.140Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10202024-02-09T21:22:22.140Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5393 bytes)
10212024-02-09T21:22:23.274Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
10222024-02-09T21:22:23.274Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-clickhouse:default.log (1161817 bytes)
10232024-02-09T21:22:25.542Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1161817 -> 1239536
10242024-02-09T21:22:26.621Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-clickhouse:default.log
10252024-02-09T21:22:26.621Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-clickhouse:default.log.0 (119 bytes)
10262024-02-09T21:22:27.738Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-clickhouse:default.log.0
10272024-02-09T21:22:27.738Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-zone-network-setup:default.log (1585 bytes)
10282024-02-09T21:22:28.844Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-zone-network-setup:default.log
10292024-02-09T21:22:28.844Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-zone-network-setup:default.log.0 (119 bytes)
10302024-02-09T21:22:29.938Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_2d87007f-dd78-4a53-9e6a-affe1e8578dd/root/var/svc/log/oxide-zone-network-setup:default.log.0
10312024-02-09T21:22:29.939Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9822dded-9084-4bcb-acff-e08ee8809728/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
10322024-02-09T21:22:31.024Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9822dded-9084-4bcb-acff-e08ee8809728/root/var/svc/log/oxide-cockroachdb:default.log
10332024-02-09T21:22:31.024Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9822dded-9084-4bcb-acff-e08ee8809728/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
10342024-02-09T21:22:32.130Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9822dded-9084-4bcb-acff-e08ee8809728/root/var/svc/log/oxide-cockroachdb:default.log.0
10352024-02-09T21:22:32.130Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9822dded-9084-4bcb-acff-e08ee8809728/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10362024-02-09T21:22:33.205Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9822dded-9084-4bcb-acff-e08ee8809728/root/var/svc/log/oxide-zone-network-setup:default.log
10372024-02-09T21:22:33.205Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9822dded-9084-4bcb-acff-e08ee8809728/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
10382024-02-09T21:22:39.515Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9822dded-9084-4bcb-acff-e08ee8809728/root/var/svc/log/oxide-zone-network-setup:default.log.0
10392024-02-09T21:22:39.515Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-agent:default.log (13956 bytes)
10402024-02-09T21:22:40.635Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-agent:default.log
10412024-02-09T21:22:40.667Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-agent:default.log.0 (119 bytes)
10422024-02-09T21:22:41.731Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-agent:default.log.0
10432024-02-09T21:22:41.731Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
10442024-02-09T21:22:42.809Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-downstairs:default.log
10452024-02-09T21:22:42.809Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
10462024-02-09T21:22:45.722Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-downstairs:default.log.0
10472024-02-09T21:22:45.722Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-downstairs:downstairs-5ed261c3-c284-4e3b-bb3d-831b7b99303d.log (5535 bytes)
10482024-02-09T21:22:46.830Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6c7363af-c204-4d04-b820-2c48b938b961/root/var/svc/log/oxide-crucible-downstairs:downstairs-5ed261c3-c284-4e3b-bb3d-831b7b99303d.log
10492024-02-09T21:22:46.830Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_26fa6230-6a52-4867-a073-2918d92baa6b/root/var/svc/log/oxide-external_dns:default.log (26768 bytes)
10502024-02-09T21:22:46.944Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_26fa6230-6a52-4867-a073-2918d92baa6b/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26768 -> 30533
10512024-02-09T21:22:48.034Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_26fa6230-6a52-4867-a073-2918d92baa6b/root/var/svc/log/oxide-external_dns:default.log
10522024-02-09T21:22:48.034Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_26fa6230-6a52-4867-a073-2918d92baa6b/root/var/svc/log/oxide-external_dns:default.log.0 (75 bytes)
10532024-02-09T21:22:49.123Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_26fa6230-6a52-4867-a073-2918d92baa6b/root/var/svc/log/oxide-external_dns:default.log.0
10542024-02-09T21:22:49.123Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0e86c47c-f102-4dae-b3de-66cf774453ac/root/var/svc/log/oxide-internal_dns:default.log (24623 bytes)
10552024-02-09T21:22:49.218Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0e86c47c-f102-4dae-b3de-66cf774453ac/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 24623 -> 28377
10562024-02-09T21:22:50.289Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0e86c47c-f102-4dae-b3de-66cf774453ac/root/var/svc/log/oxide-internal_dns:default.log
10572024-02-09T21:22:50.318Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0e86c47c-f102-4dae-b3de-66cf774453ac/root/var/svc/log/oxide-internal_dns:default.log.0 (94329 bytes)
10582024-02-09T21:22:51.542Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0e86c47c-f102-4dae-b3de-66cf774453ac/root/var/svc/log/oxide-internal_dns:default.log.0
10592024-02-09T21:22:51.542Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ef72eb88-de65-4f60-8270-28e9b6c1431f/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
10602024-02-09T21:22:52.616Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ef72eb88-de65-4f60-8270-28e9b6c1431f/root/var/svc/log/oxide-cockroachdb:default.log
10612024-02-09T21:22:52.616Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ef72eb88-de65-4f60-8270-28e9b6c1431f/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
10622024-02-09T21:22:53.721Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ef72eb88-de65-4f60-8270-28e9b6c1431f/root/var/svc/log/oxide-cockroachdb:default.log.0
10632024-02-09T21:22:53.722Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ef72eb88-de65-4f60-8270-28e9b6c1431f/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10642024-02-09T21:22:54.795Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ef72eb88-de65-4f60-8270-28e9b6c1431f/root/var/svc/log/oxide-zone-network-setup:default.log
10652024-02-09T21:22:54.795Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ef72eb88-de65-4f60-8270-28e9b6c1431f/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
10662024-02-09T21:22:55.895Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ef72eb88-de65-4f60-8270-28e9b6c1431f/root/var/svc/log/oxide-zone-network-setup:default.log.0
10672024-02-09T21:22:55.895Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-agent:default.log (20744 bytes)
10682024-02-09T21:22:57.038Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-agent:default.log
10692024-02-09T21:22:57.038Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-agent:default.log.0 (3191 bytes)
10702024-02-09T21:22:58.144Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-agent:default.log.0
10712024-02-09T21:22:58.144Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
10722024-02-09T21:22:59.225Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-downstairs:default.log
10732024-02-09T21:22:59.225Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
10742024-02-09T21:23:00.367Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-downstairs:default.log.0
10752024-02-09T21:23:00.367Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-downstairs:downstairs-7fd30fa4-48bb-45da-b31e-bcb0eac6bc1c.log (5537 bytes)
10762024-02-09T21:23:01.465Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-downstairs:downstairs-7fd30fa4-48bb-45da-b31e-bcb0eac6bc1c.log
10772024-02-09T21:23:01.466Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-downstairs:downstairs-f0e864ee-7e47-43c8-beb4-659060265a52.log (3037 bytes)
10782024-02-09T21:23:03.026Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54ecaabe-a3b7-47b1-aa6a-55c26a1ea0bf/root/var/svc/log/oxide-crucible-downstairs:downstairs-f0e864ee-7e47-43c8-beb4-659060265a52.log
10792024-02-09T21:23:03.026Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2130b665-8c04-446a-ae31-3ccbd36963c1/root/var/svc/log/oxide-external_dns:default.log (26770 bytes)
10802024-02-09T21:23:03.146Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2130b665-8c04-446a-ae31-3ccbd36963c1/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26770 -> 30531
10812024-02-09T21:23:08.221Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2130b665-8c04-446a-ae31-3ccbd36963c1/root/var/svc/log/oxide-external_dns:default.log
10822024-02-09T21:23:08.221Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2130b665-8c04-446a-ae31-3ccbd36963c1/root/var/svc/log/oxide-external_dns:default.log.0 (75 bytes)
10832024-02-09T21:23:09.281Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_2130b665-8c04-446a-ae31-3ccbd36963c1/root/var/svc/log/oxide-external_dns:default.log.0
10842024-02-09T21:23:09.310Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_10efe7b5-4c14-431b-ae96-fd6d968a40df/root/var/svc/log/oxide-internal_dns:default.log (24618 bytes)
10852024-02-09T21:23:09.394Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_10efe7b5-4c14-431b-ae96-fd6d968a40df/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 24618 -> 28373
10862024-02-09T21:23:10.882Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_10efe7b5-4c14-431b-ae96-fd6d968a40df/root/var/svc/log/oxide-internal_dns:default.log
10872024-02-09T21:23:10.882Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_10efe7b5-4c14-431b-ae96-fd6d968a40df/root/var/svc/log/oxide-internal_dns:default.log.0 (91172 bytes)
10882024-02-09T21:23:12.122Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_10efe7b5-4c14-431b-ae96-fd6d968a40df/root/var/svc/log/oxide-internal_dns:default.log.0
10892024-02-09T21:23:12.122Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_5505a386-30f2-436c-a5d3-2bc80bc9d560/root/var/svc/log/oxide-nexus:default.log (40336339 bytes)
10902024-02-09T21:23:29.670Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_5505a386-30f2-436c-a5d3-2bc80bc9d560/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 40336339 -> 40482549
10912024-02-09T21:23:30.767Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_5505a386-30f2-436c-a5d3-2bc80bc9d560/root/var/svc/log/oxide-nexus:default.log
10922024-02-09T21:23:30.768Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_5505a386-30f2-436c-a5d3-2bc80bc9d560/root/var/svc/log/oxide-nexus:default.log.0 (75 bytes)
10932024-02-09T21:23:32.291Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_5505a386-30f2-436c-a5d3-2bc80bc9d560/root/var/svc/log/oxide-nexus:default.log.0
10942024-02-09T21:23:32.291Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_93bdd1d6-923f-4556-a2e7-c8932e375777/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
10952024-02-09T21:23:33.381Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_93bdd1d6-923f-4556-a2e7-c8932e375777/root/var/svc/log/oxide-cockroachdb:default.log
10962024-02-09T21:23:33.382Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_93bdd1d6-923f-4556-a2e7-c8932e375777/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
10972024-02-09T21:23:34.486Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_93bdd1d6-923f-4556-a2e7-c8932e375777/root/var/svc/log/oxide-cockroachdb:default.log.0
10982024-02-09T21:23:34.486Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_93bdd1d6-923f-4556-a2e7-c8932e375777/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10992024-02-09T21:23:34.786ZError: No response to keepalive - Terminating session
11002024-02-09T21:23:35.559Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_93bdd1d6-923f-4556-a2e7-c8932e375777/root/var/svc/log/oxide-zone-network-setup:default.log
11012024-02-09T21:23:35.559Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_93bdd1d6-923f-4556-a2e7-c8932e375777/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
11022024-02-09T21:23:36.654Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_93bdd1d6-923f-4556-a2e7-c8932e375777/root/var/svc/log/oxide-zone-network-setup:default.log.0
11032024-02-09T21:23:36.654Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-agent:default.log (17379 bytes)
11042024-02-09T21:23:37.819Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-agent:default.log
11052024-02-09T21:23:37.856Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-agent:default.log.0 (119 bytes)
11062024-02-09T21:23:39.330Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-agent:default.log.0
11072024-02-09T21:23:39.353Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11082024-02-09T21:23:40.403Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-downstairs:default.log
11092024-02-09T21:23:40.443Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11102024-02-09T21:23:41.908Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11112024-02-09T21:23:41.909Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-downstairs:downstairs-c7d49ef8-43b6-4cd2-b630-78800b30e4ff.log (5600 bytes)
11122024-02-09T21:23:43.010Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-downstairs:downstairs-c7d49ef8-43b6-4cd2-b630-78800b30e4ff.log
11132024-02-09T21:23:43.011Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-downstairs:snapshot-c7d49ef8-43b6-4cd2-b630-78800b30e4ff-e87c0167-6998-4bf8-af64-707862a62d62.log (5178 bytes)
11142024-02-09T21:23:44.116Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b8137b72-6acd-4a71-986f-cc0c322220c4/root/var/svc/log/oxide-crucible-downstairs:snapshot-c7d49ef8-43b6-4cd2-b630-78800b30e4ff-e87c0167-6998-4bf8-af64-707862a62d62.log
11152024-02-09T21:23:44.116Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_62da62bb-f12c-4c87-939f-211eedf441e6/root/var/svc/log/oxide-crucible-pantry:default.log (2187 bytes)
11162024-02-09T21:23:44.718ZError: No response de-activating SOL payload
11172024-02-09T21:23:45.217Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_62da62bb-f12c-4c87-939f-211eedf441e6/root/var/svc/log/oxide-crucible-pantry:default.log
11182024-02-09T21:23:45.218Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_62da62bb-f12c-4c87-939f-211eedf441e6/root/var/svc/log/oxide-crucible-pantry:default.log.0 (149 bytes)
11192024-02-09T21:23:45.837Z[SOL Session operational. Use ~? for help]
11202024-02-09T21:23:46.320Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_62da62bb-f12c-4c87-939f-211eedf441e6/root/var/svc/log/oxide-crucible-pantry:default.log.0
11212024-02-09T21:23:46.320Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_56b50ae5-31a2-4588-b795-6af274c2aaff/root/var/svc/log/oxide-internal_dns:default.log (24615 bytes)
11222024-02-09T21:23:46.441Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_56b50ae5-31a2-4588-b795-6af274c2aaff/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 24615 -> 32122
11232024-02-09T21:23:47.512Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_56b50ae5-31a2-4588-b795-6af274c2aaff/root/var/svc/log/oxide-internal_dns:default.log
11242024-02-09T21:23:47.512Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_56b50ae5-31a2-4588-b795-6af274c2aaff/root/var/svc/log/oxide-internal_dns:default.log.0 (88736 bytes)
11252024-02-09T21:23:48.753Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_56b50ae5-31a2-4588-b795-6af274c2aaff/root/var/svc/log/oxide-internal_dns:default.log.0
11262024-02-09T21:23:48.753Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba0d150e-a49b-428d-a98d-600e9c760fb3/root/var/svc/log/oxide-nexus:default.log (1228382 bytes)
11272024-02-09T21:23:49.967Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba0d150e-a49b-428d-a98d-600e9c760fb3/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1228382 -> 1458088
11282024-02-09T21:23:51.040Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba0d150e-a49b-428d-a98d-600e9c760fb3/root/var/svc/log/oxide-nexus:default.log
11292024-02-09T21:23:51.098Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba0d150e-a49b-428d-a98d-600e9c760fb3/root/var/svc/log/oxide-nexus:default.log.0 (75 bytes)
11302024-02-09T21:23:52.178Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba0d150e-a49b-428d-a98d-600e9c760fb3/root/var/svc/log/oxide-nexus:default.log.0
11312024-02-09T21:23:52.179Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/svc/log/oxide-ntp:default.log (0 bytes)
11322024-02-09T21:23:53.268Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/svc/log/oxide-ntp:default.log
11332024-02-09T21:23:53.269Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/svc/log/oxide-ntp:default.log.0 (1054 bytes)
11342024-02-09T21:23:54.372Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/svc/log/oxide-ntp:default.log.0
11352024-02-09T21:23:54.372Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_50e50144-887b-4bfb-9c64-0dab98e559b3/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11362024-02-09T21:23:55.447Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_50e50144-887b-4bfb-9c64-0dab98e559b3/root/var/svc/log/oxide-cockroachdb:default.log
11372024-02-09T21:23:55.447Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_50e50144-887b-4bfb-9c64-0dab98e559b3/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
11382024-02-09T21:23:56.545Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_50e50144-887b-4bfb-9c64-0dab98e559b3/root/var/svc/log/oxide-cockroachdb:default.log.0
11392024-02-09T21:23:56.546Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_50e50144-887b-4bfb-9c64-0dab98e559b3/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11402024-02-09T21:23:58.672Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_50e50144-887b-4bfb-9c64-0dab98e559b3/root/var/svc/log/oxide-zone-network-setup:default.log
11412024-02-09T21:23:58.672Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_50e50144-887b-4bfb-9c64-0dab98e559b3/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
11422024-02-09T21:23:59.726Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_50e50144-887b-4bfb-9c64-0dab98e559b3/root/var/svc/log/oxide-zone-network-setup:default.log.0
11432024-02-09T21:23:59.726Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-agent:default.log (40563 bytes)
11442024-02-09T21:24:00.890Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-agent:default.log
11452024-02-09T21:24:00.890Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-agent:default.log.0 (3434 bytes)
11462024-02-09T21:24:01.993Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-agent:default.log.0
11472024-02-09T21:24:01.994Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11482024-02-09T21:24:03.067Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:default.log
11492024-02-09T21:24:03.067Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11502024-02-09T21:24:04.169Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11512024-02-09T21:24:04.169Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:downstairs-0b998a7e-af38-41a0-9d86-24dc2b59bf87.log (2940 bytes)
11522024-02-09T21:24:05.288Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:downstairs-0b998a7e-af38-41a0-9d86-24dc2b59bf87.log
11532024-02-09T21:24:05.288Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:downstairs-11fa1018-f978-445c-bc14-e17924e68beb.log (5539 bytes)
11542024-02-09T21:24:06.418Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:downstairs-11fa1018-f978-445c-bc14-e17924e68beb.log
11552024-02-09T21:24:06.419Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:downstairs-3bfff325-84f7-462c-baae-d1855a397c1e.log (5600 bytes)
11562024-02-09T21:24:07.925Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:downstairs-3bfff325-84f7-462c-baae-d1855a397c1e.log
11572024-02-09T21:24:07.925Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1d190ed-aebc-4dff-937e-c85fdcbd7bde.log (3038 bytes)
11582024-02-09T21:24:09.023Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1d190ed-aebc-4dff-937e-c85fdcbd7bde.log
11592024-02-09T21:24:09.023Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:snapshot-3bfff325-84f7-462c-baae-d1855a397c1e-e87c0167-6998-4bf8-af64-707862a62d62.log (5179 bytes)
11602024-02-09T21:24:10.117Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_57b93370-4580-4b14-a531-d02ceda72d24/root/var/svc/log/oxide-crucible-downstairs:snapshot-3bfff325-84f7-462c-baae-d1855a397c1e-e87c0167-6998-4bf8-af64-707862a62d62.log
11612024-02-09T21:24:10.118Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_b9446a8d-d093-495b-8393-dd3553e581a3/root/var/svc/log/oxide-nexus:default.log (1493927 bytes)
11622024-02-09T21:24:10.880Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_b9446a8d-d093-495b-8393-dd3553e581a3/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1493927 -> 1761381
11632024-02-09T21:24:11.960Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_b9446a8d-d093-495b-8393-dd3553e581a3/root/var/svc/log/oxide-nexus:default.log
11642024-02-09T21:24:11.960Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_b9446a8d-d093-495b-8393-dd3553e581a3/root/var/svc/log/oxide-nexus:default.log.0 (75 bytes)
11652024-02-09T21:24:13.058Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_b9446a8d-d093-495b-8393-dd3553e581a3/root/var/svc/log/oxide-nexus:default.log.0
11662024-02-09T21:24:13.059Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0bcc78b8-eeff-44dc-a9db-f18fef587e2c/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11672024-02-09T21:24:14.130Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0bcc78b8-eeff-44dc-a9db-f18fef587e2c/root/var/svc/log/oxide-cockroachdb:default.log
11682024-02-09T21:24:14.130Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0bcc78b8-eeff-44dc-a9db-f18fef587e2c/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
11692024-02-09T21:24:15.634Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0bcc78b8-eeff-44dc-a9db-f18fef587e2c/root/var/svc/log/oxide-cockroachdb:default.log.0
11702024-02-09T21:24:15.634Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0bcc78b8-eeff-44dc-a9db-f18fef587e2c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11712024-02-09T21:24:16.710Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0bcc78b8-eeff-44dc-a9db-f18fef587e2c/root/var/svc/log/oxide-zone-network-setup:default.log
11722024-02-09T21:24:16.710Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0bcc78b8-eeff-44dc-a9db-f18fef587e2c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
11732024-02-09T21:24:17.822Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0bcc78b8-eeff-44dc-a9db-f18fef587e2c/root/var/svc/log/oxide-zone-network-setup:default.log.0
11742024-02-09T21:24:17.822Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-agent:default.log (9647 bytes)
11752024-02-09T21:24:18.941Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-agent:default.log
11762024-02-09T21:24:18.941Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-agent:default.log.0 (119 bytes)
11772024-02-09T21:24:20.444Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-agent:default.log.0
11782024-02-09T21:24:20.444Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11792024-02-09T21:24:21.685Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-downstairs:default.log
11802024-02-09T21:24:21.685Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11812024-02-09T21:24:22.780Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11822024-02-09T21:24:22.780Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-downstairs:downstairs-63db2bab-00dd-4ba2-9bc2-599d64bff39b.log (2945 bytes)
11832024-02-09T21:24:23.885Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_35709a05-cf4a-4b4c-9fc9-3daafac7d776/root/var/svc/log/oxide-crucible-downstairs:downstairs-63db2bab-00dd-4ba2-9bc2-599d64bff39b.log
11842024-02-09T21:24:23.886Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-agent:default.log (13954 bytes)
11852024-02-09T21:24:25.039Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-agent:default.log
11862024-02-09T21:24:25.039Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-agent:default.log.0 (119 bytes)
11872024-02-09T21:24:26.136Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-agent:default.log.0
11882024-02-09T21:24:26.136Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11892024-02-09T21:24:27.214Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-downstairs:default.log
11902024-02-09T21:24:27.214Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11912024-02-09T21:24:28.315Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11922024-02-09T21:24:28.315Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-downstairs:downstairs-bdfcb3ec-9890-4687-aeee-a69e15870eed.log (3037 bytes)
11932024-02-09T21:24:29.412Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_4e405e6c-5684-46dd-aa53-1ccf5757accd/root/var/svc/log/oxide-crucible-downstairs:downstairs-bdfcb3ec-9890-4687-aeee-a69e15870eed.log
11942024-02-09T21:24:29.436Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-agent:default.log (9649 bytes)
11952024-02-09T21:24:30.534Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-agent:default.log
11962024-02-09T21:24:30.535Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-agent:default.log.0 (119 bytes)
11972024-02-09T21:24:31.631Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-agent:default.log.0
11982024-02-09T21:24:31.631Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11992024-02-09T21:24:32.704Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-downstairs:default.log
12002024-02-09T21:24:32.704Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12012024-02-09T21:24:33.802Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12022024-02-09T21:24:33.802Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-downstairs:downstairs-c172d3fe-869a-4efd-b5fb-8ba932cac545.log (2945 bytes)
12032024-02-09T21:24:34.900Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_cfd21b45-159e-4d6c-8882-a1352c6429cd/root/var/svc/log/oxide-crucible-downstairs:downstairs-c172d3fe-869a-4efd-b5fb-8ba932cac545.log
12042024-02-09T21:24:34.927Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-oximeter:default.log (309938 bytes)
12052024-02-09T21:24:35.669Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 309938 -> 434972
12062024-02-09T21:24:36.741Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-oximeter:default.log
12072024-02-09T21:24:36.741Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-oximeter:default.log.0 (119 bytes)
12082024-02-09T21:24:37.850Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-oximeter:default.log.0
12092024-02-09T21:24:37.850Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-zone-network-setup:default.log (1573 bytes)
12102024-02-09T21:24:38.953Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-zone-network-setup:default.log
12112024-02-09T21:24:38.953Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-zone-network-setup:default.log.0 (119 bytes)
12122024-02-09T21:24:40.068Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_011955b8-afdc-40b4-8778-e8e8a097f069/root/var/svc/log/oxide-zone-network-setup:default.log.0
12132024-02-09T21:24:40.068Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-agent:default.log (17377 bytes)
12142024-02-09T21:24:41.210Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-agent:default.log
12152024-02-09T21:24:41.235Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-agent:default.log.0 (119 bytes)
12162024-02-09T21:24:42.308Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-agent:default.log.0
12172024-02-09T21:24:42.308Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12182024-02-09T21:24:43.382Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-downstairs:default.log
12192024-02-09T21:24:43.382Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12202024-02-09T21:24:44.494Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12212024-02-09T21:24:44.494Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-downstairs:downstairs-09a5e9bc-aba1-43ff-81f5-38aa6fe53d96.log (5601 bytes)
12222024-02-09T21:24:45.625Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-downstairs:downstairs-09a5e9bc-aba1-43ff-81f5-38aa6fe53d96.log
12232024-02-09T21:24:45.666Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-downstairs:snapshot-09a5e9bc-aba1-43ff-81f5-38aa6fe53d96-e87c0167-6998-4bf8-af64-707862a62d62.log (5178 bytes)
12242024-02-09T21:24:46.746Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0d428723-26c3-488a-bda3-7f6e0f53d758/root/var/svc/log/oxide-crucible-downstairs:snapshot-09a5e9bc-aba1-43ff-81f5-38aa6fe53d96-e87c0167-6998-4bf8-af64-707862a62d62.log
12252024-02-09T21:24:46.746Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ab9d3036-e56a-4616-919f-3d0e8c6a163e/root/var/svc/log/oxide-crucible-pantry:default.log (2182 bytes)
12262024-02-09T21:24:47.841Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ab9d3036-e56a-4616-919f-3d0e8c6a163e/root/var/svc/log/oxide-crucible-pantry:default.log
12272024-02-09T21:24:47.841Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ab9d3036-e56a-4616-919f-3d0e8c6a163e/root/var/svc/log/oxide-crucible-pantry:default.log.0 (149 bytes)
12282024-02-09T21:24:48.938Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ab9d3036-e56a-4616-919f-3d0e8c6a163e/root/var/svc/log/oxide-crucible-pantry:default.log.0
12292024-02-09T21:24:48.938Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cb06eb84-0695-450c-8917-eec239f61fb4/root/var/svc/log/oxide-crucible-agent:default.log (3312 bytes)
12302024-02-09T21:24:50.050Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cb06eb84-0695-450c-8917-eec239f61fb4/root/var/svc/log/oxide-crucible-agent:default.log
12312024-02-09T21:24:50.081Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cb06eb84-0695-450c-8917-eec239f61fb4/root/var/svc/log/oxide-crucible-agent:default.log.0 (119 bytes)
12322024-02-09T21:24:51.154Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cb06eb84-0695-450c-8917-eec239f61fb4/root/var/svc/log/oxide-crucible-agent:default.log.0
12332024-02-09T21:24:51.154Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cb06eb84-0695-450c-8917-eec239f61fb4/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12342024-02-09T21:24:52.233Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cb06eb84-0695-450c-8917-eec239f61fb4/root/var/svc/log/oxide-crucible-downstairs:default.log
12352024-02-09T21:24:52.233Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cb06eb84-0695-450c-8917-eec239f61fb4/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12362024-02-09T21:24:53.331Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cb06eb84-0695-450c-8917-eec239f61fb4/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12372024-02-09T21:24:53.331Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_349d1df8-3bee-48ae-8910-2ff7ce874216/root/var/svc/log/oxide-crucible-pantry:default.log (1217586 bytes)
12382024-02-09T21:24:56.916Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_349d1df8-3bee-48ae-8910-2ff7ce874216/root/var/svc/log/oxide-crucible-pantry:default.log
12392024-02-09T21:24:56.916Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_349d1df8-3bee-48ae-8910-2ff7ce874216/root/var/svc/log/oxide-crucible-pantry:default.log.0 (1518 bytes)
12402024-02-09T21:24:58.015Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_349d1df8-3bee-48ae-8910-2ff7ce874216/root/var/svc/log/oxide-crucible-pantry:default.log.0
12412024-02-09T21:24:58.015Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/measurements.log (20687 bytes)
12422024-02-09T21:24:58.152Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/measurements.log" changed size mid upload: 20687 -> 26578
12432024-02-09T21:24:59.225Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/measurements.log
12442024-02-09T21:24:59.225Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/statistics.log (13806 bytes)
12452024-02-09T21:24:59.342Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/statistics.log" changed size mid upload: 13806 -> 18954
12462024-02-09T21:25:00.446Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/statistics.log
12472024-02-09T21:25:00.446Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/tracking.log (2249 bytes)
12482024-02-09T21:25:00.505Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/tracking.log" changed size mid upload: 2249 -> 2645
12492024-02-09T21:25:01.585Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_ntp_71d25d50-2cba-4615-b456-83b65add8d14/root/var/log/chrony/tracking.log