01HPNFW6N4D4QWW54B3GKXPYXZ: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HPNFWMJR3V49NYBBDN3WBG64

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-15T04:20:10.553Zjob dependencies complete; ready to run (waiting for 0 s)
22024-02-15T06:39:13.984Zjob assigned to worker 01HPNQG16SV3PHJFVNQAA76XP3 (queued for 2 h 19 m 3 s)
32024-02-15T06:39:14.602Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-02-15T06:39:14.662Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-02-15T06:39:14.707Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... 23%Error: No response to keepalive - Terminating session
62024-02-15T06:39:14.755ZError: No response de-activating SOL payload
72024-02-15T06:39:14.797Z[SOL Session operational. Use ~? for help]
82024-02-15T06:39:14.840Z 83%Error: No response to keepalive - Terminating session
92024-02-15T06:39:14.880ZError: No response de-activating SOL payload
102024-02-15T06:39:14.933Z[SOL Session operational. Use ~? for help]
112024-02-15T06:39:16.052Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-c48d6230ab9e6a3a.gz
122024-02-15T06:39:20.297Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-c48d6230ab9e6a3a.gz
132024-02-15T06:39:20.297Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
142024-02-15T06:40:02.459Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
152024-02-15T06:40:02.459Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-3a1094782a2ee831.gz
162024-02-15T06:40:55.806Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-3a1094782a2ee831.gz
172024-02-15T06:40:55.806Zdownloading input: /input/ci-tools/work/caboose-util.gz
182024-02-15T06:41:00.808Zdownloaded input: /input/ci-tools/work/caboose-util.gz
192024-02-15T06:41:00.808Zdownloading input: /input/ci-tools/work/tufaceous.gz
202024-02-15T06:41:13.537Zdownloaded input: /input/ci-tools/work/tufaceous.gz
212024-02-15T06:41:13.567Zdownloading input: /input/package/work/version.txt
222024-02-15T06:41:13.593Zdownloaded input: /input/package/work/version.txt
232024-02-15T06:41:13.593Zdownloading input: /input/package/work/package.tar.gz
242024-02-15T06:41:51.521ZError: No response to keepalive - Terminating session
252024-02-15T06:41:55.797Zdownloaded input: /input/package/work/package.tar.gz
262024-02-15T06:41:55.797Zdownloading input: /input/package/work/global-zone-packages.tar.gz
272024-02-15T06:42:01.637ZError: No response de-activating SOL payload
282024-02-15T06:42:02.762Z[SOL Session operational. Use ~? for help]
292024-02-15T06:42:54.385Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
302024-02-15T06:42:54.385Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
312024-02-15T06:43:07.699Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
322024-02-15T06:43:07.734Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
332024-02-15T06:44:11.120Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
342024-02-15T06:44:11.121Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
352024-02-15T06:45:07.405ZError: No response to keepalive - Terminating session
362024-02-15T06:45:13.587Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
372024-02-15T06:45:13.588Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
382024-02-15T06:45:17.627ZError: No response de-activating SOL payload
392024-02-15T06:45:18.853Z[SOL Session operational. Use ~? for help]
402024-02-15T06:45:37.425Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
412024-02-15T06:45:37.425Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
422024-02-15T06:45:40.164Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
432024-02-15T06:45:40.164Zdownloading input: /input/package/work/zones/crucible.tar.gz
442024-02-15T06:45:45.426Zdownloaded input: /input/package/work/zones/crucible.tar.gz
452024-02-15T06:45:45.450Zdownloading input: /input/package/work/zones/external-dns.tar.gz
462024-02-15T06:45:50.330Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
472024-02-15T06:45:50.380Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
482024-02-15T06:45:55.780Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
492024-02-15T06:45:55.780Zdownloading input: /input/package/work/zones/ntp.tar.gz
502024-02-15T06:45:56.234Zdownloaded input: /input/package/work/zones/ntp.tar.gz
512024-02-15T06:45:56.235Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
522024-02-15T06:46:04.182Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
532024-02-15T06:46:04.207Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
542024-02-15T06:46:08.023Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
552024-02-15T06:46:08.023Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
562024-02-15T06:46:26.863Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
572024-02-15T06:46:26.864Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
582024-02-15T06:46:43.649Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
592024-02-15T06:46:43.674Zdownloading input: /input/package/work/zones/overlay.tar.gz
602024-02-15T06:46:43.732Zdownloaded input: /input/package/work/zones/overlay.tar.gz
612024-02-15T06:46:43.757Zdownloading input: /input/package/work/zones/oximeter.tar.gz
622024-02-15T06:46:54.324Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
632024-02-15T06:46:54.324Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
642024-02-15T06:47:19.990Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
652024-02-15T06:47:19.990Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
662024-02-15T06:48:07.515ZError: No response to keepalive - Terminating session
672024-02-15T06:48:12.977Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
682024-02-15T06:48:13.004Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
692024-02-15T06:48:17.456ZError: No response de-activating SOL payload
702024-02-15T06:48:18.849Z[SOL Session operational. Use ~? for help]
712024-02-15T06:49:01.994Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
722024-02-15T06:49:01.994Zstarting task 0: "setup"
732024-02-15T06:49:02.018Z++ uname -s
742024-02-15T06:49:02.018Z+ kern=SunOS
752024-02-15T06:49:02.018Z+ case "$kern" in
762024-02-15T06:49:02.018Z+ groupadd -g 12345 build
772024-02-15T06:49:02.018Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
782024-02-15T06:49:04.012Z+ zfs create -o mountpoint=/work rpool/work
792024-02-15T06:49:04.037Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
802024-02-15T06:49:04.037Z+ home_fs=zfs
812024-02-15T06:49:04.037Z+ [[ zfs == autofs ]]
822024-02-15T06:49:04.037Z+ mkdir -p /home/build
832024-02-15T06:49:04.037Z+ chown build:build /home/build /work
842024-02-15T06:49:06.037Z+ chmod 0700 /home/build /work
852024-02-15T06:49:06.062Zprocess exited: duration 4046 ms, exit code 0
 
862024-02-15T06:49:06.115Zstarting task 1: "authentication"
872024-02-15T06:49:06.159Zprocess exited: duration 43 ms, exit code 0
 
882024-02-15T06:49:06.208Zstarting task 2: "build"
892024-02-15T06:49:06.233Z+ trap _exit_trap EXIT
902024-02-15T06:49:06.233Z+ set +x
912024-02-15T06:49:34.393Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
922024-02-15T06:49:34.633Zsecpolicy_fs_linkdir: 0x55 = 0x55
932024-02-15T06:49:34.634Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
942024-02-15T06:49:34.634Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
952024-02-15T06:49:34.634Zsecpolicy_fs_linkdir+3: 0 = 0xe5
962024-02-15T06:49:34.659Zsecpolicy_fs_linkdir+4: 0 = 0xb8
972024-02-15T06:49:34.659Zsecpolicy_fs_linkdir+5: 0 = 0x1
982024-02-15T06:49:34.659Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
992024-02-15T06:49:34.659Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1002024-02-15T06:49:34.659Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1012024-02-15T06:49:34.659Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1022024-02-15T06:49:34.659Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1032024-02-15T06:49:34.659Z+ [[ -d /opt/oxide ]]
1042024-02-15T06:49:34.659Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1052024-02-15T06:49:34.660Z+ pfexec mkdir /opt/oxide
1062024-02-15T06:49:34.660Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1072024-02-15T06:49:34.660Z+ [[ -d /opt/oxide-underneath ]]
1082024-02-15T06:49:34.660Z+ cd /opt/oxide-underneath
1092024-02-15T06:49:34.660Z+ pfexec tar ceEp@/f - .
1102024-02-15T06:49:34.660Z+ cd /opt/oxide
1112024-02-15T06:49:34.660Z+ pfexec tar xveEp@/f -
1122024-02-15T06:49:34.697Zx ., 0 bytes, 0 tape blocks
1132024-02-15T06:49:34.697Zx ./opte, 0 bytes, 0 tape blocks
1142024-02-15T06:49:34.697Zx ./opte/bin, 0 bytes, 0 tape blocks
1152024-02-15T06:49:34.697Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1162024-02-15T06:49:34.722Z+ pfexec rm -rf /opt/oxide-underneath
1172024-02-15T06:49:34.722Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1182024-02-15T06:49:34.747Z+ pfexec mkdir /opt/oxide/work
1192024-02-15T06:49:34.747Z+ pfexec chown build:build /opt/oxide/work
1202024-02-15T06:49:34.747Z+ cd /opt/oxide/work
1212024-02-15T06:49:34.747Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1222024-02-15T06:49:36.451ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1232024-02-15T06:49:36.451Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1242024-02-15T06:49:36.451Zx out/omicron-sled-agent.tar, 122806784 bytes, 239857 tape blocks
1252024-02-15T06:49:36.451Zx out/oxlog.tar, 8382464 bytes, 16372 tape blocks
1262024-02-15T06:49:36.451Zx out/target/test, 75 bytes, 1 tape blocks
1272024-02-15T06:49:36.451Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1282024-02-15T06:49:36.451Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1292024-02-15T06:49:36.451Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1302024-02-15T06:49:36.452Zx target/release/omicron-package, 45723808 bytes, 89305 tape blocks
1312024-02-15T06:49:36.452Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1322024-02-15T06:49:36.452Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1332024-02-15T06:49:36.452Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1342024-02-15T06:49:36.452Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1352024-02-15T06:49:36.452Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1362024-02-15T06:49:36.452Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1372024-02-15T06:49:36.452Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1382024-02-15T06:49:36.477Z
1392024-02-15T06:49:36.477Zreal 1.714508001
1402024-02-15T06:49:36.477Zuser 1.538226031
1412024-02-15T06:49:36.477Zsys 0.306228822
1422024-02-15T06:49:36.477Ztrap 0.000070070
1432024-02-15T06:49:36.477Ztflt 0.000000000
1442024-02-15T06:49:36.477Zdflt 0.000000000
1452024-02-15T06:49:36.477Zkflt 0.000000000
1462024-02-15T06:49:36.477Zlock 0.000000000
1472024-02-15T06:49:36.477Zslp 1.538364399
1482024-02-15T06:49:36.477Zlat 0.044233584
1492024-02-15T06:49:36.477Zstop 0.000125441
1502024-02-15T06:49:36.477Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1512024-02-15T06:49:37.627Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1522024-02-15T06:49:37.652Z+ mkdir tests
1532024-02-15T06:49:37.652Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1542024-02-15T06:49:37.652Z+ ptime -m gunzip
1552024-02-15T06:49:37.652Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-c48d6230ab9e6a3a
1562024-02-15T06:49:37.884Z
1572024-02-15T06:49:37.909Zreal 0.233280850
1582024-02-15T06:49:37.909Zuser 0.213424439
1592024-02-15T06:49:37.909Zsys 0.019603975
1602024-02-15T06:49:37.909Ztrap 0.000019370
1612024-02-15T06:49:37.909Ztflt 0.000000000
1622024-02-15T06:49:37.909Zdflt 0.000000000
1632024-02-15T06:49:37.910Zkflt 0.000000000
1642024-02-15T06:49:37.910Zlock 0.000000000
1652024-02-15T06:49:37.910Zslp 0.000020320
1662024-02-15T06:49:37.910Zlat 0.000023180
1672024-02-15T06:49:37.910Zstop 0.000131552
1682024-02-15T06:49:37.910Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-c48d6230ab9e6a3a
1692024-02-15T06:49:37.910Z+ chmod a+x tests/bootstrap-c48d6230ab9e6a3a
1702024-02-15T06:49:37.910Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1712024-02-15T06:49:37.910Z+ ptime -m gunzip
1722024-02-15T06:49:37.910Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1732024-02-15T06:49:40.430Z
1742024-02-15T06:49:40.455Zreal 2.534571992
1752024-02-15T06:49:40.455Zuser 2.374559678
1762024-02-15T06:49:40.455Zsys 0.159577283
1772024-02-15T06:49:40.455Ztrap 0.000205205
1782024-02-15T06:49:40.455Ztflt 0.000000000
1792024-02-15T06:49:40.455Zdflt 0.000000000
1802024-02-15T06:49:40.455Zkflt 0.000000000
1812024-02-15T06:49:40.455Zlock 0.000000000
1822024-02-15T06:49:40.455Zslp 0.000023610
1832024-02-15T06:49:40.455Zlat 0.000023850
1842024-02-15T06:49:40.455Zstop 0.000129172
1852024-02-15T06:49:40.456Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1862024-02-15T06:49:40.456Z+ chmod a+x tests/bootstrap
1872024-02-15T06:49:40.456Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1882024-02-15T06:49:40.456Z+ ptime -m gunzip
1892024-02-15T06:49:40.456Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-3a1094782a2ee831
1902024-02-15T06:49:42.991Z
1912024-02-15T06:49:43.018Zreal 2.548632695
1922024-02-15T06:49:43.018Zuser 2.403306297
1932024-02-15T06:49:43.018Zsys 0.144892046
1942024-02-15T06:49:43.018Ztrap 0.000188016
1952024-02-15T06:49:43.018Ztflt 0.000000000
1962024-02-15T06:49:43.018Zdflt 0.000000000
1972024-02-15T06:49:43.018Zkflt 0.000000000
1982024-02-15T06:49:43.018Zlock 0.000000000
1992024-02-15T06:49:43.018Zslp 0.000033620
2002024-02-15T06:49:43.018Zlat 0.000024730
2012024-02-15T06:49:43.018Zstop 0.000126932
2022024-02-15T06:49:43.019Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-3a1094782a2ee831
2032024-02-15T06:49:43.019Z+ chmod a+x tests/end_to_end_tests-3a1094782a2ee831
2042024-02-15T06:49:43.019Z+ bmat address ls
2052024-02-15T06:49:43.019ZNAME CIDR FIRST LAST COUNT
2062024-02-15T06:49:43.019Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2072024-02-15T06:49:43.019Z++ bmat address ls -f extra -Ho first,last,count
2082024-02-15T06:49:43.053Z+ set -- 10.151.2.164 10.151.2.227 64
2092024-02-15T06:49:43.053Z+ EXTRA_IP_START=10.151.2.164
2102024-02-15T06:49:43.053Z+ EXTRA_IP_END=10.151.2.227
2112024-02-15T06:49:43.053Z+ EXTRA_IP_COUNT=64
2122024-02-15T06:49:43.053Z+ (( EXTRA_IP_COUNT >= 32 ))
2132024-02-15T06:49:43.053Z+ EXTRA_IP_BASE=10.151.2
2142024-02-15T06:49:43.053Z+ EXTRA_IP_FOCTET=164
2152024-02-15T06:49:43.053Z+ EXTRA_IP_LOCTET=227
2162024-02-15T06:49:43.053Z+ SERVICE_IP_POOL_START=10.151.2.164
2172024-02-15T06:49:43.053Z+ SERVICE_IP_POOL_END=10.151.2.173
2182024-02-15T06:49:43.053Z+ DNS_IP1=10.151.2.164
2192024-02-15T06:49:43.053Z+ DNS_IP2=10.151.2.165
2202024-02-15T06:49:43.053Z+ UPLINK_IP=10.151.2.174
2212024-02-15T06:49:43.053Z+ IPPOOL_START=10.151.2.175
2222024-02-15T06:49:43.054Z+ IPPOOL_END=10.151.2.227
2232024-02-15T06:49:43.054Z++ ipadm show-addr -po type,addr
2242024-02-15T06:49:43.054Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2252024-02-15T06:49:43.054Z+ GATEWAY_IP=10.151.2.100
2262024-02-15T06:49:43.054Z+ [[ -n 10.151.2.100 ]]
2272024-02-15T06:49:43.054Z+ ping -s 10.151.2.100 56 1
2282024-02-15T06:49:43.054ZPING 10.151.2.100: 56 data bytes
2292024-02-15T06:49:43.054Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
2302024-02-15T06:49:43.054Z
2312024-02-15T06:49:43.054Z----10.151.2.100 PING Statistics----
2322024-02-15T06:49:43.054Z1 packets transmitted, 1 packets received, 0% packet loss
2332024-02-15T06:49:43.054Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2342024-02-15T06:49:43.054Z++ arp -an
2352024-02-15T06:49:43.054Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2362024-02-15T06:49:43.054Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2372024-02-15T06:49:43.054Z+ routeadm -e ipv4-forwarding -u
2382024-02-15T06:49:43.153Z+ PXA_START=10.151.2.164
2392024-02-15T06:49:43.154Z+ PXA_END=10.151.2.227
2402024-02-15T06:49:43.178Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2412024-02-15T06:49:43.178Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2422024-02-15T06:49:43.349Z+ ZPOOL_VDEV_DIR=/scratch
2432024-02-15T06:49:43.349Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2442024-02-15T06:49:43.374Z+++ dirname ./tools/create_virtual_hardware.sh
2452024-02-15T06:49:43.374Z++ cd ./tools
2462024-02-15T06:49:43.374Z++ pwd
2472024-02-15T06:49:43.374Z+ SOURCE_DIR=/opt/oxide/work/tools
2482024-02-15T06:49:43.374Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2492024-02-15T06:49:43.374Z+ SOFTNPU_MODE=zone
2502024-02-15T06:49:43.374Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2512024-02-15T06:49:43.374Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2522024-02-15T06:49:43.374Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2532024-02-15T06:49:43.374Z++ dladm show-phys -p -o LINK
2542024-02-15T06:49:43.374Z++ head -1
2552024-02-15T06:49:43.399Z+ PHYSICAL_LINK=igb0
2562024-02-15T06:49:43.399Z+ echo 'Using igb0 as physical link'
2572024-02-15T06:49:43.399ZUsing igb0 as physical link
2582024-02-15T06:49:43.399Z+ ensure_run_as_root
2592024-02-15T06:49:43.399Z++ id -u
2602024-02-15T06:49:43.399Z+ [[ 0 -ne 0 ]]
2612024-02-15T06:49:43.399Z+ ensure_zpools
2622024-02-15T06:49:43.399Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2632024-02-15T06:49:43.400Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2642024-02-15T06:49:43.400Z+ readarray -t ZPOOLS
2652024-02-15T06:49:43.400Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2662024-02-15T06:49:43.400Z++ sed 's/[ ",]//g'
2672024-02-15T06:49:43.400Z+ for ZPOOL in "${ZPOOLS[@]}"
2682024-02-15T06:49:43.400Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2692024-02-15T06:49:43.400ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2702024-02-15T06:49:43.400Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2712024-02-15T06:49:43.400Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2722024-02-15T06:49:43.400Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2732024-02-15T06:49:43.400Z0+0 records in
2742024-02-15T06:49:43.400Z0+0 records out
2752024-02-15T06:49:43.400Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2762024-02-15T06:49:43.400Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2772024-02-15T06:49:43.400Z+ set +x
2782024-02-15T06:49:43.400ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2792024-02-15T06:49:43.400Z++ zpool list -o name
2802024-02-15T06:49:43.400Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2812024-02-15T06:49:43.400Z+ [[ -z '' ]]
2822024-02-15T06:49:43.400Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2832024-02-15T06:49:43.432Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2842024-02-15T06:49:43.461Z+ set +x
2852024-02-15T06:49:43.461ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2862024-02-15T06:49:43.461Z+ for ZPOOL in "${ZPOOLS[@]}"
2872024-02-15T06:49:43.461Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2882024-02-15T06:49:43.462ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2892024-02-15T06:49:43.462Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2902024-02-15T06:49:43.462Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2912024-02-15T06:49:43.462Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2922024-02-15T06:49:43.462Z0+0 records in
2932024-02-15T06:49:43.462Z0+0 records out
2942024-02-15T06:49:43.462Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2952024-02-15T06:49:43.462Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2962024-02-15T06:49:43.462Z+ set +x
2972024-02-15T06:49:43.462ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
2982024-02-15T06:49:43.462Z++ zpool list -o name
2992024-02-15T06:49:43.462Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3002024-02-15T06:49:43.462Z+ [[ -z '' ]]
3012024-02-15T06:49:43.462Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3022024-02-15T06:49:43.494Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3032024-02-15T06:49:43.494Z+ set +x
3042024-02-15T06:49:43.494ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3052024-02-15T06:49:43.494Z+ for ZPOOL in "${ZPOOLS[@]}"
3062024-02-15T06:49:43.494Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3072024-02-15T06:49:43.494ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3082024-02-15T06:49:43.494Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3092024-02-15T06:49:43.494Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3102024-02-15T06:49:43.494Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3112024-02-15T06:49:43.494Z0+0 records in
3122024-02-15T06:49:43.494Z0+0 records out
3132024-02-15T06:49:43.494Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3142024-02-15T06:49:43.495Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3152024-02-15T06:49:43.495Z+ set +x
3162024-02-15T06:49:43.495ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3172024-02-15T06:49:43.495Z++ zpool list -o name
3182024-02-15T06:49:43.495Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3192024-02-15T06:49:43.495Z+ [[ -z '' ]]
3202024-02-15T06:49:43.495Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3212024-02-15T06:49:43.931Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3222024-02-15T06:49:43.931Z+ set +x
3232024-02-15T06:49:43.931ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3242024-02-15T06:49:43.932Z+ for ZPOOL in "${ZPOOLS[@]}"
3252024-02-15T06:49:43.932Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3262024-02-15T06:49:43.932ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3272024-02-15T06:49:43.932Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3282024-02-15T06:49:43.932Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3292024-02-15T06:49:43.933Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3302024-02-15T06:49:43.933Z0+0 records in
3312024-02-15T06:49:43.933Z0+0 records out
3322024-02-15T06:49:43.933Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3332024-02-15T06:49:43.933Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3342024-02-15T06:49:43.933Z+ set +x
3352024-02-15T06:49:43.933ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3362024-02-15T06:49:43.933Z++ zpool list -o name
3372024-02-15T06:49:44.413Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3382024-02-15T06:49:44.414Z+ [[ -z '' ]]
3392024-02-15T06:49:44.414Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3402024-02-15T06:49:44.414Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3412024-02-15T06:49:44.414Z+ set +x
3422024-02-15T06:49:44.414ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3432024-02-15T06:49:44.414Z+ for ZPOOL in "${ZPOOLS[@]}"
3442024-02-15T06:49:44.414Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3452024-02-15T06:49:44.414ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3462024-02-15T06:49:44.414Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3472024-02-15T06:49:44.414Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3482024-02-15T06:49:44.414Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3492024-02-15T06:49:44.414Z0+0 records in
3502024-02-15T06:49:44.414Z0+0 records out
3512024-02-15T06:49:44.414Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3522024-02-15T06:49:44.414Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3532024-02-15T06:49:44.414Z+ set +x
3542024-02-15T06:49:44.414ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3552024-02-15T06:49:44.414Z++ zpool list -o name
3562024-02-15T06:49:44.415Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3572024-02-15T06:49:44.415Z+ [[ -z '' ]]
3582024-02-15T06:49:44.415Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3592024-02-15T06:49:44.415Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3602024-02-15T06:49:44.415Z+ set +x
3612024-02-15T06:49:44.415ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3622024-02-15T06:49:44.415Z+ for ZPOOL in "${ZPOOLS[@]}"
3632024-02-15T06:49:44.415Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3642024-02-15T06:49:44.415ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3652024-02-15T06:49:44.415Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3662024-02-15T06:49:44.415Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3672024-02-15T06:49:44.415Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3682024-02-15T06:49:44.415Z0+0 records in
3692024-02-15T06:49:44.415Z0+0 records out
3702024-02-15T06:49:44.415Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3712024-02-15T06:49:44.415Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3722024-02-15T06:49:44.415Z+ set +x
3732024-02-15T06:49:44.415ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3742024-02-15T06:49:44.415Z++ zpool list -o name
3752024-02-15T06:49:44.415Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3762024-02-15T06:49:44.416Z+ [[ -z '' ]]
3772024-02-15T06:49:44.416Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3782024-02-15T06:49:44.416Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3792024-02-15T06:49:44.416Z+ set +x
3802024-02-15T06:49:44.416ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3812024-02-15T06:49:44.416Z+ for ZPOOL in "${ZPOOLS[@]}"
3822024-02-15T06:49:44.416Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3832024-02-15T06:49:44.416Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3842024-02-15T06:49:44.416ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3852024-02-15T06:49:44.416Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3862024-02-15T06:49:44.416Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3872024-02-15T06:49:44.416Z0+0 records in
3882024-02-15T06:49:44.416Z0+0 records out
3892024-02-15T06:49:44.416Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3902024-02-15T06:49:44.416Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3912024-02-15T06:49:44.416Z+ set +x
3922024-02-15T06:49:44.416ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3932024-02-15T06:49:44.416Z++ zpool list -o name
3942024-02-15T06:49:44.416Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3952024-02-15T06:49:44.416Z+ [[ -z '' ]]
3962024-02-15T06:49:44.416Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3972024-02-15T06:49:44.416Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
3982024-02-15T06:49:44.417Z+ set +x
3992024-02-15T06:49:44.417ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4002024-02-15T06:49:44.417Z+ for ZPOOL in "${ZPOOLS[@]}"
4012024-02-15T06:49:44.417Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4022024-02-15T06:49:44.417ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4032024-02-15T06:49:44.417Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4042024-02-15T06:49:44.417Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4052024-02-15T06:49:44.417Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4062024-02-15T06:49:44.417Z0+0 records in
4072024-02-15T06:49:44.417Z0+0 records out
4082024-02-15T06:49:44.417Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4092024-02-15T06:49:44.417Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4102024-02-15T06:49:44.417Z+ set +x
4112024-02-15T06:49:44.417ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4122024-02-15T06:49:44.417Z++ zpool list -o name
4132024-02-15T06:49:44.417Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4142024-02-15T06:49:44.417Z+ [[ -z '' ]]
4152024-02-15T06:49:44.417Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4162024-02-15T06:49:44.417Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4172024-02-15T06:49:44.418Z+ set +x
4182024-02-15T06:49:44.418ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4192024-02-15T06:49:44.418Z+ for ZPOOL in "${ZPOOLS[@]}"
4202024-02-15T06:49:44.418Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4212024-02-15T06:49:44.418ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4222024-02-15T06:49:44.418Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4232024-02-15T06:49:44.418Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4242024-02-15T06:49:44.418Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4252024-02-15T06:49:44.418Z0+0 records in
4262024-02-15T06:49:44.418Z0+0 records out
4272024-02-15T06:49:44.418Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4282024-02-15T06:49:44.418Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4292024-02-15T06:49:44.418Z+ set +x
4302024-02-15T06:49:44.418ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4312024-02-15T06:49:44.418Z++ zpool list -o name
4322024-02-15T06:49:44.418Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4332024-02-15T06:49:44.418Z+ [[ -z '' ]]
4342024-02-15T06:49:44.418Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4352024-02-15T06:49:44.418Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4362024-02-15T06:49:44.419Z+ set +x
4372024-02-15T06:49:44.445ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4382024-02-15T06:49:44.445Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4392024-02-15T06:49:44.445Z+ readarray -t ZPOOLS
4402024-02-15T06:49:44.445Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4412024-02-15T06:49:44.445Z++ sed 's/[ ",]//g'
4422024-02-15T06:49:44.445Z+ for ZPOOL in "${ZPOOLS[@]}"
4432024-02-15T06:49:44.445Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4442024-02-15T06:49:44.445ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4452024-02-15T06:49:44.445Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4462024-02-15T06:49:44.445Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4472024-02-15T06:49:44.445Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4482024-02-15T06:49:44.445Z0+0 records in
4492024-02-15T06:49:44.445Z0+0 records out
4502024-02-15T06:49:44.445Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4512024-02-15T06:49:44.445Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4522024-02-15T06:49:44.445Z+ set +x
4532024-02-15T06:49:44.445ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4542024-02-15T06:49:44.445Z++ zpool list -o name
4552024-02-15T06:49:44.446Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4562024-02-15T06:49:44.446Z+ [[ -z '' ]]
4572024-02-15T06:49:44.446Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4582024-02-15T06:49:44.446Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4592024-02-15T06:49:44.446Z+ set +x
4602024-02-15T06:49:44.446ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4612024-02-15T06:49:44.446Z+ for ZPOOL in "${ZPOOLS[@]}"
4622024-02-15T06:49:44.446Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4632024-02-15T06:49:44.446ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4642024-02-15T06:49:44.446Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4652024-02-15T06:49:44.446Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4662024-02-15T06:49:44.446Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4672024-02-15T06:49:44.446Z0+0 records in
4682024-02-15T06:49:44.446Z0+0 records out
4692024-02-15T06:49:44.446Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4702024-02-15T06:49:44.446Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4712024-02-15T06:49:44.446Z+ set +x
4722024-02-15T06:49:44.446ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4732024-02-15T06:49:44.446Z++ zpool list -o name
4742024-02-15T06:49:44.447Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4752024-02-15T06:49:44.447Z+ [[ -z '' ]]
4762024-02-15T06:49:44.447Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4772024-02-15T06:49:44.447Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4782024-02-15T06:49:44.447Z+ set +x
4792024-02-15T06:49:44.447ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4802024-02-15T06:49:44.447Z+ [[ zone == \z\o\n\e ]]
4812024-02-15T06:49:44.447Z+ ensure_simulated_links igb0
4822024-02-15T06:49:44.447Z+ local PHYSICAL_LINK=igb0
4832024-02-15T06:49:44.447Z+ INDICES=("0" "1")
4842024-02-15T06:49:44.447Z+ for I in "${INDICES[@]}"
4852024-02-15T06:49:44.447Z++ get_simnet_name_if_exists net0
4862024-02-15T06:49:44.447Z++ dladm show-simnet -p -o LINK net0
4872024-02-15T06:49:44.447Z++ echo ''
4882024-02-15T06:49:44.447Z+ [[ -z '' ]]
4892024-02-15T06:49:44.447Z+ dladm create-simnet -t net0
4902024-02-15T06:49:44.447Z+ dladm create-simnet -t sc0_0
4912024-02-15T06:49:44.447Z+ dladm modify-simnet -t -p net0 sc0_0
4922024-02-15T06:49:44.447Z+ dladm set-linkprop -p mtu=9000 sc0_0
4932024-02-15T06:49:44.447Z+ success 'Simnet net0/sc0_0 exists'
4942024-02-15T06:49:44.447Z+ set +x
4952024-02-15T06:49:44.447ZSimnet net0/sc0_0 exists
4962024-02-15T06:49:44.447Z+ for I in "${INDICES[@]}"
4972024-02-15T06:49:44.448Z++ get_simnet_name_if_exists net1
4982024-02-15T06:49:44.448Z++ dladm show-simnet -p -o LINK net1
4992024-02-15T06:49:44.448Z++ echo ''
5002024-02-15T06:49:44.448Z+ [[ -z '' ]]
5012024-02-15T06:49:44.448Z+ dladm create-simnet -t net1
5022024-02-15T06:49:44.448Z+ dladm create-simnet -t sc1_0
5032024-02-15T06:49:44.448Z+ dladm modify-simnet -t -p net1 sc1_0
5042024-02-15T06:49:44.448Z+ dladm set-linkprop -p mtu=9000 sc1_0
5052024-02-15T06:49:44.448Z+ success 'Simnet net1/sc1_0 exists'
5062024-02-15T06:49:44.448Z+ set +x
5072024-02-15T06:49:44.448ZSimnet net1/sc1_0 exists
5082024-02-15T06:49:44.448Z++ get_vnic_name_if_exists sc0_1
5092024-02-15T06:49:44.448Z++ dladm show-vnic -p -o LINK sc0_1
5102024-02-15T06:49:44.448Z++ echo ''
5112024-02-15T06:49:44.448Z+ [[ -z '' ]]
5122024-02-15T06:49:44.448Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5132024-02-15T06:49:44.448Z+ [[ -v PROMISC_FILT_OFF ]]
5142024-02-15T06:49:44.448Z+ success 'Vnic sc0_1 exists'
5152024-02-15T06:49:44.448Z+ set +x
5162024-02-15T06:49:44.448ZVnic sc0_1 exists
5172024-02-15T06:49:44.448Z+ warn_if_no_proxy_arp
5182024-02-15T06:49:44.448Z+ [[ -v PXA_START ]]
5192024-02-15T06:49:44.448Z+ [[ -v PXA_END ]]
5202024-02-15T06:49:44.449Z+ ensure_softnpu_zone
5212024-02-15T06:49:44.449Z+ zoneadm list
5222024-02-15T06:49:44.449Z+ grep -q sidecar_softnpu
5232024-02-15T06:49:44.449Z+ [[ -f out/npuzone/npuzone ]]
5242024-02-15T06:49:44.449Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5252024-02-15T06:49:44.449Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5262024-02-15T06:49:50.270Zdownloading softnpu ...done
5272024-02-15T06:49:50.295Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5282024-02-15T06:49:54.758Zdownloading asic_program.so ...done
5292024-02-15T06:49:54.783Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5302024-02-15T06:50:02.458Zdownloading scadm ...done
5312024-02-15T06:50:02.486Zcreating port tfportrear0_0 for sc0_0
5322024-02-15T06:50:02.486Zcreating port tfportqsfp0_0 for sc0_1
5332024-02-15T06:50:02.515Zsoftnpu zone setup
5342024-02-15T06:50:02.515Zconfigure zone
5352024-02-15T06:50:02.516Zinstall zone
5362024-02-15T06:50:03.546Zboot zone
5372024-02-15T06:50:06.650Z[sidecar_softnpu] svcs milestone/network
5382024-02-15T06:50:06.689ZSTATE STIME FMRI
5392024-02-15T06:50:06.690Zonline 6:50:04 svc:/milestone/network:default
5402024-02-15T06:50:06.690Z[sidecar_softnpu] /softnpu/npu start
5412024-02-15T06:50:06.716Z
5422024-02-15T06:50:06.716Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5432024-02-15T06:50:06.717Z+ GATEWAY_IP=10.151.2.100
5442024-02-15T06:50:06.717ZUsing 10.151.2.100 as gateway ip
5452024-02-15T06:50:06.717Z+ echo 'Using 10.151.2.100 as gateway ip'
5462024-02-15T06:50:06.717Z+ [[ ! -v GATEWAY_MAC ]]
5472024-02-15T06:50:06.717Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
5482024-02-15T06:50:06.748Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5492024-02-15T06:50:06.748Z+++ echo 18:c0:4d:0d:a0:2a
5502024-02-15T06:50:06.748Z+ COUNT=1
5512024-02-15T06:50:06.748Z+ [[ 1 -ne 1 ]]
5522024-02-15T06:50:06.748Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
5532024-02-15T06:50:06.748ZUsing 18:c0:4d:0d:a0:2a as gateway mac
5542024-02-15T06:50:06.748Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5552024-02-15T06:50:06.748Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5562024-02-15T06:50:06.775Z+ PXA_MAC=a8:e1:de:01:70:1d
5572024-02-15T06:50:06.775Z+ [[ -v PXA_START ]]
5582024-02-15T06:50:06.775Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5592024-02-15T06:50:06.775Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5602024-02-15T06:50:06.800Z+ z_scadm dump-state
5612024-02-15T06:50:06.800Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5622024-02-15T06:50:06.800Zlocal v6:
5632024-02-15T06:50:06.800Zlocal v4:
5642024-02-15T06:50:06.800Zrouter v6:
5652024-02-15T06:50:06.801Zrouter v4_idx:
5662024-02-15T06:50:06.801Zrouter v4_routes:
5672024-02-15T06:50:06.801Zresolver v4:
5682024-02-15T06:50:06.801Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
5692024-02-15T06:50:06.801Zresolver v6:
5702024-02-15T06:50:06.801Znat v4:
5712024-02-15T06:50:06.801Znat_v6:
5722024-02-15T06:50:06.801Zport_mac:
5732024-02-15T06:50:06.801Zproxy arp:
5742024-02-15T06:50:06.801Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
5752024-02-15T06:50:06.827Z+ success 'softnpu zone exists'
5762024-02-15T06:50:06.827Z+ set +x
5772024-02-15T06:50:06.827Zsoftnpu zone exists
5782024-02-15T06:50:06.827Z
5792024-02-15T06:50:06.827Zreal 23.450533443
5802024-02-15T06:50:06.827Zuser 0.714848378
5812024-02-15T06:50:06.827Zsys 1.574578832
5822024-02-15T06:50:06.827Ztrap 0.000067186
5832024-02-15T06:50:06.828Ztflt 0.000104098
5842024-02-15T06:50:06.828Zdflt 0.001365708
5852024-02-15T06:50:06.828Zkflt 0.000000000
5862024-02-15T06:50:06.828Zlock 18:11.078996734
5872024-02-15T06:50:06.828Zslp 1:09.999970523
5882024-02-15T06:50:06.828Zlat 0.084218927
5892024-02-15T06:50:06.828Zstop 0.358733240
5902024-02-15T06:50:06.828Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5912024-02-15T06:50:06.876Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5922024-02-15T06:50:06.876Z+ SILO_NAME=recovery
5932024-02-15T06:50:06.876Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5942024-02-15T06:50:06.876Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5952024-02-15T06:50:06.876Z+ sed -i~ '
5962024-02-15T06:50:06.876Z /^external_dns_ips/c\
5972024-02-15T06:50:06.876Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
5982024-02-15T06:50:06.876Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
5992024-02-15T06:50:06.876Z /^first/c\
6002024-02-15T06:50:06.876Zfirst = "10.151.2.164"
6012024-02-15T06:50:06.876Z /^last/c\
6022024-02-15T06:50:06.877Zlast = "10.151.2.173"
6032024-02-15T06:50:06.877Z }
6042024-02-15T06:50:06.877Z /^\[rack_network_config/,/^$/ {
6052024-02-15T06:50:06.877Z /^infra_ip_first/c\
6062024-02-15T06:50:06.877Zinfra_ip_first = "10.151.2.174"
6072024-02-15T06:50:06.877Z /^infra_ip_last/c\
6082024-02-15T06:50:06.877Zinfra_ip_last = "10.151.2.174"
6092024-02-15T06:50:06.877Z }
6102024-02-15T06:50:06.877Z /^\[\[rack_network_config.ports/,/^$/ {
6112024-02-15T06:50:06.877Z /^routes/c\
6122024-02-15T06:50:06.877Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
6132024-02-15T06:50:06.877Z /^addresses/c\
6142024-02-15T06:50:06.877Zaddresses = \["10.151.2.174/24"\]
6152024-02-15T06:50:06.878Z }
6162024-02-15T06:50:06.878Z' pkg/config-rss.toml
6172024-02-15T06:50:06.878Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6182024-02-15T06:50:06.878Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6192024-02-15T06:50:06.878Z+++ pkg/config-rss.toml Thu Feb 15 06:50:06 2024
6202024-02-15T06:50:06.878Z@@ -33,7 +33,7 @@
6212024-02-15T06:50:06.878Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6222024-02-15T06:50:06.878Z # must be contained in one of the "internal services" IP Pool ranges listed
6232024-02-15T06:50:06.878Z # below.
6242024-02-15T06:50:06.878Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6252024-02-15T06:50:06.878Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6262024-02-15T06:50:06.878Z
6272024-02-15T06:50:06.878Z # Initial TLS certificates for the external API
6282024-02-15T06:50:06.878Z #
6292024-02-15T06:50:06.879Z@@ -69,8 +69,8 @@
6302024-02-15T06:50:06.879Z #
6312024-02-15T06:50:06.879Z # For more on this and what to put here, see docs/how-to-run.adoc.
6322024-02-15T06:50:06.879Z [[internal_services_ip_pool_ranges]]
6332024-02-15T06:50:06.879Z-first = "192.168.1.20"
6342024-02-15T06:50:06.879Z-last = "192.168.1.29"
6352024-02-15T06:50:06.879Z+first = "10.151.2.164"
6362024-02-15T06:50:06.879Z+last = "10.151.2.173"
6372024-02-15T06:50:06.879Z
6382024-02-15T06:50:06.879Z # TODO - this configuration is subject to change going forward. Ultimately these
6392024-02-15T06:50:06.879Z # parameters should be provided to the control plane via wicket, but we need to
6402024-02-15T06:50:06.879Z@@ -100,9 +100,9 @@
6412024-02-15T06:50:06.879Z # You can configure multiple uplinks by repeating the following stanza
6422024-02-15T06:50:06.879Z [[rack_network_config.ports]]
6432024-02-15T06:50:06.880Z # Routes associated with this port.
6442024-02-15T06:50:06.880Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6452024-02-15T06:50:06.880Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
6462024-02-15T06:50:06.880Z # Addresses associated with this port.
6472024-02-15T06:50:06.880Z-addresses = ["192.168.1.30/24"]
6482024-02-15T06:50:06.880Z+addresses = ["10.151.2.174/24"]
6492024-02-15T06:50:06.880Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6502024-02-15T06:50:06.880Z port = "qsfp0"
6512024-02-15T06:50:06.880Z # The speed of this port.
6522024-02-15T06:50:06.880Z+ true
6532024-02-15T06:50:06.880Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6542024-02-15T06:50:06.880Za pkg/config-rss.toml 7K
6552024-02-15T06:50:06.880Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6562024-02-15T06:50:06.910Z+ TLS_NAME=recovery.sys.oxide.test
6572024-02-15T06:50:06.910Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6582024-02-15T06:50:07.444Z..+.+.....+...+......+.......+.....+..........+..+.......+...+............+......+..+.+..+...+.......+.................+.+......+.....+...+.......+...+..+....+.........+...+............+..+....+.....+.........+.+.....+.+........+.......+......+..+..........+.....+...+...+.......+...+.....+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+........+......+...+......+.+.....+.+...+..+.......+..+......+.......+..+...+...+....+.......................+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+......+.+...+........+..........+........................+........+.+.....+....+..+...+.......+.........+..+...+.......+..............+.+.............................+...+...+..........+..+...+...+...............+............+....+.....+...............+...............+.+............+.....+......+.......+..............+.........+.+....................+.............+..+......+.......+........+......................+......+..+....+....................+....+.....+....+...+..+............+...................+..............+......+.+...+........+...+.......+........+.........+......+....+.....+..........+.................+.+............+..+.........+.+...+.....+.+...............+......+........+.+.........+........+...+.....................+.+..+...+...............+...+..........+..+..........+.........+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6592024-02-15T06:50:07.644Z.+.+.....+....+.....+............+.+...+...........+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+........+.......+.........+.....+.........+.......+......+..+.+.....+.+...+...+..+...+...+.+......+.....+...+....+...+.....+....+.........+.........+.....+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...................+..+.........+.+........+.+.....+.....................+.......+...+........+....+...+.....+............+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6602024-02-15T06:50:07.673Z-----
6612024-02-15T06:50:07.673Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6622024-02-15T06:50:07.699Za pkg/initial-tls-cert.pem 2K
6632024-02-15T06:50:07.699Za pkg/initial-tls-key.pem 4K
6642024-02-15T06:50:07.699Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6652024-02-15T06:50:07.699Z+ rmdir pkg
6662024-02-15T06:50:07.699Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6672024-02-15T06:50:07.699Z+ pfexec mkdir -p /usr/oxide
6682024-02-15T06:50:07.699Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6692024-02-15T06:50:08.381Z+ pfexec chmod +x /usr/oxide/oxide
6702024-02-15T06:50:08.407Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6712024-02-15T06:50:26.664Z+ OMICRON_NO_UNINSTALL=1
6722024-02-15T06:50:26.664Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6732024-02-15T06:50:26.689ZLogging to: /opt/oxide/work/out/LOG
6742024-02-15T06:50:27.185Z
6752024-02-15T06:50:27.213Zreal 0.513327745
6762024-02-15T06:50:27.213Zuser 0.108591780
6772024-02-15T06:50:27.213Zsys 2.063569867
6782024-02-15T06:50:27.213Ztrap 0.000019460
6792024-02-15T06:50:27.213Ztflt 0.000153239
6802024-02-15T06:50:27.213Zdflt 0.000325049
6812024-02-15T06:50:27.213Zkflt 0.000000000
6822024-02-15T06:50:27.213Zlock 46.516911881
6832024-02-15T06:50:27.213Zslp 0.726756704
6842024-02-15T06:50:27.213Zlat 0.003046598
6852024-02-15T06:50:27.214Zstop 0.223538303
6862024-02-15T06:50:27.214Z+ retry=0
6872024-02-15T06:50:27.214Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6882024-02-15T06:50:27.214Z+ [[ 0 -gt 30 ]]
6892024-02-15T06:50:27.214Z+ sleep 1
6902024-02-15T06:50:28.197Z+ retry=1
6912024-02-15T06:50:28.197Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6922024-02-15T06:50:28.225Z+ [[ 1 -gt 30 ]]
6932024-02-15T06:50:28.226Z+ sleep 1
6942024-02-15T06:50:29.214Z+ retry=2
6952024-02-15T06:50:29.214Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6962024-02-15T06:50:29.240Z+ [[ 2 -gt 30 ]]
6972024-02-15T06:50:29.240Z+ sleep 1
6982024-02-15T06:50:30.225Z+ retry=3
6992024-02-15T06:50:30.225Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7002024-02-15T06:50:30.250Z+ [[ 3 -gt 30 ]]
7012024-02-15T06:50:30.250Z+ sleep 1
7022024-02-15T06:50:31.241Z+ retry=4
7032024-02-15T06:50:31.241Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7042024-02-15T06:50:56.409Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7052024-02-15T06:50:56.436Zlocal v6:
7062024-02-15T06:50:56.436Zfd56:4db2:ec92:2e89::1
7072024-02-15T06:50:56.436Zfe80::b489:c6ff:fe7d:6540
7082024-02-15T06:50:56.436Zlocal v4:
7092024-02-15T06:50:56.436Z10.151.2.174
7102024-02-15T06:50:56.436Zrouter v6:
7112024-02-15T06:50:56.436Zfd00:1122:3344:2::/64 -> fe80::a4a5:83ff:fe02:920a (1)
7122024-02-15T06:50:56.436Zfd00:1122:3344:3::/64 -> fe80::a4a5:83ff:fe02:920a (1)
7132024-02-15T06:50:56.436Zfd00:1122:3344:1::/64 -> fe80::a4a5:83ff:fe02:920a (1)
7142024-02-15T06:50:56.437Zfdb0:18c0:4d0d:a02a::/64 -> fe80::a4a5:83ff:fe02:920a (1)
7152024-02-15T06:50:56.464Zfd00:1122:3344:101::/64 -> fe80::a4a5:83ff:fe02:920a (1)
7162024-02-15T06:50:56.464Zrouter v4_idx:
7172024-02-15T06:50:56.464Z0.0.0.0/0 -> 0
7182024-02-15T06:50:56.464Zrouter v4_routes:
7192024-02-15T06:50:56.464Z0 -> 10.151.2.100 (2)
7202024-02-15T06:50:56.464Zresolver v4:
7212024-02-15T06:50:56.464Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7222024-02-15T06:50:56.464Z10.151.2.174 -> f2:e4:cb:a9:34:70
7232024-02-15T06:50:56.464Zresolver v6:
7242024-02-15T06:50:56.464Zfe80::a4a5:83ff:fe02:920a -> a6:a5:83:02:92:0a
7252024-02-15T06:50:56.464Zfe80::b489:c6ff:fe7d:6540 -> b6:89:c6:7d:65:40
7262024-02-15T06:50:56.464Znat v4:
7272024-02-15T06:50:56.464Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:f3:33
7282024-02-15T06:50:56.464Znat_v6:
7292024-02-15T06:50:56.465Zport_mac:
7302024-02-15T06:50:56.465Z1000: a8:40:25:25:76:7c
7312024-02-15T06:50:56.465Z2: a8:40:25:25:76:9d
7322024-02-15T06:50:56.465Z1: a8:40:25:25:76:7d
7332024-02-15T06:50:56.465Zproxy arp:
7342024-02-15T06:50:56.465Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7352024-02-15T06:50:56.465Z+ retry=0
7362024-02-15T06:50:56.465Z+++ zoneadm list -n
7372024-02-15T06:50:56.465Z+++ grep oxz_ntp
7382024-02-15T06:50:56.465Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7392024-02-15T06:50:56.493Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7402024-02-15T06:50:56.493Z++ true
7412024-02-15T06:50:56.494Z+ [[ '' != online ]]
7422024-02-15T06:50:56.494Z+ [[ 0 -gt 60 ]]
7432024-02-15T06:50:56.494Z+ sleep 1
7442024-02-15T06:50:57.468Z+ retry=1
7452024-02-15T06:50:57.493Z+++ zoneadm list -n
7462024-02-15T06:50:57.493Z+++ grep oxz_ntp
7472024-02-15T06:50:57.493Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7482024-02-15T06:50:57.518Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7492024-02-15T06:50:57.518Z++ true
7502024-02-15T06:50:57.518Z+ [[ '' != online ]]
7512024-02-15T06:50:57.518Z+ [[ 1 -gt 60 ]]
7522024-02-15T06:50:57.518Z+ sleep 1
7532024-02-15T06:50:58.499Z+ retry=2
7542024-02-15T06:50:58.523Z+++ zoneadm list -n
7552024-02-15T06:50:58.523Z+++ grep oxz_ntp
7562024-02-15T06:50:58.523Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7572024-02-15T06:50:58.524Z+ [[ disabled != online ]]
7582024-02-15T06:50:58.524Z+ [[ 2 -gt 60 ]]
7592024-02-15T06:50:58.524Z+ sleep 1
7602024-02-15T06:50:59.529Z+ retry=3
7612024-02-15T06:50:59.555Z+++ zoneadm list -n
7622024-02-15T06:50:59.555Z+++ grep oxz_ntp
7632024-02-15T06:50:59.555Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7642024-02-15T06:50:59.555Z+ [[ disabled != online ]]
7652024-02-15T06:50:59.556Z+ [[ 3 -gt 60 ]]
7662024-02-15T06:50:59.556Z+ sleep 1
7672024-02-15T06:51:00.547Z+ retry=4
7682024-02-15T06:51:00.578Z+++ zoneadm list -n
7692024-02-15T06:51:00.578Z+++ grep oxz_ntp
7702024-02-15T06:51:00.578Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7712024-02-15T06:51:00.578Z+ [[ disabled != online ]]
7722024-02-15T06:51:00.578Z+ [[ 4 -gt 60 ]]
7732024-02-15T06:51:00.578Z+ sleep 1
7742024-02-15T06:51:01.582Z+ retry=5
7752024-02-15T06:51:01.621Z+++ zoneadm list -n
7762024-02-15T06:51:01.621Z+++ grep oxz_ntp
7772024-02-15T06:51:01.621Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7782024-02-15T06:51:01.621Z+ [[ disabled != online ]]
7792024-02-15T06:51:01.621Z+ [[ 5 -gt 60 ]]
7802024-02-15T06:51:01.621Z+ sleep 1
7812024-02-15T06:51:02.589Z+ retry=6
7822024-02-15T06:51:02.613Z+++ zoneadm list -n
7832024-02-15T06:51:02.613Z+++ grep oxz_ntp
7842024-02-15T06:51:02.614Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7852024-02-15T06:51:02.614Z+ [[ disabled != online ]]
7862024-02-15T06:51:02.614Z+ [[ 6 -gt 60 ]]
7872024-02-15T06:51:02.614Z+ sleep 1
7882024-02-15T06:51:03.614Z+ retry=7
7892024-02-15T06:51:03.643Z+++ zoneadm list -n
7902024-02-15T06:51:03.643Z+++ grep oxz_ntp
7912024-02-15T06:51:03.643Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7922024-02-15T06:51:03.643Z+ [[ disabled != online ]]
7932024-02-15T06:51:03.643Z+ [[ 7 -gt 60 ]]
7942024-02-15T06:51:03.643Z+ sleep 1
7952024-02-15T06:51:04.636Z+ retry=8
7962024-02-15T06:51:04.665Z+++ zoneadm list -n
7972024-02-15T06:51:04.665Z+++ grep oxz_ntp
7982024-02-15T06:51:04.665Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
7992024-02-15T06:51:04.665Z+ [[ disabled != online ]]
8002024-02-15T06:51:04.665Z+ [[ 8 -gt 60 ]]
8012024-02-15T06:51:04.666Z+ sleep 1
8022024-02-15T06:51:05.670Z+ retry=9
8032024-02-15T06:51:05.706Z+++ zoneadm list -n
8042024-02-15T06:51:05.706Z+++ grep oxz_ntp
8052024-02-15T06:51:05.706Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
8062024-02-15T06:51:05.706Z+ [[ disabled != online ]]
8072024-02-15T06:51:05.706Z+ [[ 9 -gt 60 ]]
8082024-02-15T06:51:05.706Z+ sleep 1
8092024-02-15T06:51:06.682Z+ retry=10
8102024-02-15T06:51:06.710Z+++ zoneadm list -n
8112024-02-15T06:51:06.710Z+++ grep oxz_ntp
8122024-02-15T06:51:06.710Z++ pfexec svcs -z oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5 -Hostate oxide/ntp
8132024-02-15T06:51:06.710Z+ [[ online != online ]]
8142024-02-15T06:51:06.711Z+ echo 'Waited for chrony: 10s'
8152024-02-15T06:51:06.711Z+ export RUST_BACKTRACE=1
8162024-02-15T06:51:06.711ZWaited for chrony: 10s
8172024-02-15T06:51:06.711Z+ RUST_BACKTRACE=1
8182024-02-15T06:51:06.711Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8192024-02-15T06:51:06.711Z++ ./tests/bootstrap
8202024-02-15T06:51:06.739ZUsing external DNS server at 10.151.2.164:53
8212024-02-15T06:51:06.740Z2024-02-15 06:51:06.163267681 UTC: attempting to log into API
8222024-02-15T06:51:22.372Z2024-02-15 06:51:22.068785726 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8232024-02-15T06:51:22.763Z2024-02-15 06:51:23.069649440 UTC: attempting to log into API
 
8242024-02-15T06:51:23.665ZError: No response to keepalive - Terminating session
8252024-02-15T06:51:33.620ZError: No response de-activating SOL payload
8262024-02-15T06:51:34.733Z[SOL Session operational. Use ~? for help]
 
8272024-02-15T06:51:37.794Z2024-02-15 06:51:38.101068745 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8282024-02-15T06:51:38.796Z2024-02-15 06:51:39.102677786 UTC: attempting to log into API
8292024-02-15T06:51:53.827Z2024-02-15 06:51:54.133953848 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8302024-02-15T06:51:54.836Z2024-02-15 06:51:55.134708530 UTC: attempting to log into API
8312024-02-15T06:52:09.861Z2024-02-15 06:52:10.167183197 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8322024-02-15T06:52:10.862Z2024-02-15 06:52:11.168988832 UTC: attempting to log into API
8332024-02-15T06:52:25.901Z2024-02-15 06:52:26.186242767 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8342024-02-15T06:52:26.902Z2024-02-15 06:52:27.184127916 UTC: attempting to log into API
8352024-02-15T06:52:41.927Z2024-02-15 06:52:42.175029875 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8362024-02-15T06:52:42.928Z2024-02-15 06:52:43.173053917 UTC: attempting to log into API
8372024-02-15T06:52:57.983Z2024-02-15 06:52:58.165329065 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8382024-02-15T06:52:58.975Z2024-02-15 06:52:59.164138464 UTC: attempting to log into API
8392024-02-15T06:53:13.993Z2024-02-15 06:53:14.154907700 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8402024-02-15T06:53:15.003Z2024-02-15 06:53:15.152961282 UTC: attempting to log into API
8412024-02-15T06:53:30.026Z2024-02-15 06:53:30.143667779 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8422024-02-15T06:53:31.027Z2024-02-15 06:53:31.141637480 UTC: attempting to log into API
8432024-02-15T06:53:46.058Z2024-02-15 06:53:46.132126569 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8442024-02-15T06:53:47.060Z2024-02-15 06:53:47.131198375 UTC: attempting to log into API
8452024-02-15T06:54:02.094Z2024-02-15 06:54:02.121155372 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8462024-02-15T06:54:03.093Z2024-02-15 06:54:03.120218297 UTC: attempting to log into API
8472024-02-15T06:54:18.129Z2024-02-15 06:54:18.110940832 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8482024-02-15T06:54:19.126Z2024-02-15 06:54:19.109072326 UTC: attempting to log into API
 
8492024-02-15T06:54:23.646ZError: No response to keepalive - Terminating session
8502024-02-15T06:54:34.476ZError: No response de-activating SOL payload
 
8512024-02-15T06:54:34.501Z2024-02-15 06:54:34.137491296 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
8522024-02-15T06:54:34.793Z[SOL Session operational. Use ~? for help]
 
8532024-02-15T06:54:35.159Z2024-02-15 06:54:35.138483883 UTC: attempting to log into API
8542024-02-15T06:54:51.123Z2024-02-15 06:54:50.172044035 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8552024-02-15T06:54:51.247Z2024-02-15 06:54:51.173363768 UTC: attempting to log into API
8562024-02-15T06:55:06.243Z2024-02-15 06:55:06.223665771 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8572024-02-15T06:55:07.245Z2024-02-15 06:55:07.224900833 UTC: attempting to log into API
8582024-02-15T06:55:23.058Z2024-02-15 06:55:22.577197269 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8592024-02-15T06:55:23.791Z2024-02-15 06:55:23.768451020 UTC: attempting to log into API
8602024-02-15T06:55:38.934Z2024-02-15 06:55:38.916419449 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8612024-02-15T06:55:39.930Z2024-02-15 06:55:39.917399776 UTC: attempting to log into API
 
8622024-02-15T06:55:41.922ZFeb 15 06:55:41 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8632024-02-15T06:55:49.458ZFeb 15 06:55:48 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
8642024-02-15T06:55:54.962Z2024-02-15 06:55:54.949291294 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8652024-02-15T06:55:55.963Z2024-02-15 06:55:55.950298672 UTC: attempting to log into API
 
8662024-02-15T06:55:56.728ZFeb 15 06:55:56 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
8672024-02-15T06:56:02.156ZFeb 15 06:56:01 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
8682024-02-15T06:56:10.996Z2024-02-15 06:56:10.982102188 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8692024-02-15T06:56:11.997Z2024-02-15 06:56:11.983087406 UTC: attempting to log into API
8702024-02-15T06:56:30.406Z2024-02-15 06:56:27.014167345 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8712024-02-15T06:56:30.470Z2024-02-15 06:56:28.016200555 UTC: attempting to log into API
8722024-02-15T06:56:38.852Z2024-02-15 06:56:38.828607252 UTC: login succeeded
8732024-02-15T06:56:38.882Zwaiting for nexus to come up...
8742024-02-15T06:56:38.938Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8752024-02-15T06:56:39.119Zsetting up quotas...
8762024-02-15T06:56:39.169Zensuring datasets are ready...
8772024-02-15T06:56:41.877Zlet's roll.
8782024-02-15T06:56:41.909Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8792024-02-15T06:56:41.909ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8802024-02-15T06:56:41.909ZOXIDE_TOKEN=oxide-token-f28d8d3ad5e65a9304bd1a707b8e3f02df063285'
8812024-02-15T06:56:41.909Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8822024-02-15T06:56:41.909Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8832024-02-15T06:56:41.909Z++ OXIDE_TOKEN=oxide-token-f28d8d3ad5e65a9304bd1a707b8e3f02df063285
8842024-02-15T06:56:41.909Z+ export OXIDE_HOST OXIDE_TOKEN
8852024-02-15T06:56:41.910Z+ retry=0
8862024-02-15T06:56:41.910Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8872024-02-15T06:56:41.937Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8882024-02-15T06:56:41.938Z+ [[ 0 -gt 60 ]]
8892024-02-15T06:56:41.938Z+ sleep 1
8902024-02-15T06:56:42.925Z+ retry=1
8912024-02-15T06:56:42.925Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8922024-02-15T06:56:42.950Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8932024-02-15T06:56:42.951Z+ [[ 1 -gt 60 ]]
8942024-02-15T06:56:42.951Z+ sleep 1
8952024-02-15T06:56:43.942Z+ retry=2
8962024-02-15T06:56:43.942Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8972024-02-15T06:56:43.969Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8982024-02-15T06:56:43.969Z+ [[ 2 -gt 60 ]]
8992024-02-15T06:56:43.969Z+ sleep 1
9002024-02-15T06:56:44.960Z+ retry=3
9012024-02-15T06:56:44.960Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9022024-02-15T06:56:44.986Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9032024-02-15T06:56:44.986Z+ [[ 3 -gt 60 ]]
9042024-02-15T06:56:44.986Z+ sleep 1
9052024-02-15T06:56:46.270Z+ retry=4
9062024-02-15T06:56:46.270Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9072024-02-15T06:56:46.304Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9082024-02-15T06:56:46.304Z+ [[ 4 -gt 60 ]]
9092024-02-15T06:56:46.304Z+ sleep 1
9102024-02-15T06:56:46.989Z+ retry=5
9112024-02-15T06:56:46.989Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9122024-02-15T06:56:47.015Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9132024-02-15T06:56:47.015Z+ [[ 5 -gt 60 ]]
9142024-02-15T06:56:47.015Z+ sleep 1
9152024-02-15T06:56:48.005Z+ retry=6
9162024-02-15T06:56:48.005Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9172024-02-15T06:56:48.030Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9182024-02-15T06:56:48.030Z+ [[ 6 -gt 60 ]]
9192024-02-15T06:56:48.030Z+ sleep 1
9202024-02-15T06:56:49.028Z+ retry=7
9212024-02-15T06:56:49.028Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9222024-02-15T06:56:49.053Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9232024-02-15T06:56:49.053Z+ [[ 7 -gt 60 ]]
9242024-02-15T06:56:49.053Z+ sleep 1
9252024-02-15T06:56:50.042Z+ retry=8
9262024-02-15T06:56:50.042Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9272024-02-15T06:56:50.069Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9282024-02-15T06:56:50.069Z+ [[ 8 -gt 60 ]]
9292024-02-15T06:56:50.069Z+ sleep 1
9302024-02-15T06:56:51.052Z+ retry=9
9312024-02-15T06:56:51.052Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9322024-02-15T06:56:51.079Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9332024-02-15T06:56:51.079Z+ [[ 9 -gt 60 ]]
9342024-02-15T06:56:51.079Z+ sleep 1
9352024-02-15T06:56:52.076Z+ retry=10
9362024-02-15T06:56:52.076Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9372024-02-15T06:56:52.102Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9382024-02-15T06:56:52.102Z+ [[ 10 -gt 60 ]]
9392024-02-15T06:56:52.102Z+ sleep 1
9402024-02-15T06:56:53.083Z+ retry=11
9412024-02-15T06:56:53.083Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9422024-02-15T06:56:53.107Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9432024-02-15T06:56:53.107Z+ [[ 11 -gt 60 ]]
9442024-02-15T06:56:53.107Z+ sleep 1
9452024-02-15T06:56:54.101Z+ retry=12
9462024-02-15T06:56:54.101Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9472024-02-15T06:56:54.129Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9482024-02-15T06:56:54.129Z+ [[ 12 -gt 60 ]]
9492024-02-15T06:56:54.130Z+ sleep 1
9502024-02-15T06:56:55.115Z+ retry=13
9512024-02-15T06:56:55.115Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9522024-02-15T06:56:55.139Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9532024-02-15T06:56:55.139Z+ [[ 13 -gt 60 ]]
9542024-02-15T06:56:55.139Z+ sleep 1
9552024-02-15T06:56:56.131Z+ retry=14
9562024-02-15T06:56:56.131Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9572024-02-15T06:56:56.160Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9582024-02-15T06:56:56.160Z+ [[ 14 -gt 60 ]]
9592024-02-15T06:56:56.160Z+ sleep 1
9602024-02-15T06:56:57.150Z+ retry=15
9612024-02-15T06:56:57.150Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9622024-02-15T06:56:57.181Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9632024-02-15T06:56:57.181Z+ [[ 15 -gt 60 ]]
9642024-02-15T06:56:57.181Z+ sleep 1
9652024-02-15T06:56:58.163Z+ retry=16
9662024-02-15T06:56:58.163Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9672024-02-15T06:56:58.187Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9682024-02-15T06:56:58.187Z+ [[ 16 -gt 60 ]]
9692024-02-15T06:56:58.187Z+ sleep 1
9702024-02-15T06:56:59.180Z+ retry=17
9712024-02-15T06:56:59.180Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9722024-02-15T06:56:59.206Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9732024-02-15T06:56:59.206Z+ [[ 17 -gt 60 ]]
9742024-02-15T06:56:59.206Z+ sleep 1
9752024-02-15T06:57:00.196Z+ retry=18
9762024-02-15T06:57:00.197Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9772024-02-15T06:57:00.226Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9782024-02-15T06:57:00.227Z+ [[ 18 -gt 60 ]]
9792024-02-15T06:57:00.227Z+ sleep 1
9802024-02-15T06:57:01.213Z+ retry=19
9812024-02-15T06:57:01.213Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9822024-02-15T06:57:01.241Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9832024-02-15T06:57:01.241Z+ [[ 19 -gt 60 ]]
9842024-02-15T06:57:01.241Z+ sleep 1
9852024-02-15T06:57:02.229Z+ retry=20
9862024-02-15T06:57:02.229Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9872024-02-15T06:57:02.256Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9882024-02-15T06:57:02.256Z+ [[ 20 -gt 60 ]]
9892024-02-15T06:57:02.256Z+ sleep 1
9902024-02-15T06:57:03.244Z+ retry=21
9912024-02-15T06:57:03.244Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9922024-02-15T06:57:03.269Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9932024-02-15T06:57:03.269Z+ [[ 21 -gt 60 ]]
9942024-02-15T06:57:03.269Z+ sleep 1
9952024-02-15T06:57:04.262Z+ retry=22
9962024-02-15T06:57:04.263Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9972024-02-15T06:57:04.297Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9982024-02-15T06:57:04.298Z+ [[ 22 -gt 60 ]]
9992024-02-15T06:57:04.298Z+ sleep 1
10002024-02-15T06:57:05.281Z+ retry=23
10012024-02-15T06:57:05.281Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10022024-02-15T06:57:05.308Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10032024-02-15T06:57:05.308Z+ [[ 23 -gt 60 ]]
10042024-02-15T06:57:05.308Z+ sleep 1
10052024-02-15T06:57:06.290Z+ retry=24
10062024-02-15T06:57:06.290Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10072024-02-15T06:57:06.315Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10082024-02-15T06:57:06.315Z+ [[ 24 -gt 60 ]]
10092024-02-15T06:57:06.315Z+ sleep 1
10102024-02-15T06:57:07.308Z+ retry=25
10112024-02-15T06:57:07.308Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10122024-02-15T06:57:07.356Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10132024-02-15T06:57:07.356Z+ [[ 25 -gt 60 ]]
10142024-02-15T06:57:07.356Z+ sleep 1
10152024-02-15T06:57:08.341Z+ retry=26
10162024-02-15T06:57:08.341Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10172024-02-15T06:57:08.393Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10182024-02-15T06:57:08.393Z+ [[ 26 -gt 60 ]]
10192024-02-15T06:57:08.394Z+ sleep 1
10202024-02-15T06:57:09.677Z+ retry=27
10212024-02-15T06:57:09.677Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10222024-02-15T06:57:09.732Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10232024-02-15T06:57:09.732Z+ [[ 27 -gt 60 ]]
10242024-02-15T06:57:09.732Z+ sleep 1
10252024-02-15T06:57:10.373Z+ retry=28
10262024-02-15T06:57:10.373Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10272024-02-15T06:57:10.428Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10282024-02-15T06:57:11.944Z{"status":"ok"}success
10292024-02-15T06:57:11.945ZProject {
10302024-02-15T06:57:11.945Z description: "some images",
10312024-02-15T06:57:11.945Z id: 2689c324-90d2-4ec1-ba08-ba791cc4bcb2,
10322024-02-15T06:57:11.945Z name: Name(
10332024-02-15T06:57:11.945Z "images",
10342024-02-15T06:57:11.945Z ),
10352024-02-15T06:57:11.945Z time_created: 2024-02-15T06:57:10.653856Z,
10362024-02-15T06:57:11.945Z time_modified: 2024-02-15T06:57:10.653856Z,
10372024-02-15T06:57:11.946Z}
10382024-02-15T06:57:11.974Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
10392024-02-15T06:57:24.770ZError: No response to keepalive - Terminating session
10402024-02-15T06:57:33.428ZError: No response de-activating SOL payload
10412024-02-15T06:57:34.529Z[SOL Session operational. Use ~? for help]
10422024-02-15T06:57:35.911ZFeb 15 06:56:08 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
10432024-02-15T07:00:23.654ZError: No response to keepalive - Terminating session
10442024-02-15T07:00:33.858ZError: No response de-activating SOL payload
10452024-02-15T07:00:34.986Z[SOL Session operational. Use ~? for help]
 
10462024-02-15T07:02:30.561Zdone!
10472024-02-15T07:02:30.659Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
10482024-02-15T07:02:30.764Zsuccess
10492024-02-15T07:02:30.764ZImage {
10502024-02-15T07:02:30.764Z block_size: ByteCount(
10512024-02-15T07:02:30.764Z 512,
10522024-02-15T07:02:30.764Z ),
10532024-02-15T07:02:30.796Z description: "debian 11 original base image",
10542024-02-15T07:02:30.796Z digest: None,
10552024-02-15T07:02:30.796Z id: 15af7520-e810-4bf1-8e5d-8a4826b95b19,
10562024-02-15T07:02:30.796Z name: Name(
10572024-02-15T07:02:30.796Z "debian11",
10582024-02-15T07:02:30.796Z ),
10592024-02-15T07:02:30.797Z os: "debian",
10602024-02-15T07:02:30.797Z project_id: None,
10612024-02-15T07:02:30.797Z size: ByteCount(
10622024-02-15T07:02:30.797Z 2147483648,
10632024-02-15T07:02:30.797Z ),
10642024-02-15T07:02:30.797Z time_created: 2024-02-15T07:02:30.525747Z,
10652024-02-15T07:02:30.798Z time_modified: 2024-02-15T07:02:30.745698Z,
10662024-02-15T07:02:30.798Z url: None,
10672024-02-15T07:02:30.798Z version: "11",
10682024-02-15T07:02:30.798Z}
10692024-02-15T07:02:30.798Z+ rm ./tests/bootstrap
10702024-02-15T07:02:30.835Z+ for test_bin in tests/*
10712024-02-15T07:02:30.835Z+ ./tests/bootstrap-c48d6230ab9e6a3a
10722024-02-15T07:02:30.864Z
10732024-02-15T07:02:30.864Zrunning 0 tests
10742024-02-15T07:02:30.864Z
10752024-02-15T07:02:30.864Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10762024-02-15T07:02:30.865Z
10772024-02-15T07:02:30.865Z+ for test_bin in tests/*
10782024-02-15T07:02:30.865Z+ ./tests/end_to_end_tests-3a1094782a2ee831
10792024-02-15T07:02:31.159Z
10802024-02-15T07:02:31.160Zrunning 2 tests
10812024-02-15T07:02:31.414Ztest no_spoof::no_spoof_here ... ok
10822024-02-15T07:03:05.523Ztest instance_launch::instance_launch ... ok
10832024-02-15T07:03:05.523Z
10842024-02-15T07:03:05.610Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 34.33s
10852024-02-15T07:03:05.610Z
10862024-02-15T07:03:05.610Z+ _exit_trap
10872024-02-15T07:03:05.610Z+ local status=0
10882024-02-15T07:03:05.610Z+ [[ 0 -eq 0 ]]
10892024-02-15T07:03:05.610Z+ exit 0
10902024-02-15T07:03:06.049Zprocess exited: duration 839300 ms, exit code 0
 
10912024-02-15T07:03:06.155Zfound 131 output files
10922024-02-15T07:03:06.155Zuploading: /var/svc/log/oxide-sled-agent:default.log (815485 bytes)
10932024-02-15T07:03:08.835Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10942024-02-15T07:03:08.835Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (774704 bytes)
10952024-02-15T07:03:09.897Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 774704 -> 795215
10962024-02-15T07:03:11.110Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
10972024-02-15T07:03:11.110Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (2337967 bytes)
10982024-02-15T07:03:12.905Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
10992024-02-15T07:03:12.906Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
11002024-02-15T07:03:13.983Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11012024-02-15T07:03:14.007Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (18612 bytes)
11022024-02-15T07:03:15.135Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11032024-02-15T07:03:15.135Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (6277 bytes)
11042024-02-15T07:03:15.204Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 6277 -> 7323
11052024-02-15T07:03:16.277Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11062024-02-15T07:03:16.277Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (18175 bytes)
11072024-02-15T07:03:17.416Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11082024-02-15T07:03:17.416Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (417390 bytes)
11092024-02-15T07:03:17.647Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 417390 -> 436553
11102024-02-15T07:03:18.715Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11112024-02-15T07:03:18.715Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1383577 bytes)
11122024-02-15T07:03:20.502Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11132024-02-15T07:03:20.502Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (256160 bytes)
11142024-02-15T07:03:21.147Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 256160 -> 274144
11152024-02-15T07:03:22.228Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11162024-02-15T07:03:22.228Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (813747 bytes)
11172024-02-15T07:03:24.011Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11182024-02-15T07:03:24.011Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11192024-02-15T07:03:25.081Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11202024-02-15T07:03:25.082Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11212024-02-15T07:03:26.177Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11222024-02-15T07:03:26.177Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (90846 bytes)
11232024-02-15T07:03:26.394Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 90846 -> 101442
11242024-02-15T07:03:27.471Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11252024-02-15T07:03:27.471Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (264855 bytes)
11262024-02-15T07:03:28.853Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11272024-02-15T07:03:28.854Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
11282024-02-15T07:03:29.924Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11292024-02-15T07:03:29.924Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
11302024-02-15T07:03:31.026Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
11312024-02-15T07:03:31.026Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
11322024-02-15T07:03:32.117Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11332024-02-15T07:03:32.117Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5394 bytes)
11342024-02-15T07:03:33.220Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
11352024-02-15T07:03:33.221Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-clickhouse:default.log (345150 bytes)
11362024-02-15T07:03:33.730Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 345150 -> 403255
11372024-02-15T07:03:34.819Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-clickhouse:default.log
11382024-02-15T07:03:34.820Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-clickhouse:default.log.0 (517604 bytes)
11392024-02-15T07:03:36.463Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-clickhouse:default.log.0
11402024-02-15T07:03:36.463Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11412024-02-15T07:03:37.583Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-zone-network-setup:default.log
11422024-02-15T07:03:37.583Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
11432024-02-15T07:03:38.702Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_c0e4fe02-fc67-4f09-979e-ff48d15f916e/root/var/svc/log/oxide-zone-network-setup:default.log.0
11442024-02-15T07:03:38.703Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b72eb085-d1eb-4307-beeb-3183b7afff09/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11452024-02-15T07:03:39.792Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b72eb085-d1eb-4307-beeb-3183b7afff09/root/var/svc/log/oxide-cockroachdb:default.log
11462024-02-15T07:03:39.792Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b72eb085-d1eb-4307-beeb-3183b7afff09/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
11472024-02-15T07:03:39.903ZError: No response to keepalive - Terminating session
11482024-02-15T07:03:40.914Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b72eb085-d1eb-4307-beeb-3183b7afff09/root/var/svc/log/oxide-cockroachdb:default.log.0
11492024-02-15T07:03:40.914Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b72eb085-d1eb-4307-beeb-3183b7afff09/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11502024-02-15T07:03:41.998Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b72eb085-d1eb-4307-beeb-3183b7afff09/root/var/svc/log/oxide-zone-network-setup:default.log
11512024-02-15T07:03:41.998Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b72eb085-d1eb-4307-beeb-3183b7afff09/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
11522024-02-15T07:03:43.518Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_b72eb085-d1eb-4307-beeb-3183b7afff09/root/var/svc/log/oxide-zone-network-setup:default.log.0
11532024-02-15T07:03:43.518Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d36bf270-3da0-44aa-bdb0-1df5b93c76a2/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
11542024-02-15T07:03:44.588Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d36bf270-3da0-44aa-bdb0-1df5b93c76a2/root/var/svc/log/oxide-crucible-agent:default.log
11552024-02-15T07:03:44.588Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d36bf270-3da0-44aa-bdb0-1df5b93c76a2/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11562024-02-15T07:03:45.716Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d36bf270-3da0-44aa-bdb0-1df5b93c76a2/root/var/svc/log/oxide-crucible-agent:default.log.0
11572024-02-15T07:03:45.716Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d36bf270-3da0-44aa-bdb0-1df5b93c76a2/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11582024-02-15T07:03:50.385Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d36bf270-3da0-44aa-bdb0-1df5b93c76a2/root/var/svc/log/oxide-crucible-downstairs:default.log
11592024-02-15T07:03:50.385Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d36bf270-3da0-44aa-bdb0-1df5b93c76a2/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11602024-02-15T07:03:50.500ZError: No response de-activating SOL payload
11612024-02-15T07:03:51.077Z[SOL Session operational. Use ~? for help]
11622024-02-15T07:03:51.816Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d36bf270-3da0-44aa-bdb0-1df5b93c76a2/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11632024-02-15T07:03:51.816Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_f5fe9d49-e7c9-494a-b19f-4efc35cb6fde/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
11642024-02-15T07:03:52.930Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_f5fe9d49-e7c9-494a-b19f-4efc35cb6fde/root/var/svc/log/oxide-crucible-pantry:default.log
11652024-02-15T07:03:52.930Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_f5fe9d49-e7c9-494a-b19f-4efc35cb6fde/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
11662024-02-15T07:03:54.478Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_f5fe9d49-e7c9-494a-b19f-4efc35cb6fde/root/var/svc/log/oxide-crucible-pantry:default.log.0
11672024-02-15T07:03:54.478Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_19feddd6-78c6-4e31-b93a-acace968955e/root/var/svc/log/oxide-external_dns:default.log (11332 bytes)
11682024-02-15T07:03:54.512Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_19feddd6-78c6-4e31-b93a-acace968955e/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 11332 -> 15108
11692024-02-15T07:03:56.324Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_19feddd6-78c6-4e31-b93a-acace968955e/root/var/svc/log/oxide-external_dns:default.log
11702024-02-15T07:03:56.324Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_19feddd6-78c6-4e31-b93a-acace968955e/root/var/svc/log/oxide-external_dns:default.log.0 (15609 bytes)
11712024-02-15T07:03:56.870Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_19feddd6-78c6-4e31-b93a-acace968955e/root/var/svc/log/oxide-external_dns:default.log.0
11722024-02-15T07:03:56.870Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_78a9790e-f724-40b6-bd7f-e718315a779a/root/var/svc/log/oxide-internal_dns:default.log (11266 bytes)
11732024-02-15T07:03:56.992Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_78a9790e-f724-40b6-bd7f-e718315a779a/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 11266 -> 15019
11742024-02-15T07:03:58.899Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_78a9790e-f724-40b6-bd7f-e718315a779a/root/var/svc/log/oxide-internal_dns:default.log
11752024-02-15T07:03:58.899Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_78a9790e-f724-40b6-bd7f-e718315a779a/root/var/svc/log/oxide-internal_dns:default.log.0 (100416 bytes)
11762024-02-15T07:04:00.314Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_78a9790e-f724-40b6-bd7f-e718315a779a/root/var/svc/log/oxide-internal_dns:default.log.0
11772024-02-15T07:04:00.314Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f6978b02-5d61-48d0-a597-d8596e334f15/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11782024-02-15T07:04:01.418Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f6978b02-5d61-48d0-a597-d8596e334f15/root/var/svc/log/oxide-cockroachdb:default.log
11792024-02-15T07:04:01.419Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f6978b02-5d61-48d0-a597-d8596e334f15/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
11802024-02-15T07:04:02.515Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f6978b02-5d61-48d0-a597-d8596e334f15/root/var/svc/log/oxide-cockroachdb:default.log.0
11812024-02-15T07:04:02.516Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f6978b02-5d61-48d0-a597-d8596e334f15/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11822024-02-15T07:04:03.589Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f6978b02-5d61-48d0-a597-d8596e334f15/root/var/svc/log/oxide-zone-network-setup:default.log
11832024-02-15T07:04:03.589Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f6978b02-5d61-48d0-a597-d8596e334f15/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
11842024-02-15T07:04:04.742Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f6978b02-5d61-48d0-a597-d8596e334f15/root/var/svc/log/oxide-zone-network-setup:default.log.0
11852024-02-15T07:04:04.742Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-agent:default.log (6359 bytes)
11862024-02-15T07:04:06.287Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-agent:default.log
11872024-02-15T07:04:06.287Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11882024-02-15T07:04:07.385Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-agent:default.log.0
11892024-02-15T07:04:07.385Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11902024-02-15T07:04:08.923Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-downstairs:default.log
11912024-02-15T07:04:08.923Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11922024-02-15T07:04:10.051Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11932024-02-15T07:04:10.051Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-downstairs:downstairs-497b2945-be4c-4e46-8291-cd686d10f659.log (3019 bytes)
11942024-02-15T07:04:11.612Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_832b71a1-15a1-49bb-8487-4616e5f5b0be/root/var/svc/log/oxide-crucible-downstairs:downstairs-497b2945-be4c-4e46-8291-cd686d10f659.log
11952024-02-15T07:04:11.612Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_32bd8fe1-df5d-4887-b6be-0cddecf4285c/root/var/svc/log/oxide-external_dns:default.log (11331 bytes)
11962024-02-15T07:04:11.737Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_32bd8fe1-df5d-4887-b6be-0cddecf4285c/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 11331 -> 18883
11972024-02-15T07:04:12.812Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_32bd8fe1-df5d-4887-b6be-0cddecf4285c/root/var/svc/log/oxide-external_dns:default.log
11982024-02-15T07:04:12.813Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_32bd8fe1-df5d-4887-b6be-0cddecf4285c/root/var/svc/log/oxide-external_dns:default.log.0 (15611 bytes)
11992024-02-15T07:04:14.008Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_32bd8fe1-df5d-4887-b6be-0cddecf4285c/root/var/svc/log/oxide-external_dns:default.log.0
12002024-02-15T07:04:14.008Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_de8bbd15-7094-44ed-a766-1edae8657a5e/root/var/svc/log/oxide-internal_dns:default.log (11263 bytes)
12012024-02-15T07:04:14.574Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_de8bbd15-7094-44ed-a766-1edae8657a5e/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 11263 -> 18609
12022024-02-15T07:04:15.698Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_de8bbd15-7094-44ed-a766-1edae8657a5e/root/var/svc/log/oxide-internal_dns:default.log
12032024-02-15T07:04:15.698Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_de8bbd15-7094-44ed-a766-1edae8657a5e/root/var/svc/log/oxide-internal_dns:default.log.0 (104899 bytes)
12042024-02-15T07:04:17.096Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_de8bbd15-7094-44ed-a766-1edae8657a5e/root/var/svc/log/oxide-internal_dns:default.log.0
12052024-02-15T07:04:17.096Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_c6b4277c-7109-4119-86bc-926d4484fcf3/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12062024-02-15T07:04:18.183Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_c6b4277c-7109-4119-86bc-926d4484fcf3/root/var/svc/log/oxide-cockroachdb:default.log
12072024-02-15T07:04:18.183Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_c6b4277c-7109-4119-86bc-926d4484fcf3/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
12082024-02-15T07:04:19.283Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_c6b4277c-7109-4119-86bc-926d4484fcf3/root/var/svc/log/oxide-cockroachdb:default.log.0
12092024-02-15T07:04:19.284Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_c6b4277c-7109-4119-86bc-926d4484fcf3/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12102024-02-15T07:04:20.409Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_c6b4277c-7109-4119-86bc-926d4484fcf3/root/var/svc/log/oxide-zone-network-setup:default.log
12112024-02-15T07:04:20.410Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_c6b4277c-7109-4119-86bc-926d4484fcf3/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12122024-02-15T07:04:21.943Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_c6b4277c-7109-4119-86bc-926d4484fcf3/root/var/svc/log/oxide-zone-network-setup:default.log.0
12132024-02-15T07:04:21.943Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-agent:default.log (6360 bytes)
12142024-02-15T07:04:23.067Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-agent:default.log
12152024-02-15T07:04:23.067Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-agent:default.log.0 (3435 bytes)
12162024-02-15T07:04:24.164Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-agent:default.log.0
12172024-02-15T07:04:24.164Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12182024-02-15T07:04:25.238Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-downstairs:default.log
12192024-02-15T07:04:25.238Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12202024-02-15T07:04:26.375Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12212024-02-15T07:04:26.375Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-downstairs:downstairs-934b11bf-260a-4ec2-8958-676b861874bc.log (3017 bytes)
12222024-02-15T07:04:27.472Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_a6ee055c-0de9-4fb4-a27e-5f9f0a728add/root/var/svc/log/oxide-crucible-downstairs:downstairs-934b11bf-260a-4ec2-8958-676b861874bc.log
12232024-02-15T07:04:27.472Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_ffdb0d80-1b9f-4db4-a0b6-96d3f7810c28/root/var/svc/log/oxide-internal_dns:default.log (11263 bytes)
12242024-02-15T07:04:27.565Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_ffdb0d80-1b9f-4db4-a0b6-96d3f7810c28/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 11263 -> 18774
12252024-02-15T07:04:28.655Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_ffdb0d80-1b9f-4db4-a0b6-96d3f7810c28/root/var/svc/log/oxide-internal_dns:default.log
12262024-02-15T07:04:28.655Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_ffdb0d80-1b9f-4db4-a0b6-96d3f7810c28/root/var/svc/log/oxide-internal_dns:default.log.0 (102447 bytes)
12272024-02-15T07:04:29.871Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_ffdb0d80-1b9f-4db4-a0b6-96d3f7810c28/root/var/svc/log/oxide-internal_dns:default.log.0
12282024-02-15T07:04:29.871Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba8e18ad-524d-4a42-b182-bc303dcab0d9/root/var/svc/log/oxide-nexus:default.log (355861 bytes)
12292024-02-15T07:04:30.306Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba8e18ad-524d-4a42-b182-bc303dcab0d9/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 355861 -> 563771
12302024-02-15T07:04:31.379Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba8e18ad-524d-4a42-b182-bc303dcab0d9/root/var/svc/log/oxide-nexus:default.log
12312024-02-15T07:04:31.379Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba8e18ad-524d-4a42-b182-bc303dcab0d9/root/var/svc/log/oxide-nexus:default.log.0 (984384 bytes)
12322024-02-15T07:04:33.638Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_nexus_ba8e18ad-524d-4a42-b182-bc303dcab0d9/root/var/svc/log/oxide-nexus:default.log.0
12332024-02-15T07:04:33.639Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_bd11fdd7-0e86-4bec-8eab-9b51a9efaa5e/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12342024-02-15T07:04:34.723Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_bd11fdd7-0e86-4bec-8eab-9b51a9efaa5e/root/var/svc/log/oxide-cockroachdb:default.log
12352024-02-15T07:04:34.723Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_bd11fdd7-0e86-4bec-8eab-9b51a9efaa5e/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
12362024-02-15T07:04:35.994Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_bd11fdd7-0e86-4bec-8eab-9b51a9efaa5e/root/var/svc/log/oxide-cockroachdb:default.log.0
12372024-02-15T07:04:35.994Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_bd11fdd7-0e86-4bec-8eab-9b51a9efaa5e/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12382024-02-15T07:04:37.038Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_bd11fdd7-0e86-4bec-8eab-9b51a9efaa5e/root/var/svc/log/oxide-zone-network-setup:default.log
12392024-02-15T07:04:37.071Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_bd11fdd7-0e86-4bec-8eab-9b51a9efaa5e/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
12402024-02-15T07:04:38.148Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_bd11fdd7-0e86-4bec-8eab-9b51a9efaa5e/root/var/svc/log/oxide-zone-network-setup:default.log.0
12412024-02-15T07:04:38.148Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12422024-02-15T07:04:39.277Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-agent:default.log
12432024-02-15T07:04:39.277Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-agent:default.log.0 (14114 bytes)
12442024-02-15T07:04:40.423Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-agent:default.log.0
12452024-02-15T07:04:40.424Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12462024-02-15T07:04:41.496Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-downstairs:default.log
12472024-02-15T07:04:41.497Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12482024-02-15T07:04:42.620Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12492024-02-15T07:04:42.620Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-downstairs:downstairs-d02a28ac-e8d2-470e-8ee0-139944cedf05.log (0 bytes)
12502024-02-15T07:04:43.696Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-downstairs:downstairs-d02a28ac-e8d2-470e-8ee0-139944cedf05.log
12512024-02-15T07:04:43.696Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-downstairs:downstairs-d02a28ac-e8d2-470e-8ee0-139944cedf05.log.0 (3125 bytes)
12522024-02-15T07:04:44.794Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e69755d-18d7-411b-8394-947b385c4292/root/var/svc/log/oxide-crucible-downstairs:downstairs-d02a28ac-e8d2-470e-8ee0-139944cedf05.log.0
12532024-02-15T07:04:44.794Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_ab5a7d7b-1d51-4f8f-bead-f4e58e8f3b4f/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12542024-02-15T07:04:45.877Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_ab5a7d7b-1d51-4f8f-bead-f4e58e8f3b4f/root/var/svc/log/oxide-cockroachdb:default.log
12552024-02-15T07:04:45.877Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_ab5a7d7b-1d51-4f8f-bead-f4e58e8f3b4f/root/var/svc/log/oxide-cockroachdb:default.log.0 (4379 bytes)
12562024-02-15T07:04:46.988Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_ab5a7d7b-1d51-4f8f-bead-f4e58e8f3b4f/root/var/svc/log/oxide-cockroachdb:default.log.0
12572024-02-15T07:04:46.988Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_ab5a7d7b-1d51-4f8f-bead-f4e58e8f3b4f/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12582024-02-15T07:04:48.476Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_ab5a7d7b-1d51-4f8f-bead-f4e58e8f3b4f/root/var/svc/log/oxide-zone-network-setup:default.log
12592024-02-15T07:04:48.477Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_ab5a7d7b-1d51-4f8f-bead-f4e58e8f3b4f/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12602024-02-15T07:04:49.573Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_ab5a7d7b-1d51-4f8f-bead-f4e58e8f3b4f/root/var/svc/log/oxide-zone-network-setup:default.log.0
12612024-02-15T07:04:49.573Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-agent:default.log (7757 bytes)
12622024-02-15T07:04:50.709Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-agent:default.log
12632024-02-15T07:04:50.709Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-agent:default.log.0 (9792 bytes)
12642024-02-15T07:04:51.838Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-agent:default.log.0
12652024-02-15T07:04:51.838Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12662024-02-15T07:04:52.915Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:default.log
12672024-02-15T07:04:52.915Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12682024-02-15T07:04:54.010Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12692024-02-15T07:04:54.010Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:downstairs-ae6d090c-a454-42fb-ad56-cc9252596d9a.log (1091 bytes)
12702024-02-15T07:04:55.106Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:downstairs-ae6d090c-a454-42fb-ad56-cc9252596d9a.log
12712024-02-15T07:04:55.107Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:downstairs-ae6d090c-a454-42fb-ad56-cc9252596d9a.log.0 (4599 bytes)
12722024-02-15T07:04:56.208Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:downstairs-ae6d090c-a454-42fb-ad56-cc9252596d9a.log.0
12732024-02-15T07:04:56.208Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:snapshot-ae6d090c-a454-42fb-ad56-cc9252596d9a-4a886a69-4a8e-438f-b13b-3e96120232e7.log (5305 bytes)
12742024-02-15T07:04:57.338Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_420fdd44-547d-4ecb-ba4a-61cb6ff24bc1/root/var/svc/log/oxide-crucible-downstairs:snapshot-ae6d090c-a454-42fb-ad56-cc9252596d9a-4a886a69-4a8e-438f-b13b-3e96120232e7.log
12752024-02-15T07:04:57.338Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_ba19271d-5e65-44bf-a4aa-d6f796398975/root/var/svc/log/oxide-crucible-pantry:default.log (591141 bytes)
12762024-02-15T07:04:58.906Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_ba19271d-5e65-44bf-a4aa-d6f796398975/root/var/svc/log/oxide-crucible-pantry:default.log
12772024-02-15T07:04:58.906Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_ba19271d-5e65-44bf-a4aa-d6f796398975/root/var/svc/log/oxide-crucible-pantry:default.log.0 (633804 bytes)
12782024-02-15T07:05:00.547Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_ba19271d-5e65-44bf-a4aa-d6f796398975/root/var/svc/log/oxide-crucible-pantry:default.log.0
12792024-02-15T07:05:00.548Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_e95ac69e-357c-4739-98d7-387bae64db91/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
12802024-02-15T07:05:02.050Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_e95ac69e-357c-4739-98d7-387bae64db91/root/var/svc/log/oxide-crucible-pantry:default.log
12812024-02-15T07:05:02.050Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_e95ac69e-357c-4739-98d7-387bae64db91/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
12822024-02-15T07:05:03.574Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_e95ac69e-357c-4739-98d7-387bae64db91/root/var/svc/log/oxide-crucible-pantry:default.log.0
12832024-02-15T07:05:03.574Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-agent:default.log (7756 bytes)
12842024-02-15T07:05:05.126Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-agent:default.log
12852024-02-15T07:05:05.126Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-agent:default.log.0 (10221 bytes)
12862024-02-15T07:05:06.255Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-agent:default.log.0
12872024-02-15T07:05:06.256Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12882024-02-15T07:05:07.335Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:default.log
12892024-02-15T07:05:07.335Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12902024-02-15T07:05:08.449Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12912024-02-15T07:05:08.450Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:downstairs-fc43d6c8-0efa-4de8-8aae-c46f86786e8f.log (1091 bytes)
12922024-02-15T07:05:09.551Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:downstairs-fc43d6c8-0efa-4de8-8aae-c46f86786e8f.log
12932024-02-15T07:05:09.551Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:downstairs-fc43d6c8-0efa-4de8-8aae-c46f86786e8f.log.0 (4603 bytes)
12942024-02-15T07:05:10.647Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:downstairs-fc43d6c8-0efa-4de8-8aae-c46f86786e8f.log.0
12952024-02-15T07:05:10.647Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:snapshot-fc43d6c8-0efa-4de8-8aae-c46f86786e8f-4a886a69-4a8e-438f-b13b-3e96120232e7.log (5304 bytes)
12962024-02-15T07:05:11.775Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d3d66b95-9fce-4957-bed6-519660c078ce/root/var/svc/log/oxide-crucible-downstairs:snapshot-fc43d6c8-0efa-4de8-8aae-c46f86786e8f-4a886a69-4a8e-438f-b13b-3e96120232e7.log
12972024-02-15T07:05:11.775Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/svc/log/oxide-ntp:default.log (0 bytes)
12982024-02-15T07:05:12.846Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/svc/log/oxide-ntp:default.log
12992024-02-15T07:05:12.846Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/svc/log/oxide-ntp:default.log.0 (1255 bytes)
13002024-02-15T07:05:13.961Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/svc/log/oxide-ntp:default.log.0
13012024-02-15T07:05:13.962Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-oximeter:default.log (113338 bytes)
13022024-02-15T07:05:14.225Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 113338 -> 191740
13032024-02-15T07:05:15.706Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-oximeter:default.log
13042024-02-15T07:05:15.706Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-oximeter:default.log.0 (152587 bytes)
13052024-02-15T07:05:16.581Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-oximeter:default.log.0
13062024-02-15T07:05:16.581Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13072024-02-15T07:05:17.660Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-zone-network-setup:default.log
13082024-02-15T07:05:17.660Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes)
13092024-02-15T07:05:18.784Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_5c16fbd5-9570-4608-bb15-2ba4197cfd75/root/var/svc/log/oxide-zone-network-setup:default.log.0
13102024-02-15T07:05:18.784Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-agent:default.log (10678 bytes)
13112024-02-15T07:05:19.927Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-agent:default.log
13122024-02-15T07:05:19.928Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-agent:default.log.0 (13685 bytes)
13132024-02-15T07:05:21.132Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-agent:default.log.0
13142024-02-15T07:05:21.132Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13152024-02-15T07:05:22.638Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:default.log
13162024-02-15T07:05:22.638Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13172024-02-15T07:05:23.756Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13182024-02-15T07:05:23.757Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:downstairs-18a7e9be-1b71-42ed-b4c9-6d83f3e9230f.log (0 bytes)
13192024-02-15T07:05:24.846Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:downstairs-18a7e9be-1b71-42ed-b4c9-6d83f3e9230f.log
13202024-02-15T07:05:24.846Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:downstairs-18a7e9be-1b71-42ed-b4c9-6d83f3e9230f.log.0 (3124 bytes)
13212024-02-15T07:05:26.365Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:downstairs-18a7e9be-1b71-42ed-b4c9-6d83f3e9230f.log.0
13222024-02-15T07:05:26.365Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:downstairs-c64baa02-c18a-4d8d-99e1-79853ee5766a.log (5612 bytes)
13232024-02-15T07:05:27.498Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12761ad1-9214-48a7-9522-56202fcc4ea8/root/var/svc/log/oxide-crucible-downstairs:downstairs-c64baa02-c18a-4d8d-99e1-79853ee5766a.log
13242024-02-15T07:05:27.498Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_3070a05f-0975-405a-a092-97194f7ed118/root/var/svc/log/oxide-nexus:default.log (961581 bytes)
13252024-02-15T07:05:29.849Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_3070a05f-0975-405a-a092-97194f7ed118/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 961581 -> 1624326
13262024-02-15T07:05:30.942Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_3070a05f-0975-405a-a092-97194f7ed118/root/var/svc/log/oxide-nexus:default.log
13272024-02-15T07:05:30.942Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_3070a05f-0975-405a-a092-97194f7ed118/root/var/svc/log/oxide-nexus:default.log.0 (4104104 bytes)
13282024-02-15T07:05:35.121Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_3070a05f-0975-405a-a092-97194f7ed118/root/var/svc/log/oxide-nexus:default.log.0
13292024-02-15T07:05:35.122Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-agent:default.log (18005 bytes)
13302024-02-15T07:05:36.317Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-agent:default.log
13312024-02-15T07:05:36.317Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-agent:default.log.0 (10225 bytes)
13322024-02-15T07:05:37.867Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-agent:default.log.0
13332024-02-15T07:05:37.868Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13342024-02-15T07:05:38.970Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:default.log
13352024-02-15T07:05:38.970Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13362024-02-15T07:05:40.542Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13372024-02-15T07:05:40.542Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:downstairs-9e685cc5-496a-4a4c-907f-08102364646e.log (1089 bytes)
13382024-02-15T07:05:41.657Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:downstairs-9e685cc5-496a-4a4c-907f-08102364646e.log
13392024-02-15T07:05:41.657Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:downstairs-9e685cc5-496a-4a4c-907f-08102364646e.log.0 (4601 bytes)
13402024-02-15T07:05:42.786Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:downstairs-9e685cc5-496a-4a4c-907f-08102364646e.log.0
13412024-02-15T07:05:42.787Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:downstairs-ea58c064-5850-4362-8ead-ba49d533661b.log (5614 bytes)
13422024-02-15T07:05:43.935Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:downstairs-ea58c064-5850-4362-8ead-ba49d533661b.log
13432024-02-15T07:05:43.935Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:snapshot-9e685cc5-496a-4a4c-907f-08102364646e-4a886a69-4a8e-438f-b13b-3e96120232e7.log (5306 bytes)
13442024-02-15T07:05:45.075Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a7f74dd4-671c-44e3-9f19-8db1f14f9d55/root/var/svc/log/oxide-crucible-downstairs:snapshot-9e685cc5-496a-4a4c-907f-08102364646e-4a886a69-4a8e-438f-b13b-3e96120232e7.log
13452024-02-15T07:05:45.075Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-agent:default.log (16606 bytes)
13462024-02-15T07:05:46.237Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-agent:default.log
13472024-02-15T07:05:46.237Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-agent:default.log.0 (14150 bytes)
13482024-02-15T07:05:47.371Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-agent:default.log.0
13492024-02-15T07:05:47.371Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13502024-02-15T07:05:48.476Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:default.log
13512024-02-15T07:05:48.476Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13522024-02-15T07:05:49.609Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13532024-02-15T07:05:49.609Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:downstairs-8cdacf7b-0844-4af8-a67b-ab65067c8ca2.log (3019 bytes)
13542024-02-15T07:05:50.720Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:downstairs-8cdacf7b-0844-4af8-a67b-ab65067c8ca2.log
13552024-02-15T07:05:50.720Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1353f54-c53f-42ae-bda6-485a713ff118.log (5612 bytes)
13562024-02-15T07:05:52.271Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:downstairs-b1353f54-c53f-42ae-bda6-485a713ff118.log
13572024-02-15T07:05:52.271Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3668451-18f8-4131-a733-4bb80603d844.log (0 bytes)
13582024-02-15T07:05:53.396Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3668451-18f8-4131-a733-4bb80603d844.log
13592024-02-15T07:05:53.396Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3668451-18f8-4131-a733-4bb80603d844.log.0 (3123 bytes)
13602024-02-15T07:05:58.207Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c24bc8e9-aee0-450f-9ab7-f7b1f4ec057e/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3668451-18f8-4131-a733-4bb80603d844.log.0
13612024-02-15T07:05:58.207Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_ef99a85c-3cba-4477-b478-f1ddaffa2577/root/var/svc/log/oxide-nexus:default.log (17235709 bytes)
13622024-02-15T07:06:16.591Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_ef99a85c-3cba-4477-b478-f1ddaffa2577/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 17235709 -> 17700256
13632024-02-15T07:06:17.662Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_ef99a85c-3cba-4477-b478-f1ddaffa2577/root/var/svc/log/oxide-nexus:default.log
13642024-02-15T07:06:17.662Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_ef99a85c-3cba-4477-b478-f1ddaffa2577/root/var/svc/log/oxide-nexus:default.log.0 (17301919 bytes)
13652024-02-15T07:06:30.456Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_ef99a85c-3cba-4477-b478-f1ddaffa2577/root/var/svc/log/oxide-nexus:default.log.0
13662024-02-15T07:06:30.456Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/measurements.log (27537 bytes)
13672024-02-15T07:06:30.654Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/measurements.log" changed size mid upload: 27537 -> 36031
13682024-02-15T07:06:31.726Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/measurements.log
13692024-02-15T07:06:31.726Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/statistics.log (17316 bytes)
13702024-02-15T07:06:31.851Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/statistics.log" changed size mid upload: 17316 -> 23517
13712024-02-15T07:06:32.921Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/statistics.log
13722024-02-15T07:06:32.921Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/tracking.log (2514 bytes)
13732024-02-15T07:06:32.976Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/tracking.log" changed size mid upload: 2514 -> 2778
13742024-02-15T07:06:34.075Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_a42395c9-7d3c-4075-b7d1-b81c74ce09a5/root/var/log/chrony/tracking.log