01HRPSQ21HAGTHZX62S0MKPK78: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HRPSR28S7E127TQA6XXGHYVN

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-03-11T14:02:18.363Zjob dependencies complete; ready to run (waiting for 59 m 13 s)
22024-03-11T14:26:42.888Zjob assigned to worker 01HRPY6VJHGZHPC8W296XB076B (queued for 24 m 24 s)
32024-03-11T14:26:43.026Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-03-11T14:26:43.078Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-03-11T14:26:43.108Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... 24%Error: No response to keepalive - Terminating session
62024-03-11T14:26:43.142ZError: No response de-activating SOL payload
72024-03-11T14:26:43.176Z[SOL Session operational. Use ~? for help]
82024-03-11T14:26:43.827Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-65a4db6b155ae45e.gz
92024-03-11T14:26:44.610Z 87%Error: No response to keepalive - Terminating session
102024-03-11T14:26:45.938Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-65a4db6b155ae45e.gz
112024-03-11T14:26:45.963Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
122024-03-11T14:26:54.765ZError: No response de-activating SOL payload
132024-03-11T14:26:56.131Z[SOL Session operational. Use ~? for help]
142024-03-11T14:27:03.548Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
152024-03-11T14:27:03.548Zdownloading input: /input/ci-tools/work/end-to-end-tests/commtest-1a288711b562a1b6.gz
162024-03-11T14:27:06.890Zdownloaded input: /input/ci-tools/work/end-to-end-tests/commtest-1a288711b562a1b6.gz
172024-03-11T14:27:06.890Zdownloading input: /input/ci-tools/work/end-to-end-tests/dhcp_server-09883187f12d8d1b.gz
182024-03-11T14:27:09.317Zdownloaded input: /input/ci-tools/work/end-to-end-tests/dhcp_server-09883187f12d8d1b.gz
192024-03-11T14:27:09.341Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7b7b0e2adcdf9cf5.gz
202024-03-11T14:27:27.755Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7b7b0e2adcdf9cf5.gz
212024-03-11T14:27:27.755Zdownloading input: /input/ci-tools/work/caboose-util.gz
222024-03-11T14:27:28.497Zdownloaded input: /input/ci-tools/work/caboose-util.gz
232024-03-11T14:27:28.497Zdownloading input: /input/ci-tools/work/tufaceous.gz
242024-03-11T14:27:30.971Zdownloaded input: /input/ci-tools/work/tufaceous.gz
252024-03-11T14:27:30.971Zdownloading input: /input/ci-tools/work/commtest
262024-03-11T14:28:53.924Zdownloaded input: /input/ci-tools/work/commtest
272024-03-11T14:28:53.953Zdownloading input: /input/package/work/version.txt
282024-03-11T14:28:53.993Zdownloaded input: /input/package/work/version.txt
292024-03-11T14:28:54.017Zdownloading input: /input/package/work/package.tar.gz
302024-03-11T14:29:10.592Zdownloaded input: /input/package/work/package.tar.gz
312024-03-11T14:29:10.592Zdownloading input: /input/package/work/global-zone-packages.tar.gz
322024-03-11T14:29:35.316Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
332024-03-11T14:29:35.342Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
342024-03-11T14:29:42.002Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
352024-03-11T14:29:42.027Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
362024-03-11T14:30:00.716ZError: No response to keepalive - Terminating session
372024-03-11T14:30:10.919ZError: No response de-activating SOL payload
382024-03-11T14:30:12.022Z[SOL Session operational. Use ~? for help]
392024-03-11T14:30:25.687Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
402024-03-11T14:30:25.687Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
412024-03-11T14:31:09.337Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
422024-03-11T14:31:09.337Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
432024-03-11T14:31:31.921Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
442024-03-11T14:31:31.921Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
452024-03-11T14:31:37.108Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
462024-03-11T14:31:37.108Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
472024-03-11T14:31:44.778Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
482024-03-11T14:31:44.778Zdownloading input: /input/package/work/zones/external-dns.tar.gz
492024-03-11T14:31:50.282Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
502024-03-11T14:31:50.282Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
512024-03-11T14:31:55.720Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
522024-03-11T14:31:55.720Zdownloading input: /input/package/work/zones/nexus-single-sled.tar.gz
532024-03-11T14:32:11.245Zdownloaded input: /input/package/work/zones/nexus-single-sled.tar.gz
542024-03-11T14:32:11.269Zdownloading input: /input/package/work/zones/nexus.tar.gz
552024-03-11T14:32:28.126Zdownloaded input: /input/package/work/zones/nexus.tar.gz
562024-03-11T14:32:28.127Zdownloading input: /input/package/work/zones/ntp.tar.gz
572024-03-11T14:32:33.327Zdownloaded input: /input/package/work/zones/ntp.tar.gz
582024-03-11T14:32:33.327Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-03-11T14:32:38.367Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
602024-03-11T14:32:38.367Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-03-11T14:32:43.112Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
622024-03-11T14:32:43.137Zdownloading input: /input/package/work/zones/overlay.tar.gz
632024-03-11T14:32:43.162Zdownloaded input: /input/package/work/zones/overlay.tar.gz
642024-03-11T14:32:43.163Zdownloading input: /input/package/work/zones/oximeter.tar.gz
652024-03-11T14:32:53.723Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
662024-03-11T14:32:53.723Zdownloading input: /input/package/work/zones/probe.tar.gz
672024-03-11T14:32:54.351Zdownloaded input: /input/package/work/zones/probe.tar.gz
682024-03-11T14:32:54.351Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
692024-03-11T14:33:00.660ZError: No response to keepalive - Terminating session
702024-03-11T14:33:06.706Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-03-11T14:33:06.707Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-03-11T14:33:10.800ZError: No response de-activating SOL payload
732024-03-11T14:33:12.174Z[SOL Session operational. Use ~? for help]
742024-03-11T14:33:56.021Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
752024-03-11T14:33:56.021Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
762024-03-11T14:34:51.878Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
772024-03-11T14:34:51.973Zstarting task 0: "setup"
782024-03-11T14:34:51.973Z++ uname -s
792024-03-11T14:34:51.973Z+ kern=SunOS
802024-03-11T14:34:51.973Z+ case "$kern" in
812024-03-11T14:34:51.973Z+ groupadd -g 12345 build
822024-03-11T14:34:51.973Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
832024-03-11T14:34:52.086Z+ zfs create -o mountpoint=/work rpool/work
842024-03-11T14:34:52.114Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
852024-03-11T14:34:52.114Z+ home_fs=zfs
862024-03-11T14:34:52.114Z+ [[ zfs == autofs ]]
872024-03-11T14:34:52.114Z+ mkdir -p /home/build
882024-03-11T14:34:52.114Z+ chown build:build /home/build /work
892024-03-11T14:34:52.114Z+ chmod 0700 /home/build /work
902024-03-11T14:34:52.114Zprocess exited: duration 4057 ms, exit code 0
 
912024-03-11T14:34:52.162Zstarting task 1: "authentication"
922024-03-11T14:34:52.206Zprocess exited: duration 44 ms, exit code 0
 
932024-03-11T14:34:52.261Zstarting task 2: "build"
942024-03-11T14:34:52.289Z+ trap _exit_trap EXIT
952024-03-11T14:34:52.289Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
962024-03-11T14:34:52.381Zsecpolicy_fs_linkdir: 0x55 = 0x55
972024-03-11T14:34:52.381Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
982024-03-11T14:34:52.381Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
992024-03-11T14:34:52.382Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1002024-03-11T14:34:52.382Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1012024-03-11T14:34:52.382Zsecpolicy_fs_linkdir+5: 0 = 0x1
1022024-03-11T14:34:52.382Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1032024-03-11T14:34:52.382Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1042024-03-11T14:34:52.382Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1052024-03-11T14:34:52.408Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1062024-03-11T14:34:52.408Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1072024-03-11T14:34:52.408Z+ [[ -d /opt/oxide ]]
1082024-03-11T14:34:52.408Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1092024-03-11T14:34:52.408Z+ pfexec mkdir /opt/oxide
1102024-03-11T14:34:52.408Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1112024-03-11T14:34:52.408Z+ [[ -d /opt/oxide-underneath ]]
1122024-03-11T14:34:52.408Z+ cd /opt/oxide-underneath
1132024-03-11T14:34:52.408Z+ pfexec tar ceEp@/f - .
1142024-03-11T14:34:52.408Z+ cd /opt/oxide
1152024-03-11T14:34:52.408Z+ pfexec tar xveEp@/f -
1162024-03-11T14:34:52.489Zx ., 0 bytes, 0 tape blocks
1172024-03-11T14:34:52.489Zx ./opte, 0 bytes, 0 tape blocks
1182024-03-11T14:34:52.489Zx ./opte/bin, 0 bytes, 0 tape blocks
1192024-03-11T14:34:52.489Zx ./opte/bin/opteadm, 43221608 bytes, 84418 tape blocks
1202024-03-11T14:34:52.525Z+ pfexec rm -rf /opt/oxide-underneath
1212024-03-11T14:34:52.526Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1222024-03-11T14:34:52.526Z+ pfexec mkdir /opt/oxide/work
1232024-03-11T14:34:52.526Z+ pfexec chown build:build /opt/oxide/work
1242024-03-11T14:34:52.555Z+ cd /opt/oxide/work
1252024-03-11T14:34:52.556Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1262024-03-11T14:34:54.099ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1272024-03-11T14:34:54.099Zx out/mg-ddm-gz.tar, 67661824 bytes, 132152 tape blocks
1282024-03-11T14:34:54.099Zx out/omicron-sled-agent.tar, 109054976 bytes, 212998 tape blocks
1292024-03-11T14:34:54.099Zx out/oxlog.tar, 6245376 bytes, 12198 tape blocks
1302024-03-11T14:34:54.099Zx out/target/test, 75 bytes, 1 tape blocks
1312024-03-11T14:34:54.099Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1322024-03-11T14:34:54.100Zx package-manifest.toml, 26166 bytes, 52 tape blocks
1332024-03-11T14:34:54.100Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1342024-03-11T14:34:54.100Zx target/release/omicron-package, 39462272 bytes, 77075 tape blocks
1352024-03-11T14:34:54.100Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1362024-03-11T14:34:54.100Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1372024-03-11T14:34:54.100Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1382024-03-11T14:34:54.100Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1392024-03-11T14:34:54.100Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1402024-03-11T14:34:54.100Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1412024-03-11T14:34:54.100Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1422024-03-11T14:34:54.130Z
1432024-03-11T14:34:54.130Zreal 1.572612732
1442024-03-11T14:34:54.130Zuser 1.415825456
1452024-03-11T14:34:54.131Zsys 0.278321929
1462024-03-11T14:34:54.131Ztrap 0.000055500
1472024-03-11T14:34:54.131Ztflt 0.000000000
1482024-03-11T14:34:54.131Zdflt 0.000000000
1492024-03-11T14:34:54.131Zkflt 0.000000000
1502024-03-11T14:34:54.131Zlock 0.000000000
1512024-03-11T14:34:54.131Zslp 1.414737783
1522024-03-11T14:34:54.131Zlat 0.033985905
1532024-03-11T14:34:54.131Zstop 0.000127891
1542024-03-11T14:34:54.131Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/nexus-single-sled.tar.gz /input/package/work/zones/nexus.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/probe.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1552024-03-11T14:34:55.399Z+ mv out/nexus-single-sled.tar.gz out/nexus.tar.gz
1562024-03-11T14:34:55.423Z+ mkdir tests
1572024-03-11T14:34:55.423Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1582024-03-11T14:34:55.423Z+ ptime -m gunzip
1592024-03-11T14:34:55.423Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-65a4db6b155ae45e
1602024-03-11T14:34:55.625Z
1612024-03-11T14:34:55.649Zreal 0.208551391
1622024-03-11T14:34:55.650Zuser 0.192430637
1632024-03-11T14:34:55.650Zsys 0.015863850
1642024-03-11T14:34:55.650Ztrap 0.000016050
1652024-03-11T14:34:55.650Ztflt 0.000000000
1662024-03-11T14:34:55.650Zdflt 0.000000000
1672024-03-11T14:34:55.650Zkflt 0.000000000
1682024-03-11T14:34:55.650Zlock 0.000000000
1692024-03-11T14:34:55.650Zslp 0.000021370
1702024-03-11T14:34:55.650Zlat 0.000024240
1712024-03-11T14:34:55.650Zstop 0.000130002
1722024-03-11T14:34:55.650Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-65a4db6b155ae45e
1732024-03-11T14:34:55.650Z+ chmod a+x tests/bootstrap-65a4db6b155ae45e
1742024-03-11T14:34:55.650Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1752024-03-11T14:34:55.650Z+ ptime -m gunzip
1762024-03-11T14:34:55.650Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1772024-03-11T14:34:57.855Z
1782024-03-11T14:34:57.855Zreal 2.217778698
1792024-03-11T14:34:57.855Zuser 2.061744633
1802024-03-11T14:34:57.883Zsys 0.155603164
1812024-03-11T14:34:57.883Ztrap 0.000177705
1822024-03-11T14:34:57.883Ztflt 0.000000000
1832024-03-11T14:34:57.883Zdflt 0.000000000
1842024-03-11T14:34:57.883Zkflt 0.000000000
1852024-03-11T14:34:57.883Zlock 0.000000000
1862024-03-11T14:34:57.883Zslp 0.000037180
1872024-03-11T14:34:57.883Zlat 0.000033800
1882024-03-11T14:34:57.883Zstop 0.000128332
1892024-03-11T14:34:57.883Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1902024-03-11T14:34:57.883Z+ chmod a+x tests/bootstrap
1912024-03-11T14:34:57.883Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1922024-03-11T14:34:57.883Z+ ptime -m gunzip
1932024-03-11T14:34:57.883Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-1a288711b562a1b6
1942024-03-11T14:34:58.070Z
1952024-03-11T14:34:58.094Zreal 0.203513136
1962024-03-11T14:34:58.094Zuser 0.189770935
1972024-03-11T14:34:58.094Zsys 0.013487026
1982024-03-11T14:34:58.094Ztrap 0.000016150
1992024-03-11T14:34:58.094Ztflt 0.000000000
2002024-03-11T14:34:58.094Zdflt 0.000000000
2012024-03-11T14:34:58.094Zkflt 0.000000000
2022024-03-11T14:34:58.094Zlock 0.000000000
2032024-03-11T14:34:58.094Zslp 0.000023470
2042024-03-11T14:34:58.094Zlat 0.000023890
2052024-03-11T14:34:58.094Zstop 0.000129181
2062024-03-11T14:34:58.094Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-1a288711b562a1b6
2072024-03-11T14:34:58.094Z+ chmod a+x tests/commtest-1a288711b562a1b6
2082024-03-11T14:34:58.094Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2092024-03-11T14:34:58.094Z+ ptime -m gunzip
2102024-03-11T14:34:58.094Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-09883187f12d8d1b
2112024-03-11T14:34:58.288Z
2122024-03-11T14:34:58.312Zreal 0.206649919
2132024-03-11T14:34:58.312Zuser 0.192323998
2142024-03-11T14:34:58.312Zsys 0.014080455
2152024-03-11T14:34:58.312Ztrap 0.000015920
2162024-03-11T14:34:58.313Ztflt 0.000000000
2172024-03-11T14:34:58.313Zdflt 0.000000000
2182024-03-11T14:34:58.313Zkflt 0.000000000
2192024-03-11T14:34:58.313Zlock 0.000000000
2202024-03-11T14:34:58.313Zslp 0.000022370
2212024-03-11T14:34:58.313Zlat 0.000023410
2222024-03-11T14:34:58.313Zstop 0.000129512
2232024-03-11T14:34:58.313Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-09883187f12d8d1b
2242024-03-11T14:34:58.313Z+ chmod a+x tests/dhcp_server-09883187f12d8d1b
2252024-03-11T14:34:58.313Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2262024-03-11T14:34:58.313Z+ ptime -m gunzip
2272024-03-11T14:34:58.313Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7b7b0e2adcdf9cf5
2282024-03-11T14:35:00.593Z
2292024-03-11T14:35:00.617Zreal 2.293214216
2302024-03-11T14:35:00.618Zuser 2.123093860
2312024-03-11T14:35:00.618Zsys 0.169760759
2322024-03-11T14:35:00.618Ztrap 0.000165322
2332024-03-11T14:35:00.618Ztflt 0.000000000
2342024-03-11T14:35:00.618Zdflt 0.000000000
2352024-03-11T14:35:00.618Zkflt 0.000000000
2362024-03-11T14:35:00.618Zlock 0.000000000
2372024-03-11T14:35:00.618Zslp 0.000022550
2382024-03-11T14:35:00.618Zlat 0.000013220
2392024-03-11T14:35:00.618Zstop 0.000095001
2402024-03-11T14:35:00.618Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7b7b0e2adcdf9cf5
2412024-03-11T14:35:00.618Z+ chmod a+x tests/end_to_end_tests-7b7b0e2adcdf9cf5
2422024-03-11T14:35:00.618Z+ bmat address ls
2432024-03-11T14:35:00.618ZNAME CIDR FIRST LAST COUNT
2442024-03-11T14:35:00.618Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2452024-03-11T14:35:00.618Z++ bmat address ls -f extra -Ho first,last,count
2462024-03-11T14:35:00.644Z+ set -- 10.151.2.164 10.151.2.227 64
2472024-03-11T14:35:00.644Z+ EXTRA_IP_START=10.151.2.164
2482024-03-11T14:35:00.644Z+ EXTRA_IP_END=10.151.2.227
2492024-03-11T14:35:00.644Z+ EXTRA_IP_COUNT=64
2502024-03-11T14:35:00.644Z+ (( EXTRA_IP_COUNT >= 32 ))
2512024-03-11T14:35:00.644Z+ EXTRA_IP_BASE=10.151.2
2522024-03-11T14:35:00.644Z+ EXTRA_IP_FOCTET=164
2532024-03-11T14:35:00.644Z+ EXTRA_IP_LOCTET=227
2542024-03-11T14:35:00.644Z+ SERVICE_IP_POOL_START=10.151.2.164
2552024-03-11T14:35:00.644Z+ SERVICE_IP_POOL_END=10.151.2.173
2562024-03-11T14:35:00.644Z+ DNS_IP1=10.151.2.164
2572024-03-11T14:35:00.644Z+ DNS_IP2=10.151.2.165
2582024-03-11T14:35:00.644Z+ UPLINK_IP=10.151.2.174
2592024-03-11T14:35:00.644Z+ IPPOOL_START=10.151.2.175
2602024-03-11T14:35:00.644Z+ IPPOOL_END=10.151.2.227
2612024-03-11T14:35:00.644Z++ ipadm show-addr -po type,addr
2622024-03-11T14:35:00.645Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2632024-03-11T14:35:00.645Z+ GATEWAY_IP=10.151.2.100
2642024-03-11T14:35:00.645Z+ [[ -n 10.151.2.100 ]]
2652024-03-11T14:35:00.645Z+ ping -s 10.151.2.100 56 1
2662024-03-11T14:35:00.645ZPING 10.151.2.100: 56 data bytes
2672024-03-11T14:35:00.645Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.013 ms
2682024-03-11T14:35:00.645Z
2692024-03-11T14:35:00.645Z----10.151.2.100 PING Statistics----
2702024-03-11T14:35:00.645Z1 packets transmitted, 1 packets received, 0% packet loss
2712024-03-11T14:35:00.645Zround-trip (ms) min/avg/max/stddev = 0.013/0.013/0.013/-nan
2722024-03-11T14:35:00.645Z++ arp -an
2732024-03-11T14:35:00.673Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2742024-03-11T14:35:00.673Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2752024-03-11T14:35:00.673Z+ routeadm -e ipv4-forwarding -u
2762024-03-11T14:35:00.764Z+ PXA_START=10.151.2.164
2772024-03-11T14:35:00.764Z+ PXA_END=10.151.2.227
2782024-03-11T14:35:00.788Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2792024-03-11T14:35:00.788Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2802024-03-11T14:35:00.903Z+ ZPOOL_VDEV_DIR=/scratch
2812024-03-11T14:35:00.903Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2822024-03-11T14:35:00.928Z+++ dirname ./tools/create_virtual_hardware.sh
2832024-03-11T14:35:00.928Z++ cd ./tools
2842024-03-11T14:35:00.928Z++ pwd
2852024-03-11T14:35:00.928Z+ SOURCE_DIR=/opt/oxide/work/tools
2862024-03-11T14:35:00.928Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2872024-03-11T14:35:00.928Z+ SOFTNPU_MODE=zone
2882024-03-11T14:35:00.928Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2892024-03-11T14:35:00.929Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2902024-03-11T14:35:00.929Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2912024-03-11T14:35:00.929Z++ dladm show-phys -p -o LINK
2922024-03-11T14:35:00.929Z++ head -1
2932024-03-11T14:35:00.990Z+ PHYSICAL_LINK=igb0
2942024-03-11T14:35:01.015Z+ echo 'Using igb0 as physical link'
2952024-03-11T14:35:01.015ZUsing igb0 as physical link
2962024-03-11T14:35:01.015Z+ ensure_run_as_root
2972024-03-11T14:35:01.015Z++ id -u
2982024-03-11T14:35:01.015Z+ [[ 0 -ne 0 ]]
2992024-03-11T14:35:01.015Z+ ensure_zpools
3002024-03-11T14:35:01.015Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
3012024-03-11T14:35:01.015Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
3022024-03-11T14:35:01.015Z+ readarray -t ZPOOLS
3032024-03-11T14:35:01.015Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3042024-03-11T14:35:01.015Z++ sed 's/[ ",]//g'
3052024-03-11T14:35:01.015Z+ for ZPOOL in "${ZPOOLS[@]}"
3062024-03-11T14:35:01.015Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
3072024-03-11T14:35:01.015ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
3082024-03-11T14:35:01.015Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3092024-03-11T14:35:01.015Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
3102024-03-11T14:35:01.015Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
3112024-03-11T14:35:01.040Z0+0 records in
3122024-03-11T14:35:01.040Z0+0 records out
3132024-03-11T14:35:01.040Z0 bytes (0 iB) transferred in 0.000008 secs (0 iB/sec)
3142024-03-11T14:35:01.040Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
3152024-03-11T14:35:01.040Z+ set +x
3162024-03-11T14:35:01.040ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
3172024-03-11T14:35:01.040Z++ zpool list -o name
3182024-03-11T14:35:01.040Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
3192024-03-11T14:35:01.065Z+ [[ -z '' ]]
3202024-03-11T14:35:01.065Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3212024-03-11T14:35:01.089Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
3222024-03-11T14:35:01.089Z+ set +x
3232024-03-11T14:35:01.089ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3242024-03-11T14:35:01.089Z+ for ZPOOL in "${ZPOOLS[@]}"
3252024-03-11T14:35:01.089Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3262024-03-11T14:35:01.089ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3272024-03-11T14:35:01.089Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3282024-03-11T14:35:01.089Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3292024-03-11T14:35:01.089Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3302024-03-11T14:35:01.090Z0+0 records in
3312024-03-11T14:35:01.090Z0+0 records out
3322024-03-11T14:35:01.090Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3332024-03-11T14:35:01.090Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3342024-03-11T14:35:01.090Z+ set +x
3352024-03-11T14:35:01.090ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3362024-03-11T14:35:01.090Z++ zpool list -o name
3372024-03-11T14:35:01.090Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3382024-03-11T14:35:01.090Z+ [[ -z '' ]]
3392024-03-11T14:35:01.090Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3402024-03-11T14:35:01.116Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3412024-03-11T14:35:01.117Z+ set +x
3422024-03-11T14:35:01.154ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3432024-03-11T14:35:01.154Z+ for ZPOOL in "${ZPOOLS[@]}"
3442024-03-11T14:35:01.154Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3452024-03-11T14:35:01.154ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3462024-03-11T14:35:01.154Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3472024-03-11T14:35:01.154Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3482024-03-11T14:35:01.154Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3492024-03-11T14:35:01.154Z0+0 records in
3502024-03-11T14:35:01.154Z0+0 records out
3512024-03-11T14:35:01.154Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3522024-03-11T14:35:01.154Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3532024-03-11T14:35:01.155Z+ set +x
3542024-03-11T14:35:01.155ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3552024-03-11T14:35:01.155Z++ zpool list -o name
3562024-03-11T14:35:01.155Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3572024-03-11T14:35:01.155Z+ [[ -z '' ]]
3582024-03-11T14:35:01.155Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3592024-03-11T14:35:01.196Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3602024-03-11T14:35:01.196Z+ set +x
3612024-03-11T14:35:01.196ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3622024-03-11T14:35:01.196Z+ for ZPOOL in "${ZPOOLS[@]}"
3632024-03-11T14:35:01.196Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3642024-03-11T14:35:01.196ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3652024-03-11T14:35:01.197Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3662024-03-11T14:35:01.197Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3672024-03-11T14:35:01.197Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3682024-03-11T14:35:01.197Z0+0 records in
3692024-03-11T14:35:01.197Z0+0 records out
3702024-03-11T14:35:01.197Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3712024-03-11T14:35:01.198Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3722024-03-11T14:35:01.198Z+ set +x
3732024-03-11T14:35:01.198ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3742024-03-11T14:35:01.198Z++ zpool list -o name
3752024-03-11T14:35:01.198Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3762024-03-11T14:35:01.198Z+ [[ -z '' ]]
3772024-03-11T14:35:01.198Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3782024-03-11T14:35:01.226Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3792024-03-11T14:35:01.226Z+ set +x
3802024-03-11T14:35:01.227ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3812024-03-11T14:35:01.227Z+ for ZPOOL in "${ZPOOLS[@]}"
3822024-03-11T14:35:01.227Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3832024-03-11T14:35:01.227ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3842024-03-11T14:35:01.227Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3852024-03-11T14:35:01.227Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3862024-03-11T14:35:01.227Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3872024-03-11T14:35:01.227Z0+0 records in
3882024-03-11T14:35:01.227Z0+0 records out
3892024-03-11T14:35:01.227Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3902024-03-11T14:35:01.227Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3912024-03-11T14:35:01.227Z+ set +x
3922024-03-11T14:35:01.227ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3932024-03-11T14:35:01.227Z++ zpool list -o name
3942024-03-11T14:35:01.227Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3952024-03-11T14:35:01.227Z+ [[ -z '' ]]
3962024-03-11T14:35:01.227Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3972024-03-11T14:35:01.254Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3982024-03-11T14:35:01.255Z+ set +x
3992024-03-11T14:35:01.255ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
4002024-03-11T14:35:01.255Z+ for ZPOOL in "${ZPOOLS[@]}"
4012024-03-11T14:35:01.255Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
4022024-03-11T14:35:01.255ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
4032024-03-11T14:35:01.255Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4042024-03-11T14:35:01.255Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
4052024-03-11T14:35:01.255Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
4062024-03-11T14:35:01.255Z0+0 records in
4072024-03-11T14:35:01.255Z0+0 records out
4082024-03-11T14:35:01.255Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4092024-03-11T14:35:01.255Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
4102024-03-11T14:35:01.255Z+ set +x
4112024-03-11T14:35:01.255ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
4122024-03-11T14:35:01.255Z++ zpool list -o name
4132024-03-11T14:35:01.255Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
4142024-03-11T14:35:01.281Z+ [[ -z '' ]]
4152024-03-11T14:35:01.281Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4162024-03-11T14:35:01.306Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
4172024-03-11T14:35:01.306Z+ set +x
4182024-03-11T14:35:01.306ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
4192024-03-11T14:35:01.306Z+ for ZPOOL in "${ZPOOLS[@]}"
4202024-03-11T14:35:01.307Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
4212024-03-11T14:35:01.307ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
4222024-03-11T14:35:01.307Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4232024-03-11T14:35:01.307Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
4242024-03-11T14:35:01.307Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
4252024-03-11T14:35:01.307Z0+0 records in
4262024-03-11T14:35:01.307Z0+0 records out
4272024-03-11T14:35:01.307Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4282024-03-11T14:35:01.307Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4292024-03-11T14:35:01.307Z+ set +x
4302024-03-11T14:35:01.307ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
4312024-03-11T14:35:01.307Z++ zpool list -o name
4322024-03-11T14:35:01.307Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4332024-03-11T14:35:01.307Z+ [[ -z '' ]]
4342024-03-11T14:35:01.307Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4352024-03-11T14:35:01.332Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4362024-03-11T14:35:01.332Z+ set +x
4372024-03-11T14:35:01.332ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4382024-03-11T14:35:01.332Z+ for ZPOOL in "${ZPOOLS[@]}"
4392024-03-11T14:35:01.332Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4402024-03-11T14:35:01.332ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4412024-03-11T14:35:01.333Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4422024-03-11T14:35:01.333Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4432024-03-11T14:35:01.333Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4442024-03-11T14:35:01.333Z0+0 records in
4452024-03-11T14:35:01.333Z0+0 records out
4462024-03-11T14:35:01.333Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4472024-03-11T14:35:01.333Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4482024-03-11T14:35:01.333Z+ set +x
4492024-03-11T14:35:01.333ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4502024-03-11T14:35:01.333Z++ zpool list -o name
4512024-03-11T14:35:01.333Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4522024-03-11T14:35:01.358Z+ [[ -z '' ]]
4532024-03-11T14:35:01.358Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4542024-03-11T14:35:01.385Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4552024-03-11T14:35:01.385Z+ set +x
4562024-03-11T14:35:01.385ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4572024-03-11T14:35:01.385Z+ for ZPOOL in "${ZPOOLS[@]}"
4582024-03-11T14:35:01.385Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4592024-03-11T14:35:01.385ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4602024-03-11T14:35:01.385Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4612024-03-11T14:35:01.385Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4622024-03-11T14:35:01.385Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4632024-03-11T14:35:01.385Z0+0 records in
4642024-03-11T14:35:01.385Z0+0 records out
4652024-03-11T14:35:01.386Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4662024-03-11T14:35:01.386Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4672024-03-11T14:35:01.386Z+ set +x
4682024-03-11T14:35:01.386ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4692024-03-11T14:35:01.386Z++ zpool list -o name
4702024-03-11T14:35:01.386Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4712024-03-11T14:35:01.411Z+ [[ -z '' ]]
4722024-03-11T14:35:01.412Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4732024-03-11T14:35:01.436Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4742024-03-11T14:35:01.436Z+ set +x
4752024-03-11T14:35:01.436ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4762024-03-11T14:35:01.437Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4772024-03-11T14:35:01.437Z+ readarray -t ZPOOLS
4782024-03-11T14:35:01.437Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4792024-03-11T14:35:01.437Z++ sed 's/[ ",]//g'
4802024-03-11T14:35:01.437Z+ for ZPOOL in "${ZPOOLS[@]}"
4812024-03-11T14:35:01.437Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4822024-03-11T14:35:01.437ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4832024-03-11T14:35:01.437Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4842024-03-11T14:35:01.437Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4852024-03-11T14:35:01.437Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4862024-03-11T14:35:01.437Z0+0 records in
4872024-03-11T14:35:01.437Z0+0 records out
4882024-03-11T14:35:01.437Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4892024-03-11T14:35:01.437Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4902024-03-11T14:35:01.437Z+ set +x
4912024-03-11T14:35:01.437ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4922024-03-11T14:35:01.437Z++ zpool list -o name
4932024-03-11T14:35:01.437Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4942024-03-11T14:35:01.462Z+ [[ -z '' ]]
4952024-03-11T14:35:01.463Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4962024-03-11T14:35:01.487Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4972024-03-11T14:35:01.487Z+ set +x
4982024-03-11T14:35:01.487ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4992024-03-11T14:35:01.488Z+ for ZPOOL in "${ZPOOLS[@]}"
5002024-03-11T14:35:01.488Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
5012024-03-11T14:35:01.488ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
5022024-03-11T14:35:01.488Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5032024-03-11T14:35:01.488Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
5042024-03-11T14:35:01.488Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
5052024-03-11T14:35:01.488Z0+0 records in
5062024-03-11T14:35:01.488Z0+0 records out
5072024-03-11T14:35:01.488Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
5082024-03-11T14:35:01.488Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
5092024-03-11T14:35:01.488Z+ set +x
5102024-03-11T14:35:01.488ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
5112024-03-11T14:35:01.488Z++ zpool list -o name
5122024-03-11T14:35:01.488Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
5132024-03-11T14:35:01.488Z+ [[ -z '' ]]
5142024-03-11T14:35:01.488Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5152024-03-11T14:35:01.513Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
5162024-03-11T14:35:01.514Z+ set +x
5172024-03-11T14:35:01.514ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
5182024-03-11T14:35:01.514Z+ [[ zone == \z\o\n\e ]]
5192024-03-11T14:35:01.514Z+ ensure_simulated_links igb0
5202024-03-11T14:35:01.514Z+ local PHYSICAL_LINK=igb0
5212024-03-11T14:35:01.514Z+ INDICES=("0" "1")
5222024-03-11T14:35:01.514Z+ for I in "${INDICES[@]}"
5232024-03-11T14:35:01.514Z++ get_simnet_name_if_exists net0
5242024-03-11T14:35:01.514Z++ dladm show-simnet -p -o LINK net0
5252024-03-11T14:35:01.540Z++ echo ''
5262024-03-11T14:35:01.540Z+ [[ -z '' ]]
5272024-03-11T14:35:01.540Z+ dladm create-simnet -t net0
5282024-03-11T14:35:01.540Z+ dladm create-simnet -t sc0_0
5292024-03-11T14:35:01.540Z+ dladm modify-simnet -t -p net0 sc0_0
5302024-03-11T14:35:01.540Z+ dladm set-linkprop -p mtu=9000 sc0_0
5312024-03-11T14:35:01.540Z+ success 'Simnet net0/sc0_0 exists'
5322024-03-11T14:35:01.540Z+ set +x
5332024-03-11T14:35:01.540ZSimnet net0/sc0_0 exists
5342024-03-11T14:35:01.540Z+ for I in "${INDICES[@]}"
5352024-03-11T14:35:01.540Z++ get_simnet_name_if_exists net1
5362024-03-11T14:35:01.540Z++ dladm show-simnet -p -o LINK net1
5372024-03-11T14:35:01.540Z++ echo ''
5382024-03-11T14:35:01.540Z+ [[ -z '' ]]
5392024-03-11T14:35:01.540Z+ dladm create-simnet -t net1
5402024-03-11T14:35:01.565Z+ dladm create-simnet -t sc1_0
5412024-03-11T14:35:01.565Z+ dladm modify-simnet -t -p net1 sc1_0
5422024-03-11T14:35:01.565Z+ dladm set-linkprop -p mtu=9000 sc1_0
5432024-03-11T14:35:01.565Z+ success 'Simnet net1/sc1_0 exists'
5442024-03-11T14:35:01.565Z+ set +x
5452024-03-11T14:35:01.566ZSimnet net1/sc1_0 exists
5462024-03-11T14:35:01.566Z++ get_vnic_name_if_exists sc0_1
5472024-03-11T14:35:01.566Z++ dladm show-vnic -p -o LINK sc0_1
5482024-03-11T14:35:01.566Z++ echo ''
5492024-03-11T14:35:01.566Z+ [[ -z '' ]]
5502024-03-11T14:35:01.566Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5512024-03-11T14:35:01.566Z+ [[ -v PROMISC_FILT_OFF ]]
5522024-03-11T14:35:01.566Z+ success 'Vnic sc0_1 exists'
5532024-03-11T14:35:01.566Z+ set +x
5542024-03-11T14:35:01.566ZVnic sc0_1 exists
5552024-03-11T14:35:01.566Z+ warn_if_no_proxy_arp
5562024-03-11T14:35:01.566Z+ [[ -v PXA_START ]]
5572024-03-11T14:35:01.566Z+ [[ -v PXA_END ]]
5582024-03-11T14:35:01.566Z+ ensure_softnpu_zone
5592024-03-11T14:35:01.594Z+ zoneadm list
5602024-03-11T14:35:01.594Z+ grep -q sidecar_softnpu
5612024-03-11T14:35:01.594Z+ [[ -f out/npuzone/npuzone ]]
5622024-03-11T14:35:01.594Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5632024-03-11T14:35:01.594Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5642024-03-11T14:35:09.328Zdownloading softnpu ...done
5652024-03-11T14:35:09.354Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5662024-03-11T14:35:13.645Zdownloading asic_program.so ...done
5672024-03-11T14:35:13.670Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5682024-03-11T14:35:20.853Zdownloading scadm ...done
5692024-03-11T14:35:20.877Zcreating port tfportrear0_0 for sc0_0
5702024-03-11T14:35:20.877Zcreating port tfportqsfp0_0 for sc0_1
5712024-03-11T14:35:20.902Zsoftnpu zone setup
5722024-03-11T14:35:20.902Zconfigure zone
5732024-03-11T14:35:20.902Zinstall zone
5742024-03-11T14:35:21.934Zboot zone
5752024-03-11T14:35:25.039Z[sidecar_softnpu] svcs milestone/network
5762024-03-11T14:35:25.065ZSTATE STIME FMRI
5772024-03-11T14:35:25.065Zonline 14:35:23 svc:/milestone/network:default
5782024-03-11T14:35:25.065Z[sidecar_softnpu] /softnpu/npu start
5792024-03-11T14:35:25.089Z
5802024-03-11T14:35:25.114Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5812024-03-11T14:35:25.114Z+ GATEWAY_IP=10.151.2.100
5822024-03-11T14:35:25.114Z+ echo 'Using 10.151.2.100 as gateway ip'
5832024-03-11T14:35:25.114ZUsing 10.151.2.100 as gateway ip
5842024-03-11T14:35:25.114Z+ [[ ! -v GATEWAY_MAC ]]
5852024-03-11T14:35:25.114Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
5862024-03-11T14:35:25.114Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5872024-03-11T14:35:25.114Z+++ echo 18:c0:4d:0d:a0:2a
5882024-03-11T14:35:25.114Z+ COUNT=1
5892024-03-11T14:35:25.114Z+ [[ 1 -ne 1 ]]
5902024-03-11T14:35:25.115Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
5912024-03-11T14:35:25.115ZUsing 18:c0:4d:0d:a0:2a as gateway mac
5922024-03-11T14:35:25.115Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5932024-03-11T14:35:25.115Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5942024-03-11T14:35:25.140Z+ PXA_MAC=a8:e1:de:01:70:1d
5952024-03-11T14:35:25.140Z+ [[ -v PXA_START ]]
5962024-03-11T14:35:25.140Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5972024-03-11T14:35:25.140Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5982024-03-11T14:35:25.574Z+ z_scadm dump-state
5992024-03-11T14:35:25.574Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
6002024-03-11T14:35:25.622Zlocal v6:
6012024-03-11T14:35:25.622Zlocal v4:
6022024-03-11T14:35:25.622Zrouter v6:
6032024-03-11T14:35:25.622Zrouter v4_idx:
6042024-03-11T14:35:25.622Zrouter v4_routes:
6052024-03-11T14:35:25.622Zresolver v4:
6062024-03-11T14:35:25.623Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
6072024-03-11T14:35:25.623Zresolver v6:
6082024-03-11T14:35:25.623Znat v4:
6092024-03-11T14:35:25.623Znat_v6:
6102024-03-11T14:35:25.623Zport_mac:
6112024-03-11T14:35:25.623Zproxy arp:
6122024-03-11T14:35:25.623Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
6132024-03-11T14:35:25.623Z+ success 'softnpu zone exists'
6142024-03-11T14:35:25.623Z+ set +x
6152024-03-11T14:35:25.623Zsoftnpu zone exists
6162024-03-11T14:35:25.623Z
6172024-03-11T14:35:25.623Zreal 24.283779056
6182024-03-11T14:35:25.623Zuser 0.712759748
6192024-03-11T14:35:25.623Zsys 1.544181513
6202024-03-11T14:35:25.623Ztrap 0.000086894
6212024-03-11T14:35:25.623Ztflt 0.000128619
6222024-03-11T14:35:25.623Zdflt 0.001584583
6232024-03-11T14:35:25.623Zkflt 0.000000000
6242024-03-11T14:35:25.623Zlock 18:47.080346031
6252024-03-11T14:35:25.623Zslp 1:12.776268063
6262024-03-11T14:35:25.623Zlat 0.060144348
6272024-03-11T14:35:25.623Zstop 0.354440507
6282024-03-11T14:35:25.624Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
6292024-03-11T14:35:25.624Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6302024-03-11T14:35:25.624Z+ SILO_NAME=recovery
6312024-03-11T14:35:25.624Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6322024-03-11T14:35:25.624Z+ EXTERNAL_DNS_DOMAIN=oxide.test
6332024-03-11T14:35:25.624Z+ sed -i~ '
6342024-03-11T14:35:25.624Z /^external_dns_ips/c\
6352024-03-11T14:35:25.624Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6362024-03-11T14:35:25.624Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6372024-03-11T14:35:25.624Z /^first/c\
6382024-03-11T14:35:25.624Zfirst = "10.151.2.164"
6392024-03-11T14:35:25.624Z /^last/c\
6402024-03-11T14:35:25.624Zlast = "10.151.2.173"
6412024-03-11T14:35:25.624Z }
6422024-03-11T14:35:25.624Z /^\[rack_network_config/,/^$/ {
6432024-03-11T14:35:25.624Z /^infra_ip_first/c\
6442024-03-11T14:35:25.624Zinfra_ip_first = "10.151.2.174"
6452024-03-11T14:35:25.624Z /^infra_ip_last/c\
6462024-03-11T14:35:25.624Zinfra_ip_last = "10.151.2.174"
6472024-03-11T14:35:25.624Z }
6482024-03-11T14:35:25.624Z /^\[\[rack_network_config.ports/,/^$/ {
6492024-03-11T14:35:25.624Z /^routes/c\
6502024-03-11T14:35:25.624Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
6512024-03-11T14:35:25.624Z /^addresses/c\
6522024-03-11T14:35:25.625Zaddresses = \["10.151.2.174/24"\]
6532024-03-11T14:35:25.625Z }
6542024-03-11T14:35:25.625Z' pkg/config-rss.toml
6552024-03-11T14:35:25.625Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6562024-03-11T14:35:25.625Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6572024-03-11T14:35:25.625Z+++ pkg/config-rss.toml Mon Mar 11 14:35:25 2024
6582024-03-11T14:35:25.625Z@@ -33,7 +33,7 @@
6592024-03-11T14:35:25.625Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6602024-03-11T14:35:25.625Z # must be contained in one of the "internal services" IP Pool ranges listed
6612024-03-11T14:35:25.625Z # below.
6622024-03-11T14:35:25.625Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6632024-03-11T14:35:25.625Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6642024-03-11T14:35:25.625Z
6652024-03-11T14:35:25.625Z # Initial TLS certificates for the external API
6662024-03-11T14:35:25.625Z #
6672024-03-11T14:35:25.625Z@@ -69,8 +69,8 @@
6682024-03-11T14:35:25.625Z #
6692024-03-11T14:35:25.625Z # For more on this and what to put here, see docs/how-to-run.adoc.
6702024-03-11T14:35:25.625Z [[internal_services_ip_pool_ranges]]
6712024-03-11T14:35:25.625Z-first = "192.168.1.20"
6722024-03-11T14:35:25.625Z-last = "192.168.1.29"
6732024-03-11T14:35:25.625Z+first = "10.151.2.164"
6742024-03-11T14:35:25.625Z+last = "10.151.2.173"
6752024-03-11T14:35:25.626Z
6762024-03-11T14:35:25.626Z # TODO - this configuration is subject to change going forward. Ultimately these
6772024-03-11T14:35:25.626Z # parameters should be provided to the control plane via wicket, but we need to
6782024-03-11T14:35:25.626Z@@ -100,9 +100,9 @@
6792024-03-11T14:35:25.626Z # You can configure multiple uplinks by repeating the following stanza
6802024-03-11T14:35:25.626Z [[rack_network_config.ports]]
6812024-03-11T14:35:25.626Z # Routes associated with this port.
6822024-03-11T14:35:25.626Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6832024-03-11T14:35:25.626Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
6842024-03-11T14:35:25.626Z # Addresses associated with this port.
6852024-03-11T14:35:25.626Z-addresses = ["192.168.1.30/24"]
6862024-03-11T14:35:25.626Z+addresses = ["10.151.2.174/24"]
6872024-03-11T14:35:25.626Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6882024-03-11T14:35:25.626Z port = "qsfp0"
6892024-03-11T14:35:25.626Z # The speed of this port.
6902024-03-11T14:35:25.626Z+ true
6912024-03-11T14:35:25.626Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6922024-03-11T14:35:25.626Za pkg/config-rss.toml 7K
6932024-03-11T14:35:25.626Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6942024-03-11T14:35:25.626Z+ TLS_NAME=recovery.sys.oxide.test
6952024-03-11T14:35:25.626Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6962024-03-11T14:35:26.187Z....+.+..+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.......+.....+.......+........+..........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.........+.+...........+..........+..+...+....+...+........+...............+....+..............+.+......+...+......+...+.....+.............+.........+........+......+.......+............+..+.+............+..+...+......+.........+...+....+...+..........................+.+...+...+.........+...+...+...+..+...+.......+..+............+..........+........+...+...+.......+..+.............+........+....+...........+.+......+...+...........+......+..................+.+........+.+..+.....................................+...+........+.......+.....+...+............+...............+.......+.....+...+...+.+...+.....+............+......+....+......+..+.......+......+..................+..+.............+.....+.......+........+......+...............+...+............+...............+...............+...+.+.........+...........+.......+...+...........+...+......+.......+...+...........+.........+......+.+...............+..+............+...+.+..+..........+..................+............+...........................+................................+....+..+.............+..+...+....+.................+...+............+.+............+......+..+.........+..........+.....+...+.............+..+...+............+.............+........+.+...........+..........+...+.....+.........+.+..............+...+...+.+......+.................+.......+.....+....+.....+............+.........+.............+...+..+.+..+....+...+.....+...+.......+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6972024-03-11T14:35:26.476Z..+......+....+...........+......+...+.......+...+............+...+..+.........+...+.......+........+.+.........+...+.................+..........+..+.+..+......+....+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...............+...+.........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.....+................+..+...+.+.....+..........+........+..........+........+...+.+......+........+....+......+.........+..+....+.....+.+........+.............+..............+...+..........+..+.........+....+...+...............+....................+....+...+.....+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6982024-03-11T14:35:26.501Z-----
6992024-03-11T14:35:26.501Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
7002024-03-11T14:35:26.529Za pkg/initial-tls-cert.pem 2K
7012024-03-11T14:35:26.529Za pkg/initial-tls-key.pem 4K
7022024-03-11T14:35:26.530Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
7032024-03-11T14:35:26.530Z+ rmdir pkg
7042024-03-11T14:35:26.530Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
7052024-03-11T14:35:26.530Z+ pfexec mkdir -p /usr/oxide
7062024-03-11T14:35:26.531Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
7072024-03-11T14:35:27.182Z+ pfexec chmod +x /usr/oxide/oxide
7082024-03-11T14:35:27.206Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
7092024-03-11T14:35:45.450Z+ OMICRON_NO_UNINSTALL=1
7102024-03-11T14:35:45.451Z+ ptime -m pfexec ./target/release/omicron-package -t test install
7112024-03-11T14:35:45.476ZLogging to: /opt/oxide/work/out/LOG
7122024-03-11T14:35:46.009Z
7132024-03-11T14:35:46.034Zreal 0.553570185
7142024-03-11T14:35:46.034Zuser 0.110862757
7152024-03-11T14:35:46.034Zsys 2.241412849
7162024-03-11T14:35:46.034Ztrap 0.000000719
7172024-03-11T14:35:46.034Ztflt 0.000834731
7182024-03-11T14:35:46.034Zdflt 0.000433833
7192024-03-11T14:35:46.034Zkflt 0.000011870
7202024-03-11T14:35:46.034Zlock 50.399585664
7212024-03-11T14:35:46.034Zslp 0.768177083
7222024-03-11T14:35:46.034Zlat 0.003160953
7232024-03-11T14:35:46.034Zstop 0.216458734
7242024-03-11T14:35:46.034Z+ retry=0
7252024-03-11T14:35:46.034Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7262024-03-11T14:35:46.034Z+ [[ 0 -gt 30 ]]
7272024-03-11T14:35:46.034Z+ sleep 1
7282024-03-11T14:35:47.024Z+ retry=1
7292024-03-11T14:35:47.024Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7302024-03-11T14:35:47.049Z+ [[ 1 -gt 30 ]]
7312024-03-11T14:35:47.050Z+ sleep 1
7322024-03-11T14:35:48.046Z+ retry=2
7332024-03-11T14:35:48.046Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7342024-03-11T14:35:48.071Z+ [[ 2 -gt 30 ]]
7352024-03-11T14:35:48.071Z+ sleep 1
7362024-03-11T14:35:49.059Z+ retry=3
7372024-03-11T14:35:49.059Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7382024-03-11T14:35:49.084Z+ [[ 3 -gt 30 ]]
7392024-03-11T14:35:49.084Z+ sleep 1
7402024-03-11T14:35:50.073Z+ retry=4
7412024-03-11T14:35:50.074Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
 
7422024-03-11T14:36:00.297ZError: No response to keepalive - Terminating session
7432024-03-11T14:36:10.470ZError: No response de-activating SOL payload
7442024-03-11T14:36:11.577Z[SOL Session operational. Use ~? for help]
 
7452024-03-11T14:36:15.254Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7462024-03-11T14:36:15.754Zlocal v6:
7472024-03-11T14:36:15.754Zfd3c:780c:1e1b:9aa5::1
7482024-03-11T14:36:15.754Zfe80::c075:38ff:fe06:ed4b
7492024-03-11T14:36:15.754Zlocal v4:
7502024-03-11T14:36:15.755Z10.151.2.174
7512024-03-11T14:36:15.755Zrouter v6:
7522024-03-11T14:36:15.755Zfd00:1122:3344:3::/64 -> fe80::a4fd:9cff:fe02:928 (1)
7532024-03-11T14:36:15.755Zfd00:1122:3344:2::/64 -> fe80::a4fd:9cff:fe02:928 (1)
7542024-03-11T14:36:15.755Zfd00:1122:3344:1::/64 -> fe80::a4fd:9cff:fe02:928 (1)
7552024-03-11T14:36:15.756Zfd00:1122:3344:101::/64 -> fe80::a4fd:9cff:fe02:928 (1)
7562024-03-11T14:36:15.756Zfdb0:18c0:4d0d:a02a::/64 -> fe80::a4fd:9cff:fe02:928 (1)
7572024-03-11T14:36:15.756Zrouter v4_idx:
7582024-03-11T14:36:15.756Z0.0.0.0/0 -> 0
7592024-03-11T14:36:15.756Zrouter v4_routes:
7602024-03-11T14:36:15.756Z0 -> 10.151.2.100 (2)
7612024-03-11T14:36:15.757Zresolver v4:
7622024-03-11T14:36:15.757Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7632024-03-11T14:36:15.757Z10.151.2.174 -> 32:ed:42:51:17:89
7642024-03-11T14:36:15.757Zresolver v6:
7652024-03-11T14:36:15.757Zfe80::a4fd:9cff:fe02:928 -> a6:fd:9c:02:09:28
7662024-03-11T14:36:15.758Zfe80::c075:38ff:fe06:ed4b -> c2:75:38:06:ed:4b
7672024-03-11T14:36:15.758Znat v4:
7682024-03-11T14:36:15.758Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:be:fa
7692024-03-11T14:36:15.758Znat_v6:
7702024-03-11T14:36:15.758Zport_mac:
7712024-03-11T14:36:15.758Z1000: a8:40:25:51:f0:f9
7722024-03-11T14:36:15.759Z1: a8:40:25:51:f0:fa
7732024-03-11T14:36:15.759Z2: a8:40:25:51:f1:1a
7742024-03-11T14:36:15.759Zproxy arp:
7752024-03-11T14:36:15.759Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7762024-03-11T14:36:15.759Z+ retry=0
7772024-03-11T14:36:15.759Z+++ zoneadm list -n
7782024-03-11T14:36:15.760Z+++ grep oxz_ntp
7792024-03-11T14:36:15.760Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
7802024-03-11T14:36:15.760Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7812024-03-11T14:36:15.760Z++ true
7822024-03-11T14:36:15.760Z+ [[ '' != online ]]
7832024-03-11T14:36:15.760Z+ [[ 0 -gt 60 ]]
7842024-03-11T14:36:15.761Z+ sleep 1
7852024-03-11T14:36:16.314Z+ retry=1
7862024-03-11T14:36:16.339Z+++ zoneadm list -n
7872024-03-11T14:36:16.339Z+++ grep oxz_ntp
7882024-03-11T14:36:16.339Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
7892024-03-11T14:36:16.339Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7902024-03-11T14:36:16.339Z++ true
7912024-03-11T14:36:16.364Z+ [[ '' != online ]]
7922024-03-11T14:36:16.364Z+ [[ 1 -gt 60 ]]
7932024-03-11T14:36:16.364Z+ sleep 1
7942024-03-11T14:36:17.342Z+ retry=2
7952024-03-11T14:36:17.367Z+++ zoneadm list -n
7962024-03-11T14:36:17.367Z+++ grep oxz_ntp
7972024-03-11T14:36:17.367Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
7982024-03-11T14:36:17.391Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7992024-03-11T14:36:17.391Z++ true
8002024-03-11T14:36:17.391Z+ [[ '' != online ]]
8012024-03-11T14:36:17.392Z+ [[ 2 -gt 60 ]]
8022024-03-11T14:36:17.392Z+ sleep 1
8032024-03-11T14:36:18.373Z+ retry=3
8042024-03-11T14:36:18.404Z+++ zoneadm list -n
8052024-03-11T14:36:18.404Z+++ grep oxz_ntp
8062024-03-11T14:36:18.404Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
8072024-03-11T14:36:18.404Z+ [[ offline != online ]]
8082024-03-11T14:36:18.404Z+ [[ 3 -gt 60 ]]
8092024-03-11T14:36:18.404Z+ sleep 1
8102024-03-11T14:36:19.398Z+ retry=4
8112024-03-11T14:36:19.423Z+++ zoneadm list -n
8122024-03-11T14:36:19.423Z+++ grep oxz_ntp
8132024-03-11T14:36:19.423Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
8142024-03-11T14:36:19.423Z+ [[ offline != online ]]
8152024-03-11T14:36:19.423Z+ [[ 4 -gt 60 ]]
8162024-03-11T14:36:19.423Z+ sleep 1
8172024-03-11T14:36:20.420Z+ retry=5
8182024-03-11T14:36:20.446Z+++ zoneadm list -n
8192024-03-11T14:36:20.446Z+++ grep oxz_ntp
8202024-03-11T14:36:20.446Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
8212024-03-11T14:36:20.446Z+ [[ offline != online ]]
8222024-03-11T14:36:20.447Z+ [[ 5 -gt 60 ]]
8232024-03-11T14:36:20.447Z+ sleep 1
8242024-03-11T14:36:21.446Z+ retry=6
8252024-03-11T14:36:21.496Z+++ zoneadm list -n
8262024-03-11T14:36:21.496Z+++ grep oxz_ntp
8272024-03-11T14:36:21.496Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
8282024-03-11T14:36:21.496Z+ [[ offline != online ]]
8292024-03-11T14:36:21.496Z+ [[ 6 -gt 60 ]]
8302024-03-11T14:36:21.496Z+ sleep 1
8312024-03-11T14:36:22.464Z+ retry=7
8322024-03-11T14:36:22.489Z+++ zoneadm list -n
8332024-03-11T14:36:22.489Z+++ grep oxz_ntp
8342024-03-11T14:36:22.489Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
8352024-03-11T14:36:22.489Z+ [[ offline != online ]]
8362024-03-11T14:36:22.489Z+ [[ 7 -gt 60 ]]
8372024-03-11T14:36:22.489Z+ sleep 1
8382024-03-11T14:36:23.486Z+ retry=8
8392024-03-11T14:36:23.510Z+++ zoneadm list -n
8402024-03-11T14:36:23.510Z+++ grep oxz_ntp
8412024-03-11T14:36:23.510Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
8422024-03-11T14:36:23.510Z+ [[ offline != online ]]
8432024-03-11T14:36:23.510Z+ [[ 8 -gt 60 ]]
8442024-03-11T14:36:23.510Z+ sleep 1
8452024-03-11T14:36:24.508Z+ retry=9
8462024-03-11T14:36:24.533Z+++ zoneadm list -n
8472024-03-11T14:36:24.534Z+++ grep oxz_ntp
8482024-03-11T14:36:24.534Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
8492024-03-11T14:36:24.534Z+ [[ offline != online ]]
8502024-03-11T14:36:24.534Z+ [[ 9 -gt 60 ]]
8512024-03-11T14:36:24.534Z+ sleep 1
 
8522024-03-11T14:36:25.234ZMar 11 14:36:24 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8532024-03-11T14:36:25.535Z+ retry=10
8542024-03-11T14:36:25.560Z+++ zoneadm list -n
8552024-03-11T14:36:25.560Z+++ grep oxz_ntp
8562024-03-11T14:36:25.560Z++ pfexec svcs -z oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed -Hostate oxide/ntp
8572024-03-11T14:36:25.560Z+ [[ online != online ]]
8582024-03-11T14:36:25.560Z+ echo 'Waited for chrony: 10s'
8592024-03-11T14:36:25.560ZWaited for chrony: 10s
8602024-03-11T14:36:25.561Z+ export RUST_BACKTRACE=1
8612024-03-11T14:36:25.561Z+ RUST_BACKTRACE=1
8622024-03-11T14:36:25.561Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8632024-03-11T14:36:25.561Z++ ./tests/bootstrap
8642024-03-11T14:36:25.588ZUsing external DNS server at 10.151.2.164:53
8652024-03-11T14:36:25.588Z2024-03-11 14:36:25.583521726 UTC: attempting to log into API
8662024-03-11T14:36:40.618Z2024-03-11 14:36:40.608502069 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8672024-03-11T14:36:41.619Z2024-03-11 14:36:41.609513630 UTC: attempting to log into API
8682024-03-11T14:36:56.650Z2024-03-11 14:36:56.640998399 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8692024-03-11T14:36:57.651Z2024-03-11 14:36:57.641791047 UTC: attempting to log into API
8702024-03-11T14:37:12.683Z2024-03-11 14:37:12.673614991 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8712024-03-11T14:37:13.683Z2024-03-11 14:37:13.674479301 UTC: attempting to log into API
8722024-03-11T14:37:28.715Z2024-03-11 14:37:28.706089531 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8732024-03-11T14:37:29.717Z2024-03-11 14:37:29.707936628 UTC: attempting to log into API
8742024-03-11T14:37:44.750Z2024-03-11 14:37:44.740240934 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8752024-03-11T14:37:45.751Z2024-03-11 14:37:45.741028203 UTC: attempting to log into API
8762024-03-11T14:38:00.784Z2024-03-11 14:38:00.773138530 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8772024-03-11T14:38:01.785Z2024-03-11 14:38:01.773701835 UTC: attempting to log into API
8782024-03-11T14:38:16.822Z2024-03-11 14:38:16.809631637 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8792024-03-11T14:38:17.821Z2024-03-11 14:38:17.810241643 UTC: attempting to log into API
8802024-03-11T14:38:32.871Z2024-03-11 14:38:32.859490660 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8812024-03-11T14:38:33.873Z2024-03-11 14:38:33.860481262 UTC: attempting to log into API
8822024-03-11T14:38:49.013Z2024-03-11 14:38:48.984925904 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8832024-03-11T14:38:50.011Z2024-03-11 14:38:49.995470847 UTC: attempting to log into API
8842024-03-11T14:39:05.184Z2024-03-11 14:39:05.170352902 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8852024-03-11T14:39:06.182Z2024-03-11 14:39:06.171290353 UTC: attempting to log into API
 
8862024-03-11T14:39:16.572ZError: No response to keepalive - Terminating session
 
8872024-03-11T14:39:21.234Z2024-03-11 14:39:21.223789765 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8882024-03-11T14:39:22.235Z2024-03-11 14:39:22.224863138 UTC: attempting to log into API
 
8892024-03-11T14:39:26.472ZError: No response de-activating SOL payload
8902024-03-11T14:39:27.857Z[SOL Session operational. Use ~? for help]
 
8912024-03-11T14:39:33.035Z2024-03-11 14:39:33.025575530 UTC: login succeeded
8922024-03-11T14:39:33.069Zwaiting for nexus to come up...
8932024-03-11T14:39:33.146Zcreating IP pool... 10.151.2.175 - 10.151.2.227
8942024-03-11T14:39:33.324Zsetting up quotas...
8952024-03-11T14:39:33.366Zensuring datasets are ready...
8962024-03-11T14:39:35.869Zlet's roll.
8972024-03-11T14:39:35.904Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8982024-03-11T14:39:35.904ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
8992024-03-11T14:39:35.904ZOXIDE_TOKEN=oxide-token-451a8948b17a1aaf8aecdde627467daf839c70bb'
9002024-03-11T14:39:35.904Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9012024-03-11T14:39:35.905Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
9022024-03-11T14:39:35.905Z++ OXIDE_TOKEN=oxide-token-451a8948b17a1aaf8aecdde627467daf839c70bb
9032024-03-11T14:39:35.905Z+ export OXIDE_HOST OXIDE_TOKEN
9042024-03-11T14:39:35.905Z+ retry=0
9052024-03-11T14:39:35.905Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9062024-03-11T14:39:35.934Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9072024-03-11T14:39:35.934Z+ [[ 0 -gt 60 ]]
9082024-03-11T14:39:35.934Z+ sleep 1
9092024-03-11T14:39:36.932Z+ retry=1
9102024-03-11T14:39:36.932Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9112024-03-11T14:39:36.957Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9122024-03-11T14:39:36.957Z+ [[ 1 -gt 60 ]]
9132024-03-11T14:39:36.957Z+ sleep 1
9142024-03-11T14:39:37.939Z+ retry=2
9152024-03-11T14:39:37.939Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9162024-03-11T14:39:37.963Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9172024-03-11T14:39:37.963Z+ [[ 2 -gt 60 ]]
9182024-03-11T14:39:37.963Z+ sleep 1
9192024-03-11T14:39:38.954Z+ retry=3
9202024-03-11T14:39:38.954Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9212024-03-11T14:39:38.980Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9222024-03-11T14:39:38.980Z+ [[ 3 -gt 60 ]]
9232024-03-11T14:39:38.980Z+ sleep 1
9242024-03-11T14:39:39.969Z+ retry=4
9252024-03-11T14:39:39.969Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9262024-03-11T14:39:39.993Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9272024-03-11T14:39:39.994Z+ [[ 4 -gt 60 ]]
9282024-03-11T14:39:39.994Z+ sleep 1
9292024-03-11T14:39:40.985Z+ retry=5
9302024-03-11T14:39:40.985Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9312024-03-11T14:39:41.010Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9322024-03-11T14:39:41.010Z+ [[ 5 -gt 60 ]]
9332024-03-11T14:39:41.010Z+ sleep 1
9342024-03-11T14:39:42.000Z+ retry=6
9352024-03-11T14:39:42.000Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9362024-03-11T14:39:42.025Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9372024-03-11T14:39:42.025Z+ [[ 6 -gt 60 ]]
9382024-03-11T14:39:42.025Z+ sleep 1
9392024-03-11T14:39:44.234Z+ retry=7
9402024-03-11T14:39:44.234Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9412024-03-11T14:39:44.269Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9422024-03-11T14:39:44.269Z+ [[ 7 -gt 60 ]]
9432024-03-11T14:39:44.269Z+ sleep 1
9442024-03-11T14:39:44.269Z+ retry=8
9452024-03-11T14:39:44.269Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9462024-03-11T14:39:44.269Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9472024-03-11T14:39:44.269Z+ [[ 8 -gt 60 ]]
9482024-03-11T14:39:44.270Z+ sleep 1
9492024-03-11T14:39:45.046Z+ retry=9
9502024-03-11T14:39:45.046Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9512024-03-11T14:39:45.071Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9522024-03-11T14:39:45.071Z+ [[ 9 -gt 60 ]]
9532024-03-11T14:39:45.071Z+ sleep 1
9542024-03-11T14:39:46.060Z+ retry=10
9552024-03-11T14:39:46.060Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9562024-03-11T14:39:46.085Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9572024-03-11T14:39:46.085Z+ [[ 10 -gt 60 ]]
9582024-03-11T14:39:46.085Z+ sleep 1
9592024-03-11T14:39:47.075Z+ retry=11
9602024-03-11T14:39:47.075Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9612024-03-11T14:39:47.099Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9622024-03-11T14:39:47.099Z+ [[ 11 -gt 60 ]]
9632024-03-11T14:39:47.100Z+ sleep 1
9642024-03-11T14:39:48.090Z+ retry=12
9652024-03-11T14:39:48.090Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9662024-03-11T14:39:48.118Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9672024-03-11T14:39:48.118Z+ [[ 12 -gt 60 ]]
9682024-03-11T14:39:48.118Z+ sleep 1
9692024-03-11T14:39:49.105Z+ retry=13
9702024-03-11T14:39:49.105Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9712024-03-11T14:39:49.130Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9722024-03-11T14:39:49.130Z+ [[ 13 -gt 60 ]]
9732024-03-11T14:39:49.130Z+ sleep 1
9742024-03-11T14:39:50.119Z+ retry=14
9752024-03-11T14:39:50.119Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9762024-03-11T14:39:50.144Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9772024-03-11T14:39:50.144Z+ [[ 14 -gt 60 ]]
9782024-03-11T14:39:50.144Z+ sleep 1
9792024-03-11T14:39:51.135Z+ retry=15
9802024-03-11T14:39:51.135Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9812024-03-11T14:39:51.169Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9822024-03-11T14:39:51.169Z+ [[ 15 -gt 60 ]]
9832024-03-11T14:39:51.169Z+ sleep 1
9842024-03-11T14:39:52.151Z+ retry=16
9852024-03-11T14:39:52.151Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9862024-03-11T14:39:52.180Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9872024-03-11T14:39:52.180Z+ [[ 16 -gt 60 ]]
9882024-03-11T14:39:52.180Z+ sleep 1
9892024-03-11T14:39:53.167Z+ retry=17
9902024-03-11T14:39:53.168Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9912024-03-11T14:39:53.197Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9922024-03-11T14:39:53.197Z+ [[ 17 -gt 60 ]]
9932024-03-11T14:39:53.197Z+ sleep 1
9942024-03-11T14:39:54.182Z+ retry=18
9952024-03-11T14:39:54.183Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9962024-03-11T14:39:54.208Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9972024-03-11T14:39:54.208Z+ [[ 18 -gt 60 ]]
9982024-03-11T14:39:54.208Z+ sleep 1
9992024-03-11T14:39:55.197Z+ retry=19
10002024-03-11T14:39:55.198Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10012024-03-11T14:39:55.224Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10022024-03-11T14:39:55.224Z+ [[ 19 -gt 60 ]]
10032024-03-11T14:39:55.224Z+ sleep 1
10042024-03-11T14:39:56.340Z+ retry=20
10052024-03-11T14:39:56.341Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10062024-03-11T14:39:56.380Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10072024-03-11T14:39:56.380Z+ [[ 20 -gt 60 ]]
10082024-03-11T14:39:56.380Z+ sleep 1
10092024-03-11T14:39:57.227Z+ retry=21
10102024-03-11T14:39:57.227Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10112024-03-11T14:39:57.254Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10122024-03-11T14:39:57.254Z+ [[ 21 -gt 60 ]]
10132024-03-11T14:39:57.254Z+ sleep 1
10142024-03-11T14:39:58.244Z+ retry=22
10152024-03-11T14:39:58.244Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10162024-03-11T14:39:58.270Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10172024-03-11T14:39:58.270Z+ [[ 22 -gt 60 ]]
10182024-03-11T14:39:58.270Z+ sleep 1
10192024-03-11T14:39:59.263Z+ retry=23
10202024-03-11T14:39:59.264Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10212024-03-11T14:39:59.289Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10222024-03-11T14:39:59.289Z+ [[ 23 -gt 60 ]]
10232024-03-11T14:39:59.289Z+ sleep 1
10242024-03-11T14:40:00.274Z+ retry=24
10252024-03-11T14:40:00.274Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10262024-03-11T14:40:00.303Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10272024-03-11T14:40:00.303Z+ [[ 24 -gt 60 ]]
10282024-03-11T14:40:00.303Z+ sleep 1
10292024-03-11T14:40:01.290Z+ retry=25
10302024-03-11T14:40:01.290Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10312024-03-11T14:40:01.317Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10322024-03-11T14:40:01.317Z+ [[ 25 -gt 60 ]]
10332024-03-11T14:40:01.317Z+ sleep 1
10342024-03-11T14:40:02.305Z+ retry=26
10352024-03-11T14:40:02.305Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10362024-03-11T14:40:02.333Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10372024-03-11T14:40:02.333Z+ [[ 26 -gt 60 ]]
10382024-03-11T14:40:02.333Z+ sleep 1
10392024-03-11T14:40:03.327Z+ retry=27
10402024-03-11T14:40:03.327Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10412024-03-11T14:40:03.354Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10422024-03-11T14:40:03.354Z+ [[ 27 -gt 60 ]]
10432024-03-11T14:40:03.354Z+ sleep 1
10442024-03-11T14:40:04.336Z+ retry=28
10452024-03-11T14:40:04.337Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10462024-03-11T14:40:04.362Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10472024-03-11T14:40:04.362Z+ [[ 28 -gt 60 ]]
10482024-03-11T14:40:04.362Z+ sleep 1
10492024-03-11T14:40:05.351Z+ retry=29
10502024-03-11T14:40:05.351Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10512024-03-11T14:40:05.380Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10522024-03-11T14:40:05.381Z+ [[ 29 -gt 60 ]]
10532024-03-11T14:40:05.381Z+ sleep 1
10542024-03-11T14:40:06.367Z+ retry=30
10552024-03-11T14:40:06.367Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10562024-03-11T14:40:06.393Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10572024-03-11T14:40:06.393Z+ [[ 30 -gt 60 ]]
10582024-03-11T14:40:06.393Z+ sleep 1
10592024-03-11T14:40:07.382Z+ retry=31
10602024-03-11T14:40:07.382Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10612024-03-11T14:40:07.418Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10622024-03-11T14:40:07.418Z+ [[ 31 -gt 60 ]]
10632024-03-11T14:40:07.418Z+ sleep 1
10642024-03-11T14:40:08.397Z+ retry=32
10652024-03-11T14:40:08.397Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10662024-03-11T14:40:08.426Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10672024-03-11T14:40:08.426Z+ [[ 32 -gt 60 ]]
10682024-03-11T14:40:08.426Z+ sleep 1
10692024-03-11T14:40:09.413Z+ retry=33
10702024-03-11T14:40:09.413Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10712024-03-11T14:40:09.442Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10722024-03-11T14:40:09.442Z+ [[ 33 -gt 60 ]]
10732024-03-11T14:40:09.442Z+ sleep 1
10742024-03-11T14:40:10.429Z+ retry=34
10752024-03-11T14:40:10.429Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10762024-03-11T14:40:10.470Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10772024-03-11T14:40:10.470Z+ [[ 34 -gt 60 ]]
10782024-03-11T14:40:10.470Z+ sleep 1
10792024-03-11T14:40:11.444Z+ retry=35
10802024-03-11T14:40:11.444Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10812024-03-11T14:40:11.487Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10822024-03-11T14:40:11.487Z+ [[ 35 -gt 60 ]]
10832024-03-11T14:40:11.487Z+ sleep 1
10842024-03-11T14:40:12.460Z+ retry=36
10852024-03-11T14:40:12.460Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10862024-03-11T14:40:12.487Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10872024-03-11T14:40:12.487Z+ [[ 36 -gt 60 ]]
10882024-03-11T14:40:12.487Z+ sleep 1
10892024-03-11T14:40:13.474Z+ retry=37
10902024-03-11T14:40:13.474Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10912024-03-11T14:40:13.500Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10922024-03-11T14:40:13.500Z+ [[ 37 -gt 60 ]]
10932024-03-11T14:40:13.500Z+ sleep 1
10942024-03-11T14:40:14.488Z+ retry=38
10952024-03-11T14:40:14.488Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10962024-03-11T14:40:14.513Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10972024-03-11T14:40:14.513Z+ [[ 38 -gt 60 ]]
10982024-03-11T14:40:14.513Z+ sleep 1
10992024-03-11T14:40:15.503Z+ retry=39
11002024-03-11T14:40:15.504Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11012024-03-11T14:40:15.534Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11022024-03-11T14:40:15.535Z+ [[ 39 -gt 60 ]]
11032024-03-11T14:40:15.535Z+ sleep 1
11042024-03-11T14:40:23.059Z+ retry=40
11052024-03-11T14:40:23.059Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11062024-03-11T14:40:23.304Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11072024-03-11T14:40:23.304Z+ [[ 40 -gt 60 ]]
11082024-03-11T14:40:23.305Z+ sleep 1
11092024-03-11T14:40:23.305Z+ retry=41
11102024-03-11T14:40:23.305Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11112024-03-11T14:40:23.305Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11122024-03-11T14:40:23.305Z+ [[ 41 -gt 60 ]]
11132024-03-11T14:40:23.305Z+ sleep 1
11142024-03-11T14:40:23.305Z+ retry=42
11152024-03-11T14:40:23.305Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11162024-03-11T14:40:23.305Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11172024-03-11T14:40:23.305Z+ [[ 42 -gt 60 ]]
11182024-03-11T14:40:23.305Z+ sleep 1
11192024-03-11T14:40:23.531Z+ retry=43
11202024-03-11T14:40:23.531Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11212024-03-11T14:40:23.531Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11222024-03-11T14:40:23.531Z+ [[ 43 -gt 60 ]]
11232024-03-11T14:40:23.532Z+ sleep 1
11242024-03-11T14:40:23.532Z+ retry=44
11252024-03-11T14:40:23.532Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11262024-03-11T14:40:23.532Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
11272024-03-11T14:40:23.532Z{"status":"ok"}success
11282024-03-11T14:40:23.532ZProject {
11292024-03-11T14:40:23.532Z description: "some images",
11302024-03-11T14:40:23.533Z id: f5e1c055-c6f4-4d5a-86b0-bccc5d442cf3,
11312024-03-11T14:40:23.533Z name: Name(
11322024-03-11T14:40:23.533Z "images",
11332024-03-11T14:40:23.533Z ),
11342024-03-11T14:40:23.533Z time_created: 2024-03-11T14:40:20.791289Z,
11352024-03-11T14:40:23.533Z time_modified: 2024-03-11T14:40:20.791289Z,
11362024-03-11T14:40:23.533Z}
11372024-03-11T14:40:23.533Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
11382024-03-11T14:42:16.433ZError: No response to keepalive - Terminating session
11392024-03-11T14:42:26.590ZError: No response de-activating SOL payload
11402024-03-11T14:42:27.702Z[SOL Session operational. Use ~? for help]
11412024-03-11T14:45:16.411ZError: No response to keepalive - Terminating session
11422024-03-11T14:45:26.343ZError: No response de-activating SOL payload
11432024-03-11T14:45:27.861Z[SOL Session operational. Use ~? for help]
 
11442024-03-11T14:45:46.302Zdone!
11452024-03-11T14:45:46.405Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
11462024-03-11T14:45:46.526Zsuccess
11472024-03-11T14:45:46.526ZImage {
11482024-03-11T14:45:46.526Z block_size: ByteCount(
11492024-03-11T14:45:46.526Z 512,
11502024-03-11T14:45:46.526Z ),
11512024-03-11T14:45:46.564Z description: "debian 11 original base image",
11522024-03-11T14:45:46.564Z digest: None,
11532024-03-11T14:45:46.564Z id: 9c690902-51aa-4bd0-a8c5-274433f80e29,
11542024-03-11T14:45:46.564Z name: Name(
11552024-03-11T14:45:46.565Z "debian11",
11562024-03-11T14:45:46.565Z ),
11572024-03-11T14:45:46.565Z os: "debian",
11582024-03-11T14:45:46.565Z project_id: None,
11592024-03-11T14:45:46.565Z size: ByteCount(
11602024-03-11T14:45:46.565Z 2147483648,
11612024-03-11T14:45:46.565Z ),
11622024-03-11T14:45:46.565Z time_created: 2024-03-11T14:45:46.262504Z,
11632024-03-11T14:45:46.565Z time_modified: 2024-03-11T14:45:46.501423Z,
11642024-03-11T14:45:46.565Z url: None,
11652024-03-11T14:45:46.565Z version: "11",
11662024-03-11T14:45:46.565Z}
11672024-03-11T14:45:46.565Z+ rm ./tests/bootstrap
11682024-03-11T14:45:46.594Z+ for test_bin in tests/*
11692024-03-11T14:45:46.594Z+ ./tests/bootstrap-65a4db6b155ae45e
11702024-03-11T14:45:46.652Z
11712024-03-11T14:45:46.652Zrunning 0 tests
11722024-03-11T14:45:46.652Z
11732024-03-11T14:45:46.683Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11742024-03-11T14:45:46.683Z
11752024-03-11T14:45:46.683Z+ for test_bin in tests/*
11762024-03-11T14:45:46.683Z+ ./tests/commtest-1a288711b562a1b6
11772024-03-11T14:45:46.712Z
11782024-03-11T14:45:46.712Zrunning 0 tests
11792024-03-11T14:45:46.712Z
11802024-03-11T14:45:46.712Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11812024-03-11T14:45:46.712Z
11822024-03-11T14:45:46.712Z+ for test_bin in tests/*
11832024-03-11T14:45:46.713Z+ ./tests/dhcp_server-09883187f12d8d1b
11842024-03-11T14:45:46.758Z
11852024-03-11T14:45:46.758Zrunning 0 tests
11862024-03-11T14:45:46.797Z
11872024-03-11T14:45:46.797Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11882024-03-11T14:45:46.798Z
11892024-03-11T14:45:46.798Z+ for test_bin in tests/*
11902024-03-11T14:45:46.798Z+ ./tests/end_to_end_tests-7b7b0e2adcdf9cf5
11912024-03-11T14:45:47.046Z
11922024-03-11T14:45:47.046Zrunning 2 tests
11932024-03-11T14:45:47.317Ztest no_spoof::no_spoof_here ... ok
11942024-03-11T14:46:21.747Ztest instance_launch::instance_launch ... ok
11952024-03-11T14:46:21.748Z
11962024-03-11T14:46:21.748Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 34.69s
11972024-03-11T14:46:21.748Z
11982024-03-11T14:46:21.786Z+ _exit_trap
11992024-03-11T14:46:21.787Z+ local status=0
12002024-03-11T14:46:21.787Z+ [[ 0 -eq 0 ]]
12012024-03-11T14:46:21.787Z+ exit 0
12022024-03-11T14:46:21.823Zprocess exited: duration 689482 ms, exit code 0
 
12032024-03-11T14:46:21.933Zfound 185 output files
12042024-03-11T14:46:22.004Zuploading: /var/svc/log/oxide-sled-agent:default.log (975176 bytes)
12052024-03-11T14:46:24.396Zuploaded: /var/svc/log/oxide-sled-agent:default.log
12062024-03-11T14:46:24.396Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (370841 bytes)
12072024-03-11T14:46:25.552Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 370841 -> 389415
12082024-03-11T14:46:26.648Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
12092024-03-11T14:46:26.648Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (2453305 bytes)
12102024-03-11T14:46:30.220Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
12112024-03-11T14:46:30.220Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
12122024-03-11T14:46:31.296Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
12132024-03-11T14:46:31.296Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (6056 bytes)
12142024-03-11T14:46:32.420Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
12152024-03-11T14:46:32.420Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (3135 bytes)
12162024-03-11T14:46:33.561Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
12172024-03-11T14:46:33.598Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (21667 bytes)
12182024-03-11T14:46:34.791Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
12192024-03-11T14:46:34.791Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (171043 bytes)
12202024-03-11T14:46:35.823Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 171043 -> 202200
12212024-03-11T14:46:36.915Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
12222024-03-11T14:46:36.915Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1364844 bytes)
12232024-03-11T14:46:39.213Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
12242024-03-11T14:46:39.214Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (108690 bytes)
12252024-03-11T14:46:40.058Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 108690 -> 133606
12262024-03-11T14:46:41.142Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
12272024-03-11T14:46:41.142Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (802695 bytes)
12282024-03-11T14:46:50.074Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
12292024-03-11T14:46:50.115Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
12302024-03-11T14:46:51.639Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
12312024-03-11T14:46:51.639Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
12322024-03-11T14:46:53.160Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
12332024-03-11T14:46:53.160Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (39358 bytes)
12342024-03-11T14:46:53.405Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 39358 -> 55512
12352024-03-11T14:46:54.491Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
12362024-03-11T14:46:54.491Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (254746 bytes)
12372024-03-11T14:46:56.098Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
12382024-03-11T14:46:56.098Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
12392024-03-11T14:46:57.194Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
12402024-03-11T14:46:57.194Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
12412024-03-11T14:46:58.314Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
12422024-03-11T14:46:58.314Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
12432024-03-11T14:46:59.393Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
12442024-03-11T14:46:59.393Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5757 bytes)
12452024-03-11T14:47:01.343Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
12462024-03-11T14:47:01.343Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-clickhouse:default.log (172344 bytes)
12472024-03-11T14:47:01.977Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 172344 -> 292273
12482024-03-11T14:47:03.053Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-clickhouse:default.log
12492024-03-11T14:47:03.053Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-clickhouse:default.log.0 (929623 bytes)
12502024-03-11T14:47:06.116Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-clickhouse:default.log.0
12512024-03-11T14:47:06.116Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12522024-03-11T14:47:07.612Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-zone-network-setup:default.log
12532024-03-11T14:47:07.612Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1714 bytes)
12542024-03-11T14:47:08.708Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_730dcf20-c246-45f4-9071-d97941e7ebf8/root/var/svc/log/oxide-zone-network-setup:default.log.0
12552024-03-11T14:47:08.708Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_fcffa37a-3da6-4a5d-9826-d1cba11ad226/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12562024-03-11T14:47:09.784Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_fcffa37a-3da6-4a5d-9826-d1cba11ad226/root/var/svc/log/oxide-cockroachdb:default.log
12572024-03-11T14:47:09.784Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_fcffa37a-3da6-4a5d-9826-d1cba11ad226/root/var/svc/log/oxide-cockroachdb:default.log.0 (4405 bytes)
12582024-03-11T14:47:10.895Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_fcffa37a-3da6-4a5d-9826-d1cba11ad226/root/var/svc/log/oxide-cockroachdb:default.log.0
12592024-03-11T14:47:10.895Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_fcffa37a-3da6-4a5d-9826-d1cba11ad226/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12602024-03-11T14:47:11.967Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_fcffa37a-3da6-4a5d-9826-d1cba11ad226/root/var/svc/log/oxide-zone-network-setup:default.log
12612024-03-11T14:47:11.967Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_fcffa37a-3da6-4a5d-9826-d1cba11ad226/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12622024-03-11T14:47:13.062Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_fcffa37a-3da6-4a5d-9826-d1cba11ad226/root/var/svc/log/oxide-zone-network-setup:default.log.0
12632024-03-11T14:47:13.063Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12642024-03-11T14:47:14.159Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-crucible-agent:default.log
12652024-03-11T14:47:14.159Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-crucible-agent:default.log.0 (1324 bytes)
12662024-03-11T14:47:15.270Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-crucible-agent:default.log.0
12672024-03-11T14:47:15.271Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12682024-03-11T14:47:16.364Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-crucible-downstairs:default.log
12692024-03-11T14:47:16.365Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12702024-03-11T14:47:17.503Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12712024-03-11T14:47:17.529Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12722024-03-11T14:47:18.984Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-zone-network-setup:default.log
12732024-03-11T14:47:18.984Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
12742024-03-11T14:47:20.540Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e1227638-2232-47b0-87b8-e0c7ec193a95/root/var/svc/log/oxide-zone-network-setup:default.log.0
12752024-03-11T14:47:20.540Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-external_dns:default.log (7552 bytes)
12762024-03-11T14:47:21.094Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 7552 -> 11331
12772024-03-11T14:47:22.186Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-external_dns:default.log
12782024-03-11T14:47:22.186Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-external_dns:default.log.0 (24343 bytes)
12792024-03-11T14:47:23.403Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-external_dns:default.log.0
12802024-03-11T14:47:23.403Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
12812024-03-11T14:47:24.482Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-opte-interface-setup:default.log
12822024-03-11T14:47:24.483Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1188 bytes)
12832024-03-11T14:47:25.596Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-opte-interface-setup:default.log.0
12842024-03-11T14:47:25.596Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12852024-03-11T14:47:27.086Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-zone-network-setup:default.log
12862024-03-11T14:47:27.086Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1726 bytes)
12872024-03-11T14:47:28.621Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_f70c5a89-ea56-4d97-89e6-dee45f2020c8/root/var/svc/log/oxide-zone-network-setup:default.log.0
12882024-03-11T14:47:28.622Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-internal_dns:default.log (7506 bytes)
12892024-03-11T14:47:28.694Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7506 -> 11262
12902024-03-11T14:47:29.772Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-internal_dns:default.log
12912024-03-11T14:47:29.772Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-internal_dns:default.log.0 (107075 bytes)
12922024-03-11T14:47:31.189Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-internal_dns:default.log.0
12932024-03-11T14:47:31.215Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12942024-03-11T14:47:32.670Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-zone-network-setup:default.log
12952024-03-11T14:47:32.670Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
12962024-03-11T14:47:34.280Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1aa120af-a5c4-4cfb-bc3c-a316c08e32c6/root/var/svc/log/oxide-zone-network-setup:default.log.0
12972024-03-11T14:47:34.280Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-ntp:default.log (0 bytes)
12982024-03-11T14:47:35.365Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-ntp:default.log
12992024-03-11T14:47:35.365Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-ntp:default.log.0 (775 bytes)
13002024-03-11T14:47:37.252Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-ntp:default.log.0
13012024-03-11T14:47:37.253Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
13022024-03-11T14:47:38.327Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-opte-interface-setup:default.log
13032024-03-11T14:47:38.327Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1158 bytes)
13042024-03-11T14:47:39.425Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-opte-interface-setup:default.log.0
13052024-03-11T14:47:39.425Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13062024-03-11T14:47:40.907Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-zone-network-setup:default.log
13072024-03-11T14:47:40.908Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1665 bytes)
13082024-03-11T14:47:42.030Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/svc/log/oxide-zone-network-setup:default.log.0
13092024-03-11T14:47:42.031Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e42497b8-7d89-4028-be6f-3856c6c1801c/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13102024-03-11T14:47:43.509Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e42497b8-7d89-4028-be6f-3856c6c1801c/root/var/svc/log/oxide-cockroachdb:default.log
13112024-03-11T14:47:43.509Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e42497b8-7d89-4028-be6f-3856c6c1801c/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
13122024-03-11T14:47:44.610Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e42497b8-7d89-4028-be6f-3856c6c1801c/root/var/svc/log/oxide-cockroachdb:default.log.0
13132024-03-11T14:47:44.610Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e42497b8-7d89-4028-be6f-3856c6c1801c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13142024-03-11T14:47:46.101Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e42497b8-7d89-4028-be6f-3856c6c1801c/root/var/svc/log/oxide-zone-network-setup:default.log
13152024-03-11T14:47:46.101Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e42497b8-7d89-4028-be6f-3856c6c1801c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
13162024-03-11T14:47:47.618Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e42497b8-7d89-4028-be6f-3856c6c1801c/root/var/svc/log/oxide-zone-network-setup:default.log.0
13172024-03-11T14:47:47.618Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
13182024-03-11T14:47:49.096Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-crucible-agent:default.log
13192024-03-11T14:47:49.096Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
13202024-03-11T14:47:50.212Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-crucible-agent:default.log.0
13212024-03-11T14:47:50.212Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13222024-03-11T14:47:51.333Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-crucible-downstairs:default.log
13232024-03-11T14:47:51.333Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13242024-03-11T14:47:52.456Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13252024-03-11T14:47:52.486Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13262024-03-11T14:47:53.532Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-zone-network-setup:default.log
13272024-03-11T14:47:53.556Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
13282024-03-11T14:47:54.629Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7d727367-8417-4fba-9342-339fe0ed7580/root/var/svc/log/oxide-zone-network-setup:default.log.0
13292024-03-11T14:47:54.629Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-external_dns:default.log (7550 bytes)
13302024-03-11T14:47:54.753Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 7550 -> 11328
13312024-03-11T14:47:55.864Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-external_dns:default.log
13322024-03-11T14:47:55.864Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-external_dns:default.log.0 (24343 bytes)
13332024-03-11T14:47:57.502Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-external_dns:default.log.0
13342024-03-11T14:47:57.503Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
13352024-03-11T14:47:58.577Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-opte-interface-setup:default.log
13362024-03-11T14:47:58.601Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1187 bytes)
13372024-03-11T14:47:59.671Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-opte-interface-setup:default.log.0
13382024-03-11T14:47:59.671Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13392024-03-11T14:48:00.747Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-zone-network-setup:default.log
13402024-03-11T14:48:00.747Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1726 bytes)
13412024-03-11T14:48:01.842Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b8a64cff-23ea-48a8-b15e-745f0bd639d7/root/var/svc/log/oxide-zone-network-setup:default.log.0
13422024-03-11T14:48:01.842Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-internal_dns:default.log (7506 bytes)
13432024-03-11T14:48:01.928Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7506 -> 11261
13442024-03-11T14:48:03.012Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-internal_dns:default.log
13452024-03-11T14:48:03.012Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-internal_dns:default.log.0 (107071 bytes)
13462024-03-11T14:48:04.449Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-internal_dns:default.log.0
13472024-03-11T14:48:04.450Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13482024-03-11T14:48:05.538Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-zone-network-setup:default.log
13492024-03-11T14:48:05.563Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
13502024-03-11T14:48:06.635Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0b35c3d8-4727-43d4-a8c9-c749b2a9f786/root/var/svc/log/oxide-zone-network-setup:default.log.0
13512024-03-11T14:48:06.636Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-nexus:default.log (370976 bytes)
13522024-03-11T14:48:07.687Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 370976 -> 868388
13532024-03-11T14:48:08.799Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-nexus:default.log
13542024-03-11T14:48:08.799Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-nexus:default.log.0 (4492260 bytes)
13552024-03-11T14:48:13.307Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-nexus:default.log.0
13562024-03-11T14:48:13.307Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
13572024-03-11T14:48:14.392Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-opte-interface-setup:default.log
13582024-03-11T14:48:14.392Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1167 bytes)
13592024-03-11T14:48:15.513Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-opte-interface-setup:default.log.0
13602024-03-11T14:48:15.513Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13612024-03-11T14:48:17.026Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-zone-network-setup:default.log
13622024-03-11T14:48:17.027Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1684 bytes)
13632024-03-11T14:48:18.146Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_09e91af5-e10d-488a-884c-d3f10b77a4c3/root/var/svc/log/oxide-zone-network-setup:default.log.0
13642024-03-11T14:48:18.146Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_66cfbae0-4170-40a7-b55b-6218a9b6415d/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13652024-03-11T14:48:19.226Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_66cfbae0-4170-40a7-b55b-6218a9b6415d/root/var/svc/log/oxide-cockroachdb:default.log
13662024-03-11T14:48:19.226Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_66cfbae0-4170-40a7-b55b-6218a9b6415d/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
13672024-03-11T14:48:20.331Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_66cfbae0-4170-40a7-b55b-6218a9b6415d/root/var/svc/log/oxide-cockroachdb:default.log.0
13682024-03-11T14:48:20.331Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_66cfbae0-4170-40a7-b55b-6218a9b6415d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13692024-03-11T14:48:21.413Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_66cfbae0-4170-40a7-b55b-6218a9b6415d/root/var/svc/log/oxide-zone-network-setup:default.log
13702024-03-11T14:48:21.413Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_66cfbae0-4170-40a7-b55b-6218a9b6415d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
13712024-03-11T14:48:22.509Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_66cfbae0-4170-40a7-b55b-6218a9b6415d/root/var/svc/log/oxide-zone-network-setup:default.log.0
13722024-03-11T14:48:22.509Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-agent:default.log (25807 bytes)
13732024-03-11T14:48:23.656Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-agent:default.log
13742024-03-11T14:48:23.686Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-agent:default.log.0 (7682 bytes)
13752024-03-11T14:48:25.196Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-agent:default.log.0
13762024-03-11T14:48:25.197Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13772024-03-11T14:48:25.917Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:default.log
13782024-03-11T14:48:25.917Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13792024-03-11T14:48:27.444Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13802024-03-11T14:48:27.445Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:downstairs-a3b06cbc-3e1b-43ff-b0c7-54c181ccd238.log (1092 bytes)
13812024-03-11T14:48:28.551Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:downstairs-a3b06cbc-3e1b-43ff-b0c7-54c181ccd238.log
13822024-03-11T14:48:28.551Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:downstairs-a3b06cbc-3e1b-43ff-b0c7-54c181ccd238.log.0 (4606 bytes)
13832024-03-11T14:48:29.664Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:downstairs-a3b06cbc-3e1b-43ff-b0c7-54c181ccd238.log.0
13842024-03-11T14:48:29.664Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:downstairs-fab3110e-650c-4cde-b991-7dddc1aba9f7.log (5591 bytes)
13852024-03-11T14:48:30.767Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:downstairs-fab3110e-650c-4cde-b991-7dddc1aba9f7.log
13862024-03-11T14:48:30.768Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:snapshot-a3b06cbc-3e1b-43ff-b0c7-54c181ccd238-a54a324d-800f-4645-83ae-56c8f6240caa.log (5282 bytes)
13872024-03-11T14:48:31.876Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-crucible-downstairs:snapshot-a3b06cbc-3e1b-43ff-b0c7-54c181ccd238-a54a324d-800f-4645-83ae-56c8f6240caa.log
13882024-03-11T14:48:31.877Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13892024-03-11T14:48:32.470ZError: No response to keepalive - Terminating session
13902024-03-11T14:48:32.967Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-zone-network-setup:default.log
13912024-03-11T14:48:32.967Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
13922024-03-11T14:48:34.082Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7f59a2ba-2355-4f75-ac77-a093dfa69e55/root/var/svc/log/oxide-zone-network-setup:default.log.0
13932024-03-11T14:48:34.082Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-internal_dns:default.log (7503 bytes)
13942024-03-11T14:48:34.167Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 7503 -> 15011
13952024-03-11T14:48:35.242Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-internal_dns:default.log
13962024-03-11T14:48:35.243Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-internal_dns:default.log.0 (107078 bytes)
13972024-03-11T14:48:36.518Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-internal_dns:default.log.0
13982024-03-11T14:48:36.518Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13992024-03-11T14:48:37.589Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-zone-network-setup:default.log
14002024-03-11T14:48:37.589Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
14012024-03-11T14:48:38.700Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_b48fe372-dcb1-4026-9ecf-cbe7757510e3/root/var/svc/log/oxide-zone-network-setup:default.log.0
14022024-03-11T14:48:38.726Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_a6846380-c12e-4c9b-be5f-e92e716074c6/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
14032024-03-11T14:48:39.789Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_a6846380-c12e-4c9b-be5f-e92e716074c6/root/var/svc/log/oxide-cockroachdb:default.log
14042024-03-11T14:48:39.789Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_a6846380-c12e-4c9b-be5f-e92e716074c6/root/var/svc/log/oxide-cockroachdb:default.log.0 (4405 bytes)
14052024-03-11T14:48:40.898Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_a6846380-c12e-4c9b-be5f-e92e716074c6/root/var/svc/log/oxide-cockroachdb:default.log.0
14062024-03-11T14:48:40.898Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_a6846380-c12e-4c9b-be5f-e92e716074c6/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14072024-03-11T14:48:42.003Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_a6846380-c12e-4c9b-be5f-e92e716074c6/root/var/svc/log/oxide-zone-network-setup:default.log
14082024-03-11T14:48:42.004Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_a6846380-c12e-4c9b-be5f-e92e716074c6/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
14092024-03-11T14:48:42.639ZError: No response de-activating SOL payload
14102024-03-11T14:48:43.144Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_a6846380-c12e-4c9b-be5f-e92e716074c6/root/var/svc/log/oxide-zone-network-setup:default.log.0
14112024-03-11T14:48:43.144Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-agent:default.log (22279 bytes)
14122024-03-11T14:48:43.737Z[SOL Session operational. Use ~? for help]
14132024-03-11T14:48:44.313Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-agent:default.log
14142024-03-11T14:48:44.313Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-agent:default.log.0 (1326 bytes)
14152024-03-11T14:48:45.441Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-agent:default.log.0
14162024-03-11T14:48:45.441Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14172024-03-11T14:48:46.522Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-downstairs:default.log
14182024-03-11T14:48:46.522Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14192024-03-11T14:48:47.626Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14202024-03-11T14:48:47.626Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-downstairs:downstairs-42de9aaa-82ce-4818-9e2a-f2be5e023bc9.log (5587 bytes)
14212024-03-11T14:48:48.737Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-downstairs:downstairs-42de9aaa-82ce-4818-9e2a-f2be5e023bc9.log
14222024-03-11T14:48:48.738Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-downstairs:downstairs-a0aa2b4f-d467-4c7d-8580-235e591932c5.log (3006 bytes)
14232024-03-11T14:48:49.860Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-crucible-downstairs:downstairs-a0aa2b4f-d467-4c7d-8580-235e591932c5.log
14242024-03-11T14:48:49.860Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14252024-03-11T14:48:51.350Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-zone-network-setup:default.log
14262024-03-11T14:48:51.350Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1702 bytes)
14272024-03-11T14:48:52.917Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a66d9ae5-6ebd-4ca1-a33d-b1b6023e5be2/root/var/svc/log/oxide-zone-network-setup:default.log.0
14282024-03-11T14:48:52.917Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_99faaa45-08ec-4fa6-bf6d-4539a211ae16/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
14292024-03-11T14:48:53.995Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_99faaa45-08ec-4fa6-bf6d-4539a211ae16/root/var/svc/log/oxide-crucible-pantry:default.log
14302024-03-11T14:48:53.996Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_99faaa45-08ec-4fa6-bf6d-4539a211ae16/root/var/svc/log/oxide-crucible-pantry:default.log.0 (783 bytes)
14312024-03-11T14:48:55.098Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_99faaa45-08ec-4fa6-bf6d-4539a211ae16/root/var/svc/log/oxide-crucible-pantry:default.log.0
14322024-03-11T14:48:55.099Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_99faaa45-08ec-4fa6-bf6d-4539a211ae16/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14332024-03-11T14:48:56.181Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_99faaa45-08ec-4fa6-bf6d-4539a211ae16/root/var/svc/log/oxide-zone-network-setup:default.log
14342024-03-11T14:48:56.182Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_99faaa45-08ec-4fa6-bf6d-4539a211ae16/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1746 bytes)
14352024-03-11T14:48:57.278Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_99faaa45-08ec-4fa6-bf6d-4539a211ae16/root/var/svc/log/oxide-zone-network-setup:default.log.0
14362024-03-11T14:48:57.278Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_376c07b9-b3e4-4175-b900-6b0d1fa2f5ee/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
14372024-03-11T14:48:58.384Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_376c07b9-b3e4-4175-b900-6b0d1fa2f5ee/root/var/svc/log/oxide-cockroachdb:default.log
14382024-03-11T14:48:58.384Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_376c07b9-b3e4-4175-b900-6b0d1fa2f5ee/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
14392024-03-11T14:48:59.499Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_376c07b9-b3e4-4175-b900-6b0d1fa2f5ee/root/var/svc/log/oxide-cockroachdb:default.log.0
14402024-03-11T14:48:59.499Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_376c07b9-b3e4-4175-b900-6b0d1fa2f5ee/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14412024-03-11T14:49:00.577Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_376c07b9-b3e4-4175-b900-6b0d1fa2f5ee/root/var/svc/log/oxide-zone-network-setup:default.log
14422024-03-11T14:49:00.577Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_376c07b9-b3e4-4175-b900-6b0d1fa2f5ee/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
14432024-03-11T14:49:01.690Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_376c07b9-b3e4-4175-b900-6b0d1fa2f5ee/root/var/svc/log/oxide-zone-network-setup:default.log.0
14442024-03-11T14:49:01.719Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-agent:default.log (7759 bytes)
14452024-03-11T14:49:02.829Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-agent:default.log
14462024-03-11T14:49:02.829Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-agent:default.log.0 (17503 bytes)
14472024-03-11T14:49:03.986Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-agent:default.log.0
14482024-03-11T14:49:03.987Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14492024-03-11T14:49:05.063Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:default.log
14502024-03-11T14:49:05.063Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14512024-03-11T14:49:06.174Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14522024-03-11T14:49:06.174Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-2760e400-74e8-4695-aca3-42275b3e2d0b.log (0 bytes)
14532024-03-11T14:49:07.261Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-2760e400-74e8-4695-aca3-42275b3e2d0b.log
14542024-03-11T14:49:07.262Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-2760e400-74e8-4695-aca3-42275b3e2d0b.log.0 (3123 bytes)
14552024-03-11T14:49:08.788Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-2760e400-74e8-4695-aca3-42275b3e2d0b.log.0
14562024-03-11T14:49:08.788Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-4a8916be-3b8b-428a-998a-25b43c780aca.log (1092 bytes)
14572024-03-11T14:49:09.909Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-4a8916be-3b8b-428a-998a-25b43c780aca.log
14582024-03-11T14:49:09.938Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-4a8916be-3b8b-428a-998a-25b43c780aca.log.0 (4605 bytes)
14592024-03-11T14:49:11.020Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-4a8916be-3b8b-428a-998a-25b43c780aca.log.0
14602024-03-11T14:49:11.020Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:snapshot-4a8916be-3b8b-428a-998a-25b43c780aca-a54a324d-800f-4645-83ae-56c8f6240caa.log (5280 bytes)
14612024-03-11T14:49:12.131Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-crucible-downstairs:snapshot-4a8916be-3b8b-428a-998a-25b43c780aca-a54a324d-800f-4645-83ae-56c8f6240caa.log
14622024-03-11T14:49:12.131Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14632024-03-11T14:49:13.231Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-zone-network-setup:default.log
14642024-03-11T14:49:13.231Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1703 bytes)
14652024-03-11T14:49:15.210Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_0e22fbd1-68e9-4aa4-bfe1-cf63a38334c7/root/var/svc/log/oxide-zone-network-setup:default.log.0
14662024-03-11T14:49:15.210Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_2fd24eb9-66b6-4cbf-8078-74f12469935a/root/var/svc/log/oxide-crucible-pantry:default.log (138629 bytes)
14672024-03-11T14:49:15.603Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_2fd24eb9-66b6-4cbf-8078-74f12469935a/root/var/svc/log/oxide-crucible-pantry:default.log
14682024-03-11T14:49:15.603Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_2fd24eb9-66b6-4cbf-8078-74f12469935a/root/var/svc/log/oxide-crucible-pantry:default.log.0 (1085354 bytes)
14692024-03-11T14:49:19.512Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_2fd24eb9-66b6-4cbf-8078-74f12469935a/root/var/svc/log/oxide-crucible-pantry:default.log.0
14702024-03-11T14:49:19.512Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_2fd24eb9-66b6-4cbf-8078-74f12469935a/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14712024-03-11T14:49:20.595Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_2fd24eb9-66b6-4cbf-8078-74f12469935a/root/var/svc/log/oxide-zone-network-setup:default.log
14722024-03-11T14:49:20.596Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_2fd24eb9-66b6-4cbf-8078-74f12469935a/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1746 bytes)
14732024-03-11T14:49:21.693Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_2fd24eb9-66b6-4cbf-8078-74f12469935a/root/var/svc/log/oxide-zone-network-setup:default.log.0
14742024-03-11T14:49:21.693Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-nexus:default.log (199103 bytes)
14752024-03-11T14:49:22.450Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 199103 -> 585797
14762024-03-11T14:49:23.521Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-nexus:default.log
14772024-03-11T14:49:23.521Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-nexus:default.log.0 (1076381 bytes)
14782024-03-11T14:49:25.812Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-nexus:default.log.0
14792024-03-11T14:49:25.812Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
14802024-03-11T14:49:26.887Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-opte-interface-setup:default.log
14812024-03-11T14:49:26.887Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1166 bytes)
14822024-03-11T14:49:28.389Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-opte-interface-setup:default.log.0
14832024-03-11T14:49:28.389Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14842024-03-11T14:49:29.073Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-zone-network-setup:default.log
14852024-03-11T14:49:29.073Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1682 bytes)
14862024-03-11T14:49:30.171Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_fde7f673-91d1-48e3-bedc-bc31fa6f616e/root/var/svc/log/oxide-zone-network-setup:default.log.0
14872024-03-11T14:49:30.171Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-agent:default.log (6357 bytes)
14882024-03-11T14:49:31.267Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-agent:default.log
14892024-03-11T14:49:31.268Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-agent:default.log.0 (12000 bytes)
14902024-03-11T14:49:32.392Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-agent:default.log.0
14912024-03-11T14:49:32.392Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14922024-03-11T14:49:34.189Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:default.log
14932024-03-11T14:49:34.189Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14942024-03-11T14:49:34.974Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14952024-03-11T14:49:35.008Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:downstairs-5fda4efc-6820-434b-a2f1-85e762e6dbc4.log (3006 bytes)
14962024-03-11T14:49:36.089Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:downstairs-5fda4efc-6820-434b-a2f1-85e762e6dbc4.log
14972024-03-11T14:49:36.089Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:downstairs-b7f0c799-4162-4b45-9cfc-e0b2a2c32285.log (0 bytes)
14982024-03-11T14:49:37.584Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:downstairs-b7f0c799-4162-4b45-9cfc-e0b2a2c32285.log
14992024-03-11T14:49:37.584Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:downstairs-b7f0c799-4162-4b45-9cfc-e0b2a2c32285.log.0 (3126 bytes)
15002024-03-11T14:49:38.285Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-crucible-downstairs:downstairs-b7f0c799-4162-4b45-9cfc-e0b2a2c32285.log.0
15012024-03-11T14:49:38.285Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15022024-03-11T14:49:39.357Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-zone-network-setup:default.log
15032024-03-11T14:49:39.357Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1703 bytes)
15042024-03-11T14:49:40.458Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f1140f2f-7852-4ec1-9353-17dc66d92eef/root/var/svc/log/oxide-zone-network-setup:default.log.0
15052024-03-11T14:49:40.458Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
15062024-03-11T14:49:41.542Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-crucible-agent:default.log
15072024-03-11T14:49:41.542Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
15082024-03-11T14:49:42.644Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-crucible-agent:default.log.0
15092024-03-11T14:49:42.644Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
15102024-03-11T14:49:43.723Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-crucible-downstairs:default.log
15112024-03-11T14:49:43.780Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
15122024-03-11T14:49:44.827Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-crucible-downstairs:default.log.0
15132024-03-11T14:49:44.827Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15142024-03-11T14:49:45.900Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-zone-network-setup:default.log
15152024-03-11T14:49:45.900Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
15162024-03-11T14:49:46.995Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_bb6f2894-60eb-4edd-91d5-4040cd839b52/root/var/svc/log/oxide-zone-network-setup:default.log.0
15172024-03-11T14:49:46.996Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-nexus:default.log (5525298 bytes)
15182024-03-11T14:49:48.989Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5525298 -> 6298884
15192024-03-11T14:49:50.061Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-nexus:default.log
15202024-03-11T14:49:50.061Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-nexus:default.log.0 (29959515 bytes)
15212024-03-11T14:50:08.862Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-nexus:default.log.0
15222024-03-11T14:50:08.862Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
15232024-03-11T14:50:15.735Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-opte-interface-setup:default.log
15242024-03-11T14:50:15.735Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1167 bytes)
15252024-03-11T14:50:16.835Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-opte-interface-setup:default.log.0
15262024-03-11T14:50:16.836Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15272024-03-11T14:50:17.918Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-zone-network-setup:default.log
15282024-03-11T14:50:17.957Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1683 bytes)
15292024-03-11T14:50:19.040Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_6816d388-9154-4d3a-81eb-3ecf63b82b16/root/var/svc/log/oxide-zone-network-setup:default.log.0
15302024-03-11T14:50:19.040Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-oximeter:default.log (50890 bytes)
15312024-03-11T14:50:19.547Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 50890 -> 194262
15322024-03-11T14:50:20.620Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-oximeter:default.log
15332024-03-11T14:50:20.621Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-oximeter:default.log.0 (221412 bytes)
15342024-03-11T14:50:22.242Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-oximeter:default.log.0
15352024-03-11T14:50:22.242Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15362024-03-11T14:50:23.320Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-zone-network-setup:default.log
15372024-03-11T14:50:23.320Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1701 bytes)
15382024-03-11T14:50:24.438Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_oximeter_e019c51e-579b-419f-bff6-2fbc7b40e938/root/var/svc/log/oxide-zone-network-setup:default.log.0
15392024-03-11T14:50:24.438Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-agent:default.log (34337 bytes)
15402024-03-11T14:50:25.647Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-agent:default.log
15412024-03-11T14:50:25.647Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-agent:default.log.0 (7687 bytes)
15422024-03-11T14:50:26.782Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-agent:default.log.0
15432024-03-11T14:50:26.783Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
15442024-03-11T14:50:27.854Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:default.log
15452024-03-11T14:50:27.855Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
15462024-03-11T14:50:29.008Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:default.log.0
15472024-03-11T14:50:29.008Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-4b37e53e-38fd-4b1b-afd7-2790f2a70b8d.log (5589 bytes)
15482024-03-11T14:50:30.164Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-4b37e53e-38fd-4b1b-afd7-2790f2a70b8d.log
15492024-03-11T14:50:30.165Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-79bda774-159f-4095-a620-1c1da81a9191.log (1092 bytes)
15502024-03-11T14:50:31.280Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-79bda774-159f-4095-a620-1c1da81a9191.log
15512024-03-11T14:50:31.280Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-79bda774-159f-4095-a620-1c1da81a9191.log.0 (4604 bytes)
15522024-03-11T14:50:32.377Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-79bda774-159f-4095-a620-1c1da81a9191.log.0
15532024-03-11T14:50:32.378Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-ceb33e57-9744-47c0-bab4-aaf68a2701a4.log (3008 bytes)
15542024-03-11T14:50:33.501Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-ceb33e57-9744-47c0-bab4-aaf68a2701a4.log
15552024-03-11T14:50:33.502Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:snapshot-79bda774-159f-4095-a620-1c1da81a9191-a54a324d-800f-4645-83ae-56c8f6240caa.log (5284 bytes)
15562024-03-11T14:50:34.639Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-crucible-downstairs:snapshot-79bda774-159f-4095-a620-1c1da81a9191-a54a324d-800f-4645-83ae-56c8f6240caa.log
15572024-03-11T14:50:34.639Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15582024-03-11T14:50:35.724Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-zone-network-setup:default.log
15592024-03-11T14:50:35.725Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
15602024-03-11T14:50:36.839Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_73923276-b5fa-40d4-a195-829b033ad9fb/root/var/svc/log/oxide-zone-network-setup:default.log.0
15612024-03-11T14:50:36.863Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
15622024-03-11T14:50:37.912Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-agent:default.log
15632024-03-11T14:50:37.912Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-agent:default.log.0 (11577 bytes)
15642024-03-11T14:50:39.034Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-agent:default.log.0
15652024-03-11T14:50:39.034Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
15662024-03-11T14:50:40.105Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-downstairs:default.log
15672024-03-11T14:50:40.105Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
15682024-03-11T14:50:41.201Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-downstairs:default.log.0
15692024-03-11T14:50:41.201Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cc50f2f-3df2-450e-b2ab-43c5b96a56c1.log (0 bytes)
15702024-03-11T14:50:42.273Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cc50f2f-3df2-450e-b2ab-43c5b96a56c1.log
15712024-03-11T14:50:42.273Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cc50f2f-3df2-450e-b2ab-43c5b96a56c1.log.0 (3125 bytes)
15722024-03-11T14:50:43.369Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cc50f2f-3df2-450e-b2ab-43c5b96a56c1.log.0
15732024-03-11T14:50:43.369Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15742024-03-11T14:50:44.452Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-zone-network-setup:default.log
15752024-03-11T14:50:44.452Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1702 bytes)
15762024-03-11T14:50:45.552Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ce9e1165-4414-484c-b988-834e7b1f1682/root/var/svc/log/oxide-zone-network-setup:default.log.0
15772024-03-11T14:50:45.552Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_57923551-777e-401a-a9ee-e1aa728c2215/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
15782024-03-11T14:50:46.625Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_57923551-777e-401a-a9ee-e1aa728c2215/root/var/svc/log/oxide-crucible-pantry:default.log
15792024-03-11T14:50:46.625Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_57923551-777e-401a-a9ee-e1aa728c2215/root/var/svc/log/oxide-crucible-pantry:default.log.0 (779 bytes)
15802024-03-11T14:50:48.135Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_57923551-777e-401a-a9ee-e1aa728c2215/root/var/svc/log/oxide-crucible-pantry:default.log.0
15812024-03-11T14:50:48.135Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_57923551-777e-401a-a9ee-e1aa728c2215/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15822024-03-11T14:50:49.211Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_57923551-777e-401a-a9ee-e1aa728c2215/root/var/svc/log/oxide-zone-network-setup:default.log
15832024-03-11T14:50:49.211Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_57923551-777e-401a-a9ee-e1aa728c2215/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1744 bytes)
15842024-03-11T14:50:50.310Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_57923551-777e-401a-a9ee-e1aa728c2215/root/var/svc/log/oxide-zone-network-setup:default.log.0
15852024-03-11T14:50:50.310Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/measurements.log (14933 bytes)
15862024-03-11T14:50:50.472Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/measurements.log" changed size mid upload: 14933 -> 21783
15872024-03-11T14:50:51.552Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/measurements.log
15882024-03-11T14:50:51.553Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/statistics.log (9711 bytes)
15892024-03-11T14:50:51.644Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/statistics.log" changed size mid upload: 9711 -> 15093
15902024-03-11T14:50:52.719Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/statistics.log
15912024-03-11T14:50:52.719Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/tracking.log (1983 bytes)
15922024-03-11T14:50:52.775Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/tracking.log" changed size mid upload: 1983 -> 2511
15932024-03-11T14:50:53.846Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_78c8eddc-326e-4daf-bede-402c704e1aed/root/var/log/chrony/tracking.log