01HMHSG2QC2HWV0YFNMZPS1ENB: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.27",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HMHSHDEFG7J7KMDE8KW3QRWR

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-01-19T22:29:25.643Zjob dependencies complete; ready to run (waiting for 1 h 8 m 58 s)
22024-01-19T22:30:28.991Zjob assigned to worker 01HMHXFX9JQ8X7MMZVDYPDF7SW (queued for 1 m 3 s)
32024-01-19T22:30:29.176Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-01-19T22:30:29.238Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-01-19T22:30:29.301Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-01-19T22:30:29.348Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-01-19T22:30:29.398Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-01-19T22:30:29.448ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-01-19T22:30:29.493Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-01-19T22:30:29.538ZOxide Helios Version helios-2.0.22333 64-bit
112024-01-19T22:30:29.582ZConfiguring devices.
122024-01-19T22:30:29.627Z##################################################
132024-01-19T22:30:29.677Z#### ############# ##
142024-01-19T22:30:29.730Z### ### ############ ##
152024-01-19T22:30:29.783Z## ### # ## ### ## Oxide Computer Company ##
162024-01-19T22:30:29.829Z## ## ## ### # ### ##
172024-01-19T22:30:29.883Z## # ### #### #### This Station Under ##
182024-01-19T22:30:29.928Z### ### #### # ### Computer Control ##
192024-01-19T22:30:29.987Z#### #### ### ## ##
202024-01-19T22:30:30.039Z##################################################
212024-01-19T22:30:30.083ZHostname: buskin
222024-01-19T22:30:30.128ZLoading smf(7) service descriptions:
232024-01-19T22:30:30.759Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-65f30ecb53223d0e.gz
242024-01-19T22:30:32.736Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-65f30ecb53223d0e.gz
252024-01-19T22:30:32.776Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-01-19T22:31:13.846Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-01-19T22:31:13.846Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-02d296ed8b688339.gz
282024-01-19T22:31:54.990Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-02d296ed8b688339.gz
292024-01-19T22:31:54.990Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-01-19T22:31:56.032Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-01-19T22:31:56.075Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-01-19T22:32:12.809Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-01-19T22:32:12.809Zdownloading input: /input/package/work/version.txt
342024-01-19T22:32:12.809Zdownloaded input: /input/package/work/version.txt
352024-01-19T22:32:12.809Zdownloading input: /input/package/work/package.tar.gz
362024-01-19T22:32:39.385Zdownloaded input: /input/package/work/package.tar.gz
372024-01-19T22:32:39.386Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-01-19T22:33:17.109Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-01-19T22:33:17.109Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-01-19T22:33:28.453Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-01-19T22:33:28.603Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-01-19T22:34:30.877Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-01-19T22:34:30.922Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-01-19T22:35:30.105Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-01-19T22:35:30.106Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-01-19T22:36:08.521Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-01-19T22:36:08.522Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
482024-01-19T22:36:14.003Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
492024-01-19T22:36:14.004Zdownloading input: /input/package/work/zones/crucible.tar.gz
502024-01-19T22:36:22.830Zdownloaded input: /input/package/work/zones/crucible.tar.gz
512024-01-19T22:36:22.830Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-01-19T22:36:29.996Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-01-19T22:36:29.996Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-01-19T22:36:36.872Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-01-19T22:36:36.873Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-01-19T22:36:36.913Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-01-19T22:36:36.913Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-01-19T22:36:43.260Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-01-19T22:36:43.260Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-01-19T22:36:48.502Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-01-19T22:36:48.502Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-01-19T22:37:11.308Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-01-19T22:37:11.309Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-01-19T22:37:33.630Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-01-19T22:37:33.630Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-01-19T22:37:33.670Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-01-19T22:37:33.670Zdownloading input: /input/package/work/zones/oximeter-collector.tar.gz
682024-01-19T22:37:44.371Zdownloaded input: /input/package/work/zones/oximeter-collector.tar.gz
692024-01-19T22:37:44.371Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-01-19T22:38:02.416Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-01-19T22:38:02.417Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-01-19T22:39:19.936Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-01-19T22:39:19.936Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-01-19T22:40:08.780Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-01-19T22:40:08.819Zstarting task 0: "setup"
762024-01-19T22:40:08.819Z++ uname -s
772024-01-19T22:40:08.819Z+ kern=SunOS
782024-01-19T22:40:08.819Z+ case "$kern" in
792024-01-19T22:40:08.819Z+ groupadd -g 12345 build
802024-01-19T22:40:08.819Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-01-19T22:40:10.799Z+ zfs create -o mountpoint=/work rpool/work
822024-01-19T22:40:10.838Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-01-19T22:40:10.838Z+ home_fs=zfs
842024-01-19T22:40:10.838Z+ [[ zfs == autofs ]]
852024-01-19T22:40:10.839Z+ mkdir -p /home/build
862024-01-19T22:40:10.839Z+ chown build:build /home/build /work
872024-01-19T22:40:12.829Z+ chmod 0700 /home/build /work
882024-01-19T22:40:12.869Zprocess exited: duration 4051 ms, exit code 0
 
892024-01-19T22:40:12.949Zstarting task 1: "authentication"
902024-01-19T22:40:13.011Zprocess exited: duration 60 ms, exit code 0
 
912024-01-19T22:40:13.093Zstarting task 2: "build"
922024-01-19T22:40:13.142Z+ trap _exit_trap EXIT
932024-01-19T22:40:13.142Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
942024-01-19T22:40:13.297Zsecpolicy_fs_linkdir: 0x55 = 0x55
952024-01-19T22:40:13.297Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
962024-01-19T22:40:13.297Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
972024-01-19T22:40:13.297Zsecpolicy_fs_linkdir+3: 0 = 0xe5
982024-01-19T22:40:13.298Zsecpolicy_fs_linkdir+4: 0 = 0xb8
992024-01-19T22:40:13.298Zsecpolicy_fs_linkdir+5: 0 = 0x1
1002024-01-19T22:40:13.298Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1012024-01-19T22:40:13.298Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1022024-01-19T22:40:13.339Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1032024-01-19T22:40:13.339Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1042024-01-19T22:40:13.339Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1052024-01-19T22:40:13.340Z+ [[ -d /opt/oxide ]]
1062024-01-19T22:40:13.340Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1072024-01-19T22:40:13.340Z+ pfexec mkdir /opt/oxide
1082024-01-19T22:40:13.340Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1092024-01-19T22:40:13.340Z+ [[ -d /opt/oxide-underneath ]]
1102024-01-19T22:40:13.340Z+ cd /opt/oxide-underneath
1112024-01-19T22:40:13.340Z+ pfexec tar ceEp@/f - .
1122024-01-19T22:40:13.341Z+ cd /opt/oxide
1132024-01-19T22:40:13.341Z+ pfexec tar xveEp@/f -
1142024-01-19T22:40:13.426Zx ., 0 bytes, 0 tape blocks
1152024-01-19T22:40:13.427Zx ./opte, 0 bytes, 0 tape blocks
1162024-01-19T22:40:13.427Zx ./opte/bin, 0 bytes, 0 tape blocks
1172024-01-19T22:40:13.427Zx ./opte/bin/opteadm, 52567720 bytes, 102672 tape blocks
1182024-01-19T22:40:13.519Z+ pfexec rm -rf /opt/oxide-underneath
1192024-01-19T22:40:13.520Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1202024-01-19T22:40:13.520Z+ pfexec mkdir /opt/oxide/work
1212024-01-19T22:40:13.520Z+ pfexec chown build:build /opt/oxide/work
1222024-01-19T22:40:13.520Z+ cd /opt/oxide/work
1232024-01-19T22:40:13.520Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1242024-01-19T22:40:15.042ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1252024-01-19T22:40:15.043Zx out/mg-ddm-gz.tar, 62723072 bytes, 122506 tape blocks
1262024-01-19T22:40:15.043Zx out/omicron-sled-agent.tar, 117762048 bytes, 230004 tape blocks
1272024-01-19T22:40:15.043Zx out/target/test, 75 bytes, 1 tape blocks
1282024-01-19T22:40:15.043Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1292024-01-19T22:40:15.043Zx package-manifest.toml, 22919 bytes, 45 tape blocks
1302024-01-19T22:40:15.043Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1312024-01-19T22:40:15.043Zx target/release/omicron-package, 43087552 bytes, 84156 tape blocks
1322024-01-19T22:40:15.043Zx tools/create_virtual_hardware.sh, 3176 bytes, 7 tape blocks
1332024-01-19T22:40:15.044Zx tools/virtual_hardware.sh, 3408 bytes, 7 tape blocks
1342024-01-19T22:40:15.044Zx tools/scrimlet/create-softnpu-zone.sh, 619 bytes, 2 tape blocks
1352024-01-19T22:40:15.044Zx tools/scrimlet/destroy-softnpu-zone.sh, 195 bytes, 1 tape blocks
1362024-01-19T22:40:15.044Zx tools/scrimlet/softnpu-init.sh, 2149 bytes, 5 tape blocks
1372024-01-19T22:40:15.044Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1382024-01-19T22:40:15.044Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1392024-01-19T22:40:15.085Z
1402024-01-19T22:40:15.085Zreal 1.570777240
1412024-01-19T22:40:15.085Zuser 1.415724808
1422024-01-19T22:40:15.085Zsys 0.274975811
1432024-01-19T22:40:15.085Ztrap 0.000058730
1442024-01-19T22:40:15.085Ztflt 0.000000000
1452024-01-19T22:40:15.085Zdflt 0.000000000
1462024-01-19T22:40:15.085Zkflt 0.000000000
1472024-01-19T22:40:15.085Zlock 0.000000000
1482024-01-19T22:40:15.085Zslp 1.414262021
1492024-01-19T22:40:15.085Zlat 0.034517652
1502024-01-19T22:40:15.085Zstop 0.000116712
1512024-01-19T22:40:15.085Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter-collector.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1522024-01-19T22:40:16.175Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1532024-01-19T22:40:16.214Z+ mkdir tests
1542024-01-19T22:40:16.215Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1552024-01-19T22:40:16.215Z+ ptime -m gunzip
1562024-01-19T22:40:16.215Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-65f30ecb53223d0e
1572024-01-19T22:40:16.334Z
1582024-01-19T22:40:16.373Zreal 0.138718742
1592024-01-19T22:40:16.373Zuser 0.126268844
1602024-01-19T22:40:16.373Zsys 0.012201682
1612024-01-19T22:40:16.373Ztrap 0.000015529
1622024-01-19T22:40:16.373Ztflt 0.000000000
1632024-01-19T22:40:16.373Zdflt 0.000000000
1642024-01-19T22:40:16.373Zkflt 0.000000000
1652024-01-19T22:40:16.373Zlock 0.000000000
1662024-01-19T22:40:16.374Zslp 0.000024590
1672024-01-19T22:40:16.374Zlat 0.000020810
1682024-01-19T22:40:16.374Zstop 0.000126852
1692024-01-19T22:40:16.374Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-65f30ecb53223d0e
1702024-01-19T22:40:16.374Z+ chmod a+x tests/bootstrap-65f30ecb53223d0e
1712024-01-19T22:40:16.374Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1722024-01-19T22:40:16.374Z+ ptime -m gunzip
1732024-01-19T22:40:16.374Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1742024-01-19T22:40:18.703Z
1752024-01-19T22:40:18.759Zreal 2.357645700
1762024-01-19T22:40:18.759Zuser 2.215094135
1772024-01-19T22:40:18.759Zsys 0.142179054
1782024-01-19T22:40:18.759Ztrap 0.000154693
1792024-01-19T22:40:18.759Ztflt 0.000000000
1802024-01-19T22:40:18.759Zdflt 0.000000000
1812024-01-19T22:40:18.759Zkflt 0.000000000
1822024-01-19T22:40:18.759Zlock 0.000000000
1832024-01-19T22:40:18.760Zslp 0.000022900
1842024-01-19T22:40:18.760Zlat 0.000019469
1852024-01-19T22:40:18.760Zstop 0.000114273
1862024-01-19T22:40:18.760Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1872024-01-19T22:40:18.760Z+ chmod a+x tests/bootstrap
1882024-01-19T22:40:18.760Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1892024-01-19T22:40:18.760Z+ ptime -m gunzip
1902024-01-19T22:40:18.760Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-02d296ed8b688339
1912024-01-19T22:40:21.136Z
1922024-01-19T22:40:21.176Zreal 2.419899757
1932024-01-19T22:40:21.176Zuser 2.268689603
1942024-01-19T22:40:21.176Zsys 0.150798813
1952024-01-19T22:40:21.176Ztrap 0.000172944
1962024-01-19T22:40:21.176Ztflt 0.000000000
1972024-01-19T22:40:21.176Zdflt 0.000000000
1982024-01-19T22:40:21.176Zkflt 0.000000000
1992024-01-19T22:40:21.176Zlock 0.000000000
2002024-01-19T22:40:21.176Zslp 0.000022540
2012024-01-19T22:40:21.176Zlat 0.000026420
2022024-01-19T22:40:21.177Zstop 0.000122273
2032024-01-19T22:40:21.177Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-02d296ed8b688339
2042024-01-19T22:40:21.177Z+ chmod a+x tests/end_to_end_tests-02d296ed8b688339
2052024-01-19T22:40:21.177Z+ bmat address ls
2062024-01-19T22:40:21.177ZNAME CIDR FIRST LAST COUNT
2072024-01-19T22:40:21.177Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2082024-01-19T22:40:21.177Z++ bmat address ls -f extra -Ho first,last,count
2092024-01-19T22:40:21.177Z+ set -- 10.151.1.164 10.151.1.227 64
2102024-01-19T22:40:21.177Z+ EXTRA_IP_START=10.151.1.164
2112024-01-19T22:40:21.177Z+ EXTRA_IP_END=10.151.1.227
2122024-01-19T22:40:21.177Z+ EXTRA_IP_COUNT=64
2132024-01-19T22:40:21.177Z+ (( EXTRA_IP_COUNT >= 32 ))
2142024-01-19T22:40:21.177Z+ EXTRA_IP_BASE=10.151.1
2152024-01-19T22:40:21.178Z+ EXTRA_IP_FOCTET=164
2162024-01-19T22:40:21.178Z+ EXTRA_IP_LOCTET=227
2172024-01-19T22:40:21.178Z+ SERVICE_IP_POOL_START=10.151.1.164
2182024-01-19T22:40:21.178Z+ SERVICE_IP_POOL_END=10.151.1.173
2192024-01-19T22:40:21.178Z+ DNS_IP1=10.151.1.164
2202024-01-19T22:40:21.178Z+ DNS_IP2=10.151.1.165
2212024-01-19T22:40:21.178Z+ UPLINK_IP=10.151.1.174
2222024-01-19T22:40:21.178Z+ IPPOOL_START=10.151.1.175
2232024-01-19T22:40:21.178Z+ IPPOOL_END=10.151.1.227
2242024-01-19T22:40:21.178Z++ ipadm show-addr -po type,addr
2252024-01-19T22:40:21.178Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2262024-01-19T22:40:21.178Z+ GATEWAY_IP=10.151.1.100
2272024-01-19T22:40:21.178Z+ [[ -n 10.151.1.100 ]]
2282024-01-19T22:40:21.178Z+ ping -s 10.151.1.100 56 1
2292024-01-19T22:40:21.178ZPING 10.151.1.100: 56 data bytes
2302024-01-19T22:40:21.219Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2312024-01-19T22:40:21.219Z
2322024-01-19T22:40:21.219Z----10.151.1.100 PING Statistics----
2332024-01-19T22:40:21.219Z1 packets transmitted, 1 packets received, 0% packet loss
2342024-01-19T22:40:21.219Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2352024-01-19T22:40:21.220Z++ arp -an
2362024-01-19T22:40:21.220Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2372024-01-19T22:40:21.220Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2382024-01-19T22:40:21.220Z+ routeadm -e ipv4-forwarding -u
2392024-01-19T22:40:21.304Z+ PXA_START=10.151.1.164
2402024-01-19T22:40:21.304Z+ PXA_END=10.151.1.227
2412024-01-19T22:40:21.344Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2422024-01-19T22:40:21.344Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2432024-01-19T22:40:21.442Z+ ZPOOL_VDEV_DIR=/scratch
2442024-01-19T22:40:21.442Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2452024-01-19T22:40:21.482Z+++ dirname ./tools/create_virtual_hardware.sh
2462024-01-19T22:40:21.482Z++ cd ./tools
2472024-01-19T22:40:21.482Z++ pwd
2482024-01-19T22:40:21.482Z+ SOURCE_DIR=/opt/oxide/work/tools
2492024-01-19T22:40:21.482Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2502024-01-19T22:40:21.483Z+ SOFTNPU_MODE=zone
2512024-01-19T22:40:21.483Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2522024-01-19T22:40:21.483Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2532024-01-19T22:40:21.483Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2542024-01-19T22:40:21.483Z++ dladm show-phys -p -o LINK
2552024-01-19T22:40:21.483Z++ head -1
2562024-01-19T22:40:21.526Z+ PHYSICAL_LINK=igb0
2572024-01-19T22:40:21.527Z+ echo 'Using igb0 as physical link'
2582024-01-19T22:40:21.579ZUsing igb0 as physical link
2592024-01-19T22:40:21.580Z+ ensure_run_as_root
2602024-01-19T22:40:21.580Z++ id -u
2612024-01-19T22:40:21.580Z+ [[ 0 -ne 0 ]]
2622024-01-19T22:40:21.580Z+ ensure_zpools
2632024-01-19T22:40:21.580Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2642024-01-19T22:40:21.580Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2652024-01-19T22:40:21.580Z+ readarray -t ZPOOLS
2662024-01-19T22:40:21.580Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2672024-01-19T22:40:21.581Z++ sed 's/[ ",]//g'
2682024-01-19T22:40:21.581Z+ for ZPOOL in "${ZPOOLS[@]}"
2692024-01-19T22:40:21.581Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2702024-01-19T22:40:21.581Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2712024-01-19T22:40:21.581ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2722024-01-19T22:40:21.581Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2732024-01-19T22:40:21.581Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2742024-01-19T22:40:21.581Z0+0 records in
2752024-01-19T22:40:21.581Z0+0 records out
2762024-01-19T22:40:21.581Z0 bytes (0 iB) transferred in 0.000007 secs (0 iB/sec)
2772024-01-19T22:40:21.581Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2782024-01-19T22:40:21.581Z+ set +x
2792024-01-19T22:40:21.581ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2802024-01-19T22:40:21.581Z++ zpool list -o name
2812024-01-19T22:40:21.581Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2822024-01-19T22:40:21.625Z+ [[ -z '' ]]
2832024-01-19T22:40:21.625Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2842024-01-19T22:40:21.625Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2852024-01-19T22:40:21.626Z+ set +x
2862024-01-19T22:40:21.626ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2872024-01-19T22:40:21.626Z+ for ZPOOL in "${ZPOOLS[@]}"
2882024-01-19T22:40:21.626Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2892024-01-19T22:40:21.626ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2902024-01-19T22:40:21.626Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2912024-01-19T22:40:21.626Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2922024-01-19T22:40:21.626Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2932024-01-19T22:40:21.627Z0+0 records in
2942024-01-19T22:40:21.627Z0+0 records out
2952024-01-19T22:40:21.627Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2962024-01-19T22:40:21.627Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2972024-01-19T22:40:21.627Z+ set +x
2982024-01-19T22:40:21.628ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
2992024-01-19T22:40:21.628Z++ zpool list -o name
3002024-01-19T22:40:21.628Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3012024-01-19T22:40:21.628Z+ [[ -z '' ]]
3022024-01-19T22:40:21.628Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3032024-01-19T22:40:21.669Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3042024-01-19T22:40:21.669Z+ set +x
3052024-01-19T22:40:21.669ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3062024-01-19T22:40:21.669Z+ for ZPOOL in "${ZPOOLS[@]}"
3072024-01-19T22:40:21.669ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3082024-01-19T22:40:21.669Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3092024-01-19T22:40:21.669Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3102024-01-19T22:40:21.669Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3112024-01-19T22:40:21.669Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3122024-01-19T22:40:21.669Z0+0 records in
3132024-01-19T22:40:21.669Z0+0 records out
3142024-01-19T22:40:21.670Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3152024-01-19T22:40:21.670Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3162024-01-19T22:40:21.670Z+ set +x
3172024-01-19T22:40:21.670ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3182024-01-19T22:40:21.670Z++ zpool list -o name
3192024-01-19T22:40:21.670Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3202024-01-19T22:40:21.670Z+ [[ -z '' ]]
3212024-01-19T22:40:21.670Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3222024-01-19T22:40:21.710Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3232024-01-19T22:40:21.710Z+ set +x
3242024-01-19T22:40:21.710ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3252024-01-19T22:40:21.711Z+ for ZPOOL in "${ZPOOLS[@]}"
3262024-01-19T22:40:21.711Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3272024-01-19T22:40:21.711ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3282024-01-19T22:40:21.711Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3292024-01-19T22:40:21.711Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3302024-01-19T22:40:21.711Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3312024-01-19T22:40:21.711Z0+0 records in
3322024-01-19T22:40:21.711Z0+0 records out
3332024-01-19T22:40:21.711Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3342024-01-19T22:40:21.711Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3352024-01-19T22:40:21.711Z+ set +x
3362024-01-19T22:40:21.711ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3372024-01-19T22:40:21.711Z++ zpool list -o name
3382024-01-19T22:40:21.711Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3392024-01-19T22:40:21.712Z+ [[ -z '' ]]
3402024-01-19T22:40:21.713Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3412024-01-19T22:40:21.754Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3422024-01-19T22:40:21.754Z+ set +x
3432024-01-19T22:40:21.754ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3442024-01-19T22:40:21.754Z+ for ZPOOL in "${ZPOOLS[@]}"
3452024-01-19T22:40:21.755Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3462024-01-19T22:40:21.755Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3472024-01-19T22:40:21.755Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3482024-01-19T22:40:21.755ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3492024-01-19T22:40:21.755Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3502024-01-19T22:40:21.755Z0+0 records in
3512024-01-19T22:40:21.755Z0+0 records out
3522024-01-19T22:40:21.756Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3532024-01-19T22:40:21.756Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3542024-01-19T22:40:21.756Z+ set +x
3552024-01-19T22:40:21.756ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3562024-01-19T22:40:21.756Z++ zpool list -o name
3572024-01-19T22:40:21.756Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3582024-01-19T22:40:21.798Z+ [[ -z '' ]]
3592024-01-19T22:40:21.798Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3602024-01-19T22:40:21.798Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3612024-01-19T22:40:21.799Z+ set +x
3622024-01-19T22:40:21.799ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3632024-01-19T22:40:21.799Z+ for ZPOOL in "${ZPOOLS[@]}"
3642024-01-19T22:40:21.799Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3652024-01-19T22:40:21.799ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3662024-01-19T22:40:21.799Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3672024-01-19T22:40:21.799Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3682024-01-19T22:40:21.799Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3692024-01-19T22:40:21.799Z0+0 records in
3702024-01-19T22:40:21.799Z0+0 records out
3712024-01-19T22:40:21.799Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3722024-01-19T22:40:21.799Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3732024-01-19T22:40:21.800Z+ set +x
3742024-01-19T22:40:21.800ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3752024-01-19T22:40:21.800Z++ zpool list -o name
3762024-01-19T22:40:21.800Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3772024-01-19T22:40:21.875Z+ [[ -z '' ]]
3782024-01-19T22:40:21.875Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3792024-01-19T22:40:21.875Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3802024-01-19T22:40:21.876Z+ set +x
3812024-01-19T22:40:21.876ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3822024-01-19T22:40:21.876Z+ for ZPOOL in "${ZPOOLS[@]}"
3832024-01-19T22:40:21.876Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3842024-01-19T22:40:21.876ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3852024-01-19T22:40:21.876Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3862024-01-19T22:40:21.876Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3872024-01-19T22:40:21.876Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3882024-01-19T22:40:21.876Z0+0 records in
3892024-01-19T22:40:21.876Z0+0 records out
3902024-01-19T22:40:21.876Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3912024-01-19T22:40:21.876Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3922024-01-19T22:40:21.876Z+ set +x
3932024-01-19T22:40:21.876ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3942024-01-19T22:40:21.876Z++ zpool list -o name
3952024-01-19T22:40:21.876Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3962024-01-19T22:40:21.876Z+ [[ -z '' ]]
3972024-01-19T22:40:21.876Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3982024-01-19T22:40:21.916Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
3992024-01-19T22:40:21.916Z+ set +x
4002024-01-19T22:40:21.916ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4012024-01-19T22:40:21.917Z+ for ZPOOL in "${ZPOOLS[@]}"
4022024-01-19T22:40:21.917Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4032024-01-19T22:40:21.917ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4042024-01-19T22:40:21.917Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4052024-01-19T22:40:21.917Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4062024-01-19T22:40:21.917Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4072024-01-19T22:40:21.917Z0+0 records in
4082024-01-19T22:40:21.917Z0+0 records out
4092024-01-19T22:40:21.917Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4102024-01-19T22:40:21.917Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4112024-01-19T22:40:21.917Z+ set +x
4122024-01-19T22:40:21.917ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4132024-01-19T22:40:21.917Z++ zpool list -o name
4142024-01-19T22:40:21.917Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4152024-01-19T22:40:21.917Z+ [[ -z '' ]]
4162024-01-19T22:40:21.917Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4172024-01-19T22:40:21.917Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4182024-01-19T22:40:21.917Z+ set +x
4192024-01-19T22:40:21.917ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4202024-01-19T22:40:21.917Z+ for ZPOOL in "${ZPOOLS[@]}"
4212024-01-19T22:40:21.917Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4222024-01-19T22:40:21.918ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4232024-01-19T22:40:21.918Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4242024-01-19T22:40:21.918Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4252024-01-19T22:40:21.918Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4262024-01-19T22:40:21.918Z0+0 records in
4272024-01-19T22:40:21.918Z0+0 records out
4282024-01-19T22:40:21.918Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4292024-01-19T22:40:21.918Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4302024-01-19T22:40:21.918Z+ set +x
4312024-01-19T22:40:21.918ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4322024-01-19T22:40:21.918Z++ zpool list -o name
4332024-01-19T22:40:21.957Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4342024-01-19T22:40:21.957Z+ [[ -z '' ]]
4352024-01-19T22:40:21.957Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4362024-01-19T22:40:21.957Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4372024-01-19T22:40:21.957Z+ set +x
4382024-01-19T22:40:21.958ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4392024-01-19T22:40:21.958Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4402024-01-19T22:40:21.958Z+ readarray -t ZPOOLS
4412024-01-19T22:40:21.958Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4422024-01-19T22:40:21.959Z++ sed 's/[ ",]//g'
4432024-01-19T22:40:21.999Z+ for ZPOOL in "${ZPOOLS[@]}"
4442024-01-19T22:40:22.000Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4452024-01-19T22:40:22.000ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4462024-01-19T22:40:22.000Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4472024-01-19T22:40:22.000Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4482024-01-19T22:40:22.000Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4492024-01-19T22:40:22.001Z0+0 records in
4502024-01-19T22:40:22.001Z0+0 records out
4512024-01-19T22:40:22.001Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4522024-01-19T22:40:22.001Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4532024-01-19T22:40:22.001Z+ set +x
4542024-01-19T22:40:22.001ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4552024-01-19T22:40:22.001Z++ zpool list -o name
4562024-01-19T22:40:22.001Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4572024-01-19T22:40:22.001Z+ [[ -z '' ]]
4582024-01-19T22:40:22.001Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4592024-01-19T22:40:22.042Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4602024-01-19T22:40:22.042Z+ set +x
4612024-01-19T22:40:22.042ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4622024-01-19T22:40:22.042Z+ for ZPOOL in "${ZPOOLS[@]}"
4632024-01-19T22:40:22.042Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4642024-01-19T22:40:22.042ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4652024-01-19T22:40:22.042Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4662024-01-19T22:40:22.042Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4672024-01-19T22:40:22.042Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4682024-01-19T22:40:22.042Z0+0 records in
4692024-01-19T22:40:22.042Z0+0 records out
4702024-01-19T22:40:22.042Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4712024-01-19T22:40:22.043Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4722024-01-19T22:40:22.043Z+ set +x
4732024-01-19T22:40:22.043ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4742024-01-19T22:40:22.043Z++ zpool list -o name
4752024-01-19T22:40:22.043Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4762024-01-19T22:40:22.043Z+ [[ -z '' ]]
4772024-01-19T22:40:22.043Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4782024-01-19T22:40:22.085Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4792024-01-19T22:40:22.085Z+ set +x
4802024-01-19T22:40:22.085ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4812024-01-19T22:40:22.085Z+ [[ zone == \z\o\n\e ]]
4822024-01-19T22:40:22.085Z+ ensure_simulated_links igb0
4832024-01-19T22:40:22.086Z+ local PHYSICAL_LINK=igb0
4842024-01-19T22:40:22.086Z+ INDICES=("0" "1")
4852024-01-19T22:40:22.086Z+ for I in "${INDICES[@]}"
4862024-01-19T22:40:22.086Z++ get_simnet_name_if_exists net0
4872024-01-19T22:40:22.086Z++ dladm show-simnet -p -o LINK net0
4882024-01-19T22:40:22.086Z++ echo ''
4892024-01-19T22:40:22.086Z+ [[ -z '' ]]
4902024-01-19T22:40:22.086Z+ dladm create-simnet -t net0
4912024-01-19T22:40:22.086Z+ dladm create-simnet -t sc0_0
4922024-01-19T22:40:22.086Z+ dladm modify-simnet -t -p net0 sc0_0
4932024-01-19T22:40:22.086Z+ dladm set-linkprop -p mtu=9000 sc0_0
4942024-01-19T22:40:22.086Z+ success 'Simnet net0/sc0_0 exists'
4952024-01-19T22:40:22.086Z+ set +x
4962024-01-19T22:40:22.086ZSimnet net0/sc0_0 exists
4972024-01-19T22:40:22.086Z+ for I in "${INDICES[@]}"
4982024-01-19T22:40:22.089Z++ get_simnet_name_if_exists net1
4992024-01-19T22:40:22.089Z++ dladm show-simnet -p -o LINK net1
5002024-01-19T22:40:22.089Z++ echo ''
5012024-01-19T22:40:22.090Z+ [[ -z '' ]]
5022024-01-19T22:40:22.090Z+ dladm create-simnet -t net1
5032024-01-19T22:40:22.090Z+ dladm create-simnet -t sc1_0
5042024-01-19T22:40:22.130Z+ dladm modify-simnet -t -p net1 sc1_0
5052024-01-19T22:40:22.130Z+ dladm set-linkprop -p mtu=9000 sc1_0
5062024-01-19T22:40:22.130Z+ success 'Simnet net1/sc1_0 exists'
5072024-01-19T22:40:22.130Z+ set +x
5082024-01-19T22:40:22.130ZSimnet net1/sc1_0 exists
5092024-01-19T22:40:22.131Z++ get_vnic_name_if_exists sc0_1
5102024-01-19T22:40:22.131Z++ dladm show-vnic -p -o LINK sc0_1
5112024-01-19T22:40:22.131Z++ echo ''
5122024-01-19T22:40:22.131Z+ [[ -z '' ]]
5132024-01-19T22:40:22.131Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5142024-01-19T22:40:22.131Z+ [[ -v PROMISC_FILT_OFF ]]
5152024-01-19T22:40:22.131Z+ success 'Vnic sc0_1 exists'
5162024-01-19T22:40:22.133Z+ set +x
5172024-01-19T22:40:22.133ZVnic sc0_1 exists
5182024-01-19T22:40:22.133Z+ warn_if_no_proxy_arp
5192024-01-19T22:40:22.133Z+ [[ -v PXA_START ]]
5202024-01-19T22:40:22.133Z+ [[ -v PXA_END ]]
5212024-01-19T22:40:22.133Z+ ensure_softnpu_zone
5222024-01-19T22:40:22.133Z+ zoneadm list
5232024-01-19T22:40:22.133Z+ grep -q sidecar_softnpu
5242024-01-19T22:40:22.134Z+ [[ -f out/npuzone/npuzone ]]
5252024-01-19T22:40:22.134Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5262024-01-19T22:40:22.175Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5272024-01-19T22:40:30.754Zdownloading softnpu ...done
5282024-01-19T22:40:30.794Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5292024-01-19T22:40:39.171Zdownloading asic_program.so ...done
5302024-01-19T22:40:39.217Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5312024-01-19T22:40:51.992Zdownloading scadm ...done
5322024-01-19T22:40:52.031Zcreating port tfportrear0_0 for sc0_0
5332024-01-19T22:40:52.031Zcreating port tfportqsfp0_0 for sc0_1
5342024-01-19T22:40:52.031Zsoftnpu zone setup
5352024-01-19T22:40:52.031Zconfigure zone
5362024-01-19T22:40:52.082Zinstall zone
5372024-01-19T22:40:53.096Zboot zone
5382024-01-19T22:40:56.196Z[sidecar_softnpu] svcs milestone/network
5392024-01-19T22:40:56.238ZSTATE STIME FMRI
5402024-01-19T22:40:56.238Zonline 22:40:54 svc:/milestone/network:default
5412024-01-19T22:40:56.238Z[sidecar_softnpu] /softnpu/npu start
5422024-01-19T22:40:56.283Z
5432024-01-19T22:40:56.284Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5442024-01-19T22:40:56.284Z+ GATEWAY_IP=10.151.1.100
5452024-01-19T22:40:56.284Z+ echo 'Using 10.151.1.100 as gateway ip'
5462024-01-19T22:40:56.284ZUsing 10.151.1.100 as gateway ip
5472024-01-19T22:40:56.284Z+ [[ ! -v GATEWAY_MAC ]]
5482024-01-19T22:40:56.284Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5492024-01-19T22:40:56.284Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5502024-01-19T22:40:56.284Z+++ echo 18:c0:4d:0d:9f:b2
5512024-01-19T22:40:56.285Z+ COUNT=1
5522024-01-19T22:40:56.285Z+ [[ 1 -ne 1 ]]
5532024-01-19T22:40:56.285Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5542024-01-19T22:40:56.286ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5552024-01-19T22:40:56.286Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5562024-01-19T22:40:56.286Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5572024-01-19T22:40:56.328Z+ PXA_MAC=a8:e1:de:01:70:1d
5582024-01-19T22:40:56.328Z+ [[ -v PXA_START ]]
5592024-01-19T22:40:56.328Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5602024-01-19T22:40:56.328Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5612024-01-19T22:40:56.329Z+ z_scadm dump-state
5622024-01-19T22:40:56.329Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5632024-01-19T22:40:56.380Zlocal v6:
5642024-01-19T22:40:56.380Zlocal v4:
5652024-01-19T22:40:56.380Zrouter v6:
5662024-01-19T22:40:56.380Zrouter v4_idx:
5672024-01-19T22:40:56.380Zrouter v4_routes:
5682024-01-19T22:40:56.380Zresolver v4:
5692024-01-19T22:40:56.380Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5702024-01-19T22:40:56.380Zresolver v6:
5712024-01-19T22:40:56.380Znat v4:
5722024-01-19T22:40:56.381Znat_v6:
5732024-01-19T22:40:56.381Zport_mac:
5742024-01-19T22:40:56.381Zproxy arp:
5752024-01-19T22:40:56.381Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5762024-01-19T22:40:56.381Z+ success 'softnpu zone exists'
5772024-01-19T22:40:56.381Z+ set +x
5782024-01-19T22:40:56.381Zsoftnpu zone exists
5792024-01-19T22:40:56.381Z
5802024-01-19T22:40:56.381Zreal 34.907476296
5812024-01-19T22:40:56.381Zuser 0.726882579
5822024-01-19T22:40:56.381Zsys 1.650143872
5832024-01-19T22:40:56.381Ztrap 0.000096137
5842024-01-19T22:40:56.381Ztflt 0.000143214
5852024-01-19T22:40:56.382Zdflt 0.001406564
5862024-01-19T22:40:56.382Zkflt 0.000004370
5872024-01-19T22:40:56.382Zlock 27:15.930604833
5882024-01-19T22:40:56.382Zslp 1:44.618866170
5892024-01-19T22:40:56.382Zlat 0.081282551
5902024-01-19T22:40:56.382Zstop 0.360964625
5912024-01-19T22:40:56.384Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5922024-01-19T22:40:56.425Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5932024-01-19T22:40:56.425Z+ SILO_NAME=recovery
5942024-01-19T22:40:56.425Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-01-19T22:40:56.425Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5962024-01-19T22:40:56.425Z+ sed -i~ '
5972024-01-19T22:40:56.425Z /^external_dns_ips/c\
5982024-01-19T22:40:56.425Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
5992024-01-19T22:40:56.425Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6002024-01-19T22:40:56.425Z /^first/c\
6012024-01-19T22:40:56.426Zfirst = "10.151.1.164"
6022024-01-19T22:40:56.426Z /^last/c\
6032024-01-19T22:40:56.426Zlast = "10.151.1.173"
6042024-01-19T22:40:56.426Z }
6052024-01-19T22:40:56.426Z /^\[rack_network_config/,/^$/ {
6062024-01-19T22:40:56.427Z /^infra_ip_first/c\
6072024-01-19T22:40:56.427Zinfra_ip_first = "10.151.1.174"
6082024-01-19T22:40:56.427Z /^infra_ip_last/c\
6092024-01-19T22:40:56.427Zinfra_ip_last = "10.151.1.174"
6102024-01-19T22:40:56.427Z }
6112024-01-19T22:40:56.427Z /^\[\[rack_network_config.ports/,/^$/ {
6122024-01-19T22:40:56.427Z /^routes/c\
6132024-01-19T22:40:56.427Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6142024-01-19T22:40:56.427Z /^addresses/c\
6152024-01-19T22:40:56.427Zaddresses = \["10.151.1.174/32"\]
6162024-01-19T22:40:56.427Z }
6172024-01-19T22:40:56.427Z' pkg/config-rss.toml
6182024-01-19T22:40:56.427Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6192024-01-19T22:40:56.428Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6202024-01-19T22:40:56.428Z+++ pkg/config-rss.toml Fri Jan 19 22:40:56 2024
6212024-01-19T22:40:56.428Z@@ -41,7 +41,7 @@
6222024-01-19T22:40:56.428Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6232024-01-19T22:40:56.428Z # must be contained in one of the "internal services" IP Pool ranges listed
6242024-01-19T22:40:56.428Z # below.
6252024-01-19T22:40:56.428Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6262024-01-19T22:40:56.428Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6272024-01-19T22:40:56.428Z
6282024-01-19T22:40:56.428Z # Initial TLS certificates for the external API
6292024-01-19T22:40:56.428Z #
6302024-01-19T22:40:56.428Z@@ -77,8 +77,8 @@
6312024-01-19T22:40:56.428Z #
6322024-01-19T22:40:56.429Z # For more on this and what to put here, see docs/how-to-run.adoc.
6332024-01-19T22:40:56.429Z [[internal_services_ip_pool_ranges]]
6342024-01-19T22:40:56.429Z-first = "192.168.1.20"
6352024-01-19T22:40:56.429Z-last = "192.168.1.29"
6362024-01-19T22:40:56.429Z+first = "10.151.1.164"
6372024-01-19T22:40:56.429Z+last = "10.151.1.173"
6382024-01-19T22:40:56.429Z
6392024-01-19T22:40:56.429Z # TODO - this configuration is subject to change going forward. Ultimately these
6402024-01-19T22:40:56.429Z # parameters should be provided to the control plane via wicket, but we need to
6412024-01-19T22:40:56.429Z@@ -92,8 +92,8 @@
6422024-01-19T22:40:56.429Z # A range of IP addresses used by Boundary Services on the external network. In
6432024-01-19T22:40:56.429Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6442024-01-19T22:40:56.430Z # With softnpu, only one address is used.
6452024-01-19T22:40:56.430Z-infra_ip_first = "192.168.1.30"
6462024-01-19T22:40:56.430Z-infra_ip_last = "192.168.1.30"
6472024-01-19T22:40:56.430Z+infra_ip_first = "10.151.1.174"
6482024-01-19T22:40:56.430Z+infra_ip_last = "10.151.1.174"
6492024-01-19T22:40:56.430Z
6502024-01-19T22:40:56.430Z # Configurations for BGP routers to run on the scrimlets.
6512024-01-19T22:40:56.430Z bgp = []
6522024-01-19T22:40:56.430Z@@ -101,9 +101,9 @@
6532024-01-19T22:40:56.430Z # You can configure multiple uplinks by repeating the following stanza
6542024-01-19T22:40:56.430Z [[rack_network_config.ports]]
6552024-01-19T22:40:56.430Z # Routes associated with this port.
6562024-01-19T22:40:56.431Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6572024-01-19T22:40:56.431Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6582024-01-19T22:40:56.431Z # Addresses associated with this port.
6592024-01-19T22:40:56.432Z-addresses = ["192.168.1.30/32"]
6602024-01-19T22:40:56.432Z+addresses = ["10.151.1.174/32"]
6612024-01-19T22:40:56.432Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6622024-01-19T22:40:56.432Z port = "qsfp0"
6632024-01-19T22:40:56.432Z # The speed of this port.
6642024-01-19T22:40:56.432Z+ true
6652024-01-19T22:40:56.432Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6662024-01-19T22:40:56.432Za pkg/config-rss.toml 7K
6672024-01-19T22:40:56.432Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6682024-01-19T22:40:56.432Z+ TLS_NAME=recovery.sys.oxide.test
6692024-01-19T22:40:56.432Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6702024-01-19T22:40:56.737Z....+.........+.+..+.+......+...+..+......+...+...............+......+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+......+..+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+...+..+.+.....+.+...............+....................+...+......+.......+........+.......+.....+...................+...+...+.....+.........+.+..+.......+........+.+...........+.........+.+...........+.......+..+.+..+.......+...+......+.........+......+..+...+..........+....................+....+...............+..+......+...................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6712024-01-19T22:40:56.972Z...+.+.....+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+......+...+..+...+......+.........+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+......+...+....+........+..........+.....+.........................+..+............+...+.......+.....+.............+.....+.......+...+...+........+......+.+..+...............+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6722024-01-19T22:40:57.013Z-----
6732024-01-19T22:40:57.013Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6742024-01-19T22:40:57.013Za pkg/initial-tls-cert.pem 2K
6752024-01-19T22:40:57.013Za pkg/initial-tls-key.pem 4K
6762024-01-19T22:40:57.013Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6772024-01-19T22:40:57.013Z+ rmdir pkg
6782024-01-19T22:40:57.013Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6792024-01-19T22:40:57.013Z+ pfexec mkdir -p /usr/oxide
6802024-01-19T22:40:57.013Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6812024-01-19T22:40:57.784Z+ pfexec chmod +x /usr/oxide/oxide
6822024-01-19T22:40:57.825Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6832024-01-19T22:41:16.085Z+ OMICRON_NO_UNINSTALL=1
6842024-01-19T22:41:16.085Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6852024-01-19T22:41:16.131ZJan 19 22:41:16.185 DEBG target[test]: Target({"image": "standard", "machine": "non-gimlet", "rack-topology": "single-sled", "switch": "softnpu"})
6862024-01-19T22:41:16.131ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/external_dns.tar.gz, src: out/external-dns.tar.gz
6872024-01-19T22:41:16.131ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/overlay.tar.gz, src: out/overlay.tar.gz
6882024-01-19T22:41:16.132ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/sled-agent.tar, src: out/omicron-sled-agent.tar
6892024-01-19T22:41:16.132ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/mg-ddm.tar, src: out/mg-ddm-gz.tar
6902024-01-19T22:41:16.132ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/nexus.tar.gz, src: out/omicron-nexus.tar.gz
6912024-01-19T22:41:16.132ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/switch.tar.gz, src: out/switch-softnpu.tar.gz
6922024-01-19T22:41:16.132ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/propolis-server.tar.gz, src: out/propolis-server.tar.gz
6932024-01-19T22:41:16.132ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/oximeter.tar.gz, src: out/oximeter-collector.tar.gz
6942024-01-19T22:41:16.133ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/crucible.tar.gz, src: out/crucible.tar.gz
6952024-01-19T22:41:16.133ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/mgs.tar.gz, src: out/omicron-gateway-softnpu.tar.gz
6962024-01-19T22:41:16.133ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/crucible_pantry.tar.gz, src: out/crucible-pantry.tar.gz
6972024-01-19T22:41:16.133ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/clickhouse_keeper.tar.gz, src: out/clickhouse_keeper.tar.gz
6982024-01-19T22:41:16.135ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/ntp.tar.gz, src: out/ntp.tar.gz
6992024-01-19T22:41:16.135ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/internal_dns.tar.gz, src: out/internal-dns.tar.gz
7002024-01-19T22:41:16.135ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/clickhouse.tar.gz, src: out/clickhouse.tar.gz
7012024-01-19T22:41:16.136ZJan 19 22:41:16.187 INFO Installing service, dst: /opt/oxide/cockroachdb.tar.gz, src: out/cockroachdb.tar.gz
7022024-01-19T22:41:16.344ZJan 19 22:41:16.428 INFO Unpacking service tarball, service_path: /opt/oxide/mg-ddm, tar_path: /opt/oxide/mg-ddm.tar
7032024-01-19T22:41:16.385ZJan 19 22:41:16.463 INFO Unpacking service tarball, service_path: /opt/oxide/sled-agent, tar_path: /opt/oxide/sled-agent.tar
7042024-01-19T22:41:16.440ZJan 19 22:41:16.524 INFO Installing bootstrap service from /opt/oxide/sled-agent/pkg/manifest.xml
7052024-01-19T22:41:16.567Z
7062024-01-19T22:41:16.611Zreal 0.476911444
7072024-01-19T22:41:16.612Zuser 0.100055000
7082024-01-19T22:41:16.612Zsys 1.940113322
7092024-01-19T22:41:16.612Ztrap 0.000000889
7102024-01-19T22:41:16.612Ztflt 0.000027529
7112024-01-19T22:41:16.612Zdflt 0.000609136
7122024-01-19T22:41:16.612Zkflt 0.000004400
7132024-01-19T22:41:16.612Zlock 42.755202098
7142024-01-19T22:41:16.612Zslp 0.689018409
7152024-01-19T22:41:16.613Zlat 0.003238730
7162024-01-19T22:41:16.613Zstop 0.191444148
7172024-01-19T22:41:16.613Z+ retry=0
7182024-01-19T22:41:16.613Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7192024-01-19T22:41:16.613Z+ [[ 0 -gt 30 ]]
7202024-01-19T22:41:16.613Z+ sleep 1
7212024-01-19T22:41:17.583Z+ retry=1
7222024-01-19T22:41:17.583Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7232024-01-19T22:41:17.631Z+ [[ 1 -gt 30 ]]
7242024-01-19T22:41:17.631Z+ sleep 1
7252024-01-19T22:41:19.045Z+ retry=2
7262024-01-19T22:41:19.046Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7272024-01-19T22:41:19.086Z+ [[ 2 -gt 30 ]]
7282024-01-19T22:41:19.086Z+ sleep 1
7292024-01-19T22:41:19.611Z+ retry=3
7302024-01-19T22:41:19.611Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7312024-01-19T22:41:19.654Z+ [[ 3 -gt 30 ]]
7322024-01-19T22:41:19.654Z+ sleep 1
7332024-01-19T22:41:20.640Z+ retry=4
7342024-01-19T22:41:20.641Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7352024-01-19T22:41:40.513Z+ [[ 4 -gt 30 ]]
7362024-01-19T22:41:40.513Z+ sleep 1
7372024-01-19T22:41:41.516Z+ retry=5
7382024-01-19T22:41:41.516Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7392024-01-19T22:41:41.557Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7402024-01-19T22:41:41.559Zlocal v6:
7412024-01-19T22:41:41.562Zfe80::94bc:2bff:fe13:3f90
7422024-01-19T22:41:41.562Zfd00:99::1
7432024-01-19T22:41:41.562Zlocal v4:
7442024-01-19T22:41:41.562Z10.151.1.174
7452024-01-19T22:41:41.563Zrouter v6:
7462024-01-19T22:41:41.563Zrouter v4_idx:
7472024-01-19T22:41:41.563Z0.0.0.0/0 -> 0
7482024-01-19T22:41:41.563Zrouter v4_routes:
7492024-01-19T22:41:41.563Z0 -> 10.151.1.100 (2)
7502024-01-19T22:41:41.563Zresolver v4:
7512024-01-19T22:41:41.563Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7522024-01-19T22:41:41.563Zresolver v6:
7532024-01-19T22:41:41.563Zfe80::94bc:2bff:fe13:3f90 -> 96:bc:2b:13:3f:90
7542024-01-19T22:41:41.563Zfe80::ccd5:f6ff:fe08:2145 -> ce:d5:f6:08:21:45
7552024-01-19T22:41:41.563Znat v4:
7562024-01-19T22:41:41.564Znat_v6:
7572024-01-19T22:41:41.564Zport_mac:
7582024-01-19T22:41:41.564Z1000: a8:40:25:14:9a:69
7592024-01-19T22:41:41.564Z1: a8:40:25:14:9a:6a
7602024-01-19T22:41:41.564Zproxy arp:
7612024-01-19T22:41:41.564Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7622024-01-19T22:41:41.604Z+ retry=0
7632024-01-19T22:41:41.604Z+++ zoneadm list -n
7642024-01-19T22:41:41.604Z+++ grep oxz_ntp
7652024-01-19T22:41:41.605Z++ pfexec svcs -z -Hostate oxide/ntp
7662024-01-19T22:41:41.605Zsvcs: zone '-Hostate': entity not found
7672024-01-19T22:41:41.605Z++ true
7682024-01-19T22:41:41.605Z+ [[ '' != online ]]
7692024-01-19T22:41:41.605Z+ [[ 0 -gt 60 ]]
7702024-01-19T22:41:41.605Z+ sleep 1
7712024-01-19T22:41:42.580Z+ retry=1
7722024-01-19T22:41:42.621Z+++ zoneadm list -n
7732024-01-19T22:41:42.621Z+++ grep oxz_ntp
7742024-01-19T22:41:42.621Z++ pfexec svcs -z -Hostate oxide/ntp
7752024-01-19T22:41:42.621Zsvcs: zone '-Hostate': entity not found
7762024-01-19T22:41:42.621Z++ true
7772024-01-19T22:41:42.622Z+ [[ '' != online ]]
7782024-01-19T22:41:42.622Z+ [[ 1 -gt 60 ]]
7792024-01-19T22:41:42.622Z+ sleep 1
7802024-01-19T22:41:43.602Z+ retry=2
7812024-01-19T22:41:43.643Z+++ zoneadm list -n
7822024-01-19T22:41:43.644Z+++ grep oxz_ntp
7832024-01-19T22:41:43.644Z++ pfexec svcs -z -Hostate oxide/ntp
7842024-01-19T22:41:43.644Zsvcs: zone '-Hostate': entity not found
7852024-01-19T22:41:43.644Z++ true
7862024-01-19T22:41:43.644Z+ [[ '' != online ]]
7872024-01-19T22:41:43.645Z+ [[ 2 -gt 60 ]]
7882024-01-19T22:41:43.646Z+ sleep 1
7892024-01-19T22:41:44.626Z+ retry=3
7902024-01-19T22:41:44.666Z+++ zoneadm list -n
7912024-01-19T22:41:44.667Z+++ grep oxz_ntp
7922024-01-19T22:41:44.667Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
7932024-01-19T22:41:44.707Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7942024-01-19T22:41:44.708Z++ true
7952024-01-19T22:41:44.708Z+ [[ '' != online ]]
7962024-01-19T22:41:44.708Z+ [[ 3 -gt 60 ]]
7972024-01-19T22:41:44.708Z+ sleep 1
7982024-01-19T22:41:45.691Z+ retry=4
7992024-01-19T22:41:45.732Z+++ zoneadm list -n
8002024-01-19T22:41:45.732Z+++ grep oxz_ntp
8012024-01-19T22:41:45.732Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8022024-01-19T22:41:45.732Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8032024-01-19T22:41:45.732Z++ true
8042024-01-19T22:41:45.732Z+ [[ '' != online ]]
8052024-01-19T22:41:45.733Z+ [[ 4 -gt 60 ]]
8062024-01-19T22:41:45.733Z+ sleep 1
8072024-01-19T22:41:46.744Z+ retry=5
8082024-01-19T22:41:46.785Z+++ zoneadm list -n
8092024-01-19T22:41:46.785Z+++ grep oxz_ntp
8102024-01-19T22:41:46.785Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8112024-01-19T22:41:46.786Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8122024-01-19T22:41:46.786Z++ true
8132024-01-19T22:41:46.787Z+ [[ '' != online ]]
8142024-01-19T22:41:46.787Z+ [[ 5 -gt 60 ]]
8152024-01-19T22:41:46.787Z+ sleep 1
8162024-01-19T22:41:47.784Z+ retry=6
8172024-01-19T22:41:47.824Z+++ zoneadm list -n
8182024-01-19T22:41:47.825Z+++ grep oxz_ntp
8192024-01-19T22:41:47.825Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8202024-01-19T22:41:47.825Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8212024-01-19T22:41:47.825Z++ true
8222024-01-19T22:41:47.826Z+ [[ '' != online ]]
8232024-01-19T22:41:47.826Z+ [[ 6 -gt 60 ]]
8242024-01-19T22:41:47.826Z+ sleep 1
8252024-01-19T22:41:48.783Z+ retry=7
8262024-01-19T22:41:48.835Z+++ zoneadm list -n
8272024-01-19T22:41:48.836Z+++ grep oxz_ntp
8282024-01-19T22:41:48.836Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8292024-01-19T22:41:48.836Z+ [[ disabled != online ]]
8302024-01-19T22:41:48.836Z+ [[ 7 -gt 60 ]]
8312024-01-19T22:41:48.836Z+ sleep 1
8322024-01-19T22:41:49.810Z+ retry=8
8332024-01-19T22:41:49.876Z+++ zoneadm list -n
8342024-01-19T22:41:49.877Z+++ grep oxz_ntp
8352024-01-19T22:41:49.877Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8362024-01-19T22:41:49.877Z+ [[ disabled != online ]]
8372024-01-19T22:41:49.877Z+ [[ 8 -gt 60 ]]
8382024-01-19T22:41:49.877Z+ sleep 1
8392024-01-19T22:41:50.832Z+ retry=9
8402024-01-19T22:41:50.874Z+++ zoneadm list -n
8412024-01-19T22:41:50.875Z+++ grep oxz_ntp
8422024-01-19T22:41:50.875Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8432024-01-19T22:41:50.875Z+ [[ disabled != online ]]
8442024-01-19T22:41:50.875Z+ [[ 9 -gt 60 ]]
8452024-01-19T22:41:50.875Z+ sleep 1
8462024-01-19T22:41:51.856Z+ retry=10
8472024-01-19T22:41:51.902Z+++ zoneadm list -n
8482024-01-19T22:41:51.902Z+++ grep oxz_ntp
8492024-01-19T22:41:51.902Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8502024-01-19T22:41:51.902Z+ [[ disabled != online ]]
8512024-01-19T22:41:51.902Z+ [[ 10 -gt 60 ]]
8522024-01-19T22:41:51.902Z+ sleep 1
8532024-01-19T22:41:52.877Z+ retry=11
8542024-01-19T22:41:52.917Z+++ zoneadm list -n
8552024-01-19T22:41:52.918Z+++ grep oxz_ntp
8562024-01-19T22:41:52.918Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8572024-01-19T22:41:52.921Z+ [[ disabled != online ]]
8582024-01-19T22:41:52.921Z+ [[ 11 -gt 60 ]]
8592024-01-19T22:41:52.921Z+ sleep 1
8602024-01-19T22:41:53.898Z+ retry=12
8612024-01-19T22:41:53.938Z+++ zoneadm list -n
8622024-01-19T22:41:53.938Z+++ grep oxz_ntp
8632024-01-19T22:41:53.938Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8642024-01-19T22:41:53.938Z+ [[ disabled != online ]]
8652024-01-19T22:41:53.940Z+ [[ 12 -gt 60 ]]
8662024-01-19T22:41:53.940Z+ sleep 1
 
8672024-01-19T22:41:54.530Zbuskin console login: Jan 19 22:41:53 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8682024-01-19T22:41:54.920Z+ retry=13
8692024-01-19T22:41:54.960Z+++ zoneadm list -n
8702024-01-19T22:41:54.960Z+++ grep oxz_ntp
8712024-01-19T22:41:54.960Z++ pfexec svcs -z oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d -Hostate oxide/ntp
8722024-01-19T22:41:54.960Z+ [[ online != online ]]
8732024-01-19T22:41:54.960Z+ echo 'Waited for chrony: 13s'
8742024-01-19T22:41:54.960Z+ export RUST_BACKTRACE=1
8752024-01-19T22:41:54.961Z+ RUST_BACKTRACE=1
8762024-01-19T22:41:54.961ZWaited for chrony: 13s
8772024-01-19T22:41:54.961Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8782024-01-19T22:41:54.961Z++ ./tests/bootstrap
8792024-01-19T22:41:55.002ZUsing external DNS server at 10.151.1.164:53
8802024-01-19T22:41:55.002Z2024-01-19 22:41:55.055131170 UTC: attempting to log into API
8812024-01-19T22:42:10.009Z2024-01-19 22:42:10.099413540 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8822024-01-19T22:42:11.010Z2024-01-19 22:42:11.101398833 UTC: attempting to log into API
8832024-01-19T22:42:26.046Z2024-01-19 22:42:26.134600047 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8842024-01-19T22:42:27.072Z2024-01-19 22:42:27.136486698 UTC: attempting to log into API
8852024-01-19T22:42:42.084Z2024-01-19 22:42:42.264954 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8862024-01-19T22:42:43.080Z2024-01-19 22:42:43.263297048 UTC: attempting to log into API
8872024-01-19T22:42:58.112Z2024-01-19 22:42:58.256167831 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8882024-01-19T22:42:59.113Z2024-01-19 22:42:59.254201851 UTC: attempting to log into API
8892024-01-19T22:43:14.145Z2024-01-19 22:43:14.245996377 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8902024-01-19T22:43:15.147Z2024-01-19 22:43:15.244267604 UTC: attempting to log into API
8912024-01-19T22:43:30.179Z2024-01-19 22:43:30.236754278 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8922024-01-19T22:43:31.180Z2024-01-19 22:43:31.234853100 UTC: attempting to log into API
8932024-01-19T22:43:46.213Z2024-01-19 22:43:46.226941145 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8942024-01-19T22:43:47.214Z2024-01-19 22:43:47.224994177 UTC: attempting to log into API
8952024-01-19T22:44:02.253Z2024-01-19 22:44:02.231959602 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8962024-01-19T22:44:03.252Z2024-01-19 22:44:03.232597521 UTC: attempting to log into API
8972024-01-19T22:44:18.293Z2024-01-19 22:44:18.273626284 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8982024-01-19T22:44:19.297Z2024-01-19 22:44:19.274625492 UTC: attempting to log into API
 
8992024-01-19T22:44:23.830ZJan 19 22:44:23 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
9002024-01-19T22:44:31.604ZJan 19 22:44:31 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
9012024-01-19T22:44:34.327Z2024-01-19 22:44:34.306877103 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9022024-01-19T22:44:35.328Z2024-01-19 22:44:35.307892922 UTC: attempting to log into API
 
9032024-01-19T22:44:37.793ZJan 19 22:44:37 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
9042024-01-19T22:44:45.319ZJan 19 22:44:44 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
9052024-01-19T22:44:50.360Z2024-01-19 22:44:50.339943602 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9062024-01-19T22:44:51.361Z2024-01-19 22:44:51.340972299 UTC: attempting to log into API
 
9072024-01-19T22:44:52.025ZJan 19 22:44:51 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
9082024-01-19T22:45:06.393Z2024-01-19 22:45:06.373568097 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9092024-01-19T22:45:07.394Z2024-01-19 22:45:07.374468141 UTC: attempting to log into API
9102024-01-19T22:45:08.170Z2024-01-19 22:45:08.150507533 UTC: login succeeded
9112024-01-19T22:45:08.209Zwaiting for nexus to come up...
9122024-01-19T22:45:08.266Zcreating IP pool... 10.151.1.175 - 10.151.1.227
9132024-01-19T22:45:08.440Zsetting up quotas...
9142024-01-19T22:45:08.486Zensuring datasets are ready...
9152024-01-19T22:45:11.120Zlet's roll.
9162024-01-19T22:45:11.160Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
9172024-01-19T22:45:11.160ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9182024-01-19T22:45:11.160ZOXIDE_TOKEN=oxide-token-f728c0b2378ab95f38d1899b92581307d9a550d1'
9192024-01-19T22:45:11.160Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9202024-01-19T22:45:11.160Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9212024-01-19T22:45:11.160Z++ OXIDE_TOKEN=oxide-token-f728c0b2378ab95f38d1899b92581307d9a550d1
9222024-01-19T22:45:11.160Z+ export OXIDE_HOST OXIDE_TOKEN
9232024-01-19T22:45:11.160Z+ retry=0
9242024-01-19T22:45:11.160Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9252024-01-19T22:45:11.217Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9262024-01-19T22:45:11.519Z{"status":"ok"}success
9272024-01-19T22:45:11.519ZProject {
9282024-01-19T22:45:11.519Z description: "some images",
9292024-01-19T22:45:11.521Z id: 24206117-b42d-4d9b-93df-573f9fcdbb45,
9302024-01-19T22:45:11.521Z name: Name(
9312024-01-19T22:45:11.521Z "images",
9322024-01-19T22:45:11.521Z ),
9332024-01-19T22:45:11.560Z time_created: 2024-01-19T22:45:11.278989Z,
9342024-01-19T22:45:11.560Z time_modified: 2024-01-19T22:45:11.278989Z,
9352024-01-19T22:45:11.561Z}
9362024-01-19T22:45:11.561Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
9372024-01-19T22:50:40.192Zdone!
9382024-01-19T22:50:40.286Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9392024-01-19T22:50:40.385Zsuccess
9402024-01-19T22:50:40.385ZImage {
9412024-01-19T22:50:40.385Z block_size: ByteCount(
9422024-01-19T22:50:40.426Z 512,
9432024-01-19T22:50:40.426Z ),
9442024-01-19T22:50:40.427Z description: "debian 11 original base image",
9452024-01-19T22:50:40.427Z digest: None,
9462024-01-19T22:50:40.427Z id: b268b0c1-75de-4cf5-820f-99350859af14,
9472024-01-19T22:50:40.427Z name: Name(
9482024-01-19T22:50:40.427Z "debian11",
9492024-01-19T22:50:40.427Z ),
9502024-01-19T22:50:40.427Z os: "debian",
9512024-01-19T22:50:40.427Z project_id: None,
9522024-01-19T22:50:40.427Z size: ByteCount(
9532024-01-19T22:50:40.427Z 2147483648,
9542024-01-19T22:50:40.427Z ),
9552024-01-19T22:50:40.427Z time_created: 2024-01-19T22:50:40.154954Z,
9562024-01-19T22:50:40.428Z time_modified: 2024-01-19T22:50:40.362966Z,
9572024-01-19T22:50:40.428Z url: None,
9582024-01-19T22:50:40.428Z version: "11",
9592024-01-19T22:50:40.428Z}
9602024-01-19T22:50:40.428Z+ rm ./tests/bootstrap
9612024-01-19T22:50:40.481Z+ for test_bin in tests/*
9622024-01-19T22:50:40.481Z+ ./tests/bootstrap-65f30ecb53223d0e
9632024-01-19T22:50:40.520Z
9642024-01-19T22:50:40.521Zrunning 0 tests
9652024-01-19T22:50:40.521Z
9662024-01-19T22:50:40.521Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9672024-01-19T22:50:40.521Z
9682024-01-19T22:50:40.521Z+ for test_bin in tests/*
9692024-01-19T22:50:40.521Z+ ./tests/end_to_end_tests-02d296ed8b688339
9702024-01-19T22:50:40.627Z
9712024-01-19T22:50:40.627Zrunning 2 tests
9722024-01-19T22:50:40.858Ztest no_spoof::no_spoof_here ... ok
9732024-01-19T22:51:12.259Ztest instance_launch::instance_launch ... ok
9742024-01-19T22:51:12.259Z
9752024-01-19T22:51:12.259Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 31.64s
9762024-01-19T22:51:12.259Z
9772024-01-19T22:51:12.298Z+ _exit_trap
9782024-01-19T22:51:12.298Z+ local status=0
9792024-01-19T22:51:12.298Z+ [[ 0 -eq 0 ]]
9802024-01-19T22:51:12.298Z+ exit 0
9812024-01-19T22:51:12.298Zprocess exited: duration 659174 ms, exit code 0
 
9822024-01-19T22:51:12.456Zfound 105 output files
9832024-01-19T22:51:12.456Zuploading: /var/svc/log/oxide-sled-agent:default.log (1587262 bytes)
9842024-01-19T22:51:14.006Zuploaded: /var/svc/log/oxide-sled-agent:default.log
9852024-01-19T22:51:14.006Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_dbafb604-db57-486c-9605-82817c592181/root/var/svc/log/oxide-clickhouse:default.log (985037 bytes)
9862024-01-19T22:51:15.546Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_dbafb604-db57-486c-9605-82817c592181/root/var/svc/log/oxide-clickhouse:default.log
9872024-01-19T22:51:15.546Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_dbafb604-db57-486c-9605-82817c592181/root/var/svc/log/oxide-clickhouse:default.log.0 (128872 bytes)
9882024-01-19T22:51:16.923Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_dbafb604-db57-486c-9605-82817c592181/root/var/svc/log/oxide-clickhouse:default.log.0
9892024-01-19T22:51:16.923Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_dbafb604-db57-486c-9605-82817c592181/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
9902024-01-19T22:51:18.037Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_dbafb604-db57-486c-9605-82817c592181/root/var/svc/log/oxide-zone-network-setup:default.log
9912024-01-19T22:51:18.076Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_dbafb604-db57-486c-9605-82817c592181/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
9922024-01-19T22:51:19.189Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_dbafb604-db57-486c-9605-82817c592181/root/var/svc/log/oxide-zone-network-setup:default.log.0
9932024-01-19T22:51:19.228Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_df7e169a-aa8f-46fa-b3a0-821387ed6f87/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
9942024-01-19T22:51:20.307Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_df7e169a-aa8f-46fa-b3a0-821387ed6f87/root/var/svc/log/oxide-cockroachdb:default.log
9952024-01-19T22:51:20.307Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_df7e169a-aa8f-46fa-b3a0-821387ed6f87/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
9962024-01-19T22:51:21.469Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_df7e169a-aa8f-46fa-b3a0-821387ed6f87/root/var/svc/log/oxide-cockroachdb:default.log.0
9972024-01-19T22:51:21.469Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_df7e169a-aa8f-46fa-b3a0-821387ed6f87/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
9982024-01-19T22:51:22.584Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_df7e169a-aa8f-46fa-b3a0-821387ed6f87/root/var/svc/log/oxide-zone-network-setup:default.log
9992024-01-19T22:51:22.585Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_df7e169a-aa8f-46fa-b3a0-821387ed6f87/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
10002024-01-19T22:51:23.738Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_df7e169a-aa8f-46fa-b3a0-821387ed6f87/root/var/svc/log/oxide-zone-network-setup:default.log.0
10012024-01-19T22:51:23.780Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-agent:default.log (20927 bytes)
10022024-01-19T22:51:24.973Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-agent:default.log
10032024-01-19T22:51:24.973Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
10042024-01-19T22:51:26.128Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-agent:default.log.0
10052024-01-19T22:51:26.128Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
10062024-01-19T22:51:27.267Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-downstairs:default.log
10072024-01-19T22:51:27.267Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
10082024-01-19T22:51:28.436Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-downstairs:default.log.0
10092024-01-19T22:51:28.437Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-downstairs:downstairs-277db930-89b6-43ba-8615-451ec94203cd.log (5536 bytes)
10102024-01-19T22:51:29.590Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-downstairs:downstairs-277db930-89b6-43ba-8615-451ec94203cd.log
10112024-01-19T22:51:29.590Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-downstairs:downstairs-e70d12fe-61b7-4737-8f56-03b9218046fc.log (3039 bytes)
10122024-01-19T22:51:30.766Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5d0c13a6-a639-4fe6-bff4-3d654abd6307/root/var/svc/log/oxide-crucible-downstairs:downstairs-e70d12fe-61b7-4737-8f56-03b9218046fc.log
10132024-01-19T22:51:30.766Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_5c994547-9945-4f3f-a3fe-a567934ec643/root/var/svc/log/oxide-external_dns:default.log (24389 bytes)
10142024-01-19T22:51:32.658Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_5c994547-9945-4f3f-a3fe-a567934ec643/root/var/svc/log/oxide-external_dns:default.log
10152024-01-19T22:51:32.658Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_5c994547-9945-4f3f-a3fe-a567934ec643/root/var/svc/log/oxide-external_dns:default.log.0 (2553 bytes)
10162024-01-19T22:51:33.815Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_5c994547-9945-4f3f-a3fe-a567934ec643/root/var/svc/log/oxide-external_dns:default.log.0
10172024-01-19T22:51:33.859Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1b98cf87-b499-4275-bc3f-c38edab51a70/root/var/svc/log/oxide-internal_dns:default.log (23781 bytes)
10182024-01-19T22:51:35.046Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1b98cf87-b499-4275-bc3f-c38edab51a70/root/var/svc/log/oxide-internal_dns:default.log
10192024-01-19T22:51:35.046Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1b98cf87-b499-4275-bc3f-c38edab51a70/root/var/svc/log/oxide-internal_dns:default.log.0 (93984 bytes)
10202024-01-19T22:51:36.400Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1b98cf87-b499-4275-bc3f-c38edab51a70/root/var/svc/log/oxide-internal_dns:default.log.0
10212024-01-19T22:51:36.400Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10e924a1-ee54-42f7-8911-0b8bb2cc55cb/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
10222024-01-19T22:51:37.516Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10e924a1-ee54-42f7-8911-0b8bb2cc55cb/root/var/svc/log/oxide-cockroachdb:default.log
10232024-01-19T22:51:37.516Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10e924a1-ee54-42f7-8911-0b8bb2cc55cb/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
10242024-01-19T22:51:38.675Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10e924a1-ee54-42f7-8911-0b8bb2cc55cb/root/var/svc/log/oxide-cockroachdb:default.log.0
10252024-01-19T22:51:38.675Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10e924a1-ee54-42f7-8911-0b8bb2cc55cb/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10262024-01-19T22:51:39.790Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10e924a1-ee54-42f7-8911-0b8bb2cc55cb/root/var/svc/log/oxide-zone-network-setup:default.log
10272024-01-19T22:51:39.790Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10e924a1-ee54-42f7-8911-0b8bb2cc55cb/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
10282024-01-19T22:51:40.974Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10e924a1-ee54-42f7-8911-0b8bb2cc55cb/root/var/svc/log/oxide-zone-network-setup:default.log.0
10292024-01-19T22:51:40.974Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-agent:default.log (16717 bytes)
10302024-01-19T22:51:42.694Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-agent:default.log
10312024-01-19T22:51:42.695Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
10322024-01-19T22:51:44.032Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-agent:default.log.0
10332024-01-19T22:51:44.032Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
10342024-01-19T22:51:45.191Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-downstairs:default.log
10352024-01-19T22:51:45.191Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
10362024-01-19T22:51:46.391Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-downstairs:default.log.0
10372024-01-19T22:51:46.391Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-downstairs:downstairs-2bbe1e43-6e31-4b2e-a735-09d9cb68d293.log (5596 bytes)
10382024-01-19T22:51:47.560Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-downstairs:downstairs-2bbe1e43-6e31-4b2e-a735-09d9cb68d293.log
10392024-01-19T22:51:47.603Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-downstairs:snapshot-2bbe1e43-6e31-4b2e-a735-09d9cb68d293-51018181-b20e-4ea3-a647-3533f62d051e.log (5180 bytes)
10402024-01-19T22:51:48.729Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7f146366-9ff8-4f5f-a95b-ab45f7d369c0/root/var/svc/log/oxide-crucible-downstairs:snapshot-2bbe1e43-6e31-4b2e-a735-09d9cb68d293-51018181-b20e-4ea3-a647-3533f62d051e.log
10412024-01-19T22:51:48.729Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c78f0b87-cec7-49f0-9941-ffd178ce9c91/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
10422024-01-19T22:51:50.074Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c78f0b87-cec7-49f0-9941-ffd178ce9c91/root/var/svc/log/oxide-crucible-pantry:default.log
10432024-01-19T22:51:50.074Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c78f0b87-cec7-49f0-9941-ffd178ce9c91/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
10442024-01-19T22:51:52.012Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c78f0b87-cec7-49f0-9941-ffd178ce9c91/root/var/svc/log/oxide-crucible-pantry:default.log.0
10452024-01-19T22:51:52.012Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b7b1be54-d72a-4680-bbf0-bb4ec9a810a7/root/var/svc/log/oxide-external_dns:default.log (24395 bytes)
10462024-01-19T22:51:52.513Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b7b1be54-d72a-4680-bbf0-bb4ec9a810a7/root/var/svc/log/oxide-external_dns:default.log
10472024-01-19T22:51:52.514Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b7b1be54-d72a-4680-bbf0-bb4ec9a810a7/root/var/svc/log/oxide-external_dns:default.log.0 (2553 bytes)
10482024-01-19T22:51:53.676Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_b7b1be54-d72a-4680-bbf0-bb4ec9a810a7/root/var/svc/log/oxide-external_dns:default.log.0
10492024-01-19T22:51:53.676Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7516dba4-cab3-45fa-b33f-fb639159e075/root/var/svc/log/oxide-internal_dns:default.log (23782 bytes)
10502024-01-19T22:51:53.828Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7516dba4-cab3-45fa-b33f-fb639159e075/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 23782 -> 27535
10512024-01-19T22:51:54.960Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7516dba4-cab3-45fa-b33f-fb639159e075/root/var/svc/log/oxide-internal_dns:default.log
10522024-01-19T22:51:54.960Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7516dba4-cab3-45fa-b33f-fb639159e075/root/var/svc/log/oxide-internal_dns:default.log.0 (93163 bytes)
10532024-01-19T22:51:56.304Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7516dba4-cab3-45fa-b33f-fb639159e075/root/var/svc/log/oxide-internal_dns:default.log.0
10542024-01-19T22:51:56.304Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f57d8b70-95ce-4988-bbe6-9330d2564bed/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
10552024-01-19T22:51:57.516Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f57d8b70-95ce-4988-bbe6-9330d2564bed/root/var/svc/log/oxide-cockroachdb:default.log
10562024-01-19T22:51:57.516Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f57d8b70-95ce-4988-bbe6-9330d2564bed/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
10572024-01-19T22:51:58.679Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f57d8b70-95ce-4988-bbe6-9330d2564bed/root/var/svc/log/oxide-cockroachdb:default.log.0
10582024-01-19T22:51:58.680Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f57d8b70-95ce-4988-bbe6-9330d2564bed/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10592024-01-19T22:51:59.817Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f57d8b70-95ce-4988-bbe6-9330d2564bed/root/var/svc/log/oxide-zone-network-setup:default.log
10602024-01-19T22:51:59.817Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f57d8b70-95ce-4988-bbe6-9330d2564bed/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
10612024-01-19T22:52:00.957Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_f57d8b70-95ce-4988-bbe6-9330d2564bed/root/var/svc/log/oxide-zone-network-setup:default.log.0
10622024-01-19T22:52:00.957Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-agent:default.log (20502 bytes)
10632024-01-19T22:52:02.151Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-agent:default.log
10642024-01-19T22:52:02.151Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
10652024-01-19T22:52:03.312Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-agent:default.log.0
10662024-01-19T22:52:03.312Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
10672024-01-19T22:52:04.428Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-downstairs:default.log
10682024-01-19T22:52:04.428Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
10692024-01-19T22:52:05.639Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-downstairs:default.log.0
10702024-01-19T22:52:05.639Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-downstairs:downstairs-a1a97cff-34b1-4b5e-87e9-e59825334c42.log (3037 bytes)
10712024-01-19T22:52:06.803Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-downstairs:downstairs-a1a97cff-34b1-4b5e-87e9-e59825334c42.log
10722024-01-19T22:52:06.803Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-downstairs:downstairs-f8edd565-c9ae-4861-842e-84e128c8bd4a.log (5532 bytes)
10732024-01-19T22:52:07.962Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_75ab9e64-ab77-455b-8474-508158432862/root/var/svc/log/oxide-crucible-downstairs:downstairs-f8edd565-c9ae-4861-842e-84e128c8bd4a.log
10742024-01-19T22:52:07.962Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_00322514-d9eb-4d4c-9182-710dc5fae5ae/root/var/svc/log/oxide-internal_dns:default.log (23780 bytes)
10752024-01-19T22:52:08.113Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_00322514-d9eb-4d4c-9182-710dc5fae5ae/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 23780 -> 27534
10762024-01-19T22:52:09.232Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_00322514-d9eb-4d4c-9182-710dc5fae5ae/root/var/svc/log/oxide-internal_dns:default.log
10772024-01-19T22:52:09.232Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_00322514-d9eb-4d4c-9182-710dc5fae5ae/root/var/svc/log/oxide-internal_dns:default.log.0 (90409 bytes)
10782024-01-19T22:52:10.741Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_00322514-d9eb-4d4c-9182-710dc5fae5ae/root/var/svc/log/oxide-internal_dns:default.log.0
10792024-01-19T22:52:10.741Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_9b83d938-3da7-4aff-87ea-2c78e743fc0d/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
10802024-01-19T22:52:11.852Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_9b83d938-3da7-4aff-87ea-2c78e743fc0d/root/var/svc/log/oxide-cockroachdb:default.log
10812024-01-19T22:52:11.852Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_9b83d938-3da7-4aff-87ea-2c78e743fc0d/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
10822024-01-19T22:52:13.047Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_9b83d938-3da7-4aff-87ea-2c78e743fc0d/root/var/svc/log/oxide-cockroachdb:default.log.0
10832024-01-19T22:52:13.047Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_9b83d938-3da7-4aff-87ea-2c78e743fc0d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
10842024-01-19T22:52:14.293Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_9b83d938-3da7-4aff-87ea-2c78e743fc0d/root/var/svc/log/oxide-zone-network-setup:default.log
10852024-01-19T22:52:14.295Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_9b83d938-3da7-4aff-87ea-2c78e743fc0d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1705 bytes)
10862024-01-19T22:52:16.257Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_9b83d938-3da7-4aff-87ea-2c78e743fc0d/root/var/svc/log/oxide-zone-network-setup:default.log.0
10872024-01-19T22:52:16.257Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_71605134-5aaa-4e3b-bba0-d1bdeeee5cda/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
10882024-01-19T22:52:17.308Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_71605134-5aaa-4e3b-bba0-d1bdeeee5cda/root/var/svc/log/oxide-crucible-agent:default.log
10892024-01-19T22:52:17.347Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_71605134-5aaa-4e3b-bba0-d1bdeeee5cda/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
10902024-01-19T22:52:18.465Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_71605134-5aaa-4e3b-bba0-d1bdeeee5cda/root/var/svc/log/oxide-crucible-agent:default.log.0
10912024-01-19T22:52:18.511Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_71605134-5aaa-4e3b-bba0-d1bdeeee5cda/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
10922024-01-19T22:52:19.582Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_71605134-5aaa-4e3b-bba0-d1bdeeee5cda/root/var/svc/log/oxide-crucible-downstairs:default.log
10932024-01-19T22:52:19.582Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_71605134-5aaa-4e3b-bba0-d1bdeeee5cda/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
10942024-01-19T22:52:20.739Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_71605134-5aaa-4e3b-bba0-d1bdeeee5cda/root/var/svc/log/oxide-crucible-downstairs:default.log.0
10952024-01-19T22:52:20.739Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_4fa81241-4f28-4edc-b0e4-5ff8d907e440/root/var/svc/log/oxide-nexus:default.log (605013 bytes)
10962024-01-19T22:52:21.204Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_4fa81241-4f28-4edc-b0e4-5ff8d907e440/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 605013 -> 677581
10972024-01-19T22:52:22.321Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_4fa81241-4f28-4edc-b0e4-5ff8d907e440/root/var/svc/log/oxide-nexus:default.log
10982024-01-19T22:52:22.321Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_4fa81241-4f28-4edc-b0e4-5ff8d907e440/root/var/svc/log/oxide-nexus:default.log.0 (450579 bytes)
10992024-01-19T22:52:23.777Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_4fa81241-4f28-4edc-b0e4-5ff8d907e440/root/var/svc/log/oxide-nexus:default.log.0
11002024-01-19T22:52:23.777Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_f89a01cf-2c14-4249-853f-71c35fc9b6b1/root/var/svc/log/oxide-nexus:default.log (589622 bytes)
11012024-01-19T22:52:24.198Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_f89a01cf-2c14-4249-853f-71c35fc9b6b1/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 589622 -> 667854
11022024-01-19T22:52:25.313Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_f89a01cf-2c14-4249-853f-71c35fc9b6b1/root/var/svc/log/oxide-nexus:default.log
11032024-01-19T22:52:25.313Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_f89a01cf-2c14-4249-853f-71c35fc9b6b1/root/var/svc/log/oxide-nexus:default.log.0 (290776 bytes)
11042024-01-19T22:52:26.732Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_f89a01cf-2c14-4249-853f-71c35fc9b6b1/root/var/svc/log/oxide-nexus:default.log.0
11052024-01-19T22:52:26.778Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b2659ce6-f2f1-401d-b5b7-17f9c7310fb2/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11062024-01-19T22:52:27.860Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b2659ce6-f2f1-401d-b5b7-17f9c7310fb2/root/var/svc/log/oxide-cockroachdb:default.log
11072024-01-19T22:52:27.900Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b2659ce6-f2f1-401d-b5b7-17f9c7310fb2/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
11082024-01-19T22:52:29.100Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b2659ce6-f2f1-401d-b5b7-17f9c7310fb2/root/var/svc/log/oxide-cockroachdb:default.log.0
11092024-01-19T22:52:29.143Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b2659ce6-f2f1-401d-b5b7-17f9c7310fb2/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11102024-01-19T22:52:30.217Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b2659ce6-f2f1-401d-b5b7-17f9c7310fb2/root/var/svc/log/oxide-zone-network-setup:default.log
11112024-01-19T22:52:30.217Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b2659ce6-f2f1-401d-b5b7-17f9c7310fb2/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1706 bytes)
11122024-01-19T22:52:31.408Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_b2659ce6-f2f1-401d-b5b7-17f9c7310fb2/root/var/svc/log/oxide-zone-network-setup:default.log.0
11132024-01-19T22:52:31.459Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-agent:default.log (6358 bytes)
11142024-01-19T22:52:32.590Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-agent:default.log
11152024-01-19T22:52:32.591Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11162024-01-19T22:52:33.803Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-agent:default.log.0
11172024-01-19T22:52:33.842Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11182024-01-19T22:52:34.907Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-downstairs:default.log
11192024-01-19T22:52:34.907Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11202024-01-19T22:52:36.062Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11212024-01-19T22:52:36.063Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-downstairs:downstairs-0adc8fec-f323-4ae7-8c5f-38c720c5183e.log (2943 bytes)
11222024-01-19T22:52:37.237Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_9ab1cc73-5ddc-44db-9642-66ad5203ef70/root/var/svc/log/oxide-crucible-downstairs:downstairs-0adc8fec-f323-4ae7-8c5f-38c720c5183e.log
11232024-01-19T22:52:37.237Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_d7d109ec-98c1-4633-aba6-b6805122a2a5/root/var/svc/log/oxide-oximeter:default.log (284869 bytes)
11242024-01-19T22:52:37.620Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_d7d109ec-98c1-4633-aba6-b6805122a2a5/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 284869 -> 350854
11252024-01-19T22:52:38.737Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_d7d109ec-98c1-4633-aba6-b6805122a2a5/root/var/svc/log/oxide-oximeter:default.log
11262024-01-19T22:52:38.777Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_d7d109ec-98c1-4633-aba6-b6805122a2a5/root/var/svc/log/oxide-oximeter:default.log.0 (12840 bytes)
11272024-01-19T22:52:39.932Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_d7d109ec-98c1-4633-aba6-b6805122a2a5/root/var/svc/log/oxide-oximeter:default.log.0
11282024-01-19T22:52:39.932Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f3ab5ac6-2248-4aa8-99a3-4a2fd4c64ef6/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
11292024-01-19T22:52:41.047Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f3ab5ac6-2248-4aa8-99a3-4a2fd4c64ef6/root/var/svc/log/oxide-crucible-agent:default.log
11302024-01-19T22:52:41.047Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f3ab5ac6-2248-4aa8-99a3-4a2fd4c64ef6/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11312024-01-19T22:52:42.202Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f3ab5ac6-2248-4aa8-99a3-4a2fd4c64ef6/root/var/svc/log/oxide-crucible-agent:default.log.0
11322024-01-19T22:52:42.202Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f3ab5ac6-2248-4aa8-99a3-4a2fd4c64ef6/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11332024-01-19T22:52:43.317Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f3ab5ac6-2248-4aa8-99a3-4a2fd4c64ef6/root/var/svc/log/oxide-crucible-downstairs:default.log
11342024-01-19T22:52:43.317Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f3ab5ac6-2248-4aa8-99a3-4a2fd4c64ef6/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11352024-01-19T22:52:44.474Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f3ab5ac6-2248-4aa8-99a3-4a2fd4c64ef6/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11362024-01-19T22:52:44.474Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_990d064b-344a-47b8-808d-25cdd0424350/root/var/svc/log/oxide-crucible-pantry:default.log (1212238 bytes)
11372024-01-19T22:52:45.015Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_990d064b-344a-47b8-808d-25cdd0424350/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 1212238 -> 1243930
11382024-01-19T22:52:46.135Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_990d064b-344a-47b8-808d-25cdd0424350/root/var/svc/log/oxide-crucible-pantry:default.log
11392024-01-19T22:52:46.135Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_990d064b-344a-47b8-808d-25cdd0424350/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2337 bytes)
11402024-01-19T22:52:47.291Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_990d064b-344a-47b8-808d-25cdd0424350/root/var/svc/log/oxide-crucible-pantry:default.log.0
11412024-01-19T22:52:47.291Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_ac3356ba-788e-475f-bcd7-fa4806b3a839/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
11422024-01-19T22:52:48.406Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_ac3356ba-788e-475f-bcd7-fa4806b3a839/root/var/svc/log/oxide-crucible-pantry:default.log
11432024-01-19T22:52:48.406Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_ac3356ba-788e-475f-bcd7-fa4806b3a839/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2333 bytes)
11442024-01-19T22:52:49.560Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_ac3356ba-788e-475f-bcd7-fa4806b3a839/root/var/svc/log/oxide-crucible-pantry:default.log.0
11452024-01-19T22:52:49.560Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/svc/log/oxide-ntp:default.log (64 bytes)
11462024-01-19T22:52:50.714Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/svc/log/oxide-ntp:default.log
11472024-01-19T22:52:50.714Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/svc/log/oxide-ntp:default.log.0 (1384 bytes)
11482024-01-19T22:52:51.877Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/svc/log/oxide-ntp:default.log.0
11492024-01-19T22:52:51.917Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-agent:default.log (16281 bytes)
11502024-01-19T22:52:53.109Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-agent:default.log
11512024-01-19T22:52:53.152Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11522024-01-19T22:52:54.267Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-agent:default.log.0
11532024-01-19T22:52:54.267Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11542024-01-19T22:52:55.419Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-downstairs:default.log
11552024-01-19T22:52:55.459Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11562024-01-19T22:52:56.603Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11572024-01-19T22:52:56.649Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-downstairs:downstairs-a0f93457-bdb1-4b81-a24b-074e9be1e07b.log (5599 bytes)
11582024-01-19T22:52:57.764Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-downstairs:downstairs-a0f93457-bdb1-4b81-a24b-074e9be1e07b.log
11592024-01-19T22:52:57.764Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-downstairs:snapshot-a0f93457-bdb1-4b81-a24b-074e9be1e07b-51018181-b20e-4ea3-a647-3533f62d051e.log (5177 bytes)
11602024-01-19T22:52:58.920Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_746985b2-4715-4427-b7ae-eae928ee32a3/root/var/svc/log/oxide-crucible-downstairs:snapshot-a0f93457-bdb1-4b81-a24b-074e9be1e07b-51018181-b20e-4ea3-a647-3533f62d051e.log
11612024-01-19T22:52:59.016Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_201dc76f-6b70-4c3d-a73b-2f5afede6248/root/var/svc/log/oxide-nexus:default.log (34793941 bytes)
11622024-01-19T22:53:07.518Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_201dc76f-6b70-4c3d-a73b-2f5afede6248/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 34793941 -> 34943259
11632024-01-19T22:53:08.633Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_201dc76f-6b70-4c3d-a73b-2f5afede6248/root/var/svc/log/oxide-nexus:default.log
11642024-01-19T22:53:08.633Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_201dc76f-6b70-4c3d-a73b-2f5afede6248/root/var/svc/log/oxide-nexus:default.log.0 (882540 bytes)
11652024-01-19T22:53:10.179Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_201dc76f-6b70-4c3d-a73b-2f5afede6248/root/var/svc/log/oxide-nexus:default.log.0
11662024-01-19T22:53:10.179Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-agent:default.log (16602 bytes)
11672024-01-19T22:53:11.477Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-agent:default.log
11682024-01-19T22:53:11.519Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11692024-01-19T22:53:12.631Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-agent:default.log.0
11702024-01-19T22:53:12.631Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11712024-01-19T22:53:13.750Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-downstairs:default.log
11722024-01-19T22:53:13.750Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11732024-01-19T22:53:14.903Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11742024-01-19T22:53:14.904Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-6c221fc6-cbbf-4c4a-b6d9-53823a3fc388.log (3038 bytes)
11752024-01-19T22:53:16.061Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-6c221fc6-cbbf-4c4a-b6d9-53823a3fc388.log
11762024-01-19T22:53:16.062Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-ec60c9d8-7927-43cd-845e-4f4de4ee8eb7.log (2944 bytes)
11772024-01-19T22:53:17.216Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c6778fb4-5def-422b-9845-01904a30e0d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-ec60c9d8-7927-43cd-845e-4f4de4ee8eb7.log
11782024-01-19T22:53:17.217Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-agent:default.log (30284 bytes)
11792024-01-19T22:53:18.484Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-agent:default.log
11802024-01-19T22:53:18.523Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-agent:default.log.0 (3434 bytes)
11812024-01-19T22:53:19.638Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-agent:default.log.0
11822024-01-19T22:53:19.681Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11832024-01-19T22:53:20.753Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:default.log
11842024-01-19T22:53:20.753Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11852024-01-19T22:53:21.921Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11862024-01-19T22:53:21.921Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:downstairs-4f70a6f6-b3b4-4977-9d62-5317a42fa5dd.log (2944 bytes)
11872024-01-19T22:53:23.076Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:downstairs-4f70a6f6-b3b4-4977-9d62-5317a42fa5dd.log
11882024-01-19T22:53:23.116Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:downstairs-6d43d74f-f9b9-438f-9ef9-4e7ffce45480.log (5600 bytes)
11892024-01-19T22:53:24.229Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:downstairs-6d43d74f-f9b9-438f-9ef9-4e7ffce45480.log
11902024-01-19T22:53:24.229Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:downstairs-7d690b81-6b17-4708-b370-d02a7d00d28a.log (5535 bytes)
11912024-01-19T22:53:25.384Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:downstairs-7d690b81-6b17-4708-b370-d02a7d00d28a.log
11922024-01-19T22:53:25.385Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:snapshot-6d43d74f-f9b9-438f-9ef9-4e7ffce45480-51018181-b20e-4ea3-a647-3533f62d051e.log (5177 bytes)
11932024-01-19T22:53:26.610Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_9201a96a-7e67-4a94-911a-19660f20d38c/root/var/svc/log/oxide-crucible-downstairs:snapshot-6d43d74f-f9b9-438f-9ef9-4e7ffce45480-51018181-b20e-4ea3-a647-3533f62d051e.log
11942024-01-19T22:53:26.649Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/measurements.log (22057 bytes)
11952024-01-19T22:53:26.761Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/measurements.log" changed size mid upload: 22057 -> 26578
11962024-01-19T22:53:27.879Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/measurements.log
11972024-01-19T22:53:27.879Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/statistics.log (14859 bytes)
11982024-01-19T22:53:28.029Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/statistics.log" changed size mid upload: 14859 -> 18603
11992024-01-19T22:53:29.145Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/statistics.log
12002024-01-19T22:53:29.145Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/tracking.log (2251 bytes)
12012024-01-19T22:53:29.221Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/tracking.log" changed size mid upload: 2251 -> 2515
12022024-01-19T22:53:30.337Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_cd3dd295-7c94-4676-a613-40eff44daa0d/root/var/log/chrony/tracking.log