01HQQTVY11D47X0VR8SYYACNBY: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HQQTWCE2SFC1MAXVN1FRVJH1

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-28T13:04:18.674Zjob dependencies complete; ready to run (waiting for 37 m 51 s)
22024-02-28T13:09:56.574Zjob assigned to worker 01HQQX1WR0824DQY7XG6GBTNJB (queued for 5 m 37 s)
32024-02-28T13:09:56.876Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-02-28T13:09:57.005Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-02-28T13:09:57.039Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-02-28T13:09:57.073Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-02-28T13:09:57.113Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-02-28T13:09:57.151ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-02-28T13:09:57.184Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-02-28T13:09:57.218ZOxide Helios Version helios-2.0.22451 64-bit
112024-02-28T13:09:57.251ZConfiguring devices.
122024-02-28T13:09:57.295Z##################################################
132024-02-28T13:09:57.329Z#### ############# ##
142024-02-28T13:09:57.363Z### ### ############ ##
152024-02-28T13:09:57.396Z## ### # ## ### ## Oxide Computer Company ##
162024-02-28T13:09:57.429Z## ## ## ### # ### ##
172024-02-28T13:09:57.463Z## # ### #### #### This Station Under ##
182024-02-28T13:09:57.496Z### ### #### # ### Computer Control ##
192024-02-28T13:09:57.529Z#### #### ### ## ##
202024-02-28T13:09:57.563Z##################################################
212024-02-28T13:09:57.596ZHostname: buskin
222024-02-28T13:09:57.630ZLoading smf(7) service descriptions:
232024-02-28T13:09:57.841Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-4050ce4c33c23f6c.gz
242024-02-28T13:09:59.814Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-4050ce4c33c23f6c.gz
252024-02-28T13:09:59.839Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-02-28T13:10:19.411Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-02-28T13:10:19.436Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a664735483201555.gz
282024-02-28T13:10:39.213Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a664735483201555.gz
292024-02-28T13:10:39.237Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-02-28T13:10:40.043Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-02-28T13:10:40.067Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-02-28T13:10:42.957Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-02-28T13:10:42.982Zdownloading input: /input/package/work/version.txt
342024-02-28T13:10:43.006Zdownloaded input: /input/package/work/version.txt
352024-02-28T13:10:43.006Zdownloading input: /input/package/work/package.tar.gz
362024-02-28T13:10:58.089Zdownloaded input: /input/package/work/package.tar.gz
372024-02-28T13:10:58.089Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-02-28T13:11:20.014Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-02-28T13:11:20.038Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-02-28T13:11:26.812Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-02-28T13:11:26.841Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-02-28T13:12:00.295Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-02-28T13:12:00.320Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-02-28T13:12:33.901Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-02-28T13:12:33.927Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-02-28T13:12:56.533Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-02-28T13:12:56.533Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
482024-02-28T13:13:01.393Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
492024-02-28T13:13:01.393Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
502024-02-28T13:13:08.285Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
512024-02-28T13:13:08.285Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-02-28T13:13:14.597Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-02-28T13:13:14.624Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-02-28T13:13:18.678Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-02-28T13:13:18.703Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-02-28T13:13:18.736Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-02-28T13:13:18.760Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-02-28T13:13:22.515Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-02-28T13:13:22.515Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-02-28T13:13:26.031Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-02-28T13:13:26.056Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-02-28T13:13:40.892Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-02-28T13:13:40.892Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-02-28T13:13:55.694Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-02-28T13:13:55.694Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-02-28T13:13:55.760Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-02-28T13:13:55.760Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-02-28T13:14:05.213Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-02-28T13:14:05.214Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-02-28T13:14:16.501Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-02-28T13:14:16.501Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-02-28T13:15:04.649Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-02-28T13:15:04.649Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-02-28T13:15:41.435Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-02-28T13:15:41.460Zstarting task 0: "setup"
762024-02-28T13:15:41.460Z++ uname -s
772024-02-28T13:15:41.461Z+ kern=SunOS
782024-02-28T13:15:41.461Z+ case "$kern" in
792024-02-28T13:15:41.461Z+ groupadd -g 12345 build
802024-02-28T13:15:41.461Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-02-28T13:15:43.453Z+ zfs create -o mountpoint=/work rpool/work
822024-02-28T13:15:43.489Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-02-28T13:15:43.514Z+ home_fs=zfs
842024-02-28T13:15:43.514Z+ [[ zfs == autofs ]]
852024-02-28T13:15:43.514Z+ mkdir -p /home/build
862024-02-28T13:15:43.514Z+ chown build:build /home/build /work
872024-02-28T13:15:45.493Z+ chmod 0700 /home/build /work
882024-02-28T13:15:45.520Zprocess exited: duration 4058 ms, exit code 0
 
892024-02-28T13:15:45.571Zstarting task 1: "authentication"
902024-02-28T13:15:45.617Zprocess exited: duration 45 ms, exit code 0
 
912024-02-28T13:15:45.667Zstarting task 2: "build"
922024-02-28T13:15:45.692Z+ trap _exit_trap EXIT
932024-02-28T13:15:45.693Z+ set +x
942024-02-28T13:16:11.259Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-02-28T13:16:11.503Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-02-28T13:16:11.503Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-02-28T13:16:11.529Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-02-28T13:16:11.529Z+ [[ -d /opt/oxide ]]
1072024-02-28T13:16:11.529Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-02-28T13:16:11.529Z+ pfexec mkdir /opt/oxide
1092024-02-28T13:16:11.529Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-02-28T13:16:11.529Z+ [[ -d /opt/oxide-underneath ]]
1112024-02-28T13:16:11.529Z+ cd /opt/oxide-underneath
1122024-02-28T13:16:11.529Z+ pfexec tar ceEp@/f - .
1132024-02-28T13:16:11.529Z+ cd /opt/oxide
1142024-02-28T13:16:11.529Z+ pfexec tar xveEp@/f -
1152024-02-28T13:16:11.563Zx ., 0 bytes, 0 tape blocks
1162024-02-28T13:16:11.563Zx ./opte, 0 bytes, 0 tape blocks
1172024-02-28T13:16:11.563Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-02-28T13:16:11.563Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-02-28T13:16:11.588Z+ pfexec rm -rf /opt/oxide-underneath
1202024-02-28T13:16:11.588Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-02-28T13:16:11.613Z+ pfexec mkdir /opt/oxide/work
1222024-02-28T13:16:11.613Z+ pfexec chown build:build /opt/oxide/work
1232024-02-28T13:16:11.613Z+ cd /opt/oxide/work
1242024-02-28T13:16:11.613Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-02-28T13:16:13.319ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-02-28T13:16:13.319Zx out/mg-ddm-gz.tar, 67661824 bytes, 132152 tape blocks
1272024-02-28T13:16:13.319Zx out/omicron-sled-agent.tar, 123037696 bytes, 240308 tape blocks
1282024-02-28T13:16:13.320Zx out/oxlog.tar, 8557568 bytes, 16714 tape blocks
1292024-02-28T13:16:13.320Zx out/target/test, 75 bytes, 1 tape blocks
1302024-02-28T13:16:13.320Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-02-28T13:16:13.320Zx package-manifest.toml, 25053 bytes, 49 tape blocks
1322024-02-28T13:16:13.320Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-02-28T13:16:13.320Zx target/release/omicron-package, 45888536 bytes, 89627 tape blocks
1342024-02-28T13:16:13.320Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-02-28T13:16:13.320Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-02-28T13:16:13.320Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-02-28T13:16:13.320Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-02-28T13:16:13.320Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-02-28T13:16:13.320Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-02-28T13:16:13.320Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-02-28T13:16:13.345Z
1422024-02-28T13:16:13.345Zreal 1.716671646
1432024-02-28T13:16:13.345Zuser 1.540298045
1442024-02-28T13:16:13.345Zsys 0.309122795
1452024-02-28T13:16:13.345Ztrap 0.000057271
1462024-02-28T13:16:13.345Ztflt 0.000000000
1472024-02-28T13:16:13.345Zdflt 0.000000000
1482024-02-28T13:16:13.346Zkflt 0.000000000
1492024-02-28T13:16:13.346Zlock 0.000000000
1502024-02-28T13:16:13.346Zslp 1.542476219
1512024-02-28T13:16:13.346Zlat 0.039122559
1522024-02-28T13:16:13.346Zstop 0.000126453
1532024-02-28T13:16:13.346Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-02-28T13:16:14.556Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-02-28T13:16:14.581Z+ mkdir tests
1562024-02-28T13:16:14.581Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-02-28T13:16:14.581Z+ ptime -m gunzip
1582024-02-28T13:16:14.581Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-4050ce4c33c23f6c
1592024-02-28T13:16:14.812Z
1602024-02-28T13:16:14.837Zreal 0.230450781
1612024-02-28T13:16:14.837Zuser 0.213591484
1622024-02-28T13:16:14.837Zsys 0.016600349
1632024-02-28T13:16:14.837Ztrap 0.000018360
1642024-02-28T13:16:14.837Ztflt 0.000000000
1652024-02-28T13:16:14.837Zdflt 0.000000000
1662024-02-28T13:16:14.837Zkflt 0.000000000
1672024-02-28T13:16:14.837Zlock 0.000000000
1682024-02-28T13:16:14.837Zslp 0.000019090
1692024-02-28T13:16:14.837Zlat 0.000024270
1702024-02-28T13:16:14.837Zstop 0.000131423
1712024-02-28T13:16:14.837Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-4050ce4c33c23f6c
1722024-02-28T13:16:14.837Z+ chmod a+x tests/bootstrap-4050ce4c33c23f6c
1732024-02-28T13:16:14.837Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-02-28T13:16:14.837Z+ ptime -m gunzip
1752024-02-28T13:16:14.837Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-02-28T13:16:17.317Z
1772024-02-28T13:16:17.344Zreal 2.495056162
1782024-02-28T13:16:17.344Zuser 2.356435037
1792024-02-28T13:16:17.344Zsys 0.138190233
1802024-02-28T13:16:17.344Ztrap 0.000206046
1812024-02-28T13:16:17.345Ztflt 0.000000000
1822024-02-28T13:16:17.345Zdflt 0.000000000
1832024-02-28T13:16:17.345Zkflt 0.000000000
1842024-02-28T13:16:17.345Zlock 0.000000000
1852024-02-28T13:16:17.345Zslp 0.000012930
1862024-02-28T13:16:17.345Zlat 0.000025820
1872024-02-28T13:16:17.345Zstop 0.000125973
1882024-02-28T13:16:17.345Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-02-28T13:16:17.345Z+ chmod a+x tests/bootstrap
1902024-02-28T13:16:17.345Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-02-28T13:16:17.345Z+ ptime -m gunzip
1922024-02-28T13:16:17.345Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a664735483201555
1932024-02-28T13:16:19.901Z
1942024-02-28T13:16:19.929Zreal 2.570967860
1952024-02-28T13:16:19.929Zuser 2.419705114
1962024-02-28T13:16:19.929Zsys 0.150812731
1972024-02-28T13:16:19.929Ztrap 0.000201997
1982024-02-28T13:16:19.929Ztflt 0.000000000
1992024-02-28T13:16:19.929Zdflt 0.000000000
2002024-02-28T13:16:19.929Zkflt 0.000000000
2012024-02-28T13:16:19.929Zlock 0.000000000
2022024-02-28T13:16:19.929Zslp 0.000023140
2032024-02-28T13:16:19.929Zlat 0.000023300
2042024-02-28T13:16:19.929Zstop 0.000131903
2052024-02-28T13:16:19.929Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a664735483201555
2062024-02-28T13:16:19.929Z+ chmod a+x tests/end_to_end_tests-a664735483201555
2072024-02-28T13:16:19.929Z+ bmat address ls
2082024-02-28T13:16:19.929ZNAME CIDR FIRST LAST COUNT
2092024-02-28T13:16:19.929Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-02-28T13:16:19.929Z++ bmat address ls -f extra -Ho first,last,count
2112024-02-28T13:16:19.955Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-02-28T13:16:19.955Z+ EXTRA_IP_START=10.151.1.164
2132024-02-28T13:16:19.955Z+ EXTRA_IP_END=10.151.1.227
2142024-02-28T13:16:19.955Z+ EXTRA_IP_COUNT=64
2152024-02-28T13:16:19.955Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-02-28T13:16:19.955Z+ EXTRA_IP_BASE=10.151.1
2172024-02-28T13:16:19.955Z+ EXTRA_IP_FOCTET=164
2182024-02-28T13:16:19.955Z+ EXTRA_IP_LOCTET=227
2192024-02-28T13:16:19.955Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-02-28T13:16:19.955Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-02-28T13:16:19.955Z+ DNS_IP1=10.151.1.164
2222024-02-28T13:16:19.955Z+ DNS_IP2=10.151.1.165
2232024-02-28T13:16:19.955Z+ UPLINK_IP=10.151.1.174
2242024-02-28T13:16:19.955Z+ IPPOOL_START=10.151.1.175
2252024-02-28T13:16:19.955Z+ IPPOOL_END=10.151.1.227
2262024-02-28T13:16:19.956Z++ ipadm show-addr -po type,addr
2272024-02-28T13:16:19.956Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-02-28T13:16:19.956Z+ GATEWAY_IP=10.151.1.100
2292024-02-28T13:16:19.956Z+ [[ -n 10.151.1.100 ]]
2302024-02-28T13:16:19.956Z+ ping -s 10.151.1.100 56 1
2312024-02-28T13:16:19.956ZPING 10.151.1.100: 56 data bytes
2322024-02-28T13:16:19.956Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.013 ms
2332024-02-28T13:16:19.956Z
2342024-02-28T13:16:19.956Z----10.151.1.100 PING Statistics----
2352024-02-28T13:16:19.956Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-02-28T13:16:19.956Zround-trip (ms) min/avg/max/stddev = 0.013/0.013/0.013/-nan
2372024-02-28T13:16:19.956Z++ arp -an
2382024-02-28T13:16:19.956Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-02-28T13:16:19.956Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-02-28T13:16:19.956Z+ routeadm -e ipv4-forwarding -u
2412024-02-28T13:16:20.063Z+ PXA_START=10.151.1.164
2422024-02-28T13:16:20.063Z+ PXA_END=10.151.1.227
2432024-02-28T13:16:20.088Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-02-28T13:16:20.088Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-02-28T13:16:20.261Z+ ZPOOL_VDEV_DIR=/scratch
2462024-02-28T13:16:20.261Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-02-28T13:16:20.286Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-02-28T13:16:20.286Z++ cd ./tools
2492024-02-28T13:16:20.286Z++ pwd
2502024-02-28T13:16:20.286Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-02-28T13:16:20.287Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-02-28T13:16:20.287Z+ SOFTNPU_MODE=zone
2532024-02-28T13:16:20.287Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-02-28T13:16:20.287Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-02-28T13:16:20.287Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-02-28T13:16:20.287Z++ dladm show-phys -p -o LINK
2572024-02-28T13:16:20.287Z++ head -1
2582024-02-28T13:16:20.287Z+ PHYSICAL_LINK=igb0
2592024-02-28T13:16:20.287Z+ echo 'Using igb0 as physical link'
2602024-02-28T13:16:20.287ZUsing igb0 as physical link
2612024-02-28T13:16:20.287Z+ ensure_run_as_root
2622024-02-28T13:16:20.312Z++ id -u
2632024-02-28T13:16:20.312Z+ [[ 0 -ne 0 ]]
2642024-02-28T13:16:20.312Z+ ensure_zpools
2652024-02-28T13:16:20.312Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-02-28T13:16:20.312Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-02-28T13:16:20.312Z+ readarray -t ZPOOLS
2682024-02-28T13:16:20.312Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-02-28T13:16:20.312Z++ sed 's/[ ",]//g'
2702024-02-28T13:16:20.313Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-02-28T13:16:20.313Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-02-28T13:16:20.313ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-02-28T13:16:20.313Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-02-28T13:16:20.313Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-02-28T13:16:20.313Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-02-28T13:16:20.313Z0+0 records in
2772024-02-28T13:16:20.313Z0+0 records out
2782024-02-28T13:16:20.313Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2792024-02-28T13:16:20.313Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-02-28T13:16:20.313Z+ set +x
2812024-02-28T13:16:20.313ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-02-28T13:16:20.313Z++ zpool list -o name
2832024-02-28T13:16:20.313Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-02-28T13:16:20.313Z+ [[ -z '' ]]
2852024-02-28T13:16:20.313Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-28T13:16:20.341Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-02-28T13:16:20.366Z+ set +x
2882024-02-28T13:16:20.366ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-02-28T13:16:20.367Z+ for ZPOOL in "${ZPOOLS[@]}"
2902024-02-28T13:16:20.367Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2912024-02-28T13:16:20.367ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2922024-02-28T13:16:20.367Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2932024-02-28T13:16:20.367Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2942024-02-28T13:16:20.367Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-02-28T13:16:20.367Z0+0 records in
2962024-02-28T13:16:20.367Z0+0 records out
2972024-02-28T13:16:20.367Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2982024-02-28T13:16:20.367Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-02-28T13:16:20.367Z+ set +x
3002024-02-28T13:16:20.367ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-02-28T13:16:20.367Z++ zpool list -o name
3022024-02-28T13:16:20.367Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-02-28T13:16:20.367Z+ [[ -z '' ]]
3042024-02-28T13:16:20.367Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-28T13:16:20.392Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-02-28T13:16:20.392Z+ set +x
3072024-02-28T13:16:20.393ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-02-28T13:16:20.393Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-02-28T13:16:20.393Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-02-28T13:16:20.393ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-02-28T13:16:20.393Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-02-28T13:16:20.393Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-02-28T13:16:20.393Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-02-28T13:16:20.393Z0+0 records in
3152024-02-28T13:16:20.393Z0+0 records out
3162024-02-28T13:16:20.393Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3172024-02-28T13:16:20.393Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-02-28T13:16:20.393Z+ set +x
3192024-02-28T13:16:20.393ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-02-28T13:16:20.393Z++ zpool list -o name
3212024-02-28T13:16:20.393Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-02-28T13:16:20.418Z+ [[ -z '' ]]
3232024-02-28T13:16:20.418Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-02-28T13:16:20.443Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-02-28T13:16:20.443Z+ set +x
3262024-02-28T13:16:20.443ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-02-28T13:16:20.443Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-02-28T13:16:20.443Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-02-28T13:16:20.443ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3302024-02-28T13:16:20.443Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3312024-02-28T13:16:20.443Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-02-28T13:16:20.443Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-02-28T13:16:20.443Z0+0 records in
3342024-02-28T13:16:20.443Z0+0 records out
3352024-02-28T13:16:20.443Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3362024-02-28T13:16:20.443Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-02-28T13:16:20.443Z+ set +x
3382024-02-28T13:16:20.444ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-02-28T13:16:20.444Z++ zpool list -o name
3402024-02-28T13:16:20.444Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-02-28T13:16:20.444Z+ [[ -z '' ]]
3422024-02-28T13:16:20.444Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-28T13:16:20.469Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-02-28T13:16:20.469Z+ set +x
3452024-02-28T13:16:20.469ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-02-28T13:16:20.469Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-02-28T13:16:20.469Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3482024-02-28T13:16:20.469ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3492024-02-28T13:16:20.469Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-02-28T13:16:20.469Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-02-28T13:16:20.469Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-02-28T13:16:20.469Z0+0 records in
3532024-02-28T13:16:20.469Z0+0 records out
3542024-02-28T13:16:20.469Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3552024-02-28T13:16:20.469Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-02-28T13:16:20.469Z+ set +x
3572024-02-28T13:16:20.469ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-02-28T13:16:20.494Z++ zpool list -o name
3592024-02-28T13:16:20.494Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-02-28T13:16:20.494Z+ [[ -z '' ]]
3612024-02-28T13:16:20.494Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-28T13:16:20.519Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-02-28T13:16:20.519Z+ set +x
3642024-02-28T13:16:20.519ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-02-28T13:16:20.519Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-02-28T13:16:20.519Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-02-28T13:16:20.519ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-02-28T13:16:20.519Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-02-28T13:16:20.520Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-02-28T13:16:20.520Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-02-28T13:16:20.520Z0+0 records in
3722024-02-28T13:16:20.520Z0+0 records out
3732024-02-28T13:16:20.520Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3742024-02-28T13:16:20.520Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-02-28T13:16:20.520Z+ set +x
3762024-02-28T13:16:20.520ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-02-28T13:16:20.520Z++ zpool list -o name
3782024-02-28T13:16:20.520Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-02-28T13:16:20.545Z+ [[ -z '' ]]
3802024-02-28T13:16:20.545Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-28T13:16:20.570Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-02-28T13:16:20.570Z+ set +x
3832024-02-28T13:16:20.570ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-02-28T13:16:20.570Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-02-28T13:16:20.570Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3862024-02-28T13:16:20.570ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3872024-02-28T13:16:20.570Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-02-28T13:16:20.570Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-02-28T13:16:20.570Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-02-28T13:16:20.570Z0+0 records in
3912024-02-28T13:16:20.570Z0+0 records out
3922024-02-28T13:16:20.571Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3932024-02-28T13:16:20.571Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-02-28T13:16:20.571Z+ set +x
3952024-02-28T13:16:20.571ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-02-28T13:16:20.571Z++ zpool list -o name
3972024-02-28T13:16:20.571Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-02-28T13:16:20.571Z+ [[ -z '' ]]
3992024-02-28T13:16:20.571Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-28T13:16:20.596Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-02-28T13:16:20.596Z+ set +x
4022024-02-28T13:16:20.596ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-02-28T13:16:20.596Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-02-28T13:16:20.596Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4052024-02-28T13:16:20.597ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4062024-02-28T13:16:20.597Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-02-28T13:16:20.597Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-02-28T13:16:20.597Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-02-28T13:16:20.597Z0+0 records in
4102024-02-28T13:16:20.597Z0+0 records out
4112024-02-28T13:16:20.597Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4122024-02-28T13:16:20.622Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-02-28T13:16:20.622Z+ set +x
4142024-02-28T13:16:20.622ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-02-28T13:16:20.622Z++ zpool list -o name
4162024-02-28T13:16:20.622Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-02-28T13:16:20.622Z+ [[ -z '' ]]
4182024-02-28T13:16:20.622Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-28T13:16:20.647Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-02-28T13:16:20.647Z+ set +x
4212024-02-28T13:16:20.647ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-02-28T13:16:20.647Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-02-28T13:16:20.647Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-02-28T13:16:20.647ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4252024-02-28T13:16:20.647Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4262024-02-28T13:16:20.647Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-02-28T13:16:20.647Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-02-28T13:16:20.647Z0+0 records in
4292024-02-28T13:16:20.647Z0+0 records out
4302024-02-28T13:16:20.647Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4312024-02-28T13:16:20.647Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-02-28T13:16:20.647Z+ set +x
4332024-02-28T13:16:20.647ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-02-28T13:16:20.647Z++ zpool list -o name
4352024-02-28T13:16:20.647Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-02-28T13:16:20.672Z+ [[ -z '' ]]
4372024-02-28T13:16:20.672Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-28T13:16:20.697Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-02-28T13:16:20.698Z+ set +x
4402024-02-28T13:16:20.698ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-02-28T13:16:20.698Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-02-28T13:16:20.698Z+ readarray -t ZPOOLS
4432024-02-28T13:16:20.698Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-02-28T13:16:20.698Z++ sed 's/[ ",]//g'
4452024-02-28T13:16:20.698Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-02-28T13:16:20.698Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-02-28T13:16:20.698ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-02-28T13:16:20.698Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-02-28T13:16:20.698Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-02-28T13:16:20.698Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-02-28T13:16:20.698Z0+0 records in
4522024-02-28T13:16:20.698Z0+0 records out
4532024-02-28T13:16:20.698Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4542024-02-28T13:16:20.698Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-02-28T13:16:20.698Z+ set +x
4562024-02-28T13:16:20.698ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-02-28T13:16:20.698Z++ zpool list -o name
4582024-02-28T13:16:20.698Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-02-28T13:16:20.723Z+ [[ -z '' ]]
4602024-02-28T13:16:20.723Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-28T13:16:20.748Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-02-28T13:16:20.748Z+ set +x
4632024-02-28T13:16:20.749Z+ for ZPOOL in "${ZPOOLS[@]}"
4642024-02-28T13:16:20.749ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4652024-02-28T13:16:20.749Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4662024-02-28T13:16:20.749ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4672024-02-28T13:16:20.749Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4682024-02-28T13:16:20.749Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4692024-02-28T13:16:20.749Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-02-28T13:16:20.749Z0+0 records in
4712024-02-28T13:16:20.749Z0+0 records out
4722024-02-28T13:16:20.749Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-02-28T13:16:20.749Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-02-28T13:16:20.749Z+ set +x
4752024-02-28T13:16:20.749ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-02-28T13:16:20.749Z++ zpool list -o name
4772024-02-28T13:16:20.749Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-02-28T13:16:20.749Z+ [[ -z '' ]]
4792024-02-28T13:16:20.749Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-28T13:16:20.774Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-02-28T13:16:20.774Z+ set +x
4822024-02-28T13:16:20.774ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-02-28T13:16:20.774Z+ [[ zone == \z\o\n\e ]]
4842024-02-28T13:16:20.774Z+ ensure_simulated_links igb0
4852024-02-28T13:16:20.774Z+ local PHYSICAL_LINK=igb0
4862024-02-28T13:16:20.775Z+ INDICES=("0" "1")
4872024-02-28T13:16:20.775Z+ for I in "${INDICES[@]}"
4882024-02-28T13:16:20.775Z++ get_simnet_name_if_exists net0
4892024-02-28T13:16:20.775Z++ dladm show-simnet -p -o LINK net0
4902024-02-28T13:16:20.799Z++ echo ''
4912024-02-28T13:16:20.800Z+ [[ -z '' ]]
4922024-02-28T13:16:20.800Z+ dladm create-simnet -t net0
4932024-02-28T13:16:20.800Z+ dladm create-simnet -t sc0_0
4942024-02-28T13:16:20.800Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-02-28T13:16:20.800Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-02-28T13:16:20.800Z+ success 'Simnet net0/sc0_0 exists'
4972024-02-28T13:16:20.800Z+ set +x
4982024-02-28T13:16:20.800ZSimnet net0/sc0_0 exists
4992024-02-28T13:16:20.800Z+ for I in "${INDICES[@]}"
5002024-02-28T13:16:20.800Z++ get_simnet_name_if_exists net1
5012024-02-28T13:16:20.800Z++ dladm show-simnet -p -o LINK net1
5022024-02-28T13:16:20.800Z++ echo ''
5032024-02-28T13:16:20.800Z+ [[ -z '' ]]
5042024-02-28T13:16:20.800Z+ dladm create-simnet -t net1
5052024-02-28T13:16:21.267Z+ dladm create-simnet -t sc1_0
5062024-02-28T13:16:21.267Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-02-28T13:16:21.268Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-02-28T13:16:21.268Z+ success 'Simnet net1/sc1_0 exists'
5092024-02-28T13:16:21.268Z+ set +x
5102024-02-28T13:16:21.268ZSimnet net1/sc1_0 exists
5112024-02-28T13:16:21.268Z++ get_vnic_name_if_exists sc0_1
5122024-02-28T13:16:21.268Z++ dladm show-vnic -p -o LINK sc0_1
5132024-02-28T13:16:21.268Z++ echo ''
5142024-02-28T13:16:21.268Z+ [[ -z '' ]]
5152024-02-28T13:16:21.268Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-02-28T13:16:21.269Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-02-28T13:16:21.269Z+ success 'Vnic sc0_1 exists'
5182024-02-28T13:16:21.269Z+ set +x
5192024-02-28T13:16:21.269ZVnic sc0_1 exists
5202024-02-28T13:16:21.269Z+ warn_if_no_proxy_arp
5212024-02-28T13:16:21.269Z+ [[ -v PXA_START ]]
5222024-02-28T13:16:21.270Z+ [[ -v PXA_END ]]
5232024-02-28T13:16:21.270Z+ ensure_softnpu_zone
5242024-02-28T13:16:21.270Z+ zoneadm list
5252024-02-28T13:16:21.270Z+ grep -q sidecar_softnpu
5262024-02-28T13:16:21.270Z+ [[ -f out/npuzone/npuzone ]]
5272024-02-28T13:16:21.270Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-02-28T13:16:21.270Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-02-28T13:16:26.680Zdownloading softnpu ...done
5302024-02-28T13:16:26.705Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-02-28T13:16:31.512Zdownloading asic_program.so ...done
5322024-02-28T13:16:31.537Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-02-28T13:16:37.677Zdownloading scadm ...done
5342024-02-28T13:16:37.702Zcreating port tfportrear0_0 for sc0_0
5352024-02-28T13:16:37.702Zcreating port tfportqsfp0_0 for sc0_1
5362024-02-28T13:16:37.729Zsoftnpu zone setup
5372024-02-28T13:16:37.729Zconfigure zone
5382024-02-28T13:16:37.729Zinstall zone
5392024-02-28T13:16:38.805Zboot zone
5402024-02-28T13:16:41.907Z[sidecar_softnpu] svcs milestone/network
5412024-02-28T13:16:41.934ZSTATE STIME FMRI
5422024-02-28T13:16:41.934Zonline 13:16:39 svc:/milestone/network:default
5432024-02-28T13:16:41.934Z[sidecar_softnpu] /softnpu/npu start
5442024-02-28T13:16:41.960Z
5452024-02-28T13:16:41.985Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-02-28T13:16:41.985Z+ GATEWAY_IP=10.151.1.100
5472024-02-28T13:16:41.985Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-02-28T13:16:41.985ZUsing 10.151.1.100 as gateway ip
5492024-02-28T13:16:41.985Z+ [[ ! -v GATEWAY_MAC ]]
5502024-02-28T13:16:41.985Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-02-28T13:16:41.985Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-02-28T13:16:41.985Z+++ echo 18:c0:4d:0d:9f:b2
5532024-02-28T13:16:41.986Z+ COUNT=1
5542024-02-28T13:16:41.986Z+ [[ 1 -ne 1 ]]
5552024-02-28T13:16:41.986Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-02-28T13:16:41.986ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-02-28T13:16:41.986Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-02-28T13:16:41.986Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-02-28T13:16:42.011Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-02-28T13:16:42.011Z+ [[ -v PXA_START ]]
5612024-02-28T13:16:42.011Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-02-28T13:16:42.011Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-02-28T13:16:42.037Z+ z_scadm dump-state
5642024-02-28T13:16:42.038Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-02-28T13:16:42.063Zlocal v6:
5662024-02-28T13:16:42.063Zlocal v4:
5672024-02-28T13:16:42.063Zrouter v6:
5682024-02-28T13:16:42.063Zrouter v4_idx:
5692024-02-28T13:16:42.063Zrouter v4_routes:
5702024-02-28T13:16:42.064Zresolver v4:
5712024-02-28T13:16:42.064Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-02-28T13:16:42.064Zresolver v6:
5732024-02-28T13:16:42.064Znat v4:
5742024-02-28T13:16:42.064Znat_v6:
5752024-02-28T13:16:42.064Zport_mac:
5762024-02-28T13:16:42.064Zproxy arp:
5772024-02-28T13:16:42.064Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-02-28T13:16:42.064Z+ success 'softnpu zone exists'
5792024-02-28T13:16:42.064Z+ set +x
5802024-02-28T13:16:42.064Zsoftnpu zone exists
5812024-02-28T13:16:42.064Z
5822024-02-28T13:16:42.064Zreal 21.793911376
5832024-02-28T13:16:42.064Zuser 0.703504531
5842024-02-28T13:16:42.064Zsys 1.590440275
5852024-02-28T13:16:42.064Ztrap 0.000087924
5862024-02-28T13:16:42.064Ztflt 0.000125956
5872024-02-28T13:16:42.064Zdflt 0.001248532
5882024-02-28T13:16:42.064Zkflt 0.000003320
5892024-02-28T13:16:42.064Zlock 16:36.704507868
5902024-02-28T13:16:42.064Zslp 1:05.116801487
5912024-02-28T13:16:42.065Zlat 0.082479984
5922024-02-28T13:16:42.065Zstop 0.358240122
5932024-02-28T13:16:42.065Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-02-28T13:16:42.102Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-02-28T13:16:42.127Z+ SILO_NAME=recovery
5962024-02-28T13:16:42.128Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-02-28T13:16:42.128Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-02-28T13:16:42.128Z+ sed -i~ '
5992024-02-28T13:16:42.128Z /^external_dns_ips/c\
6002024-02-28T13:16:42.128Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-02-28T13:16:42.128Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-02-28T13:16:42.128Z /^first/c\
6032024-02-28T13:16:42.128Zfirst = "10.151.1.164"
6042024-02-28T13:16:42.128Z /^last/c\
6052024-02-28T13:16:42.128Zlast = "10.151.1.173"
6062024-02-28T13:16:42.128Z }
6072024-02-28T13:16:42.128Z /^\[rack_network_config/,/^$/ {
6082024-02-28T13:16:42.128Z /^infra_ip_first/c\
6092024-02-28T13:16:42.128Zinfra_ip_first = "10.151.1.174"
6102024-02-28T13:16:42.128Z /^infra_ip_last/c\
6112024-02-28T13:16:42.128Zinfra_ip_last = "10.151.1.174"
6122024-02-28T13:16:42.128Z }
6132024-02-28T13:16:42.128Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-02-28T13:16:42.128Z /^routes/c\
6152024-02-28T13:16:42.128Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-02-28T13:16:42.128Z /^addresses/c\
6172024-02-28T13:16:42.128Zaddresses = \["10.151.1.174/24"\]
6182024-02-28T13:16:42.129Z }
6192024-02-28T13:16:42.129Z' pkg/config-rss.toml
6202024-02-28T13:16:42.129Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-02-28T13:16:42.129Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-02-28T13:16:42.129Z+++ pkg/config-rss.toml Wed Feb 28 13:16:41 2024
6232024-02-28T13:16:42.129Z@@ -33,7 +33,7 @@
6242024-02-28T13:16:42.129Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-02-28T13:16:42.129Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-02-28T13:16:42.129Z # below.
6272024-02-28T13:16:42.129Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-02-28T13:16:42.129Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-02-28T13:16:42.129Z
6302024-02-28T13:16:42.129Z # Initial TLS certificates for the external API
6312024-02-28T13:16:42.129Z #
6322024-02-28T13:16:42.129Z@@ -69,8 +69,8 @@
6332024-02-28T13:16:42.129Z #
6342024-02-28T13:16:42.129Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-02-28T13:16:42.129Z [[internal_services_ip_pool_ranges]]
6362024-02-28T13:16:42.129Z-first = "192.168.1.20"
6372024-02-28T13:16:42.129Z-last = "192.168.1.29"
6382024-02-28T13:16:42.129Z+first = "10.151.1.164"
6392024-02-28T13:16:42.129Z+last = "10.151.1.173"
6402024-02-28T13:16:42.129Z
6412024-02-28T13:16:42.130Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-02-28T13:16:42.130Z # parameters should be provided to the control plane via wicket, but we need to
6432024-02-28T13:16:42.130Z@@ -100,9 +100,9 @@
6442024-02-28T13:16:42.130Z # You can configure multiple uplinks by repeating the following stanza
6452024-02-28T13:16:42.130Z [[rack_network_config.ports]]
6462024-02-28T13:16:42.130Z # Routes associated with this port.
6472024-02-28T13:16:42.130Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6482024-02-28T13:16:42.130Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6492024-02-28T13:16:42.130Z # Addresses associated with this port.
6502024-02-28T13:16:42.130Z-addresses = ["192.168.1.30/24"]
6512024-02-28T13:16:42.130Z+addresses = ["10.151.1.174/24"]
6522024-02-28T13:16:42.130Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6532024-02-28T13:16:42.130Z port = "qsfp0"
6542024-02-28T13:16:42.130Z # The speed of this port.
6552024-02-28T13:16:42.130Z+ true
6562024-02-28T13:16:42.130Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6572024-02-28T13:16:42.130Za pkg/config-rss.toml 7K
6582024-02-28T13:16:42.130Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6592024-02-28T13:16:42.130Z+ TLS_NAME=recovery.sys.oxide.test
6602024-02-28T13:16:42.130Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6612024-02-28T13:16:42.429Z....+...+.....+...+....+..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+....+...+...+...+..+.........+.+........+...............................+.........+..+.......+............+........+...+...+....+......+..+.......+.....+.......+...........+.......+..+......+.............+............+...+.........+..+.........+.........+......+.........+.+..............+......+....+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6622024-02-28T13:16:42.637Z.....+...+.+.....+.+...+...+..............+......+.......+...+.....+....+........+...+............+.......+...+..+...+.......+......+..+...+...+.......+..+..........+......+..+...+............+.......+.....+......+.+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+.....+.........+.......+.....+....+.............................+.+.....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+.......+......+......+.........+..+...+............+....+...+...............+...+..+.+.............................+.......+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6632024-02-28T13:16:42.662Z-----
6642024-02-28T13:16:42.662Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6652024-02-28T13:16:42.687Za pkg/initial-tls-cert.pem 2K
6662024-02-28T13:16:42.687Za pkg/initial-tls-key.pem 4K
6672024-02-28T13:16:42.687Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6682024-02-28T13:16:42.687Z+ rmdir pkg
6692024-02-28T13:16:42.687Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6702024-02-28T13:16:42.687Z+ pfexec mkdir -p /usr/oxide
6712024-02-28T13:16:42.687Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6722024-02-28T13:16:43.382Z+ pfexec chmod +x /usr/oxide/oxide
6732024-02-28T13:16:43.407Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6742024-02-28T13:17:01.702Z+ OMICRON_NO_UNINSTALL=1
6752024-02-28T13:17:01.702Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6762024-02-28T13:17:01.728ZLogging to: /opt/oxide/work/out/LOG
6772024-02-28T13:17:02.228Z
6782024-02-28T13:17:02.254Zreal 0.520932479
6792024-02-28T13:17:02.254Zuser 0.112978941
6802024-02-28T13:17:02.254Zsys 2.285507988
6812024-02-28T13:17:02.254Ztrap 0.000008220
6822024-02-28T13:17:02.254Ztflt 0.000789136
6832024-02-28T13:17:02.254Zdflt 0.000752755
6842024-02-28T13:17:02.254Zkflt 0.000000000
6852024-02-28T13:17:02.254Zlock 47.165198702
6862024-02-28T13:17:02.254Zslp 0.736186361
6872024-02-28T13:17:02.254Zlat 0.003323010
6882024-02-28T13:17:02.254Zstop 0.199079729
6892024-02-28T13:17:02.254Z+ retry=0
6902024-02-28T13:17:02.254Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6912024-02-28T13:17:02.254Z+ [[ 0 -gt 30 ]]
6922024-02-28T13:17:02.254Z+ sleep 1
6932024-02-28T13:17:03.242Z+ retry=1
6942024-02-28T13:17:03.243Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6952024-02-28T13:17:03.268Z+ [[ 1 -gt 30 ]]
6962024-02-28T13:17:03.268Z+ sleep 1
6972024-02-28T13:17:04.258Z+ retry=2
6982024-02-28T13:17:04.258Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
6992024-02-28T13:17:04.283Z+ [[ 2 -gt 30 ]]
7002024-02-28T13:17:04.283Z+ sleep 1
7012024-02-28T13:17:05.271Z+ retry=3
7022024-02-28T13:17:05.271Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7032024-02-28T13:17:05.296Z+ [[ 3 -gt 30 ]]
7042024-02-28T13:17:05.296Z+ sleep 1
7052024-02-28T13:17:06.286Z+ retry=4
7062024-02-28T13:17:06.286Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-02-28T13:17:31.464Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7082024-02-28T13:17:31.492Zlocal v6:
7092024-02-28T13:17:31.492Zfdac:e6d2:28d6:7ccd::1
7102024-02-28T13:17:31.492Zfe80::f855:d4ff:febe:9aff
7112024-02-28T13:17:31.493Zlocal v4:
7122024-02-28T13:17:31.493Z10.151.1.174
7132024-02-28T13:17:31.493Zrouter v6:
7142024-02-28T13:17:31.493Zfd00:1122:3344:3::/64 -> fe80::f88b:87ff:fe74:dcfc (1)
7152024-02-28T13:17:31.493Zfd00:1122:3344:101::/64 -> fe80::f88b:87ff:fe74:dcfc (1)
7162024-02-28T13:17:31.493Zfd00:1122:3344:2::/64 -> fe80::f88b:87ff:fe74:dcfc (1)
7172024-02-28T13:17:31.493Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::f88b:87ff:fe74:dcfc (1)
7182024-02-28T13:17:31.493Zfd00:1122:3344:1::/64 -> fe80::f88b:87ff:fe74:dcfc (1)
7192024-02-28T13:17:31.493Zrouter v4_idx:
7202024-02-28T13:17:31.493Z0.0.0.0/0 -> 0
7212024-02-28T13:17:31.493Zrouter v4_routes:
7222024-02-28T13:17:31.493Z0 -> 10.151.1.100 (2)
7232024-02-28T13:17:31.493Zresolver v4:
7242024-02-28T13:17:31.493Z10.151.1.174 -> 56:6a:99:f6:5e:84
7252024-02-28T13:17:31.493Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7262024-02-28T13:17:31.493Zresolver v6:
7272024-02-28T13:17:31.493Zfe80::f855:d4ff:febe:9aff -> fa:55:d4:be:9a:ff
7282024-02-28T13:17:31.493Zfe80::f88b:87ff:fe74:dcfc -> fa:8b:87:74:dc:fc
7292024-02-28T13:17:31.493Znat v4:
7302024-02-28T13:17:31.493Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:9e:30
7312024-02-28T13:17:31.493Znat_v6:
7322024-02-28T13:17:31.493Zport_mac:
7332024-02-28T13:17:31.493Z1000: a8:40:25:6f:a5:fb
7342024-02-28T13:17:31.493Z2: a8:40:25:6f:a6:1c
7352024-02-28T13:17:31.494Z1: a8:40:25:6f:a5:fc
7362024-02-28T13:17:31.494Zproxy arp:
7372024-02-28T13:17:31.494Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7382024-02-28T13:17:31.494Z+ retry=0
7392024-02-28T13:17:31.494Z+++ zoneadm list -n
7402024-02-28T13:17:31.519Z+++ grep oxz_ntp
7412024-02-28T13:17:31.519Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
7422024-02-28T13:17:31.519Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7432024-02-28T13:17:31.519Z++ true
7442024-02-28T13:17:31.519Z+ [[ '' != online ]]
7452024-02-28T13:17:31.519Z+ [[ 0 -gt 60 ]]
7462024-02-28T13:17:31.519Z+ sleep 1
7472024-02-28T13:17:32.516Z+ retry=1
7482024-02-28T13:17:32.541Z+++ zoneadm list -n
7492024-02-28T13:17:32.541Z+++ grep oxz_ntp
7502024-02-28T13:17:32.541Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
7512024-02-28T13:17:32.567Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7522024-02-28T13:17:32.567Z++ true
7532024-02-28T13:17:32.567Z+ [[ '' != online ]]
7542024-02-28T13:17:32.567Z+ [[ 1 -gt 60 ]]
7552024-02-28T13:17:32.567Z+ sleep 1
7562024-02-28T13:17:33.546Z+ retry=2
7572024-02-28T13:17:33.571Z+++ zoneadm list -n
7582024-02-28T13:17:33.571Z+++ grep oxz_ntp
7592024-02-28T13:17:33.571Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
7602024-02-28T13:17:33.571Z+ [[ disabled != online ]]
7612024-02-28T13:17:33.571Z+ [[ 2 -gt 60 ]]
7622024-02-28T13:17:33.571Z+ sleep 1
7632024-02-28T13:17:34.571Z+ retry=3
7642024-02-28T13:17:34.596Z+++ zoneadm list -n
7652024-02-28T13:17:34.596Z+++ grep oxz_ntp
7662024-02-28T13:17:34.596Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
7672024-02-28T13:17:34.596Z+ [[ disabled != online ]]
7682024-02-28T13:17:34.596Z+ [[ 3 -gt 60 ]]
7692024-02-28T13:17:34.596Z+ sleep 1
7702024-02-28T13:17:35.593Z+ retry=4
7712024-02-28T13:17:35.618Z+++ zoneadm list -n
7722024-02-28T13:17:35.618Z+++ grep oxz_ntp
7732024-02-28T13:17:35.618Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
7742024-02-28T13:17:35.618Z+ [[ disabled != online ]]
7752024-02-28T13:17:35.618Z+ [[ 4 -gt 60 ]]
7762024-02-28T13:17:35.618Z+ sleep 1
7772024-02-28T13:17:36.615Z+ retry=5
7782024-02-28T13:17:36.640Z+++ zoneadm list -n
7792024-02-28T13:17:36.640Z+++ grep oxz_ntp
7802024-02-28T13:17:36.641Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
7812024-02-28T13:17:36.641Z+ [[ disabled != online ]]
7822024-02-28T13:17:36.641Z+ [[ 5 -gt 60 ]]
7832024-02-28T13:17:36.641Z+ sleep 1
7842024-02-28T13:17:37.638Z+ retry=6
7852024-02-28T13:17:37.662Z+++ zoneadm list -n
7862024-02-28T13:17:37.662Z+++ grep oxz_ntp
7872024-02-28T13:17:37.662Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
7882024-02-28T13:17:37.662Z+ [[ disabled != online ]]
7892024-02-28T13:17:37.663Z+ [[ 6 -gt 60 ]]
7902024-02-28T13:17:37.663Z+ sleep 1
7912024-02-28T13:17:38.661Z+ retry=7
7922024-02-28T13:17:38.687Z+++ zoneadm list -n
7932024-02-28T13:17:38.687Z+++ grep oxz_ntp
7942024-02-28T13:17:38.687Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
7952024-02-28T13:17:38.687Z+ [[ disabled != online ]]
7962024-02-28T13:17:38.687Z+ [[ 7 -gt 60 ]]
7972024-02-28T13:17:38.687Z+ sleep 1
7982024-02-28T13:17:39.682Z+ retry=8
7992024-02-28T13:17:39.707Z+++ zoneadm list -n
8002024-02-28T13:17:39.707Z+++ grep oxz_ntp
8012024-02-28T13:17:39.707Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
8022024-02-28T13:17:39.707Z+ [[ disabled != online ]]
8032024-02-28T13:17:39.707Z+ [[ 8 -gt 60 ]]
8042024-02-28T13:17:39.707Z+ sleep 1
8052024-02-28T13:17:40.703Z+ retry=9
8062024-02-28T13:17:40.728Z+++ zoneadm list -n
8072024-02-28T13:17:40.728Z+++ grep oxz_ntp
8082024-02-28T13:17:40.728Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
8092024-02-28T13:17:40.729Z+ [[ disabled != online ]]
8102024-02-28T13:17:40.729Z+ [[ 9 -gt 60 ]]
8112024-02-28T13:17:40.729Z+ sleep 1
 
8122024-02-28T13:17:41.153Zbuskin console login: Feb 28 13:17:40 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8132024-02-28T13:17:41.728Z+ retry=10
8142024-02-28T13:17:41.753Z+++ zoneadm list -n
8152024-02-28T13:17:41.753Z+++ grep oxz_ntp
8162024-02-28T13:17:41.753Z++ pfexec svcs -z oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240 -Hostate oxide/ntp
8172024-02-28T13:17:41.753Z+ [[ online != online ]]
8182024-02-28T13:17:41.753Z+ echo 'Waited for chrony: 10s'
8192024-02-28T13:17:41.754Z+ export RUST_BACKTRACE=1
8202024-02-28T13:17:41.754Z+ RUST_BACKTRACE=1
8212024-02-28T13:17:41.754ZWaited for chrony: 10s
8222024-02-28T13:17:41.754Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8232024-02-28T13:17:41.754Z++ ./tests/bootstrap
8242024-02-28T13:17:41.779ZUsing external DNS server at 10.151.1.164:53
8252024-02-28T13:17:41.779Z2024-02-28 13:17:41.481203044 UTC: attempting to log into API
8262024-02-28T13:17:56.812Z2024-02-28 13:17:56.474438871 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8272024-02-28T13:17:57.813Z2024-02-28 13:17:57.475377715 UTC: attempting to log into API
8282024-02-28T13:18:12.871Z2024-02-28 13:18:12.528445703 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8292024-02-28T13:18:13.925Z2024-02-28 13:18:13.532047335 UTC: attempting to log into API
8302024-02-28T13:18:29.156Z2024-02-28 13:18:28.853417389 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8312024-02-28T13:18:30.158Z2024-02-28 13:18:29.857119921 UTC: attempting to log into API
8322024-02-28T13:18:45.190Z2024-02-28 13:18:44.930214634 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8332024-02-28T13:18:46.191Z2024-02-28 13:18:45.933936974 UTC: attempting to log into API
8342024-02-28T13:19:01.223Z2024-02-28 13:19:01.006241633 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8352024-02-28T13:19:02.224Z2024-02-28 13:19:02.009813914 UTC: attempting to log into API
8362024-02-28T13:19:18.280Z2024-02-28 13:19:17.083122603 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8372024-02-28T13:19:18.305Z2024-02-28 13:19:18.086778729 UTC: attempting to log into API
8382024-02-28T13:19:33.289Z2024-02-28 13:19:33.159417009 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8392024-02-28T13:19:34.290Z2024-02-28 13:19:34.163148066 UTC: attempting to log into API
8402024-02-28T13:19:49.322Z2024-02-28 13:19:49.236383698 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8412024-02-28T13:19:50.324Z2024-02-28 13:19:50.241153605 UTC: attempting to log into API
8422024-02-28T13:20:05.358Z2024-02-28 13:20:05.314307310 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8432024-02-28T13:20:06.361Z2024-02-28 13:20:06.318660338 UTC: attempting to log into API
8442024-02-28T13:20:22.364Z2024-02-28 13:20:22.345318041 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8452024-02-28T13:20:23.364Z2024-02-28 13:20:23.351615323 UTC: attempting to log into API
8462024-02-28T13:20:38.666Z2024-02-28 13:20:38.652196342 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8472024-02-28T13:20:39.663Z2024-02-28 13:20:39.653853775 UTC: attempting to log into API
 
8482024-02-28T13:20:50.679ZFeb 28 13:20:49 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
8492024-02-28T13:20:51.591ZFeb 28 13:20:51 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
8502024-02-28T13:20:52.210ZFeb 28 13:20:51 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8512024-02-28T13:20:54.746Z2024-02-28 13:20:54.736135829 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8522024-02-28T13:20:55.746Z2024-02-28 13:20:55.736770635 UTC: attempting to log into API
 
8532024-02-28T13:20:59.851ZFeb 28 13:20:58 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8542024-02-28T13:21:06.350ZFeb 28 13:21:06 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
8552024-02-28T13:21:10.778Z2024-02-28 13:21:10.768805990 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8562024-02-28T13:21:11.780Z2024-02-28 13:21:11.770586227 UTC: attempting to log into API
8572024-02-28T13:21:26.812Z2024-02-28 13:21:26.801531321 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8582024-02-28T13:21:27.813Z2024-02-28 13:21:27.803328628 UTC: attempting to log into API
8592024-02-28T13:21:28.742Z2024-02-28 13:21:28.732131963 UTC: login succeeded
8602024-02-28T13:21:28.774Zwaiting for nexus to come up...
8612024-02-28T13:21:28.837Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8622024-02-28T13:21:29.207Zsetting up quotas...
8632024-02-28T13:21:29.264Zensuring datasets are ready...
8642024-02-28T13:21:33.934Zlet's roll.
8652024-02-28T13:21:33.959Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8662024-02-28T13:21:33.959ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8672024-02-28T13:21:33.959ZOXIDE_TOKEN=oxide-token-1a0518e40731df865331349f17d9fd3b238c0e45'
8682024-02-28T13:21:33.959Z++ OXIDE_HOST=https://recovery.sys.oxide.test
8692024-02-28T13:21:33.959Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8702024-02-28T13:21:33.959Z++ OXIDE_TOKEN=oxide-token-1a0518e40731df865331349f17d9fd3b238c0e45
8712024-02-28T13:21:33.959Z+ export OXIDE_HOST OXIDE_TOKEN
8722024-02-28T13:21:33.959Z+ retry=0
8732024-02-28T13:21:33.959Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8742024-02-28T13:21:33.984Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8752024-02-28T13:21:33.985Z+ [[ 0 -gt 60 ]]
8762024-02-28T13:21:33.985Z+ sleep 1
8772024-02-28T13:21:34.973Z+ retry=1
8782024-02-28T13:21:34.973Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8792024-02-28T13:21:34.998Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8802024-02-28T13:21:34.998Z+ [[ 1 -gt 60 ]]
8812024-02-28T13:21:34.998Z+ sleep 1
8822024-02-28T13:21:35.989Z+ retry=2
8832024-02-28T13:21:35.989Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8842024-02-28T13:21:36.015Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8852024-02-28T13:21:36.015Z+ [[ 2 -gt 60 ]]
8862024-02-28T13:21:36.015Z+ sleep 1
8872024-02-28T13:21:37.005Z+ retry=3
8882024-02-28T13:21:37.005Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8892024-02-28T13:21:37.030Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8902024-02-28T13:21:37.030Z+ [[ 3 -gt 60 ]]
8912024-02-28T13:21:37.030Z+ sleep 1
8922024-02-28T13:21:38.022Z+ retry=4
8932024-02-28T13:21:38.022Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8942024-02-28T13:21:38.047Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
8952024-02-28T13:21:38.047Z+ [[ 4 -gt 60 ]]
8962024-02-28T13:21:38.047Z+ sleep 1
8972024-02-28T13:21:39.039Z+ retry=5
8982024-02-28T13:21:39.039Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
8992024-02-28T13:21:39.064Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9002024-02-28T13:21:39.064Z+ [[ 5 -gt 60 ]]
9012024-02-28T13:21:39.064Z+ sleep 1
9022024-02-28T13:21:40.055Z+ retry=6
9032024-02-28T13:21:40.055Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9042024-02-28T13:21:40.080Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9052024-02-28T13:21:40.080Z+ [[ 6 -gt 60 ]]
9062024-02-28T13:21:40.080Z+ sleep 1
9072024-02-28T13:21:41.071Z+ retry=7
9082024-02-28T13:21:41.072Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9092024-02-28T13:21:41.097Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9102024-02-28T13:21:41.097Z+ [[ 7 -gt 60 ]]
9112024-02-28T13:21:41.097Z+ sleep 1
9122024-02-28T13:21:42.087Z+ retry=8
9132024-02-28T13:21:42.087Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9142024-02-28T13:21:42.112Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9152024-02-28T13:21:42.112Z+ [[ 8 -gt 60 ]]
9162024-02-28T13:21:42.112Z+ sleep 1
9172024-02-28T13:21:43.105Z+ retry=9
9182024-02-28T13:21:43.105Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9192024-02-28T13:21:43.132Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9202024-02-28T13:21:43.132Z+ [[ 9 -gt 60 ]]
9212024-02-28T13:21:43.132Z+ sleep 1
9222024-02-28T13:21:44.121Z+ retry=10
9232024-02-28T13:21:44.121Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9242024-02-28T13:21:44.146Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9252024-02-28T13:21:44.146Z+ [[ 10 -gt 60 ]]
9262024-02-28T13:21:44.146Z+ sleep 1
9272024-02-28T13:21:45.138Z+ retry=11
9282024-02-28T13:21:45.139Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9292024-02-28T13:21:45.164Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9302024-02-28T13:21:45.164Z+ [[ 11 -gt 60 ]]
9312024-02-28T13:21:45.164Z+ sleep 1
9322024-02-28T13:21:46.155Z+ retry=12
9332024-02-28T13:21:46.155Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9342024-02-28T13:21:46.180Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9352024-02-28T13:21:46.180Z+ [[ 12 -gt 60 ]]
9362024-02-28T13:21:46.181Z+ sleep 1
9372024-02-28T13:21:47.173Z+ retry=13
9382024-02-28T13:21:47.173Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9392024-02-28T13:21:47.198Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9402024-02-28T13:21:47.198Z+ [[ 13 -gt 60 ]]
9412024-02-28T13:21:47.199Z+ sleep 1
9422024-02-28T13:21:48.189Z+ retry=14
9432024-02-28T13:21:48.189Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9442024-02-28T13:21:48.214Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9452024-02-28T13:21:48.214Z+ [[ 14 -gt 60 ]]
9462024-02-28T13:21:48.215Z+ sleep 1
9472024-02-28T13:21:49.206Z+ retry=15
9482024-02-28T13:21:49.206Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9492024-02-28T13:21:49.231Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9502024-02-28T13:21:49.231Z+ [[ 15 -gt 60 ]]
9512024-02-28T13:21:49.231Z+ sleep 1
9522024-02-28T13:21:50.222Z+ retry=16
9532024-02-28T13:21:50.222Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9542024-02-28T13:21:50.247Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9552024-02-28T13:21:50.247Z+ [[ 16 -gt 60 ]]
9562024-02-28T13:21:50.247Z+ sleep 1
9572024-02-28T13:21:51.239Z+ retry=17
9582024-02-28T13:21:51.239Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9592024-02-28T13:21:51.264Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9602024-02-28T13:21:51.264Z+ [[ 17 -gt 60 ]]
9612024-02-28T13:21:51.264Z+ sleep 1
9622024-02-28T13:21:52.255Z+ retry=18
9632024-02-28T13:21:52.255Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9642024-02-28T13:21:52.280Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9652024-02-28T13:21:52.280Z+ [[ 18 -gt 60 ]]
9662024-02-28T13:21:52.280Z+ sleep 1
9672024-02-28T13:21:53.271Z+ retry=19
9682024-02-28T13:21:53.271Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9692024-02-28T13:21:53.296Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9702024-02-28T13:21:53.296Z+ [[ 19 -gt 60 ]]
9712024-02-28T13:21:53.297Z+ sleep 1
9722024-02-28T13:21:54.287Z+ retry=20
9732024-02-28T13:21:54.288Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9742024-02-28T13:21:54.313Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9752024-02-28T13:21:54.313Z+ [[ 20 -gt 60 ]]
9762024-02-28T13:21:54.313Z+ sleep 1
9772024-02-28T13:21:55.305Z+ retry=21
9782024-02-28T13:21:55.305Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9792024-02-28T13:21:55.330Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9802024-02-28T13:21:55.330Z+ [[ 21 -gt 60 ]]
9812024-02-28T13:21:55.330Z+ sleep 1
9822024-02-28T13:21:56.321Z+ retry=22
9832024-02-28T13:21:56.321Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9842024-02-28T13:21:56.346Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9852024-02-28T13:21:56.346Z+ [[ 22 -gt 60 ]]
9862024-02-28T13:21:56.346Z+ sleep 1
9872024-02-28T13:21:57.338Z+ retry=23
9882024-02-28T13:21:57.338Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9892024-02-28T13:21:57.363Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9902024-02-28T13:21:57.363Z+ [[ 23 -gt 60 ]]
9912024-02-28T13:21:57.363Z+ sleep 1
9922024-02-28T13:21:58.354Z+ retry=24
9932024-02-28T13:21:58.354Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9942024-02-28T13:21:58.379Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9952024-02-28T13:21:58.379Z+ [[ 24 -gt 60 ]]
9962024-02-28T13:21:58.379Z+ sleep 1
9972024-02-28T13:21:59.371Z+ retry=25
9982024-02-28T13:21:59.371Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9992024-02-28T13:21:59.400Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10002024-02-28T13:21:59.400Z+ [[ 25 -gt 60 ]]
10012024-02-28T13:21:59.401Z+ sleep 1
10022024-02-28T13:22:00.388Z+ retry=26
10032024-02-28T13:22:00.388Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10042024-02-28T13:22:00.413Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10052024-02-28T13:22:00.413Z+ [[ 26 -gt 60 ]]
10062024-02-28T13:22:00.413Z+ sleep 1
10072024-02-28T13:22:01.405Z+ retry=27
10082024-02-28T13:22:01.405Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10092024-02-28T13:22:01.431Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10102024-02-28T13:22:01.431Z+ [[ 27 -gt 60 ]]
10112024-02-28T13:22:01.431Z+ sleep 1
10122024-02-28T13:22:02.423Z+ retry=28
10132024-02-28T13:22:02.423Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10142024-02-28T13:22:02.448Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10152024-02-28T13:22:02.448Z+ [[ 28 -gt 60 ]]
10162024-02-28T13:22:02.449Z+ sleep 1
10172024-02-28T13:22:03.440Z+ retry=29
10182024-02-28T13:22:03.465Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10192024-02-28T13:22:03.465Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10202024-02-28T13:22:03.465Z+ [[ 29 -gt 60 ]]
10212024-02-28T13:22:03.465Z+ sleep 1
10222024-02-28T13:22:04.455Z+ retry=30
10232024-02-28T13:22:04.455Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10242024-02-28T13:22:04.480Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10252024-02-28T13:22:04.481Z+ [[ 30 -gt 60 ]]
10262024-02-28T13:22:04.481Z+ sleep 1
10272024-02-28T13:22:05.471Z+ retry=31
10282024-02-28T13:22:05.471Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10292024-02-28T13:22:05.496Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10302024-02-28T13:22:05.497Z+ [[ 31 -gt 60 ]]
10312024-02-28T13:22:05.497Z+ sleep 1
10322024-02-28T13:22:06.487Z+ retry=32
10332024-02-28T13:22:06.487Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10342024-02-28T13:22:06.512Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10352024-02-28T13:22:06.512Z+ [[ 32 -gt 60 ]]
10362024-02-28T13:22:06.512Z+ sleep 1
10372024-02-28T13:22:07.501Z+ retry=33
10382024-02-28T13:22:07.501Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10392024-02-28T13:22:07.581Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10402024-02-28T13:22:08.057Z{"status":"ok"}success
10412024-02-28T13:22:08.057ZProject {
10422024-02-28T13:22:08.057Z description: "some images",
10432024-02-28T13:22:08.057Z id: 959ee03e-911c-4e3b-870d-7f95a1ca5a56,
10442024-02-28T13:22:08.058Z name: Name(
10452024-02-28T13:22:08.058Z "images",
10462024-02-28T13:22:08.058Z ),
10472024-02-28T13:22:08.083Z time_created: 2024-02-28T13:22:07.665662Z,
10482024-02-28T13:22:08.083Z time_modified: 2024-02-28T13:22:07.665662Z,
10492024-02-28T13:22:08.083Z}
10502024-02-28T13:22:08.083Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
10512024-02-28T13:27:43.470Zdone!
10522024-02-28T13:27:43.470Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
10532024-02-28T13:27:43.470Zsuccess
10542024-02-28T13:27:43.470ZImage {
10552024-02-28T13:27:43.470Z block_size: ByteCount(
10562024-02-28T13:27:43.470Z 512,
10572024-02-28T13:27:43.471Z ),
10582024-02-28T13:27:43.471Z description: "debian 11 original base image",
10592024-02-28T13:27:43.471Z digest: None,
10602024-02-28T13:27:43.471Z id: 95b4b5eb-7324-4a72-9e0f-03de68bc6dd6,
10612024-02-28T13:27:43.471Z name: Name(
10622024-02-28T13:27:43.471Z "debian11",
10632024-02-28T13:27:43.471Z ),
10642024-02-28T13:27:43.471Z os: "debian",
10652024-02-28T13:27:43.471Z project_id: None,
10662024-02-28T13:27:43.471Z size: ByteCount(
10672024-02-28T13:27:43.471Z 2147483648,
10682024-02-28T13:27:43.472Z ),
10692024-02-28T13:27:43.472Z time_created: 2024-02-28T13:27:35.377181Z,
10702024-02-28T13:27:43.472Z time_modified: 2024-02-28T13:27:35.598445Z,
10712024-02-28T13:27:43.472Z url: None,
10722024-02-28T13:27:43.472Z version: "11",
10732024-02-28T13:27:43.472Z}
10742024-02-28T13:27:43.472Z+ rm ./tests/bootstrap
10752024-02-28T13:27:43.472Z+ for test_bin in tests/*
10762024-02-28T13:27:43.472Z+ ./tests/bootstrap-4050ce4c33c23f6c
10772024-02-28T13:27:43.472Z
10782024-02-28T13:27:43.472Zrunning 0 tests
10792024-02-28T13:27:43.472Z
10802024-02-28T13:27:43.473Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10812024-02-28T13:27:43.473Z
10822024-02-28T13:27:43.473Z+ for test_bin in tests/*
10832024-02-28T13:27:43.473Z+ ./tests/end_to_end_tests-a664735483201555
10842024-02-28T13:27:43.473Z
10852024-02-28T13:27:43.473Zrunning 2 tests
10862024-02-28T13:27:43.473Ztest no_spoof::no_spoof_here ... ok
10872024-02-28T13:28:18.941Ztest instance_launch::instance_launch ... ok
10882024-02-28T13:28:18.941Z
10892024-02-28T13:28:18.966Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 42.91s
10902024-02-28T13:28:18.966Z
10912024-02-28T13:28:18.966Z+ _exit_trap
10922024-02-28T13:28:18.966Z+ local status=0
10932024-02-28T13:28:18.966Z+ [[ 0 -eq 0 ]]
10942024-02-28T13:28:18.966Z+ exit 0
10952024-02-28T13:28:18.966Zprocess exited: duration 753280 ms, exit code 0
 
10962024-02-28T13:28:19.062Zfound 88 output files
10972024-02-28T13:28:19.115Zuploading: /var/svc/log/oxide-sled-agent:default.log (2076782 bytes)
10982024-02-28T13:28:20.898Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10992024-02-28T13:28:20.898Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (2802152 bytes)
11002024-02-28T13:28:24.021Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 2802152 -> 2822677
11012024-02-28T13:28:25.090Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11022024-02-28T13:28:25.090Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (5088 bytes)
11032024-02-28T13:28:26.188Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11042024-02-28T13:28:26.189Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (25153 bytes)
11052024-02-28T13:28:27.333Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11062024-02-28T13:28:27.334Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1689081 bytes)
11072024-02-28T13:28:28.116Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1689081 -> 1710647
11082024-02-28T13:28:29.189Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11092024-02-28T13:28:29.189Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (988945 bytes)
11102024-02-28T13:28:29.892Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 988945 -> 1002101
11112024-02-28T13:28:30.970Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11122024-02-28T13:28:30.996Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1388 bytes)
11132024-02-28T13:28:32.070Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11142024-02-28T13:28:32.096Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (315715 bytes)
11152024-02-28T13:28:32.302Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 315715 -> 321769
11162024-02-28T13:28:33.375Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11172024-02-28T13:28:33.375Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (617 bytes)
11182024-02-28T13:28:34.472Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11192024-02-28T13:28:34.472Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5392 bytes)
11202024-02-28T13:28:35.570Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11212024-02-28T13:28:35.570Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_00b7bf82-35cc-48fe-9476-270d45e6d301/root/var/svc/log/oxide-clickhouse:default.log (1250361 bytes)
11222024-02-28T13:28:36.302Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_00b7bf82-35cc-48fe-9476-270d45e6d301/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1250361 -> 1326367
11232024-02-28T13:28:37.377Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_00b7bf82-35cc-48fe-9476-270d45e6d301/root/var/svc/log/oxide-clickhouse:default.log
11242024-02-28T13:28:37.377Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_00b7bf82-35cc-48fe-9476-270d45e6d301/root/var/svc/log/oxide-zone-network-setup:default.log (1713 bytes)
11252024-02-28T13:28:38.473Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_00b7bf82-35cc-48fe-9476-270d45e6d301/root/var/svc/log/oxide-zone-network-setup:default.log
11262024-02-28T13:28:38.473Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d82fdb45-6b3e-42a2-8c59-d538f5bd0b60/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
11272024-02-28T13:28:39.572Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d82fdb45-6b3e-42a2-8c59-d538f5bd0b60/root/var/svc/log/oxide-cockroachdb:default.log
11282024-02-28T13:28:39.572Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d82fdb45-6b3e-42a2-8c59-d538f5bd0b60/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
11292024-02-28T13:28:40.681Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_d82fdb45-6b3e-42a2-8c59-d538f5bd0b60/root/var/svc/log/oxide-zone-network-setup:default.log
11302024-02-28T13:28:40.681Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c36baa1a-e79a-4644-8a6b-9dc975d1f079/root/var/svc/log/oxide-crucible-agent:default.log (1326 bytes)
11312024-02-28T13:28:41.780Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c36baa1a-e79a-4644-8a6b-9dc975d1f079/root/var/svc/log/oxide-crucible-agent:default.log
11322024-02-28T13:28:41.780Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c36baa1a-e79a-4644-8a6b-9dc975d1f079/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11332024-02-28T13:28:42.876Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c36baa1a-e79a-4644-8a6b-9dc975d1f079/root/var/svc/log/oxide-crucible-downstairs:default.log
11342024-02-28T13:28:42.876Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c36baa1a-e79a-4644-8a6b-9dc975d1f079/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
11352024-02-28T13:28:43.976Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c36baa1a-e79a-4644-8a6b-9dc975d1f079/root/var/svc/log/oxide-zone-network-setup:default.log
11362024-02-28T13:28:43.977Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_de116760-7ce8-4051-89b5-dbe725a06843/root/var/svc/log/oxide-external_dns:default.log (30639 bytes)
11372024-02-28T13:28:45.143Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_de116760-7ce8-4051-89b5-dbe725a06843/root/var/svc/log/oxide-external_dns:default.log
11382024-02-28T13:28:45.169Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_de116760-7ce8-4051-89b5-dbe725a06843/root/var/svc/log/oxide-opte-interface-setup:default.log (1158 bytes)
11392024-02-28T13:28:46.241Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_de116760-7ce8-4051-89b5-dbe725a06843/root/var/svc/log/oxide-opte-interface-setup:default.log
11402024-02-28T13:28:46.266Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_de116760-7ce8-4051-89b5-dbe725a06843/root/var/svc/log/oxide-zone-network-setup:default.log (1726 bytes)
11412024-02-28T13:28:47.342Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_de116760-7ce8-4051-89b5-dbe725a06843/root/var/svc/log/oxide-zone-network-setup:default.log
11422024-02-28T13:28:47.343Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_842e2f1e-ea91-42d4-acc8-64d93d1c76c9/root/var/svc/log/oxide-internal_dns:default.log (115659 bytes)
11432024-02-28T13:28:48.556Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_842e2f1e-ea91-42d4-acc8-64d93d1c76c9/root/var/svc/log/oxide-internal_dns:default.log
11442024-02-28T13:28:48.556Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/svc/log/oxide-ntp:default.log (1326 bytes)
11452024-02-28T13:28:49.654Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/svc/log/oxide-ntp:default.log
11462024-02-28T13:28:49.655Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_406ab4c7-818a-4298-ae6e-64e3dfad5143/root/var/svc/log/oxide-oximeter:default.log (336276 bytes)
11472024-02-28T13:28:49.887Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_406ab4c7-818a-4298-ae6e-64e3dfad5143/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 336276 -> 363097
11482024-02-28T13:28:50.961Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_406ab4c7-818a-4298-ae6e-64e3dfad5143/root/var/svc/log/oxide-oximeter:default.log
11492024-02-28T13:28:50.961Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_406ab4c7-818a-4298-ae6e-64e3dfad5143/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
11502024-02-28T13:28:52.072Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_406ab4c7-818a-4298-ae6e-64e3dfad5143/root/var/svc/log/oxide-zone-network-setup:default.log
11512024-02-28T13:28:52.072Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72e08aa2-1eb6-451a-a9af-6ce17d6fe3e5/root/var/svc/log/oxide-cockroachdb:default.log (4381 bytes)
11522024-02-28T13:28:53.175Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72e08aa2-1eb6-451a-a9af-6ce17d6fe3e5/root/var/svc/log/oxide-cockroachdb:default.log
11532024-02-28T13:28:53.176Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72e08aa2-1eb6-451a-a9af-6ce17d6fe3e5/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
11542024-02-28T13:28:54.272Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_72e08aa2-1eb6-451a-a9af-6ce17d6fe3e5/root/var/svc/log/oxide-zone-network-setup:default.log
11552024-02-28T13:28:54.297Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bc500983-cf20-4c4d-8f8c-f5db945b3e2a/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
11562024-02-28T13:28:55.371Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bc500983-cf20-4c4d-8f8c-f5db945b3e2a/root/var/svc/log/oxide-crucible-agent:default.log
11572024-02-28T13:28:55.371Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bc500983-cf20-4c4d-8f8c-f5db945b3e2a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11582024-02-28T13:28:56.469Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bc500983-cf20-4c4d-8f8c-f5db945b3e2a/root/var/svc/log/oxide-crucible-downstairs:default.log
11592024-02-28T13:28:56.469Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bc500983-cf20-4c4d-8f8c-f5db945b3e2a/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
11602024-02-28T13:28:57.566Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bc500983-cf20-4c4d-8f8c-f5db945b3e2a/root/var/svc/log/oxide-zone-network-setup:default.log
11612024-02-28T13:28:57.591Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0ed061a1-d644-4f36-95d9-99c559521914/root/var/svc/log/oxide-external_dns:default.log (30642 bytes)
11622024-02-28T13:28:58.732Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0ed061a1-d644-4f36-95d9-99c559521914/root/var/svc/log/oxide-external_dns:default.log
11632024-02-28T13:28:58.732Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0ed061a1-d644-4f36-95d9-99c559521914/root/var/svc/log/oxide-opte-interface-setup:default.log (1158 bytes)
11642024-02-28T13:28:59.828Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0ed061a1-d644-4f36-95d9-99c559521914/root/var/svc/log/oxide-opte-interface-setup:default.log
11652024-02-28T13:28:59.828Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0ed061a1-d644-4f36-95d9-99c559521914/root/var/svc/log/oxide-zone-network-setup:default.log (1726 bytes)
11662024-02-28T13:29:00.928Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_0ed061a1-d644-4f36-95d9-99c559521914/root/var/svc/log/oxide-zone-network-setup:default.log
11672024-02-28T13:29:00.928Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1f905b68-a2ec-4d9a-b15d-e713ba321080/root/var/svc/log/oxide-internal_dns:default.log (113235 bytes)
11682024-02-28T13:29:02.140Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_1f905b68-a2ec-4d9a-b15d-e713ba321080/root/var/svc/log/oxide-internal_dns:default.log
11692024-02-28T13:29:02.140Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_a283e2ab-09c5-4129-8f26-97e71f66beab/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
11702024-02-28T13:29:03.242Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_a283e2ab-09c5-4129-8f26-97e71f66beab/root/var/svc/log/oxide-cockroachdb:default.log
11712024-02-28T13:29:03.242Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_a283e2ab-09c5-4129-8f26-97e71f66beab/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
11722024-02-28T13:29:04.341Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_a283e2ab-09c5-4129-8f26-97e71f66beab/root/var/svc/log/oxide-zone-network-setup:default.log
11732024-02-28T13:29:04.341Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-crucible-agent:default.log (18395 bytes)
11742024-02-28T13:29:05.483Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-crucible-agent:default.log
11752024-02-28T13:29:05.483Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11762024-02-28T13:29:06.580Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-crucible-downstairs:default.log
11772024-02-28T13:29:06.580Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-crucible-downstairs:downstairs-86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8.log (3123 bytes)
11782024-02-28T13:29:07.684Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-crucible-downstairs:downstairs-86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8.log
11792024-02-28T13:29:07.684Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-crucible-downstairs:downstairs-be1cb226-7df7-4c87-8daf-1f117e6d2ad4.log (3018 bytes)
11802024-02-28T13:29:08.782Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-crucible-downstairs:downstairs-be1cb226-7df7-4c87-8daf-1f117e6d2ad4.log
11812024-02-28T13:29:08.806Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
11822024-02-28T13:29:09.880Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ca7c0b15-dbe1-4587-87c3-9086e4f965d4/root/var/svc/log/oxide-zone-network-setup:default.log
11832024-02-28T13:29:09.880Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_a7894346-dd44-48fa-aeb3-3d055054a846/root/var/svc/log/oxide-crucible-pantry:default.log (782 bytes)
11842024-02-28T13:29:10.975Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_a7894346-dd44-48fa-aeb3-3d055054a846/root/var/svc/log/oxide-crucible-pantry:default.log
11852024-02-28T13:29:10.975Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_a7894346-dd44-48fa-aeb3-3d055054a846/root/var/svc/log/oxide-zone-network-setup:default.log (1745 bytes)
11862024-02-28T13:29:12.077Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_a7894346-dd44-48fa-aeb3-3d055054a846/root/var/svc/log/oxide-zone-network-setup:default.log
11872024-02-28T13:29:12.102Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_9e69a966-aaa5-463c-adce-1c59004ff150/root/var/svc/log/oxide-internal_dns:default.log (114634 bytes)
11882024-02-28T13:29:12.312Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_9e69a966-aaa5-463c-adce-1c59004ff150/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 114634 -> 118389
11892024-02-28T13:29:13.385Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_9e69a966-aaa5-463c-adce-1c59004ff150/root/var/svc/log/oxide-internal_dns:default.log
11902024-02-28T13:29:13.385Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_da4a9f24-d8c8-4dcc-85d4-53a41bf39cd7/root/var/svc/log/oxide-cockroachdb:default.log (4406 bytes)
11912024-02-28T13:29:14.482Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_da4a9f24-d8c8-4dcc-85d4-53a41bf39cd7/root/var/svc/log/oxide-cockroachdb:default.log
11922024-02-28T13:29:14.482Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_da4a9f24-d8c8-4dcc-85d4-53a41bf39cd7/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
11932024-02-28T13:29:15.582Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_da4a9f24-d8c8-4dcc-85d4-53a41bf39cd7/root/var/svc/log/oxide-zone-network-setup:default.log
11942024-02-28T13:29:15.582Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-crucible-agent:default.log (22721 bytes)
11952024-02-28T13:29:16.739Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-crucible-agent:default.log
11962024-02-28T13:29:16.739Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11972024-02-28T13:29:17.845Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-crucible-downstairs:default.log
11982024-02-28T13:29:17.845Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cbc0532-872c-4c68-8460-ee951d8f7600.log (3124 bytes)
11992024-02-28T13:29:18.937Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-crucible-downstairs:downstairs-4cbc0532-872c-4c68-8460-ee951d8f7600.log
12002024-02-28T13:29:18.937Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-crucible-downstairs:downstairs-c1d73c97-0a0b-44c9-9583-26cc7eb169e9.log (5612 bytes)
12012024-02-28T13:29:20.042Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-crucible-downstairs:downstairs-c1d73c97-0a0b-44c9-9583-26cc7eb169e9.log
12022024-02-28T13:29:20.042Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
12032024-02-28T13:29:21.137Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_a839add2-c178-4fc2-ac03-7efdcd3ad938/root/var/svc/log/oxide-zone-network-setup:default.log
12042024-02-28T13:29:21.137Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aef48af3-5864-42c0-a327-7527e34b00ce/root/var/svc/log/oxide-cockroachdb:default.log (4405 bytes)
12052024-02-28T13:29:22.232Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aef48af3-5864-42c0-a327-7527e34b00ce/root/var/svc/log/oxide-cockroachdb:default.log
12062024-02-28T13:29:22.232Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aef48af3-5864-42c0-a327-7527e34b00ce/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
12072024-02-28T13:29:23.348Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_aef48af3-5864-42c0-a327-7527e34b00ce/root/var/svc/log/oxide-zone-network-setup:default.log
12082024-02-28T13:29:23.348Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_49abcdd7-0bae-4ae0-88f1-0467b03df954/root/var/svc/log/oxide-crucible-agent:default.log (12008 bytes)
12092024-02-28T13:29:24.497Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_49abcdd7-0bae-4ae0-88f1-0467b03df954/root/var/svc/log/oxide-crucible-agent:default.log
12102024-02-28T13:29:24.522Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_49abcdd7-0bae-4ae0-88f1-0467b03df954/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12112024-02-28T13:29:25.594Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_49abcdd7-0bae-4ae0-88f1-0467b03df954/root/var/svc/log/oxide-crucible-downstairs:default.log
12122024-02-28T13:29:25.618Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_49abcdd7-0bae-4ae0-88f1-0467b03df954/root/var/svc/log/oxide-crucible-downstairs:downstairs-26eeba9f-c774-4a8d-9c9c-ccd10587a041.log (5613 bytes)
12132024-02-28T13:29:26.694Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_49abcdd7-0bae-4ae0-88f1-0467b03df954/root/var/svc/log/oxide-crucible-downstairs:downstairs-26eeba9f-c774-4a8d-9c9c-ccd10587a041.log
12142024-02-28T13:29:26.695Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_49abcdd7-0bae-4ae0-88f1-0467b03df954/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
12152024-02-28T13:29:27.840Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_49abcdd7-0bae-4ae0-88f1-0467b03df954/root/var/svc/log/oxide-zone-network-setup:default.log
12162024-02-28T13:29:27.840Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_6ebf9979-ce51-4c91-a9a2-011bb6255058/root/var/svc/log/oxide-crucible-pantry:default.log (1223208 bytes)
12172024-02-28T13:29:29.198Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_6ebf9979-ce51-4c91-a9a2-011bb6255058/root/var/svc/log/oxide-crucible-pantry:default.log
12182024-02-28T13:29:29.198Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_6ebf9979-ce51-4c91-a9a2-011bb6255058/root/var/svc/log/oxide-zone-network-setup:default.log (1744 bytes)
12192024-02-28T13:29:30.292Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_6ebf9979-ce51-4c91-a9a2-011bb6255058/root/var/svc/log/oxide-zone-network-setup:default.log
12202024-02-28T13:29:30.292Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-agent:default.log (43221 bytes)
12212024-02-28T13:29:31.515Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-agent:default.log
12222024-02-28T13:29:31.515Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12232024-02-28T13:29:32.612Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:default.log
12242024-02-28T13:29:32.612Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:downstairs-6960cbdc-8071-4751-a5d5-0c52591da2a2.log (5612 bytes)
12252024-02-28T13:29:33.711Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:downstairs-6960cbdc-8071-4751-a5d5-0c52591da2a2.log
12262024-02-28T13:29:33.711Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:downstairs-7b30dc63-2641-4e1a-82bb-8374a80d1439.log (3125 bytes)
12272024-02-28T13:29:34.807Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:downstairs-7b30dc63-2641-4e1a-82bb-8374a80d1439.log
12282024-02-28T13:29:34.807Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:downstairs-988789c3-8991-47a4-93fc-97510509a8ac.log (5696 bytes)
12292024-02-28T13:29:35.902Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:downstairs-988789c3-8991-47a4-93fc-97510509a8ac.log
12302024-02-28T13:29:35.902Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:downstairs-ec495347-af81-4215-b947-668072709176.log (3016 bytes)
12312024-02-28T13:29:36.996Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:downstairs-ec495347-af81-4215-b947-668072709176.log
12322024-02-28T13:29:36.996Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:snapshot-988789c3-8991-47a4-93fc-97510509a8ac-3400d481-4e0c-4b23-99d9-4ea4d578de90.log (5302 bytes)
12332024-02-28T13:29:38.096Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-crucible-downstairs:snapshot-988789c3-8991-47a4-93fc-97510509a8ac-3400d481-4e0c-4b23-99d9-4ea4d578de90.log
12342024-02-28T13:29:38.096Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
12352024-02-28T13:29:39.204Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_8dbbe7bd-5bb7-4059-a33a-2e6c08694fbd/root/var/svc/log/oxide-zone-network-setup:default.log
12362024-02-28T13:29:39.204Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_de28215d-5e75-4ba0-aaaf-7fc4933ba4c2/root/var/svc/log/oxide-nexus:default.log (34530625 bytes)
12372024-02-28T13:29:58.028Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_de28215d-5e75-4ba0-aaaf-7fc4933ba4c2/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 34530625 -> 34677872
12382024-02-28T13:29:59.099Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_de28215d-5e75-4ba0-aaaf-7fc4933ba4c2/root/var/svc/log/oxide-nexus:default.log
12392024-02-28T13:29:59.123Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-crucible-agent:default.log (15443 bytes)
12402024-02-28T13:30:00.219Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-crucible-agent:default.log
12412024-02-28T13:30:00.219Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12422024-02-28T13:30:01.735Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-crucible-downstairs:default.log
12432024-02-28T13:30:01.736Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-crucible-downstairs:downstairs-e21e29f0-a653-4424-b3c9-9c42c31fe20b.log (5692 bytes)
12442024-02-28T13:30:02.841Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-crucible-downstairs:downstairs-e21e29f0-a653-4424-b3c9-9c42c31fe20b.log
12452024-02-28T13:30:02.841Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-crucible-downstairs:snapshot-e21e29f0-a653-4424-b3c9-9c42c31fe20b-3400d481-4e0c-4b23-99d9-4ea4d578de90.log (5305 bytes)
12462024-02-28T13:30:03.947Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-crucible-downstairs:snapshot-e21e29f0-a653-4424-b3c9-9c42c31fe20b-3400d481-4e0c-4b23-99d9-4ea4d578de90.log
12472024-02-28T13:30:03.947Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
12482024-02-28T13:30:03.977Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1703 -> 0
12492024-02-28T13:30:05.053Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6e567479-af48-4e4b-925c-59aa4134ba69/root/var/svc/log/oxide-zone-network-setup:default.log
12502024-02-28T13:30:05.095Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_b05778b9-9d7a-46ab-9333-eb3104c321fe/root/var/svc/log/oxide-nexus:default.log (1188937 bytes)
12512024-02-28T13:30:05.095Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_b05778b9-9d7a-46ab-9333-eb3104c321fe/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1188937 -> 0
12522024-02-28T13:30:06.173Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_b05778b9-9d7a-46ab-9333-eb3104c321fe/root/var/svc/log/oxide-nexus:default.log
12532024-02-28T13:30:06.199Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-agent:default.log (7684 bytes)
12542024-02-28T13:30:06.199Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 7684 -> 0
12552024-02-28T13:30:07.276Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-agent:default.log
12562024-02-28T13:30:07.277Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12572024-02-28T13:30:07.306Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
12582024-02-28T13:30:08.381Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-downstairs:default.log
12592024-02-28T13:30:08.381Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c2e7a71-7b19-4685-9a91-7799b3fff07f.log (3019 bytes)
12602024-02-28T13:30:08.405Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c2e7a71-7b19-4685-9a91-7799b3fff07f.log" changed size mid upload: 3019 -> 0
12612024-02-28T13:30:09.477Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c2e7a71-7b19-4685-9a91-7799b3fff07f.log
12622024-02-28T13:30:09.478Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
12632024-02-28T13:30:09.502Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1702 -> 0
12642024-02-28T13:30:10.580Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b8c00cc1-cb6b-4f24-b10d-eb3f06dedf25/root/var/svc/log/oxide-zone-network-setup:default.log
12652024-02-28T13:30:10.580Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c263e526-2219-421f-a41f-871118e2593a/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
12662024-02-28T13:30:10.610Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c263e526-2219-421f-a41f-871118e2593a/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 783 -> 0
12672024-02-28T13:30:11.696Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c263e526-2219-421f-a41f-871118e2593a/root/var/svc/log/oxide-crucible-pantry:default.log
12682024-02-28T13:30:11.696Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c263e526-2219-421f-a41f-871118e2593a/root/var/svc/log/oxide-zone-network-setup:default.log (1745 bytes)
12692024-02-28T13:30:11.729Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c263e526-2219-421f-a41f-871118e2593a/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1745 -> 0
12702024-02-28T13:30:12.814Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_c263e526-2219-421f-a41f-871118e2593a/root/var/svc/log/oxide-zone-network-setup:default.log
12712024-02-28T13:30:12.814Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_2063053f-6bdd-4615-8127-179923ae9a65/root/var/svc/log/oxide-nexus:default.log (6148047 bytes)
12722024-02-28T13:30:12.968Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_2063053f-6bdd-4615-8127-179923ae9a65/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 6148047 -> 77763
12732024-02-28T13:30:14.056Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_2063053f-6bdd-4615-8127-179923ae9a65/root/var/svc/log/oxide-nexus:default.log
12742024-02-28T13:30:14.094Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-agent:default.log (15012 bytes)
12752024-02-28T13:30:14.094Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 15012 -> 0
12762024-02-28T13:30:15.176Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-agent:default.log
12772024-02-28T13:30:15.176Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12782024-02-28T13:30:15.201Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
12792024-02-28T13:30:16.271Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:default.log
12802024-02-28T13:30:16.271Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:downstairs-dbf8831d-c63f-4191-ab39-1451a02a1714.log (5696 bytes)
12812024-02-28T13:30:16.295Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:downstairs-dbf8831d-c63f-4191-ab39-1451a02a1714.log" changed size mid upload: 5696 -> 0
12822024-02-28T13:30:17.376Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:downstairs-dbf8831d-c63f-4191-ab39-1451a02a1714.log
12832024-02-28T13:30:17.376Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:snapshot-dbf8831d-c63f-4191-ab39-1451a02a1714-3400d481-4e0c-4b23-99d9-4ea4d578de90.log (5304 bytes)
12842024-02-28T13:30:17.401Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:snapshot-dbf8831d-c63f-4191-ab39-1451a02a1714-3400d481-4e0c-4b23-99d9-4ea4d578de90.log" changed size mid upload: 5304 -> 0
12852024-02-28T13:30:18.470Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-crucible-downstairs:snapshot-dbf8831d-c63f-4191-ab39-1451a02a1714-3400d481-4e0c-4b23-99d9-4ea4d578de90.log
12862024-02-28T13:30:18.470Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
12872024-02-28T13:30:18.495Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1703 -> 0
12882024-02-28T13:30:19.582Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c803c23d-6aa1-46ff-a7bf-b16818f7abe5/root/var/svc/log/oxide-zone-network-setup:default.log
12892024-02-28T13:30:19.582Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/measurements.log (24797 bytes)
12902024-02-28T13:30:19.678Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/measurements.log" changed size mid upload: 24797 -> 28633
12912024-02-28T13:30:20.749Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/measurements.log
12922024-02-28T13:30:20.774Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/statistics.log (16263 bytes)
12932024-02-28T13:30:20.841Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/statistics.log" changed size mid upload: 16263 -> 19773
12942024-02-28T13:30:21.914Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/statistics.log
12952024-02-28T13:30:21.914Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/tracking.log (2514 bytes)
12962024-02-28T13:30:21.962Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/tracking.log" changed size mid upload: 2514 -> 2778
12972024-02-28T13:30:23.038Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_01d1c8e5-8905-4e34-824f-8a30fe31e240/root/var/log/chrony/tracking.log