01HPFFGWFT425ZA2618GD616W4: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HPFFHVVM4DKCP8NP72J4CPJM

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-12T20:56:57.215Zjob dependencies complete; ready to run (waiting for 38 m 6 s)
22024-02-12T21:00:29.821Zjob assigned to worker 01HPFHQTXEE4S8BBBJYGHJN49K (queued for 3 m 32 s)
32024-02-12T21:00:30.073Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-02-12T21:00:30.132Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-02-12T21:00:30.186Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... 59%Error: No response to keepalive - Terminating session
62024-02-12T21:00:30.236ZError: No response de-activating SOL payload
72024-02-12T21:00:30.287Z[SOL Session operational. Use ~? for help]
82024-02-12T21:00:30.340Z ok
92024-02-12T21:00:30.393Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
102024-02-12T21:00:30.440Zhttp://172.20.0.5:9969/postboot/sock... ok
112024-02-12T21:00:30.488ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
122024-02-12T21:00:30.544Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
132024-02-12T21:00:30.603ZOxide Helios Version helios-2.0.22451 64-bit
142024-02-12T21:00:30.652ZConfiguring devices.
152024-02-12T21:00:30.708Z##################################################
162024-02-12T21:00:30.764Z#### ############# ##
172024-02-12T21:00:30.821Z### ### ############ ##
182024-02-12T21:00:30.879Z## ### # ## ### ## Oxide Computer Company ##
192024-02-12T21:00:30.938Z## ## ## ### # ### ##
202024-02-12T21:00:30.992Z## # ### #### #### This Station Under ##
212024-02-12T21:00:31.055Z### ### #### # ### Computer Control ##
222024-02-12T21:00:31.118Z#### #### ### ## ##
232024-02-12T21:00:31.171Z##################################################
242024-02-12T21:00:31.234ZHostname: sock
252024-02-12T21:00:31.302ZLoading smf(7) service descriptions:
262024-02-12T21:00:31.889Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-000e38cfb9ecff29.gz
272024-02-12T21:00:40.610Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-000e38cfb9ecff29.gz
282024-02-12T21:00:40.610Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
292024-02-12T21:01:27.100Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
302024-02-12T21:01:27.100Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a157f2ab3f0f1a11.gz
312024-02-12T21:02:01.471Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a157f2ab3f0f1a11.gz
322024-02-12T21:02:01.471Zdownloading input: /input/ci-tools/work/caboose-util.gz
332024-02-12T21:02:02.767Zdownloaded input: /input/ci-tools/work/caboose-util.gz
342024-02-12T21:02:02.767Zdownloading input: /input/ci-tools/work/tufaceous.gz
352024-02-12T21:02:05.528Zsock console login: Error: No response to keepalive - Terminating session
362024-02-12T21:02:06.237Zdownloaded input: /input/ci-tools/work/tufaceous.gz
372024-02-12T21:02:06.266Zdownloading input: /input/package/work/version.txt
382024-02-12T21:02:06.267Zdownloaded input: /input/package/work/version.txt
392024-02-12T21:02:06.267Zdownloading input: /input/package/work/package.tar.gz
402024-02-12T21:02:15.470ZError: No response de-activating SOL payload
412024-02-12T21:02:16.829Z[SOL Session operational. Use ~? for help]
422024-02-12T21:02:29.112Zdownloaded input: /input/package/work/package.tar.gz
432024-02-12T21:02:29.112Zdownloading input: /input/package/work/global-zone-packages.tar.gz
442024-02-12T21:02:59.605Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
452024-02-12T21:02:59.605Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
462024-02-12T21:03:08.166Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
472024-02-12T21:03:08.202Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
482024-02-12T21:03:48.948Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
492024-02-12T21:03:48.948Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
502024-02-12T21:04:29.063Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
512024-02-12T21:04:29.063Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
522024-02-12T21:04:54.288Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
532024-02-12T21:04:54.288Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
542024-02-12T21:04:57.452Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
552024-02-12T21:04:57.477Zdownloading input: /input/package/work/zones/crucible.tar.gz
562024-02-12T21:05:03.718Zdownloaded input: /input/package/work/zones/crucible.tar.gz
572024-02-12T21:05:03.718Zdownloading input: /input/package/work/zones/external-dns.tar.gz
582024-02-12T21:05:05.492ZError: No response to keepalive - Terminating session
592024-02-12T21:05:08.854Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
602024-02-12T21:05:08.879Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
612024-02-12T21:05:13.135Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
622024-02-12T21:05:13.135Zdownloading input: /input/package/work/zones/ntp.tar.gz
632024-02-12T21:05:13.175Zdownloaded input: /input/package/work/zones/ntp.tar.gz
642024-02-12T21:05:13.175Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
652024-02-12T21:05:15.684ZError: No response de-activating SOL payload
662024-02-12T21:05:16.767Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
672024-02-12T21:05:16.792Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
682024-02-12T21:05:16.803Z[SOL Session operational. Use ~? for help]
692024-02-12T21:05:21.285Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
702024-02-12T21:05:21.285Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
712024-02-12T21:05:37.309Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
722024-02-12T21:05:37.309Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
732024-02-12T21:06:00.561Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
742024-02-12T21:06:00.561Zdownloading input: /input/package/work/zones/overlay.tar.gz
752024-02-12T21:06:00.695Zdownloaded input: /input/package/work/zones/overlay.tar.gz
762024-02-12T21:06:00.721Zdownloading input: /input/package/work/zones/oximeter.tar.gz
772024-02-12T21:06:10.527Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
782024-02-12T21:06:10.527Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
792024-02-12T21:06:22.242Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
802024-02-12T21:06:22.242Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
812024-02-12T21:07:16.246Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
822024-02-12T21:07:16.271Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
832024-02-12T21:07:57.335Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
842024-02-12T21:07:57.335Zstarting task 0: "setup"
852024-02-12T21:07:57.360Z++ uname -s
862024-02-12T21:07:57.360Z+ kern=SunOS
872024-02-12T21:07:57.360Z+ case "$kern" in
882024-02-12T21:07:57.360Z+ groupadd -g 12345 build
892024-02-12T21:07:57.360Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
902024-02-12T21:07:59.355Z+ zfs create -o mountpoint=/work rpool/work
912024-02-12T21:07:59.379Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
922024-02-12T21:07:59.379Z+ home_fs=zfs
932024-02-12T21:07:59.379Z+ [[ zfs == autofs ]]
942024-02-12T21:07:59.379Z+ mkdir -p /home/build
952024-02-12T21:07:59.404Z+ chown build:build /home/build /work
962024-02-12T21:08:01.383Z+ chmod 0700 /home/build /work
972024-02-12T21:08:01.408Zprocess exited: duration 4051 ms, exit code 0
 
982024-02-12T21:08:01.459Zstarting task 1: "authentication"
992024-02-12T21:08:01.507Zprocess exited: duration 46 ms, exit code 0
 
1002024-02-12T21:08:01.570Zstarting task 2: "build"
1012024-02-12T21:08:01.597Z+ trap _exit_trap EXIT
1022024-02-12T21:08:01.597Z+ set +x
 
1032024-02-12T21:08:05.411ZError: No response to keepalive - Terminating session
1042024-02-12T21:08:15.660ZError: No response de-activating SOL payload
1052024-02-12T21:08:16.762Z[SOL Session operational. Use ~? for help]
 
1062024-02-12T21:08:27.602Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1072024-02-12T21:08:27.849Zsecpolicy_fs_linkdir: 0x55 = 0x55
1082024-02-12T21:08:27.849Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1092024-02-12T21:08:27.849Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1102024-02-12T21:08:27.849Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1112024-02-12T21:08:27.874Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1122024-02-12T21:08:27.874Zsecpolicy_fs_linkdir+5: 0 = 0x1
1132024-02-12T21:08:27.874Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1142024-02-12T21:08:27.874Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1152024-02-12T21:08:27.874Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1162024-02-12T21:08:27.874Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1172024-02-12T21:08:27.874Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1182024-02-12T21:08:27.874Z+ [[ -d /opt/oxide ]]
1192024-02-12T21:08:27.874Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1202024-02-12T21:08:27.874Z+ pfexec mkdir /opt/oxide
1212024-02-12T21:08:27.874Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1222024-02-12T21:08:27.874Z+ [[ -d /opt/oxide-underneath ]]
1232024-02-12T21:08:27.874Z+ cd /opt/oxide-underneath
1242024-02-12T21:08:27.874Z+ pfexec tar ceEp@/f - .
1252024-02-12T21:08:27.874Z+ cd /opt/oxide
1262024-02-12T21:08:27.875Z+ pfexec tar xveEp@/f -
1272024-02-12T21:08:27.912Zx ., 0 bytes, 0 tape blocks
1282024-02-12T21:08:27.912Zx ./opte, 0 bytes, 0 tape blocks
1292024-02-12T21:08:27.913Zx ./opte/bin, 0 bytes, 0 tape blocks
1302024-02-12T21:08:27.913Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1312024-02-12T21:08:27.938Z+ pfexec rm -rf /opt/oxide-underneath
1322024-02-12T21:08:27.938Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1332024-02-12T21:08:27.964Z+ pfexec mkdir /opt/oxide/work
1342024-02-12T21:08:27.964Z+ pfexec chown build:build /opt/oxide/work
1352024-02-12T21:08:27.964Z+ cd /opt/oxide/work
1362024-02-12T21:08:27.964Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1372024-02-12T21:08:29.668ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1382024-02-12T21:08:29.668Zx out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks
1392024-02-12T21:08:29.668Zx out/omicron-sled-agent.tar, 122565120 bytes, 239385 tape blocks
1402024-02-12T21:08:29.668Zx out/oxlog.tar, 8382464 bytes, 16372 tape blocks
1412024-02-12T21:08:29.669Zx out/target/test, 75 bytes, 1 tape blocks
1422024-02-12T21:08:29.669Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1432024-02-12T21:08:29.669Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1442024-02-12T21:08:29.669Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1452024-02-12T21:08:29.669Zx target/release/omicron-package, 45713312 bytes, 89284 tape blocks
1462024-02-12T21:08:29.669Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1472024-02-12T21:08:29.669Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1482024-02-12T21:08:29.669Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1492024-02-12T21:08:29.669Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1502024-02-12T21:08:29.669Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1512024-02-12T21:08:29.669Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1522024-02-12T21:08:29.669Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1532024-02-12T21:08:29.694Z
1542024-02-12T21:08:29.694Zreal 1.713915102
1552024-02-12T21:08:29.694Zuser 1.540158865
1562024-02-12T21:08:29.694Zsys 0.309260340
1572024-02-12T21:08:29.694Ztrap 0.000057280
1582024-02-12T21:08:29.694Ztflt 0.000000000
1592024-02-12T21:08:29.694Zdflt 0.000000000
1602024-02-12T21:08:29.694Zkflt 0.000000000
1612024-02-12T21:08:29.694Zlock 0.000000000
1622024-02-12T21:08:29.694Zslp 1.539342880
1632024-02-12T21:08:29.694Zlat 0.036754027
1642024-02-12T21:08:29.694Zstop 0.000131090
1652024-02-12T21:08:29.694Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1662024-02-12T21:08:30.851Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1672024-02-12T21:08:30.876Z+ mkdir tests
1682024-02-12T21:08:30.876Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1692024-02-12T21:08:30.876Z+ ptime -m gunzip
1702024-02-12T21:08:30.876Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-000e38cfb9ecff29
1712024-02-12T21:08:31.103Z
1722024-02-12T21:08:31.128Zreal 0.231756647
1732024-02-12T21:08:31.128Zuser 0.213617458
1742024-02-12T21:08:31.128Zsys 0.017889706
1752024-02-12T21:08:31.128Ztrap 0.000022230
1762024-02-12T21:08:31.128Ztflt 0.000000000
1772024-02-12T21:08:31.128Zdflt 0.000000000
1782024-02-12T21:08:31.128Zkflt 0.000000000
1792024-02-12T21:08:31.128Zlock 0.000000000
1802024-02-12T21:08:31.128Zslp 0.000022489
1812024-02-12T21:08:31.128Zlat 0.000021759
1822024-02-12T21:08:31.128Zstop 0.000125471
1832024-02-12T21:08:31.128Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-000e38cfb9ecff29
1842024-02-12T21:08:31.128Z+ chmod a+x tests/bootstrap-000e38cfb9ecff29
1852024-02-12T21:08:31.128Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1862024-02-12T21:08:31.128Z+ ptime -m gunzip
1872024-02-12T21:08:31.129Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1882024-02-12T21:08:33.673Z
1892024-02-12T21:08:33.697Zreal 2.552800468
1902024-02-12T21:08:33.698Zuser 2.390822023
1912024-02-12T21:08:33.698Zsys 0.161531261
1922024-02-12T21:08:33.698Ztrap 0.000206012
1932024-02-12T21:08:33.698Ztflt 0.000000000
1942024-02-12T21:08:33.698Zdflt 0.000000000
1952024-02-12T21:08:33.698Zkflt 0.000000000
1962024-02-12T21:08:33.698Zlock 0.000000000
1972024-02-12T21:08:33.698Zslp 0.000023340
1982024-02-12T21:08:33.698Zlat 0.000022689
1992024-02-12T21:08:33.698Zstop 0.000133461
2002024-02-12T21:08:33.698Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
2012024-02-12T21:08:33.698Z+ chmod a+x tests/bootstrap
2022024-02-12T21:08:33.698Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2032024-02-12T21:08:33.698Z+ ptime -m gunzip
2042024-02-12T21:08:33.698Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a157f2ab3f0f1a11
2052024-02-12T21:08:36.252Z
2062024-02-12T21:08:36.277Zreal 2.573703825
2072024-02-12T21:08:36.277Zuser 2.400509293
2082024-02-12T21:08:36.277Zsys 0.172769170
2092024-02-12T21:08:36.277Ztrap 0.000184801
2102024-02-12T21:08:36.277Ztflt 0.000000000
2112024-02-12T21:08:36.277Zdflt 0.000000000
2122024-02-12T21:08:36.277Zkflt 0.000000000
2132024-02-12T21:08:36.277Zlock 0.000000000
2142024-02-12T21:08:36.277Zslp 0.000019909
2152024-02-12T21:08:36.277Zlat 0.000021639
2162024-02-12T21:08:36.277Zstop 0.000136030
2172024-02-12T21:08:36.277Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a157f2ab3f0f1a11
2182024-02-12T21:08:36.277Z+ chmod a+x tests/end_to_end_tests-a157f2ab3f0f1a11
2192024-02-12T21:08:36.277Z+ bmat address ls
2202024-02-12T21:08:36.277ZNAME CIDR FIRST LAST COUNT
2212024-02-12T21:08:36.277Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2222024-02-12T21:08:36.277Z++ bmat address ls -f extra -Ho first,last,count
2232024-02-12T21:08:36.302Z+ set -- 10.151.2.164 10.151.2.227 64
2242024-02-12T21:08:36.302Z+ EXTRA_IP_START=10.151.2.164
2252024-02-12T21:08:36.302Z+ EXTRA_IP_END=10.151.2.227
2262024-02-12T21:08:36.302Z+ EXTRA_IP_COUNT=64
2272024-02-12T21:08:36.302Z+ (( EXTRA_IP_COUNT >= 32 ))
2282024-02-12T21:08:36.302Z+ EXTRA_IP_BASE=10.151.2
2292024-02-12T21:08:36.302Z+ EXTRA_IP_FOCTET=164
2302024-02-12T21:08:36.302Z+ EXTRA_IP_LOCTET=227
2312024-02-12T21:08:36.302Z+ SERVICE_IP_POOL_START=10.151.2.164
2322024-02-12T21:08:36.302Z+ SERVICE_IP_POOL_END=10.151.2.173
2332024-02-12T21:08:36.302Z+ DNS_IP1=10.151.2.164
2342024-02-12T21:08:36.302Z+ DNS_IP2=10.151.2.165
2352024-02-12T21:08:36.302Z+ UPLINK_IP=10.151.2.174
2362024-02-12T21:08:36.302Z+ IPPOOL_START=10.151.2.175
2372024-02-12T21:08:36.302Z+ IPPOOL_END=10.151.2.227
2382024-02-12T21:08:36.302Z++ ipadm show-addr -po type,addr
2392024-02-12T21:08:36.302Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2402024-02-12T21:08:36.302Z+ GATEWAY_IP=10.151.2.100
2412024-02-12T21:08:36.302Z+ [[ -n 10.151.2.100 ]]
2422024-02-12T21:08:36.302Z+ ping -s 10.151.2.100 56 1
2432024-02-12T21:08:36.302ZPING 10.151.2.100: 56 data bytes
2442024-02-12T21:08:36.303Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.012 ms
2452024-02-12T21:08:36.303Z
2462024-02-12T21:08:36.303Z----10.151.2.100 PING Statistics----
2472024-02-12T21:08:36.303Z1 packets transmitted, 1 packets received, 0% packet loss
2482024-02-12T21:08:36.303Zround-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan
2492024-02-12T21:08:36.303Z++ arp -an
2502024-02-12T21:08:36.303Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2512024-02-12T21:08:36.327Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2522024-02-12T21:08:36.327Z+ routeadm -e ipv4-forwarding -u
2532024-02-12T21:08:36.415Z+ PXA_START=10.151.2.164
2542024-02-12T21:08:36.416Z+ PXA_END=10.151.2.227
2552024-02-12T21:08:36.416Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2562024-02-12T21:08:36.440Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2572024-02-12T21:08:36.613Z+ ZPOOL_VDEV_DIR=/scratch
2582024-02-12T21:08:36.613Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2592024-02-12T21:08:36.638Z+++ dirname ./tools/create_virtual_hardware.sh
2602024-02-12T21:08:36.638Z++ cd ./tools
2612024-02-12T21:08:36.638Z++ pwd
2622024-02-12T21:08:36.638Z+ SOURCE_DIR=/opt/oxide/work/tools
2632024-02-12T21:08:36.638Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2642024-02-12T21:08:36.638Z+ SOFTNPU_MODE=zone
2652024-02-12T21:08:36.638Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2662024-02-12T21:08:36.638Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2672024-02-12T21:08:36.638Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2682024-02-12T21:08:36.638Z++ dladm show-phys -p -o LINK
2692024-02-12T21:08:36.638Z++ head -1
2702024-02-12T21:08:36.663Z+ PHYSICAL_LINK=igb0
2712024-02-12T21:08:36.663Z+ echo 'Using igb0 as physical link'
2722024-02-12T21:08:36.663ZUsing igb0 as physical link
2732024-02-12T21:08:36.663Z+ ensure_run_as_root
2742024-02-12T21:08:36.663Z++ id -u
2752024-02-12T21:08:36.663Z+ [[ 0 -ne 0 ]]
2762024-02-12T21:08:36.663Z+ ensure_zpools
2772024-02-12T21:08:36.663Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2782024-02-12T21:08:36.663Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2792024-02-12T21:08:36.663Z+ readarray -t ZPOOLS
2802024-02-12T21:08:36.663Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2812024-02-12T21:08:36.663Z++ sed 's/[ ",]//g'
2822024-02-12T21:08:36.663Z+ for ZPOOL in "${ZPOOLS[@]}"
2832024-02-12T21:08:36.663Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2842024-02-12T21:08:36.663ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2852024-02-12T21:08:36.663Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-12T21:08:36.663Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2872024-02-12T21:08:36.663Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2882024-02-12T21:08:36.663Z0+0 records in
2892024-02-12T21:08:36.663Z0+0 records out
2902024-02-12T21:08:36.663Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
2912024-02-12T21:08:36.663Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2922024-02-12T21:08:36.664Z+ set +x
2932024-02-12T21:08:36.664ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2942024-02-12T21:08:36.664Z++ zpool list -o name
2952024-02-12T21:08:36.664Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2962024-02-12T21:08:36.664Z+ [[ -z '' ]]
2972024-02-12T21:08:36.664Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2982024-02-12T21:08:36.694Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2992024-02-12T21:08:36.718Z+ set +x
3002024-02-12T21:08:36.718ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3012024-02-12T21:08:36.718Z+ for ZPOOL in "${ZPOOLS[@]}"
3022024-02-12T21:08:36.718Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3032024-02-12T21:08:36.719ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3042024-02-12T21:08:36.719Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-12T21:08:36.719Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3062024-02-12T21:08:36.719Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3072024-02-12T21:08:36.719Z0+0 records in
3082024-02-12T21:08:36.719Z0+0 records out
3092024-02-12T21:08:36.719Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3102024-02-12T21:08:36.719Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3112024-02-12T21:08:36.719Z+ set +x
3122024-02-12T21:08:36.719ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3132024-02-12T21:08:36.719Z++ zpool list -o name
3142024-02-12T21:08:36.719Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3152024-02-12T21:08:36.719Z+ [[ -z '' ]]
3162024-02-12T21:08:36.719Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3172024-02-12T21:08:36.751Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3182024-02-12T21:08:36.751Z+ set +x
3192024-02-12T21:08:36.751Z+ for ZPOOL in "${ZPOOLS[@]}"
3202024-02-12T21:08:36.751Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3212024-02-12T21:08:36.751Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3222024-02-12T21:08:36.751ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3232024-02-12T21:08:36.751ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3242024-02-12T21:08:36.751Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3252024-02-12T21:08:36.751Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3262024-02-12T21:08:36.751Z0+0 records in
3272024-02-12T21:08:36.751Z0+0 records out
3282024-02-12T21:08:36.751Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3292024-02-12T21:08:36.751Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3302024-02-12T21:08:36.751Z+ set +x
3312024-02-12T21:08:36.752ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3322024-02-12T21:08:36.752Z++ zpool list -o name
3332024-02-12T21:08:36.752Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3342024-02-12T21:08:36.752Z+ [[ -z '' ]]
3352024-02-12T21:08:36.752Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3362024-02-12T21:08:36.777Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3372024-02-12T21:08:36.777Z+ set +x
3382024-02-12T21:08:36.801ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3392024-02-12T21:08:36.801Z+ for ZPOOL in "${ZPOOLS[@]}"
3402024-02-12T21:08:36.801Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3412024-02-12T21:08:36.801ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3422024-02-12T21:08:36.801Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-12T21:08:36.801Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3442024-02-12T21:08:36.801Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3452024-02-12T21:08:36.801Z0+0 records in
3462024-02-12T21:08:36.801Z0+0 records out
3472024-02-12T21:08:36.801Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3482024-02-12T21:08:36.801Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3492024-02-12T21:08:36.801Z+ set +x
3502024-02-12T21:08:36.801ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3512024-02-12T21:08:36.801Z++ zpool list -o name
3522024-02-12T21:08:36.801Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3532024-02-12T21:08:36.801Z+ [[ -z '' ]]
3542024-02-12T21:08:36.801Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3552024-02-12T21:08:36.826Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3562024-02-12T21:08:36.826Z+ set +x
3572024-02-12T21:08:36.826ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3582024-02-12T21:08:36.826Z+ for ZPOOL in "${ZPOOLS[@]}"
3592024-02-12T21:08:36.826Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3602024-02-12T21:08:36.826ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3612024-02-12T21:08:36.826Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-12T21:08:36.826Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3632024-02-12T21:08:36.826Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3642024-02-12T21:08:36.826Z0+0 records in
3652024-02-12T21:08:36.826Z0+0 records out
3662024-02-12T21:08:36.826Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3672024-02-12T21:08:36.826Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3682024-02-12T21:08:36.826Z+ set +x
3692024-02-12T21:08:36.826ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3702024-02-12T21:08:36.826Z++ zpool list -o name
3712024-02-12T21:08:36.826Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3722024-02-12T21:08:36.851Z+ [[ -z '' ]]
3732024-02-12T21:08:36.851Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3742024-02-12T21:08:36.875Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3752024-02-12T21:08:36.875Z+ set +x
3762024-02-12T21:08:36.875ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3772024-02-12T21:08:36.875Z+ for ZPOOL in "${ZPOOLS[@]}"
3782024-02-12T21:08:36.875Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3792024-02-12T21:08:36.875ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3802024-02-12T21:08:36.875Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-12T21:08:36.875Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3822024-02-12T21:08:36.875Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3832024-02-12T21:08:36.875Z0+0 records in
3842024-02-12T21:08:36.875Z0+0 records out
3852024-02-12T21:08:36.875Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3862024-02-12T21:08:36.875Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3872024-02-12T21:08:36.876Z+ set +x
3882024-02-12T21:08:36.876ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3892024-02-12T21:08:36.876Z++ zpool list -o name
3902024-02-12T21:08:36.876Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3912024-02-12T21:08:36.900Z+ [[ -z '' ]]
3922024-02-12T21:08:36.900Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3932024-02-12T21:08:36.924Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3942024-02-12T21:08:36.924Z+ set +x
3952024-02-12T21:08:36.925ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3962024-02-12T21:08:36.925ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3972024-02-12T21:08:36.925Z+ for ZPOOL in "${ZPOOLS[@]}"
3982024-02-12T21:08:36.925Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3992024-02-12T21:08:36.925Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-12T21:08:36.925Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
4012024-02-12T21:08:36.925Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
4022024-02-12T21:08:36.925Z0+0 records in
4032024-02-12T21:08:36.925Z0+0 records out
4042024-02-12T21:08:36.925Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4052024-02-12T21:08:36.925Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4062024-02-12T21:08:36.925Z+ set +x
4072024-02-12T21:08:36.925ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
4082024-02-12T21:08:36.925Z++ zpool list -o name
4092024-02-12T21:08:36.925Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4102024-02-12T21:08:36.925Z+ [[ -z '' ]]
4112024-02-12T21:08:36.925Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4122024-02-12T21:08:36.950Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4132024-02-12T21:08:36.950Z+ set +x
4142024-02-12T21:08:36.950ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4152024-02-12T21:08:36.950Z+ for ZPOOL in "${ZPOOLS[@]}"
4162024-02-12T21:08:36.950Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4172024-02-12T21:08:36.950ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4182024-02-12T21:08:36.950Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-12T21:08:36.950Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4202024-02-12T21:08:36.950Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4212024-02-12T21:08:36.950Z0+0 records in
4222024-02-12T21:08:36.951Z0+0 records out
4232024-02-12T21:08:36.951Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4242024-02-12T21:08:36.951Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4252024-02-12T21:08:36.951Z+ set +x
4262024-02-12T21:08:36.951ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4272024-02-12T21:08:36.975Z++ zpool list -o name
4282024-02-12T21:08:36.975Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4292024-02-12T21:08:36.975Z+ [[ -z '' ]]
4302024-02-12T21:08:36.975Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4312024-02-12T21:08:37.000Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4322024-02-12T21:08:37.000Z+ set +x
4332024-02-12T21:08:37.000ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4342024-02-12T21:08:37.000Z+ for ZPOOL in "${ZPOOLS[@]}"
4352024-02-12T21:08:37.000Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4362024-02-12T21:08:37.000ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4372024-02-12T21:08:37.000Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-12T21:08:37.000Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4392024-02-12T21:08:37.001Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4402024-02-12T21:08:37.001Z0+0 records in
4412024-02-12T21:08:37.001Z0+0 records out
4422024-02-12T21:08:37.001Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4432024-02-12T21:08:37.001Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4442024-02-12T21:08:37.001Z+ set +x
4452024-02-12T21:08:37.001ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4462024-02-12T21:08:37.002Z++ zpool list -o name
4472024-02-12T21:08:37.002Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4482024-02-12T21:08:37.032Z+ [[ -z '' ]]
4492024-02-12T21:08:37.032Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4502024-02-12T21:08:37.058Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4512024-02-12T21:08:37.058Z+ set +x
4522024-02-12T21:08:37.058ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4532024-02-12T21:08:37.058Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4542024-02-12T21:08:37.058Z+ readarray -t ZPOOLS
4552024-02-12T21:08:37.058Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4562024-02-12T21:08:37.058Z++ sed 's/[ ",]//g'
4572024-02-12T21:08:37.058Z+ for ZPOOL in "${ZPOOLS[@]}"
4582024-02-12T21:08:37.058Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4592024-02-12T21:08:37.058ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4602024-02-12T21:08:37.058Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-12T21:08:37.058Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4622024-02-12T21:08:37.058Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4632024-02-12T21:08:37.058Z0+0 records in
4642024-02-12T21:08:37.058Z0+0 records out
4652024-02-12T21:08:37.058Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4662024-02-12T21:08:37.058Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4672024-02-12T21:08:37.058Z+ set +x
4682024-02-12T21:08:37.058ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4692024-02-12T21:08:37.059Z++ zpool list -o name
4702024-02-12T21:08:37.059Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4712024-02-12T21:08:37.083Z+ [[ -z '' ]]
4722024-02-12T21:08:37.083Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4732024-02-12T21:08:37.107Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4742024-02-12T21:08:37.107Z+ set +x
4752024-02-12T21:08:37.107ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4762024-02-12T21:08:37.107Z+ for ZPOOL in "${ZPOOLS[@]}"
4772024-02-12T21:08:37.107Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4782024-02-12T21:08:37.107ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4792024-02-12T21:08:37.107Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-12T21:08:37.107Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4812024-02-12T21:08:37.107Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4822024-02-12T21:08:37.108Z0+0 records in
4832024-02-12T21:08:37.108Z0+0 records out
4842024-02-12T21:08:37.108Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4852024-02-12T21:08:37.108Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4862024-02-12T21:08:37.108Z+ set +x
4872024-02-12T21:08:37.108ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4882024-02-12T21:08:37.108Z++ zpool list -o name
4892024-02-12T21:08:37.108Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4902024-02-12T21:08:37.108Z+ [[ -z '' ]]
4912024-02-12T21:08:37.108Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4922024-02-12T21:08:37.134Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4932024-02-12T21:08:37.134Z+ set +x
4942024-02-12T21:08:37.134ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4952024-02-12T21:08:37.159Z+ [[ zone == \z\o\n\e ]]
4962024-02-12T21:08:37.159Z+ ensure_simulated_links igb0
4972024-02-12T21:08:37.159Z+ local PHYSICAL_LINK=igb0
4982024-02-12T21:08:37.159Z+ INDICES=("0" "1")
4992024-02-12T21:08:37.159Z+ for I in "${INDICES[@]}"
5002024-02-12T21:08:37.159Z++ get_simnet_name_if_exists net0
5012024-02-12T21:08:37.159Z++ dladm show-simnet -p -o LINK net0
5022024-02-12T21:08:37.159Z++ echo ''
5032024-02-12T21:08:37.159Z+ [[ -z '' ]]
5042024-02-12T21:08:37.159Z+ dladm create-simnet -t net0
5052024-02-12T21:08:37.159Z+ dladm create-simnet -t sc0_0
5062024-02-12T21:08:37.159Z+ dladm modify-simnet -t -p net0 sc0_0
5072024-02-12T21:08:37.159Z+ dladm set-linkprop -p mtu=9000 sc0_0
5082024-02-12T21:08:37.159Z+ success 'Simnet net0/sc0_0 exists'
5092024-02-12T21:08:37.159Z+ set +x
5102024-02-12T21:08:37.159ZSimnet net0/sc0_0 exists
5112024-02-12T21:08:37.159Z+ for I in "${INDICES[@]}"
5122024-02-12T21:08:37.184Z++ get_simnet_name_if_exists net1
5132024-02-12T21:08:37.184Z++ dladm show-simnet -p -o LINK net1
5142024-02-12T21:08:37.184Z++ echo ''
5152024-02-12T21:08:37.184Z+ [[ -z '' ]]
5162024-02-12T21:08:37.184Z+ dladm create-simnet -t net1
5172024-02-12T21:08:37.184Z+ dladm create-simnet -t sc1_0
5182024-02-12T21:08:37.184Z+ dladm modify-simnet -t -p net1 sc1_0
5192024-02-12T21:08:37.184Z+ dladm set-linkprop -p mtu=9000 sc1_0
5202024-02-12T21:08:37.184Z+ success 'Simnet net1/sc1_0 exists'
5212024-02-12T21:08:37.184Z+ set +x
5222024-02-12T21:08:37.184ZSimnet net1/sc1_0 exists
5232024-02-12T21:08:37.184Z++ get_vnic_name_if_exists sc0_1
5242024-02-12T21:08:37.184Z++ dladm show-vnic -p -o LINK sc0_1
5252024-02-12T21:08:37.209Z++ echo ''
5262024-02-12T21:08:37.209Z+ [[ -z '' ]]
5272024-02-12T21:08:37.209Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5282024-02-12T21:08:37.209Z+ [[ -v PROMISC_FILT_OFF ]]
5292024-02-12T21:08:37.209Z+ success 'Vnic sc0_1 exists'
5302024-02-12T21:08:37.209Z+ set +x
5312024-02-12T21:08:37.209ZVnic sc0_1 exists
5322024-02-12T21:08:37.209Z+ warn_if_no_proxy_arp
5332024-02-12T21:08:37.209Z+ [[ -v PXA_START ]]
5342024-02-12T21:08:37.209Z+ [[ -v PXA_END ]]
5352024-02-12T21:08:37.209Z+ ensure_softnpu_zone
5362024-02-12T21:08:37.209Z+ zoneadm list
5372024-02-12T21:08:37.209Z+ grep -q sidecar_softnpu
5382024-02-12T21:08:37.209Z+ [[ -f out/npuzone/npuzone ]]
5392024-02-12T21:08:37.209Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5402024-02-12T21:08:37.234Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5412024-02-12T21:08:43.387Zdownloading softnpu ...done
5422024-02-12T21:08:43.412Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5432024-02-12T21:08:48.169Zdownloading asic_program.so ...done
5442024-02-12T21:08:48.193Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5452024-02-12T21:08:54.104Zdownloading scadm ...done
5462024-02-12T21:08:54.128Zcreating port tfportrear0_0 for sc0_0
5472024-02-12T21:08:54.128Zcreating port tfportqsfp0_0 for sc0_1
5482024-02-12T21:08:54.152Zsoftnpu zone setup
5492024-02-12T21:08:54.153Zconfigure zone
5502024-02-12T21:08:54.153Zinstall zone
5512024-02-12T21:08:55.222Zboot zone
5522024-02-12T21:08:58.327Z[sidecar_softnpu] svcs milestone/network
5532024-02-12T21:08:58.354ZSTATE STIME FMRI
5542024-02-12T21:08:58.354Zonline 21:08:57 svc:/milestone/network:default
5552024-02-12T21:08:58.355Z[sidecar_softnpu] /softnpu/npu start
5562024-02-12T21:08:58.379Z
5572024-02-12T21:08:58.403Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5582024-02-12T21:08:58.403Z+ GATEWAY_IP=10.151.2.100
5592024-02-12T21:08:58.403Z+ echo 'Using 10.151.2.100 as gateway ip'
5602024-02-12T21:08:58.403ZUsing 10.151.2.100 as gateway ip
5612024-02-12T21:08:58.403Z+ [[ ! -v GATEWAY_MAC ]]
5622024-02-12T21:08:58.403Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
5632024-02-12T21:08:58.404Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5642024-02-12T21:08:58.404Z+++ echo 18:c0:4d:0d:a0:2a
5652024-02-12T21:08:58.404Z+ COUNT=1
5662024-02-12T21:08:58.404Z+ [[ 1 -ne 1 ]]
5672024-02-12T21:08:58.404Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
5682024-02-12T21:08:58.404ZUsing 18:c0:4d:0d:a0:2a as gateway mac
5692024-02-12T21:08:58.404Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5702024-02-12T21:08:58.404Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5712024-02-12T21:08:58.428Z+ PXA_MAC=a8:e1:de:01:70:1d
5722024-02-12T21:08:58.428Z+ [[ -v PXA_START ]]
5732024-02-12T21:08:58.428Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5742024-02-12T21:08:58.428Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5752024-02-12T21:08:58.452Z+ z_scadm dump-state
5762024-02-12T21:08:58.452Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5772024-02-12T21:08:58.478Zlocal v6:
5782024-02-12T21:08:58.478Zlocal v4:
5792024-02-12T21:08:58.479Zrouter v6:
5802024-02-12T21:08:58.479Zrouter v4_idx:
5812024-02-12T21:08:58.479Zrouter v4_routes:
5822024-02-12T21:08:58.479Zresolver v4:
5832024-02-12T21:08:58.479Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
5842024-02-12T21:08:58.479Zresolver v6:
5852024-02-12T21:08:58.479Znat v4:
5862024-02-12T21:08:58.479Znat_v6:
5872024-02-12T21:08:58.479Zport_mac:
5882024-02-12T21:08:58.479Zproxy arp:
5892024-02-12T21:08:58.479Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
5902024-02-12T21:08:58.504Z+ success 'softnpu zone exists'
5912024-02-12T21:08:58.504Z+ set +x
5922024-02-12T21:08:58.504Zsoftnpu zone exists
5932024-02-12T21:08:58.504Z
5942024-02-12T21:08:58.504Zreal 21.863682865
5952024-02-12T21:08:58.504Zuser 0.689335095
5962024-02-12T21:08:58.504Zsys 1.564942091
5972024-02-12T21:08:58.504Ztrap 0.000098154
5982024-02-12T21:08:58.504Ztflt 0.000162176
5992024-02-12T21:08:58.505Zdflt 0.001235521
6002024-02-12T21:08:58.505Zkflt 0.000000000
6012024-02-12T21:08:58.505Zlock 16:54.473767297
6022024-02-12T21:08:58.505Zslp 1:05.350356063
6032024-02-12T21:08:58.505Zlat 0.072811851
6042024-02-12T21:08:58.505Zstop 0.343782393
6052024-02-12T21:08:58.505Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
6062024-02-12T21:08:58.530Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6072024-02-12T21:08:58.530Z+ SILO_NAME=recovery
6082024-02-12T21:08:58.530Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6092024-02-12T21:08:58.530Z+ EXTERNAL_DNS_DOMAIN=oxide.test
6102024-02-12T21:08:58.530Z+ sed -i~ '
6112024-02-12T21:08:58.530Z /^external_dns_ips/c\
6122024-02-12T21:08:58.530Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6132024-02-12T21:08:58.530Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6142024-02-12T21:08:58.530Z /^first/c\
6152024-02-12T21:08:58.530Zfirst = "10.151.2.164"
6162024-02-12T21:08:58.530Z /^last/c\
6172024-02-12T21:08:58.530Zlast = "10.151.2.173"
6182024-02-12T21:08:58.530Z }
6192024-02-12T21:08:58.530Z /^\[rack_network_config/,/^$/ {
6202024-02-12T21:08:58.530Z /^infra_ip_first/c\
6212024-02-12T21:08:58.530Zinfra_ip_first = "10.151.2.174"
6222024-02-12T21:08:58.530Z /^infra_ip_last/c\
6232024-02-12T21:08:58.531Zinfra_ip_last = "10.151.2.174"
6242024-02-12T21:08:58.531Z }
6252024-02-12T21:08:58.531Z /^\[\[rack_network_config.ports/,/^$/ {
6262024-02-12T21:08:58.531Z /^routes/c\
6272024-02-12T21:08:58.531Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
6282024-02-12T21:08:58.531Z /^addresses/c\
6292024-02-12T21:08:58.531Zaddresses = \["10.151.2.174/24"\]
6302024-02-12T21:08:58.531Z }
6312024-02-12T21:08:58.531Z' pkg/config-rss.toml
6322024-02-12T21:08:58.531Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6332024-02-12T21:08:58.531Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6342024-02-12T21:08:58.531Z+++ pkg/config-rss.toml Mon Feb 12 21:08:58 2024
6352024-02-12T21:08:58.531Z@@ -33,7 +33,7 @@
6362024-02-12T21:08:58.531Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6372024-02-12T21:08:58.531Z # must be contained in one of the "internal services" IP Pool ranges listed
6382024-02-12T21:08:58.531Z # below.
6392024-02-12T21:08:58.531Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6402024-02-12T21:08:58.531Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6412024-02-12T21:08:58.531Z
6422024-02-12T21:08:58.531Z # Initial TLS certificates for the external API
6432024-02-12T21:08:58.531Z #
6442024-02-12T21:08:58.531Z@@ -69,8 +69,8 @@
6452024-02-12T21:08:58.531Z #
6462024-02-12T21:08:58.531Z # For more on this and what to put here, see docs/how-to-run.adoc.
6472024-02-12T21:08:58.531Z [[internal_services_ip_pool_ranges]]
6482024-02-12T21:08:58.532Z-first = "192.168.1.20"
6492024-02-12T21:08:58.532Z-last = "192.168.1.29"
6502024-02-12T21:08:58.532Z+first = "10.151.2.164"
6512024-02-12T21:08:58.532Z+last = "10.151.2.173"
6522024-02-12T21:08:58.532Z
6532024-02-12T21:08:58.532Z # TODO - this configuration is subject to change going forward. Ultimately these
6542024-02-12T21:08:58.532Z # parameters should be provided to the control plane via wicket, but we need to
6552024-02-12T21:08:58.532Z@@ -100,9 +100,9 @@
6562024-02-12T21:08:58.532Z # You can configure multiple uplinks by repeating the following stanza
6572024-02-12T21:08:58.532Z [[rack_network_config.ports]]
6582024-02-12T21:08:58.532Z # Routes associated with this port.
6592024-02-12T21:08:58.532Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6602024-02-12T21:08:58.532Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
6612024-02-12T21:08:58.532Z # Addresses associated with this port.
6622024-02-12T21:08:58.532Z-addresses = ["192.168.1.30/24"]
6632024-02-12T21:08:58.532Z+addresses = ["10.151.2.174/24"]
6642024-02-12T21:08:58.532Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6652024-02-12T21:08:58.532Z port = "qsfp0"
6662024-02-12T21:08:58.532Z # The speed of this port.
6672024-02-12T21:08:58.532Z+ true
6682024-02-12T21:08:58.532Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6692024-02-12T21:08:58.557Za pkg/config-rss.toml 7K
6702024-02-12T21:08:58.557Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6712024-02-12T21:08:58.557Z+ TLS_NAME=recovery.sys.oxide.test
6722024-02-12T21:08:58.557Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6732024-02-12T21:08:58.928Z...+....+...........+..................................+.........+..+..........+..+.+............+...+.....+.+.....+......+....+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+..+.............+...+............+..+.+.....+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+.........+.+..+....+......+.....+....+.........+.....+....+......+..+............+.+......+...+...........+....+...........+.......+...+..+..................+.+......+...+..+..........+..+.......+..............+.......+.......................+.........+......+.+.....+...+..........+.....................+......+..............+.......+............+...+...............+..............+......+..........+...+...........+......+....+...............+...+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6742024-02-12T21:09:00.073Z...+....+.....+.+.....+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.......+..+...+.+.....+.+.....+.+............+........+...+....+..+.........+......+...+............+....+..............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+...+......+.+...+...+..+...+.........+.........+............+...+....+..+.+........+.......+........+......+...................+..+....+......+..+...+....+........+................+..+....+.....+.+.....+...+.+...+...+............+..+.............+........+..........+.....+.......+...........+.........+.........................+..+......+..............................+...............+.......+...+..............+.+..+.+.........+...........+......+..................+.......+.....+......+...............+....+...+.....+.......+...............+.....+......+..........+...............+...+.........+.......................+.........+...................+.....+.+..............+.+.....................+..+.+.........+..+....+........................+.....+.......+......+..+.+......+......+.............................+.+..+.+....................+.........+......+.+.....+.+...+...........+.........+......+.........+............+.......+...+..+...+....+........+.+......+......+..................+.................+...+......+...+.......+......+...+..+.........+...+.+.........+.....+.......+...............+........+.+.................+........................+.+.....+...+......+.+.........+........+...+..........+........+.+.........+.....+......+.+...+......+......+..+...+..................+.......+..+.+......+...............+........+.......+...+...+...+......+.....+.+............+...+..+......+......+....+...........+......+............+...+............+.+...............+...........+...+..........+..+.........+............+.........+....+..+.......+......+......+...+......+...........+.+..+.+...........+.+........................+...........+...+......+..........+...+.....+......+.+......+..+......+.+...+...+...+..............+.+.........+..+......+...............+.......+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6752024-02-12T21:09:00.098Z-----
6762024-02-12T21:09:00.098Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6772024-02-12T21:09:00.123Za pkg/initial-tls-cert.pem 2K
6782024-02-12T21:09:00.123Za pkg/initial-tls-key.pem 4K
6792024-02-12T21:09:00.124Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6802024-02-12T21:09:00.124Z+ rmdir pkg
6812024-02-12T21:09:00.124Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6822024-02-12T21:09:00.124Z+ pfexec mkdir -p /usr/oxide
6832024-02-12T21:09:00.124Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6842024-02-12T21:09:00.918Z+ pfexec chmod +x /usr/oxide/oxide
6852024-02-12T21:09:00.946Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6862024-02-12T21:09:19.192Z+ OMICRON_NO_UNINSTALL=1
6872024-02-12T21:09:19.192Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6882024-02-12T21:09:19.217ZLogging to: /opt/oxide/work/out/LOG
6892024-02-12T21:09:19.752Z
6902024-02-12T21:09:19.777Zreal 0.554575121
6912024-02-12T21:09:19.778Zuser 0.109291197
6922024-02-12T21:09:19.778Zsys 2.325520055
6932024-02-12T21:09:19.778Ztrap 0.000002250
6942024-02-12T21:09:19.778Ztflt 0.000137561
6952024-02-12T21:09:19.778Zdflt 0.000247916
6962024-02-12T21:09:19.778Zkflt 0.000000000
6972024-02-12T21:09:19.778Zlock 50.431681785
6982024-02-12T21:09:19.778Zslp 0.755594453
6992024-02-12T21:09:19.778Zlat 0.002911919
7002024-02-12T21:09:19.778Zstop 0.207401907
7012024-02-12T21:09:19.778Z+ retry=0
7022024-02-12T21:09:19.778Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7032024-02-12T21:09:19.778Z+ [[ 0 -gt 30 ]]
7042024-02-12T21:09:19.778Z+ sleep 1
7052024-02-12T21:09:20.772Z+ retry=1
7062024-02-12T21:09:20.772Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7072024-02-12T21:09:20.798Z+ [[ 1 -gt 30 ]]
7082024-02-12T21:09:20.798Z+ sleep 1
7092024-02-12T21:09:21.787Z+ retry=2
7102024-02-12T21:09:21.787Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7112024-02-12T21:09:21.812Z+ [[ 2 -gt 30 ]]
7122024-02-12T21:09:21.812Z+ sleep 1
7132024-02-12T21:09:22.795Z+ retry=3
7142024-02-12T21:09:22.795Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7152024-02-12T21:09:22.820Z+ [[ 3 -gt 30 ]]
7162024-02-12T21:09:22.820Z+ sleep 1
7172024-02-12T21:09:23.810Z+ retry=4
7182024-02-12T21:09:23.810Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7192024-02-12T21:09:48.985Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7202024-02-12T21:09:49.011Zlocal v6:
7212024-02-12T21:09:49.011Zfddc:ecd:3f96:961a::1
7222024-02-12T21:09:49.012Zfe80::8ced:34ff:fe0e:f520
7232024-02-12T21:09:49.012Zlocal v4:
7242024-02-12T21:09:49.012Z10.151.2.174
7252024-02-12T21:09:49.012Zrouter v6:
7262024-02-12T21:09:49.012Zfdb0:18c0:4d0d:a02a::/64 -> fe80::e4d9:aaff:fe2f:4ffb (1)
7272024-02-12T21:09:49.012Zfd00:1122:3344:3::/64 -> fe80::e4d9:aaff:fe2f:4ffb (1)
7282024-02-12T21:09:49.012Zfd00:1122:3344:101::/64 -> fe80::e4d9:aaff:fe2f:4ffb (1)
7292024-02-12T21:09:49.012Zrouter v4_idx:
7302024-02-12T21:09:49.012Z0.0.0.0/0 -> 0
7312024-02-12T21:09:49.012Zrouter v4_routes:
7322024-02-12T21:09:49.012Z0 -> 10.151.2.100 (2)
7332024-02-12T21:09:49.012Zresolver v4:
7342024-02-12T21:09:49.012Z10.151.2.174 -> 02:ba:f3:5f:a4:f9
7352024-02-12T21:09:49.012Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7362024-02-12T21:09:49.012Zresolver v6:
7372024-02-12T21:09:49.012Zfe80::e4d9:aaff:fe2f:4ffb -> e6:d9:aa:2f:4f:fb
7382024-02-12T21:09:49.012Zfe80::8ced:34ff:fe0e:f520 -> 8e:ed:34:0e:f5:20
7392024-02-12T21:09:49.012Znat v4:
7402024-02-12T21:09:49.012Znat_v6:
7412024-02-12T21:09:49.012Zport_mac:
7422024-02-12T21:09:49.037Z1000: a8:40:25:1c:dc:46
7432024-02-12T21:09:49.037Z1: a8:40:25:1c:dc:47
7442024-02-12T21:09:49.037Zproxy arp:
7452024-02-12T21:09:49.037Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7462024-02-12T21:09:49.037Z+ retry=0
7472024-02-12T21:09:49.037Z+++ zoneadm list -n
7482024-02-12T21:09:49.037Z+++ grep oxz_ntp
7492024-02-12T21:09:49.037Z++ pfexec svcs -z -Hostate oxide/ntp
7502024-02-12T21:09:49.037Zsvcs: zone '-Hostate': entity not found
7512024-02-12T21:09:49.037Z++ true
7522024-02-12T21:09:49.037Z+ [[ '' != online ]]
7532024-02-12T21:09:49.037Z+ [[ 0 -gt 60 ]]
7542024-02-12T21:09:49.037Z+ sleep 1
7552024-02-12T21:09:50.035Z+ retry=1
7562024-02-12T21:09:50.060Z+++ zoneadm list -n
7572024-02-12T21:09:50.060Z+++ grep oxz_ntp
7582024-02-12T21:09:50.060Z++ pfexec svcs -z -Hostate oxide/ntp
7592024-02-12T21:09:50.060Zsvcs: zone '-Hostate': entity not found
7602024-02-12T21:09:50.060Z++ true
7612024-02-12T21:09:50.060Z+ [[ '' != online ]]
7622024-02-12T21:09:50.060Z+ [[ 1 -gt 60 ]]
7632024-02-12T21:09:50.060Z+ sleep 1
7642024-02-12T21:09:51.058Z+ retry=2
7652024-02-12T21:09:51.082Z+++ zoneadm list -n
7662024-02-12T21:09:51.082Z+++ grep oxz_ntp
7672024-02-12T21:09:51.082Z++ pfexec svcs -z -Hostate oxide/ntp
7682024-02-12T21:09:51.082Zsvcs: zone '-Hostate': entity not found
7692024-02-12T21:09:51.082Z++ true
7702024-02-12T21:09:51.082Z+ [[ '' != online ]]
7712024-02-12T21:09:51.082Z+ [[ 2 -gt 60 ]]
7722024-02-12T21:09:51.082Z+ sleep 1
7732024-02-12T21:09:52.081Z+ retry=3
7742024-02-12T21:09:52.106Z+++ zoneadm list -n
7752024-02-12T21:09:52.106Z+++ grep oxz_ntp
7762024-02-12T21:09:52.106Z++ pfexec svcs -z -Hostate oxide/ntp
7772024-02-12T21:09:52.106Zsvcs: zone '-Hostate': entity not found
7782024-02-12T21:09:52.106Z++ true
7792024-02-12T21:09:52.106Z+ [[ '' != online ]]
7802024-02-12T21:09:52.106Z+ [[ 3 -gt 60 ]]
7812024-02-12T21:09:52.106Z+ sleep 1
7822024-02-12T21:09:53.104Z+ retry=4
7832024-02-12T21:09:53.128Z+++ zoneadm list -n
7842024-02-12T21:09:53.128Z+++ grep oxz_ntp
7852024-02-12T21:09:53.128Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
7862024-02-12T21:09:53.152Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7872024-02-12T21:09:53.152Z++ true
7882024-02-12T21:09:53.153Z+ [[ '' != online ]]
7892024-02-12T21:09:53.153Z+ [[ 4 -gt 60 ]]
7902024-02-12T21:09:53.153Z+ sleep 1
7912024-02-12T21:09:54.137Z+ retry=5
7922024-02-12T21:09:54.161Z+++ zoneadm list -n
7932024-02-12T21:09:54.161Z+++ grep oxz_ntp
7942024-02-12T21:09:54.161Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
7952024-02-12T21:09:54.185Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7962024-02-12T21:09:54.185Z++ true
7972024-02-12T21:09:54.185Z+ [[ '' != online ]]
7982024-02-12T21:09:54.185Z+ [[ 5 -gt 60 ]]
7992024-02-12T21:09:54.185Z+ sleep 1
8002024-02-12T21:09:55.165Z+ retry=6
8012024-02-12T21:09:55.190Z+++ zoneadm list -n
8022024-02-12T21:09:55.190Z+++ grep oxz_ntp
8032024-02-12T21:09:55.190Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8042024-02-12T21:09:55.214Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8052024-02-12T21:09:55.214Z++ true
8062024-02-12T21:09:55.214Z+ [[ '' != online ]]
8072024-02-12T21:09:55.214Z+ [[ 6 -gt 60 ]]
8082024-02-12T21:09:55.214Z+ sleep 1
8092024-02-12T21:09:56.197Z+ retry=7
8102024-02-12T21:09:56.222Z+++ zoneadm list -n
8112024-02-12T21:09:56.222Z+++ grep oxz_ntp
8122024-02-12T21:09:56.222Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8132024-02-12T21:09:56.247Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8142024-02-12T21:09:56.247Z++ true
8152024-02-12T21:09:56.247Z+ [[ '' != online ]]
8162024-02-12T21:09:56.247Z+ [[ 7 -gt 60 ]]
8172024-02-12T21:09:56.247Z+ sleep 1
8182024-02-12T21:09:57.228Z+ retry=8
8192024-02-12T21:09:57.252Z+++ zoneadm list -n
8202024-02-12T21:09:57.253Z+++ grep oxz_ntp
8212024-02-12T21:09:57.253Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8222024-02-12T21:09:57.253Z+ [[ - != online ]]
8232024-02-12T21:09:57.253Z+ [[ 8 -gt 60 ]]
8242024-02-12T21:09:57.253Z+ sleep 1
8252024-02-12T21:09:58.255Z+ retry=9
8262024-02-12T21:09:58.281Z+++ zoneadm list -n
8272024-02-12T21:09:58.281Z+++ grep oxz_ntp
8282024-02-12T21:09:58.281Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8292024-02-12T21:09:58.281Z+ [[ disabled != online ]]
8302024-02-12T21:09:58.281Z+ [[ 9 -gt 60 ]]
8312024-02-12T21:09:58.281Z+ sleep 1
8322024-02-12T21:09:59.276Z+ retry=10
8332024-02-12T21:09:59.301Z+++ zoneadm list -n
8342024-02-12T21:09:59.301Z+++ grep oxz_ntp
8352024-02-12T21:09:59.301Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8362024-02-12T21:09:59.301Z+ [[ disabled != online ]]
8372024-02-12T21:09:59.301Z+ [[ 10 -gt 60 ]]
8382024-02-12T21:09:59.302Z+ sleep 1
8392024-02-12T21:10:00.299Z+ retry=11
8402024-02-12T21:10:00.323Z+++ zoneadm list -n
8412024-02-12T21:10:00.323Z+++ grep oxz_ntp
8422024-02-12T21:10:00.323Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8432024-02-12T21:10:00.324Z+ [[ disabled != online ]]
8442024-02-12T21:10:00.324Z+ [[ 11 -gt 60 ]]
8452024-02-12T21:10:00.324Z+ sleep 1
8462024-02-12T21:10:01.321Z+ retry=12
8472024-02-12T21:10:01.346Z+++ zoneadm list -n
8482024-02-12T21:10:01.346Z+++ grep oxz_ntp
8492024-02-12T21:10:01.346Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8502024-02-12T21:10:01.346Z+ [[ disabled != online ]]
8512024-02-12T21:10:01.346Z+ [[ 12 -gt 60 ]]
8522024-02-12T21:10:01.347Z+ sleep 1
8532024-02-12T21:10:02.344Z+ retry=13
8542024-02-12T21:10:02.369Z+++ zoneadm list -n
8552024-02-12T21:10:02.369Z+++ grep oxz_ntp
8562024-02-12T21:10:02.369Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8572024-02-12T21:10:02.369Z+ [[ disabled != online ]]
8582024-02-12T21:10:02.369Z+ [[ 13 -gt 60 ]]
8592024-02-12T21:10:02.369Z+ sleep 1
8602024-02-12T21:10:03.366Z+ retry=14
8612024-02-12T21:10:03.393Z+++ zoneadm list -n
8622024-02-12T21:10:03.393Z+++ grep oxz_ntp
8632024-02-12T21:10:03.393Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8642024-02-12T21:10:03.393Z+ [[ disabled != online ]]
8652024-02-12T21:10:03.393Z+ [[ 14 -gt 60 ]]
8662024-02-12T21:10:03.393Z+ sleep 1
8672024-02-12T21:10:04.388Z+ retry=15
8682024-02-12T21:10:04.413Z+++ zoneadm list -n
8692024-02-12T21:10:04.413Z+++ grep oxz_ntp
8702024-02-12T21:10:04.413Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8712024-02-12T21:10:04.413Z+ [[ disabled != online ]]
8722024-02-12T21:10:04.413Z+ [[ 15 -gt 60 ]]
8732024-02-12T21:10:04.413Z+ sleep 1
8742024-02-12T21:10:05.411Z+ retry=16
8752024-02-12T21:10:05.437Z+++ zoneadm list -n
8762024-02-12T21:10:05.437Z+++ grep oxz_ntp
8772024-02-12T21:10:05.437Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8782024-02-12T21:10:05.437Z+ [[ disabled != online ]]
8792024-02-12T21:10:05.437Z+ [[ 16 -gt 60 ]]
8802024-02-12T21:10:05.437Z+ sleep 1
8812024-02-12T21:10:06.433Z+ retry=17
8822024-02-12T21:10:06.458Z+++ zoneadm list -n
8832024-02-12T21:10:06.458Z+++ grep oxz_ntp
8842024-02-12T21:10:06.458Z++ pfexec svcs -z oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d -Hostate oxide/ntp
8852024-02-12T21:10:06.458Z+ [[ online != online ]]
8862024-02-12T21:10:06.458Z+ echo 'Waited for chrony: 17s'
8872024-02-12T21:10:06.458Z+ export RUST_BACKTRACE=1
8882024-02-12T21:10:06.458ZWaited for chrony: 17s
8892024-02-12T21:10:06.458Z+ RUST_BACKTRACE=1
8902024-02-12T21:10:06.458Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8912024-02-12T21:10:06.458Z++ ./tests/bootstrap
8922024-02-12T21:10:06.483ZUsing external DNS server at 10.151.2.164:53
8932024-02-12T21:10:06.508Z2024-02-12 21:10:06.816422922 UTC: attempting to log into API
8942024-02-12T21:10:21.521Z2024-02-12 21:10:21.724953873 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8952024-02-12T21:10:22.522Z2024-02-12 21:10:22.723867077 UTC: attempting to log into API
8962024-02-12T21:10:37.555Z2024-02-12 21:10:37.714956886 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8972024-02-12T21:10:38.556Z2024-02-12 21:10:38.713176884 UTC: attempting to log into API
8982024-02-12T21:10:53.588Z2024-02-12 21:10:53.704375903 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8992024-02-12T21:10:54.588Z2024-02-12 21:10:54.702277489 UTC: attempting to log into API
9002024-02-12T21:11:09.622Z2024-02-12 21:11:09.693471349 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9012024-02-12T21:11:10.622Z2024-02-12 21:11:10.692322892 UTC: attempting to log into API
 
9022024-02-12T21:11:21.613ZError: No response to keepalive - Terminating session
 
9032024-02-12T21:11:25.653Z2024-02-12 21:11:25.684139534 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9042024-02-12T21:11:26.654Z2024-02-12 21:11:26.682579593 UTC: attempting to log into API
 
9052024-02-12T21:11:31.557ZError: No response de-activating SOL payload
9062024-02-12T21:11:32.669Z[SOL Session operational. Use ~? for help]
 
9072024-02-12T21:11:41.687Z2024-02-12 21:11:41.676862025 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9082024-02-12T21:11:42.689Z2024-02-12 21:11:42.676189131 UTC: attempting to log into API
9092024-02-12T21:11:57.720Z2024-02-12 21:11:57.704137545 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9102024-02-12T21:11:58.721Z2024-02-12 21:11:58.705755879 UTC: attempting to log into API
9112024-02-12T21:12:13.756Z2024-02-12 21:12:13.738091082 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9122024-02-12T21:12:14.756Z2024-02-12 21:12:14.739767566 UTC: attempting to log into API
9132024-02-12T21:12:29.788Z2024-02-12 21:12:29.771937298 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9142024-02-12T21:12:30.790Z2024-02-12 21:12:30.772839916 UTC: attempting to log into API
9152024-02-12T21:12:45.821Z2024-02-12 21:12:45.804902526 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9162024-02-12T21:12:46.822Z2024-02-12 21:12:46.805984776 UTC: attempting to log into API
9172024-02-12T21:13:01.855Z2024-02-12 21:13:01.838465029 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9182024-02-12T21:13:02.857Z2024-02-12 21:13:02.840138154 UTC: attempting to log into API
9192024-02-12T21:13:17.891Z2024-02-12 21:13:17.872352335 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9202024-02-12T21:13:18.891Z2024-02-12 21:13:18.874057590 UTC: attempting to log into API
9212024-02-12T21:13:33.930Z2024-02-12 21:13:33.913055311 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9222024-02-12T21:13:34.929Z2024-02-12 21:13:34.916309854 UTC: attempting to log into API
9232024-02-12T21:13:50.025Z2024-02-12 21:13:50.016434660 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9242024-02-12T21:13:51.025Z2024-02-12 21:13:51.017222838 UTC: attempting to log into API
9252024-02-12T21:14:14.947Z2024-02-12 21:14:06.075747206 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9262024-02-12T21:14:14.947Z2024-02-12 21:14:12.954047632 UTC: attempting to log into API
 
9272024-02-12T21:14:21.439ZError: No response to keepalive - Terminating session
 
9282024-02-12T21:14:28.730Z2024-02-12 21:14:28.686509752 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9292024-02-12T21:14:29.715Z2024-02-12 21:14:29.695487565 UTC: attempting to log into API
 
9302024-02-12T21:14:31.631ZError: No response de-activating SOL payload
9312024-02-12T21:14:32.736Z[SOL Session operational. Use ~? for help]
 
9322024-02-12T21:14:44.758Z2024-02-12 21:14:44.747655603 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9332024-02-12T21:14:45.756Z2024-02-12 21:14:45.748735472 UTC: attempting to log into API
 
9342024-02-12T21:14:52.016ZFeb 12 21:14:51 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
9352024-02-12T21:14:58.751ZFeb 12 21:14:57 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
9362024-02-12T21:15:00.789Z2024-02-12 21:15:00.780901451 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9372024-02-12T21:15:01.791Z2024-02-12 21:15:01.781677268 UTC: attempting to log into API
 
9382024-02-12T21:15:04.125ZFeb 12 21:15:03 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
9392024-02-12T21:15:10.849ZFeb 12 21:15:10 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
9402024-02-12T21:15:16.824Z2024-02-12 21:15:16.816204946 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
 
9412024-02-12T21:15:17.562ZFeb 12 21:15:16 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
 
9422024-02-12T21:15:17.824Z2024-02-12 21:15:17.817277486 UTC: attempting to log into API
9432024-02-12T21:15:32.857Z2024-02-12 21:15:32.850004239 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9442024-02-12T21:15:33.859Z2024-02-12 21:15:33.851784434 UTC: attempting to log into API
9452024-02-12T21:15:44.666Z2024-02-12 21:15:44.659001527 UTC: login succeeded
9462024-02-12T21:15:44.700Zwaiting for nexus to come up...
9472024-02-12T21:15:44.773Zcreating IP pool... 10.151.2.175 - 10.151.2.227
9482024-02-12T21:15:44.941Zsetting up quotas...
9492024-02-12T21:15:44.990Zensuring datasets are ready...
9502024-02-12T21:15:47.458Zlet's roll.
9512024-02-12T21:15:47.483Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
9522024-02-12T21:15:47.483ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
9532024-02-12T21:15:47.483ZOXIDE_TOKEN=oxide-token-42e9dda0eaa2531201e186abc12c5949b79a1714'
9542024-02-12T21:15:47.483Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9552024-02-12T21:15:47.483Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
9562024-02-12T21:15:47.483Z++ OXIDE_TOKEN=oxide-token-42e9dda0eaa2531201e186abc12c5949b79a1714
9572024-02-12T21:15:47.483Z+ export OXIDE_HOST OXIDE_TOKEN
9582024-02-12T21:15:47.483Z+ retry=0
9592024-02-12T21:15:47.483Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9602024-02-12T21:15:47.509Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9612024-02-12T21:15:47.509Z+ [[ 0 -gt 60 ]]
9622024-02-12T21:15:47.509Z+ sleep 1
9632024-02-12T21:15:48.500Z+ retry=1
9642024-02-12T21:15:48.500Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9652024-02-12T21:15:48.525Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9662024-02-12T21:15:48.525Z+ [[ 1 -gt 60 ]]
9672024-02-12T21:15:48.525Z+ sleep 1
9682024-02-12T21:15:49.516Z+ retry=2
9692024-02-12T21:15:49.516Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9702024-02-12T21:15:49.540Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9712024-02-12T21:15:49.540Z+ [[ 2 -gt 60 ]]
9722024-02-12T21:15:49.540Z+ sleep 1
9732024-02-12T21:15:50.531Z+ retry=3
9742024-02-12T21:15:50.531Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9752024-02-12T21:15:50.556Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9762024-02-12T21:15:50.556Z+ [[ 3 -gt 60 ]]
9772024-02-12T21:15:50.556Z+ sleep 1
9782024-02-12T21:15:51.547Z+ retry=4
9792024-02-12T21:15:51.547Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9802024-02-12T21:15:51.571Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9812024-02-12T21:15:51.571Z+ [[ 4 -gt 60 ]]
9822024-02-12T21:15:51.571Z+ sleep 1
9832024-02-12T21:15:52.564Z+ retry=5
9842024-02-12T21:15:52.564Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9852024-02-12T21:15:52.588Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9862024-02-12T21:15:52.588Z+ [[ 5 -gt 60 ]]
9872024-02-12T21:15:52.588Z+ sleep 1
9882024-02-12T21:15:53.580Z+ retry=6
9892024-02-12T21:15:53.580Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9902024-02-12T21:15:53.605Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9912024-02-12T21:15:53.605Z+ [[ 6 -gt 60 ]]
9922024-02-12T21:15:53.605Z+ sleep 1
9932024-02-12T21:15:54.596Z+ retry=7
9942024-02-12T21:15:54.596Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9952024-02-12T21:15:54.620Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9962024-02-12T21:15:54.620Z+ [[ 7 -gt 60 ]]
9972024-02-12T21:15:54.620Z+ sleep 1
9982024-02-12T21:15:55.613Z+ retry=8
9992024-02-12T21:15:55.613Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10002024-02-12T21:15:55.638Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10012024-02-12T21:15:55.638Z+ [[ 8 -gt 60 ]]
10022024-02-12T21:15:55.638Z+ sleep 1
10032024-02-12T21:15:56.635Z+ retry=9
10042024-02-12T21:15:56.635Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10052024-02-12T21:15:56.661Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10062024-02-12T21:15:56.661Z+ [[ 9 -gt 60 ]]
10072024-02-12T21:15:56.661Z+ sleep 1
10082024-02-12T21:15:57.752Z+ retry=10
10092024-02-12T21:15:57.752Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10102024-02-12T21:15:57.777Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10112024-02-12T21:15:57.777Z+ [[ 10 -gt 60 ]]
10122024-02-12T21:15:57.777Z+ sleep 1
10132024-02-12T21:15:58.661Z+ retry=11
10142024-02-12T21:15:58.661Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10152024-02-12T21:15:58.689Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10162024-02-12T21:15:58.689Z+ [[ 11 -gt 60 ]]
10172024-02-12T21:15:58.689Z+ sleep 1
10182024-02-12T21:15:59.682Z+ retry=12
10192024-02-12T21:15:59.682Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10202024-02-12T21:15:59.707Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10212024-02-12T21:15:59.707Z+ [[ 12 -gt 60 ]]
10222024-02-12T21:15:59.707Z+ sleep 1
10232024-02-12T21:16:00.695Z+ retry=13
10242024-02-12T21:16:00.695Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10252024-02-12T21:16:00.719Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10262024-02-12T21:16:00.719Z+ [[ 13 -gt 60 ]]
10272024-02-12T21:16:00.719Z+ sleep 1
10282024-02-12T21:16:01.715Z+ retry=14
10292024-02-12T21:16:01.715Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10302024-02-12T21:16:01.778Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10312024-02-12T21:16:01.778Z+ [[ 14 -gt 60 ]]
10322024-02-12T21:16:01.778Z+ sleep 1
10332024-02-12T21:16:02.727Z+ retry=15
10342024-02-12T21:16:02.727Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10352024-02-12T21:16:02.753Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10362024-02-12T21:16:02.753Z+ [[ 15 -gt 60 ]]
10372024-02-12T21:16:02.753Z+ sleep 1
10382024-02-12T21:16:03.745Z+ retry=16
10392024-02-12T21:16:03.745Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10402024-02-12T21:16:03.770Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10412024-02-12T21:16:03.771Z+ [[ 16 -gt 60 ]]
10422024-02-12T21:16:03.771Z+ sleep 1
10432024-02-12T21:16:04.759Z+ retry=17
10442024-02-12T21:16:04.784Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10452024-02-12T21:16:04.784Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10462024-02-12T21:16:04.784Z+ [[ 17 -gt 60 ]]
10472024-02-12T21:16:04.784Z+ sleep 1
10482024-02-12T21:16:05.775Z+ retry=18
10492024-02-12T21:16:05.775Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10502024-02-12T21:16:05.800Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10512024-02-12T21:16:05.800Z+ [[ 18 -gt 60 ]]
10522024-02-12T21:16:05.800Z+ sleep 1
10532024-02-12T21:16:06.791Z+ retry=19
10542024-02-12T21:16:06.816Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10552024-02-12T21:16:06.817Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10562024-02-12T21:16:06.817Z+ [[ 19 -gt 60 ]]
10572024-02-12T21:16:06.817Z+ sleep 1
10582024-02-12T21:16:07.808Z+ retry=20
10592024-02-12T21:16:07.809Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10602024-02-12T21:16:07.834Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10612024-02-12T21:16:07.834Z+ [[ 20 -gt 60 ]]
10622024-02-12T21:16:07.834Z+ sleep 1
10632024-02-12T21:16:08.823Z+ retry=21
10642024-02-12T21:16:08.823Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10652024-02-12T21:16:08.849Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10662024-02-12T21:16:08.849Z+ [[ 21 -gt 60 ]]
10672024-02-12T21:16:08.849Z+ sleep 1
10682024-02-12T21:16:09.840Z+ retry=22
10692024-02-12T21:16:09.840Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10702024-02-12T21:16:09.865Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10712024-02-12T21:16:09.865Z+ [[ 22 -gt 60 ]]
10722024-02-12T21:16:09.865Z+ sleep 1
10732024-02-12T21:16:10.856Z+ retry=23
10742024-02-12T21:16:10.856Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10752024-02-12T21:16:10.882Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10762024-02-12T21:16:10.882Z+ [[ 23 -gt 60 ]]
10772024-02-12T21:16:10.882Z+ sleep 1
10782024-02-12T21:16:11.872Z+ retry=24
10792024-02-12T21:16:11.872Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10802024-02-12T21:16:11.897Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10812024-02-12T21:16:11.897Z+ [[ 24 -gt 60 ]]
10822024-02-12T21:16:11.897Z+ sleep 1
10832024-02-12T21:16:12.887Z+ retry=25
10842024-02-12T21:16:12.887Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10852024-02-12T21:16:12.913Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10862024-02-12T21:16:12.913Z+ [[ 25 -gt 60 ]]
10872024-02-12T21:16:12.913Z+ sleep 1
10882024-02-12T21:16:13.903Z+ retry=26
10892024-02-12T21:16:13.903Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10902024-02-12T21:16:13.928Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10912024-02-12T21:16:13.928Z+ [[ 26 -gt 60 ]]
10922024-02-12T21:16:13.928Z+ sleep 1
10932024-02-12T21:16:14.918Z+ retry=27
10942024-02-12T21:16:14.918Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10952024-02-12T21:16:14.942Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10962024-02-12T21:16:14.942Z+ [[ 27 -gt 60 ]]
10972024-02-12T21:16:14.942Z+ sleep 1
10982024-02-12T21:16:15.934Z+ retry=28
10992024-02-12T21:16:15.934Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11002024-02-12T21:16:15.959Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11012024-02-12T21:16:15.959Z+ [[ 28 -gt 60 ]]
11022024-02-12T21:16:15.959Z+ sleep 1
11032024-02-12T21:16:16.951Z+ retry=29
11042024-02-12T21:16:16.951Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11052024-02-12T21:16:16.975Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11062024-02-12T21:16:16.975Z+ [[ 29 -gt 60 ]]
11072024-02-12T21:16:16.975Z+ sleep 1
11082024-02-12T21:16:17.967Z+ retry=30
11092024-02-12T21:16:17.967Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11102024-02-12T21:16:17.993Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11112024-02-12T21:16:17.993Z+ [[ 30 -gt 60 ]]
11122024-02-12T21:16:17.993Z+ sleep 1
11132024-02-12T21:16:18.984Z+ retry=31
11142024-02-12T21:16:18.984Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11152024-02-12T21:16:19.061Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
11162024-02-12T21:16:19.432Z{"status":"ok"}success
11172024-02-12T21:16:19.432ZProject {
11182024-02-12T21:16:19.432Z description: "some images",
11192024-02-12T21:16:19.432Z id: 6389c8af-8619-4721-a669-0bbde32c0871,
11202024-02-12T21:16:19.432Z name: Name(
11212024-02-12T21:16:19.432Z "images",
11222024-02-12T21:16:19.433Z ),
11232024-02-12T21:16:19.433Z time_created: 2024-02-12T21:16:19.162589Z,
11242024-02-12T21:16:19.433Z time_modified: 2024-02-12T21:16:19.162589Z,
11252024-02-12T21:16:19.433Z}
11262024-02-12T21:16:19.457Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
11272024-02-12T21:17:37.665ZError: No response to keepalive - Terminating session
11282024-02-12T21:17:47.825ZError: No response de-activating SOL payload
11292024-02-12T21:17:48.924Z[SOL Session operational. Use ~? for help]
11302024-02-12T21:20:37.675ZError: No response to keepalive - Terminating session
11312024-02-12T21:20:47.850ZError: No response de-activating SOL payload
11322024-02-12T21:20:48.957Z[SOL Session operational. Use ~? for help]
 
11332024-02-12T21:21:51.143Zdone!
11342024-02-12T21:21:51.248Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
11352024-02-12T21:21:51.365Zsuccess
11362024-02-12T21:21:51.365ZImage {
11372024-02-12T21:21:51.391Z block_size: ByteCount(
11382024-02-12T21:21:51.391Z 512,
11392024-02-12T21:21:51.391Z ),
11402024-02-12T21:21:51.391Z description: "debian 11 original base image",
11412024-02-12T21:21:51.391Z digest: None,
11422024-02-12T21:21:51.391Z id: 3565ef0d-0711-4f72-b51a-23f6e6f8e316,
11432024-02-12T21:21:51.391Z name: Name(
11442024-02-12T21:21:51.391Z "debian11",
11452024-02-12T21:21:51.391Z ),
11462024-02-12T21:21:51.391Z os: "debian",
11472024-02-12T21:21:51.391Z project_id: None,
11482024-02-12T21:21:51.391Z size: ByteCount(
11492024-02-12T21:21:51.391Z 2147483648,
11502024-02-12T21:21:51.391Z ),
11512024-02-12T21:21:51.391Z time_created: 2024-02-12T21:21:51.105499Z,
11522024-02-12T21:21:51.392Z time_modified: 2024-02-12T21:21:51.330771Z,
11532024-02-12T21:21:51.392Z url: None,
11542024-02-12T21:21:51.392Z version: "11",
11552024-02-12T21:21:51.392Z}
11562024-02-12T21:21:51.392Z+ rm ./tests/bootstrap
11572024-02-12T21:21:51.483Z+ for test_bin in tests/*
11582024-02-12T21:21:51.483Z+ ./tests/bootstrap-000e38cfb9ecff29
11592024-02-12T21:21:51.509Z
11602024-02-12T21:21:51.510Zrunning 0 tests
11612024-02-12T21:21:51.510Z
11622024-02-12T21:21:51.510Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
11632024-02-12T21:21:51.510Z
11642024-02-12T21:21:51.510Z+ for test_bin in tests/*
11652024-02-12T21:21:51.510Z+ ./tests/end_to_end_tests-a157f2ab3f0f1a11
11662024-02-12T21:21:51.723Z
11672024-02-12T21:21:51.723Zrunning 2 tests
11682024-02-12T21:21:51.977Ztest no_spoof::no_spoof_here ... ok
11692024-02-12T21:22:30.357Ztest instance_launch::instance_launch ... ok
11702024-02-12T21:22:30.357Z
11712024-02-12T21:22:30.357Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 38.63s
11722024-02-12T21:22:30.357Z
11732024-02-12T21:22:30.391Z+ _exit_trap
11742024-02-12T21:22:30.391Z+ local status=0
11752024-02-12T21:22:30.391Z+ [[ 0 -eq 0 ]]
11762024-02-12T21:22:30.392Z+ exit 0
11772024-02-12T21:22:30.392Zprocess exited: duration 868789 ms, exit code 0
 
11782024-02-12T21:22:30.496Zfound 125 output files
11792024-02-12T21:22:30.528Zuploading: /var/svc/log/oxide-sled-agent:default.log (945044 bytes)
11802024-02-12T21:22:31.871Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11812024-02-12T21:22:31.871Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (1900001 bytes)
11822024-02-12T21:22:34.045Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 1900001 -> 1913364
11832024-02-12T21:22:35.116Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11842024-02-12T21:22:35.116Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (1360749 bytes)
11852024-02-12T21:22:37.979Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11862024-02-12T21:22:37.979Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
11872024-02-12T21:22:39.057Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11882024-02-12T21:22:39.057Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (19038 bytes)
11892024-02-12T21:22:40.243Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11902024-02-12T21:22:40.244Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (17419 bytes)
11912024-02-12T21:22:40.339Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 17419 -> 17767
11922024-02-12T21:22:41.422Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11932024-02-12T21:22:41.422Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (8075 bytes)
11942024-02-12T21:22:42.541Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11952024-02-12T21:22:42.541Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1255461 bytes)
11962024-02-12T21:22:44.368Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1255461 -> 1281809
11972024-02-12T21:22:45.442Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11982024-02-12T21:22:45.442Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (665897 bytes)
11992024-02-12T21:22:47.141Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
12002024-02-12T21:22:47.141Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (730516 bytes)
12012024-02-12T21:22:47.729Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 730516 -> 750604
12022024-02-12T21:22:48.801Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
12032024-02-12T21:22:48.801Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (405191 bytes)
12042024-02-12T21:22:50.308Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
12052024-02-12T21:22:50.308Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
12062024-02-12T21:22:51.380Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
12072024-02-12T21:22:51.380Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
12082024-02-12T21:22:52.485Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
12092024-02-12T21:22:52.485Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (217503 bytes)
12102024-02-12T21:22:52.805Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 217503 -> 229110
12112024-02-12T21:22:53.878Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
12122024-02-12T21:22:53.878Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (156329 bytes)
12132024-02-12T21:22:55.176Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
12142024-02-12T21:22:55.176Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
12152024-02-12T21:22:56.265Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
12162024-02-12T21:22:56.293Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
12172024-02-12T21:22:57.376Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
12182024-02-12T21:22:57.376Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
12192024-02-12T21:22:58.463Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
12202024-02-12T21:22:58.463Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5392 bytes)
12212024-02-12T21:23:00.053Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
12222024-02-12T21:23:00.054Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-clickhouse:default.log (682659 bytes)
12232024-02-12T21:23:01.074Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 682659 -> 738831
12242024-02-12T21:23:02.152Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-clickhouse:default.log
12252024-02-12T21:23:02.152Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-clickhouse:default.log.0 (128715 bytes)
12262024-02-12T21:23:03.646Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-clickhouse:default.log.0
12272024-02-12T21:23:08.443Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12282024-02-12T21:23:10.053Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-zone-network-setup:default.log
12292024-02-12T21:23:10.053Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
12302024-02-12T21:23:11.186Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_e733a7ce-081d-4937-a1e2-b060c0d9ab6d/root/var/svc/log/oxide-zone-network-setup:default.log.0
12312024-02-12T21:23:11.187Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4d4cf8ab-b5b8-4c10-9dd4-ce8a79ba98ae/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12322024-02-12T21:23:12.768Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4d4cf8ab-b5b8-4c10-9dd4-ce8a79ba98ae/root/var/svc/log/oxide-cockroachdb:default.log
12332024-02-12T21:23:12.768Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4d4cf8ab-b5b8-4c10-9dd4-ce8a79ba98ae/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
12342024-02-12T21:23:13.893Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4d4cf8ab-b5b8-4c10-9dd4-ce8a79ba98ae/root/var/svc/log/oxide-cockroachdb:default.log.0
12352024-02-12T21:23:13.893Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4d4cf8ab-b5b8-4c10-9dd4-ce8a79ba98ae/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12362024-02-12T21:23:15.402Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4d4cf8ab-b5b8-4c10-9dd4-ce8a79ba98ae/root/var/svc/log/oxide-zone-network-setup:default.log
12372024-02-12T21:23:15.402Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4d4cf8ab-b5b8-4c10-9dd4-ce8a79ba98ae/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
12382024-02-12T21:23:16.511Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4d4cf8ab-b5b8-4c10-9dd4-ce8a79ba98ae/root/var/svc/log/oxide-zone-network-setup:default.log.0
12392024-02-12T21:23:16.512Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_28f78cf7-810f-48fd-8811-7b283f1be923/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12402024-02-12T21:23:17.600Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_28f78cf7-810f-48fd-8811-7b283f1be923/root/var/svc/log/oxide-crucible-agent:default.log
12412024-02-12T21:23:17.600Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_28f78cf7-810f-48fd-8811-7b283f1be923/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12422024-02-12T21:23:19.165Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_28f78cf7-810f-48fd-8811-7b283f1be923/root/var/svc/log/oxide-crucible-agent:default.log.0
12432024-02-12T21:23:19.165Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_28f78cf7-810f-48fd-8811-7b283f1be923/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12442024-02-12T21:23:20.238Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_28f78cf7-810f-48fd-8811-7b283f1be923/root/var/svc/log/oxide-crucible-downstairs:default.log
12452024-02-12T21:23:20.238Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_28f78cf7-810f-48fd-8811-7b283f1be923/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12462024-02-12T21:23:21.343Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_28f78cf7-810f-48fd-8811-7b283f1be923/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12472024-02-12T21:23:21.343Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6101c0e3-9522-41ec-9d43-ff896023da96/root/var/svc/log/oxide-external_dns:default.log (28166 bytes)
12482024-02-12T21:23:21.943Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6101c0e3-9522-41ec-9d43-ff896023da96/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 28166 -> 31944
12492024-02-12T21:23:23.027Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6101c0e3-9522-41ec-9d43-ff896023da96/root/var/svc/log/oxide-external_dns:default.log
12502024-02-12T21:23:23.028Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6101c0e3-9522-41ec-9d43-ff896023da96/root/var/svc/log/oxide-external_dns:default.log.0 (2554 bytes)
12512024-02-12T21:23:24.140Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_6101c0e3-9522-41ec-9d43-ff896023da96/root/var/svc/log/oxide-external_dns:default.log.0
12522024-02-12T21:23:24.140Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d1a35229-70f9-4ec2-b784-0ca73763703d/root/var/svc/log/oxide-internal_dns:default.log (27535 bytes)
12532024-02-12T21:23:24.300Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d1a35229-70f9-4ec2-b784-0ca73763703d/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27535 -> 31288
12542024-02-12T21:23:25.378Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d1a35229-70f9-4ec2-b784-0ca73763703d/root/var/svc/log/oxide-internal_dns:default.log
12552024-02-12T21:23:25.407Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d1a35229-70f9-4ec2-b784-0ca73763703d/root/var/svc/log/oxide-internal_dns:default.log.0 (91132 bytes)
12562024-02-12T21:23:26.726Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d1a35229-70f9-4ec2-b784-0ca73763703d/root/var/svc/log/oxide-internal_dns:default.log.0
12572024-02-12T21:23:26.726Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9cecb1a7-b906-4df2-93f0-6557ad862965/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12582024-02-12T21:23:27.812Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9cecb1a7-b906-4df2-93f0-6557ad862965/root/var/svc/log/oxide-cockroachdb:default.log
12592024-02-12T21:23:27.812Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9cecb1a7-b906-4df2-93f0-6557ad862965/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
12602024-02-12T21:23:28.916Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9cecb1a7-b906-4df2-93f0-6557ad862965/root/var/svc/log/oxide-cockroachdb:default.log.0
12612024-02-12T21:23:28.916Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9cecb1a7-b906-4df2-93f0-6557ad862965/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12622024-02-12T21:23:35.641Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9cecb1a7-b906-4df2-93f0-6557ad862965/root/var/svc/log/oxide-zone-network-setup:default.log
12632024-02-12T21:23:35.642Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9cecb1a7-b906-4df2-93f0-6557ad862965/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
12642024-02-12T21:23:35.796Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9cecb1a7-b906-4df2-93f0-6557ad862965/root/var/svc/log/oxide-zone-network-setup:default.log.0
12652024-02-12T21:23:35.796Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-agent:default.log (10678 bytes)
12662024-02-12T21:23:36.951Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-agent:default.log
12672024-02-12T21:23:36.952Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-agent:default.log.0 (3435 bytes)
12682024-02-12T21:23:37.772ZError: No response to keepalive - Terminating session
12692024-02-12T21:23:38.473Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-agent:default.log.0
12702024-02-12T21:23:38.473Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12712024-02-12T21:23:39.556Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-downstairs:default.log
12722024-02-12T21:23:39.587Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12732024-02-12T21:23:41.070Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12742024-02-12T21:23:41.070Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-downstairs:downstairs-43d401ab-59d0-4747-8795-0dd6d3101732.log (5534 bytes)
12752024-02-12T21:23:42.200Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_16665e90-f952-4307-8ac2-dedac5a7283d/root/var/svc/log/oxide-crucible-downstairs:downstairs-43d401ab-59d0-4747-8795-0dd6d3101732.log
12762024-02-12T21:23:42.200Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_48efc303-3118-498a-b58e-b03efff77e5f/root/var/svc/log/oxide-external_dns:default.log (30505 bytes)
12772024-02-12T21:23:42.362Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_48efc303-3118-498a-b58e-b03efff77e5f/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 30505 -> 34267
12782024-02-12T21:23:43.454Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_48efc303-3118-498a-b58e-b03efff77e5f/root/var/svc/log/oxide-external_dns:default.log
12792024-02-12T21:23:43.454Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_48efc303-3118-498a-b58e-b03efff77e5f/root/var/svc/log/oxide-external_dns:default.log.0 (120 bytes)
12802024-02-12T21:23:44.562Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_48efc303-3118-498a-b58e-b03efff77e5f/root/var/svc/log/oxide-external_dns:default.log.0
12812024-02-12T21:23:44.562Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a05e15cd-5d17-4f3c-aa97-d96e56f31649/root/var/svc/log/oxide-internal_dns:default.log (27529 bytes)
12822024-02-12T21:23:44.726Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a05e15cd-5d17-4f3c-aa97-d96e56f31649/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27529 -> 31282
12832024-02-12T21:23:45.798Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a05e15cd-5d17-4f3c-aa97-d96e56f31649/root/var/svc/log/oxide-internal_dns:default.log
12842024-02-12T21:23:45.827Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a05e15cd-5d17-4f3c-aa97-d96e56f31649/root/var/svc/log/oxide-internal_dns:default.log.0 (96815 bytes)
12852024-02-12T21:23:47.192Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_a05e15cd-5d17-4f3c-aa97-d96e56f31649/root/var/svc/log/oxide-internal_dns:default.log.0
12862024-02-12T21:23:47.192Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1d541044-9827-46f2-aaf4-2c4e2dfc887f/root/var/svc/log/oxide-nexus:default.log (5617284 bytes)
12872024-02-12T21:23:47.958ZError: No response de-activating SOL payload
12882024-02-12T21:23:49.172Z[SOL Session operational. Use ~? for help]
12892024-02-12T21:23:52.534Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1d541044-9827-46f2-aaf4-2c4e2dfc887f/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 5617284 -> 5756373
12902024-02-12T21:23:54.029Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1d541044-9827-46f2-aaf4-2c4e2dfc887f/root/var/svc/log/oxide-nexus:default.log
12912024-02-12T21:23:54.030Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1d541044-9827-46f2-aaf4-2c4e2dfc887f/root/var/svc/log/oxide-nexus:default.log.0 (120 bytes)
12922024-02-12T21:23:55.132Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1d541044-9827-46f2-aaf4-2c4e2dfc887f/root/var/svc/log/oxide-nexus:default.log.0
12932024-02-12T21:23:55.132Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_de35095f-6f41-417a-be82-199ea98d52df/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12942024-02-12T21:23:56.206Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_de35095f-6f41-417a-be82-199ea98d52df/root/var/svc/log/oxide-cockroachdb:default.log
12952024-02-12T21:23:56.206Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_de35095f-6f41-417a-be82-199ea98d52df/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
12962024-02-12T21:23:57.308Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_de35095f-6f41-417a-be82-199ea98d52df/root/var/svc/log/oxide-cockroachdb:default.log.0
12972024-02-12T21:23:57.308Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_de35095f-6f41-417a-be82-199ea98d52df/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12982024-02-12T21:23:58.456Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_de35095f-6f41-417a-be82-199ea98d52df/root/var/svc/log/oxide-zone-network-setup:default.log
12992024-02-12T21:23:58.456Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_de35095f-6f41-417a-be82-199ea98d52df/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
13002024-02-12T21:23:59.532Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_de35095f-6f41-417a-be82-199ea98d52df/root/var/svc/log/oxide-zone-network-setup:default.log.0
13012024-02-12T21:23:59.532Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-agent:default.log (26849 bytes)
13022024-02-12T21:24:00.694Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-agent:default.log
13032024-02-12T21:24:00.694Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13042024-02-12T21:24:01.795Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-agent:default.log.0
13052024-02-12T21:24:01.795Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13062024-02-12T21:24:02.874Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:default.log
13072024-02-12T21:24:02.908Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13082024-02-12T21:24:04.001Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13092024-02-12T21:24:04.001Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:downstairs-19e0d072-74ae-4d3b-a9a4-a45e4539870a.log (5537 bytes)
13102024-02-12T21:24:06.444Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:downstairs-19e0d072-74ae-4d3b-a9a4-a45e4539870a.log
13112024-02-12T21:24:06.444Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:downstairs-9446b8a1-f2df-4f4d-b580-6c6c147a752a.log (2943 bytes)
13122024-02-12T21:24:07.553Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:downstairs-9446b8a1-f2df-4f4d-b580-6c6c147a752a.log
13132024-02-12T21:24:07.553Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:downstairs-e9c3c514-bd63-4d03-b280-6f4306ceb53c.log (3037 bytes)
13142024-02-12T21:24:08.664Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_d28bdc81-5ffc-400a-819e-dcb9846f3e99/root/var/svc/log/oxide-crucible-downstairs:downstairs-e9c3c514-bd63-4d03-b280-6f4306ceb53c.log
13152024-02-12T21:24:08.664Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_8bd14a93-87cf-4cdd-b233-e7e61efc0367/root/var/svc/log/oxide-internal_dns:default.log (27536 bytes)
13162024-02-12T21:24:08.809Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_8bd14a93-87cf-4cdd-b233-e7e61efc0367/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27536 -> 32541
13172024-02-12T21:24:09.886Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_8bd14a93-87cf-4cdd-b233-e7e61efc0367/root/var/svc/log/oxide-internal_dns:default.log
13182024-02-12T21:24:09.886Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_8bd14a93-87cf-4cdd-b233-e7e61efc0367/root/var/svc/log/oxide-internal_dns:default.log.0 (99247 bytes)
13192024-02-12T21:24:11.100Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_8bd14a93-87cf-4cdd-b233-e7e61efc0367/root/var/svc/log/oxide-internal_dns:default.log.0
13202024-02-12T21:24:11.100Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_33c83d5e-b11b-4f73-9a24-ff8bc1a44fc9/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13212024-02-12T21:24:12.173Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_33c83d5e-b11b-4f73-9a24-ff8bc1a44fc9/root/var/svc/log/oxide-cockroachdb:default.log
13222024-02-12T21:24:12.173Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_33c83d5e-b11b-4f73-9a24-ff8bc1a44fc9/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
13232024-02-12T21:24:13.270Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_33c83d5e-b11b-4f73-9a24-ff8bc1a44fc9/root/var/svc/log/oxide-cockroachdb:default.log.0
13242024-02-12T21:24:13.270Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_33c83d5e-b11b-4f73-9a24-ff8bc1a44fc9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13252024-02-12T21:24:14.343Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_33c83d5e-b11b-4f73-9a24-ff8bc1a44fc9/root/var/svc/log/oxide-zone-network-setup:default.log
13262024-02-12T21:24:14.343Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_33c83d5e-b11b-4f73-9a24-ff8bc1a44fc9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
13272024-02-12T21:24:15.446Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_33c83d5e-b11b-4f73-9a24-ff8bc1a44fc9/root/var/svc/log/oxide-zone-network-setup:default.log.0
13282024-02-12T21:24:15.446Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-agent:default.log (10677 bytes)
13292024-02-12T21:24:16.570Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-agent:default.log
13302024-02-12T21:24:16.571Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13312024-02-12T21:24:17.665Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-agent:default.log.0
13322024-02-12T21:24:17.665Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13332024-02-12T21:24:18.738Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-downstairs:default.log
13342024-02-12T21:24:18.738Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13352024-02-12T21:24:19.834Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13362024-02-12T21:24:19.835Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-downstairs:downstairs-0a49d1f3-8d9b-4232-a424-16179bafdf38.log (5536 bytes)
13372024-02-12T21:24:20.973Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_2e854ab3-8a3b-43a3-982f-cd967a502994/root/var/svc/log/oxide-crucible-downstairs:downstairs-0a49d1f3-8d9b-4232-a424-16179bafdf38.log
13382024-02-12T21:24:20.974Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_cc1838f6-4e7a-4cf2-b635-6897ec0f9c04/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
13392024-02-12T21:24:22.046Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_cc1838f6-4e7a-4cf2-b635-6897ec0f9c04/root/var/svc/log/oxide-cockroachdb:default.log
13402024-02-12T21:24:22.046Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_cc1838f6-4e7a-4cf2-b635-6897ec0f9c04/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
13412024-02-12T21:24:24.847Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_cc1838f6-4e7a-4cf2-b635-6897ec0f9c04/root/var/svc/log/oxide-cockroachdb:default.log.0
13422024-02-12T21:24:24.847Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_cc1838f6-4e7a-4cf2-b635-6897ec0f9c04/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13432024-02-12T21:24:26.003Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_cc1838f6-4e7a-4cf2-b635-6897ec0f9c04/root/var/svc/log/oxide-zone-network-setup:default.log
13442024-02-12T21:24:26.003Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_cc1838f6-4e7a-4cf2-b635-6897ec0f9c04/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
13452024-02-12T21:24:27.123Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_cc1838f6-4e7a-4cf2-b635-6897ec0f9c04/root/var/svc/log/oxide-zone-network-setup:default.log.0
13462024-02-12T21:24:27.124Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-agent:default.log (10245 bytes)
13472024-02-12T21:24:33.957Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-agent:default.log
13482024-02-12T21:24:33.957Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13492024-02-12T21:24:35.056Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-agent:default.log.0
13502024-02-12T21:24:35.056Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13512024-02-12T21:24:36.139Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-downstairs:default.log
13522024-02-12T21:24:36.139Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13532024-02-12T21:24:37.271Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13542024-02-12T21:24:37.272Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f736709-71fd-4a8b-9c44-119b1c775175.log (3035 bytes)
13552024-02-12T21:24:38.372Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_24f83735-d50d-4646-9427-9a930aa442cd/root/var/svc/log/oxide-crucible-downstairs:downstairs-3f736709-71fd-4a8b-9c44-119b1c775175.log
13562024-02-12T21:24:38.372Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-agent:default.log (16717 bytes)
13572024-02-12T21:24:39.516Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-agent:default.log
13582024-02-12T21:24:39.516Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13592024-02-12T21:24:40.614Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-agent:default.log.0
13602024-02-12T21:24:40.614Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13612024-02-12T21:24:41.698Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-downstairs:default.log
13622024-02-12T21:24:41.724Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13632024-02-12T21:24:42.799Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13642024-02-12T21:24:42.799Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-downstairs:downstairs-12022fb5-468a-40e1-ab80-683b18a088a6.log (5598 bytes)
13652024-02-12T21:24:43.906Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-downstairs:downstairs-12022fb5-468a-40e1-ab80-683b18a088a6.log
13662024-02-12T21:24:43.944Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-downstairs:snapshot-12022fb5-468a-40e1-ab80-683b18a088a6-d5595bbd-d9b8-4f25-96e0-b133935ed4b1.log (5180 bytes)
13672024-02-12T21:24:45.020Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_f7232f56-0603-4a5b-827e-81c1fe92e588/root/var/svc/log/oxide-crucible-downstairs:snapshot-12022fb5-468a-40e1-ab80-683b18a088a6-d5595bbd-d9b8-4f25-96e0-b133935ed4b1.log
13682024-02-12T21:24:45.020Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_34df1680-6de8-4726-9bc8-9af7aa8fdd70/root/var/svc/log/oxide-crucible-pantry:default.log (1223473 bytes)
13692024-02-12T21:24:46.400Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_34df1680-6de8-4726-9bc8-9af7aa8fdd70/root/var/svc/log/oxide-crucible-pantry:default.log
13702024-02-12T21:24:46.400Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_34df1680-6de8-4726-9bc8-9af7aa8fdd70/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
13712024-02-12T21:24:47.501Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_34df1680-6de8-4726-9bc8-9af7aa8fdd70/root/var/svc/log/oxide-crucible-pantry:default.log.0
13722024-02-12T21:24:47.501Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/svc/log/oxide-ntp:default.log (66 bytes)
13732024-02-12T21:24:48.601Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/svc/log/oxide-ntp:default.log
13742024-02-12T21:24:48.601Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/svc/log/oxide-ntp:default.log.0 (1251 bytes)
13752024-02-12T21:24:49.703Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/svc/log/oxide-ntp:default.log.0
13762024-02-12T21:24:49.703Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-oximeter:default.log (243882 bytes)
13772024-02-12T21:24:49.942Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 243882 -> 322102
13782024-02-12T21:24:51.020Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-oximeter:default.log
13792024-02-12T21:24:51.020Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-oximeter:default.log.0 (11949 bytes)
13802024-02-12T21:24:52.145Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-oximeter:default.log.0
13812024-02-12T21:24:52.146Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13822024-02-12T21:24:53.638Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-zone-network-setup:default.log
13832024-02-12T21:24:53.638Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes)
13842024-02-12T21:24:59.856Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_0b0f000e-5f70-455c-b681-1e398c01c82c/root/var/svc/log/oxide-zone-network-setup:default.log.0
13852024-02-12T21:24:59.857Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-agent:default.log (24815 bytes)
13862024-02-12T21:25:00.714Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-agent:default.log
13872024-02-12T21:25:00.714Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13882024-02-12T21:25:01.821Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-agent:default.log.0
13892024-02-12T21:25:01.821Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13902024-02-12T21:25:02.895Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:default.log
13912024-02-12T21:25:02.895Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13922024-02-12T21:25:04.029Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13932024-02-12T21:25:04.061Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:downstairs-2cc91bce-8d47-4bda-b2fe-b6fd1fed54f9.log (5596 bytes)
13942024-02-12T21:25:05.134Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:downstairs-2cc91bce-8d47-4bda-b2fe-b6fd1fed54f9.log
13952024-02-12T21:25:05.134Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:downstairs-ca3ceb9a-0fac-4024-86be-68eec8e8446a.log (2943 bytes)
13962024-02-12T21:25:06.238Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:downstairs-ca3ceb9a-0fac-4024-86be-68eec8e8446a.log
13972024-02-12T21:25:06.239Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:snapshot-2cc91bce-8d47-4bda-b2fe-b6fd1fed54f9-d5595bbd-d9b8-4f25-96e0-b133935ed4b1.log (5177 bytes)
13982024-02-12T21:25:07.352Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_82bbaed1-a891-4d6a-851c-c93de0c209ba/root/var/svc/log/oxide-crucible-downstairs:snapshot-2cc91bce-8d47-4bda-b2fe-b6fd1fed54f9-d5595bbd-d9b8-4f25-96e0-b133935ed4b1.log
13992024-02-12T21:25:07.352Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_a78a1e26-e517-416d-be04-7edd0fb9b813/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
14002024-02-12T21:25:08.427Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_a78a1e26-e517-416d-be04-7edd0fb9b813/root/var/svc/log/oxide-crucible-pantry:default.log
14012024-02-12T21:25:08.427Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_a78a1e26-e517-416d-be04-7edd0fb9b813/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2336 bytes)
14022024-02-12T21:25:09.535Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_a78a1e26-e517-416d-be04-7edd0fb9b813/root/var/svc/log/oxide-crucible-pantry:default.log.0
14032024-02-12T21:25:09.536Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-agent:default.log (16719 bytes)
14042024-02-12T21:25:10.731Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-agent:default.log
14052024-02-12T21:25:10.757Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
14062024-02-12T21:25:11.841Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-agent:default.log.0
14072024-02-12T21:25:11.841Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14082024-02-12T21:25:14.018Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-downstairs:default.log
14092024-02-12T21:25:14.018Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14102024-02-12T21:25:15.141Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14112024-02-12T21:25:15.141Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-downstairs:downstairs-743be761-5184-40be-84f8-9a0e9137cba5.log (5599 bytes)
14122024-02-12T21:25:16.255Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-downstairs:downstairs-743be761-5184-40be-84f8-9a0e9137cba5.log
14132024-02-12T21:25:16.255Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-downstairs:snapshot-743be761-5184-40be-84f8-9a0e9137cba5-d5595bbd-d9b8-4f25-96e0-b133935ed4b1.log (5180 bytes)
14142024-02-12T21:25:17.354Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e2958ff6-8833-4694-bb33-97b20fdcb479/root/var/svc/log/oxide-crucible-downstairs:snapshot-743be761-5184-40be-84f8-9a0e9137cba5-d5595bbd-d9b8-4f25-96e0-b133935ed4b1.log
14152024-02-12T21:25:17.354Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ae4455f9-8116-4b93-bd09-dcf5aff39562/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
14162024-02-12T21:25:18.429Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ae4455f9-8116-4b93-bd09-dcf5aff39562/root/var/svc/log/oxide-crucible-pantry:default.log
14172024-02-12T21:25:18.460Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ae4455f9-8116-4b93-bd09-dcf5aff39562/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2332 bytes)
14182024-02-12T21:25:19.532Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_ae4455f9-8116-4b93-bd09-dcf5aff39562/root/var/svc/log/oxide-crucible-pantry:default.log.0
14192024-02-12T21:25:19.532Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1dd7b187-7237-4946-8823-ee5a6824dc81/root/var/svc/log/oxide-nexus:default.log (1698907 bytes)
14202024-02-12T21:25:20.300Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1dd7b187-7237-4946-8823-ee5a6824dc81/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1698907 -> 2093413
14212024-02-12T21:25:21.373Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1dd7b187-7237-4946-8823-ee5a6824dc81/root/var/svc/log/oxide-nexus:default.log
14222024-02-12T21:25:21.373Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1dd7b187-7237-4946-8823-ee5a6824dc81/root/var/svc/log/oxide-nexus:default.log.0 (75 bytes)
14232024-02-12T21:25:22.493Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_1dd7b187-7237-4946-8823-ee5a6824dc81/root/var/svc/log/oxide-nexus:default.log.0
14242024-02-12T21:25:22.494Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_f1b885c1-f0c6-4048-a7c1-c16f1f23453f/root/var/svc/log/oxide-nexus:default.log (34580551 bytes)
14252024-02-12T21:25:37.008Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_f1b885c1-f0c6-4048-a7c1-c16f1f23453f/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 34580551 -> 34963557
14262024-02-12T21:25:38.125Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_f1b885c1-f0c6-4048-a7c1-c16f1f23453f/root/var/svc/log/oxide-nexus:default.log
14272024-02-12T21:25:38.126Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_f1b885c1-f0c6-4048-a7c1-c16f1f23453f/root/var/svc/log/oxide-nexus:default.log.0 (75 bytes)
14282024-02-12T21:25:39.260Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_f1b885c1-f0c6-4048-a7c1-c16f1f23453f/root/var/svc/log/oxide-nexus:default.log.0
14292024-02-12T21:25:39.260Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-agent:default.log (17501 bytes)
14302024-02-12T21:25:40.408Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-agent:default.log
14312024-02-12T21:25:40.408Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
14322024-02-12T21:25:41.506Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-agent:default.log.0
14332024-02-12T21:25:41.506Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14342024-02-12T21:25:42.580Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-downstairs:default.log
14352024-02-12T21:25:42.580Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14362024-02-12T21:25:43.683Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14372024-02-12T21:25:43.683Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c335026-a1a9-4ad3-a8a9-3fe7e4537de6.log (3037 bytes)
14382024-02-12T21:25:44.797Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-downstairs:downstairs-5c335026-a1a9-4ad3-a8a9-3fe7e4537de6.log
14392024-02-12T21:25:44.798Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-downstairs:downstairs-e3d071fa-9e7d-4399-bf7a-883fb9b8e108.log (2943 bytes)
14402024-02-12T21:25:45.894Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_54f4cb01-9160-4148-aa48-88ff8db14bb5/root/var/svc/log/oxide-crucible-downstairs:downstairs-e3d071fa-9e7d-4399-bf7a-883fb9b8e108.log
14412024-02-12T21:25:45.895Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/measurements.log (20276 bytes)
14422024-02-12T21:25:46.008Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/measurements.log" changed size mid upload: 20276 -> 28359
14432024-02-12T21:25:47.114Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/measurements.log
14442024-02-12T21:25:47.114Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/statistics.log (12285 bytes)
14452024-02-12T21:25:47.612Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/statistics.log" changed size mid upload: 12285 -> 17550
14462024-02-12T21:25:48.691Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/statistics.log
14472024-02-12T21:25:48.722Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/tracking.log (2251 bytes)
14482024-02-12T21:25:48.754Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/tracking.log" changed size mid upload: 2251 -> 2647
14492024-02-12T21:25:49.831Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_60aa114a-3ab0-4a66-91de-44313f689e4d/root/var/log/chrony/tracking.log