01HPQFB92KZV2REGW42PH30G7B: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HPQFDJJRP0W9YG4M8ZXH6897

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-02-15T23:34:51.939Zjob dependencies complete; ready to run (waiting for 44 m 26 s)
22024-02-16T02:42:00.587Zjob assigned to worker 01HPQWBQ3ERW7AAAZYHJQWKAGD (queued for 3 h 7 m 8 s)
32024-02-16T02:42:00.653Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-02-16T02:42:00.699Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-02-16T02:42:00.733Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-02-16T02:42:00.768Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-02-16T02:42:00.803Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-02-16T02:42:00.838ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-02-16T02:42:00.872Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-02-16T02:42:00.911ZOxide Helios Version helios-2.0.22451 64-bit
112024-02-16T02:42:00.947ZConfiguring devices.
122024-02-16T02:42:00.983Z##################################################
132024-02-16T02:42:01.018Z#### ############# ##
142024-02-16T02:42:01.057Z### ### ############ ##
152024-02-16T02:42:01.100Z## ### # ## ### ## Oxide Computer Company ##
162024-02-16T02:42:01.138Z## ## ## ### # ### ##
172024-02-16T02:42:01.175Z## # ### #### #### This Station Under ##
182024-02-16T02:42:01.209Z### ### #### # ### Computer Control ##
192024-02-16T02:42:01.243Z#### #### ### ## ##
202024-02-16T02:42:01.276Z##################################################
212024-02-16T02:42:01.310ZHostname: buskin
222024-02-16T02:42:01.343ZLoading smf(7) service descriptions:
232024-02-16T02:42:02.073Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-5c5e256b526718ba.gz
242024-02-16T02:42:05.812Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-5c5e256b526718ba.gz
252024-02-16T02:42:05.812Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-02-16T02:42:32.849Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-02-16T02:42:32.850Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-398b34350dfa5341.gz
282024-02-16T02:42:59.921Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-398b34350dfa5341.gz
292024-02-16T02:42:59.921Zdownloading input: /input/ci-tools/work/caboose-util.gz
302024-02-16T02:43:00.938Zdownloaded input: /input/ci-tools/work/caboose-util.gz
312024-02-16T02:43:00.938Zdownloading input: /input/ci-tools/work/tufaceous.gz
322024-02-16T02:43:03.899Zdownloaded input: /input/ci-tools/work/tufaceous.gz
332024-02-16T02:43:03.925Zdownloading input: /input/package/work/version.txt
342024-02-16T02:43:03.949Zdownloaded input: /input/package/work/version.txt
352024-02-16T02:43:03.949Zdownloading input: /input/package/work/package.tar.gz
362024-02-16T02:43:28.711Zdownloaded input: /input/package/work/package.tar.gz
372024-02-16T02:43:28.711Zdownloading input: /input/package/work/global-zone-packages.tar.gz
382024-02-16T02:44:01.549Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
392024-02-16T02:44:01.549Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
402024-02-16T02:44:08.217Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
412024-02-16T02:44:08.241Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
422024-02-16T02:45:00.270Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
432024-02-16T02:45:00.270Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
442024-02-16T02:45:57.623Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
452024-02-16T02:45:57.623Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
462024-02-16T02:46:28.053Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
472024-02-16T02:46:28.053Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
482024-02-16T02:46:38.002Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
492024-02-16T02:46:38.002Zdownloading input: /input/package/work/zones/crucible.tar.gz
502024-02-16T02:46:53.766Zdownloaded input: /input/package/work/zones/crucible.tar.gz
512024-02-16T02:46:53.766Zdownloading input: /input/package/work/zones/external-dns.tar.gz
522024-02-16T02:46:58.858Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
532024-02-16T02:46:58.859Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
542024-02-16T02:47:03.103Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
552024-02-16T02:47:03.127Zdownloading input: /input/package/work/zones/ntp.tar.gz
562024-02-16T02:47:03.168Zdownloaded input: /input/package/work/zones/ntp.tar.gz
572024-02-16T02:47:03.192Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
582024-02-16T02:47:06.625Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
592024-02-16T02:47:06.626Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
602024-02-16T02:47:10.536Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
612024-02-16T02:47:10.536Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
622024-02-16T02:47:25.766Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
632024-02-16T02:47:25.766Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
642024-02-16T02:47:40.590Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
652024-02-16T02:47:40.590Zdownloading input: /input/package/work/zones/overlay.tar.gz
662024-02-16T02:47:40.680Zdownloaded input: /input/package/work/zones/overlay.tar.gz
672024-02-16T02:47:40.704Zdownloading input: /input/package/work/zones/oximeter.tar.gz
682024-02-16T02:47:50.327Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
692024-02-16T02:47:50.327Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
702024-02-16T02:48:08.529Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
712024-02-16T02:48:08.529Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
722024-02-16T02:49:42.236Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
732024-02-16T02:49:42.236Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
742024-02-16T02:50:22.666Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
752024-02-16T02:50:22.666Zstarting task 0: "setup"
762024-02-16T02:50:22.691Z++ uname -s
772024-02-16T02:50:22.691Z+ kern=SunOS
782024-02-16T02:50:22.691Z+ case "$kern" in
792024-02-16T02:50:22.691Z+ groupadd -g 12345 build
802024-02-16T02:50:22.691Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
812024-02-16T02:50:24.685Z+ zfs create -o mountpoint=/work rpool/work
822024-02-16T02:50:24.727Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
832024-02-16T02:50:24.750Z+ home_fs=zfs
842024-02-16T02:50:24.751Z+ [[ zfs == autofs ]]
852024-02-16T02:50:24.751Z+ mkdir -p /home/build
862024-02-16T02:50:24.751Z+ chown build:build /home/build /work
872024-02-16T02:50:26.738Z+ chmod 0700 /home/build /work
882024-02-16T02:50:26.765Zprocess exited: duration 4072 ms, exit code 0
 
892024-02-16T02:50:26.813Zstarting task 1: "authentication"
902024-02-16T02:50:26.857Zprocess exited: duration 43 ms, exit code 0
 
912024-02-16T02:50:26.904Zstarting task 2: "build"
922024-02-16T02:50:26.928Z+ trap _exit_trap EXIT
932024-02-16T02:50:26.928Z+ set +x
942024-02-16T02:50:54.408Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
952024-02-16T02:50:54.653Zsecpolicy_fs_linkdir: 0x55 = 0x55
962024-02-16T02:50:54.653Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
972024-02-16T02:50:54.653Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
982024-02-16T02:50:54.653Zsecpolicy_fs_linkdir+3: 0 = 0xe5
992024-02-16T02:50:54.677Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1002024-02-16T02:50:54.677Zsecpolicy_fs_linkdir+5: 0 = 0x1
1012024-02-16T02:50:54.677Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1022024-02-16T02:50:54.677Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1032024-02-16T02:50:54.677Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1042024-02-16T02:50:54.677Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1052024-02-16T02:50:54.677Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1062024-02-16T02:50:54.678Z+ [[ -d /opt/oxide ]]
1072024-02-16T02:50:54.678Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1082024-02-16T02:50:54.678Z+ pfexec mkdir /opt/oxide
1092024-02-16T02:50:54.678Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1102024-02-16T02:50:54.678Z+ [[ -d /opt/oxide-underneath ]]
1112024-02-16T02:50:54.678Z+ cd /opt/oxide-underneath
1122024-02-16T02:50:54.678Z+ pfexec tar ceEp@/f - .
1132024-02-16T02:50:54.678Z+ cd /opt/oxide
1142024-02-16T02:50:54.678Z+ pfexec tar xveEp@/f -
1152024-02-16T02:50:54.714Zx ., 0 bytes, 0 tape blocks
1162024-02-16T02:50:54.714Zx ./opte, 0 bytes, 0 tape blocks
1172024-02-16T02:50:54.714Zx ./opte/bin, 0 bytes, 0 tape blocks
1182024-02-16T02:50:54.714Zx ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks
1192024-02-16T02:50:54.738Z+ pfexec rm -rf /opt/oxide-underneath
1202024-02-16T02:50:54.738Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1212024-02-16T02:50:54.761Z+ pfexec mkdir /opt/oxide/work
1222024-02-16T02:50:54.761Z+ pfexec chown build:build /opt/oxide/work
1232024-02-16T02:50:54.761Z+ cd /opt/oxide/work
1242024-02-16T02:50:54.761Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1252024-02-16T02:50:56.445ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1262024-02-16T02:50:56.445Zx out/mg-ddm-gz.tar, 64939008 bytes, 126834 tape blocks
1272024-02-16T02:50:56.445Zx out/omicron-sled-agent.tar, 122618368 bytes, 239489 tape blocks
1282024-02-16T02:50:56.445Zx out/oxlog.tar, 8382464 bytes, 16372 tape blocks
1292024-02-16T02:50:56.445Zx out/target/test, 75 bytes, 1 tape blocks
1302024-02-16T02:50:56.445Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1312024-02-16T02:50:56.445Zx package-manifest.toml, 23732 bytes, 47 tape blocks
1322024-02-16T02:50:56.445Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1332024-02-16T02:50:56.446Zx target/release/omicron-package, 45712928 bytes, 89284 tape blocks
1342024-02-16T02:50:56.446Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1352024-02-16T02:50:56.446Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1362024-02-16T02:50:56.446Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1372024-02-16T02:50:56.446Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1382024-02-16T02:50:56.446Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1392024-02-16T02:50:56.446Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402024-02-16T02:50:56.446Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412024-02-16T02:50:56.474Z
1422024-02-16T02:50:56.474Zreal 1.687373159
1432024-02-16T02:50:56.475Zuser 1.516233983
1442024-02-16T02:50:56.475Zsys 0.299844650
1452024-02-16T02:50:56.475Ztrap 0.000068081
1462024-02-16T02:50:56.475Ztflt 0.000000000
1472024-02-16T02:50:56.475Zdflt 0.000000000
1482024-02-16T02:50:56.475Zkflt 0.000000000
1492024-02-16T02:50:56.475Zlock 0.000000000
1502024-02-16T02:50:56.476Zslp 1.515072360
1512024-02-16T02:50:56.476Zlat 0.041497717
1522024-02-16T02:50:56.476Zstop 0.000124652
1532024-02-16T02:50:56.476Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542024-02-16T02:50:57.703Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552024-02-16T02:50:57.730Z+ mkdir tests
1562024-02-16T02:50:57.730Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572024-02-16T02:50:57.730Z+ ptime -m gunzip
1582024-02-16T02:50:57.730Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-5c5e256b526718ba
1592024-02-16T02:50:57.969Z
1602024-02-16T02:50:57.999Zreal 0.239214543
1612024-02-16T02:50:57.999Zuser 0.218918963
1622024-02-16T02:50:58.000Zsys 0.020048856
1632024-02-16T02:50:58.001Ztrap 0.000015920
1642024-02-16T02:50:58.001Ztflt 0.000000000
1652024-02-16T02:50:58.001Zdflt 0.000000000
1662024-02-16T02:50:58.001Zkflt 0.000000000
1672024-02-16T02:50:58.002Zlock 0.000000000
1682024-02-16T02:50:58.002Zslp 0.000023420
1692024-02-16T02:50:58.002Zlat 0.000024300
1702024-02-16T02:50:58.003Zstop 0.000123041
1712024-02-16T02:50:58.003Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-5c5e256b526718ba
1722024-02-16T02:50:58.003Z+ chmod a+x tests/bootstrap-5c5e256b526718ba
1732024-02-16T02:50:58.003Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742024-02-16T02:50:58.004Z+ ptime -m gunzip
1752024-02-16T02:50:58.004Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762024-02-16T02:51:00.472Z
1772024-02-16T02:51:00.496Zreal 2.493963062
1782024-02-16T02:51:00.496Zuser 2.335040160
1792024-02-16T02:51:00.496Zsys 0.158500657
1802024-02-16T02:51:00.496Ztrap 0.000190522
1812024-02-16T02:51:00.496Ztflt 0.000000000
1822024-02-16T02:51:00.496Zdflt 0.000000000
1832024-02-16T02:51:00.496Zkflt 0.000000000
1842024-02-16T02:51:00.496Zlock 0.000000000
1852024-02-16T02:51:00.496Zslp 0.000022280
1862024-02-16T02:51:00.496Zlat 0.000031980
1872024-02-16T02:51:00.496Zstop 0.000116181
1882024-02-16T02:51:00.496Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892024-02-16T02:51:00.496Z+ chmod a+x tests/bootstrap
1902024-02-16T02:51:00.496Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912024-02-16T02:51:00.496Z+ ptime -m gunzip
1922024-02-16T02:51:00.496Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-398b34350dfa5341
1932024-02-16T02:51:03.109Z
1942024-02-16T02:51:03.138Zreal 2.626325355
1952024-02-16T02:51:03.139Zuser 2.455260574
1962024-02-16T02:51:03.139Zsys 0.170649851
1972024-02-16T02:51:03.139Ztrap 0.000185185
1982024-02-16T02:51:03.139Ztflt 0.000000000
1992024-02-16T02:51:03.139Zdflt 0.000000000
2002024-02-16T02:51:03.139Zkflt 0.000000000
2012024-02-16T02:51:03.139Zlock 0.000000000
2022024-02-16T02:51:03.139Zslp 0.000021370
2032024-02-16T02:51:03.139Zlat 0.000024330
2042024-02-16T02:51:03.139Zstop 0.000126131
2052024-02-16T02:51:03.139Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-398b34350dfa5341
2062024-02-16T02:51:03.139Z+ chmod a+x tests/end_to_end_tests-398b34350dfa5341
2072024-02-16T02:51:03.139Z+ bmat address ls
2082024-02-16T02:51:03.139ZNAME CIDR FIRST LAST COUNT
2092024-02-16T02:51:03.139Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2102024-02-16T02:51:03.139Z++ bmat address ls -f extra -Ho first,last,count
2112024-02-16T02:51:03.139Z+ set -- 10.151.1.164 10.151.1.227 64
2122024-02-16T02:51:03.139Z+ EXTRA_IP_START=10.151.1.164
2132024-02-16T02:51:03.139Z+ EXTRA_IP_END=10.151.1.227
2142024-02-16T02:51:03.139Z+ EXTRA_IP_COUNT=64
2152024-02-16T02:51:03.139Z+ (( EXTRA_IP_COUNT >= 32 ))
2162024-02-16T02:51:03.139Z+ EXTRA_IP_BASE=10.151.1
2172024-02-16T02:51:03.139Z+ EXTRA_IP_FOCTET=164
2182024-02-16T02:51:03.140Z+ EXTRA_IP_LOCTET=227
2192024-02-16T02:51:03.140Z+ SERVICE_IP_POOL_START=10.151.1.164
2202024-02-16T02:51:03.140Z+ SERVICE_IP_POOL_END=10.151.1.173
2212024-02-16T02:51:03.140Z+ DNS_IP1=10.151.1.164
2222024-02-16T02:51:03.140Z+ DNS_IP2=10.151.1.165
2232024-02-16T02:51:03.140Z+ UPLINK_IP=10.151.1.174
2242024-02-16T02:51:03.140Z+ IPPOOL_START=10.151.1.175
2252024-02-16T02:51:03.140Z+ IPPOOL_END=10.151.1.227
2262024-02-16T02:51:03.165Z++ ipadm show-addr -po type,addr
2272024-02-16T02:51:03.165Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282024-02-16T02:51:03.165Z+ GATEWAY_IP=10.151.1.100
2292024-02-16T02:51:03.165Z+ [[ -n 10.151.1.100 ]]
2302024-02-16T02:51:03.165Z+ ping -s 10.151.1.100 56 1
2312024-02-16T02:51:03.166ZPING 10.151.1.100: 56 data bytes
2322024-02-16T02:51:03.166Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2332024-02-16T02:51:03.166Z
2342024-02-16T02:51:03.166Z----10.151.1.100 PING Statistics----
2352024-02-16T02:51:03.166Z1 packets transmitted, 1 packets received, 0% packet loss
2362024-02-16T02:51:03.166Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2372024-02-16T02:51:03.166Z++ arp -an
2382024-02-16T02:51:03.166Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2392024-02-16T02:51:03.166Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2402024-02-16T02:51:03.166Z+ routeadm -e ipv4-forwarding -u
2412024-02-16T02:51:03.271Z+ PXA_START=10.151.1.164
2422024-02-16T02:51:03.271Z+ PXA_END=10.151.1.227
2432024-02-16T02:51:03.271Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442024-02-16T02:51:03.296Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452024-02-16T02:51:03.467Z+ ZPOOL_VDEV_DIR=/scratch
2462024-02-16T02:51:03.467Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472024-02-16T02:51:03.491Z+++ dirname ./tools/create_virtual_hardware.sh
2482024-02-16T02:51:03.491Z++ cd ./tools
2492024-02-16T02:51:03.492Z++ pwd
2502024-02-16T02:51:03.492Z+ SOURCE_DIR=/opt/oxide/work/tools
2512024-02-16T02:51:03.492Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522024-02-16T02:51:03.492Z+ SOFTNPU_MODE=zone
2532024-02-16T02:51:03.492Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2542024-02-16T02:51:03.492Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2552024-02-16T02:51:03.492Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2562024-02-16T02:51:03.492Z++ dladm show-phys -p -o LINK
2572024-02-16T02:51:03.492Z++ head -1
2582024-02-16T02:51:03.516Z+ PHYSICAL_LINK=igb0
2592024-02-16T02:51:03.516Z+ echo 'Using igb0 as physical link'
2602024-02-16T02:51:03.516ZUsing igb0 as physical link
2612024-02-16T02:51:03.516Z+ ensure_run_as_root
2622024-02-16T02:51:03.516Z++ id -u
2632024-02-16T02:51:03.516Z+ [[ 0 -ne 0 ]]
2642024-02-16T02:51:03.516Z+ ensure_zpools
2652024-02-16T02:51:03.516Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2662024-02-16T02:51:03.516Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2672024-02-16T02:51:03.516Z+ readarray -t ZPOOLS
2682024-02-16T02:51:03.517Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2692024-02-16T02:51:03.517Z++ sed 's/[ ",]//g'
2702024-02-16T02:51:03.517Z+ for ZPOOL in "${ZPOOLS[@]}"
2712024-02-16T02:51:03.517Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2722024-02-16T02:51:03.517ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2732024-02-16T02:51:03.517Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2742024-02-16T02:51:03.517Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2752024-02-16T02:51:03.517Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2762024-02-16T02:51:03.517Z0+0 records in
2772024-02-16T02:51:03.517Z0+0 records out
2782024-02-16T02:51:03.517Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2792024-02-16T02:51:03.517Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2802024-02-16T02:51:03.517Z+ set +x
2812024-02-16T02:51:03.517ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2822024-02-16T02:51:03.517Z++ zpool list -o name
2832024-02-16T02:51:03.517Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2842024-02-16T02:51:03.517Z+ [[ -z '' ]]
2852024-02-16T02:51:03.517Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2862024-02-16T02:51:03.552Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2872024-02-16T02:51:03.577Z+ set +x
2882024-02-16T02:51:03.577ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2892024-02-16T02:51:03.577Z+ for ZPOOL in "${ZPOOLS[@]}"
2902024-02-16T02:51:03.577ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2912024-02-16T02:51:03.577Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
2922024-02-16T02:51:03.577Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
2932024-02-16T02:51:03.577Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
2942024-02-16T02:51:03.577Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
2952024-02-16T02:51:03.577Z0+0 records in
2962024-02-16T02:51:03.578Z0+0 records out
2972024-02-16T02:51:03.578Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
2982024-02-16T02:51:03.578Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
2992024-02-16T02:51:03.578Z+ set +x
3002024-02-16T02:51:03.578ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012024-02-16T02:51:03.578Z++ zpool list -o name
3022024-02-16T02:51:03.578Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3032024-02-16T02:51:03.578Z+ [[ -z '' ]]
3042024-02-16T02:51:03.578Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3052024-02-16T02:51:03.606Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3062024-02-16T02:51:03.606Z+ set +x
3072024-02-16T02:51:03.606ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3082024-02-16T02:51:03.606Z+ for ZPOOL in "${ZPOOLS[@]}"
3092024-02-16T02:51:03.606Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3102024-02-16T02:51:03.606ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3112024-02-16T02:51:03.606Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3122024-02-16T02:51:03.606Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3132024-02-16T02:51:03.606Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3142024-02-16T02:51:03.606Z0+0 records in
3152024-02-16T02:51:03.606Z0+0 records out
3162024-02-16T02:51:03.606Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3172024-02-16T02:51:03.606Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3182024-02-16T02:51:03.606Z+ set +x
3192024-02-16T02:51:03.606ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3202024-02-16T02:51:03.606Z++ zpool list -o name
3212024-02-16T02:51:03.606Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3222024-02-16T02:51:03.631Z+ [[ -z '' ]]
3232024-02-16T02:51:03.631Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242024-02-16T02:51:03.656Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3252024-02-16T02:51:03.656Z+ set +x
3262024-02-16T02:51:03.656ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3272024-02-16T02:51:03.656Z+ for ZPOOL in "${ZPOOLS[@]}"
3282024-02-16T02:51:03.656Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3292024-02-16T02:51:03.656ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3302024-02-16T02:51:03.656Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3312024-02-16T02:51:03.656Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3322024-02-16T02:51:03.656Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3332024-02-16T02:51:03.656Z0+0 records in
3342024-02-16T02:51:03.656Z0+0 records out
3352024-02-16T02:51:03.656Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3362024-02-16T02:51:03.656Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3372024-02-16T02:51:03.656Z+ set +x
3382024-02-16T02:51:03.656ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3392024-02-16T02:51:03.656Z++ zpool list -o name
3402024-02-16T02:51:03.656Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3412024-02-16T02:51:03.656Z+ [[ -z '' ]]
3422024-02-16T02:51:03.657Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3432024-02-16T02:51:03.682Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3442024-02-16T02:51:03.682Z+ set +x
3452024-02-16T02:51:03.706ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3462024-02-16T02:51:03.706Z+ for ZPOOL in "${ZPOOLS[@]}"
3472024-02-16T02:51:03.706ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3482024-02-16T02:51:03.706Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3492024-02-16T02:51:03.706Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3502024-02-16T02:51:03.706Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3512024-02-16T02:51:03.706Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3522024-02-16T02:51:03.707Z0+0 records in
3532024-02-16T02:51:03.707Z0+0 records out
3542024-02-16T02:51:03.707Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3552024-02-16T02:51:03.707Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3562024-02-16T02:51:03.707Z+ set +x
3572024-02-16T02:51:03.707ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3582024-02-16T02:51:03.707Z++ zpool list -o name
3592024-02-16T02:51:03.707Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3602024-02-16T02:51:03.707Z+ [[ -z '' ]]
3612024-02-16T02:51:03.707Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3622024-02-16T02:51:03.731Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3632024-02-16T02:51:03.731Z+ set +x
3642024-02-16T02:51:03.731ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3652024-02-16T02:51:03.731Z+ for ZPOOL in "${ZPOOLS[@]}"
3662024-02-16T02:51:03.731Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3672024-02-16T02:51:03.731ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3682024-02-16T02:51:03.731Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3692024-02-16T02:51:03.731Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3702024-02-16T02:51:03.731Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3712024-02-16T02:51:03.731Z0+0 records in
3722024-02-16T02:51:03.731Z0+0 records out
3732024-02-16T02:51:03.731Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3742024-02-16T02:51:03.731Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3752024-02-16T02:51:03.732Z+ set +x
3762024-02-16T02:51:03.732ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3772024-02-16T02:51:03.732Z++ zpool list -o name
3782024-02-16T02:51:03.756Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3792024-02-16T02:51:03.756Z+ [[ -z '' ]]
3802024-02-16T02:51:03.756Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3812024-02-16T02:51:03.781Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
3822024-02-16T02:51:03.781Z+ set +x
3832024-02-16T02:51:03.781ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3842024-02-16T02:51:03.781Z+ for ZPOOL in "${ZPOOLS[@]}"
3852024-02-16T02:51:03.781Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
3862024-02-16T02:51:03.781ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3872024-02-16T02:51:03.781Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
3882024-02-16T02:51:03.781Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
3892024-02-16T02:51:03.781Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
3902024-02-16T02:51:03.781Z0+0 records in
3912024-02-16T02:51:03.781Z0+0 records out
3922024-02-16T02:51:03.781Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3932024-02-16T02:51:03.781Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
3942024-02-16T02:51:03.781Z+ set +x
3952024-02-16T02:51:03.781ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3962024-02-16T02:51:03.781Z++ zpool list -o name
3972024-02-16T02:51:03.781Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
3982024-02-16T02:51:03.808Z+ [[ -z '' ]]
3992024-02-16T02:51:03.808Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4002024-02-16T02:51:03.832Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4012024-02-16T02:51:03.832Z+ set +x
4022024-02-16T02:51:03.832ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4032024-02-16T02:51:03.833Z+ for ZPOOL in "${ZPOOLS[@]}"
4042024-02-16T02:51:03.833Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4052024-02-16T02:51:03.833ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4062024-02-16T02:51:03.833Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4072024-02-16T02:51:03.833Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4082024-02-16T02:51:03.833Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4092024-02-16T02:51:03.833Z0+0 records in
4102024-02-16T02:51:03.833Z0+0 records out
4112024-02-16T02:51:03.833Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4122024-02-16T02:51:03.833Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4132024-02-16T02:51:03.833Z+ set +x
4142024-02-16T02:51:03.833ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4152024-02-16T02:51:03.833Z++ zpool list -o name
4162024-02-16T02:51:03.833Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4172024-02-16T02:51:03.833Z+ [[ -z '' ]]
4182024-02-16T02:51:03.833Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4192024-02-16T02:51:03.857Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4202024-02-16T02:51:03.857Z+ set +x
4212024-02-16T02:51:03.857ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4222024-02-16T02:51:03.857Z+ for ZPOOL in "${ZPOOLS[@]}"
4232024-02-16T02:51:03.857Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4242024-02-16T02:51:03.857ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4252024-02-16T02:51:03.857Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4262024-02-16T02:51:03.858Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4272024-02-16T02:51:03.858Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4282024-02-16T02:51:03.858Z0+0 records in
4292024-02-16T02:51:03.858Z0+0 records out
4302024-02-16T02:51:03.858Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4312024-02-16T02:51:03.858Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4322024-02-16T02:51:03.858Z+ set +x
4332024-02-16T02:51:03.858ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4342024-02-16T02:51:03.882Z++ zpool list -o name
4352024-02-16T02:51:03.882Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4362024-02-16T02:51:03.882Z+ [[ -z '' ]]
4372024-02-16T02:51:03.882Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4382024-02-16T02:51:03.908Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4392024-02-16T02:51:03.908Z+ set +x
4402024-02-16T02:51:03.908ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4412024-02-16T02:51:03.908Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4422024-02-16T02:51:03.908Z+ readarray -t ZPOOLS
4432024-02-16T02:51:03.908Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4442024-02-16T02:51:03.908Z++ sed 's/[ ",]//g'
4452024-02-16T02:51:03.908Z+ for ZPOOL in "${ZPOOLS[@]}"
4462024-02-16T02:51:03.908Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4472024-02-16T02:51:03.908ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4482024-02-16T02:51:03.908Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4492024-02-16T02:51:03.908Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4502024-02-16T02:51:03.908Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4512024-02-16T02:51:03.908Z0+0 records in
4522024-02-16T02:51:03.908Z0+0 records out
4532024-02-16T02:51:03.908Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4542024-02-16T02:51:03.908Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4552024-02-16T02:51:03.908Z+ set +x
4562024-02-16T02:51:03.909ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4572024-02-16T02:51:03.933Z++ zpool list -o name
4582024-02-16T02:51:03.933Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4592024-02-16T02:51:03.933Z+ [[ -z '' ]]
4602024-02-16T02:51:03.933Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4612024-02-16T02:51:03.958Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4622024-02-16T02:51:03.958Z+ set +x
4632024-02-16T02:51:03.959ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4642024-02-16T02:51:03.959Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-02-16T02:51:03.959Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4662024-02-16T02:51:03.959ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
4672024-02-16T02:51:03.959Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4682024-02-16T02:51:03.959Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4692024-02-16T02:51:03.959Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4702024-02-16T02:51:03.959Z0+0 records in
4712024-02-16T02:51:03.959Z0+0 records out
4722024-02-16T02:51:03.959Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-02-16T02:51:03.959Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4742024-02-16T02:51:03.959Z+ set +x
4752024-02-16T02:51:03.959ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4762024-02-16T02:51:03.959Z++ zpool list -o name
4772024-02-16T02:51:03.959Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4782024-02-16T02:51:03.985Z+ [[ -z '' ]]
4792024-02-16T02:51:03.985Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4802024-02-16T02:51:04.012Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4812024-02-16T02:51:04.013Z+ set +x
4822024-02-16T02:51:04.013ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
4832024-02-16T02:51:04.013Z+ [[ zone == \z\o\n\e ]]
4842024-02-16T02:51:04.013Z+ ensure_simulated_links igb0
4852024-02-16T02:51:04.013Z+ local PHYSICAL_LINK=igb0
4862024-02-16T02:51:04.013Z+ INDICES=("0" "1")
4872024-02-16T02:51:04.013Z+ for I in "${INDICES[@]}"
4882024-02-16T02:51:04.013Z++ get_simnet_name_if_exists net0
4892024-02-16T02:51:04.013Z++ dladm show-simnet -p -o LINK net0
4902024-02-16T02:51:04.013Z++ echo ''
4912024-02-16T02:51:04.013Z+ [[ -z '' ]]
4922024-02-16T02:51:04.013Z+ dladm create-simnet -t net0
4932024-02-16T02:51:04.013Z+ dladm create-simnet -t sc0_0
4942024-02-16T02:51:04.013Z+ dladm modify-simnet -t -p net0 sc0_0
4952024-02-16T02:51:04.037Z+ dladm set-linkprop -p mtu=9000 sc0_0
4962024-02-16T02:51:04.037Z+ success 'Simnet net0/sc0_0 exists'
4972024-02-16T02:51:04.038Z+ set +x
4982024-02-16T02:51:04.038ZSimnet net0/sc0_0 exists
4992024-02-16T02:51:04.038Z+ for I in "${INDICES[@]}"
5002024-02-16T02:51:04.038Z++ get_simnet_name_if_exists net1
5012024-02-16T02:51:04.038Z++ dladm show-simnet -p -o LINK net1
5022024-02-16T02:51:04.038Z++ echo ''
5032024-02-16T02:51:04.038Z+ [[ -z '' ]]
5042024-02-16T02:51:04.038Z+ dladm create-simnet -t net1
5052024-02-16T02:51:04.038Z+ dladm create-simnet -t sc1_0
5062024-02-16T02:51:04.038Z+ dladm modify-simnet -t -p net1 sc1_0
5072024-02-16T02:51:04.038Z+ dladm set-linkprop -p mtu=9000 sc1_0
5082024-02-16T02:51:04.062Z+ success 'Simnet net1/sc1_0 exists'
5092024-02-16T02:51:04.062Z+ set +x
5102024-02-16T02:51:04.062ZSimnet net1/sc1_0 exists
5112024-02-16T02:51:04.062Z++ get_vnic_name_if_exists sc0_1
5122024-02-16T02:51:04.062Z++ dladm show-vnic -p -o LINK sc0_1
5132024-02-16T02:51:04.062Z++ echo ''
5142024-02-16T02:51:04.062Z+ [[ -z '' ]]
5152024-02-16T02:51:04.062Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5162024-02-16T02:51:04.062Z+ [[ -v PROMISC_FILT_OFF ]]
5172024-02-16T02:51:04.062Z+ success 'Vnic sc0_1 exists'
5182024-02-16T02:51:04.062Z+ set +x
5192024-02-16T02:51:04.062ZVnic sc0_1 exists
5202024-02-16T02:51:04.062Z+ warn_if_no_proxy_arp
5212024-02-16T02:51:04.063Z+ [[ -v PXA_START ]]
5222024-02-16T02:51:04.063Z+ [[ -v PXA_END ]]
5232024-02-16T02:51:04.063Z+ ensure_softnpu_zone
5242024-02-16T02:51:04.063Z+ zoneadm list
5252024-02-16T02:51:04.063Z+ grep -q sidecar_softnpu
5262024-02-16T02:51:04.063Z+ [[ -f out/npuzone/npuzone ]]
5272024-02-16T02:51:04.063Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5282024-02-16T02:51:04.087Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5292024-02-16T02:51:10.433Zdownloading softnpu ...done
5302024-02-16T02:51:10.457Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5312024-02-16T02:51:15.628Zdownloading asic_program.so ...done
5322024-02-16T02:51:15.652Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5332024-02-16T02:51:22.373Zdownloading scadm ...done
5342024-02-16T02:51:22.398Zcreating port tfportrear0_0 for sc0_0
5352024-02-16T02:51:22.398Zcreating port tfportqsfp0_0 for sc0_1
5362024-02-16T02:51:22.427Zsoftnpu zone setup
5372024-02-16T02:51:22.427Zconfigure zone
5382024-02-16T02:51:22.428Zinstall zone
5392024-02-16T02:51:23.492Zboot zone
5402024-02-16T02:51:26.599Z[sidecar_softnpu] svcs milestone/network
5412024-02-16T02:51:26.625ZSTATE STIME FMRI
5422024-02-16T02:51:26.626Zonline 2:51:24 svc:/milestone/network:default
5432024-02-16T02:51:26.626Z[sidecar_softnpu] /softnpu/npu start
5442024-02-16T02:51:26.652Z
5452024-02-16T02:51:26.675Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5462024-02-16T02:51:26.675Z+ GATEWAY_IP=10.151.1.100
5472024-02-16T02:51:26.675Z+ echo 'Using 10.151.1.100 as gateway ip'
5482024-02-16T02:51:26.675ZUsing 10.151.1.100 as gateway ip
5492024-02-16T02:51:26.675Z+ [[ ! -v GATEWAY_MAC ]]
5502024-02-16T02:51:26.675Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5512024-02-16T02:51:26.675Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5522024-02-16T02:51:26.676Z+++ echo 18:c0:4d:0d:9f:b2
5532024-02-16T02:51:26.676Z+ COUNT=1
5542024-02-16T02:51:26.676Z+ [[ 1 -ne 1 ]]
5552024-02-16T02:51:26.676Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5562024-02-16T02:51:26.676ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5572024-02-16T02:51:26.676Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5582024-02-16T02:51:26.676Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5592024-02-16T02:51:26.708Z+ PXA_MAC=a8:e1:de:01:70:1d
5602024-02-16T02:51:26.708Z+ [[ -v PXA_START ]]
5612024-02-16T02:51:26.708Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5622024-02-16T02:51:26.708Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5632024-02-16T02:51:26.732Z+ z_scadm dump-state
5642024-02-16T02:51:26.732Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5652024-02-16T02:51:26.756Zlocal v6:
5662024-02-16T02:51:26.756Zlocal v4:
5672024-02-16T02:51:26.756Zrouter v6:
5682024-02-16T02:51:26.756Zrouter v4_idx:
5692024-02-16T02:51:26.756Zrouter v4_routes:
5702024-02-16T02:51:26.756Zresolver v4:
5712024-02-16T02:51:26.756Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5722024-02-16T02:51:26.756Zresolver v6:
5732024-02-16T02:51:26.756Znat v4:
5742024-02-16T02:51:26.756Znat_v6:
5752024-02-16T02:51:26.756Zport_mac:
5762024-02-16T02:51:26.756Zproxy arp:
5772024-02-16T02:51:26.756Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5782024-02-16T02:51:26.756Z+ success 'softnpu zone exists'
5792024-02-16T02:51:26.756Z+ set +x
5802024-02-16T02:51:26.756Zsoftnpu zone exists
5812024-02-16T02:51:26.780Z
5822024-02-16T02:51:26.780Zreal 23.285624093
5832024-02-16T02:51:26.780Zuser 0.724692796
5842024-02-16T02:51:26.780Zsys 1.602658008
5852024-02-16T02:51:26.780Ztrap 0.000079815
5862024-02-16T02:51:26.780Ztflt 0.000092844
5872024-02-16T02:51:26.780Zdflt 0.001343601
5882024-02-16T02:51:26.780Zkflt 0.000000000
5892024-02-16T02:51:26.780Zlock 18:02.405994141
5902024-02-16T02:51:26.780Zslp 1:09.530915516
5912024-02-16T02:51:26.780Zlat 0.082410231
5922024-02-16T02:51:26.780Zstop 0.376699756
5932024-02-16T02:51:26.781Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5942024-02-16T02:51:26.809Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5952024-02-16T02:51:26.833Z+ SILO_NAME=recovery
5962024-02-16T02:51:26.833Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5972024-02-16T02:51:26.833Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5982024-02-16T02:51:26.833Z+ sed -i~ '
5992024-02-16T02:51:26.833Z /^external_dns_ips/c\
6002024-02-16T02:51:26.833Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6012024-02-16T02:51:26.833Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6022024-02-16T02:51:26.833Z /^first/c\
6032024-02-16T02:51:26.833Zfirst = "10.151.1.164"
6042024-02-16T02:51:26.833Z /^last/c\
6052024-02-16T02:51:26.833Zlast = "10.151.1.173"
6062024-02-16T02:51:26.833Z }
6072024-02-16T02:51:26.834Z /^\[rack_network_config/,/^$/ {
6082024-02-16T02:51:26.834Z /^infra_ip_first/c\
6092024-02-16T02:51:26.834Zinfra_ip_first = "10.151.1.174"
6102024-02-16T02:51:26.834Z /^infra_ip_last/c\
6112024-02-16T02:51:26.834Zinfra_ip_last = "10.151.1.174"
6122024-02-16T02:51:26.834Z }
6132024-02-16T02:51:26.834Z /^\[\[rack_network_config.ports/,/^$/ {
6142024-02-16T02:51:26.834Z /^routes/c\
6152024-02-16T02:51:26.834Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6162024-02-16T02:51:26.834Z /^addresses/c\
6172024-02-16T02:51:26.834Zaddresses = \["10.151.1.174/24"\]
6182024-02-16T02:51:26.834Z }
6192024-02-16T02:51:26.834Z' pkg/config-rss.toml
6202024-02-16T02:51:26.834Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6212024-02-16T02:51:26.834Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6222024-02-16T02:51:26.834Z+++ pkg/config-rss.toml Fri Feb 16 02:51:26 2024
6232024-02-16T02:51:26.834Z@@ -41,7 +41,7 @@
6242024-02-16T02:51:26.834Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6252024-02-16T02:51:26.834Z # must be contained in one of the "internal services" IP Pool ranges listed
6262024-02-16T02:51:26.834Z # below.
6272024-02-16T02:51:26.834Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6282024-02-16T02:51:26.834Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6292024-02-16T02:51:26.834Z
6302024-02-16T02:51:26.834Z # Initial TLS certificates for the external API
6312024-02-16T02:51:26.834Z #
6322024-02-16T02:51:26.835Z@@ -77,8 +77,8 @@
6332024-02-16T02:51:26.835Z #
6342024-02-16T02:51:26.835Z # For more on this and what to put here, see docs/how-to-run.adoc.
6352024-02-16T02:51:26.835Z [[internal_services_ip_pool_ranges]]
6362024-02-16T02:51:26.835Z-first = "192.168.1.20"
6372024-02-16T02:51:26.835Z-last = "192.168.1.29"
6382024-02-16T02:51:26.835Z+first = "10.151.1.164"
6392024-02-16T02:51:26.835Z+last = "10.151.1.173"
6402024-02-16T02:51:26.835Z
6412024-02-16T02:51:26.835Z # TODO - this configuration is subject to change going forward. Ultimately these
6422024-02-16T02:51:26.835Z # parameters should be provided to the control plane via wicket, but we need to
6432024-02-16T02:51:26.835Z@@ -92,8 +92,8 @@
6442024-02-16T02:51:26.835Z # A range of IP addresses used by Boundary Services on the external network. In
6452024-02-16T02:51:26.835Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6462024-02-16T02:51:26.835Z # With softnpu, only one address is used.
6472024-02-16T02:51:26.835Z-infra_ip_first = "192.168.1.30"
6482024-02-16T02:51:26.835Z-infra_ip_last = "192.168.1.30"
6492024-02-16T02:51:26.835Z+infra_ip_first = "10.151.1.174"
6502024-02-16T02:51:26.835Z+infra_ip_last = "10.151.1.174"
6512024-02-16T02:51:26.835Z
6522024-02-16T02:51:26.835Z # Configurations for BGP routers to run on the scrimlets.
6532024-02-16T02:51:26.835Z bgp = []
6542024-02-16T02:51:26.835Z@@ -101,9 +101,9 @@
6552024-02-16T02:51:26.835Z # You can configure multiple uplinks by repeating the following stanza
6562024-02-16T02:51:26.836Z [[rack_network_config.ports]]
6572024-02-16T02:51:26.836Z # Routes associated with this port.
6582024-02-16T02:51:26.836Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6592024-02-16T02:51:26.836Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6602024-02-16T02:51:26.836Z # Addresses associated with this port.
6612024-02-16T02:51:26.836Z-addresses = ["192.168.1.30/24"]
6622024-02-16T02:51:26.836Z+addresses = ["10.151.1.174/24"]
6632024-02-16T02:51:26.836Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6642024-02-16T02:51:26.836Z port = "qsfp0"
6652024-02-16T02:51:26.836Z # The speed of this port.
6662024-02-16T02:51:26.836Z+ true
6672024-02-16T02:51:26.836Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6682024-02-16T02:51:26.836Za pkg/config-rss.toml 7K
6692024-02-16T02:51:26.836Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6702024-02-16T02:51:26.836Z+ TLS_NAME=recovery.sys.oxide.test
6712024-02-16T02:51:26.836Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6722024-02-16T02:51:27.360Z...............+............+..+.......+.....+.+...+............+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.+......+.....+...............+...............+...................+.....+.............+...+...+.........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+..+................+...+......+......+..+......+......+...+.......+.....+................+...............+..............+.....................+...+.......+........+............+............+......+.......+..............+...+...+.......+....................+............+...............+....+..+...................+......+.....+.........+......+....+..............+....+...+.........+...+...+...+...........+...+...+.......+..+.........+.+...+...........+......+.+..+..........+...........+....+..................+.........+......+........+.........+.......+.........+..+......................+.....+.+..+.......+...........+.+...+.....+.+......+.....+.+...+..............+...+...+....+......+.....+.........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6732024-02-16T02:51:27.525Z...+...+.+......+..+...+....+.....+.+..+.+.....+.........+...+.......+..+.+........+....+...+.....+...+...................+..+....+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+.+..+......+......+....+.....+.......+...+..+....+........+.......+...+...........+......+.........+.......+.........+......+..+...+......................+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+....+...........+....+...+...+...+.........+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6742024-02-16T02:51:27.549Z-----
6752024-02-16T02:51:27.573Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6762024-02-16T02:51:27.573Za pkg/initial-tls-cert.pem 2K
6772024-02-16T02:51:27.573Za pkg/initial-tls-key.pem 4K
6782024-02-16T02:51:27.573Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6792024-02-16T02:51:27.573Z+ rmdir pkg
6802024-02-16T02:51:27.573Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6812024-02-16T02:51:27.573Z+ pfexec mkdir -p /usr/oxide
6822024-02-16T02:51:27.573Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6832024-02-16T02:51:28.301Z+ pfexec chmod +x /usr/oxide/oxide
6842024-02-16T02:51:28.325Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6852024-02-16T02:51:46.602Z+ OMICRON_NO_UNINSTALL=1
6862024-02-16T02:51:46.602Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6872024-02-16T02:51:46.626ZLogging to: /opt/oxide/work/out/LOG
6882024-02-16T02:51:47.133Z
6892024-02-16T02:51:47.157Zreal 0.526038550
6902024-02-16T02:51:47.158Zuser 0.109226674
6912024-02-16T02:51:47.158Zsys 2.014064996
6922024-02-16T02:51:47.158Ztrap 0.000010480
6932024-02-16T02:51:47.158Ztflt 0.000263552
6942024-02-16T02:51:47.158Zdflt 0.000331856
6952024-02-16T02:51:47.158Zkflt 0.000002309
6962024-02-16T02:51:47.158Zlock 47.848112287
6972024-02-16T02:51:47.158Zslp 0.726722875
6982024-02-16T02:51:47.158Zlat 0.003064987
6992024-02-16T02:51:47.158Zstop 0.212353906
7002024-02-16T02:51:47.158Z+ retry=0
7012024-02-16T02:51:47.158Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7022024-02-16T02:51:47.158Z+ [[ 0 -gt 30 ]]
7032024-02-16T02:51:47.158Z+ sleep 1
7042024-02-16T02:51:48.151Z+ retry=1
7052024-02-16T02:51:48.152Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7062024-02-16T02:51:48.175Z+ [[ 1 -gt 30 ]]
7072024-02-16T02:51:48.175Z+ sleep 1
7082024-02-16T02:51:49.172Z+ retry=2
7092024-02-16T02:51:49.172Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7102024-02-16T02:51:49.198Z+ [[ 2 -gt 30 ]]
7112024-02-16T02:51:49.198Z+ sleep 1
7122024-02-16T02:51:50.179Z+ retry=3
7132024-02-16T02:51:50.179Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7142024-02-16T02:51:50.204Z+ [[ 3 -gt 30 ]]
7152024-02-16T02:51:50.204Z+ sleep 1
7162024-02-16T02:51:51.193Z+ retry=4
7172024-02-16T02:51:51.193Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7182024-02-16T02:52:16.366Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7192024-02-16T02:52:16.394Zlocal v6:
7202024-02-16T02:52:16.394Zfe80::d895:3aff:fec1:af13
7212024-02-16T02:52:16.394Zfde5:1600:41e3:919b::1
7222024-02-16T02:52:16.394Zlocal v4:
7232024-02-16T02:52:16.394Z10.151.1.174
7242024-02-16T02:52:16.394Zrouter v6:
7252024-02-16T02:52:16.394Zfd00:1122:3344:3::/64 -> fe80::f4ac:fbff:fef3:f6e9 (1)
7262024-02-16T02:52:16.394Zfd00:1122:3344:101::/64 -> fe80::f4ac:fbff:fef3:f6e9 (1)
7272024-02-16T02:52:16.394Zfd00:1122:3344:2::/64 -> fe80::f4ac:fbff:fef3:f6e9 (1)
7282024-02-16T02:52:16.394Zfd00:1122:3344:1::/64 -> fe80::f4ac:fbff:fef3:f6e9 (1)
7292024-02-16T02:52:16.394Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::f4ac:fbff:fef3:f6e9 (1)
7302024-02-16T02:52:16.394Zrouter v4_idx:
7312024-02-16T02:52:16.394Z0.0.0.0/0 -> 0
7322024-02-16T02:52:16.395Zrouter v4_routes:
7332024-02-16T02:52:16.395Z0 -> 10.151.1.100 (2)
7342024-02-16T02:52:16.395Zresolver v4:
7352024-02-16T02:52:16.419Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7362024-02-16T02:52:16.419Z10.151.1.174 -> ca:88:99:ff:1f:94
7372024-02-16T02:52:16.419Zresolver v6:
7382024-02-16T02:52:16.419Zfe80::d895:3aff:fec1:af13 -> da:95:3a:c1:af:13
7392024-02-16T02:52:16.419Zfe80::f4ac:fbff:fef3:f6e9 -> f6:ac:fb:f3:f6:e9
7402024-02-16T02:52:16.419Znat v4:
7412024-02-16T02:52:16.419Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:d9:c9
7422024-02-16T02:52:16.419Znat_v6:
7432024-02-16T02:52:16.419Zport_mac:
7442024-02-16T02:52:16.419Z1: a8:40:25:1c:89:5f
7452024-02-16T02:52:16.419Z1000: a8:40:25:1c:89:5e
7462024-02-16T02:52:16.419Zproxy arp:
7472024-02-16T02:52:16.419Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7482024-02-16T02:52:16.419Z+ retry=0
7492024-02-16T02:52:16.419Z+++ zoneadm list -n
7502024-02-16T02:52:16.419Z+++ grep oxz_ntp
7512024-02-16T02:52:16.419Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
7522024-02-16T02:52:16.443Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7532024-02-16T02:52:16.443Z++ true
7542024-02-16T02:52:16.443Z+ [[ '' != online ]]
7552024-02-16T02:52:16.443Z+ [[ 0 -gt 60 ]]
7562024-02-16T02:52:16.443Z+ sleep 1
7572024-02-16T02:52:17.428Z+ retry=1
7582024-02-16T02:52:17.453Z+++ zoneadm list -n
7592024-02-16T02:52:17.453Z+++ grep oxz_ntp
7602024-02-16T02:52:17.453Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
7612024-02-16T02:52:17.476Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7622024-02-16T02:52:17.476Z++ true
7632024-02-16T02:52:17.476Z+ [[ '' != online ]]
7642024-02-16T02:52:17.476Z+ [[ 1 -gt 60 ]]
7652024-02-16T02:52:17.477Z+ sleep 1
7662024-02-16T02:52:18.460Z+ retry=2
7672024-02-16T02:52:18.484Z+++ zoneadm list -n
7682024-02-16T02:52:18.484Z+++ grep oxz_ntp
7692024-02-16T02:52:18.484Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
7702024-02-16T02:52:18.508Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7712024-02-16T02:52:18.508Z++ true
7722024-02-16T02:52:18.508Z+ [[ '' != online ]]
7732024-02-16T02:52:18.508Z+ [[ 2 -gt 60 ]]
7742024-02-16T02:52:18.508Z+ sleep 1
7752024-02-16T02:52:19.490Z+ retry=3
7762024-02-16T02:52:19.514Z+++ zoneadm list -n
7772024-02-16T02:52:19.514Z+++ grep oxz_ntp
7782024-02-16T02:52:19.514Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
7792024-02-16T02:52:19.515Z+ [[ disabled != online ]]
7802024-02-16T02:52:19.515Z+ [[ 3 -gt 60 ]]
7812024-02-16T02:52:19.515Z+ sleep 1
7822024-02-16T02:52:20.512Z+ retry=4
7832024-02-16T02:52:20.536Z+++ zoneadm list -n
7842024-02-16T02:52:20.536Z+++ grep oxz_ntp
7852024-02-16T02:52:20.536Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
7862024-02-16T02:52:20.536Z+ [[ disabled != online ]]
7872024-02-16T02:52:20.536Z+ [[ 4 -gt 60 ]]
7882024-02-16T02:52:20.536Z+ sleep 1
7892024-02-16T02:52:21.540Z+ retry=5
7902024-02-16T02:52:21.567Z+++ zoneadm list -n
7912024-02-16T02:52:21.567Z+++ grep oxz_ntp
7922024-02-16T02:52:21.567Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
7932024-02-16T02:52:21.567Z+ [[ disabled != online ]]
7942024-02-16T02:52:21.568Z+ [[ 5 -gt 60 ]]
7952024-02-16T02:52:21.568Z+ sleep 1
7962024-02-16T02:52:22.565Z+ retry=6
7972024-02-16T02:52:22.592Z+++ zoneadm list -n
7982024-02-16T02:52:22.593Z+++ grep oxz_ntp
7992024-02-16T02:52:22.593Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
8002024-02-16T02:52:22.593Z+ [[ disabled != online ]]
8012024-02-16T02:52:22.593Z+ [[ 6 -gt 60 ]]
8022024-02-16T02:52:22.594Z+ sleep 1
8032024-02-16T02:52:23.585Z+ retry=7
8042024-02-16T02:52:23.615Z+++ zoneadm list -n
8052024-02-16T02:52:23.615Z+++ grep oxz_ntp
8062024-02-16T02:52:23.616Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
8072024-02-16T02:52:23.616Z+ [[ disabled != online ]]
8082024-02-16T02:52:23.616Z+ [[ 7 -gt 60 ]]
8092024-02-16T02:52:23.616Z+ sleep 1
8102024-02-16T02:52:24.608Z+ retry=8
8112024-02-16T02:52:24.643Z+++ zoneadm list -n
8122024-02-16T02:52:24.643Z+++ grep oxz_ntp
8132024-02-16T02:52:24.644Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
8142024-02-16T02:52:24.644Z+ [[ disabled != online ]]
8152024-02-16T02:52:24.645Z+ [[ 8 -gt 60 ]]
8162024-02-16T02:52:24.645Z+ sleep 1
8172024-02-16T02:52:25.628Z+ retry=9
8182024-02-16T02:52:25.658Z+++ zoneadm list -n
8192024-02-16T02:52:25.659Z+++ grep oxz_ntp
8202024-02-16T02:52:25.659Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
8212024-02-16T02:52:25.659Z+ [[ disabled != online ]]
8222024-02-16T02:52:25.659Z+ [[ 9 -gt 60 ]]
8232024-02-16T02:52:25.659Z+ sleep 1
8242024-02-16T02:52:26.647Z+ retry=10
8252024-02-16T02:52:26.671Z+++ zoneadm list -n
8262024-02-16T02:52:26.671Z+++ grep oxz_ntp
8272024-02-16T02:52:26.671Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
8282024-02-16T02:52:26.671Z+ [[ disabled != online ]]
8292024-02-16T02:52:26.671Z+ [[ 10 -gt 60 ]]
8302024-02-16T02:52:26.672Z+ sleep 1
 
8312024-02-16T02:52:27.630Zbuskin console login: Feb 16 02:52:26 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8322024-02-16T02:52:27.669Z+ retry=11
8332024-02-16T02:52:27.692Z+++ zoneadm list -n
8342024-02-16T02:52:27.692Z+++ grep oxz_ntp
8352024-02-16T02:52:27.692Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
8362024-02-16T02:52:27.692Z+ [[ disabled != online ]]
8372024-02-16T02:52:27.692Z+ [[ 11 -gt 60 ]]
8382024-02-16T02:52:27.692Z+ sleep 1
8392024-02-16T02:52:28.692Z+ retry=12
8402024-02-16T02:52:28.716Z+++ zoneadm list -n
8412024-02-16T02:52:28.717Z+++ grep oxz_ntp
8422024-02-16T02:52:28.717Z++ pfexec svcs -z oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305 -Hostate oxide/ntp
8432024-02-16T02:52:28.717Z+ [[ online != online ]]
8442024-02-16T02:52:28.717Z+ echo 'Waited for chrony: 12s'
8452024-02-16T02:52:28.717Z+ export RUST_BACKTRACE=1
8462024-02-16T02:52:28.717ZWaited for chrony: 12s
8472024-02-16T02:52:28.717Z+ RUST_BACKTRACE=1
8482024-02-16T02:52:28.717Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8492024-02-16T02:52:28.717Z++ ./tests/bootstrap
8502024-02-16T02:52:28.741ZUsing external DNS server at 10.151.1.164:53
8512024-02-16T02:52:28.764Z2024-02-16 02:52:28.484034772 UTC: attempting to log into API
8522024-02-16T02:52:43.781Z2024-02-16 02:52:43.787518720 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8532024-02-16T02:52:44.783Z2024-02-16 02:52:44.786584020 UTC: attempting to log into API
8542024-02-16T02:52:59.815Z2024-02-16 02:52:59.809208738 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8552024-02-16T02:53:00.817Z2024-02-16 02:53:00.811070889 UTC: attempting to log into API
8562024-02-16T02:53:15.862Z2024-02-16 02:53:15.843465046 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8572024-02-16T02:53:16.851Z2024-02-16 02:53:16.845230356 UTC: attempting to log into API
8582024-02-16T02:53:31.883Z2024-02-16 02:53:31.876980869 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8592024-02-16T02:53:32.884Z2024-02-16 02:53:32.877614461 UTC: attempting to log into API
8602024-02-16T02:53:47.916Z2024-02-16 02:53:47.907958241 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8612024-02-16T02:53:48.920Z2024-02-16 02:53:48.909329369 UTC: attempting to log into API
8622024-02-16T02:54:03.950Z2024-02-16 02:54:03.937054204 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8632024-02-16T02:54:04.951Z2024-02-16 02:54:04.937563177 UTC: attempting to log into API
8642024-02-16T02:54:19.983Z2024-02-16 02:54:19.965159521 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8652024-02-16T02:54:20.984Z2024-02-16 02:54:20.966451977 UTC: attempting to log into API
8662024-02-16T02:54:36.017Z2024-02-16 02:54:35.997274890 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8672024-02-16T02:54:37.036Z2024-02-16 02:54:36.998934028 UTC: attempting to log into API
8682024-02-16T02:54:52.331Z2024-02-16 02:54:52.032796250 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8692024-02-16T02:54:53.118Z2024-02-16 02:54:53.057470668 UTC: attempting to log into API
8702024-02-16T02:55:08.509Z2024-02-16 02:55:08.372008914 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8712024-02-16T02:55:09.394Z2024-02-16 02:55:09.373429358 UTC: attempting to log into API
8722024-02-16T02:55:24.430Z2024-02-16 02:55:24.409066768 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8732024-02-16T02:55:25.431Z2024-02-16 02:55:25.410090625 UTC: attempting to log into API
8742024-02-16T02:55:40.469Z2024-02-16 02:55:40.446780505 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8752024-02-16T02:55:41.470Z2024-02-16 02:55:41.448211520 UTC: attempting to log into API
8762024-02-16T02:55:56.523Z2024-02-16 02:55:56.503175662 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8772024-02-16T02:55:57.524Z2024-02-16 02:55:57.504385019 UTC: attempting to log into API
 
8782024-02-16T02:56:03.328ZFeb 16 02:56:03 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
8792024-02-16T02:56:11.100ZFeb 16 02:56:10 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
8802024-02-16T02:56:12.558Z2024-02-16 02:56:12.538739591 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8812024-02-16T02:56:13.559Z2024-02-16 02:56:13.539678337 UTC: attempting to log into API
 
8822024-02-16T02:56:18.623ZFeb 16 02:56:18 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
8832024-02-16T02:56:25.793ZFeb 16 02:56:25 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
8842024-02-16T02:56:28.591Z2024-02-16 02:56:28.571812135 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8852024-02-16T02:56:29.593Z2024-02-16 02:56:29.572787952 UTC: attempting to log into API
 
8862024-02-16T02:56:32.444ZFeb 16 02:56:32 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
 
8872024-02-16T02:56:44.625Z2024-02-16 02:56:44.605578639 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8882024-02-16T02:56:45.626Z2024-02-16 02:56:45.607415150 UTC: attempting to log into API
8892024-02-16T02:57:00.658Z2024-02-16 02:57:00.639730434 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8902024-02-16T02:57:01.659Z2024-02-16 02:57:01.640441526 UTC: attempting to log into API
8912024-02-16T02:57:02.455Z2024-02-16 02:57:02.436248651 UTC: login succeeded
8922024-02-16T02:57:02.487Zwaiting for nexus to come up...
8932024-02-16T02:57:02.558Zcreating IP pool... 10.151.1.175 - 10.151.1.227
8942024-02-16T02:57:02.728Zsetting up quotas...
8952024-02-16T02:57:02.766Zensuring datasets are ready...
8962024-02-16T02:57:04.956Zlet's roll.
8972024-02-16T02:57:04.981Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
8982024-02-16T02:57:04.981ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
8992024-02-16T02:57:04.981ZOXIDE_TOKEN=oxide-token-d09e93e11648bb6fa496f4e4900cb89231e6c44b'
9002024-02-16T02:57:04.981Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9012024-02-16T02:57:04.981Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
9022024-02-16T02:57:04.981Z++ OXIDE_TOKEN=oxide-token-d09e93e11648bb6fa496f4e4900cb89231e6c44b
9032024-02-16T02:57:04.981Z+ export OXIDE_HOST OXIDE_TOKEN
9042024-02-16T02:57:04.981Z+ retry=0
9052024-02-16T02:57:04.981Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9062024-02-16T02:57:05.008Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9072024-02-16T02:57:05.008Z+ [[ 0 -gt 60 ]]
9082024-02-16T02:57:05.008Z+ sleep 1
9092024-02-16T02:57:05.988Z+ retry=1
9102024-02-16T02:57:05.988Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9112024-02-16T02:57:06.014Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9122024-02-16T02:57:06.014Z+ [[ 1 -gt 60 ]]
9132024-02-16T02:57:06.014Z+ sleep 1
9142024-02-16T02:57:07.003Z+ retry=2
9152024-02-16T02:57:07.003Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9162024-02-16T02:57:07.056Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9172024-02-16T02:57:07.056Z+ [[ 2 -gt 60 ]]
9182024-02-16T02:57:07.056Z+ sleep 1
9192024-02-16T02:57:08.020Z+ retry=3
9202024-02-16T02:57:08.020Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9212024-02-16T02:57:08.044Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9222024-02-16T02:57:08.044Z+ [[ 3 -gt 60 ]]
9232024-02-16T02:57:08.044Z+ sleep 1
9242024-02-16T02:57:09.036Z+ retry=4
9252024-02-16T02:57:09.036Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9262024-02-16T02:57:09.060Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9272024-02-16T02:57:09.060Z+ [[ 4 -gt 60 ]]
9282024-02-16T02:57:09.060Z+ sleep 1
9292024-02-16T02:57:10.052Z+ retry=5
9302024-02-16T02:57:10.052Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9312024-02-16T02:57:10.077Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9322024-02-16T02:57:10.077Z+ [[ 5 -gt 60 ]]
9332024-02-16T02:57:10.077Z+ sleep 1
9342024-02-16T02:57:11.068Z+ retry=6
9352024-02-16T02:57:11.068Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9362024-02-16T02:57:11.093Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9372024-02-16T02:57:11.093Z+ [[ 6 -gt 60 ]]
9382024-02-16T02:57:11.093Z+ sleep 1
9392024-02-16T02:57:12.084Z+ retry=7
9402024-02-16T02:57:12.084Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9412024-02-16T02:57:12.108Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9422024-02-16T02:57:12.108Z+ [[ 7 -gt 60 ]]
9432024-02-16T02:57:12.108Z+ sleep 1
9442024-02-16T02:57:13.100Z+ retry=8
9452024-02-16T02:57:13.100Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9462024-02-16T02:57:13.124Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9472024-02-16T02:57:13.124Z+ [[ 8 -gt 60 ]]
9482024-02-16T02:57:13.124Z+ sleep 1
9492024-02-16T02:57:14.120Z+ retry=9
9502024-02-16T02:57:14.120Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9512024-02-16T02:57:14.144Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9522024-02-16T02:57:14.144Z+ [[ 9 -gt 60 ]]
9532024-02-16T02:57:14.144Z+ sleep 1
9542024-02-16T02:57:15.134Z+ retry=10
9552024-02-16T02:57:15.135Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9562024-02-16T02:57:15.159Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9572024-02-16T02:57:15.159Z+ [[ 10 -gt 60 ]]
9582024-02-16T02:57:15.159Z+ sleep 1
9592024-02-16T02:57:16.150Z+ retry=11
9602024-02-16T02:57:16.150Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9612024-02-16T02:57:16.174Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9622024-02-16T02:57:16.174Z+ [[ 11 -gt 60 ]]
9632024-02-16T02:57:16.174Z+ sleep 1
9642024-02-16T02:57:17.168Z+ retry=12
9652024-02-16T02:57:17.194Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9662024-02-16T02:57:17.194Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9672024-02-16T02:57:17.194Z+ [[ 12 -gt 60 ]]
9682024-02-16T02:57:17.194Z+ sleep 1
9692024-02-16T02:57:18.183Z+ retry=13
9702024-02-16T02:57:18.184Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9712024-02-16T02:57:18.208Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9722024-02-16T02:57:18.208Z+ [[ 13 -gt 60 ]]
9732024-02-16T02:57:18.208Z+ sleep 1
9742024-02-16T02:57:19.200Z+ retry=14
9752024-02-16T02:57:19.200Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9762024-02-16T02:57:19.224Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9772024-02-16T02:57:19.224Z+ [[ 14 -gt 60 ]]
9782024-02-16T02:57:19.224Z+ sleep 1
9792024-02-16T02:57:20.216Z+ retry=15
9802024-02-16T02:57:20.216Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9812024-02-16T02:57:20.240Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9822024-02-16T02:57:20.240Z+ [[ 15 -gt 60 ]]
9832024-02-16T02:57:20.240Z+ sleep 1
9842024-02-16T02:57:21.231Z+ retry=16
9852024-02-16T02:57:21.231Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9862024-02-16T02:57:21.258Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9872024-02-16T02:57:21.258Z+ [[ 16 -gt 60 ]]
9882024-02-16T02:57:21.258Z+ sleep 1
9892024-02-16T02:57:22.247Z+ retry=17
9902024-02-16T02:57:22.248Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9912024-02-16T02:57:22.272Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9922024-02-16T02:57:22.272Z+ [[ 17 -gt 60 ]]
9932024-02-16T02:57:22.272Z+ sleep 1
9942024-02-16T02:57:23.264Z+ retry=18
9952024-02-16T02:57:23.264Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9962024-02-16T02:57:23.288Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
9972024-02-16T02:57:23.288Z+ [[ 18 -gt 60 ]]
9982024-02-16T02:57:23.288Z+ sleep 1
9992024-02-16T02:57:24.280Z+ retry=19
10002024-02-16T02:57:24.280Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10012024-02-16T02:57:24.306Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10022024-02-16T02:57:24.306Z+ [[ 19 -gt 60 ]]
10032024-02-16T02:57:24.306Z+ sleep 1
10042024-02-16T02:57:25.297Z+ retry=20
10052024-02-16T02:57:25.297Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10062024-02-16T02:57:25.321Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10072024-02-16T02:57:25.321Z+ [[ 20 -gt 60 ]]
10082024-02-16T02:57:25.321Z+ sleep 1
10092024-02-16T02:57:26.313Z+ retry=21
10102024-02-16T02:57:26.314Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10112024-02-16T02:57:26.337Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10122024-02-16T02:57:26.337Z+ [[ 21 -gt 60 ]]
10132024-02-16T02:57:26.337Z+ sleep 1
10142024-02-16T02:57:27.327Z+ retry=22
10152024-02-16T02:57:27.327Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10162024-02-16T02:57:27.351Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10172024-02-16T02:57:27.351Z+ [[ 22 -gt 60 ]]
10182024-02-16T02:57:27.351Z+ sleep 1
10192024-02-16T02:57:28.343Z+ retry=23
10202024-02-16T02:57:28.343Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10212024-02-16T02:57:28.367Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10222024-02-16T02:57:28.367Z+ [[ 23 -gt 60 ]]
10232024-02-16T02:57:28.367Z+ sleep 1
10242024-02-16T02:57:29.359Z+ retry=24
10252024-02-16T02:57:29.359Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10262024-02-16T02:57:29.383Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10272024-02-16T02:57:29.383Z+ [[ 24 -gt 60 ]]
10282024-02-16T02:57:29.383Z+ sleep 1
10292024-02-16T02:57:30.374Z+ retry=25
10302024-02-16T02:57:30.374Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10312024-02-16T02:57:30.399Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10322024-02-16T02:57:30.399Z+ [[ 25 -gt 60 ]]
10332024-02-16T02:57:30.399Z+ sleep 1
10342024-02-16T02:57:31.389Z+ retry=26
10352024-02-16T02:57:31.390Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10362024-02-16T02:57:31.414Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10372024-02-16T02:57:31.414Z+ [[ 26 -gt 60 ]]
10382024-02-16T02:57:31.414Z+ sleep 1
10392024-02-16T02:57:32.407Z+ retry=27
10402024-02-16T02:57:32.407Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10412024-02-16T02:57:32.431Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
10422024-02-16T02:57:32.431Z+ [[ 27 -gt 60 ]]
10432024-02-16T02:57:32.431Z+ sleep 1
10442024-02-16T02:57:33.423Z+ retry=28
10452024-02-16T02:57:33.423Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
10462024-02-16T02:57:33.500Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
10472024-02-16T02:57:33.805Z{"status":"ok"}success
10482024-02-16T02:57:33.805ZProject {
10492024-02-16T02:57:33.805Z description: "some images",
10502024-02-16T02:57:33.805Z id: 08707de2-f355-4eb4-bdb4-31b8340dd393,
10512024-02-16T02:57:33.832Z name: Name(
10522024-02-16T02:57:33.832Z "images",
10532024-02-16T02:57:33.832Z ),
10542024-02-16T02:57:33.832Z time_created: 2024-02-16T02:57:33.582118Z,
10552024-02-16T02:57:33.832Z time_modified: 2024-02-16T02:57:33.582118Z,
10562024-02-16T02:57:33.832Z}
10572024-02-16T02:57:33.832Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
10582024-02-16T03:03:08.058Zdone!
10592024-02-16T03:03:08.157Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
10602024-02-16T03:03:08.257Zsuccess
10612024-02-16T03:03:08.257ZImage {
10622024-02-16T03:03:08.257Z block_size: ByteCount(
10632024-02-16T03:03:08.281Z 512,
10642024-02-16T03:03:08.281Z ),
10652024-02-16T03:03:08.282Z description: "debian 11 original base image",
10662024-02-16T03:03:08.282Z digest: None,
10672024-02-16T03:03:08.282Z id: b1f9516f-2291-4eb0-aeec-fbfc376ec493,
10682024-02-16T03:03:08.282Z name: Name(
10692024-02-16T03:03:08.282Z "debian11",
10702024-02-16T03:03:08.282Z ),
10712024-02-16T03:03:08.282Z os: "debian",
10722024-02-16T03:03:08.282Z project_id: None,
10732024-02-16T03:03:08.282Z size: ByteCount(
10742024-02-16T03:03:08.282Z 2147483648,
10752024-02-16T03:03:08.282Z ),
10762024-02-16T03:03:08.282Z time_created: 2024-02-16T03:03:08.021572Z,
10772024-02-16T03:03:08.282Z time_modified: 2024-02-16T03:03:08.237945Z,
10782024-02-16T03:03:08.283Z url: None,
10792024-02-16T03:03:08.283Z version: "11",
10802024-02-16T03:03:08.283Z}
10812024-02-16T03:03:08.283Z+ rm ./tests/bootstrap
10822024-02-16T03:03:08.331Z+ for test_bin in tests/*
10832024-02-16T03:03:08.331Z+ ./tests/bootstrap-5c5e256b526718ba
10842024-02-16T03:03:08.355Z
10852024-02-16T03:03:08.355Zrunning 0 tests
10862024-02-16T03:03:08.355Z
10872024-02-16T03:03:08.355Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
10882024-02-16T03:03:08.356Z
10892024-02-16T03:03:08.356Z+ for test_bin in tests/*
10902024-02-16T03:03:08.356Z+ ./tests/end_to_end_tests-398b34350dfa5341
10912024-02-16T03:03:08.462Z
10922024-02-16T03:03:08.462Zrunning 2 tests
10932024-02-16T03:03:08.684Ztest no_spoof::no_spoof_here ... ok
10942024-02-16T03:03:42.877Ztest instance_launch::instance_launch ... ok
10952024-02-16T03:03:42.877Z
10962024-02-16T03:03:42.877Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 34.41s
10972024-02-16T03:03:42.877Z
10982024-02-16T03:03:42.901Z+ _exit_trap
10992024-02-16T03:03:42.901Z+ local status=0
11002024-02-16T03:03:42.902Z+ [[ 0 -eq 0 ]]
11012024-02-16T03:03:42.902Z+ exit 0
11022024-02-16T03:03:42.902Zprocess exited: duration 795972 ms, exit code 0
 
11032024-02-16T03:03:43.016Zfound 131 output files
11042024-02-16T03:03:43.017Zuploading: /var/svc/log/oxide-sled-agent:default.log (1200562 bytes)
11052024-02-16T03:03:44.330Zuploaded: /var/svc/log/oxide-sled-agent:default.log
11062024-02-16T03:03:44.330Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (935373 bytes)
11072024-02-16T03:03:44.639Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 935373 -> 942807
11082024-02-16T03:03:45.713Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
11092024-02-16T03:03:45.713Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (2020112 bytes)
11102024-02-16T03:03:47.512Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
11112024-02-16T03:03:47.512Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes)
11122024-02-16T03:03:48.595Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
11132024-02-16T03:03:48.595Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (5858 bytes)
11142024-02-16T03:03:49.693Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
11152024-02-16T03:03:49.693Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (8361 bytes)
11162024-02-16T03:03:50.814Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
11172024-02-16T03:03:50.814Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (17127 bytes)
11182024-02-16T03:03:51.955Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
11192024-02-16T03:03:51.955Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (452845 bytes)
11202024-02-16T03:03:52.192Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 452845 -> 460026
11212024-02-16T03:03:53.263Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
11222024-02-16T03:03:53.263Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1038484 bytes)
11232024-02-16T03:03:54.596Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
11242024-02-16T03:03:54.596Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (286592 bytes)
11252024-02-16T03:03:54.804Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 286592 -> 299050
11262024-02-16T03:03:55.876Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
11272024-02-16T03:03:55.876Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (628805 bytes)
11282024-02-16T03:03:57.828Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
11292024-02-16T03:03:57.828Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
11302024-02-16T03:03:58.898Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
11312024-02-16T03:03:58.898Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
11322024-02-16T03:03:59.992Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
11332024-02-16T03:03:59.993Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (106487 bytes)
11342024-02-16T03:04:00.156Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 106487 -> 114563
11352024-02-16T03:04:01.227Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
11362024-02-16T03:04:01.252Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (224942 bytes)
11372024-02-16T03:04:02.480Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
11382024-02-16T03:04:02.481Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes)
11392024-02-16T03:04:03.555Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
11402024-02-16T03:04:03.555Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
11412024-02-16T03:04:04.650Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
11422024-02-16T03:04:04.650Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
11432024-02-16T03:04:05.724Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
11442024-02-16T03:04:05.724Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5392 bytes)
11452024-02-16T03:04:06.819Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
11462024-02-16T03:04:06.819Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-clickhouse:default.log (634753 bytes)
11472024-02-16T03:04:07.119Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 634753 -> 722430
11482024-02-16T03:04:08.190Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-clickhouse:default.log
11492024-02-16T03:04:08.191Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-clickhouse:default.log.0 (599176 bytes)
11502024-02-16T03:04:09.496Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-clickhouse:default.log.0
11512024-02-16T03:04:09.497Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11522024-02-16T03:04:10.567Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-zone-network-setup:default.log
11532024-02-16T03:04:10.567Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
11542024-02-16T03:04:11.662Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_4f544553-38a6-474b-b7b6-1a2638ac980c/root/var/svc/log/oxide-zone-network-setup:default.log.0
11552024-02-16T03:04:11.662Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_0eb7fb33-b379-451e-a5d6-971776ab129e/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11562024-02-16T03:04:12.732Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_0eb7fb33-b379-451e-a5d6-971776ab129e/root/var/svc/log/oxide-cockroachdb:default.log
11572024-02-16T03:04:12.732Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_0eb7fb33-b379-451e-a5d6-971776ab129e/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
11582024-02-16T03:04:13.827Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_0eb7fb33-b379-451e-a5d6-971776ab129e/root/var/svc/log/oxide-cockroachdb:default.log.0
11592024-02-16T03:04:13.827Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_0eb7fb33-b379-451e-a5d6-971776ab129e/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11602024-02-16T03:04:14.898Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_0eb7fb33-b379-451e-a5d6-971776ab129e/root/var/svc/log/oxide-zone-network-setup:default.log
11612024-02-16T03:04:14.898Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_0eb7fb33-b379-451e-a5d6-971776ab129e/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
11622024-02-16T03:04:15.993Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_0eb7fb33-b379-451e-a5d6-971776ab129e/root/var/svc/log/oxide-zone-network-setup:default.log.0
11632024-02-16T03:04:15.993Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-agent:default.log (6360 bytes)
11642024-02-16T03:04:17.088Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-agent:default.log
11652024-02-16T03:04:17.088Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-agent:default.log.0 (14576 bytes)
11662024-02-16T03:04:18.209Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-agent:default.log.0
11672024-02-16T03:04:18.209Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11682024-02-16T03:04:19.280Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:default.log
11692024-02-16T03:04:19.280Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
11702024-02-16T03:04:20.374Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:default.log.0
11712024-02-16T03:04:20.374Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:downstairs-0570870e-0796-43d7-aad5-78e62e34452f.log (0 bytes)
11722024-02-16T03:04:21.448Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:downstairs-0570870e-0796-43d7-aad5-78e62e34452f.log
11732024-02-16T03:04:21.448Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:downstairs-0570870e-0796-43d7-aad5-78e62e34452f.log.0 (3051 bytes)
11742024-02-16T03:04:22.546Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:downstairs-0570870e-0796-43d7-aad5-78e62e34452f.log.0
11752024-02-16T03:04:22.546Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:downstairs-5a50c24b-ea16-4631-aaaa-f19be5fba660.log (2943 bytes)
11762024-02-16T03:04:23.639Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_7189aca2-19cc-4753-a80c-bd2be5c8b655/root/var/svc/log/oxide-crucible-downstairs:downstairs-5a50c24b-ea16-4631-aaaa-f19be5fba660.log
11772024-02-16T03:04:23.640Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_44f27b4e-3b76-4bc4-9a0c-94f0a95f975c/root/var/svc/log/oxide-external_dns:default.log (15109 bytes)
11782024-02-16T03:04:24.759Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_44f27b4e-3b76-4bc4-9a0c-94f0a95f975c/root/var/svc/log/oxide-external_dns:default.log
11792024-02-16T03:04:24.759Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_44f27b4e-3b76-4bc4-9a0c-94f0a95f975c/root/var/svc/log/oxide-external_dns:default.log.0 (15607 bytes)
11802024-02-16T03:04:25.877Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_44f27b4e-3b76-4bc4-9a0c-94f0a95f975c/root/var/svc/log/oxide-external_dns:default.log.0
11812024-02-16T03:04:25.877Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_b12c1708-328a-4da2-bdc9-89cf9577c05b/root/var/svc/log/oxide-internal_dns:default.log (15018 bytes)
11822024-02-16T03:04:26.998Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_b12c1708-328a-4da2-bdc9-89cf9577c05b/root/var/svc/log/oxide-internal_dns:default.log
11832024-02-16T03:04:26.998Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_b12c1708-328a-4da2-bdc9-89cf9577c05b/root/var/svc/log/oxide-internal_dns:default.log.0 (106496 bytes)
11842024-02-16T03:04:28.204Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_b12c1708-328a-4da2-bdc9-89cf9577c05b/root/var/svc/log/oxide-internal_dns:default.log.0
11852024-02-16T03:04:28.204Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_850e9a48-48dc-4eb6-a791-15ef86895b7f/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
11862024-02-16T03:04:29.276Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_850e9a48-48dc-4eb6-a791-15ef86895b7f/root/var/svc/log/oxide-cockroachdb:default.log
11872024-02-16T03:04:29.276Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_850e9a48-48dc-4eb6-a791-15ef86895b7f/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
11882024-02-16T03:04:30.371Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_850e9a48-48dc-4eb6-a791-15ef86895b7f/root/var/svc/log/oxide-cockroachdb:default.log.0
11892024-02-16T03:04:30.371Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_850e9a48-48dc-4eb6-a791-15ef86895b7f/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
11902024-02-16T03:04:31.442Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_850e9a48-48dc-4eb6-a791-15ef86895b7f/root/var/svc/log/oxide-zone-network-setup:default.log
11912024-02-16T03:04:31.443Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_850e9a48-48dc-4eb6-a791-15ef86895b7f/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
11922024-02-16T03:04:32.536Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_850e9a48-48dc-4eb6-a791-15ef86895b7f/root/var/svc/log/oxide-zone-network-setup:default.log.0
11932024-02-16T03:04:32.537Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-agent:default.log (10681 bytes)
11942024-02-16T03:04:33.656Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-agent:default.log
11952024-02-16T03:04:33.656Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
11962024-02-16T03:04:34.750Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-agent:default.log.0
11972024-02-16T03:04:34.750Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
11982024-02-16T03:04:35.821Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-downstairs:default.log
11992024-02-16T03:04:35.821Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12002024-02-16T03:04:36.916Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12012024-02-16T03:04:36.916Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-downstairs:downstairs-f508a707-78c9-40f3-b3fd-ff696b050c26.log (5538 bytes)
12022024-02-16T03:04:38.011Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b787400c-3d63-40a9-9b4a-b585d098c586/root/var/svc/log/oxide-crucible-downstairs:downstairs-f508a707-78c9-40f3-b3fd-ff696b050c26.log
12032024-02-16T03:04:38.011Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e28f1c7a-8b90-4f68-b824-799c167beffd/root/var/svc/log/oxide-external_dns:default.log (15103 bytes)
12042024-02-16T03:04:38.102Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e28f1c7a-8b90-4f68-b824-799c167beffd/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 15103 -> 18880
12052024-02-16T03:04:39.176Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e28f1c7a-8b90-4f68-b824-799c167beffd/root/var/svc/log/oxide-external_dns:default.log
12062024-02-16T03:04:39.176Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e28f1c7a-8b90-4f68-b824-799c167beffd/root/var/svc/log/oxide-external_dns:default.log.0 (15611 bytes)
12072024-02-16T03:04:40.293Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_e28f1c7a-8b90-4f68-b824-799c167beffd/root/var/svc/log/oxide-external_dns:default.log.0
12082024-02-16T03:04:40.293Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6d8d988f-afa1-449a-84ae-7a70c2a15456/root/var/svc/log/oxide-internal_dns:default.log (15019 bytes)
12092024-02-16T03:04:40.385Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6d8d988f-afa1-449a-84ae-7a70c2a15456/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 15019 -> 18775
12102024-02-16T03:04:41.459Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6d8d988f-afa1-449a-84ae-7a70c2a15456/root/var/svc/log/oxide-internal_dns:default.log
12112024-02-16T03:04:41.459Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6d8d988f-afa1-449a-84ae-7a70c2a15456/root/var/svc/log/oxide-internal_dns:default.log.0 (103263 bytes)
12122024-02-16T03:04:42.669Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6d8d988f-afa1-449a-84ae-7a70c2a15456/root/var/svc/log/oxide-internal_dns:default.log.0
12132024-02-16T03:04:42.669Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_437e63b0-5d34-4374-baa9-7f3adc59b38b/root/var/svc/log/oxide-nexus:default.log (582885 bytes)
12142024-02-16T03:04:42.927Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_437e63b0-5d34-4374-baa9-7f3adc59b38b/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 582885 -> 703540
12152024-02-16T03:04:44.000Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_437e63b0-5d34-4374-baa9-7f3adc59b38b/root/var/svc/log/oxide-nexus:default.log
12162024-02-16T03:04:44.000Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_437e63b0-5d34-4374-baa9-7f3adc59b38b/root/var/svc/log/oxide-nexus:default.log.0 (2461651 bytes)
12172024-02-16T03:04:45.823Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_437e63b0-5d34-4374-baa9-7f3adc59b38b/root/var/svc/log/oxide-nexus:default.log.0
12182024-02-16T03:04:45.823Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_decd40e2-201e-4efd-bfc7-6fd7b053f29c/root/var/svc/log/oxide-nexus:default.log (463347 bytes)
12192024-02-16T03:04:46.078Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_decd40e2-201e-4efd-bfc7-6fd7b053f29c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 463347 -> 584332
12202024-02-16T03:04:47.149Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_decd40e2-201e-4efd-bfc7-6fd7b053f29c/root/var/svc/log/oxide-nexus:default.log
12212024-02-16T03:04:47.149Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_decd40e2-201e-4efd-bfc7-6fd7b053f29c/root/var/svc/log/oxide-nexus:default.log.0 (844846 bytes)
12222024-02-16T03:04:48.457Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_decd40e2-201e-4efd-bfc7-6fd7b053f29c/root/var/svc/log/oxide-nexus:default.log.0
12232024-02-16T03:04:48.458Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/svc/log/oxide-ntp:default.log (0 bytes)
12242024-02-16T03:04:49.529Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/svc/log/oxide-ntp:default.log
12252024-02-16T03:04:49.529Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/svc/log/oxide-ntp:default.log.0 (915 bytes)
12262024-02-16T03:04:50.623Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/svc/log/oxide-ntp:default.log.0
12272024-02-16T03:04:50.623Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_45c6fc5c-7301-4dcf-82b8-6d118ae12619/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12282024-02-16T03:04:51.694Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_45c6fc5c-7301-4dcf-82b8-6d118ae12619/root/var/svc/log/oxide-cockroachdb:default.log
12292024-02-16T03:04:51.694Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_45c6fc5c-7301-4dcf-82b8-6d118ae12619/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
12302024-02-16T03:04:52.791Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_45c6fc5c-7301-4dcf-82b8-6d118ae12619/root/var/svc/log/oxide-cockroachdb:default.log.0
12312024-02-16T03:04:52.791Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_45c6fc5c-7301-4dcf-82b8-6d118ae12619/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12322024-02-16T03:04:53.859Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_45c6fc5c-7301-4dcf-82b8-6d118ae12619/root/var/svc/log/oxide-zone-network-setup:default.log
12332024-02-16T03:04:53.859Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_45c6fc5c-7301-4dcf-82b8-6d118ae12619/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
12342024-02-16T03:04:54.955Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_45c6fc5c-7301-4dcf-82b8-6d118ae12619/root/var/svc/log/oxide-zone-network-setup:default.log.0
12352024-02-16T03:04:54.955Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-agent:default.log (18005 bytes)
12362024-02-16T03:04:56.095Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-agent:default.log
12372024-02-16T03:04:56.095Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-agent:default.log.0 (9366 bytes)
12382024-02-16T03:04:57.213Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-agent:default.log.0
12392024-02-16T03:04:57.213Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12402024-02-16T03:04:58.285Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:default.log
12412024-02-16T03:04:58.285Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12422024-02-16T03:04:59.380Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12432024-02-16T03:04:59.380Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-c13a88b5-9eb1-4029-9582-3986824ad027.log (1091 bytes)
12442024-02-16T03:05:00.476Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-c13a88b5-9eb1-4029-9582-3986824ad027.log
12452024-02-16T03:05:00.500Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-c13a88b5-9eb1-4029-9582-3986824ad027.log.0 (4527 bytes)
12462024-02-16T03:05:01.574Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-c13a88b5-9eb1-4029-9582-3986824ad027.log.0
12472024-02-16T03:05:01.574Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-e714813c-0656-466a-90ca-1398998e34af.log (5538 bytes)
12482024-02-16T03:05:02.674Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:downstairs-e714813c-0656-466a-90ca-1398998e34af.log
12492024-02-16T03:05:02.674Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:snapshot-c13a88b5-9eb1-4029-9582-3986824ad027-4d67639d-fe66-4540-b335-76f647063e02.log (5180 bytes)
12502024-02-16T03:05:03.771Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_ef3802f7-87fc-4b1d-b86d-f47aacb298fa/root/var/svc/log/oxide-crucible-downstairs:snapshot-c13a88b5-9eb1-4029-9582-3986824ad027-4d67639d-fe66-4540-b335-76f647063e02.log
12512024-02-16T03:05:03.771Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_b62a47d9-09b2-440b-8db4-c2a516847b31/root/var/svc/log/oxide-crucible-pantry:default.log (664831 bytes)
12522024-02-16T03:05:05.089Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_b62a47d9-09b2-440b-8db4-c2a516847b31/root/var/svc/log/oxide-crucible-pantry:default.log
12532024-02-16T03:05:05.089Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_b62a47d9-09b2-440b-8db4-c2a516847b31/root/var/svc/log/oxide-crucible-pantry:default.log.0 (562434 bytes)
12542024-02-16T03:05:06.395Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_b62a47d9-09b2-440b-8db4-c2a516847b31/root/var/svc/log/oxide-crucible-pantry:default.log.0
12552024-02-16T03:05:06.395Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_40683450-b4f8-40c6-9d06-2f242cdb7171/root/var/svc/log/oxide-internal_dns:default.log (15021 bytes)
12562024-02-16T03:05:06.487Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_40683450-b4f8-40c6-9d06-2f242cdb7171/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 15021 -> 18777
12572024-02-16T03:05:07.563Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_40683450-b4f8-40c6-9d06-2f242cdb7171/root/var/svc/log/oxide-internal_dns:default.log
12582024-02-16T03:05:07.563Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_40683450-b4f8-40c6-9d06-2f242cdb7171/root/var/svc/log/oxide-internal_dns:default.log.0 (102939 bytes)
12592024-02-16T03:05:08.786Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_40683450-b4f8-40c6-9d06-2f242cdb7171/root/var/svc/log/oxide-internal_dns:default.log.0
12602024-02-16T03:05:08.786Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_3b21196a-e6c5-483d-9a30-50714565cfda/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12612024-02-16T03:05:09.849Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_3b21196a-e6c5-483d-9a30-50714565cfda/root/var/svc/log/oxide-cockroachdb:default.log
12622024-02-16T03:05:09.849Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_3b21196a-e6c5-483d-9a30-50714565cfda/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
12632024-02-16T03:05:10.944Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_3b21196a-e6c5-483d-9a30-50714565cfda/root/var/svc/log/oxide-cockroachdb:default.log.0
12642024-02-16T03:05:10.944Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_3b21196a-e6c5-483d-9a30-50714565cfda/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12652024-02-16T03:05:12.015Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_3b21196a-e6c5-483d-9a30-50714565cfda/root/var/svc/log/oxide-zone-network-setup:default.log
12662024-02-16T03:05:12.015Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_3b21196a-e6c5-483d-9a30-50714565cfda/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
12672024-02-16T03:05:13.109Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_3b21196a-e6c5-483d-9a30-50714565cfda/root/var/svc/log/oxide-zone-network-setup:default.log.0
12682024-02-16T03:05:13.109Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_eb6b1ee2-9578-40d0-976e-dd5452676f9a/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12692024-02-16T03:05:14.183Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_eb6b1ee2-9578-40d0-976e-dd5452676f9a/root/var/svc/log/oxide-crucible-agent:default.log
12702024-02-16T03:05:14.183Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_eb6b1ee2-9578-40d0-976e-dd5452676f9a/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
12712024-02-16T03:05:15.284Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_eb6b1ee2-9578-40d0-976e-dd5452676f9a/root/var/svc/log/oxide-crucible-agent:default.log.0
12722024-02-16T03:05:15.284Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_eb6b1ee2-9578-40d0-976e-dd5452676f9a/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12732024-02-16T03:05:16.360Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_eb6b1ee2-9578-40d0-976e-dd5452676f9a/root/var/svc/log/oxide-crucible-downstairs:default.log
12742024-02-16T03:05:16.360Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_eb6b1ee2-9578-40d0-976e-dd5452676f9a/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12752024-02-16T03:05:17.465Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_eb6b1ee2-9578-40d0-976e-dd5452676f9a/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12762024-02-16T03:05:17.465Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_be5f7c97-402f-4705-a06f-6e098e090547/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
12772024-02-16T03:05:18.535Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_be5f7c97-402f-4705-a06f-6e098e090547/root/var/svc/log/oxide-cockroachdb:default.log
12782024-02-16T03:05:18.535Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_be5f7c97-402f-4705-a06f-6e098e090547/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes)
12792024-02-16T03:05:19.630Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_be5f7c97-402f-4705-a06f-6e098e090547/root/var/svc/log/oxide-cockroachdb:default.log.0
12802024-02-16T03:05:19.630Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_be5f7c97-402f-4705-a06f-6e098e090547/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12812024-02-16T03:05:20.704Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_be5f7c97-402f-4705-a06f-6e098e090547/root/var/svc/log/oxide-zone-network-setup:default.log
12822024-02-16T03:05:20.704Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_be5f7c97-402f-4705-a06f-6e098e090547/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
12832024-02-16T03:05:21.802Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_be5f7c97-402f-4705-a06f-6e098e090547/root/var/svc/log/oxide-zone-network-setup:default.log.0
12842024-02-16T03:05:21.802Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_a363fd5a-91c9-4c9b-be72-815499526986/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
12852024-02-16T03:05:22.874Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_a363fd5a-91c9-4c9b-be72-815499526986/root/var/svc/log/oxide-crucible-agent:default.log
12862024-02-16T03:05:22.874Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_a363fd5a-91c9-4c9b-be72-815499526986/root/var/svc/log/oxide-crucible-agent:default.log.0 (3435 bytes)
12872024-02-16T03:05:23.969Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_a363fd5a-91c9-4c9b-be72-815499526986/root/var/svc/log/oxide-crucible-agent:default.log.0
12882024-02-16T03:05:23.969Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_a363fd5a-91c9-4c9b-be72-815499526986/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
12892024-02-16T03:05:25.040Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_a363fd5a-91c9-4c9b-be72-815499526986/root/var/svc/log/oxide-crucible-downstairs:default.log
12902024-02-16T03:05:25.040Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_a363fd5a-91c9-4c9b-be72-815499526986/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
12912024-02-16T03:05:26.136Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_a363fd5a-91c9-4c9b-be72-815499526986/root/var/svc/log/oxide-crucible-downstairs:default.log.0
12922024-02-16T03:05:26.136Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-oximeter:default.log (177225 bytes)
12932024-02-16T03:05:26.340Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 177225 -> 257698
12942024-02-16T03:05:27.410Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-oximeter:default.log
12952024-02-16T03:05:27.410Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-oximeter:default.log.0 (159016 bytes)
12962024-02-16T03:05:28.618Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-oximeter:default.log.0
12972024-02-16T03:05:28.618Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
12982024-02-16T03:05:29.689Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-zone-network-setup:default.log
12992024-02-16T03:05:29.689Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1696 bytes)
13002024-02-16T03:05:30.786Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_oximeter_c698e8ce-2e84-48e7-ae07-086e0f5433d0/root/var/svc/log/oxide-zone-network-setup:default.log.0
13012024-02-16T03:05:30.811Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-agent:default.log (6357 bytes)
13022024-02-16T03:05:31.883Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-agent:default.log
13032024-02-16T03:05:31.883Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes)
13042024-02-16T03:05:32.981Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-agent:default.log.0
13052024-02-16T03:05:32.981Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13062024-02-16T03:05:34.052Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-downstairs:default.log
13072024-02-16T03:05:34.052Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13082024-02-16T03:05:35.146Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13092024-02-16T03:05:35.147Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-downstairs:downstairs-b8e3c3c8-e218-4dfc-b454-d86902877201.log (2945 bytes)
13102024-02-16T03:05:36.241Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_d4003d8d-68fd-403c-85cd-c7f2332df113/root/var/svc/log/oxide-crucible-downstairs:downstairs-b8e3c3c8-e218-4dfc-b454-d86902877201.log
13112024-02-16T03:05:36.241Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-agent:default.log (7752 bytes)
13122024-02-16T03:05:37.357Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-agent:default.log
13132024-02-16T03:05:37.357Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-agent:default.log.0 (20041 bytes)
13142024-02-16T03:05:38.477Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-agent:default.log.0
13152024-02-16T03:05:38.477Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13162024-02-16T03:05:39.548Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:default.log
13172024-02-16T03:05:39.548Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13182024-02-16T03:05:40.643Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13192024-02-16T03:05:40.643Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc306c45-0be6-4908-aacd-d7eff78c6107.log (0 bytes)
13202024-02-16T03:05:41.717Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc306c45-0be6-4908-aacd-d7eff78c6107.log
13212024-02-16T03:05:41.717Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc306c45-0be6-4908-aacd-d7eff78c6107.log.0 (3051 bytes)
13222024-02-16T03:05:42.811Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:downstairs-cc306c45-0be6-4908-aacd-d7eff78c6107.log.0
13232024-02-16T03:05:42.811Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:downstairs-eb1d6de3-1dae-413f-8fcf-0ed37c8ad35a.log (1091 bytes)
13242024-02-16T03:05:43.905Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:downstairs-eb1d6de3-1dae-413f-8fcf-0ed37c8ad35a.log
13252024-02-16T03:05:43.905Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:downstairs-eb1d6de3-1dae-413f-8fcf-0ed37c8ad35a.log.0 (4530 bytes)
13262024-02-16T03:05:45.001Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:downstairs-eb1d6de3-1dae-413f-8fcf-0ed37c8ad35a.log.0
13272024-02-16T03:05:45.001Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:snapshot-eb1d6de3-1dae-413f-8fcf-0ed37c8ad35a-4d67639d-fe66-4540-b335-76f647063e02.log (5176 bytes)
13282024-02-16T03:05:46.095Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_0fbd34ca-aa2d-4e6f-88dd-173aebd50d4a/root/var/svc/log/oxide-crucible-downstairs:snapshot-eb1d6de3-1dae-413f-8fcf-0ed37c8ad35a-4d67639d-fe66-4540-b335-76f647063e02.log
13292024-02-16T03:05:46.096Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_d532b437-fe5c-4263-8c62-4c559b52bbf3/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13302024-02-16T03:05:47.166Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_d532b437-fe5c-4263-8c62-4c559b52bbf3/root/var/svc/log/oxide-crucible-pantry:default.log
13312024-02-16T03:05:47.166Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_d532b437-fe5c-4263-8c62-4c559b52bbf3/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2333 bytes)
13322024-02-16T03:05:48.260Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_d532b437-fe5c-4263-8c62-4c559b52bbf3/root/var/svc/log/oxide-crucible-pantry:default.log.0
13332024-02-16T03:05:48.261Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_ade3e7c3-a409-4e22-8570-c22cbd6f3178/root/var/svc/log/oxide-nexus:default.log (19487928 bytes)
13342024-02-16T03:05:51.581Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_ade3e7c3-a409-4e22-8570-c22cbd6f3178/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 19487928 -> 19725989
13352024-02-16T03:05:52.652Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_ade3e7c3-a409-4e22-8570-c22cbd6f3178/root/var/svc/log/oxide-nexus:default.log
13362024-02-16T03:05:52.652Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_ade3e7c3-a409-4e22-8570-c22cbd6f3178/root/var/svc/log/oxide-nexus:default.log.0 (15133309 bytes)
13372024-02-16T03:05:55.831Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_ade3e7c3-a409-4e22-8570-c22cbd6f3178/root/var/svc/log/oxide-nexus:default.log.0
13382024-02-16T03:05:55.831Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-agent:default.log (10678 bytes)
13392024-02-16T03:05:56.947Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-agent:default.log
13402024-02-16T03:05:56.947Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-agent:default.log.0 (13689 bytes)
13412024-02-16T03:05:58.064Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-agent:default.log.0
13422024-02-16T03:05:58.064Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13432024-02-16T03:05:59.137Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:default.log
13442024-02-16T03:05:59.137Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13452024-02-16T03:06:00.234Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13462024-02-16T03:06:00.234Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:downstairs-078fdebb-3957-4293-a9be-194e78367129.log (0 bytes)
13472024-02-16T03:06:01.308Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:downstairs-078fdebb-3957-4293-a9be-194e78367129.log
13482024-02-16T03:06:01.309Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:downstairs-078fdebb-3957-4293-a9be-194e78367129.log.0 (3051 bytes)
13492024-02-16T03:06:02.410Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:downstairs-078fdebb-3957-4293-a9be-194e78367129.log.0
13502024-02-16T03:06:02.410Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab480b45-379c-4059-a054-504aff712fc3.log (5537 bytes)
13512024-02-16T03:06:03.508Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_64188d91-42e5-42bc-a261-117c1252cecd/root/var/svc/log/oxide-crucible-downstairs:downstairs-ab480b45-379c-4059-a054-504aff712fc3.log
13522024-02-16T03:06:03.508Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_d422f2d4-4616-4408-a85e-1d2807eaffb3/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
13532024-02-16T03:06:04.580Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_d422f2d4-4616-4408-a85e-1d2807eaffb3/root/var/svc/log/oxide-crucible-pantry:default.log
13542024-02-16T03:06:04.581Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_d422f2d4-4616-4408-a85e-1d2807eaffb3/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes)
13552024-02-16T03:06:05.679Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_d422f2d4-4616-4408-a85e-1d2807eaffb3/root/var/svc/log/oxide-crucible-pantry:default.log.0
13562024-02-16T03:06:05.679Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-agent:default.log (13688 bytes)
13572024-02-16T03:06:06.805Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-agent:default.log
13582024-02-16T03:06:06.805Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-agent:default.log.0 (9792 bytes)
13592024-02-16T03:06:07.919Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-agent:default.log.0
13602024-02-16T03:06:07.919Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13612024-02-16T03:06:08.996Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:default.log
13622024-02-16T03:06:08.996Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13632024-02-16T03:06:10.093Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13642024-02-16T03:06:10.093Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:downstairs-03145fae-cfbc-47b9-ba72-d9afc196dd70.log (2945 bytes)
13652024-02-16T03:06:11.190Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:downstairs-03145fae-cfbc-47b9-ba72-d9afc196dd70.log
13662024-02-16T03:06:11.190Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:downstairs-d9fbeea7-93d4-4479-b069-6640a12b2a77.log (1090 bytes)
13672024-02-16T03:06:12.287Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:downstairs-d9fbeea7-93d4-4479-b069-6640a12b2a77.log
13682024-02-16T03:06:12.288Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:downstairs-d9fbeea7-93d4-4479-b069-6640a12b2a77.log.0 (4528 bytes)
13692024-02-16T03:06:13.383Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:downstairs-d9fbeea7-93d4-4479-b069-6640a12b2a77.log.0
13702024-02-16T03:06:13.384Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:snapshot-d9fbeea7-93d4-4479-b069-6640a12b2a77-4d67639d-fe66-4540-b335-76f647063e02.log (5179 bytes)
13712024-02-16T03:06:14.479Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c43e6230-f466-4a16-b065-9791226d99be/root/var/svc/log/oxide-crucible-downstairs:snapshot-d9fbeea7-93d4-4479-b069-6640a12b2a77-4d67639d-fe66-4540-b335-76f647063e02.log
13722024-02-16T03:06:14.479Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/measurements.log (16303 bytes)
13732024-02-16T03:06:14.573Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/measurements.log" changed size mid upload: 16303 -> 19865
13742024-02-16T03:06:15.646Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/measurements.log
13752024-02-16T03:06:15.647Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/statistics.log (10998 bytes)
13762024-02-16T03:06:15.718Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/statistics.log" changed size mid upload: 10998 -> 14157
13772024-02-16T03:06:16.791Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/statistics.log
13782024-02-16T03:06:16.791Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/tracking.log (1984 bytes)
13792024-02-16T03:06:16.837Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/tracking.log" changed size mid upload: 1984 -> 2380
13802024-02-16T03:06:17.911Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_d405cd2d-13ed-4577-a433-dd90bfb9c305/root/var/log/chrony/tracking.log