01HT6NJQJP8VH9TYHYX5JCPKZV: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HT6NQQP8XF86NTEBQMBFM7CA

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-03-30T04:03:05.947Zjob dependencies complete; ready to run (waiting for 46 m 33 s)
22024-03-30T05:30:26.023Zjob assigned to worker 01HT6X811N8TXNTE071GFPT4FD (queued for 1 h 27 m 20 s)
32024-03-30T05:30:26.085Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-03-30T05:30:26.131Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-03-30T05:30:26.166Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-03-30T05:30:26.202Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-03-30T05:30:26.233Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-03-30T05:30:26.267ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-03-30T05:30:26.302Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-03-30T05:30:26.335ZOxide Helios Version helios-2.0.22550 64-bit
112024-03-30T05:30:26.368ZConfiguring devices.
122024-03-30T05:30:26.406Z##################################################
132024-03-30T05:30:26.450Z#### ############# ##
142024-03-30T05:30:26.493Z### ### ############ ##
152024-03-30T05:30:26.528Z## ### # ## ### ## Oxide Computer Company ##
162024-03-30T05:30:26.574Z## ## ## ### # ### ##
172024-03-30T05:30:26.633Z## # ### #### #### This Station Under ##
182024-03-30T05:30:26.676Z### ### #### # ### Computer Control ##
192024-03-30T05:30:26.722Z#### #### ### ## ##
202024-03-30T05:30:26.763Z##################################################
212024-03-30T05:30:26.808ZHostname: buskin
222024-03-30T05:30:26.844ZLoading smf(7) service descriptions:
232024-03-30T05:30:27.997Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-84fc686bbe1391cf.gz
242024-03-30T05:30:30.101Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-84fc686bbe1391cf.gz
252024-03-30T05:30:30.101Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-03-30T05:30:56.285Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-03-30T05:30:56.285Zdownloading input: /input/ci-tools/work/end-to-end-tests/commtest-522cd312e3be3808.gz
282024-03-30T05:30:58.432Zdownloaded input: /input/ci-tools/work/end-to-end-tests/commtest-522cd312e3be3808.gz
292024-03-30T05:30:58.464Zdownloading input: /input/ci-tools/work/end-to-end-tests/dhcp_server-51ad6d99a44fc35f.gz
302024-03-30T05:31:00.505Zdownloaded input: /input/ci-tools/work/end-to-end-tests/dhcp_server-51ad6d99a44fc35f.gz
312024-03-30T05:31:00.530Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7d252aeafffd2c0c.gz
322024-03-30T05:31:23.627Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7d252aeafffd2c0c.gz
332024-03-30T05:31:23.652Zdownloading input: /input/ci-tools/work/caboose-util.gz
342024-03-30T05:31:27.208Zdownloaded input: /input/ci-tools/work/caboose-util.gz
352024-03-30T05:31:27.208Zdownloading input: /input/ci-tools/work/tufaceous.gz
362024-03-30T05:31:31.595Zdownloaded input: /input/ci-tools/work/tufaceous.gz
372024-03-30T05:31:31.595Zdownloading input: /input/ci-tools/work/commtest
382024-03-30T05:33:25.048Zdownloaded input: /input/ci-tools/work/commtest
392024-03-30T05:33:25.072Zdownloading input: /input/package/work/version.txt
402024-03-30T05:33:25.097Zdownloaded input: /input/package/work/version.txt
412024-03-30T05:33:25.097Zdownloading input: /input/package/work/package.tar.gz
422024-03-30T05:33:46.585Zdownloaded input: /input/package/work/package.tar.gz
432024-03-30T05:33:46.613Zdownloading input: /input/package/work/global-zone-packages.tar.gz
442024-03-30T05:34:20.669Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
452024-03-30T05:34:20.669Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
462024-03-30T05:34:36.993Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
472024-03-30T05:34:37.018Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
482024-03-30T05:35:35.387Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
492024-03-30T05:35:35.387Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
502024-03-30T05:36:25.534Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
512024-03-30T05:36:25.534Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
522024-03-30T05:36:49.002Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
532024-03-30T05:36:49.027Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
542024-03-30T05:36:53.760Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
552024-03-30T05:36:53.785Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
562024-03-30T05:37:01.394Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
572024-03-30T05:37:01.429Zdownloading input: /input/package/work/zones/external-dns.tar.gz
582024-03-30T05:37:09.045Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
592024-03-30T05:37:09.075Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
602024-03-30T05:37:17.722Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
612024-03-30T05:37:17.751Zdownloading input: /input/package/work/zones/nexus-single-sled.tar.gz
622024-03-30T05:37:47.711Zdownloaded input: /input/package/work/zones/nexus-single-sled.tar.gz
632024-03-30T05:37:47.711Zdownloading input: /input/package/work/zones/nexus.tar.gz
642024-03-30T05:38:21.376Zdownloaded input: /input/package/work/zones/nexus.tar.gz
652024-03-30T05:38:21.377Zdownloading input: /input/package/work/zones/ntp.tar.gz
662024-03-30T05:38:23.545Zdownloaded input: /input/package/work/zones/ntp.tar.gz
672024-03-30T05:38:23.570Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
682024-03-30T05:38:26.895Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
692024-03-30T05:38:26.920Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
702024-03-30T05:38:30.277Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
712024-03-30T05:38:30.307Zdownloading input: /input/package/work/zones/overlay.tar.gz
722024-03-30T05:38:30.334Zdownloaded input: /input/package/work/zones/overlay.tar.gz
732024-03-30T05:38:30.335Zdownloading input: /input/package/work/zones/oximeter.tar.gz
742024-03-30T05:38:48.830Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
752024-03-30T05:38:48.830Zdownloading input: /input/package/work/zones/probe.tar.gz
762024-03-30T05:38:51.397Zdownloaded input: /input/package/work/zones/probe.tar.gz
772024-03-30T05:38:51.398Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
782024-03-30T05:39:09.818Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
792024-03-30T05:39:09.818Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
802024-03-30T05:40:23.684Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
812024-03-30T05:40:23.710Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
822024-03-30T05:41:06.314Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
832024-03-30T05:41:06.339Zstarting task 0: "setup"
842024-03-30T05:41:06.339Z++ uname -s
852024-03-30T05:41:06.339Z+ kern=SunOS
862024-03-30T05:41:06.339Z+ case "$kern" in
872024-03-30T05:41:06.339Z+ groupadd -g 12345 build
882024-03-30T05:41:06.339Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
892024-03-30T05:41:08.334Z+ zfs create -o mountpoint=/work rpool/work
902024-03-30T05:41:08.363Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
912024-03-30T05:41:08.390Z+ home_fs=zfs
922024-03-30T05:41:08.391Z+ [[ zfs == autofs ]]
932024-03-30T05:41:08.391Z+ mkdir -p /home/build
942024-03-30T05:41:08.391Z+ chown build:build /home/build /work
952024-03-30T05:41:10.366Z+ chmod 0700 /home/build /work
962024-03-30T05:41:10.393Zprocess exited: duration 4054 ms, exit code 0
 
972024-03-30T05:41:10.443Zstarting task 1: "authentication"
982024-03-30T05:41:10.487Zprocess exited: duration 44 ms, exit code 0
 
992024-03-30T05:41:10.540Zstarting task 2: "build"
1002024-03-30T05:41:10.565Z+ trap _exit_trap EXIT
1012024-03-30T05:41:10.565Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1022024-03-30T05:41:10.660Zsecpolicy_fs_linkdir: 0x55 = 0x55
1032024-03-30T05:41:10.660Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1042024-03-30T05:41:10.661Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1052024-03-30T05:41:10.661Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1062024-03-30T05:41:10.661Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1072024-03-30T05:41:10.661Zsecpolicy_fs_linkdir+5: 0 = 0x1
1082024-03-30T05:41:10.661Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1092024-03-30T05:41:10.661Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1102024-03-30T05:41:10.661Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1112024-03-30T05:41:10.661Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1122024-03-30T05:41:10.689Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1132024-03-30T05:41:10.689Z+ [[ -d /opt/oxide ]]
1142024-03-30T05:41:10.689Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1152024-03-30T05:41:10.689Z+ pfexec mkdir /opt/oxide
1162024-03-30T05:41:10.689Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1172024-03-30T05:41:10.689Z+ [[ -d /opt/oxide-underneath ]]
1182024-03-30T05:41:10.689Z+ cd /opt/oxide-underneath
1192024-03-30T05:41:10.689Z+ pfexec tar ceEp@/f - .
1202024-03-30T05:41:10.689Z+ cd /opt/oxide
1212024-03-30T05:41:10.689Z+ pfexec tar xveEp@/f -
1222024-03-30T05:41:10.769Zx ., 0 bytes, 0 tape blocks
1232024-03-30T05:41:10.769Zx ./opte, 0 bytes, 0 tape blocks
1242024-03-30T05:41:10.769Zx ./opte/bin, 0 bytes, 0 tape blocks
1252024-03-30T05:41:10.769Zx ./opte/bin/opteadm, 43221608 bytes, 84418 tape blocks
1262024-03-30T05:41:10.794Z+ pfexec rm -rf /opt/oxide-underneath
1272024-03-30T05:41:10.794Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1282024-03-30T05:41:10.822Z+ pfexec mkdir /opt/oxide/work
1292024-03-30T05:41:10.822Z+ pfexec chown build:build /opt/oxide/work
1302024-03-30T05:41:10.822Z+ cd /opt/oxide/work
1312024-03-30T05:41:10.822Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1322024-03-30T05:41:12.463ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1332024-03-30T05:41:12.463Zx out/mg-ddm-gz.tar, 75678720 bytes, 147810 tape blocks
1342024-03-30T05:41:12.463Zx out/omicron-sled-agent.tar, 115584000 bytes, 225750 tape blocks
1352024-03-30T05:41:12.463Zx out/oxlog.tar, 6244352 bytes, 12196 tape blocks
1362024-03-30T05:41:12.463Zx out/target/test, 75 bytes, 1 tape blocks
1372024-03-30T05:41:12.464Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1382024-03-30T05:41:12.464Zx package-manifest.toml, 26511 bytes, 52 tape blocks
1392024-03-30T05:41:12.464Zx smf/sled-agent/non-gimlet/config.toml, 3156 bytes, 7 tape blocks
1402024-03-30T05:41:12.464Zx target/release/omicron-package, 40182160 bytes, 78481 tape blocks
1412024-03-30T05:41:12.464Zx tools/create_virtual_hardware.sh, 3183 bytes, 7 tape blocks
1422024-03-30T05:41:12.464Zx tools/virtual_hardware.sh, 3172 bytes, 7 tape blocks
1432024-03-30T05:41:12.464Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1442024-03-30T05:41:12.464Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1452024-03-30T05:41:12.464Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1462024-03-30T05:41:12.464Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1472024-03-30T05:41:12.464Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1482024-03-30T05:41:12.494Z
1492024-03-30T05:41:12.494Zreal 1.656494011
1502024-03-30T05:41:12.494Zuser 1.490514461
1512024-03-30T05:41:12.494Zsys 0.296066743
1522024-03-30T05:41:12.495Ztrap 0.000078848
1532024-03-30T05:41:12.495Ztflt 0.000000000
1542024-03-30T05:41:12.495Zdflt 0.000000000
1552024-03-30T05:41:12.495Zkflt 0.000000000
1562024-03-30T05:41:12.495Zlock 0.000000000
1572024-03-30T05:41:12.495Zslp 1.487000776
1582024-03-30T05:41:12.495Zlat 0.037377615
1592024-03-30T05:41:12.495Zstop 0.000122752
1602024-03-30T05:41:12.495Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/nexus-single-sled.tar.gz /input/package/work/zones/nexus.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/probe.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1612024-03-30T05:41:13.750Z+ mv out/nexus-single-sled.tar.gz out/nexus.tar.gz
1622024-03-30T05:41:13.779Z+ mkdir tests
1632024-03-30T05:41:13.780Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1642024-03-30T05:41:13.780Z+ ptime -m gunzip
1652024-03-30T05:41:13.780Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-84fc686bbe1391cf
1662024-03-30T05:41:13.986Z
1672024-03-30T05:41:14.018Zreal 0.212448075
1682024-03-30T05:41:14.018Zuser 0.194448398
1692024-03-30T05:41:14.019Zsys 0.017754781
1702024-03-30T05:41:14.019Ztrap 0.000017020
1712024-03-30T05:41:14.019Ztflt 0.000000000
1722024-03-30T05:41:14.019Zdflt 0.000000000
1732024-03-30T05:41:14.019Zkflt 0.000000000
1742024-03-30T05:41:14.020Zlock 0.000000000
1752024-03-30T05:41:14.020Zslp 0.000018820
1762024-03-30T05:41:14.020Zlat 0.000022770
1772024-03-30T05:41:14.020Zstop 0.000126442
1782024-03-30T05:41:14.020Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-84fc686bbe1391cf
1792024-03-30T05:41:14.020Z+ chmod a+x tests/bootstrap-84fc686bbe1391cf
1802024-03-30T05:41:14.020Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1812024-03-30T05:41:14.021Z+ ptime -m gunzip
1822024-03-30T05:41:14.021Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1832024-03-30T05:41:16.260Z
1842024-03-30T05:41:16.288Zreal 2.271085866
1852024-03-30T05:41:16.288Zuser 2.138580253
1862024-03-30T05:41:16.288Zsys 0.132085814
1872024-03-30T05:41:16.288Ztrap 0.000179064
1882024-03-30T05:41:16.288Ztflt 0.000000000
1892024-03-30T05:41:16.288Zdflt 0.000000000
1902024-03-30T05:41:16.288Zkflt 0.000000000
1912024-03-30T05:41:16.288Zlock 0.000000000
1922024-03-30T05:41:16.288Zslp 0.000019510
1932024-03-30T05:41:16.288Zlat 0.000023670
1942024-03-30T05:41:16.288Zstop 0.000130732
1952024-03-30T05:41:16.288Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1962024-03-30T05:41:16.288Z+ chmod a+x tests/bootstrap
1972024-03-30T05:41:16.288Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1982024-03-30T05:41:16.288Z+ ptime -m gunzip
1992024-03-30T05:41:16.288Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-522cd312e3be3808
2002024-03-30T05:41:16.479Z
2012024-03-30T05:41:16.512Zreal 0.205410768
2022024-03-30T05:41:16.513Zuser 0.190141351
2032024-03-30T05:41:16.513Zsys 0.015012701
2042024-03-30T05:41:16.513Ztrap 0.000019710
2052024-03-30T05:41:16.513Ztflt 0.000000000
2062024-03-30T05:41:16.513Zdflt 0.000000000
2072024-03-30T05:41:16.513Zkflt 0.000000000
2082024-03-30T05:41:16.513Zlock 0.000000000
2092024-03-30T05:41:16.513Zslp 0.000020110
2102024-03-30T05:41:16.513Zlat 0.000032050
2112024-03-30T05:41:16.513Zstop 0.000127762
2122024-03-30T05:41:16.513Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-522cd312e3be3808
2132024-03-30T05:41:16.513Z+ chmod a+x tests/commtest-522cd312e3be3808
2142024-03-30T05:41:16.514Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2152024-03-30T05:41:16.514Z+ ptime -m gunzip
2162024-03-30T05:41:16.514Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-51ad6d99a44fc35f
2172024-03-30T05:41:17.011Z
2182024-03-30T05:41:17.011Zreal 0.208670047
2192024-03-30T05:41:17.011Zuser 0.194052186
2202024-03-30T05:41:17.011Zsys 0.014377805
2212024-03-30T05:41:17.011Ztrap 0.000016029
2222024-03-30T05:41:17.011Ztflt 0.000000000
2232024-03-30T05:41:17.012Zdflt 0.000000000
2242024-03-30T05:41:17.012Zkflt 0.000000000
2252024-03-30T05:41:17.012Zlock 0.000000000
2262024-03-30T05:41:17.012Zslp 0.000019830
2272024-03-30T05:41:17.012Zlat 0.000021600
2282024-03-30T05:41:17.012Zstop 0.000121562
2292024-03-30T05:41:17.012Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-51ad6d99a44fc35f
2302024-03-30T05:41:17.012Z+ chmod a+x tests/dhcp_server-51ad6d99a44fc35f
2312024-03-30T05:41:17.012Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2322024-03-30T05:41:17.012Z+ ptime -m gunzip
2332024-03-30T05:41:17.012Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7d252aeafffd2c0c
2342024-03-30T05:41:19.011Z
2352024-03-30T05:41:19.036Zreal 2.302292871
2362024-03-30T05:41:19.036Zuser 2.167298260
2372024-03-30T05:41:19.036Zsys 0.134616715
2382024-03-30T05:41:19.036Ztrap 0.000145481
2392024-03-30T05:41:19.036Ztflt 0.000000000
2402024-03-30T05:41:19.036Zdflt 0.000000000
2412024-03-30T05:41:19.036Zkflt 0.000000000
2422024-03-30T05:41:19.036Zlock 0.000000000
2432024-03-30T05:41:19.036Zslp 0.000022140
2442024-03-30T05:41:19.036Zlat 0.000026030
2452024-03-30T05:41:19.036Zstop 0.000120591
2462024-03-30T05:41:19.036Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7d252aeafffd2c0c
2472024-03-30T05:41:19.036Z+ chmod a+x tests/end_to_end_tests-7d252aeafffd2c0c
2482024-03-30T05:41:19.036Z+ bmat address ls
2492024-03-30T05:41:19.036ZNAME CIDR FIRST LAST COUNT
2502024-03-30T05:41:19.036Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2512024-03-30T05:41:19.036Z++ bmat address ls -f extra -Ho first,last,count
2522024-03-30T05:41:19.068Z+ set -- 10.151.1.164 10.151.1.227 64
2532024-03-30T05:41:19.069Z+ EXTRA_IP_START=10.151.1.164
2542024-03-30T05:41:19.069Z+ EXTRA_IP_END=10.151.1.227
2552024-03-30T05:41:19.069Z+ EXTRA_IP_COUNT=64
2562024-03-30T05:41:19.069Z+ (( EXTRA_IP_COUNT >= 32 ))
2572024-03-30T05:41:19.069Z+ EXTRA_IP_BASE=10.151.1
2582024-03-30T05:41:19.069Z+ EXTRA_IP_FOCTET=164
2592024-03-30T05:41:19.069Z+ EXTRA_IP_LOCTET=227
2602024-03-30T05:41:19.070Z+ SERVICE_IP_POOL_START=10.151.1.164
2612024-03-30T05:41:19.070Z+ SERVICE_IP_POOL_END=10.151.1.173
2622024-03-30T05:41:19.070Z+ DNS_IP1=10.151.1.164
2632024-03-30T05:41:19.070Z+ DNS_IP2=10.151.1.165
2642024-03-30T05:41:19.070Z+ UPLINK_IP=10.151.1.174
2652024-03-30T05:41:19.070Z+ IPPOOL_START=10.151.1.175
2662024-03-30T05:41:19.070Z+ IPPOOL_END=10.151.1.227
2672024-03-30T05:41:19.070Z++ ipadm show-addr -po type,addr
2682024-03-30T05:41:19.070Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2692024-03-30T05:41:19.071Z+ GATEWAY_IP=10.151.1.100
2702024-03-30T05:41:19.071Z+ [[ -n 10.151.1.100 ]]
2712024-03-30T05:41:19.071Z+ ping -s 10.151.1.100 56 1
2722024-03-30T05:41:19.071ZPING 10.151.1.100: 56 data bytes
2732024-03-30T05:41:19.071Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2742024-03-30T05:41:19.071Z
2752024-03-30T05:41:19.071Z----10.151.1.100 PING Statistics----
2762024-03-30T05:41:19.072Z1 packets transmitted, 1 packets received, 0% packet loss
2772024-03-30T05:41:19.072Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2782024-03-30T05:41:19.072Z++ arp -an
2792024-03-30T05:41:19.072Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2802024-03-30T05:41:19.116Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2812024-03-30T05:41:19.116Z+ routeadm -e ipv4-forwarding -u
2822024-03-30T05:41:19.178Z+ PXA_START=10.151.1.164
2832024-03-30T05:41:19.178Z+ PXA_END=10.151.1.227
2842024-03-30T05:41:19.203Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2852024-03-30T05:41:19.203Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2862024-03-30T05:41:19.305Z+ VDEV_DIR=/scratch
2872024-03-30T05:41:19.305Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2882024-03-30T05:41:19.331Z+++ dirname ./tools/create_virtual_hardware.sh
2892024-03-30T05:41:19.331Z++ cd ./tools
2902024-03-30T05:41:19.331Z++ pwd
2912024-03-30T05:41:19.331Z+ SOURCE_DIR=/opt/oxide/work/tools
2922024-03-30T05:41:19.331Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2932024-03-30T05:41:19.331Z+ SOFTNPU_MODE=zone
2942024-03-30T05:41:19.331Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2952024-03-30T05:41:19.331Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2962024-03-30T05:41:19.331Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2972024-03-30T05:41:19.331Z++ dladm show-phys -p -o LINK
2982024-03-30T05:41:19.332Z++ head -1
2992024-03-30T05:41:19.389Z+ PHYSICAL_LINK=igb0
3002024-03-30T05:41:19.414Z+ echo 'Using igb0 as physical link'
3012024-03-30T05:41:19.414ZUsing igb0 as physical link
3022024-03-30T05:41:19.414Z+ ensure_run_as_root
3032024-03-30T05:41:19.414Z++ id -u
3042024-03-30T05:41:19.414Z+ [[ 0 -ne 0 ]]
3052024-03-30T05:41:19.414Z+ ensure_vdevs
3062024-03-30T05:41:19.414Z+ VDEV_TYPES=('m2_' 'u2_')
3072024-03-30T05:41:19.414Z+ for VDEV_TYPE in "${VDEV_TYPES[@]}"
3082024-03-30T05:41:19.414Z+ readarray -t VDEVS
3092024-03-30T05:41:19.414Z++ grep '"m2_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3102024-03-30T05:41:19.414Z++ sed 's/[ ",]//g'
3112024-03-30T05:41:19.414Z+ for VDEV in "${VDEVS[@]}"
3122024-03-30T05:41:19.415Z+ echo 'Device: [m2_0.vdev]'
3132024-03-30T05:41:19.415ZDevice: [m2_0.vdev]
3142024-03-30T05:41:19.415Z+ VDEV_PATH=/scratch/m2_0.vdev
3152024-03-30T05:41:19.415Z+ [[ -f /scratch/m2_0.vdev ]]
3162024-03-30T05:41:19.415Z+ dd if=/dev/zero of=/scratch/m2_0.vdev bs=1 count=0 seek=20G
3172024-03-30T05:41:19.441Z0+0 records in
3182024-03-30T05:41:19.441Z0+0 records out
3192024-03-30T05:41:19.441Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3202024-03-30T05:41:19.442Z+ success 'vdev /scratch/m2_0.vdev exists'
3212024-03-30T05:41:19.442Z+ set +x
3222024-03-30T05:41:19.442Zvdev /scratch/m2_0.vdev exists
3232024-03-30T05:41:19.442Z+ for VDEV in "${VDEVS[@]}"
3242024-03-30T05:41:19.442Z+ echo 'Device: [m2_1.vdev]'
3252024-03-30T05:41:19.442ZDevice: [m2_1.vdev]
3262024-03-30T05:41:19.442Z+ VDEV_PATH=/scratch/m2_1.vdev
3272024-03-30T05:41:19.442Z+ [[ -f /scratch/m2_1.vdev ]]
3282024-03-30T05:41:19.442Z+ dd if=/dev/zero of=/scratch/m2_1.vdev bs=1 count=0 seek=20G
3292024-03-30T05:41:19.442Z0+0 records in
3302024-03-30T05:41:19.442Z0+0 records out
3312024-03-30T05:41:19.442Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3322024-03-30T05:41:19.442Z+ success 'vdev /scratch/m2_1.vdev exists'
3332024-03-30T05:41:19.442Z+ set +x
3342024-03-30T05:41:19.442Zvdev /scratch/m2_1.vdev exists
3352024-03-30T05:41:19.442Z+ for VDEV_TYPE in "${VDEV_TYPES[@]}"
3362024-03-30T05:41:19.442Z+ readarray -t VDEVS
3372024-03-30T05:41:19.442Z++ grep '"u2_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3382024-03-30T05:41:19.442Z++ sed 's/[ ",]//g'
3392024-03-30T05:41:19.442Z+ for VDEV in "${VDEVS[@]}"
3402024-03-30T05:41:19.443Z+ echo 'Device: [u2_0.vdev]'
3412024-03-30T05:41:19.443ZDevice: [u2_0.vdev]
3422024-03-30T05:41:19.443Z+ VDEV_PATH=/scratch/u2_0.vdev
3432024-03-30T05:41:19.443Z+ [[ -f /scratch/u2_0.vdev ]]
3442024-03-30T05:41:19.443Z+ dd if=/dev/zero of=/scratch/u2_0.vdev bs=1 count=0 seek=20G
3452024-03-30T05:41:19.443Z0+0 records in
3462024-03-30T05:41:19.443Z0+0 records out
3472024-03-30T05:41:19.443Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3482024-03-30T05:41:19.443Z+ success 'vdev /scratch/u2_0.vdev exists'
3492024-03-30T05:41:19.443Z+ set +x
3502024-03-30T05:41:19.443Zvdev /scratch/u2_0.vdev exists
3512024-03-30T05:41:19.443Z+ for VDEV in "${VDEVS[@]}"
3522024-03-30T05:41:19.443Z+ echo 'Device: [u2_1.vdev]'
3532024-03-30T05:41:19.443ZDevice: [u2_1.vdev]
3542024-03-30T05:41:19.443Z+ VDEV_PATH=/scratch/u2_1.vdev
3552024-03-30T05:41:19.443Z+ [[ -f /scratch/u2_1.vdev ]]
3562024-03-30T05:41:19.443Z+ dd if=/dev/zero of=/scratch/u2_1.vdev bs=1 count=0 seek=20G
3572024-03-30T05:41:19.469Z0+0 records in
3582024-03-30T05:41:19.469Z0+0 records out
3592024-03-30T05:41:19.470Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3602024-03-30T05:41:19.470Z+ success 'vdev /scratch/u2_1.vdev exists'
3612024-03-30T05:41:19.470Z+ set +x
3622024-03-30T05:41:19.470Zvdev /scratch/u2_1.vdev exists
3632024-03-30T05:41:19.470Z+ for VDEV in "${VDEVS[@]}"
3642024-03-30T05:41:19.470ZDevice: [u2_2.vdev]
3652024-03-30T05:41:19.470Z+ echo 'Device: [u2_2.vdev]'
3662024-03-30T05:41:19.470Z+ VDEV_PATH=/scratch/u2_2.vdev
3672024-03-30T05:41:19.470Z+ [[ -f /scratch/u2_2.vdev ]]
3682024-03-30T05:41:19.470Z+ dd if=/dev/zero of=/scratch/u2_2.vdev bs=1 count=0 seek=20G
3692024-03-30T05:41:19.470Z0+0 records in
3702024-03-30T05:41:19.470Z0+0 records out
3712024-03-30T05:41:19.470Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3722024-03-30T05:41:19.470Z+ success 'vdev /scratch/u2_2.vdev exists'
3732024-03-30T05:41:19.470Z+ set +x
3742024-03-30T05:41:19.470Zvdev /scratch/u2_2.vdev exists
3752024-03-30T05:41:19.470Z+ for VDEV in "${VDEVS[@]}"
3762024-03-30T05:41:19.470Z+ echo 'Device: [u2_3.vdev]'
3772024-03-30T05:41:19.470ZDevice: [u2_3.vdev]
3782024-03-30T05:41:19.470Z+ VDEV_PATH=/scratch/u2_3.vdev
3792024-03-30T05:41:19.470Z+ [[ -f /scratch/u2_3.vdev ]]
3802024-03-30T05:41:19.471Z+ dd if=/dev/zero of=/scratch/u2_3.vdev bs=1 count=0 seek=20G
3812024-03-30T05:41:19.471Z0+0 records in
3822024-03-30T05:41:19.471Z0+0 records out
3832024-03-30T05:41:19.471Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3842024-03-30T05:41:19.471Z+ success 'vdev /scratch/u2_3.vdev exists'
3852024-03-30T05:41:19.471Z+ set +x
3862024-03-30T05:41:19.471Zvdev /scratch/u2_3.vdev exists
3872024-03-30T05:41:19.471Z+ for VDEV in "${VDEVS[@]}"
3882024-03-30T05:41:19.471ZDevice: [u2_4.vdev]
3892024-03-30T05:41:19.471Z+ echo 'Device: [u2_4.vdev]'
3902024-03-30T05:41:19.471Z+ VDEV_PATH=/scratch/u2_4.vdev
3912024-03-30T05:41:19.471Z+ [[ -f /scratch/u2_4.vdev ]]
3922024-03-30T05:41:19.471Z+ dd if=/dev/zero of=/scratch/u2_4.vdev bs=1 count=0 seek=20G
3932024-03-30T05:41:19.471Z0+0 records in
3942024-03-30T05:41:19.471Z0+0 records out
3952024-03-30T05:41:19.471Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3962024-03-30T05:41:19.471Z+ success 'vdev /scratch/u2_4.vdev exists'
3972024-03-30T05:41:19.471Z+ set +x
3982024-03-30T05:41:19.471Zvdev /scratch/u2_4.vdev exists
3992024-03-30T05:41:19.472Z+ for VDEV in "${VDEVS[@]}"
4002024-03-30T05:41:19.472ZDevice: [u2_5.vdev]
4012024-03-30T05:41:19.472Z+ echo 'Device: [u2_5.vdev]'
4022024-03-30T05:41:19.472Z+ VDEV_PATH=/scratch/u2_5.vdev
4032024-03-30T05:41:19.472Z+ [[ -f /scratch/u2_5.vdev ]]
4042024-03-30T05:41:19.472Z+ dd if=/dev/zero of=/scratch/u2_5.vdev bs=1 count=0 seek=20G
4052024-03-30T05:41:19.472Z0+0 records in
4062024-03-30T05:41:19.472Z0+0 records out
4072024-03-30T05:41:19.472Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4082024-03-30T05:41:19.472Z+ success 'vdev /scratch/u2_5.vdev exists'
4092024-03-30T05:41:19.472Z+ set +x
4102024-03-30T05:41:19.472Zvdev /scratch/u2_5.vdev exists
4112024-03-30T05:41:19.472Z+ for VDEV in "${VDEVS[@]}"
4122024-03-30T05:41:19.472Z+ echo 'Device: [u2_6.vdev]'
4132024-03-30T05:41:19.472ZDevice: [u2_6.vdev]
4142024-03-30T05:41:19.472Z+ VDEV_PATH=/scratch/u2_6.vdev
4152024-03-30T05:41:19.472Z+ [[ -f /scratch/u2_6.vdev ]]
4162024-03-30T05:41:19.472Z+ dd if=/dev/zero of=/scratch/u2_6.vdev bs=1 count=0 seek=20G
4172024-03-30T05:41:19.472Z0+0 records in
4182024-03-30T05:41:19.472Z0+0 records out
4192024-03-30T05:41:19.472Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4202024-03-30T05:41:19.473Z+ success 'vdev /scratch/u2_6.vdev exists'
4212024-03-30T05:41:19.473Z+ set +x
4222024-03-30T05:41:19.473Zvdev /scratch/u2_6.vdev exists
4232024-03-30T05:41:19.473Z+ for VDEV in "${VDEVS[@]}"
4242024-03-30T05:41:19.473Z+ echo 'Device: [u2_7.vdev]'
4252024-03-30T05:41:19.473ZDevice: [u2_7.vdev]
4262024-03-30T05:41:19.473Z+ VDEV_PATH=/scratch/u2_7.vdev
4272024-03-30T05:41:19.473Z+ [[ -f /scratch/u2_7.vdev ]]
4282024-03-30T05:41:19.473Z+ dd if=/dev/zero of=/scratch/u2_7.vdev bs=1 count=0 seek=20G
4292024-03-30T05:41:19.473Z0+0 records in
4302024-03-30T05:41:19.473Z0+0 records out
4312024-03-30T05:41:19.473Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4322024-03-30T05:41:19.473Z+ success 'vdev /scratch/u2_7.vdev exists'
4332024-03-30T05:41:19.473Z+ set +x
4342024-03-30T05:41:19.473Zvdev /scratch/u2_7.vdev exists
4352024-03-30T05:41:19.473ZDevice: [u2_8.vdev]
4362024-03-30T05:41:19.473Z+ for VDEV in "${VDEVS[@]}"
4372024-03-30T05:41:19.473Z+ echo 'Device: [u2_8.vdev]'
4382024-03-30T05:41:19.473Z+ VDEV_PATH=/scratch/u2_8.vdev
4392024-03-30T05:41:19.473Z+ [[ -f /scratch/u2_8.vdev ]]
4402024-03-30T05:41:19.474Z+ dd if=/dev/zero of=/scratch/u2_8.vdev bs=1 count=0 seek=20G
4412024-03-30T05:41:19.474Z0+0 records in
4422024-03-30T05:41:19.474Z0+0 records out
4432024-03-30T05:41:19.474Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4442024-03-30T05:41:19.474Z+ success 'vdev /scratch/u2_8.vdev exists'
4452024-03-30T05:41:19.474Z+ set +x
4462024-03-30T05:41:19.474Zvdev /scratch/u2_8.vdev exists
4472024-03-30T05:41:19.474Z+ [[ zone == \z\o\n\e ]]
4482024-03-30T05:41:19.474Z+ ensure_simulated_links igb0
4492024-03-30T05:41:19.474Z+ local PHYSICAL_LINK=igb0
4502024-03-30T05:41:19.474Z+ INDICES=("0" "1")
4512024-03-30T05:41:19.474Z+ for I in "${INDICES[@]}"
4522024-03-30T05:41:19.474Z++ get_simnet_name_if_exists net0
4532024-03-30T05:41:19.474Z++ dladm show-simnet -p -o LINK net0
4542024-03-30T05:41:19.474Z++ echo ''
4552024-03-30T05:41:19.474Z+ [[ -z '' ]]
4562024-03-30T05:41:19.475Z+ dladm create-simnet -t net0
4572024-03-30T05:41:19.513Z+ dladm create-simnet -t sc0_0
4582024-03-30T05:41:19.513Z+ dladm modify-simnet -t -p net0 sc0_0
4592024-03-30T05:41:19.513Z+ dladm set-linkprop -p mtu=9000 sc0_0
4602024-03-30T05:41:19.513Z+ success 'Simnet net0/sc0_0 exists'
4612024-03-30T05:41:19.513Z+ set +x
4622024-03-30T05:41:19.513ZSimnet net0/sc0_0 exists
4632024-03-30T05:41:19.513Z+ for I in "${INDICES[@]}"
4642024-03-30T05:41:19.513Z++ get_simnet_name_if_exists net1
4652024-03-30T05:41:19.513Z++ dladm show-simnet -p -o LINK net1
4662024-03-30T05:41:19.513Z++ echo ''
4672024-03-30T05:41:19.513Z+ [[ -z '' ]]
4682024-03-30T05:41:19.513Z+ dladm create-simnet -t net1
4692024-03-30T05:41:19.513Z+ dladm create-simnet -t sc1_0
4702024-03-30T05:41:19.513Z+ dladm modify-simnet -t -p net1 sc1_0
4712024-03-30T05:41:19.513Z+ dladm set-linkprop -p mtu=9000 sc1_0
4722024-03-30T05:41:19.540Z+ success 'Simnet net1/sc1_0 exists'
4732024-03-30T05:41:19.540Z+ set +x
4742024-03-30T05:41:19.540ZSimnet net1/sc1_0 exists
4752024-03-30T05:41:19.540Z++ get_vnic_name_if_exists sc0_1
4762024-03-30T05:41:19.540Z++ dladm show-vnic -p -o LINK sc0_1
4772024-03-30T05:41:19.540Z++ echo ''
4782024-03-30T05:41:19.540Z+ [[ -z '' ]]
4792024-03-30T05:41:19.540Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
4802024-03-30T05:41:19.540Z+ [[ -v PROMISC_FILT_OFF ]]
4812024-03-30T05:41:19.540Z+ success 'Vnic sc0_1 exists'
4822024-03-30T05:41:19.540Z+ set +x
4832024-03-30T05:41:19.540ZVnic sc0_1 exists
4842024-03-30T05:41:19.541Z+ warn_if_no_proxy_arp
4852024-03-30T05:41:19.541Z+ [[ -v PXA_START ]]
4862024-03-30T05:41:19.541Z+ [[ -v PXA_END ]]
4872024-03-30T05:41:19.541Z+ ensure_softnpu_zone
4882024-03-30T05:41:19.541Z+ zoneadm list
4892024-03-30T05:41:19.541Z+ grep -q sidecar_softnpu
4902024-03-30T05:41:19.541Z+ [[ -f out/npuzone/npuzone ]]
4912024-03-30T05:41:19.541Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
4922024-03-30T05:41:19.541Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
4932024-03-30T05:41:29.911Zdownloading softnpu ...done
4942024-03-30T05:41:29.940Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
4952024-03-30T05:41:40.523Zdownloading asic_program.so ...done
4962024-03-30T05:41:40.552Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
4972024-03-30T05:41:48.980Zdownloading scadm ...done
4982024-03-30T05:41:48.980Zcreating port tfportrear0_0 for sc0_0
4992024-03-30T05:41:48.981Zcreating port tfportqsfp0_0 for sc0_1
5002024-03-30T05:41:48.981Zsoftnpu zone setup
5012024-03-30T05:41:48.981Zconfigure zone
5022024-03-30T05:41:48.982Zinstall zone
5032024-03-30T05:41:49.337Zboot zone
5042024-03-30T05:41:52.449Z[sidecar_softnpu] svcs milestone/network
5052024-03-30T05:41:52.475ZSTATE STIME FMRI
5062024-03-30T05:41:52.476Zonline 5:41:50 svc:/milestone/network:default
5072024-03-30T05:41:52.476Z[sidecar_softnpu] /softnpu/npu start
5082024-03-30T05:41:52.502Z
5092024-03-30T05:41:52.502Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5102024-03-30T05:41:52.502Z+ GATEWAY_IP=10.151.1.100
5112024-03-30T05:41:52.503Z+ echo 'Using 10.151.1.100 as gateway ip'
5122024-03-30T05:41:52.503ZUsing 10.151.1.100 as gateway ip
5132024-03-30T05:41:52.503Z+ [[ ! -v GATEWAY_MAC ]]
5142024-03-30T05:41:52.503Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5152024-03-30T05:41:52.503Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5162024-03-30T05:41:52.503Z+++ echo 18:c0:4d:0d:9f:b2
5172024-03-30T05:41:52.503Z+ COUNT=1
5182024-03-30T05:41:52.503Z+ [[ 1 -ne 1 ]]
5192024-03-30T05:41:52.504Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5202024-03-30T05:41:52.504ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5212024-03-30T05:41:52.504Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5222024-03-30T05:41:52.504Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5232024-03-30T05:41:52.531Z+ PXA_MAC=a8:e1:de:01:70:1d
5242024-03-30T05:41:52.558Z+ [[ -v PXA_START ]]
5252024-03-30T05:41:52.559Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5262024-03-30T05:41:52.559Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5272024-03-30T05:41:52.585Z+ z_scadm dump-state
5282024-03-30T05:41:52.585Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5292024-03-30T05:41:52.585Zlocal v6:
5302024-03-30T05:41:52.585Zlocal v4:
5312024-03-30T05:41:52.585Zrouter v6:
5322024-03-30T05:41:52.585Zrouter v4_idx:
5332024-03-30T05:41:52.586Zrouter v4_routes:
5342024-03-30T05:41:52.586Zresolver v4:
5352024-03-30T05:41:52.586Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5362024-03-30T05:41:52.586Zresolver v6:
5372024-03-30T05:41:52.586Znat v4:
5382024-03-30T05:41:52.586Znat_v6:
5392024-03-30T05:41:52.586Zport_mac:
5402024-03-30T05:41:52.586Zproxy arp:
5412024-03-30T05:41:52.586Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5422024-03-30T05:41:52.613Z+ success 'softnpu zone exists'
5432024-03-30T05:41:52.613Z+ set +x
5442024-03-30T05:41:52.614Zsoftnpu zone exists
5452024-03-30T05:41:52.614Z
5462024-03-30T05:41:52.614Zreal 33.277486224
5472024-03-30T05:41:52.614Zuser 0.630118848
5482024-03-30T05:41:52.615Zsys 1.377839528
5492024-03-30T05:41:52.615Ztrap 0.000088475
5502024-03-30T05:41:52.615Ztflt 0.000185576
5512024-03-30T05:41:52.615Zdflt 0.001534014
5522024-03-30T05:41:52.616Zkflt 0.000003569
5532024-03-30T05:41:52.616Zlock 26:20.073568068
5542024-03-30T05:41:52.616Zslp 1:40.356554791
5552024-03-30T05:41:52.616Zlat 0.081063108
5562024-03-30T05:41:52.617Zstop 0.321769846
5572024-03-30T05:41:52.617Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
5582024-03-30T05:41:52.651Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
5592024-03-30T05:41:52.651Z+ diff -u pkg/config.toml~ pkg/config.toml
5602024-03-30T05:41:52.652Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
5612024-03-30T05:41:52.652Z+++ pkg/config.toml Sat Mar 30 05:41:52 2024
5622024-03-30T05:41:52.652Z@@ -29,18 +29,18 @@
5632024-03-30T05:41:52.652Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
5642024-03-30T05:41:52.652Z # followed by a string that is embedded into their fake serial values.
5652024-03-30T05:41:52.653Z vdevs = [
5662024-03-30T05:41:52.653Z- "m2_0.vdev",
5672024-03-30T05:41:52.653Z- "m2_1.vdev",
5682024-03-30T05:41:52.653Z+ "/scratch/m2_0.vdev",
5692024-03-30T05:41:52.654Z+ "/scratch/m2_1.vdev",
5702024-03-30T05:41:52.654Z
5712024-03-30T05:41:52.654Z- "u2_0.vdev",
5722024-03-30T05:41:52.654Z- "u2_1.vdev",
5732024-03-30T05:41:52.655Z- "u2_2.vdev",
5742024-03-30T05:41:52.655Z- "u2_3.vdev",
5752024-03-30T05:41:52.655Z- "u2_4.vdev",
5762024-03-30T05:41:52.655Z- "u2_5.vdev",
5772024-03-30T05:41:52.655Z- "u2_6.vdev",
5782024-03-30T05:41:52.656Z- "u2_7.vdev",
5792024-03-30T05:41:52.656Z- "u2_8.vdev",
5802024-03-30T05:41:52.656Z+ "/scratch/u2_0.vdev",
5812024-03-30T05:41:52.657Z+ "/scratch/u2_1.vdev",
5822024-03-30T05:41:52.657Z+ "/scratch/u2_2.vdev",
5832024-03-30T05:41:52.657Z+ "/scratch/u2_3.vdev",
5842024-03-30T05:41:52.657Z+ "/scratch/u2_4.vdev",
5852024-03-30T05:41:52.658Z+ "/scratch/u2_5.vdev",
5862024-03-30T05:41:52.658Z+ "/scratch/u2_6.vdev",
5872024-03-30T05:41:52.658Z+ "/scratch/u2_7.vdev",
5882024-03-30T05:41:52.658Z+ "/scratch/u2_8.vdev",
5892024-03-30T05:41:52.658Z ]
5902024-03-30T05:41:52.659Z
5912024-03-30T05:41:52.659Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
5922024-03-30T05:41:52.659Z+ true
5932024-03-30T05:41:52.659Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5942024-03-30T05:41:52.659Z+ SILO_NAME=recovery
5952024-03-30T05:41:52.660Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5962024-03-30T05:41:52.660Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5972024-03-30T05:41:52.660Z+ sed -i~ '
5982024-03-30T05:41:52.660Z /^external_dns_ips/c\
5992024-03-30T05:41:52.660Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6002024-03-30T05:41:52.660Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6012024-03-30T05:41:52.660Z /^first/c\
6022024-03-30T05:41:52.661Zfirst = "10.151.1.164"
6032024-03-30T05:41:52.661Z /^last/c\
6042024-03-30T05:41:52.661Zlast = "10.151.1.173"
6052024-03-30T05:41:52.661Z }
6062024-03-30T05:41:52.662Z /^infra_ip_first/c\
6072024-03-30T05:41:52.662Zinfra_ip_first = "10.151.1.174"
6082024-03-30T05:41:52.662Z /^infra_ip_last/c\
6092024-03-30T05:41:52.662Zinfra_ip_last = "10.151.1.174"
6102024-03-30T05:41:52.663Z /^\[\[rack_network_config.ports/,/^$/ {
6112024-03-30T05:41:52.663Z /^routes/c\
6122024-03-30T05:41:52.663Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6132024-03-30T05:41:52.663Z /^addresses/c\
6142024-03-30T05:41:52.663Zaddresses = \["10.151.1.174/24"\]
6152024-03-30T05:41:52.664Z }
6162024-03-30T05:41:52.664Z' pkg/config-rss.toml
6172024-03-30T05:41:52.664Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6182024-03-30T05:41:52.664Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6192024-03-30T05:41:52.664Z+++ pkg/config-rss.toml Sat Mar 30 05:41:52 2024
6202024-03-30T05:41:52.665Z@@ -33,7 +33,7 @@
6212024-03-30T05:41:52.665Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6222024-03-30T05:41:52.665Z # must be contained in one of the "internal services" IP Pool ranges listed
6232024-03-30T05:41:52.665Z # below.
6242024-03-30T05:41:52.665Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6252024-03-30T05:41:52.665Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6262024-03-30T05:41:52.666Z
6272024-03-30T05:41:52.666Z # Initial TLS certificates for the external API
6282024-03-30T05:41:52.666Z #
6292024-03-30T05:41:52.666Z@@ -69,8 +69,8 @@
6302024-03-30T05:41:52.667Z #
6312024-03-30T05:41:52.667Z # For more on this and what to put here, see docs/how-to-run.adoc.
6322024-03-30T05:41:52.667Z [[internal_services_ip_pool_ranges]]
6332024-03-30T05:41:52.667Z-first = "192.168.1.20"
6342024-03-30T05:41:52.667Z-last = "192.168.1.29"
6352024-03-30T05:41:52.668Z+first = "10.151.1.164"
6362024-03-30T05:41:52.668Z+last = "10.151.1.173"
6372024-03-30T05:41:52.668Z
6382024-03-30T05:41:52.668Z # TODO - this configuration is subject to change going forward. Ultimately these
6392024-03-30T05:41:52.669Z # parameters should be provided to the control plane via wicket, but we need to
6402024-03-30T05:41:52.669Z@@ -91,8 +91,8 @@
6412024-03-30T05:41:52.669Z # A range of IP addresses used by Boundary Services on the external network. In
6422024-03-30T05:41:52.669Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6432024-03-30T05:41:52.669Z # With softnpu, only one address is used.
6442024-03-30T05:41:52.670Z-infra_ip_first = "192.168.1.30"
6452024-03-30T05:41:52.670Z-infra_ip_last = "192.168.1.30"
6462024-03-30T05:41:52.670Z+infra_ip_first = "10.151.1.174"
6472024-03-30T05:41:52.670Z+infra_ip_last = "10.151.1.174"
6482024-03-30T05:41:52.670Z
6492024-03-30T05:41:52.670Z # Configurations for BGP routers to run on the scrimlets.
6502024-03-30T05:41:52.671Z bgp = []
6512024-03-30T05:41:52.671Z@@ -100,9 +100,9 @@
6522024-03-30T05:41:52.671Z # You can configure multiple uplinks by repeating the following stanza
6532024-03-30T05:41:52.671Z [[rack_network_config.ports]]
6542024-03-30T05:41:52.671Z # Routes associated with this port.
6552024-03-30T05:41:52.671Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6562024-03-30T05:41:52.672Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6572024-03-30T05:41:52.672Z # Addresses associated with this port.
6582024-03-30T05:41:53.123Z-addresses = ["192.168.1.30/24"]
6592024-03-30T05:41:53.123Z+addresses = ["10.151.1.174/24"]
6602024-03-30T05:41:53.123Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6612024-03-30T05:41:53.123Z port = "qsfp0"
6622024-03-30T05:41:53.123Z # The speed of this port.
6632024-03-30T05:41:53.124Z+ true
6642024-03-30T05:41:53.124Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
6652024-03-30T05:41:53.124Za pkg/config-rss.toml 7K
6662024-03-30T05:41:53.124Za pkg/config.toml 4K
6672024-03-30T05:41:53.124Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
6682024-03-30T05:41:53.124Z+ TLS_NAME=recovery.sys.oxide.test
6692024-03-30T05:41:53.124Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6702024-03-30T05:41:54.589Z.+.....+............+.+...+..+...+......+......+...+....+......+.........+......+......+...+.....+...+..........+..+.......+...+..+.+..+......+......+...+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*................+.........+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+....+...+...............+......+...............+..+...+....+............+.........+...........+...+...+....+.....+...............................+..+..........+........+...+.+......+.....+....+...+..+..................+..........+.....+...+....+...+........+...+.........+.+.................+...+.+.........+..+...+..........+..........................+.+.....+...+.......+...+.........+.....+.+..+....+.........+..+...+....+...+...+......+.....+.+....................+.......+...........+.+...+..+...............+.+..............+.............+...+...+..............+.+............+.....+....+...............+..............+......+..........+...+.....+.......+...+...+........+......+....+...............+..+...+...............+..........+............+..+.+..+.......+..+...+.+.....+....+..................+..+......+.......+........+.........+...+.........+......+..........................................+......+.....................+...+.............+........+....+..+....+.........+..+.+...+.........+.....+......+.......+..+...+..........+...+............+..............+...+...+.......+..+.+..............+...+...............+.+.........+........+.........+................+..+.+..+...+.+.....+.........+..........+..+...+.........+.+.........+..+......+.......+......+.....................+.....+.+..............+..........+...........+.......+..+...+.+.........+...............+...........+....+.....+.+.....+.......+.....+...+....+..+..........+...+...+...+.....+...................+.....+......+.......+.....+..........+...+...........+..........+......+...............+..................+..+....+........+......+.......+...+.....+.........+......+......+..................+.......+......+.....+...............+.......+.....+...+...+.........+...+...+.+...............+........+.......+...+..................+........+...................+..+....+...............+..+...+......+...+.......+........+.......+...+............+......+........+....+...+..+...+....+........+......+....+......+............+..................+.....+......+..........+.........+..+.........+...+.+......+...+...........+................+...+..+...+..................+.......+........+.............+...............+..+....+...........+..........+..............+.+..+............+....+......+.....+...+...+.........+....+..............+...............+...+....+......+.........+.....+..........+.....+......+....+...+...........+...................+.......................+.......+.................+.........+.+..................+..+......+...+.......+.....+...+......+.............+......+......+.............................+.......+...+......+...........+...............+.......+..+......+....+...........+...+...............+.+...+.....+.+......+......+..+.+......+...+...+........+...............+.......+...+.....................+......+..+.......+...+.....+.+......+.....+....+..+....+..................+........+............+...+.......+..+..........+...+...............+...+..............+...............+.+.........+......+...............+.....+....+........+.......+..............+..................................+..+.+.........+...+.................+.+.......................+.......+...............+..+.+............+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6712024-03-30T05:41:54.736Z...+.....+.......+......+...........+...+..................+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+....+.....+.+..+...+...............+.........+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*................+...+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6722024-03-30T05:41:54.761Z-----
6732024-03-30T05:41:54.761Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6742024-03-30T05:41:54.789Za pkg/initial-tls-cert.pem 2K
6752024-03-30T05:41:54.789Za pkg/initial-tls-key.pem 4K
6762024-03-30T05:41:54.790Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6772024-03-30T05:41:54.790Z+ rmdir pkg
6782024-03-30T05:41:54.790Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6792024-03-30T05:41:54.790Z+ pfexec mkdir -p /usr/oxide
6802024-03-30T05:41:54.790Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6812024-03-30T05:41:55.466Z+ pfexec chmod +x /usr/oxide/oxide
6822024-03-30T05:41:55.491Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6832024-03-30T05:42:13.761Z+ OMICRON_NO_UNINSTALL=1
6842024-03-30T05:42:13.761Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6852024-03-30T05:42:13.786ZLogging to: /opt/oxide/work/out/LOG
6862024-03-30T05:42:14.317Z
6872024-03-30T05:42:14.345Zreal 0.551583044
6882024-03-30T05:42:14.345Zuser 0.112230085
6892024-03-30T05:42:14.345Zsys 2.286892687
6902024-03-30T05:42:14.346Ztrap 0.000000500
6912024-03-30T05:42:14.346Ztflt 0.000035429
6922024-03-30T05:42:14.346Zdflt 0.000866275
6932024-03-30T05:42:14.347Zkflt 0.000000000
6942024-03-30T05:42:14.347Zlock 50.162090244
6952024-03-30T05:42:14.347Zslp 0.758607987
6962024-03-30T05:42:14.348Zlat 0.003125308
6972024-03-30T05:42:14.348Zstop 0.197146670
6982024-03-30T05:42:14.348Z+ retry=0
6992024-03-30T05:42:14.348Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7002024-03-30T05:42:14.348Z+ [[ 0 -gt 30 ]]
7012024-03-30T05:42:14.349Z+ sleep 1
7022024-03-30T05:42:15.333Z+ retry=1
7032024-03-30T05:42:15.333Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7042024-03-30T05:42:15.358Z+ [[ 1 -gt 30 ]]
7052024-03-30T05:42:15.358Z+ sleep 1
7062024-03-30T05:42:16.348Z+ retry=2
7072024-03-30T05:42:16.348Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7082024-03-30T05:42:16.373Z+ [[ 2 -gt 30 ]]
7092024-03-30T05:42:16.373Z+ sleep 1
7102024-03-30T05:42:17.361Z+ retry=3
7112024-03-30T05:42:17.362Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7122024-03-30T05:42:42.537Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7132024-03-30T05:42:42.563Zlocal v6:
7142024-03-30T05:42:42.563Zfe80::dc3f:61ff:fe81:82ee
7152024-03-30T05:42:42.563Zfdcc:3062:2a73:db69::1
7162024-03-30T05:42:42.563Zlocal v4:
7172024-03-30T05:42:42.563Z10.151.1.174
7182024-03-30T05:42:42.563Zrouter v6:
7192024-03-30T05:42:42.564Zfd00:1122:3344:1::/64 -> fe80::6c80:a6ff:fe61:6ed7 (1)
7202024-03-30T05:42:42.564Zfd00:1122:3344:101::/64 -> fe80::6c80:a6ff:fe61:6ed7 (1)
7212024-03-30T05:42:42.564Zfd00:1122:3344:2::/64 -> fe80::6c80:a6ff:fe61:6ed7 (1)
7222024-03-30T05:42:42.564Zfd00:1122:3344:3::/64 -> fe80::6c80:a6ff:fe61:6ed7 (1)
7232024-03-30T05:42:42.564Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::6c80:a6ff:fe61:6ed7 (1)
7242024-03-30T05:42:42.564Zrouter v4_idx:
7252024-03-30T05:42:42.564Z0.0.0.0/0 -> 0
7262024-03-30T05:42:42.564Zrouter v4_routes:
7272024-03-30T05:42:42.564Z0 -> 10.151.1.100 (2)
7282024-03-30T05:42:42.564Zresolver v4:
7292024-03-30T05:42:42.564Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7302024-03-30T05:42:42.564Z10.151.1.174 -> da:94:40:4d:f7:a3
7312024-03-30T05:42:42.564Zresolver v6:
7322024-03-30T05:42:42.589Zfe80::6c80:a6ff:fe61:6ed7 -> 6e:80:a6:61:6e:d7
7332024-03-30T05:42:42.589Zfe80::dc3f:61ff:fe81:82ee -> de:3f:61:81:82:ee
7342024-03-30T05:42:42.589Znat v4:
7352024-03-30T05:42:42.589Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:8f:a7
7362024-03-30T05:42:42.590Znat_v6:
7372024-03-30T05:42:42.590Zport_mac:
7382024-03-30T05:42:42.590Z1000: a8:40:25:5c:ab:37
7392024-03-30T05:42:42.590Z1: a8:40:25:5c:ab:38
7402024-03-30T05:42:42.590Z2: a8:40:25:5c:ab:58
7412024-03-30T05:42:42.590Zproxy arp:
7422024-03-30T05:42:42.590Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7432024-03-30T05:42:42.590Z+ retry=0
7442024-03-30T05:42:42.590Z+++ zoneadm list -n
7452024-03-30T05:42:42.590Z+++ grep oxz_ntp
7462024-03-30T05:42:42.590Z++ pfexec svcs -z -Hostate oxide/ntp
7472024-03-30T05:42:42.590Zsvcs: zone '-Hostate': entity not found
7482024-03-30T05:42:42.590Z++ true
7492024-03-30T05:42:42.590Z+ [[ '' != online ]]
7502024-03-30T05:42:42.590Z+ [[ 0 -gt 60 ]]
7512024-03-30T05:42:42.590Z+ sleep 1
7522024-03-30T05:42:43.589Z+ retry=1
7532024-03-30T05:42:43.615Z+++ zoneadm list -n
7542024-03-30T05:42:43.615Z+++ grep oxz_ntp
7552024-03-30T05:42:43.615Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
7562024-03-30T05:42:43.657Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7572024-03-30T05:42:43.682Z++ true
7582024-03-30T05:42:43.682Z+ [[ '' != online ]]
7592024-03-30T05:42:43.682Z+ [[ 1 -gt 60 ]]
7602024-03-30T05:42:43.682Z+ sleep 1
7612024-03-30T05:42:44.663Z+ retry=2
7622024-03-30T05:42:44.689Z+++ zoneadm list -n
7632024-03-30T05:42:44.689Z+++ grep oxz_ntp
7642024-03-30T05:42:44.689Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
7652024-03-30T05:42:44.717Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7662024-03-30T05:42:44.717Z++ true
7672024-03-30T05:42:44.717Z+ [[ '' != online ]]
7682024-03-30T05:42:44.717Z+ [[ 2 -gt 60 ]]
7692024-03-30T05:42:44.718Z+ sleep 1
7702024-03-30T05:42:45.699Z+ retry=3
7712024-03-30T05:42:45.726Z+++ zoneadm list -n
7722024-03-30T05:42:45.726Z+++ grep oxz_ntp
7732024-03-30T05:42:45.727Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
7742024-03-30T05:42:45.727Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7752024-03-30T05:42:45.727Z++ true
7762024-03-30T05:42:45.727Z+ [[ '' != online ]]
7772024-03-30T05:42:45.727Z+ [[ 3 -gt 60 ]]
7782024-03-30T05:42:45.727Z+ sleep 1
7792024-03-30T05:42:46.722Z+ retry=4
7802024-03-30T05:42:46.747Z+++ zoneadm list -n
7812024-03-30T05:42:46.748Z+++ grep oxz_ntp
7822024-03-30T05:42:46.748Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
7832024-03-30T05:42:46.748Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7842024-03-30T05:42:46.748Z++ true
7852024-03-30T05:42:46.773Z+ [[ '' != online ]]
7862024-03-30T05:42:46.773Z+ [[ 4 -gt 60 ]]
7872024-03-30T05:42:46.773Z+ sleep 1
7882024-03-30T05:42:47.750Z+ retry=5
7892024-03-30T05:42:47.779Z+++ zoneadm list -n
7902024-03-30T05:42:47.779Z+++ grep oxz_ntp
7912024-03-30T05:42:47.779Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
7922024-03-30T05:42:47.779Z+ [[ offline != online ]]
7932024-03-30T05:42:47.779Z+ [[ 5 -gt 60 ]]
7942024-03-30T05:42:47.779Z+ sleep 1
7952024-03-30T05:42:48.773Z+ retry=6
7962024-03-30T05:42:48.798Z+++ zoneadm list -n
7972024-03-30T05:42:48.798Z+++ grep oxz_ntp
7982024-03-30T05:42:48.799Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
7992024-03-30T05:42:48.799Z+ [[ offline != online ]]
8002024-03-30T05:42:48.799Z+ [[ 6 -gt 60 ]]
8012024-03-30T05:42:48.799Z+ sleep 1
8022024-03-30T05:42:49.796Z+ retry=7
8032024-03-30T05:42:49.821Z+++ zoneadm list -n
8042024-03-30T05:42:49.821Z+++ grep oxz_ntp
8052024-03-30T05:42:49.821Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
8062024-03-30T05:42:49.821Z+ [[ offline != online ]]
8072024-03-30T05:42:49.821Z+ [[ 7 -gt 60 ]]
8082024-03-30T05:42:49.821Z+ sleep 1
8092024-03-30T05:42:50.828Z+ retry=8
8102024-03-30T05:42:50.871Z+++ zoneadm list -n
8112024-03-30T05:42:50.871Z+++ grep oxz_ntp
8122024-03-30T05:42:50.872Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
8132024-03-30T05:42:50.872Z+ [[ offline != online ]]
8142024-03-30T05:42:50.872Z+ [[ 8 -gt 60 ]]
8152024-03-30T05:42:50.872Z+ sleep 1
8162024-03-30T05:42:51.841Z+ retry=9
8172024-03-30T05:42:51.866Z+++ zoneadm list -n
8182024-03-30T05:42:51.866Z+++ grep oxz_ntp
8192024-03-30T05:42:51.866Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
8202024-03-30T05:42:51.866Z+ [[ offline != online ]]
8212024-03-30T05:42:51.866Z+ [[ 9 -gt 60 ]]
8222024-03-30T05:42:51.866Z+ sleep 1
8232024-03-30T05:42:52.867Z+ retry=10
8242024-03-30T05:42:52.893Z+++ zoneadm list -n
8252024-03-30T05:42:52.893Z+++ grep oxz_ntp
8262024-03-30T05:42:52.894Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
8272024-03-30T05:42:52.894Z+ [[ offline != online ]]
8282024-03-30T05:42:52.894Z+ [[ 10 -gt 60 ]]
8292024-03-30T05:42:52.894Z+ sleep 1
8302024-03-30T05:42:53.884Z+ retry=11
8312024-03-30T05:42:53.909Z+++ zoneadm list -n
8322024-03-30T05:42:53.909Z+++ grep oxz_ntp
8332024-03-30T05:42:53.909Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
8342024-03-30T05:42:53.909Z+ [[ offline != online ]]
8352024-03-30T05:42:53.909Z+ [[ 11 -gt 60 ]]
8362024-03-30T05:42:53.909Z+ sleep 1
8372024-03-30T05:42:54.906Z+ retry=12
8382024-03-30T05:42:54.931Z+++ zoneadm list -n
8392024-03-30T05:42:54.932Z+++ grep oxz_ntp
8402024-03-30T05:42:54.932Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
8412024-03-30T05:42:54.932Z+ [[ offline != online ]]
8422024-03-30T05:42:54.932Z+ [[ 12 -gt 60 ]]
8432024-03-30T05:42:54.932Z+ sleep 1
 
8442024-03-30T05:42:55.399Zbuskin console login: Mar 30 05:42:54 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8452024-03-30T05:42:55.930Z+ retry=13
8462024-03-30T05:42:55.959Z+++ zoneadm list -n
8472024-03-30T05:42:55.959Z+++ grep oxz_ntp
8482024-03-30T05:42:55.960Z++ pfexec svcs -z oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7 -Hostate oxide/ntp
8492024-03-30T05:42:55.960Z+ [[ online != online ]]
8502024-03-30T05:42:55.960Z+ echo 'Waited for chrony: 13s'
8512024-03-30T05:42:55.960Z+ retry=0
8522024-03-30T05:42:55.960ZWaited for chrony: 13s
8532024-03-30T05:42:55.961Z+ zoneadm list
8542024-03-30T05:42:55.961Z+ grep nexus
8552024-03-30T05:42:55.961Z+ [[ 0 -gt 300 ]]
8562024-03-30T05:42:55.961Z+ sleep 1
8572024-03-30T05:42:56.958Z+ retry=1
8582024-03-30T05:42:56.985Z+ zoneadm list
8592024-03-30T05:42:56.985Z+ grep nexus
8602024-03-30T05:42:56.985Z+ [[ 1 -gt 300 ]]
8612024-03-30T05:42:56.985Z+ sleep 1
8622024-03-30T05:42:57.979Z+ retry=2
8632024-03-30T05:42:57.979Z+ zoneadm list
8642024-03-30T05:42:57.979Z+ grep nexus
8652024-03-30T05:42:57.979Z+ [[ 2 -gt 300 ]]
8662024-03-30T05:42:57.979Z+ sleep 1
8672024-03-30T05:42:58.979Z+ retry=3
8682024-03-30T05:42:59.005Z+ zoneadm list
8692024-03-30T05:42:59.005Z+ grep nexus
8702024-03-30T05:42:59.006Z+ [[ 3 -gt 300 ]]
8712024-03-30T05:42:59.006Z+ sleep 1
8722024-03-30T05:42:59.989Z+ retry=4
8732024-03-30T05:43:00.017Z+ zoneadm list
8742024-03-30T05:43:00.017Z+ grep nexus
8752024-03-30T05:43:00.017Z+ [[ 4 -gt 300 ]]
8762024-03-30T05:43:00.017Z+ sleep 1
8772024-03-30T05:43:00.998Z+ retry=5
8782024-03-30T05:43:01.027Z+ zoneadm list
8792024-03-30T05:43:01.027Z+ grep nexus
8802024-03-30T05:43:01.027Z+ [[ 5 -gt 300 ]]
8812024-03-30T05:43:01.027Z+ sleep 1
8822024-03-30T05:43:02.009Z+ retry=6
8832024-03-30T05:43:02.035Z+ zoneadm list
8842024-03-30T05:43:02.035Z+ grep nexus
8852024-03-30T05:43:02.035Z+ [[ 6 -gt 300 ]]
8862024-03-30T05:43:02.036Z+ sleep 1
8872024-03-30T05:43:03.018Z+ retry=7
8882024-03-30T05:43:03.043Z+ zoneadm list
8892024-03-30T05:43:03.043Z+ grep nexus
8902024-03-30T05:43:03.043Z+ [[ 7 -gt 300 ]]
8912024-03-30T05:43:03.043Z+ sleep 1
8922024-03-30T05:43:04.029Z+ retry=8
8932024-03-30T05:43:04.056Z+ zoneadm list
8942024-03-30T05:43:04.057Z+ grep nexus
8952024-03-30T05:43:04.057Z+ [[ 8 -gt 300 ]]
8962024-03-30T05:43:04.057Z+ sleep 1
8972024-03-30T05:43:05.041Z+ retry=9
8982024-03-30T05:43:05.167Z+ zoneadm list
8992024-03-30T05:43:05.167Z+ grep nexus
9002024-03-30T05:43:05.168Z+ [[ 9 -gt 300 ]]
9012024-03-30T05:43:05.168Z+ sleep 1
9022024-03-30T05:43:06.051Z+ retry=10
9032024-03-30T05:43:06.076Z+ zoneadm list
9042024-03-30T05:43:06.076Z+ grep nexus
9052024-03-30T05:43:06.076Z+ [[ 10 -gt 300 ]]
9062024-03-30T05:43:06.077Z+ sleep 1
9072024-03-30T05:43:07.063Z+ retry=11
9082024-03-30T05:43:07.096Z+ zoneadm list
9092024-03-30T05:43:07.096Z+ grep nexus
9102024-03-30T05:43:07.096Z+ [[ 11 -gt 300 ]]
9112024-03-30T05:43:07.097Z+ sleep 1
9122024-03-30T05:43:08.099Z+ retry=12
9132024-03-30T05:43:08.166Z+ zoneadm list
9142024-03-30T05:43:08.166Z+ grep nexus
9152024-03-30T05:43:08.201Z+ [[ 12 -gt 300 ]]
9162024-03-30T05:43:08.201Z+ sleep 1
9172024-03-30T05:43:09.209Z+ retry=13
9182024-03-30T05:43:09.234Z+ zoneadm list
9192024-03-30T05:43:09.235Z+ grep nexus
9202024-03-30T05:43:09.235Z+ [[ 13 -gt 300 ]]
9212024-03-30T05:43:09.235Z+ sleep 1
9222024-03-30T05:43:10.221Z+ retry=14
9232024-03-30T05:43:10.246Z+ zoneadm list
9242024-03-30T05:43:10.246Z+ grep nexus
9252024-03-30T05:43:10.246Z+ [[ 14 -gt 300 ]]
9262024-03-30T05:43:10.246Z+ sleep 1
9272024-03-30T05:43:11.234Z+ retry=15
9282024-03-30T05:43:11.259Z+ zoneadm list
9292024-03-30T05:43:11.260Z+ grep nexus
9302024-03-30T05:43:11.260Z+ [[ 15 -gt 300 ]]
9312024-03-30T05:43:11.260Z+ sleep 1
9322024-03-30T05:43:12.247Z+ retry=16
9332024-03-30T05:43:12.273Z+ zoneadm list
9342024-03-30T05:43:12.273Z+ grep nexus
9352024-03-30T05:43:12.273Z+ [[ 16 -gt 300 ]]
9362024-03-30T05:43:12.273Z+ sleep 1
9372024-03-30T05:43:13.259Z+ retry=17
9382024-03-30T05:43:13.288Z+ zoneadm list
9392024-03-30T05:43:13.288Z+ grep nexus
9402024-03-30T05:43:13.289Z+ [[ 17 -gt 300 ]]
9412024-03-30T05:43:13.289Z+ sleep 1
9422024-03-30T05:43:14.269Z+ retry=18
9432024-03-30T05:43:14.294Z+ zoneadm list
9442024-03-30T05:43:14.295Z+ grep nexus
9452024-03-30T05:43:14.295Z+ [[ 18 -gt 300 ]]
9462024-03-30T05:43:14.295Z+ sleep 1
9472024-03-30T05:43:15.282Z+ retry=19
9482024-03-30T05:43:15.307Z+ zoneadm list
9492024-03-30T05:43:15.307Z+ grep nexus
9502024-03-30T05:43:15.307Z+ [[ 19 -gt 300 ]]
9512024-03-30T05:43:15.307Z+ sleep 1
9522024-03-30T05:43:16.294Z+ retry=20
9532024-03-30T05:43:16.319Z+ zoneadm list
9542024-03-30T05:43:16.319Z+ grep nexus
9552024-03-30T05:43:16.319Z+ [[ 20 -gt 300 ]]
9562024-03-30T05:43:16.320Z+ sleep 1
9572024-03-30T05:43:17.309Z+ retry=21
9582024-03-30T05:43:17.335Z+ zoneadm list
9592024-03-30T05:43:17.335Z+ grep nexus
9602024-03-30T05:43:17.335Z+ [[ 21 -gt 300 ]]
9612024-03-30T05:43:17.335Z+ sleep 1
9622024-03-30T05:43:18.322Z+ retry=22
9632024-03-30T05:43:18.354Z+ zoneadm list
9642024-03-30T05:43:18.354Z+ grep nexus
9652024-03-30T05:43:18.354Z+ [[ 22 -gt 300 ]]
9662024-03-30T05:43:18.354Z+ sleep 1
9672024-03-30T05:43:19.335Z+ retry=23
9682024-03-30T05:43:19.360Z+ zoneadm list
9692024-03-30T05:43:19.360Z+ grep nexus
9702024-03-30T05:43:19.360Z+ [[ 23 -gt 300 ]]
9712024-03-30T05:43:19.360Z+ sleep 1
9722024-03-30T05:43:20.348Z+ retry=24
9732024-03-30T05:43:20.373Z+ zoneadm list
9742024-03-30T05:43:20.373Z+ grep nexus
9752024-03-30T05:43:20.374Z+ [[ 24 -gt 300 ]]
9762024-03-30T05:43:20.374Z+ sleep 1
9772024-03-30T05:43:21.359Z+ retry=25
9782024-03-30T05:43:21.384Z+ zoneadm list
9792024-03-30T05:43:21.384Z+ grep nexus
9802024-03-30T05:43:21.384Z+ [[ 25 -gt 300 ]]
9812024-03-30T05:43:21.385Z+ sleep 1
9822024-03-30T05:43:22.370Z+ retry=26
9832024-03-30T05:43:22.394Z+ zoneadm list
9842024-03-30T05:43:22.394Z+ grep nexus
9852024-03-30T05:43:22.394Z+ [[ 26 -gt 300 ]]
9862024-03-30T05:43:22.394Z+ sleep 1
9872024-03-30T05:43:23.382Z+ retry=27
9882024-03-30T05:43:23.406Z+ zoneadm list
9892024-03-30T05:43:23.406Z+ grep nexus
9902024-03-30T05:43:23.406Z+ [[ 27 -gt 300 ]]
9912024-03-30T05:43:23.406Z+ sleep 1
9922024-03-30T05:43:24.395Z+ retry=28
9932024-03-30T05:43:24.420Z+ zoneadm list
9942024-03-30T05:43:24.420Z+ grep nexus
9952024-03-30T05:43:24.420Z+ [[ 28 -gt 300 ]]
9962024-03-30T05:43:24.420Z+ sleep 1
9972024-03-30T05:43:25.404Z+ retry=29
9982024-03-30T05:43:25.430Z+ zoneadm list
9992024-03-30T05:43:25.430Z+ grep nexus
10002024-03-30T05:43:25.431Z+ [[ 29 -gt 300 ]]
10012024-03-30T05:43:25.431Z+ sleep 1
10022024-03-30T05:43:26.415Z+ retry=30
10032024-03-30T05:43:26.439Z+ zoneadm list
10042024-03-30T05:43:26.439Z+ grep nexus
10052024-03-30T05:43:26.439Z+ [[ 30 -gt 300 ]]
10062024-03-30T05:43:26.439Z+ sleep 1
10072024-03-30T05:43:27.428Z+ retry=31
10082024-03-30T05:43:32.261Z+ zoneadm list
10092024-03-30T05:43:33.164Z+ grep nexus
10102024-03-30T05:43:33.165Z+ [[ 31 -gt 300 ]]
10112024-03-30T05:43:33.165Z+ sleep 1
10122024-03-30T05:43:33.200Z+ retry=32
10132024-03-30T05:43:33.200Z+ zoneadm list
10142024-03-30T05:43:33.201Z+ grep nexus
10152024-03-30T05:43:33.201Z+ [[ 32 -gt 300 ]]
10162024-03-30T05:43:33.201Z+ sleep 1
10172024-03-30T05:43:34.113Z+ retry=33
10182024-03-30T05:43:34.137Z+ zoneadm list
10192024-03-30T05:43:34.137Z+ grep nexus
10202024-03-30T05:43:34.137Z+ [[ 33 -gt 300 ]]
10212024-03-30T05:43:34.137Z+ sleep 1
10222024-03-30T05:43:35.135Z+ retry=34
10232024-03-30T05:43:35.163Z+ zoneadm list
10242024-03-30T05:43:35.163Z+ grep nexus
10252024-03-30T05:43:35.163Z+ [[ 34 -gt 300 ]]
10262024-03-30T05:43:35.164Z+ sleep 1
10272024-03-30T05:43:36.146Z+ retry=35
10282024-03-30T05:43:36.171Z+ zoneadm list
10292024-03-30T05:43:36.171Z+ grep nexus
10302024-03-30T05:43:36.171Z+ [[ 35 -gt 300 ]]
10312024-03-30T05:43:36.171Z+ sleep 1
10322024-03-30T05:43:37.165Z+ retry=36
10332024-03-30T05:43:37.191Z+ zoneadm list
10342024-03-30T05:43:37.192Z+ grep nexus
10352024-03-30T05:43:37.192Z+ [[ 36 -gt 300 ]]
10362024-03-30T05:43:37.192Z+ sleep 1
10372024-03-30T05:43:38.784Z+ retry=37
10382024-03-30T05:43:38.784Z+ zoneadm list
10392024-03-30T05:43:38.785Z+ grep nexus
10402024-03-30T05:43:38.785Z+ [[ 37 -gt 300 ]]
10412024-03-30T05:43:38.785Z+ sleep 1
10422024-03-30T05:43:39.201Z+ retry=38
10432024-03-30T05:43:39.233Z+ zoneadm list
10442024-03-30T05:43:39.233Z+ grep nexus
10452024-03-30T05:43:39.233Z+ [[ 38 -gt 300 ]]
10462024-03-30T05:43:39.233Z+ sleep 1
10472024-03-30T05:43:40.210Z+ retry=39
10482024-03-30T05:43:40.236Z+ zoneadm list
10492024-03-30T05:43:40.236Z+ grep nexus
10502024-03-30T05:43:40.236Z+ [[ 39 -gt 300 ]]
10512024-03-30T05:43:40.237Z+ sleep 1
10522024-03-30T05:43:41.225Z+ retry=40
10532024-03-30T05:43:41.250Z+ zoneadm list
10542024-03-30T05:43:41.250Z+ grep nexus
10552024-03-30T05:43:41.250Z+ [[ 40 -gt 300 ]]
10562024-03-30T05:43:41.250Z+ sleep 1
10572024-03-30T05:43:42.236Z+ retry=41
10582024-03-30T05:43:42.260Z+ zoneadm list
10592024-03-30T05:43:42.260Z+ grep nexus
10602024-03-30T05:43:42.260Z+ [[ 41 -gt 300 ]]
10612024-03-30T05:43:42.260Z+ sleep 1
10622024-03-30T05:43:43.249Z+ retry=42
10632024-03-30T05:43:43.279Z+ zoneadm list
10642024-03-30T05:43:43.280Z+ grep nexus
10652024-03-30T05:43:43.280Z+ [[ 42 -gt 300 ]]
10662024-03-30T05:43:43.280Z+ sleep 1
10672024-03-30T05:43:44.261Z+ retry=43
10682024-03-30T05:43:44.285Z+ zoneadm list
10692024-03-30T05:43:44.285Z+ grep nexus
10702024-03-30T05:43:44.285Z+ [[ 43 -gt 300 ]]
10712024-03-30T05:43:44.285Z+ sleep 1
10722024-03-30T05:43:45.272Z+ retry=44
10732024-03-30T05:43:45.296Z+ zoneadm list
10742024-03-30T05:43:45.296Z+ grep nexus
10752024-03-30T05:43:45.296Z+ [[ 44 -gt 300 ]]
10762024-03-30T05:43:45.297Z+ sleep 1
10772024-03-30T05:43:46.286Z+ retry=45
10782024-03-30T05:43:46.316Z+ zoneadm list
10792024-03-30T05:43:46.316Z+ grep nexus
10802024-03-30T05:43:46.316Z+ [[ 45 -gt 300 ]]
10812024-03-30T05:43:46.317Z+ sleep 1
10822024-03-30T05:43:47.297Z+ retry=46
10832024-03-30T05:43:47.321Z+ zoneadm list
10842024-03-30T05:43:47.321Z+ grep nexus
10852024-03-30T05:43:47.321Z+ [[ 46 -gt 300 ]]
10862024-03-30T05:43:47.321Z+ sleep 1
10872024-03-30T05:43:48.311Z+ retry=47
10882024-03-30T05:43:48.755Z+ zoneadm list
10892024-03-30T05:43:48.755Z+ grep nexus
10902024-03-30T05:43:48.755Z+ [[ 47 -gt 300 ]]
10912024-03-30T05:43:48.755Z+ sleep 1
10922024-03-30T05:43:49.325Z+ retry=48
10932024-03-30T05:43:49.354Z+ zoneadm list
10942024-03-30T05:43:49.354Z+ grep nexus
10952024-03-30T05:43:49.355Z+ [[ 48 -gt 300 ]]
10962024-03-30T05:43:49.355Z+ sleep 1
10972024-03-30T05:43:50.333Z+ retry=49
10982024-03-30T05:43:50.357Z+ zoneadm list
10992024-03-30T05:43:50.357Z+ grep nexus
11002024-03-30T05:43:50.357Z+ [[ 49 -gt 300 ]]
11012024-03-30T05:43:50.357Z+ sleep 1
11022024-03-30T05:43:51.346Z+ retry=50
11032024-03-30T05:43:51.371Z+ zoneadm list
11042024-03-30T05:43:51.371Z+ grep nexus
11052024-03-30T05:43:51.372Z+ [[ 50 -gt 300 ]]
11062024-03-30T05:43:51.372Z+ sleep 1
11072024-03-30T05:43:52.359Z+ retry=51
11082024-03-30T05:43:52.384Z+ zoneadm list
11092024-03-30T05:43:52.384Z+ grep nexus
11102024-03-30T05:43:52.384Z+ [[ 51 -gt 300 ]]
11112024-03-30T05:43:52.385Z+ sleep 1
11122024-03-30T05:43:53.370Z+ retry=52
11132024-03-30T05:43:53.397Z+ zoneadm list
11142024-03-30T05:43:53.397Z+ grep nexus
11152024-03-30T05:43:53.397Z+ [[ 52 -gt 300 ]]
11162024-03-30T05:43:53.397Z+ sleep 1
11172024-03-30T05:43:54.385Z+ retry=53
11182024-03-30T05:43:54.409Z+ zoneadm list
11192024-03-30T05:43:54.409Z+ grep nexus
11202024-03-30T05:43:54.409Z+ [[ 53 -gt 300 ]]
11212024-03-30T05:43:54.409Z+ sleep 1
11222024-03-30T05:43:55.406Z+ retry=54
11232024-03-30T05:43:55.433Z+ zoneadm list
11242024-03-30T05:43:55.433Z+ grep nexus
11252024-03-30T05:43:55.433Z+ [[ 54 -gt 300 ]]
11262024-03-30T05:43:55.433Z+ sleep 1
11272024-03-30T05:43:56.405Z+ retry=55
11282024-03-30T05:43:56.429Z+ zoneadm list
11292024-03-30T05:43:56.429Z+ grep nexus
11302024-03-30T05:43:56.429Z+ [[ 55 -gt 300 ]]
11312024-03-30T05:43:56.429Z+ sleep 1
11322024-03-30T05:43:57.418Z+ retry=56
11332024-03-30T05:43:57.443Z+ zoneadm list
11342024-03-30T05:43:57.443Z+ grep nexus
11352024-03-30T05:43:57.443Z+ [[ 56 -gt 300 ]]
11362024-03-30T05:43:57.443Z+ sleep 1
11372024-03-30T05:43:58.430Z+ retry=57
11382024-03-30T05:43:58.463Z+ zoneadm list
11392024-03-30T05:43:58.463Z+ grep nexus
11402024-03-30T05:43:58.463Z+ [[ 57 -gt 300 ]]
11412024-03-30T05:43:58.463Z+ sleep 1
11422024-03-30T05:43:59.441Z+ retry=58
11432024-03-30T05:43:59.465Z+ zoneadm list
11442024-03-30T05:43:59.465Z+ grep nexus
11452024-03-30T05:43:59.465Z+ [[ 58 -gt 300 ]]
11462024-03-30T05:43:59.465Z+ sleep 1
11472024-03-30T05:44:00.469Z+ retry=59
11482024-03-30T05:44:00.494Z+ zoneadm list
11492024-03-30T05:44:00.494Z+ grep nexus
11502024-03-30T05:44:00.494Z+ [[ 59 -gt 300 ]]
11512024-03-30T05:44:00.494Z+ sleep 1
11522024-03-30T05:44:01.465Z+ retry=60
11532024-03-30T05:44:01.490Z+ zoneadm list
11542024-03-30T05:44:01.490Z+ grep nexus
11552024-03-30T05:44:01.490Z+ [[ 60 -gt 300 ]]
11562024-03-30T05:44:01.490Z+ sleep 1
11572024-03-30T05:44:02.477Z+ retry=61
11582024-03-30T05:44:02.505Z+ zoneadm list
11592024-03-30T05:44:02.505Z+ grep nexus
11602024-03-30T05:44:02.505Z+ [[ 61 -gt 300 ]]
11612024-03-30T05:44:02.505Z+ sleep 1
11622024-03-30T05:44:03.486Z+ retry=62
11632024-03-30T05:44:03.511Z+ zoneadm list
11642024-03-30T05:44:03.511Z+ grep nexus
11652024-03-30T05:44:03.511Z+ [[ 62 -gt 300 ]]
11662024-03-30T05:44:03.511Z+ sleep 1
11672024-03-30T05:44:04.498Z+ retry=63
11682024-03-30T05:44:04.522Z+ zoneadm list
11692024-03-30T05:44:04.522Z+ grep nexus
11702024-03-30T05:44:04.522Z+ [[ 63 -gt 300 ]]
11712024-03-30T05:44:04.522Z+ sleep 1
11722024-03-30T05:44:05.511Z+ retry=64
11732024-03-30T05:44:05.536Z+ zoneadm list
11742024-03-30T05:44:05.536Z+ grep nexus
11752024-03-30T05:44:05.536Z+ [[ 64 -gt 300 ]]
11762024-03-30T05:44:05.536Z+ sleep 1
11772024-03-30T05:44:06.522Z+ retry=65
11782024-03-30T05:44:06.546Z+ zoneadm list
11792024-03-30T05:44:06.546Z+ grep nexus
11802024-03-30T05:44:06.546Z+ [[ 65 -gt 300 ]]
11812024-03-30T05:44:06.546Z+ sleep 1
11822024-03-30T05:44:07.535Z+ retry=66
11832024-03-30T05:44:07.559Z+ zoneadm list
11842024-03-30T05:44:07.559Z+ grep nexus
11852024-03-30T05:44:07.559Z+ [[ 66 -gt 300 ]]
11862024-03-30T05:44:07.559Z+ sleep 1
11872024-03-30T05:44:08.552Z+ retry=67
11882024-03-30T05:44:08.576Z+ zoneadm list
11892024-03-30T05:44:08.576Z+ grep nexus
11902024-03-30T05:44:08.576Z+ [[ 67 -gt 300 ]]
11912024-03-30T05:44:08.576Z+ sleep 1
11922024-03-30T05:44:09.566Z+ retry=68
11932024-03-30T05:44:09.592Z+ zoneadm list
11942024-03-30T05:44:09.592Z+ grep nexus
11952024-03-30T05:44:09.592Z+ [[ 68 -gt 300 ]]
11962024-03-30T05:44:09.593Z+ sleep 1
11972024-03-30T05:44:10.579Z+ retry=69
11982024-03-30T05:44:10.606Z+ zoneadm list
11992024-03-30T05:44:10.606Z+ grep nexus
12002024-03-30T05:44:10.606Z+ [[ 69 -gt 300 ]]
12012024-03-30T05:44:10.606Z+ sleep 1
12022024-03-30T05:44:11.599Z+ retry=70
12032024-03-30T05:44:11.632Z+ zoneadm list
12042024-03-30T05:44:11.632Z+ grep nexus
12052024-03-30T05:44:11.632Z+ [[ 70 -gt 300 ]]
12062024-03-30T05:44:11.633Z+ sleep 1
12072024-03-30T05:44:12.612Z+ retry=71
12082024-03-30T05:44:12.641Z+ zoneadm list
12092024-03-30T05:44:12.642Z+ grep nexus
12102024-03-30T05:44:12.642Z+ [[ 71 -gt 300 ]]
12112024-03-30T05:44:12.642Z+ sleep 1
12122024-03-30T05:44:13.623Z+ retry=72
12132024-03-30T05:44:13.647Z+ zoneadm list
12142024-03-30T05:44:13.647Z+ grep nexus
12152024-03-30T05:44:13.647Z+ [[ 72 -gt 300 ]]
12162024-03-30T05:44:13.647Z+ sleep 1
12172024-03-30T05:44:14.642Z+ retry=73
12182024-03-30T05:44:14.677Z+ zoneadm list
12192024-03-30T05:44:14.677Z+ grep nexus
12202024-03-30T05:44:14.678Z+ [[ 73 -gt 300 ]]
12212024-03-30T05:44:14.678Z+ sleep 1
12222024-03-30T05:44:15.658Z+ retry=74
12232024-03-30T05:44:15.693Z+ zoneadm list
12242024-03-30T05:44:15.693Z+ grep nexus
12252024-03-30T05:44:15.693Z+ [[ 74 -gt 300 ]]
12262024-03-30T05:44:15.693Z+ sleep 1
12272024-03-30T05:44:16.668Z+ retry=75
12282024-03-30T05:44:16.692Z+ zoneadm list
12292024-03-30T05:44:16.692Z+ grep nexus
12302024-03-30T05:44:16.692Z+ [[ 75 -gt 300 ]]
12312024-03-30T05:44:16.692Z+ sleep 1
12322024-03-30T05:44:17.684Z+ retry=76
12332024-03-30T05:44:17.709Z+ zoneadm list
12342024-03-30T05:44:17.709Z+ grep nexus
12352024-03-30T05:44:17.709Z+ [[ 76 -gt 300 ]]
12362024-03-30T05:44:17.710Z+ sleep 1
12372024-03-30T05:44:18.704Z+ retry=77
12382024-03-30T05:44:18.732Z+ zoneadm list
12392024-03-30T05:44:18.732Z+ grep nexus
12402024-03-30T05:44:18.732Z+ [[ 77 -gt 300 ]]
12412024-03-30T05:44:18.732Z+ sleep 1
12422024-03-30T05:44:19.713Z+ retry=78
12432024-03-30T05:44:19.744Z+ zoneadm list
12442024-03-30T05:44:19.744Z+ grep nexus
12452024-03-30T05:44:19.744Z+ [[ 78 -gt 300 ]]
12462024-03-30T05:44:19.744Z+ sleep 1
12472024-03-30T05:44:20.729Z+ retry=79
12482024-03-30T05:44:20.753Z+ zoneadm list
12492024-03-30T05:44:20.753Z+ grep nexus
12502024-03-30T05:44:20.753Z+ [[ 79 -gt 300 ]]
12512024-03-30T05:44:20.753Z+ sleep 1
12522024-03-30T05:44:21.743Z+ retry=80
12532024-03-30T05:44:21.769Z+ zoneadm list
12542024-03-30T05:44:21.769Z+ grep nexus
12552024-03-30T05:44:21.769Z+ [[ 80 -gt 300 ]]
12562024-03-30T05:44:21.770Z+ sleep 1
12572024-03-30T05:44:22.759Z+ retry=81
12582024-03-30T05:44:22.786Z+ zoneadm list
12592024-03-30T05:44:22.786Z+ grep nexus
12602024-03-30T05:44:22.787Z+ [[ 81 -gt 300 ]]
12612024-03-30T05:44:22.787Z+ sleep 1
12622024-03-30T05:44:23.783Z+ retry=82
12632024-03-30T05:44:23.808Z+ zoneadm list
12642024-03-30T05:44:23.808Z+ grep nexus
12652024-03-30T05:44:23.808Z+ [[ 82 -gt 300 ]]
12662024-03-30T05:44:23.808Z+ sleep 1
12672024-03-30T05:44:24.787Z+ retry=83
12682024-03-30T05:44:24.812Z+ zoneadm list
12692024-03-30T05:44:24.812Z+ grep nexus
12702024-03-30T05:44:24.812Z+ [[ 83 -gt 300 ]]
12712024-03-30T05:44:24.812Z+ sleep 1
12722024-03-30T05:44:25.802Z+ retry=84
12732024-03-30T05:44:25.826Z+ zoneadm list
12742024-03-30T05:44:25.826Z+ grep nexus
12752024-03-30T05:44:25.826Z+ [[ 84 -gt 300 ]]
12762024-03-30T05:44:25.826Z+ sleep 1
12772024-03-30T05:44:26.817Z+ retry=85
12782024-03-30T05:44:26.842Z+ zoneadm list
12792024-03-30T05:44:26.842Z+ grep nexus
12802024-03-30T05:44:26.842Z+ [[ 85 -gt 300 ]]
12812024-03-30T05:44:26.842Z+ sleep 1
12822024-03-30T05:44:27.834Z+ retry=86
12832024-03-30T05:44:27.859Z+ zoneadm list
12842024-03-30T05:44:27.859Z+ grep nexus
12852024-03-30T05:44:27.859Z+ [[ 86 -gt 300 ]]
12862024-03-30T05:44:27.860Z+ sleep 1
12872024-03-30T05:44:28.859Z+ retry=87
12882024-03-30T05:44:28.921Z+ zoneadm list
12892024-03-30T05:44:28.921Z+ grep nexus
12902024-03-30T05:44:28.946Z+ [[ 87 -gt 300 ]]
12912024-03-30T05:44:28.946Z+ sleep 1
12922024-03-30T05:44:29.928Z+ retry=88
12932024-03-30T05:44:29.954Z+ zoneadm list
12942024-03-30T05:44:29.955Z+ grep nexus
12952024-03-30T05:44:29.955Z+ [[ 88 -gt 300 ]]
12962024-03-30T05:44:29.955Z+ sleep 1
12972024-03-30T05:44:30.950Z+ retry=89
12982024-03-30T05:44:30.975Z+ zoneadm list
12992024-03-30T05:44:30.975Z+ grep nexus
13002024-03-30T05:44:30.976Z+ [[ 89 -gt 300 ]]
13012024-03-30T05:44:30.976Z+ sleep 1
13022024-03-30T05:44:42.104Z+ retry=90
13032024-03-30T05:44:42.135Z+ zoneadm list
13042024-03-30T05:44:42.135Z+ grep nexus
13052024-03-30T05:44:42.135Z+ [[ 90 -gt 300 ]]
13062024-03-30T05:44:42.135Z+ sleep 1
13072024-03-30T05:44:42.136Z+ retry=91
13082024-03-30T05:44:42.136Z+ zoneadm list
13092024-03-30T05:44:42.136Z+ grep nexus
13102024-03-30T05:44:42.136Z+ [[ 91 -gt 300 ]]
13112024-03-30T05:44:42.136Z+ sleep 1
13122024-03-30T05:44:42.740Z+ retry=92
13132024-03-30T05:44:42.766Z+ zoneadm list
13142024-03-30T05:44:42.766Z+ grep nexus
13152024-03-30T05:44:42.766Z+ [[ 92 -gt 300 ]]
13162024-03-30T05:44:42.767Z+ sleep 1
13172024-03-30T05:44:43.762Z+ retry=93
13182024-03-30T05:44:43.788Z+ zoneadm list
13192024-03-30T05:44:43.788Z+ grep nexus
13202024-03-30T05:44:43.788Z+ [[ 93 -gt 300 ]]
13212024-03-30T05:44:43.789Z+ sleep 1
13222024-03-30T05:44:46.426Z+ retry=94
13232024-03-30T05:44:46.460Z+ zoneadm list
13242024-03-30T05:44:46.460Z+ grep nexus
13252024-03-30T05:44:46.460Z+ [[ 94 -gt 300 ]]
13262024-03-30T05:44:46.460Z+ sleep 1
13272024-03-30T05:44:47.303Z+ retry=95
13282024-03-30T05:44:47.327Z+ zoneadm list
13292024-03-30T05:44:47.327Z+ grep nexus
13302024-03-30T05:44:47.327Z+ [[ 95 -gt 300 ]]
13312024-03-30T05:44:47.327Z+ sleep 1
13322024-03-30T05:44:48.320Z+ retry=96
13332024-03-30T05:44:48.350Z+ zoneadm list
13342024-03-30T05:44:48.351Z+ grep nexus
13352024-03-30T05:44:48.351Z+ [[ 96 -gt 300 ]]
13362024-03-30T05:44:48.351Z+ sleep 1
13372024-03-30T05:44:49.350Z+ retry=97
13382024-03-30T05:44:49.403Z+ zoneadm list
13392024-03-30T05:44:49.403Z+ grep nexus
13402024-03-30T05:44:49.404Zoxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd
13412024-03-30T05:44:49.404Zoxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4
13422024-03-30T05:44:49.404Zoxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d
13432024-03-30T05:44:49.404Z+ echo 'Waited for nexus: 97s'
13442024-03-30T05:44:49.404ZWaited for nexus: 97s
13452024-03-30T05:44:49.404Z+ export RUST_BACKTRACE=1
13462024-03-30T05:44:49.404Z+ RUST_BACKTRACE=1
13472024-03-30T05:44:49.404Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
13482024-03-30T05:44:49.404Z++ ./tests/bootstrap
13492024-03-30T05:44:50.217ZUsing external DNS server at 10.151.1.164:53
13502024-03-30T05:44:50.243Z2024-03-30 05:44:50.217251372 UTC: attempting to log into API
 
13512024-03-30T05:45:03.140ZSUNW-MSG-ID: ZFS-8000-FD, TYPE: Fault, VER: 1, SEVERITY: Major
13522024-03-30T05:45:03.180ZEVENT-TIME: Sat Mar 30 05:45:02 UTC 2024
13532024-03-30T05:45:03.214ZPLATFORM: R152-Z32-00, CSN: GKG8N7212A0021, HOSTNAME: buskin
13542024-03-30T05:45:03.247ZSOURCE: zfs-diagnosis, REV: 1.0
13552024-03-30T05:45:03.292ZEVENT-ID: 0c0a539f-9024-48b6-81ba-161dcea13cc9
13562024-03-30T05:45:03.326ZDESC: The number of I/O errors associated with a ZFS device exceeded
13572024-03-30T05:45:03.359Zacceptable levels. Refer to http://illumos.org/msg/ZFS-8000-FD for more information.
13582024-03-30T05:45:03.393ZAUTO-RESPONSE: The device has been offlined and marked as faulted. An attempt
13592024-03-30T05:45:03.440Zwill be made to activate a hot spare if available.
13602024-03-30T05:45:03.486ZIMPACT: Fault tolerance of the pool may be compromised.
13612024-03-30T05:45:03.525ZREC-ACTION: Run 'zpool status -x' and replace the bad device.
13622024-03-30T05:45:03.564Z^@Mar 30 05:45:02 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
13632024-03-30T05:45:04.140ZMar 30 05:45:03 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
13642024-03-30T05:45:04.178ZMar 30 05:45:03 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
13652024-03-30T05:45:04.500ZMar 30 05:45:03 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
13662024-03-30T05:45:04.538ZMar 30 05:45:03 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
 
13672024-03-30T05:45:05.312Z2024-03-30 05:45:05.286238864 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
13682024-03-30T05:45:06.309Z2024-03-30 05:45:06.287973046 UTC: attempting to log into API
13692024-03-30T05:45:17.116Z2024-03-30 05:45:17.093111674 UTC: login succeeded
13702024-03-30T05:45:17.153Zwaiting for nexus to come up...
13712024-03-30T05:45:17.225Zcreating IP pool... 10.151.1.175 - 10.151.1.227
13722024-03-30T05:45:17.420Zsetting up quotas...
13732024-03-30T05:45:17.460Zensuring datasets are ready...
13742024-03-30T05:45:19.955Zlet's roll.
13752024-03-30T05:45:19.979Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
13762024-03-30T05:45:19.979ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
13772024-03-30T05:45:19.979ZOXIDE_TOKEN=oxide-token-a9c002e8d109029818ce7c68f757e183e156a448'
13782024-03-30T05:45:19.979Z++ OXIDE_HOST=https://recovery.sys.oxide.test
13792024-03-30T05:45:19.979Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
13802024-03-30T05:45:19.980Z++ OXIDE_TOKEN=oxide-token-a9c002e8d109029818ce7c68f757e183e156a448
13812024-03-30T05:45:19.980Z+ export OXIDE_HOST OXIDE_TOKEN
13822024-03-30T05:45:19.980Z+ retry=0
13832024-03-30T05:45:19.980Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13842024-03-30T05:45:20.004Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13852024-03-30T05:45:20.004Z+ [[ 0 -gt 60 ]]
13862024-03-30T05:45:20.004Z+ sleep 1
13872024-03-30T05:45:20.983Z+ retry=1
13882024-03-30T05:45:20.983Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13892024-03-30T05:45:21.007Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13902024-03-30T05:45:21.007Z+ [[ 1 -gt 60 ]]
13912024-03-30T05:45:21.007Z+ sleep 1
13922024-03-30T05:45:21.999Z+ retry=2
13932024-03-30T05:45:21.999Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13942024-03-30T05:45:22.023Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
13952024-03-30T05:45:22.023Z+ [[ 2 -gt 60 ]]
13962024-03-30T05:45:22.023Z+ sleep 1
13972024-03-30T05:45:23.026Z+ retry=3
13982024-03-30T05:45:23.026Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
13992024-03-30T05:45:23.056Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14002024-03-30T05:45:23.056Z+ [[ 3 -gt 60 ]]
14012024-03-30T05:45:23.056Z+ sleep 1
14022024-03-30T05:45:24.029Z+ retry=4
14032024-03-30T05:45:24.029Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14042024-03-30T05:45:24.053Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14052024-03-30T05:45:24.053Z+ [[ 4 -gt 60 ]]
14062024-03-30T05:45:24.053Z+ sleep 1
14072024-03-30T05:45:25.047Z+ retry=5
14082024-03-30T05:45:25.048Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14092024-03-30T05:45:25.071Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14102024-03-30T05:45:25.071Z+ [[ 5 -gt 60 ]]
14112024-03-30T05:45:25.071Z+ sleep 1
14122024-03-30T05:45:26.062Z+ retry=6
14132024-03-30T05:45:26.063Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14142024-03-30T05:45:26.496Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14152024-03-30T05:45:26.497Z+ [[ 6 -gt 60 ]]
14162024-03-30T05:45:26.497Z+ sleep 1
14172024-03-30T05:45:27.075Z+ retry=7
14182024-03-30T05:45:27.075Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14192024-03-30T05:45:27.099Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14202024-03-30T05:45:27.099Z+ [[ 7 -gt 60 ]]
14212024-03-30T05:45:27.099Z+ sleep 1
14222024-03-30T05:45:28.091Z+ retry=8
14232024-03-30T05:45:28.091Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14242024-03-30T05:45:28.115Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14252024-03-30T05:45:28.115Z+ [[ 8 -gt 60 ]]
14262024-03-30T05:45:28.115Z+ sleep 1
14272024-03-30T05:45:29.109Z+ retry=9
14282024-03-30T05:45:29.109Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14292024-03-30T05:45:29.138Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14302024-03-30T05:45:29.138Z+ [[ 9 -gt 60 ]]
14312024-03-30T05:45:29.138Z+ sleep 1
14322024-03-30T05:45:30.121Z+ retry=10
14332024-03-30T05:45:30.121Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14342024-03-30T05:45:30.145Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14352024-03-30T05:45:30.146Z+ [[ 10 -gt 60 ]]
14362024-03-30T05:45:30.146Z+ sleep 1
14372024-03-30T05:45:31.137Z+ retry=11
14382024-03-30T05:45:31.137Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14392024-03-30T05:45:31.161Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14402024-03-30T05:45:31.161Z+ [[ 11 -gt 60 ]]
14412024-03-30T05:45:31.161Z+ sleep 1
14422024-03-30T05:45:32.155Z+ retry=12
14432024-03-30T05:45:32.156Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14442024-03-30T05:45:32.186Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14452024-03-30T05:45:32.186Z+ [[ 12 -gt 60 ]]
14462024-03-30T05:45:32.187Z+ sleep 1
14472024-03-30T05:45:33.168Z+ retry=13
14482024-03-30T05:45:33.168Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14492024-03-30T05:45:33.192Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14502024-03-30T05:45:33.192Z+ [[ 13 -gt 60 ]]
14512024-03-30T05:45:33.192Z+ sleep 1
14522024-03-30T05:45:34.184Z+ retry=14
14532024-03-30T05:45:34.184Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14542024-03-30T05:45:34.209Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14552024-03-30T05:45:34.209Z+ [[ 14 -gt 60 ]]
14562024-03-30T05:45:34.209Z+ sleep 1
14572024-03-30T05:45:35.203Z+ retry=15
14582024-03-30T05:45:35.203Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14592024-03-30T05:45:35.233Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14602024-03-30T05:45:35.234Z+ [[ 15 -gt 60 ]]
14612024-03-30T05:45:35.234Z+ sleep 1
14622024-03-30T05:45:36.214Z+ retry=16
14632024-03-30T05:45:36.214Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14642024-03-30T05:45:36.239Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14652024-03-30T05:45:36.239Z+ [[ 16 -gt 60 ]]
14662024-03-30T05:45:36.239Z+ sleep 1
14672024-03-30T05:45:37.228Z+ retry=17
14682024-03-30T05:45:37.228Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14692024-03-30T05:45:37.253Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14702024-03-30T05:45:37.253Z+ [[ 17 -gt 60 ]]
14712024-03-30T05:45:37.253Z+ sleep 1
14722024-03-30T05:45:38.656Z+ retry=18
14732024-03-30T05:45:38.656Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14742024-03-30T05:45:39.086Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14752024-03-30T05:45:39.086Z+ [[ 18 -gt 60 ]]
14762024-03-30T05:45:39.086Z+ sleep 1
14772024-03-30T05:45:39.271Z+ retry=19
14782024-03-30T05:45:39.272Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14792024-03-30T05:45:39.304Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14802024-03-30T05:45:39.305Z+ [[ 19 -gt 60 ]]
14812024-03-30T05:45:39.305Z+ sleep 1
14822024-03-30T05:45:40.282Z+ retry=20
14832024-03-30T05:45:40.282Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14842024-03-30T05:45:40.311Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14852024-03-30T05:45:40.312Z+ [[ 20 -gt 60 ]]
14862024-03-30T05:45:40.313Z+ sleep 1
14872024-03-30T05:45:41.293Z+ retry=21
14882024-03-30T05:45:41.293Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14892024-03-30T05:45:41.318Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14902024-03-30T05:45:41.318Z+ [[ 21 -gt 60 ]]
14912024-03-30T05:45:41.318Z+ sleep 1
14922024-03-30T05:45:42.304Z+ retry=22
14932024-03-30T05:45:42.304Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14942024-03-30T05:45:42.328Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
14952024-03-30T05:45:42.329Z+ [[ 22 -gt 60 ]]
14962024-03-30T05:45:42.329Z+ sleep 1
14972024-03-30T05:45:43.318Z+ retry=23
14982024-03-30T05:45:43.318Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
14992024-03-30T05:45:43.342Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15002024-03-30T05:45:43.342Z+ [[ 23 -gt 60 ]]
15012024-03-30T05:45:43.342Z+ sleep 1
15022024-03-30T05:45:44.341Z+ retry=24
15032024-03-30T05:45:44.341Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15042024-03-30T05:45:44.372Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15052024-03-30T05:45:44.372Z+ [[ 24 -gt 60 ]]
15062024-03-30T05:45:44.372Z+ sleep 1
15072024-03-30T05:45:45.348Z+ retry=25
15082024-03-30T05:45:45.348Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15092024-03-30T05:45:45.372Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15102024-03-30T05:45:45.372Z+ [[ 25 -gt 60 ]]
15112024-03-30T05:45:45.372Z+ sleep 1
15122024-03-30T05:45:46.367Z+ retry=26
15132024-03-30T05:45:46.367Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15142024-03-30T05:45:46.391Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15152024-03-30T05:45:46.391Z+ [[ 26 -gt 60 ]]
15162024-03-30T05:45:46.391Z+ sleep 1
15172024-03-30T05:45:47.384Z+ retry=27
15182024-03-30T05:45:47.384Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15192024-03-30T05:45:47.414Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15202024-03-30T05:45:47.414Z+ [[ 27 -gt 60 ]]
15212024-03-30T05:45:47.414Z+ sleep 1
15222024-03-30T05:45:48.394Z+ retry=28
15232024-03-30T05:45:48.394Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15242024-03-30T05:45:48.427Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15252024-03-30T05:45:48.427Z+ [[ 28 -gt 60 ]]
15262024-03-30T05:45:48.427Z+ sleep 1
15272024-03-30T05:45:49.410Z+ retry=29
15282024-03-30T05:45:49.410Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15292024-03-30T05:45:49.434Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15302024-03-30T05:45:49.434Z+ [[ 29 -gt 60 ]]
15312024-03-30T05:45:49.434Z+ sleep 1
15322024-03-30T05:45:50.426Z+ retry=30
15332024-03-30T05:45:50.426Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15342024-03-30T05:45:50.451Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15352024-03-30T05:45:50.451Z+ [[ 30 -gt 60 ]]
15362024-03-30T05:45:50.451Z+ sleep 1
15372024-03-30T05:45:51.442Z+ retry=31
15382024-03-30T05:45:51.442Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15392024-03-30T05:45:51.467Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15402024-03-30T05:45:51.467Z+ [[ 31 -gt 60 ]]
15412024-03-30T05:45:51.467Z+ sleep 1
15422024-03-30T05:45:52.457Z+ retry=32
15432024-03-30T05:45:52.457Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15442024-03-30T05:45:52.487Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15452024-03-30T05:45:52.487Z+ [[ 32 -gt 60 ]]
15462024-03-30T05:45:52.487Z+ sleep 1
15472024-03-30T05:45:53.473Z+ retry=33
15482024-03-30T05:45:53.473Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15492024-03-30T05:45:53.497Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15502024-03-30T05:45:53.497Z+ [[ 33 -gt 60 ]]
15512024-03-30T05:45:53.497Z+ sleep 1
15522024-03-30T05:45:54.488Z+ retry=34
15532024-03-30T05:45:54.489Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15542024-03-30T05:45:54.512Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15552024-03-30T05:45:54.512Z+ [[ 34 -gt 60 ]]
15562024-03-30T05:45:54.512Z+ sleep 1
15572024-03-30T05:45:55.504Z+ retry=35
15582024-03-30T05:45:55.504Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15592024-03-30T05:45:55.527Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15602024-03-30T05:45:55.527Z+ [[ 35 -gt 60 ]]
15612024-03-30T05:45:55.527Z+ sleep 1
15622024-03-30T05:45:56.529Z+ retry=36
15632024-03-30T05:45:56.529Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15642024-03-30T05:45:56.560Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15652024-03-30T05:45:56.561Z+ [[ 36 -gt 60 ]]
15662024-03-30T05:45:56.561Z+ sleep 1
15672024-03-30T05:45:57.535Z+ retry=37
15682024-03-30T05:45:57.535Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15692024-03-30T05:45:57.559Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15702024-03-30T05:45:57.560Z+ [[ 37 -gt 60 ]]
15712024-03-30T05:45:57.560Z+ sleep 1
15722024-03-30T05:45:58.550Z+ retry=38
15732024-03-30T05:45:58.550Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15742024-03-30T05:45:58.574Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15752024-03-30T05:45:58.574Z+ [[ 38 -gt 60 ]]
15762024-03-30T05:45:58.574Z+ sleep 1
15772024-03-30T05:45:59.567Z+ retry=39
15782024-03-30T05:45:59.567Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15792024-03-30T05:45:59.593Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15802024-03-30T05:45:59.593Z+ [[ 39 -gt 60 ]]
15812024-03-30T05:45:59.593Z+ sleep 1
15822024-03-30T05:46:00.597Z+ retry=40
15832024-03-30T05:46:00.597Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15842024-03-30T05:46:00.623Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15852024-03-30T05:46:00.624Z+ [[ 40 -gt 60 ]]
15862024-03-30T05:46:00.624Z+ sleep 1
15872024-03-30T05:46:01.598Z+ retry=41
15882024-03-30T05:46:01.598Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15892024-03-30T05:46:01.622Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15902024-03-30T05:46:01.622Z+ [[ 41 -gt 60 ]]
15912024-03-30T05:46:01.622Z+ sleep 1
15922024-03-30T05:46:02.621Z+ retry=42
15932024-03-30T05:46:02.621Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15942024-03-30T05:46:02.649Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
15952024-03-30T05:46:02.649Z+ [[ 42 -gt 60 ]]
15962024-03-30T05:46:02.649Z+ sleep 1
15972024-03-30T05:46:03.627Z+ retry=43
15982024-03-30T05:46:03.628Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
15992024-03-30T05:46:03.652Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16002024-03-30T05:46:03.653Z+ [[ 43 -gt 60 ]]
16012024-03-30T05:46:03.653Z+ sleep 1
16022024-03-30T05:46:04.642Z+ retry=44
16032024-03-30T05:46:04.642Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16042024-03-30T05:46:04.666Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16052024-03-30T05:46:04.666Z+ [[ 44 -gt 60 ]]
16062024-03-30T05:46:04.666Z+ sleep 1
16072024-03-30T05:46:05.660Z+ retry=45
16082024-03-30T05:46:05.660Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16092024-03-30T05:46:05.688Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16102024-03-30T05:46:05.688Z+ [[ 45 -gt 60 ]]
16112024-03-30T05:46:05.688Z+ sleep 1
16122024-03-30T05:46:06.677Z+ retry=46
16132024-03-30T05:46:06.677Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16142024-03-30T05:46:06.705Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16152024-03-30T05:46:06.705Z+ [[ 46 -gt 60 ]]
16162024-03-30T05:46:06.705Z+ sleep 1
16172024-03-30T05:46:07.689Z+ retry=47
16182024-03-30T05:46:07.689Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16192024-03-30T05:46:07.714Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
16202024-03-30T05:46:07.714Z+ [[ 47 -gt 60 ]]
16212024-03-30T05:46:07.714Z+ sleep 1
16222024-03-30T05:46:08.705Z+ retry=48
16232024-03-30T05:46:08.705Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
16242024-03-30T05:46:08.788Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
16252024-03-30T05:46:09.263Z{"status":"ok"}success
16262024-03-30T05:46:09.264ZProject {
16272024-03-30T05:46:09.288Z description: "some images",
16282024-03-30T05:46:09.289Z id: bafb2abe-de4c-431f-97b0-84aada811b08,
16292024-03-30T05:46:09.289Z name: Name(
16302024-03-30T05:46:09.289Z "images",
16312024-03-30T05:46:09.289Z ),
16322024-03-30T05:46:09.290Z time_created: 2024-03-30T05:46:08.968607Z,
16332024-03-30T05:46:09.290Z time_modified: 2024-03-30T05:46:08.968607Z,
16342024-03-30T05:46:09.290Z}
16352024-03-30T05:46:09.290Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
16362024-03-30T05:51:45.320Zdone!
16372024-03-30T05:51:45.420Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
16382024-03-30T05:51:45.531Zsuccess
16392024-03-30T05:51:45.531ZImage {
16402024-03-30T05:51:45.555Z block_size: ByteCount(
16412024-03-30T05:51:45.555Z 512,
16422024-03-30T05:51:45.555Z ),
16432024-03-30T05:51:45.555Z description: "debian 11 original base image",
16442024-03-30T05:51:45.555Z digest: None,
16452024-03-30T05:51:45.555Z id: 1a3e3db4-9cd1-43f6-87fa-1063f4fe4040,
16462024-03-30T05:51:45.555Z name: Name(
16472024-03-30T05:51:45.555Z "debian11",
16482024-03-30T05:51:45.555Z ),
16492024-03-30T05:51:45.556Z os: "debian",
16502024-03-30T05:51:45.556Z project_id: None,
16512024-03-30T05:51:45.556Z size: ByteCount(
16522024-03-30T05:51:45.556Z 2147483648,
16532024-03-30T05:51:45.556Z ),
16542024-03-30T05:51:45.556Z time_created: 2024-03-30T05:51:45.283694Z,
16552024-03-30T05:51:45.556Z time_modified: 2024-03-30T05:51:45.511734Z,
16562024-03-30T05:51:45.556Z url: None,
16572024-03-30T05:51:45.556Z version: "11",
16582024-03-30T05:51:45.556Z}
16592024-03-30T05:51:45.556Z+ rm ./tests/bootstrap
16602024-03-30T05:51:45.612Z+ for test_bin in tests/*
16612024-03-30T05:51:45.612Z+ ./tests/bootstrap-84fc686bbe1391cf
16622024-03-30T05:51:45.677Z
16632024-03-30T05:51:45.677Zrunning 0 tests
16642024-03-30T05:51:45.677Z
16652024-03-30T05:51:45.677Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
16662024-03-30T05:51:45.677Z
16672024-03-30T05:51:45.702Z+ for test_bin in tests/*
16682024-03-30T05:51:45.702Z+ ./tests/commtest-522cd312e3be3808
16692024-03-30T05:51:45.727Z
16702024-03-30T05:51:45.727Zrunning 0 tests
16712024-03-30T05:51:45.727Z
16722024-03-30T05:51:45.727Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
16732024-03-30T05:51:45.727Z
16742024-03-30T05:51:45.751Z+ for test_bin in tests/*
16752024-03-30T05:51:45.751Z+ ./tests/dhcp_server-51ad6d99a44fc35f
16762024-03-30T05:51:45.781Z
16772024-03-30T05:51:45.782Zrunning 0 tests
16782024-03-30T05:51:45.782Z
16792024-03-30T05:51:45.806Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
16802024-03-30T05:51:45.806Z
16812024-03-30T05:51:45.806Z+ for test_bin in tests/*
16822024-03-30T05:51:45.806Z+ ./tests/end_to_end_tests-7d252aeafffd2c0c
16832024-03-30T05:51:46.271Z
16842024-03-30T05:51:46.272Zrunning 2 tests
16852024-03-30T05:51:46.535Ztest no_spoof::no_spoof_here ... ok
16862024-03-30T05:52:11.661Ztest instance_launch::instance_launch ... ok
16872024-03-30T05:52:11.686Z
16882024-03-30T05:52:11.686Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 25.39s
16892024-03-30T05:52:11.687Z
16902024-03-30T05:52:11.687Z+ _exit_trap
16912024-03-30T05:52:11.687Z+ local status=0
16922024-03-30T05:52:11.687Z+ [[ 0 -eq 0 ]]
16932024-03-30T05:52:11.687Z+ exit 0
16942024-03-30T05:52:11.687Zprocess exited: duration 661123 ms, exit code 0
 
16952024-03-30T05:52:11.821Zfound 181 output files
16962024-03-30T05:52:12.111Zuploading: /var/svc/log/oxide-sled-agent:default.log (1622059 bytes)
16972024-03-30T05:52:13.602Zuploaded: /var/svc/log/oxide-sled-agent:default.log
16982024-03-30T05:52:13.602Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (1950735 bytes)
16992024-03-30T05:52:15.278Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 1950735 -> 1966246
17002024-03-30T05:52:16.348Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
17012024-03-30T05:52:16.348Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (638698 bytes)
17022024-03-30T05:52:17.656Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
17032024-03-30T05:52:17.656Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (0 bytes)
17042024-03-30T05:52:18.729Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
17052024-03-30T05:52:18.729Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0 (52288 bytes)
17062024-03-30T05:52:19.905Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0
17072024-03-30T05:52:19.905Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (187380 bytes)
17082024-03-30T05:52:20.089Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 187380 -> 190574
17092024-03-30T05:52:21.158Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
17102024-03-30T05:52:21.158Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (25462 bytes)
17112024-03-30T05:52:22.296Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
17122024-03-30T05:52:22.297Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (237825 bytes)
17132024-03-30T05:52:22.496Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 237825 -> 241815
17142024-03-30T05:52:23.565Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
17152024-03-30T05:52:23.565Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (25561 bytes)
17162024-03-30T05:52:24.711Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
17172024-03-30T05:52:24.711Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1030525 bytes)
17182024-03-30T05:52:24.987Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1030525 -> 1049694
17192024-03-30T05:52:26.056Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
17202024-03-30T05:52:26.057Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (317551 bytes)
17212024-03-30T05:52:27.327Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
17222024-03-30T05:52:27.328Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (573892 bytes)
17232024-03-30T05:52:27.588Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 573892 -> 591876
17242024-03-30T05:52:28.661Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
17252024-03-30T05:52:28.662Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (183691 bytes)
17262024-03-30T05:52:29.887Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
17272024-03-30T05:52:29.887Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
17282024-03-30T05:52:31.428Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
17292024-03-30T05:52:31.428Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
17302024-03-30T05:52:32.526Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
17312024-03-30T05:52:32.550Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (209445 bytes)
17322024-03-30T05:52:33.031Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 209445 -> 220550
17332024-03-30T05:52:34.100Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
17342024-03-30T05:52:34.100Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (62469 bytes)
17352024-03-30T05:52:35.370Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
17362024-03-30T05:52:35.371Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (8326 bytes)
17372024-03-30T05:52:36.483Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
17382024-03-30T05:52:36.483Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes)
17392024-03-30T05:52:37.577Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
17402024-03-30T05:52:37.577Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
17412024-03-30T05:52:38.660Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
17422024-03-30T05:52:38.660Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5392 bytes)
17432024-03-30T05:52:39.752Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
17442024-03-30T05:52:39.753Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_cockroachdb_f597bf55-7c6a-456c-8e41-286fd5037349/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
17452024-03-30T05:52:40.825Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_cockroachdb_f597bf55-7c6a-456c-8e41-286fd5037349/root/var/svc/log/oxide-cockroachdb:default.log
17462024-03-30T05:52:40.825Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_cockroachdb_f597bf55-7c6a-456c-8e41-286fd5037349/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
17472024-03-30T05:52:41.918Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_cockroachdb_f597bf55-7c6a-456c-8e41-286fd5037349/root/var/svc/log/oxide-cockroachdb:default.log.0
17482024-03-30T05:52:41.918Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_cockroachdb_f597bf55-7c6a-456c-8e41-286fd5037349/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
17492024-03-30T05:52:42.990Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_cockroachdb_f597bf55-7c6a-456c-8e41-286fd5037349/root/var/svc/log/oxide-zone-network-setup:default.log
17502024-03-30T05:52:42.990Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_cockroachdb_f597bf55-7c6a-456c-8e41-286fd5037349/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
17512024-03-30T05:52:44.097Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_cockroachdb_f597bf55-7c6a-456c-8e41-286fd5037349/root/var/svc/log/oxide-zone-network-setup:default.log.0
17522024-03-30T05:52:44.097Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-agent:default.log (29859 bytes)
17532024-03-30T05:52:45.262Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-agent:default.log
17542024-03-30T05:52:45.262Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
17552024-03-30T05:52:46.358Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-agent:default.log.0
17562024-03-30T05:52:46.358Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
17572024-03-30T05:52:47.431Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:default.log
17582024-03-30T05:52:47.431Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
17592024-03-30T05:52:48.532Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:default.log.0
17602024-03-30T05:52:48.532Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:downstairs-0c3cb8ae-8460-4b90-8255-6032d26b6237.log (3112 bytes)
17612024-03-30T05:52:49.628Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:downstairs-0c3cb8ae-8460-4b90-8255-6032d26b6237.log
17622024-03-30T05:52:49.628Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:downstairs-30022201-864b-494b-95e5-25d03cc88469.log (5674 bytes)
17632024-03-30T05:52:50.721Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:downstairs-30022201-864b-494b-95e5-25d03cc88469.log
17642024-03-30T05:52:50.722Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:downstairs-7ccbc65b-ddc6-4cbf-8ab1-becc50d657bf.log (3020 bytes)
17652024-03-30T05:52:51.822Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:downstairs-7ccbc65b-ddc6-4cbf-8ab1-becc50d657bf.log
17662024-03-30T05:52:51.822Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:snapshot-30022201-864b-494b-95e5-25d03cc88469-df132503-9198-4173-b67d-ac960c2931e9.log (5306 bytes)
17672024-03-30T05:52:52.918Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-crucible-downstairs:snapshot-30022201-864b-494b-95e5-25d03cc88469-df132503-9198-4173-b67d-ac960c2931e9.log
17682024-03-30T05:52:52.918Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
17692024-03-30T05:52:53.992Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-zone-network-setup:default.log
17702024-03-30T05:52:53.992Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
17712024-03-30T05:52:55.087Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_525c4f1a-5d69-4ecf-a43b-162fb1134523/root/var/svc/log/oxide-zone-network-setup:default.log.0
17722024-03-30T05:52:55.088Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_pantry_f4d5df0a-748d-40ab-8235-7c927aae50ce/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
17732024-03-30T05:52:56.165Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_pantry_f4d5df0a-748d-40ab-8235-7c927aae50ce/root/var/svc/log/oxide-crucible-pantry:default.log
17742024-03-30T05:52:56.165Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_pantry_f4d5df0a-748d-40ab-8235-7c927aae50ce/root/var/svc/log/oxide-crucible-pantry:default.log.0 (780 bytes)
17752024-03-30T05:52:57.260Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_pantry_f4d5df0a-748d-40ab-8235-7c927aae50ce/root/var/svc/log/oxide-crucible-pantry:default.log.0
17762024-03-30T05:52:57.261Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_pantry_f4d5df0a-748d-40ab-8235-7c927aae50ce/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
17772024-03-30T05:52:58.333Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_pantry_f4d5df0a-748d-40ab-8235-7c927aae50ce/root/var/svc/log/oxide-zone-network-setup:default.log
17782024-03-30T05:52:58.333Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_pantry_f4d5df0a-748d-40ab-8235-7c927aae50ce/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1744 bytes)
17792024-03-30T05:52:59.432Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_crucible_pantry_f4d5df0a-748d-40ab-8235-7c927aae50ce/root/var/svc/log/oxide-zone-network-setup:default.log.0
17802024-03-30T05:52:59.432Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-external_dns:default.log (30433 bytes)
17812024-03-30T05:53:00.640Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-external_dns:default.log
17822024-03-30T05:53:00.665Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-external_dns:default.log.0 (119 bytes)
17832024-03-30T05:53:01.736Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-external_dns:default.log.0
17842024-03-30T05:53:01.736Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-opte-interface-setup:default.log (571 bytes)
17852024-03-30T05:53:02.836Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-opte-interface-setup:default.log
17862024-03-30T05:53:02.836Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (617 bytes)
17872024-03-30T05:53:03.943Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-opte-interface-setup:default.log.0
17882024-03-30T05:53:03.943Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
17892024-03-30T05:53:05.014Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-zone-network-setup:default.log
17902024-03-30T05:53:05.014Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1726 bytes)
17912024-03-30T05:53:06.110Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_external_dns_dbd59cbf-fa3e-4fe2-b758-b2a136ae25a8/root/var/svc/log/oxide-zone-network-setup:default.log.0
17922024-03-30T05:53:06.110Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_internal_dns_c037c9e2-43a2-432a-bcd7-352e08f26490/root/var/svc/log/oxide-internal_dns:default.log (27531 bytes)
17932024-03-30T05:53:07.295Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_internal_dns_c037c9e2-43a2-432a-bcd7-352e08f26490/root/var/svc/log/oxide-internal_dns:default.log
17942024-03-30T05:53:07.295Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_internal_dns_c037c9e2-43a2-432a-bcd7-352e08f26490/root/var/svc/log/oxide-internal_dns:default.log.0 (88618 bytes)
17952024-03-30T05:53:08.641Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_internal_dns_c037c9e2-43a2-432a-bcd7-352e08f26490/root/var/svc/log/oxide-internal_dns:default.log.0
17962024-03-30T05:53:08.641Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_internal_dns_c037c9e2-43a2-432a-bcd7-352e08f26490/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
17972024-03-30T05:53:09.713Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_internal_dns_c037c9e2-43a2-432a-bcd7-352e08f26490/root/var/svc/log/oxide-zone-network-setup:default.log
17982024-03-30T05:53:09.713Zuploading: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_internal_dns_c037c9e2-43a2-432a-bcd7-352e08f26490/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
17992024-03-30T05:53:10.810Zuploaded: /pool/ext/28899eb6-914e-44b6-b77e-9d82d92186d6/crypt/zone/oxz_internal_dns_c037c9e2-43a2-432a-bcd7-352e08f26490/root/var/svc/log/oxide-zone-network-setup:default.log.0
18002024-03-30T05:53:10.810Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
18012024-03-30T05:53:11.881Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-crucible-agent:default.log
18022024-03-30T05:53:11.881Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
18032024-03-30T05:53:12.982Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-crucible-agent:default.log.0
18042024-03-30T05:53:12.982Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
18052024-03-30T05:53:14.049Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-crucible-downstairs:default.log
18062024-03-30T05:53:14.049Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
18072024-03-30T05:53:15.146Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-crucible-downstairs:default.log.0
18082024-03-30T05:53:15.146Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18092024-03-30T05:53:16.220Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-zone-network-setup:default.log
18102024-03-30T05:53:16.244Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
18112024-03-30T05:53:17.326Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_crucible_06241231-d15c-4adb-ae5b-e8e364e35528/root/var/svc/log/oxide-zone-network-setup:default.log.0
18122024-03-30T05:53:17.326Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-nexus:default.log (3041676 bytes)
18132024-03-30T05:53:20.324Zupload warning: file "/pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 3041676 -> 3253675
18142024-03-30T05:53:21.394Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-nexus:default.log
18152024-03-30T05:53:21.394Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-nexus:default.log.0 (119 bytes)
18162024-03-30T05:53:22.493Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-nexus:default.log.0
18172024-03-30T05:53:22.493Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-opte-interface-setup:default.log (557 bytes)
18182024-03-30T05:53:23.591Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-opte-interface-setup:default.log
18192024-03-30T05:53:23.591Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (610 bytes)
18202024-03-30T05:53:24.684Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-opte-interface-setup:default.log.0
18212024-03-30T05:53:24.684Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18222024-03-30T05:53:25.756Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-zone-network-setup:default.log
18232024-03-30T05:53:25.756Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1682 bytes)
18242024-03-30T05:53:26.852Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_3b85f16b-9ecd-4867-ae56-7f8a1f492a4d/root/var/svc/log/oxide-zone-network-setup:default.log.0
18252024-03-30T05:53:26.852Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-nexus:default.log (35287801 bytes)
18262024-03-30T05:53:41.130Zupload warning: file "/pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 35287801 -> 35560743
18272024-03-30T05:53:42.211Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-nexus:default.log
18282024-03-30T05:53:42.211Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-nexus:default.log.0 (119 bytes)
18292024-03-30T05:53:43.309Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-nexus:default.log.0
18302024-03-30T05:53:43.310Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-opte-interface-setup:default.log (557 bytes)
18312024-03-30T05:53:44.404Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-opte-interface-setup:default.log
18322024-03-30T05:53:44.404Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (610 bytes)
18332024-03-30T05:53:45.501Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-opte-interface-setup:default.log.0
18342024-03-30T05:53:45.501Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18352024-03-30T05:53:46.573Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-zone-network-setup:default.log
18362024-03-30T05:53:46.573Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1684 bytes)
18372024-03-30T05:53:47.694Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_nexus_f33d72e6-7ea4-4e54-8bfc-dc4233c612c4/root/var/svc/log/oxide-zone-network-setup:default.log.0
18382024-03-30T05:53:47.694Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-oximeter:default.log (1326989 bytes)
18392024-03-30T05:53:49.452Zupload warning: file "/pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 1326989 -> 1634566
18402024-03-30T05:53:50.525Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-oximeter:default.log
18412024-03-30T05:53:50.549Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-oximeter:default.log.0 (6404 bytes)
18422024-03-30T05:53:51.631Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-oximeter:default.log.0
18432024-03-30T05:53:51.632Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18442024-03-30T05:53:52.707Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-zone-network-setup:default.log
18452024-03-30T05:53:52.707Zuploading: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1702 bytes)
18462024-03-30T05:53:53.808Zuploaded: /pool/ext/3c92b6bd-8180-45a3-9123-a99ddc649159/crypt/zone/oxz_oximeter_b6a17b0f-0906-4eb9-94c3-528d000f68dc/root/var/svc/log/oxide-zone-network-setup:default.log.0
18472024-03-30T05:53:53.809Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_cockroachdb_f7108ea5-965b-4e70-a9a0-7ffd5d13885f/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
18482024-03-30T05:53:54.886Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_cockroachdb_f7108ea5-965b-4e70-a9a0-7ffd5d13885f/root/var/svc/log/oxide-cockroachdb:default.log
18492024-03-30T05:53:54.886Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_cockroachdb_f7108ea5-965b-4e70-a9a0-7ffd5d13885f/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
18502024-03-30T05:53:55.982Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_cockroachdb_f7108ea5-965b-4e70-a9a0-7ffd5d13885f/root/var/svc/log/oxide-cockroachdb:default.log.0
18512024-03-30T05:53:55.983Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_cockroachdb_f7108ea5-965b-4e70-a9a0-7ffd5d13885f/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18522024-03-30T05:53:57.058Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_cockroachdb_f7108ea5-965b-4e70-a9a0-7ffd5d13885f/root/var/svc/log/oxide-zone-network-setup:default.log
18532024-03-30T05:53:57.058Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_cockroachdb_f7108ea5-965b-4e70-a9a0-7ffd5d13885f/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
18542024-03-30T05:53:58.153Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_cockroachdb_f7108ea5-965b-4e70-a9a0-7ffd5d13885f/root/var/svc/log/oxide-zone-network-setup:default.log.0
18552024-03-30T05:53:58.153Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
18562024-03-30T05:53:59.226Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-crucible-agent:default.log
18572024-03-30T05:53:59.226Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
18582024-03-30T05:54:00.327Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-crucible-agent:default.log.0
18592024-03-30T05:54:00.327Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
18602024-03-30T05:54:01.400Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-crucible-downstairs:default.log
18612024-03-30T05:54:01.400Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
18622024-03-30T05:54:02.495Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-crucible-downstairs:default.log.0
18632024-03-30T05:54:02.495Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18642024-03-30T05:54:03.568Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-zone-network-setup:default.log
18652024-03-30T05:54:03.568Zuploading: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
18662024-03-30T05:54:04.666Zuploaded: /pool/ext/5c3019ca-328c-47ab-9982-06e092199db8/crypt/zone/oxz_crucible_47a9dbe8-5005-4fee-bb98-58944f67aa76/root/var/svc/log/oxide-zone-network-setup:default.log.0
18672024-03-30T05:54:04.666Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_cockroachdb_ddf7c878-622c-4bc8-8b0b-5a158ff3b198/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
18682024-03-30T05:54:05.750Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_cockroachdb_ddf7c878-622c-4bc8-8b0b-5a158ff3b198/root/var/svc/log/oxide-cockroachdb:default.log
18692024-03-30T05:54:05.750Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_cockroachdb_ddf7c878-622c-4bc8-8b0b-5a158ff3b198/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes)
18702024-03-30T05:54:06.846Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_cockroachdb_ddf7c878-622c-4bc8-8b0b-5a158ff3b198/root/var/svc/log/oxide-cockroachdb:default.log.0
18712024-03-30T05:54:06.847Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_cockroachdb_ddf7c878-622c-4bc8-8b0b-5a158ff3b198/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18722024-03-30T05:54:07.921Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_cockroachdb_ddf7c878-622c-4bc8-8b0b-5a158ff3b198/root/var/svc/log/oxide-zone-network-setup:default.log
18732024-03-30T05:54:07.921Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_cockroachdb_ddf7c878-622c-4bc8-8b0b-5a158ff3b198/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
18742024-03-30T05:54:09.019Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_cockroachdb_ddf7c878-622c-4bc8-8b0b-5a158ff3b198/root/var/svc/log/oxide-zone-network-setup:default.log.0
18752024-03-30T05:54:09.019Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-agent:default.log (26854 bytes)
18762024-03-30T05:54:10.577Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-agent:default.log
18772024-03-30T05:54:10.601Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
18782024-03-30T05:54:11.687Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-agent:default.log.0
18792024-03-30T05:54:11.714Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
18802024-03-30T05:54:12.757Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:default.log
18812024-03-30T05:54:12.757Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
18822024-03-30T05:54:19.042Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:default.log.0
18832024-03-30T05:54:19.042Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ab54824-1774-493c-9fbd-5f075798645c.log (3113 bytes)
18842024-03-30T05:54:20.115Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ab54824-1774-493c-9fbd-5f075798645c.log
18852024-03-30T05:54:20.139Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:downstairs-b9a0508f-95f4-40ac-88e9-b00359786958.log (5610 bytes)
18862024-03-30T05:54:21.212Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:downstairs-b9a0508f-95f4-40ac-88e9-b00359786958.log
18872024-03-30T05:54:21.212Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:downstairs-ec213cb3-eb72-47b9-a827-9dde700237ee.log (3017 bytes)
18882024-03-30T05:54:22.310Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-crucible-downstairs:downstairs-ec213cb3-eb72-47b9-a827-9dde700237ee.log
18892024-03-30T05:54:22.310Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18902024-03-30T05:54:23.382Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-zone-network-setup:default.log
18912024-03-30T05:54:23.382Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
18922024-03-30T05:54:24.481Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_0a93b238-dc4f-4234-98ad-cf545c1b8ea6/root/var/svc/log/oxide-zone-network-setup:default.log.0
18932024-03-30T05:54:24.481Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_pantry_a684a100-6031-4b97-8de3-41e15037fbd5/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
18942024-03-30T05:54:25.553Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_pantry_a684a100-6031-4b97-8de3-41e15037fbd5/root/var/svc/log/oxide-crucible-pantry:default.log
18952024-03-30T05:54:25.553Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_pantry_a684a100-6031-4b97-8de3-41e15037fbd5/root/var/svc/log/oxide-crucible-pantry:default.log.0 (783 bytes)
18962024-03-30T05:54:26.652Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_pantry_a684a100-6031-4b97-8de3-41e15037fbd5/root/var/svc/log/oxide-crucible-pantry:default.log.0
18972024-03-30T05:54:26.652Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_pantry_a684a100-6031-4b97-8de3-41e15037fbd5/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
18982024-03-30T05:54:27.723Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_pantry_a684a100-6031-4b97-8de3-41e15037fbd5/root/var/svc/log/oxide-zone-network-setup:default.log
18992024-03-30T05:54:27.723Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_pantry_a684a100-6031-4b97-8de3-41e15037fbd5/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1745 bytes)
19002024-03-30T05:54:28.818Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_crucible_pantry_a684a100-6031-4b97-8de3-41e15037fbd5/root/var/svc/log/oxide-zone-network-setup:default.log.0
19012024-03-30T05:54:28.818Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-internal_dns:default.log (27539 bytes)
19022024-03-30T05:54:28.935Zupload warning: file "/pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27539 -> 35046
19032024-03-30T05:54:30.007Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-internal_dns:default.log
19042024-03-30T05:54:30.007Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-internal_dns:default.log.0 (88631 bytes)
19052024-03-30T05:54:31.214Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-internal_dns:default.log.0
19062024-03-30T05:54:31.214Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
19072024-03-30T05:54:32.286Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-zone-network-setup:default.log
19082024-03-30T05:54:32.286Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
19092024-03-30T05:54:33.381Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_internal_dns_655db966-87f1-48aa-8868-000f036af1b2/root/var/svc/log/oxide-zone-network-setup:default.log.0
19102024-03-30T05:54:33.381Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-nexus:default.log (2681922 bytes)
19112024-03-30T05:54:35.459Zupload warning: file "/pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2681922 -> 3356184
19122024-03-30T05:54:36.529Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-nexus:default.log
19132024-03-30T05:54:36.530Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-nexus:default.log.0 (119 bytes)
19142024-03-30T05:54:37.627Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-nexus:default.log.0
19152024-03-30T05:54:37.627Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-opte-interface-setup:default.log (557 bytes)
19162024-03-30T05:54:38.725Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-opte-interface-setup:default.log
19172024-03-30T05:54:38.750Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (610 bytes)
19182024-03-30T05:54:39.822Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-opte-interface-setup:default.log.0
19192024-03-30T05:54:39.822Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
19202024-03-30T05:54:40.894Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-zone-network-setup:default.log
19212024-03-30T05:54:40.894Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1683 bytes)
19222024-03-30T05:54:42.001Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_nexus_cca30d41-f76f-4c5a-92f4-bb1cde1c17bd/root/var/svc/log/oxide-zone-network-setup:default.log.0
19232024-03-30T05:54:42.001Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-ntp:default.log (137 bytes)
19242024-03-30T05:54:42.051Zupload warning: file "/pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 137 -> 204
19252024-03-30T05:54:43.123Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-ntp:default.log
19262024-03-30T05:54:43.123Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-ntp:default.log.0 (1179 bytes)
19272024-03-30T05:54:44.220Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-ntp:default.log.0
19282024-03-30T05:54:44.220Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
19292024-03-30T05:54:45.292Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-opte-interface-setup:default.log
19302024-03-30T05:54:45.292Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1158 bytes)
19312024-03-30T05:54:46.392Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-opte-interface-setup:default.log.0
19322024-03-30T05:54:46.392Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
19332024-03-30T05:54:47.463Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-zone-network-setup:default.log
19342024-03-30T05:54:47.464Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1665 bytes)
19352024-03-30T05:54:48.561Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/svc/log/oxide-zone-network-setup:default.log.0
19362024-03-30T05:54:48.561Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-clickhouse:default.log (2252553 bytes)
19372024-03-30T05:54:50.591Zupload warning: file "/pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 2252553 -> 3070568
19382024-03-30T05:54:51.677Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-clickhouse:default.log
19392024-03-30T05:54:51.677Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-clickhouse:default.log.0 (1289 bytes)
19402024-03-30T05:54:52.776Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-clickhouse:default.log.0
19412024-03-30T05:54:52.776Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
19422024-03-30T05:54:53.856Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-zone-network-setup:default.log
19432024-03-30T05:54:53.856Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1714 bytes)
19442024-03-30T05:54:54.950Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_clickhouse_8bf3945e-e049-4e64-8e87-3d72b2744d88/root/var/svc/log/oxide-zone-network-setup:default.log.0
19452024-03-30T05:54:54.950Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_cockroachdb_f7311d36-617f-4f72-be7a-3427dc69c306/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
19462024-03-30T05:54:56.023Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_cockroachdb_f7311d36-617f-4f72-be7a-3427dc69c306/root/var/svc/log/oxide-cockroachdb:default.log
19472024-03-30T05:54:56.047Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_cockroachdb_f7311d36-617f-4f72-be7a-3427dc69c306/root/var/svc/log/oxide-cockroachdb:default.log.0 (4405 bytes)
19482024-03-30T05:54:57.117Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_cockroachdb_f7311d36-617f-4f72-be7a-3427dc69c306/root/var/svc/log/oxide-cockroachdb:default.log.0
19492024-03-30T05:54:57.117Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_cockroachdb_f7311d36-617f-4f72-be7a-3427dc69c306/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
19502024-03-30T05:54:58.193Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_cockroachdb_f7311d36-617f-4f72-be7a-3427dc69c306/root/var/svc/log/oxide-zone-network-setup:default.log
19512024-03-30T05:54:58.193Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_cockroachdb_f7311d36-617f-4f72-be7a-3427dc69c306/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
19522024-03-30T05:54:59.288Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_cockroachdb_f7311d36-617f-4f72-be7a-3427dc69c306/root/var/svc/log/oxide-zone-network-setup:default.log.0
19532024-03-30T05:54:59.288Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-agent:default.log (20960 bytes)
19542024-03-30T05:55:00.435Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-agent:default.log
19552024-03-30T05:55:00.435Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
19562024-03-30T05:55:01.534Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-agent:default.log.0
19572024-03-30T05:55:01.534Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
19582024-03-30T05:55:02.613Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-downstairs:default.log
19592024-03-30T05:55:02.613Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
19602024-03-30T05:55:03.709Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-downstairs:default.log.0
19612024-03-30T05:55:03.709Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-downstairs:downstairs-5533c111-2905-41b6-b14a-cf7a0e39e42c.log (3114 bytes)
19622024-03-30T05:55:04.802Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-downstairs:downstairs-5533c111-2905-41b6-b14a-cf7a0e39e42c.log
19632024-03-30T05:55:04.803Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-downstairs:downstairs-6892b899-3348-4d71-89d9-f540ef51190d.log (5612 bytes)
19642024-03-30T05:55:05.922Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-crucible-downstairs:downstairs-6892b899-3348-4d71-89d9-f540ef51190d.log
19652024-03-30T05:55:05.922Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
19662024-03-30T05:55:06.993Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-zone-network-setup:default.log
19672024-03-30T05:55:06.993Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
19682024-03-30T05:55:08.087Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_crucible_648e5f66-03f8-489e-a2bb-91cee8654a72/root/var/svc/log/oxide-zone-network-setup:default.log.0
19692024-03-30T05:55:08.087Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-external_dns:default.log (30434 bytes)
19702024-03-30T05:55:08.264Zupload warning: file "/pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 30434 -> 37961
19712024-03-30T05:55:09.334Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-external_dns:default.log
19722024-03-30T05:55:09.334Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-external_dns:default.log.0 (119 bytes)
19732024-03-30T05:55:10.427Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-external_dns:default.log.0
19742024-03-30T05:55:10.427Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-opte-interface-setup:default.log (571 bytes)
19752024-03-30T05:55:11.526Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-opte-interface-setup:default.log
19762024-03-30T05:55:11.526Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (617 bytes)
19772024-03-30T05:55:12.625Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-opte-interface-setup:default.log.0
19782024-03-30T05:55:12.625Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
19792024-03-30T05:55:13.692Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-zone-network-setup:default.log
19802024-03-30T05:55:13.692Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1725 bytes)
19812024-03-30T05:55:14.785Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_external_dns_57425cdc-844b-42e3-b45f-c8fb7871161f/root/var/svc/log/oxide-zone-network-setup:default.log.0
19822024-03-30T05:55:14.785Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-internal_dns:default.log (27537 bytes)
19832024-03-30T05:55:14.962Zupload warning: file "/pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27537 -> 38805
19842024-03-30T05:55:16.035Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-internal_dns:default.log
19852024-03-30T05:55:16.035Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-internal_dns:default.log.0 (88632 bytes)
19862024-03-30T05:55:17.364Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-internal_dns:default.log.0
19872024-03-30T05:55:17.364Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
19882024-03-30T05:55:18.840Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-zone-network-setup:default.log
19892024-03-30T05:55:18.840Zuploading: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
19902024-03-30T05:55:19.536Zuploaded: /pool/ext/82347231-68ab-4934-8007-b28d9a3a3777/crypt/zone/oxz_internal_dns_55e16fed-0b39-4c9e-94aa-dbf1dfed9795/root/var/svc/log/oxide-zone-network-setup:default.log.0
19912024-03-30T05:55:19.536Zuploading: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
19922024-03-30T05:55:20.607Zuploaded: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-crucible-agent:default.log
19932024-03-30T05:55:20.608Zuploading: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-crucible-agent:default.log.0 (1326 bytes)
19942024-03-30T05:55:21.707Zuploaded: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-crucible-agent:default.log.0
19952024-03-30T05:55:21.707Zuploading: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
19962024-03-30T05:55:22.780Zuploaded: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-crucible-downstairs:default.log
19972024-03-30T05:55:22.780Zuploading: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
19982024-03-30T05:55:23.873Zuploaded: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-crucible-downstairs:default.log.0
19992024-03-30T05:55:23.873Zuploading: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
20002024-03-30T05:55:24.947Zuploaded: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-zone-network-setup:default.log
20012024-03-30T05:55:24.947Zuploading: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
20022024-03-30T05:55:26.042Zuploaded: /pool/ext/c7e0e489-6c2b-472e-8a1f-efe83bb548dd/crypt/zone/oxz_crucible_6eebe2cc-6b03-4cdd-bd4d-26af275d74bc/root/var/svc/log/oxide-zone-network-setup:default.log.0
20032024-03-30T05:55:26.042Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
20042024-03-30T05:55:27.114Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-crucible-agent:default.log
20052024-03-30T05:55:27.114Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
20062024-03-30T05:55:28.209Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-crucible-agent:default.log.0
20072024-03-30T05:55:28.209Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
20082024-03-30T05:55:29.279Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-crucible-downstairs:default.log
20092024-03-30T05:55:29.279Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
20102024-03-30T05:55:30.373Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-crucible-downstairs:default.log.0
20112024-03-30T05:55:30.373Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
20122024-03-30T05:55:31.445Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-zone-network-setup:default.log
20132024-03-30T05:55:31.473Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1703 bytes)
20142024-03-30T05:55:32.540Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_57f3dc22-0a8a-40ec-a7b7-137531501134/root/var/svc/log/oxide-zone-network-setup:default.log.0
20152024-03-30T05:55:32.540Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_pantry_23c9f9de-3736-4878-ba3b-118cebaacb82/root/var/svc/log/oxide-crucible-pantry:default.log (1224960 bytes)
20162024-03-30T05:55:34.426Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_pantry_23c9f9de-3736-4878-ba3b-118cebaacb82/root/var/svc/log/oxide-crucible-pantry:default.log
20172024-03-30T05:55:34.450Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_pantry_23c9f9de-3736-4878-ba3b-118cebaacb82/root/var/svc/log/oxide-crucible-pantry:default.log.0 (783 bytes)
20182024-03-30T05:55:35.522Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_pantry_23c9f9de-3736-4878-ba3b-118cebaacb82/root/var/svc/log/oxide-crucible-pantry:default.log.0
20192024-03-30T05:55:35.522Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_pantry_23c9f9de-3736-4878-ba3b-118cebaacb82/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
20202024-03-30T05:55:36.603Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_pantry_23c9f9de-3736-4878-ba3b-118cebaacb82/root/var/svc/log/oxide-zone-network-setup:default.log
20212024-03-30T05:55:36.603Zuploading: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_pantry_23c9f9de-3736-4878-ba3b-118cebaacb82/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1746 bytes)
20222024-03-30T05:55:37.701Zuploaded: /pool/ext/e22df0ad-bbf8-4902-93d6-e67ff23c3234/crypt/zone/oxz_crucible_pantry_23c9f9de-3736-4878-ba3b-118cebaacb82/root/var/svc/log/oxide-zone-network-setup:default.log.0
20232024-03-30T05:55:37.701Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_cockroachdb_9d0139eb-7e07-43fa-92d7-f8a6676bf465/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
20242024-03-30T05:55:38.771Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_cockroachdb_9d0139eb-7e07-43fa-92d7-f8a6676bf465/root/var/svc/log/oxide-cockroachdb:default.log
20252024-03-30T05:55:38.795Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_cockroachdb_9d0139eb-7e07-43fa-92d7-f8a6676bf465/root/var/svc/log/oxide-cockroachdb:default.log.0 (4379 bytes)
20262024-03-30T05:55:39.870Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_cockroachdb_9d0139eb-7e07-43fa-92d7-f8a6676bf465/root/var/svc/log/oxide-cockroachdb:default.log.0
20272024-03-30T05:55:39.895Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_cockroachdb_9d0139eb-7e07-43fa-92d7-f8a6676bf465/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
20282024-03-30T05:55:40.946Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_cockroachdb_9d0139eb-7e07-43fa-92d7-f8a6676bf465/root/var/svc/log/oxide-zone-network-setup:default.log
20292024-03-30T05:55:40.971Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_cockroachdb_9d0139eb-7e07-43fa-92d7-f8a6676bf465/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
20302024-03-30T05:55:42.043Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_cockroachdb_9d0139eb-7e07-43fa-92d7-f8a6676bf465/root/var/svc/log/oxide-zone-network-setup:default.log.0
20312024-03-30T05:55:42.070Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-agent:default.log (20037 bytes)
20322024-03-30T05:55:43.184Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-agent:default.log
20332024-03-30T05:55:43.184Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
20342024-03-30T05:55:44.279Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-agent:default.log.0
20352024-03-30T05:55:44.279Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
20362024-03-30T05:55:45.351Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:default.log
20372024-03-30T05:55:45.351Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
20382024-03-30T05:55:46.447Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:default.log.0
20392024-03-30T05:55:46.447Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:downstairs-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f.log (5675 bytes)
20402024-03-30T05:55:47.543Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:downstairs-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f.log
20412024-03-30T05:55:47.543Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:downstairs-49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3.log (3018 bytes)
20422024-03-30T05:55:48.637Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:downstairs-49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3.log
20432024-03-30T05:55:48.638Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:snapshot-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f-df132503-9198-4173-b67d-ac960c2931e9.log (5306 bytes)
20442024-03-30T05:55:49.734Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-crucible-downstairs:snapshot-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f-df132503-9198-4173-b67d-ac960c2931e9.log
20452024-03-30T05:55:49.734Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
20462024-03-30T05:55:50.808Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-zone-network-setup:default.log
20472024-03-30T05:55:50.808Zuploading: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1703 bytes)
20482024-03-30T05:55:51.904Zuploaded: /pool/ext/e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crypt/zone/oxz_crucible_80d3c328-30b9-4b19-852b-d0002f908859/root/var/svc/log/oxide-zone-network-setup:default.log.0
20492024-03-30T05:55:51.904Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-agent:default.log (23932 bytes)
20502024-03-30T05:55:53.045Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-agent:default.log
20512024-03-30T05:55:53.045Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
20522024-03-30T05:55:54.142Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-agent:default.log.0
20532024-03-30T05:55:54.142Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
20542024-03-30T05:55:55.214Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:default.log
20552024-03-30T05:55:55.214Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
20562024-03-30T05:55:56.311Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:default.log.0
20572024-03-30T05:55:56.311Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:downstairs-7b483a05-4e92-4624-bc91-51e6996da23a.log (5613 bytes)
20582024-03-30T05:55:57.409Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:downstairs-7b483a05-4e92-4624-bc91-51e6996da23a.log
20592024-03-30T05:55:57.409Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:downstairs-c1f70722-8fd3-4da5-a2eb-917ee27a0306.log (5672 bytes)
20602024-03-30T05:55:58.505Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:downstairs-c1f70722-8fd3-4da5-a2eb-917ee27a0306.log
20612024-03-30T05:55:58.505Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:snapshot-c1f70722-8fd3-4da5-a2eb-917ee27a0306-df132503-9198-4173-b67d-ac960c2931e9.log (5306 bytes)
20622024-03-30T05:55:59.601Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-crucible-downstairs:snapshot-c1f70722-8fd3-4da5-a2eb-917ee27a0306-df132503-9198-4173-b67d-ac960c2931e9.log
20632024-03-30T05:55:59.601Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
20642024-03-30T05:56:00.682Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-zone-network-setup:default.log
20652024-03-30T05:56:00.682Zuploading: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1702 bytes)
20662024-03-30T05:56:01.783Zuploaded: /pool/ext/ea19d3d4-e058-46fb-981b-9ccb255f563c/crypt/zone/oxz_crucible_22aed52b-11e9-4a7d-bebf-3356da024fc9/root/var/svc/log/oxide-zone-network-setup:default.log.0
20672024-03-30T05:56:01.783Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/measurements.log (21646 bytes)
20682024-03-30T05:56:01.902Zupload warning: file "/pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/measurements.log" changed size mid upload: 21646 -> 30140
20692024-03-30T05:56:02.984Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/measurements.log
20702024-03-30T05:56:02.985Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/statistics.log (14391 bytes)
20712024-03-30T05:56:03.069Zupload warning: file "/pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/statistics.log" changed size mid upload: 14391 -> 21528
20722024-03-30T05:56:04.140Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/statistics.log
20732024-03-30T05:56:04.140Zuploading: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/tracking.log (2117 bytes)
20742024-03-30T05:56:04.190Zupload warning: file "/pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/tracking.log" changed size mid upload: 2117 -> 2777
20752024-03-30T05:56:05.263Zuploaded: /pool/ext/6de8542c-123a-4abc-9a88-e72f1063a9f4/crypt/zone/oxz_ntp_2168e6f2-fbb0-4d6d-8811-9fd75847a2a7/root/var/log/chrony/tracking.log