01HSGS7TX0PCY5G78RGMNKZH5H: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HSGS8GRXMXAKJ32W45635926

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-03-21T15:53:51.389Zjob dependencies complete; ready to run (waiting for 39 m 1 s)
22024-03-21T17:48:07.437Zjob assigned to worker 01HSH1TBXJ5TB048V3214MYG6J (queued for 1 h 54 m 16 s)
32024-03-21T17:48:08.414Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-03-21T17:48:08.486Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-03-21T17:48:08.536Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-03-21T17:48:08.573Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-03-21T17:48:08.617Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-03-21T17:48:08.656ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-03-21T17:48:08.696Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-03-21T17:48:08.736ZOxide Helios Version helios-2.0.22550 64-bit
112024-03-21T17:48:08.784ZConfiguring devices.
122024-03-21T17:48:08.824Z##################################################
132024-03-21T17:48:08.872Z#### ############# ##
142024-03-21T17:48:08.925Z### ### ############ ##
152024-03-21T17:48:08.977Z## ### # ## ### ## Oxide Computer Company ##
162024-03-21T17:48:09.031Z## ## ## ### # ### ##
172024-03-21T17:48:09.095Z## # ### #### #### This Station Under ##
182024-03-21T17:48:09.135Z### ### #### # ### Computer Control ##
192024-03-21T17:48:09.176Z#### #### ### ## ##
202024-03-21T17:48:09.216Z##################################################
212024-03-21T17:48:09.256ZHostname: buskin
222024-03-21T17:48:09.293ZLoading smf(7) service descriptions:
232024-03-21T17:48:09.721Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-ebb6682cb4af86e9.gz
242024-03-21T17:48:12.919Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-ebb6682cb4af86e9.gz
252024-03-21T17:48:12.920Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-03-21T17:48:39.187Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-03-21T17:48:39.187Zdownloading input: /input/ci-tools/work/end-to-end-tests/commtest-eb80106b092225f5.gz
282024-03-21T17:48:42.294Zdownloaded input: /input/ci-tools/work/end-to-end-tests/commtest-eb80106b092225f5.gz
292024-03-21T17:48:42.294Zdownloading input: /input/ci-tools/work/end-to-end-tests/dhcp_server-5ee17f10b12b6e1e.gz
302024-03-21T17:48:44.294Zdownloaded input: /input/ci-tools/work/end-to-end-tests/dhcp_server-5ee17f10b12b6e1e.gz
312024-03-21T17:48:44.323Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2ddaeb260a344b4e.gz
322024-03-21T17:49:07.613Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2ddaeb260a344b4e.gz
332024-03-21T17:49:07.613Zdownloading input: /input/ci-tools/work/caboose-util.gz
342024-03-21T17:49:09.782Zdownloaded input: /input/ci-tools/work/caboose-util.gz
352024-03-21T17:49:09.814Zdownloading input: /input/ci-tools/work/tufaceous.gz
362024-03-21T17:49:13.376Zdownloaded input: /input/ci-tools/work/tufaceous.gz
372024-03-21T17:49:13.376Zdownloading input: /input/ci-tools/work/commtest
382024-03-21T17:52:48.842Zdownloaded input: /input/ci-tools/work/commtest
392024-03-21T17:52:49.298Zdownloading input: /input/package/work/version.txt
402024-03-21T17:52:49.336Zdownloaded input: /input/package/work/version.txt
412024-03-21T17:52:49.336Zdownloading input: /input/package/work/package.tar.gz
422024-03-21T17:53:11.309Zdownloaded input: /input/package/work/package.tar.gz
432024-03-21T17:53:11.337Zdownloading input: /input/package/work/global-zone-packages.tar.gz
442024-03-21T17:53:36.350Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
452024-03-21T17:53:36.350Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
462024-03-21T17:53:42.438Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
472024-03-21T17:53:42.476Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
482024-03-21T17:54:48.792Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
492024-03-21T17:54:48.792Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
502024-03-21T17:55:29.174Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
512024-03-21T17:55:29.174Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
522024-03-21T17:55:51.519Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
532024-03-21T17:55:51.519Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
542024-03-21T17:55:56.812Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
552024-03-21T17:55:56.812Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
562024-03-21T17:56:03.452Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
572024-03-21T17:56:03.453Zdownloading input: /input/package/work/zones/external-dns.tar.gz
582024-03-21T17:56:09.814Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
592024-03-21T17:56:09.840Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
602024-03-21T17:56:15.391Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
612024-03-21T17:56:15.391Zdownloading input: /input/package/work/zones/nexus-single-sled.tar.gz
622024-03-21T17:56:31.399Zdownloaded input: /input/package/work/zones/nexus-single-sled.tar.gz
632024-03-21T17:56:31.399Zdownloading input: /input/package/work/zones/nexus.tar.gz
642024-03-21T17:56:47.307Zdownloaded input: /input/package/work/zones/nexus.tar.gz
652024-03-21T17:56:47.307Zdownloading input: /input/package/work/zones/ntp.tar.gz
662024-03-21T17:56:49.348Zdownloaded input: /input/package/work/zones/ntp.tar.gz
672024-03-21T17:56:49.348Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
682024-03-21T17:56:52.569Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
692024-03-21T17:56:52.570Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
702024-03-21T17:56:58.690Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
712024-03-21T17:56:58.690Zdownloading input: /input/package/work/zones/overlay.tar.gz
722024-03-21T17:56:58.742Zdownloaded input: /input/package/work/zones/overlay.tar.gz
732024-03-21T17:56:58.742Zdownloading input: /input/package/work/zones/oximeter.tar.gz
742024-03-21T17:57:14.851Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
752024-03-21T17:57:14.851Zdownloading input: /input/package/work/zones/probe.tar.gz
762024-03-21T17:57:15.530Zdownloaded input: /input/package/work/zones/probe.tar.gz
772024-03-21T17:57:15.558Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
782024-03-21T17:57:28.929Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
792024-03-21T17:57:28.929Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
802024-03-21T17:58:21.635Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
812024-03-21T17:58:21.635Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
822024-03-21T17:58:58.592Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
832024-03-21T17:58:58.592Zstarting task 0: "setup"
842024-03-21T17:58:58.620Z++ uname -s
852024-03-21T17:58:58.620Z+ kern=SunOS
862024-03-21T17:58:58.620Z+ case "$kern" in
872024-03-21T17:58:58.620Z+ groupadd -g 12345 build
882024-03-21T17:58:58.620Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
892024-03-21T17:59:00.611Z+ zfs create -o mountpoint=/work rpool/work
902024-03-21T17:59:00.649Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
912024-03-21T17:59:00.674Z+ home_fs=zfs
922024-03-21T17:59:00.674Z+ [[ zfs == autofs ]]
932024-03-21T17:59:00.674Z+ mkdir -p /home/build
942024-03-21T17:59:00.674Z+ chown build:build /home/build /work
952024-03-21T17:59:02.657Z+ chmod 0700 /home/build /work
962024-03-21T17:59:02.681Zprocess exited: duration 4067 ms, exit code 0
 
972024-03-21T17:59:02.731Zstarting task 1: "authentication"
982024-03-21T17:59:02.778Zprocess exited: duration 43 ms, exit code 0
 
992024-03-21T17:59:02.830Zstarting task 2: "build"
1002024-03-21T17:59:02.855Z+ trap _exit_trap EXIT
1012024-03-21T17:59:02.856Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1022024-03-21T17:59:02.948Zsecpolicy_fs_linkdir: 0x55 = 0x55
1032024-03-21T17:59:02.948Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1042024-03-21T17:59:02.948Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1052024-03-21T17:59:02.948Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1062024-03-21T17:59:02.948Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1072024-03-21T17:59:02.948Zsecpolicy_fs_linkdir+5: 0 = 0x1
1082024-03-21T17:59:02.948Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1092024-03-21T17:59:02.948Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1102024-03-21T17:59:02.975Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1112024-03-21T17:59:02.975Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1122024-03-21T17:59:02.975Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1132024-03-21T17:59:02.975Z+ [[ -d /opt/oxide ]]
1142024-03-21T17:59:02.975Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1152024-03-21T17:59:02.975Z+ pfexec mkdir /opt/oxide
1162024-03-21T17:59:02.976Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1172024-03-21T17:59:02.976Z+ [[ -d /opt/oxide-underneath ]]
1182024-03-21T17:59:02.976Z+ cd /opt/oxide-underneath
1192024-03-21T17:59:02.976Z+ pfexec tar ceEp@/f - .
1202024-03-21T17:59:02.976Z+ cd /opt/oxide
1212024-03-21T17:59:02.976Z+ pfexec tar xveEp@/f -
1222024-03-21T17:59:03.063Zx ., 0 bytes, 0 tape blocks
1232024-03-21T17:59:03.063Zx ./opte, 0 bytes, 0 tape blocks
1242024-03-21T17:59:03.063Zx ./opte/bin, 0 bytes, 0 tape blocks
1252024-03-21T17:59:03.063Zx ./opte/bin/opteadm, 43221608 bytes, 84418 tape blocks
1262024-03-21T17:59:03.088Z+ pfexec rm -rf /opt/oxide-underneath
1272024-03-21T17:59:03.088Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1282024-03-21T17:59:03.114Z+ pfexec mkdir /opt/oxide/work
1292024-03-21T17:59:03.114Z+ pfexec chown build:build /opt/oxide/work
1302024-03-21T17:59:03.114Z+ cd /opt/oxide/work
1312024-03-21T17:59:03.114Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1322024-03-21T17:59:03.114Ztar: blocksize = 10
1332024-03-21T17:59:04.644ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1342024-03-21T17:59:04.644Zx out/mg-ddm-gz.tar, 52915712 bytes, 103351 tape blocks
1352024-03-21T17:59:04.644Zx out/omicron-sled-agent.tar, 116829184 bytes, 228182 tape blocks
1362024-03-21T17:59:04.644Zx out/oxlog.tar, 6244352 bytes, 12196 tape blocks
1372024-03-21T17:59:04.644Zx out/target/test, 75 bytes, 1 tape blocks
1382024-03-21T17:59:04.645Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1392024-03-21T17:59:04.645Zx package-manifest.toml, 26511 bytes, 52 tape blocks
1402024-03-21T17:59:04.645Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1412024-03-21T17:59:04.645Zx target/release/omicron-package, 40101200 bytes, 78323 tape blocks
1422024-03-21T17:59:04.645Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1432024-03-21T17:59:04.646Zx tools/virtual_hardware.sh, 3429 bytes, 7 tape blocks
1442024-03-21T17:59:04.646Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1452024-03-21T17:59:04.646Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1462024-03-21T17:59:04.646Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1472024-03-21T17:59:04.646Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1482024-03-21T17:59:04.646Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1492024-03-21T17:59:04.677Z
1502024-03-21T17:59:04.677Zreal 1.537009216
1512024-03-21T17:59:04.677Zuser 1.378728164
1522024-03-21T17:59:04.677Zsys 0.303870293
1532024-03-21T17:59:04.677Ztrap 0.000061889
1542024-03-21T17:59:04.677Ztflt 0.000000000
1552024-03-21T17:59:04.678Zdflt 0.000000000
1562024-03-21T17:59:04.678Zkflt 0.000000000
1572024-03-21T17:59:04.678Zlock 0.000000000
1582024-03-21T17:59:04.678Zslp 1.349526067
1592024-03-21T17:59:04.678Zlat 0.039774740
1602024-03-21T17:59:04.678Zstop 0.000122982
1612024-03-21T17:59:04.678Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/nexus-single-sled.tar.gz /input/package/work/zones/nexus.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/probe.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1622024-03-21T17:59:05.992Z+ mv out/nexus-single-sled.tar.gz out/nexus.tar.gz
1632024-03-21T17:59:06.017Z+ mkdir tests
1642024-03-21T17:59:06.017Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1652024-03-21T17:59:06.017Z+ ptime -m gunzip
1662024-03-21T17:59:06.017Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-ebb6682cb4af86e9
1672024-03-21T17:59:06.224Z
1682024-03-21T17:59:06.251Zreal 0.207348846
1692024-03-21T17:59:06.251Zuser 0.190041016
1702024-03-21T17:59:06.251Zsys 0.017052725
1712024-03-21T17:59:06.252Ztrap 0.000015570
1722024-03-21T17:59:06.252Ztflt 0.000000000
1732024-03-21T17:59:06.252Zdflt 0.000000000
1742024-03-21T17:59:06.252Zkflt 0.000000000
1752024-03-21T17:59:06.252Zlock 0.000000000
1762024-03-21T17:59:06.252Zslp 0.000024660
1772024-03-21T17:59:06.252Zlat 0.000022830
1782024-03-21T17:59:06.252Zstop 0.000129822
1792024-03-21T17:59:06.252Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-ebb6682cb4af86e9
1802024-03-21T17:59:06.252Z+ chmod a+x tests/bootstrap-ebb6682cb4af86e9
1812024-03-21T17:59:06.252Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1822024-03-21T17:59:06.252Z+ ptime -m gunzip
1832024-03-21T17:59:06.252Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1842024-03-21T17:59:08.486Z
1852024-03-21T17:59:08.513Zreal 2.256224796
1862024-03-21T17:59:08.513Zuser 2.114652013
1872024-03-21T17:59:08.513Zsys 0.141199409
1882024-03-21T17:59:08.513Ztrap 0.000155000
1892024-03-21T17:59:08.513Ztflt 0.000000000
1902024-03-21T17:59:08.513Zdflt 0.000000000
1912024-03-21T17:59:08.513Zkflt 0.000000000
1922024-03-21T17:59:08.513Zlock 0.000000000
1932024-03-21T17:59:08.513Zslp 0.000020020
1942024-03-21T17:59:08.514Zlat 0.000021240
1952024-03-21T17:59:08.514Zstop 0.000120471
1962024-03-21T17:59:08.514Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1972024-03-21T17:59:08.514Z+ chmod a+x tests/bootstrap
1982024-03-21T17:59:08.514Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1992024-03-21T17:59:08.514Z+ ptime -m gunzip
2002024-03-21T17:59:08.514Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-eb80106b092225f5
2012024-03-21T17:59:08.708Z
2022024-03-21T17:59:08.733Zreal 0.208273062
2032024-03-21T17:59:08.733Zuser 0.189894632
2042024-03-21T17:59:08.734Zsys 0.018129065
2052024-03-21T17:59:08.734Ztrap 0.000016440
2062024-03-21T17:59:08.734Ztflt 0.000000000
2072024-03-21T17:59:08.734Zdflt 0.000000000
2082024-03-21T17:59:08.734Zkflt 0.000000000
2092024-03-21T17:59:08.734Zlock 0.000000000
2102024-03-21T17:59:08.734Zslp 0.000020490
2112024-03-21T17:59:08.734Zlat 0.000023610
2122024-03-21T17:59:08.734Zstop 0.000126821
2132024-03-21T17:59:08.734Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-eb80106b092225f5
2142024-03-21T17:59:08.734Z+ chmod a+x tests/commtest-eb80106b092225f5
2152024-03-21T17:59:08.734Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2162024-03-21T17:59:08.734Z+ ptime -m gunzip
2172024-03-21T17:59:08.734Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-5ee17f10b12b6e1e
2182024-03-21T17:59:08.926Z
2192024-03-21T17:59:08.952Zreal 0.207635551
2202024-03-21T17:59:08.952Zuser 0.192220903
2212024-03-21T17:59:08.952Zsys 0.015163543
2222024-03-21T17:59:08.952Ztrap 0.000019229
2232024-03-21T17:59:08.952Ztflt 0.000000000
2242024-03-21T17:59:08.952Zdflt 0.000000000
2252024-03-21T17:59:08.952Zkflt 0.000000000
2262024-03-21T17:59:08.952Zlock 0.000000000
2272024-03-21T17:59:08.952Zslp 0.000024450
2282024-03-21T17:59:08.952Zlat 0.000020740
2292024-03-21T17:59:08.953Zstop 0.000125652
2302024-03-21T17:59:08.953Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-5ee17f10b12b6e1e
2312024-03-21T17:59:08.953Z+ chmod a+x tests/dhcp_server-5ee17f10b12b6e1e
2322024-03-21T17:59:08.953Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2332024-03-21T17:59:08.953Z+ ptime -m gunzip
2342024-03-21T17:59:08.953Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2ddaeb260a344b4e
2352024-03-21T17:59:11.235Z
2362024-03-21T17:59:11.260Zreal 2.295198695
2372024-03-21T17:59:11.260Zuser 2.164618141
2382024-03-21T17:59:11.260Zsys 0.130170734
2392024-03-21T17:59:11.260Ztrap 0.000171954
2402024-03-21T17:59:11.260Ztflt 0.000000000
2412024-03-21T17:59:11.261Zdflt 0.000000000
2422024-03-21T17:59:11.261Zkflt 0.000000000
2432024-03-21T17:59:11.261Zlock 0.000000000
2442024-03-21T17:59:11.261Zslp 0.000017620
2452024-03-21T17:59:11.261Zlat 0.000024160
2462024-03-21T17:59:11.261Zstop 0.000132202
2472024-03-21T17:59:11.261Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2ddaeb260a344b4e
2482024-03-21T17:59:11.261Z+ chmod a+x tests/end_to_end_tests-2ddaeb260a344b4e
2492024-03-21T17:59:11.261Z+ bmat address ls
2502024-03-21T17:59:11.261ZNAME CIDR FIRST LAST COUNT
2512024-03-21T17:59:11.261Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2522024-03-21T17:59:11.261Z++ bmat address ls -f extra -Ho first,last,count
2532024-03-21T17:59:11.287Z+ set -- 10.151.1.164 10.151.1.227 64
2542024-03-21T17:59:11.287Z+ EXTRA_IP_START=10.151.1.164
2552024-03-21T17:59:11.287Z+ EXTRA_IP_END=10.151.1.227
2562024-03-21T17:59:11.287Z+ EXTRA_IP_COUNT=64
2572024-03-21T17:59:11.287Z+ (( EXTRA_IP_COUNT >= 32 ))
2582024-03-21T17:59:11.287Z+ EXTRA_IP_BASE=10.151.1
2592024-03-21T17:59:11.287Z+ EXTRA_IP_FOCTET=164
2602024-03-21T17:59:11.287Z+ EXTRA_IP_LOCTET=227
2612024-03-21T17:59:11.287Z+ SERVICE_IP_POOL_START=10.151.1.164
2622024-03-21T17:59:11.287Z+ SERVICE_IP_POOL_END=10.151.1.173
2632024-03-21T17:59:11.287Z+ DNS_IP1=10.151.1.164
2642024-03-21T17:59:11.287Z+ DNS_IP2=10.151.1.165
2652024-03-21T17:59:11.287Z+ UPLINK_IP=10.151.1.174
2662024-03-21T17:59:11.287Z+ IPPOOL_START=10.151.1.175
2672024-03-21T17:59:11.287Z+ IPPOOL_END=10.151.1.227
2682024-03-21T17:59:11.287Z++ ipadm show-addr -po type,addr
2692024-03-21T17:59:11.287Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2702024-03-21T17:59:11.288Z+ GATEWAY_IP=10.151.1.100
2712024-03-21T17:59:11.288Z+ [[ -n 10.151.1.100 ]]
2722024-03-21T17:59:11.288Z+ ping -s 10.151.1.100 56 1
2732024-03-21T17:59:11.288ZPING 10.151.1.100: 56 data bytes
2742024-03-21T17:59:11.288Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2752024-03-21T17:59:11.288Z
2762024-03-21T17:59:11.288Z----10.151.1.100 PING Statistics----
2772024-03-21T17:59:11.288Z1 packets transmitted, 1 packets received, 0% packet loss
2782024-03-21T17:59:11.288Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2792024-03-21T17:59:11.288Z++ arp -an
2802024-03-21T17:59:11.288Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2812024-03-21T17:59:11.288Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2822024-03-21T17:59:11.288Z+ routeadm -e ipv4-forwarding -u
2832024-03-21T17:59:11.401Z+ PXA_START=10.151.1.164
2842024-03-21T17:59:11.401Z+ PXA_END=10.151.1.227
2852024-03-21T17:59:11.426Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2862024-03-21T17:59:11.426Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2872024-03-21T17:59:11.537Z+ ZPOOL_VDEV_DIR=/scratch
2882024-03-21T17:59:11.537Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2892024-03-21T17:59:11.562Z+++ dirname ./tools/create_virtual_hardware.sh
2902024-03-21T17:59:11.562Z++ cd ./tools
2912024-03-21T17:59:11.562Z++ pwd
2922024-03-21T17:59:11.562Z+ SOURCE_DIR=/opt/oxide/work/tools
2932024-03-21T17:59:11.562Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2942024-03-21T17:59:11.562Z+ SOFTNPU_MODE=zone
2952024-03-21T17:59:11.562Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2962024-03-21T17:59:11.563Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2972024-03-21T17:59:11.563Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2982024-03-21T17:59:11.563Z++ dladm show-phys -p -o LINK
2992024-03-21T17:59:11.563Z++ head -1
3002024-03-21T17:59:11.623Z+ PHYSICAL_LINK=igb0
3012024-03-21T17:59:11.655Z+ echo 'Using igb0 as physical link'
3022024-03-21T17:59:11.655ZUsing igb0 as physical link
3032024-03-21T17:59:11.655Z+ ensure_run_as_root
3042024-03-21T17:59:11.655Z++ id -u
3052024-03-21T17:59:11.655Z+ [[ 0 -ne 0 ]]
3062024-03-21T17:59:11.655Z+ ensure_zpools
3072024-03-21T17:59:11.655Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
3082024-03-21T17:59:11.655Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
3092024-03-21T17:59:11.655Z+ readarray -t ZPOOLS
3102024-03-21T17:59:11.655Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3112024-03-21T17:59:11.655Z++ sed 's/[ ",]//g'
3122024-03-21T17:59:11.655Z+ for ZPOOL in "${ZPOOLS[@]}"
3132024-03-21T17:59:11.655Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
3142024-03-21T17:59:11.655ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
3152024-03-21T17:59:11.655Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3162024-03-21T17:59:11.655Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
3172024-03-21T17:59:11.655Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
3182024-03-21T17:59:11.685Z0+0 records in
3192024-03-21T17:59:11.685Z0+0 records out
3202024-03-21T17:59:11.686Z0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec)
3212024-03-21T17:59:11.686Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
3222024-03-21T17:59:11.686Z+ set +x
3232024-03-21T17:59:11.686ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
3242024-03-21T17:59:11.686Z++ zpool list -o name
3252024-03-21T17:59:11.686Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
3262024-03-21T17:59:11.686Z+ [[ -z '' ]]
3272024-03-21T17:59:11.686Z+ zpool create -o ashift=12 -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3282024-03-21T17:59:11.726Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
3292024-03-21T17:59:11.726Z+ set +x
3302024-03-21T17:59:11.726ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3312024-03-21T17:59:11.726Z+ for ZPOOL in "${ZPOOLS[@]}"
3322024-03-21T17:59:11.726Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3332024-03-21T17:59:11.727ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3342024-03-21T17:59:11.727Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3352024-03-21T17:59:11.727Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3362024-03-21T17:59:11.727Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3372024-03-21T17:59:11.727Z0+0 records in
3382024-03-21T17:59:11.727Z0+0 records out
3392024-03-21T17:59:11.727Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3402024-03-21T17:59:11.727Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3412024-03-21T17:59:11.727Z+ set +x
3422024-03-21T17:59:11.727ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3432024-03-21T17:59:11.727Z++ zpool list -o name
3442024-03-21T17:59:11.727Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3452024-03-21T17:59:11.758Z+ [[ -z '' ]]
3462024-03-21T17:59:11.758Z+ zpool create -o ashift=12 -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3472024-03-21T17:59:11.758Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3482024-03-21T17:59:11.758Z+ set +x
3492024-03-21T17:59:11.759ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3502024-03-21T17:59:11.759Z+ for ZPOOL in "${ZPOOLS[@]}"
3512024-03-21T17:59:11.759Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3522024-03-21T17:59:11.759ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3532024-03-21T17:59:11.759Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3542024-03-21T17:59:11.759Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3552024-03-21T17:59:11.759Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3562024-03-21T17:59:11.759Z0+0 records in
3572024-03-21T17:59:11.759Z0+0 records out
3582024-03-21T17:59:11.759Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3592024-03-21T17:59:11.759Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3602024-03-21T17:59:11.759Z+ set +x
3612024-03-21T17:59:11.759ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3622024-03-21T17:59:11.759Z++ zpool list -o name
3632024-03-21T17:59:11.759Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3642024-03-21T17:59:11.786Z+ [[ -z '' ]]
3652024-03-21T17:59:11.786Z+ zpool create -o ashift=12 -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3662024-03-21T17:59:11.812Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3672024-03-21T17:59:11.812Z+ set +x
3682024-03-21T17:59:11.812ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3692024-03-21T17:59:11.812Z+ for ZPOOL in "${ZPOOLS[@]}"
3702024-03-21T17:59:11.812Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3712024-03-21T17:59:11.812ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3722024-03-21T17:59:11.812Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3732024-03-21T17:59:11.812Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3742024-03-21T17:59:11.812Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3752024-03-21T17:59:11.812Z0+0 records in
3762024-03-21T17:59:11.812Z0+0 records out
3772024-03-21T17:59:11.812Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3782024-03-21T17:59:11.812Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3792024-03-21T17:59:11.812Z+ set +x
3802024-03-21T17:59:11.812ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3812024-03-21T17:59:11.812Z++ zpool list -o name
3822024-03-21T17:59:11.812Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3832024-03-21T17:59:11.813Z+ [[ -z '' ]]
3842024-03-21T17:59:11.813Z+ zpool create -o ashift=12 -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3852024-03-21T17:59:11.838Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3862024-03-21T17:59:11.838Z+ set +x
3872024-03-21T17:59:11.838ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3882024-03-21T17:59:11.838Z+ for ZPOOL in "${ZPOOLS[@]}"
3892024-03-21T17:59:11.838Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3902024-03-21T17:59:11.838ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
3912024-03-21T17:59:11.839Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3922024-03-21T17:59:11.839Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3932024-03-21T17:59:11.839Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3942024-03-21T17:59:11.839Z0+0 records in
3952024-03-21T17:59:11.839Z0+0 records out
3962024-03-21T17:59:11.839Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3972024-03-21T17:59:11.839Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3982024-03-21T17:59:11.839Z+ set +x
3992024-03-21T17:59:11.839ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
4002024-03-21T17:59:11.839Z++ zpool list -o name
4012024-03-21T17:59:11.839Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
4022024-03-21T17:59:11.864Z+ [[ -z '' ]]
4032024-03-21T17:59:11.864Z+ zpool create -o ashift=12 -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
4042024-03-21T17:59:11.891Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
4052024-03-21T17:59:11.891Z+ set +x
4062024-03-21T17:59:11.891ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
4072024-03-21T17:59:11.891Z+ for ZPOOL in "${ZPOOLS[@]}"
4082024-03-21T17:59:11.891Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
4092024-03-21T17:59:11.891ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
4102024-03-21T17:59:11.891Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4112024-03-21T17:59:11.891Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
4122024-03-21T17:59:11.891Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
4132024-03-21T17:59:11.891Z0+0 records in
4142024-03-21T17:59:11.891Z0+0 records out
4152024-03-21T17:59:11.891Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4162024-03-21T17:59:11.891Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
4172024-03-21T17:59:11.891Z+ set +x
4182024-03-21T17:59:11.891ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
4192024-03-21T17:59:11.891Z++ zpool list -o name
4202024-03-21T17:59:11.891Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
4212024-03-21T17:59:11.891Z+ [[ -z '' ]]
4222024-03-21T17:59:11.891Z+ zpool create -o ashift=12 -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4232024-03-21T17:59:11.917Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
4242024-03-21T17:59:11.917Z+ set +x
4252024-03-21T17:59:11.918ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
4262024-03-21T17:59:11.943Z+ for ZPOOL in "${ZPOOLS[@]}"
4272024-03-21T17:59:11.943Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
4282024-03-21T17:59:11.943ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
4292024-03-21T17:59:11.943Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4302024-03-21T17:59:11.943Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
4312024-03-21T17:59:11.943Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
4322024-03-21T17:59:11.943Z0+0 records in
4332024-03-21T17:59:11.944Z0+0 records out
4342024-03-21T17:59:11.944Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4352024-03-21T17:59:11.944Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4362024-03-21T17:59:11.944Z+ set +x
4372024-03-21T17:59:11.944ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
4382024-03-21T17:59:11.944Z++ zpool list -o name
4392024-03-21T17:59:11.944Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4402024-03-21T17:59:11.944Z+ [[ -z '' ]]
4412024-03-21T17:59:11.944Z+ zpool create -o ashift=12 -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4422024-03-21T17:59:11.969Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4432024-03-21T17:59:11.969Z+ set +x
4442024-03-21T17:59:11.969Z+ for ZPOOL in "${ZPOOLS[@]}"
4452024-03-21T17:59:11.969ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4462024-03-21T17:59:11.969Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4472024-03-21T17:59:11.969ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4482024-03-21T17:59:11.969Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4492024-03-21T17:59:11.970Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4502024-03-21T17:59:11.970Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4512024-03-21T17:59:11.970Z0+0 records in
4522024-03-21T17:59:11.970Z0+0 records out
4532024-03-21T17:59:11.970Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4542024-03-21T17:59:11.970Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4552024-03-21T17:59:11.970Z+ set +x
4562024-03-21T17:59:11.970ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4572024-03-21T17:59:11.970Z++ zpool list -o name
4582024-03-21T17:59:11.970Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4592024-03-21T17:59:11.995Z+ [[ -z '' ]]
4602024-03-21T17:59:11.995Z+ zpool create -o ashift=12 -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4612024-03-21T17:59:12.020Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4622024-03-21T17:59:12.020Z+ set +x
4632024-03-21T17:59:12.020ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4642024-03-21T17:59:12.020Z+ for ZPOOL in "${ZPOOLS[@]}"
4652024-03-21T17:59:12.020Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4662024-03-21T17:59:12.020Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4672024-03-21T17:59:12.021Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4682024-03-21T17:59:12.021ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4692024-03-21T17:59:12.021Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4702024-03-21T17:59:12.021Z0+0 records in
4712024-03-21T17:59:12.021Z0+0 records out
4722024-03-21T17:59:12.021Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4732024-03-21T17:59:12.021Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4742024-03-21T17:59:12.021Z+ set +x
4752024-03-21T17:59:12.021ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4762024-03-21T17:59:12.021Z++ zpool list -o name
4772024-03-21T17:59:12.021Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4782024-03-21T17:59:12.021Z+ [[ -z '' ]]
4792024-03-21T17:59:12.021Z+ zpool create -o ashift=12 -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4802024-03-21T17:59:12.049Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4812024-03-21T17:59:12.049Z+ set +x
4822024-03-21T17:59:12.075ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4832024-03-21T17:59:12.075Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4842024-03-21T17:59:12.075Z+ readarray -t ZPOOLS
4852024-03-21T17:59:12.075Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4862024-03-21T17:59:12.075Z++ sed 's/[ ",]//g'
4872024-03-21T17:59:12.075Z+ for ZPOOL in "${ZPOOLS[@]}"
4882024-03-21T17:59:12.075Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4892024-03-21T17:59:12.075ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
4902024-03-21T17:59:12.075Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4912024-03-21T17:59:12.075Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4922024-03-21T17:59:12.075Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4932024-03-21T17:59:12.075Z0+0 records in
4942024-03-21T17:59:12.075Z0+0 records out
4952024-03-21T17:59:12.075Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4962024-03-21T17:59:12.075Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4972024-03-21T17:59:12.075Z+ set +x
4982024-03-21T17:59:12.076ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
4992024-03-21T17:59:12.076Z++ zpool list -o name
5002024-03-21T17:59:12.076Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
5012024-03-21T17:59:12.076Z+ [[ -z '' ]]
5022024-03-21T17:59:12.076Z+ zpool create -o ashift=12 -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5032024-03-21T17:59:12.102Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
5042024-03-21T17:59:12.102Z+ set +x
5052024-03-21T17:59:12.102ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
5062024-03-21T17:59:12.102Z+ for ZPOOL in "${ZPOOLS[@]}"
5072024-03-21T17:59:12.102Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
5082024-03-21T17:59:12.102ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
5092024-03-21T17:59:12.102Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5102024-03-21T17:59:12.103Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
5112024-03-21T17:59:12.103Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
5122024-03-21T17:59:12.128Z0+0 records in
5132024-03-21T17:59:12.128Z0+0 records out
5142024-03-21T17:59:12.128Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
5152024-03-21T17:59:12.128Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
5162024-03-21T17:59:12.128Z+ set +x
5172024-03-21T17:59:12.128ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
5182024-03-21T17:59:12.128Z++ zpool list -o name
5192024-03-21T17:59:12.128Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
5202024-03-21T17:59:12.128Z+ [[ -z '' ]]
5212024-03-21T17:59:12.128Z+ zpool create -o ashift=12 -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5222024-03-21T17:59:12.157Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
5232024-03-21T17:59:12.158Z+ set +x
5242024-03-21T17:59:12.158ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
5252024-03-21T17:59:12.158Z+ [[ zone == \z\o\n\e ]]
5262024-03-21T17:59:12.158Z+ ensure_simulated_links igb0
5272024-03-21T17:59:12.159Z+ local PHYSICAL_LINK=igb0
5282024-03-21T17:59:12.159Z+ INDICES=("0" "1")
5292024-03-21T17:59:12.159Z+ for I in "${INDICES[@]}"
5302024-03-21T17:59:12.159Z++ get_simnet_name_if_exists net0
5312024-03-21T17:59:12.159Z++ dladm show-simnet -p -o LINK net0
5322024-03-21T17:59:12.159Z++ echo ''
5332024-03-21T17:59:12.160Z+ [[ -z '' ]]
5342024-03-21T17:59:12.160Z+ dladm create-simnet -t net0
5352024-03-21T17:59:12.627Z+ dladm create-simnet -t sc0_0
5362024-03-21T17:59:12.627Z+ dladm modify-simnet -t -p net0 sc0_0
5372024-03-21T17:59:12.627Z+ dladm set-linkprop -p mtu=9000 sc0_0
5382024-03-21T17:59:12.628Z+ success 'Simnet net0/sc0_0 exists'
5392024-03-21T17:59:12.628Z+ set +x
5402024-03-21T17:59:12.628ZSimnet net0/sc0_0 exists
5412024-03-21T17:59:12.628Z+ for I in "${INDICES[@]}"
5422024-03-21T17:59:12.628Z++ get_simnet_name_if_exists net1
5432024-03-21T17:59:12.628Z++ dladm show-simnet -p -o LINK net1
5442024-03-21T17:59:12.628Z++ echo ''
5452024-03-21T17:59:12.628Z+ [[ -z '' ]]
5462024-03-21T17:59:12.628Z+ dladm create-simnet -t net1
5472024-03-21T17:59:12.628Z+ dladm create-simnet -t sc1_0
5482024-03-21T17:59:12.628Z+ dladm modify-simnet -t -p net1 sc1_0
5492024-03-21T17:59:12.629Z+ dladm set-linkprop -p mtu=9000 sc1_0
5502024-03-21T17:59:12.629Z+ success 'Simnet net1/sc1_0 exists'
5512024-03-21T17:59:12.629Z+ set +x
5522024-03-21T17:59:12.629ZSimnet net1/sc1_0 exists
5532024-03-21T17:59:12.629Z++ get_vnic_name_if_exists sc0_1
5542024-03-21T17:59:12.629Z++ dladm show-vnic -p -o LINK sc0_1
5552024-03-21T17:59:12.629Z++ echo ''
5562024-03-21T17:59:12.629Z+ [[ -z '' ]]
5572024-03-21T17:59:12.629Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5582024-03-21T17:59:12.629Z+ [[ -v PROMISC_FILT_OFF ]]
5592024-03-21T17:59:12.629Z+ success 'Vnic sc0_1 exists'
5602024-03-21T17:59:12.629Z+ set +x
5612024-03-21T17:59:12.629ZVnic sc0_1 exists
5622024-03-21T17:59:12.629Z+ warn_if_no_proxy_arp
5632024-03-21T17:59:12.629Z+ [[ -v PXA_START ]]
5642024-03-21T17:59:12.629Z+ [[ -v PXA_END ]]
5652024-03-21T17:59:12.629Z+ ensure_softnpu_zone
5662024-03-21T17:59:12.630Z+ zoneadm list
5672024-03-21T17:59:12.630Z+ grep -q sidecar_softnpu
5682024-03-21T17:59:12.630Z+ [[ -f out/npuzone/npuzone ]]
5692024-03-21T17:59:12.630Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5702024-03-21T17:59:12.630Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5712024-03-21T17:59:18.000Zdownloading softnpu ...done
5722024-03-21T17:59:18.026Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
5732024-03-21T17:59:25.077Zdownloading asic_program.so ...done
5742024-03-21T17:59:25.077Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
5752024-03-21T17:59:31.702Zdownloading scadm ...done
5762024-03-21T17:59:31.727Zcreating port tfportrear0_0 for sc0_0
5772024-03-21T17:59:31.727Zcreating port tfportqsfp0_0 for sc0_1
5782024-03-21T17:59:31.752Zsoftnpu zone setup
5792024-03-21T17:59:31.752Zconfigure zone
5802024-03-21T17:59:31.752Zinstall zone
5812024-03-21T17:59:32.784Zboot zone
5822024-03-21T17:59:35.890Z[sidecar_softnpu] svcs milestone/network
5832024-03-21T17:59:35.917ZSTATE STIME FMRI
5842024-03-21T17:59:35.917Zonline 17:59:34 svc:/milestone/network:default
5852024-03-21T17:59:35.917Z[sidecar_softnpu] /softnpu/npu start
5862024-03-21T17:59:35.945Z
5872024-03-21T17:59:35.969Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5882024-03-21T17:59:35.970Z+ GATEWAY_IP=10.151.1.100
5892024-03-21T17:59:35.970Z+ echo 'Using 10.151.1.100 as gateway ip'
5902024-03-21T17:59:35.970ZUsing 10.151.1.100 as gateway ip
5912024-03-21T17:59:35.970Z+ [[ ! -v GATEWAY_MAC ]]
5922024-03-21T17:59:35.970Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5932024-03-21T17:59:35.970Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5942024-03-21T17:59:35.970Z+++ echo 18:c0:4d:0d:9f:b2
5952024-03-21T17:59:35.970Z+ COUNT=1
5962024-03-21T17:59:35.970Z+ [[ 1 -ne 1 ]]
5972024-03-21T17:59:35.970Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5982024-03-21T17:59:35.970ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5992024-03-21T17:59:35.970Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
6002024-03-21T17:59:35.970Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
6012024-03-21T17:59:35.995Z+ PXA_MAC=a8:e1:de:01:70:1d
6022024-03-21T17:59:35.995Z+ [[ -v PXA_START ]]
6032024-03-21T17:59:35.995Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
6042024-03-21T17:59:35.995Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
6052024-03-21T17:59:36.024Z+ z_scadm dump-state
6062024-03-21T17:59:36.024Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
6072024-03-21T17:59:36.049Zlocal v6:
6082024-03-21T17:59:36.050Zlocal v4:
6092024-03-21T17:59:36.050Zrouter v6:
6102024-03-21T17:59:36.050Zrouter v4_idx:
6112024-03-21T17:59:36.050Zrouter v4_routes:
6122024-03-21T17:59:36.050Zresolver v4:
6132024-03-21T17:59:36.050Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
6142024-03-21T17:59:36.050Zresolver v6:
6152024-03-21T17:59:36.050Znat v4:
6162024-03-21T17:59:36.050Znat_v6:
6172024-03-21T17:59:36.050Zport_mac:
6182024-03-21T17:59:36.050Zproxy arp:
6192024-03-21T17:59:36.050Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
6202024-03-21T17:59:36.050Z+ success 'softnpu zone exists'
6212024-03-21T17:59:36.050Z+ set +x
6222024-03-21T17:59:36.050Zsoftnpu zone exists
6232024-03-21T17:59:36.050Z
6242024-03-21T17:59:36.050Zreal 24.504106603
6252024-03-21T17:59:36.050Zuser 0.701579014
6262024-03-21T17:59:36.050Zsys 1.614170657
6272024-03-21T17:59:36.050Ztrap 0.000074957
6282024-03-21T17:59:36.050Ztflt 0.000207356
6292024-03-21T17:59:36.050Zdflt 0.000923877
6302024-03-21T17:59:36.050Zkflt 0.000002660
6312024-03-21T17:59:36.050Zlock 18:47.683583681
6322024-03-21T17:59:36.051Zslp 1:13.216201614
6332024-03-21T17:59:36.051Zlat 0.081714843
6342024-03-21T17:59:36.051Zstop 0.357026720
6352024-03-21T17:59:36.051Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
6362024-03-21T17:59:36.081Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6372024-03-21T17:59:36.107Z+ SILO_NAME=recovery
6382024-03-21T17:59:36.107Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6392024-03-21T17:59:36.108Z+ EXTERNAL_DNS_DOMAIN=oxide.test
6402024-03-21T17:59:36.108Z+ sed -i~ '
6412024-03-21T17:59:36.108Z /^external_dns_ips/c\
6422024-03-21T17:59:36.108Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6432024-03-21T17:59:36.108Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6442024-03-21T17:59:36.108Z /^first/c\
6452024-03-21T17:59:36.108Zfirst = "10.151.1.164"
6462024-03-21T17:59:36.108Z /^last/c\
6472024-03-21T17:59:36.108Zlast = "10.151.1.173"
6482024-03-21T17:59:36.108Z }
6492024-03-21T17:59:36.108Z /^infra_ip_first/c\
6502024-03-21T17:59:36.108Zinfra_ip_first = "10.151.1.174"
6512024-03-21T17:59:36.108Z /^infra_ip_last/c\
6522024-03-21T17:59:36.108Zinfra_ip_last = "10.151.1.174"
6532024-03-21T17:59:36.108Z /^\[\[rack_network_config.ports/,/^$/ {
6542024-03-21T17:59:36.108Z /^routes/c\
6552024-03-21T17:59:36.108Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6562024-03-21T17:59:36.108Z /^addresses/c\
6572024-03-21T17:59:36.108Zaddresses = \["10.151.1.174/24"\]
6582024-03-21T17:59:36.108Z }
6592024-03-21T17:59:36.108Z' pkg/config-rss.toml
6602024-03-21T17:59:36.108Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6612024-03-21T17:59:36.108Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6622024-03-21T17:59:36.108Z+++ pkg/config-rss.toml Thu Mar 21 17:59:36 2024
6632024-03-21T17:59:36.109Z@@ -33,7 +33,7 @@
6642024-03-21T17:59:36.109Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6652024-03-21T17:59:36.109Z # must be contained in one of the "internal services" IP Pool ranges listed
6662024-03-21T17:59:36.109Z # below.
6672024-03-21T17:59:36.109Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6682024-03-21T17:59:36.109Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6692024-03-21T17:59:36.109Z
6702024-03-21T17:59:36.109Z # Initial TLS certificates for the external API
6712024-03-21T17:59:36.109Z #
6722024-03-21T17:59:36.109Z@@ -69,8 +69,8 @@
6732024-03-21T17:59:36.109Z #
6742024-03-21T17:59:36.109Z # For more on this and what to put here, see docs/how-to-run.adoc.
6752024-03-21T17:59:36.109Z [[internal_services_ip_pool_ranges]]
6762024-03-21T17:59:36.109Z-first = "192.168.1.20"
6772024-03-21T17:59:36.109Z-last = "192.168.1.29"
6782024-03-21T17:59:36.109Z+first = "10.151.1.164"
6792024-03-21T17:59:36.109Z+last = "10.151.1.173"
6802024-03-21T17:59:36.109Z
6812024-03-21T17:59:36.109Z # TODO - this configuration is subject to change going forward. Ultimately these
6822024-03-21T17:59:36.109Z # parameters should be provided to the control plane via wicket, but we need to
6832024-03-21T17:59:36.109Z@@ -91,8 +91,8 @@
6842024-03-21T17:59:36.109Z # A range of IP addresses used by Boundary Services on the external network. In
6852024-03-21T17:59:36.109Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6862024-03-21T17:59:36.109Z # With softnpu, only one address is used.
6872024-03-21T17:59:36.110Z-infra_ip_first = "192.168.1.30"
6882024-03-21T17:59:36.110Z-infra_ip_last = "192.168.1.30"
6892024-03-21T17:59:36.110Z+infra_ip_first = "10.151.1.174"
6902024-03-21T17:59:36.110Z+infra_ip_last = "10.151.1.174"
6912024-03-21T17:59:36.110Z
6922024-03-21T17:59:36.110Z # Configurations for BGP routers to run on the scrimlets.
6932024-03-21T17:59:36.110Z bgp = []
6942024-03-21T17:59:36.110Z@@ -100,9 +100,9 @@
6952024-03-21T17:59:36.110Z # You can configure multiple uplinks by repeating the following stanza
6962024-03-21T17:59:36.110Z [[rack_network_config.ports]]
6972024-03-21T17:59:36.110Z # Routes associated with this port.
6982024-03-21T17:59:36.110Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6992024-03-21T17:59:36.110Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
7002024-03-21T17:59:36.110Z # Addresses associated with this port.
7012024-03-21T17:59:36.110Z-addresses = ["192.168.1.30/24"]
7022024-03-21T17:59:36.110Z+addresses = ["10.151.1.174/24"]
7032024-03-21T17:59:36.110Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
7042024-03-21T17:59:36.110Z port = "qsfp0"
7052024-03-21T17:59:36.110Z # The speed of this port.
7062024-03-21T17:59:36.110Z+ true
7072024-03-21T17:59:36.110Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
7082024-03-21T17:59:36.110Za pkg/config-rss.toml 7K
7092024-03-21T17:59:36.110Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
7102024-03-21T17:59:36.111Z+ TLS_NAME=recovery.sys.oxide.test
7112024-03-21T17:59:36.111Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
7122024-03-21T17:59:36.331Z....+.+.....+.+......+..+...+...+......+................+...+..+.........+...+...+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+...........+....+..+....+..+...+.......+.........+...+......+..+...+.........+.......+........+.+..............+.............+..+...+...+.+......+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.....+..........+...........+.+.....+...+......+....+...+..+..........+...+.....+...............+....+........+.+..+............+.+..+.......+..+.........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
7132024-03-21T17:59:38.431Z.+....+...+......+.....+....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+....+...+..................+.....+..................+.+...+...........+......+................+...+......+...+...........+.+......+.....+..........+..+............+...+......+.+...+.....+......+....+....................+...+...+.+...........+...+..........+.........+...+..+.+..............+..................+.........+................+.........+........+.............+.....+.........+......+............+.+.....+.+......+...+.........+...........+.......+...+..+.........+.+..+......+....+...................................+......+....+......+..+.......+............+......+..+......+.+........+.....................+............+....+...........+...+.........+.+......+.........+...............+.................+.......+...........+....+............+........+.......+......+........+......+...+.+.....+.....................+...+............+................+...+..+.............+.........+......+..+.......+..+...............+.+..+..........+.....+.......+...+........+...+......+....+......+..............+.........+......+..............................+.......+............+..+...............+.............+.....+.+......+......+..+......+....+...+..+.+.....+.....................+......+...+.+......+.....+.......+......+......+........+.+..+..........+.....+..........+...+......+.....+........................+.+...........+..........+..+...............+..........+......+.....+.+...+......+..............+......+.......+................................+.......+.....+....+..+...................+...+..+..........+......+.....+.........+.........+......+.+.....+...+......+...+.+........................+...+...............+.........+........+.+..........................+....+.....+......+.+..+...+....+........+.+............+........+......+....+.....+............+.......+..+.+..+..........+..+.+..............+.+..+...+.......+...........+....+..........................+.+........+...+...+.+........+.............+............+...+.........+.....+....+..+...+...............+......+...+.......+.....+...+..........+...+............+......+...........+.+...+........................+.....+.+..+...+.......+..+.+......+..................+...+..+...+.........+.............+...+.....+....+.....+......+...............+....+.....+..................+......+....+...+........+.......+...+.....+....+.....+..........+........+.......+.....+...+...+......+.+........+.....................+.+...........................+............+.........+............+........+.......+...+.....+......+...+.............+.........+...+...............+..+...+.+......+...+.....+...+...+..........+...........+..........+.........+..............+.......+...+........+...+.........+...+....+...........+...+.+......+............+.....+.+....................+.+......+.........+.........+.........+...+..+..................+..........+..+.+.........+..+.........+.......+..............+...............+......+.......+......+..+.......+...........+....+........+...+..........+......+.....+...+...+.......+..+...................+.....+................+.........+..+............+.+............+...+....................+....+...............+......+...........+...+.+....................+.+...+.................+.+..+.......+........+..................+...+......+.........+......+....+.............................+.+......+.....+..........+.........+..............+............+................+..+.......+..............+.+..............+.+.....+................+...+.....+.......+........+........................+.......+.....+....+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
7142024-03-21T17:59:38.456Z-----
7152024-03-21T17:59:38.457Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
7162024-03-21T17:59:38.486Za pkg/initial-tls-cert.pem 2K
7172024-03-21T17:59:38.486Za pkg/initial-tls-key.pem 4K
7182024-03-21T17:59:38.486Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
7192024-03-21T17:59:38.486Z+ rmdir pkg
7202024-03-21T17:59:38.486Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
7212024-03-21T17:59:38.486Z+ pfexec mkdir -p /usr/oxide
7222024-03-21T17:59:38.486Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
7232024-03-21T17:59:39.191Z+ pfexec chmod +x /usr/oxide/oxide
7242024-03-21T17:59:39.216Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
7252024-03-21T17:59:57.477Z+ OMICRON_NO_UNINSTALL=1
7262024-03-21T17:59:57.477Z+ ptime -m pfexec ./target/release/omicron-package -t test install
7272024-03-21T17:59:57.503ZLogging to: /opt/oxide/work/out/LOG
7282024-03-21T17:59:57.982Z
7292024-03-21T17:59:58.011Zreal 0.501950076
7302024-03-21T17:59:58.011Zuser 0.110323445
7312024-03-21T17:59:58.011Zsys 2.167335077
7322024-03-21T17:59:58.011Ztrap 0.000016120
7332024-03-21T17:59:58.011Ztflt 0.000025659
7342024-03-21T17:59:58.011Zdflt 0.001100847
7352024-03-21T17:59:58.011Zkflt 0.000000000
7362024-03-21T17:59:58.011Zlock 45.417692109
7372024-03-21T17:59:58.011Zslp 0.715185534
7382024-03-21T17:59:58.011Zlat 0.004557817
7392024-03-21T17:59:58.011Zstop 0.205483883
7402024-03-21T17:59:58.011Z+ retry=0
7412024-03-21T17:59:58.011Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7422024-03-21T17:59:58.012Z+ [[ 0 -gt 30 ]]
7432024-03-21T17:59:58.012Z+ sleep 1
7442024-03-21T17:59:58.998Z+ retry=1
7452024-03-21T17:59:58.998Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7462024-03-21T17:59:59.023Z+ [[ 1 -gt 30 ]]
7472024-03-21T17:59:59.023Z+ sleep 1
7482024-03-21T18:00:00.016Z+ retry=2
7492024-03-21T18:00:00.016Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7502024-03-21T18:00:00.043Z+ [[ 2 -gt 30 ]]
7512024-03-21T18:00:00.043Z+ sleep 1
7522024-03-21T18:00:01.028Z+ retry=3
7532024-03-21T18:00:01.028Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7542024-03-21T18:00:01.054Z+ [[ 3 -gt 30 ]]
7552024-03-21T18:00:01.054Z+ sleep 1
7562024-03-21T18:00:02.046Z+ retry=4
7572024-03-21T18:00:02.046Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7582024-03-21T18:00:27.224Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7592024-03-21T18:00:27.252Zlocal v6:
7602024-03-21T18:00:27.252Zfe80::24bd:91ff:fec1:18bd
7612024-03-21T18:00:27.252Zfd38:3181:a596:60e6::1
7622024-03-21T18:00:27.252Zlocal v4:
7632024-03-21T18:00:27.252Z10.151.1.174
7642024-03-21T18:00:27.252Zrouter v6:
7652024-03-21T18:00:27.252Zfd00:1122:3344:2::/64 -> fe80::54bf:e8ff:feee:4f1f (1)
7662024-03-21T18:00:27.252Zfd00:1122:3344:101::/64 -> fe80::54bf:e8ff:feee:4f1f (1)
7672024-03-21T18:00:27.252Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::54bf:e8ff:feee:4f1f (1)
7682024-03-21T18:00:27.252Zfd00:1122:3344:3::/64 -> fe80::54bf:e8ff:feee:4f1f (1)
7692024-03-21T18:00:27.252Zfd00:1122:3344:1::/64 -> fe80::54bf:e8ff:feee:4f1f (1)
7702024-03-21T18:00:27.252Zrouter v4_idx:
7712024-03-21T18:00:27.252Z0.0.0.0/0 -> 0
7722024-03-21T18:00:27.252Zrouter v4_routes:
7732024-03-21T18:00:27.252Z0 -> 10.151.1.100 (2)
7742024-03-21T18:00:27.252Zresolver v4:
7752024-03-21T18:00:27.252Z10.151.1.174 -> 0e:1e:af:df:81:44
7762024-03-21T18:00:27.253Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7772024-03-21T18:00:27.253Zresolver v6:
7782024-03-21T18:00:27.279Zfe80::24bd:91ff:fec1:18bd -> 26:bd:91:c1:18:bd
7792024-03-21T18:00:27.279Zfe80::54bf:e8ff:feee:4f1f -> 56:bf:e8:ee:4f:1f
7802024-03-21T18:00:27.279Znat v4:
7812024-03-21T18:00:27.279Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:a3:89
7822024-03-21T18:00:27.279Znat_v6:
7832024-03-21T18:00:27.279Zport_mac:
7842024-03-21T18:00:27.279Z2: a8:40:25:29:36:69
7852024-03-21T18:00:27.279Z1000: a8:40:25:29:36:48
7862024-03-21T18:00:27.279Z1: a8:40:25:29:36:49
7872024-03-21T18:00:27.279Zproxy arp:
7882024-03-21T18:00:27.279Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7892024-03-21T18:00:27.279Z+ retry=0
7902024-03-21T18:00:27.279Z+++ zoneadm list -n
7912024-03-21T18:00:27.279Z+++ grep oxz_ntp
7922024-03-21T18:00:27.279Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
7932024-03-21T18:00:27.304Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7942024-03-21T18:00:27.304Z++ true
7952024-03-21T18:00:27.304Z+ [[ '' != online ]]
7962024-03-21T18:00:27.305Z+ [[ 0 -gt 60 ]]
7972024-03-21T18:00:27.305Z+ sleep 1
7982024-03-21T18:00:28.287Z+ retry=1
7992024-03-21T18:00:28.315Z+++ zoneadm list -n
8002024-03-21T18:00:28.315Z+++ grep oxz_ntp
8012024-03-21T18:00:28.315Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8022024-03-21T18:00:28.341Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8032024-03-21T18:00:28.342Z++ true
8042024-03-21T18:00:28.342Z+ [[ '' != online ]]
8052024-03-21T18:00:28.342Z+ [[ 1 -gt 60 ]]
8062024-03-21T18:00:28.342Z+ sleep 1
8072024-03-21T18:00:29.318Z+ retry=2
8082024-03-21T18:00:29.343Z+++ zoneadm list -n
8092024-03-21T18:00:29.343Z+++ grep oxz_ntp
8102024-03-21T18:00:29.343Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8112024-03-21T18:00:29.343Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8122024-03-21T18:00:29.343Z++ true
8132024-03-21T18:00:29.369Z+ [[ '' != online ]]
8142024-03-21T18:00:29.369Z+ [[ 2 -gt 60 ]]
8152024-03-21T18:00:29.369Z+ sleep 1
8162024-03-21T18:00:30.347Z+ retry=3
8172024-03-21T18:00:30.373Z+++ zoneadm list -n
8182024-03-21T18:00:30.373Z+++ grep oxz_ntp
8192024-03-21T18:00:30.373Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8202024-03-21T18:00:30.373Z+ [[ offline != online ]]
8212024-03-21T18:00:30.373Z+ [[ 3 -gt 60 ]]
8222024-03-21T18:00:30.373Z+ sleep 1
8232024-03-21T18:00:31.371Z+ retry=4
8242024-03-21T18:00:31.396Z+++ zoneadm list -n
8252024-03-21T18:00:31.396Z+++ grep oxz_ntp
8262024-03-21T18:00:31.396Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8272024-03-21T18:00:31.396Z+ [[ offline != online ]]
8282024-03-21T18:00:31.396Z+ [[ 4 -gt 60 ]]
8292024-03-21T18:00:31.396Z+ sleep 1
8302024-03-21T18:00:32.396Z+ retry=5
8312024-03-21T18:00:32.422Z+++ zoneadm list -n
8322024-03-21T18:00:32.423Z+++ grep oxz_ntp
8332024-03-21T18:00:32.423Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8342024-03-21T18:00:32.423Z+ [[ offline != online ]]
8352024-03-21T18:00:32.423Z+ [[ 5 -gt 60 ]]
8362024-03-21T18:00:32.423Z+ sleep 1
8372024-03-21T18:00:33.416Z+ retry=6
8382024-03-21T18:00:33.441Z+++ zoneadm list -n
8392024-03-21T18:00:33.441Z+++ grep oxz_ntp
8402024-03-21T18:00:33.441Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8412024-03-21T18:00:33.441Z+ [[ offline != online ]]
8422024-03-21T18:00:33.441Z+ [[ 6 -gt 60 ]]
8432024-03-21T18:00:33.441Z+ sleep 1
8442024-03-21T18:00:34.438Z+ retry=7
8452024-03-21T18:00:34.463Z+++ zoneadm list -n
8462024-03-21T18:00:34.463Z+++ grep oxz_ntp
8472024-03-21T18:00:34.463Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8482024-03-21T18:00:34.463Z+ [[ offline != online ]]
8492024-03-21T18:00:34.463Z+ [[ 7 -gt 60 ]]
8502024-03-21T18:00:34.463Z+ sleep 1
8512024-03-21T18:00:35.462Z+ retry=8
8522024-03-21T18:00:35.489Z+++ zoneadm list -n
8532024-03-21T18:00:35.489Z+++ grep oxz_ntp
8542024-03-21T18:00:35.489Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8552024-03-21T18:00:35.489Z+ [[ offline != online ]]
8562024-03-21T18:00:35.490Z+ [[ 8 -gt 60 ]]
8572024-03-21T18:00:35.490Z+ sleep 1
 
8582024-03-21T18:00:35.687Zbuskin console login: Mar 21 18:00:35 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8592024-03-21T18:00:36.485Z+ retry=9
8602024-03-21T18:00:36.510Z+++ zoneadm list -n
8612024-03-21T18:00:36.510Z+++ grep oxz_ntp
8622024-03-21T18:00:36.510Z++ pfexec svcs -z oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d -Hostate oxide/ntp
8632024-03-21T18:00:36.510Z+ [[ online != online ]]
8642024-03-21T18:00:36.510Z+ echo 'Waited for chrony: 9s'
8652024-03-21T18:00:36.510ZWaited for chrony: 9s
8662024-03-21T18:00:36.510Z+ retry=0
8672024-03-21T18:00:36.510Z+ zoneadm list
8682024-03-21T18:00:36.510Z+ grep nexus
8692024-03-21T18:00:36.535Z+ [[ 0 -gt 300 ]]
8702024-03-21T18:00:36.536Z+ sleep 1
8712024-03-21T18:00:37.515Z+ retry=1
8722024-03-21T18:00:37.541Z+ zoneadm list
8732024-03-21T18:00:37.541Z+ grep nexus
8742024-03-21T18:00:37.541Z+ [[ 1 -gt 300 ]]
8752024-03-21T18:00:37.541Z+ sleep 1
8762024-03-21T18:00:38.525Z+ retry=2
8772024-03-21T18:00:38.551Z+ zoneadm list
8782024-03-21T18:00:38.551Z+ grep nexus
8792024-03-21T18:00:38.551Z+ [[ 2 -gt 300 ]]
8802024-03-21T18:00:38.551Z+ sleep 1
8812024-03-21T18:00:39.536Z+ retry=3
8822024-03-21T18:00:39.562Z+ zoneadm list
8832024-03-21T18:00:39.562Z+ grep nexus
8842024-03-21T18:00:39.562Z+ [[ 3 -gt 300 ]]
8852024-03-21T18:00:39.562Z+ sleep 1
8862024-03-21T18:00:40.556Z+ retry=4
8872024-03-21T18:00:40.586Z+ zoneadm list
8882024-03-21T18:00:40.586Z+ grep nexus
8892024-03-21T18:00:40.586Z+ [[ 4 -gt 300 ]]
8902024-03-21T18:00:40.586Z+ sleep 1
8912024-03-21T18:00:41.558Z+ retry=5
8922024-03-21T18:00:41.587Z+ zoneadm list
8932024-03-21T18:00:41.587Z+ grep nexus
8942024-03-21T18:00:41.587Z+ [[ 5 -gt 300 ]]
8952024-03-21T18:00:41.587Z+ sleep 1
8962024-03-21T18:00:42.568Z+ retry=6
8972024-03-21T18:00:42.593Z+ zoneadm list
8982024-03-21T18:00:42.593Z+ grep nexus
8992024-03-21T18:00:42.593Z+ [[ 6 -gt 300 ]]
9002024-03-21T18:00:42.593Z+ sleep 1
9012024-03-21T18:00:43.580Z+ retry=7
9022024-03-21T18:00:43.605Z+ zoneadm list
9032024-03-21T18:00:43.605Z+ grep nexus
9042024-03-21T18:00:43.605Z+ [[ 7 -gt 300 ]]
9052024-03-21T18:00:43.605Z+ sleep 1
9062024-03-21T18:00:44.589Z+ retry=8
9072024-03-21T18:00:44.615Z+ zoneadm list
9082024-03-21T18:00:44.615Z+ grep nexus
9092024-03-21T18:00:44.615Z+ [[ 8 -gt 300 ]]
9102024-03-21T18:00:44.615Z+ sleep 1
9112024-03-21T18:00:45.609Z+ retry=9
9122024-03-21T18:00:45.648Z+ zoneadm list
9132024-03-21T18:00:45.649Z+ grep nexus
9142024-03-21T18:00:45.649Z+ [[ 9 -gt 300 ]]
9152024-03-21T18:00:45.649Z+ sleep 1
9162024-03-21T18:00:46.612Z+ retry=10
9172024-03-21T18:00:46.638Z+ zoneadm list
9182024-03-21T18:00:46.638Z+ grep nexus
9192024-03-21T18:00:46.638Z+ [[ 10 -gt 300 ]]
9202024-03-21T18:00:46.638Z+ sleep 1
9212024-03-21T18:00:47.622Z+ retry=11
9222024-03-21T18:00:47.648Z+ zoneadm list
9232024-03-21T18:00:47.648Z+ grep nexus
9242024-03-21T18:00:47.648Z+ [[ 11 -gt 300 ]]
9252024-03-21T18:00:47.648Z+ sleep 1
9262024-03-21T18:00:48.631Z+ retry=12
9272024-03-21T18:00:48.658Z+ zoneadm list
9282024-03-21T18:00:48.658Z+ grep nexus
9292024-03-21T18:00:48.659Z+ [[ 12 -gt 300 ]]
9302024-03-21T18:00:48.659Z+ sleep 1
9312024-03-21T18:00:49.642Z+ retry=13
9322024-03-21T18:00:49.701Z+ zoneadm list
9332024-03-21T18:00:49.701Z+ grep nexus
9342024-03-21T18:00:49.701Z+ [[ 13 -gt 300 ]]
9352024-03-21T18:00:49.701Z+ sleep 1
9362024-03-21T18:00:50.665Z+ retry=14
9372024-03-21T18:00:50.700Z+ zoneadm list
9382024-03-21T18:00:50.700Z+ grep nexus
9392024-03-21T18:00:50.700Z+ [[ 14 -gt 300 ]]
9402024-03-21T18:00:50.700Z+ sleep 1
9412024-03-21T18:00:51.665Z+ retry=15
9422024-03-21T18:00:51.691Z+ zoneadm list
9432024-03-21T18:00:51.691Z+ grep nexus
9442024-03-21T18:00:51.691Z+ [[ 15 -gt 300 ]]
9452024-03-21T18:00:51.691Z+ sleep 1
9462024-03-21T18:00:52.676Z+ retry=16
9472024-03-21T18:00:52.702Z+ zoneadm list
9482024-03-21T18:00:52.702Z+ grep nexus
9492024-03-21T18:00:52.702Z+ [[ 16 -gt 300 ]]
9502024-03-21T18:00:52.702Z+ sleep 1
9512024-03-21T18:00:53.686Z+ retry=17
9522024-03-21T18:00:53.712Z+ zoneadm list
9532024-03-21T18:00:53.712Z+ grep nexus
9542024-03-21T18:00:53.712Z+ [[ 17 -gt 300 ]]
9552024-03-21T18:00:53.713Z+ sleep 1
9562024-03-21T18:00:54.700Z+ retry=18
9572024-03-21T18:00:54.727Z+ zoneadm list
9582024-03-21T18:00:54.727Z+ grep nexus
9592024-03-21T18:00:54.727Z+ [[ 18 -gt 300 ]]
9602024-03-21T18:00:54.727Z+ sleep 1
9612024-03-21T18:00:55.707Z+ retry=19
9622024-03-21T18:00:55.732Z+ zoneadm list
9632024-03-21T18:00:55.732Z+ grep nexus
9642024-03-21T18:00:55.733Z+ [[ 19 -gt 300 ]]
9652024-03-21T18:00:55.733Z+ sleep 1
9662024-03-21T18:00:56.718Z+ retry=20
9672024-03-21T18:00:56.743Z+ zoneadm list
9682024-03-21T18:00:56.744Z+ grep nexus
9692024-03-21T18:00:56.744Z+ [[ 20 -gt 300 ]]
9702024-03-21T18:00:56.744Z+ sleep 1
9712024-03-21T18:00:57.733Z+ retry=21
9722024-03-21T18:00:57.760Z+ zoneadm list
9732024-03-21T18:00:57.760Z+ grep nexus
9742024-03-21T18:00:57.760Z+ [[ 21 -gt 300 ]]
9752024-03-21T18:00:57.760Z+ sleep 1
9762024-03-21T18:00:58.738Z+ retry=22
9772024-03-21T18:00:58.764Z+ zoneadm list
9782024-03-21T18:00:58.764Z+ grep nexus
9792024-03-21T18:00:58.764Z+ [[ 22 -gt 300 ]]
9802024-03-21T18:00:58.764Z+ sleep 1
9812024-03-21T18:00:59.750Z+ retry=23
9822024-03-21T18:00:59.776Z+ zoneadm list
9832024-03-21T18:00:59.777Z+ grep nexus
9842024-03-21T18:00:59.777Z+ [[ 23 -gt 300 ]]
9852024-03-21T18:00:59.777Z+ sleep 1
9862024-03-21T18:01:00.759Z+ retry=24
9872024-03-21T18:01:00.785Z+ zoneadm list
9882024-03-21T18:01:00.785Z+ grep nexus
9892024-03-21T18:01:00.785Z+ [[ 24 -gt 300 ]]
9902024-03-21T18:01:00.785Z+ sleep 1
9912024-03-21T18:01:01.774Z+ retry=25
9922024-03-21T18:01:01.802Z+ zoneadm list
9932024-03-21T18:01:01.802Z+ grep nexus
9942024-03-21T18:01:01.802Z+ [[ 25 -gt 300 ]]
9952024-03-21T18:01:01.802Z+ sleep 1
9962024-03-21T18:01:02.780Z+ retry=26
9972024-03-21T18:01:02.813Z+ zoneadm list
9982024-03-21T18:01:02.813Z+ grep nexus
9992024-03-21T18:01:02.813Z+ [[ 26 -gt 300 ]]
10002024-03-21T18:01:02.813Z+ sleep 1
10012024-03-21T18:01:03.790Z+ retry=27
10022024-03-21T18:01:03.816Z+ zoneadm list
10032024-03-21T18:01:03.816Z+ grep nexus
10042024-03-21T18:01:03.816Z+ [[ 27 -gt 300 ]]
10052024-03-21T18:01:03.816Z+ sleep 1
10062024-03-21T18:01:04.801Z+ retry=28
10072024-03-21T18:01:04.828Z+ zoneadm list
10082024-03-21T18:01:04.828Z+ grep nexus
10092024-03-21T18:01:04.828Z+ [[ 28 -gt 300 ]]
10102024-03-21T18:01:04.828Z+ sleep 1
10112024-03-21T18:01:05.813Z+ retry=29
10122024-03-21T18:01:05.842Z+ zoneadm list
10132024-03-21T18:01:05.842Z+ grep nexus
10142024-03-21T18:01:05.842Z+ [[ 29 -gt 300 ]]
10152024-03-21T18:01:05.842Z+ sleep 1
10162024-03-21T18:01:06.829Z+ retry=30
10172024-03-21T18:01:06.860Z+ zoneadm list
10182024-03-21T18:01:06.861Z+ grep nexus
10192024-03-21T18:01:06.861Z+ [[ 30 -gt 300 ]]
10202024-03-21T18:01:06.861Z+ sleep 1
10212024-03-21T18:01:07.834Z+ retry=31
10222024-03-21T18:01:07.862Z+ zoneadm list
10232024-03-21T18:01:07.862Z+ grep nexus
10242024-03-21T18:01:07.862Z+ [[ 31 -gt 300 ]]
10252024-03-21T18:01:07.862Z+ sleep 1
10262024-03-21T18:01:08.844Z+ retry=32
10272024-03-21T18:01:08.870Z+ zoneadm list
10282024-03-21T18:01:08.870Z+ grep nexus
10292024-03-21T18:01:08.871Z+ [[ 32 -gt 300 ]]
10302024-03-21T18:01:08.871Z+ sleep 1
10312024-03-21T18:01:09.859Z+ retry=33
10322024-03-21T18:01:09.896Z+ zoneadm list
10332024-03-21T18:01:09.896Z+ grep nexus
10342024-03-21T18:01:09.896Z+ [[ 33 -gt 300 ]]
10352024-03-21T18:01:09.896Z+ sleep 1
10362024-03-21T18:01:10.864Z+ retry=34
10372024-03-21T18:01:10.890Z+ zoneadm list
10382024-03-21T18:01:10.890Z+ grep nexus
10392024-03-21T18:01:10.890Z+ [[ 34 -gt 300 ]]
10402024-03-21T18:01:10.890Z+ sleep 1
10412024-03-21T18:01:11.875Z+ retry=35
10422024-03-21T18:01:11.900Z+ zoneadm list
10432024-03-21T18:01:11.900Z+ grep nexus
10442024-03-21T18:01:11.900Z+ [[ 35 -gt 300 ]]
10452024-03-21T18:01:11.901Z+ sleep 1
10462024-03-21T18:01:12.887Z+ retry=36
10472024-03-21T18:01:12.913Z+ zoneadm list
10482024-03-21T18:01:12.913Z+ grep nexus
10492024-03-21T18:01:12.913Z+ [[ 36 -gt 300 ]]
10502024-03-21T18:01:12.913Z+ sleep 1
10512024-03-21T18:01:13.897Z+ retry=37
10522024-03-21T18:01:13.924Z+ zoneadm list
10532024-03-21T18:01:13.924Z+ grep nexus
10542024-03-21T18:01:13.924Z+ [[ 37 -gt 300 ]]
10552024-03-21T18:01:13.924Z+ sleep 1
10562024-03-21T18:01:14.907Z+ retry=38
10572024-03-21T18:01:14.934Z+ zoneadm list
10582024-03-21T18:01:14.934Z+ grep nexus
10592024-03-21T18:01:14.934Z+ [[ 38 -gt 300 ]]
10602024-03-21T18:01:14.934Z+ sleep 1
10612024-03-21T18:01:15.917Z+ retry=39
10622024-03-21T18:01:15.950Z+ zoneadm list
10632024-03-21T18:01:15.950Z+ grep nexus
10642024-03-21T18:01:15.950Z+ [[ 39 -gt 300 ]]
10652024-03-21T18:01:15.950Z+ sleep 1
10662024-03-21T18:01:16.928Z+ retry=40
10672024-03-21T18:01:16.957Z+ zoneadm list
10682024-03-21T18:01:16.957Z+ grep nexus
10692024-03-21T18:01:16.957Z+ [[ 40 -gt 300 ]]
10702024-03-21T18:01:16.957Z+ sleep 1
10712024-03-21T18:01:17.945Z+ retry=41
10722024-03-21T18:01:17.975Z+ zoneadm list
10732024-03-21T18:01:17.975Z+ grep nexus
10742024-03-21T18:01:17.975Z+ [[ 41 -gt 300 ]]
10752024-03-21T18:01:17.975Z+ sleep 1
10762024-03-21T18:01:18.957Z+ retry=42
10772024-03-21T18:01:18.985Z+ zoneadm list
10782024-03-21T18:01:18.985Z+ grep nexus
10792024-03-21T18:01:18.985Z+ [[ 42 -gt 300 ]]
10802024-03-21T18:01:18.985Z+ sleep 1
10812024-03-21T18:01:19.960Z+ retry=43
10822024-03-21T18:01:19.986Z+ zoneadm list
10832024-03-21T18:01:19.986Z+ grep nexus
10842024-03-21T18:01:19.986Z+ [[ 43 -gt 300 ]]
10852024-03-21T18:01:19.986Z+ sleep 1
10862024-03-21T18:01:20.970Z+ retry=44
10872024-03-21T18:01:20.997Z+ zoneadm list
10882024-03-21T18:01:20.997Z+ grep nexus
10892024-03-21T18:01:20.997Z+ [[ 44 -gt 300 ]]
10902024-03-21T18:01:20.997Z+ sleep 1
10912024-03-21T18:01:21.998Z+ retry=45
10922024-03-21T18:01:22.034Z+ zoneadm list
10932024-03-21T18:01:22.034Z+ grep nexus
10942024-03-21T18:01:22.034Z+ [[ 45 -gt 300 ]]
10952024-03-21T18:01:22.034Z+ sleep 1
10962024-03-21T18:01:22.993Z+ retry=46
10972024-03-21T18:01:23.023Z+ zoneadm list
10982024-03-21T18:01:23.023Z+ grep nexus
10992024-03-21T18:01:23.023Z+ [[ 46 -gt 300 ]]
11002024-03-21T18:01:23.023Z+ sleep 1
11012024-03-21T18:01:24.003Z+ retry=47
11022024-03-21T18:01:24.029Z+ zoneadm list
11032024-03-21T18:01:24.029Z+ grep nexus
11042024-03-21T18:01:24.029Z+ [[ 47 -gt 300 ]]
11052024-03-21T18:01:24.029Z+ sleep 1
11062024-03-21T18:01:25.018Z+ retry=48
11072024-03-21T18:01:25.045Z+ zoneadm list
11082024-03-21T18:01:25.045Z+ grep nexus
11092024-03-21T18:01:25.045Z+ [[ 48 -gt 300 ]]
11102024-03-21T18:01:25.046Z+ sleep 1
11112024-03-21T18:01:26.024Z+ retry=49
11122024-03-21T18:01:26.051Z+ zoneadm list
11132024-03-21T18:01:26.051Z+ grep nexus
11142024-03-21T18:01:26.051Z+ [[ 49 -gt 300 ]]
11152024-03-21T18:01:26.051Z+ sleep 1
11162024-03-21T18:01:27.038Z+ retry=50
11172024-03-21T18:01:27.064Z+ zoneadm list
11182024-03-21T18:01:27.065Z+ grep nexus
11192024-03-21T18:01:27.065Z+ [[ 50 -gt 300 ]]
11202024-03-21T18:01:27.065Z+ sleep 1
11212024-03-21T18:01:28.052Z+ retry=51
11222024-03-21T18:01:28.077Z+ zoneadm list
11232024-03-21T18:01:28.078Z+ grep nexus
11242024-03-21T18:01:28.078Z+ [[ 51 -gt 300 ]]
11252024-03-21T18:01:28.078Z+ sleep 1
11262024-03-21T18:01:29.067Z+ retry=52
11272024-03-21T18:01:29.092Z+ zoneadm list
11282024-03-21T18:01:29.092Z+ grep nexus
11292024-03-21T18:01:29.092Z+ [[ 52 -gt 300 ]]
11302024-03-21T18:01:29.092Z+ sleep 1
11312024-03-21T18:01:30.080Z+ retry=53
11322024-03-21T18:01:30.107Z+ zoneadm list
11332024-03-21T18:01:30.107Z+ grep nexus
11342024-03-21T18:01:30.107Z+ [[ 53 -gt 300 ]]
11352024-03-21T18:01:30.107Z+ sleep 1
11362024-03-21T18:01:31.107Z+ retry=54
11372024-03-21T18:01:31.606Z+ zoneadm list
11382024-03-21T18:01:31.606Z+ grep nexus
11392024-03-21T18:01:31.606Z+ [[ 54 -gt 300 ]]
11402024-03-21T18:01:31.606Z+ sleep 1
11412024-03-21T18:01:32.109Z+ retry=55
11422024-03-21T18:01:32.135Z+ zoneadm list
11432024-03-21T18:01:32.135Z+ grep nexus
11442024-03-21T18:01:32.135Z+ [[ 55 -gt 300 ]]
11452024-03-21T18:01:32.135Z+ sleep 1
11462024-03-21T18:01:33.123Z+ retry=56
11472024-03-21T18:01:33.149Z+ zoneadm list
11482024-03-21T18:01:33.149Z+ grep nexus
11492024-03-21T18:01:33.149Z+ [[ 56 -gt 300 ]]
11502024-03-21T18:01:33.150Z+ sleep 1
11512024-03-21T18:01:34.139Z+ retry=57
11522024-03-21T18:01:34.165Z+ zoneadm list
11532024-03-21T18:01:34.165Z+ grep nexus
11542024-03-21T18:01:34.165Z+ [[ 57 -gt 300 ]]
11552024-03-21T18:01:34.165Z+ sleep 1
11562024-03-21T18:01:35.149Z+ retry=58
11572024-03-21T18:01:35.175Z+ zoneadm list
11582024-03-21T18:01:35.175Z+ grep nexus
11592024-03-21T18:01:35.175Z+ [[ 58 -gt 300 ]]
11602024-03-21T18:01:35.175Z+ sleep 1
11612024-03-21T18:01:36.164Z+ retry=59
11622024-03-21T18:01:36.190Z+ zoneadm list
11632024-03-21T18:01:36.190Z+ grep nexus
11642024-03-21T18:01:36.190Z+ [[ 59 -gt 300 ]]
11652024-03-21T18:01:36.190Z+ sleep 1
11662024-03-21T18:01:37.186Z+ retry=60
11672024-03-21T18:01:37.211Z+ zoneadm list
11682024-03-21T18:01:37.211Z+ grep nexus
11692024-03-21T18:01:37.211Z+ [[ 60 -gt 300 ]]
11702024-03-21T18:01:37.211Z+ sleep 1
11712024-03-21T18:01:38.191Z+ retry=61
11722024-03-21T18:01:38.219Z+ zoneadm list
11732024-03-21T18:01:38.219Z+ grep nexus
11742024-03-21T18:01:38.219Z+ [[ 61 -gt 300 ]]
11752024-03-21T18:01:38.219Z+ sleep 1
11762024-03-21T18:01:39.205Z+ retry=62
11772024-03-21T18:01:39.235Z+ zoneadm list
11782024-03-21T18:01:39.235Z+ grep nexus
11792024-03-21T18:01:39.235Z+ [[ 62 -gt 300 ]]
11802024-03-21T18:01:39.236Z+ sleep 1
11812024-03-21T18:01:40.218Z+ retry=63
11822024-03-21T18:01:40.245Z+ zoneadm list
11832024-03-21T18:01:40.245Z+ grep nexus
11842024-03-21T18:01:40.245Z+ [[ 63 -gt 300 ]]
11852024-03-21T18:01:40.245Z+ sleep 1
11862024-03-21T18:01:41.234Z+ retry=64
11872024-03-21T18:01:41.260Z+ zoneadm list
11882024-03-21T18:01:41.260Z+ grep nexus
11892024-03-21T18:01:41.260Z+ [[ 64 -gt 300 ]]
11902024-03-21T18:01:41.260Z+ sleep 1
11912024-03-21T18:01:42.245Z+ retry=65
11922024-03-21T18:01:42.272Z+ zoneadm list
11932024-03-21T18:01:42.272Z+ grep nexus
11942024-03-21T18:01:42.272Z+ [[ 65 -gt 300 ]]
11952024-03-21T18:01:42.272Z+ sleep 1
11962024-03-21T18:01:43.260Z+ retry=66
11972024-03-21T18:01:43.287Z+ zoneadm list
11982024-03-21T18:01:43.287Z+ grep nexus
11992024-03-21T18:01:43.287Z+ [[ 66 -gt 300 ]]
12002024-03-21T18:01:43.287Z+ sleep 1
12012024-03-21T18:01:44.274Z+ retry=67
12022024-03-21T18:01:44.329Z+ zoneadm list
12032024-03-21T18:01:44.329Z+ grep nexus
12042024-03-21T18:01:44.329Z+ [[ 67 -gt 300 ]]
12052024-03-21T18:01:44.329Z+ sleep 1
12062024-03-21T18:01:45.288Z+ retry=68
12072024-03-21T18:01:45.320Z+ zoneadm list
12082024-03-21T18:01:45.320Z+ grep nexus
12092024-03-21T18:01:45.320Z+ [[ 68 -gt 300 ]]
12102024-03-21T18:01:45.320Z+ sleep 1
12112024-03-21T18:01:46.298Z+ retry=69
12122024-03-21T18:01:46.324Z+ zoneadm list
12132024-03-21T18:01:46.324Z+ grep nexus
12142024-03-21T18:01:46.324Z+ [[ 69 -gt 300 ]]
12152024-03-21T18:01:46.324Z+ sleep 1
12162024-03-21T18:01:47.312Z+ retry=70
12172024-03-21T18:01:47.338Z+ zoneadm list
12182024-03-21T18:01:47.339Z+ grep nexus
12192024-03-21T18:01:47.339Z+ [[ 70 -gt 300 ]]
12202024-03-21T18:01:47.339Z+ sleep 1
12212024-03-21T18:01:48.328Z+ retry=71
12222024-03-21T18:01:48.354Z+ zoneadm list
12232024-03-21T18:01:48.354Z+ grep nexus
12242024-03-21T18:01:48.354Z+ [[ 71 -gt 300 ]]
12252024-03-21T18:01:48.354Z+ sleep 1
12262024-03-21T18:01:49.341Z+ retry=72
12272024-03-21T18:01:49.368Z+ zoneadm list
12282024-03-21T18:01:49.368Z+ grep nexus
12292024-03-21T18:01:49.368Z+ [[ 72 -gt 300 ]]
12302024-03-21T18:01:49.368Z+ sleep 1
12312024-03-21T18:01:50.355Z+ retry=73
12322024-03-21T18:01:50.382Z+ zoneadm list
12332024-03-21T18:01:50.382Z+ grep nexus
12342024-03-21T18:01:50.382Z+ [[ 73 -gt 300 ]]
12352024-03-21T18:01:50.382Z+ sleep 1
12362024-03-21T18:01:51.370Z+ retry=74
12372024-03-21T18:01:51.396Z+ zoneadm list
12382024-03-21T18:01:51.396Z+ grep nexus
12392024-03-21T18:01:51.396Z+ [[ 74 -gt 300 ]]
12402024-03-21T18:01:51.396Z+ sleep 1
12412024-03-21T18:01:52.390Z+ retry=75
12422024-03-21T18:01:52.420Z+ zoneadm list
12432024-03-21T18:01:52.420Z+ grep nexus
12442024-03-21T18:01:52.420Z+ [[ 75 -gt 300 ]]
12452024-03-21T18:01:52.421Z+ sleep 1
12462024-03-21T18:01:53.396Z+ retry=76
12472024-03-21T18:01:53.422Z+ zoneadm list
12482024-03-21T18:01:53.422Z+ grep nexus
12492024-03-21T18:01:53.422Z+ [[ 76 -gt 300 ]]
12502024-03-21T18:01:53.423Z+ sleep 1
12512024-03-21T18:01:54.820Z+ retry=77
12522024-03-21T18:01:54.847Z+ zoneadm list
12532024-03-21T18:01:54.847Z+ grep nexus
12542024-03-21T18:01:54.847Z+ [[ 77 -gt 300 ]]
12552024-03-21T18:01:54.847Z+ sleep 1
12562024-03-21T18:01:55.424Z+ retry=78
12572024-03-21T18:01:55.450Z+ zoneadm list
12582024-03-21T18:01:55.450Z+ grep nexus
12592024-03-21T18:01:55.450Z+ [[ 78 -gt 300 ]]
12602024-03-21T18:01:55.450Z+ sleep 1
12612024-03-21T18:01:56.437Z+ retry=79
12622024-03-21T18:01:56.463Z+ zoneadm list
12632024-03-21T18:01:56.464Z+ grep nexus
12642024-03-21T18:01:56.464Z+ [[ 79 -gt 300 ]]
12652024-03-21T18:01:56.464Z+ sleep 1
12662024-03-21T18:01:57.455Z+ retry=80
12672024-03-21T18:01:57.480Z+ zoneadm list
12682024-03-21T18:01:57.480Z+ grep nexus
12692024-03-21T18:01:57.480Z+ [[ 80 -gt 300 ]]
12702024-03-21T18:01:57.480Z+ sleep 1
12712024-03-21T18:01:58.474Z+ retry=81
12722024-03-21T18:01:58.506Z+ zoneadm list
12732024-03-21T18:01:58.506Z+ grep nexus
12742024-03-21T18:01:58.506Z+ [[ 81 -gt 300 ]]
12752024-03-21T18:01:58.506Z+ sleep 1
12762024-03-21T18:01:59.482Z+ retry=82
12772024-03-21T18:01:59.521Z+ zoneadm list
12782024-03-21T18:01:59.522Z+ grep nexus
12792024-03-21T18:01:59.522Z+ [[ 82 -gt 300 ]]
12802024-03-21T18:01:59.522Z+ sleep 1
12812024-03-21T18:02:00.494Z+ retry=83
12822024-03-21T18:02:00.530Z+ zoneadm list
12832024-03-21T18:02:00.530Z+ grep nexus
12842024-03-21T18:02:00.530Z+ [[ 83 -gt 300 ]]
12852024-03-21T18:02:00.530Z+ sleep 1
12862024-03-21T18:02:01.508Z+ retry=84
12872024-03-21T18:02:01.535Z+ zoneadm list
12882024-03-21T18:02:01.535Z+ grep nexus
12892024-03-21T18:02:01.535Z+ [[ 84 -gt 300 ]]
12902024-03-21T18:02:01.535Z+ sleep 1
12912024-03-21T18:02:02.524Z+ retry=85
12922024-03-21T18:02:02.552Z+ zoneadm list
12932024-03-21T18:02:02.552Z+ grep nexus
12942024-03-21T18:02:02.552Z+ [[ 85 -gt 300 ]]
12952024-03-21T18:02:02.552Z+ sleep 1
12962024-03-21T18:02:03.534Z+ retry=86
12972024-03-21T18:02:03.561Z+ zoneadm list
12982024-03-21T18:02:03.561Z+ grep nexus
12992024-03-21T18:02:03.561Z+ [[ 86 -gt 300 ]]
13002024-03-21T18:02:03.561Z+ sleep 1
13012024-03-21T18:02:04.549Z+ retry=87
13022024-03-21T18:02:04.577Z+ zoneadm list
13032024-03-21T18:02:04.577Z+ grep nexus
13042024-03-21T18:02:04.577Z+ [[ 87 -gt 300 ]]
13052024-03-21T18:02:04.577Z+ sleep 1
13062024-03-21T18:02:05.575Z+ retry=88
13072024-03-21T18:02:05.611Z+ zoneadm list
13082024-03-21T18:02:05.612Z+ grep nexus
13092024-03-21T18:02:05.612Z+ [[ 88 -gt 300 ]]
13102024-03-21T18:02:05.612Z+ sleep 1
13112024-03-21T18:02:06.576Z+ retry=89
13122024-03-21T18:02:06.602Z+ zoneadm list
13132024-03-21T18:02:06.603Z+ grep nexus
13142024-03-21T18:02:06.603Z+ [[ 89 -gt 300 ]]
13152024-03-21T18:02:06.603Z+ sleep 1
13162024-03-21T18:02:07.591Z+ retry=90
13172024-03-21T18:02:07.617Z+ zoneadm list
13182024-03-21T18:02:07.617Z+ grep nexus
13192024-03-21T18:02:07.617Z+ [[ 90 -gt 300 ]]
13202024-03-21T18:02:07.617Z+ sleep 1
13212024-03-21T18:02:08.611Z+ retry=91
13222024-03-21T18:02:08.639Z+ zoneadm list
13232024-03-21T18:02:08.639Z+ grep nexus
13242024-03-21T18:02:08.639Z+ [[ 91 -gt 300 ]]
13252024-03-21T18:02:08.639Z+ sleep 1
13262024-03-21T18:02:09.617Z+ retry=92
13272024-03-21T18:02:09.644Z+ zoneadm list
13282024-03-21T18:02:09.644Z+ grep nexus
13292024-03-21T18:02:09.644Z+ [[ 92 -gt 300 ]]
13302024-03-21T18:02:09.644Z+ sleep 1
13312024-03-21T18:02:10.636Z+ retry=93
13322024-03-21T18:02:10.664Z+ zoneadm list
13332024-03-21T18:02:10.664Z+ grep nexus
13342024-03-21T18:02:10.664Z+ [[ 93 -gt 300 ]]
13352024-03-21T18:02:10.664Z+ sleep 1
13362024-03-21T18:02:11.637Z+ retry=94
13372024-03-21T18:02:11.664Z+ zoneadm list
13382024-03-21T18:02:11.664Z+ grep nexus
13392024-03-21T18:02:11.664Z+ [[ 94 -gt 300 ]]
13402024-03-21T18:02:11.664Z+ sleep 1
13412024-03-21T18:02:12.647Z+ retry=95
13422024-03-21T18:02:12.672Z+ zoneadm list
13432024-03-21T18:02:12.673Z+ grep nexus
13442024-03-21T18:02:12.673Z+ [[ 95 -gt 300 ]]
13452024-03-21T18:02:12.673Z+ sleep 1
13462024-03-21T18:02:13.661Z+ retry=96
13472024-03-21T18:02:13.686Z+ zoneadm list
13482024-03-21T18:02:13.687Z+ grep nexus
13492024-03-21T18:02:13.687Z+ [[ 96 -gt 300 ]]
13502024-03-21T18:02:13.687Z+ sleep 1
13512024-03-21T18:02:14.675Z+ retry=97
13522024-03-21T18:02:14.675Z+ zoneadm list
13532024-03-21T18:02:14.676Z+ grep nexus
13542024-03-21T18:02:14.704Z+ [[ 97 -gt 300 ]]
13552024-03-21T18:02:14.704Z+ sleep 1
13562024-03-21T18:02:15.680Z+ retry=98
13572024-03-21T18:02:15.708Z+ zoneadm list
13582024-03-21T18:02:15.708Z+ grep nexus
13592024-03-21T18:02:15.708Z+ [[ 98 -gt 300 ]]
13602024-03-21T18:02:15.708Z+ sleep 1
13612024-03-21T18:02:16.690Z+ retry=99
13622024-03-21T18:02:16.716Z+ zoneadm list
13632024-03-21T18:02:16.716Z+ grep nexus
13642024-03-21T18:02:16.716Z+ [[ 99 -gt 300 ]]
13652024-03-21T18:02:16.716Z+ sleep 1
13662024-03-21T18:02:17.702Z+ retry=100
13672024-03-21T18:02:17.728Z+ zoneadm list
13682024-03-21T18:02:17.728Z+ grep nexus
13692024-03-21T18:02:17.728Z+ [[ 100 -gt 300 ]]
13702024-03-21T18:02:17.728Z+ sleep 1
13712024-03-21T18:02:18.716Z+ retry=101
13722024-03-21T18:02:18.743Z+ zoneadm list
13732024-03-21T18:02:18.743Z+ grep nexus
13742024-03-21T18:02:18.743Z+ [[ 101 -gt 300 ]]
13752024-03-21T18:02:18.744Z+ sleep 1
13762024-03-21T18:02:19.724Z+ retry=102
13772024-03-21T18:02:19.750Z+ zoneadm list
13782024-03-21T18:02:19.750Z+ grep nexus
13792024-03-21T18:02:19.750Z+ [[ 102 -gt 300 ]]
13802024-03-21T18:02:19.750Z+ sleep 1
13812024-03-21T18:02:20.731Z+ retry=103
13822024-03-21T18:02:20.757Z+ zoneadm list
13832024-03-21T18:02:20.757Z+ grep nexus
13842024-03-21T18:02:20.757Z+ [[ 103 -gt 300 ]]
13852024-03-21T18:02:20.757Z+ sleep 1
13862024-03-21T18:02:21.745Z+ retry=104
13872024-03-21T18:02:21.770Z+ zoneadm list
13882024-03-21T18:02:21.770Z+ grep nexus
13892024-03-21T18:02:21.770Z+ [[ 104 -gt 300 ]]
13902024-03-21T18:02:21.770Z+ sleep 1
13912024-03-21T18:02:22.753Z+ retry=105
13922024-03-21T18:02:22.784Z+ zoneadm list
13932024-03-21T18:02:22.784Z+ grep nexus
13942024-03-21T18:02:22.784Z+ [[ 105 -gt 300 ]]
13952024-03-21T18:02:22.784Z+ sleep 1
13962024-03-21T18:02:23.765Z+ retry=106
13972024-03-21T18:02:23.793Z+ zoneadm list
13982024-03-21T18:02:23.793Z+ grep nexus
13992024-03-21T18:02:23.793Z+ [[ 106 -gt 300 ]]
14002024-03-21T18:02:23.793Z+ sleep 1
14012024-03-21T18:02:24.774Z+ retry=107
14022024-03-21T18:02:24.799Z+ zoneadm list
14032024-03-21T18:02:24.800Z+ grep nexus
14042024-03-21T18:02:24.800Z+ [[ 107 -gt 300 ]]
14052024-03-21T18:02:24.800Z+ sleep 1
14062024-03-21T18:02:25.785Z+ retry=108
14072024-03-21T18:02:25.810Z+ zoneadm list
14082024-03-21T18:02:25.810Z+ grep nexus
14092024-03-21T18:02:25.810Z+ [[ 108 -gt 300 ]]
14102024-03-21T18:02:25.810Z+ sleep 1
14112024-03-21T18:02:26.815Z+ retry=109
14122024-03-21T18:02:26.841Z+ zoneadm list
14132024-03-21T18:02:26.841Z+ grep nexus
14142024-03-21T18:02:26.841Z+ [[ 109 -gt 300 ]]
14152024-03-21T18:02:26.841Z+ sleep 1
14162024-03-21T18:02:27.818Z+ retry=110
14172024-03-21T18:02:27.844Z+ zoneadm list
14182024-03-21T18:02:27.844Z+ grep nexus
14192024-03-21T18:02:27.844Z+ [[ 110 -gt 300 ]]
14202024-03-21T18:02:27.845Z+ sleep 1
14212024-03-21T18:02:28.819Z+ retry=111
14222024-03-21T18:02:28.845Z+ zoneadm list
14232024-03-21T18:02:28.845Z+ grep nexus
14242024-03-21T18:02:28.845Z+ [[ 111 -gt 300 ]]
14252024-03-21T18:02:28.845Z+ sleep 1
14262024-03-21T18:02:29.828Z+ retry=112
14272024-03-21T18:02:29.854Z+ zoneadm list
14282024-03-21T18:02:29.854Z+ grep nexus
14292024-03-21T18:02:29.854Z+ [[ 112 -gt 300 ]]
14302024-03-21T18:02:29.854Z+ sleep 1
14312024-03-21T18:02:30.838Z+ retry=113
14322024-03-21T18:02:30.863Z+ zoneadm list
14332024-03-21T18:02:30.863Z+ grep nexus
14342024-03-21T18:02:30.863Z+ [[ 113 -gt 300 ]]
14352024-03-21T18:02:30.863Z+ sleep 1
14362024-03-21T18:02:31.848Z+ retry=114
14372024-03-21T18:02:31.874Z+ zoneadm list
14382024-03-21T18:02:31.874Z+ grep nexus
14392024-03-21T18:02:31.874Z+ [[ 114 -gt 300 ]]
14402024-03-21T18:02:31.874Z+ sleep 1
14412024-03-21T18:02:32.859Z+ retry=115
14422024-03-21T18:02:32.884Z+ zoneadm list
14432024-03-21T18:02:32.885Z+ grep nexus
14442024-03-21T18:02:32.885Z+ [[ 115 -gt 300 ]]
14452024-03-21T18:02:32.885Z+ sleep 1
14462024-03-21T18:02:33.870Z+ retry=116
14472024-03-21T18:02:33.895Z+ zoneadm list
14482024-03-21T18:02:33.896Z+ grep nexus
14492024-03-21T18:02:33.896Z+ [[ 116 -gt 300 ]]
14502024-03-21T18:02:33.896Z+ sleep 1
14512024-03-21T18:02:34.882Z+ retry=117
14522024-03-21T18:02:34.907Z+ zoneadm list
14532024-03-21T18:02:34.907Z+ grep nexus
14542024-03-21T18:02:34.907Z+ [[ 117 -gt 300 ]]
14552024-03-21T18:02:34.907Z+ sleep 1
14562024-03-21T18:02:35.894Z+ retry=118
14572024-03-21T18:02:35.921Z+ zoneadm list
14582024-03-21T18:02:35.921Z+ grep nexus
14592024-03-21T18:02:35.921Z+ [[ 118 -gt 300 ]]
14602024-03-21T18:02:35.921Z+ sleep 1
14612024-03-21T18:02:36.907Z+ retry=119
14622024-03-21T18:02:36.933Z+ zoneadm list
14632024-03-21T18:02:36.933Z+ grep nexus
14642024-03-21T18:02:36.993Z+ [[ 119 -gt 300 ]]
14652024-03-21T18:02:36.993Z+ sleep 1
14662024-03-21T18:02:37.955Z+ retry=120
14672024-03-21T18:02:37.982Z+ grep nexus
14682024-03-21T18:02:38.021Z+ zoneadm list
14692024-03-21T18:02:38.118Z+ [[ 120 -gt 300 ]]
14702024-03-21T18:02:38.150Z+ sleep 1
14712024-03-21T18:02:39.124Z+ retry=121
14722024-03-21T18:02:39.152Z+ zoneadm list
14732024-03-21T18:02:39.153Z+ grep nexus
14742024-03-21T18:02:39.153Z+ [[ 121 -gt 300 ]]
14752024-03-21T18:02:39.153Z+ sleep 1
14762024-03-21T18:02:45.802Z+ retry=122
14772024-03-21T18:02:45.849Z+ zoneadm list
14782024-03-21T18:02:45.849Z+ grep nexus
14792024-03-21T18:02:45.849Z+ [[ 122 -gt 300 ]]
14802024-03-21T18:02:45.849Z+ sleep 1
14812024-03-21T18:02:45.849Z+ retry=123
14822024-03-21T18:02:45.849Z+ zoneadm list
14832024-03-21T18:02:45.850Z+ grep nexus
14842024-03-21T18:02:45.850Z+ [[ 123 -gt 300 ]]
14852024-03-21T18:02:45.850Z+ sleep 1
14862024-03-21T18:02:45.850Z+ retry=124
14872024-03-21T18:02:45.850Z+ zoneadm list
14882024-03-21T18:02:45.850Z+ grep nexus
14892024-03-21T18:02:45.850Z+ [[ 124 -gt 300 ]]
14902024-03-21T18:02:45.850Z+ sleep 1
14912024-03-21T18:02:45.850Z+ retry=125
14922024-03-21T18:02:45.850Z+ zoneadm list
14932024-03-21T18:02:45.850Z+ grep nexus
14942024-03-21T18:02:45.850Z+ [[ 125 -gt 300 ]]
14952024-03-21T18:02:45.850Z+ sleep 1
14962024-03-21T18:02:45.850Z+ retry=126
14972024-03-21T18:02:45.850Z+ zoneadm list
14982024-03-21T18:02:45.851Z+ grep nexus
14992024-03-21T18:02:45.851Z+ [[ 126 -gt 300 ]]
15002024-03-21T18:02:45.851Z+ sleep 1
15012024-03-21T18:02:45.881Z+ retry=127
15022024-03-21T18:02:45.881Z+ zoneadm list
15032024-03-21T18:02:45.881Z+ grep nexus
15042024-03-21T18:02:45.881Z+ [[ 127 -gt 300 ]]
15052024-03-21T18:02:45.881Z+ sleep 1
15062024-03-21T18:02:46.218Z+ retry=128
15072024-03-21T18:02:46.247Z+ zoneadm list
15082024-03-21T18:02:46.247Z+ grep nexus
15092024-03-21T18:02:46.247Z+ [[ 128 -gt 300 ]]
15102024-03-21T18:02:46.247Z+ sleep 1
15112024-03-21T18:02:47.230Z+ retry=129
15122024-03-21T18:02:47.256Z+ zoneadm list
15132024-03-21T18:02:47.256Z+ grep nexus
15142024-03-21T18:02:47.256Z+ [[ 129 -gt 300 ]]
15152024-03-21T18:02:47.256Z+ sleep 1
15162024-03-21T18:02:48.253Z+ retry=130
15172024-03-21T18:02:48.281Z+ zoneadm list
15182024-03-21T18:02:48.281Z+ grep nexus
15192024-03-21T18:02:48.282Z+ [[ 130 -gt 300 ]]
15202024-03-21T18:02:48.282Z+ sleep 1
15212024-03-21T18:02:49.262Z+ retry=131
15222024-03-21T18:02:49.289Z+ zoneadm list
15232024-03-21T18:02:49.290Z+ grep nexus
15242024-03-21T18:02:49.290Z+ [[ 131 -gt 300 ]]
15252024-03-21T18:02:49.290Z+ sleep 1
15262024-03-21T18:02:50.278Z+ retry=132
15272024-03-21T18:02:50.307Z+ zoneadm list
15282024-03-21T18:02:50.307Z+ grep nexus
15292024-03-21T18:02:50.307Z+ [[ 132 -gt 300 ]]
15302024-03-21T18:02:50.307Z+ sleep 1
15312024-03-21T18:02:51.302Z+ retry=133
15322024-03-21T18:02:51.328Z+ zoneadm list
15332024-03-21T18:02:51.328Z+ grep nexus
15342024-03-21T18:02:51.328Z+ [[ 133 -gt 300 ]]
15352024-03-21T18:02:51.328Z+ sleep 1
15362024-03-21T18:02:52.314Z+ retry=134
15372024-03-21T18:02:52.348Z+ zoneadm list
15382024-03-21T18:02:52.348Z+ grep nexus
15392024-03-21T18:02:52.348Z+ [[ 134 -gt 300 ]]
15402024-03-21T18:02:52.348Z+ sleep 1
15412024-03-21T18:02:53.328Z+ retry=135
15422024-03-21T18:02:53.356Z+ zoneadm list
15432024-03-21T18:02:53.356Z+ grep nexus
15442024-03-21T18:02:53.356Z+ [[ 135 -gt 300 ]]
15452024-03-21T18:02:53.356Z+ sleep 1
15462024-03-21T18:02:54.345Z+ retry=136
15472024-03-21T18:02:54.376Z+ zoneadm list
15482024-03-21T18:02:54.377Z+ grep nexus
15492024-03-21T18:02:54.377Z+ [[ 136 -gt 300 ]]
15502024-03-21T18:02:54.377Z+ sleep 1
15512024-03-21T18:02:55.353Z+ retry=137
15522024-03-21T18:02:55.381Z+ zoneadm list
15532024-03-21T18:02:55.381Z+ grep nexus
15542024-03-21T18:02:55.382Z+ [[ 137 -gt 300 ]]
15552024-03-21T18:02:55.382Z+ sleep 1
15562024-03-21T18:02:56.783Z+ retry=138
15572024-03-21T18:02:56.809Z+ zoneadm list
15582024-03-21T18:02:56.809Z+ grep nexus
15592024-03-21T18:02:56.809Z+ [[ 138 -gt 300 ]]
15602024-03-21T18:02:56.809Z+ sleep 1
15612024-03-21T18:02:57.377Z+ retry=139
15622024-03-21T18:02:57.404Z+ zoneadm list
15632024-03-21T18:02:57.404Z+ grep nexus
15642024-03-21T18:02:57.404Z+ [[ 139 -gt 300 ]]
15652024-03-21T18:02:57.404Z+ sleep 1
15662024-03-21T18:02:58.394Z+ retry=140
15672024-03-21T18:02:58.500Z+ zoneadm list
15682024-03-21T18:02:58.500Z+ grep nexus
15692024-03-21T18:02:58.500Z+ [[ 140 -gt 300 ]]
15702024-03-21T18:02:58.500Z+ sleep 1
15712024-03-21T18:02:59.408Z+ retry=141
15722024-03-21T18:02:59.433Z+ zoneadm list
15732024-03-21T18:02:59.433Z+ grep nexus
15742024-03-21T18:02:59.433Z+ [[ 141 -gt 300 ]]
15752024-03-21T18:02:59.433Z+ sleep 1
15762024-03-21T18:03:00.419Z+ retry=142
15772024-03-21T18:03:00.445Z+ zoneadm list
15782024-03-21T18:03:00.445Z+ grep nexus
15792024-03-21T18:03:00.445Z+ [[ 142 -gt 300 ]]
15802024-03-21T18:03:00.445Z+ sleep 1
15812024-03-21T18:03:01.431Z+ retry=143
15822024-03-21T18:03:01.458Z+ zoneadm list
15832024-03-21T18:03:01.458Z+ grep nexus
15842024-03-21T18:03:01.458Z+ [[ 143 -gt 300 ]]
15852024-03-21T18:03:01.458Z+ sleep 1
15862024-03-21T18:03:02.442Z+ retry=144
15872024-03-21T18:03:02.468Z+ zoneadm list
15882024-03-21T18:03:02.468Z+ grep nexus
15892024-03-21T18:03:02.469Z+ [[ 144 -gt 300 ]]
15902024-03-21T18:03:02.469Z+ sleep 1
15912024-03-21T18:03:03.457Z+ retry=145
15922024-03-21T18:03:03.486Z+ zoneadm list
15932024-03-21T18:03:03.486Z+ grep nexus
15942024-03-21T18:03:03.486Z+ [[ 145 -gt 300 ]]
15952024-03-21T18:03:03.486Z+ sleep 1
15962024-03-21T18:03:04.468Z+ retry=146
15972024-03-21T18:03:04.494Z+ zoneadm list
15982024-03-21T18:03:04.494Z+ grep nexus
15992024-03-21T18:03:04.494Z+ [[ 146 -gt 300 ]]
16002024-03-21T18:03:04.494Z+ sleep 1
16012024-03-21T18:03:05.481Z+ retry=147
16022024-03-21T18:03:05.509Z+ zoneadm list
16032024-03-21T18:03:05.509Z+ grep nexus
16042024-03-21T18:03:05.509Z+ [[ 147 -gt 300 ]]
16052024-03-21T18:03:05.509Z+ sleep 1
16062024-03-21T18:03:06.494Z+ retry=148
16072024-03-21T18:03:06.523Z+ zoneadm list
16082024-03-21T18:03:06.523Z+ grep nexus
16092024-03-21T18:03:06.523Z+ [[ 148 -gt 300 ]]
16102024-03-21T18:03:06.523Z+ sleep 1
16112024-03-21T18:03:07.510Z+ retry=149
16122024-03-21T18:03:07.536Z+ zoneadm list
16132024-03-21T18:03:07.536Z+ grep nexus
16142024-03-21T18:03:07.536Z+ [[ 149 -gt 300 ]]
16152024-03-21T18:03:07.536Z+ sleep 1
16162024-03-21T18:03:08.519Z+ retry=150
16172024-03-21T18:03:08.546Z+ zoneadm list
16182024-03-21T18:03:08.546Z+ grep nexus
16192024-03-21T18:03:08.546Z+ [[ 150 -gt 300 ]]
16202024-03-21T18:03:08.546Z+ sleep 1
16212024-03-21T18:03:09.540Z+ retry=151
16222024-03-21T18:03:09.568Z+ zoneadm list
16232024-03-21T18:03:09.568Z+ grep nexus
16242024-03-21T18:03:09.568Z+ [[ 151 -gt 300 ]]
16252024-03-21T18:03:09.568Z+ sleep 1
16262024-03-21T18:03:10.550Z+ retry=152
16272024-03-21T18:03:10.576Z+ zoneadm list
16282024-03-21T18:03:10.576Z+ grep nexus
16292024-03-21T18:03:10.576Z+ [[ 152 -gt 300 ]]
16302024-03-21T18:03:10.576Z+ sleep 1
16312024-03-21T18:03:11.563Z+ retry=153
16322024-03-21T18:03:11.588Z+ zoneadm list
16332024-03-21T18:03:11.589Z+ grep nexus
16342024-03-21T18:03:11.589Z+ [[ 153 -gt 300 ]]
16352024-03-21T18:03:11.589Z+ sleep 1
16362024-03-21T18:03:12.577Z+ retry=154
16372024-03-21T18:03:12.602Z+ zoneadm list
16382024-03-21T18:03:12.602Z+ grep nexus
16392024-03-21T18:03:12.602Z+ [[ 154 -gt 300 ]]
16402024-03-21T18:03:12.602Z+ sleep 1
16412024-03-21T18:03:13.588Z+ retry=155
16422024-03-21T18:03:13.614Z+ zoneadm list
16432024-03-21T18:03:13.614Z+ grep nexus
16442024-03-21T18:03:13.614Z+ [[ 155 -gt 300 ]]
16452024-03-21T18:03:13.614Z+ sleep 1
16462024-03-21T18:03:14.601Z+ retry=156
16472024-03-21T18:03:14.626Z+ zoneadm list
16482024-03-21T18:03:14.626Z+ grep nexus
16492024-03-21T18:03:14.626Z+ [[ 156 -gt 300 ]]
16502024-03-21T18:03:14.626Z+ sleep 1
16512024-03-21T18:03:15.614Z+ retry=157
16522024-03-21T18:03:15.641Z+ zoneadm list
16532024-03-21T18:03:15.641Z+ grep nexus
16542024-03-21T18:03:15.642Z+ [[ 157 -gt 300 ]]
16552024-03-21T18:03:15.642Z+ sleep 1
16562024-03-21T18:03:16.628Z+ retry=158
16572024-03-21T18:03:16.655Z+ zoneadm list
16582024-03-21T18:03:16.655Z+ grep nexus
16592024-03-21T18:03:16.655Z+ [[ 158 -gt 300 ]]
16602024-03-21T18:03:16.655Z+ sleep 1
16612024-03-21T18:03:17.649Z+ retry=159
16622024-03-21T18:03:17.676Z+ zoneadm list
16632024-03-21T18:03:17.676Z+ grep nexus
16642024-03-21T18:03:17.676Z+ [[ 159 -gt 300 ]]
16652024-03-21T18:03:17.676Z+ sleep 1
16662024-03-21T18:03:18.861Z+ retry=160
16672024-03-21T18:03:19.146Z+ zoneadm list
16682024-03-21T18:03:19.268Z+ grep nexus
16692024-03-21T18:03:19.298Z+ [[ 160 -gt 300 ]]
16702024-03-21T18:03:19.298Z+ sleep 1
16712024-03-21T18:03:23.899Z+ retry=161
16722024-03-21T18:03:23.933Z+ zoneadm list
16732024-03-21T18:03:23.933Z+ grep nexus
16742024-03-21T18:03:23.969Z+ [[ 161 -gt 300 ]]
16752024-03-21T18:03:23.999Z+ sleep 1
16762024-03-21T18:03:25.349Z+ retry=162
16772024-03-21T18:03:25.418Z+ zoneadm list
16782024-03-21T18:03:25.471Z+ grep nexus
16792024-03-21T18:03:25.517Z+ [[ 162 -gt 300 ]]
16802024-03-21T18:03:25.517Z+ sleep 1
16812024-03-21T18:03:26.654Z+ retry=163
16822024-03-21T18:03:26.683Z+ zoneadm list
16832024-03-21T18:03:26.684Z+ grep nexus
16842024-03-21T18:03:26.684Z+ [[ 163 -gt 300 ]]
16852024-03-21T18:03:26.684Z+ sleep 1
16862024-03-21T18:03:27.682Z+ retry=164
16872024-03-21T18:03:27.709Z+ zoneadm list
16882024-03-21T18:03:27.709Z+ grep nexus
16892024-03-21T18:03:27.709Z+ [[ 164 -gt 300 ]]
16902024-03-21T18:03:27.709Z+ sleep 1
16912024-03-21T18:03:28.716Z+ retry=165
16922024-03-21T18:03:28.743Z+ zoneadm list
16932024-03-21T18:03:28.743Z+ grep nexus
16942024-03-21T18:03:28.743Z+ [[ 165 -gt 300 ]]
16952024-03-21T18:03:28.743Z+ sleep 1
16962024-03-21T18:03:29.731Z+ retry=166
16972024-03-21T18:03:29.757Z+ zoneadm list
16982024-03-21T18:03:29.757Z+ grep nexus
16992024-03-21T18:03:29.757Z+ [[ 166 -gt 300 ]]
17002024-03-21T18:03:29.757Z+ sleep 1
17012024-03-21T18:03:30.766Z+ retry=167
17022024-03-21T18:03:30.792Z+ zoneadm list
17032024-03-21T18:03:30.792Z+ grep nexus
17042024-03-21T18:03:30.792Zoxz_nexus_63f8ddb8-9337-4e6d-9183-6a3d2d46eb44
17052024-03-21T18:03:30.792Zoxz_nexus_1867af63-d8cb-42d5-9792-21b7480ed01f
17062024-03-21T18:03:30.792Zoxz_nexus_321f738a-6501-4db1-ba8e-61692f8f3967
17072024-03-21T18:03:30.819Z+ echo 'Waited for nexus: 167s'
17082024-03-21T18:03:30.820ZWaited for nexus: 167s
17092024-03-21T18:03:30.820Z+ export RUST_BACKTRACE=1
17102024-03-21T18:03:30.820Z+ RUST_BACKTRACE=1
17112024-03-21T18:03:30.820Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
17122024-03-21T18:03:30.820Z++ ./tests/bootstrap
17132024-03-21T18:03:31.326ZUsing external DNS server at 10.151.1.164:53
17142024-03-21T18:03:31.355Z2024-03-21 18:03:31.339529698 UTC: attempting to log into API
17152024-03-21T18:03:46.412Z2024-03-21 18:03:46.401837671 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
17162024-03-21T18:03:47.413Z2024-03-21 18:03:47.403504403 UTC: attempting to log into API
 
17172024-03-21T18:03:47.709ZMar 21 18:03:47 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
17182024-03-21T18:03:48.282ZMar 21 18:03:47 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
17192024-03-21T18:03:48.326ZMar 21 18:03:47 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
17202024-03-21T18:03:49.163ZMar 21 18:03:48 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
17212024-03-21T18:03:50.258ZMar 21 18:03:49 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
17222024-03-21T18:04:02.445Z2024-03-21 18:04:02.434415055 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
17232024-03-21T18:04:03.446Z2024-03-21 18:04:03.435595907 UTC: attempting to log into API
17242024-03-21T18:04:08.487Z2024-03-21 18:04:08.474813779 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: dns error: no record found for Query { name: Name("recovery.sys.oxide.test."), query_type: AAAA, query_class: IN }
17252024-03-21T18:04:09.492Z2024-03-21 18:04:09.477245924 UTC: attempting to log into API
17262024-03-21T18:04:09.528Z2024-03-21 18:04:09.515514860 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: tcp connect error: Connection refused (os error 146)
17272024-03-21T18:04:10.531Z2024-03-21 18:04:10.518053597 UTC: attempting to log into API
17282024-03-21T18:04:11.309Z2024-03-21 18:04:11.297936115 UTC: login succeeded
17292024-03-21T18:04:11.340Zwaiting for nexus to come up...
17302024-03-21T18:04:11.418Zcreating IP pool... 10.151.1.175 - 10.151.1.227
17312024-03-21T18:04:11.584Zsetting up quotas...
17322024-03-21T18:04:11.625Zensuring datasets are ready...
17332024-03-21T18:04:13.596Zlet's roll.
17342024-03-21T18:04:13.631Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
17352024-03-21T18:04:13.631ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
17362024-03-21T18:04:13.631ZOXIDE_TOKEN=oxide-token-c69da121326563436ccfacb21bea2d743d73070b'
17372024-03-21T18:04:13.631Z++ OXIDE_HOST=https://recovery.sys.oxide.test
17382024-03-21T18:04:13.631Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
17392024-03-21T18:04:13.631Z++ OXIDE_TOKEN=oxide-token-c69da121326563436ccfacb21bea2d743d73070b
17402024-03-21T18:04:13.631Z+ export OXIDE_HOST OXIDE_TOKEN
17412024-03-21T18:04:13.631Z+ retry=0
17422024-03-21T18:04:13.631Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
17432024-03-21T18:04:13.697Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
17442024-03-21T18:04:13.972Z{"status":"ok"}success
17452024-03-21T18:04:13.972ZProject {
17462024-03-21T18:04:13.972Z description: "some images",
17472024-03-21T18:04:13.972Z id: 832ac273-1c0f-4313-9722-2121ba31448a,
17482024-03-21T18:04:13.972Z name: Name(
17492024-03-21T18:04:13.972Z "images",
17502024-03-21T18:04:13.972Z ),
17512024-03-21T18:04:14.005Z time_created: 2024-03-21T18:04:13.746061Z,
17522024-03-21T18:04:14.005Z time_modified: 2024-03-21T18:04:13.746061Z,
17532024-03-21T18:04:14.005Z}
17542024-03-21T18:04:14.005Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
17552024-03-21T18:10:03.507Zdone!
17562024-03-21T18:10:03.599Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
17572024-03-21T18:10:03.699Zsuccess
17582024-03-21T18:10:03.699ZImage {
17592024-03-21T18:10:03.730Z block_size: ByteCount(
17602024-03-21T18:10:03.730Z 512,
17612024-03-21T18:10:03.730Z ),
17622024-03-21T18:10:03.730Z description: "debian 11 original base image",
17632024-03-21T18:10:03.730Z digest: None,
17642024-03-21T18:10:03.730Z id: 1adb5a89-b9da-48c7-b1ce-4b3142c9bafc,
17652024-03-21T18:10:03.730Z name: Name(
17662024-03-21T18:10:03.730Z "debian11",
17672024-03-21T18:10:03.730Z ),
17682024-03-21T18:10:03.730Z os: "debian",
17692024-03-21T18:10:03.730Z project_id: None,
17702024-03-21T18:10:03.730Z size: ByteCount(
17712024-03-21T18:10:03.730Z 2147483648,
17722024-03-21T18:10:03.730Z ),
17732024-03-21T18:10:03.730Z time_created: 2024-03-21T18:10:03.468922Z,
17742024-03-21T18:10:03.730Z time_modified: 2024-03-21T18:10:03.673948Z,
17752024-03-21T18:10:03.731Z url: None,
17762024-03-21T18:10:03.731Z version: "11",
17772024-03-21T18:10:03.731Z}
17782024-03-21T18:10:03.731Z+ rm ./tests/bootstrap
17792024-03-21T18:10:03.773Z+ for test_bin in tests/*
17802024-03-21T18:10:03.773Z+ ./tests/bootstrap-ebb6682cb4af86e9
17812024-03-21T18:10:03.830Z
17822024-03-21T18:10:03.830Zrunning 0 tests
17832024-03-21T18:10:03.858Z
17842024-03-21T18:10:03.859Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
17852024-03-21T18:10:03.859Z
17862024-03-21T18:10:03.859Z+ for test_bin in tests/*
17872024-03-21T18:10:03.859Z+ ./tests/commtest-eb80106b092225f5
17882024-03-21T18:10:03.888Z
17892024-03-21T18:10:03.888Zrunning 0 tests
17902024-03-21T18:10:03.888Z
17912024-03-21T18:10:03.888Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
17922024-03-21T18:10:03.888Z
17932024-03-21T18:10:03.888Z+ for test_bin in tests/*
17942024-03-21T18:10:03.888Z+ ./tests/dhcp_server-5ee17f10b12b6e1e
17952024-03-21T18:10:03.920Z
17962024-03-21T18:10:03.920Zrunning 0 tests
17972024-03-21T18:10:03.920Z
17982024-03-21T18:10:03.920Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
17992024-03-21T18:10:03.920Z
18002024-03-21T18:10:03.920Z+ for test_bin in tests/*
18012024-03-21T18:10:03.920Z+ ./tests/end_to_end_tests-2ddaeb260a344b4e
18022024-03-21T18:10:04.190Z
18032024-03-21T18:10:04.190Zrunning 2 tests
18042024-03-21T18:10:04.432Ztest no_spoof::no_spoof_here ... ok
18052024-03-21T18:10:30.297Ztest instance_launch::instance_launch ... ok
18062024-03-21T18:10:30.297Z
18072024-03-21T18:10:30.323Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 26.11s
18082024-03-21T18:10:30.323Z
18092024-03-21T18:10:30.323Z+ _exit_trap
18102024-03-21T18:10:30.323Z+ local status=0
18112024-03-21T18:10:30.323Z+ [[ 0 -eq 0 ]]
18122024-03-21T18:10:30.323Z+ exit 0
18132024-03-21T18:10:30.323Zprocess exited: duration 687472 ms, exit code 0
 
18142024-03-21T18:10:30.481Zfound 100 output files
18152024-03-21T18:10:30.481Zuploading: /var/svc/log/oxide-sled-agent:default.log (941141 bytes)
18162024-03-21T18:10:32.701Zuploaded: /var/svc/log/oxide-sled-agent:default.log
18172024-03-21T18:10:32.701Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (2777725 bytes)
18182024-03-21T18:10:36.147Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 2777725 -> 2801770
18192024-03-21T18:10:37.226Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
18202024-03-21T18:10:37.226Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52287 bytes)
18212024-03-21T18:10:38.490Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
18222024-03-21T18:10:38.490Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (9307 bytes)
18232024-03-21T18:10:40.032Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
18242024-03-21T18:10:40.032Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (57010 bytes)
18252024-03-21T18:10:41.323Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
18262024-03-21T18:10:41.323Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1417108 bytes)
18272024-03-21T18:10:43.214Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1417108 -> 1436278
18282024-03-21T18:10:44.292Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
18292024-03-21T18:10:44.292Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (806707 bytes)
18302024-03-21T18:10:46.072Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 806707 -> 826097
18312024-03-21T18:10:47.150Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
18322024-03-21T18:10:47.151Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1388 bytes)
18332024-03-21T18:10:48.262Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
18342024-03-21T18:10:48.291Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (294094 bytes)
18352024-03-21T18:10:48.928Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 294094 -> 304186
18362024-03-21T18:10:50.010Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
18372024-03-21T18:10:50.010Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (8222 bytes)
18382024-03-21T18:10:51.140Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
18392024-03-21T18:10:51.141Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5759 bytes)
18402024-03-21T18:10:52.271Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
18412024-03-21T18:10:52.304Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_3180ed41-bec0-470b-aead-81b85d06adf6/root/var/svc/log/oxide-clickhouse:default.log (1462447 bytes)
18422024-03-21T18:10:54.583Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_3180ed41-bec0-470b-aead-81b85d06adf6/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1462447 -> 1542549
18432024-03-21T18:10:55.663Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_3180ed41-bec0-470b-aead-81b85d06adf6/root/var/svc/log/oxide-clickhouse:default.log
18442024-03-21T18:10:55.663Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_3180ed41-bec0-470b-aead-81b85d06adf6/root/var/svc/log/oxide-zone-network-setup:default.log (1713 bytes)
18452024-03-21T18:10:56.781Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_3180ed41-bec0-470b-aead-81b85d06adf6/root/var/svc/log/oxide-zone-network-setup:default.log
18462024-03-21T18:10:56.781Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_962c0adc-25a8-4b52-9c01-db6860e37774/root/var/svc/log/oxide-cockroachdb:default.log (4406 bytes)
18472024-03-21T18:10:57.882Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_962c0adc-25a8-4b52-9c01-db6860e37774/root/var/svc/log/oxide-cockroachdb:default.log
18482024-03-21T18:10:57.882Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_962c0adc-25a8-4b52-9c01-db6860e37774/root/var/svc/log/oxide-zone-network-setup:default.log (1716 bytes)
18492024-03-21T18:10:58.991Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_962c0adc-25a8-4b52-9c01-db6860e37774/root/var/svc/log/oxide-zone-network-setup:default.log
18502024-03-21T18:10:58.991Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-agent:default.log (35932 bytes)
18512024-03-21T18:11:00.210Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-agent:default.log
18522024-03-21T18:11:00.211Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
18532024-03-21T18:11:01.321Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:default.log
18542024-03-21T18:11:01.322Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:downstairs-2f09d0c6-5b00-4de3-bab8-5b0396c12b29.log (5614 bytes)
18552024-03-21T18:11:02.469Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:downstairs-2f09d0c6-5b00-4de3-bab8-5b0396c12b29.log
18562024-03-21T18:11:02.469Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:downstairs-9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8.log (3123 bytes)
18572024-03-21T18:11:03.575Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:downstairs-9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8.log
18582024-03-21T18:11:03.576Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:downstairs-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7.log (5693 bytes)
18592024-03-21T18:11:04.793Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:downstairs-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7.log
18602024-03-21T18:11:04.793Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:snapshot-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7-fe1e7c32-a3e0-469a-9e5c-10034bec5870.log (5304 bytes)
18612024-03-21T18:11:05.806Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-crucible-downstairs:snapshot-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7-fe1e7c32-a3e0-469a-9e5c-10034bec5870.log
18622024-03-21T18:11:05.806Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
18632024-03-21T18:11:06.907Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_ad4a5561-dc8d-4083-8f16-119c68e57347/root/var/svc/log/oxide-zone-network-setup:default.log
18642024-03-21T18:11:06.907Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4e50e7be-6fe9-4f8e-a8d0-2e9594b97494/root/var/svc/log/oxide-external_dns:default.log (27628 bytes)
18652024-03-21T18:11:07.078Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4e50e7be-6fe9-4f8e-a8d0-2e9594b97494/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 27628 -> 31404
18662024-03-21T18:11:08.153Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4e50e7be-6fe9-4f8e-a8d0-2e9594b97494/root/var/svc/log/oxide-external_dns:default.log
18672024-03-21T18:11:08.153Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4e50e7be-6fe9-4f8e-a8d0-2e9594b97494/root/var/svc/log/oxide-opte-interface-setup:default.log (1188 bytes)
18682024-03-21T18:11:09.253Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4e50e7be-6fe9-4f8e-a8d0-2e9594b97494/root/var/svc/log/oxide-opte-interface-setup:default.log
18692024-03-21T18:11:09.253Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4e50e7be-6fe9-4f8e-a8d0-2e9594b97494/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
18702024-03-21T18:11:10.357Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4e50e7be-6fe9-4f8e-a8d0-2e9594b97494/root/var/svc/log/oxide-zone-network-setup:default.log
18712024-03-21T18:11:10.357Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7c261579-c0ac-44ad-8a5c-d19534e8de67/root/var/svc/log/oxide-internal_dns:default.log (107371 bytes)
18722024-03-21T18:11:10.706Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7c261579-c0ac-44ad-8a5c-d19534e8de67/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107371 -> 111128
18732024-03-21T18:11:11.790Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7c261579-c0ac-44ad-8a5c-d19534e8de67/root/var/svc/log/oxide-internal_dns:default.log
18742024-03-21T18:11:11.790Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7c261579-c0ac-44ad-8a5c-d19534e8de67/root/var/svc/log/oxide-zone-network-setup:default.log (1707 bytes)
18752024-03-21T18:11:12.890Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_7c261579-c0ac-44ad-8a5c-d19534e8de67/root/var/svc/log/oxide-zone-network-setup:default.log
18762024-03-21T18:11:12.891Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_5212b16c-c411-4b79-897f-c1d2ce097b13/root/var/svc/log/oxide-cockroachdb:default.log (4408 bytes)
18772024-03-21T18:11:13.991Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_5212b16c-c411-4b79-897f-c1d2ce097b13/root/var/svc/log/oxide-cockroachdb:default.log
18782024-03-21T18:11:13.991Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_5212b16c-c411-4b79-897f-c1d2ce097b13/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
18792024-03-21T18:11:15.107Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_5212b16c-c411-4b79-897f-c1d2ce097b13/root/var/svc/log/oxide-zone-network-setup:default.log
18802024-03-21T18:11:15.107Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-agent:default.log (20939 bytes)
18812024-03-21T18:11:16.282Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-agent:default.log
18822024-03-21T18:11:16.282Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
18832024-03-21T18:11:17.383Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-downstairs:default.log
18842024-03-21T18:11:17.384Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-downstairs:downstairs-28113627-f2d5-4dc3-b918-394ef1f85ec2.log (5696 bytes)
18852024-03-21T18:11:18.524Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-downstairs:downstairs-28113627-f2d5-4dc3-b918-394ef1f85ec2.log
18862024-03-21T18:11:18.524Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-downstairs:downstairs-39945c08-5b4f-4ae4-83e3-d3254def8938.log (3020 bytes)
18872024-03-21T18:11:19.640Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-downstairs:downstairs-39945c08-5b4f-4ae4-83e3-d3254def8938.log
18882024-03-21T18:11:19.640Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-downstairs:snapshot-28113627-f2d5-4dc3-b918-394ef1f85ec2-fe1e7c32-a3e0-469a-9e5c-10034bec5870.log (5303 bytes)
18892024-03-21T18:11:20.734Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-crucible-downstairs:snapshot-28113627-f2d5-4dc3-b918-394ef1f85ec2-fe1e7c32-a3e0-469a-9e5c-10034bec5870.log
18902024-03-21T18:11:20.734Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
18912024-03-21T18:11:21.836Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c90afcd5-91a8-4a76-9f6c-679834a1647e/root/var/svc/log/oxide-zone-network-setup:default.log
18922024-03-21T18:11:21.836Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7c865eb6-b5e7-489f-b89d-276fb69b0134/root/var/svc/log/oxide-external_dns:default.log (26873 bytes)
18932024-03-21T18:11:22.001Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7c865eb6-b5e7-489f-b89d-276fb69b0134/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26873 -> 30650
18942024-03-21T18:11:23.078Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7c865eb6-b5e7-489f-b89d-276fb69b0134/root/var/svc/log/oxide-external_dns:default.log
18952024-03-21T18:11:23.078Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7c865eb6-b5e7-489f-b89d-276fb69b0134/root/var/svc/log/oxide-opte-interface-setup:default.log (1188 bytes)
18962024-03-21T18:11:24.179Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7c865eb6-b5e7-489f-b89d-276fb69b0134/root/var/svc/log/oxide-opte-interface-setup:default.log
18972024-03-21T18:11:24.179Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7c865eb6-b5e7-489f-b89d-276fb69b0134/root/var/svc/log/oxide-zone-network-setup:default.log (1725 bytes)
18982024-03-21T18:11:25.281Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_7c865eb6-b5e7-489f-b89d-276fb69b0134/root/var/svc/log/oxide-zone-network-setup:default.log
18992024-03-21T18:11:25.281Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_40fdef96-95bd-4498-930b-07e0bc0ee2d0/root/var/svc/log/oxide-internal_dns:default.log (107358 bytes)
19002024-03-21T18:11:25.634Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_40fdef96-95bd-4498-930b-07e0bc0ee2d0/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107358 -> 111112
19012024-03-21T18:11:26.709Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_40fdef96-95bd-4498-930b-07e0bc0ee2d0/root/var/svc/log/oxide-internal_dns:default.log
19022024-03-21T18:11:26.709Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_40fdef96-95bd-4498-930b-07e0bc0ee2d0/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
19032024-03-21T18:11:27.810Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_40fdef96-95bd-4498-930b-07e0bc0ee2d0/root/var/svc/log/oxide-zone-network-setup:default.log
19042024-03-21T18:11:27.811Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_321f738a-6501-4db1-ba8e-61692f8f3967/root/var/svc/log/oxide-nexus:default.log (1802741 bytes)
19052024-03-21T18:11:30.007Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_321f738a-6501-4db1-ba8e-61692f8f3967/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1802741 -> 2004110
19062024-03-21T18:11:31.541Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_321f738a-6501-4db1-ba8e-61692f8f3967/root/var/svc/log/oxide-nexus:default.log
19072024-03-21T18:11:31.541Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_321f738a-6501-4db1-ba8e-61692f8f3967/root/var/svc/log/oxide-opte-interface-setup:default.log (1167 bytes)
19082024-03-21T18:11:32.648Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_321f738a-6501-4db1-ba8e-61692f8f3967/root/var/svc/log/oxide-opte-interface-setup:default.log
19092024-03-21T18:11:32.674Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_321f738a-6501-4db1-ba8e-61692f8f3967/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
19102024-03-21T18:11:33.768Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_321f738a-6501-4db1-ba8e-61692f8f3967/root/var/svc/log/oxide-zone-network-setup:default.log
19112024-03-21T18:11:33.768Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2fd71886-b669-4748-b128-312cefeef46f/root/var/svc/log/oxide-cockroachdb:default.log (4406 bytes)
19122024-03-21T18:11:34.889Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2fd71886-b669-4748-b128-312cefeef46f/root/var/svc/log/oxide-cockroachdb:default.log
19132024-03-21T18:11:34.889Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2fd71886-b669-4748-b128-312cefeef46f/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
19142024-03-21T18:11:36.040Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_2fd71886-b669-4748-b128-312cefeef46f/root/var/svc/log/oxide-zone-network-setup:default.log
19152024-03-21T18:11:36.040Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_1796c2cd-e529-47e3-97c0-aa1cd73e1121/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
19162024-03-21T18:11:37.180Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_1796c2cd-e529-47e3-97c0-aa1cd73e1121/root/var/svc/log/oxide-crucible-agent:default.log
19172024-03-21T18:11:37.180Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_1796c2cd-e529-47e3-97c0-aa1cd73e1121/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
19182024-03-21T18:11:38.308Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_1796c2cd-e529-47e3-97c0-aa1cd73e1121/root/var/svc/log/oxide-crucible-downstairs:default.log
19192024-03-21T18:11:38.308Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_1796c2cd-e529-47e3-97c0-aa1cd73e1121/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
19202024-03-21T18:11:39.444Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_1796c2cd-e529-47e3-97c0-aa1cd73e1121/root/var/svc/log/oxide-zone-network-setup:default.log
19212024-03-21T18:11:39.444Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7f65d905-b9ae-45c4-8202-b83c173f708b/root/var/svc/log/oxide-internal_dns:default.log (107359 bytes)
19222024-03-21T18:11:39.853Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7f65d905-b9ae-45c4-8202-b83c173f708b/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107359 -> 111113
19232024-03-21T18:11:41.378Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7f65d905-b9ae-45c4-8202-b83c173f708b/root/var/svc/log/oxide-internal_dns:default.log
19242024-03-21T18:11:41.378Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7f65d905-b9ae-45c4-8202-b83c173f708b/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
19252024-03-21T18:11:42.528Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_7f65d905-b9ae-45c4-8202-b83c173f708b/root/var/svc/log/oxide-zone-network-setup:default.log
19262024-03-21T18:11:42.528Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_c081ffa7-57b2-4200-b25f-9fd86c55e543/root/var/svc/log/oxide-oximeter:default.log (316134 bytes)
19272024-03-21T18:11:44.121Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_c081ffa7-57b2-4200-b25f-9fd86c55e543/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 316134 -> 373956
19282024-03-21T18:11:45.252Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_c081ffa7-57b2-4200-b25f-9fd86c55e543/root/var/svc/log/oxide-oximeter:default.log
19292024-03-21T18:11:45.252Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_c081ffa7-57b2-4200-b25f-9fd86c55e543/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
19302024-03-21T18:11:46.336Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_c081ffa7-57b2-4200-b25f-9fd86c55e543/root/var/svc/log/oxide-zone-network-setup:default.log
19312024-03-21T18:11:46.336Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_b5b11a81-6066-4bf8-b39d-d567e6f605f9/root/var/svc/log/oxide-cockroachdb:default.log (4408 bytes)
19322024-03-21T18:11:47.453Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_b5b11a81-6066-4bf8-b39d-d567e6f605f9/root/var/svc/log/oxide-cockroachdb:default.log
19332024-03-21T18:11:47.453Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_b5b11a81-6066-4bf8-b39d-d567e6f605f9/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes)
19342024-03-21T18:11:48.589Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_b5b11a81-6066-4bf8-b39d-d567e6f605f9/root/var/svc/log/oxide-zone-network-setup:default.log
19352024-03-21T18:11:48.589Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-crucible-agent:default.log (21827 bytes)
19362024-03-21T18:11:50.189Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-crucible-agent:default.log
19372024-03-21T18:11:50.189Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
19382024-03-21T18:11:51.700Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-crucible-downstairs:default.log
19392024-03-21T18:11:51.700Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-crucible-downstairs:downstairs-047b079d-cc73-4609-be28-040ed9009ed7.log (5610 bytes)
19402024-03-21T18:11:52.820Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-crucible-downstairs:downstairs-047b079d-cc73-4609-be28-040ed9009ed7.log
19412024-03-21T18:11:52.820Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-crucible-downstairs:downstairs-8de46491-911c-4caa-97a0-1c0abd9e262b.log (3123 bytes)
19422024-03-21T18:11:53.951Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-crucible-downstairs:downstairs-8de46491-911c-4caa-97a0-1c0abd9e262b.log
19432024-03-21T18:11:53.951Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
19442024-03-21T18:11:55.074Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_dadd2d75-7f86-4e23-a754-495d7933fd3f/root/var/svc/log/oxide-zone-network-setup:default.log
19452024-03-21T18:11:55.074Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_63f8ddb8-9337-4e6d-9183-6a3d2d46eb44/root/var/svc/log/oxide-nexus:default.log (1789630 bytes)
19462024-03-21T18:11:56.321Zupload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_63f8ddb8-9337-4e6d-9183-6a3d2d46eb44/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1789630 -> 2122399
19472024-03-21T18:11:57.404Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_63f8ddb8-9337-4e6d-9183-6a3d2d46eb44/root/var/svc/log/oxide-nexus:default.log
19482024-03-21T18:11:57.404Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_63f8ddb8-9337-4e6d-9183-6a3d2d46eb44/root/var/svc/log/oxide-opte-interface-setup:default.log (1167 bytes)
19492024-03-21T18:11:58.505Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_63f8ddb8-9337-4e6d-9183-6a3d2d46eb44/root/var/svc/log/oxide-opte-interface-setup:default.log
19502024-03-21T18:11:58.505Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_63f8ddb8-9337-4e6d-9183-6a3d2d46eb44/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
19512024-03-21T18:11:59.608Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_63f8ddb8-9337-4e6d-9183-6a3d2d46eb44/root/var/svc/log/oxide-zone-network-setup:default.log
19522024-03-21T18:11:59.608Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0ec8aadf-5087-4bca-8642-8e50b6d5e739/root/var/svc/log/oxide-cockroachdb:default.log (4380 bytes)
19532024-03-21T18:12:01.140Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0ec8aadf-5087-4bca-8642-8e50b6d5e739/root/var/svc/log/oxide-cockroachdb:default.log
19542024-03-21T18:12:01.140Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0ec8aadf-5087-4bca-8642-8e50b6d5e739/root/var/svc/log/oxide-zone-network-setup:default.log (1716 bytes)
19552024-03-21T18:12:02.240Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_0ec8aadf-5087-4bca-8642-8e50b6d5e739/root/var/svc/log/oxide-zone-network-setup:default.log
19562024-03-21T18:12:02.240Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-crucible-agent:default.log (17969 bytes)
19572024-03-21T18:12:03.383Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-crucible-agent:default.log
19582024-03-21T18:12:03.383Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
19592024-03-21T18:12:04.484Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-crucible-downstairs:default.log
19602024-03-21T18:12:04.485Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-6db8394b-7024-4c25-a268-739effb93108.log (3124 bytes)
19612024-03-21T18:12:05.586Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-6db8394b-7024-4c25-a268-739effb93108.log
19622024-03-21T18:12:05.586Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-7d351e63-33a7-41d4-95b9-796c77966798.log (3019 bytes)
19632024-03-21T18:12:06.686Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-crucible-downstairs:downstairs-7d351e63-33a7-41d4-95b9-796c77966798.log
19642024-03-21T18:12:06.686Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
19652024-03-21T18:12:07.786Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_07f5c5b3-c27b-4676-bce6-a3c57ef4a5c7/root/var/svc/log/oxide-zone-network-setup:default.log
19662024-03-21T18:12:07.786Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_cba4428f-e712-4a5f-afac-5ae8f4a3ba67/root/var/svc/log/oxide-crucible-pantry:default.log (780 bytes)
19672024-03-21T18:12:08.884Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_cba4428f-e712-4a5f-afac-5ae8f4a3ba67/root/var/svc/log/oxide-crucible-pantry:default.log
19682024-03-21T18:12:08.884Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_cba4428f-e712-4a5f-afac-5ae8f4a3ba67/root/var/svc/log/oxide-zone-network-setup:default.log (1744 bytes)
19692024-03-21T18:12:09.984Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_cba4428f-e712-4a5f-afac-5ae8f4a3ba67/root/var/svc/log/oxide-zone-network-setup:default.log
19702024-03-21T18:12:09.984Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_1867af63-d8cb-42d5-9792-21b7480ed01f/root/var/svc/log/oxide-nexus:default.log (37349174 bytes)
19712024-03-21T18:12:22.512Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_1867af63-d8cb-42d5-9792-21b7480ed01f/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 37349174 -> 37905644
19722024-03-21T18:12:23.631Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_1867af63-d8cb-42d5-9792-21b7480ed01f/root/var/svc/log/oxide-nexus:default.log
19732024-03-21T18:12:23.631Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_1867af63-d8cb-42d5-9792-21b7480ed01f/root/var/svc/log/oxide-opte-interface-setup:default.log (1167 bytes)
19742024-03-21T18:12:24.731Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_1867af63-d8cb-42d5-9792-21b7480ed01f/root/var/svc/log/oxide-opte-interface-setup:default.log
19752024-03-21T18:12:24.731Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_1867af63-d8cb-42d5-9792-21b7480ed01f/root/var/svc/log/oxide-zone-network-setup:default.log (1684 bytes)
19762024-03-21T18:12:25.834Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_1867af63-d8cb-42d5-9792-21b7480ed01f/root/var/svc/log/oxide-zone-network-setup:default.log
19772024-03-21T18:12:25.834Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-crucible-agent:default.log (15444 bytes)
19782024-03-21T18:12:26.985Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-crucible-agent:default.log
19792024-03-21T18:12:26.985Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
19802024-03-21T18:12:28.088Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-crucible-downstairs:default.log
19812024-03-21T18:12:28.088Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-crucible-downstairs:downstairs-7bd351a8-f34b-44ab-9289-818aa53413e5.log (5694 bytes)
19822024-03-21T18:12:29.209Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-crucible-downstairs:downstairs-7bd351a8-f34b-44ab-9289-818aa53413e5.log
19832024-03-21T18:12:29.209Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-crucible-downstairs:snapshot-7bd351a8-f34b-44ab-9289-818aa53413e5-fe1e7c32-a3e0-469a-9e5c-10034bec5870.log (5303 bytes)
19842024-03-21T18:12:30.311Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-crucible-downstairs:snapshot-7bd351a8-f34b-44ab-9289-818aa53413e5-fe1e7c32-a3e0-469a-9e5c-10034bec5870.log
19852024-03-21T18:12:30.312Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-zone-network-setup:default.log (1700 bytes)
19862024-03-21T18:12:31.414Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_65a251b5-db44-4383-ada6-83f1fde9bd43/root/var/svc/log/oxide-zone-network-setup:default.log
19872024-03-21T18:12:31.414Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_b1328b85-575b-45c8-acb6-be5a5cb5aa0f/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
19882024-03-21T18:12:32.529Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_b1328b85-575b-45c8-acb6-be5a5cb5aa0f/root/var/svc/log/oxide-crucible-pantry:default.log
19892024-03-21T18:12:32.530Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_b1328b85-575b-45c8-acb6-be5a5cb5aa0f/root/var/svc/log/oxide-zone-network-setup:default.log (1746 bytes)
19902024-03-21T18:12:33.622Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_b1328b85-575b-45c8-acb6-be5a5cb5aa0f/root/var/svc/log/oxide-zone-network-setup:default.log
19912024-03-21T18:12:33.622Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_56a96eb3-dee7-41e6-a406-5830afb2b41d/root/var/svc/log/oxide-crucible-agent:default.log (12005 bytes)
19922024-03-21T18:12:34.750Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_56a96eb3-dee7-41e6-a406-5830afb2b41d/root/var/svc/log/oxide-crucible-agent:default.log
19932024-03-21T18:12:34.750Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_56a96eb3-dee7-41e6-a406-5830afb2b41d/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
19942024-03-21T18:12:35.855Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_56a96eb3-dee7-41e6-a406-5830afb2b41d/root/var/svc/log/oxide-crucible-downstairs:default.log
19952024-03-21T18:12:35.855Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_56a96eb3-dee7-41e6-a406-5830afb2b41d/root/var/svc/log/oxide-crucible-downstairs:downstairs-13f2b000-e4cf-4031-a10a-25b6e6328983.log (5612 bytes)
19962024-03-21T18:12:36.958Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_56a96eb3-dee7-41e6-a406-5830afb2b41d/root/var/svc/log/oxide-crucible-downstairs:downstairs-13f2b000-e4cf-4031-a10a-25b6e6328983.log
19972024-03-21T18:12:36.958Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_56a96eb3-dee7-41e6-a406-5830afb2b41d/root/var/svc/log/oxide-zone-network-setup:default.log (1701 bytes)
19982024-03-21T18:12:38.061Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_56a96eb3-dee7-41e6-a406-5830afb2b41d/root/var/svc/log/oxide-zone-network-setup:default.log
19992024-03-21T18:12:38.061Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/svc/log/oxide-ntp:default.log (1171 bytes)
20002024-03-21T18:12:39.166Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/svc/log/oxide-ntp:default.log
20012024-03-21T18:12:39.166Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/svc/log/oxide-opte-interface-setup:default.log (1157 bytes)
20022024-03-21T18:12:40.376Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/svc/log/oxide-opte-interface-setup:default.log
20032024-03-21T18:12:40.376Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/svc/log/oxide-zone-network-setup:default.log (1665 bytes)
20042024-03-21T18:12:41.478Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/svc/log/oxide-zone-network-setup:default.log
20052024-03-21T18:12:41.478Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1e87646-2a62-4e73-a24d-ffc68ae40256/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
20062024-03-21T18:12:42.579Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1e87646-2a62-4e73-a24d-ffc68ae40256/root/var/svc/log/oxide-crucible-agent:default.log
20072024-03-21T18:12:42.579Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1e87646-2a62-4e73-a24d-ffc68ae40256/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
20082024-03-21T18:12:43.680Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1e87646-2a62-4e73-a24d-ffc68ae40256/root/var/svc/log/oxide-crucible-downstairs:default.log
20092024-03-21T18:12:43.680Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1e87646-2a62-4e73-a24d-ffc68ae40256/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
20102024-03-21T18:12:44.780Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b1e87646-2a62-4e73-a24d-ffc68ae40256/root/var/svc/log/oxide-zone-network-setup:default.log
20112024-03-21T18:12:44.780Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_912311c3-de4e-490c-8401-d767699d02ab/root/var/svc/log/oxide-crucible-pantry:default.log (1225814 bytes)
20122024-03-21T18:12:47.502Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_912311c3-de4e-490c-8401-d767699d02ab/root/var/svc/log/oxide-crucible-pantry:default.log
20132024-03-21T18:12:47.502Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_912311c3-de4e-490c-8401-d767699d02ab/root/var/svc/log/oxide-zone-network-setup:default.log (1746 bytes)
20142024-03-21T18:12:48.603Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_912311c3-de4e-490c-8401-d767699d02ab/root/var/svc/log/oxide-zone-network-setup:default.log
20152024-03-21T18:12:48.604Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_aaa3e4ec-d2fd-4053-a7d8-286da99953d8/root/var/svc/log/oxide-crucible-agent:default.log (7684 bytes)
20162024-03-21T18:12:49.730Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_aaa3e4ec-d2fd-4053-a7d8-286da99953d8/root/var/svc/log/oxide-crucible-agent:default.log
20172024-03-21T18:12:49.730Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_aaa3e4ec-d2fd-4053-a7d8-286da99953d8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
20182024-03-21T18:12:50.826Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_aaa3e4ec-d2fd-4053-a7d8-286da99953d8/root/var/svc/log/oxide-crucible-downstairs:default.log
20192024-03-21T18:12:50.826Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_aaa3e4ec-d2fd-4053-a7d8-286da99953d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-54e766bc-d9cc-4162-8f55-3320cd008c78.log (3019 bytes)
20202024-03-21T18:12:51.924Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_aaa3e4ec-d2fd-4053-a7d8-286da99953d8/root/var/svc/log/oxide-crucible-downstairs:downstairs-54e766bc-d9cc-4162-8f55-3320cd008c78.log
20212024-03-21T18:12:51.924Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_aaa3e4ec-d2fd-4053-a7d8-286da99953d8/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
20222024-03-21T18:12:53.024Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_aaa3e4ec-d2fd-4053-a7d8-286da99953d8/root/var/svc/log/oxide-zone-network-setup:default.log
20232024-03-21T18:12:53.024Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/measurements.log (22605 bytes)
20242024-03-21T18:12:53.118Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/measurements.log" changed size mid upload: 22605 -> 27811
20252024-03-21T18:12:54.191Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/measurements.log
20262024-03-21T18:12:54.191Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/statistics.log (14625 bytes)
20272024-03-21T18:12:54.286Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/statistics.log" changed size mid upload: 14625 -> 19071
20282024-03-21T18:12:55.359Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/statistics.log
20292024-03-21T18:12:55.359Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/tracking.log (1987 bytes)
20302024-03-21T18:12:55.407Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/tracking.log" changed size mid upload: 1987 -> 2251
20312024-03-21T18:12:56.479Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_2d690200-66e8-4c9f-bc2f-39442f54764d/root/var/log/chrony/tracking.log