01HTHD6Z9H9MSWZ50832AQZEV6: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HTHD90JXCC64TPSYMX1JJQ17

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-04-03T08:09:46.175Zjob dependencies complete; ready to run (waiting for 49 m 26 s)
22024-04-03T09:55:58.539Zjob assigned to worker 01HTHNZMJTYPMMXBN7QCR0BMZ0 (queued for 1 h 46 m 12 s)
32024-04-03T09:55:58.619Zhttp://172.20.0.5:9969/ipxe/buskin... ok
42024-04-03T09:55:58.676Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok
52024-04-03T09:55:58.722Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok
62024-04-03T09:55:58.759Zhttp://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok
72024-04-03T09:55:58.793Zhttp://172.20.0.5:9969/postboot/buskin... ok
82024-04-03T09:55:58.832ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-04-03T09:55:58.896Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-04-03T09:55:58.954ZOxide Helios Version helios-2.0.22550 64-bit
112024-04-03T09:55:58.999ZConfiguring devices.
122024-04-03T09:55:59.046Z##################################################
132024-04-03T09:55:59.096Z#### ############# ##
142024-04-03T09:55:59.146Z### ### ############ ##
152024-04-03T09:55:59.195Z## ### # ## ### ## Oxide Computer Company ##
162024-04-03T09:55:59.241Z## ## ## ### # ### ##
172024-04-03T09:55:59.288Z## # ### #### #### This Station Under ##
182024-04-03T09:55:59.346Z### ### #### # ### Computer Control ##
192024-04-03T09:55:59.510Z#### #### ### ## ##
202024-04-03T09:55:59.712Z##################################################
212024-04-03T09:55:59.778ZHostname: buskin
222024-04-03T09:55:59.820ZLoading smf(7) service descriptions:
232024-04-03T09:56:01.047Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-28a51422b533788d.gz
242024-04-03T09:56:06.857Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-28a51422b533788d.gz
252024-04-03T09:56:07.312Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-04-03T09:56:49.654Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-04-03T09:56:49.655Zdownloading input: /input/ci-tools/work/end-to-end-tests/commtest-0e6379a48de6d126.gz
282024-04-03T09:56:56.126Zdownloaded input: /input/ci-tools/work/end-to-end-tests/commtest-0e6379a48de6d126.gz
292024-04-03T09:56:56.161Zdownloading input: /input/ci-tools/work/end-to-end-tests/dhcp_server-3228f4e88b82b7eb.gz
302024-04-03T09:57:04.139Zdownloaded input: /input/ci-tools/work/end-to-end-tests/dhcp_server-3228f4e88b82b7eb.gz
312024-04-03T09:57:04.174Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2972fd47be91e6e5.gz
322024-04-03T09:57:46.886Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2972fd47be91e6e5.gz
332024-04-03T09:57:46.886Zdownloading input: /input/ci-tools/work/caboose-util.gz
342024-04-03T09:57:49.171Zdownloaded input: /input/ci-tools/work/caboose-util.gz
352024-04-03T09:57:49.195Zdownloading input: /input/ci-tools/work/tufaceous.gz
362024-04-03T09:57:51.817Zdownloaded input: /input/ci-tools/work/tufaceous.gz
372024-04-03T09:57:51.817Zdownloading input: /input/ci-tools/work/commtest
382024-04-03T09:59:39.722Zdownloaded input: /input/ci-tools/work/commtest
392024-04-03T09:59:39.752Zdownloading input: /input/package/work/version.txt
402024-04-03T09:59:39.803Zdownloaded input: /input/package/work/version.txt
412024-04-03T09:59:39.803Zdownloading input: /input/package/work/package.tar.gz
422024-04-03T09:59:55.677Zdownloaded input: /input/package/work/package.tar.gz
432024-04-03T09:59:55.677Zdownloading input: /input/package/work/global-zone-packages.tar.gz
442024-04-03T10:00:22.948Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
452024-04-03T10:00:22.948Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
462024-04-03T10:00:36.993Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
472024-04-03T10:00:37.029Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
482024-04-03T10:01:44.453Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
492024-04-03T10:01:44.453Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
502024-04-03T10:02:27.329Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
512024-04-03T10:02:27.329Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
522024-04-03T10:02:58.575Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
532024-04-03T10:02:58.575Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
542024-04-03T10:03:04.565Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
552024-04-03T10:03:04.566Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
562024-04-03T10:03:13.710Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
572024-04-03T10:03:13.710Zdownloading input: /input/package/work/zones/external-dns.tar.gz
582024-04-03T10:03:23.511Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
592024-04-03T10:03:23.511Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
602024-04-03T10:03:30.109Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
612024-04-03T10:03:30.133Zdownloading input: /input/package/work/zones/nexus-single-sled.tar.gz
622024-04-03T10:03:48.859Zdownloaded input: /input/package/work/zones/nexus-single-sled.tar.gz
632024-04-03T10:03:48.859Zdownloading input: /input/package/work/zones/nexus.tar.gz
642024-04-03T10:04:08.546Zdownloaded input: /input/package/work/zones/nexus.tar.gz
652024-04-03T10:04:08.546Zdownloading input: /input/package/work/zones/ntp.tar.gz
662024-04-03T10:04:10.532Zdownloaded input: /input/package/work/zones/ntp.tar.gz
672024-04-03T10:04:10.532Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
682024-04-03T10:04:18.244Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
692024-04-03T10:04:18.244Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
702024-04-03T10:04:22.127Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
712024-04-03T10:04:22.151Zdownloading input: /input/package/work/zones/overlay.tar.gz
722024-04-03T10:04:22.179Zdownloaded input: /input/package/work/zones/overlay.tar.gz
732024-04-03T10:04:22.617Zdownloading input: /input/package/work/zones/oximeter.tar.gz
742024-04-03T10:04:35.292Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
752024-04-03T10:04:35.292Zdownloading input: /input/package/work/zones/probe.tar.gz
762024-04-03T10:04:36.533Zdownloaded input: /input/package/work/zones/probe.tar.gz
772024-04-03T10:04:36.533Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
782024-04-03T10:04:51.344Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
792024-04-03T10:04:51.368Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
802024-04-03T10:06:01.617Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
812024-04-03T10:06:01.642Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
822024-04-03T10:06:40.860Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
832024-04-03T10:06:40.885Zstarting task 0: "setup"
842024-04-03T10:06:40.885Z++ uname -s
852024-04-03T10:06:40.885Z+ kern=SunOS
862024-04-03T10:06:40.885Z+ case "$kern" in
872024-04-03T10:06:40.885Z+ groupadd -g 12345 build
882024-04-03T10:06:40.885Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
892024-04-03T10:06:42.879Z+ zfs create -o mountpoint=/work rpool/work
902024-04-03T10:06:42.924Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
912024-04-03T10:06:42.948Z+ home_fs=zfs
922024-04-03T10:06:42.948Z+ [[ zfs == autofs ]]
932024-04-03T10:06:42.948Z+ mkdir -p /home/build
942024-04-03T10:06:42.948Z+ chown build:build /home/build /work
952024-04-03T10:06:44.933Z+ chmod 0700 /home/build /work
962024-04-03T10:06:44.958Zprocess exited: duration 4076 ms, exit code 0
 
972024-04-03T10:06:45.006Zstarting task 1: "authentication"
982024-04-03T10:06:45.050Zprocess exited: duration 43 ms, exit code 0
 
992024-04-03T10:06:45.098Zstarting task 2: "build"
1002024-04-03T10:06:45.122Z+ trap _exit_trap EXIT
1012024-04-03T10:06:45.122Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1022024-04-03T10:06:45.219Zsecpolicy_fs_linkdir: 0x55 = 0x55
1032024-04-03T10:06:45.219Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1042024-04-03T10:06:45.219Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1052024-04-03T10:06:45.244Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1062024-04-03T10:06:45.244Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1072024-04-03T10:06:45.244Zsecpolicy_fs_linkdir+5: 0 = 0x1
1082024-04-03T10:06:45.244Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1092024-04-03T10:06:45.244Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1102024-04-03T10:06:45.244Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1112024-04-03T10:06:45.244Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1122024-04-03T10:06:45.244Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1132024-04-03T10:06:45.244Z+ [[ -d /opt/oxide ]]
1142024-04-03T10:06:45.244Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1152024-04-03T10:06:45.244Z+ pfexec mkdir /opt/oxide
1162024-04-03T10:06:45.244Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1172024-04-03T10:06:45.244Z+ [[ -d /opt/oxide-underneath ]]
1182024-04-03T10:06:45.244Z+ cd /opt/oxide-underneath
1192024-04-03T10:06:45.244Z+ pfexec tar ceEp@/f - .
1202024-04-03T10:06:45.244Z+ cd /opt/oxide
1212024-04-03T10:06:45.244Z+ pfexec tar xveEp@/f -
1222024-04-03T10:06:45.325Zx ., 0 bytes, 0 tape blocks
1232024-04-03T10:06:45.325Zx ./opte, 0 bytes, 0 tape blocks
1242024-04-03T10:06:45.325Zx ./opte/bin, 0 bytes, 0 tape blocks
1252024-04-03T10:06:45.325Zx ./opte/bin/opteadm, 43221608 bytes, 84418 tape blocks
1262024-04-03T10:06:45.350Z+ pfexec rm -rf /opt/oxide-underneath
1272024-04-03T10:06:45.350Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1282024-04-03T10:06:45.375Z+ pfexec mkdir /opt/oxide/work
1292024-04-03T10:06:45.375Z+ pfexec chown build:build /opt/oxide/work
1302024-04-03T10:06:45.375Z+ cd /opt/oxide/work
1312024-04-03T10:06:45.375Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1322024-04-03T10:06:47.023ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1332024-04-03T10:06:47.023Zx out/mg-ddm-gz.tar, 75678720 bytes, 147810 tape blocks
1342024-04-03T10:06:47.023Zx out/omicron-sled-agent.tar, 115637248 bytes, 225854 tape blocks
1352024-04-03T10:06:47.023Zx out/oxlog.tar, 6260736 bytes, 12228 tape blocks
1362024-04-03T10:06:47.024Zx out/target/test, 75 bytes, 1 tape blocks
1372024-04-03T10:06:47.024Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1382024-04-03T10:06:47.024Zx package-manifest.toml, 26511 bytes, 52 tape blocks
1392024-04-03T10:06:47.024Zx smf/sled-agent/non-gimlet/config.toml, 3156 bytes, 7 tape blocks
1402024-04-03T10:06:47.024Zx target/release/omicron-package, 40277600 bytes, 78668 tape blocks
1412024-04-03T10:06:47.024Zx tools/create_virtual_hardware.sh, 3183 bytes, 7 tape blocks
1422024-04-03T10:06:47.024Zx tools/virtual_hardware.sh, 3172 bytes, 7 tape blocks
1432024-04-03T10:06:47.024Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1442024-04-03T10:06:47.024Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1452024-04-03T10:06:47.024Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1462024-04-03T10:06:47.024Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1472024-04-03T10:06:47.024Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1482024-04-03T10:06:47.049Z
1492024-04-03T10:06:47.049Zreal 1.658474510
1502024-04-03T10:06:47.049Zuser 1.492329407
1512024-04-03T10:06:47.049Zsys 0.293723394
1522024-04-03T10:06:47.049Ztrap 0.000052530
1532024-04-03T10:06:47.049Ztflt 0.000000000
1542024-04-03T10:06:47.049Zdflt 0.000000000
1552024-04-03T10:06:47.049Zkflt 0.000000000
1562024-04-03T10:06:47.049Zlock 0.000000000
1572024-04-03T10:06:47.049Zslp 1.491915252
1582024-04-03T10:06:47.049Zlat 0.036623378
1592024-04-03T10:06:47.049Zstop 0.000123482
1602024-04-03T10:06:47.050Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/nexus-single-sled.tar.gz /input/package/work/zones/nexus.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/probe.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1612024-04-03T10:06:48.364Z+ mv out/nexus-single-sled.tar.gz out/nexus.tar.gz
1622024-04-03T10:06:48.388Z+ mkdir tests
1632024-04-03T10:06:48.388Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1642024-04-03T10:06:48.388Z+ ptime -m gunzip
1652024-04-03T10:06:48.388Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-28a51422b533788d
1662024-04-03T10:06:48.588Z
1672024-04-03T10:06:48.612Zreal 0.204976432
1682024-04-03T10:06:48.612Zuser 0.189971419
1692024-04-03T10:06:48.612Zsys 0.014762008
1702024-04-03T10:06:48.612Ztrap 0.000014270
1712024-04-03T10:06:48.612Ztflt 0.000000000
1722024-04-03T10:06:48.612Zdflt 0.000000000
1732024-04-03T10:06:48.612Zkflt 0.000000000
1742024-04-03T10:06:48.612Zlock 0.000000000
1752024-04-03T10:06:48.612Zslp 0.000022420
1762024-04-03T10:06:48.613Zlat 0.000023460
1772024-04-03T10:06:48.613Zstop 0.000123022
1782024-04-03T10:06:48.613Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-28a51422b533788d
1792024-04-03T10:06:48.613Z+ chmod a+x tests/bootstrap-28a51422b533788d
1802024-04-03T10:06:48.613Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1812024-04-03T10:06:48.613Z+ ptime -m gunzip
1822024-04-03T10:06:48.613Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1832024-04-03T10:06:50.893Z
1842024-04-03T10:06:50.917Zreal 2.294851509
1852024-04-03T10:06:50.918Zuser 2.141071277
1862024-04-03T10:06:50.918Zsys 0.153392606
1872024-04-03T10:06:50.918Ztrap 0.000161910
1882024-04-03T10:06:50.918Ztflt 0.000000000
1892024-04-03T10:06:50.918Zdflt 0.000000000
1902024-04-03T10:06:50.918Zkflt 0.000000000
1912024-04-03T10:06:50.918Zlock 0.000000000
1922024-04-03T10:06:50.918Zslp 0.000023050
1932024-04-03T10:06:50.918Zlat 0.000018100
1942024-04-03T10:06:50.918Zstop 0.000122272
1952024-04-03T10:06:50.918Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1962024-04-03T10:06:50.918Z+ chmod a+x tests/bootstrap
1972024-04-03T10:06:50.918Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1982024-04-03T10:06:50.918Z+ ptime -m gunzip
1992024-04-03T10:06:50.918Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-0e6379a48de6d126
2002024-04-03T10:06:51.109Z
2012024-04-03T10:06:51.134Zreal 0.203991324
2022024-04-03T10:06:51.134Zuser 0.190088736
2032024-04-03T10:06:51.134Zsys 0.013645843
2042024-04-03T10:06:51.134Ztrap 0.000017479
2052024-04-03T10:06:51.134Ztflt 0.000000000
2062024-04-03T10:06:51.134Zdflt 0.000000000
2072024-04-03T10:06:51.134Zkflt 0.000000000
2082024-04-03T10:06:51.134Zlock 0.000000000
2092024-04-03T10:06:51.135Zslp 0.000022690
2102024-04-03T10:06:51.135Zlat 0.000023829
2112024-04-03T10:06:51.135Zstop 0.000125382
2122024-04-03T10:06:51.135Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-0e6379a48de6d126
2132024-04-03T10:06:51.135Z+ chmod a+x tests/commtest-0e6379a48de6d126
2142024-04-03T10:06:51.135Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2152024-04-03T10:06:51.135Z+ ptime -m gunzip
2162024-04-03T10:06:51.135Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-3228f4e88b82b7eb
2172024-04-03T10:06:51.329Z
2182024-04-03T10:06:51.353Zreal 0.208736131
2192024-04-03T10:06:51.353Zuser 0.190744551
2202024-04-03T10:06:51.354Zsys 0.017764934
2212024-04-03T10:06:51.354Ztrap 0.000015910
2222024-04-03T10:06:51.354Ztflt 0.000000000
2232024-04-03T10:06:51.354Zdflt 0.000000000
2242024-04-03T10:06:51.354Zkflt 0.000000000
2252024-04-03T10:06:51.354Zlock 0.000000000
2262024-04-03T10:06:51.354Zslp 0.000023340
2272024-04-03T10:06:51.354Zlat 0.000016250
2282024-04-03T10:06:51.354Zstop 0.000115991
2292024-04-03T10:06:51.354Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-3228f4e88b82b7eb
2302024-04-03T10:06:51.354Z+ chmod a+x tests/dhcp_server-3228f4e88b82b7eb
2312024-04-03T10:06:51.354Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2322024-04-03T10:06:51.354Z+ ptime -m gunzip
2332024-04-03T10:06:51.354Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2972fd47be91e6e5
2342024-04-03T10:06:53.676Z
2352024-04-03T10:06:53.700Zreal 2.335112944
2362024-04-03T10:06:53.700Zuser 2.166987321
2372024-04-03T10:06:53.700Zsys 0.167714165
2382024-04-03T10:06:53.700Ztrap 0.000171142
2392024-04-03T10:06:53.700Ztflt 0.000000000
2402024-04-03T10:06:53.700Zdflt 0.000000000
2412024-04-03T10:06:53.700Zkflt 0.000000000
2422024-04-03T10:06:53.700Zlock 0.000000000
2432024-04-03T10:06:53.700Zslp 0.000022040
2442024-04-03T10:06:53.701Zlat 0.000024140
2452024-04-03T10:06:53.701Zstop 0.000122702
2462024-04-03T10:06:53.701Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2972fd47be91e6e5
2472024-04-03T10:06:53.701Z+ chmod a+x tests/end_to_end_tests-2972fd47be91e6e5
2482024-04-03T10:06:53.701Z+ bmat address ls
2492024-04-03T10:06:53.701ZNAME CIDR FIRST LAST COUNT
2502024-04-03T10:06:53.701Zextra 10.151.1.0/24 10.151.1.164 10.151.1.227 64
2512024-04-03T10:06:53.701Z++ bmat address ls -f extra -Ho first,last,count
2522024-04-03T10:06:53.725Z+ set -- 10.151.1.164 10.151.1.227 64
2532024-04-03T10:06:53.725Z+ EXTRA_IP_START=10.151.1.164
2542024-04-03T10:06:53.725Z+ EXTRA_IP_END=10.151.1.227
2552024-04-03T10:06:53.725Z+ EXTRA_IP_COUNT=64
2562024-04-03T10:06:53.725Z+ (( EXTRA_IP_COUNT >= 32 ))
2572024-04-03T10:06:53.725Z+ EXTRA_IP_BASE=10.151.1
2582024-04-03T10:06:53.725Z+ EXTRA_IP_FOCTET=164
2592024-04-03T10:06:53.726Z+ EXTRA_IP_LOCTET=227
2602024-04-03T10:06:53.726Z+ SERVICE_IP_POOL_START=10.151.1.164
2612024-04-03T10:06:53.726Z+ SERVICE_IP_POOL_END=10.151.1.173
2622024-04-03T10:06:53.726Z+ DNS_IP1=10.151.1.164
2632024-04-03T10:06:53.726Z+ DNS_IP2=10.151.1.165
2642024-04-03T10:06:53.726Z+ UPLINK_IP=10.151.1.174
2652024-04-03T10:06:53.726Z+ IPPOOL_START=10.151.1.175
2662024-04-03T10:06:53.726Z+ IPPOOL_END=10.151.1.227
2672024-04-03T10:06:53.726Z++ ipadm show-addr -po type,addr
2682024-04-03T10:06:53.726Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2692024-04-03T10:06:53.726Z+ GATEWAY_IP=10.151.1.100
2702024-04-03T10:06:53.726Z+ [[ -n 10.151.1.100 ]]
2712024-04-03T10:06:53.726Z+ ping -s 10.151.1.100 56 1
2722024-04-03T10:06:53.726ZPING 10.151.1.100: 56 data bytes
2732024-04-03T10:06:53.726Z64 bytes from 10.151.1.100: icmp_seq=0. time=0.011 ms
2742024-04-03T10:06:53.726Z
2752024-04-03T10:06:53.726Z----10.151.1.100 PING Statistics----
2762024-04-03T10:06:53.726Z1 packets transmitted, 1 packets received, 0% packet loss
2772024-04-03T10:06:53.726Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2782024-04-03T10:06:53.726Z++ arp -an
2792024-04-03T10:06:53.726Z++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}'
2802024-04-03T10:06:53.750Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
2812024-04-03T10:06:53.750Z+ routeadm -e ipv4-forwarding -u
2822024-04-03T10:06:53.841Z+ PXA_START=10.151.1.164
2832024-04-03T10:06:53.841Z+ PXA_END=10.151.1.227
2842024-04-03T10:06:53.865Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2852024-04-03T10:06:53.865Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2862024-04-03T10:06:53.976Z+ VDEV_DIR=/scratch
2872024-04-03T10:06:53.976Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2882024-04-03T10:06:54.000Z+++ dirname ./tools/create_virtual_hardware.sh
2892024-04-03T10:06:54.000Z++ cd ./tools
2902024-04-03T10:06:54.001Z++ pwd
2912024-04-03T10:06:54.001Z+ SOURCE_DIR=/opt/oxide/work/tools
2922024-04-03T10:06:54.001Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2932024-04-03T10:06:54.001Z+ SOFTNPU_MODE=zone
2942024-04-03T10:06:54.001Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2952024-04-03T10:06:54.001Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2962024-04-03T10:06:54.001Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2972024-04-03T10:06:54.001Z++ dladm show-phys -p -o LINK
2982024-04-03T10:06:54.001Z++ head -1
2992024-04-03T10:06:54.060Z+ PHYSICAL_LINK=igb0
3002024-04-03T10:06:54.086Z+ echo 'Using igb0 as physical link'
3012024-04-03T10:06:54.086ZUsing igb0 as physical link
3022024-04-03T10:06:54.086Z+ ensure_run_as_root
3032024-04-03T10:06:54.086Z++ id -u
3042024-04-03T10:06:54.086Z+ [[ 0 -ne 0 ]]
3052024-04-03T10:06:54.087Z+ ensure_vdevs
3062024-04-03T10:06:54.087Z+ VDEV_TYPES=('m2_' 'u2_')
3072024-04-03T10:06:54.087Z+ for VDEV_TYPE in "${VDEV_TYPES[@]}"
3082024-04-03T10:06:54.087Z+ readarray -t VDEVS
3092024-04-03T10:06:54.087Z++ grep '"m2_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3102024-04-03T10:06:54.087Z++ sed 's/[ ",]//g'
3112024-04-03T10:06:54.087Z+ for VDEV in "${VDEVS[@]}"
3122024-04-03T10:06:54.087Z+ echo 'Device: [m2_0.vdev]'
3132024-04-03T10:06:54.087ZDevice: [m2_0.vdev]
3142024-04-03T10:06:54.087Z+ VDEV_PATH=/scratch/m2_0.vdev
3152024-04-03T10:06:54.087Z+ [[ -f /scratch/m2_0.vdev ]]
3162024-04-03T10:06:54.087Z+ dd if=/dev/zero of=/scratch/m2_0.vdev bs=1 count=0 seek=20G
3172024-04-03T10:06:54.112Z0+0 records in
3182024-04-03T10:06:54.112Z0+0 records out
3192024-04-03T10:06:54.112Z0 bytes (0 iB) transferred in 0.000006 secs (0 iB/sec)
3202024-04-03T10:06:54.112Z+ success 'vdev /scratch/m2_0.vdev exists'
3212024-04-03T10:06:54.112Z+ set +x
3222024-04-03T10:06:54.112Zvdev /scratch/m2_0.vdev exists
3232024-04-03T10:06:54.112Z+ for VDEV in "${VDEVS[@]}"
3242024-04-03T10:06:54.112Z+ echo 'Device: [m2_1.vdev]'
3252024-04-03T10:06:54.112ZDevice: [m2_1.vdev]
3262024-04-03T10:06:54.112Z+ VDEV_PATH=/scratch/m2_1.vdev
3272024-04-03T10:06:54.112Z+ [[ -f /scratch/m2_1.vdev ]]
3282024-04-03T10:06:54.112Z+ dd if=/dev/zero of=/scratch/m2_1.vdev bs=1 count=0 seek=20G
3292024-04-03T10:06:54.112Z0+0 records in
3302024-04-03T10:06:54.112Z0+0 records out
3312024-04-03T10:06:54.112Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3322024-04-03T10:06:54.112Z+ success 'vdev /scratch/m2_1.vdev exists'
3332024-04-03T10:06:54.113Z+ set +x
3342024-04-03T10:06:54.113Zvdev /scratch/m2_1.vdev exists
3352024-04-03T10:06:54.113Z+ for VDEV_TYPE in "${VDEV_TYPES[@]}"
3362024-04-03T10:06:54.113Z+ readarray -t VDEVS
3372024-04-03T10:06:54.113Z++ grep '"u2_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3382024-04-03T10:06:54.113Z++ sed 's/[ ",]//g'
3392024-04-03T10:06:54.113Z+ for VDEV in "${VDEVS[@]}"
3402024-04-03T10:06:54.113Z+ echo 'Device: [u2_0.vdev]'
3412024-04-03T10:06:54.113ZDevice: [u2_0.vdev]
3422024-04-03T10:06:54.113Z+ VDEV_PATH=/scratch/u2_0.vdev
3432024-04-03T10:06:54.113Z+ [[ -f /scratch/u2_0.vdev ]]
3442024-04-03T10:06:54.113Z+ dd if=/dev/zero of=/scratch/u2_0.vdev bs=1 count=0 seek=20G
3452024-04-03T10:06:54.113Z0+0 records in
3462024-04-03T10:06:54.113Z0+0 records out
3472024-04-03T10:06:54.113Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3482024-04-03T10:06:54.113Z+ success 'vdev /scratch/u2_0.vdev exists'
3492024-04-03T10:06:54.113Z+ set +x
3502024-04-03T10:06:54.113Zvdev /scratch/u2_0.vdev exists
3512024-04-03T10:06:54.113Z+ for VDEV in "${VDEVS[@]}"
3522024-04-03T10:06:54.113Z+ echo 'Device: [u2_1.vdev]'
3532024-04-03T10:06:54.114ZDevice: [u2_1.vdev]
3542024-04-03T10:06:54.114Z+ VDEV_PATH=/scratch/u2_1.vdev
3552024-04-03T10:06:54.114Z+ [[ -f /scratch/u2_1.vdev ]]
3562024-04-03T10:06:54.114Z+ dd if=/dev/zero of=/scratch/u2_1.vdev bs=1 count=0 seek=20G
3572024-04-03T10:06:54.114Z0+0 records in
3582024-04-03T10:06:54.114Z0+0 records out
3592024-04-03T10:06:54.114Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3602024-04-03T10:06:54.114Z+ success 'vdev /scratch/u2_1.vdev exists'
3612024-04-03T10:06:54.114Z+ set +x
3622024-04-03T10:06:54.114Zvdev /scratch/u2_1.vdev exists
3632024-04-03T10:06:54.114Z+ for VDEV in "${VDEVS[@]}"
3642024-04-03T10:06:54.114Z+ echo 'Device: [u2_2.vdev]'
3652024-04-03T10:06:54.114ZDevice: [u2_2.vdev]
3662024-04-03T10:06:54.114Z+ VDEV_PATH=/scratch/u2_2.vdev
3672024-04-03T10:06:54.114Z+ [[ -f /scratch/u2_2.vdev ]]
3682024-04-03T10:06:54.114Z+ dd if=/dev/zero of=/scratch/u2_2.vdev bs=1 count=0 seek=20G
3692024-04-03T10:06:54.161Z0+0 records in
3702024-04-03T10:06:54.161Z0+0 records out
3712024-04-03T10:06:54.161Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3722024-04-03T10:06:54.161Z+ success 'vdev /scratch/u2_2.vdev exists'
3732024-04-03T10:06:54.161Z+ set +x
3742024-04-03T10:06:54.161Zvdev /scratch/u2_2.vdev exists
3752024-04-03T10:06:54.161Z+ for VDEV in "${VDEVS[@]}"
3762024-04-03T10:06:54.161Z+ echo 'Device: [u2_3.vdev]'
3772024-04-03T10:06:54.161ZDevice: [u2_3.vdev]
3782024-04-03T10:06:54.161Z+ VDEV_PATH=/scratch/u2_3.vdev
3792024-04-03T10:06:54.161Z+ [[ -f /scratch/u2_3.vdev ]]
3802024-04-03T10:06:54.161Z+ dd if=/dev/zero of=/scratch/u2_3.vdev bs=1 count=0 seek=20G
3812024-04-03T10:06:54.161Z0+0 records in
3822024-04-03T10:06:54.161Z0+0 records out
3832024-04-03T10:06:54.161Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3842024-04-03T10:06:54.162Z+ success 'vdev /scratch/u2_3.vdev exists'
3852024-04-03T10:06:54.162Z+ set +x
3862024-04-03T10:06:54.162Zvdev /scratch/u2_3.vdev exists
3872024-04-03T10:06:54.162Z+ for VDEV in "${VDEVS[@]}"
3882024-04-03T10:06:54.162Z+ echo 'Device: [u2_4.vdev]'
3892024-04-03T10:06:54.162ZDevice: [u2_4.vdev]
3902024-04-03T10:06:54.162Z+ VDEV_PATH=/scratch/u2_4.vdev
3912024-04-03T10:06:54.162Z+ [[ -f /scratch/u2_4.vdev ]]
3922024-04-03T10:06:54.162Z+ dd if=/dev/zero of=/scratch/u2_4.vdev bs=1 count=0 seek=20G
3932024-04-03T10:06:54.162Z0+0 records in
3942024-04-03T10:06:54.162Z0+0 records out
3952024-04-03T10:06:54.162Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3962024-04-03T10:06:54.162Z+ success 'vdev /scratch/u2_4.vdev exists'
3972024-04-03T10:06:54.162Z+ set +x
3982024-04-03T10:06:54.162Zvdev /scratch/u2_4.vdev exists
3992024-04-03T10:06:54.162Z+ for VDEV in "${VDEVS[@]}"
4002024-04-03T10:06:54.162ZDevice: [u2_5.vdev]
4012024-04-03T10:06:54.162Z+ echo 'Device: [u2_5.vdev]'
4022024-04-03T10:06:54.162Z+ VDEV_PATH=/scratch/u2_5.vdev
4032024-04-03T10:06:54.162Z+ [[ -f /scratch/u2_5.vdev ]]
4042024-04-03T10:06:54.162Z+ dd if=/dev/zero of=/scratch/u2_5.vdev bs=1 count=0 seek=20G
4052024-04-03T10:06:54.163Z0+0 records in
4062024-04-03T10:06:54.163Z0+0 records out
4072024-04-03T10:06:54.163Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4082024-04-03T10:06:54.163Z+ success 'vdev /scratch/u2_5.vdev exists'
4092024-04-03T10:06:54.163Z+ set +x
4102024-04-03T10:06:54.163Zvdev /scratch/u2_5.vdev exists
4112024-04-03T10:06:54.163Z+ for VDEV in "${VDEVS[@]}"
4122024-04-03T10:06:54.163Z+ echo 'Device: [u2_6.vdev]'
4132024-04-03T10:06:54.163ZDevice: [u2_6.vdev]
4142024-04-03T10:06:54.163Z+ VDEV_PATH=/scratch/u2_6.vdev
4152024-04-03T10:06:54.163Z+ [[ -f /scratch/u2_6.vdev ]]
4162024-04-03T10:06:54.163Z+ dd if=/dev/zero of=/scratch/u2_6.vdev bs=1 count=0 seek=20G
4172024-04-03T10:06:54.163Z0+0 records in
4182024-04-03T10:06:54.163Z0+0 records out
4192024-04-03T10:06:54.163Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4202024-04-03T10:06:54.163Z+ success 'vdev /scratch/u2_6.vdev exists'
4212024-04-03T10:06:54.163Z+ set +x
4222024-04-03T10:06:54.163Zvdev /scratch/u2_6.vdev exists
4232024-04-03T10:06:54.163Z+ for VDEV in "${VDEVS[@]}"
4242024-04-03T10:06:54.163ZDevice: [u2_7.vdev]
4252024-04-03T10:06:54.163Z+ echo 'Device: [u2_7.vdev]'
4262024-04-03T10:06:54.164Z+ VDEV_PATH=/scratch/u2_7.vdev
4272024-04-03T10:06:54.164Z+ [[ -f /scratch/u2_7.vdev ]]
4282024-04-03T10:06:54.164Z+ dd if=/dev/zero of=/scratch/u2_7.vdev bs=1 count=0 seek=20G
4292024-04-03T10:06:54.164Z0+0 records in
4302024-04-03T10:06:54.164Z0+0 records out
4312024-04-03T10:06:54.164Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4322024-04-03T10:06:54.164Z+ success 'vdev /scratch/u2_7.vdev exists'
4332024-04-03T10:06:54.164Z+ set +x
4342024-04-03T10:06:54.164Zvdev /scratch/u2_7.vdev exists
4352024-04-03T10:06:54.164Z+ for VDEV in "${VDEVS[@]}"
4362024-04-03T10:06:54.164Z+ echo 'Device: [u2_8.vdev]'
4372024-04-03T10:06:54.164ZDevice: [u2_8.vdev]
4382024-04-03T10:06:54.164Z+ VDEV_PATH=/scratch/u2_8.vdev
4392024-04-03T10:06:54.164Z+ [[ -f /scratch/u2_8.vdev ]]
4402024-04-03T10:06:54.164Z+ dd if=/dev/zero of=/scratch/u2_8.vdev bs=1 count=0 seek=20G
4412024-04-03T10:06:54.164Z0+0 records in
4422024-04-03T10:06:54.164Z0+0 records out
4432024-04-03T10:06:54.164Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4442024-04-03T10:06:54.164Z+ success 'vdev /scratch/u2_8.vdev exists'
4452024-04-03T10:06:54.164Z+ set +x
4462024-04-03T10:06:54.165Zvdev /scratch/u2_8.vdev exists
4472024-04-03T10:06:54.165Z+ [[ zone == \z\o\n\e ]]
4482024-04-03T10:06:54.165Z+ ensure_simulated_links igb0
4492024-04-03T10:06:54.165Z+ local PHYSICAL_LINK=igb0
4502024-04-03T10:06:54.165Z+ INDICES=("0" "1")
4512024-04-03T10:06:54.165Z+ for I in "${INDICES[@]}"
4522024-04-03T10:06:54.165Z++ get_simnet_name_if_exists net0
4532024-04-03T10:06:54.165Z++ dladm show-simnet -p -o LINK net0
4542024-04-03T10:06:54.165Z++ echo ''
4552024-04-03T10:06:54.165Z+ [[ -z '' ]]
4562024-04-03T10:06:54.165Z+ dladm create-simnet -t net0
4572024-04-03T10:06:54.189Z+ dladm create-simnet -t sc0_0
4582024-04-03T10:06:54.189Z+ dladm modify-simnet -t -p net0 sc0_0
4592024-04-03T10:06:54.189Z+ dladm set-linkprop -p mtu=9000 sc0_0
4602024-04-03T10:06:54.190Z+ success 'Simnet net0/sc0_0 exists'
4612024-04-03T10:06:54.190Z+ set +x
4622024-04-03T10:06:54.190ZSimnet net0/sc0_0 exists
4632024-04-03T10:06:54.190Z+ for I in "${INDICES[@]}"
4642024-04-03T10:06:54.190Z++ get_simnet_name_if_exists net1
4652024-04-03T10:06:54.190Z++ dladm show-simnet -p -o LINK net1
4662024-04-03T10:06:54.190Z++ echo ''
4672024-04-03T10:06:54.190Z+ [[ -z '' ]]
4682024-04-03T10:06:54.190Z+ dladm create-simnet -t net1
4692024-04-03T10:06:54.190Z+ dladm create-simnet -t sc1_0
4702024-04-03T10:06:54.190Z+ dladm modify-simnet -t -p net1 sc1_0
4712024-04-03T10:06:54.190Z+ dladm set-linkprop -p mtu=9000 sc1_0
4722024-04-03T10:06:54.190Z+ success 'Simnet net1/sc1_0 exists'
4732024-04-03T10:06:54.190Z+ set +x
4742024-04-03T10:06:54.190ZSimnet net1/sc1_0 exists
4752024-04-03T10:06:54.190Z++ get_vnic_name_if_exists sc0_1
4762024-04-03T10:06:54.190Z++ dladm show-vnic -p -o LINK sc0_1
4772024-04-03T10:06:54.190Z++ echo ''
4782024-04-03T10:06:54.190Z+ [[ -z '' ]]
4792024-04-03T10:06:54.190Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
4802024-04-03T10:06:54.190Z+ [[ -v PROMISC_FILT_OFF ]]
4812024-04-03T10:06:54.191Z+ success 'Vnic sc0_1 exists'
4822024-04-03T10:06:54.191Z+ set +x
4832024-04-03T10:06:54.191ZVnic sc0_1 exists
4842024-04-03T10:06:54.191Z+ warn_if_no_proxy_arp
4852024-04-03T10:06:54.191Z+ [[ -v PXA_START ]]
4862024-04-03T10:06:54.191Z+ [[ -v PXA_END ]]
4872024-04-03T10:06:54.191Z+ ensure_softnpu_zone
4882024-04-03T10:06:54.191Z+ zoneadm list
4892024-04-03T10:06:54.191Z+ grep -q sidecar_softnpu
4902024-04-03T10:06:54.215Z+ [[ -f out/npuzone/npuzone ]]
4912024-04-03T10:06:54.215Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
4922024-04-03T10:06:54.215Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
4932024-04-03T10:07:00.682Zdownloading softnpu ...done
4942024-04-03T10:07:00.706Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
4952024-04-03T10:07:05.640Zdownloading asic_program.so ...done
4962024-04-03T10:07:05.664Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
4972024-04-03T10:07:11.694Zdownloading scadm ...done
4982024-04-03T10:07:11.717Zcreating port tfportrear0_0 for sc0_0
4992024-04-03T10:07:11.718Zcreating port tfportqsfp0_0 for sc0_1
5002024-04-03T10:07:11.744Zsoftnpu zone setup
5012024-04-03T10:07:11.744Zconfigure zone
5022024-04-03T10:07:11.744Zinstall zone
5032024-04-03T10:07:12.776Zboot zone
5042024-04-03T10:07:15.881Z[sidecar_softnpu] svcs milestone/network
5052024-04-03T10:07:15.909ZSTATE STIME FMRI
5062024-04-03T10:07:15.909Zonline 10:07:14 svc:/milestone/network:default
5072024-04-03T10:07:15.909Z[sidecar_softnpu] /softnpu/npu start
5082024-04-03T10:07:15.934Z
5092024-04-03T10:07:15.958Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5102024-04-03T10:07:15.958Z+ GATEWAY_IP=10.151.1.100
5112024-04-03T10:07:15.958Z+ echo 'Using 10.151.1.100 as gateway ip'
5122024-04-03T10:07:15.958ZUsing 10.151.1.100 as gateway ip
5132024-04-03T10:07:15.958Z+ [[ ! -v GATEWAY_MAC ]]
5142024-04-03T10:07:15.958Z+ GATEWAY_MAC=18:c0:4d:0d:9f:b2
5152024-04-03T10:07:15.958Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5162024-04-03T10:07:15.959Z+++ echo 18:c0:4d:0d:9f:b2
5172024-04-03T10:07:15.959Z+ COUNT=1
5182024-04-03T10:07:15.959Z+ [[ 1 -ne 1 ]]
5192024-04-03T10:07:15.959Z+ echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac'
5202024-04-03T10:07:15.959ZUsing 18:c0:4d:0d:9f:b2 as gateway mac
5212024-04-03T10:07:15.959Z+ z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5222024-04-03T10:07:15.959Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2
5232024-04-03T10:07:15.983Z+ PXA_MAC=a8:e1:de:01:70:1d
5242024-04-03T10:07:15.983Z+ [[ -v PXA_START ]]
5252024-04-03T10:07:15.983Z+ z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5262024-04-03T10:07:15.983Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d
5272024-04-03T10:07:16.012Z+ z_scadm dump-state
5282024-04-03T10:07:16.012Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5292024-04-03T10:07:16.037Zlocal v6:
5302024-04-03T10:07:16.037Zlocal v4:
5312024-04-03T10:07:16.037Zrouter v6:
5322024-04-03T10:07:16.037Zrouter v4_idx:
5332024-04-03T10:07:16.037Zrouter v4_routes:
5342024-04-03T10:07:16.038Zresolver v4:
5352024-04-03T10:07:16.038Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
5362024-04-03T10:07:16.038Zresolver v6:
5372024-04-03T10:07:16.038Znat v4:
5382024-04-03T10:07:16.038Znat_v6:
5392024-04-03T10:07:16.038Zport_mac:
5402024-04-03T10:07:16.038Zproxy arp:
5412024-04-03T10:07:16.038Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
5422024-04-03T10:07:16.038Z+ success 'softnpu zone exists'
5432024-04-03T10:07:16.038Z+ set +x
5442024-04-03T10:07:16.038Zsoftnpu zone exists
5452024-04-03T10:07:16.038Z
5462024-04-03T10:07:16.038Zreal 22.057035925
5472024-04-03T10:07:16.038Zuser 0.664946656
5482024-04-03T10:07:16.038Zsys 1.428416063
5492024-04-03T10:07:16.038Ztrap 0.000054950
5502024-04-03T10:07:16.038Ztflt 0.000139637
5512024-04-03T10:07:16.063Zdflt 0.001718848
5522024-04-03T10:07:16.063Zkflt 0.000000000
5532024-04-03T10:07:16.063Zlock 17:20.029697794
5542024-04-03T10:07:16.063Zslp 1:06.444141312
5552024-04-03T10:07:16.063Zlat 0.085571011
5562024-04-03T10:07:16.063Zstop 0.360205087
5572024-04-03T10:07:16.063Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
5582024-04-03T10:07:16.088Z+ sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml
5592024-04-03T10:07:16.088Z+ diff -u pkg/config.toml~ pkg/config.toml
5602024-04-03T10:07:16.088Z--- pkg/config.toml~ Mon Jul 24 01:21:28 2006
5612024-04-03T10:07:16.088Z+++ pkg/config.toml Wed Apr 3 10:07:16 2024
5622024-04-03T10:07:16.088Z@@ -29,18 +29,18 @@
5632024-04-03T10:07:16.088Z # These paths have the prefix of either "u2" or "m2", followed by an underscore,
5642024-04-03T10:07:16.088Z # followed by a string that is embedded into their fake serial values.
5652024-04-03T10:07:16.089Z vdevs = [
5662024-04-03T10:07:16.089Z- "m2_0.vdev",
5672024-04-03T10:07:16.089Z- "m2_1.vdev",
5682024-04-03T10:07:16.089Z+ "/scratch/m2_0.vdev",
5692024-04-03T10:07:16.089Z+ "/scratch/m2_1.vdev",
5702024-04-03T10:07:16.089Z
5712024-04-03T10:07:16.089Z- "u2_0.vdev",
5722024-04-03T10:07:16.089Z- "u2_1.vdev",
5732024-04-03T10:07:16.089Z- "u2_2.vdev",
5742024-04-03T10:07:16.089Z- "u2_3.vdev",
5752024-04-03T10:07:16.089Z- "u2_4.vdev",
5762024-04-03T10:07:16.089Z- "u2_5.vdev",
5772024-04-03T10:07:16.089Z- "u2_6.vdev",
5782024-04-03T10:07:16.089Z- "u2_7.vdev",
5792024-04-03T10:07:16.089Z- "u2_8.vdev",
5802024-04-03T10:07:16.089Z+ "/scratch/u2_0.vdev",
5812024-04-03T10:07:16.089Z+ "/scratch/u2_1.vdev",
5822024-04-03T10:07:16.089Z+ "/scratch/u2_2.vdev",
5832024-04-03T10:07:16.089Z+ "/scratch/u2_3.vdev",
5842024-04-03T10:07:16.089Z+ "/scratch/u2_4.vdev",
5852024-04-03T10:07:16.089Z+ "/scratch/u2_5.vdev",
5862024-04-03T10:07:16.090Z+ "/scratch/u2_6.vdev",
5872024-04-03T10:07:16.090Z+ "/scratch/u2_7.vdev",
5882024-04-03T10:07:16.090Z+ "/scratch/u2_8.vdev",
5892024-04-03T10:07:16.090Z ]
5902024-04-03T10:07:16.090Z
5912024-04-03T10:07:16.090Z # Percentage of usable physical DRAM to use for the VMM reservoir, which
5922024-04-03T10:07:16.090Z+ true
5932024-04-03T10:07:16.090Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5942024-04-03T10:07:16.090Z+ SILO_NAME=recovery
5952024-04-03T10:07:16.115Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5962024-04-03T10:07:16.115Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5972024-04-03T10:07:16.115Z+ sed -i~ '
5982024-04-03T10:07:16.115Z /^external_dns_ips/c\
5992024-04-03T10:07:16.115Zexternal_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6002024-04-03T10:07:16.115Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6012024-04-03T10:07:16.115Z /^first/c\
6022024-04-03T10:07:16.115Zfirst = "10.151.1.164"
6032024-04-03T10:07:16.115Z /^last/c\
6042024-04-03T10:07:16.116Zlast = "10.151.1.173"
6052024-04-03T10:07:16.116Z }
6062024-04-03T10:07:16.116Z /^infra_ip_first/c\
6072024-04-03T10:07:16.116Zinfra_ip_first = "10.151.1.174"
6082024-04-03T10:07:16.116Z /^infra_ip_last/c\
6092024-04-03T10:07:16.116Zinfra_ip_last = "10.151.1.174"
6102024-04-03T10:07:16.116Z /^\[\[rack_network_config.ports/,/^$/ {
6112024-04-03T10:07:16.116Z /^routes/c\
6122024-04-03T10:07:16.116Zroutes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\]
6132024-04-03T10:07:16.116Z /^addresses/c\
6142024-04-03T10:07:16.116Zaddresses = \["10.151.1.174/24"\]
6152024-04-03T10:07:16.116Z }
6162024-04-03T10:07:16.116Z' pkg/config-rss.toml
6172024-04-03T10:07:16.116Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6182024-04-03T10:07:16.116Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6192024-04-03T10:07:16.116Z+++ pkg/config-rss.toml Wed Apr 3 10:07:16 2024
6202024-04-03T10:07:16.116Z@@ -33,7 +33,7 @@
6212024-04-03T10:07:16.116Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6222024-04-03T10:07:16.116Z # must be contained in one of the "internal services" IP Pool ranges listed
6232024-04-03T10:07:16.116Z # below.
6242024-04-03T10:07:16.116Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6252024-04-03T10:07:16.117Z+external_dns_ips = [ "10.151.1.164", "10.151.1.165" ]
6262024-04-03T10:07:16.117Z
6272024-04-03T10:07:16.117Z # Initial TLS certificates for the external API
6282024-04-03T10:07:16.117Z #
6292024-04-03T10:07:16.117Z@@ -69,8 +69,8 @@
6302024-04-03T10:07:16.117Z #
6312024-04-03T10:07:16.117Z # For more on this and what to put here, see docs/how-to-run.adoc.
6322024-04-03T10:07:16.117Z [[internal_services_ip_pool_ranges]]
6332024-04-03T10:07:16.117Z-first = "192.168.1.20"
6342024-04-03T10:07:16.117Z-last = "192.168.1.29"
6352024-04-03T10:07:16.117Z+first = "10.151.1.164"
6362024-04-03T10:07:16.117Z+last = "10.151.1.173"
6372024-04-03T10:07:16.117Z
6382024-04-03T10:07:16.117Z # TODO - this configuration is subject to change going forward. Ultimately these
6392024-04-03T10:07:16.117Z # parameters should be provided to the control plane via wicket, but we need to
6402024-04-03T10:07:16.117Z@@ -91,8 +91,8 @@
6412024-04-03T10:07:16.118Z # A range of IP addresses used by Boundary Services on the external network. In
6422024-04-03T10:07:16.118Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6432024-04-03T10:07:16.118Z # With softnpu, only one address is used.
6442024-04-03T10:07:16.118Z-infra_ip_first = "192.168.1.30"
6452024-04-03T10:07:16.118Z-infra_ip_last = "192.168.1.30"
6462024-04-03T10:07:16.118Z+infra_ip_first = "10.151.1.174"
6472024-04-03T10:07:16.118Z+infra_ip_last = "10.151.1.174"
6482024-04-03T10:07:16.118Z
6492024-04-03T10:07:16.118Z # Configurations for BGP routers to run on the scrimlets.
6502024-04-03T10:07:16.118Z bgp = []
6512024-04-03T10:07:16.118Z@@ -100,9 +100,9 @@
6522024-04-03T10:07:16.118Z # You can configure multiple uplinks by repeating the following stanza
6532024-04-03T10:07:16.118Z [[rack_network_config.ports]]
6542024-04-03T10:07:16.118Z # Routes associated with this port.
6552024-04-03T10:07:16.118Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
6562024-04-03T10:07:16.118Z+routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}]
6572024-04-03T10:07:16.118Z # Addresses associated with this port.
6582024-04-03T10:07:16.118Z-addresses = ["192.168.1.30/24"]
6592024-04-03T10:07:16.118Z+addresses = ["10.151.1.174/24"]
6602024-04-03T10:07:16.119Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6612024-04-03T10:07:16.119Z port = "qsfp0"
6622024-04-03T10:07:16.119Z # The speed of this port.
6632024-04-03T10:07:16.119Z+ true
6642024-04-03T10:07:16.119Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml
6652024-04-03T10:07:16.119Za pkg/config-rss.toml 7K
6662024-04-03T10:07:16.119Za pkg/config.toml 4K
6672024-04-03T10:07:16.119Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~
6682024-04-03T10:07:16.119Z+ TLS_NAME=recovery.sys.oxide.test
6692024-04-03T10:07:16.119Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6702024-04-03T10:07:17.159Z....+.+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.........+......+...............+....+...+.....+......+.......+..+.+.........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+................+..+.+.........+...+..............+.+.....+...+...........................+.......+..+...+...+......................+...............+...........+............+.........+......+.......+...........+......+.+.........+...........+..........+.........+.....+.+.................+.+....................+....+..+.+........+....+...+...+.........+.....+..................+...+.+.....+....+.....+...............+.+...+.....+.......+.....+.+........................+...........+............+...+...+.......+..+.............+..+.......+.....+.+........+....+..+....+.........+..+...+..........+..+...+.......+...+.....................+...........+...+.+......+..............+....+..+......+...+.......+.....+...................+......+...+..+....+...+...........+.+......+.....+..........+........+.+...........+...+......+.+..+.......+.........+.....+..........+.........+......+.....+......+......+...+.+......+.....+....+......+...+.....................+.....+..................+.+......+......+..+.+.....+......+.+............+..+.............+......+...........+.+...+..+.......+........+....+...+...........+......+...+.............+..............................+...+.....+......+.+...+......+.....+.............+...............+...........+.+.....+.............+........+...+.+......+...+.........+.....+.+..+....+.....+.........+....+...+........+.........+.......+......+....................+.........+..................+.+.........+.....+......+............+...+....+...........+.+.....+...+......+...........................+...................+........+...+....+......+...+..+....+......+..+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6712024-04-03T10:07:17.484Z...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+.+...+..+....+..+.......+...+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.....+................+..+..........+...........+.......+.....+....+...........+...+................+......+..+............+....+.....+....+...+.........+.....+.............+..+.+.....+....+...+.....+.+.....+.+...+...........+.........+................+.........+.....+...+...............+..........+...+..+.......+......+.....+.......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6722024-04-03T10:07:17.508Z-----
6732024-04-03T10:07:17.509Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6742024-04-03T10:07:17.533Za pkg/initial-tls-cert.pem 2K
6752024-04-03T10:07:17.533Za pkg/initial-tls-key.pem 4K
6762024-04-03T10:07:17.533Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6772024-04-03T10:07:17.533Z+ rmdir pkg
6782024-04-03T10:07:17.533Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6792024-04-03T10:07:17.533Z+ pfexec mkdir -p /usr/oxide
6802024-04-03T10:07:17.533Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
6812024-04-03T10:07:18.307Z+ pfexec chmod +x /usr/oxide/oxide
6822024-04-03T10:07:18.332Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
6832024-04-03T10:07:36.597Z+ OMICRON_NO_UNINSTALL=1
6842024-04-03T10:07:36.597Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6852024-04-03T10:07:36.622ZLogging to: /opt/oxide/work/out/LOG
6862024-04-03T10:07:37.159Z
6872024-04-03T10:07:37.184Zreal 0.558013237
6882024-04-03T10:07:37.184Zuser 0.113047727
6892024-04-03T10:07:37.184Zsys 2.371324233
6902024-04-03T10:07:37.184Ztrap 0.000008729
6912024-04-03T10:07:37.184Ztflt 0.000055038
6922024-04-03T10:07:37.184Zdflt 0.001085514
6932024-04-03T10:07:37.184Zkflt 0.000006589
6942024-04-03T10:07:37.184Zlock 50.683384212
6952024-04-03T10:07:37.184Zslp 0.770545312
6962024-04-03T10:07:37.184Zlat 0.002953315
6972024-04-03T10:07:37.184Zstop 0.229301822
6982024-04-03T10:07:37.184Z+ retry=0
6992024-04-03T10:07:37.184Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7002024-04-03T10:07:37.184Z+ [[ 0 -gt 30 ]]
7012024-04-03T10:07:37.184Z+ sleep 1
7022024-04-03T10:07:38.175Z+ retry=1
7032024-04-03T10:07:38.175Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7042024-04-03T10:07:38.199Z+ [[ 1 -gt 30 ]]
7052024-04-03T10:07:38.199Z+ sleep 1
7062024-04-03T10:07:39.191Z+ retry=2
7072024-04-03T10:07:39.191Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7082024-04-03T10:07:39.215Z+ [[ 2 -gt 30 ]]
7092024-04-03T10:07:39.215Z+ sleep 1
7102024-04-03T10:07:40.207Z+ retry=3
7112024-04-03T10:07:40.207Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7122024-04-03T10:08:05.375Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7132024-04-03T10:08:05.400Zlocal v6:
7142024-04-03T10:08:05.400Zfdf0:c015:1e8a:4ea0::1
7152024-04-03T10:08:05.400Zfe80::fca2:c9ff:fefe:d06
7162024-04-03T10:08:05.400Zlocal v4:
7172024-04-03T10:08:05.400Z10.151.1.174
7182024-04-03T10:08:05.400Zrouter v6:
7192024-04-03T10:08:05.400Zfd00:1122:3344:1::/64 -> fe80::e0c5:efff:fe05:52d4 (1)
7202024-04-03T10:08:05.400Zfd00:1122:3344:101::/64 -> fe80::e0c5:efff:fe05:52d4 (1)
7212024-04-03T10:08:05.400Zfd00:1122:3344:3::/64 -> fe80::e0c5:efff:fe05:52d4 (1)
7222024-04-03T10:08:05.400Zfdb0:18c0:4d0d:9fb2::/64 -> fe80::e0c5:efff:fe05:52d4 (1)
7232024-04-03T10:08:05.400Zfd00:1122:3344:2::/64 -> fe80::e0c5:efff:fe05:52d4 (1)
7242024-04-03T10:08:05.400Zrouter v4_idx:
7252024-04-03T10:08:05.425Z0.0.0.0/0 -> 0
7262024-04-03T10:08:05.425Zrouter v4_routes:
7272024-04-03T10:08:05.425Z0 -> 10.151.1.100 (2)
7282024-04-03T10:08:05.425Zresolver v4:
7292024-04-03T10:08:05.425Z10.151.1.174 -> 32:ef:59:85:1b:5a
7302024-04-03T10:08:05.425Z10.151.1.100 -> 18:c0:4d:0d:9f:b2
7312024-04-03T10:08:05.425Zresolver v6:
7322024-04-03T10:08:05.425Zfe80::fca2:c9ff:fefe:d06 -> fe:a2:c9:fe:0d:06
7332024-04-03T10:08:05.425Zfe80::e0c5:efff:fe05:52d4 -> e2:c5:ef:05:52:d4
7342024-04-03T10:08:05.425Znat v4:
7352024-04-03T10:08:05.425Z10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:eb:d8
7362024-04-03T10:08:05.425Znat_v6:
7372024-04-03T10:08:05.425Zport_mac:
7382024-04-03T10:08:05.425Z1000: a8:40:25:53:1f:e2
7392024-04-03T10:08:05.425Z1: a8:40:25:53:1f:e3
7402024-04-03T10:08:05.425Z2: a8:40:25:53:20:03
7412024-04-03T10:08:05.425Zproxy arp:
7422024-04-03T10:08:05.425Z10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d
7432024-04-03T10:08:05.426Z+ retry=0
7442024-04-03T10:08:05.426Z+++ zoneadm list -n
7452024-04-03T10:08:05.426Z+++ grep oxz_ntp
7462024-04-03T10:08:05.426Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
7472024-04-03T10:08:05.450Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7482024-04-03T10:08:05.450Z++ true
7492024-04-03T10:08:05.450Z+ [[ '' != online ]]
7502024-04-03T10:08:05.450Z+ [[ 0 -gt 60 ]]
7512024-04-03T10:08:05.450Z+ sleep 1
7522024-04-03T10:08:06.435Z+ retry=1
7532024-04-03T10:08:06.459Z+++ zoneadm list -n
7542024-04-03T10:08:06.459Z+++ grep oxz_ntp
7552024-04-03T10:08:06.459Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
7562024-04-03T10:08:06.483Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7572024-04-03T10:08:06.483Z++ true
7582024-04-03T10:08:06.483Z+ [[ '' != online ]]
7592024-04-03T10:08:06.483Z+ [[ 1 -gt 60 ]]
7602024-04-03T10:08:06.483Z+ sleep 1
7612024-04-03T10:08:07.465Z+ retry=2
7622024-04-03T10:08:07.489Z+++ zoneadm list -n
7632024-04-03T10:08:07.489Z+++ grep oxz_ntp
7642024-04-03T10:08:07.489Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
7652024-04-03T10:08:07.513Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
7662024-04-03T10:08:07.513Z++ true
7672024-04-03T10:08:07.514Z+ [[ '' != online ]]
7682024-04-03T10:08:07.514Z+ [[ 2 -gt 60 ]]
7692024-04-03T10:08:07.514Z+ sleep 1
7702024-04-03T10:08:08.496Z+ retry=3
7712024-04-03T10:08:08.521Z+++ zoneadm list -n
7722024-04-03T10:08:08.521Z+++ grep oxz_ntp
7732024-04-03T10:08:08.521Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
7742024-04-03T10:08:08.521Z+ [[ offline != online ]]
7752024-04-03T10:08:08.521Z+ [[ 3 -gt 60 ]]
7762024-04-03T10:08:08.521Z+ sleep 1
7772024-04-03T10:08:09.518Z+ retry=4
7782024-04-03T10:08:09.544Z+++ zoneadm list -n
7792024-04-03T10:08:09.544Z+++ grep oxz_ntp
7802024-04-03T10:08:09.544Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
7812024-04-03T10:08:09.544Z+ [[ offline != online ]]
7822024-04-03T10:08:09.544Z+ [[ 4 -gt 60 ]]
7832024-04-03T10:08:09.544Z+ sleep 1
7842024-04-03T10:08:10.540Z+ retry=5
7852024-04-03T10:08:10.564Z+++ zoneadm list -n
7862024-04-03T10:08:10.564Z+++ grep oxz_ntp
7872024-04-03T10:08:10.564Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
7882024-04-03T10:08:10.564Z+ [[ offline != online ]]
7892024-04-03T10:08:10.564Z+ [[ 5 -gt 60 ]]
7902024-04-03T10:08:10.564Z+ sleep 1
7912024-04-03T10:08:11.562Z+ retry=6
7922024-04-03T10:08:11.586Z+++ zoneadm list -n
7932024-04-03T10:08:11.586Z+++ grep oxz_ntp
7942024-04-03T10:08:11.586Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
7952024-04-03T10:08:11.586Z+ [[ offline != online ]]
7962024-04-03T10:08:11.586Z+ [[ 6 -gt 60 ]]
7972024-04-03T10:08:11.586Z+ sleep 1
7982024-04-03T10:08:12.584Z+ retry=7
7992024-04-03T10:08:12.609Z+++ zoneadm list -n
8002024-04-03T10:08:12.609Z+++ grep oxz_ntp
8012024-04-03T10:08:12.609Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
8022024-04-03T10:08:12.609Z+ [[ offline != online ]]
8032024-04-03T10:08:12.609Z+ [[ 7 -gt 60 ]]
8042024-04-03T10:08:12.609Z+ sleep 1
8052024-04-03T10:08:13.607Z+ retry=8
8062024-04-03T10:08:13.635Z+++ zoneadm list -n
8072024-04-03T10:08:13.635Z+++ grep oxz_ntp
8082024-04-03T10:08:13.635Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
8092024-04-03T10:08:13.635Z+ [[ offline != online ]]
8102024-04-03T10:08:13.635Z+ [[ 8 -gt 60 ]]
8112024-04-03T10:08:13.635Z+ sleep 1
8122024-04-03T10:08:14.630Z+ retry=9
8132024-04-03T10:08:14.654Z+++ zoneadm list -n
8142024-04-03T10:08:14.654Z+++ grep oxz_ntp
8152024-04-03T10:08:14.654Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
8162024-04-03T10:08:14.654Z+ [[ offline != online ]]
8172024-04-03T10:08:14.654Z+ [[ 9 -gt 60 ]]
8182024-04-03T10:08:14.654Z+ sleep 1
 
8192024-04-03T10:08:15.575Zbuskin console login: Apr 3 10:08:14 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8202024-04-03T10:08:15.653Z+ retry=10
8212024-04-03T10:08:15.677Z+++ zoneadm list -n
8222024-04-03T10:08:15.677Z+++ grep oxz_ntp
8232024-04-03T10:08:15.677Z++ pfexec svcs -z oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176 -Hostate oxide/ntp
8242024-04-03T10:08:15.677Z+ [[ online != online ]]
8252024-04-03T10:08:15.677Z+ echo 'Waited for chrony: 10s'
8262024-04-03T10:08:15.677ZWaited for chrony: 10s
8272024-04-03T10:08:15.677Z+ retry=0
8282024-04-03T10:08:15.677Z+ zoneadm list
8292024-04-03T10:08:15.677Z+ grep nexus
8302024-04-03T10:08:15.704Z+ [[ 0 -gt 300 ]]
8312024-04-03T10:08:15.705Z+ sleep 1
8322024-04-03T10:08:16.683Z+ retry=1
8332024-04-03T10:08:16.707Z+ zoneadm list
8342024-04-03T10:08:16.707Z+ grep nexus
8352024-04-03T10:08:16.707Z+ [[ 1 -gt 300 ]]
8362024-04-03T10:08:16.707Z+ sleep 1
8372024-04-03T10:08:17.692Z+ retry=2
8382024-04-03T10:08:17.717Z+ zoneadm list
8392024-04-03T10:08:17.717Z+ grep nexus
8402024-04-03T10:08:17.717Z+ [[ 2 -gt 300 ]]
8412024-04-03T10:08:17.717Z+ sleep 1
8422024-04-03T10:08:18.703Z+ retry=3
8432024-04-03T10:08:18.727Z+ zoneadm list
8442024-04-03T10:08:18.728Z+ grep nexus
8452024-04-03T10:08:18.728Z+ [[ 3 -gt 300 ]]
8462024-04-03T10:08:18.728Z+ sleep 1
8472024-04-03T10:08:19.714Z+ retry=4
8482024-04-03T10:08:19.738Z+ zoneadm list
8492024-04-03T10:08:19.738Z+ grep nexus
8502024-04-03T10:08:19.738Z+ [[ 4 -gt 300 ]]
8512024-04-03T10:08:19.738Z+ sleep 1
8522024-04-03T10:08:20.724Z+ retry=5
8532024-04-03T10:08:20.748Z+ zoneadm list
8542024-04-03T10:08:20.748Z+ grep nexus
8552024-04-03T10:08:20.748Z+ [[ 5 -gt 300 ]]
8562024-04-03T10:08:20.748Z+ sleep 1
8572024-04-03T10:08:21.737Z+ retry=6
8582024-04-03T10:08:21.761Z+ zoneadm list
8592024-04-03T10:08:21.761Z+ grep nexus
8602024-04-03T10:08:21.762Z+ [[ 6 -gt 300 ]]
8612024-04-03T10:08:21.762Z+ sleep 1
8622024-04-03T10:08:22.773Z+ retry=7
8632024-04-03T10:08:22.800Z+ zoneadm list
8642024-04-03T10:08:22.800Z+ grep nexus
8652024-04-03T10:08:22.801Z+ [[ 7 -gt 300 ]]
8662024-04-03T10:08:22.801Z+ sleep 1
8672024-04-03T10:08:23.767Z+ retry=8
8682024-04-03T10:08:23.793Z+ zoneadm list
8692024-04-03T10:08:23.793Z+ grep nexus
8702024-04-03T10:08:23.793Z+ [[ 8 -gt 300 ]]
8712024-04-03T10:08:23.793Z+ sleep 1
8722024-04-03T10:08:24.782Z+ retry=9
8732024-04-03T10:08:24.843Z+ zoneadm list
8742024-04-03T10:08:24.843Z+ grep nexus
8752024-04-03T10:08:24.843Z+ [[ 9 -gt 300 ]]
8762024-04-03T10:08:24.843Z+ sleep 1
8772024-04-03T10:08:25.879Z+ retry=10
8782024-04-03T10:08:25.907Z+ zoneadm list
8792024-04-03T10:08:25.907Z+ grep nexus
8802024-04-03T10:08:25.933Z+ [[ 10 -gt 300 ]]
8812024-04-03T10:08:25.933Z+ sleep 1
8822024-04-03T10:08:26.951Z+ retry=11
8832024-04-03T10:08:26.988Z+ zoneadm list
8842024-04-03T10:08:27.021Z+ grep nexus
8852024-04-03T10:08:27.060Z+ [[ 11 -gt 300 ]]
8862024-04-03T10:08:27.060Z+ sleep 1
8872024-04-03T10:08:28.070Z+ retry=12
8882024-04-03T10:08:28.097Z+ zoneadm list
8892024-04-03T10:08:28.097Z+ grep nexus
8902024-04-03T10:08:28.097Z+ [[ 12 -gt 300 ]]
8912024-04-03T10:08:28.097Z+ sleep 1
8922024-04-03T10:08:29.086Z+ retry=13
8932024-04-03T10:08:29.111Z+ zoneadm list
8942024-04-03T10:08:29.111Z+ grep nexus
8952024-04-03T10:08:29.111Z+ [[ 13 -gt 300 ]]
8962024-04-03T10:08:29.111Z+ sleep 1
8972024-04-03T10:08:30.101Z+ retry=14
8982024-04-03T10:08:30.125Z+ zoneadm list
8992024-04-03T10:08:30.126Z+ grep nexus
9002024-04-03T10:08:30.126Z+ [[ 14 -gt 300 ]]
9012024-04-03T10:08:30.126Z+ sleep 1
9022024-04-03T10:08:31.118Z+ retry=15
9032024-04-03T10:08:31.143Z+ zoneadm list
9042024-04-03T10:08:31.143Z+ grep nexus
9052024-04-03T10:08:31.143Z+ [[ 15 -gt 300 ]]
9062024-04-03T10:08:31.143Z+ sleep 1
9072024-04-03T10:08:32.133Z+ retry=16
9082024-04-03T10:08:32.158Z+ zoneadm list
9092024-04-03T10:08:32.158Z+ grep nexus
9102024-04-03T10:08:32.158Z+ [[ 16 -gt 300 ]]
9112024-04-03T10:08:32.158Z+ sleep 1
9122024-04-03T10:08:33.147Z+ retry=17
9132024-04-03T10:08:33.171Z+ zoneadm list
9142024-04-03T10:08:33.171Z+ grep nexus
9152024-04-03T10:08:33.171Z+ [[ 17 -gt 300 ]]
9162024-04-03T10:08:33.172Z+ sleep 1
9172024-04-03T10:08:34.162Z+ retry=18
9182024-04-03T10:08:34.187Z+ zoneadm list
9192024-04-03T10:08:34.187Z+ grep nexus
9202024-04-03T10:08:34.187Z+ [[ 18 -gt 300 ]]
9212024-04-03T10:08:34.187Z+ sleep 1
9222024-04-03T10:08:35.179Z+ retry=19
9232024-04-03T10:08:35.204Z+ zoneadm list
9242024-04-03T10:08:35.204Z+ grep nexus
9252024-04-03T10:08:35.204Z+ [[ 19 -gt 300 ]]
9262024-04-03T10:08:35.204Z+ sleep 1
9272024-04-03T10:08:36.197Z+ retry=20
9282024-04-03T10:08:36.223Z+ zoneadm list
9292024-04-03T10:08:36.223Z+ grep nexus
9302024-04-03T10:08:36.223Z+ [[ 20 -gt 300 ]]
9312024-04-03T10:08:36.223Z+ sleep 1
9322024-04-03T10:08:37.221Z+ retry=21
9332024-04-03T10:08:37.221Z+ zoneadm list
9342024-04-03T10:08:37.246Z+ grep nexus
9352024-04-03T10:08:37.246Z+ [[ 21 -gt 300 ]]
9362024-04-03T10:08:37.246Z+ sleep 1
9372024-04-03T10:08:38.255Z+ retry=22
9382024-04-03T10:08:42.864Z+ zoneadm list
9392024-04-03T10:08:42.889Z+ grep nexus
9402024-04-03T10:08:42.889Z+ [[ 22 -gt 300 ]]
9412024-04-03T10:08:42.889Z+ sleep 1
9422024-04-03T10:08:43.899Z+ retry=23
9432024-04-03T10:08:43.924Z+ zoneadm list
9442024-04-03T10:08:43.925Z+ grep nexus
9452024-04-03T10:08:43.925Z+ [[ 23 -gt 300 ]]
9462024-04-03T10:08:43.925Z+ sleep 1
9472024-04-03T10:08:44.922Z+ retry=24
9482024-04-03T10:08:44.922Z+ zoneadm list
9492024-04-03T10:08:44.947Z+ grep nexus
9502024-04-03T10:08:44.947Z+ [[ 24 -gt 300 ]]
9512024-04-03T10:08:44.948Z+ sleep 1
9522024-04-03T10:08:45.939Z+ retry=25
9532024-04-03T10:08:45.964Z+ zoneadm list
9542024-04-03T10:08:45.964Z+ grep nexus
9552024-04-03T10:08:45.964Z+ [[ 25 -gt 300 ]]
9562024-04-03T10:08:45.964Z+ sleep 1
9572024-04-03T10:08:46.957Z+ retry=26
9582024-04-03T10:08:46.982Z+ zoneadm list
9592024-04-03T10:08:46.982Z+ grep nexus
9602024-04-03T10:08:46.982Z+ [[ 26 -gt 300 ]]
9612024-04-03T10:08:46.982Z+ sleep 1
9622024-04-03T10:08:47.974Z+ retry=27
9632024-04-03T10:08:47.998Z+ zoneadm list
9642024-04-03T10:08:47.998Z+ grep nexus
9652024-04-03T10:08:47.999Z+ [[ 27 -gt 300 ]]
9662024-04-03T10:08:47.999Z+ sleep 1
9672024-04-03T10:08:48.986Z+ retry=28
9682024-04-03T10:08:49.010Z+ zoneadm list
9692024-04-03T10:08:49.010Z+ grep nexus
9702024-04-03T10:08:49.010Z+ [[ 28 -gt 300 ]]
9712024-04-03T10:08:49.010Z+ sleep 1
9722024-04-03T10:08:50.796Z+ retry=29
9732024-04-03T10:08:50.824Z+ zoneadm list
9742024-04-03T10:08:50.824Z+ grep nexus
9752024-04-03T10:08:50.824Z+ [[ 29 -gt 300 ]]
9762024-04-03T10:08:50.824Z+ sleep 1
9772024-04-03T10:08:51.061Z+ retry=30
9782024-04-03T10:08:51.061Z+ zoneadm list
9792024-04-03T10:08:51.061Z+ grep nexus
9802024-04-03T10:08:51.061Z+ [[ 30 -gt 300 ]]
9812024-04-03T10:08:51.061Z+ sleep 1
9822024-04-03T10:08:52.019Z+ retry=31
9832024-04-03T10:08:52.045Z+ zoneadm list
9842024-04-03T10:08:52.045Z+ grep nexus
9852024-04-03T10:08:52.045Z+ [[ 31 -gt 300 ]]
9862024-04-03T10:08:52.045Z+ sleep 1
9872024-04-03T10:08:53.031Z+ retry=32
9882024-04-03T10:08:53.067Z+ zoneadm list
9892024-04-03T10:08:53.067Z+ grep nexus
9902024-04-03T10:08:53.067Z+ [[ 32 -gt 300 ]]
9912024-04-03T10:08:53.067Z+ sleep 1
9922024-04-03T10:08:54.050Z+ retry=33
9932024-04-03T10:08:54.075Z+ zoneadm list
9942024-04-03T10:08:54.075Z+ grep nexus
9952024-04-03T10:08:54.075Z+ [[ 33 -gt 300 ]]
9962024-04-03T10:08:54.075Z+ sleep 1
9972024-04-03T10:08:55.053Z+ retry=34
9982024-04-03T10:08:55.077Z+ zoneadm list
9992024-04-03T10:08:55.077Z+ grep nexus
10002024-04-03T10:08:55.077Z+ [[ 34 -gt 300 ]]
10012024-04-03T10:08:55.077Z+ sleep 1
10022024-04-03T10:08:56.065Z+ retry=35
10032024-04-03T10:08:56.089Z+ zoneadm list
10042024-04-03T10:08:56.089Z+ grep nexus
10052024-04-03T10:08:56.089Z+ [[ 35 -gt 300 ]]
10062024-04-03T10:08:56.089Z+ sleep 1
10072024-04-03T10:08:57.077Z+ retry=36
10082024-04-03T10:08:57.101Z+ zoneadm list
10092024-04-03T10:08:57.101Z+ grep nexus
10102024-04-03T10:08:57.101Z+ [[ 36 -gt 300 ]]
10112024-04-03T10:08:57.101Z+ sleep 1
10122024-04-03T10:08:58.088Z+ retry=37
10132024-04-03T10:08:58.112Z+ zoneadm list
10142024-04-03T10:08:58.112Z+ grep nexus
10152024-04-03T10:08:58.112Z+ [[ 37 -gt 300 ]]
10162024-04-03T10:08:58.112Z+ sleep 1
10172024-04-03T10:08:59.100Z+ retry=38
10182024-04-03T10:08:59.124Z+ zoneadm list
10192024-04-03T10:08:59.124Z+ grep nexus
10202024-04-03T10:08:59.124Z+ [[ 38 -gt 300 ]]
10212024-04-03T10:08:59.124Z+ sleep 1
10222024-04-03T10:09:00.113Z+ retry=39
10232024-04-03T10:09:00.137Z+ zoneadm list
10242024-04-03T10:09:00.137Z+ grep nexus
10252024-04-03T10:09:00.137Z+ [[ 39 -gt 300 ]]
10262024-04-03T10:09:00.137Z+ sleep 1
10272024-04-03T10:09:01.124Z+ retry=40
10282024-04-03T10:09:01.148Z+ zoneadm list
10292024-04-03T10:09:01.148Z+ grep nexus
10302024-04-03T10:09:01.148Z+ [[ 40 -gt 300 ]]
10312024-04-03T10:09:01.148Z+ sleep 1
10322024-04-03T10:09:02.137Z+ retry=41
10332024-04-03T10:09:02.162Z+ zoneadm list
10342024-04-03T10:09:02.162Z+ grep nexus
10352024-04-03T10:09:02.162Z+ [[ 41 -gt 300 ]]
10362024-04-03T10:09:02.162Z+ sleep 1
10372024-04-03T10:09:03.146Z+ retry=42
10382024-04-03T10:09:03.171Z+ zoneadm list
10392024-04-03T10:09:03.171Z+ grep nexus
10402024-04-03T10:09:03.171Z+ [[ 42 -gt 300 ]]
10412024-04-03T10:09:03.171Z+ sleep 1
10422024-04-03T10:09:04.160Z+ retry=43
10432024-04-03T10:09:04.185Z+ zoneadm list
10442024-04-03T10:09:04.185Z+ grep nexus
10452024-04-03T10:09:04.185Z+ [[ 43 -gt 300 ]]
10462024-04-03T10:09:04.185Z+ sleep 1
10472024-04-03T10:09:05.169Z+ retry=44
10482024-04-03T10:09:05.198Z+ zoneadm list
10492024-04-03T10:09:05.198Z+ grep nexus
10502024-04-03T10:09:05.198Z+ [[ 44 -gt 300 ]]
10512024-04-03T10:09:05.198Z+ sleep 1
10522024-04-03T10:09:06.181Z+ retry=45
10532024-04-03T10:09:06.206Z+ zoneadm list
10542024-04-03T10:09:06.207Z+ grep nexus
10552024-04-03T10:09:06.207Z+ [[ 45 -gt 300 ]]
10562024-04-03T10:09:06.207Z+ sleep 1
10572024-04-03T10:09:07.193Z+ retry=46
10582024-04-03T10:09:07.217Z+ zoneadm list
10592024-04-03T10:09:07.217Z+ grep nexus
10602024-04-03T10:09:07.217Z+ [[ 46 -gt 300 ]]
10612024-04-03T10:09:07.217Z+ sleep 1
10622024-04-03T10:09:08.204Z+ retry=47
10632024-04-03T10:09:08.228Z+ zoneadm list
10642024-04-03T10:09:08.228Z+ grep nexus
10652024-04-03T10:09:08.228Z+ [[ 47 -gt 300 ]]
10662024-04-03T10:09:08.228Z+ sleep 1
10672024-04-03T10:09:09.215Z+ retry=48
10682024-04-03T10:09:09.241Z+ zoneadm list
10692024-04-03T10:09:09.241Z+ grep nexus
10702024-04-03T10:09:09.241Z+ [[ 48 -gt 300 ]]
10712024-04-03T10:09:09.241Z+ sleep 1
10722024-04-03T10:09:10.227Z+ retry=49
10732024-04-03T10:09:10.251Z+ zoneadm list
10742024-04-03T10:09:10.251Z+ grep nexus
10752024-04-03T10:09:10.251Z+ [[ 49 -gt 300 ]]
10762024-04-03T10:09:10.251Z+ sleep 1
10772024-04-03T10:09:11.246Z+ retry=50
10782024-04-03T10:09:11.271Z+ zoneadm list
10792024-04-03T10:09:11.271Z+ grep nexus
10802024-04-03T10:09:11.271Z+ [[ 50 -gt 300 ]]
10812024-04-03T10:09:11.271Z+ sleep 1
10822024-04-03T10:09:12.260Z+ retry=51
10832024-04-03T10:09:12.285Z+ zoneadm list
10842024-04-03T10:09:12.285Z+ grep nexus
10852024-04-03T10:09:12.285Z+ [[ 51 -gt 300 ]]
10862024-04-03T10:09:12.285Z+ sleep 1
10872024-04-03T10:09:13.291Z+ retry=52
10882024-04-03T10:09:13.323Z+ zoneadm list
10892024-04-03T10:09:13.324Z+ grep nexus
10902024-04-03T10:09:13.324Z+ [[ 52 -gt 300 ]]
10912024-04-03T10:09:13.324Z+ sleep 1
10922024-04-03T10:09:14.307Z+ retry=53
10932024-04-03T10:09:14.331Z+ zoneadm list
10942024-04-03T10:09:14.331Z+ grep nexus
10952024-04-03T10:09:14.331Z+ [[ 53 -gt 300 ]]
10962024-04-03T10:09:14.331Z+ sleep 1
10972024-04-03T10:09:15.323Z+ retry=54
10982024-04-03T10:09:22.689Z+ grep nexus
10992024-04-03T10:09:22.689Z+ zoneadm list
11002024-04-03T10:09:22.689Z+ [[ 54 -gt 300 ]]
11012024-04-03T10:09:22.689Z+ sleep 1
11022024-04-03T10:09:23.797Z+ retry=55
11032024-04-03T10:09:23.828Z+ zoneadm list
11042024-04-03T10:09:23.828Z+ grep nexus
11052024-04-03T10:09:23.828Z+ [[ 55 -gt 300 ]]
11062024-04-03T10:09:23.828Z+ sleep 1
11072024-04-03T10:09:24.900Z+ retry=56
11082024-04-03T10:09:25.091Z+ zoneadm list
11092024-04-03T10:09:25.091Z+ grep nexus
11102024-04-03T10:09:25.091Z+ [[ 56 -gt 300 ]]
11112024-04-03T10:09:25.091Z+ sleep 1
11122024-04-03T10:09:25.910Z+ retry=57
11132024-04-03T10:09:25.934Z+ zoneadm list
11142024-04-03T10:09:25.934Z+ grep nexus
11152024-04-03T10:09:25.935Zoxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1
11162024-04-03T10:09:25.935Zoxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004
11172024-04-03T10:09:25.935Zoxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf
11182024-04-03T10:09:25.935Z+ echo 'Waited for nexus: 57s'
11192024-04-03T10:09:25.935ZWaited for nexus: 57s
11202024-04-03T10:09:25.935Z+ export RUST_BACKTRACE=1
11212024-04-03T10:09:25.935Z+ RUST_BACKTRACE=1
11222024-04-03T10:09:25.935Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
11232024-04-03T10:09:25.959Z++ ./tests/bootstrap
11242024-04-03T10:09:26.713ZUsing external DNS server at 10.151.1.164:53
11252024-04-03T10:09:26.759Z2024-04-03 10:09:26.745555662 UTC: attempting to log into API
11262024-04-03T10:09:41.834Z2024-04-03 10:09:41.819113353 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
11272024-04-03T10:09:42.834Z2024-04-03 10:09:42.821174199 UTC: attempting to log into API
 
11282024-04-03T10:09:47.751ZApr 3 10:09:47 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
11292024-04-03T10:09:48.327ZApr 3 10:09:47 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
11302024-04-03T10:09:49.021ZApr 3 10:09:48 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
11312024-04-03T10:09:49.326ZApr 3 10:09:48 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
11322024-04-03T10:09:49.360ZApr 3 10:09:48 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
 
11332024-04-03T10:09:57.872Z2024-04-03 10:09:57.859395226 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
11342024-04-03T10:09:58.873Z2024-04-03 10:09:58.860499114 UTC: attempting to log into API
11352024-04-03T10:10:13.907Z2024-04-03 10:10:13.894595086 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
11362024-04-03T10:10:14.908Z2024-04-03 10:10:14.895632432 UTC: attempting to log into API
11372024-04-03T10:10:29.940Z2024-04-03 10:10:29.927597896 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
11382024-04-03T10:10:30.941Z2024-04-03 10:10:30.928532170 UTC: attempting to log into API
11392024-04-03T10:10:31.912Z2024-04-03 10:10:31.898835545 UTC: login succeeded
11402024-04-03T10:10:31.949Zwaiting for nexus to come up...
11412024-04-03T10:10:32.018Zcreating IP pool... 10.151.1.175 - 10.151.1.227
11422024-04-03T10:10:32.225Zsetting up quotas...
11432024-04-03T10:10:32.277Zensuring datasets are ready...
11442024-04-03T10:10:34.305Zlet's roll.
11452024-04-03T10:10:34.329Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
11462024-04-03T10:10:34.329ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
11472024-04-03T10:10:34.329ZOXIDE_TOKEN=oxide-token-42f11d05f4cb0d12fdf1e86d549c2989c7273a9e'
11482024-04-03T10:10:34.329Z++ OXIDE_HOST=https://recovery.sys.oxide.test
11492024-04-03T10:10:34.329Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166
11502024-04-03T10:10:34.329Z++ OXIDE_TOKEN=oxide-token-42f11d05f4cb0d12fdf1e86d549c2989c7273a9e
11512024-04-03T10:10:34.329Z+ export OXIDE_HOST OXIDE_TOKEN
11522024-04-03T10:10:34.329Z+ retry=0
11532024-04-03T10:10:34.329Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11542024-04-03T10:10:34.354Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11552024-04-03T10:10:34.354Z+ [[ 0 -gt 60 ]]
11562024-04-03T10:10:34.354Z+ sleep 1
11572024-04-03T10:10:35.337Z+ retry=1
11582024-04-03T10:10:35.337Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11592024-04-03T10:10:35.369Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11602024-04-03T10:10:35.369Z+ [[ 1 -gt 60 ]]
11612024-04-03T10:10:35.369Z+ sleep 1
11622024-04-03T10:10:36.353Z+ retry=2
11632024-04-03T10:10:36.353Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11642024-04-03T10:10:36.377Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11652024-04-03T10:10:36.377Z+ [[ 2 -gt 60 ]]
11662024-04-03T10:10:36.377Z+ sleep 1
11672024-04-03T10:10:37.368Z+ retry=3
11682024-04-03T10:10:37.368Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11692024-04-03T10:10:37.393Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11702024-04-03T10:10:37.393Z+ [[ 3 -gt 60 ]]
11712024-04-03T10:10:37.393Z+ sleep 1
11722024-04-03T10:10:38.382Z+ retry=4
11732024-04-03T10:10:38.382Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11742024-04-03T10:10:38.410Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11752024-04-03T10:10:38.410Z+ [[ 4 -gt 60 ]]
11762024-04-03T10:10:38.410Z+ sleep 1
11772024-04-03T10:10:39.402Z+ retry=5
11782024-04-03T10:10:39.402Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11792024-04-03T10:10:39.431Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11802024-04-03T10:10:39.431Z+ [[ 5 -gt 60 ]]
11812024-04-03T10:10:39.431Z+ sleep 1
11822024-04-03T10:10:40.413Z+ retry=6
11832024-04-03T10:10:40.413Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11842024-04-03T10:10:40.437Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11852024-04-03T10:10:40.437Z+ [[ 6 -gt 60 ]]
11862024-04-03T10:10:40.438Z+ sleep 1
11872024-04-03T10:10:41.427Z+ retry=7
11882024-04-03T10:10:41.428Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11892024-04-03T10:10:41.457Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11902024-04-03T10:10:41.457Z+ [[ 7 -gt 60 ]]
11912024-04-03T10:10:41.457Z+ sleep 1
11922024-04-03T10:10:42.442Z+ retry=8
11932024-04-03T10:10:42.442Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11942024-04-03T10:10:42.466Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
11952024-04-03T10:10:42.466Z+ [[ 8 -gt 60 ]]
11962024-04-03T10:10:42.466Z+ sleep 1
11972024-04-03T10:10:43.462Z+ retry=9
11982024-04-03T10:10:43.462Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
11992024-04-03T10:10:43.487Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12002024-04-03T10:10:43.487Z+ [[ 9 -gt 60 ]]
12012024-04-03T10:10:43.487Z+ sleep 1
12022024-04-03T10:10:44.471Z+ retry=10
12032024-04-03T10:10:44.471Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12042024-04-03T10:10:44.495Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12052024-04-03T10:10:44.495Z+ [[ 10 -gt 60 ]]
12062024-04-03T10:10:44.496Z+ sleep 1
12072024-04-03T10:10:45.486Z+ retry=11
12082024-04-03T10:10:45.486Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12092024-04-03T10:10:45.511Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12102024-04-03T10:10:45.511Z+ [[ 11 -gt 60 ]]
12112024-04-03T10:10:45.511Z+ sleep 1
12122024-04-03T10:10:46.502Z+ retry=12
12132024-04-03T10:10:46.502Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12142024-04-03T10:10:46.537Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12152024-04-03T10:10:46.537Z+ [[ 12 -gt 60 ]]
12162024-04-03T10:10:46.537Z+ sleep 1
12172024-04-03T10:10:47.517Z+ retry=13
12182024-04-03T10:10:47.517Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12192024-04-03T10:10:47.541Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12202024-04-03T10:10:47.541Z+ [[ 13 -gt 60 ]]
12212024-04-03T10:10:47.541Z+ sleep 1
12222024-04-03T10:10:48.532Z+ retry=14
12232024-04-03T10:10:48.532Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12242024-04-03T10:10:48.556Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12252024-04-03T10:10:48.556Z+ [[ 14 -gt 60 ]]
12262024-04-03T10:10:48.556Z+ sleep 1
12272024-04-03T10:10:49.559Z+ retry=15
12282024-04-03T10:10:49.559Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12292024-04-03T10:10:49.609Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12302024-04-03T10:10:49.610Z+ [[ 15 -gt 60 ]]
12312024-04-03T10:10:49.610Z+ sleep 1
12322024-04-03T10:10:50.572Z+ retry=16
12332024-04-03T10:10:50.572Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12342024-04-03T10:10:50.599Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12352024-04-03T10:10:50.599Z+ [[ 16 -gt 60 ]]
12362024-04-03T10:10:50.599Z+ sleep 1
12372024-04-03T10:10:51.582Z+ retry=17
12382024-04-03T10:10:51.582Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12392024-04-03T10:10:51.606Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12402024-04-03T10:10:51.606Z+ [[ 17 -gt 60 ]]
12412024-04-03T10:10:51.606Z+ sleep 1
12422024-04-03T10:10:52.591Z+ retry=18
12432024-04-03T10:10:52.591Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12442024-04-03T10:10:52.616Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12452024-04-03T10:10:52.616Z+ [[ 18 -gt 60 ]]
12462024-04-03T10:10:52.616Z+ sleep 1
12472024-04-03T10:10:53.606Z+ retry=19
12482024-04-03T10:10:53.607Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12492024-04-03T10:10:53.631Zcurl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server
12502024-04-03T10:10:53.631Z+ [[ 19 -gt 60 ]]
12512024-04-03T10:10:53.631Z+ sleep 1
12522024-04-03T10:10:54.629Z+ retry=20
12532024-04-03T10:10:54.629Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
12542024-04-03T10:10:54.707Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
12552024-04-03T10:10:55.079Z{"status":"ok"}success
12562024-04-03T10:10:55.080ZProject {
12572024-04-03T10:10:55.104Z description: "some images",
12582024-04-03T10:10:55.104Z id: 3af1895c-0994-401f-87da-65c7c8c263e7,
12592024-04-03T10:10:55.104Z name: Name(
12602024-04-03T10:10:55.104Z "images",
12612024-04-03T10:10:55.104Z ),
12622024-04-03T10:10:55.104Z time_created: 2024-04-03T10:10:54.830622Z,
12632024-04-03T10:10:55.104Z time_modified: 2024-04-03T10:10:54.830622Z,
12642024-04-03T10:10:55.104Z}
12652024-04-03T10:10:55.104Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
12662024-04-03T10:16:07.899Zdone!
12672024-04-03T10:16:08.000Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
12682024-04-03T10:16:08.103Zsuccess
12692024-04-03T10:16:08.103ZImage {
12702024-04-03T10:16:08.128Z block_size: ByteCount(
12712024-04-03T10:16:08.128Z 512,
12722024-04-03T10:16:08.129Z ),
12732024-04-03T10:16:08.129Z description: "debian 11 original base image",
12742024-04-03T10:16:08.129Z digest: None,
12752024-04-03T10:16:08.129Z id: b1d3fbc8-986b-41c1-8e03-50629651eef7,
12762024-04-03T10:16:08.129Z name: Name(
12772024-04-03T10:16:08.129Z "debian11",
12782024-04-03T10:16:08.129Z ),
12792024-04-03T10:16:08.129Z os: "debian",
12802024-04-03T10:16:08.129Z project_id: None,
12812024-04-03T10:16:08.129Z size: ByteCount(
12822024-04-03T10:16:08.129Z 2147483648,
12832024-04-03T10:16:08.129Z ),
12842024-04-03T10:16:08.129Z time_created: 2024-04-03T10:16:07.859315Z,
12852024-04-03T10:16:08.129Z time_modified: 2024-04-03T10:16:08.083276Z,
12862024-04-03T10:16:08.129Z url: None,
12872024-04-03T10:16:08.129Z version: "11",
12882024-04-03T10:16:08.129Z}
12892024-04-03T10:16:08.129Z+ rm ./tests/bootstrap
12902024-04-03T10:16:08.189Z+ for test_bin in tests/*
12912024-04-03T10:16:08.189Z+ ./tests/bootstrap-28a51422b533788d
12922024-04-03T10:16:08.213Z
12932024-04-03T10:16:08.214Zrunning 0 tests
12942024-04-03T10:16:08.214Z
12952024-04-03T10:16:08.241Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
12962024-04-03T10:16:08.241Z
12972024-04-03T10:16:08.241Z+ for test_bin in tests/*
12982024-04-03T10:16:08.241Z+ ./tests/commtest-0e6379a48de6d126
12992024-04-03T10:16:08.273Z
13002024-04-03T10:16:08.274Zrunning 0 tests
13012024-04-03T10:16:08.274Z
13022024-04-03T10:16:08.302Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13032024-04-03T10:16:08.302Z
13042024-04-03T10:16:08.302Z+ for test_bin in tests/*
13052024-04-03T10:16:08.302Z+ ./tests/dhcp_server-3228f4e88b82b7eb
13062024-04-03T10:16:08.327Z
13072024-04-03T10:16:08.327Zrunning 0 tests
13082024-04-03T10:16:08.327Z
13092024-04-03T10:16:08.327Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
13102024-04-03T10:16:08.327Z
13112024-04-03T10:16:08.328Z+ for test_bin in tests/*
13122024-04-03T10:16:08.328Z+ ./tests/end_to_end_tests-2972fd47be91e6e5
13132024-04-03T10:16:08.517Z
13142024-04-03T10:16:08.517Zrunning 2 tests
13152024-04-03T10:16:08.771Ztest no_spoof::no_spoof_here ... ok
13162024-04-03T10:16:34.617Ztest instance_launch::instance_launch ... ok
13172024-04-03T10:16:34.617Z
13182024-04-03T10:16:34.617Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 26.10s
13192024-04-03T10:16:34.617Z
13202024-04-03T10:16:34.643Z+ _exit_trap
13212024-04-03T10:16:34.643Z+ local status=0
13222024-04-03T10:16:34.643Z+ [[ 0 -eq 0 ]]
13232024-04-03T10:16:34.643Z+ exit 0
13242024-04-03T10:16:34.643Zprocess exited: duration 589522 ms, exit code 0
 
13252024-04-03T10:16:34.761Zfound 187 output files
13262024-04-03T10:16:34.761Zuploading: /var/svc/log/oxide-sled-agent:default.log (741542 bytes)
13272024-04-03T10:16:36.966Zuploaded: /var/svc/log/oxide-sled-agent:default.log
13282024-04-03T10:16:36.967Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (441386 bytes)
13292024-04-03T10:16:37.250Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 441386 -> 451850
13302024-04-03T10:16:38.321Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
13312024-04-03T10:16:38.350Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (1901952 bytes)
13322024-04-03T10:16:40.985Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0
13332024-04-03T10:16:40.985Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (0 bytes)
13342024-04-03T10:16:42.478Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
13352024-04-03T10:16:42.478Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0 (52291 bytes)
13362024-04-03T10:16:43.727Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log.0
13372024-04-03T10:16:43.727Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (37510 bytes)
13382024-04-03T10:16:43.872Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 37510 -> 41102
13392024-04-03T10:16:44.981Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
13402024-04-03T10:16:44.981Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (170987 bytes)
13412024-04-03T10:16:46.231Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0
13422024-04-03T10:16:46.232Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (47915 bytes)
13432024-04-03T10:16:46.867Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 47915 -> 52698
13442024-04-03T10:16:49.197Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
13452024-04-03T10:16:49.197Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (203126 bytes)
13462024-04-03T10:16:50.548Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0
13472024-04-03T10:16:50.548Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (210413 bytes)
13482024-04-03T10:16:50.924Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 210413 -> 243945
13492024-04-03T10:16:52.007Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
13502024-04-03T10:16:52.007Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (1009011 bytes)
13512024-04-03T10:16:53.925Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0
13522024-04-03T10:16:53.925Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (121846 bytes)
13532024-04-03T10:16:54.268Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 121846 -> 146762
13542024-04-03T10:16:55.351Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
13552024-04-03T10:16:55.376Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (559593 bytes)
13562024-04-03T10:16:57.663Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0
13572024-04-03T10:16:57.689Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes)
13582024-04-03T10:16:58.738Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
13592024-04-03T10:16:58.738Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes)
13602024-04-03T10:17:00.251Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0
13612024-04-03T10:17:00.251Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (46833 bytes)
13622024-04-03T10:17:00.947Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 46833 -> 59425
13632024-04-03T10:17:02.022Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
13642024-04-03T10:17:02.022Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (200370 bytes)
13652024-04-03T10:17:03.488Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0
13662024-04-03T10:17:03.513Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (1755 bytes)
13672024-04-03T10:17:03.537Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log" changed size mid upload: 1755 -> 2340
13682024-04-03T10:17:04.619Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
13692024-04-03T10:17:04.646Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (6018 bytes)
13702024-04-03T10:17:05.731Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0
13712024-04-03T10:17:05.731Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes)
13722024-04-03T10:17:06.803Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
13732024-04-03T10:17:06.804Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5759 bytes)
13742024-04-03T10:17:07.902Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0
13752024-04-03T10:17:07.902Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-agent:default.log (25808 bytes)
13762024-04-03T10:17:14.866Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-agent:default.log
13772024-04-03T10:17:14.866Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-agent:default.log.0 (7259 bytes)
13782024-04-03T10:17:16.062Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-agent:default.log.0
13792024-04-03T10:17:16.062Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
13802024-04-03T10:17:17.108Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:default.log
13812024-04-03T10:17:17.132Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
13822024-04-03T10:17:18.201Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:default.log.0
13832024-04-03T10:17:18.201Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:downstairs-372e2d8f-5ec7-4d90-bd44-23eb4eca50e3.log (5592 bytes)
13842024-04-03T10:17:19.307Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:downstairs-372e2d8f-5ec7-4d90-bd44-23eb4eca50e3.log
13852024-04-03T10:17:19.335Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:downstairs-9b67fd67-8350-4ac3-a707-6bf58a378f3f.log (1091 bytes)
13862024-04-03T10:17:20.435Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:downstairs-9b67fd67-8350-4ac3-a707-6bf58a378f3f.log
13872024-04-03T10:17:20.435Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:downstairs-9b67fd67-8350-4ac3-a707-6bf58a378f3f.log.0 (4600 bytes)
13882024-04-03T10:17:21.539Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:downstairs-9b67fd67-8350-4ac3-a707-6bf58a378f3f.log.0
13892024-04-03T10:17:21.539Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:snapshot-9b67fd67-8350-4ac3-a707-6bf58a378f3f-8ba53ba0-cb4a-4089-94d0-f37b23833df0.log (5286 bytes)
13902024-04-03T10:17:22.639Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-crucible-downstairs:snapshot-9b67fd67-8350-4ac3-a707-6bf58a378f3f-8ba53ba0-cb4a-4089-94d0-f37b23833df0.log
13912024-04-03T10:17:22.639Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
13922024-04-03T10:17:23.709Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-zone-network-setup:default.log
13932024-04-03T10:17:23.709Zuploading: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1703 bytes)
13942024-04-03T10:17:24.812Zuploaded: /pool/ext/2e47e008-76df-41d9-b268-da990559f786/crypt/zone/oxz_crucible_c0d8975f-0e34-474b-a84c-10dd693605b9/root/var/svc/log/oxide-zone-network-setup:default.log.0
13952024-04-03T10:17:24.812Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-clickhouse:default.log (402413 bytes)
13962024-04-03T10:17:25.603Zupload warning: file "/pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 402413 -> 614623
13972024-04-03T10:17:26.677Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-clickhouse:default.log
13982024-04-03T10:17:26.677Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-clickhouse:default.log.0 (1512059 bytes)
13992024-04-03T10:17:29.514Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-clickhouse:default.log.0
14002024-04-03T10:17:29.514Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14012024-04-03T10:17:30.585Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-zone-network-setup:default.log
14022024-04-03T10:17:30.585Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1712 bytes)
14032024-04-03T10:17:31.685Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_clickhouse_498d9e47-b1b3-4a91-a9ab-1b36877185b9/root/var/svc/log/oxide-zone-network-setup:default.log.0
14042024-04-03T10:17:31.685Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
14052024-04-03T10:17:33.799Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656/root/var/svc/log/oxide-cockroachdb:default.log
14062024-04-03T10:17:33.825Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
14072024-04-03T10:17:34.894Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656/root/var/svc/log/oxide-cockroachdb:default.log.0
14082024-04-03T10:17:34.920Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14092024-04-03T10:17:35.966Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656/root/var/svc/log/oxide-zone-network-setup:default.log
14102024-04-03T10:17:35.990Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
14112024-04-03T10:17:37.068Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_cockroachdb_11685285-c0ca-4aa1-9b75-f46dccb6d656/root/var/svc/log/oxide-zone-network-setup:default.log.0
14122024-04-03T10:17:37.109Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-agent:default.log (21807 bytes)
14132024-04-03T10:17:38.211Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-agent:default.log
14142024-04-03T10:17:38.243Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-agent:default.log.0 (1326 bytes)
14152024-04-03T10:17:39.313Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-agent:default.log.0
14162024-04-03T10:17:39.313Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14172024-04-03T10:17:40.413Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-downstairs:default.log
14182024-04-03T10:17:40.938Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14192024-04-03T10:17:41.520Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14202024-04-03T10:17:41.520Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53.log (3007 bytes)
14212024-04-03T10:17:43.035Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d03c54e-13a4-4bc4-be7c-3bcb55eb6f53.log
14222024-04-03T10:17:43.036Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-downstairs:downstairs-f59bb156-316d-4a97-8a92-c121ac2870dc.log (5592 bytes)
14232024-04-03T10:17:44.161Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-crucible-downstairs:downstairs-f59bb156-316d-4a97-8a92-c121ac2870dc.log
14242024-04-03T10:17:44.188Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14252024-04-03T10:17:45.241Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-zone-network-setup:default.log
14262024-04-03T10:17:45.241Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
14272024-04-03T10:17:46.355Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_crucible_e53f8ac5-d09d-406d-9a03-3edf1a9aecce/root/var/svc/log/oxide-zone-network-setup:default.log.0
14282024-04-03T10:17:46.355Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-external_dns:default.log (3777 bytes)
14292024-04-03T10:17:46.402Zupload warning: file "/pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 3777 -> 7550
14302024-04-03T10:17:47.473Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-external_dns:default.log
14312024-04-03T10:17:47.473Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-external_dns:default.log.0 (23091 bytes)
14322024-04-03T10:17:48.623Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-external_dns:default.log.0
14332024-04-03T10:17:48.623Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
14342024-04-03T10:17:49.700Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-opte-interface-setup:default.log
14352024-04-03T10:17:49.700Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1188 bytes)
14362024-04-03T10:17:50.816Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-opte-interface-setup:default.log.0
14372024-04-03T10:17:50.816Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14382024-04-03T10:17:51.891Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-zone-network-setup:default.log
14392024-04-03T10:17:51.891Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1726 bytes)
14402024-04-03T10:17:53.015Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_external_dns_2fbdcbcd-ff1b-4375-856b-f7f3530b0e63/root/var/svc/log/oxide-zone-network-setup:default.log.0
14412024-04-03T10:17:53.015Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-internal_dns:default.log (3755 bytes)
14422024-04-03T10:17:53.551Zupload warning: file "/pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 3755 -> 7508
14432024-04-03T10:17:54.632Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-internal_dns:default.log
14442024-04-03T10:17:54.632Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-internal_dns:default.log.0 (107867 bytes)
14452024-04-03T10:17:55.837Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-internal_dns:default.log.0
14462024-04-03T10:17:55.837Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14472024-04-03T10:17:56.912Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-zone-network-setup:default.log
14482024-04-03T10:17:56.912Zuploading: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
14492024-04-03T10:17:58.017Zuploaded: /pool/ext/36614205-9374-49cf-8904-cb3f4aa78846/crypt/zone/oxz_internal_dns_0e04e52c-490d-4b79-9cc6-e5adae4e5501/root/var/svc/log/oxide-zone-network-setup:default.log.0
14502024-04-03T10:17:58.064Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
14512024-04-03T10:17:59.540Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21/root/var/svc/log/oxide-cockroachdb:default.log
14522024-04-03T10:17:59.565Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
14532024-04-03T10:18:00.635Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21/root/var/svc/log/oxide-cockroachdb:default.log.0
14542024-04-03T10:18:00.660Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14552024-04-03T10:18:01.715Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21/root/var/svc/log/oxide-zone-network-setup:default.log
14562024-04-03T10:18:01.715Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
14572024-04-03T10:18:02.819Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_cockroachdb_ebd15857-ca2c-4b36-b21c-496bb0330c21/root/var/svc/log/oxide-zone-network-setup:default.log.0
14582024-04-03T10:18:02.819Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-agent:default.log (10253 bytes)
14592024-04-03T10:18:03.954Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-agent:default.log
14602024-04-03T10:18:03.955Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-agent:default.log.0 (1326 bytes)
14612024-04-03T10:18:05.049Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-agent:default.log.0
14622024-04-03T10:18:05.049Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
14632024-04-03T10:18:06.136Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-downstairs:default.log
14642024-04-03T10:18:06.136Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
14652024-04-03T10:18:07.239Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-downstairs:default.log.0
14662024-04-03T10:18:07.239Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-downstairs:downstairs-7862bdab-9347-4201-b3d7-e752bbd52e35.log (5593 bytes)
14672024-04-03T10:18:08.376Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-crucible-downstairs:downstairs-7862bdab-9347-4201-b3d7-e752bbd52e35.log
14682024-04-03T10:18:08.376Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14692024-04-03T10:18:09.444Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-zone-network-setup:default.log
14702024-04-03T10:18:09.444Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
14712024-04-03T10:18:10.545Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_397924c0-2b87-42bd-adce-1a37f31bd063/root/var/svc/log/oxide-zone-network-setup:default.log.0
14722024-04-03T10:18:10.575Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
14732024-04-03T10:18:11.618Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0/root/var/svc/log/oxide-crucible-pantry:default.log
14742024-04-03T10:18:11.619Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0/root/var/svc/log/oxide-crucible-pantry:default.log.0 (781 bytes)
14752024-04-03T10:18:12.718Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0/root/var/svc/log/oxide-crucible-pantry:default.log.0
14762024-04-03T10:18:12.718Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14772024-04-03T10:18:14.195Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0/root/var/svc/log/oxide-zone-network-setup:default.log
14782024-04-03T10:18:14.195Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1746 bytes)
14792024-04-03T10:18:15.300Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_crucible_pantry_e26e39ef-02c9-4887-939e-4ec196eb3ce0/root/var/svc/log/oxide-zone-network-setup:default.log.0
14802024-04-03T10:18:15.300Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-nexus:default.log (570954 bytes)
14812024-04-03T10:18:17.073Zupload warning: file "/pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 570954 -> 1100354
14822024-04-03T10:18:18.145Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-nexus:default.log
14832024-04-03T10:18:18.186Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-nexus:default.log.0 (3145939 bytes)
14842024-04-03T10:18:21.729Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-nexus:default.log.0
14852024-04-03T10:18:21.729Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
14862024-04-03T10:18:22.810Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-opte-interface-setup:default.log
14872024-04-03T10:18:22.810Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1167 bytes)
14882024-04-03T10:18:23.908Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-opte-interface-setup:default.log.0
14892024-04-03T10:18:23.908Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14902024-04-03T10:18:24.987Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-zone-network-setup:default.log
14912024-04-03T10:18:24.988Zuploading: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1682 bytes)
14922024-04-03T10:18:26.081Zuploaded: /pool/ext/4533d42a-5c24-4d2c-8caa-2a74a63c16c3/crypt/zone/oxz_nexus_adc64792-b7f1-4498-a95d-8e860b5867bf/root/var/svc/log/oxide-zone-network-setup:default.log.0
14932024-04-03T10:18:26.081Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
14942024-04-03T10:18:27.153Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8/root/var/svc/log/oxide-cockroachdb:default.log
14952024-04-03T10:18:27.179Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8/root/var/svc/log/oxide-cockroachdb:default.log.0 (4380 bytes)
14962024-04-03T10:18:28.753Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8/root/var/svc/log/oxide-cockroachdb:default.log.0
14972024-04-03T10:18:28.753Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
14982024-04-03T10:18:29.827Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8/root/var/svc/log/oxide-zone-network-setup:default.log
14992024-04-03T10:18:29.827Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
15002024-04-03T10:18:30.933Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_cockroachdb_0a4a83f7-d6ae-4102-9eac-7ae6b9522ff8/root/var/svc/log/oxide-zone-network-setup:default.log.0
15012024-04-03T10:18:30.933Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
15022024-04-03T10:18:32.012Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-crucible-agent:default.log
15032024-04-03T10:18:32.012Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
15042024-04-03T10:18:33.107Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-crucible-agent:default.log.0
15052024-04-03T10:18:33.131Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
15062024-04-03T10:18:34.189Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-crucible-downstairs:default.log
15072024-04-03T10:18:34.189Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
15082024-04-03T10:18:35.287Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-crucible-downstairs:default.log.0
15092024-04-03T10:18:35.287Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15102024-04-03T10:18:36.363Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-zone-network-setup:default.log
15112024-04-03T10:18:36.363Zuploading: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1702 bytes)
15122024-04-03T10:18:37.459Zuploaded: /pool/ext/474bd740-7e4d-443a-9485-0c3e8b3716ec/crypt/zone/oxz_crucible_df36c634-5f4d-4fe1-987c-2dbd6a1ad52a/root/var/svc/log/oxide-zone-network-setup:default.log.0
15132024-04-03T10:18:37.506Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
15142024-04-03T10:18:38.550Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64/root/var/svc/log/oxide-cockroachdb:default.log
15152024-04-03T10:18:38.550Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes)
15162024-04-03T10:18:39.669Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64/root/var/svc/log/oxide-cockroachdb:default.log.0
15172024-04-03T10:18:39.669Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15182024-04-03T10:18:40.743Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64/root/var/svc/log/oxide-zone-network-setup:default.log
15192024-04-03T10:18:40.767Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes)
15202024-04-03T10:18:41.848Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_cockroachdb_d57be767-d5bf-4ae1-a63a-e2d6e438bf64/root/var/svc/log/oxide-zone-network-setup:default.log.0
15212024-04-03T10:18:41.848Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-agent:default.log (13684 bytes)
15222024-04-03T10:18:42.988Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-agent:default.log
15232024-04-03T10:18:42.989Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-agent:default.log.0 (17502 bytes)
15242024-04-03T10:18:44.141Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-agent:default.log.0
15252024-04-03T10:18:44.169Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
15262024-04-03T10:18:45.212Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:default.log
15272024-04-03T10:18:45.238Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
15282024-04-03T10:18:46.312Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:default.log.0
15292024-04-03T10:18:46.312Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-84efd15b-29b6-4c72-b4b4-23cf1865242d.log (3008 bytes)
15302024-04-03T10:18:47.403Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-84efd15b-29b6-4c72-b4b4-23cf1865242d.log
15312024-04-03T10:18:47.403Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-bdd73775-8068-4988-83cf-2f005c4e16e1.log (0 bytes)
15322024-04-03T10:18:48.473Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-bdd73775-8068-4988-83cf-2f005c4e16e1.log
15332024-04-03T10:18:48.473Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-bdd73775-8068-4988-83cf-2f005c4e16e1.log.0 (3126 bytes)
15342024-04-03T10:18:49.567Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-bdd73775-8068-4988-83cf-2f005c4e16e1.log.0
15352024-04-03T10:18:49.567Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-df1b7f84-1f6b-4855-a38e-403a76a91cdf.log (1090 bytes)
15362024-04-03T10:18:50.679Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-df1b7f84-1f6b-4855-a38e-403a76a91cdf.log
15372024-04-03T10:18:50.679Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-df1b7f84-1f6b-4855-a38e-403a76a91cdf.log.0 (4604 bytes)
15382024-04-03T10:18:51.775Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:downstairs-df1b7f84-1f6b-4855-a38e-403a76a91cdf.log.0
15392024-04-03T10:18:51.775Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:snapshot-df1b7f84-1f6b-4855-a38e-403a76a91cdf-8ba53ba0-cb4a-4089-94d0-f37b23833df0.log (5283 bytes)
15402024-04-03T10:18:52.876Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-crucible-downstairs:snapshot-df1b7f84-1f6b-4855-a38e-403a76a91cdf-8ba53ba0-cb4a-4089-94d0-f37b23833df0.log
15412024-04-03T10:18:52.876Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15422024-04-03T10:18:53.969Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-zone-network-setup:default.log
15432024-04-03T10:18:53.969Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
15442024-04-03T10:18:55.064Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_crucible_c4d3bf20-ae50-40b6-af25-d9a472abc430/root/var/svc/log/oxide-zone-network-setup:default.log.0
15452024-04-03T10:18:55.064Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-internal_dns:default.log (3756 bytes)
15462024-04-03T10:18:55.157Zupload warning: file "/pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 3756 -> 15017
15472024-04-03T10:18:56.239Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-internal_dns:default.log
15482024-04-03T10:18:56.239Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-internal_dns:default.log.0 (107868 bytes)
15492024-04-03T10:18:57.606Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-internal_dns:default.log.0
15502024-04-03T10:18:57.606Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15512024-04-03T10:18:58.677Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-zone-network-setup:default.log
15522024-04-03T10:18:58.703Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes)
15532024-04-03T10:18:59.781Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_internal_dns_586c70fe-6c95-438f-be65-3daafd7be41b/root/var/svc/log/oxide-zone-network-setup:default.log.0
15542024-04-03T10:18:59.782Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-nexus:default.log (285957 bytes)
15552024-04-03T10:19:01.378Zupload warning: file "/pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 285957 -> 811979
15562024-04-03T10:19:03.498Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-nexus:default.log
15572024-04-03T10:19:03.498Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-nexus:default.log.0 (1518889 bytes)
15582024-04-03T10:19:06.946Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-nexus:default.log.0
15592024-04-03T10:19:06.947Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
15602024-04-03T10:19:08.017Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-opte-interface-setup:default.log
15612024-04-03T10:19:08.017Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1167 bytes)
15622024-04-03T10:19:09.114Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-opte-interface-setup:default.log.0
15632024-04-03T10:19:09.114Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15642024-04-03T10:19:10.187Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-zone-network-setup:default.log
15652024-04-03T10:19:10.187Zuploading: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1683 bytes)
15662024-04-03T10:19:11.283Zuploaded: /pool/ext/5735529a-b898-4275-88a6-00a9444d8997/crypt/zone/oxz_nexus_e35963e6-a05d-4aaa-a3e2-d78509c59004/root/var/svc/log/oxide-zone-network-setup:default.log.0
15672024-04-03T10:19:11.283Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-agent:default.log (7757 bytes)
15682024-04-03T10:19:12.387Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-agent:default.log
15692024-04-03T10:19:12.412Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-agent:default.log.0 (17504 bytes)
15702024-04-03T10:19:13.532Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-agent:default.log.0
15712024-04-03T10:19:13.532Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
15722024-04-03T10:19:14.608Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:default.log
15732024-04-03T10:19:14.637Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
15742024-04-03T10:19:15.703Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:default.log.0
15752024-04-03T10:19:15.703Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:downstairs-141660de-7ef1-4018-be2f-3a3c01faac1a.log (0 bytes)
15762024-04-03T10:19:16.777Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:downstairs-141660de-7ef1-4018-be2f-3a3c01faac1a.log
15772024-04-03T10:19:16.777Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:downstairs-141660de-7ef1-4018-be2f-3a3c01faac1a.log.0 (3125 bytes)
15782024-04-03T10:19:17.872Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:downstairs-141660de-7ef1-4018-be2f-3a3c01faac1a.log.0
15792024-04-03T10:19:17.872Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:downstairs-eafdd8dd-11e7-485f-9292-848016ea93f0.log (1091 bytes)
15802024-04-03T10:19:18.971Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:downstairs-eafdd8dd-11e7-485f-9292-848016ea93f0.log
15812024-04-03T10:19:18.971Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:downstairs-eafdd8dd-11e7-485f-9292-848016ea93f0.log.0 (4603 bytes)
15822024-04-03T10:19:20.066Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:downstairs-eafdd8dd-11e7-485f-9292-848016ea93f0.log.0
15832024-04-03T10:19:20.066Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:snapshot-eafdd8dd-11e7-485f-9292-848016ea93f0-8ba53ba0-cb4a-4089-94d0-f37b23833df0.log (5284 bytes)
15842024-04-03T10:19:21.170Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-crucible-downstairs:snapshot-eafdd8dd-11e7-485f-9292-848016ea93f0-8ba53ba0-cb4a-4089-94d0-f37b23833df0.log
15852024-04-03T10:19:21.170Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15862024-04-03T10:19:22.242Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-zone-network-setup:default.log
15872024-04-03T10:19:22.242Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
15882024-04-03T10:19:23.337Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_ddcb991a-c8a0-472d-a34d-1dcd46abb727/root/var/svc/log/oxide-zone-network-setup:default.log.0
15892024-04-03T10:19:23.337Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes)
15902024-04-03T10:19:24.427Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555/root/var/svc/log/oxide-crucible-pantry:default.log
15912024-04-03T10:19:24.428Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555/root/var/svc/log/oxide-crucible-pantry:default.log.0 (783 bytes)
15922024-04-03T10:19:25.929Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555/root/var/svc/log/oxide-crucible-pantry:default.log.0
15932024-04-03T10:19:25.929Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
15942024-04-03T10:19:26.999Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555/root/var/svc/log/oxide-zone-network-setup:default.log
15952024-04-03T10:19:26.999Zuploading: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1746 bytes)
15962024-04-03T10:19:28.093Zuploaded: /pool/ext/5df238e3-5630-4184-a188-36117b1a7b7b/crypt/zone/oxz_crucible_pantry_80bb8934-38d8-48bc-aa7e-eea4a490a555/root/var/svc/log/oxide-zone-network-setup:default.log.0
15972024-04-03T10:19:28.093Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes)
15982024-04-03T10:19:29.164Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab/root/var/svc/log/oxide-cockroachdb:default.log
15992024-04-03T10:19:29.164Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab/root/var/svc/log/oxide-cockroachdb:default.log.0 (4405 bytes)
16002024-04-03T10:19:30.261Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab/root/var/svc/log/oxide-cockroachdb:default.log.0
16012024-04-03T10:19:30.261Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16022024-04-03T10:19:31.342Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab/root/var/svc/log/oxide-zone-network-setup:default.log
16032024-04-03T10:19:31.342Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes)
16042024-04-03T10:19:32.443Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_cockroachdb_ea8792b7-14fc-4019-98d6-831452c676ab/root/var/svc/log/oxide-zone-network-setup:default.log.0
16052024-04-03T10:19:32.443Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-agent:default.log (6355 bytes)
16062024-04-03T10:19:33.554Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-agent:default.log
16072024-04-03T10:19:33.554Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-agent:default.log.0 (12038 bytes)
16082024-04-03T10:19:34.676Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-agent:default.log.0
16092024-04-03T10:19:34.676Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
16102024-04-03T10:19:35.762Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:default.log
16112024-04-03T10:19:35.762Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
16122024-04-03T10:19:36.860Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:default.log.0
16132024-04-03T10:19:36.860Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:downstairs-35a96369-51f0-4634-b29f-a031f74565b4.log (3006 bytes)
16142024-04-03T10:19:37.977Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:downstairs-35a96369-51f0-4634-b29f-a031f74565b4.log
16152024-04-03T10:19:37.977Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:downstairs-9d8ae67d-fcb6-4034-8d3c-fb2ef9a6ef25.log (0 bytes)
16162024-04-03T10:19:39.048Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:downstairs-9d8ae67d-fcb6-4034-8d3c-fb2ef9a6ef25.log
16172024-04-03T10:19:39.048Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:downstairs-9d8ae67d-fcb6-4034-8d3c-fb2ef9a6ef25.log.0 (3126 bytes)
16182024-04-03T10:19:40.143Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-crucible-downstairs:downstairs-9d8ae67d-fcb6-4034-8d3c-fb2ef9a6ef25.log.0
16192024-04-03T10:19:40.143Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16202024-04-03T10:19:41.212Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-zone-network-setup:default.log
16212024-04-03T10:19:41.212Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1702 bytes)
16222024-04-03T10:19:42.340Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_crucible_f8615f1a-8ae7-4cc1-96a8-b7e86d5a6767/root/var/svc/log/oxide-zone-network-setup:default.log.0
16232024-04-03T10:19:42.340Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-external_dns:default.log (3779 bytes)
16242024-04-03T10:19:42.410Zupload warning: file "/pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 3779 -> 15107
16252024-04-03T10:19:43.491Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-external_dns:default.log
16262024-04-03T10:19:43.491Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-external_dns:default.log.0 (23086 bytes)
16272024-04-03T10:19:45.047Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-external_dns:default.log.0
16282024-04-03T10:19:45.047Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
16292024-04-03T10:19:45.722Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-opte-interface-setup:default.log
16302024-04-03T10:19:45.746Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1188 bytes)
16312024-04-03T10:19:46.817Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-opte-interface-setup:default.log.0
16322024-04-03T10:19:46.817Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16332024-04-03T10:19:47.890Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-zone-network-setup:default.log
16342024-04-03T10:19:47.917Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1723 bytes)
16352024-04-03T10:19:48.988Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_external_dns_ad48337a-add3-4214-9d0f-f8db41e43622/root/var/svc/log/oxide-zone-network-setup:default.log.0
16362024-04-03T10:19:48.988Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-internal_dns:default.log (8793 bytes)
16372024-04-03T10:19:49.102Zupload warning: file "/pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 8793 -> 20057
16382024-04-03T10:19:50.174Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-internal_dns:default.log
16392024-04-03T10:19:50.198Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-internal_dns:default.log.0 (104051 bytes)
16402024-04-03T10:19:51.542Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-internal_dns:default.log.0
16412024-04-03T10:19:51.542Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16422024-04-03T10:19:52.613Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-zone-network-setup:default.log
16432024-04-03T10:19:52.613Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1708 bytes)
16442024-04-03T10:19:53.713Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_internal_dns_c60e57f5-2712-45fb-af0b-bc0ff46e083c/root/var/svc/log/oxide-zone-network-setup:default.log.0
16452024-04-03T10:19:53.739Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-ntp:default.log (0 bytes)
16462024-04-03T10:19:54.788Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-ntp:default.log
16472024-04-03T10:19:54.788Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-ntp:default.log.0 (774 bytes)
16482024-04-03T10:19:57.324Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-ntp:default.log.0
16492024-04-03T10:19:57.324Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
16502024-04-03T10:19:57.991Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-opte-interface-setup:default.log
16512024-04-03T10:19:58.015Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1158 bytes)
16522024-04-03T10:19:59.089Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-opte-interface-setup:default.log.0
16532024-04-03T10:19:59.089Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16542024-04-03T10:20:00.161Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-zone-network-setup:default.log
16552024-04-03T10:20:00.185Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1665 bytes)
16562024-04-03T10:20:01.257Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/svc/log/oxide-zone-network-setup:default.log.0
16572024-04-03T10:20:01.257Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
16582024-04-03T10:20:02.330Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-crucible-agent:default.log
16592024-04-03T10:20:02.330Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
16602024-04-03T10:20:03.429Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-crucible-agent:default.log.0
16612024-04-03T10:20:03.429Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
16622024-04-03T10:20:04.509Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-crucible-downstairs:default.log
16632024-04-03T10:20:04.509Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
16642024-04-03T10:20:05.613Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-crucible-downstairs:default.log.0
16652024-04-03T10:20:05.613Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16662024-04-03T10:20:06.698Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-zone-network-setup:default.log
16672024-04-03T10:20:06.698Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1704 bytes)
16682024-04-03T10:20:07.794Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_crucible_da41d7a4-e925-4040-b523-178b3850bd7c/root/var/svc/log/oxide-zone-network-setup:default.log.0
16692024-04-03T10:20:07.794Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-nexus:default.log (8326436 bytes)
16702024-04-03T10:20:14.325Zupload warning: file "/pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 8326436 -> 9111236
16712024-04-03T10:20:15.398Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-nexus:default.log
16722024-04-03T10:20:15.398Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-nexus:default.log.0 (26893718 bytes)
16732024-04-03T10:20:31.347Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-nexus:default.log.0
16742024-04-03T10:20:31.347Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-opte-interface-setup:default.log (0 bytes)
16752024-04-03T10:20:32.419Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-opte-interface-setup:default.log
16762024-04-03T10:20:32.420Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-opte-interface-setup:default.log.0 (1167 bytes)
16772024-04-03T10:20:33.519Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-opte-interface-setup:default.log.0
16782024-04-03T10:20:33.544Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16792024-04-03T10:20:34.590Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-zone-network-setup:default.log
16802024-04-03T10:20:34.590Zuploading: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1683 bytes)
16812024-04-03T10:20:35.685Zuploaded: /pool/ext/a0234d98-6d13-4518-a6ed-6616f80ec892/crypt/zone/oxz_nexus_c0f8db76-0c38-4867-b869-53c2384889d1/root/var/svc/log/oxide-zone-network-setup:default.log.0
16822024-04-03T10:20:35.685Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes)
16832024-04-03T10:20:36.756Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-crucible-agent:default.log
16842024-04-03T10:20:36.756Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-crucible-agent:default.log.0 (1327 bytes)
16852024-04-03T10:20:37.853Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-crucible-agent:default.log.0
16862024-04-03T10:20:37.880Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes)
16872024-04-03T10:20:38.925Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-crucible-downstairs:default.log
16882024-04-03T10:20:38.925Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes)
16892024-04-03T10:20:40.021Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-crucible-downstairs:default.log.0
16902024-04-03T10:20:40.022Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16912024-04-03T10:20:41.093Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-zone-network-setup:default.log
16922024-04-03T10:20:41.093Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1703 bytes)
16932024-04-03T10:20:42.197Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_a530ec6b-c8ab-4990-a9b9-f6bb7be02742/root/var/svc/log/oxide-zone-network-setup:default.log.0
16942024-04-03T10:20:42.197Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d/root/var/svc/log/oxide-crucible-pantry:default.log (245832 bytes)
16952024-04-03T10:20:44.223Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d/root/var/svc/log/oxide-crucible-pantry:default.log
16962024-04-03T10:20:44.224Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d/root/var/svc/log/oxide-crucible-pantry:default.log.0 (977826 bytes)
16972024-04-03T10:20:46.397Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d/root/var/svc/log/oxide-crucible-pantry:default.log.0
16982024-04-03T10:20:46.398Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
16992024-04-03T10:20:55.159Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d/root/var/svc/log/oxide-zone-network-setup:default.log
17002024-04-03T10:20:55.159Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1740 bytes)
17012024-04-03T10:20:56.397Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_crucible_pantry_61c01227-a384-41a8-bc59-455062631a0d/root/var/svc/log/oxide-zone-network-setup:default.log.0
17022024-04-03T10:20:56.397Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-oximeter:default.log (380015 bytes)
17032024-04-03T10:20:58.735Zupload warning: file "/pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 380015 -> 1453308
17042024-04-03T10:20:59.829Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-oximeter:default.log
17052024-04-03T10:20:59.829Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-oximeter:default.log.0 (1269215 bytes)
17062024-04-03T10:21:03.065Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-oximeter:default.log.0
17072024-04-03T10:21:03.100Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes)
17082024-04-03T10:21:03.769Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-zone-network-setup:default.log
17092024-04-03T10:21:03.770Zuploading: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1701 bytes)
17102024-04-03T10:21:05.358Zuploaded: /pool/ext/f14b76c3-7994-4bb4-962a-4f772a3dd8b9/crypt/zone/oxz_oximeter_eff9cae2-d3de-4f90-b501-6553b5ad9c11/root/var/svc/log/oxide-zone-network-setup:default.log.0
17112024-04-03T10:21:05.359Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/measurements.log (12741 bytes)
17122024-04-03T10:21:05.897Zupload warning: file "/pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/measurements.log" changed size mid upload: 12741 -> 18906
17132024-04-03T10:21:07.432Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/measurements.log
17142024-04-03T10:21:07.432Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/statistics.log (6903 bytes)
17152024-04-03T10:21:07.541Zupload warning: file "/pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/statistics.log" changed size mid upload: 6903 -> 11349
17162024-04-03T10:21:08.615Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/statistics.log
17172024-04-03T10:21:08.615Zuploading: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/tracking.log (1717 bytes)
17182024-04-03T10:21:09.098Zupload warning: file "/pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/tracking.log" changed size mid upload: 1717 -> 2245
17192024-04-03T10:21:10.187Zuploaded: /pool/ext/6b96699f-97d9-48d8-b1c0-05be5951e087/crypt/zone/oxz_ntp_54c5d8c0-1ab1-438b-8fc8-cf20c5890176/root/var/log/chrony/tracking.log