01HRTWGX7JAHBM2HAC2SB2SRRS: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.28",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HRTWK7AD23VQCC2JV7XETP7C

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12024-03-13T03:51:35.819Zjob dependencies complete; ready to run (waiting for 41 m 46 s)
22024-03-13T04:30:28.846Zjob assigned to worker 01HRV14YVE2ZSKW6HAQCQTCYWZ (queued for 38 m 53 s)
32024-03-13T04:30:29.089Zhttp://172.20.0.5:9969/ipxe/sock... ok
42024-03-13T04:30:29.776Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52024-03-13T04:30:29.839Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62024-03-13T04:30:29.884Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72024-03-13T04:30:29.930Zhttp://172.20.0.5:9969/postboot/sock... ok
82024-03-13T04:30:29.993ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92024-03-13T04:30:30.457Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
102024-03-13T04:30:30.507ZOxide Helios Version helios-2.0.22550 64-bit
112024-03-13T04:30:30.549ZConfiguring devices.
122024-03-13T04:30:30.601Z##################################################
132024-03-13T04:30:30.649Z#### ############# ##
142024-03-13T04:30:31.100Z### ### ############ ##
152024-03-13T04:30:31.562Z## ### # ## ### ## Oxide Computer Company ##
162024-03-13T04:30:31.610Z## ## ## ### # ### ##
172024-03-13T04:30:31.661Z## # ### #### #### This Station Under ##
182024-03-13T04:30:31.708Z### ### #### # ### Computer Control ##
192024-03-13T04:30:31.769Z#### #### ### ## ##
202024-03-13T04:30:31.822Z##################################################
212024-03-13T04:30:31.866ZHostname: sock
222024-03-13T04:30:31.911ZLoading smf(7) service descriptions:
232024-03-13T04:30:33.172Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-a3be395245e6bd94.gz
242024-03-13T04:30:38.650Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-a3be395245e6bd94.gz
252024-03-13T04:30:38.684Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
262024-03-13T04:31:39.392Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
272024-03-13T04:31:39.392Zdownloading input: /input/ci-tools/work/end-to-end-tests/commtest-ef47fb3f0eb26d6a.gz
282024-03-13T04:31:42.101Zdownloaded input: /input/ci-tools/work/end-to-end-tests/commtest-ef47fb3f0eb26d6a.gz
292024-03-13T04:31:42.101Zdownloading input: /input/ci-tools/work/end-to-end-tests/dhcp_server-ce54f5d7753d595c.gz
302024-03-13T04:31:47.410Zdownloaded input: /input/ci-tools/work/end-to-end-tests/dhcp_server-ce54f5d7753d595c.gz
312024-03-13T04:31:47.410Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2f0c448a5875b5d7.gz
322024-03-13T04:32:07.527Zsock console login: Error: No response to keepalive - Terminating session
332024-03-13T04:32:17.494ZError: No response de-activating SOL payload
342024-03-13T04:32:18.890Z[SOL Session operational. Use ~? for help]
352024-03-13T04:32:42.954Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2f0c448a5875b5d7.gz
362024-03-13T04:32:42.999Zdownloading input: /input/ci-tools/work/caboose-util.gz
372024-03-13T04:32:43.835Zdownloaded input: /input/ci-tools/work/caboose-util.gz
382024-03-13T04:32:43.835Zdownloading input: /input/ci-tools/work/tufaceous.gz
392024-03-13T04:32:48.834Zdownloaded input: /input/ci-tools/work/tufaceous.gz
402024-03-13T04:32:48.875Zdownloading input: /input/ci-tools/work/commtest
412024-03-13T04:35:07.658ZError: No response to keepalive - Terminating session
422024-03-13T04:35:17.637ZError: No response de-activating SOL payload
432024-03-13T04:35:18.766Z[SOL Session operational. Use ~? for help]
442024-03-13T04:36:58.801Zdownloaded input: /input/ci-tools/work/commtest
452024-03-13T04:36:58.836Zdownloading input: /input/package/work/version.txt
462024-03-13T04:36:58.889Zdownloaded input: /input/package/work/version.txt
472024-03-13T04:36:58.928Zdownloading input: /input/package/work/package.tar.gz
482024-03-13T04:37:50.041Zdownloaded input: /input/package/work/package.tar.gz
492024-03-13T04:37:50.042Zdownloading input: /input/package/work/global-zone-packages.tar.gz
502024-03-13T04:38:07.332ZError: No response to keepalive - Terminating session
512024-03-13T04:38:17.572ZError: No response de-activating SOL payload
522024-03-13T04:38:18.955Z[SOL Session operational. Use ~? for help]
532024-03-13T04:38:40.272Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
542024-03-13T04:38:40.297Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
552024-03-13T04:38:49.613Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
562024-03-13T04:38:49.648Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
572024-03-13T04:39:46.504Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
582024-03-13T04:39:46.504Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
592024-03-13T04:40:40.894Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
602024-03-13T04:40:40.937Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
612024-03-13T04:41:23.505ZError: No response to keepalive - Terminating session
622024-03-13T04:41:26.857Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
632024-03-13T04:41:26.858Zdownloading input: /input/package/work/zones/crucible-pantry-zone.tar.gz
642024-03-13T04:41:33.456ZError: No response de-activating SOL payload
652024-03-13T04:41:34.837Z[SOL Session operational. Use ~? for help]
662024-03-13T04:41:34.954Zdownloaded input: /input/package/work/zones/crucible-pantry-zone.tar.gz
672024-03-13T04:41:34.979Zdownloading input: /input/package/work/zones/crucible-zone.tar.gz
682024-03-13T04:41:45.867Zdownloaded input: /input/package/work/zones/crucible-zone.tar.gz
692024-03-13T04:41:45.867Zdownloading input: /input/package/work/zones/external-dns.tar.gz
702024-03-13T04:42:00.803Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
712024-03-13T04:42:00.869Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
722024-03-13T04:42:18.875Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
732024-03-13T04:42:18.902Zdownloading input: /input/package/work/zones/nexus-single-sled.tar.gz
742024-03-13T04:42:54.136Zdownloaded input: /input/package/work/zones/nexus-single-sled.tar.gz
752024-03-13T04:42:54.136Zdownloading input: /input/package/work/zones/nexus.tar.gz
762024-03-13T04:43:21.366Zdownloaded input: /input/package/work/zones/nexus.tar.gz
772024-03-13T04:43:21.399Zdownloading input: /input/package/work/zones/ntp.tar.gz
782024-03-13T04:43:24.815Zdownloaded input: /input/package/work/zones/ntp.tar.gz
792024-03-13T04:43:24.815Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
802024-03-13T04:43:34.232Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
812024-03-13T04:43:34.232Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
822024-03-13T04:43:46.789Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
832024-03-13T04:43:46.820Zdownloading input: /input/package/work/zones/overlay.tar.gz
842024-03-13T04:43:46.879Zdownloaded input: /input/package/work/zones/overlay.tar.gz
852024-03-13T04:43:46.905Zdownloading input: /input/package/work/zones/oximeter.tar.gz
862024-03-13T04:44:02.680Zdownloaded input: /input/package/work/zones/oximeter.tar.gz
872024-03-13T04:44:02.712Zdownloading input: /input/package/work/zones/probe.tar.gz
882024-03-13T04:44:03.687Zdownloaded input: /input/package/work/zones/probe.tar.gz
892024-03-13T04:44:03.858Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
902024-03-13T04:44:23.479ZError: No response to keepalive - Terminating session
912024-03-13T04:44:28.109Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
922024-03-13T04:44:28.109Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
932024-03-13T04:44:33.745ZError: No response de-activating SOL payload
942024-03-13T04:44:34.888Z[SOL Session operational. Use ~? for help]
952024-03-13T04:46:03.441Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
962024-03-13T04:46:03.469Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
972024-03-13T04:46:54.258Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
982024-03-13T04:46:54.354Zstarting task 0: "setup"
992024-03-13T04:46:54.354Z++ uname -s
1002024-03-13T04:46:54.354Z+ kern=SunOS
1012024-03-13T04:46:54.354Z+ case "$kern" in
1022024-03-13T04:46:54.354Z+ groupadd -g 12345 build
1032024-03-13T04:46:54.354Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
1042024-03-13T04:46:56.224Z+ zfs create -o mountpoint=/work rpool/work
1052024-03-13T04:46:56.278Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
1062024-03-13T04:46:56.278Z+ home_fs=zfs
1072024-03-13T04:46:56.278Z+ [[ zfs == autofs ]]
1082024-03-13T04:46:56.278Z+ mkdir -p /home/build
1092024-03-13T04:46:56.278Z+ chown build:build /home/build /work
1102024-03-13T04:46:58.259Z+ chmod 0700 /home/build /work
1112024-03-13T04:46:58.341Zprocess exited: duration 4057 ms, exit code 0
 
1122024-03-13T04:46:58.500Zstarting task 1: "authentication"
1132024-03-13T04:46:58.593Zprocess exited: duration 93 ms, exit code 0
 
1142024-03-13T04:46:58.725Zstarting task 2: "build"
1152024-03-13T04:46:58.860Z+ trap _exit_trap EXIT
1162024-03-13T04:46:58.860Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
1172024-03-13T04:46:58.938Zsecpolicy_fs_linkdir: 0x55 = 0x55
1182024-03-13T04:46:58.938Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
1192024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
1202024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1212024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1222024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+5: 0 = 0x1
1232024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1242024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1252024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1262024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1272024-03-13T04:46:58.939Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1282024-03-13T04:46:58.939Z+ [[ -d /opt/oxide ]]
1292024-03-13T04:46:58.939Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1302024-03-13T04:46:58.939Z+ pfexec mkdir /opt/oxide
1312024-03-13T04:46:58.939Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1322024-03-13T04:46:58.939Z+ [[ -d /opt/oxide-underneath ]]
1332024-03-13T04:46:58.939Z+ cd /opt/oxide-underneath
1342024-03-13T04:46:58.939Z+ pfexec tar ceEp@/f - .
1352024-03-13T04:46:58.939Z+ cd /opt/oxide
1362024-03-13T04:46:58.939Z+ pfexec tar xveEp@/f -
1372024-03-13T04:46:59.063Zx ., 0 bytes, 0 tape blocks
1382024-03-13T04:46:59.063Zx ./opte, 0 bytes, 0 tape blocks
1392024-03-13T04:46:59.063Zx ./opte/bin, 0 bytes, 0 tape blocks
1402024-03-13T04:46:59.063Zx ./opte/bin/opteadm, 43221608 bytes, 84418 tape blocks
1412024-03-13T04:46:59.063Z+ pfexec rm -rf /opt/oxide-underneath
1422024-03-13T04:46:59.063Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1432024-03-13T04:46:59.064Z+ pfexec mkdir /opt/oxide/work
1442024-03-13T04:46:59.064Z+ pfexec chown build:build /opt/oxide/work
1452024-03-13T04:46:59.064Z+ cd /opt/oxide/work
1462024-03-13T04:46:59.064Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1472024-03-13T04:47:00.564ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1482024-03-13T04:47:00.564Zx out/mg-ddm-gz.tar, 67661824 bytes, 132152 tape blocks
1492024-03-13T04:47:00.564Zx out/omicron-sled-agent.tar, 110202368 bytes, 215239 tape blocks
1502024-03-13T04:47:00.564Zx out/oxlog.tar, 6245376 bytes, 12198 tape blocks
1512024-03-13T04:47:00.564Zx out/target/test, 75 bytes, 1 tape blocks
1522024-03-13T04:47:00.564Zx out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks
1532024-03-13T04:47:00.564Zx package-manifest.toml, 26496 bytes, 52 tape blocks
1542024-03-13T04:47:00.564Zx smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks
1552024-03-13T04:47:00.564Zx target/release/omicron-package, 39982240 bytes, 78091 tape blocks
1562024-03-13T04:47:00.564Zx tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks
1572024-03-13T04:47:00.564Zx tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks
1582024-03-13T04:47:00.564Zx tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks
1592024-03-13T04:47:00.564Zx tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks
1602024-03-13T04:47:00.565Zx tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks
1612024-03-13T04:47:00.565Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1622024-03-13T04:47:00.565Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1632024-03-13T04:47:00.711Z
1642024-03-13T04:47:00.711Zreal 1.581357245
1652024-03-13T04:47:00.711Zuser 1.420677829
1662024-03-13T04:47:00.711Zsys 0.279318811
1672024-03-13T04:47:00.711Ztrap 0.000064510
1682024-03-13T04:47:00.711Ztflt 0.000000000
1692024-03-13T04:47:00.712Zdflt 0.000000000
1702024-03-13T04:47:00.712Zkflt 0.000000000
1712024-03-13T04:47:00.712Zlock 0.000000000
1722024-03-13T04:47:00.712Zslp 1.424496400
1732024-03-13T04:47:00.712Zlat 0.035961122
1742024-03-13T04:47:00.713Zstop 0.000127670
1752024-03-13T04:47:00.713Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry-zone.tar.gz /input/package/work/zones/crucible-zone.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/nexus-single-sled.tar.gz /input/package/work/zones/nexus.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/probe.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1762024-03-13T04:47:01.851Z+ mv out/nexus-single-sled.tar.gz out/nexus.tar.gz
1772024-03-13T04:47:01.963Z+ mkdir tests
1782024-03-13T04:47:01.963Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1792024-03-13T04:47:01.963Z+ ptime -m gunzip
1802024-03-13T04:47:01.963Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-a3be395245e6bd94
1812024-03-13T04:47:02.076Z
1822024-03-13T04:47:02.294Zreal 0.206610963
1832024-03-13T04:47:02.295Zuser 0.192346726
1842024-03-13T04:47:02.295Zsys 0.013995633
1852024-03-13T04:47:02.295Ztrap 0.000023130
1862024-03-13T04:47:02.295Ztflt 0.000000000
1872024-03-13T04:47:02.295Zdflt 0.000000000
1882024-03-13T04:47:02.295Zkflt 0.000000000
1892024-03-13T04:47:02.295Zlock 0.000000000
1902024-03-13T04:47:02.296Zslp 0.000020260
1912024-03-13T04:47:02.296Zlat 0.000033170
1922024-03-13T04:47:02.296Zstop 0.000131851
1932024-03-13T04:47:02.296Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-a3be395245e6bd94
1942024-03-13T04:47:02.296Z+ chmod a+x tests/bootstrap-a3be395245e6bd94
1952024-03-13T04:47:02.296Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1962024-03-13T04:47:02.296Z+ ptime -m gunzip
1972024-03-13T04:47:02.296Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1982024-03-13T04:47:04.347Z
1992024-03-13T04:47:04.469Zreal 2.254406173
2002024-03-13T04:47:04.469Zuser 2.124015586
2012024-03-13T04:47:04.469Zsys 0.129949139
2022024-03-13T04:47:04.469Ztrap 0.000186913
2032024-03-13T04:47:04.469Ztflt 0.000000000
2042024-03-13T04:47:04.469Zdflt 0.000000000
2052024-03-13T04:47:04.469Zkflt 0.000000000
2062024-03-13T04:47:04.469Zlock 0.000000000
2072024-03-13T04:47:04.469Zslp 0.000023820
2082024-03-13T04:47:04.469Zlat 0.000038860
2092024-03-13T04:47:04.469Zstop 0.000129582
2102024-03-13T04:47:04.470Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
2112024-03-13T04:47:04.470Z+ chmod a+x tests/bootstrap
2122024-03-13T04:47:04.470Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2132024-03-13T04:47:04.470Z+ ptime -m gunzip
2142024-03-13T04:47:04.470Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-ef47fb3f0eb26d6a
2152024-03-13T04:47:04.696Z
2162024-03-13T04:47:04.696Zreal 0.205949493
2172024-03-13T04:47:04.696Zuser 0.189956033
2182024-03-13T04:47:04.697Zsys 0.015720704
2192024-03-13T04:47:04.697Ztrap 0.000020531
2202024-03-13T04:47:04.697Ztflt 0.000000000
2212024-03-13T04:47:04.697Zdflt 0.000000000
2222024-03-13T04:47:04.697Zkflt 0.000000000
2232024-03-13T04:47:04.697Zlock 0.000000000
2242024-03-13T04:47:04.697Zslp 0.000022240
2252024-03-13T04:47:04.697Zlat 0.000022690
2262024-03-13T04:47:04.697Zstop 0.000130281
2272024-03-13T04:47:04.697Z++ basename /input/ci-tools/work/end-to-end-tests/commtest-ef47fb3f0eb26d6a
2282024-03-13T04:47:04.697Z+ chmod a+x tests/commtest-ef47fb3f0eb26d6a
2292024-03-13T04:47:04.697Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2302024-03-13T04:47:04.697Z+ ptime -m gunzip
2312024-03-13T04:47:04.697Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-ce54f5d7753d595c
2322024-03-13T04:47:04.850Z
2332024-03-13T04:47:04.850Zreal 0.206241198
2342024-03-13T04:47:04.850Zuser 0.192516285
2352024-03-13T04:47:04.850Zsys 0.013463898
2362024-03-13T04:47:04.850Ztrap 0.000022039
2372024-03-13T04:47:04.850Ztflt 0.000000000
2382024-03-13T04:47:04.850Zdflt 0.000000000
2392024-03-13T04:47:04.850Zkflt 0.000000000
2402024-03-13T04:47:04.850Zlock 0.000000000
2412024-03-13T04:47:04.850Zslp 0.000024720
2422024-03-13T04:47:04.850Zlat 0.000027930
2432024-03-13T04:47:04.850Zstop 0.000127082
2442024-03-13T04:47:04.850Z++ basename /input/ci-tools/work/end-to-end-tests/dhcp_server-ce54f5d7753d595c
2452024-03-13T04:47:04.850Z+ chmod a+x tests/dhcp_server-ce54f5d7753d595c
2462024-03-13T04:47:04.851Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
2472024-03-13T04:47:04.851Z+ ptime -m gunzip
2482024-03-13T04:47:04.920Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2f0c448a5875b5d7
2492024-03-13T04:47:07.135Z
2502024-03-13T04:47:07.210Zreal 2.298782033
2512024-03-13T04:47:07.210Zuser 2.159993993
2522024-03-13T04:47:07.211Zsys 0.138366473
2532024-03-13T04:47:07.211Ztrap 0.000197781
2542024-03-13T04:47:07.211Ztflt 0.000000000
2552024-03-13T04:47:07.211Zdflt 0.000000000
2562024-03-13T04:47:07.211Zkflt 0.000000000
2572024-03-13T04:47:07.211Zlock 0.000000000
2582024-03-13T04:47:07.211Zslp 0.000016010
2592024-03-13T04:47:07.211Zlat 0.000032411
2602024-03-13T04:47:07.211Zstop 0.000125691
2612024-03-13T04:47:07.211Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-2f0c448a5875b5d7
2622024-03-13T04:47:07.211Z+ chmod a+x tests/end_to_end_tests-2f0c448a5875b5d7
2632024-03-13T04:47:07.211Z+ bmat address ls
2642024-03-13T04:47:07.211ZNAME CIDR FIRST LAST COUNT
2652024-03-13T04:47:07.211Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2662024-03-13T04:47:07.211Z++ bmat address ls -f extra -Ho first,last,count
2672024-03-13T04:47:07.212Z+ set -- 10.151.2.164 10.151.2.227 64
2682024-03-13T04:47:07.212Z+ EXTRA_IP_START=10.151.2.164
2692024-03-13T04:47:07.212Z+ EXTRA_IP_END=10.151.2.227
2702024-03-13T04:47:07.212Z+ EXTRA_IP_COUNT=64
2712024-03-13T04:47:07.212Z+ (( EXTRA_IP_COUNT >= 32 ))
2722024-03-13T04:47:07.212Z+ EXTRA_IP_BASE=10.151.2
2732024-03-13T04:47:07.212Z+ EXTRA_IP_FOCTET=164
2742024-03-13T04:47:07.212Z+ EXTRA_IP_LOCTET=227
2752024-03-13T04:47:07.212Z+ SERVICE_IP_POOL_START=10.151.2.164
2762024-03-13T04:47:07.212Z+ SERVICE_IP_POOL_END=10.151.2.173
2772024-03-13T04:47:07.212Z+ DNS_IP1=10.151.2.164
2782024-03-13T04:47:07.212Z+ DNS_IP2=10.151.2.165
2792024-03-13T04:47:07.212Z+ UPLINK_IP=10.151.2.174
2802024-03-13T04:47:07.213Z+ IPPOOL_START=10.151.2.175
2812024-03-13T04:47:07.213Z+ IPPOOL_END=10.151.2.227
2822024-03-13T04:47:07.213Z++ ipadm show-addr -po type,addr
2832024-03-13T04:47:07.213Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2842024-03-13T04:47:07.213Z+ GATEWAY_IP=10.151.2.100
2852024-03-13T04:47:07.213Z+ [[ -n 10.151.2.100 ]]
2862024-03-13T04:47:07.213Z+ ping -s 10.151.2.100 56 1
2872024-03-13T04:47:07.213ZPING 10.151.2.100: 56 data bytes
2882024-03-13T04:47:07.213Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
2892024-03-13T04:47:07.213Z
2902024-03-13T04:47:07.213Z----10.151.2.100 PING Statistics----
2912024-03-13T04:47:07.213Z1 packets transmitted, 1 packets received, 0% packet loss
2922024-03-13T04:47:07.213Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2932024-03-13T04:47:07.214Z++ arp -an
2942024-03-13T04:47:07.214Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2952024-03-13T04:47:07.214Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2962024-03-13T04:47:07.214Z+ routeadm -e ipv4-forwarding -u
2972024-03-13T04:47:07.341Z+ PXA_START=10.151.2.164
2982024-03-13T04:47:07.341Z+ PXA_END=10.151.2.227
2992024-03-13T04:47:07.341Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
3002024-03-13T04:47:07.341Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
3012024-03-13T04:47:07.478Z+ ZPOOL_VDEV_DIR=/scratch
3022024-03-13T04:47:07.478Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
3032024-03-13T04:47:07.478Z+++ dirname ./tools/create_virtual_hardware.sh
3042024-03-13T04:47:07.478Z++ cd ./tools
3052024-03-13T04:47:07.479Z++ pwd
3062024-03-13T04:47:07.479Z+ SOURCE_DIR=/opt/oxide/work/tools
3072024-03-13T04:47:07.479Z+ OMICRON_TOP=/opt/oxide/work/tools/..
3082024-03-13T04:47:07.479Z+ SOFTNPU_MODE=zone
3092024-03-13T04:47:07.479Z+ . /opt/oxide/work/tools/virtual_hardware.sh
3102024-03-13T04:47:07.479Z++ MARKER=/etc/opt/oxide/NO_INSTALL
3112024-03-13T04:47:07.479Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
3122024-03-13T04:47:07.479Z++ dladm show-phys -p -o LINK
3132024-03-13T04:47:07.479Z++ head -1
3142024-03-13T04:47:07.479Z+ PHYSICAL_LINK=igb0
3152024-03-13T04:47:07.479Z+ echo 'Using igb0 as physical link'
3162024-03-13T04:47:07.479ZUsing igb0 as physical link
3172024-03-13T04:47:07.479Z+ ensure_run_as_root
3182024-03-13T04:47:07.479Z++ id -u
3192024-03-13T04:47:07.710Z+ [[ 0 -ne 0 ]]
3202024-03-13T04:47:07.710Z+ ensure_zpools
3212024-03-13T04:47:07.710Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
3222024-03-13T04:47:07.710Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
3232024-03-13T04:47:07.710Z+ readarray -t ZPOOLS
3242024-03-13T04:47:07.710Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
3252024-03-13T04:47:07.711Z++ sed 's/[ ",]//g'
3262024-03-13T04:47:07.711Z+ for ZPOOL in "${ZPOOLS[@]}"
3272024-03-13T04:47:07.711Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
3282024-03-13T04:47:07.711ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
3292024-03-13T04:47:07.711Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3302024-03-13T04:47:07.711Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
3312024-03-13T04:47:07.711Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
3322024-03-13T04:47:07.712Z0+0 records in
3332024-03-13T04:47:07.712Z0+0 records out
3342024-03-13T04:47:07.712Z0 bytes (0 iB) transferred in 0.000006 secs (0 iB/sec)
3352024-03-13T04:47:07.712Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
3362024-03-13T04:47:07.712Z+ set +x
3372024-03-13T04:47:07.712ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
3382024-03-13T04:47:07.712Z++ zpool list -o name
3392024-03-13T04:47:07.712Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
3402024-03-13T04:47:07.712Z+ [[ -z '' ]]
3412024-03-13T04:47:07.712Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
3422024-03-13T04:47:07.712Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
3432024-03-13T04:47:07.712Z+ set +x
3442024-03-13T04:47:07.712ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3452024-03-13T04:47:07.713Z+ for ZPOOL in "${ZPOOLS[@]}"
3462024-03-13T04:47:07.713Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3472024-03-13T04:47:07.713ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3482024-03-13T04:47:07.713Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3492024-03-13T04:47:07.713Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3502024-03-13T04:47:07.713Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3512024-03-13T04:47:07.713Z0+0 records in
3522024-03-13T04:47:07.713Z0+0 records out
3532024-03-13T04:47:07.713Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3542024-03-13T04:47:07.714Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3552024-03-13T04:47:07.714Z+ set +x
3562024-03-13T04:47:07.714ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3572024-03-13T04:47:07.714Z++ zpool list -o name
3582024-03-13T04:47:07.714Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3592024-03-13T04:47:07.714Z+ [[ -z '' ]]
3602024-03-13T04:47:07.714Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3612024-03-13T04:47:07.715Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3622024-03-13T04:47:07.715Z+ set +x
3632024-03-13T04:47:07.715ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3642024-03-13T04:47:07.715Z+ for ZPOOL in "${ZPOOLS[@]}"
3652024-03-13T04:47:07.715ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
3662024-03-13T04:47:07.715Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3672024-03-13T04:47:07.715Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3682024-03-13T04:47:07.715Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3692024-03-13T04:47:07.715Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3702024-03-13T04:47:07.715Z0+0 records in
3712024-03-13T04:47:07.716Z0+0 records out
3722024-03-13T04:47:07.716Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3732024-03-13T04:47:07.716Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3742024-03-13T04:47:07.716Z+ set +x
3752024-03-13T04:47:07.716ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3762024-03-13T04:47:07.716Z++ zpool list -o name
3772024-03-13T04:47:07.716Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3782024-03-13T04:47:07.716Z+ [[ -z '' ]]
3792024-03-13T04:47:07.716Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3802024-03-13T04:47:07.716Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3812024-03-13T04:47:07.716Z+ set +x
3822024-03-13T04:47:07.716ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3832024-03-13T04:47:07.716Z+ for ZPOOL in "${ZPOOLS[@]}"
3842024-03-13T04:47:07.717Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3852024-03-13T04:47:07.717ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
3862024-03-13T04:47:07.717Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3872024-03-13T04:47:07.717Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3882024-03-13T04:47:07.717Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3892024-03-13T04:47:07.717Z0+0 records in
3902024-03-13T04:47:07.717Z0+0 records out
3912024-03-13T04:47:07.717Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3922024-03-13T04:47:07.717Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3932024-03-13T04:47:07.718Z+ set +x
3942024-03-13T04:47:07.718ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3952024-03-13T04:47:07.718Z++ zpool list -o name
3962024-03-13T04:47:07.718Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3972024-03-13T04:47:07.719Z+ [[ -z '' ]]
3982024-03-13T04:47:07.719Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3992024-03-13T04:47:07.814Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
4002024-03-13T04:47:07.814Z+ set +x
4012024-03-13T04:47:07.814ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
4022024-03-13T04:47:07.814Z+ for ZPOOL in "${ZPOOLS[@]}"
4032024-03-13T04:47:07.814Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
4042024-03-13T04:47:07.814ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
4052024-03-13T04:47:07.815Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
4062024-03-13T04:47:07.815Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
4072024-03-13T04:47:07.815Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
4082024-03-13T04:47:07.815Z0+0 records in
4092024-03-13T04:47:07.815Z0+0 records out
4102024-03-13T04:47:07.815Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4112024-03-13T04:47:07.815Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
4122024-03-13T04:47:07.815Z+ set +x
4132024-03-13T04:47:07.816ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
4142024-03-13T04:47:07.816Z++ zpool list -o name
4152024-03-13T04:47:07.816Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
4162024-03-13T04:47:07.816Z+ [[ -z '' ]]
4172024-03-13T04:47:07.816Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
4182024-03-13T04:47:07.816Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
4192024-03-13T04:47:07.816Z+ set +x
4202024-03-13T04:47:07.816ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
4212024-03-13T04:47:07.816Z+ for ZPOOL in "${ZPOOLS[@]}"
4222024-03-13T04:47:07.816Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
4232024-03-13T04:47:07.816ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
4242024-03-13T04:47:07.816Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4252024-03-13T04:47:07.816Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
4262024-03-13T04:47:07.816Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
4272024-03-13T04:47:07.816Z0+0 records in
4282024-03-13T04:47:07.816Z0+0 records out
4292024-03-13T04:47:07.817Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4302024-03-13T04:47:07.818Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
4312024-03-13T04:47:07.818Z+ set +x
4322024-03-13T04:47:07.818ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
4332024-03-13T04:47:07.818Z++ zpool list -o name
4342024-03-13T04:47:07.818Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
4352024-03-13T04:47:07.818Z+ [[ -z '' ]]
4362024-03-13T04:47:07.818Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4372024-03-13T04:47:07.818Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
4382024-03-13T04:47:07.818Z+ set +x
4392024-03-13T04:47:07.818ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
4402024-03-13T04:47:07.818Z+ for ZPOOL in "${ZPOOLS[@]}"
4412024-03-13T04:47:07.818Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
4422024-03-13T04:47:07.818ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
4432024-03-13T04:47:07.818Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4442024-03-13T04:47:07.819Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
4452024-03-13T04:47:07.819Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
4462024-03-13T04:47:07.819Z0+0 records in
4472024-03-13T04:47:07.819Z0+0 records out
4482024-03-13T04:47:07.819Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4492024-03-13T04:47:07.819Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4502024-03-13T04:47:07.819Z+ set +x
4512024-03-13T04:47:07.819ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
4522024-03-13T04:47:07.819Z++ zpool list -o name
4532024-03-13T04:47:07.819Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4542024-03-13T04:47:07.819Z+ [[ -z '' ]]
4552024-03-13T04:47:07.819Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4562024-03-13T04:47:07.921Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4572024-03-13T04:47:07.921Z+ set +x
4582024-03-13T04:47:07.921ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
4592024-03-13T04:47:07.921Z+ for ZPOOL in "${ZPOOLS[@]}"
4602024-03-13T04:47:07.921Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4612024-03-13T04:47:07.921ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
4622024-03-13T04:47:07.921Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4632024-03-13T04:47:07.921Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4642024-03-13T04:47:07.921Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4652024-03-13T04:47:07.921Z0+0 records in
4662024-03-13T04:47:07.921Z0+0 records out
4672024-03-13T04:47:07.922Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4682024-03-13T04:47:07.922Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4692024-03-13T04:47:07.922Z+ set +x
4702024-03-13T04:47:07.922ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
4712024-03-13T04:47:07.922Z++ zpool list -o name
4722024-03-13T04:47:07.922Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4732024-03-13T04:47:07.922Z+ [[ -z '' ]]
4742024-03-13T04:47:07.922Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4752024-03-13T04:47:07.922Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4762024-03-13T04:47:07.922Z+ set +x
4772024-03-13T04:47:07.922ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
4782024-03-13T04:47:07.922Z+ for ZPOOL in "${ZPOOLS[@]}"
4792024-03-13T04:47:07.922Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4802024-03-13T04:47:07.922ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
4812024-03-13T04:47:07.922Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4822024-03-13T04:47:07.922Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4832024-03-13T04:47:07.922Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4842024-03-13T04:47:07.922Z0+0 records in
4852024-03-13T04:47:07.922Z0+0 records out
4862024-03-13T04:47:07.922Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4872024-03-13T04:47:07.922Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4882024-03-13T04:47:07.922Z+ set +x
4892024-03-13T04:47:07.923ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
4902024-03-13T04:47:07.923Z++ zpool list -o name
4912024-03-13T04:47:07.923Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4922024-03-13T04:47:07.923Z+ [[ -z '' ]]
4932024-03-13T04:47:07.923Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4942024-03-13T04:47:08.124Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4952024-03-13T04:47:08.124Z+ set +x
4962024-03-13T04:47:08.124ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
4972024-03-13T04:47:08.124Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4982024-03-13T04:47:08.124Z+ readarray -t ZPOOLS
4992024-03-13T04:47:08.124Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
5002024-03-13T04:47:08.124Z++ sed 's/[ ",]//g'
5012024-03-13T04:47:08.124Z+ for ZPOOL in "${ZPOOLS[@]}"
5022024-03-13T04:47:08.124Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
5032024-03-13T04:47:08.124ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
5042024-03-13T04:47:08.124Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5052024-03-13T04:47:08.125Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
5062024-03-13T04:47:08.125Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
5072024-03-13T04:47:08.125Z0+0 records in
5082024-03-13T04:47:08.125Z0+0 records out
5092024-03-13T04:47:08.125Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
5102024-03-13T04:47:08.125Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
5112024-03-13T04:47:08.125Z+ set +x
5122024-03-13T04:47:08.125ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
5132024-03-13T04:47:08.125Z++ zpool list -o name
5142024-03-13T04:47:08.125Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
5152024-03-13T04:47:08.125Z+ [[ -z '' ]]
5162024-03-13T04:47:08.125Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5172024-03-13T04:47:08.125Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
5182024-03-13T04:47:08.125Z+ set +x
5192024-03-13T04:47:08.125ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
5202024-03-13T04:47:08.125Z+ for ZPOOL in "${ZPOOLS[@]}"
5212024-03-13T04:47:08.125Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
5222024-03-13T04:47:08.125ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
5232024-03-13T04:47:08.125Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5242024-03-13T04:47:08.125Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
5252024-03-13T04:47:08.126Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
5262024-03-13T04:47:08.126Z0+0 records in
5272024-03-13T04:47:08.126Z0+0 records out
5282024-03-13T04:47:08.126Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
5292024-03-13T04:47:08.126Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
5302024-03-13T04:47:08.126Z+ set +x
5312024-03-13T04:47:08.126ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
5322024-03-13T04:47:08.126Z++ zpool list -o name
5332024-03-13T04:47:08.126Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
5342024-03-13T04:47:08.126Z+ [[ -z '' ]]
5352024-03-13T04:47:08.126Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
5362024-03-13T04:47:08.126Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
5372024-03-13T04:47:08.126Z+ set +x
5382024-03-13T04:47:08.126ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
5392024-03-13T04:47:08.126Z+ [[ zone == \z\o\n\e ]]
5402024-03-13T04:47:08.126Z+ ensure_simulated_links igb0
5412024-03-13T04:47:08.126Z+ local PHYSICAL_LINK=igb0
5422024-03-13T04:47:08.126Z+ INDICES=("0" "1")
5432024-03-13T04:47:08.126Z+ for I in "${INDICES[@]}"
5442024-03-13T04:47:08.126Z++ get_simnet_name_if_exists net0
5452024-03-13T04:47:08.126Z++ dladm show-simnet -p -o LINK net0
5462024-03-13T04:47:08.126Z++ echo ''
5472024-03-13T04:47:08.127Z+ [[ -z '' ]]
5482024-03-13T04:47:08.127Z+ dladm create-simnet -t net0
5492024-03-13T04:47:08.127Z+ dladm create-simnet -t sc0_0
5502024-03-13T04:47:08.127Z+ dladm modify-simnet -t -p net0 sc0_0
5512024-03-13T04:47:08.127Z+ dladm set-linkprop -p mtu=9000 sc0_0
5522024-03-13T04:47:08.127Z+ success 'Simnet net0/sc0_0 exists'
5532024-03-13T04:47:08.127Z+ set +x
5542024-03-13T04:47:08.127ZSimnet net0/sc0_0 exists
5552024-03-13T04:47:08.127Z+ for I in "${INDICES[@]}"
5562024-03-13T04:47:08.127Z++ get_simnet_name_if_exists net1
5572024-03-13T04:47:08.127Z++ dladm show-simnet -p -o LINK net1
5582024-03-13T04:47:08.127Z++ echo ''
5592024-03-13T04:47:08.127Z+ [[ -z '' ]]
5602024-03-13T04:47:08.127Z+ dladm create-simnet -t net1
5612024-03-13T04:47:08.127Z+ dladm create-simnet -t sc1_0
5622024-03-13T04:47:08.127Z+ dladm modify-simnet -t -p net1 sc1_0
5632024-03-13T04:47:08.127Z+ dladm set-linkprop -p mtu=9000 sc1_0
5642024-03-13T04:47:08.127Z+ success 'Simnet net1/sc1_0 exists'
5652024-03-13T04:47:08.127Z+ set +x
5662024-03-13T04:47:08.128ZSimnet net1/sc1_0 exists
5672024-03-13T04:47:08.128Z++ get_vnic_name_if_exists sc0_1
5682024-03-13T04:47:08.128Z++ dladm show-vnic -p -o LINK sc0_1
5692024-03-13T04:47:08.128Z++ echo ''
5702024-03-13T04:47:08.128Z+ [[ -z '' ]]
5712024-03-13T04:47:08.128Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5722024-03-13T04:47:08.128Z+ [[ -v PROMISC_FILT_OFF ]]
5732024-03-13T04:47:08.128Z+ success 'Vnic sc0_1 exists'
5742024-03-13T04:47:08.128Z+ set +x
5752024-03-13T04:47:08.128ZVnic sc0_1 exists
5762024-03-13T04:47:08.128Z+ warn_if_no_proxy_arp
5772024-03-13T04:47:08.128Z+ [[ -v PXA_START ]]
5782024-03-13T04:47:08.128Z+ [[ -v PXA_END ]]
5792024-03-13T04:47:08.128Z+ ensure_softnpu_zone
5802024-03-13T04:47:08.128Z+ zoneadm list
5812024-03-13T04:47:08.128Z+ grep -q sidecar_softnpu
5822024-03-13T04:47:08.128Z+ [[ -f out/npuzone/npuzone ]]
5832024-03-13T04:47:08.129Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092
5842024-03-13T04:47:08.129Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt
5852024-03-13T04:47:39.392Zdownloading softnpu ...done
5862024-03-13T04:47:39.420Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt
 
5872024-03-13T04:47:39.729ZError: No response to keepalive - Terminating session
 
5882024-03-13T04:47:49.224Zdownloading asic_program.so ...done
5892024-03-13T04:47:49.252Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt
 
5902024-03-13T04:47:49.736ZError: No response de-activating SOL payload
5912024-03-13T04:47:50.877Z[SOL Session operational. Use ~? for help]
 
5922024-03-13T04:48:04.871Zdownloading scadm ...done
5932024-03-13T04:48:04.897Zcreating port tfportrear0_0 for sc0_0
5942024-03-13T04:48:04.897Zcreating port tfportqsfp0_0 for sc0_1
5952024-03-13T04:48:04.923Zsoftnpu zone setup
5962024-03-13T04:48:04.924Zconfigure zone
5972024-03-13T04:48:04.924Zinstall zone
5982024-03-13T04:48:05.962Zboot zone
5992024-03-13T04:48:09.074Z[sidecar_softnpu] svcs milestone/network
6002024-03-13T04:48:09.099ZSTATE STIME FMRI
6012024-03-13T04:48:09.099Zonline 4:48:07 svc:/milestone/network:default
6022024-03-13T04:48:09.099Z[sidecar_softnpu] /softnpu/npu start
6032024-03-13T04:48:09.123Z
6042024-03-13T04:48:09.148Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
6052024-03-13T04:48:09.148Z+ GATEWAY_IP=10.151.2.100
6062024-03-13T04:48:09.148Z+ echo 'Using 10.151.2.100 as gateway ip'
6072024-03-13T04:48:09.148ZUsing 10.151.2.100 as gateway ip
6082024-03-13T04:48:09.148Z+ [[ ! -v GATEWAY_MAC ]]
6092024-03-13T04:48:09.148Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
6102024-03-13T04:48:09.148Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
6112024-03-13T04:48:09.148Z+++ echo 18:c0:4d:0d:a0:2a
6122024-03-13T04:48:09.149Z+ COUNT=1
6132024-03-13T04:48:09.149Z+ [[ 1 -ne 1 ]]
6142024-03-13T04:48:09.149Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
6152024-03-13T04:48:09.149ZUsing 18:c0:4d:0d:a0:2a as gateway mac
6162024-03-13T04:48:09.149Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
6172024-03-13T04:48:09.149Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
6182024-03-13T04:48:09.173Z+ PXA_MAC=a8:e1:de:01:70:1d
6192024-03-13T04:48:09.173Z+ [[ -v PXA_START ]]
6202024-03-13T04:48:09.173Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
6212024-03-13T04:48:09.173Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
6222024-03-13T04:48:09.197Z+ z_scadm dump-state
6232024-03-13T04:48:09.197Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
6242024-03-13T04:48:09.223Zlocal v6:
6252024-03-13T04:48:09.223Zlocal v4:
6262024-03-13T04:48:09.223Zrouter v6:
6272024-03-13T04:48:09.223Zrouter v4_idx:
6282024-03-13T04:48:09.224Zrouter v4_routes:
6292024-03-13T04:48:09.224Zresolver v4:
6302024-03-13T04:48:09.224Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
6312024-03-13T04:48:09.224Zresolver v6:
6322024-03-13T04:48:09.224Znat v4:
6332024-03-13T04:48:09.224Znat_v6:
6342024-03-13T04:48:09.224Zport_mac:
6352024-03-13T04:48:09.225Zproxy arp:
6362024-03-13T04:48:09.225Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
6372024-03-13T04:48:09.225Z+ success 'softnpu zone exists'
6382024-03-13T04:48:09.225Z+ set +x
6392024-03-13T04:48:09.225Zsoftnpu zone exists
6402024-03-13T04:48:09.226Z
6412024-03-13T04:48:09.226Zreal 1:01.828147413
6422024-03-13T04:48:09.226Zuser 0.709560400
6432024-03-13T04:48:09.226Zsys 1.611498974
6442024-03-13T04:48:09.227Ztrap 0.000104408
6452024-03-13T04:48:09.227Ztflt 0.000120576
6462024-03-13T04:48:09.227Zdflt 0.001484350
6472024-03-13T04:48:09.227Zkflt 0.000000000
6482024-03-13T04:48:09.227Zlock 48:42.176818509
6492024-03-13T04:48:09.258Zslp 3:05.379280828
6502024-03-13T04:48:09.258Zlat 0.068915709
6512024-03-13T04:48:09.258Zstop 0.370042599
6522024-03-13T04:48:09.258Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
6532024-03-13T04:48:09.259Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6542024-03-13T04:48:09.259Z+ SILO_NAME=recovery
6552024-03-13T04:48:09.259Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
6562024-03-13T04:48:09.294Z+ EXTERNAL_DNS_DOMAIN=oxide.test
6572024-03-13T04:48:09.294Z+ sed -i~ '
6582024-03-13T04:48:09.294Z /^external_dns_ips/c\
6592024-03-13T04:48:09.294Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6602024-03-13T04:48:09.295Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
6612024-03-13T04:48:09.295Z /^first/c\
6622024-03-13T04:48:09.295Zfirst = "10.151.2.164"
6632024-03-13T04:48:09.295Z /^last/c\
6642024-03-13T04:48:09.295Zlast = "10.151.2.173"
6652024-03-13T04:48:09.295Z }
6662024-03-13T04:48:09.295Z /^\[rack_network_config/,/^$/ {
6672024-03-13T04:48:09.295Z /^infra_ip_first/c\
6682024-03-13T04:48:09.296Zinfra_ip_first = "10.151.2.174"
6692024-03-13T04:48:09.296Z /^infra_ip_last/c\
6702024-03-13T04:48:09.296Zinfra_ip_last = "10.151.2.174"
6712024-03-13T04:48:09.296Z }
6722024-03-13T04:48:09.296Z /^\[\[rack_network_config.ports/,/^$/ {
6732024-03-13T04:48:09.296Z /^routes/c\
6742024-03-13T04:48:09.296Zroutes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\]
6752024-03-13T04:48:09.296Z /^addresses/c\
6762024-03-13T04:48:09.296Zaddresses = \["10.151.2.174/24"\]
6772024-03-13T04:48:09.296Z }
6782024-03-13T04:48:09.296Z' pkg/config-rss.toml
6792024-03-13T04:48:09.296Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6802024-03-13T04:48:09.297Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6812024-03-13T04:48:09.297Z+++ pkg/config-rss.toml Wed Mar 13 04:48:09 2024
6822024-03-13T04:48:09.297Z@@ -33,7 +33,7 @@
6832024-03-13T04:48:09.297Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6842024-03-13T04:48:09.297Z # must be contained in one of the "internal services" IP Pool ranges listed
6852024-03-13T04:48:09.297Z # below.
6862024-03-13T04:48:09.297Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6872024-03-13T04:48:09.297Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6882024-03-13T04:48:09.297Z
6892024-03-13T04:48:09.297Z # Initial TLS certificates for the external API
6902024-03-13T04:48:09.297Z #
6912024-03-13T04:48:09.298Z@@ -69,8 +69,8 @@
6922024-03-13T04:48:09.298Z #
6932024-03-13T04:48:09.298Z # For more on this and what to put here, see docs/how-to-run.adoc.
6942024-03-13T04:48:09.298Z [[internal_services_ip_pool_ranges]]
6952024-03-13T04:48:09.298Z-first = "192.168.1.20"
6962024-03-13T04:48:09.298Z-last = "192.168.1.29"
6972024-03-13T04:48:09.298Z+first = "10.151.2.164"
6982024-03-13T04:48:09.298Z+last = "10.151.2.173"
6992024-03-13T04:48:09.298Z
7002024-03-13T04:48:09.299Z # TODO - this configuration is subject to change going forward. Ultimately these
7012024-03-13T04:48:09.299Z # parameters should be provided to the control plane via wicket, but we need to
7022024-03-13T04:48:09.299Z@@ -100,9 +100,9 @@
7032024-03-13T04:48:09.299Z # You can configure multiple uplinks by repeating the following stanza
7042024-03-13T04:48:09.299Z [[rack_network_config.ports]]
7052024-03-13T04:48:09.299Z # Routes associated with this port.
7062024-03-13T04:48:09.299Z-routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}]
7072024-03-13T04:48:09.299Z+routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}]
7082024-03-13T04:48:09.299Z # Addresses associated with this port.
7092024-03-13T04:48:09.299Z-addresses = ["192.168.1.30/24"]
7102024-03-13T04:48:09.300Z+addresses = ["10.151.2.174/24"]
7112024-03-13T04:48:09.300Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
7122024-03-13T04:48:09.300Z port = "qsfp0"
7132024-03-13T04:48:09.300Z # The speed of this port.
7142024-03-13T04:48:09.300Z+ true
7152024-03-13T04:48:09.300Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
7162024-03-13T04:48:09.300Za pkg/config-rss.toml 7K
7172024-03-13T04:48:09.300Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
7182024-03-13T04:48:09.300Z+ TLS_NAME=recovery.sys.oxide.test
7192024-03-13T04:48:09.300Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
7202024-03-13T04:48:10.808Z....+.....+.........+......+.+..+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..........+.....+....+.....+.+.....+......+................+..+............................+.....+............+.......+...+.....+.+..+...+....+..+.+.........+......+...+..............+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.......................+...+.........+.........+....+...+...+..............+...........................+...+......+....+........+...+.....................+................+...+..+....+..........................+....+...........+..........+............+.....+..............................+...+....+......+...+......+......+........+...............+......+....+.....+.......+..+...............+.+..+...+....+........+.........+....+......+...........+.......+............+.........+..+...+......+.+.........+...+.....+.+.........+.................+....+...........+.............+.....+............+......+.........+.+............+............+......+.........+........................+..+....+...+..................+...+.........+.....+.+......+...........+.......+...+........+.....................+.+..+.......+...+........+...............+............................+.....+....+......+...........+.........+......+...+.......+...........+.......+..+....+...........+...+...............+..........+........+....+.........+.....+.......+........+....+........+...+.+...........+...+.......+.........+...+..+....+......+...........+....+......+........+..............................+.+...+..+.........+.......+..+.+.........+...........+..........+.........+.....+...............+...............+............+....+.........+......+.........+..+...+.+....................+....+...+....................+...+.......+.........+.....+.............+.....+..........+.....+..........+........+...+.+.....+..........+......+...+......+.....+...+...+.............+..............+...+....+........+......+.+.........+.........+......+......+........+.+.....+....+.....+............+.+.............................+...+...+.............+..+....+.....................+.....+..........+.........+..............+.......+.........+.....+..................+......+....+..+.+..+.+......+.....+.+...+..+..................+......+....+...........+......+....+...+....................+............+...+.+.....+......+....+..............+......+...............+......+......+.........+.............+.....+......+.+...+.....+.....................+....+............+...+...+..............+...................+.....+.+......+.....+............+.............+..+......+......+.............+...+.....+...+......+......+....+.....+...+.......+..................+.................+.+........+.+....................+......+...+....+...+.................+.+..+...+.........+.+............+.........+........+..........+...+.....+....+...+....................+.......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
7212024-03-13T04:48:11.072Z..............+......+...+.+...........+...+..........+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+............+..........+........+.......+........+...+.+...+......+...........+......+..........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+...+......+.....+......+....+...+.....+............+................+..+.+..+...+.......+..+..........+......+.....+....+............+.....+....+..+...+.+...+........+.............+.....+......+.+.....+....+.....+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
7222024-03-13T04:48:11.097Z-----
7232024-03-13T04:48:11.097Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
7242024-03-13T04:48:11.123Za pkg/initial-tls-cert.pem 2K
7252024-03-13T04:48:11.123Za pkg/initial-tls-key.pem 4K
7262024-03-13T04:48:11.123Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
7272024-03-13T04:48:11.123Z+ rmdir pkg
7282024-03-13T04:48:11.123Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
7292024-03-13T04:48:11.123Z+ pfexec mkdir -p /usr/oxide
7302024-03-13T04:48:11.123Z+ pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0
7312024-03-13T04:48:11.863Z+ pfexec chmod +x /usr/oxide/oxide
7322024-03-13T04:48:11.894Z+ curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw
7332024-03-13T04:48:30.184Z+ OMICRON_NO_UNINSTALL=1
7342024-03-13T04:48:30.184Z+ ptime -m pfexec ./target/release/omicron-package -t test install
7352024-03-13T04:48:30.212ZLogging to: /opt/oxide/work/out/LOG
7362024-03-13T04:48:30.730Z
7372024-03-13T04:48:30.757Zreal 0.538958612
7382024-03-13T04:48:30.757Zuser 0.110169462
7392024-03-13T04:48:30.757Zsys 2.442827318
7402024-03-13T04:48:30.757Ztrap 0.000005269
7412024-03-13T04:48:30.757Ztflt 0.000019660
7422024-03-13T04:48:30.758Zdflt 0.000412025
7432024-03-13T04:48:30.758Zkflt 0.000016249
7442024-03-13T04:48:30.758Zlock 48.712066313
7452024-03-13T04:48:30.758Zslp 0.748473755
7462024-03-13T04:48:30.758Zlat 0.003021315
7472024-03-13T04:48:30.758Zstop 0.219482965
7482024-03-13T04:48:30.758Z+ retry=0
7492024-03-13T04:48:30.758Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7502024-03-13T04:48:30.758Z+ [[ 0 -gt 30 ]]
7512024-03-13T04:48:30.758Z+ sleep 1
7522024-03-13T04:48:31.742Z+ retry=1
7532024-03-13T04:48:31.742Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7542024-03-13T04:48:31.768Z+ [[ 1 -gt 30 ]]
7552024-03-13T04:48:31.768Z+ sleep 1
7562024-03-13T04:48:32.757Z+ retry=2
7572024-03-13T04:48:32.757Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7582024-03-13T04:48:32.782Z+ [[ 2 -gt 30 ]]
7592024-03-13T04:48:32.783Z+ sleep 1
7602024-03-13T04:48:34.180Z+ retry=3
7612024-03-13T04:48:34.180Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7622024-03-13T04:48:34.209Z+ [[ 3 -gt 30 ]]
7632024-03-13T04:48:34.209Z+ sleep 1
7642024-03-13T04:48:34.791Z+ retry=4
7652024-03-13T04:48:34.791Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7662024-03-13T04:48:59.958Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7672024-03-13T04:48:59.985Zlocal v6:
7682024-03-13T04:48:59.986Zfe80::1058:bcff:fee1:b88d
7692024-03-13T04:48:59.986Zfdde:3570:2d22:a7d3::1
7702024-03-13T04:48:59.986Zlocal v4:
7712024-03-13T04:48:59.986Z10.151.2.174
7722024-03-13T04:48:59.986Zrouter v6:
7732024-03-13T04:48:59.986Zfdb0:18c0:4d0d:a02a::/64 -> fe80::d418:7eff:fe2f:5d47 (1)
7742024-03-13T04:48:59.986Zfd00:1122:3344:3::/64 -> fe80::d418:7eff:fe2f:5d47 (1)
7752024-03-13T04:48:59.986Zfd00:1122:3344:2::/64 -> fe80::d418:7eff:fe2f:5d47 (1)
7762024-03-13T04:48:59.986Zfd00:1122:3344:101::/64 -> fe80::d418:7eff:fe2f:5d47 (1)
7772024-03-13T04:48:59.986Zfd00:1122:3344:1::/64 -> fe80::d418:7eff:fe2f:5d47 (1)
7782024-03-13T04:48:59.986Zrouter v4_idx:
7792024-03-13T04:48:59.986Z0.0.0.0/0 -> 0
7802024-03-13T04:48:59.986Zrouter v4_routes:
7812024-03-13T04:48:59.986Z0 -> 10.151.2.100 (2)
7822024-03-13T04:48:59.986Zresolver v4:
7832024-03-13T04:49:00.015Z10.151.2.174 -> aa:96:c9:16:e4:92
7842024-03-13T04:49:00.015Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7852024-03-13T04:49:00.015Zresolver v6:
7862024-03-13T04:49:00.015Zfe80::d418:7eff:fe2f:5d47 -> d6:18:7e:2f:5d:47
7872024-03-13T04:49:00.015Zfe80::1058:bcff:fee1:b88d -> 12:58:bc:e1:b8:8d
7882024-03-13T04:49:00.016Znat v4:
7892024-03-13T04:49:00.016Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:e1:ad
7902024-03-13T04:49:00.016Znat_v6:
7912024-03-13T04:49:00.016Zport_mac:
7922024-03-13T04:49:00.016Z2: a8:40:25:0c:93:0a
7932024-03-13T04:49:00.016Z1: a8:40:25:0c:92:ea
7942024-03-13T04:49:00.016Z1000: a8:40:25:0c:92:e9
7952024-03-13T04:49:00.016Zproxy arp:
7962024-03-13T04:49:00.016Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7972024-03-13T04:49:00.016Z+ retry=0
7982024-03-13T04:49:00.016Z+++ zoneadm list -n
7992024-03-13T04:49:00.016Z+++ grep oxz_ntp
8002024-03-13T04:49:00.016Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8012024-03-13T04:49:00.043Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8022024-03-13T04:49:00.044Z++ true
8032024-03-13T04:49:00.044Z+ [[ '' != online ]]
8042024-03-13T04:49:00.044Z+ [[ 0 -gt 60 ]]
8052024-03-13T04:49:00.044Z+ sleep 1
8062024-03-13T04:49:01.018Z+ retry=1
8072024-03-13T04:49:01.056Z+++ zoneadm list -n
8082024-03-13T04:49:01.056Z+++ grep oxz_ntp
8092024-03-13T04:49:01.056Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8102024-03-13T04:49:01.057Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8112024-03-13T04:49:01.057Z++ true
8122024-03-13T04:49:01.532Z+ [[ '' != online ]]
8132024-03-13T04:49:01.532Z+ [[ 1 -gt 60 ]]
8142024-03-13T04:49:01.532Z+ sleep 1
8152024-03-13T04:49:02.046Z+ retry=2
8162024-03-13T04:49:02.074Z+++ zoneadm list -n
8172024-03-13T04:49:02.074Z+++ grep oxz_ntp
8182024-03-13T04:49:02.074Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8192024-03-13T04:49:02.074Z+ [[ offline != online ]]
8202024-03-13T04:49:02.074Z+ [[ 2 -gt 60 ]]
8212024-03-13T04:49:02.074Z+ sleep 1
8222024-03-13T04:49:03.069Z+ retry=3
8232024-03-13T04:49:03.233Z+++ zoneadm list -n
8242024-03-13T04:49:03.234Z+++ grep oxz_ntp
8252024-03-13T04:49:03.234Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8262024-03-13T04:49:03.271Z+ [[ offline != online ]]
8272024-03-13T04:49:03.271Z+ [[ 3 -gt 60 ]]
8282024-03-13T04:49:03.271Z+ sleep 1
8292024-03-13T04:49:04.093Z+ retry=4
8302024-03-13T04:49:04.119Z+++ zoneadm list -n
8312024-03-13T04:49:04.119Z+++ grep oxz_ntp
8322024-03-13T04:49:04.119Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8332024-03-13T04:49:04.119Z+ [[ offline != online ]]
8342024-03-13T04:49:04.119Z+ [[ 4 -gt 60 ]]
8352024-03-13T04:49:04.119Z+ sleep 1
8362024-03-13T04:49:05.114Z+ retry=5
8372024-03-13T04:49:05.144Z+++ zoneadm list -n
8382024-03-13T04:49:05.144Z+++ grep oxz_ntp
8392024-03-13T04:49:05.144Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8402024-03-13T04:49:05.145Z+ [[ offline != online ]]
8412024-03-13T04:49:05.145Z+ [[ 5 -gt 60 ]]
8422024-03-13T04:49:05.145Z+ sleep 1
8432024-03-13T04:49:06.136Z+ retry=6
8442024-03-13T04:49:06.162Z+++ zoneadm list -n
8452024-03-13T04:49:06.163Z+++ grep oxz_ntp
8462024-03-13T04:49:06.163Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8472024-03-13T04:49:06.163Z+ [[ offline != online ]]
8482024-03-13T04:49:06.163Z+ [[ 6 -gt 60 ]]
8492024-03-13T04:49:06.163Z+ sleep 1
8502024-03-13T04:49:07.158Z+ retry=7
8512024-03-13T04:49:07.187Z+++ zoneadm list -n
8522024-03-13T04:49:07.188Z+++ grep oxz_ntp
8532024-03-13T04:49:07.188Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8542024-03-13T04:49:07.188Z+ [[ offline != online ]]
8552024-03-13T04:49:07.188Z+ [[ 7 -gt 60 ]]
8562024-03-13T04:49:07.188Z+ sleep 1
8572024-03-13T04:49:08.318Z+ retry=8
8582024-03-13T04:49:08.318Z+++ zoneadm list -n
8592024-03-13T04:49:08.318Z+++ grep oxz_ntp
8602024-03-13T04:49:08.318Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8612024-03-13T04:49:08.318Z+ [[ offline != online ]]
8622024-03-13T04:49:08.318Z+ [[ 8 -gt 60 ]]
8632024-03-13T04:49:08.318Z+ sleep 1
 
8642024-03-13T04:49:08.635ZMar 13 04:49:07 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
8652024-03-13T04:49:09.203Z+ retry=9
8662024-03-13T04:49:09.228Z+++ zoneadm list -n
8672024-03-13T04:49:09.228Z+++ grep oxz_ntp
8682024-03-13T04:49:09.228Z++ pfexec svcs -z oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5 -Hostate oxide/ntp
8692024-03-13T04:49:09.228Z+ [[ online != online ]]
8702024-03-13T04:49:09.228Z+ echo 'Waited for chrony: 9s'
8712024-03-13T04:49:09.228ZWaited for chrony: 9s
8722024-03-13T04:49:09.228Z+ export RUST_BACKTRACE=1
8732024-03-13T04:49:09.228Z+ RUST_BACKTRACE=1
8742024-03-13T04:49:09.228Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
8752024-03-13T04:49:09.229Z++ ./tests/bootstrap
8762024-03-13T04:49:09.255ZUsing external DNS server at 10.151.2.164:53
8772024-03-13T04:49:09.280Z2024-03-13 04:49:09.121058911 UTC: attempting to log into API
8782024-03-13T04:49:24.292Z2024-03-13 04:49:24.243044354 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8792024-03-13T04:49:25.300Z2024-03-13 04:49:25.244008132 UTC: attempting to log into API
8802024-03-13T04:49:40.334Z2024-03-13 04:49:40.283506022 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8812024-03-13T04:49:41.336Z2024-03-13 04:49:41.284972537 UTC: attempting to log into API
8822024-03-13T04:49:56.370Z2024-03-13 04:49:56.321639653 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8832024-03-13T04:49:57.377Z2024-03-13 04:49:57.322628351 UTC: attempting to log into API
8842024-03-13T04:50:12.403Z2024-03-13 04:50:12.353609858 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8852024-03-13T04:50:13.404Z2024-03-13 04:50:13.354685187 UTC: attempting to log into API
8862024-03-13T04:50:28.436Z2024-03-13 04:50:28.391864526 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8872024-03-13T04:50:29.437Z2024-03-13 04:50:29.393662298 UTC: attempting to log into API
 
8882024-03-13T04:50:39.450ZError: No response to keepalive - Terminating session
 
8892024-03-13T04:50:44.467Z2024-03-13 04:50:44.435374170 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8902024-03-13T04:50:45.468Z2024-03-13 04:50:45.437147965 UTC: attempting to log into API
 
8912024-03-13T04:50:49.398ZError: No response de-activating SOL payload
8922024-03-13T04:50:50.517Z[SOL Session operational. Use ~? for help]
 
8932024-03-13T04:51:00.500Z2024-03-13 04:51:00.479644673 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8942024-03-13T04:51:01.501Z2024-03-13 04:51:01.481425364 UTC: attempting to log into API
8952024-03-13T04:51:31.970Z2024-03-13 04:51:16.524255949 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8962024-03-13T04:51:38.671Z2024-03-13 04:51:17.525878332 UTC: attempting to log into API
8972024-03-13T04:51:38.696Z2024-03-13 04:51:37.803587382 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
8982024-03-13T04:51:38.821Z2024-03-13 04:51:38.805747908 UTC: attempting to log into API
8992024-03-13T04:51:54.349Z2024-03-13 04:51:54.339832145 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9002024-03-13T04:51:55.350Z2024-03-13 04:51:55.340932494 UTC: attempting to log into API
 
9012024-03-13T04:52:13.334ZMar 13 04:52:07 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast
9022024-03-13T04:52:13.429ZMar 13 04:52:07 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast
9032024-03-13T04:52:13.472ZMar 13 04:52:08 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast
9042024-03-13T04:52:13.513ZMar 13 04:52:08 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast
9052024-03-13T04:52:13.561ZMar 13 04:52:09 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast
 
9062024-03-13T04:52:14.165Z2024-03-13 04:52:10.374893654 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9072024-03-13T04:52:14.165Z2024-03-13 04:52:11.375928292 UTC: attempting to log into API
9082024-03-13T04:52:22.196Z2024-03-13 04:52:22.188280197 UTC: login succeeded
9092024-03-13T04:52:22.233Zwaiting for nexus to come up...
9102024-03-13T04:52:22.309Zcreating IP pool... 10.151.2.175 - 10.151.2.227
9112024-03-13T04:52:22.536Zsetting up quotas...
9122024-03-13T04:52:22.589Zensuring datasets are ready...
9132024-03-13T04:52:25.486Zlet's roll.
9142024-03-13T04:52:25.511Z+ eval 'OXIDE_HOST=https://recovery.sys.oxide.test
9152024-03-13T04:52:25.511ZOXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
9162024-03-13T04:52:25.511ZOXIDE_TOKEN=oxide-token-ded5f990df637f47e591f6d7e41b1dad25edd042'
9172024-03-13T04:52:25.535Z++ OXIDE_HOST=https://recovery.sys.oxide.test
9182024-03-13T04:52:25.535Z++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166
9192024-03-13T04:52:25.535Z++ OXIDE_TOKEN=oxide-token-ded5f990df637f47e591f6d7e41b1dad25edd042
9202024-03-13T04:52:25.535Z+ export OXIDE_HOST OXIDE_TOKEN
9212024-03-13T04:52:25.535Z+ retry=0
9222024-03-13T04:52:25.535Z+ curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem
9232024-03-13T04:52:25.620Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images'
9242024-03-13T04:52:26.041Z{"status":"ok"}success
9252024-03-13T04:52:26.041ZProject {
9262024-03-13T04:52:26.545Z description: "some images",
9272024-03-13T04:52:26.545Z id: cbc3c66f-26d3-4219-9477-18e8e1385bf7,
9282024-03-13T04:52:26.546Z name: Name(
9292024-03-13T04:52:26.546Z "images",
9302024-03-13T04:52:26.546Z ),
9312024-03-13T04:52:26.546Z time_created: 2024-03-13T04:52:25.709902Z,
9322024-03-13T04:52:26.546Z time_modified: 2024-03-13T04:52:25.709902Z,
9332024-03-13T04:52:26.546Z}
9342024-03-13T04:52:26.546Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11
 
9352024-03-13T04:53:39.836ZError: No response to keepalive - Terminating session
9362024-03-13T04:53:49.726ZError: No response de-activating SOL payload
9372024-03-13T04:53:50.857Z[SOL Session operational. Use ~? for help]
9382024-03-13T04:56:39.672ZError: No response to keepalive - Terminating session
9392024-03-13T04:56:49.784ZError: No response de-activating SOL payload
9402024-03-13T04:56:50.911Z[SOL Session operational. Use ~? for help]
 
9412024-03-13T04:57:49.717Zdone!
9422024-03-13T04:57:49.717Z+ /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11
9432024-03-13T04:57:49.717Zsuccess
9442024-03-13T04:57:49.717ZImage {
9452024-03-13T04:57:49.717Z block_size: ByteCount(
9462024-03-13T04:57:49.717Z 512,
9472024-03-13T04:57:49.718Z ),
9482024-03-13T04:57:49.718Z description: "debian 11 original base image",
9492024-03-13T04:57:49.718Z digest: None,
9502024-03-13T04:57:49.718Z id: 2d437890-e82b-4749-90c6-71f2c25d362a,
9512024-03-13T04:57:49.718Z name: Name(
9522024-03-13T04:57:49.718Z "debian11",
9532024-03-13T04:57:49.718Z ),
9542024-03-13T04:57:49.718Z os: "debian",
9552024-03-13T04:57:49.718Z project_id: None,
9562024-03-13T04:57:49.718Z size: ByteCount(
9572024-03-13T04:57:49.718Z 2147483648,
9582024-03-13T04:57:49.718Z ),
9592024-03-13T04:57:49.718Z time_created: 2024-03-13T04:57:46.220890Z,
9602024-03-13T04:57:49.718Z time_modified: 2024-03-13T04:57:46.445846Z,
9612024-03-13T04:57:49.718Z url: None,
9622024-03-13T04:57:49.718Z version: "11",
9632024-03-13T04:57:49.718Z}
9642024-03-13T04:57:49.718Z+ rm ./tests/bootstrap
9652024-03-13T04:57:49.718Z+ for test_bin in tests/*
9662024-03-13T04:57:49.719Z+ ./tests/bootstrap-a3be395245e6bd94
9672024-03-13T04:57:49.719Z
9682024-03-13T04:57:49.719Zrunning 0 tests
9692024-03-13T04:57:49.719Z
9702024-03-13T04:57:49.719Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9712024-03-13T04:57:49.719Z
9722024-03-13T04:57:49.719Z+ for test_bin in tests/*
9732024-03-13T04:57:49.719Z+ ./tests/commtest-ef47fb3f0eb26d6a
9742024-03-13T04:57:49.719Z
9752024-03-13T04:57:49.719Zrunning 0 tests
9762024-03-13T04:57:49.719Z
9772024-03-13T04:57:49.719Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9782024-03-13T04:57:49.719Z
9792024-03-13T04:57:49.719Z+ for test_bin in tests/*
9802024-03-13T04:57:49.719Z+ ./tests/dhcp_server-ce54f5d7753d595c
9812024-03-13T04:57:49.719Z
9822024-03-13T04:57:49.719Zrunning 0 tests
9832024-03-13T04:57:49.719Z
9842024-03-13T04:57:49.719Ztest result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
9852024-03-13T04:57:49.719Z
9862024-03-13T04:57:49.719Z+ for test_bin in tests/*
9872024-03-13T04:57:49.720Z+ ./tests/end_to_end_tests-2f0c448a5875b5d7
9882024-03-13T04:57:49.720Z
9892024-03-13T04:57:49.720Zrunning 2 tests
9902024-03-13T04:57:49.720Ztest no_spoof::no_spoof_here ... ok
9912024-03-13T04:58:30.141Ztest instance_launch::instance_launch ... ok
9922024-03-13T04:58:30.142Z
9932024-03-13T04:58:30.142Ztest result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 43.14s
9942024-03-13T04:58:30.142Z
9952024-03-13T04:58:30.167Z+ _exit_trap
9962024-03-13T04:58:30.167Z+ local status=0
9972024-03-13T04:58:30.167Z+ [[ 0 -eq 0 ]]
9982024-03-13T04:58:30.167Z+ exit 0
9992024-03-13T04:58:30.167Zprocess exited: duration 691426 ms, exit code 0
 
10002024-03-13T04:58:30.294Zfound 100 output files
10012024-03-13T04:58:30.767Zuploading: /var/svc/log/oxide-sled-agent:default.log (2241797 bytes)
10022024-03-13T04:58:33.448Zupload warning: file "/var/svc/log/oxide-sled-agent:default.log" changed size mid upload: 2241797 -> 2243277
10032024-03-13T04:58:34.073Zuploaded: /var/svc/log/oxide-sled-agent:default.log
10042024-03-13T04:58:34.073Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (2664494 bytes)
10052024-03-13T04:58:36.918Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 2664494 -> 2692653
10062024-03-13T04:58:37.994Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log
10072024-03-13T04:58:37.994Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log (52291 bytes)
10082024-03-13T04:58:39.211Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-lldpd:default.log
10092024-03-13T04:58:39.211Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (4879 bytes)
10102024-03-13T04:58:40.315Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log
10112024-03-13T04:58:40.315Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (23408 bytes)
10122024-03-13T04:58:41.467Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log
10132024-03-13T04:58:41.497Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1522060 bytes)
10142024-03-13T04:58:43.179Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1522060 -> 1548402
10152024-03-13T04:58:44.251Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log
10162024-03-13T04:58:44.251Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (882359 bytes)
10172024-03-13T04:58:45.749Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 882359 -> 905869
10182024-03-13T04:58:46.848Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log
10192024-03-13T04:58:46.873Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (1388 bytes)
10202024-03-13T04:58:47.946Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log
10212024-03-13T04:58:47.946Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (278470 bytes)
10222024-03-13T04:58:48.436Zupload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 278470 -> 286548
10232024-03-13T04:58:49.524Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log
10242024-03-13T04:58:49.525Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (617 bytes)
10252024-03-13T04:58:50.643Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log
10262024-03-13T04:58:50.643Zuploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (5393 bytes)
10272024-03-13T04:58:51.740Zuploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log
10282024-03-13T04:58:51.740Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_340ea411-015e-4310-9e09-f57902227991/root/var/svc/log/oxide-clickhouse:default.log (1385704 bytes)
10292024-03-13T04:58:53.913Zupload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_340ea411-015e-4310-9e09-f57902227991/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 1385704 -> 1468634
10302024-03-13T04:58:54.986Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_340ea411-015e-4310-9e09-f57902227991/root/var/svc/log/oxide-clickhouse:default.log
10312024-03-13T04:58:54.986Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_340ea411-015e-4310-9e09-f57902227991/root/var/svc/log/oxide-zone-network-setup:default.log (1714 bytes)
10322024-03-13T04:58:56.109Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_340ea411-015e-4310-9e09-f57902227991/root/var/svc/log/oxide-zone-network-setup:default.log
10332024-03-13T04:58:56.109Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e35710c2-0ad4-4310-b535-49fbc3b2e728/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
10342024-03-13T04:58:57.211Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e35710c2-0ad4-4310-b535-49fbc3b2e728/root/var/svc/log/oxide-cockroachdb:default.log
10352024-03-13T04:58:57.212Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e35710c2-0ad4-4310-b535-49fbc3b2e728/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
10362024-03-13T04:58:59.533Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_e35710c2-0ad4-4310-b535-49fbc3b2e728/root/var/svc/log/oxide-zone-network-setup:default.log
10372024-03-13T04:58:59.533Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_36c1813a-a91d-4925-a096-e92f2a0a83b6/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
10382024-03-13T04:59:00.694Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_36c1813a-a91d-4925-a096-e92f2a0a83b6/root/var/svc/log/oxide-crucible-agent:default.log
10392024-03-13T04:59:00.694Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_36c1813a-a91d-4925-a096-e92f2a0a83b6/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10402024-03-13T04:59:01.795Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_36c1813a-a91d-4925-a096-e92f2a0a83b6/root/var/svc/log/oxide-crucible-downstairs:default.log
10412024-03-13T04:59:01.820Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_36c1813a-a91d-4925-a096-e92f2a0a83b6/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
10422024-03-13T04:59:03.301Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_36c1813a-a91d-4925-a096-e92f2a0a83b6/root/var/svc/log/oxide-zone-network-setup:default.log
10432024-03-13T04:59:03.302Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_f8c19a73-6a0d-4acc-8ac0-70d1578cd442/root/var/svc/log/oxide-crucible-pantry:default.log (783 bytes)
10442024-03-13T04:59:04.417Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_f8c19a73-6a0d-4acc-8ac0-70d1578cd442/root/var/svc/log/oxide-crucible-pantry:default.log
10452024-03-13T04:59:04.417Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_f8c19a73-6a0d-4acc-8ac0-70d1578cd442/root/var/svc/log/oxide-zone-network-setup:default.log (1746 bytes)
10462024-03-13T04:59:05.522Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_f8c19a73-6a0d-4acc-8ac0-70d1578cd442/root/var/svc/log/oxide-zone-network-setup:default.log
10472024-03-13T04:59:05.522Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_eed3f3eb-69ed-4a60-b845-9b5af9f488d3/root/var/svc/log/oxide-external_dns:default.log (26863 bytes)
10482024-03-13T04:59:07.125Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_eed3f3eb-69ed-4a60-b845-9b5af9f488d3/root/var/svc/log/oxide-external_dns:default.log
10492024-03-13T04:59:07.126Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_eed3f3eb-69ed-4a60-b845-9b5af9f488d3/root/var/svc/log/oxide-opte-interface-setup:default.log (1188 bytes)
10502024-03-13T04:59:08.225Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_eed3f3eb-69ed-4a60-b845-9b5af9f488d3/root/var/svc/log/oxide-opte-interface-setup:default.log
10512024-03-13T04:59:08.226Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_eed3f3eb-69ed-4a60-b845-9b5af9f488d3/root/var/svc/log/oxide-zone-network-setup:default.log (1726 bytes)
10522024-03-13T04:59:09.325Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_eed3f3eb-69ed-4a60-b845-9b5af9f488d3/root/var/svc/log/oxide-zone-network-setup:default.log
10532024-03-13T04:59:09.325Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_615a9669-97b2-4c06-9ca1-f5cee9e02620/root/var/svc/log/oxide-internal_dns:default.log (106194 bytes)
10542024-03-13T04:59:11.581Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_615a9669-97b2-4c06-9ca1-f5cee9e02620/root/var/svc/log/oxide-internal_dns:default.log
10552024-03-13T04:59:11.581Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_615a9669-97b2-4c06-9ca1-f5cee9e02620/root/var/svc/log/oxide-zone-network-setup:default.log (1708 bytes)
10562024-03-13T04:59:12.275Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_615a9669-97b2-4c06-9ca1-f5cee9e02620/root/var/svc/log/oxide-zone-network-setup:default.log
10572024-03-13T04:59:12.275Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f0953b77-046f-4954-9588-57eed328d77a/root/var/svc/log/oxide-cockroachdb:default.log (4405 bytes)
10582024-03-13T04:59:13.376Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f0953b77-046f-4954-9588-57eed328d77a/root/var/svc/log/oxide-cockroachdb:default.log
10592024-03-13T04:59:13.376Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f0953b77-046f-4954-9588-57eed328d77a/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes)
10602024-03-13T04:59:14.493Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_f0953b77-046f-4954-9588-57eed328d77a/root/var/svc/log/oxide-zone-network-setup:default.log
10612024-03-13T04:59:14.494Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-agent:default.log (36368 bytes)
10622024-03-13T04:59:15.656Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-agent:default.log
10632024-03-13T04:59:15.656Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10642024-03-13T04:59:16.748Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:default.log
10652024-03-13T04:59:16.775Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:downstairs-9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6.log (5614 bytes)
10662024-03-13T04:59:17.841Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:downstairs-9c6a2f6e-2ba9-4cf3-88b4-656bae85bee6.log
10672024-03-13T04:59:18.271Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:downstairs-ce033bfe-9230-4d19-a9d2-912a765ad2ca.log (3124 bytes)
10682024-03-13T04:59:18.946Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:downstairs-ce033bfe-9230-4d19-a9d2-912a765ad2ca.log
10692024-03-13T04:59:18.946Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:downstairs-dedd7bc4-90c2-48f0-96ae-93981d75768b.log (5695 bytes)
10702024-03-13T04:59:20.068Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:downstairs-dedd7bc4-90c2-48f0-96ae-93981d75768b.log
10712024-03-13T04:59:20.093Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:snapshot-dedd7bc4-90c2-48f0-96ae-93981d75768b-6c125d2f-b8d1-4fdb-bccf-20213af38f6d.log (5303 bytes)
10722024-03-13T04:59:21.596Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-crucible-downstairs:snapshot-dedd7bc4-90c2-48f0-96ae-93981d75768b-6c125d2f-b8d1-4fdb-bccf-20213af38f6d.log
10732024-03-13T04:59:21.596Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
10742024-03-13T04:59:22.303Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3510780b-aa00-4979-b27b-0a2d8da59e0a/root/var/svc/log/oxide-zone-network-setup:default.log
10752024-03-13T04:59:22.303Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_62e81a8e-9f5e-4f8b-ab77-1b6098b89825/root/var/svc/log/oxide-external_dns:default.log (26870 bytes)
10762024-03-13T04:59:22.418Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_62e81a8e-9f5e-4f8b-ab77-1b6098b89825/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26870 -> 30647
10772024-03-13T04:59:23.504Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_62e81a8e-9f5e-4f8b-ab77-1b6098b89825/root/var/svc/log/oxide-external_dns:default.log
10782024-03-13T04:59:23.505Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_62e81a8e-9f5e-4f8b-ab77-1b6098b89825/root/var/svc/log/oxide-opte-interface-setup:default.log (1187 bytes)
10792024-03-13T04:59:24.617Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_62e81a8e-9f5e-4f8b-ab77-1b6098b89825/root/var/svc/log/oxide-opte-interface-setup:default.log
10802024-03-13T04:59:24.617Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_62e81a8e-9f5e-4f8b-ab77-1b6098b89825/root/var/svc/log/oxide-zone-network-setup:default.log (1726 bytes)
10812024-03-13T04:59:26.175Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_62e81a8e-9f5e-4f8b-ab77-1b6098b89825/root/var/svc/log/oxide-zone-network-setup:default.log
10822024-03-13T04:59:26.207Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_69e66ea6-9cdf-49f5-aa83-36e00f886d4b/root/var/svc/log/oxide-internal_dns:default.log (106205 bytes)
10832024-03-13T04:59:26.519Zupload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_69e66ea6-9cdf-49f5-aa83-36e00f886d4b/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 106205 -> 109957
10842024-03-13T04:59:27.623Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_69e66ea6-9cdf-49f5-aa83-36e00f886d4b/root/var/svc/log/oxide-internal_dns:default.log
10852024-03-13T04:59:27.623Zuploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_69e66ea6-9cdf-49f5-aa83-36e00f886d4b/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
10862024-03-13T04:59:28.726Zuploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_69e66ea6-9cdf-49f5-aa83-36e00f886d4b/root/var/svc/log/oxide-zone-network-setup:default.log
10872024-03-13T04:59:28.726Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_16bef80b-4497-4091-b795-b5147cfeb79c/root/var/svc/log/oxide-cockroachdb:default.log (4381 bytes)
10882024-03-13T04:59:29.833Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_16bef80b-4497-4091-b795-b5147cfeb79c/root/var/svc/log/oxide-cockroachdb:default.log
10892024-03-13T04:59:29.833Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_16bef80b-4497-4091-b795-b5147cfeb79c/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
10902024-03-13T04:59:30.927Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_16bef80b-4497-4091-b795-b5147cfeb79c/root/var/svc/log/oxide-zone-network-setup:default.log
10912024-03-13T04:59:30.927Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_8a65210f-4483-492e-bc36-138d2fd14051/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
10922024-03-13T04:59:32.382Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_8a65210f-4483-492e-bc36-138d2fd14051/root/var/svc/log/oxide-crucible-agent:default.log
10932024-03-13T04:59:32.382Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_8a65210f-4483-492e-bc36-138d2fd14051/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
10942024-03-13T04:59:33.490Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_8a65210f-4483-492e-bc36-138d2fd14051/root/var/svc/log/oxide-crucible-downstairs:default.log
10952024-03-13T04:59:33.490Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_8a65210f-4483-492e-bc36-138d2fd14051/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
10962024-03-13T04:59:34.582Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_8a65210f-4483-492e-bc36-138d2fd14051/root/var/svc/log/oxide-zone-network-setup:default.log
10972024-03-13T04:59:34.582Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_008b60d6-d8b4-4d18-b06a-f3d5490b3230/root/var/svc/log/oxide-internal_dns:default.log (107816 bytes)
10982024-03-13T04:59:34.930Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_008b60d6-d8b4-4d18-b06a-f3d5490b3230/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 107816 -> 111569
10992024-03-13T04:59:36.012Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_008b60d6-d8b4-4d18-b06a-f3d5490b3230/root/var/svc/log/oxide-internal_dns:default.log
11002024-03-13T04:59:36.012Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_008b60d6-d8b4-4d18-b06a-f3d5490b3230/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
11012024-03-13T04:59:37.108Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_008b60d6-d8b4-4d18-b06a-f3d5490b3230/root/var/svc/log/oxide-zone-network-setup:default.log
11022024-03-13T04:59:37.109Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_05ec9f59-db4e-4734-8295-85ee1e1f4c08/root/var/svc/log/oxide-oximeter:default.log (298048 bytes)
11032024-03-13T04:59:38.360Zupload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_05ec9f59-db4e-4734-8295-85ee1e1f4c08/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 298048 -> 352257
11042024-03-13T04:59:39.448Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_05ec9f59-db4e-4734-8295-85ee1e1f4c08/root/var/svc/log/oxide-oximeter:default.log
11052024-03-13T04:59:39.448Zuploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_05ec9f59-db4e-4734-8295-85ee1e1f4c08/root/var/svc/log/oxide-zone-network-setup:default.log (1702 bytes)
11062024-03-13T04:59:52.481Zuploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_05ec9f59-db4e-4734-8295-85ee1e1f4c08/root/var/svc/log/oxide-zone-network-setup:default.log
11072024-03-13T04:59:52.481Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_891ec291-a154-4e9a-b484-c05219c7ab52/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
11082024-03-13T04:59:52.481Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_891ec291-a154-4e9a-b484-c05219c7ab52/root/var/svc/log/oxide-cockroachdb:default.log
11092024-03-13T04:59:52.481Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_891ec291-a154-4e9a-b484-c05219c7ab52/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
11102024-03-13T04:59:53.161Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_891ec291-a154-4e9a-b484-c05219c7ab52/root/var/svc/log/oxide-zone-network-setup:default.log
11112024-03-13T04:59:53.161Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_b20d1a12-9adc-48c2-a39c-00be3468ee57/root/var/svc/log/oxide-crucible-agent:default.log (1327 bytes)
11122024-03-13T04:59:54.239Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_b20d1a12-9adc-48c2-a39c-00be3468ee57/root/var/svc/log/oxide-crucible-agent:default.log
11132024-03-13T04:59:54.240Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_b20d1a12-9adc-48c2-a39c-00be3468ee57/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11142024-03-13T04:59:55.339Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_b20d1a12-9adc-48c2-a39c-00be3468ee57/root/var/svc/log/oxide-crucible-downstairs:default.log
11152024-03-13T04:59:55.339Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_b20d1a12-9adc-48c2-a39c-00be3468ee57/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
11162024-03-13T04:59:55.747ZError: No response to keepalive - Terminating session
11172024-03-13T04:59:56.432Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_b20d1a12-9adc-48c2-a39c-00be3468ee57/root/var/svc/log/oxide-zone-network-setup:default.log
11182024-03-13T04:59:56.457Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_24d8c7e8-c65a-4393-9f69-957caf4c073f/root/var/svc/log/oxide-cockroachdb:default.log (4407 bytes)
11192024-03-13T04:59:57.535Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_24d8c7e8-c65a-4393-9f69-957caf4c073f/root/var/svc/log/oxide-cockroachdb:default.log
11202024-03-13T04:59:57.535Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_24d8c7e8-c65a-4393-9f69-957caf4c073f/root/var/svc/log/oxide-zone-network-setup:default.log (1709 bytes)
11212024-03-13T04:59:59.036Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_24d8c7e8-c65a-4393-9f69-957caf4c073f/root/var/svc/log/oxide-zone-network-setup:default.log
11222024-03-13T04:59:59.036Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-agent:default.log (22725 bytes)
11232024-03-13T05:00:00.202Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-agent:default.log
11242024-03-13T05:00:00.202Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11252024-03-13T05:00:01.715Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-downstairs:default.log
11262024-03-13T05:00:01.715Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-downstairs:downstairs-01a925fb-7184-45cf-b127-79cbd073ee1e.log (5608 bytes)
11272024-03-13T05:00:01.750Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-downstairs:downstairs-01a925fb-7184-45cf-b127-79cbd073ee1e.log" changed size mid upload: 5608 -> 0
11282024-03-13T05:00:02.825Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-downstairs:downstairs-01a925fb-7184-45cf-b127-79cbd073ee1e.log
11292024-03-13T05:00:02.825Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-downstairs:downstairs-968a1a98-6148-4551-a5ca-160d7a74bbe0.log (3124 bytes)
11302024-03-13T05:00:02.860Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-downstairs:downstairs-968a1a98-6148-4551-a5ca-160d7a74bbe0.log" changed size mid upload: 3124 -> 0
11312024-03-13T05:00:03.932Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-crucible-downstairs:downstairs-968a1a98-6148-4551-a5ca-160d7a74bbe0.log
11322024-03-13T05:00:03.932Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
11332024-03-13T05:00:03.964Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1703 -> 0
11342024-03-13T05:00:05.040Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_fb90c97d-7de4-4022-b4f1-be1904778459/root/var/svc/log/oxide-zone-network-setup:default.log
11352024-03-13T05:00:05.040Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-nexus:default.log (1953279 bytes)
11362024-03-13T05:00:05.546Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1953279 -> 12455
11372024-03-13T05:00:05.743ZError: No response de-activating SOL payload
11382024-03-13T05:00:06.643Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-nexus:default.log
11392024-03-13T05:00:06.643Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-opte-interface-setup:default.log (1167 bytes)
11402024-03-13T05:00:06.729Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1167 -> 0
11412024-03-13T05:00:06.861Z[SOL Session operational. Use ~? for help]
11422024-03-13T05:00:07.813Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-opte-interface-setup:default.log
11432024-03-13T05:00:07.813Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-zone-network-setup:default.log (1683 bytes)
11442024-03-13T05:00:07.840Zupload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1683 -> 0
11452024-03-13T05:00:08.914Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_d798d81a-4c8a-4b2f-99a0-a7f78ebf55dd/root/var/svc/log/oxide-zone-network-setup:default.log
11462024-03-13T05:00:08.914Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-agent:default.log (25687 bytes)
11472024-03-13T05:00:08.941Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 25687 -> 0
11482024-03-13T05:00:10.016Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-agent:default.log
11492024-03-13T05:00:10.041Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11502024-03-13T05:00:10.041Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
11512024-03-13T05:00:11.133Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:default.log
11522024-03-13T05:00:11.134Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c2f4d3a-bb6c-41f0-a566-84dd10f65b5c.log (5692 bytes)
11532024-03-13T05:00:11.161Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c2f4d3a-bb6c-41f0-a566-84dd10f65b5c.log" changed size mid upload: 5692 -> 0
11542024-03-13T05:00:12.637Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c2f4d3a-bb6c-41f0-a566-84dd10f65b5c.log
11552024-03-13T05:00:12.637Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:downstairs-b6611e40-2e15-4fcf-af03-388776f5ba32.log (5612 bytes)
11562024-03-13T05:00:12.662Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:downstairs-b6611e40-2e15-4fcf-af03-388776f5ba32.log" changed size mid upload: 5612 -> 0
11572024-03-13T05:00:13.735Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:downstairs-b6611e40-2e15-4fcf-af03-388776f5ba32.log
11582024-03-13T05:00:13.735Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:snapshot-2c2f4d3a-bb6c-41f0-a566-84dd10f65b5c-6c125d2f-b8d1-4fdb-bccf-20213af38f6d.log (5305 bytes)
11592024-03-13T05:00:13.760Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:snapshot-2c2f4d3a-bb6c-41f0-a566-84dd10f65b5c-6c125d2f-b8d1-4fdb-bccf-20213af38f6d.log" changed size mid upload: 5305 -> 0
11602024-03-13T05:00:14.837Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-crucible-downstairs:snapshot-2c2f4d3a-bb6c-41f0-a566-84dd10f65b5c-6c125d2f-b8d1-4fdb-bccf-20213af38f6d.log
11612024-03-13T05:00:14.837Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
11622024-03-13T05:00:14.869Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1703 -> 0
11632024-03-13T05:00:15.987Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_571e2cd1-4997-4816-897c-36a5ef05150b/root/var/svc/log/oxide-zone-network-setup:default.log
11642024-03-13T05:00:15.988Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_025aaad9-fa6b-410f-a5f6-1c1c47c46cf7/root/var/svc/log/oxide-crucible-pantry:default.log (1215272 bytes)
11652024-03-13T05:00:16.021Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_025aaad9-fa6b-410f-a5f6-1c1c47c46cf7/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 1215272 -> 0
11662024-03-13T05:00:17.094Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_025aaad9-fa6b-410f-a5f6-1c1c47c46cf7/root/var/svc/log/oxide-crucible-pantry:default.log
11672024-03-13T05:00:17.094Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_025aaad9-fa6b-410f-a5f6-1c1c47c46cf7/root/var/svc/log/oxide-zone-network-setup:default.log (1744 bytes)
11682024-03-13T05:00:17.127Zupload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_025aaad9-fa6b-410f-a5f6-1c1c47c46cf7/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1744 -> 0
11692024-03-13T05:00:18.518Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_025aaad9-fa6b-410f-a5f6-1c1c47c46cf7/root/var/svc/log/oxide-zone-network-setup:default.log
11702024-03-13T05:00:18.518Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-agent:default.log (7689 bytes)
11712024-03-13T05:00:18.518Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 7689 -> 0
11722024-03-13T05:00:19.321Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-agent:default.log
11732024-03-13T05:00:19.321Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
11742024-03-13T05:00:19.820Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
11752024-03-13T05:00:20.415Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-downstairs:default.log
11762024-03-13T05:00:20.415Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-downstairs:downstairs-84170123-351f-4f9b-91d4-f50b6d310862.log (3019 bytes)
11772024-03-13T05:00:20.441Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-downstairs:downstairs-84170123-351f-4f9b-91d4-f50b6d310862.log" changed size mid upload: 3019 -> 0
11782024-03-13T05:00:21.533Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-crucible-downstairs:downstairs-84170123-351f-4f9b-91d4-f50b6d310862.log
11792024-03-13T05:00:21.533Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-zone-network-setup:default.log (1703 bytes)
11802024-03-13T05:00:21.563Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1703 -> 0
11812024-03-13T05:00:22.641Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_12924109-8fb2-4608-85e4-921cb9c1ac43/root/var/svc/log/oxide-zone-network-setup:default.log
11822024-03-13T05:00:22.642Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_6778525f-f783-40e2-a9f8-9912dff07f97/root/var/svc/log/oxide-crucible-pantry:default.log (781 bytes)
11832024-03-13T05:00:22.687Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_6778525f-f783-40e2-a9f8-9912dff07f97/root/var/svc/log/oxide-crucible-pantry:default.log" changed size mid upload: 781 -> 0
11842024-03-13T05:00:23.740Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_6778525f-f783-40e2-a9f8-9912dff07f97/root/var/svc/log/oxide-crucible-pantry:default.log
11852024-03-13T05:00:23.741Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_6778525f-f783-40e2-a9f8-9912dff07f97/root/var/svc/log/oxide-zone-network-setup:default.log (1746 bytes)
11862024-03-13T05:00:23.765Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_6778525f-f783-40e2-a9f8-9912dff07f97/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1746 -> 0
11872024-03-13T05:00:24.844Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_6778525f-f783-40e2-a9f8-9912dff07f97/root/var/svc/log/oxide-zone-network-setup:default.log
11882024-03-13T05:00:24.844Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-nexus:default.log (1277879 bytes)
11892024-03-13T05:00:25.246Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1277879 -> 81681
11902024-03-13T05:00:26.328Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-nexus:default.log
11912024-03-13T05:00:26.328Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-opte-interface-setup:default.log (1167 bytes)
11922024-03-13T05:00:26.361Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1167 -> 0
11932024-03-13T05:00:27.445Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-opte-interface-setup:default.log
11942024-03-13T05:00:27.445Zuploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-zone-network-setup:default.log (1682 bytes)
11952024-03-13T05:00:27.477Zupload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1682 -> 0
11962024-03-13T05:00:28.565Zuploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_fc1b1f72-cd47-46c1-810c-f9761356930c/root/var/svc/log/oxide-zone-network-setup:default.log
11972024-03-13T05:00:28.565Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-agent:default.log (17934 bytes)
11982024-03-13T05:00:28.594Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 17934 -> 0
11992024-03-13T05:00:29.675Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-agent:default.log
12002024-03-13T05:00:29.675Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12012024-03-13T05:00:29.708Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
12022024-03-13T05:00:31.239Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:default.log
12032024-03-13T05:00:31.264Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c1e37ba-553c-4e23-86f0-05ed5e075534.log (3125 bytes)
12042024-03-13T05:00:31.292Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c1e37ba-553c-4e23-86f0-05ed5e075534.log" changed size mid upload: 3125 -> 0
12052024-03-13T05:00:32.342Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c1e37ba-553c-4e23-86f0-05ed5e075534.log
12062024-03-13T05:00:32.376Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:downstairs-8d21f3d7-4510-4db1-9a29-a5a57f6d2a82.log (3020 bytes)
12072024-03-13T05:00:32.376Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:downstairs-8d21f3d7-4510-4db1-9a29-a5a57f6d2a82.log" changed size mid upload: 3020 -> 0
12082024-03-13T05:00:33.449Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-crucible-downstairs:downstairs-8d21f3d7-4510-4db1-9a29-a5a57f6d2a82.log
12092024-03-13T05:00:33.449Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
12102024-03-13T05:00:33.486Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1704 -> 0
12112024-03-13T05:00:34.561Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_a676d038-a560-4b5a-aa4b-0a36d9317152/root/var/svc/log/oxide-zone-network-setup:default.log
12122024-03-13T05:00:34.561Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-ntp:default.log (977 bytes)
12132024-03-13T05:00:35.012Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-ntp:default.log" changed size mid upload: 977 -> 0
12142024-03-13T05:00:36.098Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-ntp:default.log
12152024-03-13T05:00:36.098Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-opte-interface-setup:default.log (1158 bytes)
12162024-03-13T05:00:36.122Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1158 -> 0
12172024-03-13T05:00:37.204Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-opte-interface-setup:default.log
12182024-03-13T05:00:37.204Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-zone-network-setup:default.log (1664 bytes)
12192024-03-13T05:00:37.228Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1664 -> 0
12202024-03-13T05:00:38.307Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/svc/log/oxide-zone-network-setup:default.log
12212024-03-13T05:00:38.308Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-agent:default.log (21374 bytes)
12222024-03-13T05:00:38.340Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-agent:default.log" changed size mid upload: 21374 -> 0
12232024-03-13T05:00:39.426Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-agent:default.log
12242024-03-13T05:00:39.426Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes)
12252024-03-13T05:00:39.458Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:default.log" changed size mid upload: 75 -> 0
12262024-03-13T05:00:40.524Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:default.log
12272024-03-13T05:00:40.550Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:downstairs-db83f827-7d85-48cc-8d3c-490becc67c1d.log (3020 bytes)
12282024-03-13T05:00:40.550Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:downstairs-db83f827-7d85-48cc-8d3c-490becc67c1d.log" changed size mid upload: 3020 -> 0
12292024-03-13T05:00:41.617Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:downstairs-db83f827-7d85-48cc-8d3c-490becc67c1d.log
12302024-03-13T05:00:41.617Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:downstairs-e6c0780f-06af-4142-89de-d705a97d6f68.log (5690 bytes)
12312024-03-13T05:00:41.643Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:downstairs-e6c0780f-06af-4142-89de-d705a97d6f68.log" changed size mid upload: 5690 -> 0
12322024-03-13T05:00:42.724Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:downstairs-e6c0780f-06af-4142-89de-d705a97d6f68.log
12332024-03-13T05:00:42.724Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:snapshot-e6c0780f-06af-4142-89de-d705a97d6f68-6c125d2f-b8d1-4fdb-bccf-20213af38f6d.log (5302 bytes)
12342024-03-13T05:00:42.755Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:snapshot-e6c0780f-06af-4142-89de-d705a97d6f68-6c125d2f-b8d1-4fdb-bccf-20213af38f6d.log" changed size mid upload: 5302 -> 0
12352024-03-13T05:00:43.828Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-crucible-downstairs:snapshot-e6c0780f-06af-4142-89de-d705a97d6f68-6c125d2f-b8d1-4fdb-bccf-20213af38f6d.log
12362024-03-13T05:00:43.828Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-zone-network-setup:default.log (1704 bytes)
12372024-03-13T05:00:43.852Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1704 -> 0
12382024-03-13T05:00:44.923Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e3e68004-3d78-4f80-988e-5f96af4f9b02/root/var/svc/log/oxide-zone-network-setup:default.log
12392024-03-13T05:00:44.923Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-nexus:default.log (38533907 bytes)
12402024-03-13T05:00:45.246Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 38533907 -> 91320
12412024-03-13T05:00:46.741Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-nexus:default.log
12422024-03-13T05:00:46.741Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-opte-interface-setup:default.log (1166 bytes)
12432024-03-13T05:00:46.790Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-opte-interface-setup:default.log" changed size mid upload: 1166 -> 0
12442024-03-13T05:00:47.883Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-opte-interface-setup:default.log
12452024-03-13T05:00:47.909Zuploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-zone-network-setup:default.log (1684 bytes)
12462024-03-13T05:00:47.909Zupload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-zone-network-setup:default.log" changed size mid upload: 1684 -> 0
12472024-03-13T05:00:49.002Zuploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_624690b4-cee6-4070-81e8-611b39bdcdb3/root/var/svc/log/oxide-zone-network-setup:default.log
12482024-03-13T05:00:49.003Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/measurements.log (20002 bytes)
12492024-03-13T05:00:49.146Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/measurements.log" changed size mid upload: 20002 -> 24797
12502024-03-13T05:00:50.662Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/measurements.log
12512024-03-13T05:00:50.662Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/statistics.log (13104 bytes)
12522024-03-13T05:00:50.772Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/statistics.log" changed size mid upload: 13104 -> 17433
12532024-03-13T05:00:51.855Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/statistics.log
12542024-03-13T05:00:51.884Zuploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/tracking.log (1985 bytes)
12552024-03-13T05:00:51.909Zupload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/tracking.log" changed size mid upload: 1985 -> 2249
12562024-03-13T05:00:52.975Zuploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_483f2279-0a3f-444e-ac3d-24db30026ca5/root/var/log/chrony/tracking.log