01HD7KEHA1TATY5AB7EXTQNAS8: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-sled-agent:default.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.25",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01HD7KET11D87SKMQWRQV2373Y

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12023-10-20T22:31:53.991Zjob dependencies complete; ready to run (waiting for 0 s)
22023-10-20T22:32:40.321Zjob assigned to worker 01HD7KF0T1G1PZ2DJMJRWPKD54 (queued for 46 s)
32023-10-20T22:32:40.785Zhttp://172.20.0.5:9969/ipxe/sock... ok
42023-10-20T22:32:40.911Zxcvsh0tfvd xcvsh0tfvd xcvsh0tfvd xcvsh0tfvd xcvsh0tfvd xcvsh0tfvd xcvsh0tfvd xcvsh0tfvd
52023-10-20T22:32:40.955Zhttp://172.20.0.5:9969/ipxe/sock... ok
62023-10-20T22:32:40.989Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
72023-10-20T22:32:41.022Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
82023-10-20T22:32:41.056Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
92023-10-20T22:32:41.089Zhttp://172.20.0.5:9969/postboot/sock... ok
102023-10-20T22:32:41.123ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
112023-10-20T22:32:41.161Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d1
122023-10-20T22:32:41.197ZOxide Helios Version helios-2.0.22241 64-bit
132023-10-20T22:32:41.235ZConfiguring devices.
142023-10-20T22:32:41.273Z##################################################
152023-10-20T22:32:41.313Z#### ############# ##
162023-10-20T22:32:41.347Z### ### ############ ##
172023-10-20T22:32:41.386Z## ### # ## ### ## Oxide Computer Company ##
182023-10-20T22:32:41.424Z## ## ## ### # ### ##
192023-10-20T22:32:41.457Z## # ### #### #### This Station Under ##
202023-10-20T22:32:41.491Z### ### #### # ### Computer Control ##
212023-10-20T22:32:41.525Z#### #### ### ## ##
222023-10-20T22:32:41.558Z##################################################
232023-10-20T22:32:41.591ZHostname: sock
242023-10-20T22:32:41.624ZLoading smf(7) serice descriptions:
252023-10-20T22:32:41.948Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-bff296622eee022c.gz
262023-10-20T22:32:43.396Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-bff296622eee022c.gz
272023-10-20T22:32:43.420Zdownloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
282023-10-20T22:33:00.702Zdownloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz
292023-10-20T22:33:00.738Zdownloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-066d0e625cf05e06.gz
302023-10-20T22:33:22.374Zdownloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-066d0e625cf05e06.gz
312023-10-20T22:33:22.398Zdownloading input: /input/ci-tools/work/caboose-util.gz
322023-10-20T22:33:23.375Zdownloaded input: /input/ci-tools/work/caboose-util.gz
332023-10-20T22:33:23.405Zdownloading input: /input/ci-tools/work/tufaceous.gz
342023-10-20T22:33:27.086Zdownloaded input: /input/ci-tools/work/tufaceous.gz
352023-10-20T22:33:27.110Zdownloading input: /input/package/work/version.txt
362023-10-20T22:33:27.134Zdownloaded input: /input/package/work/version.txt
372023-10-20T22:33:27.163Zdownloading input: /input/package/work/package.tar.gz
382023-10-20T22:33:41.482Zdownloaded input: /input/package/work/package.tar.gz
392023-10-20T22:33:41.510Zdownloading input: /input/package/work/global-zone-packages.tar.gz
402023-10-20T22:34:02.771Zdownloaded input: /input/package/work/global-zone-packages.tar.gz
412023-10-20T22:34:02.795Zdownloading input: /input/package/work/trampoline-global-zone-packages.tar.gz
422023-10-20T22:34:09.591Zdownloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz
432023-10-20T22:34:09.616Zdownloading input: /input/package/work/zones/clickhouse.tar.gz
442023-10-20T22:34:39.840Zdownloaded input: /input/package/work/zones/clickhouse.tar.gz
452023-10-20T22:34:39.863Zdownloading input: /input/package/work/zones/clickhouse_keeper.tar.gz
462023-10-20T22:35:10.820Zdownloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz
472023-10-20T22:35:10.844Zdownloading input: /input/package/work/zones/cockroachdb.tar.gz
482023-10-20T22:35:31.121Zdownloaded input: /input/package/work/zones/cockroachdb.tar.gz
492023-10-20T22:35:31.145Zdownloading input: /input/package/work/zones/crucible-pantry.tar.gz
502023-10-20T22:35:35.204Zdownloaded input: /input/package/work/zones/crucible-pantry.tar.gz
512023-10-20T22:35:35.228Zdownloading input: /input/package/work/zones/crucible.tar.gz
522023-10-20T22:35:42.389Zdownloaded input: /input/package/work/zones/crucible.tar.gz
532023-10-20T22:35:42.413Zdownloading input: /input/package/work/zones/external-dns.tar.gz
542023-10-20T22:35:46.305Zdownloaded input: /input/package/work/zones/external-dns.tar.gz
552023-10-20T22:35:46.376Zdownloading input: /input/package/work/zones/internal-dns.tar.gz
562023-10-20T22:35:50.260Zdownloaded input: /input/package/work/zones/internal-dns.tar.gz
572023-10-20T22:35:50.284Zdownloading input: /input/package/work/zones/ntp.tar.gz
582023-10-20T22:35:50.362Zdownloaded input: /input/package/work/zones/ntp.tar.gz
592023-10-20T22:35:50.387Zdownloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz
602023-10-20T22:35:53.284Zdownloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz
612023-10-20T22:35:53.307Zdownloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
622023-10-20T22:35:56.439Zdownloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz
632023-10-20T22:35:56.463Zdownloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
642023-10-20T22:36:09.437Zdownloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz
652023-10-20T22:36:09.462Zdownloading input: /input/package/work/zones/omicron-nexus.tar.gz
662023-10-20T22:36:22.287Zdownloaded input: /input/package/work/zones/omicron-nexus.tar.gz
672023-10-20T22:36:22.311Zdownloading input: /input/package/work/zones/overlay.tar.gz
682023-10-20T22:36:22.403Zdownloaded input: /input/package/work/zones/overlay.tar.gz
692023-10-20T22:36:22.428Zdownloading input: /input/package/work/zones/oximeter-collector.tar.gz
702023-10-20T22:36:25.760Zdownloaded input: /input/package/work/zones/oximeter-collector.tar.gz
712023-10-20T22:36:25.785Zdownloading input: /input/package/work/zones/propolis-server.tar.gz
722023-10-20T22:36:37.312Zdownloaded input: /input/package/work/zones/propolis-server.tar.gz
732023-10-20T22:36:37.338Zdownloading input: /input/package/work/zones/switch-asic.tar.gz
742023-10-20T22:37:17.885Zdownloaded input: /input/package/work/zones/switch-asic.tar.gz
752023-10-20T22:37:17.910Zdownloading input: /input/package/work/zones/switch-softnpu.tar.gz
762023-10-20T22:37:43.378Zdownloaded input: /input/package/work/zones/switch-softnpu.tar.gz
 
772023-10-20T22:37:43.402Zstarting task 0: "setup"
782023-10-20T22:37:43.435Z++ uname -s
792023-10-20T22:37:43.458Z+ kern=SunOS
802023-10-20T22:37:43.482Z+ case "$kern" in
812023-10-20T22:37:43.505Z+ groupadd -g 12345 build
822023-10-20T22:37:43.559Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
832023-10-20T22:37:45.444Z+ zfs create -o mountpoint=/work rpool/work
842023-10-20T22:37:45.468Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
852023-10-20T22:37:45.492Z+ home_fs=zfs
862023-10-20T22:37:45.516Z+ [[ zfs == autofs ]]
872023-10-20T22:37:45.539Z+ mkdir -p /home/build
882023-10-20T22:37:45.563Z+ chown build:build /home/build /work
892023-10-20T22:37:47.472Z+ chmod 0700 /home/build /work
902023-10-20T22:37:47.543Zprocess exited: duration 4050 ms, exit code 0
 
912023-10-20T22:37:47.649Zstarting task 1: "authentication"
922023-10-20T22:37:47.778Zprocess exited: duration 105 ms, exit code 0
 
932023-10-20T22:37:47.837Zstarting task 2: "build"
942023-10-20T22:37:47.918Z+ trap _exit_trap EXIT
952023-10-20T22:37:47.942Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
962023-10-20T22:37:48.070Zsecpolicy_fs_linkdir: 0x55 = 0x55
972023-10-20T22:37:48.095Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
982023-10-20T22:37:48.118Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
992023-10-20T22:37:48.146Zsecpolicy_fs_linkdir+3: 0 = 0xe5
1002023-10-20T22:37:48.169Zsecpolicy_fs_linkdir+4: 0 = 0xb8
1012023-10-20T22:37:48.193Zsecpolicy_fs_linkdir+5: 0 = 0x1
1022023-10-20T22:37:48.217Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
1032023-10-20T22:37:48.240Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
1042023-10-20T22:37:48.263Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
1052023-10-20T22:37:48.287Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
1062023-10-20T22:37:48.313Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
1072023-10-20T22:37:48.337Z+ [[ -d /opt/oxide ]]
1082023-10-20T22:37:48.361Z+ pfexec mv /opt/oxide /opt/oxide-underneath
1092023-10-20T22:37:48.385Z+ pfexec mkdir /opt/oxide
1102023-10-20T22:37:48.409Z+ pfexec mount -F tmpfs -O swap /opt/oxide
1112023-10-20T22:37:48.433Z+ [[ -d /opt/oxide-underneath ]]
1122023-10-20T22:37:48.456Z+ cd /opt/oxide-underneath
1132023-10-20T22:37:48.489Z+ pfexec tar ceEp@/f - .
1142023-10-20T22:37:48.514Z+ cd /opt/oxide
1152023-10-20T22:37:48.537Z+ pfexec tar xveEp@/f -
1162023-10-20T22:37:48.561Zx ., 0 bytes, 0 tape blocks
1172023-10-20T22:37:48.584Zx ./opte, 0 bytes, 0 tape blocks
1182023-10-20T22:37:48.609Zx ./opte/bin, 0 bytes, 0 tape blocks
1192023-10-20T22:37:48.632Zx ./opte/bin/opteadm, 50714832 bytes, 99053 tape blocks
1202023-10-20T22:37:48.655Z+ pfexec rm -rf /opt/oxide-underneath
1212023-10-20T22:37:48.679Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
1222023-10-20T22:37:48.702Z+ pfexec mkdir /opt/oxide/work
1232023-10-20T22:37:48.726Z+ pfexec chown build:build /opt/oxide/work
1242023-10-20T22:37:48.749Z+ cd /opt/oxide/work
1252023-10-20T22:37:48.806Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
1262023-10-20T22:37:49.836ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
1272023-10-20T22:37:49.862Zx out/maghemite.tar, 74957312 bytes, 146401 tape blocks
1282023-10-20T22:37:49.898Zx out/omicron-sled-agent.tar, 113740800 bytes, 222150 tape blocks
1292023-10-20T22:37:49.922Zx out/target/test, 75 bytes, 1 tape blocks
1302023-10-20T22:37:49.945Zx out/npuzone/npuzone, 37379944 bytes, 73008 tape blocks
1312023-10-20T22:37:49.969Zx package-manifest.toml, 21303 bytes, 42 tape blocks
1322023-10-20T22:37:49.992Zx smf/sled-agent/non-gimlet/config.toml, 3097 bytes, 7 tape blocks
1332023-10-20T22:37:50.016Zx target/release/omicron-package, 38093728 bytes, 74402 tape blocks
1342023-10-20T22:37:50.040Zx tools/create_virtual_hardware.sh, 2818 bytes, 6 tape blocks
1352023-10-20T22:37:50.063Zx tools/virtual_hardware.sh, 3408 bytes, 7 tape blocks
1362023-10-20T22:37:50.087Zx tools/scrimlet/create-softnpu-zone.sh, 619 bytes, 2 tape blocks
1372023-10-20T22:37:50.110Zx tools/scrimlet/destroy-softnpu-zone.sh, 195 bytes, 1 tape blocks
1382023-10-20T22:37:50.135Zx tools/scrimlet/softnpu-init.sh, 2148 bytes, 5 tape blocks
1392023-10-20T22:37:50.159Zx tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks
1402023-10-20T22:37:50.182Zx tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks
1412023-10-20T22:37:50.214Z
1422023-10-20T22:37:50.237Zreal 1.602196037
1432023-10-20T22:37:50.261Zuser 1.443321058
1442023-10-20T22:37:50.290Zsys 0.279526241
1452023-10-20T22:37:50.323Ztrap 0.000063139
1462023-10-20T22:37:50.349Ztflt 0.000000000
1472023-10-20T22:37:50.386Zdflt 0.000000000
1482023-10-20T22:37:50.411Zkflt 0.000000000
1492023-10-20T22:37:50.436Zlock 0.000000000
1502023-10-20T22:37:50.460Zslp 1.441648123
1512023-10-20T22:37:50.483Zlat 0.037845641
1522023-10-20T22:37:50.506Zstop 0.000120801
1532023-10-20T22:37:50.530Z+ cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter-collector.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/
1542023-10-20T22:37:50.832Z+ mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz
1552023-10-20T22:37:50.857Z+ mkdir tests
1562023-10-20T22:37:50.881Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1572023-10-20T22:37:50.923Z+ ptime -m gunzip
1582023-10-20T22:37:50.946Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-bff296622eee022c
1592023-10-20T22:37:50.986Z
1602023-10-20T22:37:51.010Zreal 0.137376133
1612023-10-20T22:37:51.033Zuser 0.126997556
1622023-10-20T22:37:51.057Zsys 0.010120692
1632023-10-20T22:37:51.080Ztrap 0.000012830
1642023-10-20T22:37:51.104Ztflt 0.000000000
1652023-10-20T22:37:51.128Zdflt 0.000000000
1662023-10-20T22:37:51.151Zkflt 0.000000000
1672023-10-20T22:37:51.175Zlock 0.000000000
1682023-10-20T22:37:51.199Zslp 0.000023530
1692023-10-20T22:37:51.222Zlat 0.000022550
1702023-10-20T22:37:51.246Zstop 0.000135891
1712023-10-20T22:37:51.270Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-bff296622eee022c
1722023-10-20T22:37:51.293Z+ chmod a+x tests/bootstrap-bff296622eee022c
1732023-10-20T22:37:51.317Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1742023-10-20T22:37:51.341Z+ ptime -m gunzip
1752023-10-20T22:37:51.365Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1762023-10-20T22:37:53.224Z
1772023-10-20T22:37:53.247Zreal 2.226809106
1782023-10-20T22:37:53.271Zuser 2.082534710
1792023-10-20T22:37:53.294Zsys 0.143865059
1802023-10-20T22:37:53.317Ztrap 0.000170624
1812023-10-20T22:37:53.341Ztflt 0.000000000
1822023-10-20T22:37:53.365Zdflt 0.000000000
1832023-10-20T22:37:53.388Zkflt 0.000000000
1842023-10-20T22:37:53.411Zlock 0.000000000
1852023-10-20T22:37:53.435Zslp 0.000020600
1862023-10-20T22:37:53.458Zlat 0.000023390
1872023-10-20T22:37:53.485Zstop 0.000134982
1882023-10-20T22:37:53.509Z++ basename /input/ci-tools/work/end-to-end-tests/bootstrap
1892023-10-20T22:37:53.533Z+ chmod a+x tests/bootstrap
1902023-10-20T22:37:53.556Z+ for p in /input/ci-tools/work/end-to-end-tests/*.gz
1912023-10-20T22:37:53.580Z+ ptime -m gunzip
1922023-10-20T22:37:53.604Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-066d0e625cf05e06
1932023-10-20T22:37:55.743Z
1942023-10-20T22:37:55.766Zreal 2.507558756
1952023-10-20T22:37:55.790Zuser 2.366399990
1962023-10-20T22:37:55.814Zsys 0.140728031
1972023-10-20T22:37:55.848Ztrap 0.000200051
1982023-10-20T22:37:55.877Ztflt 0.000000000
1992023-10-20T22:37:55.904Zdflt 0.000000000
2002023-10-20T22:37:55.931Zkflt 0.000000000
2012023-10-20T22:37:55.954Zlock 0.000000000
2022023-10-20T22:37:55.978Zslp 0.000024610
2032023-10-20T22:37:56.002Zlat 0.000023820
2042023-10-20T22:37:56.046Zstop 0.000124732
2052023-10-20T22:37:56.070Z++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-066d0e625cf05e06
2062023-10-20T22:37:56.093Z+ chmod a+x tests/end_to_end_tests-066d0e625cf05e06
2072023-10-20T22:37:56.117Z+ bmat address ls
2082023-10-20T22:37:56.141ZNAME CIDR FIRST LAST COUNT
2092023-10-20T22:37:56.164Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
2102023-10-20T22:37:56.188Z++ bmat address ls -f extra -Ho first,last,count
2112023-10-20T22:37:56.212Z+ set -- 10.151.2.164 10.151.2.227 64
2122023-10-20T22:37:56.235Z+ EXTRA_IP_START=10.151.2.164
2132023-10-20T22:37:56.259Z+ EXTRA_IP_END=10.151.2.227
2142023-10-20T22:37:56.282Z+ EXTRA_IP_COUNT=64
2152023-10-20T22:37:56.306Z+ (( EXTRA_IP_COUNT >= 32 ))
2162023-10-20T22:37:56.332Z+ EXTRA_IP_BASE=10.151.2
2172023-10-20T22:37:56.359Z+ EXTRA_IP_FOCTET=164
2182023-10-20T22:37:56.386Z+ EXTRA_IP_LOCTET=227
2192023-10-20T22:37:56.410Z+ SERVICE_IP_POOL_START=10.151.2.164
2202023-10-20T22:37:56.436Z+ SERVICE_IP_POOL_END=10.151.2.173
2212023-10-20T22:37:56.464Z+ DNS_IP1=10.151.2.164
2222023-10-20T22:37:56.490Z+ DNS_IP2=10.151.2.165
2232023-10-20T22:37:56.514Z+ UPLINK_IP=10.151.2.174
2242023-10-20T22:37:56.537Z+ IPPOOL_START=10.151.2.175
2252023-10-20T22:37:56.561Z+ IPPOOL_END=10.151.2.227
2262023-10-20T22:37:56.585Z++ ipadm show-addr -po type,addr
2272023-10-20T22:37:56.612Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
2282023-10-20T22:37:56.635Z+ GATEWAY_IP=10.151.2.100
2292023-10-20T22:37:56.659Z+ [[ -n 10.151.2.100 ]]
2302023-10-20T22:37:56.682Z+ ping -s 10.151.2.100 56 1
2312023-10-20T22:37:56.705ZPING 10.151.2.100: 56 data bytes
2322023-10-20T22:37:56.729Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
2332023-10-20T22:37:56.752Z
2342023-10-20T22:37:56.776Z----10.151.2.100 PING Statistics----
2352023-10-20T22:37:56.799Z1 packets transmitted, 1 packets received, 0% packet loss
2362023-10-20T22:37:56.823Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
2372023-10-20T22:37:56.846Z++ arp -an
2382023-10-20T22:37:56.870Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
2392023-10-20T22:37:56.894Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
2402023-10-20T22:37:56.922Z+ routeadm -e ipv4-forwarding -u
2412023-10-20T22:37:57.376Z+ PXA_START=10.151.2.164
2422023-10-20T22:37:57.400Z+ PXA_END=10.151.2.227
2432023-10-20T22:37:57.423Z+ export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END
2442023-10-20T22:37:57.447Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
2452023-10-20T22:37:57.583Z+ ZPOOL_VDEV_DIR=/scratch
2462023-10-20T22:37:57.609Z+ ptime -m pfexec ./tools/create_virtual_hardware.sh
2472023-10-20T22:37:57.632Z+++ dirname ./tools/create_virtual_hardware.sh
2482023-10-20T22:37:57.655Z++ cd ./tools
2492023-10-20T22:37:57.679Z++ pwd
2502023-10-20T22:37:57.702Z+ SOURCE_DIR=/opt/oxide/work/tools
2512023-10-20T22:37:57.725Z+ OMICRON_TOP=/opt/oxide/work/tools/..
2522023-10-20T22:37:57.749Z+ . /opt/oxide/work/tools/virtual_hardware.sh
2532023-10-20T22:37:57.772Z++ MARKER=/etc/opt/oxide/NO_INSTALL
2542023-10-20T22:37:57.796Z++ [[ -f /etc/opt/oxide/NO_INSTALL ]]
2552023-10-20T22:37:57.819Z++ dladm show-phys -p -o LINK
2562023-10-20T22:37:57.843Z++ head -1
2572023-10-20T22:37:57.866Z+ PHYSICAL_LINK=igb0
2582023-10-20T22:37:57.890Z+ echo 'Using igb0 as physical link'
2592023-10-20T22:37:57.914ZUsing igb0 as physical link
2602023-10-20T22:37:57.937Z+ ensure_run_as_root
2612023-10-20T22:37:57.961Z++ id -u
2622023-10-20T22:37:57.984Z+ [[ 0 -ne 0 ]]
2632023-10-20T22:37:58.007Z+ ensure_zpools
2642023-10-20T22:37:58.032Z+ ZPOOL_TYPES=('oxp_' 'oxi_')
2652023-10-20T22:37:58.056Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
2662023-10-20T22:37:58.095Z+ readarray -t ZPOOLS
2672023-10-20T22:37:58.119Z++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
2682023-10-20T22:37:58.143Z++ sed 's/[ ",]//g'
2692023-10-20T22:37:58.167Z+ for ZPOOL in "${ZPOOLS[@]}"
2702023-10-20T22:37:58.191Z+ echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]'
2712023-10-20T22:37:58.215ZZpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]
2722023-10-20T22:37:58.239Z+ VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2732023-10-20T22:37:58.264Z+ [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
2742023-10-20T22:37:58.288Z+ dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
2752023-10-20T22:37:58.312Z0+0 records in
2762023-10-20T22:37:58.335ZZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
2772023-10-20T22:37:58.366Z0+0 records out
2782023-10-20T22:37:58.390ZZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists
2792023-10-20T22:37:58.413Z0 bytes (0 iB) transferred in 0.000007 secs (0 iB/sec)
2802023-10-20T22:37:58.436ZZpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2812023-10-20T22:37:58.460Z+ success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
2822023-10-20T22:37:58.483ZZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
2832023-10-20T22:37:58.507Z+ set +x
2842023-10-20T22:37:58.530ZZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
2852023-10-20T22:37:58.554Z++ zpool list -o name
2862023-10-20T22:37:58.577ZZpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]
2872023-10-20T22:37:58.601Z++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
2882023-10-20T22:37:58.625ZZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
2892023-10-20T22:37:58.648Z+ [[ -z '' ]]
2902023-10-20T22:37:58.671ZZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
2912023-10-20T22:37:58.696Z+ zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
2922023-10-20T22:37:58.719ZZpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]
2932023-10-20T22:37:58.743Z+ success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
2942023-10-20T22:37:58.768ZZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
2952023-10-20T22:37:58.791Z+ set +x
2962023-10-20T22:37:58.815ZZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
2972023-10-20T22:37:58.838Z+ for ZPOOL in "${ZPOOLS[@]}"
2982023-10-20T22:37:58.862ZZpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]
2992023-10-20T22:37:58.886Z+ echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3002023-10-20T22:37:58.916ZZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists
3012023-10-20T22:37:58.943Z+ VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3022023-10-20T22:37:58.975ZZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists
3032023-10-20T22:37:59.005Z+ [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3042023-10-20T22:37:59.033ZZpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]
3052023-10-20T22:37:59.069Z+ dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3062023-10-20T22:37:59.138ZZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists
3072023-10-20T22:37:59.172Z0+0 records in
3082023-10-20T22:37:59.211ZZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists
3092023-10-20T22:37:59.237Z0+0 records out
3102023-10-20T22:37:59.673ZZpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]
3112023-10-20T22:37:59.696Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3122023-10-20T22:37:59.720ZZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists
3132023-10-20T22:37:59.745Z+ success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3142023-10-20T22:37:59.768ZZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists
3152023-10-20T22:37:59.792Z+ set +x
3162023-10-20T22:37:59.818ZZpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]
3172023-10-20T22:37:59.842Z++ zpool list -o name
3182023-10-20T22:37:59.865ZZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists
3192023-10-20T22:37:59.889Z++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
3202023-10-20T22:37:59.912ZZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists
3212023-10-20T22:37:59.936Z+ [[ -z '' ]]
3222023-10-20T22:37:59.959ZZpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]
3232023-10-20T22:37:59.982Z+ zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3242023-10-20T22:38:00.006ZZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists
3252023-10-20T22:38:00.031Z+ success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3262023-10-20T22:38:00.067ZZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists
3272023-10-20T22:38:00.528Z+ set +x
3282023-10-20T22:38:00.559ZZpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]
3292023-10-20T22:38:00.587Z+ for ZPOOL in "${ZPOOLS[@]}"
3302023-10-20T22:38:00.612ZZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
3312023-10-20T22:38:00.636Z+ echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3322023-10-20T22:38:00.660ZZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3332023-10-20T22:38:00.684Z+ VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3342023-10-20T22:38:00.713ZZpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]
3352023-10-20T22:38:00.738Z+ [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3362023-10-20T22:38:00.762ZZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists
3372023-10-20T22:38:00.786Z+ dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3382023-10-20T22:38:00.811ZZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists
3392023-10-20T22:38:00.835Z0+0 records in
3402023-10-20T22:38:00.858ZSimnet net0/sc0_0 exists
3412023-10-20T22:38:00.882Z0+0 records out
3422023-10-20T22:38:00.905ZSimnet net1/sc1_0 exists
3432023-10-20T22:38:01.337Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3442023-10-20T22:38:01.381ZVnic sc0_1 exists
3452023-10-20T22:38:01.412Z+ success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3462023-10-20T22:38:01.437Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/c1c42398c82b0220c8b5fa3bfba9c7a3bcaa0943/softnpu.sha256.txt
3472023-10-20T22:38:01.468Z+ set +x
3482023-10-20T22:38:01.508Z++ zpool list -o name
3492023-10-20T22:38:01.953Z++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
3502023-10-20T22:38:01.978Z+ [[ -z '' ]]
3512023-10-20T22:38:02.072Z+ zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3522023-10-20T22:38:02.098Z+ success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3532023-10-20T22:38:02.122Z+ set +x
3542023-10-20T22:38:02.146Z+ for ZPOOL in "${ZPOOLS[@]}"
3552023-10-20T22:38:02.170Z+ echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3562023-10-20T22:38:02.195Z+ VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3572023-10-20T22:38:02.240Z+ [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3582023-10-20T22:38:02.267Z+ dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3592023-10-20T22:38:02.295Z0+0 records in
3602023-10-20T22:38:02.324Z0+0 records out
3612023-10-20T22:38:02.349Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
3622023-10-20T22:38:02.375Z+ success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3632023-10-20T22:38:02.399Z+ set +x
3642023-10-20T22:38:02.422Z++ zpool list -o name
3652023-10-20T22:38:02.447Z++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
3662023-10-20T22:38:02.474Z+ [[ -z '' ]]
3672023-10-20T22:38:02.499Z+ zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3682023-10-20T22:38:02.523Z+ success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3692023-10-20T22:38:02.547Z+ set +x
3702023-10-20T22:38:02.575Z+ for ZPOOL in "${ZPOOLS[@]}"
3712023-10-20T22:38:02.599Z+ echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]'
3722023-10-20T22:38:02.623Z+ VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3732023-10-20T22:38:02.647Z+ [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]]
3742023-10-20T22:38:02.672Z+ dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G
3752023-10-20T22:38:02.697Z0+0 records in
3762023-10-20T22:38:02.720Z0+0 records out
3772023-10-20T22:38:02.744Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3782023-10-20T22:38:02.768Z+ success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists'
3792023-10-20T22:38:02.792Z+ set +x
3802023-10-20T22:38:02.816Z++ zpool list -o name
3812023-10-20T22:38:02.841Z++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
3822023-10-20T22:38:02.867Z+ [[ -z '' ]]
3832023-10-20T22:38:02.891Z+ zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev
3842023-10-20T22:38:02.916Z+ success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists'
3852023-10-20T22:38:02.965Z+ set +x
3862023-10-20T22:38:02.989Z+ for ZPOOL in "${ZPOOLS[@]}"
3872023-10-20T22:38:03.015Z+ echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]'
3882023-10-20T22:38:03.044Z+ VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
3892023-10-20T22:38:03.069Z+ [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]]
3902023-10-20T22:38:03.093Z+ dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G
3912023-10-20T22:38:03.116Z0+0 records in
3922023-10-20T22:38:03.140Z0+0 records out
3932023-10-20T22:38:03.166Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
3942023-10-20T22:38:03.194Z+ success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists'
3952023-10-20T22:38:03.219Z+ set +x
3962023-10-20T22:38:03.284Z++ zpool list -o name
3972023-10-20T22:38:03.310Z++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
3982023-10-20T22:38:03.334Z+ [[ -z '' ]]
3992023-10-20T22:38:03.358Z+ zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev
4002023-10-20T22:38:03.382Z+ success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists'
4012023-10-20T22:38:03.406Z+ set +x
4022023-10-20T22:38:03.431Z+ for ZPOOL in "${ZPOOLS[@]}"
4032023-10-20T22:38:03.455Z+ echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]'
4042023-10-20T22:38:03.479Z+ VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4052023-10-20T22:38:03.503Z+ [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]]
4062023-10-20T22:38:03.529Z+ dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G
4072023-10-20T22:38:03.554Z0+0 records in
4082023-10-20T22:38:03.578Z0+0 records out
4092023-10-20T22:38:03.603Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4102023-10-20T22:38:03.627Z+ success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists'
4112023-10-20T22:38:03.652Z+ set +x
4122023-10-20T22:38:03.677Z++ zpool list -o name
4132023-10-20T22:38:03.701Z++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
4142023-10-20T22:38:03.725Z+ [[ -z '' ]]
4152023-10-20T22:38:03.755Z+ zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev
4162023-10-20T22:38:03.779Z+ success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists'
4172023-10-20T22:38:03.803Z+ set +x
4182023-10-20T22:38:03.827Z+ for ZPOOL in "${ZPOOLS[@]}"
4192023-10-20T22:38:03.853Z+ echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]'
4202023-10-20T22:38:03.886Z+ VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4212023-10-20T22:38:03.948Z+ [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]]
4222023-10-20T22:38:03.972Z+ dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G
4232023-10-20T22:38:03.996Z0+0 records in
4242023-10-20T22:38:04.020Z0+0 records out
4252023-10-20T22:38:04.044Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4262023-10-20T22:38:04.068Z+ success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists'
4272023-10-20T22:38:04.092Z+ set +x
4282023-10-20T22:38:04.116Z++ zpool list -o name
4292023-10-20T22:38:04.140Z++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f
4302023-10-20T22:38:04.164Z+ [[ -z '' ]]
4312023-10-20T22:38:04.189Z+ zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev
4322023-10-20T22:38:04.213Z+ success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists'
4332023-10-20T22:38:04.237Z+ set +x
4342023-10-20T22:38:04.260Z+ for ZPOOL in "${ZPOOLS[@]}"
4352023-10-20T22:38:04.308Z+ echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]'
4362023-10-20T22:38:04.334Z+ VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4372023-10-20T22:38:04.360Z+ [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]]
4382023-10-20T22:38:04.792Z+ dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G
4392023-10-20T22:38:04.816Z0+0 records in
4402023-10-20T22:38:04.846Z0+0 records out
4412023-10-20T22:38:05.284Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4422023-10-20T22:38:05.362Z+ success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists'
4432023-10-20T22:38:05.395Z+ set +x
4442023-10-20T22:38:05.420Z++ zpool list -o name
4452023-10-20T22:38:05.444Z++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
4462023-10-20T22:38:05.468Z+ [[ -z '' ]]
4472023-10-20T22:38:05.491Z+ zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev
4482023-10-20T22:38:05.515Z+ success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists'
4492023-10-20T22:38:05.538Z+ set +x
4502023-10-20T22:38:05.564Z+ for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}"
4512023-10-20T22:38:05.589Z+ readarray -t ZPOOLS
4522023-10-20T22:38:05.619Z++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml
4532023-10-20T22:38:05.648Z++ sed 's/[ ",]//g'
4542023-10-20T22:38:05.674Z+ for ZPOOL in "${ZPOOLS[@]}"
4552023-10-20T22:38:05.699Z+ echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4562023-10-20T22:38:05.723Z+ VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4572023-10-20T22:38:05.746Z+ [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4582023-10-20T22:38:05.769Z+ dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4592023-10-20T22:38:05.793Z0+0 records in
4602023-10-20T22:38:05.817Z0+0 records out
4612023-10-20T22:38:05.841Z0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec)
4622023-10-20T22:38:05.865Z+ success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4632023-10-20T22:38:05.888Z+ set +x
4642023-10-20T22:38:05.913Z++ zpool list -o name
4652023-10-20T22:38:05.936Z++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
4662023-10-20T22:38:05.960Z+ [[ -z '' ]]
4672023-10-20T22:38:05.986Z+ zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4682023-10-20T22:38:06.012Z+ success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4692023-10-20T22:38:06.037Z+ set +x
4702023-10-20T22:38:06.062Z+ for ZPOOL in "${ZPOOLS[@]}"
4712023-10-20T22:38:06.089Z+ echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]'
4722023-10-20T22:38:06.113Z+ VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4732023-10-20T22:38:06.137Z+ [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]]
4742023-10-20T22:38:06.162Z+ dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G
4752023-10-20T22:38:06.193Z0+0 records in
4762023-10-20T22:38:06.217Z0+0 records out
4772023-10-20T22:38:06.241Z0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec)
4782023-10-20T22:38:06.264Z+ success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists'
4792023-10-20T22:38:06.299Z+ set +x
4802023-10-20T22:38:06.326Z++ zpool list -o name
4812023-10-20T22:38:06.350Z++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
4822023-10-20T22:38:06.381Z+ [[ -z '' ]]
4832023-10-20T22:38:06.405Z+ zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev
4842023-10-20T22:38:06.434Z+ success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists'
4852023-10-20T22:38:06.460Z+ set +x
4862023-10-20T22:38:06.484Z+ ensure_simulated_links igb0
4872023-10-20T22:38:06.507Z+ local PHYSICAL_LINK=igb0
4882023-10-20T22:38:06.531Z+ INDICES=("0" "1")
4892023-10-20T22:38:06.558Z+ for I in "${INDICES[@]}"
4902023-10-20T22:38:06.582Z++ get_simnet_name_if_exists net0
4912023-10-20T22:38:06.606Z++ dladm show-simnet -p -o LINK net0
4922023-10-20T22:38:06.630Z++ echo ''
4932023-10-20T22:38:06.653Z+ [[ -z '' ]]
4942023-10-20T22:38:06.677Z+ dladm create-simnet -t net0
4952023-10-20T22:38:06.701Z+ dladm create-simnet -t sc0_0
4962023-10-20T22:38:07.131Z+ dladm modify-simnet -t -p net0 sc0_0
4972023-10-20T22:38:07.160Z+ dladm set-linkprop -p mtu=9000 sc0_0
4982023-10-20T22:38:07.210Z+ success 'Simnet net0/sc0_0 exists'
4992023-10-20T22:38:07.234Z+ set +x
5002023-10-20T22:38:07.257Z+ for I in "${INDICES[@]}"
5012023-10-20T22:38:07.281Z++ get_simnet_name_if_exists net1
5022023-10-20T22:38:07.306Z++ dladm show-simnet -p -o LINK net1
5032023-10-20T22:38:07.329Zdownloading softnpu ...done
5042023-10-20T22:38:07.353Z++ echo ''
5052023-10-20T22:38:07.377Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/f0585a29fb0285f7a1220c1118856b0e5c1f75c5/libsidecar_lite.so.sha256.txt
5062023-10-20T22:38:07.410Z+ [[ -z '' ]]
5072023-10-20T22:38:07.434Z+ dladm create-simnet -t net1
5082023-10-20T22:38:07.457Z+ dladm create-simnet -t sc1_0
5092023-10-20T22:38:07.480Z+ dladm modify-simnet -t -p net1 sc1_0
5102023-10-20T22:38:07.504Z+ dladm set-linkprop -p mtu=9000 sc1_0
5112023-10-20T22:38:07.527Z+ success 'Simnet net1/sc1_0 exists'
5122023-10-20T22:38:07.551Z+ set +x
5132023-10-20T22:38:07.575Z++ get_vnic_name_if_exists sc0_1
5142023-10-20T22:38:07.602Z++ dladm show-vnic -p -o LINK sc0_1
5152023-10-20T22:38:07.626Z++ echo ''
5162023-10-20T22:38:07.652Z+ [[ -z '' ]]
5172023-10-20T22:38:07.677Z+ dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d
5182023-10-20T22:38:07.713Z+ success 'Vnic sc0_1 exists'
5192023-10-20T22:38:07.746Z+ set +x
5202023-10-20T22:38:08.182Z+ warn_if_no_proxy_arp
5212023-10-20T22:38:08.612Z+ [[ -v PXA_START ]]
5222023-10-20T22:38:08.641Z+ [[ -v PXA_END ]]
5232023-10-20T22:38:08.670Z+ ensure_softnpu_zone
5242023-10-20T22:38:08.695Z+ zoneadm list
5252023-10-20T22:38:08.718Z+ grep -q sidecar_softnpu
5262023-10-20T22:38:08.742Z+ [[ -f out/npuzone/npuzone ]]
5272023-10-20T22:38:08.767Z+ out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0
5282023-10-20T22:38:11.330Zdownloading asic_program.so ...done
5292023-10-20T22:38:11.791Zremote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/f0585a29fb0285f7a1220c1118856b0e5c1f75c5/scadm.sha256.txt
5302023-10-20T22:38:17.578Zdownloading scadm ...done
5312023-10-20T22:38:17.601Zcreating port tfportrear0_0 for sc0_0
5322023-10-20T22:38:17.625Zcreating port tfportqsfp0_0 for sc0_1
5332023-10-20T22:38:17.648Zsoftnpu zone setup
5342023-10-20T22:38:17.672Zconfigure zone
5352023-10-20T22:38:17.695Zinstall zone
5362023-10-20T22:38:18.646Zboot zone
5372023-10-20T22:38:21.749Z[sidecar_softnpu] svcs milestone/network
5382023-10-20T22:38:21.775ZSTATE STIME FMRI
5392023-10-20T22:38:21.798Zonline 22:38:20 svc:/milestone/network:default
5402023-10-20T22:38:21.839Z[sidecar_softnpu] /softnpu/npu start
5412023-10-20T22:38:21.863Z
5422023-10-20T22:38:21.887Z+ /opt/oxide/work/tools/scrimlet/softnpu-init.sh
5432023-10-20T22:38:21.910Z+ GATEWAY_IP=10.151.2.100
5442023-10-20T22:38:21.934Z+ echo 'Using 10.151.2.100 as gateway ip'
5452023-10-20T22:38:21.958ZUsing 10.151.2.100 as gateway ip
5462023-10-20T22:38:21.982Z+ [[ ! -v GATEWAY_MAC ]]
5472023-10-20T22:38:22.032Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
5482023-10-20T22:38:22.056Z++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63
5492023-10-20T22:38:22.079Z+++ echo 18:c0:4d:0d:a0:2a
5502023-10-20T22:38:22.103Z+ COUNT=1
5512023-10-20T22:38:22.126Z+ [[ 1 -ne 1 ]]
5522023-10-20T22:38:22.149Z+ echo 'Using 18:c0:4d:0d:a0:2a as gateway mac'
5532023-10-20T22:38:22.173ZUsing 18:c0:4d:0d:a0:2a as gateway mac
5542023-10-20T22:38:22.196Z+ z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5552023-10-20T22:38:22.220Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a
5562023-10-20T22:38:22.243Z+ PXA_MAC=a8:e1:de:01:70:1d
5572023-10-20T22:38:22.267Z+ [[ -v PXA_START ]]
5582023-10-20T22:38:22.290Z+ z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5592023-10-20T22:38:22.314Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d
5602023-10-20T22:38:22.338Z+ z_scadm dump-state
5612023-10-20T22:38:22.364Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
5622023-10-20T22:38:22.388Zlocal v6:
5632023-10-20T22:38:22.412Zlocal v4:
5642023-10-20T22:38:22.435Zrouter v6:
5652023-10-20T22:38:22.459Zrouter v4_idx:
5662023-10-20T22:38:22.483Zrouter v4_routes:
5672023-10-20T22:38:22.507Zresolver v4:
5682023-10-20T22:38:22.531Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
5692023-10-20T22:38:22.554Zresolver v6:
5702023-10-20T22:38:22.578Znat v4:
5712023-10-20T22:38:22.602Znat_v6:
5722023-10-20T22:38:22.626Zport_mac:
5732023-10-20T22:38:22.649Zproxy arp:
5742023-10-20T22:38:22.673Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
5752023-10-20T22:38:22.696Z+ success 'softnpu zone exists'
5762023-10-20T22:38:22.720Z+ set +x
5772023-10-20T22:38:22.743Zsoftnpu zone exists
5782023-10-20T22:38:22.767Z
5792023-10-20T22:38:22.790Zreal 25.835133412
5802023-10-20T22:38:22.814Zuser 0.685038730
5812023-10-20T22:38:22.864Zsys 1.569484165
5822023-10-20T22:38:22.887Ztrap 0.000066840
5832023-10-20T22:38:22.911Ztflt 0.000162596
5842023-10-20T22:38:22.935Zdflt 0.000518265
5852023-10-20T22:38:22.959Zkflt 0.000000000
5862023-10-20T22:38:22.983Zlock 20:10.564874902
5872023-10-20T22:38:23.006Zslp 1:15.602027594
5882023-10-20T22:38:23.031Zlat 0.069949907
5892023-10-20T22:38:23.055Zstop 0.357476951
5902023-10-20T22:38:23.082Z+ tar xf out/omicron-sled-agent.tar pkg/config-rss.toml
5912023-10-20T22:38:23.108Z++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5922023-10-20T22:38:23.132Z+ SILO_NAME=recovery
5932023-10-20T22:38:23.156Z++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml
5942023-10-20T22:38:23.179Z+ EXTERNAL_DNS_DOMAIN=oxide.test
5952023-10-20T22:38:23.202Z+ sed -i~ '
5962023-10-20T22:38:23.226Z /^external_dns_ips/c\
5972023-10-20T22:38:23.249Zexternal_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
5982023-10-20T22:38:23.273Z /^\[\[internal_services_ip_pool_ranges/,/^$/ {
5992023-10-20T22:38:23.296Z /^first/c\
6002023-10-20T22:38:23.320Zfirst = "10.151.2.164"
6012023-10-20T22:38:23.343Z /^last/c\
6022023-10-20T22:38:23.367Zlast = "10.151.2.173"
6032023-10-20T22:38:23.390Z }
6042023-10-20T22:38:23.414Z /^\[rack_network_config/,/^$/ {
6052023-10-20T22:38:23.437Z /^infra_ip_first/c\
6062023-10-20T22:38:23.461Zinfra_ip_first = "10.151.2.174"
6072023-10-20T22:38:23.484Z /^infra_ip_last/c\
6082023-10-20T22:38:23.507Zinfra_ip_last = "10.151.2.174"
6092023-10-20T22:38:23.532Z }
6102023-10-20T22:38:23.560Z--- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006
6112023-10-20T22:38:23.586Z /^\[\[rack_network_config.uplinks/,/^$/ {
6122023-10-20T22:38:23.612Z+++ pkg/config-rss.toml Fri Oct 20 22:38:22 2023
6132023-10-20T22:38:23.640Z /^gateway_ip/c\
6142023-10-20T22:38:23.667Z@@ -41,7 +41,7 @@
6152023-10-20T22:38:23.693Zgateway_ip = "10.151.2.100"
6162023-10-20T22:38:23.717Z # the DNS domain delegated to the rack by the customer. Each of these addresses
6172023-10-20T22:38:23.742Z /^uplink_cidr/c\
6182023-10-20T22:38:23.765Z # must be contained in one of the "internal services" IP Pool ranges listed
6192023-10-20T22:38:23.788Zuplink_cidr = "10.151.2.174/32"
6202023-10-20T22:38:23.812Z # below.
6212023-10-20T22:38:23.835Z }
6222023-10-20T22:38:23.859Z-external_dns_ips = [ "192.168.1.20", "192.168.1.21" ]
6232023-10-20T22:38:23.889Z' pkg/config-rss.toml
6242023-10-20T22:38:23.912Z+external_dns_ips = [ "10.151.2.164", "10.151.2.165" ]
6252023-10-20T22:38:23.936Z+ diff -u pkg/config-rss.toml~ pkg/config-rss.toml
6262023-10-20T22:38:23.959Z
6272023-10-20T22:38:23.983Z+ true
6282023-10-20T22:38:24.007Z # Initial TLS certificates for the external API
6292023-10-20T22:38:24.031Z+ tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml
6302023-10-20T22:38:24.054Z #
6312023-10-20T22:38:24.078Z+ rm -f pkg/config-rss.toml pkg/config-rss.toml~
6322023-10-20T22:38:24.104Z@@ -77,8 +77,8 @@
6332023-10-20T22:38:24.128Z+ TLS_NAME=recovery.sys.oxide.test
6342023-10-20T22:38:24.152Z #
6352023-10-20T22:38:24.175Z+ openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin
6362023-10-20T22:38:24.199Z # For more on this and what to put here, see docs/how-to-run.adoc.
6372023-10-20T22:38:24.222Z [[internal_services_ip_pool_ranges]]
6382023-10-20T22:38:24.246Z-first = "192.168.1.20"
6392023-10-20T22:38:24.269Z..+...+.+..+....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+.+..............+.+..+.......+...+........+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...............+....+...+...+.....+.......+..+..................+...+....+.....+...+.+......+...+...+.........+...+.....+.+............+..+......+.+.....+.+.....+...+.......+..............+...+.+.........+........+.......+......+..............+.......+......+..+...+....+.....+.+.....+...............+......................+........+...+....+...........+....+...+..+.......+......+........+.+......+....................+..........+..+............+.........+.........+.......+...+..+..........+.....+....+..+...+......+.+...............+............+............+...+........+....+...........+....+.....+..................+.......+...+..+.+..+...+....+.....+.............+..+.+............+.....+.+.........+.....+.+..+...........................+.......+...+...+.........+...........+.......+......+..+.......+...........+.+...........+...+.+........+.+......+.....+.+...+.....+.........+......+.+..........................+....+...+......+.....+.+...........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6402023-10-20T22:38:24.295Z-last = "192.168.1.29"
6412023-10-20T22:38:24.319Z+first = "10.151.2.164"
6422023-10-20T22:38:24.343Z+last = "10.151.2.173"
6432023-10-20T22:38:24.366Z
6442023-10-20T22:38:24.391Z # TODO - this configuration is subject to change going forward. Ultimately these
6452023-10-20T22:38:24.415Z....+.......+.....+..........+.....+....+...+.....+.+.....+..........+.........+..+...+.......+.....+....+......+...+.....+......+....+..+....+.................+....+.....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+......+....+.....+......+.+........+......+.+........+......+....+...........+...+............+......+...+.........+.+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+......+..+....+.....+.............+.................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6462023-10-20T22:38:24.438Z # parameters should be provided to the control plane via wicket, but we need to
6472023-10-20T22:38:24.462Z-----
6482023-10-20T22:38:24.485Z@@ -91,13 +91,13 @@
6492023-10-20T22:38:24.508Z+ tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6502023-10-20T22:38:24.536Z # A range of IP addresses used by Boundary Services on the external network. In
6512023-10-20T22:38:24.562Z+ rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem
6522023-10-20T22:38:24.586Z # a real system, these would be addresses of the uplink ports on the Sidecar.
6532023-10-20T22:38:24.613Z+ rmdir pkg
6542023-10-20T22:38:24.637Z # With softnpu, only one address is used.
6552023-10-20T22:38:24.661Z+ E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem
6562023-10-20T22:38:24.684Z-infra_ip_first = "192.168.1.30"
6572023-10-20T22:38:24.708Z+ pfexec mkdir -p /usr/oxide
6582023-10-20T22:38:24.732Z-infra_ip_last = "192.168.1.30"
6592023-10-20T22:38:25.195Z+ pfexec rm -f /usr/oxide/tcpproxy
6602023-10-20T22:38:25.222Z+infra_ip_first = "10.151.2.174"
6612023-10-20T22:38:25.246Z+ pfexec curl -sSfL -o /usr/oxide/tcpproxy http://catacomb.eng.oxide.computer:12346/tcpproxy
6622023-10-20T22:38:25.270Z+infra_ip_last = "10.151.2.174"
6632023-10-20T22:38:25.293Z+ pfexec chmod +x /usr/oxide/tcpproxy
6642023-10-20T22:38:25.317Z
6652023-10-20T22:38:25.340Z+ pfexec rm -f /var/svc/manifest/site/tcpproxy.xml
6662023-10-20T22:38:25.364Z # You can configure multiple uplinks by repeating the following stanza
6672023-10-20T22:38:25.387Z+ pfexec curl -sSfL -o /var/svc/manifest/site/tcpproxy.xml http://catacomb.eng.oxide.computer:12346/tcpproxy.xml
6682023-10-20T22:38:25.411Z [[rack_network_config.uplinks]]
6692023-10-20T22:38:25.435Z+ pfexec svccfg import /var/svc/manifest/site/tcpproxy.xml
6702023-10-20T22:38:25.458Z # The gateway IP for the rack's external network
6712023-10-20T22:38:25.482Z+ OMICRON_NO_UNINSTALL=1
6722023-10-20T22:38:25.506Z-gateway_ip = "192.168.1.199"
6732023-10-20T22:38:25.529Z+ ptime -m pfexec ./target/release/omicron-package -t test install
6742023-10-20T22:38:25.553Z+gateway_ip = "10.151.2.100"
6752023-10-20T22:38:25.576ZOct 20 22:38:23.563 DEBG target[test]: Target({"image": "standard", "machine": "non-gimlet", "rack-topology": "single-sled", "switch": "softnpu"})
6762023-10-20T22:38:25.600Z # Name of the uplink port. This should always be "qsfp0" when using softnpu.
6772023-10-20T22:38:25.630ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/clickhouse.tar.gz, src: out/clickhouse.tar.gz
6782023-10-20T22:38:25.654Z uplink_port = "qsfp0"
6792023-10-20T22:38:25.677ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/cockroachdb.tar.gz, src: out/cockroachdb.tar.gz
6802023-10-20T22:38:25.701Z uplink_port_speed = "40G"
6812023-10-20T22:38:25.725ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/ntp.tar.gz, src: out/ntp.tar.gz
6822023-10-20T22:38:25.749Z@@ -104,7 +104,7 @@
6832023-10-20T22:38:25.772ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/mgs.tar.gz, src: out/omicron-gateway-softnpu.tar.gz
6842023-10-20T22:38:25.796Z uplink_port_fec="none"
6852023-10-20T22:38:25.820ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/nexus.tar.gz, src: out/omicron-nexus.tar.gz
6862023-10-20T22:38:25.843Z # For softnpu, an address within the "infra" block above that will be used for
6872023-10-20T22:38:25.866ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/clickhouse_keeper.tar.gz, src: out/clickhouse_keeper.tar.gz
6882023-10-20T22:38:25.891Z # the softnpu uplink port. You can just pick the first address in that pool.
6892023-10-20T22:38:25.938ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/oximeter.tar.gz, src: out/oximeter-collector.tar.gz
6902023-10-20T22:38:25.961Z-uplink_cidr = "192.168.1.30/32"
6912023-10-20T22:38:25.985ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/crucible_pantry.tar.gz, src: out/crucible-pantry.tar.gz
6922023-10-20T22:38:26.008Z+uplink_cidr = "10.151.2.174/32"
6932023-10-20T22:38:26.032ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/internal_dns.tar.gz, src: out/internal-dns.tar.gz
6942023-10-20T22:38:26.055Z # Switch to use for the uplink. For single-rack deployments this can be
6952023-10-20T22:38:26.079ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/propolis-server.tar.gz, src: out/propolis-server.tar.gz
6962023-10-20T22:38:26.102Z # "switch0" (upper slot) or "switch1" (lower slot). For single-node softnpu
6972023-10-20T22:38:26.129ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/switch.tar.gz, src: out/switch-softnpu.tar.gz
6982023-10-20T22:38:26.153Z # and dendrite stub environments, use "switch0"
6992023-10-20T22:38:26.176ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/overlay.tar.gz, src: out/overlay.tar.gz
7002023-10-20T22:38:26.200Za pkg/config-rss.toml 7K
7012023-10-20T22:38:26.223ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/external_dns.tar.gz, src: out/external-dns.tar.gz
7022023-10-20T22:38:26.247Za pkg/initial-tls-cert.pem 2K
7032023-10-20T22:38:26.271ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/mg-ddm.tar, src: out/maghemite.tar
7042023-10-20T22:38:26.295Za pkg/initial-tls-key.pem 4K
7052023-10-20T22:38:26.318ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/sled-agent.tar, src: out/omicron-sled-agent.tar
7062023-10-20T22:38:26.341ZOct 20 22:38:23.565 INFO Installing service, dst: /opt/oxide/crucible.tar.gz, src: out/crucible.tar.gz
7072023-10-20T22:38:26.364ZOct 20 22:38:23.816 INFO Unpacking service tarball, service_path: /opt/oxide/mg-ddm, tar_path: /opt/oxide/mg-ddm.tar
7082023-10-20T22:38:26.388ZOct 20 22:38:23.859 INFO Unpacking service tarball, service_path: /opt/oxide/sled-agent, tar_path: /opt/oxide/sled-agent.tar
7092023-10-20T22:38:26.411ZOct 20 22:38:23.919 INFO Installing bootstrap service from /opt/oxide/sled-agent/pkg/manifest.xml
7102023-10-20T22:38:26.435Z
7112023-10-20T22:38:26.458Zreal 0.494264416
7122023-10-20T22:38:26.481Zuser 0.097820310
7132023-10-20T22:38:26.505Zsys 1.933388097
7142023-10-20T22:38:26.528Ztrap 0.000000269
7152023-10-20T22:38:26.552Ztflt 0.000026479
7162023-10-20T22:38:26.575Zdflt 0.000481841
7172023-10-20T22:38:26.598Zkflt 0.000008150
7182023-10-20T22:38:26.622Zlock 44.547422530
7192023-10-20T22:38:26.645Zslp 0.693351433
7202023-10-20T22:38:26.669Zlat 0.002877260
7212023-10-20T22:38:26.692Zstop 0.208850764
7222023-10-20T22:38:26.716Z+ retry=0
7232023-10-20T22:38:26.739Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7242023-10-20T22:38:26.762Z+ [[ 0 -gt 30 ]]
7252023-10-20T22:38:26.786Z+ sleep 1
7262023-10-20T22:38:26.809Z+ retry=1
7272023-10-20T22:38:26.832Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7282023-10-20T22:38:26.856Z+ [[ 1 -gt 30 ]]
7292023-10-20T22:38:26.882Z+ sleep 1
7302023-10-20T22:38:26.905Z+ retry=2
7312023-10-20T22:38:26.930Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7322023-10-20T22:38:45.379Z+ [[ 2 -gt 30 ]]
7332023-10-20T22:38:45.406Z+ sleep 1
7342023-10-20T22:38:46.376Z+ retry=3
7352023-10-20T22:38:46.399Z+ curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/'
7362023-10-20T22:38:46.423Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
7372023-10-20T22:38:46.446Zlocal v6:
7382023-10-20T22:38:46.480Zfe80::ecc6:3dff:fe20:ccbb
7392023-10-20T22:38:46.503Zfd00:99::1
7402023-10-20T22:38:46.526Zlocal v4:
7412023-10-20T22:38:46.550Z10.151.2.174
7422023-10-20T22:38:46.573Zrouter v6:
7432023-10-20T22:38:46.596Zrouter v4_idx:
7442023-10-20T22:38:46.620Zrouter v4_routes:
7452023-10-20T22:38:46.644Zresolver v4:
7462023-10-20T22:38:46.668Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
7472023-10-20T22:38:46.692Zresolver v6:
7482023-10-20T22:38:46.730Zfe80::c418:9dff:fe23:e08c -> c6:18:9d:23:e0:8c
7492023-10-20T22:38:46.757Zfe80::ecc6:3dff:fe20:ccbb -> ee:c6:3d:20:cc:bb
7502023-10-20T22:38:46.780Znat v4:
7512023-10-20T22:38:46.803Znat_v6:
7522023-10-20T22:38:46.827Zport_mac:
7532023-10-20T22:38:46.850Z1000: a8:40:25:18:7d:1c
7542023-10-20T22:38:46.888Z1: a8:40:25:18:7d:1d
7552023-10-20T22:38:46.912Zproxy arp:
7562023-10-20T22:38:46.936Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
7572023-10-20T22:38:46.959Z+ retry=0
7582023-10-20T22:38:46.982Z+++ zoneadm list -n
7592023-10-20T22:38:47.006Z+++ grep oxz_ntp
7602023-10-20T22:38:47.029Z++ pfexec svcs -z -Hostate oxide/ntp
7612023-10-20T22:38:47.056Zsvcs: zone '-Hostate': entity not found
7622023-10-20T22:38:47.105Z++ true
7632023-10-20T22:38:47.128Z+ [[ '' != online ]]
7642023-10-20T22:38:47.152Z+ [[ 0 -gt 60 ]]
7652023-10-20T22:38:47.175Z+ sleep 1
7662023-10-20T22:38:47.439Z+ retry=1
7672023-10-20T22:38:47.463Z+++ zoneadm list -n
7682023-10-20T22:38:47.504Z+++ grep oxz_ntp
7692023-10-20T22:38:47.528Z++ pfexec svcs -z -Hostate oxide/ntp
7702023-10-20T22:38:47.559Zsvcs: zone '-Hostate': entity not found
7712023-10-20T22:38:47.585Z++ true
7722023-10-20T22:38:47.612Z+ [[ '' != online ]]
7732023-10-20T22:38:47.636Z+ [[ 1 -gt 60 ]]
7742023-10-20T22:38:47.665Z+ sleep 1
7752023-10-20T22:38:48.461Z+ retry=2
7762023-10-20T22:38:48.485Z+++ zoneadm list -n
7772023-10-20T22:38:48.540Z+++ grep oxz_ntp
7782023-10-20T22:38:48.565Z++ pfexec svcs -z -Hostate oxide/ntp
7792023-10-20T22:38:48.588Zsvcs: zone '-Hostate': entity not found
7802023-10-20T22:38:48.612Z++ true
7812023-10-20T22:38:48.635Z+ [[ '' != online ]]
7822023-10-20T22:38:48.659Z+ [[ 2 -gt 60 ]]
7832023-10-20T22:38:48.683Z+ sleep 1
7842023-10-20T22:38:49.489Z+ retry=3
7852023-10-20T22:38:49.513Z+++ zoneadm list -n
7862023-10-20T22:38:49.537Z+++ grep oxz_ntp
7872023-10-20T22:38:49.565Z++ pfexec svcs -z -Hostate oxide/ntp
7882023-10-20T22:38:49.588Zsvcs: zone '-Hostate': entity not found
7892023-10-20T22:38:49.616Z++ true
7902023-10-20T22:38:49.645Z+ [[ '' != online ]]
7912023-10-20T22:38:49.668Z+ [[ 3 -gt 60 ]]
7922023-10-20T22:38:49.692Z+ sleep 1
7932023-10-20T22:38:50.509Z+ retry=4
7942023-10-20T22:38:50.533Z+++ zoneadm list -n
7952023-10-20T22:38:50.556Z+++ grep oxz_ntp
7962023-10-20T22:38:50.599Z++ pfexec svcs -z -Hostate oxide/ntp
7972023-10-20T22:38:50.623Zsvcs: zone '-Hostate': entity not found
7982023-10-20T22:38:50.648Z++ true
7992023-10-20T22:38:50.671Z+ [[ '' != online ]]
8002023-10-20T22:38:50.694Z+ [[ 4 -gt 60 ]]
8012023-10-20T22:38:50.718Z+ sleep 1
8022023-10-20T22:38:51.533Z+ retry=5
8032023-10-20T22:38:51.557Z+++ zoneadm list -n
8042023-10-20T22:38:51.581Z+++ grep oxz_ntp
8052023-10-20T22:38:51.620Z++ pfexec svcs -z -Hostate oxide/ntp
8062023-10-20T22:38:51.645Zsvcs: zone '-Hostate': entity not found
8072023-10-20T22:38:51.669Z++ true
8082023-10-20T22:38:51.692Z+ [[ '' != online ]]
8092023-10-20T22:38:51.715Z+ [[ 5 -gt 60 ]]
8102023-10-20T22:38:51.739Z+ sleep 1
8112023-10-20T22:38:52.553Z+ retry=6
8122023-10-20T22:38:52.576Z+++ zoneadm list -n
8132023-10-20T22:38:52.600Z+++ grep oxz_ntp
8142023-10-20T22:38:52.646Z++ pfexec svcs -z -Hostate oxide/ntp
8152023-10-20T22:38:52.672Zsvcs: zone '-Hostate': entity not found
8162023-10-20T22:38:52.696Z++ true
8172023-10-20T22:38:52.719Z+ [[ '' != online ]]
8182023-10-20T22:38:52.743Z+ [[ 6 -gt 60 ]]
8192023-10-20T22:38:52.766Z+ sleep 1
8202023-10-20T22:38:53.575Z+ retry=7
8212023-10-20T22:38:53.598Z+++ zoneadm list -n
8222023-10-20T22:38:53.622Z+++ grep oxz_ntp
8232023-10-20T22:38:53.670Z++ pfexec svcs -z -Hostate oxide/ntp
8242023-10-20T22:38:53.694Zsvcs: zone '-Hostate': entity not found
8252023-10-20T22:38:53.717Z++ true
8262023-10-20T22:38:53.741Z+ [[ '' != online ]]
8272023-10-20T22:38:53.764Z+ [[ 7 -gt 60 ]]
8282023-10-20T22:38:53.788Z+ sleep 1
8292023-10-20T22:38:54.598Z+ retry=8
8302023-10-20T22:38:54.621Z+++ zoneadm list -n
8312023-10-20T22:38:54.645Z+++ grep oxz_ntp
8322023-10-20T22:38:54.668Z++ pfexec svcs -z -Hostate oxide/ntp
8332023-10-20T22:38:54.695Zsvcs: zone '-Hostate': entity not found
8342023-10-20T22:38:54.722Z++ true
8352023-10-20T22:38:54.746Z+ [[ '' != online ]]
8362023-10-20T22:38:54.770Z+ [[ 8 -gt 60 ]]
8372023-10-20T22:38:54.794Z+ sleep 1
8382023-10-20T22:38:55.620Z+ retry=9
8392023-10-20T22:38:55.644Z+++ zoneadm list -n
8402023-10-20T22:38:55.674Z+++ grep oxz_ntp
8412023-10-20T22:38:55.719Z++ pfexec svcs -z -Hostate oxide/ntp
8422023-10-20T22:38:55.743Zsvcs: zone '-Hostate': entity not found
8432023-10-20T22:38:55.767Z++ true
8442023-10-20T22:38:55.790Z+ [[ '' != online ]]
8452023-10-20T22:38:55.813Z+ [[ 9 -gt 60 ]]
8462023-10-20T22:38:55.837Z+ sleep 1
8472023-10-20T22:38:56.642Z+ retry=10
8482023-10-20T22:38:56.665Z+++ zoneadm list -n
8492023-10-20T22:38:56.689Z+++ grep oxz_ntp
8502023-10-20T22:38:56.712Z++ pfexec svcs -z -Hostate oxide/ntp
8512023-10-20T22:38:56.744Zsvcs: zone '-Hostate': entity not found
8522023-10-20T22:38:56.767Z++ true
8532023-10-20T22:38:56.791Z+ [[ '' != online ]]
8542023-10-20T22:38:56.814Z+ [[ 10 -gt 60 ]]
8552023-10-20T22:38:56.838Z+ sleep 1
8562023-10-20T22:38:57.662Z+ retry=11
8572023-10-20T22:38:57.686Z+++ zoneadm list -n
8582023-10-20T22:38:57.710Z+++ grep oxz_ntp
8592023-10-20T22:38:57.733Z++ pfexec svcs -z -Hostate oxide/ntp
8602023-10-20T22:38:57.769Zsvcs: zone '-Hostate': entity not found
8612023-10-20T22:38:57.792Z++ true
8622023-10-20T22:38:57.816Z+ [[ '' != online ]]
8632023-10-20T22:38:57.839Z+ [[ 11 -gt 60 ]]
8642023-10-20T22:38:57.863Z+ sleep 1
8652023-10-20T22:38:58.685Z+ retry=12
8662023-10-20T22:38:58.709Z+++ zoneadm list -n
8672023-10-20T22:38:58.732Z+++ grep oxz_ntp
8682023-10-20T22:38:58.756Z++ pfexec svcs -z -Hostate oxide/ntp
8692023-10-20T22:38:58.793Zsvcs: zone '-Hostate': entity not found
8702023-10-20T22:38:58.817Z++ true
8712023-10-20T22:38:58.841Z+ [[ '' != online ]]
8722023-10-20T22:38:58.864Z+ [[ 12 -gt 60 ]]
8732023-10-20T22:38:58.888Z+ sleep 1
8742023-10-20T22:38:59.708Z+ retry=13
8752023-10-20T22:38:59.735Z+++ zoneadm list -n
8762023-10-20T22:38:59.761Z+++ grep oxz_ntp
8772023-10-20T22:38:59.819Z++ pfexec svcs -z -Hostate oxide/ntp
8782023-10-20T22:38:59.843Zsvcs: zone '-Hostate': entity not found
8792023-10-20T22:38:59.866Z++ true
8802023-10-20T22:38:59.890Z+ [[ '' != online ]]
8812023-10-20T22:38:59.913Z+ [[ 13 -gt 60 ]]
8822023-10-20T22:38:59.937Z+ sleep 1
8832023-10-20T22:39:00.729Z+ retry=14
8842023-10-20T22:39:00.753Z+++ zoneadm list -n
8852023-10-20T22:39:00.776Z+++ grep oxz_ntp
8862023-10-20T22:39:00.800Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
8872023-10-20T22:39:00.845Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8882023-10-20T22:39:00.868Z++ true
8892023-10-20T22:39:00.893Z+ [[ '' != online ]]
8902023-10-20T22:39:00.917Z+ [[ 14 -gt 60 ]]
8912023-10-20T22:39:00.940Z+ sleep 1
8922023-10-20T22:39:01.785Z+ retry=15
8932023-10-20T22:39:01.809Z+++ zoneadm list -n
8942023-10-20T22:39:01.835Z+++ grep oxz_ntp
8952023-10-20T22:39:01.868Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
8962023-10-20T22:39:01.894Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
8972023-10-20T22:39:01.918Z++ true
8982023-10-20T22:39:01.943Z+ [[ '' != online ]]
8992023-10-20T22:39:02.001Z+ [[ 15 -gt 60 ]]
9002023-10-20T22:39:02.025Z+ sleep 1
9012023-10-20T22:39:02.816Z+ retry=16
9022023-10-20T22:39:02.841Z+++ zoneadm list -n
9032023-10-20T22:39:02.865Z+++ grep oxz_ntp
9042023-10-20T22:39:02.893Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9052023-10-20T22:39:02.917Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
9062023-10-20T22:39:02.941Z++ true
9072023-10-20T22:39:02.966Z+ [[ '' != online ]]
9082023-10-20T22:39:02.990Z+ [[ 16 -gt 60 ]]
9092023-10-20T22:39:03.014Z+ sleep 1
9102023-10-20T22:39:03.854Z+ retry=17
9112023-10-20T22:39:03.885Z+++ zoneadm list -n
9122023-10-20T22:39:03.921Z+++ grep oxz_ntp
9132023-10-20T22:39:03.947Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9142023-10-20T22:39:03.971Zsvcs: Pattern 'oxide/ntp' doesn't match any instances
9152023-10-20T22:39:03.995Z++ true
9162023-10-20T22:39:04.019Z+ [[ '' != online ]]
9172023-10-20T22:39:04.043Z+ [[ 17 -gt 60 ]]
9182023-10-20T22:39:04.067Z+ sleep 1
9192023-10-20T22:39:04.880Z+ retry=18
9202023-10-20T22:39:04.904Z+++ zoneadm list -n
9212023-10-20T22:39:04.942Z+++ grep oxz_ntp
9222023-10-20T22:39:04.966Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9232023-10-20T22:39:04.989Z+ [[ disabled != online ]]
9242023-10-20T22:39:05.013Z+ [[ 18 -gt 60 ]]
9252023-10-20T22:39:05.037Z+ sleep 1
9262023-10-20T22:39:05.898Z+ retry=19
9272023-10-20T22:39:06.335Z+++ zoneadm list -n
9282023-10-20T22:39:06.359Z+++ grep oxz_ntp
9292023-10-20T22:39:06.382Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9302023-10-20T22:39:06.406Z+ [[ disabled != online ]]
9312023-10-20T22:39:06.430Z+ [[ 19 -gt 60 ]]
9322023-10-20T22:39:06.454Z+ sleep 1
9332023-10-20T22:39:06.920Z+ retry=20
9342023-10-20T22:39:06.944Z+++ zoneadm list -n
9352023-10-20T22:39:06.967Z+++ grep oxz_ntp
9362023-10-20T22:39:07.003Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9372023-10-20T22:39:07.027Z+ [[ disabled != online ]]
9382023-10-20T22:39:07.076Z+ [[ 20 -gt 60 ]]
9392023-10-20T22:39:07.099Z+ sleep 1
9402023-10-20T22:39:07.943Z+ retry=21
9412023-10-20T22:39:07.967Z+++ zoneadm list -n
9422023-10-20T22:39:07.991Z+++ grep oxz_ntp
9432023-10-20T22:39:08.029Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9442023-10-20T22:39:08.053Z+ [[ disabled != online ]]
9452023-10-20T22:39:08.077Z+ [[ 21 -gt 60 ]]
9462023-10-20T22:39:08.100Z+ sleep 1
9472023-10-20T22:39:08.966Z+ retry=22
9482023-10-20T22:39:08.992Z+++ zoneadm list -n
9492023-10-20T22:39:09.019Z+++ grep oxz_ntp
9502023-10-20T22:39:09.064Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9512023-10-20T22:39:09.087Z+ [[ disabled != online ]]
9522023-10-20T22:39:09.111Z+ [[ 22 -gt 60 ]]
9532023-10-20T22:39:09.135Z+ sleep 1
9542023-10-20T22:39:09.988Z+ retry=23
9552023-10-20T22:39:10.014Z+++ zoneadm list -n
9562023-10-20T22:39:10.039Z+++ grep oxz_ntp
9572023-10-20T22:39:10.088Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9582023-10-20T22:39:10.111Z+ [[ disabled != online ]]
9592023-10-20T22:39:10.135Z+ [[ 23 -gt 60 ]]
9602023-10-20T22:39:10.158Z+ sleep 1
9612023-10-20T22:39:11.018Z+ retry=24
9622023-10-20T22:39:11.045Z+++ zoneadm list -n
9632023-10-20T22:39:11.069Z+++ grep oxz_ntp
9642023-10-20T22:39:11.110Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9652023-10-20T22:39:11.135Z+ [[ disabled != online ]]
9662023-10-20T22:39:11.159Z+ [[ 24 -gt 60 ]]
9672023-10-20T22:39:11.182Z+ sleep 1
 
9682023-10-20T22:39:11.536Zsock console login: Oct 20 22:39:11 sok ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast
 
9692023-10-20T22:39:12.031Z+ retry=25
9702023-10-20T22:39:12.055Z+++ zoneadm list -n
9712023-10-20T22:39:12.078Z+++ grep oxz_ntp
9722023-10-20T22:39:12.102Z++ pfexec svcs -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe -Hostate oxide/ntp
9732023-10-20T22:39:12.137Z+ [[ online != online ]]
9742023-10-20T22:39:12.161Z+ echo 'Waited for chrony: 25s'
9752023-10-20T22:39:12.184ZWaited for chrony: 25s
9762023-10-20T22:39:12.208Z+ export RUST_BACKTRACE=1
9772023-10-20T22:39:12.231Z+ RUST_BACKTRACE=1
9782023-10-20T22:39:12.257Z+ export E2E_TLS_CERT IPPOOL_START IPPOOL_END
9792023-10-20T22:39:12.281Z+ ./tests/bootstrap
9802023-10-20T22:39:12.307ZUsing external DNS server at 10.151.2.164:53
9812023-10-20T22:39:12.330Z2023-10-20 22:39:12.386834208 UTC: attempting to log into API
9822023-10-20T22:39:27.115Z2023-10-20 22:39:27.423537879 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9832023-10-20T22:39:28.117Z2023-10-20 22:39:28.424639207 UTC: attempting to log into API
9842023-10-20T22:39:43.150Z2023-10-20 22:39:43.458344690 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9852023-10-20T22:39:44.151Z2023-10-20 22:39:44.459265006 UTC: attempting to log into API
9862023-10-20T22:39:59.184Z2023-10-20 22:39:59.492872177 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9872023-10-20T22:40:00.186Z2023-10-20 22:40:00.493785803 UTC: attempting to log into API
9882023-10-20T22:40:15.224Z2023-10-20 22:40:15.526297797 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9892023-10-20T22:40:16.219Z2023-10-20 22:40:16.527186952 UTC: attempting to log into API
9902023-10-20T22:40:31.252Z2023-10-20 22:40:31.560592380 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9912023-10-20T22:40:32.259Z2023-10-20 22:40:32.561582757 UTC: attempting to log into API
9922023-10-20T22:40:47.587Z2023-10-20 22:40:47.593793987 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9932023-10-20T22:40:48.286Z2023-10-20 22:40:48.594793783 UTC: attempting to log into API
9942023-10-20T22:41:03.325Z2023-10-20 22:41:03.627898187 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9952023-10-20T22:41:04.322Z2023-10-20 22:41:04.629588675 UTC: attempting to log into API
9962023-10-20T22:41:19.354Z2023-10-20 22:41:19.662085799 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9972023-10-20T22:41:20.355Z2023-10-20 22:41:20.662867242 UTC: attempting to log into API
9982023-10-20T22:41:35.389Z2023-10-20 22:41:35.696821909 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
9992023-10-20T22:41:36.390Z2023-10-20 22:41:36.698463086 UTC: attempting to log into API
10002023-10-20T22:42:05.473Z2023-10-20 22:41:51.730869569 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10012023-10-20T22:42:05.586Z2023-10-20 22:41:52.731817635 UTC: attempting to log into API
10022023-10-20T22:42:07.456Z2023-10-20 22:42:07.764575383 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10032023-10-20T22:42:08.458Z2023-10-20 22:42:08.766259531 UTC: attempting to log into API
10042023-10-20T22:42:23.492Z2023-10-20 22:42:23.799869872 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10052023-10-20T22:42:24.496Z2023-10-20 22:42:24.801688432 UTC: attempting to log into API
10062023-10-20T22:42:39.527Z2023-10-20 22:42:39.834916458 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10072023-10-20T22:42:40.529Z2023-10-20 22:42:40.836713407 UTC: attempting to log into API
10082023-10-20T22:42:55.563Z2023-10-20 22:42:55.869188991 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10092023-10-20T22:42:56.564Z2023-10-20 22:42:56.869937503 UTC: attempting to log into API
10102023-10-20T22:43:11.610Z2023-10-20 22:43:11.902392447 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10112023-10-20T22:43:12.604Z2023-10-20 22:43:12.903079629 UTC: attempting to log into API
10122023-10-20T22:43:27.629Z2023-10-20 22:43:27.936470717 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10132023-10-20T22:43:28.630Z2023-10-20 22:43:28.937301131 UTC: attempting to log into API
10142023-10-20T22:43:43.662Z2023-10-20 22:43:43.970526796 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10152023-10-20T22:43:44.666Z2023-10-20 22:43:44.971534923 UTC: attempting to log into API
10162023-10-20T22:43:59.696Z2023-10-20 22:44:00.003933746 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10172023-10-20T22:44:00.699Z2023-10-20 22:44:01.004781120 UTC: attempting to log into API
10182023-10-20T22:44:15.729Z2023-10-20 22:44:16.037347615 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10192023-10-20T22:44:16.730Z2023-10-20 22:44:17.038104908 UTC: attempting to log into API
10202023-10-20T22:44:38.965Z2023-10-20 22:44:32.070801786 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10212023-10-20T22:44:39.045Z2023-10-20 22:44:33.071945174 UTC: attempting to log into API
10222023-10-20T22:44:47.797Z2023-10-20 22:44:48.104858965 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10232023-10-20T22:44:48.798Z2023-10-20 22:44:49.105778361 UTC: attempting to log into API
10242023-10-20T22:45:03.830Z2023-10-20 22:45:04.138014251 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10252023-10-20T22:45:04.832Z2023-10-20 22:45:05.139027038 UTC: attempting to log into API
10262023-10-20T22:45:19.865Z2023-10-20 22:45:20.172708040 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10272023-10-20T22:45:20.867Z2023-10-20 22:45:21.174398788 UTC: attempting to log into API
10282023-10-20T22:45:35.900Z2023-10-20 22:45:36.207991380 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10292023-10-20T22:45:36.901Z2023-10-20 22:45:37.209664397 UTC: attempting to log into API
10302023-10-20T22:45:51.981Z2023-10-20 22:45:52.242790971 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10312023-10-20T22:45:52.943Z2023-10-20 22:45:53.244596600 UTC: attempting to log into API
10322023-10-20T22:46:07.976Z2023-10-20 22:46:08.276305092 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10332023-10-20T22:46:08.969Z2023-10-20 22:46:09.277136256 UTC: attempting to log into API
10342023-10-20T22:46:24.003Z2023-10-20 22:46:24.310487174 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10352023-10-20T22:46:25.003Z2023-10-20 22:46:25.311257077 UTC: attempting to log into API
10362023-10-20T22:46:40.035Z2023-10-20 22:46:40.343150872 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10372023-10-20T22:46:41.037Z2023-10-20 22:46:41.343981066 UTC: attempting to log into API
10382023-10-20T22:46:56.068Z2023-10-20 22:46:56.376030313 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10392023-10-20T22:46:57.069Z2023-10-20 22:46:57.377030630 UTC: attempting to log into API
10402023-10-20T22:47:12.102Z2023-10-20 22:47:12.409561004 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10412023-10-20T22:47:13.105Z2023-10-20 22:47:13.410270057 UTC: attempting to log into API
10422023-10-20T22:47:28.135Z2023-10-20 22:47:28.443120616 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10432023-10-20T22:47:29.136Z2023-10-20 22:47:29.444130423 UTC: attempting to log into API
10442023-10-20T22:47:44.168Z2023-10-20 22:47:44.476329973 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10452023-10-20T22:47:45.169Z2023-10-20 22:47:45.477087846 UTC: attempting to log into API
10462023-10-20T22:48:00.202Z2023-10-20 22:48:00.509542049 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10472023-10-20T22:48:01.203Z2023-10-20 22:48:01.510384663 UTC: attempting to log into API
10482023-10-20T22:48:16.238Z2023-10-20 22:48:16.543966095 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10492023-10-20T22:48:17.413Z2023-10-20 22:48:17.544778678 UTC: attempting to log into API
10502023-10-20T22:48:32.272Z2023-10-20 22:48:32.576969128 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10512023-10-20T22:48:33.270Z2023-10-20 22:48:33.577835912 UTC: attempting to log into API
10522023-10-20T22:48:48.303Z2023-10-20 22:48:48.610897856 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10532023-10-20T22:48:49.304Z2023-10-20 22:48:49.611810841 UTC: attempting to log into API
10542023-10-20T22:49:04.338Z2023-10-20 22:49:04.645408372 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10552023-10-20T22:49:05.339Z2023-10-20 22:49:05.646369449 UTC: attempting to log into API
10562023-10-20T22:49:20.372Z2023-10-20 22:49:20.680010761 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out
10572023-10-20T22:49:21.376ZError: logging in
10582023-10-20T22:49:21.400Z
10592023-10-20T22:49:21.424ZCaused by:
10602023-10-20T22:49:21.847Z timed out after 609.293928816s
10612023-10-20T22:49:21.872Z
10622023-10-20T22:49:21.896ZStack backtrace:
10632023-10-20T22:49:21.920Z
10642023-10-20T22:49:21.944Z+ _exit_trap
10652023-10-20T22:49:21.995Z+ local status=1
10662023-10-20T22:49:22.019Z+ [[ 1 -eq 0 ]]
10672023-10-20T22:49:22.043Z+ set +o errexit
10682023-10-20T22:49:22.067Z+ set -o xtrace
10692023-10-20T22:49:22.091Z+ banner evidence
10702023-10-20T22:49:22.115Z
10712023-10-20T22:49:22.140Z ###### # # # ##### ###### # # #### ######
10722023-10-20T22:49:22.167Z # # # # # # # ## # # # #
10732023-10-20T22:49:22.194Z ##### # # # # # ##### # # # # #####
10742023-10-20T22:49:22.221Z # # # # # # # # # # # #
10752023-10-20T22:49:22.247Z # # # # # # # # ## # # #
10762023-10-20T22:49:22.271Z ###### ## # ##### ###### # # #### ######
10772023-10-20T22:49:22.295Z
10782023-10-20T22:49:22.319Z+ zoneadm list -civ
10792023-10-20T22:49:22.343Z ID NAME STATUS PATH BRAND IP
10802023-10-20T22:49:22.368Z 0 global running / ipkg shared
10812023-10-20T22:49:22.393Z 1 sidecar_softnpu running /sidecar/sidecar_softnpu omicron1 excl
10822023-10-20T22:49:22.417Z 2 oxz_switch running /zone/oxz_switch omicron1 excl
10832023-10-20T22:49:22.441Z 3 oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af running /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af omicron1 excl
10842023-10-20T22:49:22.465Z 4 oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877 running /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877 omicron1 excl
10852023-10-20T22:49:22.510Z 5 oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84 running /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84 omicron1 excl
10862023-10-20T22:49:22.535Z 6 oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe running /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe omicron1 excl
10872023-10-20T22:49:22.559Z+ pfexec dladm show-phys -m
10882023-10-20T22:49:22.583ZLINK SLOT ADDRESS INUSE CLIENT
10892023-10-20T22:49:22.607Zigb0 primary 18:c0:4d:d:a0:2a yes igb0
10902023-10-20T22:49:22.632Zigb1 primary 18:c0:4d:d:a0:2b no --
10912023-10-20T22:49:22.656Ztfpkt0 primary 2:0:0:0:0:0 no --
10922023-10-20T22:49:22.680Z+ pfexec dladm show-link
10932023-10-20T22:49:22.704ZLINK CLASS MTU STATE BRIDGE OVER
10942023-10-20T22:49:22.727Zigb0 phys 1500 up -- --
10952023-10-20T22:49:22.751Zigb1 phys 1500 unknown -- --
10962023-10-20T22:49:22.776Ztfpkt0 phys 1500 down -- --
10972023-10-20T22:49:22.800Znet0 simnet 9000 up -- sc0_0
10982023-10-20T22:49:22.824Zsc0_0 simnet 9000 up -- net0
10992023-10-20T22:49:22.848Znet1 simnet 9000 up -- sc1_0
11002023-10-20T22:49:22.872Zsc1_0 simnet 9000 up -- net1
11012023-10-20T22:49:22.897Zsc0_1 vnic 1500 up -- igb0
11022023-10-20T22:49:22.921Ztfportrear0_0 simnet 9000 up -- sidecar_shi0
11032023-10-20T22:49:22.946Zsidecar_shi0 simnet 9000 up -- tfportrear0_0
11042023-10-20T22:49:22.970Ztfportqsfp0_0 simnet 9000 up -- sidecar_shi1
11052023-10-20T22:49:22.994Zsidecar_shi1 simnet 9000 up -- tfportqsfp0_0
11062023-10-20T22:49:23.018Zbootstrap_stub0 etherstub 9000 up -- --
11072023-10-20T22:49:23.043Zbootstrap0 vnic 1500 up -- bootstrap_stub0
11082023-10-20T22:49:23.067Zunderlay_stub0 etherstub 9000 up -- --
11092023-10-20T22:49:23.091Zunderlay0 vnic 9000 up -- underlay_stub0
11102023-10-20T22:49:23.115ZoxBootstrap0 vnic 1500 up -- bootstrap_stub0
11112023-10-20T22:49:23.140ZoxControlService0 vnic 9000 up -- underlay_stub0
11122023-10-20T22:49:23.164ZoxControlService1 vnic 9000 up -- underlay_stub0
11132023-10-20T22:49:23.188ZoxControlService2 vnic 9000 up -- underlay_stub0
11142023-10-20T22:49:23.213ZoxControlService3 vnic 9000 up -- underlay_stub0
11152023-10-20T22:49:23.237Zopte0 misc 1500 up -- --
11162023-10-20T22:49:23.261Zvopte0 vnic 1500 up -- opte0
11172023-10-20T22:49:23.285ZLINK CLASS MTU STATE BRIDGE OVER
11182023-10-20T22:49:23.309ZoxControlService4 vnic 9000 up -- underlay_stub0
11192023-10-20T22:49:23.332Z+ pfexec dladm show-vnic
11202023-10-20T22:49:23.356ZLINK OVER SPEED MACADDRESS MACADDRTYPE VID
11212023-10-20T22:49:23.380Zsc0_1 igb0 1000 a8:e1:de:1:70:1d fixed 0
11222023-10-20T22:49:23.405Zbootstrap0 bootstrap_stub0 0 2:8:20:56:83:53 random 0
11232023-10-20T22:49:23.429Zunderlay0 underlay_stub0 0 2:8:20:f5:3:21 random 0
11242023-10-20T22:49:23.453ZoxBootstrap0 bootstrap_stub0 0 2:8:20:9e:a5:b7 random 0
11252023-10-20T22:49:23.882ZoxControlService0 underlay_stub0 0 2:8:20:bf:4b:61 random 0
11262023-10-20T22:49:23.906ZoxControlService1 underlay_stub0 0 2:8:20:9f:8c:2d random 0
11272023-10-20T22:49:23.930ZoxControlService2 underlay_stub0 0 2:8:20:30:ba:dc random 0
11282023-10-20T22:49:23.954Z+ pfexec ipadm
11292023-10-20T22:49:23.978ZoxControlService3 underlay_stub0 0 2:8:20:b1:8a:c1 random 0
11302023-10-20T22:49:24.003Z+ pfexec netstat -rncva
11312023-10-20T22:49:24.027Zvopte0 opte0 0 a8:40:25:ff:a8:e1 fixed 0
11322023-10-20T22:49:24.051Z+ pfexec netstat -anu
11332023-10-20T22:49:24.077ZoxControlService4 underlay_stub0 0 2:8:20:b7:7c:42 random 0
11342023-10-20T22:49:24.101Z+ pfexec arp -an
11352023-10-20T22:49:24.125ZADDROBJ TYPE STATE ADDR
11362023-10-20T22:49:24.149Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
11372023-10-20T22:49:24.173Zlo0/v4 static ok 127.0.0.1/8
11382023-10-20T22:49:24.197Zigb0/dhcp dhcp ok 10.151.2.100/24
11392023-10-20T22:49:24.221Zlo0/v6 static ok ::1/128
11402023-10-20T22:49:24.245Znet0/ll addrconf ok fe80::c418:9dff:fe23:e08c%net0/10
11412023-10-20T22:49:24.269Znet1/ll addrconf ok fe80::38da:9bff:fef4:4c2d%net1/10
11422023-10-20T22:49:24.297Zbootstrap0/ll addrconf ok fe80::8:20ff:fe56:8353%bootstrap0/10
11432023-10-20T22:49:24.321Zbootstrap0/bootstrap6 static ok fdb0:18c0:4d0d:a02a::1/64
11442023-10-20T22:49:24.345Zunderlay0/ll addrconf ok fe80::8:20ff:fef5:321%underlay0/10
11452023-10-20T22:49:24.369Zunderlay0/sled6 static ok fd00:1122:3344:101::1/64
11462023-10-20T22:49:24.393Zunderlay0/internaldns2 static ok fd00:1122:3344:3::2/64
11472023-10-20T22:49:24.417Zunderlay0/internaldns1 static ok fd00:1122:3344:2::2/64
11482023-10-20T22:49:24.442Zunderlay0/internaldns0 static ok fd00:1122:3344:1::2/64
11492023-10-20T22:49:24.466Z
11502023-10-20T22:49:24.490Z+ pfexec /opt/oxide/opte/bin/opteadm list-ports
11512023-10-20T22:49:24.514ZIRE Table: IPv4
11522023-10-20T22:49:24.561Z+ z_swadm link ls
11532023-10-20T22:49:24.586Z Destination Mask Gateway Device MTU Ref Flg Out In/Fwd
11542023-10-20T22:49:24.611Z+ echo '== swadm link' ls
11552023-10-20T22:49:24.636Z-------------------- --------------- -------------------- ------ ----- --- --- ------ ------
11562023-10-20T22:49:24.660Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm link ls
11572023-10-20T22:49:24.684Z0.0.0.0 255.255.255.255 -- igb0 1500 1 UHb 0 0
11582023-10-20T22:49:24.708Z+ z_swadm addr list
11592023-10-20T22:49:24.733Zdefault 0.0.0.0 10.151.2.1 igb0 1500 3 UG 649325 0
11602023-10-20T22:49:24.765Z+ echo '== swadm addr' list
11612023-10-20T22:49:24.839Z10.0.0.0 255.255.255.255 -- igb0 1500 1 UHb 0 0
11622023-10-20T22:49:24.863Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm addr list
11632023-10-20T22:49:24.888Z10.151.2.0 255.255.255.255 -- igb0 1500 1 UHb 0 0
11642023-10-20T22:49:24.912Z+ z_swadm route list
11652023-10-20T22:49:24.936Z10.151.2.0/24 255.255.255.0 10.151.2.100 igb0 1500 4 U 114 0
11662023-10-20T22:49:24.960Z+ echo '== swadm route' list
11672023-10-20T22:49:24.984Z10.151.2.1/32 255.255.255.255 10.151.2.100 igb0 1500 3 UC 0 0
11682023-10-20T22:49:25.008Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm route list
11692023-10-20T22:49:25.032Z10.151.2.100 255.255.255.255 -- igb0 1500 2 UHL 2 1273142
11702023-10-20T22:49:25.056Z+ z_swadm arp list
11712023-10-20T22:49:25.079Z10.151.2.164/32 255.255.255.255 10.151.2.100 igb0 1500 2 UC 114 0
11722023-10-20T22:49:25.103Z+ echo '== swadm arp' list
11732023-10-20T22:49:25.127Z10.151.2.255 255.255.255.255 -- igb0 1500 1 UHb 0 0
11742023-10-20T22:49:25.151Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm arp list
11752023-10-20T22:49:25.175Z10.255.255.255 255.255.255.255 -- igb0 1500 1 UHb 0 0
11762023-10-20T22:49:25.200Z+ z_swadm nat list
11772023-10-20T22:49:25.224Z127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 70 70
11782023-10-20T22:49:25.251Z+ echo '== swadm nat' list
11792023-10-20T22:49:25.283Z255.255.255.255 255.255.255.255 -- igb0 1500 1 UHb 0 5
11802023-10-20T22:49:25.314Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm nat list
11812023-10-20T22:49:25.338Z
11822023-10-20T22:49:25.362Z++ pfexec /opt/oxide/opte/bin/opteadm list-ports
11832023-10-20T22:49:25.386ZIRE Table: IPv6
11842023-10-20T22:49:25.410Z++ tail +2
11852023-10-20T22:49:25.435Z Destination/Mask Gateway If MTU Ref Flags Out In/Fwd
11862023-10-20T22:49:25.459Z++ awk '{ print $1; }'
11872023-10-20T22:49:25.483Z--------------------------- --------------------------- ----- ----- --- ----- ------ ------
11882023-10-20T22:49:25.507Z+ PORTS=opte0
11892023-10-20T22:49:25.531Zfe80::8:20ff:fef5:321 -- underlay0 9000 2 UHL 0 0
11902023-10-20T22:49:25.556Z+ for p in $PORTS
11912023-10-20T22:49:25.586Z::1 ::1 lo0 8252 4 UH 428 428
11922023-10-20T22:49:25.610Z++ pfexec /opt/oxide/opte/bin/opteadm list-layers -p opte0
11932023-10-20T22:49:25.634Zfdb0:18c0:4d0d:a02a::2 fdb0:18c0:4d0d:a02a::1 bootstrap0 1500 2 UC 111 0
11942023-10-20T22:49:25.658Z++ tail +2
11952023-10-20T22:49:25.683Zfdb0:18c0:4d0d:a02a::1 -- bootstrap0 1500 2 UHL 8 141
11962023-10-20T22:49:25.720Z++ awk '{ print $1; }'
11972023-10-20T22:49:25.747Zfe80::8:20ff:fe56:8353 -- bootstrap0 1500 2 UHL 0 0
11982023-10-20T22:49:25.773Z+ LAYERS='gateway
11992023-10-20T22:49:25.800Zfe80::c418:9dff:fe23:e08c -- net0 9000 2 UHL 7 401
12002023-10-20T22:49:25.826Zfirewall
12012023-10-20T22:49:25.850Zfd00:1122:3344:101::c fd00:1122:3344:101::1 underlay0 9000 25 UC 335 0
12022023-10-20T22:49:25.873Zrouter
12032023-10-20T22:49:25.897Zfe80::38da:9bff:fef4:4c2d -- net1 9000 2 UHL 0 0
12042023-10-20T22:49:25.922Znat
12052023-10-20T22:49:25.946Zfd00:1122:3344:101::b fd00:1122:3344:101::1 underlay0 9000 2 UC 207 0
12062023-10-20T22:49:25.970Zoverlay'
12072023-10-20T22:49:25.994Zfd00:1122:3344:101::a fd00:1122:3344:101::1 underlay0 9000 2 UC 207 0
12082023-10-20T22:49:26.018Z+ for l in $LAYERS
12092023-10-20T22:49:26.042Zfd00:1122:3344:3::2 -- underlay0 9000 2 UHL 0 245
12102023-10-20T22:49:26.066Z+ pfexec /opt/oxide/opte/bin/opteadm dump-layer -p opte0 gateway
12112023-10-20T22:49:26.091Zfd00:1122:3344:101::1 -- underlay0 9000 2 UHL 606 684
12122023-10-20T22:49:26.115Z+ for l in $LAYERS
12132023-10-20T22:49:26.139Zfd00:1122:3344:2::2 -- underlay0 9000 2 UHL 0 230
12142023-10-20T22:49:26.163Z+ pfexec /opt/oxide/opte/bin/opteadm dump-layer -p opte0 firewall
12152023-10-20T22:49:26.187Zfd00:1122:3344:1::1 fd00:1122:3344:1::2 underlay0 9000 2 UC 267 221
12162023-10-20T22:49:26.211Z+ for l in $LAYERS
12172023-10-20T22:49:26.238Zfd00:1122:3344:1::2 -- underlay0 9000 2 UHL 0 224
12182023-10-20T22:49:26.262Z+ pfexec /opt/oxide/opte/bin/opteadm dump-layer -p opte0 router
12192023-10-20T22:49:26.286Zfe80::ecc6:3dff:fe20:ccbb fe80::c418:9dff:fe23:e08c net0 9000 3 UC 397 0
12202023-10-20T22:49:26.310Zfd00:1122:3344:2::1 fd00:1122:3344:2::2 underlay0 9000 2 UC 270 213
12212023-10-20T22:49:26.334Zfd00:1122:3344:101::2 fd00:1122:3344:101::1 underlay0 9000 2 UC 346 421
12222023-10-20T22:49:26.358Zfd00:1122:3344:3::1 fd00:1122:3344:3::2 underlay0 9000 2 UC 282 189
12232023-10-20T22:49:26.382Zfdb0:18c0:4d0d:a02a::/64 fdb0:18c0:4d0d:a02a::1 bootstrap0 1500 3 U 111 0
12242023-10-20T22:49:26.406Zfd00:1122:3344:1::/64 fd00:1122:3344:1::2 underlay0 9000 3 U 267 221
12252023-10-20T22:49:26.430Zfd00:99::/64 fe80::ecc6:3dff:fe20:ccbb net0 9000 1 UG 0 0
12262023-10-20T22:49:26.454Zfd00:1122:3344:101::/64 fd00:1122:3344:101::1 underlay0 9000 6 U 1095 421
12272023-10-20T22:49:26.477Zfd00:1122:3344:3::/64 fd00:1122:3344:3::2 underlay0 9000 3 U 282 189
12282023-10-20T22:49:26.501Zfd00:1122:3344:2::/64 fd00:1122:3344:2::2 underlay0 9000 3 U 270 213
12292023-10-20T22:49:26.525Zfe80::/10 fe80::8:20ff:fef5:321 underlay0 9000 2 U 0 0
12302023-10-20T22:49:26.549Zfe80::/10 fe80::8:20ff:fe56:8353 bootstrap0 1500 2 U 0 0
12312023-10-20T22:49:26.573Zfe80::/10 fe80::38da:9bff:fef4:4c2d net1 9000 2 U 0 0
12322023-10-20T22:49:26.612Zfe80::/10 fe80::c418:9dff:fe23:e08c net0 9000 3 U 397 0
12332023-10-20T22:49:26.636Z
12342023-10-20T22:49:26.660ZUDP: IPv4
12352023-10-20T22:49:26.684Z Local Address Remote Address User Pid Command State
12362023-10-20T22:49:26.708Z-------------------- -------------------- -------- ------ -------------- ----------
12372023-10-20T22:49:26.732Z *.* root 78 in.mpathd Unbound
12382023-10-20T22:49:26.756Z *.* root 78 in.mpathd Unbound
12392023-10-20T22:49:26.780Z *.68 root 235 dhcpagent Idle
12402023-10-20T22:49:26.804Z *.546 root 235 dhcpagent Idle
12412023-10-20T22:49:26.828Z10.151.2.100.68 root 235 dhcpagent Idle
12422023-10-20T22:49:26.852Z *.111 daemon 715 rpcbind Idle
12432023-10-20T22:49:26.876Z *.* daemon 715 rpcbind Unbound
12442023-10-20T22:49:26.900Z *.50475 daemon 715 rpcbind Idle
12452023-10-20T22:49:26.924Z *.111 daemon 715 rpcbind Idle
12462023-10-20T22:49:26.948Z *.* daemon 715 rpcbind Unbound
12472023-10-20T22:49:26.998Z *.53037 daemon 715 rpcbind Idle
12482023-10-20T22:49:27.023Z *.* root 727 in.ndpd Unbound
12492023-10-20T22:49:27.051Z
12502023-10-20T22:49:27.086ZUDP: IPv6
12512023-10-20T22:49:27.113Z Local Address Remote Address User Pid Command State If
12522023-10-20T22:49:27.140Z--------------------------------- --------------------------------- -------- ------ -------------- ---------- -----
12532023-10-20T22:49:27.167Z *.* root 78 in.mpathd Unbound
12542023-10-20T22:49:27.190Z *.546 root 235 dhcpagent Idle
12552023-10-20T22:49:27.214Z *.111 daemon 715 rpcbind Idle
12562023-10-20T22:49:27.238Z *.* daemon 715 rpcbind Unbound
12572023-10-20T22:49:27.263Z *.50475 daemon 715 rpcbind Idle
12582023-10-20T22:49:27.287Z *.* root 727 in.ndpd Unbound
12592023-10-20T22:49:27.311Zff02::dd.3549 root 1676 ddmd Idle net1
12602023-10-20T22:49:27.336Zff02::dd.3549 root 1676 ddmd Idle net0
12612023-10-20T22:49:27.360Zfe80::38da:9bff:fef4:4c2d.3549 root 1676 ddmd Idle net1
12622023-10-20T22:49:27.383Zfe80::c418:9dff:fe23:e08c.3549 root 1676 ddmd Idle net0
12632023-10-20T22:49:27.408Z
12642023-10-20T22:49:27.432ZTCP: IPv4
12652023-10-20T22:49:27.456Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State
12662023-10-20T22:49:27.480Z-------------------- -------------------- -------- ------ -------------- ------ ------ ------ ------ -----------
12672023-10-20T22:49:27.503Z127.0.0.1.5999 *.* root 78 in.mpathd 0 0 128000 0 LISTEN
12682023-10-20T22:49:27.527Z127.0.0.1.4999 *.* root 235 dhcpagent 0 0 128000 0 LISTEN
12692023-10-20T22:49:27.551Z *.111 *.* daemon 715 rpcbind 0 0 128000 0 LISTEN
12702023-10-20T22:49:27.576Z *.* *.* daemon 715 rpcbind 0 0 128000 0 IDLE
12712023-10-20T22:49:27.600Z *.111 *.* daemon 715 rpcbind 0 0 128000 0 LISTEN
12722023-10-20T22:49:27.637Z *.* *.* daemon 715 rpcbind 0 0 128000 0 IDLE
12732023-10-20T22:49:27.661Z *.54321 *.* root 1655 tcpproxy 0 0 128000 0 LISTEN
12742023-10-20T22:49:27.685Z10.151.2.100.64077 54.200.19.125.443 root 807 agent 1049792 371 128872 0 ESTABLISHED
12752023-10-20T22:49:27.709Z
12762023-10-20T22:49:27.733ZTCP: IPv6
12772023-10-20T22:49:27.757Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State If
12782023-10-20T22:49:27.781Z--------------------------------- --------------------------------- -------- ------ -------------- ------ ------ ------ ------ ----------- -----
12792023-10-20T22:49:27.805Z+ for l in $LAYERS
12802023-10-20T22:49:27.829Zfd00:1122:3344:101::1.36218 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12812023-10-20T22:49:27.853Z+ pfexec /opt/oxide/opte/bin/opteadm dump-layer -p opte0 nat
12822023-10-20T22:49:27.877Z::1.5999 *.* root 78 in.mpathd 0 0 128000 0 LISTEN
12832023-10-20T22:49:27.902Z+ for l in $LAYERS
12842023-10-20T22:49:27.926Zfe80::c418:9dff:fe23:e08c.56797 *.* root 1676 ddmd 0 0 128000 0 LISTEN
12852023-10-20T22:49:27.950Z+ pfexec /opt/oxide/opte/bin/opteadm dump-layer -p opte0 overlay
12862023-10-20T22:49:27.974Zfd00:1122:3344:101::1.35565 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12872023-10-20T22:49:27.998Z+ pfexec zfs list
12882023-10-20T22:49:28.025Zfd00:1122:3344:101::1.51413 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12892023-10-20T22:49:28.049Zfd00:1122:3344:101::1.58534 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12902023-10-20T22:49:28.073Zfd00:1122:3344:101::1.40307 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12912023-10-20T22:49:28.097Z *.111 *.* daemon 715 rpcbind 0 0 128000 0 LISTEN
12922023-10-20T22:49:28.120Z *.* *.* daemon 715 rpcbind 0 0 128000 0 IDLE
12932023-10-20T22:49:28.145Zfd00:1122:3344:101::1.12345 *.* root 1661 sled-agent 0 0 128000 0 LISTEN
12942023-10-20T22:49:28.168Zfd00:1122:3344:101::1.35631 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12952023-10-20T22:49:28.192Zfd00:1122:3344:101::1.36750 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12962023-10-20T22:49:28.216Zfd00:1122:3344:101::1.35901 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12972023-10-20T22:49:28.241Zfd00:1122:3344:101::1.45556 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12982023-10-20T22:49:28.265Zfd00:1122:3344:101::1.44068 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
12992023-10-20T22:49:28.289Zfd00:1122:3344:101::1.57723 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13002023-10-20T22:49:28.313Z *.54321 *.* root 1655 tcpproxy 0 0 128000 0 LISTEN
13012023-10-20T22:49:28.337Z::1.8000 *.* root 1676 ddmd 0 0 128000 0 LISTEN
13022023-10-20T22:49:28.361Z::1.37723 ::1.8000 root 1661 sled-agent 65440 0 139264 0 ESTABLISHED
13032023-10-20T22:49:28.385Z::1.8000 ::1.37723 root 1676 ddmd 139060 0 130880 0 ESTABLISHED
13042023-10-20T22:49:28.412Zfdb0:18c0:4d0d:a02a::1.12347 *.* root 1661 sled-agent 0 0 128000 0 LISTEN
13052023-10-20T22:49:28.441Zfdb0:18c0:4d0d:a02a::1.80 *.* root 1661 sled-agent 0 0 128000 0 LISTEN
13062023-10-20T22:49:28.470Zfdb0:18c0:4d0d:a02a::1.12346 *.* root 1661 sled-agent 0 0 128000 0 LISTEN
13072023-10-20T22:49:28.497Zfd00:1122:3344:101::1.41254 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13082023-10-20T22:49:28.525Zfd00:1122:3344:101::1.34942 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13092023-10-20T22:49:28.555Zfd00:1122:3344:101::1.55766 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13102023-10-20T22:49:28.579Zfd00:1122:3344:101::1.59166 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13112023-10-20T22:49:28.604Zfd00:1122:3344:101::1.40225 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13122023-10-20T22:49:28.629Zfd00:1122:3344:101::1.54539 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13132023-10-20T22:49:28.666Zfd00:1122:3344:101::1.41187 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13142023-10-20T22:49:28.692Zfd00:1122:3344:101::1.39399 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13152023-10-20T22:49:28.716Zfd00:1122:3344:101::1.39136 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13162023-10-20T22:49:28.740Zfd00:1122:3344:101::1.47634 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13172023-10-20T22:49:28.764Zfd00:1122:3344:101::1.36445 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13182023-10-20T22:49:28.788Zfd00:1122:3344:101::1.41851 fd00:1122:3344:101::c.12221 root 1661 sled-agent 0 0 134100 0 SYN_SENT
13192023-10-20T22:49:28.812Z
13202023-10-20T22:49:28.836ZActive UNIX domain sockets
13212023-10-20T22:49:28.871ZAddress Type User Pid Command Local Address Remote Address
13222023-10-20T22:49:28.895Z---------------- ---------- -------- ------ -------------- --------------------------------------- ---------------------------------------
13232023-10-20T22:49:28.919Zfffffe85b56767f8 stream-ord root 2861 zoneadmd /var/run/zones/oxz_internal_dns_94ce7ee
13242023-10-20T22:49:28.943Zfffffe85b86887c0 stream-ord root 2858 zoneadmd /var/run/zones/oxz_internal_dns_5b407f7
13252023-10-20T22:49:28.968Zfffffe85b4c36410 stream-ord root 1676 ddmd
13262023-10-20T22:49:29.000Zfffffe85b4c36410 stream-ord root 1676 ddmd
13272023-10-20T22:49:29.027Zfffffe85b4c367b0 stream-ord root 1676 ddmd
13282023-10-20T22:49:29.051Zfffffe85af5d7048 stream-ord root 1939 zoneadmd /var/run/zones/oxz_switch.console_sock
13292023-10-20T22:49:29.075Zfffffe859851a768 stream-ord root 1661 sled-agent
13302023-10-20T22:49:29.099Zfffffe859851a768 stream-ord root 1661 sled-agent
13312023-10-20T22:49:29.123Zfffffe859851ab08 stream-ord root 1661 sled-agent
13322023-10-20T22:49:29.147Zfffffe8587684020 stream-ord root 2843 zoneadmd /var/run/zones/oxz_internal_dns_694393a
13332023-10-20T22:49:29.175Zfffffe85876843c0 stream-ord root 807 agent /var/run/buildomat.sock
13342023-10-20T22:49:29.199Zfffffe8587684760 stream-ord root 807 agent
13352023-10-20T22:49:29.223Zfffffe8587684760 stream-ord root 807 agent
13362023-10-20T22:49:29.247Zfffffe8587684b00 stream-ord root 807 agent
13372023-10-20T22:49:29.271Zfffffe8587555018 stream-ord root 4980 zoneadmd /var/run/zones/oxz_ntp_cdd0f738-d00f-42
13382023-10-20T22:49:29.298Zfffffe85849e2008 stream-ord root 989 zoneadmd /var/run/zones/sidecar_softnpu.console_
13392023-10-20T22:49:29.323Zfffffe85849e23a8 dgram root 727 in.ndpd /var/run/in.ndpd_mib
13402023-10-20T22:49:29.348Zfffffe85849e2748 stream-ord root 727 in.ndpd /var/run/in.ndpd_ipadm
13412023-10-20T22:49:29.372Zfffffe85849e2ae8 stream-ord root 762 inetd /var/run/.inetd.uds
13422023-10-20T22:49:29.396ZNet to Media Table: IPv4
13432023-10-20T22:49:29.427ZDevice IP Address Mask Flags Phys Addr
13442023-10-20T22:49:29.457Z------ -------------------- --------------- -------- ---------------
13452023-10-20T22:49:29.481Zigb0 10.151.2.164 255.255.255.255 a8:e1:de:01:70:1d
13462023-10-20T22:49:29.505Zigb0 10.151.2.1 255.255.255.255 aa:00:04:00:ca:fe
13472023-10-20T22:49:29.528Zigb0 10.151.2.100 255.255.255.255 SPLA 18:c0:4d:0d:a0:2a
13482023-10-20T22:49:29.552Z+ pfexec zpool list
13492023-10-20T22:49:29.576Zlocal v6:
13502023-10-20T22:49:29.600Z+ pfexec fmdump -eVp
13512023-10-20T22:49:29.624Zfe80::ecc6:3dff:fe20:ccbb
13522023-10-20T22:49:29.649Zfd00:99::1
13532023-10-20T22:49:29.692Zlocal v4:
13542023-10-20T22:49:29.716Z10.151.2.174
13552023-10-20T22:49:29.740Zrouter v6:
13562023-10-20T22:49:29.764Zexpected [port, address], found: [1, 0, 8c, e0, 23, fe, ff, 9d, 18, c4, 0, 0, 0, 0, 0, 0, 80, fe, 0, 0]
13572023-10-20T22:49:29.788Zfd00:1122:3344:101::/64 -> ?
13582023-10-20T22:49:29.812Zexpected [port, address], found: [1, 0, 8c, e0, 23, fe, ff, 9d, 18, c4, 0, 0, 0, 0, 0, 0, 80, fe, 0, 0]
13592023-10-20T22:49:29.836Zfdb0:18c0:4d0d:a02a::/64 -> ?
13602023-10-20T22:49:29.864Zexpected [port, address], found: [1, 0, 8c, e0, 23, fe, ff, 9d, 18, c4, 0, 0, 0, 0, 0, 0, 80, fe, 0, 0]
13612023-10-20T22:49:29.889Zfd00:1122:3344:3::/64 -> ?
13622023-10-20T22:49:29.915Zexpected [port, address], found: [1, 0, 8c, e0, 23, fe, ff, 9d, 18, c4, 0, 0, 0, 0, 0, 0, 80, fe, 0, 0]
13632023-10-20T22:49:29.938Zfd00:1122:3344:2::/64 -> ?
13642023-10-20T22:49:29.963Zexpected [port, address], found: [1, 0, 8c, e0, 23, fe, ff, 9d, 18, c4, 0, 0, 0, 0, 0, 0, 80, fe, 0, 0]
13652023-10-20T22:49:29.986Zfd00:1122:3344:1::/64 -> ?
13662023-10-20T22:49:30.015Zrouter v4_idx:
13672023-10-20T22:49:30.040Zrouter v4_routes:
13682023-10-20T22:49:30.064Zresolver v4:
13692023-10-20T22:49:30.088Z10.151.2.174 -> be:af:b5:82:ce:9e
13702023-10-20T22:49:30.112Z10.151.2.100 -> 18:c0:4d:0d:a0:2a
13712023-10-20T22:49:30.137Zresolver v6:
13722023-10-20T22:49:30.161Zfe80::c418:9dff:fe23:e08c -> c6:18:9d:23:e0:8c
13732023-10-20T22:49:30.185Zfe80::ecc6:3dff:fe20:ccbb -> ee:c6:3d:20:cc:bb
13742023-10-20T22:49:30.210Znat v4:
13752023-10-20T22:49:30.234Z10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:a8:e1
13762023-10-20T22:49:30.258Znat_v6:
13772023-10-20T22:49:30.282Zport_mac:
13782023-10-20T22:49:30.306Z1000: a8:40:25:18:7d:1c
13792023-10-20T22:49:30.330Z1: a8:40:25:18:7d:1d
13802023-10-20T22:49:30.354Zproxy arp:
13812023-10-20T22:49:30.378Z10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d
13822023-10-20T22:49:30.403ZLINK MAC ADDRESS IPv4 ADDRESS EXTERNAL IPv4 IPv6 ADDRESS EXTERNAL IPv6 STATE
13832023-10-20T22:49:30.428Zopte0 A8:40:25:FF:A8:E1 172.30.3.5 None None None running
13842023-10-20T22:49:30.452Z== swadm link ls
13852023-10-20T22:49:30.477ZPort/Link Media Speed FEC Enabled State MAC
13862023-10-20T22:49:30.501Zint0/0 CPU 10G None true Up a8:40:25:18:7d:1c
13872023-10-20T22:49:30.530Zrear0/0 Copper 100G None true Up a8:40:25:18:7d:1d
13882023-10-20T22:49:30.554Zqsfp0/0 Copper 40G None true Up a8:40:25:18:7d:3d
13892023-10-20T22:49:30.578Z== swadm addr list
13902023-10-20T22:49:30.603ZLink IPv4 IPv6
13912023-10-20T22:49:30.627Zrear0/0 fe80::ecc6:3dff:fe20:ccbb
13922023-10-20T22:49:30.653Zqsfp0/0 10.151.2.174
13932023-10-20T22:49:30.677Zloopback fd00:99::1
13942023-10-20T22:49:30.723Z== swadm route list
13952023-10-20T22:49:30.747ZSubnet Port Link Gateway
13962023-10-20T22:49:30.774Z0.0.0.0/0 qsfp0 0 10.151.2.100
13972023-10-20T22:49:30.798Zfd00:1122:3344:1::/64 rear0 0 fe80::c418:9dff:fe23:e08c
13982023-10-20T22:49:30.823Zfd00:1122:3344:2::/64 rear0 0 fe80::c418:9dff:fe23:e08c
13992023-10-20T22:49:30.850Zfd00:1122:3344:3::/64 rear0 0 fe80::c418:9dff:fe23:e08c
14002023-10-20T22:49:30.875Zfd00:1122:3344:101::/64 rear0 0 fe80::c418:9dff:fe23:e08c
14012023-10-20T22:49:30.899Zfdb0:18c0:4d0d:a02a::/64 rear0 0 fe80::c418:9dff:fe23:e08c
14022023-10-20T22:49:30.923Z== swadm arp list
14032023-10-20T22:49:30.947Zhost mac age
14042023-10-20T22:49:30.971Z10.151.2.174 be:af:b5:82:ce:9e 10m35s
14052023-10-20T22:49:30.995Zfe80::c418:9dff:fe23:e08c c6:18:9d:23:e0:8c 10m37s
14062023-10-20T22:49:31.019Zfe80::ecc6:3dff:fe20:ccbb ee:c6:3d:20:cc:bb 10m37s
14072023-10-20T22:49:31.043Z== swadm nat list
14082023-10-20T22:49:31.067ZExternal IP Port low Port high Internal IP Inner MAC VNI
14092023-10-20T22:49:31.091Z10.151.2.169 0 16383 fd00:1122:3344:101::1 a8:40:25:ff:a8:e1 100
14102023-10-20T22:49:31.115ZLayer gateway
14112023-10-20T22:49:31.139Z======================================================================
14122023-10-20T22:49:31.163ZInbound Flows
14132023-10-20T22:49:31.187Z----------------------------------------------------------------------
14142023-10-20T22:49:31.211ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
14152023-10-20T22:49:31.237Z
14162023-10-20T22:49:31.671ZOutbound Flows
14172023-10-20T22:49:31.695Z----------------------------------------------------------------------
14182023-10-20T22:49:31.746ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
14192023-10-20T22:49:31.772Z
14202023-10-20T22:49:31.798ZInbound Rules
14212023-10-20T22:49:31.822Z----------------------------------------------------------------------
14222023-10-20T22:49:31.846ZID PRI HITS PREDICATES ACTION
14232023-10-20T22:49:31.870Z0 1000 0 inner.ip.dst=172.30.3.5 "Static: ether.src=A8:40:25:FF:77:77"
14242023-10-20T22:49:31.894Z inner.ether.dst=A8:40:25:FF:A8:E1
14252023-10-20T22:49:31.920Z
14262023-10-20T22:49:31.943ZDEF -- 0 -- "deny"
14272023-10-20T22:49:31.967Z
14282023-10-20T22:49:31.991ZOutbound Rules
14292023-10-20T22:49:32.015Z----------------------------------------------------------------------
14302023-10-20T22:49:32.039ZID PRI HITS PREDICATES ACTION
14312023-10-20T22:49:32.063Z3 1 0 inner.ether.src=A8:40:25:FF:A8:E1 "Hairpin: ICMPv4 Echo Reply (A8:40:25:FF:77:77,172.30.3.1) => (A8:40:25:FF:A8:E1,172.30.3.5)"
14322023-10-20T22:49:32.118Z inner.ether.dst=A8:40:25:FF:77:77
14332023-10-20T22:49:32.142Z inner.ip.src=172.30.3.5
14342023-10-20T22:49:32.166Z inner.ip.dst=172.30.3.1
14352023-10-20T22:49:32.190Z inner.ip.proto=ICMP
14362023-10-20T22:49:32.214Z icmp.msg_type=echo request
14372023-10-20T22:49:32.238Z
14382023-10-20T22:49:32.262Z2 1 1 inner.ether.dst=FF:FF:FF:FF:FF:FF "Hairpin: DHCPv4 ACK: 172.30.3.5"
14392023-10-20T22:49:32.286Z inner.ether.src=A8:40:25:FF:A8:E1
14402023-10-20T22:49:32.310Z inner.ip.src=0.0.0.0
14412023-10-20T22:49:32.337Z inner.ip.dst=255.255.255.255
14422023-10-20T22:49:32.361Z inner.ip.proto=UDP
14432023-10-20T22:49:32.386Z inner.ulp.dst=67
14442023-10-20T22:49:32.410Z inner.ulp.src=68
14452023-10-20T22:49:32.434Z dhcp.msg_type=Request
14462023-10-20T22:49:32.458Z
14472023-10-20T22:49:32.483Z1 1 1 inner.ether.dst=FF:FF:FF:FF:FF:FF "Hairpin: DHCPv4 OFFER: 172.30.3.5"
14482023-10-20T22:49:32.507Z inner.ether.src=A8:40:25:FF:A8:E1
14492023-10-20T22:49:32.531Z inner.ip.src=0.0.0.0
14502023-10-20T22:49:32.554Z inner.ip.dst=255.255.255.255
14512023-10-20T22:49:32.579Z inner.ip.proto=UDP
14522023-10-20T22:49:32.603Z inner.ulp.dst=67
14532023-10-20T22:49:32.627Z inner.ulp.src=68
14542023-10-20T22:49:32.651Z dhcp.msg_type=Discover
14552023-10-20T22:49:32.678Z
14562023-10-20T22:49:32.702Z0 1 20 inner.ether.ether_type=ARP "Handle Packet"
14572023-10-20T22:49:32.727Z inner.ether.dst=FF:FF:FF:FF:FF:FF
14582023-10-20T22:49:32.771Z inner.ether.src=A8:40:25:FF:A8:E1
14592023-10-20T22:49:32.798Z
14602023-10-20T22:49:32.822Z4 1000 44 inner.ip.src=172.30.3.5 "Meta: vpc-meta"
14612023-10-20T22:49:32.846Z inner.ether.src=A8:40:25:FF:A8:E1
14622023-10-20T22:49:32.871Z
14632023-10-20T22:49:32.907ZDEF -- 27 -- "deny"
14642023-10-20T22:49:32.936Z
14652023-10-20T22:49:32.962ZLayer firewall
14662023-10-20T22:49:32.987Z======================================================================
14672023-10-20T22:49:33.012ZInbound Flows
14682023-10-20T22:49:33.036Z----------------------------------------------------------------------
14692023-10-20T22:49:33.061ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
14702023-10-20T22:49:33.085ZUDP 1.1.1.1 53 172.30.3.5 59841 0 no-op
14712023-10-20T22:49:33.109ZUDP 9.9.9.9 53 172.30.3.5 42639 0 no-op
14722023-10-20T22:49:33.133Z
14732023-10-20T22:49:33.157ZOutbound Flows
14742023-10-20T22:49:33.181Z----------------------------------------------------------------------
14752023-10-20T22:49:33.205ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
14762023-10-20T22:49:33.229ZUDP 172.30.3.5 42639 9.9.9.9 53 0 no-op
14772023-10-20T22:49:33.253ZUDP 172.30.3.5 59841 1.1.1.1 53 0 no-op
14782023-10-20T22:49:33.278Z
14792023-10-20T22:49:33.303ZInbound Rules
14802023-10-20T22:49:33.327Z----------------------------------------------------------------------
14812023-10-20T22:49:33.352ZID PRI HITS PREDICATES ACTION
14822023-10-20T22:49:33.377ZDEF -- 0 -- "deny"
14832023-10-20T22:49:33.403Z
14842023-10-20T22:49:33.427ZOutbound Rules
14852023-10-20T22:49:33.456Z----------------------------------------------------------------------
14862023-10-20T22:49:33.481ZID PRI HITS PREDICATES ACTION
14872023-10-20T22:49:33.506ZDEF -- 44 -- "stateful allow"
14882023-10-20T22:49:33.530Z
14892023-10-20T22:49:33.554ZLayer router
14902023-10-20T22:49:33.578Z======================================================================
14912023-10-20T22:49:33.603ZInbound Flows
14922023-10-20T22:49:33.631Z----------------------------------------------------------------------
14932023-10-20T22:49:33.655ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
14942023-10-20T22:49:33.679Z
14952023-10-20T22:49:33.703ZOutbound Flows
14962023-10-20T22:49:33.727Z----------------------------------------------------------------------
14972023-10-20T22:49:33.752ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
14982023-10-20T22:49:33.796Z
14992023-10-20T22:49:33.820ZInbound Rules
15002023-10-20T22:49:33.844Z----------------------------------------------------------------------
15012023-10-20T22:49:34.280ZID PRI HITS PREDICATES ACTION
15022023-10-20T22:49:34.304ZDEF -- 0 -- "allow"
15032023-10-20T22:49:34.331Z
15042023-10-20T22:49:34.357ZOutbound Rules
15052023-10-20T22:49:34.385Z----------------------------------------------------------------------
15062023-10-20T22:49:34.411ZID PRI HITS PREDICATES ACTION
15072023-10-20T22:49:34.435Z0 18 0 inner.ip.dst=172.30.3.0/24 "Meta: Target = Subnet: 172.30.3.0/24"
15082023-10-20T22:49:34.459Z+ pfexec ptree -z global
15092023-10-20T22:49:34.483Z1 42 44 inner.ip.dst=0.0.0.0/0 "Meta: Target = IG"
15102023-10-20T22:49:34.514Z+ pfexec svcs -xv
15112023-10-20T22:49:34.543ZDEF -- 0 -- "deny"
15122023-10-20T22:49:34.567Z++ zoneadm list -n
15132023-10-20T22:49:34.591Z
15142023-10-20T22:49:34.616Z+ for z in $(zoneadm list -n)
15152023-10-20T22:49:34.640ZLayer nat
15162023-10-20T22:49:34.665Z+ banner sidecar_softnpu
15172023-10-20T22:49:34.689Z======================================================================
15182023-10-20T22:49:34.713Z+ pfexec svcs -xv -z sidecar_softnpu
15192023-10-20T22:49:34.737ZInbound Flows
15202023-10-20T22:49:34.761Z+ pfexec ptree -z sidecar_softnpu
15212023-10-20T22:49:34.785Z----------------------------------------------------------------------
15222023-10-20T22:49:34.821Z+ pfexec zlogin sidecar_softnpu ipadm
15232023-10-20T22:49:34.845ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
15242023-10-20T22:49:34.869Z+ pfexec zlogin sidecar_softnpu netstat -rncva
15252023-10-20T22:49:34.894ZUDP 1.1.1.1 53 10.151.2.169 16372 0 SNAT
15262023-10-20T22:49:34.918Z+ pfexec zlogin sidecar_softnpu netstat -anu
15272023-10-20T22:49:35.351ZUDP 1.1.1.1 53 10.151.2.169 16376 0 SNAT
15282023-10-20T22:49:35.383Z+ pfexec zlogin sidecar_softnpu arp -an
15292023-10-20T22:49:35.411ZUDP 9.9.9.9 53 10.151.2.169 16373 0 SNAT
15302023-10-20T22:49:35.437Z+ for z in $(zoneadm list -n)
15312023-10-20T22:49:35.466Z
15322023-10-20T22:49:35.497Z+ banner switch
15332023-10-20T22:49:35.525ZOutbound Flows
15342023-10-20T22:49:35.549Z+ pfexec svcs -xv -z oxz_switch
15352023-10-20T22:49:35.574Z----------------------------------------------------------------------
15362023-10-20T22:49:35.598Z+ pfexec ptree -z oxz_switch
15372023-10-20T22:49:35.626ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
15382023-10-20T22:49:35.650Z+ pfexec zlogin oxz_switch ipadm
15392023-10-20T22:49:35.674ZUDP 172.30.3.5 42639 9.9.9.9 53 0 SNAT
15402023-10-20T22:49:35.699Z+ pfexec zlogin oxz_switch netstat -rncva
15412023-10-20T22:49:35.723ZUDP 172.30.3.5 55585 1.1.1.1 53 0 SNAT
15422023-10-20T22:49:35.747Z+ pfexec zlogin oxz_switch netstat -anu
15432023-10-20T22:49:35.771ZUDP 172.30.3.5 59841 1.1.1.1 53 0 SNAT
15442023-10-20T22:49:35.798Z
15452023-10-20T22:49:35.849ZInbound Rules
15462023-10-20T22:49:35.874Z----------------------------------------------------------------------
15472023-10-20T22:49:35.897ZID PRI HITS PREDICATES ACTION
15482023-10-20T22:49:35.927ZDEF -- 0 -- "allow"
15492023-10-20T22:49:35.952Z
15502023-10-20T22:49:35.976ZOutbound Rules
15512023-10-20T22:49:36.000Z----------------------------------------------------------------------
15522023-10-20T22:49:36.024ZID PRI HITS PREDICATES ACTION
15532023-10-20T22:49:36.049Z0 100 45 inner.ether.ether_type=IPv4 "Stateful: 10.151.2.169:0-16383"
15542023-10-20T22:49:36.073Z meta: router-target=ig
15552023-10-20T22:49:36.097Z
15562023-10-20T22:49:36.121ZDEF -- 0 -- "allow"
15572023-10-20T22:49:36.145Z
15582023-10-20T22:49:36.169ZLayer overlay
15592023-10-20T22:49:36.193Z======================================================================
15602023-10-20T22:49:36.218ZInbound Flows
15612023-10-20T22:49:36.242Z----------------------------------------------------------------------
15622023-10-20T22:49:36.266ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
15632023-10-20T22:49:36.289Z
15642023-10-20T22:49:36.314ZOutbound Flows
15652023-10-20T22:49:36.339Z----------------------------------------------------------------------
15662023-10-20T22:49:36.377ZPROTO SRC IP SPORT DST IP DPORT HITS ACTION
15672023-10-20T22:49:36.407Z
15682023-10-20T22:49:36.433ZInbound Rules
15692023-10-20T22:49:36.458Z----------------------------------------------------------------------
15702023-10-20T22:49:36.482ZID PRI HITS PREDICATES ACTION
15712023-10-20T22:49:36.506Z0 1 0 * "Static: Decap"
15722023-10-20T22:49:36.530ZDEF -- 0 -- "deny"
15732023-10-20T22:49:36.554Z
15742023-10-20T22:49:36.578ZOutbound Rules
15752023-10-20T22:49:36.603Z----------------------------------------------------------------------
15762023-10-20T22:49:36.627ZID PRI HITS PREDICATES ACTION
15772023-10-20T22:49:36.653Z0 1 45 * "Static: Encap"
15782023-10-20T22:49:36.677ZDEF -- 0 -- "deny"
15792023-10-20T22:49:36.701Z
15802023-10-20T22:49:36.725ZNAME USED AVAIL REFER MOUNTPOINT
15812023-10-20T22:49:36.749Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b 576K 18.9G 24K /oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b
15822023-10-20T22:49:36.773Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/backing 60.5K 18.9G 24K /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/backing
15832023-10-20T22:49:36.798Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/backing/fmd 36.5K 500M 36.5K /var/fm/fmd
15842023-10-20T22:49:36.824Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster 25.5K 18.9G 25.5K /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster
15852023-10-20T22:49:36.879Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/config 58K 18.9G 58K /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config
15862023-10-20T22:49:36.906Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/crash 24K 18.9G 24K /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/crash
15872023-10-20T22:49:36.931Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/debug 24K 18.9G 24K /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/debug
15882023-10-20T22:49:36.982Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/install 24K 18.9G 24K /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/install
15892023-10-20T22:49:37.006Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/swap 51K 18.9G 51K -
15902023-10-20T22:49:37.030Zoxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b 426K 18.9G 24K /oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b
15912023-10-20T22:49:37.054Zoxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b/backing 24K 18.9G 24K /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/backing
15922023-10-20T22:49:37.080Zoxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster 24K 18.9G 24K /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster
15932023-10-20T22:49:37.105Zoxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b/config 51.5K 18.9G 51.5K /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config
15942023-10-20T22:49:37.129Zoxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b/crash 24K 18.9G 24K /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/crash
15952023-10-20T22:49:37.156Zoxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b/debug 24K 18.9G 24K /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/debug
15962023-10-20T22:49:37.180Zoxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b/install 24K 18.9G 24K /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/install
15972023-10-20T22:49:37.204Zoxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 239M 18.7G 24K /oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03
15982023-10-20T22:49:37.227Zoxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt 239M 18.7G 133K /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt
15992023-10-20T22:49:37.251Zoxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug 99K 18.7G 99K /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug
16002023-10-20T22:49:37.275Zoxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone 238M 18.7G 109K /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone
16012023-10-20T22:49:37.299Zoxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84 238M 18.7G 238M /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84
16022023-10-20T22:49:37.324Zoxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 637K 18.9G 24K /oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03
16032023-10-20T22:49:37.348Zoxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt 331K 18.9G 133K /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt
16042023-10-20T22:49:37.372Zoxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug 99K 18.9G 99K /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug
16052023-10-20T22:49:37.396Zoxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone 99K 18.9G 99K /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone
16062023-10-20T22:49:37.420Zoxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/internal_dns 40.5K 18.9G 40.5K /data
16072023-10-20T22:49:37.444Zoxp_31bd71cd-4736-4a12-a387-9b74b050396f 582K 18.9G 24K /oxp_31bd71cd-4736-4a12-a387-9b74b050396f
16082023-10-20T22:49:37.468Zoxp_31bd71cd-4736-4a12-a387-9b74b050396f/crypt 331K 18.9G 133K /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt
16092023-10-20T22:49:37.492Zoxp_31bd71cd-4736-4a12-a387-9b74b050396f/crypt/debug 99K 18.9G 99K /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/debug
16102023-10-20T22:49:37.516Zoxp_31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone 99K 18.9G 99K /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone
16112023-10-20T22:49:37.540Zoxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 239M 18.7G 24K /oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7
16122023-10-20T22:49:37.564Zoxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt 238M 18.7G 133K /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt
16132023-10-20T22:49:37.588Zoxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/debug 99K 18.7G 99K /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/debug
16142023-10-20T22:49:37.612Zoxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone 238M 18.7G 109K /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone
16152023-10-20T22:49:37.636Zoxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877 238M 18.7G 238M /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877
16162023-10-20T22:49:37.661Zoxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 185M 18.7G 24K /oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930
16172023-10-20T22:49:37.695Zoxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt 185M 18.7G 133K /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt
16182023-10-20T22:49:37.723Zoxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/debug 99K 18.7G 99K /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/debug
16192023-10-20T22:49:37.747Zoxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone 185M 18.7G 100K /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone
16202023-10-20T22:49:37.771Zoxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe 185M 18.7G 185M /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe
16212023-10-20T22:49:37.795Zoxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 239M 18.7G 24K /oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60
16222023-10-20T22:49:37.820Zoxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt 238M 18.7G 133K /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt
16232023-10-20T22:49:37.843Zoxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/debug 99K 18.7G 99K /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/debug
16242023-10-20T22:49:37.868Zoxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone 238M 18.7G 109K /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone
16252023-10-20T22:49:37.903Zoxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af 238M 18.7G 238M /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af
16262023-10-20T22:49:37.927Zoxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/internal_dns 44K 18.7G 44K /data
16272023-10-20T22:49:37.951Zoxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b 588K 18.9G 24K /oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b
16282023-10-20T22:49:37.975Zoxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt 331K 18.9G 133K /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt
16292023-10-20T22:49:38.000Zoxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/debug 99K 18.9G 99K /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/debug
16302023-10-20T22:49:38.024Zoxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone 99K 18.9G 99K /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone
16312023-10-20T22:49:38.050Zoxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 640K 18.9G 24K /oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03
16322023-10-20T22:49:38.074Zoxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt 331K 18.9G 133K /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt
16332023-10-20T22:49:38.099Zoxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug 99K 18.9G 99K /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug
16342023-10-20T22:49:38.124Zoxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone 99K 18.9G 99K /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone
16352023-10-20T22:49:38.151Zoxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/internal_dns 42K 18.9G 42K /data
16362023-10-20T22:49:38.177Zoxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 584K 18.9G 24K /oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03
16372023-10-20T22:49:38.201Zoxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt 331K 18.9G 133K /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt
16382023-10-20T22:49:38.225Zoxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug 99K 18.9G 99K /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug
16392023-10-20T22:49:38.249Zoxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone 99K 18.9G 99K /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone
16402023-10-20T22:49:38.273Zrpool 1.89G 5.38G 24K /rpool
16412023-10-20T22:49:38.297Zrpool/home 25.5K 5.38G 25.5K /home
16422023-10-20T22:49:38.321Zrpool/input 1.57G 5.38G 1.57G /input
16432023-10-20T22:49:38.345Zrpool/sidecar 75.1M 5.38G 24K /sidecar
16442023-10-20T22:49:38.369Zrpool/sidecar/sidecar_softnpu 75.1M 5.38G 75.1M /sidecar/sidecar_softnpu
16452023-10-20T22:49:38.394Zrpool/work 24K 5.38G 24K /work
16462023-10-20T22:49:38.418Zrpool/zone 251M 5.38G 24K /zone
16472023-10-20T22:49:38.442Zrpool/zone/oxz_switch 251M 5.38G 251M /zone/oxz_switch
16482023-10-20T22:49:38.466Zscratch 1.13G 1.80T 1.13G /scratch
16492023-10-20T22:49:38.491ZNAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
16502023-10-20T22:49:38.515Zoxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b 19.5G 580K 19.5G - - 0% 0% 1.00x ONLINE -
16512023-10-20T22:49:38.540Zoxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b 19.5G 426K 19.5G - - 0% 0% 1.00x ONLINE -
16522023-10-20T22:49:39.001Zoxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 19.5G 239M 19.3G - - 0% 1% 1.00x ONLINE -
16532023-10-20T22:49:39.025Zoxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 19.5G 641K 19.5G - - 0% 0% 1.00x ONLINE -
16542023-10-20T22:49:39.049Zoxp_31bd71cd-4736-4a12-a387-9b74b050396f 19.5G 582K 19.5G - - 0% 0% 1.00x ONLINE -
16552023-10-20T22:49:39.073Zoxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 19.5G 239M 19.3G - - 0% 1% 1.00x ONLINE -
16562023-10-20T22:49:39.097Zoxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 19.5G 186M 19.3G - - 0% 0% 1.00x ONLINE -
16572023-10-20T22:49:39.121Zoxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 19.5G 239M 19.3G - - 0% 1% 1.00x ONLINE -
16582023-10-20T22:49:39.145Zoxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b 19.5G 588K 19.5G - - 0% 0% 1.00x ONLINE -
16592023-10-20T22:49:39.174Zoxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 19.5G 644K 19.5G - - 0% 0% 1.00x ONLINE -
16602023-10-20T22:49:39.199Zoxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 19.5G 584K 19.5G - - 0% 0% 1.00x ONLINE -
16612023-10-20T22:49:39.223Z+ pfexec zlogin oxz_switch arp -an
16622023-10-20T22:49:39.247Zrpool 7.50G 1.89G 5.61G - - 0% 25% 1.00x ONLINE -
16632023-10-20T22:49:39.271Z+ for z in $(zoneadm list -n)
16642023-10-20T22:49:39.295Zscratch 1.86T 1.13G 1.86T - - 0% 0% 1.00x ONLINE -
16652023-10-20T22:49:39.320Z+ banner internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af
16662023-10-20T22:49:39.344ZTIME CLASS
16672023-10-20T22:49:39.368Z+ pfexec svcs -xv -z oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af
16682023-10-20T22:49:39.392ZOct 20 2023 22:38:25.876090415 ereport.fm.fmd.asru_nodir
16692023-10-20T22:49:39.417Z+ pfexec ptree -z oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af
16702023-10-20T22:49:39.442Znvlist version: 0
16712023-10-20T22:49:39.467Z+ pfexec zlogin oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af ipadm
16722023-10-20T22:49:39.491Z version = 0x0
16732023-10-20T22:49:39.515Z+ pfexec zlogin oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af netstat -rncva
16742023-10-20T22:49:39.539Z class = ereport.fm.fmd.asru_nodir
16752023-10-20T22:49:39.564Z+ pfexec zlogin oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af netstat -anu
16762023-10-20T22:49:39.589Z ena = 0xb12c93c11d00401
16772023-10-20T22:49:39.613Z msg = failed to open asru cache directory /var/fm/fmd/rsrc
16782023-10-20T22:49:39.646Z __ttl = 0x1
16792023-10-20T22:49:39.684Z __tod = 0x65330161 0x3438142f
16802023-10-20T22:49:39.714Z
16812023-10-20T22:49:39.740Z8 /lib/svc/bin/svc.startd
16822023-10-20T22:49:39.764Z 644 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat -
16832023-10-20T22:49:39.788Z 661 /usr/lib/saf/sac -t 300
16842023-10-20T22:49:39.812Z 667 /usr/lib/saf/ttymon
16852023-10-20T22:49:39.836Z 806 /usr/bin/ctrun -l child -o noorphan,regent /opt/buildomat/lib/agent ru
16862023-10-20T22:49:39.885Z 807 /opt/buildomat/lib/agent run
16872023-10-20T22:49:39.909Z 821 /bin/bash /tmp/Madcv3phoOVDcXeI.sh
16882023-10-20T22:49:39.950Z 12961 ptree -z global
16892023-10-20T22:49:39.978Z 1655 /usr/oxide/tcpproxy -b :: -l 54321 -h 172.20.0.5 -r 12346
16902023-10-20T22:49:40.003Z10 /lib/svc/bin/svc.configd
16912023-10-20T22:49:40.027Z47 /sbin/dlmgmtd
16922023-10-20T22:49:40.051Z51 /lib/inet/ipmgmtd
16932023-10-20T22:49:40.075Z52 /lib/inet/netcfgd
16942023-10-20T22:49:40.099Z78 /lib/inet/in.mpathd
16952023-10-20T22:49:40.126Z98 /usr/lib/pfexecd
16962023-10-20T22:49:40.597Z154 /usr/lib/zones/zonestatd
16972023-10-20T22:49:40.638Z161 /usr/lib/sysevent/syseventd
16982023-10-20T22:49:40.662Z170 devfsadmd
16992023-10-20T22:49:40.688Z235 /sbin/dhcpagent
17002023-10-20T22:49:40.712Z569 /usr/lib/picl/picld
17012023-10-20T22:49:40.736Z602 /usr/sbin/nscd
17022023-10-20T22:49:40.760Z643 /usr/lib/utmpd
17032023-10-20T22:49:40.784Z673 /usr/sbin/cron
17042023-10-20T22:49:40.809Z681 /usr/lib/hotplugd
17052023-10-20T22:49:40.833Z685 /usr/sbin/syslogd
17062023-10-20T22:49:40.857Z715 /usr/sbin/rpcbind
17072023-10-20T22:49:40.882Z727 /usr/lib/inet/in.ndpd
17082023-10-20T22:49:40.906Z762 /usr/lib/inet/inetd start
17092023-10-20T22:49:40.930Z788 /usr/perl5/bin/perl /usr/lib/intrd
17102023-10-20T22:49:40.977Z989 zoneadmd -z sidecar_softnpu
17112023-10-20T22:49:41.001Z1660 ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /
17122023-10-20T22:49:41.025Z 1661 /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.
17132023-10-20T22:49:41.050Z1675 ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_scrip
17142023-10-20T22:49:41.074Z 1676 /opt/oxide/mg-ddm/ddmd --admin-port 8000 --admin-addr ::1 --kind serve
17152023-10-20T22:49:41.098Z1798 /usr/lib/fm/fmd/fmd
17162023-10-20T22:49:41.122Z1939 zoneadmd -z oxz_switch
17172023-10-20T22:49:41.146Z2843 zoneadmd -z oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af
17182023-10-20T22:49:41.170Z2858 zoneadmd -z oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877
17192023-10-20T22:49:41.194Z2861 zoneadmd -z oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84
17202023-10-20T22:49:41.218Z4980 zoneadmd -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe
17212023-10-20T22:49:41.242Z
17222023-10-20T22:49:41.266Z #### # ##### ###### #### ## ##### #### ####
17232023-10-20T22:49:41.290Z # # # # # # # # # # # # # #
17242023-10-20T22:49:41.314Z #### # # # ##### # # # # # #### # #
17252023-10-20T22:49:41.338Z # # # # # # ###### ##### # # #
17262023-10-20T22:49:41.364Z # # # # # # # # # # # # # # # #
17272023-10-20T22:49:41.391Z #### # ##### ###### #### # # # # ####### #### ####
17282023-10-20T22:49:41.418Z
17292023-10-20T22:49:41.444Z992 zsched
17302023-10-20T22:49:41.468Z 1009 /sbin/init
17312023-10-20T22:49:41.493Z1014 /lib/svc/bin/svc.startd
17322023-10-20T22:49:41.517Z 1554 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat -
17332023-10-20T22:49:41.541Z1016 /lib/svc/bin/svc.configd
17342023-10-20T22:49:41.565Z1060 /lib/inet/ipmgmtd
17352023-10-20T22:49:41.589Z1062 /lib/inet/netcfgd
17362023-10-20T22:49:41.613Z1240 /usr/lib/fm/fmd/fmd
17372023-10-20T22:49:41.637Z1264 /usr/lib/pfexecd
17382023-10-20T22:49:41.661Z1388 /softnpu/softnpu --uds-path /softnpu /softnpu/softnpu.toml
17392023-10-20T22:49:41.685Z1490 /usr/sbin/nscd
17402023-10-20T22:49:41.709Z1540 /usr/lib/utmpd
17412023-10-20T22:49:41.733Z1547 /usr/sbin/syslogd
17422023-10-20T22:49:41.758Z1556 /usr/sbin/cron
17432023-10-20T22:49:41.782Z1612 /usr/lib/inet/in.ndpd
17442023-10-20T22:49:41.806ZADDROBJ TYPE STATE ADDR
17452023-10-20T22:49:41.829Zlo0/v4 static ok 127.0.0.1/8
17462023-10-20T22:49:41.853Zlo0/v6 static ok ::1/128
17472023-10-20T22:49:41.877Z
17482023-10-20T22:49:41.901ZIRE Table: IPv4
17492023-10-20T22:49:41.925Z Destination Mask Gateway Device MTU Ref Flg Out In/Fwd
17502023-10-20T22:49:41.949Z-------------------- --------------- -------------------- ------ ----- --- --- ------ ------
17512023-10-20T22:49:41.973Z127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 0 0
17522023-10-20T22:49:42.010Z
17532023-10-20T22:49:42.041ZIRE Table: IPv6
17542023-10-20T22:49:42.112Z Destination/Mask Gateway If MTU Ref Flags Out In/Fwd
17552023-10-20T22:49:42.136Z--------------------------- --------------------------- ----- ----- --- ----- ------ ------
17562023-10-20T22:49:42.160Z::1 ::1 lo0 8252 2 UH 0 0
17572023-10-20T22:49:42.184Z
17582023-10-20T22:49:42.209ZUDP: IPv4
17592023-10-20T22:49:42.233Z Local Address Remote Address User Pid Command State
17602023-10-20T22:49:42.257Z-------------------- -------------------- -------- ------ -------------- ----------
17612023-10-20T22:49:42.282Z *.* root 1612 in.ndpd Unbound
17622023-10-20T22:49:42.306Z
17632023-10-20T22:49:42.330ZUDP: IPv6
17642023-10-20T22:49:42.354Z Local Address Remote Address User Pid Command State If
17652023-10-20T22:49:42.379Z--------------------------------- --------------------------------- -------- ------ -------------- ---------- -----
17662023-10-20T22:49:42.403Z *.* root 1612 in.ndpd Unbound
17672023-10-20T22:49:42.427Z
17682023-10-20T22:49:42.451ZActive UNIX domain sockets
17692023-10-20T22:49:42.478ZAddress Type User Pid Command Local Address Remote Address
17702023-10-20T22:49:42.508Z---------------- ---------- -------- ------ -------------- --------------------------------------- ---------------------------------------
17712023-10-20T22:49:42.535Zfffffe85af5d73e8 stream-ord root 1388 softnpu
17722023-10-20T22:49:42.559Zfffffe85af5d73e8 stream-ord root 1388 softnpu
17732023-10-20T22:49:42.583Zfffffe85af5d7788 stream-ord root 1388 softnpu
17742023-10-20T22:49:42.606Zfffffe85af5d7b28 dgram root 1388 softnpu /softnpu/server
17752023-10-20T22:49:42.631Zfffffe859f409778 stream-ord root 1612 in.ndpd /var/run/in.ndpd_ipadm
17762023-10-20T22:49:42.659Zfffffe859f409b18 dgram root 1612 in.ndpd /var/run/in.ndpd_mib
17772023-10-20T22:49:42.685Z
17782023-10-20T22:49:42.709Z #### # # # ##### #### # #
17792023-10-20T22:49:42.733Z # # # # # # # # #
17802023-10-20T22:49:43.782Z #### # # # # # ######
17812023-10-20T22:49:43.807Z # # ## # # # # # #
17822023-10-20T22:49:43.831Z # # ## ## # # # # # #
17832023-10-20T22:49:43.855Z #### # # # # #### # #
17842023-10-20T22:49:43.879Z
17852023-10-20T22:49:43.903Z1942 zsched
17862023-10-20T22:49:43.927Z 1962 /sbin/init
17872023-10-20T22:49:43.958Z1968 /lib/svc/bin/svc.startd
17882023-10-20T22:49:43.986Z 2455 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat -
17892023-10-20T22:49:44.016Z1970 /lib/svc/bin/svc.configd
17902023-10-20T22:49:44.064Z2018 /lib/inet/ipmgmtd
17912023-10-20T22:49:44.089Z2019 /lib/inet/netcfgd
17922023-10-20T22:49:44.113Z2161 /usr/lib/fm/fmd/fmd
17932023-10-20T22:49:44.137Z2197 /usr/lib/pfexecd
17942023-10-20T22:49:44.162Z2401 /usr/sbin/nscd
17952023-10-20T22:49:44.186Z2453 /usr/lib/utmpd
17962023-10-20T22:49:44.210Z2473 /usr/sbin/cron
17972023-10-20T22:49:44.234Z2475 /usr/sbin/syslogd
17982023-10-20T22:49:44.258Z2590 /usr/lib/inet/in.ndpd
17992023-10-20T22:49:44.282Z2643 /opt/oxide/dendrite/bin/dpd run
18002023-10-20T22:49:44.306Z2651 /opt/oxide/mgs/bin/mgs run --id-and-address-from-smf /var/svc/manifest/s
18012023-10-20T22:49:44.330Z2656 /opt/oxide/dendrite/bin/uplinkd
18022023-10-20T22:49:44.354Z2668 ctrun -l child -o noorphan,regent /opt/oxide/wicketd/bin/wicketd run /va
18032023-10-20T22:49:44.379Z 2669 /opt/oxide/wicketd/bin/wicketd run /var/svc/manifest/site/wicketd/conf
18042023-10-20T22:49:44.403Z2678 ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_scrip
18052023-10-20T22:49:44.426Z 2679 /opt/oxide/mg-ddm/bin/ddmd --admin-port 8000 --admin-addr :: --kind tr
18062023-10-20T22:49:44.451Z2694 ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync
18072023-10-20T22:49:44.482Z 2695 /opt/oxide/dendrite/bin/tfportd --sync-only --pkt-source none
18082023-10-20T22:49:44.510Z2707 ctrun -l child -o noorphan,regent /opt/oxide/sp-sim/bin/sp-sim /var/svc/
18092023-10-20T22:49:44.534Z 2709 /opt/oxide/sp-sim/bin/sp-sim /var/svc/manifest/site/sp-sim/config.toml
18102023-10-20T22:49:44.558Z2827 /sbin/dhcpagent
18112023-10-20T22:49:44.582ZADDROBJ TYPE STATE ADDR
18122023-10-20T22:49:44.606Zlo0/v4 static ok 127.0.0.1/8
18132023-10-20T22:49:44.630Ztfportqsfp0_0/uplink1 static ok 10.151.2.174/32
18142023-10-20T22:49:44.654Zlo0/v6 static ok ::1/128
18152023-10-20T22:49:44.678ZoxControlService0/ll addrconf ok fe80::8:20ff:febf:4b61%oxControlService0/10
18162023-10-20T22:49:44.702ZoxControlService0/omicron6 static ok fd00:1122:3344:101::2/64
18172023-10-20T22:49:44.726Ztfportrear0_0/ll addrconf ok fe80::ecc6:3dff:fe20:ccbb%tfportrear0_0/10
18182023-10-20T22:49:44.750ZoxBootstrap0/ll addrconf ok fe80::8:20ff:fe9e:a5b7%oxBootstrap0/10
18192023-10-20T22:49:44.774ZoxBootstrap0/bootstrap6 static ok fdb0:18c0:4d0d:a02a::2/64
18202023-10-20T22:49:44.798Z
18212023-10-20T22:49:44.823ZIRE Table: IPv4
18222023-10-20T22:49:44.847Z Destination Mask Gateway Device MTU Ref Flg Out In/Fwd
18232023-10-20T22:49:44.871Z-------------------- --------------- -------------------- ------ ----- --- --- ------ ------
18242023-10-20T22:49:44.900Z0.0.0.0 255.255.255.255 -- tfportqsfp0_0 9000 1 UHb 0 0
18252023-10-20T22:49:44.928Z10.0.0.0 255.255.255.255 -- tfportqsfp0_0 9000 1 UHb 0 0
18262023-10-20T22:49:44.952Z10.151.2.174 255.255.255.255 -- tfportqsfp0_0 9000 2 UHL 0 0
18272023-10-20T22:49:44.976Z+ pfexec zlogin oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af arp -an
18282023-10-20T22:49:45.000Z10.151.2.174 255.255.255.255 10.151.2.174 tfportqsfp0_0 9000 2 UH 0 0
18292023-10-20T22:49:45.024Z+ for z in $(zoneadm list -n)
18302023-10-20T22:49:45.048Z10.255.255.255 255.255.255.255 -- tfportqsfp0_0 9000 1 UHb 0 0
18312023-10-20T22:49:45.090Z+ banner internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877
18322023-10-20T22:49:45.118Z127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 46 46
18332023-10-20T22:49:45.142Z+ pfexec svcs -xv -z oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877
18342023-10-20T22:49:45.167Z255.255.255.255 255.255.255.255 -- tfportqsfp0_0 9000 1 UHb 0 0
18352023-10-20T22:49:45.191Z+ pfexec ptree -z oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877
18362023-10-20T22:49:45.215Z
18372023-10-20T22:49:45.239Z+ pfexec zlogin oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877 ipadm
18382023-10-20T22:49:45.264ZIRE Table: IPv6
18392023-10-20T22:49:45.288Z+ pfexec zlogin oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877 netstat -rncva
18402023-10-20T22:49:45.312Z Destination/Mask Gateway If MTU Ref Flags Out In/Fwd
18412023-10-20T22:49:45.336Z+ pfexec zlogin oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877 netstat -anu
18422023-10-20T22:49:45.368Z--------------------------- --------------------------- ----- ----- --- ----- ------ ------
18432023-10-20T22:49:45.391Z+ pfexec zlogin oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877 arp -an
18442023-10-20T22:49:45.415Z::1 ::1 lo0 8252 20 UH 5949 5948
18452023-10-20T22:49:45.439Z+ for z in $(zoneadm list -n)
18462023-10-20T22:49:45.463Zfe80::8:20ff:febf:4b61 -- oxControlService0 9000 2 UHL 0 0
18472023-10-20T22:49:45.487Z+ banner internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84
18482023-10-20T22:49:45.511Zfdb0:18c0:4d0d:a02a::2 -- oxBootstrap0 1500 2 UHL 0 111
18492023-10-20T22:49:45.535Z+ pfexec svcs -xv -z oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84
18502023-10-20T22:49:45.559Zfdb0:18c0:4d0d:a02a::1 fdb0:18c0:4d0d:a02a::2 oxBootstrap0 1500 4 UC 133 0
18512023-10-20T22:49:45.583Z+ pfexec ptree -z oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84
18522023-10-20T22:49:45.607Zfe80::c418:9dff:fe23:e08c fe80::ecc6:3dff:fe20:ccbb tfportrear0_0 9000 3 UC 399 0
18532023-10-20T22:49:45.631Zfd00:1122:3344:101::c fd00:1122:3344:101::2 oxControlService0 9000 3 UC 174 0
18542023-10-20T22:49:45.655Zfe80::8:20ff:fe9e:a5b7 -- oxBootstrap0 1500 2 UHL 0 0
18552023-10-20T22:49:45.679Zfd00:1122:3344:101::1 fd00:1122:3344:101::2 oxControlService0 9000 3 UC 78 0
18562023-10-20T22:49:45.703Zfe80::ecc6:3dff:fe20:ccbb -- tfportrear0_0 9000 2 UHL 7 409
18572023-10-20T22:49:45.727Zfd00:1122:3344:101::2 -- oxControlService0 9000 2 UHL 174 937
18582023-10-20T22:49:46.061Zfdb0:18c0:4d0d:a02a::/64 fdb0:18c0:4d0d:a02a::2 oxBootstrap0 1500 3 U 133 0
18592023-10-20T22:49:46.085Zfd00:1122:3344:101::/64 fd00:1122:3344:101::2 oxControlService0 9000 4 U 252 0
18602023-10-20T22:49:46.114Zfdb0::/16 fe80::8:20ff:fe56:8353 oxBootstrap0 1500 1 UG 0 0
18612023-10-20T22:49:46.138Zfe80::/10 fe80::8:20ff:febf:4b61 oxControlService0 9000 2 U 0 0
18622023-10-20T22:49:46.161Zfe80::/10 fe80::8:20ff:fe9e:a5b7 oxBootstrap0 1500 2 U 0 0
18632023-10-20T22:49:46.185Zfe80::/10 fe80::ecc6:3dff:fe20:ccbb tfportrear0_0 9000 3 U 400 0
18642023-10-20T22:49:46.208Zdefault fd00:1122:3344:101::1 0 2 UG 917 0
18652023-10-20T22:49:46.234Z
18662023-10-20T22:49:46.258ZUDP: IPv4
18672023-10-20T22:49:46.283Z Local Address Remote Address User Pid Command State
18682023-10-20T22:49:46.307Z-------------------- -------------------- -------- ------ -------------- ----------
18692023-10-20T22:49:46.331Z *.* root 2590 in.ndpd Unbound
18702023-10-20T22:49:46.354Z *.38922 root 2651 mgs Idle
18712023-10-20T22:49:46.378Z *.39934 root 2651 mgs Idle
18722023-10-20T22:49:46.402Z *.64416 root 2651 mgs Idle
18732023-10-20T22:49:46.426Z *.33300 root 2709 sp-sim Idle
18742023-10-20T22:49:46.450Z *.33301 root 2709 sp-sim Idle
18752023-10-20T22:49:46.473Z *.33310 root 2709 sp-sim Idle
18762023-10-20T22:49:46.497Z *.33311 root 2709 sp-sim Idle
18772023-10-20T22:49:46.520Z *.33320 root 2709 sp-sim Idle
18782023-10-20T22:49:46.543Z *.33321 root 2709 sp-sim Idle
18792023-10-20T22:49:46.572Z *.68 root 2827 dhcpagent Idle
18802023-10-20T22:49:46.596Z *.546 root 2827 dhcpagent Idle
18812023-10-20T22:49:46.619Z
18822023-10-20T22:49:46.643ZUDP: IPv6
18832023-10-20T22:49:46.667Z Local Address Remote Address User Pid Command State If
18842023-10-20T22:49:46.691Z--------------------------------- --------------------------------- -------- ------ -------------- ---------- -----
18852023-10-20T22:49:46.714Z *.* root 2590 in.ndpd Unbound
18862023-10-20T22:49:46.738Z *.38922 root 2651 mgs Idle
18872023-10-20T22:49:46.762Z *.39934 root 2651 mgs Idle
18882023-10-20T22:49:46.787Z *.64416 root 2651 mgs Idle
18892023-10-20T22:49:46.811Zff02::dd.3549 root 2679 ddmd Idle tfportrear0_0
18902023-10-20T22:49:46.835Zfe80::ecc6:3dff:fe20:ccbb.3549 root 2679 ddmd Idle tfportrear0_0
18912023-10-20T22:49:46.858Z *.33300 root 2709 sp-sim Idle
18922023-10-20T22:49:46.882Z *.33301 root 2709 sp-sim Idle
18932023-10-20T22:49:46.905Z *.33310 root 2709 sp-sim Idle
18942023-10-20T22:49:46.929Z *.33311 root 2709 sp-sim Idle
18952023-10-20T22:49:46.999Z *.33320 root 2709 sp-sim Idle
18962023-10-20T22:49:47.023Z *.33321 root 2709 sp-sim Idle
18972023-10-20T22:49:47.050Z *.546 root 2827 dhcpagent Idle
18982023-10-20T22:49:47.080Z
18992023-10-20T22:49:47.109ZTCP: IPv4
19002023-10-20T22:49:47.141Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State
19012023-10-20T22:49:47.166Z-------------------- -------------------- -------- ------ -------------- ------ ------ ------ ------ -----------
19022023-10-20T22:49:47.189Z *.12229 *.* root 2669 wicketd 0 0 128000 0 LISTEN
19032023-10-20T22:49:47.213Z *.8000 *.* root 2679 ddmd 0 0 128000 0 LISTEN
19042023-10-20T22:49:47.237Z127.0.0.1.4999 *.* root 2827 dhcpagent 0 0 128000 0 LISTEN
19052023-10-20T22:49:47.262Z
19062023-10-20T22:49:47.289ZTCP: IPv6
19072023-10-20T22:49:47.315Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State If
19082023-10-20T22:49:47.339Z--------------------------------- --------------------------------- -------- ------ -------------- ------ ------ ------ ------ ----------- -----
19092023-10-20T22:49:47.363Z::1.58340 ::1.12224 root 2695 tfportd 65440 0 139264 0 ESTABLISHED
19102023-10-20T22:49:47.386Z::1.12224 ::1.58340 root 2643 dpd 139060 0 130880 0 ESTABLISHED
19112023-10-20T22:49:47.411Z::1.12224 *.* root 2643 dpd 0 0 128000 0 LISTEN
19122023-10-20T22:49:47.435Z::1.12225 *.* root 2651 mgs 0 0 128000 0 LISTEN
19132023-10-20T22:49:47.460Z *.12229 *.* root 2669 wicketd 0 0 128000 0 LISTEN
19142023-10-20T22:49:47.485Z::1.12226 *.* root 2669 wicketd 0 0 128000 0 LISTEN
19152023-10-20T22:49:47.509Zfdb0:18c0:4d0d:a02a::2.12227 *.* root 2669 wicketd 0 0 128000 0 LISTEN
19162023-10-20T22:49:47.533Z *.8000 *.* root 2679 ddmd 0 0 128000 0 LISTEN
19172023-10-20T22:49:47.557Z::1.39506 ::1.12224 root 2695 tfportd 65440 0 139264 0 ESTABLISHED
19182023-10-20T22:49:47.581Z::1.12224 ::1.39506 root 2643 dpd 139060 0 130880 0 ESTABLISHED
19192023-10-20T22:49:47.608Z::1.33312 *.* root 2709 sp-sim 0 0 128000 0 LISTEN
19202023-10-20T22:49:47.632Z::1.33322 *.* root 2709 sp-sim 0 0 128000 0 LISTEN
19212023-10-20T22:49:47.657Zfd00:1122:3344:101::2.12224 *.* root 2643 dpd 0 0 128000 0 LISTEN
19222023-10-20T22:49:47.689Zfd00:1122:3344:101::2.12225 *.* root 2651 mgs 0 0 128000 0 LISTEN
19232023-10-20T22:49:47.716Zfdb0:18c0:4d0d:a02a::2.34621 fdb0:18c0:4d0d:a02a::1.80 128520 0 128520 0 TIME_WAIT
19242023-10-20T22:49:47.741Z::1.63745 ::1.12225 root 2669 wicketd 65440 0 139264 0 ESTABLISHED
19252023-10-20T22:49:47.770Z+ pfexec zlogin oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84 ipadm
19262023-10-20T22:49:47.794Z::1.12225 ::1.63745 root 2651 mgs 139060 0 130880 0 ESTABLISHED
19272023-10-20T22:49:47.821Z+ pfexec zlogin oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84 netstat -rncva
19282023-10-20T22:49:47.845Z::1.35159 ::1.12225 root 2669 wicketd 65440 0 139264 0 ESTABLISHED
19292023-10-20T22:49:47.869Z+ pfexec zlogin oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84 netstat -anu
19302023-10-20T22:49:47.893Z::1.50626 ::1.12225 root 2669 wicketd 65440 0 139264 0 ESTABLISHED
19312023-10-20T22:49:47.917Z+ pfexec zlogin oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84 arp -an
19322023-10-20T22:49:47.942Z::1.12225 ::1.35159 root 2651 mgs 139060 0 130880 0 ESTABLISHED
19332023-10-20T22:49:47.966Z+ for z in $(zoneadm list -n)
19342023-10-20T22:49:47.990Z::1.12225 ::1.50626 root 2651 mgs 139060 0 130880 0 ESTABLISHED
19352023-10-20T22:49:48.014Z+ banner ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe
19362023-10-20T22:49:48.037Zfe80::ecc6:3dff:fe20:ccbb.56797 *.* root 2679 ddmd 0 0 128000 0 LISTEN
19372023-10-20T22:49:48.061Z+ pfexec svcs -xv -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe
19382023-10-20T22:49:48.084Zfdb0:18c0:4d0d:a02a::2.58249 fdb0:18c0:4d0d:a02a::1.80 128520 0 128520 0 TIME_WAIT
19392023-10-20T22:49:48.519Z+ pfexec ptree -z oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe
19402023-10-20T22:49:48.547Zfd00:1122:3344:101::2.42066 fd00:1122:3344:101::c.12221 root 2643 dpd 0 0 134100 0 SYN_SENT
19412023-10-20T22:49:48.573Z+ pfexec zlogin oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe ipadm
19422023-10-20T22:49:48.599Z::1.44229 ::1.8000 root 2669 wicketd 65440 0 139264 0 ESTABLISHED
19432023-10-20T22:49:48.624Z+ pfexec zlogin oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe netstat -rncva
19442023-10-20T22:49:48.649Z::1.8000 ::1.44229 root 2679 ddmd 139060 0 130880 0 ESTABLISHED
19452023-10-20T22:49:48.673Z+ pfexec zlogin oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe netstat -anu
19462023-10-20T22:49:48.698Z
19472023-10-20T22:49:48.721ZActive UNIX domain sockets
19482023-10-20T22:49:48.745ZAddress Type User Pid Command Local Address Remote Address
19492023-10-20T22:49:48.771Z---------------- ---------- -------- ------ -------------- --------------------------------------- ---------------------------------------
19502023-10-20T22:49:48.800Zfffffe85b5f6a7e8 stream-ord root 2709 sp-sim
19512023-10-20T22:49:48.825Zfffffe85b5f6a7e8 stream-ord root 2709 sp-sim
19522023-10-20T22:49:48.851Zfffffe85b5f6ab88 stream-ord root 2709 sp-sim
19532023-10-20T22:49:48.876Zfffffe85b64c87e0 stream-ord root 2695 tfportd
19542023-10-20T22:49:48.902Zfffffe85b64c87e0 stream-ord root 2695 tfportd
19552023-10-20T22:49:48.926Zfffffe85b64c8b80 stream-ord root 2695 tfportd
19562023-10-20T22:49:48.950Zfffffe85b7657098 stream-ord root 2669 wicketd
19572023-10-20T22:49:48.973Zfffffe85b7657098 stream-ord root 2669 wicketd
19582023-10-20T22:49:48.997Zfffffe85b7657438 stream-ord root 2669 wicketd
19592023-10-20T22:49:49.021Zfffffe85b7657b78 stream-ord root 2656 uplinkd
19602023-10-20T22:49:49.046Zfffffe85b6347090 stream-ord root 2656 uplinkd
19612023-10-20T22:49:49.069Zfffffe85b63477d0 stream-ord root 2651 mgs
19622023-10-20T22:49:49.093Zfffffe85b6347b70 stream-ord root 2651 mgs
19632023-10-20T22:49:49.116Zfffffe85b8abd428 stream-ord root 2651 mgs
19642023-10-20T22:49:49.140Zfffffe85b8abd428 stream-ord root 2651 mgs
19652023-10-20T22:49:49.163Zfffffe85b8abd7c8 stream-ord root 2651 mgs
19662023-10-20T22:49:49.194Zfffffe85b8abdb68 stream-ord root 2643 dpd
19672023-10-20T22:49:49.220Zfffffe85b8688080 stream-ord root 2643 dpd
19682023-10-20T22:49:49.244Zfffffe85b1dfeb48 stream-ord root 2590 in.ndpd /var/run/in.ndpd_ipadm
19692023-10-20T22:49:49.267Zfffffe85aed3e060 stream-ord root 2679 ddmd
19702023-10-20T22:49:49.291Zfffffe85aed3e7a0 stream-ord root 2679 ddmd
19712023-10-20T22:49:49.314Zfffffe85aed3e7a0 stream-ord root 2679 ddmd
19722023-10-20T22:49:49.338Zfffffe85aed3eb40 stream-ord root 2643 dpd
19732023-10-20T22:49:49.361Zfffffe85aed3eb40 stream-ord root 2643 dpd
19742023-10-20T22:49:49.385Zfffffe85b2787798 stream-ord root 2643 dpd
19752023-10-20T22:49:49.409Zfffffe8587555af8 dgram root 2590 in.ndpd /var/run/in.ndpd_mib
19762023-10-20T22:49:49.434ZNet to Media Table: IPv4
19772023-10-20T22:49:49.457ZDevice IP Address Mask Flags Phys Addr
19782023-10-20T22:49:49.481Z------ -------------------- --------------- -------- ---------------
19792023-10-20T22:49:49.505Ztfportqsfp0_0 10.151.2.174 255.255.255.255 SPLA be:af:b5:82:ce:9e
19802023-10-20T22:49:49.530Z
19812023-10-20T22:49:49.553Z # # # ##### ###### ##### # # ## # #####
19822023-10-20T22:49:49.577Z # ## # # # # # ## # # # # # #
19832023-10-20T22:49:49.604Z # # # # # ##### # # # # # # # # # #
19842023-10-20T22:49:49.630Z # # # # # # ##### # # # ###### # # #
19852023-10-20T22:49:49.654Z # # ## # # # # # ## # # # # #
19862023-10-20T22:49:49.677Z # # # # ###### # # # # # # ###### ####### #####
19872023-10-20T22:49:49.701Z
19882023-10-20T22:49:49.724Z2853 zsched
19892023-10-20T22:49:49.748Z 2885 /sbin/init
19902023-10-20T22:49:49.772Z2925 /lib/svc/bin/svc.startd
19912023-10-20T22:49:49.796Z 4441 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat -
19922023-10-20T22:49:49.819Z2929 /lib/svc/bin/svc.configd
19932023-10-20T22:49:49.843Z3068 /lib/inet/netcfgd
19942023-10-20T22:49:49.867Z3072 /lib/inet/ipmgmtd
19952023-10-20T22:49:49.890Z3755 /usr/lib/fm/fmd/fmd
19962023-10-20T22:49:49.914Z3786 /usr/lib/pfexecd
19972023-10-20T22:49:49.938Z4267 /usr/sbin/nscd
19982023-10-20T22:49:49.961Z4432 /usr/lib/utmpd
19992023-10-20T22:49:49.985Z4483 /usr/sbin/cron
20002023-10-20T22:49:50.008Z4495 /usr/sbin/syslogd
20012023-10-20T22:49:50.032Z4665 /usr/lib/inet/in.ndpd
20022023-10-20T22:49:50.068Z4923 ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server -
20032023-10-20T22:49:50.095Z 4926 /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/s
20042023-10-20T22:49:50.122Z5559 /sbin/dhcpagent
20052023-10-20T22:49:50.148ZADDROBJ TYPE STATE ADDR
20062023-10-20T22:49:50.175Zlo0/v4 static ok 127.0.0.1/8
20072023-10-20T22:49:50.199Zlo0/v6 static ok ::1/128
20082023-10-20T22:49:50.223ZoxControlService3/ll addrconf ok fe80::8:20ff:feb1:8ac1%oxControlService3/10
20092023-10-20T22:49:50.246ZoxControlService3/omicron6 static ok fd00:1122:3344:1::1/64
20102023-10-20T22:49:50.270Z
20112023-10-20T22:49:50.294ZIRE Table: IPv4
20122023-10-20T22:49:50.318Z Destination Mask Gateway Device MTU Ref Flg Out In/Fwd
20132023-10-20T22:49:50.341Z-------------------- --------------- -------------------- ------ ----- --- --- ------ ------
20142023-10-20T22:49:50.365Z127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 18 18
20152023-10-20T22:49:50.389Z
20162023-10-20T22:49:50.412ZIRE Table: IPv6
20172023-10-20T22:49:50.436Z Destination/Mask Gateway If MTU Ref Flags Out In/Fwd
20182023-10-20T22:49:50.459Z--------------------------- --------------------------- ----- ----- --- ----- ------ ------
20192023-10-20T22:49:50.483Z::1 ::1 lo0 8252 2 UH 0 0
20202023-10-20T22:49:50.506Zfe80::8:20ff:feb1:8ac1 -- oxControlService3 9000 2 UHL 0 0
20212023-10-20T22:49:50.530Zfd00:1122:3344:1::1 -- oxControlService3 9000 2 UHL 2 487
20222023-10-20T22:49:50.968Zfd00:1122:3344:1::2 fd00:1122:3344:1::1 oxControlService3 9000 3 UC 225 0
20232023-10-20T22:49:50.993Zfd00:1122:3344:1::/64 fd00:1122:3344:1::1 oxControlService3 9000 3 U 225 0
20242023-10-20T22:49:51.026Zfe80::/10 fe80::8:20ff:feb1:8ac1 oxControlService3 9000 2 U 0 0
20252023-10-20T22:49:51.050Zdefault fd00:1122:3344:1::2 0 3 UG 140 0
20262023-10-20T22:49:51.074Z+ pfexec zlogin oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe arp -an
20272023-10-20T22:49:51.098Z
20282023-10-20T22:49:51.121Z++ zoneadm list -n
20292023-10-20T22:49:51.145ZUDP: IPv4
20302023-10-20T22:49:51.168Z++ grep oxz_ntp
20312023-10-20T22:49:51.192Z Local Address Remote Address User Pid Command State
20322023-10-20T22:49:51.216Z+ for z in $(zoneadm list -n | grep oxz_ntp)
20332023-10-20T22:49:51.239Z-------------------- -------------------- -------- ------ -------------- ----------
20342023-10-20T22:49:51.263Z+ banner ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe
20352023-10-20T22:49:51.286Z *.* root 4665 in.ndpd Unbound
20362023-10-20T22:49:51.310Z+ pfexec zlogin oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe chronyc tracking
20372023-10-20T22:49:51.334Z *.68 root 5559 dhcpagent Idle
20382023-10-20T22:49:51.358Z+ pfexec zlogin oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe chronyc sources
20392023-10-20T22:49:51.383Z *.546 root 5559 dhcpagent Idle
20402023-10-20T22:49:51.406Z+ pfexec zlogin oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe cat /etc/inet/chrony.conf
20412023-10-20T22:49:51.432Z
20422023-10-20T22:49:51.456Z+ pfexec zlogin sidecar_softnpu cat /var/log/softnpu.log
20432023-10-20T22:49:51.479ZUDP: IPv6
20442023-10-20T22:49:51.503Z+ exit 1
20452023-10-20T22:49:51.527Z Local Address Remote Address User Pid Command State If
20462023-10-20T22:49:51.551Z--------------------------------- --------------------------------- -------- ------ -------------- ---------- -----
20472023-10-20T22:49:51.575Z *.* root 4665 in.ndpd Unbound
20482023-10-20T22:49:51.598Zfd00:1122:3344:1::1.53 root 4926 dns-server Idle
20492023-10-20T22:49:51.622Z *.546 root 5559 dhcpagent Idle
20502023-10-20T22:49:51.646Z
20512023-10-20T22:49:51.669ZTCP: IPv4
20522023-10-20T22:49:51.693Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State
20532023-10-20T22:49:51.717Z-------------------- -------------------- -------- ------ -------------- ------ ------ ------ ------ -----------
20542023-10-20T22:49:51.741Z127.0.0.1.4999 *.* root 5559 dhcpagent 0 0 128000 0 LISTEN
20552023-10-20T22:49:51.764Z
20562023-10-20T22:49:51.788ZTCP: IPv6
20572023-10-20T22:49:51.813Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State If
20582023-10-20T22:49:51.839Z--------------------------------- --------------------------------- -------- ------ -------------- ------ ------ ------ ------ ----------- -----
20592023-10-20T22:49:51.866Zfd00:1122:3344:1::1.5353 *.* root 4926 dns-server 0 0 128000 0 LISTEN
20602023-10-20T22:49:51.890Z
20612023-10-20T22:49:51.914ZActive UNIX domain sockets
20622023-10-20T22:49:51.938ZAddress Type User Pid Command Local Address Remote Address
20632023-10-20T22:49:51.962Z---------------- ---------- -------- ------ -------------- --------------------------------------- ---------------------------------------
20642023-10-20T22:49:51.986Zfffffe85d73e0810 stream-ord root 4926 dns-server
20652023-10-20T22:49:52.010Zfffffe85d73e0810 stream-ord root 4926 dns-server
20662023-10-20T22:49:52.075Zfffffe85d73e0bb0 stream-ord root 4926 dns-server
20672023-10-20T22:49:52.099Zfffffe85e04adba0 dgram root 4665 in.ndpd /var/run/in.ndpd_mib
20682023-10-20T22:49:52.122Zfffffe85b56760b8 stream-ord root 4665 in.ndpd /var/run/in.ndpd_ipadm
20692023-10-20T22:49:52.146Z
20702023-10-20T22:49:52.170Z # # # ##### ###### ##### # # ## # #####
20712023-10-20T22:49:52.194Z # ## # # # # # ## # # # # # #
20722023-10-20T22:49:52.217Z # # # # # ##### # # # # # # # # # #
20732023-10-20T22:49:52.241Z # # # # # # ##### # # # ###### # # #
20742023-10-20T22:49:52.265Z # # ## # # # # # ## # # # # #
20752023-10-20T22:49:52.288Z # # # # ###### # # # # # # ###### ####### #####
20762023-10-20T22:49:52.324Z
20772023-10-20T22:49:52.372Z2870 zsched
20782023-10-20T22:49:52.396Z 2911 /sbin/init
20792023-10-20T22:49:52.420Z2933 /lib/svc/bin/svc.startd
20802023-10-20T22:49:52.444Z 4499 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat -
20812023-10-20T22:49:52.468Z2936 /lib/svc/bin/svc.configd
20822023-10-20T22:49:52.491Z3105 /lib/inet/netcfgd
20832023-10-20T22:49:52.516Z3108 /lib/inet/ipmgmtd
20842023-10-20T22:49:52.540Z3872 /usr/lib/fm/fmd/fmd
20852023-10-20T22:49:52.564Z3905 /usr/lib/pfexecd
20862023-10-20T22:49:52.588Z4295 /usr/sbin/nscd
20872023-10-20T22:49:52.612Z4478 /usr/lib/utmpd
20882023-10-20T22:49:52.636Z4534 /usr/sbin/cron
20892023-10-20T22:49:52.659Z4557 /usr/sbin/syslogd
20902023-10-20T22:49:52.683Z4695 /usr/lib/inet/in.ndpd
20912023-10-20T22:49:52.707Z4875 ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server -
20922023-10-20T22:49:52.730Z 4876 /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/s
20932023-10-20T22:49:52.754Z5412 /sbin/dhcpagent
20942023-10-20T22:49:52.778ZADDROBJ TYPE STATE ADDR
20952023-10-20T22:49:52.802Zlo0/v4 static ok 127.0.0.1/8
20962023-10-20T22:49:52.825Zlo0/v6 static ok ::1/128
20972023-10-20T22:49:52.849ZoxControlService1/ll addrconf ok fe80::8:20ff:fe9f:8c2d%oxControlService1/10
20982023-10-20T22:49:52.873ZoxControlService1/omicron6 static ok fd00:1122:3344:2::1/64
20992023-10-20T22:49:52.896Z
21002023-10-20T22:49:52.920ZIRE Table: IPv4
21012023-10-20T22:49:52.944Z Destination Mask Gateway Device MTU Ref Flg Out In/Fwd
21022023-10-20T22:49:52.967Z-------------------- --------------- -------------------- ------ ----- --- --- ------ ------
21032023-10-20T22:49:52.991Z127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 18 18
21042023-10-20T22:49:53.015Z
21052023-10-20T22:49:53.039ZIRE Table: IPv6
21062023-10-20T22:49:53.074Z Destination/Mask Gateway If MTU Ref Flags Out In/Fwd
21072023-10-20T22:49:53.098Z--------------------------- --------------------------- ----- ----- --- ----- ------ ------
21082023-10-20T22:49:53.128Z::1 ::1 lo0 8252 2 UH 0 0
21092023-10-20T22:49:53.155Zfe80::8:20ff:fe9f:8c2d -- oxControlService1 9000 2 UHL 0 0
21102023-10-20T22:49:53.179Zfd00:1122:3344:2::2 fd00:1122:3344:2::1 oxControlService1 9000 3 UC 231 0
21112023-10-20T22:49:53.203Zfd00:1122:3344:2::1 -- oxControlService1 9000 2 UHL 2 493
21122023-10-20T22:49:53.226Zfd00:1122:3344:2::/64 fd00:1122:3344:2::1 oxControlService1 9000 3 U 231 0
21132023-10-20T22:49:53.250Zfe80::/10 fe80::8:20ff:fe9f:8c2d oxControlService1 9000 2 U 0 0
21142023-10-20T22:49:53.274Zdefault fd00:1122:3344:2::2 0 3 UG 145 0
21152023-10-20T22:49:53.298Z
21162023-10-20T22:49:53.322ZUDP: IPv4
21172023-10-20T22:49:53.346Z Local Address Remote Address User Pid Command State
21182023-10-20T22:49:53.369Z-------------------- -------------------- -------- ------ -------------- ----------
21192023-10-20T22:49:53.393Z *.* root 4695 in.ndpd Unbound
21202023-10-20T22:49:53.417Z *.68 root 5412 dhcpagent Idle
21212023-10-20T22:49:53.440Z *.546 root 5412 dhcpagent Idle
21222023-10-20T22:49:53.464Z
21232023-10-20T22:49:53.487ZUDP: IPv6
21242023-10-20T22:49:53.511Z Local Address Remote Address User Pid Command State If
21252023-10-20T22:49:53.535Z--------------------------------- --------------------------------- -------- ------ -------------- ---------- -----
21262023-10-20T22:49:53.564Z *.* root 4695 in.ndpd Unbound
21272023-10-20T22:49:53.592Zfd00:1122:3344:2::1.53 root 4876 dns-server Idle
21282023-10-20T22:49:53.621Z *.546 root 5412 dhcpagent Idle
21292023-10-20T22:49:53.655Z
21302023-10-20T22:49:53.679ZTCP: IPv4
21312023-10-20T22:49:53.703Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State
21322023-10-20T22:49:53.727Z-------------------- -------------------- -------- ------ -------------- ------ ------ ------ ------ -----------
21332023-10-20T22:49:53.750Z127.0.0.1.4999 *.* root 5412 dhcpagent 0 0 128000 0 LISTEN
21342023-10-20T22:49:53.774Z
21352023-10-20T22:49:53.797ZTCP: IPv6
21362023-10-20T22:49:53.821Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State If
21372023-10-20T22:49:53.845Z--------------------------------- --------------------------------- -------- ------ -------------- ------ ------ ------ ------ ----------- -----
21382023-10-20T22:49:53.868Zfd00:1122:3344:2::1.5353 *.* root 4876 dns-server 0 0 128000 0 LISTEN
21392023-10-20T22:49:53.892Z
21402023-10-20T22:49:53.916ZActive UNIX domain sockets
21412023-10-20T22:49:53.939ZAddress Type User Pid Command Local Address Remote Address
21422023-10-20T22:49:53.963Z---------------- ---------- -------- ------ -------------- --------------------------------------- ---------------------------------------
21432023-10-20T22:49:53.987Zfffffe85d9156468 stream-ord root 4876 dns-server
21442023-10-20T22:49:54.011Zfffffe85d9156468 stream-ord root 4876 dns-server
21452023-10-20T22:49:54.035Zfffffe85d9156808 stream-ord root 4876 dns-server
21462023-10-20T22:49:54.059Zfffffe85e04ad800 dgram root 4695 in.ndpd /var/run/in.ndpd_mib
21472023-10-20T22:49:54.109Zfffffe85b27873f8 stream-ord root 4695 in.ndpd /var/run/in.ndpd_ipadm
21482023-10-20T22:49:54.133Z
21492023-10-20T22:49:54.157Z # # # ##### ###### ##### # # ## # #####
21502023-10-20T22:49:54.181Z # ## # # # # # ## # # # # # #
21512023-10-20T22:49:54.205Z # # # # # ##### # # # # # # # # # #
21522023-10-20T22:49:54.228Z # # # # # # ##### # # # ###### # # #
21532023-10-20T22:49:54.253Z # # ## # # # # # ## # # # # #
21542023-10-20T22:49:54.277Z # # # # ###### # # # # # # ###### ####### #####
21552023-10-20T22:49:54.300Z
21562023-10-20T22:49:54.324Z2873 zsched
21572023-10-20T22:49:54.347Z 2918 /sbin/init
21582023-10-20T22:49:54.371Z2937 /lib/svc/bin/svc.startd
21592023-10-20T22:49:54.395Z 4493 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat -
21602023-10-20T22:49:54.418Z2939 /lib/svc/bin/svc.configd
21612023-10-20T22:49:54.442Z3089 /lib/inet/ipmgmtd
21622023-10-20T22:49:54.466Z3091 /lib/inet/netcfgd
21632023-10-20T22:49:54.490Z3868 /usr/lib/fm/fmd/fmd
21642023-10-20T22:49:54.540Z3893 /usr/lib/pfexecd
21652023-10-20T22:49:54.571Z4299 /usr/sbin/nscd
21662023-10-20T22:49:54.597Z4467 /usr/lib/utmpd
21672023-10-20T22:49:54.622Z4556 /usr/sbin/cron
21682023-10-20T22:49:54.646Z4565 /usr/sbin/syslogd
21692023-10-20T22:49:54.671Z4819 ctrun -l child -o noorphan,regent /opt/oxide/dns-server/bin/dns-server -
21702023-10-20T22:49:54.695Z 4820 /opt/oxide/dns-server/bin/dns-server --config-file /var/svc/manifest/s
21712023-10-20T22:49:54.720Z5393 /sbin/dhcpagent
21722023-10-20T22:49:54.743Z5414 /usr/lib/inet/in.ndpd
21732023-10-20T22:49:54.767ZADDROBJ TYPE STATE ADDR
21742023-10-20T22:49:54.791Zlo0/v4 static ok 127.0.0.1/8
21752023-10-20T22:49:54.870Zlo0/v6 static ok ::1/128
21762023-10-20T22:49:54.990ZoxControlService2/ll addrconf ok fe80::8:20ff:fe30:badc%oxControlService2/10
21772023-10-20T22:49:55.014ZoxControlService2/omicron6 static ok fd00:1122:3344:3::1/64
21782023-10-20T22:49:55.045Z
21792023-10-20T22:49:55.072ZIRE Table: IPv4
21802023-10-20T22:49:55.096Z Destination Mask Gateway Device MTU Ref Flg Out In/Fwd
21812023-10-20T22:49:55.138Z-------------------- --------------- -------------------- ------ ----- --- --- ------ ------
21822023-10-20T22:49:55.162Z127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 18 18
21832023-10-20T22:49:55.186Z
21842023-10-20T22:49:55.209ZIRE Table: IPv6
21852023-10-20T22:49:55.233Z Destination/Mask Gateway If MTU Ref Flags Out In/Fwd
21862023-10-20T22:49:55.257Z--------------------------- --------------------------- ----- ----- --- ----- ------ ------
21872023-10-20T22:49:55.280Zfe80::8:20ff:fe30:badc -- oxControlService2 9000 2 UHL 0 0
21882023-10-20T22:49:55.304Z::1 ::1 lo0 8252 2 UH 0 0
21892023-10-20T22:49:55.328Zfd00:1122:3344:3::2 fd00:1122:3344:3::1 oxControlService2 9000 3 UC 245 0
21902023-10-20T22:49:55.352Zfd00:1122:3344:3::1 -- oxControlService2 9000 2 UHL 0 477
21912023-10-20T22:49:55.375Zfd00:1122:3344:3::/64 fd00:1122:3344:3::1 oxControlService2 9000 3 U 245 0
21922023-10-20T22:49:55.399Zfe80::/10 fe80::8:20ff:fe30:badc oxControlService2 9000 2 U 0 0
21932023-10-20T22:49:55.423Zdefault fd00:1122:3344:3::2 0 3 UG 145 0
21942023-10-20T22:49:55.446Z
21952023-10-20T22:49:55.470ZUDP: IPv4
21962023-10-20T22:49:55.494Z Local Address Remote Address User Pid Command State
21972023-10-20T22:49:55.517Z-------------------- -------------------- -------- ------ -------------- ----------
21982023-10-20T22:49:55.541Z *.* root 5414 in.ndpd Unbound
21992023-10-20T22:49:55.564Z *.68 root 5393 dhcpagent Idle
22002023-10-20T22:49:55.588Z *.546 root 5393 dhcpagent Idle
22012023-10-20T22:49:55.612Z
22022023-10-20T22:49:55.635ZUDP: IPv6
22032023-10-20T22:49:55.659Z Local Address Remote Address User Pid Command State If
22042023-10-20T22:49:55.682Z--------------------------------- --------------------------------- -------- ------ -------------- ---------- -----
22052023-10-20T22:49:55.706Z *.* root 5414 in.ndpd Unbound
22062023-10-20T22:49:55.729Zfd00:1122:3344:3::1.53 root 4820 dns-server Idle
22072023-10-20T22:49:55.753Z *.546 root 5393 dhcpagent Idle
22082023-10-20T22:49:55.776Z
22092023-10-20T22:49:55.800ZTCP: IPv4
22102023-10-20T22:49:55.823Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State
22112023-10-20T22:49:55.847Z-------------------- -------------------- -------- ------ -------------- ------ ------ ------ ------ -----------
22122023-10-20T22:49:55.876Z127.0.0.1.4999 *.* root 5393 dhcpagent 0 0 128000 0 LISTEN
22132023-10-20T22:49:55.901Z
22142023-10-20T22:49:55.925ZTCP: IPv6
22152023-10-20T22:49:55.948Zprocess exited: duration 721300 ms, exit code 1
22162023-10-20T22:49:55.972Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State If
22172023-10-20T22:49:55.996Zexec warning: stdio descriptors remain open after task exit; waiting 60 seconds for them to close
22182023-10-20T22:49:56.023Z--------------------------------- --------------------------------- -------- ------ -------------- ------ ------ ------ ------ ----------- -----
22192023-10-20T22:49:56.048Zfd00:1122:3344:3::1.5353 *.* root 4820 dns-server 0 0 128000 0 LISTEN
22202023-10-20T22:49:56.074Z
22212023-10-20T22:49:56.098ZActive UNIX domain sockets
22222023-10-20T22:49:56.122ZAddress Type User Pid Command Local Address Remote Address
22232023-10-20T22:49:56.168Z---------------- ---------- -------- ------ -------------- --------------------------------------- ---------------------------------------
22242023-10-20T22:49:56.193Zfffffe85b88007f0 stream-ord root 4820 dns-server
22252023-10-20T22:49:56.217Zfffffe85b4c36070 stream-ord root 4820 dns-server
22262023-10-20T22:49:56.292Zfffffe85b4c36070 stream-ord root 4820 dns-server
22272023-10-20T22:49:56.320Zfffffe85ad7c0790 stream-ord root 5414 in.ndpd /var/run/in.ndpd_ipadm
22282023-10-20T22:49:56.346Zfffffe85ad7c0b30 dgram root 5414 in.ndpd /var/run/in.ndpd_mib
22292023-10-20T22:49:56.372Z ### #######
22302023-10-20T22:49:56.396Z # # ##### ##### #### ##### ##### # # ###### # #
22312023-10-20T22:49:56.419Z ## # # # # # # # # # # # # # #
22322023-10-20T22:49:56.443Z # # # # # # # # # # # # # ##### #
22332023-10-20T22:49:56.467Z # # # # ##### # # # # # # # # #
22342023-10-20T22:49:56.491Z # ## # # # # # # # # # # # #
22352023-10-20T22:49:56.515Z # # # # ####### #### ##### ##### ### # #
22362023-10-20T22:49:56.538Z
22372023-10-20T22:49:56.562Z4983 zsched
22382023-10-20T22:49:56.585Z 4999 /sbin/init
22392023-10-20T22:49:56.609Z5009 /lib/svc/bin/svc.startd
22402023-10-20T22:49:56.633Z 5572 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat -
22412023-10-20T22:49:56.656Z5012 /lib/svc/bin/svc.configd
22422023-10-20T22:49:56.680Z5070 /lib/inet/netcfgd
22432023-10-20T22:49:56.703Z5073 /lib/inet/ipmgmtd
22442023-10-20T22:49:56.727Z5284 /usr/lib/fm/fmd/fmd
22452023-10-20T22:49:56.751Z5286 /usr/lib/pfexecd
22462023-10-20T22:49:56.774Z5556 /usr/lib/utmpd
22472023-10-20T22:49:56.798Z5567 /usr/sbin/cron
22482023-10-20T22:49:57.238Z5582 /usr/sbin/syslogd
22492023-10-20T22:49:57.287Z5655 /usr/lib/inet/in.ndpd
22502023-10-20T22:49:57.311Z5721 /sbin/dhcpagent
22512023-10-20T22:49:57.334Z5819 /usr/sbin/nscd
22522023-10-20T22:49:57.358Z5837 /usr/sbin/chronyd -d -f /etc/inet/chrony.conf
22532023-10-20T22:49:57.383Z 5838 /usr/sbin/chronyd -d -f /etc/inet/chrony.conf
22542023-10-20T22:49:57.406ZADDROBJ TYPE STATE ADDR
22552023-10-20T22:49:57.430Zlo0/v4 static ok 127.0.0.1/8
22562023-10-20T22:49:57.456Zvopte0/public dhcp ok 172.30.3.5/32
22572023-10-20T22:49:57.480Zlo0/v6 static ok ::1/128
22582023-10-20T22:49:57.504ZoxControlService4/ll addrconf ok fe80::8:20ff:feb7:7c42%oxControlService4/10
22592023-10-20T22:49:57.528ZoxControlService4/omicron6 static ok fd00:1122:3344:101::1b/64
22602023-10-20T22:49:57.551Z
22612023-10-20T22:49:57.575ZIRE Table: IPv4
22622023-10-20T22:49:57.598Z Destination Mask Gateway Device MTU Ref Flg Out In/Fwd
22632023-10-20T22:49:57.622Z-------------------- --------------- -------------------- ------ ----- --- --- ------ ------
22642023-10-20T22:49:57.646Z0.0.0.0 255.255.255.255 -- vopte0 1500 1 UHb 0 0
22652023-10-20T22:49:57.669Zdefault 0.0.0.0 172.30.3.1 0 4 UG 92 0
22662023-10-20T22:49:57.693Z127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 50 50
22672023-10-20T22:49:57.716Z172.30.0.0 255.255.255.255 -- vopte0 1500 1 UHb 0 0
22682023-10-20T22:49:57.740Z172.30.3.1 255.255.255.255 172.30.3.5 vopte0 1500 2 UH 92 0
22692023-10-20T22:49:57.765Z172.30.3.5 255.255.255.255 -- vopte0 1500 2 UHL 0 0
22702023-10-20T22:49:57.788Z172.30.3.5 255.255.255.255 172.30.3.5 vopte0 1500 2 UH 0 0
22712023-10-20T22:49:57.812Z172.30.255.255 255.255.255.255 -- vopte0 1500 1 UHb 0 0
22722023-10-20T22:49:57.835Z255.255.255.255 255.255.255.255 -- vopte0 1500 1 UHb 0 0
22732023-10-20T22:49:57.859Z
22742023-10-20T22:49:57.882ZIRE Table: IPv6
22752023-10-20T22:49:57.906Z Destination/Mask Gateway If MTU Ref Flags Out In/Fwd
22762023-10-20T22:49:57.930Z--------------------------- --------------------------- ----- ----- --- ----- ------ ------
22772023-10-20T22:49:57.954Z::1 ::1 lo0 8252 2 UH 18 18
22782023-10-20T22:49:57.977Zfd00:1122:3344:101::1b -- oxControlService4 9000 2 UHL 0 0
22792023-10-20T22:49:58.001Zfe80::8:20ff:feb7:7c42 -- oxControlService4 9000 2 UHL 0 0
22802023-10-20T22:49:58.025Zfd00:1122:3344:101::/64 fd00:1122:3344:101::1b oxControlService4 9000 2 U 0 0
22812023-10-20T22:49:58.048Zfe80::/10 fe80::8:20ff:feb7:7c42 oxControlService4 9000 2 U 0 0
22822023-10-20T22:49:58.072Zdefault fd00:1122:3344:101::1 0 1 UG 0 0
22832023-10-20T22:49:58.095Z
22842023-10-20T22:49:58.121ZUDP: IPv4
22852023-10-20T22:49:58.153Z Local Address Remote Address User Pid Command State
22862023-10-20T22:49:58.179Z-------------------- -------------------- -------- ------ -------------- ----------
22872023-10-20T22:49:58.223Z *.* root 5655 in.ndpd Unbound
22882023-10-20T22:49:58.249Z *.68 root 5721 dhcpagent Idle
22892023-10-20T22:49:58.273Z *.546 root 5721 dhcpagent Idle
22902023-10-20T22:49:58.296Z172.30.3.5.68 root 5721 dhcpagent Idle
22912023-10-20T22:49:58.320Z127.0.0.1.323 chrony 5837 chronyd Idle
22922023-10-20T22:49:58.344Z *.123 chrony 5837 chronyd Idle
22932023-10-20T22:49:58.368Z172.30.3.5.55585 1.1.1.1.53 root 5819 nscd Connected
22942023-10-20T22:49:58.392Z172.30.3.5.51685 9.9.9.9.53 root 5819 nscd Connected
22952023-10-20T22:49:58.416Z
22962023-10-20T22:49:58.440ZUDP: IPv6
22972023-10-20T22:49:58.464Z Local Address Remote Address User Pid Command State If
22982023-10-20T22:49:58.488Z--------------------------------- --------------------------------- -------- ------ -------------- ---------- -----
22992023-10-20T22:49:58.512Z *.* root 5655 in.ndpd Unbound
23002023-10-20T22:49:58.535Z *.546 root 5721 dhcpagent Idle
23012023-10-20T22:49:58.560Z::1.323 chrony 5837 chronyd Idle
23022023-10-20T22:49:58.584Z *.123 chrony 5837 chronyd Idle
23032023-10-20T22:49:58.607Z
23042023-10-20T22:49:58.637ZTCP: IPv4
23052023-10-20T22:49:58.662Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State
23062023-10-20T22:49:58.686Z-------------------- -------------------- -------- ------ -------------- ------ ------ ------ ------ -----------
23072023-10-20T22:49:58.710Z127.0.0.1.4999 *.* root 5721 dhcpagent 0 0 128000 0 LISTEN
23082023-10-20T22:49:58.733Z
23092023-10-20T22:49:58.757ZActive UNIX domain sockets
23102023-10-20T22:49:58.781ZAddress Type User Pid Command Local Address Remote Address
23112023-10-20T22:49:58.804Z---------------- ---------- -------- ------ -------------- --------------------------------------- ---------------------------------------
23122023-10-20T22:49:58.828Zfffffe85de350bb8 stream-ord
23132023-10-20T22:49:58.852Zfffffe85d73e00d0 stream-ord
23142023-10-20T22:49:58.875Zfffffe85d9156ba8 dgram chrony 5837 chronyd /var/run/chrony/chronyd.sock
23152023-10-20T22:49:58.899Zfffffe85b8800450 stream-ord root 5655 in.ndpd /var/run/in.ndpd_ipadm
23162023-10-20T22:49:58.923Zfffffe85b4eddb58 dgram root 5655 in.ndpd /var/run/in.ndpd_mib
23172023-10-20T22:49:58.947ZNet to Media Table: IPv4
23182023-10-20T22:49:58.970ZDevice IP Address Mask Flags Phys Addr
23192023-10-20T22:49:58.994Z------ -------------------- --------------- -------- ---------------
23202023-10-20T22:49:59.018Zvopte0 172.30.3.1 255.255.255.255 a8:40:25:ff:77:77
23212023-10-20T22:49:59.041Zvopte0 172.30.3.5 255.255.255.255 SPLA a8:40:25:ff:a8:e1
23222023-10-20T22:49:59.065Z ### #######
23232023-10-20T22:49:59.090Z # # ##### ##### #### ##### ##### # # ###### # #
23242023-10-20T22:49:59.114Z ## # # # # # # # # # # # # # #
23252023-10-20T22:49:59.138Z # # # # # # # # # # # # # ##### #
23262023-10-20T22:49:59.161Z # # # # ##### # # # # # # # # #
23272023-10-20T22:49:59.185Z # ## # # # # # # # # # # # #
23282023-10-20T22:49:59.209Z # # # # ####### #### ##### ##### ### # #
23292023-10-20T22:49:59.246Z
23302023-10-20T22:49:59.270ZReference ID : 7F7F0101 ()
23312023-10-20T22:49:59.294ZStratum : 10
23322023-10-20T22:49:59.317ZRef time (UTC) : Fri Oct 20 22:49:04 2023
23332023-10-20T22:49:59.341ZSystem time : 0.000000000 seconds fast of NTP time
23342023-10-20T22:49:59.365ZLast offset : +0.000000000 seconds
23352023-10-20T22:49:59.389ZRMS offset : 0.000000000 seconds
23362023-10-20T22:49:59.412ZFrequency : 0.000 ppm slow
23372023-10-20T22:49:59.436ZResidual freq : +0.000 ppm
23382023-10-20T22:49:59.462ZSkew : 0.000 ppm
23392023-10-20T22:49:59.488ZRoot delay : 0.000000000 seconds
23402023-10-20T22:49:59.512ZRoot dispersion : 0.000000000 seconds
23412023-10-20T22:49:59.535ZUpdate interval : 0.0 seconds
23422023-10-20T22:49:59.559ZLeap status : Normal
23432023-10-20T22:49:59.583ZMS Name/IP address Stratum Poll Reach LastRx Last sample
23442023-10-20T22:49:59.606Z===============================================================================
23452023-10-20T22:49:59.630Z#
23462023-10-20T22:49:59.654Z# Configuration file for a boundary NTP server - one which communicates with
23472023-10-20T22:49:59.677Z# NTP servers outside the rack.
23482023-10-20T22:49:59.701Z#
23492023-10-20T22:49:59.725Z
23502023-10-20T22:49:59.749Z
23512023-10-20T22:49:59.772Zdriftfile /var/lib/chrony/drift
23522023-10-20T22:49:59.796Zntsdumpdir /var/lib/chrony
23532023-10-20T22:49:59.820Zdumpdir /var/lib/chrony
23542023-10-20T22:49:59.844Zpidfile /var/run/chrony/chronyd.pid
23552023-10-20T22:49:59.867Zlogdir /var/log/chrony
23562023-10-20T22:49:59.897Z
23572023-10-20T22:49:59.927Zlog measurements statistics tracking
23582023-10-20T22:49:59.956Z
23592023-10-20T22:49:59.982Zallow fe80::/10
23602023-10-20T22:50:00.007Zallow fd00:1122:3344:100::/56
23612023-10-20T22:50:00.032Z
23622023-10-20T22:50:00.056Z# Enable local reference mode, which keeps us operating as an NTP server that
23632023-10-20T22:50:00.080Z# appears synchronised even if there are currently no active upstreams. When
23642023-10-20T22:50:00.103Z# in this mode, we report as stratum 10 to clients.
23652023-10-20T22:50:00.127Zlocal stratum 10
23662023-10-20T22:50:00.153Z
23672023-10-20T22:50:00.176Z# makestep <threshold> <limit>
23682023-10-20T22:50:00.200Z# We allow chrony to step the system clock during the first three time updates
23692023-10-20T22:50:00.224Z# if we are more than 0.1 seconds out.
23702023-10-20T22:50:00.271Zmakestep 0.1 3
23712023-10-20T22:50:00.295Z
23722023-10-20T22:50:00.319Z# When a leap second occurs we slew the clock over approximately 37 seconds.
23732023-10-20T22:50:00.343Zleapsecmode slew
23742023-10-20T22:50:00.367Zmaxslewrate 2708.333
23752023-10-20T22:50:00.397Z
23762023-10-20T22:50:00.431Zpool 0.pool.ntp.org iburst maxdelay 0.1 maxsources 16
23772023-10-20T22:50:00.455Z
23782023-10-20T22:50:00.479ZConfig {
23792023-10-20T22:50:00.503Z p4_program: "/softnpu/asic_program.so",
23802023-10-20T22:50:00.527Z ports: [
23812023-10-20T22:50:00.551Z Port {
23822023-10-20T22:50:00.575Z sidecar: "sc0_0",
23832023-10-20T22:50:00.599Z scrimlet: "sidecar_shi0",
23842023-10-20T22:50:00.623Z mtu: 9000,
23852023-10-20T22:50:00.648Z },
23862023-10-20T22:50:00.672Z Port {
23872023-10-20T22:50:00.696Z sidecar: "sc0_1",
23882023-10-20T22:50:00.720Z scrimlet: "sidecar_shi1",
23892023-10-20T22:50:00.744Z mtu: 9000,
23902023-10-20T22:50:00.768Z },
23912023-10-20T22:50:00.793Z ],
23922023-10-20T22:50:00.825Z}
23932023-10-20T22:50:00.852Zadd table entry: unknown table id ingress.router.v4.rtr, ignoring
 
23942023-10-20T22:50:00.938Zfound 10 output files
23952023-10-20T22:50:00.963Zuploading: /var/svc/log/oxide-sled-agent:default.log (259390 bytes)
23962023-10-20T22:50:02.190Zuploaded: /var/svc/log/oxide-sled-agent:default.log
23972023-10-20T22:50:02.214Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84/root/var/svc/log/oxide-internal_dns:default.log (0 bytes)
23982023-10-20T22:50:03.269Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84/root/var/svc/log/oxide-internal_dns:default.log
23992023-10-20T22:50:03.294Zuploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84/root/var/svc/log/oxide-internal_dns:default.log.0 (11189 bytes)
24002023-10-20T22:50:04.407Zuploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_94ce7ee0-9c26-4ffd-95f2-0766b7385c84/root/var/svc/log/oxide-internal_dns:default.log.0
24012023-10-20T22:50:04.438Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877/root/var/svc/log/oxide-internal_dns:default.log (0 bytes)
24022023-10-20T22:50:05.498Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877/root/var/svc/log/oxide-internal_dns:default.log
24032023-10-20T22:50:05.525Zuploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877/root/var/svc/log/oxide-internal_dns:default.log.0 (8347 bytes)
24042023-10-20T22:50:06.623Zuploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_5b407f77-3e2b-4ffa-b9b1-47537d63d877/root/var/svc/log/oxide-internal_dns:default.log.0
24052023-10-20T22:50:06.647Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe/root/var/svc/log/oxide-ntp:default.log (0 bytes)
24062023-10-20T22:50:07.693Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe/root/var/svc/log/oxide-ntp:default.log
24072023-10-20T22:50:07.720Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe/root/var/svc/log/oxide-ntp:default.log.0 (713 bytes)
24082023-10-20T22:50:08.792Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe/root/var/svc/log/oxide-ntp:default.log.0
24092023-10-20T22:50:08.816Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af/root/var/svc/log/oxide-internal_dns:default.log (0 bytes)
24102023-10-20T22:50:09.869Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af/root/var/svc/log/oxide-internal_dns:default.log
24112023-10-20T22:50:09.902Zuploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af/root/var/svc/log/oxide-internal_dns:default.log.0 (5910 bytes)
24122023-10-20T22:50:10.977Zuploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_694393ae-5b29-4564-9cc4-00e8d1aba0af/root/var/svc/log/oxide-internal_dns:default.log.0
24132023-10-20T22:50:11.002Zuploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe/root/var/log/chrony/tracking.log (529 bytes)
24142023-10-20T22:50:12.071Zuploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_cdd0f738-d00f-42ba-8e72-2b244139eafe/root/var/log/chrony/tracking.log