01KPRTB9QJKMXMTQXT0HSX6SYC: helios / deploy

BasicConfig {
    output_rules: [
        "%/var/svc/log/oxide-*.log*",
        "%/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/oxide-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_*/root/var/svc/log/system-illumos-*.log*",
        "%/pool/ext/*/crypt/zone/oxz_ntp_*/root/var/log/chrony/*.log*",
        "!/pool/ext/*/crypt/zone/oxz_propolis-server_*/root/var/svc/log/*.log*",
        "%/pool/ext/*/crypt/debug/global/oxide-sled-agent:default.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/oxide-*.log.*",
        "%/pool/ext/*/crypt/debug/oxz_*/system-illumos-*.log.*",
        "!/pool/ext/*/crypt/debug/oxz_propolis-server_*/*.log.*",
        "/tmp/kstat/*.kstat",
    ],
    rust_toolchain: None,
    target: Some(
        "lab-2.0-opte-0.40",
    ),
    access_repos: [],
    publish: [],
    skip_clone: true,
}

Buildomat Job: 01KPRTC44E2G4DDKGJZ3BXXJAP

Tags:

Artefacts:

Output:

SEQ GLOBAL TIME DETAILS
12026-04-21T20:24:18.618Zjob dependencies complete; ready to run (waiting for 18 m 34 s)
22026-04-21T20:27:09.383Zjob assigned to worker 01KPRVEBR2ADZABE5GFEZB0NFH [factory lab, sock/16690] (queued for 2 m 50 s)
32026-04-21T20:27:09.701Zhttp://172.20.0.5:9969/ipxe/sock... ok
42026-04-21T20:27:09.738Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok
52026-04-21T20:27:09.771Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok
62026-04-21T20:27:09.806Zhttp://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok
72026-04-21T20:27:09.871Zhttp://172.20.0.5:9969/postboot/sock... ok
82026-04-21T20:27:09.905ZwcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U
92026-04-21T20:27:09.938ZWARNING: cpu0: failed to update microcode from version 0xa001133 to 0xa0011de
102026-04-21T20:27:09.982ZWARNING: cpu0: using older fallback microcode; update the system firmware
112026-04-21T20:27:10.017Zcpu0: microcode has been updated from version 0xa001133 to 0xa0011d5
122026-04-21T20:27:10.050ZOxide Helios Version helios-2.0.23894 64-bit
132026-04-21T20:27:10.083ZConfiguring devices.
142026-04-21T20:27:10.116Z##################################################
152026-04-21T20:27:10.152Z#### ############# ##
162026-04-21T20:27:10.228Z### ### ############ ##
172026-04-21T20:27:10.261Z## ### # ## ### ## Oxide Computer Company ##
182026-04-21T20:27:10.295Z## ## ## ### # ### ##
192026-04-21T20:27:10.329Z## # ### #### #### This Station Under ##
202026-04-21T20:27:10.362Z### ### #### # ### Computer Control ##
212026-04-21T20:27:10.395Z#### #### ### ## ##
222026-04-21T20:27:10.428Z##################################################
232026-04-21T20:27:10.462ZHostname: sock
242026-04-21T20:27:10.495ZLoading smf(7) service descriptions:
252026-04-21T20:27:11.041Zdownloading input: /input/package/work/package.tar.gz
262026-04-21T20:27:23.077Zsock console login:
272026-04-21T20:27:23.112ZSUNW-MSG-ID: PCIEX-8000-0A, TYPE: Fault, VER: 1, SEVERITY: Critical
282026-04-21T20:27:23.145ZEVENT-TIME: Tue Apr 21 20:27:22 UTC 2026
292026-04-21T20:27:23.179ZPLATFORM: R152-Z32-00, CSN: GKG8N7212A0003, HOSTNAME: sock
302026-04-21T20:27:23.213ZSOURCE: eft, REV: 1.16
312026-04-21T20:27:23.257ZEVENT-ID: 64e5a537-e3cb-432d-a37a-2c8cbb6c4fa2
322026-04-21T20:27:23.335ZDESC: A problem was detected for a PCIEX device.
332026-04-21T20:27:23.368ZRefer to http://illumos.org/msg/PCIEX-8000-0A for more information.
342026-04-21T20:27:23.402ZAUTO-RESPONSE: One or more device instances may be disabled
352026-04-21T20:27:23.435ZIMPACT: Loss of services provided by the device instances associated with this fault
362026-04-21T20:27:23.469ZREC-ACTION: Schedule a repair procedure to replace the affected device. Use fmadm faulty to identify the device or contact your illumos distribution team for support.
372026-04-21T20:34:17.954Zdownloaded input: /input/package/work/package.tar.gz
 
382026-04-21T20:34:17.979Zstarting task 0: "setup"
392026-04-21T20:34:17.979Z++ uname -s
402026-04-21T20:34:17.979Z+ kern=SunOS
412026-04-21T20:34:17.979Z+ build_user=build
422026-04-21T20:34:17.979Z+ build_uid=12345
432026-04-21T20:34:17.979Z+ work_dir=/work
442026-04-21T20:34:17.979Z+ input_dir=/input
452026-04-21T20:34:17.979Z+ [[ 0 == 12345 ]]
462026-04-21T20:34:17.979Z+ case "$kern" in
472026-04-21T20:34:17.980Z+ groupadd -g 12345 build
482026-04-21T20:34:17.980Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
492026-04-21T20:34:19.973Z+ zfs create -o mountpoint=/work rpool/work
502026-04-21T20:34:19.997Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
512026-04-21T20:34:19.997Z+ home_fs=zfs
522026-04-21T20:34:19.997Z+ [[ zfs == autofs ]]
532026-04-21T20:34:19.997Z+ mkdir -p /home/build
542026-04-21T20:34:19.997Z+ chown build:build /home/build /work
552026-04-21T20:34:21.999Z+ chmod 0700 /home/build /work
562026-04-21T20:34:22.024Zprocess exited: duration 4047 ms, exit code 0
 
572026-04-21T20:34:22.073Zstarting task 1: "authentication"
582026-04-21T20:34:22.118Zprocess exited: duration 44 ms, exit code 0
 
592026-04-21T20:34:22.168Zstarting task 2: "build"
602026-04-21T20:34:22.192Z+ trap _exit_trap EXIT
612026-04-21T20:34:22.193Z+ OPTE_COMMIT=
622026-04-21T20:34:22.193Z+ [[ x != \x ]]
632026-04-21T20:34:22.193Z+ pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3'
642026-04-21T20:34:22.284Zsecpolicy_fs_linkdir: 0x55 = 0x55
652026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+1: 0xb8 = 0x48
662026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+2: 0x1 = 0x89
672026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+3: 0 = 0xe5
682026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+4: 0 = 0xb8
692026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+5: 0 = 0x1
702026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+6: 0x48 = 0x0
712026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+7: 0x89 = 0x0
722026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+8: 0xe5 = 0x0
732026-04-21T20:34:22.284Zsecpolicy_fs_linkdir+9: 0x48 = 0x5d
742026-04-21T20:34:22.285Zsecpolicy_fs_linkdir+0xa: 0x83 = 0xc3
752026-04-21T20:34:22.309Z+ [[ -d /opt/oxide ]]
762026-04-21T20:34:22.309Z+ pfexec mv /opt/oxide /opt/oxide-underneath
772026-04-21T20:34:22.310Z+ pfexec mkdir /opt/oxide
782026-04-21T20:34:22.310Z+ pfexec mount -F tmpfs -O swap /opt/oxide
792026-04-21T20:34:22.310Z+ [[ -d /opt/oxide-underneath ]]
802026-04-21T20:34:22.310Z+ cd /opt/oxide-underneath
812026-04-21T20:34:22.310Z+ pfexec tar ceEp@/f - .
822026-04-21T20:34:22.310Z+ cd /opt/oxide
832026-04-21T20:34:22.310Z+ pfexec tar xveEp@/f -
842026-04-21T20:34:22.359Zx ., 0 bytes, 0 tape blocks
852026-04-21T20:34:22.359Zx ./opte, 0 bytes, 0 tape blocks
862026-04-21T20:34:22.359Zx ./opte/bin, 0 bytes, 0 tape blocks
872026-04-21T20:34:22.359Zx ./opte/bin/opteadm, 24311432 bytes, 47484 tape blocks
882026-04-21T20:34:22.384Z+ pfexec rm -rf /opt/oxide-underneath
892026-04-21T20:34:22.384Z+ pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone
902026-04-21T20:34:22.408Z+ pfexec mkdir /opt/oxide/work
912026-04-21T20:34:22.408Z+ pfexec chown build:build /opt/oxide/work
922026-04-21T20:34:22.408Z+ cd /opt/oxide/work
932026-04-21T20:34:22.408Z+ ptime -m tar xvzf /input/package/work/package.tar.gz
942026-04-21T20:34:44.025ZDecompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'...
952026-04-21T20:34:44.025Zx .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks
962026-04-21T20:34:44.025Zx out/target/test, 107 bytes, 1 tape blocks
972026-04-21T20:34:44.025Zx out/npuzone/npuzone, 28059200 bytes, 54804 tape blocks
982026-04-21T20:34:44.025Zx package-manifest.toml, 35397 bytes, 70 tape blocks
992026-04-21T20:34:44.025Zx smf/sled-agent/non-gimlet/config.toml, 5328 bytes, 11 tape blocks
1002026-04-21T20:34:44.025Zx target/release/omicron-package, 47008384 bytes, 91814 tape blocks
1012026-04-21T20:34:44.025Zx target/release/xtask, 11720632 bytes, 22892 tape blocks
1022026-04-21T20:34:44.025Zx target/debug/bootstrap, 349170200 bytes, 681974 tape blocks
1032026-04-21T20:34:44.025Zx tests/bootstrap-2591d64deb37c086, 32061200 bytes, 62620 tape blocks
1042026-04-21T20:34:44.025Zx tests/commtest-4942e29ae4ca8837, 33172136 bytes, 64790 tape blocks
1052026-04-21T20:34:44.025Zx tests/dhcp_server-b1bc68e80128657d, 32061200 bytes, 62620 tape blocks
1062026-04-21T20:34:44.025Zx tests/end_to_end_tests-ec2fae9151184196, 392569752 bytes, 766738 tape blocks
1072026-04-21T20:34:44.025Zx out/clickhouse.tar.gz, 320527973 bytes, 626032 tape blocks
1082026-04-21T20:34:44.025Zx out/clickhouse_keeper.tar.gz, 305672255 bytes, 597017 tape blocks
1092026-04-21T20:34:44.025Zx out/clickhouse_server.tar.gz, 320526808 bytes, 626029 tape blocks
1102026-04-21T20:34:44.025Zx out/cockroachdb.tar.gz, 165081611 bytes, 322426 tape blocks
1112026-04-21T20:34:44.025Zx out/crucible-pantry-zone.tar.gz, 45112963 bytes, 88112 tape blocks
1122026-04-21T20:34:44.025Zx out/crucible-utils.tar, 18169344 bytes, 35487 tape blocks
1132026-04-21T20:34:44.025Zx out/crucible-zone.tar.gz, 59590351 bytes, 116388 tape blocks
1142026-04-21T20:34:44.025Zx out/external-dns.tar.gz, 50056996 bytes, 97768 tape blocks
1152026-04-21T20:34:44.025Zx out/internal-dns.tar.gz, 50056594 bytes, 97767 tape blocks
1162026-04-21T20:34:44.025Zx out/mg-ddm-gz.tar, 97423872 bytes, 190281 tape blocks
1172026-04-21T20:34:44.025Zx out/nexus.tar.gz, 224835768 bytes, 439133 tape blocks
1182026-04-21T20:34:44.025Zx out/ntp.tar.gz, 32665811 bytes, 63801 tape blocks
1192026-04-21T20:34:44.025Zx out/omicron-gateway-softnpu.tar.gz, 29037558 bytes, 56714 tape blocks
1202026-04-21T20:34:44.025Zx out/omicron-sled-agent.tar, 205493248 bytes, 401354 tape blocks
1212026-04-21T20:34:44.025Zx out/overlay.tar.gz, 3030 bytes, 6 tape blocks
1222026-04-21T20:34:44.025Zx out/oximeter.tar.gz, 64971723 bytes, 126898 tape blocks
1232026-04-21T20:34:44.025Zx out/oxlog.tar, 3872256 bytes, 7563 tape blocks
1242026-04-21T20:34:44.026Zx out/probe.tar.gz, 3109568 bytes, 6074 tape blocks
1252026-04-21T20:34:44.026Zx out/propolis-server.tar.gz, 39656396 bytes, 77454 tape blocks
1262026-04-21T20:34:44.026Zx out/pumpkind-gz.tar, 27286528 bytes, 53294 tape blocks
1272026-04-21T20:34:44.026Zx out/switch-softnpu.tar.gz, 400378062 bytes, 781989 tape blocks
1282026-04-21T20:34:44.051Z
1292026-04-21T20:34:44.051Zreal 21.609580468
1302026-04-21T20:34:44.051Zuser 19.313395425
1312026-04-21T20:34:44.051Zsys 3.878851931
1322026-04-21T20:34:44.051Ztrap 0.000934766
1332026-04-21T20:34:44.051Ztflt 0.000000000
1342026-04-21T20:34:44.051Zdflt 0.000000000
1352026-04-21T20:34:44.051Zkflt 0.000000000
1362026-04-21T20:34:44.051Zlock 0.000000000
1372026-04-21T20:34:44.052Zslp 19.451606600
1382026-04-21T20:34:44.052Zlat 0.572391389
1392026-04-21T20:34:44.052Zstop 0.000130923
1402026-04-21T20:34:44.052Z+ source .github/buildomat/ci-env.sh
1412026-04-21T20:34:44.052Z++ export CARGO_TERM_COLOR=always
1422026-04-21T20:34:44.052Z++ CARGO_TERM_COLOR=always
1432026-04-21T20:34:44.052Z+ bmat address ls
1442026-04-21T20:34:44.052ZNAME CIDR FIRST LAST COUNT
1452026-04-21T20:34:44.052Zextra 10.151.2.0/24 10.151.2.164 10.151.2.227 64
1462026-04-21T20:34:44.052Z++ bmat address ls -f extra -Ho first,last,count
1472026-04-21T20:34:44.052Z+ set -- 10.151.2.164 10.151.2.227 64
1482026-04-21T20:34:44.052Z+ EXTRA_IP_START=10.151.2.164
1492026-04-21T20:34:44.052Z+ EXTRA_IP_END=10.151.2.227
1502026-04-21T20:34:44.052Z+ EXTRA_IP_COUNT=64
1512026-04-21T20:34:44.052Z+ (( EXTRA_IP_COUNT >= 32 ))
1522026-04-21T20:34:44.052Z+ EXTRA_IP_BASE=10.151.2
1532026-04-21T20:34:44.052Z+ EXTRA_IP_FOCTET=164
1542026-04-21T20:34:44.052Z+ EXTRA_IP_LOCTET=227
1552026-04-21T20:34:44.052Z+ SERVICE_IP_POOL_START=10.151.2.164
1562026-04-21T20:34:44.052Z+ SERVICE_IP_POOL_END=10.151.2.173
1572026-04-21T20:34:44.052Z+ DNS_IP1=10.151.2.164
1582026-04-21T20:34:44.052Z+ DNS_IP2=10.151.2.165
1592026-04-21T20:34:44.052Z+ UPLINK_IP=10.151.2.174
1602026-04-21T20:34:44.052Z+ IPPOOL_START=10.151.2.175
1612026-04-21T20:34:44.052Z+ IPPOOL_END=10.151.2.227
1622026-04-21T20:34:44.052Z++ ipadm show-addr -po type,addr
1632026-04-21T20:34:44.052Z++ awk '-F[:/]' '$1 == "dhcp" {print $2}'
1642026-04-21T20:34:44.052Z+ GATEWAY_IP=10.151.2.100
1652026-04-21T20:34:44.052Z+ [[ -n 10.151.2.100 ]]
1662026-04-21T20:34:44.052Z+ ping -s 10.151.2.100 56 1
1672026-04-21T20:34:44.052ZPING 10.151.2.100: 56 data bytes
1682026-04-21T20:34:44.052Z64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms
1692026-04-21T20:34:44.052Z
1702026-04-21T20:34:44.052Z----10.151.2.100 PING Statistics----
1712026-04-21T20:34:44.052Z1 packets transmitted, 1 packets received, 0% packet loss
1722026-04-21T20:34:44.052Zround-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan
1732026-04-21T20:34:44.052Z++ arp -an
1742026-04-21T20:34:44.052Z++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}'
1752026-04-21T20:34:44.053Z+ GATEWAY_MAC=18:c0:4d:0d:a0:2a
1762026-04-21T20:34:44.053Z+ routeadm -e ipv4-forwarding -u
1772026-04-21T20:34:44.154Z+ PXA_START=10.151.2.164
1782026-04-21T20:34:44.154Z+ PXA_END=10.151.2.227
1792026-04-21T20:34:44.154Z+ pfexec zpool create -f scratch c1t1d0 c2t1d0
1802026-04-21T20:34:44.178Zcannot open 'c2t1d0': no such device in /dev/dsk
1812026-04-21T20:34:44.178Zmust be a full path or shorthand device name
1822026-04-21T20:34:44.179Z+ _exit_trap
1832026-04-21T20:34:44.179Z+ local status=1
1842026-04-21T20:34:44.179Z+ set +o errexit
1852026-04-21T20:34:44.179Z+ [[ x != \x ]]
1862026-04-21T20:34:44.179Z+ pfexec svcadm -Z disable -s cron
1872026-04-21T20:34:44.203Z+ [[ 1 -eq 0 ]]
1882026-04-21T20:34:44.203Z+ set -o xtrace
1892026-04-21T20:34:44.204Z+ banner evidence
1902026-04-21T20:34:44.204Z
1912026-04-21T20:34:44.204Z ###### # # # ##### ###### # # #### ######
1922026-04-21T20:34:44.204Z # # # # # # # ## # # # #
1932026-04-21T20:34:44.204Z ##### # # # # # ##### # # # # #####
1942026-04-21T20:34:44.204Z # # # # # # # # # # # #
1952026-04-21T20:34:44.204Z # # # # # # # # ## # # #
1962026-04-21T20:34:44.204Z ###### ## # ##### ###### # # #### ######
1972026-04-21T20:34:44.204Z
1982026-04-21T20:34:44.204Z+ zoneadm list -civ
1992026-04-21T20:34:44.204Z ID NAME STATUS PATH BRAND IP
2002026-04-21T20:34:44.204Z 0 global running / ipkg shared
2012026-04-21T20:34:44.204Z+ pfexec dladm show-phys -m
2022026-04-21T20:34:44.204ZLINK SLOT ADDRESS INUSE CLIENT
2032026-04-21T20:34:44.204Zigb0 primary 18:c0:4d:d:a0:2a yes igb0
2042026-04-21T20:34:44.265Zigb1 primary 18:c0:4d:d:a0:2b no --
2052026-04-21T20:34:44.290Z+ pfexec dladm show-link
2062026-04-21T20:34:44.290ZLINK CLASS MTU STATE BRIDGE OVER
2072026-04-21T20:34:44.290Zigb0 phys 1500 up -- --
2082026-04-21T20:34:44.290Zigb1 phys 1500 unknown -- --
2092026-04-21T20:34:44.290Z+ pfexec dladm show-vnic
2102026-04-21T20:34:44.290Z+ pfexec ipadm
2112026-04-21T20:34:44.290ZADDROBJ TYPE STATE ADDR
2122026-04-21T20:34:44.290Zlo0/v4 static ok 127.0.0.1/8
2132026-04-21T20:34:44.291Zigb0/dhcp dhcp ok 10.151.2.100/24
2142026-04-21T20:34:44.291Zlo0/v6 static ok ::1/128
2152026-04-21T20:34:44.291Z+ pfexec netstat -rncva
2162026-04-21T20:34:44.291Z
2172026-04-21T20:34:44.291ZIRE Table: IPv4
2182026-04-21T20:34:44.291Z Destination Mask Gateway Device MTU Ref Flg Out In/Fwd
2192026-04-21T20:34:44.291Z-------------------- --------------- -------------------- ------ ----- --- --- ------ ------
2202026-04-21T20:34:44.291Z0.0.0.0 255.255.255.255 -- igb0 1500 1 UHb 0 0
2212026-04-21T20:34:44.291Zdefault 0.0.0.0 10.151.2.1 igb0 1500 4 UG 892843 0
2222026-04-21T20:34:44.291Z10.0.0.0 255.255.255.255 -- igb0 1500 1 UHb 0 0
2232026-04-21T20:34:44.291Z10.151.2.0 255.255.255.255 -- igb0 1500 1 UHb 0 0
2242026-04-21T20:34:44.291Z10.151.2.0/24 255.255.255.0 10.151.2.100 igb0 1500 3 U 0 0
2252026-04-21T20:34:44.291Z10.151.2.1/32 255.255.255.255 10.151.2.100 igb0 1500 3 UC 0 0
2262026-04-21T20:34:44.291Z10.151.2.100 255.255.255.255 -- igb0 1500 2 UHL 2 1785145
2272026-04-21T20:34:44.291Z10.151.2.255 255.255.255.255 -- igb0 1500 1 UHb 0 0
2282026-04-21T20:34:44.292Z10.255.255.255 255.255.255.255 -- igb0 1500 1 UHb 0 0
2292026-04-21T20:34:44.292Z127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 14 14
2302026-04-21T20:34:44.292Z255.255.255.255 255.255.255.255 -- igb0 1500 1 UHb 0 1
2312026-04-21T20:34:44.292Z
2322026-04-21T20:34:44.292ZIRE Table: IPv6
2332026-04-21T20:34:44.292Z Destination/Mask Gateway If MTU Ref Flags Out In/Fwd
2342026-04-21T20:34:44.292Z--------------------------- --------------------------- ----- ----- --- ----- ------ ------
2352026-04-21T20:34:44.292Z::1 ::1 lo0 8252 2 UH 0 0
2362026-04-21T20:34:44.292Z+ pfexec netstat -anu
2372026-04-21T20:34:44.318Z
2382026-04-21T20:34:44.318ZUDP: IPv4
2392026-04-21T20:34:44.318Z Local Address Remote Address User Pid Command State
2402026-04-21T20:34:44.318Z-------------------- -------------------- -------- ------ -------------- ----------
2412026-04-21T20:34:44.318Z *.* root 66 in.mpathd Unbound
2422026-04-21T20:34:44.318Z *.* root 66 in.mpathd Unbound
2432026-04-21T20:34:44.318Z *.68 root 230 dhcpagent Idle
2442026-04-21T20:34:44.318Z *.546 root 230 dhcpagent Idle
2452026-04-21T20:34:44.318Z10.151.2.100.68 root 230 dhcpagent Idle
2462026-04-21T20:34:44.318Z *.111 daemon 709 rpcbind Idle
2472026-04-21T20:34:44.318Z *.* daemon 709 rpcbind Unbound
2482026-04-21T20:34:44.318Z *.64295 daemon 709 rpcbind Idle
2492026-04-21T20:34:44.318Z *.111 daemon 709 rpcbind Idle
2502026-04-21T20:34:44.318Z *.* daemon 709 rpcbind Unbound
2512026-04-21T20:34:44.318Z *.36480 daemon 709 rpcbind Idle
2522026-04-21T20:34:44.318Z *.* root 721 in.ndpd Unbound
2532026-04-21T20:34:44.318Z *.* root 853 rcm_daemon Unbound
2542026-04-21T20:34:44.318Z *.* root 853 rcm_daemon Unbound
2552026-04-21T20:34:44.318Z
2562026-04-21T20:34:44.318ZUDP: IPv6
2572026-04-21T20:34:44.318Z Local Address Remote Address User Pid Command State If
2582026-04-21T20:34:44.318Z--------------------------------- --------------------------------- -------- ------ -------------- ---------- -----
2592026-04-21T20:34:44.318Z *.* root 66 in.mpathd Unbound
2602026-04-21T20:34:44.318Z *.546 root 230 dhcpagent Idle
2612026-04-21T20:34:44.318Z *.111 daemon 709 rpcbind Idle
2622026-04-21T20:34:44.318Z *.* daemon 709 rpcbind Unbound
2632026-04-21T20:34:44.319Z *.64295 daemon 709 rpcbind Idle
2642026-04-21T20:34:44.319Z *.* root 721 in.ndpd Unbound
2652026-04-21T20:34:44.319Z *.* root 853 rcm_daemon Unbound
2662026-04-21T20:34:44.319Z
2672026-04-21T20:34:44.319ZTCP: IPv4
2682026-04-21T20:34:44.319Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State
2692026-04-21T20:34:44.319Z-------------------- -------------------- -------- ------ -------------- ------ ------ ------ ------ -----------
2702026-04-21T20:34:44.319Z127.0.0.1.5999 *.* root 66 in.mpathd 0 0 128000 0 LISTEN
2712026-04-21T20:34:44.320Z127.0.0.1.4999 *.* root 230 dhcpagent 0 0 128000 0 LISTEN
2722026-04-21T20:34:44.320Z *.111 *.* daemon 709 rpcbind 0 0 128000 0 LISTEN
2732026-04-21T20:34:44.320Z *.* *.* daemon 709 rpcbind 0 0 128000 0 IDLE
2742026-04-21T20:34:44.320Z *.111 *.* daemon 709 rpcbind 0 0 128000 0 LISTEN
2752026-04-21T20:34:44.320Z *.* *.* daemon 709 rpcbind 0 0 128000 0 IDLE
2762026-04-21T20:34:44.320Z10.151.2.100.65484 54.187.123.254.443 root 802 agent 1049792 0 128872 0 ESTABLISHED
2772026-04-21T20:34:44.320Z10.151.2.100.57293 54.187.123.254.443 root 802 agent 1049792 4878 128872 0 ESTABLISHED
2782026-04-21T20:34:44.320Z
2792026-04-21T20:34:44.320ZTCP: IPv6
2802026-04-21T20:34:44.320Z Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State If
2812026-04-21T20:34:44.320Z--------------------------------- --------------------------------- -------- ------ -------------- ------ ------ ------ ------ ----------- -----
2822026-04-21T20:34:44.320Z::1.5999 *.* root 66 in.mpathd 0 0 128000 0 LISTEN
2832026-04-21T20:34:44.320Z *.111 *.* daemon 709 rpcbind 0 0 128000 0 LISTEN
2842026-04-21T20:34:44.320Z *.* *.* daemon 709 rpcbind 0 0 128000 0 IDLE
2852026-04-21T20:34:44.320Z
2862026-04-21T20:34:44.321ZActive UNIX domain sockets
2872026-04-21T20:34:44.321ZAddress Type User Pid Command Local Address Remote Address
2882026-04-21T20:34:44.321Z---------------- ---------- -------- ------ -------------- --------------------------------------- ---------------------------------------
2892026-04-21T20:34:44.321Zfffffe8569cfd758 stream-ord root 802 agent /var/run/buildomat.sock
2902026-04-21T20:34:44.321Zfffffe8569cfdaf8 stream-ord root 802 agent
2912026-04-21T20:34:44.321Zfffffe8569cfdaf8 stream-ord root 802 agent
2922026-04-21T20:34:44.321Zfffffe8586cfc010 stream-ord root 802 agent
2932026-04-21T20:34:44.321Zfffffe8584426008 stream-ord root 757 inetd /var/run/.inetd.uds
2942026-04-21T20:34:44.321Zfffffe85844263a8 dgram root 721 in.ndpd /var/run/in.ndpd_mib
2952026-04-21T20:34:44.321Zfffffe8584426748 stream-ord root 721 in.ndpd /var/run/in.ndpd_ipadm
2962026-04-21T20:34:44.321Z+ pfexec arp -an
2972026-04-21T20:34:44.321ZNet to Media Table: IPv4
2982026-04-21T20:34:44.321ZDevice IP Address Mask Flags Phys Addr
2992026-04-21T20:34:44.321Z------ -------------------- --------------- -------- ---------------
3002026-04-21T20:34:44.321Zigb0 10.151.2.1 255.255.255.255 aa:00:04:00:ca:fe
3012026-04-21T20:34:44.321Zigb0 10.151.2.100 255.255.255.255 SPLA 18:c0:4d:0d:a0:2a
3022026-04-21T20:34:44.321Z+ pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state
3032026-04-21T20:34:44.321Zzlogin: zone 'sidecar_softnpu' unknown
3042026-04-21T20:34:44.321Z+ pfexec /opt/oxide/opte/bin/opteadm list-ports
3052026-04-21T20:34:44.346ZLINK MAC ADDRESS IPv4 ADDRESS EPHEMERAL IPv4 FLOATING IPv4 IPv6 ADDRESS EXTERNAL IPv6 FLOATING IPv6 STATE
3062026-04-21T20:34:44.346Z+ pfexec /opt/oxide/opte/bin/opteadm dump-v2b
3072026-04-21T20:34:44.347ZVirtual to Boundary Mappings
3082026-04-21T20:34:44.347Z======================================================================
3092026-04-21T20:34:44.347Z
3102026-04-21T20:34:44.347ZIPv4 mappings
3112026-04-21T20:34:44.347Z----------------------------------------------------------------------
3122026-04-21T20:34:44.347ZTUNNELED PREFIX BOUNDARY IP VNI
3132026-04-21T20:34:44.347Z
3142026-04-21T20:34:44.347ZIPv6 mappings
3152026-04-21T20:34:44.347Z----------------------------------------------------------------------
3162026-04-21T20:34:44.347ZTUNNELED PREFIX BOUNDARY IP VNI
3172026-04-21T20:34:44.347Z
3182026-04-21T20:34:44.347Z+ pfexec /opt/oxide/opte/bin/opteadm dump-v2p
3192026-04-21T20:34:44.347ZVirtual to Physical Mappings
3202026-04-21T20:34:44.347Z======================================================================
3212026-04-21T20:34:44.347Z+ z_swadm link ls
3222026-04-21T20:34:44.347Z+ echo '== swadm link' ls
3232026-04-21T20:34:44.347Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm link ls
3242026-04-21T20:34:44.347Z== swadm link ls
3252026-04-21T20:34:44.347Zzlogin: zone 'oxz_switch' unknown
3262026-04-21T20:34:44.347Z+ z_swadm addr list
3272026-04-21T20:34:44.347Z+ echo '== swadm addr' list
3282026-04-21T20:34:44.347Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm addr list
3292026-04-21T20:34:44.347Z== swadm addr list
3302026-04-21T20:34:44.347Z== swadm route list
3312026-04-21T20:34:44.347Zzlogin: zone 'oxz_switch' unknown
3322026-04-21T20:34:44.347Z+ z_swadm route list
3332026-04-21T20:34:44.347Z+ echo '== swadm route' list
3342026-04-21T20:34:44.347Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm route list
3352026-04-21T20:34:44.347Zzlogin: zone 'oxz_switch' unknown
3362026-04-21T20:34:44.347Z+ z_swadm arp list
3372026-04-21T20:34:44.347Z+ echo '== swadm arp' list
3382026-04-21T20:34:44.347Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm arp list
3392026-04-21T20:34:44.373Z== swadm arp list
3402026-04-21T20:34:44.373Zzlogin: zone 'oxz_switch' unknown
3412026-04-21T20:34:44.373Z+ z_swadm nat list
3422026-04-21T20:34:44.373Z+ echo '== swadm nat' list
3432026-04-21T20:34:44.373Z+ pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm nat list
3442026-04-21T20:34:44.373Z== swadm nat list
3452026-04-21T20:34:44.373Zzlogin: zone 'oxz_switch' unknown
3462026-04-21T20:34:44.373Z++ pfexec /opt/oxide/opte/bin/opteadm list-ports
3472026-04-21T20:34:44.373Z++ tail +2
3482026-04-21T20:34:44.373Z++ awk '{ print $1; }'
3492026-04-21T20:34:44.373Z+ PORTS=
3502026-04-21T20:34:44.373Z+ mkdir -p /tmp/kstat
3512026-04-21T20:34:44.373Z+ pfexec kstat -p xde:
3522026-04-21T20:34:44.373Z+ pfexec zfs list
3532026-04-21T20:34:44.398ZNAME USED AVAIL REFER MOUNTPOINT
3542026-04-21T20:34:44.398Zrpool 2.24G 5.03G 24K /rpool
3552026-04-21T20:34:44.398Zrpool/home 25.5K 5.03G 25.5K /home
3562026-04-21T20:34:44.398Zrpool/input 2.24G 5.03G 2.24G /input
3572026-04-21T20:34:44.398Zrpool/work 24K 5.03G 24K /work
3582026-04-21T20:34:44.398Zrpool/zone 24K 5.03G 24K /zone
3592026-04-21T20:34:44.398Z+ pfexec zpool list
3602026-04-21T20:34:44.398ZNAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
3612026-04-21T20:34:44.399Zrpool 7.50G 2.24G 5.26G - - 0% 29% 1.00x ONLINE -
3622026-04-21T20:34:44.399Z+ pfexec fmdump -eVp
3632026-04-21T20:34:44.424ZTIME CLASS
3642026-04-21T20:34:44.424ZApr 21 2026 20:26:52.433086335 ereport.io.service.lost
3652026-04-21T20:34:44.424Znvlist version: 0
3662026-04-21T20:34:44.424Z class = ereport.io.service.lost
3672026-04-21T20:34:44.424Z ena = 0x91f84d884208801
3682026-04-21T20:34:44.424Z detector = dev:////pci@0,0/pci1022,1483@3,4/pci1dee,1dee@0
3692026-04-21T20:34:44.426Z __ttl = 0x1
3702026-04-21T20:34:44.426Z __tod = 0x69e7dd8c 0x19d05f7f
3712026-04-21T20:34:44.426Z
3722026-04-21T20:34:44.426Z+ pfexec ptree -z global
3732026-04-21T20:34:44.426Z8 /lib/svc/bin/svc.startd
3742026-04-21T20:34:44.426Z 639 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat -
3752026-04-21T20:34:44.426Z 665 /usr/lib/saf/sac -t 300
3762026-04-21T20:34:44.426Z 673 /usr/lib/saf/ttymon
3772026-04-21T20:34:44.426Z 801 /usr/bin/ctrun -l child -o noorphan,regent /opt/buildomat/lib/agent ru
3782026-04-21T20:34:44.426Z 802 /opt/buildomat/lib/agent run
3792026-04-21T20:34:44.426Z 816 /bin/bash /tmp/rXlZyEc9iI7m1mP9.sh
3802026-04-21T20:34:44.426Z 881 ptree -z global
3812026-04-21T20:34:44.426Z10 /lib/svc/bin/svc.configd
3822026-04-21T20:34:44.426Z38 /sbin/dlmgmtd
3832026-04-21T20:34:44.426Z42 /lib/inet/ipmgmtd
3842026-04-21T20:34:44.426Z45 /lib/inet/netcfgd
3852026-04-21T20:34:44.426Z66 /lib/inet/in.mpathd
3862026-04-21T20:34:44.426Z95 /usr/lib/pfexecd
3872026-04-21T20:34:44.426Z141 /usr/lib/sysevent/syseventd
3882026-04-21T20:34:44.426Z145 devfsadmd
3892026-04-21T20:34:44.426Z161 /usr/lib/zones/zonestatd
3902026-04-21T20:34:44.426Z230 /sbin/dhcpagent
3912026-04-21T20:34:44.427Z564 /usr/lib/picl/picld
3922026-04-21T20:34:44.427Z597 /usr/sbin/nscd
3932026-04-21T20:34:44.427Z638 /usr/lib/utmpd
3942026-04-21T20:34:44.427Z678 /usr/lib/hotplugd
3952026-04-21T20:34:44.427Z685 /usr/sbin/syslogd
3962026-04-21T20:34:44.427Z709 /usr/sbin/rpcbind
3972026-04-21T20:34:44.427Z721 /usr/lib/inet/in.ndpd
3982026-04-21T20:34:44.427Z722 /usr/lib/fm/fmd/fmd
3992026-04-21T20:34:44.427Z757 /usr/lib/inet/inetd start
4002026-04-21T20:34:44.427Z784 /usr/perl5/bin/perl /usr/lib/intrd
4012026-04-21T20:34:44.427Z853 /usr/lib/rcm/rcm_daemon
4022026-04-21T20:34:44.427Z+ pfexec svcs -xv
4032026-04-21T20:34:44.490Z++ zoneadm list -n
4042026-04-21T20:34:44.516Z++ zoneadm list -n
4052026-04-21T20:34:44.516Z++ grep oxz_ntp
4062026-04-21T20:34:44.516Z+ pfexec zlogin sidecar_softnpu cat /var/log/softnpu.log
4072026-04-21T20:34:44.516Zzlogin: zone 'sidecar_softnpu' unknown
4082026-04-21T20:34:44.516Z+ exit 1
4092026-04-21T20:34:44.516Zprocess exited: duration 22341 ms, exit code 1
 
4102026-04-21T20:34:44.566Zfound 1 output files
4112026-04-21T20:34:44.566Zuploading: /tmp/kstat/xde.kstat (1005 bytes)
4122026-04-21T20:34:45.665Zuploaded: /tmp/kstat/xde.kstat