|
|
|
| 1 | 2026-04-21T20:24:18.618Z | job dependencies complete; ready to run (waiting for 18 m 34 s) |
| 2 | 2026-04-21T20:27:09.383Z | job assigned to worker 01KPRVEBR2ADZABE5GFEZB0NFH [factory lab, sock/16690] (queued for 2 m 50 s) |
| 3 | 2026-04-21T20:27:09.701Z | http://172.20.0.5:9969/ipxe/sock... ok |
| 4 | 2026-04-21T20:27:09.738Z | http://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok |
| 5 | 2026-04-21T20:27:09.771Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok |
| 6 | 2026-04-21T20:27:09.806Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok |
| 7 | 2026-04-21T20:27:09.871Z | http://172.20.0.5:9969/postboot/sock... ok |
| 8 | 2026-04-21T20:27:09.905Z | wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U |
| 9 | 2026-04-21T20:27:09.938Z | WARNING: cpu0: failed to update microcode from version 0xa001133 to 0xa0011de |
| 10 | 2026-04-21T20:27:09.982Z | WARNING: cpu0: using older fallback microcode; update the system firmware |
| 11 | 2026-04-21T20:27:10.017Z | cpu0: microcode has been updated from version 0xa001133 to 0xa0011d5 |
| 12 | 2026-04-21T20:27:10.050Z | Oxide Helios Version helios-2.0.23894 64-bit |
| 13 | 2026-04-21T20:27:10.083Z | Configuring devices. |
| 14 | 2026-04-21T20:27:10.116Z | ################################################## |
| 15 | 2026-04-21T20:27:10.152Z | #### ############# ## |
| 16 | 2026-04-21T20:27:10.228Z | ### ### ############ ## |
| 17 | 2026-04-21T20:27:10.261Z | ## ### # ## ### ## Oxide Computer Company ## |
| 18 | 2026-04-21T20:27:10.295Z | ## ## ## ### # ### ## |
| 19 | 2026-04-21T20:27:10.329Z | ## # ### #### #### This Station Under ## |
| 20 | 2026-04-21T20:27:10.362Z | ### ### #### # ### Computer Control ## |
| 21 | 2026-04-21T20:27:10.395Z | #### #### ### ## ## |
| 22 | 2026-04-21T20:27:10.428Z | ################################################## |
| 23 | 2026-04-21T20:27:10.462Z | Hostname: sock |
| 24 | 2026-04-21T20:27:10.495Z | Loading smf(7) service descriptions: |
| 25 | 2026-04-21T20:27:11.041Z | downloading input: /input/package/work/package.tar.gz |
| 26 | 2026-04-21T20:27:23.077Z | sock console login: |
| 27 | 2026-04-21T20:27:23.112Z | SUNW-MSG-ID: PCIEX-8000-0A, TYPE: Fault, VER: 1, SEVERITY: Critical |
| 28 | 2026-04-21T20:27:23.145Z | EVENT-TIME: Tue Apr 21 20:27:22 UTC 2026 |
| 29 | 2026-04-21T20:27:23.179Z | PLATFORM: R152-Z32-00, CSN: GKG8N7212A0003, HOSTNAME: sock |
| 30 | 2026-04-21T20:27:23.213Z | SOURCE: eft, REV: 1.16 |
| 31 | 2026-04-21T20:27:23.257Z | EVENT-ID: 64e5a537-e3cb-432d-a37a-2c8cbb6c4fa2 |
| 32 | 2026-04-21T20:27:23.335Z | DESC: A problem was detected for a PCIEX device. |
| 33 | 2026-04-21T20:27:23.368Z | Refer to http://illumos.org/msg/PCIEX-8000-0A for more information. |
| 34 | 2026-04-21T20:27:23.402Z | AUTO-RESPONSE: One or more device instances may be disabled |
| 35 | 2026-04-21T20:27:23.435Z | IMPACT: Loss of services provided by the device instances associated with this fault |
| 36 | 2026-04-21T20:27:23.469Z | REC-ACTION: Schedule a repair procedure to replace the affected device. Use fmadm faulty to identify the device or contact your illumos distribution team for support. |
| 37 | 2026-04-21T20:34:17.954Z | downloaded input: /input/package/work/package.tar.gz |
| |
| 38 | 2026-04-21T20:34:17.979Z | starting task 0: "setup" |
| 39 | 2026-04-21T20:34:17.979Z | ++ uname -s |
| 40 | 2026-04-21T20:34:17.979Z | + kern=SunOS |
| 41 | 2026-04-21T20:34:17.979Z | + build_user=build |
| 42 | 2026-04-21T20:34:17.979Z | + build_uid=12345 |
| 43 | 2026-04-21T20:34:17.979Z | + work_dir=/work |
| 44 | 2026-04-21T20:34:17.979Z | + input_dir=/input |
| 45 | 2026-04-21T20:34:17.979Z | + [[ 0 == 12345 ]] |
| 46 | 2026-04-21T20:34:17.979Z | + case "$kern" in |
| 47 | 2026-04-21T20:34:17.980Z | + groupadd -g 12345 build |
| 48 | 2026-04-21T20:34:17.980Z | + useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build |
| 49 | 2026-04-21T20:34:19.973Z | + zfs create -o mountpoint=/work rpool/work |
| 50 | 2026-04-21T20:34:19.997Z | ++ awk '$2 == "/home" { print $3 }' /etc/mnttab |
| 51 | 2026-04-21T20:34:19.997Z | + home_fs=zfs |
| 52 | 2026-04-21T20:34:19.997Z | + [[ zfs == autofs ]] |
| 53 | 2026-04-21T20:34:19.997Z | + mkdir -p /home/build |
| 54 | 2026-04-21T20:34:19.997Z | + chown build:build /home/build /work |
| 55 | 2026-04-21T20:34:21.999Z | + chmod 0700 /home/build /work |
| 56 | 2026-04-21T20:34:22.024Z | process exited: duration 4047 ms, exit code 0 |
| |
| 57 | 2026-04-21T20:34:22.073Z | starting task 1: "authentication" |
| 58 | 2026-04-21T20:34:22.118Z | process exited: duration 44 ms, exit code 0 |
| |
| 59 | 2026-04-21T20:34:22.168Z | starting task 2: "build" |
| 60 | 2026-04-21T20:34:22.192Z | + trap _exit_trap EXIT |
| 61 | 2026-04-21T20:34:22.193Z | + OPTE_COMMIT= |
| 62 | 2026-04-21T20:34:22.193Z | + [[ x != \x ]] |
| 63 | 2026-04-21T20:34:22.193Z | + pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3' |
| 64 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir: 0x55 = 0x55 |
| 65 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+1: 0xb8 = 0x48 |
| 66 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+2: 0x1 = 0x89 |
| 67 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+3: 0 = 0xe5 |
| 68 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+4: 0 = 0xb8 |
| 69 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+5: 0 = 0x1 |
| 70 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+6: 0x48 = 0x0 |
| 71 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+7: 0x89 = 0x0 |
| 72 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+8: 0xe5 = 0x0 |
| 73 | 2026-04-21T20:34:22.284Z | secpolicy_fs_linkdir+9: 0x48 = 0x5d |
| 74 | 2026-04-21T20:34:22.285Z | secpolicy_fs_linkdir+0xa: 0x83 = 0xc3 |
| 75 | 2026-04-21T20:34:22.309Z | + [[ -d /opt/oxide ]] |
| 76 | 2026-04-21T20:34:22.309Z | + pfexec mv /opt/oxide /opt/oxide-underneath |
| 77 | 2026-04-21T20:34:22.310Z | + pfexec mkdir /opt/oxide |
| 78 | 2026-04-21T20:34:22.310Z | + pfexec mount -F tmpfs -O swap /opt/oxide |
| 79 | 2026-04-21T20:34:22.310Z | + [[ -d /opt/oxide-underneath ]] |
| 80 | 2026-04-21T20:34:22.310Z | + cd /opt/oxide-underneath |
| 81 | 2026-04-21T20:34:22.310Z | + pfexec tar ceEp@/f - . |
| 82 | 2026-04-21T20:34:22.310Z | + cd /opt/oxide |
| 83 | 2026-04-21T20:34:22.310Z | + pfexec tar xveEp@/f - |
| 84 | 2026-04-21T20:34:22.359Z | x ., 0 bytes, 0 tape blocks |
| 85 | 2026-04-21T20:34:22.359Z | x ./opte, 0 bytes, 0 tape blocks |
| 86 | 2026-04-21T20:34:22.359Z | x ./opte/bin, 0 bytes, 0 tape blocks |
| 87 | 2026-04-21T20:34:22.359Z | x ./opte/bin/opteadm, 24311432 bytes, 47484 tape blocks |
| 88 | 2026-04-21T20:34:22.384Z | + pfexec rm -rf /opt/oxide-underneath |
| 89 | 2026-04-21T20:34:22.384Z | + pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone |
| 90 | 2026-04-21T20:34:22.408Z | + pfexec mkdir /opt/oxide/work |
| 91 | 2026-04-21T20:34:22.408Z | + pfexec chown build:build /opt/oxide/work |
| 92 | 2026-04-21T20:34:22.408Z | + cd /opt/oxide/work |
| 93 | 2026-04-21T20:34:22.408Z | + ptime -m tar xvzf /input/package/work/package.tar.gz |
| 94 | 2026-04-21T20:34:44.025Z | Decompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'... |
| 95 | 2026-04-21T20:34:44.025Z | x .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks |
| 96 | 2026-04-21T20:34:44.025Z | x out/target/test, 107 bytes, 1 tape blocks |
| 97 | 2026-04-21T20:34:44.025Z | x out/npuzone/npuzone, 28059200 bytes, 54804 tape blocks |
| 98 | 2026-04-21T20:34:44.025Z | x package-manifest.toml, 35397 bytes, 70 tape blocks |
| 99 | 2026-04-21T20:34:44.025Z | x smf/sled-agent/non-gimlet/config.toml, 5328 bytes, 11 tape blocks |
| 100 | 2026-04-21T20:34:44.025Z | x target/release/omicron-package, 47008384 bytes, 91814 tape blocks |
| 101 | 2026-04-21T20:34:44.025Z | x target/release/xtask, 11720632 bytes, 22892 tape blocks |
| 102 | 2026-04-21T20:34:44.025Z | x target/debug/bootstrap, 349170200 bytes, 681974 tape blocks |
| 103 | 2026-04-21T20:34:44.025Z | x tests/bootstrap-2591d64deb37c086, 32061200 bytes, 62620 tape blocks |
| 104 | 2026-04-21T20:34:44.025Z | x tests/commtest-4942e29ae4ca8837, 33172136 bytes, 64790 tape blocks |
| 105 | 2026-04-21T20:34:44.025Z | x tests/dhcp_server-b1bc68e80128657d, 32061200 bytes, 62620 tape blocks |
| 106 | 2026-04-21T20:34:44.025Z | x tests/end_to_end_tests-ec2fae9151184196, 392569752 bytes, 766738 tape blocks |
| 107 | 2026-04-21T20:34:44.025Z | x out/clickhouse.tar.gz, 320527973 bytes, 626032 tape blocks |
| 108 | 2026-04-21T20:34:44.025Z | x out/clickhouse_keeper.tar.gz, 305672255 bytes, 597017 tape blocks |
| 109 | 2026-04-21T20:34:44.025Z | x out/clickhouse_server.tar.gz, 320526808 bytes, 626029 tape blocks |
| 110 | 2026-04-21T20:34:44.025Z | x out/cockroachdb.tar.gz, 165081611 bytes, 322426 tape blocks |
| 111 | 2026-04-21T20:34:44.025Z | x out/crucible-pantry-zone.tar.gz, 45112963 bytes, 88112 tape blocks |
| 112 | 2026-04-21T20:34:44.025Z | x out/crucible-utils.tar, 18169344 bytes, 35487 tape blocks |
| 113 | 2026-04-21T20:34:44.025Z | x out/crucible-zone.tar.gz, 59590351 bytes, 116388 tape blocks |
| 114 | 2026-04-21T20:34:44.025Z | x out/external-dns.tar.gz, 50056996 bytes, 97768 tape blocks |
| 115 | 2026-04-21T20:34:44.025Z | x out/internal-dns.tar.gz, 50056594 bytes, 97767 tape blocks |
| 116 | 2026-04-21T20:34:44.025Z | x out/mg-ddm-gz.tar, 97423872 bytes, 190281 tape blocks |
| 117 | 2026-04-21T20:34:44.025Z | x out/nexus.tar.gz, 224835768 bytes, 439133 tape blocks |
| 118 | 2026-04-21T20:34:44.025Z | x out/ntp.tar.gz, 32665811 bytes, 63801 tape blocks |
| 119 | 2026-04-21T20:34:44.025Z | x out/omicron-gateway-softnpu.tar.gz, 29037558 bytes, 56714 tape blocks |
| 120 | 2026-04-21T20:34:44.025Z | x out/omicron-sled-agent.tar, 205493248 bytes, 401354 tape blocks |
| 121 | 2026-04-21T20:34:44.025Z | x out/overlay.tar.gz, 3030 bytes, 6 tape blocks |
| 122 | 2026-04-21T20:34:44.025Z | x out/oximeter.tar.gz, 64971723 bytes, 126898 tape blocks |
| 123 | 2026-04-21T20:34:44.025Z | x out/oxlog.tar, 3872256 bytes, 7563 tape blocks |
| 124 | 2026-04-21T20:34:44.026Z | x out/probe.tar.gz, 3109568 bytes, 6074 tape blocks |
| 125 | 2026-04-21T20:34:44.026Z | x out/propolis-server.tar.gz, 39656396 bytes, 77454 tape blocks |
| 126 | 2026-04-21T20:34:44.026Z | x out/pumpkind-gz.tar, 27286528 bytes, 53294 tape blocks |
| 127 | 2026-04-21T20:34:44.026Z | x out/switch-softnpu.tar.gz, 400378062 bytes, 781989 tape blocks |
| 128 | 2026-04-21T20:34:44.051Z | |
| 129 | 2026-04-21T20:34:44.051Z | real 21.609580468 |
| 130 | 2026-04-21T20:34:44.051Z | user 19.313395425 |
| 131 | 2026-04-21T20:34:44.051Z | sys 3.878851931 |
| 132 | 2026-04-21T20:34:44.051Z | trap 0.000934766 |
| 133 | 2026-04-21T20:34:44.051Z | tflt 0.000000000 |
| 134 | 2026-04-21T20:34:44.051Z | dflt 0.000000000 |
| 135 | 2026-04-21T20:34:44.051Z | kflt 0.000000000 |
| 136 | 2026-04-21T20:34:44.051Z | lock 0.000000000 |
| 137 | 2026-04-21T20:34:44.052Z | slp 19.451606600 |
| 138 | 2026-04-21T20:34:44.052Z | lat 0.572391389 |
| 139 | 2026-04-21T20:34:44.052Z | stop 0.000130923 |
| 140 | 2026-04-21T20:34:44.052Z | + source .github/buildomat/ci-env.sh |
| 141 | 2026-04-21T20:34:44.052Z | ++ export CARGO_TERM_COLOR=always |
| 142 | 2026-04-21T20:34:44.052Z | ++ CARGO_TERM_COLOR=always |
| 143 | 2026-04-21T20:34:44.052Z | + bmat address ls |
| 144 | 2026-04-21T20:34:44.052Z | NAME CIDR FIRST LAST COUNT |
| 145 | 2026-04-21T20:34:44.052Z | extra 10.151.2.0/24 10.151.2.164 10.151.2.227 64 |
| 146 | 2026-04-21T20:34:44.052Z | ++ bmat address ls -f extra -Ho first,last,count |
| 147 | 2026-04-21T20:34:44.052Z | + set -- 10.151.2.164 10.151.2.227 64 |
| 148 | 2026-04-21T20:34:44.052Z | + EXTRA_IP_START=10.151.2.164 |
| 149 | 2026-04-21T20:34:44.052Z | + EXTRA_IP_END=10.151.2.227 |
| 150 | 2026-04-21T20:34:44.052Z | + EXTRA_IP_COUNT=64 |
| 151 | 2026-04-21T20:34:44.052Z | + (( EXTRA_IP_COUNT >= 32 )) |
| 152 | 2026-04-21T20:34:44.052Z | + EXTRA_IP_BASE=10.151.2 |
| 153 | 2026-04-21T20:34:44.052Z | + EXTRA_IP_FOCTET=164 |
| 154 | 2026-04-21T20:34:44.052Z | + EXTRA_IP_LOCTET=227 |
| 155 | 2026-04-21T20:34:44.052Z | + SERVICE_IP_POOL_START=10.151.2.164 |
| 156 | 2026-04-21T20:34:44.052Z | + SERVICE_IP_POOL_END=10.151.2.173 |
| 157 | 2026-04-21T20:34:44.052Z | + DNS_IP1=10.151.2.164 |
| 158 | 2026-04-21T20:34:44.052Z | + DNS_IP2=10.151.2.165 |
| 159 | 2026-04-21T20:34:44.052Z | + UPLINK_IP=10.151.2.174 |
| 160 | 2026-04-21T20:34:44.052Z | + IPPOOL_START=10.151.2.175 |
| 161 | 2026-04-21T20:34:44.052Z | + IPPOOL_END=10.151.2.227 |
| 162 | 2026-04-21T20:34:44.052Z | ++ ipadm show-addr -po type,addr |
| 163 | 2026-04-21T20:34:44.052Z | ++ awk '-F[:/]' '$1 == "dhcp" {print $2}' |
| 164 | 2026-04-21T20:34:44.052Z | + GATEWAY_IP=10.151.2.100 |
| 165 | 2026-04-21T20:34:44.052Z | + [[ -n 10.151.2.100 ]] |
| 166 | 2026-04-21T20:34:44.052Z | + ping -s 10.151.2.100 56 1 |
| 167 | 2026-04-21T20:34:44.052Z | PING 10.151.2.100: 56 data bytes |
| 168 | 2026-04-21T20:34:44.052Z | 64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms |
| 169 | 2026-04-21T20:34:44.052Z | |
| 170 | 2026-04-21T20:34:44.052Z | ----10.151.2.100 PING Statistics---- |
| 171 | 2026-04-21T20:34:44.052Z | 1 packets transmitted, 1 packets received, 0% packet loss |
| 172 | 2026-04-21T20:34:44.052Z | round-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan |
| 173 | 2026-04-21T20:34:44.052Z | ++ arp -an |
| 174 | 2026-04-21T20:34:44.052Z | ++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}' |
| 175 | 2026-04-21T20:34:44.053Z | + GATEWAY_MAC=18:c0:4d:0d:a0:2a |
| 176 | 2026-04-21T20:34:44.053Z | + routeadm -e ipv4-forwarding -u |
| 177 | 2026-04-21T20:34:44.154Z | + PXA_START=10.151.2.164 |
| 178 | 2026-04-21T20:34:44.154Z | + PXA_END=10.151.2.227 |
| 179 | 2026-04-21T20:34:44.154Z | + pfexec zpool create -f scratch c1t1d0 c2t1d0 |
| 180 | 2026-04-21T20:34:44.178Z | cannot open 'c2t1d0': no such device in /dev/dsk |
| 181 | 2026-04-21T20:34:44.178Z | must be a full path or shorthand device name |
| 182 | 2026-04-21T20:34:44.179Z | + _exit_trap |
| 183 | 2026-04-21T20:34:44.179Z | + local status=1 |
| 184 | 2026-04-21T20:34:44.179Z | + set +o errexit |
| 185 | 2026-04-21T20:34:44.179Z | + [[ x != \x ]] |
| 186 | 2026-04-21T20:34:44.179Z | + pfexec svcadm -Z disable -s cron |
| 187 | 2026-04-21T20:34:44.203Z | + [[ 1 -eq 0 ]] |
| 188 | 2026-04-21T20:34:44.203Z | + set -o xtrace |
| 189 | 2026-04-21T20:34:44.204Z | + banner evidence |
| 190 | 2026-04-21T20:34:44.204Z | |
| 191 | 2026-04-21T20:34:44.204Z | ###### # # # ##### ###### # # #### ###### |
| 192 | 2026-04-21T20:34:44.204Z | # # # # # # # ## # # # # |
| 193 | 2026-04-21T20:34:44.204Z | ##### # # # # # ##### # # # # ##### |
| 194 | 2026-04-21T20:34:44.204Z | # # # # # # # # # # # # |
| 195 | 2026-04-21T20:34:44.204Z | # # # # # # # # ## # # # |
| 196 | 2026-04-21T20:34:44.204Z | ###### ## # ##### ###### # # #### ###### |
| 197 | 2026-04-21T20:34:44.204Z | |
| 198 | 2026-04-21T20:34:44.204Z | + zoneadm list -civ |
| 199 | 2026-04-21T20:34:44.204Z | ID NAME STATUS PATH BRAND IP |
| 200 | 2026-04-21T20:34:44.204Z | 0 global running / ipkg shared |
| 201 | 2026-04-21T20:34:44.204Z | + pfexec dladm show-phys -m |
| 202 | 2026-04-21T20:34:44.204Z | LINK SLOT ADDRESS INUSE CLIENT |
| 203 | 2026-04-21T20:34:44.204Z | igb0 primary 18:c0:4d:d:a0:2a yes igb0 |
| 204 | 2026-04-21T20:34:44.265Z | igb1 primary 18:c0:4d:d:a0:2b no -- |
| 205 | 2026-04-21T20:34:44.290Z | + pfexec dladm show-link |
| 206 | 2026-04-21T20:34:44.290Z | LINK CLASS MTU STATE BRIDGE OVER |
| 207 | 2026-04-21T20:34:44.290Z | igb0 phys 1500 up -- -- |
| 208 | 2026-04-21T20:34:44.290Z | igb1 phys 1500 unknown -- -- |
| 209 | 2026-04-21T20:34:44.290Z | + pfexec dladm show-vnic |
| 210 | 2026-04-21T20:34:44.290Z | + pfexec ipadm |
| 211 | 2026-04-21T20:34:44.290Z | ADDROBJ TYPE STATE ADDR |
| 212 | 2026-04-21T20:34:44.290Z | lo0/v4 static ok 127.0.0.1/8 |
| 213 | 2026-04-21T20:34:44.291Z | igb0/dhcp dhcp ok 10.151.2.100/24 |
| 214 | 2026-04-21T20:34:44.291Z | lo0/v6 static ok ::1/128 |
| 215 | 2026-04-21T20:34:44.291Z | + pfexec netstat -rncva |
| 216 | 2026-04-21T20:34:44.291Z | |
| 217 | 2026-04-21T20:34:44.291Z | IRE Table: IPv4 |
| 218 | 2026-04-21T20:34:44.291Z | Destination Mask Gateway Device MTU Ref Flg Out In/Fwd |
| 219 | 2026-04-21T20:34:44.291Z | -------------------- --------------- -------------------- ------ ----- --- --- ------ ------ |
| 220 | 2026-04-21T20:34:44.291Z | 0.0.0.0 255.255.255.255 -- igb0 1500 1 UHb 0 0 |
| 221 | 2026-04-21T20:34:44.291Z | default 0.0.0.0 10.151.2.1 igb0 1500 4 UG 892843 0 |
| 222 | 2026-04-21T20:34:44.291Z | 10.0.0.0 255.255.255.255 -- igb0 1500 1 UHb 0 0 |
| 223 | 2026-04-21T20:34:44.291Z | 10.151.2.0 255.255.255.255 -- igb0 1500 1 UHb 0 0 |
| 224 | 2026-04-21T20:34:44.291Z | 10.151.2.0/24 255.255.255.0 10.151.2.100 igb0 1500 3 U 0 0 |
| 225 | 2026-04-21T20:34:44.291Z | 10.151.2.1/32 255.255.255.255 10.151.2.100 igb0 1500 3 UC 0 0 |
| 226 | 2026-04-21T20:34:44.291Z | 10.151.2.100 255.255.255.255 -- igb0 1500 2 UHL 2 1785145 |
| 227 | 2026-04-21T20:34:44.291Z | 10.151.2.255 255.255.255.255 -- igb0 1500 1 UHb 0 0 |
| 228 | 2026-04-21T20:34:44.292Z | 10.255.255.255 255.255.255.255 -- igb0 1500 1 UHb 0 0 |
| 229 | 2026-04-21T20:34:44.292Z | 127.0.0.1 255.255.255.255 127.0.0.1 lo0 8232 2 UH 14 14 |
| 230 | 2026-04-21T20:34:44.292Z | 255.255.255.255 255.255.255.255 -- igb0 1500 1 UHb 0 1 |
| 231 | 2026-04-21T20:34:44.292Z | |
| 232 | 2026-04-21T20:34:44.292Z | IRE Table: IPv6 |
| 233 | 2026-04-21T20:34:44.292Z | Destination/Mask Gateway If MTU Ref Flags Out In/Fwd |
| 234 | 2026-04-21T20:34:44.292Z | --------------------------- --------------------------- ----- ----- --- ----- ------ ------ |
| 235 | 2026-04-21T20:34:44.292Z | ::1 ::1 lo0 8252 2 UH 0 0 |
| 236 | 2026-04-21T20:34:44.292Z | + pfexec netstat -anu |
| 237 | 2026-04-21T20:34:44.318Z | |
| 238 | 2026-04-21T20:34:44.318Z | UDP: IPv4 |
| 239 | 2026-04-21T20:34:44.318Z | Local Address Remote Address User Pid Command State |
| 240 | 2026-04-21T20:34:44.318Z | -------------------- -------------------- -------- ------ -------------- ---------- |
| 241 | 2026-04-21T20:34:44.318Z | *.* root 66 in.mpathd Unbound |
| 242 | 2026-04-21T20:34:44.318Z | *.* root 66 in.mpathd Unbound |
| 243 | 2026-04-21T20:34:44.318Z | *.68 root 230 dhcpagent Idle |
| 244 | 2026-04-21T20:34:44.318Z | *.546 root 230 dhcpagent Idle |
| 245 | 2026-04-21T20:34:44.318Z | 10.151.2.100.68 root 230 dhcpagent Idle |
| 246 | 2026-04-21T20:34:44.318Z | *.111 daemon 709 rpcbind Idle |
| 247 | 2026-04-21T20:34:44.318Z | *.* daemon 709 rpcbind Unbound |
| 248 | 2026-04-21T20:34:44.318Z | *.64295 daemon 709 rpcbind Idle |
| 249 | 2026-04-21T20:34:44.318Z | *.111 daemon 709 rpcbind Idle |
| 250 | 2026-04-21T20:34:44.318Z | *.* daemon 709 rpcbind Unbound |
| 251 | 2026-04-21T20:34:44.318Z | *.36480 daemon 709 rpcbind Idle |
| 252 | 2026-04-21T20:34:44.318Z | *.* root 721 in.ndpd Unbound |
| 253 | 2026-04-21T20:34:44.318Z | *.* root 853 rcm_daemon Unbound |
| 254 | 2026-04-21T20:34:44.318Z | *.* root 853 rcm_daemon Unbound |
| 255 | 2026-04-21T20:34:44.318Z | |
| 256 | 2026-04-21T20:34:44.318Z | UDP: IPv6 |
| 257 | 2026-04-21T20:34:44.318Z | Local Address Remote Address User Pid Command State If |
| 258 | 2026-04-21T20:34:44.318Z | --------------------------------- --------------------------------- -------- ------ -------------- ---------- ----- |
| 259 | 2026-04-21T20:34:44.318Z | *.* root 66 in.mpathd Unbound |
| 260 | 2026-04-21T20:34:44.318Z | *.546 root 230 dhcpagent Idle |
| 261 | 2026-04-21T20:34:44.318Z | *.111 daemon 709 rpcbind Idle |
| 262 | 2026-04-21T20:34:44.318Z | *.* daemon 709 rpcbind Unbound |
| 263 | 2026-04-21T20:34:44.319Z | *.64295 daemon 709 rpcbind Idle |
| 264 | 2026-04-21T20:34:44.319Z | *.* root 721 in.ndpd Unbound |
| 265 | 2026-04-21T20:34:44.319Z | *.* root 853 rcm_daemon Unbound |
| 266 | 2026-04-21T20:34:44.319Z | |
| 267 | 2026-04-21T20:34:44.319Z | TCP: IPv4 |
| 268 | 2026-04-21T20:34:44.319Z | Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State |
| 269 | 2026-04-21T20:34:44.319Z | -------------------- -------------------- -------- ------ -------------- ------ ------ ------ ------ ----------- |
| 270 | 2026-04-21T20:34:44.319Z | 127.0.0.1.5999 *.* root 66 in.mpathd 0 0 128000 0 LISTEN |
| 271 | 2026-04-21T20:34:44.320Z | 127.0.0.1.4999 *.* root 230 dhcpagent 0 0 128000 0 LISTEN |
| 272 | 2026-04-21T20:34:44.320Z | *.111 *.* daemon 709 rpcbind 0 0 128000 0 LISTEN |
| 273 | 2026-04-21T20:34:44.320Z | *.* *.* daemon 709 rpcbind 0 0 128000 0 IDLE |
| 274 | 2026-04-21T20:34:44.320Z | *.111 *.* daemon 709 rpcbind 0 0 128000 0 LISTEN |
| 275 | 2026-04-21T20:34:44.320Z | *.* *.* daemon 709 rpcbind 0 0 128000 0 IDLE |
| 276 | 2026-04-21T20:34:44.320Z | 10.151.2.100.65484 54.187.123.254.443 root 802 agent 1049792 0 128872 0 ESTABLISHED |
| 277 | 2026-04-21T20:34:44.320Z | 10.151.2.100.57293 54.187.123.254.443 root 802 agent 1049792 4878 128872 0 ESTABLISHED |
| 278 | 2026-04-21T20:34:44.320Z | |
| 279 | 2026-04-21T20:34:44.320Z | TCP: IPv6 |
| 280 | 2026-04-21T20:34:44.320Z | Local Address Remote Address User Pid Command Swind Send-Q Rwind Recv-Q State If |
| 281 | 2026-04-21T20:34:44.320Z | --------------------------------- --------------------------------- -------- ------ -------------- ------ ------ ------ ------ ----------- ----- |
| 282 | 2026-04-21T20:34:44.320Z | ::1.5999 *.* root 66 in.mpathd 0 0 128000 0 LISTEN |
| 283 | 2026-04-21T20:34:44.320Z | *.111 *.* daemon 709 rpcbind 0 0 128000 0 LISTEN |
| 284 | 2026-04-21T20:34:44.320Z | *.* *.* daemon 709 rpcbind 0 0 128000 0 IDLE |
| 285 | 2026-04-21T20:34:44.320Z | |
| 286 | 2026-04-21T20:34:44.321Z | Active UNIX domain sockets |
| 287 | 2026-04-21T20:34:44.321Z | Address Type User Pid Command Local Address Remote Address |
| 288 | 2026-04-21T20:34:44.321Z | ---------------- ---------- -------- ------ -------------- --------------------------------------- --------------------------------------- |
| 289 | 2026-04-21T20:34:44.321Z | fffffe8569cfd758 stream-ord root 802 agent /var/run/buildomat.sock |
| 290 | 2026-04-21T20:34:44.321Z | fffffe8569cfdaf8 stream-ord root 802 agent |
| 291 | 2026-04-21T20:34:44.321Z | fffffe8569cfdaf8 stream-ord root 802 agent |
| 292 | 2026-04-21T20:34:44.321Z | fffffe8586cfc010 stream-ord root 802 agent |
| 293 | 2026-04-21T20:34:44.321Z | fffffe8584426008 stream-ord root 757 inetd /var/run/.inetd.uds |
| 294 | 2026-04-21T20:34:44.321Z | fffffe85844263a8 dgram root 721 in.ndpd /var/run/in.ndpd_mib |
| 295 | 2026-04-21T20:34:44.321Z | fffffe8584426748 stream-ord root 721 in.ndpd /var/run/in.ndpd_ipadm |
| 296 | 2026-04-21T20:34:44.321Z | + pfexec arp -an |
| 297 | 2026-04-21T20:34:44.321Z | Net to Media Table: IPv4 |
| 298 | 2026-04-21T20:34:44.321Z | Device IP Address Mask Flags Phys Addr |
| 299 | 2026-04-21T20:34:44.321Z | ------ -------------------- --------------- -------- --------------- |
| 300 | 2026-04-21T20:34:44.321Z | igb0 10.151.2.1 255.255.255.255 aa:00:04:00:ca:fe |
| 301 | 2026-04-21T20:34:44.321Z | igb0 10.151.2.100 255.255.255.255 SPLA 18:c0:4d:0d:a0:2a |
| 302 | 2026-04-21T20:34:44.321Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
| 303 | 2026-04-21T20:34:44.321Z | zlogin: zone 'sidecar_softnpu' unknown |
| 304 | 2026-04-21T20:34:44.321Z | + pfexec /opt/oxide/opte/bin/opteadm list-ports |
| 305 | 2026-04-21T20:34:44.346Z | LINK MAC ADDRESS IPv4 ADDRESS EPHEMERAL IPv4 FLOATING IPv4 IPv6 ADDRESS EXTERNAL IPv6 FLOATING IPv6 STATE |
| 306 | 2026-04-21T20:34:44.346Z | + pfexec /opt/oxide/opte/bin/opteadm dump-v2b |
| 307 | 2026-04-21T20:34:44.347Z | Virtual to Boundary Mappings |
| 308 | 2026-04-21T20:34:44.347Z | ====================================================================== |
| 309 | 2026-04-21T20:34:44.347Z | |
| 310 | 2026-04-21T20:34:44.347Z | IPv4 mappings |
| 311 | 2026-04-21T20:34:44.347Z | ---------------------------------------------------------------------- |
| 312 | 2026-04-21T20:34:44.347Z | TUNNELED PREFIX BOUNDARY IP VNI |
| 313 | 2026-04-21T20:34:44.347Z | |
| 314 | 2026-04-21T20:34:44.347Z | IPv6 mappings |
| 315 | 2026-04-21T20:34:44.347Z | ---------------------------------------------------------------------- |
| 316 | 2026-04-21T20:34:44.347Z | TUNNELED PREFIX BOUNDARY IP VNI |
| 317 | 2026-04-21T20:34:44.347Z | |
| 318 | 2026-04-21T20:34:44.347Z | + pfexec /opt/oxide/opte/bin/opteadm dump-v2p |
| 319 | 2026-04-21T20:34:44.347Z | Virtual to Physical Mappings |
| 320 | 2026-04-21T20:34:44.347Z | ====================================================================== |
| 321 | 2026-04-21T20:34:44.347Z | + z_swadm link ls |
| 322 | 2026-04-21T20:34:44.347Z | + echo '== swadm link' ls |
| 323 | 2026-04-21T20:34:44.347Z | + pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm link ls |
| 324 | 2026-04-21T20:34:44.347Z | == swadm link ls |
| 325 | 2026-04-21T20:34:44.347Z | zlogin: zone 'oxz_switch' unknown |
| 326 | 2026-04-21T20:34:44.347Z | + z_swadm addr list |
| 327 | 2026-04-21T20:34:44.347Z | + echo '== swadm addr' list |
| 328 | 2026-04-21T20:34:44.347Z | + pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm addr list |
| 329 | 2026-04-21T20:34:44.347Z | == swadm addr list |
| 330 | 2026-04-21T20:34:44.347Z | == swadm route list |
| 331 | 2026-04-21T20:34:44.347Z | zlogin: zone 'oxz_switch' unknown |
| 332 | 2026-04-21T20:34:44.347Z | + z_swadm route list |
| 333 | 2026-04-21T20:34:44.347Z | + echo '== swadm route' list |
| 334 | 2026-04-21T20:34:44.347Z | + pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm route list |
| 335 | 2026-04-21T20:34:44.347Z | zlogin: zone 'oxz_switch' unknown |
| 336 | 2026-04-21T20:34:44.347Z | + z_swadm arp list |
| 337 | 2026-04-21T20:34:44.347Z | + echo '== swadm arp' list |
| 338 | 2026-04-21T20:34:44.347Z | + pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm arp list |
| 339 | 2026-04-21T20:34:44.373Z | == swadm arp list |
| 340 | 2026-04-21T20:34:44.373Z | zlogin: zone 'oxz_switch' unknown |
| 341 | 2026-04-21T20:34:44.373Z | + z_swadm nat list |
| 342 | 2026-04-21T20:34:44.373Z | + echo '== swadm nat' list |
| 343 | 2026-04-21T20:34:44.373Z | + pfexec zlogin oxz_switch /opt/oxide/dendrite/bin/swadm nat list |
| 344 | 2026-04-21T20:34:44.373Z | == swadm nat list |
| 345 | 2026-04-21T20:34:44.373Z | zlogin: zone 'oxz_switch' unknown |
| 346 | 2026-04-21T20:34:44.373Z | ++ pfexec /opt/oxide/opte/bin/opteadm list-ports |
| 347 | 2026-04-21T20:34:44.373Z | ++ tail +2 |
| 348 | 2026-04-21T20:34:44.373Z | ++ awk '{ print $1; }' |
| 349 | 2026-04-21T20:34:44.373Z | + PORTS= |
| 350 | 2026-04-21T20:34:44.373Z | + mkdir -p /tmp/kstat |
| 351 | 2026-04-21T20:34:44.373Z | + pfexec kstat -p xde: |
| 352 | 2026-04-21T20:34:44.373Z | + pfexec zfs list |
| 353 | 2026-04-21T20:34:44.398Z | NAME USED AVAIL REFER MOUNTPOINT |
| 354 | 2026-04-21T20:34:44.398Z | rpool 2.24G 5.03G 24K /rpool |
| 355 | 2026-04-21T20:34:44.398Z | rpool/home 25.5K 5.03G 25.5K /home |
| 356 | 2026-04-21T20:34:44.398Z | rpool/input 2.24G 5.03G 2.24G /input |
| 357 | 2026-04-21T20:34:44.398Z | rpool/work 24K 5.03G 24K /work |
| 358 | 2026-04-21T20:34:44.398Z | rpool/zone 24K 5.03G 24K /zone |
| 359 | 2026-04-21T20:34:44.398Z | + pfexec zpool list |
| 360 | 2026-04-21T20:34:44.398Z | NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT |
| 361 | 2026-04-21T20:34:44.399Z | rpool 7.50G 2.24G 5.26G - - 0% 29% 1.00x ONLINE - |
| 362 | 2026-04-21T20:34:44.399Z | + pfexec fmdump -eVp |
| 363 | 2026-04-21T20:34:44.424Z | TIME CLASS |
| 364 | 2026-04-21T20:34:44.424Z | Apr 21 2026 20:26:52.433086335 ereport.io.service.lost |
| 365 | 2026-04-21T20:34:44.424Z | nvlist version: 0 |
| 366 | 2026-04-21T20:34:44.424Z | class = ereport.io.service.lost |
| 367 | 2026-04-21T20:34:44.424Z | ena = 0x91f84d884208801 |
| 368 | 2026-04-21T20:34:44.424Z | detector = dev:////pci@0,0/pci1022,1483@3,4/pci1dee,1dee@0 |
| 369 | 2026-04-21T20:34:44.426Z | __ttl = 0x1 |
| 370 | 2026-04-21T20:34:44.426Z | __tod = 0x69e7dd8c 0x19d05f7f |
| 371 | 2026-04-21T20:34:44.426Z | |
| 372 | 2026-04-21T20:34:44.426Z | + pfexec ptree -z global |
| 373 | 2026-04-21T20:34:44.426Z | 8 /lib/svc/bin/svc.startd |
| 374 | 2026-04-21T20:34:44.426Z | 639 /usr/lib/saf/ttymon -g -d /dev/console -l console -m ldterm,ttcompat - |
| 375 | 2026-04-21T20:34:44.426Z | 665 /usr/lib/saf/sac -t 300 |
| 376 | 2026-04-21T20:34:44.426Z | 673 /usr/lib/saf/ttymon |
| 377 | 2026-04-21T20:34:44.426Z | 801 /usr/bin/ctrun -l child -o noorphan,regent /opt/buildomat/lib/agent ru |
| 378 | 2026-04-21T20:34:44.426Z | 802 /opt/buildomat/lib/agent run |
| 379 | 2026-04-21T20:34:44.426Z | 816 /bin/bash /tmp/rXlZyEc9iI7m1mP9.sh |
| 380 | 2026-04-21T20:34:44.426Z | 881 ptree -z global |
| 381 | 2026-04-21T20:34:44.426Z | 10 /lib/svc/bin/svc.configd |
| 382 | 2026-04-21T20:34:44.426Z | 38 /sbin/dlmgmtd |
| 383 | 2026-04-21T20:34:44.426Z | 42 /lib/inet/ipmgmtd |
| 384 | 2026-04-21T20:34:44.426Z | 45 /lib/inet/netcfgd |
| 385 | 2026-04-21T20:34:44.426Z | 66 /lib/inet/in.mpathd |
| 386 | 2026-04-21T20:34:44.426Z | 95 /usr/lib/pfexecd |
| 387 | 2026-04-21T20:34:44.426Z | 141 /usr/lib/sysevent/syseventd |
| 388 | 2026-04-21T20:34:44.426Z | 145 devfsadmd |
| 389 | 2026-04-21T20:34:44.426Z | 161 /usr/lib/zones/zonestatd |
| 390 | 2026-04-21T20:34:44.426Z | 230 /sbin/dhcpagent |
| 391 | 2026-04-21T20:34:44.427Z | 564 /usr/lib/picl/picld |
| 392 | 2026-04-21T20:34:44.427Z | 597 /usr/sbin/nscd |
| 393 | 2026-04-21T20:34:44.427Z | 638 /usr/lib/utmpd |
| 394 | 2026-04-21T20:34:44.427Z | 678 /usr/lib/hotplugd |
| 395 | 2026-04-21T20:34:44.427Z | 685 /usr/sbin/syslogd |
| 396 | 2026-04-21T20:34:44.427Z | 709 /usr/sbin/rpcbind |
| 397 | 2026-04-21T20:34:44.427Z | 721 /usr/lib/inet/in.ndpd |
| 398 | 2026-04-21T20:34:44.427Z | 722 /usr/lib/fm/fmd/fmd |
| 399 | 2026-04-21T20:34:44.427Z | 757 /usr/lib/inet/inetd start |
| 400 | 2026-04-21T20:34:44.427Z | 784 /usr/perl5/bin/perl /usr/lib/intrd |
| 401 | 2026-04-21T20:34:44.427Z | 853 /usr/lib/rcm/rcm_daemon |
| 402 | 2026-04-21T20:34:44.427Z | + pfexec svcs -xv |
| 403 | 2026-04-21T20:34:44.490Z | ++ zoneadm list -n |
| 404 | 2026-04-21T20:34:44.516Z | ++ zoneadm list -n |
| 405 | 2026-04-21T20:34:44.516Z | ++ grep oxz_ntp |
| 406 | 2026-04-21T20:34:44.516Z | + pfexec zlogin sidecar_softnpu cat /var/log/softnpu.log |
| 407 | 2026-04-21T20:34:44.516Z | zlogin: zone 'sidecar_softnpu' unknown |
| 408 | 2026-04-21T20:34:44.516Z | + exit 1 |
| 409 | 2026-04-21T20:34:44.516Z | process exited: duration 22341 ms, exit code 1 |
| |
| 410 | 2026-04-21T20:34:44.566Z | found 1 output files |
| 411 | 2026-04-21T20:34:44.566Z | uploading: /tmp/kstat/xde.kstat (1005 bytes) |
| 412 | 2026-04-21T20:34:45.665Z | uploaded: /tmp/kstat/xde.kstat |