|
|
|
1 | 2025-01-15T04:54:41.010Z | job dependencies complete; ready to run (waiting for 35 m 23 s) |
2 | 2025-01-15T04:58:16.131Z | job assigned to worker 01JHM50SP61C80RSPTQ3ZAJQZ7 [factory lab, sock/11060] (queued for 3 m 35 s) |
3 | 2025-01-15T04:58:16.346Z | http://172.20.0.5:9969/ipxe/sock... ok |
4 | 2025-01-15T04:58:16.392Z | http://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok |
5 | 2025-01-15T04:58:16.427Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok |
6 | 2025-01-15T04:58:16.460Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok |
7 | 2025-01-15T04:58:16.494Z | http://172.20.0.5:9969/postboot/sock... ok |
8 | 2025-01-15T04:58:16.527Z | wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U |
9 | 2025-01-15T04:58:16.560Z | cpu0: microcode has been updated from version 0xa001133 to 0xa0011d5 |
10 | 2025-01-15T04:58:16.594Z | Oxide Helios Version helios-2.0.23032 64-bit |
11 | 2025-01-15T04:58:16.893Z | Configuring devices. |
12 | 2025-01-15T04:58:16.950Z | ################################################## |
13 | 2025-01-15T04:58:16.983Z | #### ############# ## |
14 | 2025-01-15T04:58:17.017Z | ### ### ############ ## |
15 | 2025-01-15T04:58:17.050Z | ## ### # ## ### ## Oxide Computer Company ## |
16 | 2025-01-15T04:58:17.084Z | ## ## ## ### # ### ## |
17 | 2025-01-15T04:58:17.118Z | ## # ### #### #### This Station Under ## |
18 | 2025-01-15T04:58:17.151Z | ### ### #### # ### Computer Control ## |
19 | 2025-01-15T04:58:17.185Z | #### #### ### ## ## |
20 | 2025-01-15T04:58:17.218Z | ################################################## |
21 | 2025-01-15T04:58:17.251Z | Hostname: sock |
22 | 2025-01-15T04:58:17.285Z | Loading smf(7) service descriptions: |
23 | 2025-01-15T04:58:18.381Z | downloading input: /input/package/work/package.tar.gz |
24 | 2025-01-15T05:03:45.017Z | downloaded input: /input/package/work/package.tar.gz |
|
25 | 2025-01-15T05:03:45.042Z | starting task 0: "setup" |
26 | 2025-01-15T05:03:45.042Z | ++ uname -s |
27 | 2025-01-15T05:03:45.042Z | + kern=SunOS |
28 | 2025-01-15T05:03:45.042Z | + case "$kern" in |
29 | 2025-01-15T05:03:45.042Z | + groupadd -g 12345 build |
30 | 2025-01-15T05:03:45.042Z | + useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build |
31 | 2025-01-15T05:03:47.036Z | + zfs create -o mountpoint=/work rpool/work |
32 | 2025-01-15T05:03:47.060Z | ++ awk '$2 == "/home" { print $3 }' /etc/mnttab |
33 | 2025-01-15T05:03:47.060Z | + home_fs=zfs |
34 | 2025-01-15T05:03:47.060Z | + [[ zfs == autofs ]] |
35 | 2025-01-15T05:03:47.060Z | + mkdir -p /home/build |
36 | 2025-01-15T05:03:47.084Z | + chown build:build /home/build /work |
37 | 2025-01-15T05:03:49.063Z | + chmod 0700 /home/build /work |
38 | 2025-01-15T05:03:49.087Z | process exited: duration 4049 ms, exit code 0 |
|
39 | 2025-01-15T05:03:49.134Z | starting task 1: "authentication" |
40 | 2025-01-15T05:03:49.183Z | process exited: duration 49 ms, exit code 0 |
|
41 | 2025-01-15T05:03:49.229Z | starting task 2: "build" |
42 | 2025-01-15T05:03:49.253Z | + trap _exit_trap EXIT |
43 | 2025-01-15T05:03:49.253Z | + OPTE_COMMIT= |
44 | 2025-01-15T05:03:49.253Z | + [[ x != \x ]] |
45 | 2025-01-15T05:03:49.253Z | + pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3' |
46 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir: 0x55 = 0x55 |
47 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+1: 0xb8 = 0x48 |
48 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+2: 0x1 = 0x89 |
49 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+3: 0 = 0xe5 |
50 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+4: 0 = 0xb8 |
51 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+5: 0 = 0x1 |
52 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+6: 0x48 = 0x0 |
53 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+7: 0x89 = 0x0 |
54 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+8: 0xe5 = 0x0 |
55 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+9: 0x48 = 0x5d |
56 | 2025-01-15T05:03:49.350Z | secpolicy_fs_linkdir+0xa: 0x83 = 0xc3 |
57 | 2025-01-15T05:03:49.374Z | + [[ -d /opt/oxide ]] |
58 | 2025-01-15T05:03:49.374Z | + pfexec mv /opt/oxide /opt/oxide-underneath |
59 | 2025-01-15T05:03:49.374Z | + pfexec mkdir /opt/oxide |
60 | 2025-01-15T05:03:49.374Z | + pfexec mount -F tmpfs -O swap /opt/oxide |
61 | 2025-01-15T05:03:49.374Z | + [[ -d /opt/oxide-underneath ]] |
62 | 2025-01-15T05:03:49.374Z | + cd /opt/oxide-underneath |
63 | 2025-01-15T05:03:49.375Z | + pfexec tar ceEp@/f - . |
64 | 2025-01-15T05:03:49.375Z | + cd /opt/oxide |
65 | 2025-01-15T05:03:49.375Z | + pfexec tar xveEp@/f - |
66 | 2025-01-15T05:03:49.408Z | x ., 0 bytes, 0 tape blocks |
67 | 2025-01-15T05:03:49.408Z | x ./opte, 0 bytes, 0 tape blocks |
68 | 2025-01-15T05:03:49.408Z | x ./opte/bin, 0 bytes, 0 tape blocks |
69 | 2025-01-15T05:03:49.408Z | x ./opte/bin/opteadm, 17490984 bytes, 34163 tape blocks |
70 | 2025-01-15T05:03:49.431Z | + pfexec rm -rf /opt/oxide-underneath |
71 | 2025-01-15T05:03:49.431Z | + pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone |
72 | 2025-01-15T05:03:49.454Z | + pfexec mkdir /opt/oxide/work |
73 | 2025-01-15T05:03:49.454Z | + pfexec chown build:build /opt/oxide/work |
74 | 2025-01-15T05:03:49.454Z | + cd /opt/oxide/work |
75 | 2025-01-15T05:03:49.454Z | + ptime -m tar xvzf /input/package/work/package.tar.gz |
76 | 2025-01-15T05:04:03.624Z | Decompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'... |
77 | 2025-01-15T05:04:03.624Z | x .github/buildomat/ci-env.sh, 196 bytes, 1 tape blocks |
78 | 2025-01-15T05:04:03.624Z | x out/target/test, 107 bytes, 1 tape blocks |
79 | 2025-01-15T05:04:03.625Z | x out/npuzone/npuzone, 23699288 bytes, 46288 tape blocks |
80 | 2025-01-15T05:04:03.625Z | x package-manifest.toml, 34009 bytes, 67 tape blocks |
81 | 2025-01-15T05:04:03.625Z | x smf/sled-agent/non-gimlet/config.toml, 3569 bytes, 7 tape blocks |
82 | 2025-01-15T05:04:03.625Z | x target/release/omicron-package, 37210000 bytes, 72676 tape blocks |
83 | 2025-01-15T05:04:03.625Z | x target/release/xtask, 12204192 bytes, 23837 tape blocks |
84 | 2025-01-15T05:04:03.625Z | x target/debug/bootstrap, 226617840 bytes, 442613 tape blocks |
85 | 2025-01-15T05:04:03.625Z | x tests/bootstrap-498b2f8dcf6fc48d, 24907736 bytes, 48648 tape blocks |
86 | 2025-01-15T05:04:03.625Z | x tests/commtest-5e14b44c64968d02, 25412632 bytes, 49635 tape blocks |
87 | 2025-01-15T05:04:03.625Z | x tests/dhcp_server-3e2027c6203b48d9, 24907752 bytes, 48648 tape blocks |
88 | 2025-01-15T05:04:03.625Z | x tests/end_to_end_tests-c4a4f96c8aefc701, 289811720 bytes, 566039 tape blocks |
89 | 2025-01-15T05:04:03.625Z | x out/clickhouse.tar.gz, 301647906 bytes, 589157 tape blocks |
90 | 2025-01-15T05:04:03.625Z | x out/clickhouse_keeper.tar.gz, 288311006 bytes, 563108 tape blocks |
91 | 2025-01-15T05:04:03.625Z | x out/clickhouse_server.tar.gz, 301641432 bytes, 589144 tape blocks |
92 | 2025-01-15T05:04:03.625Z | x out/cockroachdb.tar.gz, 138301234 bytes, 270120 tape blocks |
93 | 2025-01-15T05:04:03.625Z | x out/crucible-dtrace.tar, 97792 bytes, 191 tape blocks |
94 | 2025-01-15T05:04:03.625Z | x out/crucible-pantry-zone.tar.gz, 29217505 bytes, 57066 tape blocks |
95 | 2025-01-15T05:04:03.625Z | x out/crucible-zone.tar.gz, 37692112 bytes, 73618 tape blocks |
96 | 2025-01-15T05:04:03.625Z | x out/external-dns.tar.gz, 36585646 bytes, 71457 tape blocks |
97 | 2025-01-15T05:04:03.625Z | x out/internal-dns.tar.gz, 36583688 bytes, 71453 tape blocks |
98 | 2025-01-15T05:04:03.625Z | x out/mg-ddm-gz.tar, 64588288 bytes, 126149 tape blocks |
99 | 2025-01-15T05:04:03.625Z | x out/nexus.tar.gz, 102352019 bytes, 199907 tape blocks |
100 | 2025-01-15T05:04:03.625Z | x out/ntp.tar.gz, 10746163 bytes, 20989 tape blocks |
101 | 2025-01-15T05:04:03.625Z | x out/omicron-gateway-softnpu.tar.gz, 24759037 bytes, 48358 tape blocks |
102 | 2025-01-15T05:04:03.625Z | x out/omicron-sled-agent.tar, 117371392 bytes, 229241 tape blocks |
103 | 2025-01-15T05:04:03.625Z | x out/overlay.tar.gz, 2622 bytes, 6 tape blocks |
104 | 2025-01-15T05:04:03.625Z | x out/oximeter.tar.gz, 49548263 bytes, 96774 tape blocks |
105 | 2025-01-15T05:04:03.625Z | x out/oxlog.tar, 3232768 bytes, 6314 tape blocks |
106 | 2025-01-15T05:04:03.625Z | x out/probe.tar.gz, 2829470 bytes, 5527 tape blocks |
107 | 2025-01-15T05:04:03.625Z | x out/propolis-server.tar.gz, 68061443 bytes, 132933 tape blocks |
108 | 2025-01-15T05:04:03.625Z | x out/pumpkind-gz.tar, 27304960 bytes, 53330 tape blocks |
109 | 2025-01-15T05:04:03.625Z | x out/switch-softnpu.tar.gz, 241938820 bytes, 472537 tape blocks |
110 | 2025-01-15T05:04:03.649Z | |
111 | 2025-01-15T05:04:03.649Z | real 14.181102219 |
112 | 2025-01-15T05:04:03.649Z | user 12.579572866 |
113 | 2025-01-15T05:04:03.649Z | sys 2.796287668 |
114 | 2025-01-15T05:04:03.649Z | trap 0.000429986 |
115 | 2025-01-15T05:04:03.649Z | tflt 0.000000000 |
116 | 2025-01-15T05:04:03.649Z | dflt 0.000000000 |
117 | 2025-01-15T05:04:03.649Z | kflt 0.000000000 |
118 | 2025-01-15T05:04:03.649Z | lock 0.000000000 |
119 | 2025-01-15T05:04:03.649Z | slp 12.642685545 |
120 | 2025-01-15T05:04:03.649Z | lat 0.341023280 |
121 | 2025-01-15T05:04:03.649Z | stop 0.000129462 |
122 | 2025-01-15T05:04:03.649Z | + source .github/buildomat/ci-env.sh |
123 | 2025-01-15T05:04:03.649Z | ++ export CARGO_TERM_COLOR=always |
124 | 2025-01-15T05:04:03.649Z | ++ CARGO_TERM_COLOR=always |
125 | 2025-01-15T05:04:03.649Z | + bmat address ls |
126 | 2025-01-15T05:04:03.649Z | NAME CIDR FIRST LAST COUNT |
127 | 2025-01-15T05:04:03.649Z | extra 10.151.2.0/24 10.151.2.164 10.151.2.227 64 |
128 | 2025-01-15T05:04:03.649Z | ++ bmat address ls -f extra -Ho first,last,count |
129 | 2025-01-15T05:04:03.649Z | + set -- 10.151.2.164 10.151.2.227 64 |
130 | 2025-01-15T05:04:03.649Z | + EXTRA_IP_START=10.151.2.164 |
131 | 2025-01-15T05:04:03.649Z | + EXTRA_IP_END=10.151.2.227 |
132 | 2025-01-15T05:04:03.650Z | + EXTRA_IP_COUNT=64 |
133 | 2025-01-15T05:04:03.650Z | + (( EXTRA_IP_COUNT >= 32 )) |
134 | 2025-01-15T05:04:03.650Z | + EXTRA_IP_BASE=10.151.2 |
135 | 2025-01-15T05:04:03.650Z | + EXTRA_IP_FOCTET=164 |
136 | 2025-01-15T05:04:03.650Z | + EXTRA_IP_LOCTET=227 |
137 | 2025-01-15T05:04:03.650Z | + SERVICE_IP_POOL_START=10.151.2.164 |
138 | 2025-01-15T05:04:03.650Z | + SERVICE_IP_POOL_END=10.151.2.173 |
139 | 2025-01-15T05:04:03.650Z | + DNS_IP1=10.151.2.164 |
140 | 2025-01-15T05:04:03.650Z | + DNS_IP2=10.151.2.165 |
141 | 2025-01-15T05:04:03.650Z | + UPLINK_IP=10.151.2.174 |
142 | 2025-01-15T05:04:03.650Z | + IPPOOL_START=10.151.2.175 |
143 | 2025-01-15T05:04:03.650Z | + IPPOOL_END=10.151.2.227 |
144 | 2025-01-15T05:04:03.650Z | ++ ipadm show-addr -po type,addr |
145 | 2025-01-15T05:04:03.674Z | ++ awk '-F[:/]' '$1 == "dhcp" {print $2}' |
146 | 2025-01-15T05:04:03.674Z | + GATEWAY_IP=10.151.2.100 |
147 | 2025-01-15T05:04:03.674Z | + [[ -n 10.151.2.100 ]] |
148 | 2025-01-15T05:04:03.674Z | + ping -s 10.151.2.100 56 1 |
149 | 2025-01-15T05:04:03.674Z | PING 10.151.2.100: 56 data bytes |
150 | 2025-01-15T05:04:03.674Z | 64 bytes from 10.151.2.100: icmp_seq=0. time=0.012 ms |
151 | 2025-01-15T05:04:03.674Z | |
152 | 2025-01-15T05:04:03.674Z | ----10.151.2.100 PING Statistics---- |
153 | 2025-01-15T05:04:03.674Z | 1 packets transmitted, 1 packets received, 0% packet loss |
154 | 2025-01-15T05:04:03.674Z | round-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan |
155 | 2025-01-15T05:04:03.674Z | ++ arp -an |
156 | 2025-01-15T05:04:03.674Z | ++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}' |
157 | 2025-01-15T05:04:03.674Z | + GATEWAY_MAC=18:c0:4d:0d:a0:2a |
158 | 2025-01-15T05:04:03.674Z | + routeadm -e ipv4-forwarding -u |
159 | 2025-01-15T05:04:03.782Z | + PXA_START=10.151.2.164 |
160 | 2025-01-15T05:04:03.782Z | + PXA_END=10.151.2.227 |
161 | 2025-01-15T05:04:03.782Z | + pfexec zpool create -f scratch c1t1d0 c2t1d0 |
162 | 2025-01-15T05:04:03.921Z | + ptime -m pfexec ./target/release/xtask virtual-hardware --vdev-dir /scratch create --gateway-ip 10.151.2.100 --gateway-mac 18:c0:4d:0d:a0:2a --pxa-start 10.151.2.164 --pxa-end 10.151.2.227 |
163 | 2025-01-15T05:04:03.944Z | Couldn't find Cargo.toml, using /opt/oxide/work as workspace root |
164 | 2025-01-15T05:04:03.999Z | creating virtual hardware |
165 | 2025-01-15T05:04:04.022Z | creating /scratch/m2_0.vdev |
166 | 2025-01-15T05:04:04.023Z | creating /scratch/m2_1.vdev |
167 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_0.vdev |
168 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_1.vdev |
169 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_2.vdev |
170 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_3.vdev |
171 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_4.vdev |
172 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_5.vdev |
173 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_6.vdev |
174 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_7.vdev |
175 | 2025-01-15T05:04:04.023Z | creating /scratch/u2_8.vdev |
176 | 2025-01-15T05:04:04.046Z | Simnet net0/sc0_0 exists |
177 | 2025-01-15T05:04:04.070Z | Simnet net1/sc1_0 exists |
178 | 2025-01-15T05:04:04.070Z | Vnic sc0_1 exists |
179 | 2025-01-15T05:04:16.287Z | Using 10.151.2.100 as gateway ip |
180 | 2025-01-15T05:04:16.287Z | using 18:C0:4D:0D:A0:2A as gateway mac |
181 | 2025-01-15T05:04:16.287Z | configuring SoftNPU ARP entry |
182 | 2025-01-15T05:04:16.314Z | configuring SoftNPU proxy ARP |
183 | 2025-01-15T05:04:16.369Z | SoftNPU state: |
184 | 2025-01-15T05:04:16.369Z | local v6: |
185 | 2025-01-15T05:04:16.369Z | local v4: |
186 | 2025-01-15T05:04:16.370Z | router v6: |
187 | 2025-01-15T05:04:16.370Z | router v4_idx: |
188 | 2025-01-15T05:04:16.370Z | router v4_routes: |
189 | 2025-01-15T05:04:16.370Z | resolver v4: |
190 | 2025-01-15T05:04:16.370Z | 10.151.2.100 -> 18:c0:4d:0d:a0:2a |
191 | 2025-01-15T05:04:16.370Z | resolver v6: |
192 | 2025-01-15T05:04:16.370Z | nat v4: |
193 | 2025-01-15T05:04:16.370Z | nat_v6: |
194 | 2025-01-15T05:04:16.370Z | port_mac: |
195 | 2025-01-15T05:04:16.370Z | proxy arp: |
196 | 2025-01-15T05:04:16.370Z | 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d |
197 | 2025-01-15T05:04:16.370Z | created virtual hardware |
198 | 2025-01-15T05:04:16.394Z | |
199 | 2025-01-15T05:04:16.394Z | real 12.446156569 |
200 | 2025-01-15T05:04:16.394Z | user 0.662228413 |
201 | 2025-01-15T05:04:16.394Z | sys 3.240008724 |
202 | 2025-01-15T05:04:16.394Z | trap 0.000061067 |
203 | 2025-01-15T05:04:16.394Z | tflt 0.000143697 |
204 | 2025-01-15T05:04:16.394Z | dflt 0.000402724 |
205 | 2025-01-15T05:04:16.394Z | kflt 0.000020768 |
206 | 2025-01-15T05:04:16.394Z | lock 9:37.393277472 |
207 | 2025-01-15T05:04:16.394Z | slp 37.592715955 |
208 | 2025-01-15T05:04:16.394Z | lat 0.068079129 |
209 | 2025-01-15T05:04:16.394Z | stop 0.325347436 |
210 | 2025-01-15T05:04:16.394Z | + tar xf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml |
211 | 2025-01-15T05:04:16.417Z | + sed -E -i~ 's/(m2|u2)(.*\.vdev)/\/scratch\/\1\2/g' pkg/config.toml |
212 | 2025-01-15T05:04:16.417Z | + diff -u pkg/config.toml~ pkg/config.toml |
213 | 2025-01-15T05:04:16.417Z | --- pkg/config.toml~ Mon Jul 24 01:21:28 2006 |
214 | 2025-01-15T05:04:16.417Z | +++ pkg/config.toml Wed Jan 15 05:04:16 2025 |
215 | 2025-01-15T05:04:16.417Z | @@ -29,18 +29,18 @@ |
216 | 2025-01-15T05:04:16.417Z | # These paths have the prefix of either "u2" or "m2", followed by an underscore, |
217 | 2025-01-15T05:04:16.417Z | # followed by a string that is embedded into their fake serial values. |
218 | 2025-01-15T05:04:16.418Z | vdevs = [ |
219 | 2025-01-15T05:04:16.418Z | - "m2_0.vdev", |
220 | 2025-01-15T05:04:16.418Z | - "m2_1.vdev", |
221 | 2025-01-15T05:04:16.418Z | + "/scratch/m2_0.vdev", |
222 | 2025-01-15T05:04:16.418Z | + "/scratch/m2_1.vdev", |
223 | 2025-01-15T05:04:16.418Z | |
224 | 2025-01-15T05:04:16.418Z | - "u2_0.vdev", |
225 | 2025-01-15T05:04:16.418Z | - "u2_1.vdev", |
226 | 2025-01-15T05:04:16.418Z | - "u2_2.vdev", |
227 | 2025-01-15T05:04:16.418Z | - "u2_3.vdev", |
228 | 2025-01-15T05:04:16.418Z | - "u2_4.vdev", |
229 | 2025-01-15T05:04:16.418Z | - "u2_5.vdev", |
230 | 2025-01-15T05:04:16.418Z | - "u2_6.vdev", |
231 | 2025-01-15T05:04:16.418Z | - "u2_7.vdev", |
232 | 2025-01-15T05:04:16.418Z | - "u2_8.vdev", |
233 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_0.vdev", |
234 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_1.vdev", |
235 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_2.vdev", |
236 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_3.vdev", |
237 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_4.vdev", |
238 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_5.vdev", |
239 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_6.vdev", |
240 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_7.vdev", |
241 | 2025-01-15T05:04:16.418Z | + "/scratch/u2_8.vdev", |
242 | 2025-01-15T05:04:16.418Z | ] |
243 | 2025-01-15T05:04:16.418Z | |
244 | 2025-01-15T05:04:16.418Z | # Percentage of usable physical DRAM to use for the VMM reservoir, which |
245 | 2025-01-15T05:04:16.418Z | + true |
246 | 2025-01-15T05:04:16.418Z | ++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
247 | 2025-01-15T05:04:16.418Z | + SILO_NAME=recovery |
248 | 2025-01-15T05:04:16.418Z | ++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
249 | 2025-01-15T05:04:16.418Z | + EXTERNAL_DNS_DOMAIN=oxide.test |
250 | 2025-01-15T05:04:16.418Z | + sed -i~ ' |
251 | 2025-01-15T05:04:16.418Z | /^external_dns_ips/c\ |
252 | 2025-01-15T05:04:16.418Z | external_dns_ips = [ "10.151.2.164", "10.151.2.165" ] |
253 | 2025-01-15T05:04:16.418Z | /^\[\[internal_services_ip_pool_ranges/,/^$/ { |
254 | 2025-01-15T05:04:16.418Z | /^first/c\ |
255 | 2025-01-15T05:04:16.418Z | first = "10.151.2.164" |
256 | 2025-01-15T05:04:16.419Z | /^last/c\ |
257 | 2025-01-15T05:04:16.419Z | last = "10.151.2.173" |
258 | 2025-01-15T05:04:16.419Z | } |
259 | 2025-01-15T05:04:16.419Z | /^infra_ip_first/c\ |
260 | 2025-01-15T05:04:16.419Z | infra_ip_first = "10.151.2.174" |
261 | 2025-01-15T05:04:16.419Z | /^infra_ip_last/c\ |
262 | 2025-01-15T05:04:16.419Z | infra_ip_last = "10.151.2.174" |
263 | 2025-01-15T05:04:16.419Z | /^\[\[rack_network_config.ports/,/^$/ { |
264 | 2025-01-15T05:04:16.419Z | /^routes/c\ |
265 | 2025-01-15T05:04:16.419Z | routes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\] |
266 | 2025-01-15T05:04:16.419Z | /^addresses/c\ |
267 | 2025-01-15T05:04:16.419Z | addresses = \[{address = "10.151.2.174/24"} \] |
268 | 2025-01-15T05:04:16.419Z | } |
269 | 2025-01-15T05:04:16.419Z | ' pkg/config-rss.toml |
270 | 2025-01-15T05:04:16.446Z | + diff -u pkg/config-rss.toml~ pkg/config-rss.toml |
271 | 2025-01-15T05:04:16.446Z | --- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006 |
272 | 2025-01-15T05:04:16.446Z | +++ pkg/config-rss.toml Wed Jan 15 05:04:16 2025 |
273 | 2025-01-15T05:04:16.446Z | @@ -33,7 +33,7 @@ |
274 | 2025-01-15T05:04:16.446Z | # the DNS domain delegated to the rack by the customer. Each of these addresses |
275 | 2025-01-15T05:04:16.446Z | # must be contained in one of the "internal services" IP Pool ranges listed |
276 | 2025-01-15T05:04:16.446Z | # below. |
277 | 2025-01-15T05:04:16.447Z | -external_dns_ips = [ "192.168.1.20", "192.168.1.21" ] |
278 | 2025-01-15T05:04:16.447Z | +external_dns_ips = [ "10.151.2.164", "10.151.2.165" ] |
279 | 2025-01-15T05:04:16.447Z | |
280 | 2025-01-15T05:04:16.447Z | # Initial TLS certificates for the external API |
281 | 2025-01-15T05:04:16.447Z | # |
282 | 2025-01-15T05:04:16.447Z | @@ -69,8 +69,8 @@ |
283 | 2025-01-15T05:04:16.447Z | # |
284 | 2025-01-15T05:04:16.447Z | # For more on this and what to put here, see docs/how-to-run.adoc. |
285 | 2025-01-15T05:04:16.447Z | [[internal_services_ip_pool_ranges]] |
286 | 2025-01-15T05:04:16.447Z | -first = "192.168.1.20" |
287 | 2025-01-15T05:04:16.447Z | -last = "192.168.1.29" |
288 | 2025-01-15T05:04:16.447Z | +first = "10.151.2.164" |
289 | 2025-01-15T05:04:16.447Z | +last = "10.151.2.173" |
290 | 2025-01-15T05:04:16.447Z | |
291 | 2025-01-15T05:04:16.447Z | # TODO - this configuration is subject to change going forward. Ultimately these |
292 | 2025-01-15T05:04:16.447Z | # parameters should be provided to the control plane via wicket, but we need to |
293 | 2025-01-15T05:04:16.447Z | @@ -91,8 +91,8 @@ |
294 | 2025-01-15T05:04:16.447Z | # A range of IP addresses used by Boundary Services on the external network. In |
295 | 2025-01-15T05:04:16.448Z | # a real system, these would be addresses of the uplink ports on the Sidecar. |
296 | 2025-01-15T05:04:16.448Z | # With softnpu, only one address is used. |
297 | 2025-01-15T05:04:16.448Z | -infra_ip_first = "192.168.1.30" |
298 | 2025-01-15T05:04:16.448Z | -infra_ip_last = "192.168.1.30" |
299 | 2025-01-15T05:04:16.448Z | +infra_ip_first = "10.151.2.174" |
300 | 2025-01-15T05:04:16.448Z | +infra_ip_last = "10.151.2.174" |
301 | 2025-01-15T05:04:16.448Z | |
302 | 2025-01-15T05:04:16.448Z | # Configurations for BGP routers to run on the scrimlets. |
303 | 2025-01-15T05:04:16.448Z | bgp = [] |
304 | 2025-01-15T05:04:16.448Z | @@ -100,9 +100,9 @@ |
305 | 2025-01-15T05:04:16.448Z | # You can configure multiple uplinks by repeating the following stanza |
306 | 2025-01-15T05:04:16.448Z | [[rack_network_config.ports]] |
307 | 2025-01-15T05:04:16.448Z | # Routes associated with this port. |
308 | 2025-01-15T05:04:16.448Z | -routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}] |
309 | 2025-01-15T05:04:16.448Z | +routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}] |
310 | 2025-01-15T05:04:16.448Z | # Addresses associated with this port. |
311 | 2025-01-15T05:04:16.448Z | -addresses = [{address = "192.168.1.30/24"}] |
312 | 2025-01-15T05:04:16.448Z | +addresses = [{address = "10.151.2.174/24"} ] |
313 | 2025-01-15T05:04:16.448Z | # Name of the uplink port. This should always be "qsfp0" when using softnpu. |
314 | 2025-01-15T05:04:16.448Z | port = "qsfp0" |
315 | 2025-01-15T05:04:16.448Z | # The speed of this port. |
316 | 2025-01-15T05:04:16.448Z | + true |
317 | 2025-01-15T05:04:16.448Z | + tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml pkg/config.toml |
318 | 2025-01-15T05:04:16.448Z | a pkg/config-rss.toml 8K |
319 | 2025-01-15T05:04:16.448Z | a pkg/config.toml 4K |
320 | 2025-01-15T05:04:16.448Z | + rm -f pkg/config-rss.toml pkg/config-rss.toml~ pkg/config.toml pkg/config.toml~ |
321 | 2025-01-15T05:04:16.448Z | + TLS_NAME=recovery.sys.oxide.test |
322 | 2025-01-15T05:04:16.448Z | + openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin |
323 | 2025-01-15T05:04:17.066Z | ...............+..................+......+...+...+.......+..+......+...+.+...+......+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+......+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*............+....+......+.........+..+...............+.........+.+...+.....+....+..+......+....+...+......+......+........+......+.......+........+.+......+..+.+............+...............+...+...........+..........+...+..+..........+.........+..............+.+.................+.......+...+........+....+...............+.....+..........+...........+....+...+........+.....................+...+.+............+..+................+..............+.+..+.......+......+...............+.....+.+........+.........................+..+......+...+.+......+........+....+..+...+............+....+.....+....+...........+.+........+.........................+.....+..........+..+.+...+..+...+.......+..................+.....+.+.........+..+...+.+.........+..............+...+...+......+.+........+.+...+..+................+..+.......+.........+..+...............+...+.......+..............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
324 | 2025-01-15T05:04:17.337Z | ......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+.............+............+..+...............+...+.+..+..........+..+.+.........+...+..+............+...+.+....................+......+.............+..+.+...+.........+..+...+......+.......+..+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+....+...........+.......+...+.....+.......+........+................+.....+......+.......+.....+...+.........+....+......+...+........+...+..........+.....+..........+........................+..+.+........+..........+...........+...+.............+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
325 | 2025-01-15T05:04:17.360Z | ----- |
326 | 2025-01-15T05:04:17.383Z | + tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
327 | 2025-01-15T05:04:17.383Z | a pkg/initial-tls-cert.pem 2K |
328 | 2025-01-15T05:04:17.383Z | a pkg/initial-tls-key.pem 4K |
329 | 2025-01-15T05:04:17.383Z | + rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
330 | 2025-01-15T05:04:17.383Z | + rmdir pkg |
331 | 2025-01-15T05:04:17.383Z | + E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
332 | 2025-01-15T05:04:17.383Z | + pfexec mkdir -p /usr/oxide |
333 | 2025-01-15T05:04:17.383Z | + pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.1 |
334 | 2025-01-15T05:04:17.967Z | + pfexec chmod +x /usr/oxide/oxide |
335 | 2025-01-15T05:04:17.990Z | + curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw |
336 | 2025-01-15T05:04:36.319Z | + OMICRON_NO_UNINSTALL=1 |
337 | 2025-01-15T05:04:36.319Z | + ptime -m pfexec ./target/release/omicron-package -t test install |
338 | 2025-01-15T05:04:36.342Z | Logging to: /opt/oxide/work/out/LOG |
339 | 2025-01-15T05:04:36.968Z | |
340 | 2025-01-15T05:04:36.991Z | real 0.644254038 |
341 | 2025-01-15T05:04:36.992Z | user 0.139097674 |
342 | 2025-01-15T05:04:36.992Z | sys 3.472868874 |
343 | 2025-01-15T05:04:36.992Z | trap 0.000002669 |
344 | 2025-01-15T05:04:36.992Z | tflt 0.000003160 |
345 | 2025-01-15T05:04:36.992Z | dflt 0.000574135 |
346 | 2025-01-15T05:04:36.992Z | kflt 0.000000000 |
347 | 2025-01-15T05:04:36.992Z | lock 57.881165545 |
348 | 2025-01-15T05:04:36.992Z | slp 0.842215875 |
349 | 2025-01-15T05:04:36.992Z | lat 0.003424488 |
350 | 2025-01-15T05:04:36.992Z | stop 0.207689303 |
351 | 2025-01-15T05:04:36.992Z | + retry=0 |
352 | 2025-01-15T05:04:36.992Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
353 | 2025-01-15T05:04:36.992Z | + [[ 0 -gt 30 ]] |
354 | 2025-01-15T05:04:36.992Z | + sleep 1 |
355 | 2025-01-15T05:04:37.983Z | + retry=1 |
356 | 2025-01-15T05:04:37.983Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
357 | 2025-01-15T05:04:38.007Z | + [[ 1 -gt 30 ]] |
358 | 2025-01-15T05:04:38.007Z | + sleep 1 |
359 | 2025-01-15T05:04:38.997Z | + retry=2 |
360 | 2025-01-15T05:04:38.997Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
361 | 2025-01-15T05:04:39.021Z | + [[ 2 -gt 30 ]] |
362 | 2025-01-15T05:04:39.021Z | + sleep 1 |
363 | 2025-01-15T05:04:40.012Z | + retry=3 |
364 | 2025-01-15T05:04:40.012Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
365 | 2025-01-15T05:04:59.837Z | + [[ 3 -gt 30 ]] |
366 | 2025-01-15T05:04:59.838Z | + sleep 1 |
367 | 2025-01-15T05:05:00.841Z | + retry=4 |
368 | 2025-01-15T05:05:00.841Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
369 | 2025-01-15T05:05:00.864Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
370 | 2025-01-15T05:05:00.888Z | local v6: |
371 | 2025-01-15T05:05:00.888Z | fe80::748f:6bff:fe08:381c |
372 | 2025-01-15T05:05:00.888Z | fd76:6e05:5e43:db42::1 |
373 | 2025-01-15T05:05:00.888Z | local v4: |
374 | 2025-01-15T05:05:00.888Z | 10.151.2.174 |
375 | 2025-01-15T05:05:00.888Z | router v6: |
376 | 2025-01-15T05:05:00.888Z | router v4_idx: |
377 | 2025-01-15T05:05:00.888Z | router v4_routes: |
378 | 2025-01-15T05:05:00.888Z | resolver v4: |
379 | 2025-01-15T05:05:00.888Z | 10.151.2.100 -> 18:c0:4d:0d:a0:2a |
380 | 2025-01-15T05:05:00.888Z | resolver v6: |
381 | 2025-01-15T05:05:00.888Z | fe80::da:29ff:feb9:7081 -> 02:da:29:b9:70:81 |
382 | 2025-01-15T05:05:00.888Z | fe80::748f:6bff:fe08:381c -> 76:8f:6b:08:38:1c |
383 | 2025-01-15T05:05:00.888Z | nat v4: |
384 | 2025-01-15T05:05:00.888Z | nat_v6: |
385 | 2025-01-15T05:05:00.888Z | port_mac: |
386 | 2025-01-15T05:05:00.888Z | 1000: a8:40:25:63:03:c1 |
387 | 2025-01-15T05:05:00.888Z | 1: a8:40:25:63:03:c2 |
388 | 2025-01-15T05:05:00.889Z | 2: a8:40:25:63:03:e2 |
389 | 2025-01-15T05:05:00.889Z | proxy arp: |
390 | 2025-01-15T05:05:00.889Z | 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d |
391 | 2025-01-15T05:05:00.912Z | + retry=0 |
392 | 2025-01-15T05:05:00.912Z | +++ zoneadm list -n |
393 | 2025-01-15T05:05:00.912Z | +++ grep oxz_ntp |
394 | 2025-01-15T05:05:00.912Z | ++ pfexec svcs -z -Hostate oxide/ntp |
395 | 2025-01-15T05:05:00.912Z | svcs: zone '-Hostate': entity not found |
396 | 2025-01-15T05:05:00.912Z | ++ true |
397 | 2025-01-15T05:05:00.912Z | + [[ '' != online ]] |
398 | 2025-01-15T05:05:00.912Z | + [[ 0 -gt 60 ]] |
399 | 2025-01-15T05:05:00.912Z | + sleep 1 |
400 | 2025-01-15T05:05:01.914Z | + retry=1 |
401 | 2025-01-15T05:05:01.938Z | +++ zoneadm list -n |
402 | 2025-01-15T05:05:01.938Z | +++ grep oxz_ntp |
403 | 2025-01-15T05:05:01.938Z | ++ pfexec svcs -z -Hostate oxide/ntp |
404 | 2025-01-15T05:05:01.938Z | svcs: zone '-Hostate': entity not found |
405 | 2025-01-15T05:05:01.938Z | ++ true |
406 | 2025-01-15T05:05:01.938Z | + [[ '' != online ]] |
407 | 2025-01-15T05:05:01.938Z | + [[ 1 -gt 60 ]] |
408 | 2025-01-15T05:05:01.938Z | + sleep 1 |
409 | 2025-01-15T05:05:02.935Z | + retry=2 |
410 | 2025-01-15T05:05:02.959Z | +++ zoneadm list -n |
411 | 2025-01-15T05:05:02.959Z | +++ grep oxz_ntp |
412 | 2025-01-15T05:05:02.959Z | ++ pfexec svcs -z -Hostate oxide/ntp |
413 | 2025-01-15T05:05:02.959Z | svcs: zone '-Hostate': entity not found |
414 | 2025-01-15T05:05:02.959Z | ++ true |
415 | 2025-01-15T05:05:02.959Z | + [[ '' != online ]] |
416 | 2025-01-15T05:05:02.959Z | + [[ 2 -gt 60 ]] |
417 | 2025-01-15T05:05:02.959Z | + sleep 1 |
418 | 2025-01-15T05:05:03.956Z | + retry=3 |
419 | 2025-01-15T05:05:03.979Z | +++ zoneadm list -n |
420 | 2025-01-15T05:05:03.979Z | +++ grep oxz_ntp |
421 | 2025-01-15T05:05:03.979Z | ++ pfexec svcs -z -Hostate oxide/ntp |
422 | 2025-01-15T05:05:03.979Z | svcs: zone '-Hostate': entity not found |
423 | 2025-01-15T05:05:03.979Z | ++ true |
424 | 2025-01-15T05:05:03.979Z | + [[ '' != online ]] |
425 | 2025-01-15T05:05:03.979Z | + [[ 3 -gt 60 ]] |
426 | 2025-01-15T05:05:03.979Z | + sleep 1 |
427 | 2025-01-15T05:05:04.979Z | + retry=4 |
428 | 2025-01-15T05:05:05.002Z | +++ zoneadm list -n |
429 | 2025-01-15T05:05:05.002Z | +++ grep oxz_ntp |
430 | 2025-01-15T05:05:05.002Z | ++ pfexec svcs -z -Hostate oxide/ntp |
431 | 2025-01-15T05:05:05.002Z | svcs: zone '-Hostate': entity not found |
432 | 2025-01-15T05:05:05.002Z | ++ true |
433 | 2025-01-15T05:05:05.002Z | + [[ '' != online ]] |
434 | 2025-01-15T05:05:05.002Z | + [[ 4 -gt 60 ]] |
435 | 2025-01-15T05:05:05.002Z | + sleep 1 |
436 | 2025-01-15T05:05:06.002Z | + retry=5 |
437 | 2025-01-15T05:05:06.025Z | +++ zoneadm list -n |
438 | 2025-01-15T05:05:06.025Z | +++ grep oxz_ntp |
439 | 2025-01-15T05:05:06.025Z | ++ pfexec svcs -z -Hostate oxide/ntp |
440 | 2025-01-15T05:05:06.025Z | svcs: zone '-Hostate': entity not found |
441 | 2025-01-15T05:05:06.026Z | ++ true |
442 | 2025-01-15T05:05:06.026Z | + [[ '' != online ]] |
443 | 2025-01-15T05:05:06.026Z | + [[ 5 -gt 60 ]] |
444 | 2025-01-15T05:05:06.026Z | + sleep 1 |
445 | 2025-01-15T05:05:07.027Z | + retry=6 |
446 | 2025-01-15T05:05:07.050Z | +++ zoneadm list -n |
447 | 2025-01-15T05:05:07.050Z | +++ grep oxz_ntp |
448 | 2025-01-15T05:05:07.050Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
449 | 2025-01-15T05:05:07.073Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
450 | 2025-01-15T05:05:07.073Z | ++ true |
451 | 2025-01-15T05:05:07.073Z | + [[ '' != online ]] |
452 | 2025-01-15T05:05:07.073Z | + [[ 6 -gt 60 ]] |
453 | 2025-01-15T05:05:07.073Z | + sleep 1 |
454 | 2025-01-15T05:05:08.071Z | + retry=7 |
455 | 2025-01-15T05:05:08.095Z | +++ zoneadm list -n |
456 | 2025-01-15T05:05:08.095Z | +++ grep oxz_ntp |
457 | 2025-01-15T05:05:08.095Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
458 | 2025-01-15T05:05:08.118Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
459 | 2025-01-15T05:05:08.118Z | ++ true |
460 | 2025-01-15T05:05:08.118Z | + [[ '' != online ]] |
461 | 2025-01-15T05:05:08.118Z | + [[ 7 -gt 60 ]] |
462 | 2025-01-15T05:05:08.118Z | + sleep 1 |
463 | 2025-01-15T05:05:09.106Z | + retry=8 |
464 | 2025-01-15T05:05:09.129Z | +++ zoneadm list -n |
465 | 2025-01-15T05:05:09.129Z | +++ grep oxz_ntp |
466 | 2025-01-15T05:05:09.129Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
467 | 2025-01-15T05:05:09.153Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
468 | 2025-01-15T05:05:09.153Z | ++ true |
469 | 2025-01-15T05:05:09.153Z | + [[ '' != online ]] |
470 | 2025-01-15T05:05:09.153Z | + [[ 8 -gt 60 ]] |
471 | 2025-01-15T05:05:09.153Z | + sleep 1 |
472 | 2025-01-15T05:05:10.136Z | + retry=9 |
473 | 2025-01-15T05:05:10.159Z | +++ zoneadm list -n |
474 | 2025-01-15T05:05:10.159Z | +++ grep oxz_ntp |
475 | 2025-01-15T05:05:10.159Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
476 | 2025-01-15T05:05:10.182Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
477 | 2025-01-15T05:05:10.182Z | ++ true |
478 | 2025-01-15T05:05:10.182Z | + [[ '' != online ]] |
479 | 2025-01-15T05:05:10.182Z | + [[ 9 -gt 60 ]] |
480 | 2025-01-15T05:05:10.182Z | + sleep 1 |
481 | 2025-01-15T05:05:11.168Z | + retry=10 |
482 | 2025-01-15T05:05:11.192Z | +++ zoneadm list -n |
483 | 2025-01-15T05:05:11.192Z | +++ grep oxz_ntp |
484 | 2025-01-15T05:05:11.192Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
485 | 2025-01-15T05:05:11.192Z | + [[ offline != online ]] |
486 | 2025-01-15T05:05:11.192Z | + [[ 10 -gt 60 ]] |
487 | 2025-01-15T05:05:11.192Z | + sleep 1 |
488 | 2025-01-15T05:05:12.190Z | + retry=11 |
489 | 2025-01-15T05:05:12.214Z | +++ zoneadm list -n |
490 | 2025-01-15T05:05:12.214Z | +++ grep oxz_ntp |
491 | 2025-01-15T05:05:12.214Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
492 | 2025-01-15T05:05:12.214Z | + [[ offline != online ]] |
493 | 2025-01-15T05:05:12.214Z | + [[ 11 -gt 60 ]] |
494 | 2025-01-15T05:05:12.214Z | + sleep 1 |
495 | 2025-01-15T05:05:13.211Z | + retry=12 |
496 | 2025-01-15T05:05:13.235Z | +++ zoneadm list -n |
497 | 2025-01-15T05:05:13.235Z | +++ grep oxz_ntp |
498 | 2025-01-15T05:05:13.235Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
499 | 2025-01-15T05:05:13.235Z | + [[ offline != online ]] |
500 | 2025-01-15T05:05:13.235Z | + [[ 12 -gt 60 ]] |
501 | 2025-01-15T05:05:13.235Z | + sleep 1 |
502 | 2025-01-15T05:05:14.233Z | + retry=13 |
503 | 2025-01-15T05:05:14.256Z | +++ zoneadm list -n |
504 | 2025-01-15T05:05:14.256Z | +++ grep oxz_ntp |
505 | 2025-01-15T05:05:14.256Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
506 | 2025-01-15T05:05:14.256Z | + [[ offline != online ]] |
507 | 2025-01-15T05:05:14.257Z | + [[ 13 -gt 60 ]] |
508 | 2025-01-15T05:05:14.257Z | + sleep 1 |
509 | 2025-01-15T05:05:15.256Z | + retry=14 |
510 | 2025-01-15T05:05:15.279Z | +++ zoneadm list -n |
511 | 2025-01-15T05:05:15.279Z | +++ grep oxz_ntp |
512 | 2025-01-15T05:05:15.279Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
513 | 2025-01-15T05:05:15.279Z | + [[ offline != online ]] |
514 | 2025-01-15T05:05:15.279Z | + [[ 14 -gt 60 ]] |
515 | 2025-01-15T05:05:15.279Z | + sleep 1 |
516 | 2025-01-15T05:05:16.278Z | + retry=15 |
517 | 2025-01-15T05:05:16.301Z | +++ zoneadm list -n |
518 | 2025-01-15T05:05:16.301Z | +++ grep oxz_ntp |
519 | 2025-01-15T05:05:16.301Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
520 | 2025-01-15T05:05:16.301Z | + [[ offline != online ]] |
521 | 2025-01-15T05:05:16.301Z | + [[ 15 -gt 60 ]] |
522 | 2025-01-15T05:05:16.302Z | + sleep 1 |
|
523 | 2025-01-15T05:05:16.347Z | sock console login: Jan 15 05:05:16 sock ip: ip: joining multicasts failed (4) on opte0 - will use link layer broadcasts for multicast |
|
524 | 2025-01-15T05:05:17.300Z | + retry=16 |
525 | 2025-01-15T05:05:17.324Z | +++ zoneadm list -n |
526 | 2025-01-15T05:05:17.324Z | +++ grep oxz_ntp |
527 | 2025-01-15T05:05:17.324Z | ++ pfexec svcs -z oxz_ntp_8e926629-53be-4ddf-9833-2912f8e2a0a8 -Hostate oxide/ntp |
528 | 2025-01-15T05:05:17.324Z | + [[ online != online ]] |
529 | 2025-01-15T05:05:17.324Z | + echo 'Waited for chrony: 16s' |
530 | 2025-01-15T05:05:17.324Z | Waited for chrony: 16s |
531 | 2025-01-15T05:05:17.324Z | + retry=0 |
532 | 2025-01-15T05:05:17.324Z | + zoneadm list |
533 | 2025-01-15T05:05:17.324Z | + grep nexus |
534 | 2025-01-15T05:05:17.348Z | + [[ 0 -gt 300 ]] |
535 | 2025-01-15T05:05:17.348Z | + sleep 1 |
536 | 2025-01-15T05:05:18.332Z | + retry=1 |
537 | 2025-01-15T05:05:18.355Z | + zoneadm list |
538 | 2025-01-15T05:05:18.378Z | + grep nexus |
539 | 2025-01-15T05:05:18.378Z | + [[ 1 -gt 300 ]] |
540 | 2025-01-15T05:05:18.378Z | + sleep 1 |
541 | 2025-01-15T05:05:19.345Z | + retry=2 |
542 | 2025-01-15T05:05:19.368Z | + zoneadm list |
543 | 2025-01-15T05:05:19.369Z | + grep nexus |
544 | 2025-01-15T05:05:19.369Z | + [[ 2 -gt 300 ]] |
545 | 2025-01-15T05:05:19.369Z | + sleep 1 |
546 | 2025-01-15T05:05:20.360Z | + retry=3 |
547 | 2025-01-15T05:05:20.384Z | + zoneadm list |
548 | 2025-01-15T05:05:20.384Z | + grep nexus |
549 | 2025-01-15T05:05:20.384Z | + [[ 3 -gt 300 ]] |
550 | 2025-01-15T05:05:20.384Z | + sleep 1 |
551 | 2025-01-15T05:05:21.374Z | + retry=4 |
552 | 2025-01-15T05:05:21.398Z | + zoneadm list |
553 | 2025-01-15T05:05:21.398Z | + grep nexus |
554 | 2025-01-15T05:05:21.398Z | + [[ 4 -gt 300 ]] |
555 | 2025-01-15T05:05:21.398Z | + sleep 1 |
556 | 2025-01-15T05:05:22.387Z | + retry=5 |
557 | 2025-01-15T05:05:22.410Z | + zoneadm list |
558 | 2025-01-15T05:05:22.410Z | + grep nexus |
559 | 2025-01-15T05:05:22.410Z | + [[ 5 -gt 300 ]] |
560 | 2025-01-15T05:05:22.410Z | + sleep 1 |
561 | 2025-01-15T05:05:23.401Z | + retry=6 |
562 | 2025-01-15T05:05:23.425Z | + zoneadm list |
563 | 2025-01-15T05:05:23.425Z | + grep nexus |
564 | 2025-01-15T05:05:23.425Z | + [[ 6 -gt 300 ]] |
565 | 2025-01-15T05:05:23.425Z | + sleep 1 |
566 | 2025-01-15T05:05:24.415Z | + retry=7 |
567 | 2025-01-15T05:05:24.438Z | + zoneadm list |
568 | 2025-01-15T05:05:24.438Z | + grep nexus |
569 | 2025-01-15T05:05:24.438Z | + [[ 7 -gt 300 ]] |
570 | 2025-01-15T05:05:24.438Z | + sleep 1 |
571 | 2025-01-15T05:05:25.429Z | + retry=8 |
572 | 2025-01-15T05:05:25.452Z | + zoneadm list |
573 | 2025-01-15T05:05:25.452Z | + grep nexus |
574 | 2025-01-15T05:05:25.452Z | + [[ 8 -gt 300 ]] |
575 | 2025-01-15T05:05:25.452Z | + sleep 1 |
576 | 2025-01-15T05:05:26.443Z | + retry=9 |
577 | 2025-01-15T05:05:26.466Z | + zoneadm list |
578 | 2025-01-15T05:05:26.466Z | + grep nexus |
579 | 2025-01-15T05:05:26.466Z | + [[ 9 -gt 300 ]] |
580 | 2025-01-15T05:05:26.466Z | + sleep 1 |
581 | 2025-01-15T05:05:27.457Z | + retry=10 |
582 | 2025-01-15T05:05:27.480Z | + zoneadm list |
583 | 2025-01-15T05:05:27.480Z | + grep nexus |
584 | 2025-01-15T05:05:27.480Z | + [[ 10 -gt 300 ]] |
585 | 2025-01-15T05:05:27.480Z | + sleep 1 |
586 | 2025-01-15T05:05:28.471Z | + retry=11 |
587 | 2025-01-15T05:05:28.495Z | + zoneadm list |
588 | 2025-01-15T05:05:28.495Z | + grep nexus |
589 | 2025-01-15T05:05:28.495Z | + [[ 11 -gt 300 ]] |
590 | 2025-01-15T05:05:28.495Z | + sleep 1 |
591 | 2025-01-15T05:05:29.486Z | + retry=12 |
592 | 2025-01-15T05:05:29.510Z | + zoneadm list |
593 | 2025-01-15T05:05:29.510Z | + grep nexus |
594 | 2025-01-15T05:05:29.510Z | + [[ 12 -gt 300 ]] |
595 | 2025-01-15T05:05:29.510Z | + sleep 1 |
596 | 2025-01-15T05:05:30.500Z | + retry=13 |
597 | 2025-01-15T05:05:30.523Z | + zoneadm list |
598 | 2025-01-15T05:05:30.523Z | + grep nexus |
599 | 2025-01-15T05:05:30.523Z | + [[ 13 -gt 300 ]] |
600 | 2025-01-15T05:05:30.523Z | + sleep 1 |
601 | 2025-01-15T05:05:31.514Z | + retry=14 |
602 | 2025-01-15T05:05:31.539Z | + zoneadm list |
603 | 2025-01-15T05:05:31.540Z | + grep nexus |
604 | 2025-01-15T05:05:31.540Z | + [[ 14 -gt 300 ]] |
605 | 2025-01-15T05:05:31.540Z | + sleep 1 |
606 | 2025-01-15T05:05:32.529Z | + retry=15 |
607 | 2025-01-15T05:05:32.553Z | + zoneadm list |
608 | 2025-01-15T05:05:32.553Z | + grep nexus |
609 | 2025-01-15T05:05:32.553Z | + [[ 15 -gt 300 ]] |
610 | 2025-01-15T05:05:32.553Z | + sleep 1 |
611 | 2025-01-15T05:05:33.544Z | + retry=16 |
612 | 2025-01-15T05:05:33.567Z | + zoneadm list |
613 | 2025-01-15T05:05:33.567Z | + grep nexus |
614 | 2025-01-15T05:05:33.567Z | + [[ 16 -gt 300 ]] |
615 | 2025-01-15T05:05:33.567Z | + sleep 1 |
616 | 2025-01-15T05:05:34.602Z | + retry=17 |
617 | 2025-01-15T05:05:34.628Z | + zoneadm list |
618 | 2025-01-15T05:05:34.628Z | + grep nexus |
619 | 2025-01-15T05:05:34.661Z | + [[ 17 -gt 300 ]] |
620 | 2025-01-15T05:05:34.661Z | + sleep 1 |
621 | 2025-01-15T05:05:35.668Z | + retry=18 |
622 | 2025-01-15T05:05:35.692Z | + zoneadm list |
623 | 2025-01-15T05:05:35.692Z | + grep nexus |
624 | 2025-01-15T05:05:35.692Z | + [[ 18 -gt 300 ]] |
625 | 2025-01-15T05:05:35.692Z | + sleep 1 |
626 | 2025-01-15T05:05:36.686Z | + retry=19 |
627 | 2025-01-15T05:05:36.710Z | + zoneadm list |
628 | 2025-01-15T05:05:36.710Z | + grep nexus |
629 | 2025-01-15T05:05:36.710Z | + [[ 19 -gt 300 ]] |
630 | 2025-01-15T05:05:36.710Z | + sleep 1 |
631 | 2025-01-15T05:05:37.705Z | + retry=20 |
632 | 2025-01-15T05:05:37.728Z | + zoneadm list |
633 | 2025-01-15T05:05:37.728Z | + grep nexus |
634 | 2025-01-15T05:05:37.728Z | + [[ 20 -gt 300 ]] |
635 | 2025-01-15T05:05:37.729Z | + sleep 1 |
636 | 2025-01-15T05:05:38.720Z | + retry=21 |
637 | 2025-01-15T05:05:38.743Z | + zoneadm list |
638 | 2025-01-15T05:05:38.743Z | + grep nexus |
639 | 2025-01-15T05:05:38.744Z | + [[ 21 -gt 300 ]] |
640 | 2025-01-15T05:05:38.744Z | + sleep 1 |
641 | 2025-01-15T05:05:39.739Z | + retry=22 |
642 | 2025-01-15T05:05:39.763Z | + zoneadm list |
643 | 2025-01-15T05:05:39.763Z | + grep nexus |
644 | 2025-01-15T05:05:39.763Z | + [[ 22 -gt 300 ]] |
645 | 2025-01-15T05:05:39.763Z | + sleep 1 |
646 | 2025-01-15T05:05:40.755Z | + retry=23 |
647 | 2025-01-15T05:05:40.778Z | + zoneadm list |
648 | 2025-01-15T05:05:40.779Z | + grep nexus |
649 | 2025-01-15T05:05:40.779Z | + [[ 23 -gt 300 ]] |
650 | 2025-01-15T05:05:40.779Z | + sleep 1 |
651 | 2025-01-15T05:05:41.769Z | + retry=24 |
652 | 2025-01-15T05:05:41.792Z | + zoneadm list |
653 | 2025-01-15T05:05:41.792Z | + grep nexus |
654 | 2025-01-15T05:05:41.792Z | + [[ 24 -gt 300 ]] |
655 | 2025-01-15T05:05:41.793Z | + sleep 1 |
656 | 2025-01-15T05:05:42.786Z | + retry=25 |
657 | 2025-01-15T05:05:42.809Z | + zoneadm list |
658 | 2025-01-15T05:05:42.809Z | + grep nexus |
659 | 2025-01-15T05:05:42.809Z | + [[ 25 -gt 300 ]] |
660 | 2025-01-15T05:05:42.809Z | + sleep 1 |
661 | 2025-01-15T05:05:43.802Z | + retry=26 |
662 | 2025-01-15T05:05:43.826Z | + zoneadm list |
663 | 2025-01-15T05:05:43.826Z | + grep nexus |
664 | 2025-01-15T05:05:43.826Z | + [[ 26 -gt 300 ]] |
665 | 2025-01-15T05:05:43.826Z | + sleep 1 |
666 | 2025-01-15T05:05:44.818Z | + retry=27 |
667 | 2025-01-15T05:05:44.841Z | + zoneadm list |
668 | 2025-01-15T05:05:44.841Z | + grep nexus |
669 | 2025-01-15T05:05:44.841Z | + [[ 27 -gt 300 ]] |
670 | 2025-01-15T05:05:44.841Z | + sleep 1 |
671 | 2025-01-15T05:05:45.928Z | + retry=28 |
672 | 2025-01-15T05:05:46.215Z | + zoneadm list |
673 | 2025-01-15T05:05:46.246Z | + grep nexus |
674 | 2025-01-15T05:05:46.270Z | + [[ 28 -gt 300 ]] |
675 | 2025-01-15T05:05:46.270Z | + sleep 1 |
676 | 2025-01-15T05:05:47.260Z | + retry=29 |
677 | 2025-01-15T05:05:47.284Z | + zoneadm list |
678 | 2025-01-15T05:05:47.284Z | + grep nexus |
679 | 2025-01-15T05:05:47.284Z | + [[ 29 -gt 300 ]] |
680 | 2025-01-15T05:05:47.284Z | + sleep 1 |
681 | 2025-01-15T05:05:48.276Z | + retry=30 |
682 | 2025-01-15T05:05:48.300Z | + zoneadm list |
683 | 2025-01-15T05:05:48.300Z | + grep nexus |
684 | 2025-01-15T05:05:48.301Z | + [[ 30 -gt 300 ]] |
685 | 2025-01-15T05:05:48.301Z | + sleep 1 |
686 | 2025-01-15T05:05:49.289Z | + retry=31 |
687 | 2025-01-15T05:05:49.312Z | + zoneadm list |
688 | 2025-01-15T05:05:49.312Z | + grep nexus |
689 | 2025-01-15T05:05:49.312Z | + [[ 31 -gt 300 ]] |
690 | 2025-01-15T05:05:49.312Z | + sleep 1 |
691 | 2025-01-15T05:05:50.302Z | + retry=32 |
692 | 2025-01-15T05:05:50.326Z | + zoneadm list |
693 | 2025-01-15T05:05:50.326Z | + grep nexus |
694 | 2025-01-15T05:05:50.326Z | + [[ 32 -gt 300 ]] |
695 | 2025-01-15T05:05:50.326Z | + sleep 1 |
696 | 2025-01-15T05:05:51.314Z | + retry=33 |
697 | 2025-01-15T05:05:51.337Z | + zoneadm list |
698 | 2025-01-15T05:05:51.337Z | + grep nexus |
699 | 2025-01-15T05:05:51.337Z | + [[ 33 -gt 300 ]] |
700 | 2025-01-15T05:05:51.337Z | + sleep 1 |
701 | 2025-01-15T05:05:52.325Z | + retry=34 |
702 | 2025-01-15T05:05:52.348Z | + zoneadm list |
703 | 2025-01-15T05:05:52.348Z | + grep nexus |
704 | 2025-01-15T05:05:52.348Z | + [[ 34 -gt 300 ]] |
705 | 2025-01-15T05:05:52.348Z | + sleep 1 |
706 | 2025-01-15T05:05:53.357Z | + retry=35 |
707 | 2025-01-15T05:05:53.357Z | + zoneadm list |
708 | 2025-01-15T05:05:53.357Z | + grep nexus |
709 | 2025-01-15T05:05:53.357Z | + [[ 35 -gt 300 ]] |
710 | 2025-01-15T05:05:53.357Z | + sleep 1 |
711 | 2025-01-15T05:05:54.349Z | + retry=36 |
712 | 2025-01-15T05:05:54.372Z | + zoneadm list |
713 | 2025-01-15T05:05:54.372Z | + grep nexus |
714 | 2025-01-15T05:05:54.372Z | + [[ 36 -gt 300 ]] |
715 | 2025-01-15T05:05:54.372Z | + sleep 1 |
716 | 2025-01-15T05:05:55.367Z | + retry=37 |
717 | 2025-01-15T05:05:55.367Z | + zoneadm list |
718 | 2025-01-15T05:05:55.390Z | + grep nexus |
719 | 2025-01-15T05:05:55.390Z | + [[ 37 -gt 300 ]] |
720 | 2025-01-15T05:05:55.390Z | + sleep 1 |
721 | 2025-01-15T05:05:56.382Z | + retry=38 |
722 | 2025-01-15T05:05:56.405Z | + zoneadm list |
723 | 2025-01-15T05:05:56.405Z | + grep nexus |
724 | 2025-01-15T05:05:56.405Z | + [[ 38 -gt 300 ]] |
725 | 2025-01-15T05:05:56.405Z | + sleep 1 |
726 | 2025-01-15T05:05:57.393Z | + retry=39 |
727 | 2025-01-15T05:05:57.416Z | + zoneadm list |
728 | 2025-01-15T05:05:57.416Z | + grep nexus |
729 | 2025-01-15T05:05:57.416Z | + [[ 39 -gt 300 ]] |
730 | 2025-01-15T05:05:57.416Z | + sleep 1 |
731 | 2025-01-15T05:05:58.404Z | + retry=40 |
732 | 2025-01-15T05:05:58.427Z | + zoneadm list |
733 | 2025-01-15T05:05:58.427Z | + grep nexus |
734 | 2025-01-15T05:05:58.429Z | + [[ 40 -gt 300 ]] |
735 | 2025-01-15T05:05:58.429Z | + sleep 1 |
736 | 2025-01-15T05:05:59.417Z | + retry=41 |
737 | 2025-01-15T05:05:59.440Z | + zoneadm list |
738 | 2025-01-15T05:05:59.440Z | + grep nexus |
739 | 2025-01-15T05:05:59.440Z | + [[ 41 -gt 300 ]] |
740 | 2025-01-15T05:05:59.440Z | + sleep 1 |
741 | 2025-01-15T05:06:00.429Z | + retry=42 |
742 | 2025-01-15T05:06:00.452Z | + zoneadm list |
743 | 2025-01-15T05:06:00.452Z | + grep nexus |
744 | 2025-01-15T05:06:00.452Z | + [[ 42 -gt 300 ]] |
745 | 2025-01-15T05:06:00.452Z | + sleep 1 |
746 | 2025-01-15T05:06:01.441Z | + retry=43 |
747 | 2025-01-15T05:06:01.467Z | + zoneadm list |
748 | 2025-01-15T05:06:01.468Z | + grep nexus |
749 | 2025-01-15T05:06:01.468Z | + [[ 43 -gt 300 ]] |
750 | 2025-01-15T05:06:01.468Z | + sleep 1 |
751 | 2025-01-15T05:06:02.452Z | + retry=44 |
752 | 2025-01-15T05:06:02.476Z | + zoneadm list |
753 | 2025-01-15T05:06:02.476Z | + grep nexus |
754 | 2025-01-15T05:06:02.476Z | + [[ 44 -gt 300 ]] |
755 | 2025-01-15T05:06:02.476Z | + sleep 1 |
756 | 2025-01-15T05:06:03.464Z | + retry=45 |
757 | 2025-01-15T05:06:03.487Z | + zoneadm list |
758 | 2025-01-15T05:06:03.487Z | + grep nexus |
759 | 2025-01-15T05:06:03.487Z | + [[ 45 -gt 300 ]] |
760 | 2025-01-15T05:06:03.487Z | + sleep 1 |
761 | 2025-01-15T05:06:04.476Z | + retry=46 |
762 | 2025-01-15T05:06:04.518Z | + zoneadm list |
763 | 2025-01-15T05:06:04.518Z | + grep nexus |
764 | 2025-01-15T05:06:04.518Z | + [[ 46 -gt 300 ]] |
765 | 2025-01-15T05:06:04.518Z | + sleep 1 |
766 | 2025-01-15T05:06:05.488Z | + retry=47 |
767 | 2025-01-15T05:06:05.511Z | + zoneadm list |
768 | 2025-01-15T05:06:05.511Z | + grep nexus |
769 | 2025-01-15T05:06:05.512Z | + [[ 47 -gt 300 ]] |
770 | 2025-01-15T05:06:05.512Z | + sleep 1 |
771 | 2025-01-15T05:06:06.501Z | + retry=48 |
772 | 2025-01-15T05:06:06.525Z | + zoneadm list |
773 | 2025-01-15T05:06:06.525Z | + grep nexus |
774 | 2025-01-15T05:06:06.525Z | + [[ 48 -gt 300 ]] |
775 | 2025-01-15T05:06:06.525Z | + sleep 1 |
776 | 2025-01-15T05:06:07.514Z | + retry=49 |
777 | 2025-01-15T05:06:07.538Z | + zoneadm list |
778 | 2025-01-15T05:06:07.538Z | + grep nexus |
779 | 2025-01-15T05:06:07.538Z | + [[ 49 -gt 300 ]] |
780 | 2025-01-15T05:06:07.538Z | + sleep 1 |
781 | 2025-01-15T05:06:08.527Z | + retry=50 |
782 | 2025-01-15T05:06:08.551Z | + zoneadm list |
783 | 2025-01-15T05:06:08.551Z | + grep nexus |
784 | 2025-01-15T05:06:08.551Z | + [[ 50 -gt 300 ]] |
785 | 2025-01-15T05:06:08.551Z | + sleep 1 |
786 | 2025-01-15T05:06:09.541Z | + retry=51 |
787 | 2025-01-15T05:06:09.563Z | + zoneadm list |
788 | 2025-01-15T05:06:09.564Z | + grep nexus |
789 | 2025-01-15T05:06:09.564Z | + [[ 51 -gt 300 ]] |
790 | 2025-01-15T05:06:09.564Z | + sleep 1 |
791 | 2025-01-15T05:06:10.554Z | + retry=52 |
792 | 2025-01-15T05:06:10.577Z | + zoneadm list |
793 | 2025-01-15T05:06:10.577Z | + grep nexus |
794 | 2025-01-15T05:06:10.577Z | + [[ 52 -gt 300 ]] |
795 | 2025-01-15T05:06:10.577Z | + sleep 1 |
796 | 2025-01-15T05:06:11.567Z | + retry=53 |
797 | 2025-01-15T05:06:11.590Z | + zoneadm list |
798 | 2025-01-15T05:06:11.590Z | + grep nexus |
799 | 2025-01-15T05:06:11.590Z | + [[ 53 -gt 300 ]] |
800 | 2025-01-15T05:06:11.590Z | + sleep 1 |
801 | 2025-01-15T05:06:12.580Z | + retry=54 |
802 | 2025-01-15T05:06:12.603Z | + zoneadm list |
803 | 2025-01-15T05:06:12.603Z | + grep nexus |
804 | 2025-01-15T05:06:12.603Z | + [[ 54 -gt 300 ]] |
805 | 2025-01-15T05:06:12.603Z | + sleep 1 |
806 | 2025-01-15T05:06:13.593Z | + retry=55 |
807 | 2025-01-15T05:06:13.616Z | + zoneadm list |
808 | 2025-01-15T05:06:13.616Z | + grep nexus |
809 | 2025-01-15T05:06:13.616Z | + [[ 55 -gt 300 ]] |
810 | 2025-01-15T05:06:13.616Z | + sleep 1 |
811 | 2025-01-15T05:06:14.605Z | + retry=56 |
812 | 2025-01-15T05:06:14.628Z | + zoneadm list |
813 | 2025-01-15T05:06:14.628Z | + grep nexus |
814 | 2025-01-15T05:06:14.628Z | + [[ 56 -gt 300 ]] |
815 | 2025-01-15T05:06:14.628Z | + sleep 1 |
816 | 2025-01-15T05:06:15.623Z | + retry=57 |
817 | 2025-01-15T05:06:15.646Z | + zoneadm list |
818 | 2025-01-15T05:06:15.646Z | + grep nexus |
819 | 2025-01-15T05:06:15.646Z | + [[ 57 -gt 300 ]] |
820 | 2025-01-15T05:06:15.646Z | + sleep 1 |
821 | 2025-01-15T05:06:16.634Z | + retry=58 |
822 | 2025-01-15T05:06:16.657Z | + zoneadm list |
823 | 2025-01-15T05:06:16.657Z | + grep nexus |
824 | 2025-01-15T05:06:16.657Z | + [[ 58 -gt 300 ]] |
825 | 2025-01-15T05:06:16.657Z | + sleep 1 |
826 | 2025-01-15T05:06:17.646Z | + retry=59 |
827 | 2025-01-15T05:06:17.670Z | + zoneadm list |
828 | 2025-01-15T05:06:17.670Z | + grep nexus |
829 | 2025-01-15T05:06:17.670Z | + [[ 59 -gt 300 ]] |
830 | 2025-01-15T05:06:17.670Z | + sleep 1 |
831 | 2025-01-15T05:06:18.659Z | + retry=60 |
832 | 2025-01-15T05:06:18.683Z | + zoneadm list |
833 | 2025-01-15T05:06:18.683Z | + grep nexus |
834 | 2025-01-15T05:06:18.683Z | + [[ 60 -gt 300 ]] |
835 | 2025-01-15T05:06:18.683Z | + sleep 1 |
836 | 2025-01-15T05:06:19.672Z | + retry=61 |
837 | 2025-01-15T05:06:19.696Z | + zoneadm list |
838 | 2025-01-15T05:06:19.696Z | + grep nexus |
839 | 2025-01-15T05:06:19.696Z | + [[ 61 -gt 300 ]] |
840 | 2025-01-15T05:06:19.696Z | + sleep 1 |
841 | 2025-01-15T05:06:20.693Z | + retry=62 |
842 | 2025-01-15T05:06:20.717Z | + zoneadm list |
843 | 2025-01-15T05:06:20.717Z | + grep nexus |
844 | 2025-01-15T05:06:20.740Z | + [[ 62 -gt 300 ]] |
845 | 2025-01-15T05:06:20.740Z | + sleep 1 |
846 | 2025-01-15T05:06:21.803Z | + retry=63 |
847 | 2025-01-15T05:06:21.827Z | + zoneadm list |
848 | 2025-01-15T05:06:21.827Z | + grep nexus |
849 | 2025-01-15T05:06:21.850Z | + [[ 63 -gt 300 ]] |
850 | 2025-01-15T05:06:21.851Z | + sleep 1 |
851 | 2025-01-15T05:06:22.988Z | + retry=64 |
852 | 2025-01-15T05:06:23.016Z | + zoneadm list |
853 | 2025-01-15T05:06:23.039Z | + grep nexus |
854 | 2025-01-15T05:06:23.062Z | + [[ 64 -gt 300 ]] |
855 | 2025-01-15T05:06:23.062Z | + sleep 1 |
856 | 2025-01-15T05:06:24.057Z | + retry=65 |
857 | 2025-01-15T05:06:24.080Z | + zoneadm list |
858 | 2025-01-15T05:06:24.080Z | + grep nexus |
859 | 2025-01-15T05:06:24.080Z | + [[ 65 -gt 300 ]] |
860 | 2025-01-15T05:06:24.080Z | + sleep 1 |
|
861 | 2025-01-15T05:07:55.686Z | panic[cpu0]/thread=fffffe00b7ef2c20: pageout_deadman: stuck pushing the same page for 90 seconds (freemem is 102945) |
862 | 2025-01-15T05:07:55.748Z | fffffe00b7ef2a60 genunix:pageout_deadman+62 () |
863 | 2025-01-15T05:07:55.784Z | fffffe00b7ef2ad0 genunix:clock+7b3 () |
864 | 2025-01-15T05:07:55.818Z | fffffe00b7ef2b60 genunix:cyclic_softint+e1 () |
865 | 2025-01-15T05:07:55.861Z | fffffe00b7ef2b80 unix:cbe_softclock+23 () |
866 | 2025-01-15T05:07:55.962Z | fffffe00b7ef2bd0 unix:av_dispatch_softvect+72 () |
867 | 2025-01-15T05:07:55.996Z | fffffe00b7ef2c00 apix:apix_dispatch_softint+35 () |
868 | 2025-01-15T05:07:56.029Z | fffffe00b7e059f0 unix:switch_sp_and_call+15 () |
869 | 2025-01-15T05:07:56.203Z | fffffe00b7e05a40 apix:apix_do_softint+5a () |
870 | 2025-01-15T05:07:56.412Z | fffffe00b7e05aa0 apix:apix_do_interrupt+2bf () |
871 | 2025-01-15T05:07:56.574Z | fffffe00b7e05ab0 unix:_interrupt+c3 () |
872 | 2025-01-15T05:07:56.654Z | fffffe00b7e05ba0 unix:i86_mwait+12 () |
873 | 2025-01-15T05:07:56.686Z | fffffe00b7e05bd0 unix:cpu_idle_mwait+14b () |
874 | 2025-01-15T05:07:56.720Z | fffffe00b7e05be0 unix:cpu_idle_adaptive+19 () |
875 | 2025-01-15T05:07:56.754Z | fffffe00b7e05c00 unix:idle+a8 () |
876 | 2025-01-15T05:07:56.787Z | fffffe00b7e05c10 unix:thread_start+b () |
877 | 2025-01-15T05:07:56.820Z | skipping system dump - no dump device configured |
878 | 2025-01-15T05:07:56.853Z | rebooting... |
879 | 2025-01-15T05:08:44.361Z | ^[[2J^[[1;1H^[[8;25;80t^[[2J^[[1;1H^[[1;1H^[[0;37;40m^[[2J^[[1;1H^[[25; |
880 | 2025-01-15T05:08:45.234Z | 8H98^[[1;1H^[[25;78H9D^[[1;1H^[[25;78H9A^[[1;1H^[[25;78H9C^[[1;1H^[[25;78 |
881 | 2025-01-15T05:08:45.270Z | 9D^[[1;1H^[[25;78H9A^[[1;1H^[[25;78H9C^[[1;1H^[[25;78HB4^[[1;1H^[[25;78HB |
882 | 2025-01-15T05:08:47.847Z | ^[[1;1H^[[25;78HB4^[[1;1H^[[1;1H^[[1;1HPress <DEL> to enter setup, <F1 |
883 | 2025-01-15T05:08:49.547Z | > Display Boot Menu, <F12> Force Network Boot ^[[25;78H92^[[2;1H^[ |
884 | 2025-01-15T05:08:49.582Z | 25;78HA0^[[2;1H^[[25;78HA0^[[2;1H^[[25;78H99^[[2;1H^[[25;78H92^[[2;1H^[[2 |
885 | 2025-01-15T05:08:49.615Z | ;78H92^[[2;1H^[[25;78H72^[[2;1H^[[25;78HA0^[[2;1H^[[25;78HA2^[[2;1H^[[25; |
886 | 2025-01-15T05:08:49.649Z | 8HA2^[[2;1H^[[25;78HA2^[[2;1H^[[25;78HA2^[[2;1H^[[25;78HA2^[[2;1H^[[25;78 |
887 | 2025-01-15T05:08:49.961Z | A2^[[2;1H^[[25;78HA2^[[2;1H^[[25;78HA2^[[2;1H^[[25;78H92^[[2;1H^[[25; |
888 | 2025-01-15T05:08:50.006Z | 8HB2^[[2;1H^[[2J^[[1;1H^[[01;00H^[[0m^[[2;37;40mInitializing Intel(R) B |
889 | 2025-01-15T05:08:50.051Z | ot Agent GE v1.5.53 ^[[02;00HP |
890 | 2025-01-15T05:08:50.096Z | E 2.1 Build 092 (WfM 2.0) ^[ |
891 | 2025-01-15T05:08:50.140Z | 03;00HPress Ctrl+S to enter the Setup Menu. ^[ |
892 | 2025-01-15T05:08:50.174Z | 04;00H ^[ |
893 | 2025-01-15T05:08:50.207Z | 05;00H ^[ |
894 | 2025-01-15T05:08:50.241Z | 06;00H ^[ |
895 | 2025-01-15T05:08:50.569Z | 07;00H ^[ |
896 | 2025-01-15T05:08:50.621Z | 08;00H ^[ |
897 | 2025-01-15T05:08:50.656Z | 09;00H ^[ |
898 | 2025-01-15T05:08:50.688Z | 10;00H ^[ |
899 | 2025-01-15T05:08:50.733Z | 11;00H ^[ |
900 | 2025-01-15T05:08:50.778Z | 12;00H ^[ |
901 | 2025-01-15T05:08:50.822Z | 13;00H ^[ |
902 | 2025-01-15T05:08:50.856Z | 14;00H ^[ |
903 | 2025-01-15T05:08:50.889Z | 15;00H ^[ |
904 | 2025-01-15T05:08:50.922Z | 16;00H ^[ |
905 | 2025-01-15T05:08:50.967Z | 17;00H ^[ |
906 | 2025-01-15T05:08:51.001Z | 18;00H ^[ |
907 | 2025-01-15T05:08:51.045Z | 19;00H ^[ |
908 | 2025-01-15T05:08:51.279Z | 20;00H ^[ |
909 | 2025-01-15T05:08:51.391Z | 21;00H ^[ |
910 | 2025-01-15T05:08:51.446Z | 22;00H ^[ |
911 | 2025-01-15T05:08:51.480Z | 23;00H ^[ |
912 | 2025-01-15T05:08:51.513Z | 24;00H ^[ |
913 | 2025-01-15T05:08:51.547Z | 24;00H^[[03;39H^[[03;00HPress Ctrl+S to enter the Setup Menu.. |
914 | 2025-01-15T05:08:52.741Z | ^[[03;39H^[[01;00HInitializ |
915 | 2025-01-15T05:08:52.781Z | ng Intel(R) Boot Agent GE v1.5.53 ^[ |
916 | 2025-01-15T05:08:52.815Z | 02;00HPXE 2.1 Build 092 (WfM 2.0) ^[ |
917 | 2025-01-15T05:08:52.849Z | 03;00H ^[ |
918 | 2025-01-15T05:08:52.882Z | 04;00H ^[ |
919 | 2025-01-15T05:08:52.916Z | 05;00HInitializing Intel(R) Boot Agent GE v1.5.53 ^[ |
920 | 2025-01-15T05:08:52.949Z | 06;00HPXE 2.1 Build 092 (WfM 2.0) ^[ |
921 | 2025-01-15T05:08:52.983Z | 07;00HPress Ctrl+S to enter the Setup Menu. ^[ |
922 | 2025-01-15T05:08:53.017Z | 08;00H ^[ |
923 | 2025-01-15T05:08:53.052Z | 09;00H ^[ |
924 | 2025-01-15T05:08:53.108Z | 10;00H ^[ |
925 | 2025-01-15T05:08:53.164Z | 11;00H ^[ |
926 | 2025-01-15T05:08:53.251Z | 12;00H ^[ |
927 | 2025-01-15T05:08:53.298Z | 13;00H ^[ |
928 | 2025-01-15T05:08:53.331Z | 14;00H ^[ |
929 | 2025-01-15T05:08:53.365Z | 15;00H ^[ |
930 | 2025-01-15T05:08:53.398Z | 16;00H ^[ |
931 | 2025-01-15T05:08:53.431Z | 17;00H ^[ |
932 | 2025-01-15T05:08:53.745Z | 18;00H ^[ |
933 | 2025-01-15T05:08:53.785Z | 19;00H ^[ |
934 | 2025-01-15T05:08:53.833Z | 20;00H ^[ |
935 | 2025-01-15T05:08:53.877Z | 21;00H ^[ |
936 | 2025-01-15T05:08:53.910Z | 22;00H ^[ |
937 | 2025-01-15T05:08:53.944Z | 23;00H ^[ |
938 | 2025-01-15T05:08:53.977Z | 24;00H ^[ |
939 | 2025-01-15T05:08:54.015Z | 24;00H^[[07;39H^[[07;00HPress Ctrl+S to enter the Setup Menu.. |
940 | 2025-01-15T05:08:56.837Z | ^[[07;39H^[[2J^[[1;1H^[[8;25;80t^[ |
941 | 2025-01-15T05:08:56.866Z | 2J^[[1;1H^[[1;1H^[[0;37;40mPress <DEL> to enter setup, <F10> Display |
942 | 2025-01-15T05:08:57.470Z | Boot Menu, <F12> Force Network Boot B2^[ |
943 | 2025-01-15T05:08:57.502Z | 2;1H^[[2;1H^[[2;1H |
944 | 2025-01-15T05:08:57.558Z | ^[[3;1H^[[3;1HBIOS Version: MZ32-AR0- |
945 | 2025-01-15T05:08:57.603Z | 0-M06 ^[[4;1H^[[4 |
946 | 2025-01-15T05:08:57.648Z | 1HBIOS Date: 07/10/2021 ^[ |
947 | 2025-01-15T05:08:57.917Z | 5;1H^[[5;1HProcessor Type: AMD EPYC 7413 24-Core Processor |
948 | 2025-01-15T05:08:58.007Z | ^[[6;1H^[[6;1HProcessor Speed: 2650 MHz |
949 | 2025-01-15T05:08:58.064Z | ^[[7;1H^[[7;1HTot |
950 | 2025-01-15T05:08:58.098Z | l Memory: 131072MB (DDR4 3200) ^[ |
951 | 2025-01-15T05:08:58.132Z | 8;1H^[[8;1HBMC Firmware Version: 12.54.05 |
952 | 2025-01-15T05:08:58.165Z | ^[[9;1H^[[9;1HBMC IP : 172.20.4.56 |
953 | 2025-01-15T05:08:58.199Z | ^[[10;1H |
954 | 2025-01-15T05:08:58.232Z | ^[ |
955 | 2025-01-15T05:08:58.266Z | 11;1H^[[11;1H |
956 | 2025-01-15T05:08:58.299Z | ^[[12;1H^[[12;1HUSB Devices total: 0 KBDs |
957 | 2025-01-15T05:08:58.334Z | 0 MICE, 0 MASS, 3 HUBs ^[[13;1H^[[13 |
958 | 2025-01-15T05:08:58.367Z | 1H ^[ |
959 | 2025-01-15T05:08:58.400Z | 14;1H^[[14;1HDetected ATA/ATAPI Devices... |
960 | 2025-01-15T05:08:58.434Z | ^[[15;1H^[[15;1H |
961 | 2025-01-15T05:08:58.467Z | ^[[16;1H^[[16 |
962 | 2025-01-15T05:08:58.501Z | 1HDetected NVME Devices... ^[ |
963 | 2025-01-15T05:08:58.535Z | 17;1H^[[17;1HHP SSD EX950 1TB Size: 1024.2GB |
964 | 2025-01-15T05:08:58.568Z | ^[[18;1H^[[18;1HHP SSD EX950 1TB Size: 10 |
965 | 2025-01-15T05:09:01.934Z | 4.2GB ^[[19;1H^[[19 |
966 | 2025-01-15T05:09:02.520Z | 1HPreparing Bios Setup configuration.... ^[ |
967 | 2025-01-15T05:09:02.558Z | 20;1H^[[20;1HImporting Bios settings from BMC. |
968 | 2025-01-15T05:09:03.424Z | ^[[21;1H^[[21;1H |
969 | 2025-01-15T05:09:17.286Z | ^[[2J^[[1;1H^[ |
970 | 2025-01-15T05:09:18.438Z | 2J^[[1;1H^[[2J^[[1;1H^[[01;00H |
971 | 2025-01-15T05:09:34.882Z | iPXE initialising devices...ok |
972 | 2025-01-15T05:09:34.926Z | ^[[0m |
973 | 2025-01-15T05:09:34.971Z | ^[[1miPXE 1.21.1+ (g8bff5)^[[0m -- Open Source Network Boot Firmwar |
974 | 2025-01-15T05:09:35.004Z | -- ^[[36mhttp://ipxe.org^[[0m |
975 | 2025-01-15T05:09:35.038Z | Features: DNS HTTP iSCSI TFTP SRP AoE ELF MBOOT PXE bzImage Menu PXEXT |
976 | 2025-01-15T05:09:37.028Z | net0: 18:c0:4d:0d:a0:2a using i350 on 0000:c3:00.0 (Ethernet) [open] |
977 | 2025-01-15T05:09:37.061Z | [Link:up, TX:0 TXE:1 RX:0 RXE:0] |
978 | 2025-01-15T05:09:37.094Z | [TXE: 1 x "Network unreachable (http://ipxe.org/28086011)"] |
979 | 2025-01-15T05:09:39.988Z | Configuring (net0 18:c0:4d:0d:a0:2a)...... ok |
980 | 2025-01-15T05:09:40.029Z | net0: 10.151.2.100/255.255.255.0 gw 10.151.2.1 |
981 | 2025-01-15T05:09:40.158Z | Filename: http://172.20.0.5:9969/ipxe/sock |
982 | 2025-01-15T05:09:40.195Z | http://172.20.0.5:9969/ipxe/sock... ok |
983 | 2025-01-15T05:09:40.228Z | sock : 555 bytes [script] |
984 | 2025-01-15T05:11:39.695Z | worker failed without completing job |
985 | 2025-01-15T05:11:39.696Z | task 2 was incomplete, marked failed |