|
|
|
1 | 2023-10-21T17:10:16.068Z | job dependencies complete; ready to run (waiting for 51 m 1 s) |
2 | 2023-10-21T17:11:00.413Z | job assigned to worker 01HD9KETRNAH2BGPNY97JRNEFR (queued for 44 s) |
3 | 2023-10-21T17:11:00.600Z | http://172.20.0.5:9969/ipxe/buskin... ok |
4 | 2023-10-21T17:11:00.655Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok |
5 | 2023-10-21T17:11:00.688Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok |
6 | 2023-10-21T17:11:00.722Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok |
7 | 2023-10-21T17:11:00.755Z | http://172.20.0.5:9969/postboot/buskin... ok |
8 | 2023-10-21T17:11:00.789Z | wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U |
9 | 2023-10-21T17:11:00.822Z | cpu0: microcode has been updated from version 0xa001133 to 0xa0011d1 |
10 | 2023-10-21T17:11:00.857Z | Oxide Helios Version helios-2.0.22241 64-bit |
11 | 2023-10-21T17:11:00.888Z | Configuring device. |
12 | 2023-10-21T17:11:00.922Z | ################################################# |
13 | 2023-10-21T17:11:00.956Z | #### ############# ## |
14 | 2023-10-21T17:11:00.989Z | ### ### ############ ## |
15 | 2023-10-21T17:11:01.025Z | ## ### # ## ### ## Oxide Computer Company ## |
16 | 2023-10-21T17:11:01.068Z | ## ## ## ### # ### ## |
17 | 2023-10-21T17:11:01.100Z | ## # ### #### #### This Station Under ## |
18 | 2023-10-21T17:11:01.136Z | ### ### #### # ### Computer Control ## |
19 | 2023-10-21T17:11:01.167Z | #### #### ### ## ## |
20 | 2023-10-21T17:11:01.201Z | ################################################## |
21 | 2023-10-21T17:11:01.234Z | Hostname: buskin |
22 | 2023-10-21T17:11:01.268Z | Loading smf(7) serice descriptions: |
23 | 2023-10-21T17:11:01.488Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-49e31e75b930b622.gz |
24 | 2023-10-21T17:11:03.041Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-49e31e75b930b622.gz |
25 | 2023-10-21T17:11:03.068Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
26 | 2023-10-21T17:11:24.396Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
27 | 2023-10-21T17:11:24.420Z | downloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a91cf9af3457d280.gz |
28 | 2023-10-21T17:11:56.580Z | downloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a91cf9af3457d280.gz |
29 | 2023-10-21T17:11:56.605Z | downloading input: /input/ci-tools/work/caboose-util.gz |
30 | 2023-10-21T17:11:57.585Z | downloaded input: /input/ci-tools/work/caboose-util.gz |
31 | 2023-10-21T17:11:57.609Z | downloading input: /input/ci-tools/work/tufaceous.gz |
32 | 2023-10-21T17:12:00.740Z | downloaded input: /input/ci-tools/work/tufaceous.gz |
33 | 2023-10-21T17:12:00.769Z | downloading input: /input/package/work/version.txt |
34 | 2023-10-21T17:12:00.801Z | downloaded input: /input/package/work/version.txt |
35 | 2023-10-21T17:12:00.833Z | downloading input: /input/package/work/package.tar.gz |
36 | 2023-10-21T17:12:22.345Z | downloaded input: /input/package/work/package.tar.gz |
37 | 2023-10-21T17:12:22.370Z | downloading input: /input/package/work/global-zone-packages.tar.gz |
38 | 2023-10-21T17:12:54.571Z | downloaded input: /input/package/work/global-zone-packages.tar.gz |
39 | 2023-10-21T17:12:54.597Z | downloading input: /input/package/work/trampoline-global-zone-packages.tar.gz |
40 | 2023-10-21T17:13:05.635Z | downloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz |
41 | 2023-10-21T17:13:05.666Z | downloading input: /input/package/work/zones/clickhouse.tar.gz |
42 | 2023-10-21T17:14:04.693Z | downloaded input: /input/package/work/zones/clickhouse.tar.gz |
43 | 2023-10-21T17:14:04.717Z | downloading input: /input/package/work/zones/clickhouse_keeper.tar.gz |
44 | 2023-10-21T17:14:41.042Z | downloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz |
45 | 2023-10-21T17:14:41.068Z | downloading input: /input/package/work/zones/cockroachdb.tar.gz |
46 | 2023-10-21T17:15:04.560Z | downloaded input: /input/package/work/zones/cockroachdb.tar.gz |
47 | 2023-10-21T17:15:04.586Z | downloading input: /input/package/work/zones/crucible-pantry.tar.gz |
48 | 2023-10-21T17:15:08.923Z | downloaded input: /input/package/work/zones/crucible-pantry.tar.gz |
49 | 2023-10-21T17:15:08.950Z | downloading input: /input/package/work/zones/crucible.tar.gz |
50 | 2023-10-21T17:15:17.366Z | downloaded input: /input/package/work/zones/crucible.tar.gz |
51 | 2023-10-21T17:15:17.397Z | downloading input: /input/package/work/zones/external-dns.tar.gz |
52 | 2023-10-21T17:15:21.395Z | downloaded input: /input/package/work/zones/external-dns.tar.gz |
53 | 2023-10-21T17:15:21.420Z | downloading input: /input/package/work/zones/internal-dns.tar.gz |
54 | 2023-10-21T17:15:26.761Z | downloaded input: /input/package/work/zones/internal-dns.tar.gz |
55 | 2023-10-21T17:15:26.785Z | downloading input: /input/package/work/zones/ntp.tar.gz |
56 | 2023-10-21T17:15:26.809Z | downloaded input: /input/package/work/zones/ntp.tar.gz |
57 | 2023-10-21T17:15:26.833Z | downloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
58 | 2023-10-21T17:15:31.571Z | downloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
59 | 2023-10-21T17:15:31.599Z | downloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
60 | 2023-10-21T17:15:34.887Z | downloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
61 | 2023-10-21T17:15:34.912Z | downloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
62 | 2023-10-21T17:15:48.991Z | downloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
63 | 2023-10-21T17:15:49.015Z | downloading input: /input/package/work/zones/omicron-nexus.tar.gz |
64 | 2023-10-21T17:16:01.854Z | downloaded input: /input/package/work/zones/omicron-nexus.tar.gz |
65 | 2023-10-21T17:16:01.878Z | downloading input: /input/package/work/zones/overlay.tar.gz |
66 | 2023-10-21T17:16:01.904Z | downloaded input: /input/package/work/zones/overlay.tar.gz |
67 | 2023-10-21T17:16:01.928Z | downloading input: /input/package/work/zones/oximeter-collector.tar.gz |
68 | 2023-10-21T17:16:05.294Z | downloaded input: /input/package/work/zones/oximeter-collector.tar.gz |
69 | 2023-10-21T17:16:05.321Z | downloading input: /input/package/work/zones/propolis-server.tar.gz |
70 | 2023-10-21T17:16:21.576Z | downloaded input: /input/package/work/zones/propolis-server.tar.gz |
71 | 2023-10-21T17:16:21.621Z | downloading input: /input/package/work/zones/switch-asic.tar.gz |
72 | 2023-10-21T17:17:12.337Z | downloaded input: /input/package/work/zones/switch-asic.tar.gz |
73 | 2023-10-21T17:17:12.362Z | downloading input: /input/package/work/zones/switch-softnpu.tar.gz |
74 | 2023-10-21T17:17:44.535Z | downloaded input: /input/package/work/zones/switch-softnpu.tar.gz |
|
75 | 2023-10-21T17:17:44.567Z | starting task 0: "setup" |
76 | 2023-10-21T17:17:44.601Z | ++ uname -s |
77 | 2023-10-21T17:17:44.626Z | + kern=SunOS |
78 | 2023-10-21T17:17:44.651Z | + case "$kern" in |
79 | 2023-10-21T17:17:44.679Z | + groupadd -g 12345 build |
80 | 2023-10-21T17:17:44.704Z | + useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build |
81 | 2023-10-21T17:17:46.611Z | + zfs create -o mountpoint=/work rpool/work |
82 | 2023-10-21T17:17:46.635Z | ++ awk '$2 == "/home" { print $3 }' /etc/mnttab |
83 | 2023-10-21T17:17:46.668Z | + home_fs=zfs |
84 | 2023-10-21T17:17:46.696Z | + [[ zfs == autofs ]] |
85 | 2023-10-21T17:17:46.741Z | + mkdir -p /home/build |
86 | 2023-10-21T17:17:46.776Z | + chown build:build /home/build /work |
87 | 2023-10-21T17:17:48.635Z | + chmod 0700 /home/build /work |
88 | 2023-10-21T17:17:48.660Z | process exited: duration 4045 ms, exit code 0 |
|
89 | 2023-10-21T17:17:48.709Z | starting task 1: "authentication" |
90 | 2023-10-21T17:17:48.777Z | process exited: duration 44 ms, exit code 0 |
|
91 | 2023-10-21T17:17:48.826Z | starting task 2: "build" |
92 | 2023-10-21T17:17:48.857Z | + trap _exit_trap EXIT |
93 | 2023-10-21T17:17:48.881Z | + pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3' |
94 | 2023-10-21T17:17:49.054Z | secpolicy_fs_linkdir: 0x55 = 0x55 |
95 | 2023-10-21T17:17:49.081Z | secpolicy_fs_linkdir+1: 0xb8 = 0x48 |
96 | 2023-10-21T17:17:49.124Z | secpolicy_fs_linkdir+2: 0x1 = 0x89 |
97 | 2023-10-21T17:17:49.149Z | secpolicy_fs_linkdir+3: 0 = 0xe5 |
98 | 2023-10-21T17:17:49.174Z | secpolicy_fs_linkdir+4: 0 = 0xb8 |
99 | 2023-10-21T17:17:49.198Z | secpolicy_fs_linkdir+5: 0 = 0x1 |
100 | 2023-10-21T17:17:49.222Z | secpolicy_fs_linkdir+6: 0x48 = 0x0 |
101 | 2023-10-21T17:17:49.246Z | secpolicy_fs_linkdir+7: 0x89 = 0x0 |
102 | 2023-10-21T17:17:49.270Z | secpolicy_fs_linkdir+8: 0xe5 = 0x0 |
103 | 2023-10-21T17:17:49.294Z | secpolicy_fs_linkdir+9: 0x48 = 0x5d |
104 | 2023-10-21T17:17:49.318Z | secpolicy_fs_linkdir+0xa: 0x83 = 0xc3 |
105 | 2023-10-21T17:17:49.342Z | + [[ -d /opt/oxide ]] |
106 | 2023-10-21T17:17:49.366Z | + pfexec mv /opt/oxide /opt/oxide-underneath |
107 | 2023-10-21T17:17:49.390Z | + pfexec mkdir /opt/oxide |
108 | 2023-10-21T17:17:49.416Z | + pfexec mount -F tmpfs -O swap /opt/oxide |
109 | 2023-10-21T17:17:49.441Z | + [[ -d /opt/oxide-underneath ]] |
110 | 2023-10-21T17:17:49.465Z | + cd /opt/oxide-underneath |
111 | 2023-10-21T17:17:49.489Z | + pfexec tar ceEp@/f - . |
112 | 2023-10-21T17:17:49.513Z | + cd /opt/oxide |
113 | 2023-10-21T17:17:49.537Z | + pfexec tar xveEp@/f - |
114 | 2023-10-21T17:17:49.561Z | x ., 0 bytes, 0 tape blocks |
115 | 2023-10-21T17:17:49.585Z | x ./opte, 0 bytes, 0 tape blocks |
116 | 2023-10-21T17:17:49.609Z | x ./opte/bin, 0 bytes, 0 tape blocks |
117 | 2023-10-21T17:17:49.633Z | x ./opte/bin/opteadm, 50714832 bytes, 99053 tape blocks |
118 | 2023-10-21T17:17:49.657Z | + pfexec rm -rf /opt/oxide-underneath |
119 | 2023-10-21T17:17:49.681Z | + pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone |
120 | 2023-10-21T17:17:49.705Z | + pfexec mkdir /opt/oxide/work |
121 | 2023-10-21T17:17:49.729Z | + pfexec chown build:build /opt/oxide/work |
122 | 2023-10-21T17:17:49.753Z | + cd /opt/oxide/work |
123 | 2023-10-21T17:17:49.777Z | + ptime -m tar xvzf /input/package/work/package.tar.gz |
124 | 2023-10-21T17:17:50.777Z | Decompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'... |
125 | 2023-10-21T17:17:50.818Z | x out/mg-ddm-gz.tar, 63638528 bytes, 124294 tape blocks |
126 | 2023-10-21T17:17:50.845Z | x out/omicron-sled-agent.tar, 115460608 bytes, 225509 tape blocks |
127 | 2023-10-21T17:17:50.873Z | x out/target/test, 75 bytes, 1 tape blocks |
128 | 2023-10-21T17:17:50.918Z | x out/npuzone/npuzone, 37381232 bytes, 73011 tape blocks |
129 | 2023-10-21T17:17:50.965Z | x package-manifest.toml, 22037 bytes, 44 tape blocks |
130 | 2023-10-21T17:17:51.015Z | x smf/sled-agent/non-gimlet/config.toml, 3097 bytes, 7 tape blocks |
131 | 2023-10-21T17:17:51.075Z | x target/release/omicron-package, 38196032 bytes, 74602 tape blocks |
132 | 2023-10-21T17:17:51.122Z | x tools/create_virtual_hardware.sh, 2986 bytes, 6 tape blocks |
133 | 2023-10-21T17:17:51.210Z | x tools/virtual_hardware.sh, 3408 bytes, 7 tape blocks |
134 | 2023-10-21T17:17:51.278Z | x tools/scrimlet/create-softnpu-zone.sh, 619 bytes, 2 tape blocks |
135 | 2023-10-21T17:17:51.402Z | x tools/scrimlet/destroy-softnpu-zone.sh, 195 bytes, 1 tape blocks |
136 | 2023-10-21T17:17:51.665Z | x tools/scrimlet/softnpu-init.sh, 2148 bytes, 5 tape blocks |
137 | 2023-10-21T17:18:04.405Z | x tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks |
138 | 2023-10-21T17:18:04.615Z | x tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks |
139 | 2023-10-21T17:18:04.925Z | |
140 | 2023-10-21T17:18:05.317Z | real 1.557534478 |
141 | 2023-10-21T17:18:05.518Z | user 1.401837038 |
142 | 2023-10-21T17:18:05.808Z | sys 0.276661540 |
143 | 2023-10-21T17:18:05.868Z | trap 0.000058271 |
144 | 2023-10-21T17:18:05.959Z | tflt 0.000000000 |
145 | 2023-10-21T17:18:06.006Z | dflt 0.000000000 |
146 | 2023-10-21T17:18:06.064Z | kflt 0.000000000 |
147 | 2023-10-21T17:18:06.114Z | lock 0.000000000 |
148 | 2023-10-21T17:18:06.155Z | slp 1.398581672 |
149 | 2023-10-21T17:18:06.222Z | lat 0.035986401 |
150 | 2023-10-21T17:18:06.256Z | stop 0.000117321 |
151 | 2023-10-21T17:18:06.285Z | + cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter-collector.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/ |
152 | 2023-10-21T17:18:06.326Z | + mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz |
153 | 2023-10-21T17:18:06.392Z | + mkdir tests |
154 | 2023-10-21T17:18:06.421Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
155 | 2023-10-21T17:18:06.465Z | + ptime -m gunzip |
156 | 2023-10-21T17:18:06.498Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-49e31e75b930b622 |
157 | 2023-10-21T17:18:06.528Z | |
158 | 2023-10-21T17:18:06.556Z | real 0.143542176 |
159 | 2023-10-21T17:18:06.582Z | user 0.129844850 |
160 | 2023-10-21T17:18:06.609Z | sys 0.013473783 |
161 | 2023-10-21T17:18:06.636Z | trap 0.000009680 |
162 | 2023-10-21T17:18:06.665Z | tflt 0.000000000 |
163 | 2023-10-21T17:18:06.698Z | dflt 0.000000000 |
164 | 2023-10-21T17:18:06.753Z | kflt 0.000000000 |
165 | 2023-10-21T17:18:06.779Z | lock 0.000000000 |
166 | 2023-10-21T17:18:06.809Z | slp 0.000019680 |
167 | 2023-10-21T17:18:06.840Z | lat 0.000019640 |
168 | 2023-10-21T17:18:06.866Z | stop 0.000115371 |
169 | 2023-10-21T17:18:06.899Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-49e31e75b930b622 |
170 | 2023-10-21T17:18:06.931Z | + chmod a+x tests/bootstrap-49e31e75b930b622 |
171 | 2023-10-21T17:18:06.958Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
172 | 2023-10-21T17:18:06.984Z | + ptime -m gunzip |
173 | 2023-10-21T17:18:07.020Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
174 | 2023-10-21T17:18:07.054Z | |
175 | 2023-10-21T17:18:07.088Z | real 2.252661307 |
176 | 2023-10-21T17:18:07.129Z | user 2.101885747 |
177 | 2023-10-21T17:18:07.165Z | sys 0.150375743 |
178 | 2023-10-21T17:18:07.191Z | trap 0.000178623 |
179 | 2023-10-21T17:18:07.279Z | tflt 0.000000000 |
180 | 2023-10-21T17:18:07.311Z | dflt 0.000000000 |
181 | 2023-10-21T17:18:07.340Z | kflt 0.000000000 |
182 | 2023-10-21T17:18:07.370Z | lock 0.000000000 |
183 | 2023-10-21T17:18:07.396Z | slp 0.000020770 |
184 | 2023-10-21T17:18:07.425Z | lat 0.000018119 |
185 | 2023-10-21T17:18:07.458Z | stop 0.000119372 |
186 | 2023-10-21T17:18:07.900Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
187 | 2023-10-21T17:18:07.933Z | + chmod a+x tests/bootstrap |
188 | 2023-10-21T17:18:07.986Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
189 | 2023-10-21T17:18:08.018Z | + ptime -m gunzip |
190 | 2023-10-21T17:18:08.049Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a91cf9af3457d280 |
191 | 2023-10-21T17:18:08.077Z | |
192 | 2023-10-21T17:18:08.103Z | real 2.552525010 |
193 | 2023-10-21T17:18:08.136Z | user 2.391904430 |
194 | 2023-10-21T17:18:08.172Z | sys 0.160164126 |
195 | 2023-10-21T17:18:08.216Z | trap 0.000199952 |
196 | 2023-10-21T17:18:08.257Z | tflt 0.000000000 |
197 | 2023-10-21T17:18:08.320Z | dflt 0.000000000 |
198 | 2023-10-21T17:18:08.351Z | kflt 0.000000000 |
199 | 2023-10-21T17:18:08.410Z | lock 0.000000000 |
200 | 2023-10-21T17:18:08.456Z | slp 0.000023850 |
201 | 2023-10-21T17:18:08.488Z | lat 0.000040660 |
202 | 2023-10-21T17:18:08.520Z | stop 0.000125741 |
203 | 2023-10-21T17:18:08.547Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-a91cf9af3457d280 |
204 | 2023-10-21T17:18:08.582Z | + chmod a+x tests/end_to_end_tests-a91cf9af3457d280 |
205 | 2023-10-21T17:18:08.608Z | NAME CIDR FIRST LAST COUNT |
206 | 2023-10-21T17:18:08.643Z | + bmat address ls |
207 | 2023-10-21T17:18:08.672Z | extra 10.151.1.0/24 10.151.1.164 10.151.1.227 64 |
208 | 2023-10-21T17:18:08.710Z | ++ bmat address ls -f extra -Ho first,last,count |
209 | 2023-10-21T17:18:08.755Z | PING 10.151.1.100: 56 data bytes |
210 | 2023-10-21T17:18:08.799Z | + set -- 10.151.1.164 10.151.1.227 64 |
211 | 2023-10-21T17:18:08.833Z | 64 bytes from 10.151.1.100: icmp_seq=0. time=0.010 ms |
212 | 2023-10-21T17:18:08.871Z | + EXTRA_IP_START=10.151.1.164 |
213 | 2023-10-21T17:18:08.914Z | |
214 | 2023-10-21T17:18:08.950Z | + EXTRA_IP_END=10.151.1.227 |
215 | 2023-10-21T17:18:08.993Z | ----10.151.1.100 PING Statistics---- |
216 | 2023-10-21T17:18:09.029Z | + EXTRA_IP_COUNT=64 |
217 | 2023-10-21T17:18:09.057Z | 1 packets transmitted, 1 packets received, 0% packet loss |
218 | 2023-10-21T17:18:09.094Z | + (( EXTRA_IP_COUNT >= 32 )) |
219 | 2023-10-21T17:18:09.120Z | round-trip (ms) min/avg/max/stddev = 0.010/0.010/0.010/-nan |
220 | 2023-10-21T17:18:09.165Z | + EXTRA_IP_BASE=10.151.1 |
221 | 2023-10-21T17:18:09.200Z | Using igb0 as physical link |
222 | 2023-10-21T17:18:09.235Z | + EXTRA_IP_FOCTET=164 |
223 | 2023-10-21T17:18:09.264Z | Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b] |
224 | 2023-10-21T17:18:09.307Z | + EXTRA_IP_LOCTET=227 |
225 | 2023-10-21T17:18:09.389Z | ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
226 | 2023-10-21T17:18:09.414Z | + SERVICE_IP_POOL_START=10.151.1.164 |
227 | 2023-10-21T17:18:09.455Z | ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
228 | 2023-10-21T17:18:09.505Z | + SERVICE_IP_POOL_END=10.151.1.173 |
229 | 2023-10-21T17:18:09.549Z | Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
230 | 2023-10-21T17:18:09.578Z | + DNS_IP1=10.151.1.164 |
231 | 2023-10-21T17:18:09.621Z | ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
232 | 2023-10-21T17:18:09.647Z | + DNS_IP2=10.151.1.165 |
233 | 2023-10-21T17:18:09.679Z | ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
234 | 2023-10-21T17:18:09.718Z | + UPLINK_IP=10.151.1.174 |
235 | 2023-10-21T17:18:09.765Z | Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
236 | 2023-10-21T17:18:09.804Z | + IPPOOL_START=10.151.1.175 |
237 | 2023-10-21T17:18:09.831Z | ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
238 | 2023-10-21T17:18:09.862Z | + IPPOOL_END=10.151.1.227 |
239 | 2023-10-21T17:18:09.894Z | ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
240 | 2023-10-21T17:18:09.926Z | ++ ipadm show-addr -po type,addr |
241 | 2023-10-21T17:18:09.953Z | Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03] |
242 | 2023-10-21T17:18:09.978Z | ++ awk '-F[:/]' '$1 == "dhcp" {print $2}' |
243 | 2023-10-21T17:18:10.003Z | ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
244 | 2023-10-21T17:18:10.033Z | + GATEWAY_IP=10.151.1.100 |
245 | 2023-10-21T17:18:10.062Z | ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
246 | 2023-10-21T17:18:10.092Z | + [[ -n 10.151.1.100 ]] |
247 | 2023-10-21T17:18:10.122Z | Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03] |
248 | 2023-10-21T17:18:10.150Z | + ping -s 10.151.1.100 56 1 |
249 | 2023-10-21T17:18:10.176Z | ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
250 | 2023-10-21T17:18:10.206Z | ++ arp -an |
251 | 2023-10-21T17:18:10.236Z | ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
252 | 2023-10-21T17:18:10.261Z | ++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}' |
253 | 2023-10-21T17:18:10.286Z | Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930] |
254 | 2023-10-21T17:18:10.310Z | + GATEWAY_MAC=18:c0:4d:0d:9f:b2 |
255 | 2023-10-21T17:18:10.336Z | ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists |
256 | 2023-10-21T17:18:10.390Z | + routeadm -e ipv4-forwarding -u |
257 | 2023-10-21T17:18:10.451Z | ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists |
258 | 2023-10-21T17:18:10.485Z | + PXA_START=10.151.1.164 |
259 | 2023-10-21T17:18:10.516Z | Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60] |
260 | 2023-10-21T17:18:10.546Z | + PXA_END=10.151.1.227 |
261 | 2023-10-21T17:18:10.571Z | ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists |
262 | 2023-10-21T17:18:10.599Z | + export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END |
263 | 2023-10-21T17:18:10.629Z | ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists |
264 | 2023-10-21T17:18:10.659Z | + pfexec zpool create -f scratch c1t1d0 c2t1d0 |
265 | 2023-10-21T17:18:11.132Z | Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f] |
266 | 2023-10-21T17:18:11.157Z | + ZPOOL_VDEV_DIR=/scratch |
267 | 2023-10-21T17:18:11.183Z | ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists |
268 | 2023-10-21T17:18:11.209Z | + ptime -m pfexec ./tools/create_virtual_hardware.sh |
269 | 2023-10-21T17:18:11.239Z | ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists |
270 | 2023-10-21T17:18:11.264Z | +++ dirname ./tools/create_virtual_hardware.sh |
271 | 2023-10-21T17:18:11.288Z | Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7] |
272 | 2023-10-21T17:18:11.317Z | ++ cd ./tools |
273 | 2023-10-21T17:18:11.350Z | ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists |
274 | 2023-10-21T17:18:11.379Z | ++ pwd |
275 | 2023-10-21T17:18:11.416Z | ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists |
276 | 2023-10-21T17:18:11.442Z | + SOURCE_DIR=/opt/oxide/work/tools |
277 | 2023-10-21T17:18:11.515Z | Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b] |
278 | 2023-10-21T17:18:11.576Z | + OMICRON_TOP=/opt/oxide/work/tools/.. |
279 | 2023-10-21T17:18:11.619Z | ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
280 | 2023-10-21T17:18:11.725Z | + . /opt/oxide/work/tools/virtual_hardware.sh |
281 | 2023-10-21T17:18:11.749Z | ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
282 | 2023-10-21T17:18:11.775Z | ++ MARKER=/etc/opt/oxide/NO_INSTALL |
283 | 2023-10-21T17:18:11.799Z | Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b] |
284 | 2023-10-21T17:18:11.831Z | ++ [[ -f /etc/opt/oxide/NO_INSTALL ]] |
285 | 2023-10-21T17:18:11.858Z | ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
286 | 2023-10-21T17:18:11.883Z | ++ dladm show-phys -p -o LINK |
287 | 2023-10-21T17:18:11.908Z | ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
288 | 2023-10-21T17:18:11.932Z | ++ head -1 |
289 | 2023-10-21T17:18:11.956Z | Simnet net0/sc0_0 exists |
290 | 2023-10-21T17:18:11.980Z | + PHYSICAL_LINK=igb0 |
291 | 2023-10-21T17:18:12.004Z | Simnet net1/sc1_0 exists |
292 | 2023-10-21T17:18:12.028Z | + echo 'Using igb0 as physical link' |
293 | 2023-10-21T17:18:12.052Z | Vnic sc0_1 exists |
294 | 2023-10-21T17:18:12.076Z | + ensure_run_as_root |
295 | 2023-10-21T17:18:12.100Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/c1c42398c82b0220c8b5fa3bfba9c7a3bcaa0943/softnpu.sha256.txt |
296 | 2023-10-21T17:18:12.124Z | ++ id -u |
297 | 2023-10-21T17:18:12.148Z | + [[ 0 -ne 0 ]] |
298 | 2023-10-21T17:18:12.172Z | + ensure_zpools |
299 | 2023-10-21T17:18:12.196Z | + ZPOOL_TYPES=('oxp_' 'oxi_') |
300 | 2023-10-21T17:18:12.227Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
301 | 2023-10-21T17:18:12.253Z | + readarray -t ZPOOLS |
302 | 2023-10-21T17:18:12.277Z | ++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
303 | 2023-10-21T17:18:12.301Z | ++ sed 's/[ ",]//g' |
304 | 2023-10-21T17:18:12.325Z | + for ZPOOL in "${ZPOOLS[@]}" |
305 | 2023-10-21T17:18:12.350Z | + echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
306 | 2023-10-21T17:18:12.376Z | + VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
307 | 2023-10-21T17:18:12.400Z | + [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
308 | 2023-10-21T17:18:12.424Z | + dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
309 | 2023-10-21T17:18:12.448Z | 0+0 records in |
310 | 2023-10-21T17:18:12.473Z | 0+0 records out |
311 | 2023-10-21T17:18:12.497Z | 0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec) |
312 | 2023-10-21T17:18:12.550Z | + success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
313 | 2023-10-21T17:18:12.575Z | + set +x |
314 | 2023-10-21T17:18:12.599Z | ++ zpool list -o name |
315 | 2023-10-21T17:18:12.623Z | ++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b |
316 | 2023-10-21T17:18:12.649Z | + [[ -z '' ]] |
317 | 2023-10-21T17:18:12.675Z | + zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
318 | 2023-10-21T17:18:12.701Z | + success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
319 | 2023-10-21T17:18:12.727Z | + set +x |
320 | 2023-10-21T17:18:12.760Z | + for ZPOOL in "${ZPOOLS[@]}" |
321 | 2023-10-21T17:18:12.787Z | + echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
322 | 2023-10-21T17:18:12.811Z | + VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
323 | 2023-10-21T17:18:12.835Z | + [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
324 | 2023-10-21T17:18:12.859Z | + dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
325 | 2023-10-21T17:18:12.885Z | 0+0 records in |
326 | 2023-10-21T17:18:12.909Z | 0+0 records out |
327 | 2023-10-21T17:18:12.935Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
328 | 2023-10-21T17:18:12.960Z | + success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
329 | 2023-10-21T17:18:12.984Z | + set +x |
330 | 2023-10-21T17:18:13.008Z | ++ zpool list -o name |
331 | 2023-10-21T17:18:13.033Z | ++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
332 | 2023-10-21T17:18:13.056Z | + [[ -z '' ]] |
333 | 2023-10-21T17:18:13.081Z | + zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
334 | 2023-10-21T17:18:13.105Z | + success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
335 | 2023-10-21T17:18:13.129Z | + set +x |
336 | 2023-10-21T17:18:13.155Z | + for ZPOOL in "${ZPOOLS[@]}" |
337 | 2023-10-21T17:18:13.182Z | + echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
338 | 2023-10-21T17:18:13.208Z | + VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
339 | 2023-10-21T17:18:13.232Z | + [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
340 | 2023-10-21T17:18:13.257Z | + dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
341 | 2023-10-21T17:18:13.281Z | 0+0 records in |
342 | 2023-10-21T17:18:13.305Z | 0+0 records out |
343 | 2023-10-21T17:18:13.329Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
344 | 2023-10-21T17:18:13.353Z | + success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
345 | 2023-10-21T17:18:13.377Z | + set +x |
346 | 2023-10-21T17:18:13.409Z | ++ zpool list -o name |
347 | 2023-10-21T17:18:13.439Z | ++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
348 | 2023-10-21T17:18:13.466Z | + [[ -z '' ]] |
349 | 2023-10-21T17:18:13.496Z | + zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
350 | 2023-10-21T17:18:13.527Z | + success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
351 | 2023-10-21T17:18:13.604Z | + set +x |
352 | 2023-10-21T17:18:13.648Z | + for ZPOOL in "${ZPOOLS[@]}" |
353 | 2023-10-21T17:18:13.677Z | + echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
354 | 2023-10-21T17:18:13.703Z | + VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
355 | 2023-10-21T17:18:13.733Z | + [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
356 | 2023-10-21T17:18:13.763Z | + dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
357 | 2023-10-21T17:18:13.790Z | 0+0 records in |
358 | 2023-10-21T17:18:13.817Z | 0+0 records out |
359 | 2023-10-21T17:18:13.844Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
360 | 2023-10-21T17:18:13.874Z | + success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
361 | 2023-10-21T17:18:13.900Z | + set +x |
362 | 2023-10-21T17:18:13.926Z | ++ zpool list -o name |
363 | 2023-10-21T17:18:13.954Z | ++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 |
364 | 2023-10-21T17:18:13.982Z | + [[ -z '' ]] |
365 | 2023-10-21T17:18:14.013Z | + zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
366 | 2023-10-21T17:18:14.037Z | + success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
367 | 2023-10-21T17:18:14.062Z | + set +x |
368 | 2023-10-21T17:18:14.095Z | + for ZPOOL in "${ZPOOLS[@]}" |
369 | 2023-10-21T17:18:14.122Z | + echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
370 | 2023-10-21T17:18:14.146Z | + VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
371 | 2023-10-21T17:18:14.170Z | + [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
372 | 2023-10-21T17:18:14.195Z | + dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
373 | 2023-10-21T17:18:14.220Z | 0+0 records in |
374 | 2023-10-21T17:18:14.244Z | 0+0 records out |
375 | 2023-10-21T17:18:14.280Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
376 | 2023-10-21T17:18:14.305Z | + success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
377 | 2023-10-21T17:18:14.330Z | + set +x |
378 | 2023-10-21T17:18:14.354Z | ++ zpool list -o name |
379 | 2023-10-21T17:18:14.378Z | ++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 |
380 | 2023-10-21T17:18:14.406Z | + [[ -z '' ]] |
381 | 2023-10-21T17:18:14.430Z | + zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
382 | 2023-10-21T17:18:14.454Z | + success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
383 | 2023-10-21T17:18:14.478Z | + set +x |
384 | 2023-10-21T17:18:14.503Z | + for ZPOOL in "${ZPOOLS[@]}" |
385 | 2023-10-21T17:18:14.534Z | downloading softnpu ...done |
386 | 2023-10-21T17:18:14.560Z | + echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]' |
387 | 2023-10-21T17:18:14.584Z | + VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
388 | 2023-10-21T17:18:14.608Z | + [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]] |
389 | 2023-10-21T17:18:14.661Z | + dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G |
390 | 2023-10-21T17:18:14.685Z | 0+0 records in |
391 | 2023-10-21T17:18:14.710Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/f397c5da66b2b54b0a288d89f0afaee00eb9a576/libsidecar_lite.so.sha256.txt |
392 | 2023-10-21T17:18:14.734Z | 0+0 records out |
393 | 2023-10-21T17:18:14.758Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
394 | 2023-10-21T17:18:14.782Z | + success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists' |
395 | 2023-10-21T17:18:14.806Z | + set +x |
396 | 2023-10-21T17:18:14.830Z | ++ zpool list -o name |
397 | 2023-10-21T17:18:14.854Z | ++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 |
398 | 2023-10-21T17:18:14.878Z | + [[ -z '' ]] |
399 | 2023-10-21T17:18:14.902Z | + zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
400 | 2023-10-21T17:18:14.930Z | + success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists' |
401 | 2023-10-21T17:18:14.980Z | + set +x |
402 | 2023-10-21T17:18:15.008Z | + for ZPOOL in "${ZPOOLS[@]}" |
403 | 2023-10-21T17:18:15.035Z | + echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]' |
404 | 2023-10-21T17:18:15.059Z | + VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
405 | 2023-10-21T17:18:15.084Z | + [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]] |
406 | 2023-10-21T17:18:15.108Z | + dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G |
407 | 2023-10-21T17:18:15.132Z | 0+0 records in |
408 | 2023-10-21T17:18:15.156Z | 0+0 records out |
409 | 2023-10-21T17:18:15.181Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
410 | 2023-10-21T17:18:15.207Z | + success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists' |
411 | 2023-10-21T17:18:15.231Z | + set +x |
412 | 2023-10-21T17:18:15.257Z | ++ zpool list -o name |
413 | 2023-10-21T17:18:15.281Z | ++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 |
414 | 2023-10-21T17:18:15.305Z | + [[ -z '' ]] |
415 | 2023-10-21T17:18:15.332Z | + zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
416 | 2023-10-21T17:18:15.356Z | + success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists' |
417 | 2023-10-21T17:18:15.385Z | + set +x |
418 | 2023-10-21T17:18:15.824Z | + for ZPOOL in "${ZPOOLS[@]}" |
419 | 2023-10-21T17:18:15.851Z | + echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]' |
420 | 2023-10-21T17:18:15.875Z | + VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
421 | 2023-10-21T17:18:16.309Z | + [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]] |
422 | 2023-10-21T17:18:16.344Z | + dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G |
423 | 2023-10-21T17:18:16.370Z | 0+0 records in |
424 | 2023-10-21T17:18:16.397Z | 0+0 records out |
425 | 2023-10-21T17:18:16.421Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
426 | 2023-10-21T17:18:16.446Z | + success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists' |
427 | 2023-10-21T17:18:16.470Z | + set +x |
428 | 2023-10-21T17:18:16.495Z | ++ zpool list -o name |
429 | 2023-10-21T17:18:16.544Z | ++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f |
430 | 2023-10-21T17:18:16.568Z | + [[ -z '' ]] |
431 | 2023-10-21T17:18:16.593Z | + zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
432 | 2023-10-21T17:18:16.617Z | + success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists' |
433 | 2023-10-21T17:18:16.641Z | + set +x |
434 | 2023-10-21T17:18:16.666Z | + for ZPOOL in "${ZPOOLS[@]}" |
435 | 2023-10-21T17:18:16.696Z | + echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]' |
436 | 2023-10-21T17:18:16.727Z | + VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
437 | 2023-10-21T17:18:16.759Z | + [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]] |
438 | 2023-10-21T17:18:16.784Z | + dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G |
439 | 2023-10-21T17:18:16.809Z | 0+0 records in |
440 | 2023-10-21T17:18:16.833Z | 0+0 records out |
441 | 2023-10-21T17:18:16.857Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
442 | 2023-10-21T17:18:16.881Z | + success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists' |
443 | 2023-10-21T17:18:16.906Z | + set +x |
444 | 2023-10-21T17:18:16.930Z | ++ zpool list -o name |
445 | 2023-10-21T17:18:16.954Z | ++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 |
446 | 2023-10-21T17:18:16.979Z | + [[ -z '' ]] |
447 | 2023-10-21T17:18:17.003Z | + zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
448 | 2023-10-21T17:18:17.028Z | + success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists' |
449 | 2023-10-21T17:18:17.053Z | + set +x |
450 | 2023-10-21T17:18:17.078Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
451 | 2023-10-21T17:18:17.104Z | + readarray -t ZPOOLS |
452 | 2023-10-21T17:18:17.131Z | ++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
453 | 2023-10-21T17:18:17.163Z | ++ sed 's/[ ",]//g' |
454 | 2023-10-21T17:18:17.189Z | + for ZPOOL in "${ZPOOLS[@]}" |
455 | 2023-10-21T17:18:17.217Z | + echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
456 | 2023-10-21T17:18:17.242Z | + VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
457 | 2023-10-21T17:18:17.267Z | + [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
458 | 2023-10-21T17:18:17.294Z | + dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
459 | 2023-10-21T17:18:17.318Z | 0+0 records in |
460 | 2023-10-21T17:18:17.344Z | 0+0 records out |
461 | 2023-10-21T17:18:17.370Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
462 | 2023-10-21T17:18:17.395Z | + success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
463 | 2023-10-21T17:18:17.420Z | + set +x |
464 | 2023-10-21T17:18:17.444Z | ++ zpool list -o name |
465 | 2023-10-21T17:18:17.468Z | ++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b |
466 | 2023-10-21T17:18:17.493Z | + [[ -z '' ]] |
467 | 2023-10-21T17:18:17.517Z | + zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
468 | 2023-10-21T17:18:17.541Z | + success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
469 | 2023-10-21T17:18:17.566Z | + set +x |
470 | 2023-10-21T17:18:17.595Z | + for ZPOOL in "${ZPOOLS[@]}" |
471 | 2023-10-21T17:18:17.622Z | + echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
472 | 2023-10-21T17:18:17.650Z | + VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
473 | 2023-10-21T17:18:17.675Z | + [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
474 | 2023-10-21T17:18:17.699Z | + dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
475 | 2023-10-21T17:18:17.723Z | 0+0 records in |
476 | 2023-10-21T17:18:17.776Z | 0+0 records out |
477 | 2023-10-21T17:18:17.800Z | 0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec) |
478 | 2023-10-21T17:18:17.826Z | + success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
479 | 2023-10-21T17:18:17.850Z | + set +x |
480 | 2023-10-21T17:18:17.874Z | ++ zpool list -o name |
481 | 2023-10-21T17:18:17.898Z | ++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b |
482 | 2023-10-21T17:18:17.923Z | + [[ -z '' ]] |
483 | 2023-10-21T17:18:17.947Z | + zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
484 | 2023-10-21T17:18:17.972Z | + success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
485 | 2023-10-21T17:18:17.996Z | + set +x |
486 | 2023-10-21T17:18:18.023Z | + ensure_simulated_links igb0 |
487 | 2023-10-21T17:18:18.057Z | + local PHYSICAL_LINK=igb0 |
488 | 2023-10-21T17:18:18.085Z | + INDICES=("0" "1") |
489 | 2023-10-21T17:18:18.110Z | + for I in "${INDICES[@]}" |
490 | 2023-10-21T17:18:18.134Z | ++ get_simnet_name_if_exists net0 |
491 | 2023-10-21T17:18:18.158Z | ++ dladm show-simnet -p -o LINK net0 |
492 | 2023-10-21T17:18:18.183Z | ++ echo '' |
493 | 2023-10-21T17:18:18.207Z | + [[ -z '' ]] |
494 | 2023-10-21T17:18:18.231Z | + dladm create-simnet -t net0 |
495 | 2023-10-21T17:18:18.255Z | + dladm create-simnet -t sc0_0 |
496 | 2023-10-21T17:18:18.279Z | + dladm modify-simnet -t -p net0 sc0_0 |
497 | 2023-10-21T17:18:18.304Z | + dladm set-linkprop -p mtu=9000 sc0_0 |
498 | 2023-10-21T17:18:18.328Z | + success 'Simnet net0/sc0_0 exists' |
499 | 2023-10-21T17:18:18.355Z | + set +x |
500 | 2023-10-21T17:18:18.380Z | + for I in "${INDICES[@]}" |
501 | 2023-10-21T17:18:18.407Z | ++ get_simnet_name_if_exists net1 |
502 | 2023-10-21T17:18:18.431Z | ++ dladm show-simnet -p -o LINK net1 |
503 | 2023-10-21T17:18:18.457Z | ++ echo '' |
504 | 2023-10-21T17:18:18.481Z | + [[ -z '' ]] |
505 | 2023-10-21T17:18:18.506Z | + dladm create-simnet -t net1 |
506 | 2023-10-21T17:18:18.530Z | + dladm create-simnet -t sc1_0 |
507 | 2023-10-21T17:18:18.554Z | + dladm modify-simnet -t -p net1 sc1_0 |
508 | 2023-10-21T17:18:18.578Z | + dladm set-linkprop -p mtu=9000 sc1_0 |
509 | 2023-10-21T17:18:18.603Z | + success 'Simnet net1/sc1_0 exists' |
510 | 2023-10-21T17:18:18.627Z | + set +x |
511 | 2023-10-21T17:18:18.651Z | ++ get_vnic_name_if_exists sc0_1 |
512 | 2023-10-21T17:18:18.675Z | ++ dladm show-vnic -p -o LINK sc0_1 |
513 | 2023-10-21T17:18:18.699Z | ++ echo '' |
514 | 2023-10-21T17:18:18.723Z | + [[ -z '' ]] |
515 | 2023-10-21T17:18:18.747Z | + dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d |
516 | 2023-10-21T17:18:18.771Z | + [[ -v PROMISC_FILT_OFF ]] |
517 | 2023-10-21T17:18:18.812Z | + success 'Vnic sc0_1 exists' |
518 | 2023-10-21T17:18:18.846Z | + set +x |
519 | 2023-10-21T17:18:19.279Z | + warn_if_no_proxy_arp |
520 | 2023-10-21T17:18:19.719Z | + [[ -v PXA_START ]] |
521 | 2023-10-21T17:18:19.743Z | + [[ -v PXA_END ]] |
522 | 2023-10-21T17:18:19.768Z | + ensure_softnpu_zone |
523 | 2023-10-21T17:18:21.082Z | + zoneadm list |
524 | 2023-10-21T17:18:21.112Z | + grep -q sidecar_softnpu |
525 | 2023-10-21T17:18:21.136Z | + [[ -f out/npuzone/npuzone ]] |
526 | 2023-10-21T17:18:21.161Z | + out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-branch omicron-tracking |
527 | 2023-10-21T17:18:21.294Z | downloading asic_program.so ...done |
528 | 2023-10-21T17:18:21.485Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/f397c5da66b2b54b0a288d89f0afaee00eb9a576/scadm.sha256.txt |
529 | 2023-10-21T17:18:28.007Z | downloading scadm ...done |
530 | 2023-10-21T17:18:28.032Z | creating port tfportrear0_0 for sc0_0 |
531 | 2023-10-21T17:18:28.058Z | creating port tfportqsfp0_0 for sc0_1 |
532 | 2023-10-21T17:18:28.090Z | softnpu zone setup |
533 | 2023-10-21T17:18:28.115Z | configure zone |
534 | 2023-10-21T17:18:28.140Z | install zone |
535 | 2023-10-21T17:18:29.089Z | boot zone |
536 | 2023-10-21T17:18:32.195Z | [sidecar_softnpu] svcs milestone/network |
537 | 2023-10-21T17:18:32.222Z | STATE STIME FMRI |
538 | 2023-10-21T17:18:32.247Z | online 17:18:30 svc:/milestone/network:default |
539 | 2023-10-21T17:18:32.272Z | [sidecar_softnpu] /softnpu/npu start |
540 | 2023-10-21T17:18:32.296Z | |
541 | 2023-10-21T17:18:32.321Z | + /opt/oxide/work/tools/scrimlet/softnpu-init.sh |
542 | 2023-10-21T17:18:32.351Z | + GATEWAY_IP=10.151.1.100 |
543 | 2023-10-21T17:18:32.375Z | + echo 'Using 10.151.1.100 as gateway ip' |
544 | 2023-10-21T17:18:32.400Z | Using 10.151.1.100 as gateway ip |
545 | 2023-10-21T17:18:32.424Z | + [[ ! -v GATEWAY_MAC ]] |
546 | 2023-10-21T17:18:32.452Z | + GATEWAY_MAC=18:c0:4d:0d:9f:b2 |
547 | 2023-10-21T17:18:32.478Z | ++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63 |
548 | 2023-10-21T17:18:32.512Z | +++ echo 18:c0:4d:0d:9f:b2 |
549 | 2023-10-21T17:18:32.554Z | + COUNT=1 |
550 | 2023-10-21T17:18:32.586Z | + [[ 1 -ne 1 ]] |
551 | 2023-10-21T17:18:32.612Z | + echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac' |
552 | 2023-10-21T17:18:32.637Z | Using 18:c0:4d:0d:9f:b2 as gateway mac |
553 | 2023-10-21T17:18:32.661Z | + z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2 |
554 | 2023-10-21T17:18:32.688Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2 |
555 | 2023-10-21T17:18:32.712Z | + PXA_MAC=a8:e1:de:01:70:1d |
556 | 2023-10-21T17:18:32.741Z | + [[ -v PXA_START ]] |
557 | 2023-10-21T17:18:32.765Z | + z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d |
558 | 2023-10-21T17:18:32.790Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d |
559 | 2023-10-21T17:18:32.814Z | + z_scadm dump-state |
560 | 2023-10-21T17:18:32.838Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
561 | 2023-10-21T17:18:32.862Z | local v6: |
562 | 2023-10-21T17:18:32.902Z | local v4: |
563 | 2023-10-21T17:18:32.939Z | router v6: |
564 | 2023-10-21T17:18:32.964Z | router v4: |
565 | 2023-10-21T17:18:32.988Z | resolver v4: |
566 | 2023-10-21T17:18:33.013Z | 10.151.1.100 -> 18:c0:4d:0d:9f:b2 |
567 | 2023-10-21T17:18:33.037Z | resolver v6: |
568 | 2023-10-21T17:18:33.061Z | nat v4: |
569 | 2023-10-21T17:18:33.089Z | nat_v6: |
570 | 2023-10-21T17:18:33.114Z | port_mac: |
571 | 2023-10-21T17:18:33.139Z | proxy arp: |
572 | 2023-10-21T17:18:33.164Z | 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d |
573 | 2023-10-21T17:18:33.191Z | + success 'softnpu zone exists' |
574 | 2023-10-21T17:18:33.215Z | + set +x |
575 | 2023-10-21T17:18:33.240Z | softnpu zone exists |
576 | 2023-10-21T17:18:33.264Z | |
577 | 2023-10-21T17:18:33.289Z | real 27.075628928 |
578 | 2023-10-21T17:18:33.314Z | user 0.694494299 |
579 | 2023-10-21T17:18:33.338Z | sys 1.568018320 |
580 | 2023-10-21T17:18:33.376Z | trap 0.000083948 |
581 | 2023-10-21T17:18:33.443Z | tflt 0.000120005 |
582 | 2023-10-21T17:18:33.467Z | dflt 0.000665902 |
583 | 2023-10-21T17:18:33.492Z | kflt 0.000000000 |
584 | 2023-10-21T17:18:33.517Z | lock 21:10.926837712 |
585 | 2023-10-21T17:18:33.541Z | slp 1:20.459015971 |
586 | 2023-10-21T17:18:33.566Z | lat 0.071139877 |
587 | 2023-10-21T17:18:33.618Z | stop 0.367165929 |
588 | 2023-10-21T17:18:33.642Z | + tar xf out/omicron-sled-agent.tar pkg/config-rss.toml |
589 | 2023-10-21T17:18:33.668Z | ++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
590 | 2023-10-21T17:18:33.692Z | + SILO_NAME=recovery |
591 | 2023-10-21T17:18:33.717Z | ++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
592 | 2023-10-21T17:18:33.743Z | + EXTERNAL_DNS_DOMAIN=oxide.test |
593 | 2023-10-21T17:18:33.768Z | + sed -i~ ' |
594 | 2023-10-21T17:18:33.801Z | /^external_dns_ips/c\ |
595 | 2023-10-21T17:18:33.827Z | external_dns_ips = [ "10.151.1.164", "10.151.1.165" ] |
596 | 2023-10-21T17:18:33.852Z | /^\[\[internal_services_ip_pool_ranges/,/^$/ { |
597 | 2023-10-21T17:18:33.876Z | /^first/c\ |
598 | 2023-10-21T17:18:33.900Z | first = "10.151.1.164" |
599 | 2023-10-21T17:18:33.925Z | /^last/c\ |
600 | 2023-10-21T17:18:33.949Z | last = "10.151.1.173" |
601 | 2023-10-21T17:18:33.973Z | } |
602 | 2023-10-21T17:18:34.407Z | /^\[rack_network_config/,/^$/ { |
603 | 2023-10-21T17:18:34.847Z | /^infra_ip_first/c\ |
604 | 2023-10-21T17:18:34.873Z | infra_ip_first = "10.151.1.174" |
605 | 2023-10-21T17:18:34.901Z | /^infra_ip_last/c\ |
606 | 2023-10-21T17:18:34.937Z | infra_ip_last = "10.151.1.174" |
607 | 2023-10-21T17:18:34.962Z | } |
608 | 2023-10-21T17:18:34.986Z | /^\[\[rack_network_config.ports/,/^$/ { |
609 | 2023-10-21T17:18:35.011Z | /^routes/c\ |
610 | 2023-10-21T17:18:35.035Z | --- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006 |
611 | 2023-10-21T17:18:35.060Z | routes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\] |
612 | 2023-10-21T17:18:35.087Z | +++ pkg/config-rss.toml Sat Oct 21 17:18:32 2023 |
613 | 2023-10-21T17:18:35.111Z | /^addresses/c\ |
614 | 2023-10-21T17:18:35.135Z | @@ -41,7 +41,7 @@ |
615 | 2023-10-21T17:18:35.159Z | addresses = \["10.151.1.174/32"\] |
616 | 2023-10-21T17:18:35.185Z | # the DNS domain delegated to the rack by the customer. Each of these addresses |
617 | 2023-10-21T17:18:35.210Z | } |
618 | 2023-10-21T17:18:35.234Z | # must be contained in one of the "internal services" IP Pool ranges listed |
619 | 2023-10-21T17:18:35.259Z | ' pkg/config-rss.toml |
620 | 2023-10-21T17:18:35.283Z | # below. |
621 | 2023-10-21T17:18:35.308Z | + diff -u pkg/config-rss.toml~ pkg/config-rss.toml |
622 | 2023-10-21T17:18:35.332Z | -external_dns_ips = [ "192.168.1.20", "192.168.1.21" ] |
623 | 2023-10-21T17:18:35.357Z | + true |
624 | 2023-10-21T17:18:35.383Z | +external_dns_ips = [ "10.151.1.164", "10.151.1.165" ] |
625 | 2023-10-21T17:18:35.408Z | + tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml |
626 | 2023-10-21T17:18:35.442Z | |
627 | 2023-10-21T17:18:35.467Z | + rm -f pkg/config-rss.toml pkg/config-rss.toml~ |
628 | 2023-10-21T17:18:35.907Z | # Initial TLS certificates for the external API |
629 | 2023-10-21T17:18:35.931Z | + TLS_NAME=recovery.sys.oxide.test |
630 | 2023-10-21T17:18:35.956Z | # |
631 | 2023-10-21T17:18:35.980Z | + openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin |
632 | 2023-10-21T17:18:36.004Z | @@ -77,8 +77,8 @@ |
633 | 2023-10-21T17:18:36.029Z | # |
634 | 2023-10-21T17:18:36.053Z | # For more on this and what to put here, see docs/how-to-run.adoc. |
635 | 2023-10-21T17:18:36.077Z | [[internal_services_ip_pool_ranges]] |
636 | 2023-10-21T17:18:36.102Z | -first = "192.168.1.20" |
637 | 2023-10-21T17:18:36.126Z | .+.....+....+.........+..+.+..+..........+......+......+.............................+..........+..+...+.+...............+.....+......+..........+............+..+...+...+....+.........+..+.........+.+..............+.........+......+.+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+.......+.....+...+.......+..+.+.........+.....+.......+...+...+........+....+...+..............+...+......+.......+.....+.........+....+..+.............+......+...+.....+.+..+.............+....................+.....................+...+......+....+...+.....+.......+...+............+.....+.......+........+...+...+.........+.+......+......+........+.+..................+..+....+............+..+..........+......+..+...............+.............+......+........+......+....+...........+......+......+.........+.+............+.....+...+.............+.........+...+...+...........+...+.......+..................+......+..+.......+..+......+.......+..+...................+.....+.+.....+.........+............+.........+...+...+.........+..............................+...+......+....+...+.....+...+.+..............+.+.....+.............+.....................+.....+....+..+.+...+...............+............+.................+.............+..+..........+...........+.......+........+..........+...............+.................+.........+.+..+.......+.........+...........+.+.....+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
638 | 2023-10-21T17:18:36.151Z | -last = "192.168.1.29" |
639 | 2023-10-21T17:18:36.177Z | +first = "10.151.1.164" |
640 | 2023-10-21T17:18:36.202Z | +last = "10.151.1.173" |
641 | 2023-10-21T17:18:36.227Z | |
642 | 2023-10-21T17:18:36.253Z | # TODO - this configuration is subject to change going forward. Ultimately these |
643 | 2023-10-21T17:18:36.277Z | # parameters should be provided to the control plane via wicket, but we need to |
644 | 2023-10-21T17:18:36.310Z | @@ -92,8 +92,8 @@ |
645 | 2023-10-21T17:18:36.351Z | # A range of IP addresses used by Boundary Services on the external network. In |
646 | 2023-10-21T17:18:36.377Z | # a real system, these would be addresses of the uplink ports on the Sidecar. |
647 | 2023-10-21T17:18:36.402Z | # With softnpu, only one address is used. |
648 | 2023-10-21T17:18:36.428Z | -infra_ip_first = "192.168.1.30" |
649 | 2023-10-21T17:18:36.452Z | -infra_ip_last = "192.168.1.30" |
650 | 2023-10-21T17:18:36.477Z | +infra_ip_first = "10.151.1.174" |
651 | 2023-10-21T17:18:36.502Z | +infra_ip_last = "10.151.1.174" |
652 | 2023-10-21T17:18:36.526Z | |
653 | 2023-10-21T17:18:36.551Z | # Configurations for BGP routers to run on the scrimlets. |
654 | 2023-10-21T17:18:36.575Z | bgp = [] |
655 | 2023-10-21T17:18:36.599Z | @@ -101,9 +101,9 @@ |
656 | 2023-10-21T17:18:36.624Z | # You can configure multiple uplinks by repeating the following stanza |
657 | 2023-10-21T17:18:36.648Z | [[rack_network_config.ports]] |
658 | 2023-10-21T17:18:36.698Z | # Routes associated with this port. |
659 | 2023-10-21T17:18:36.723Z | -routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}] |
660 | 2023-10-21T17:18:36.748Z | +routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}] |
661 | 2023-10-21T17:18:36.776Z | # Addresses associated with this port. |
662 | 2023-10-21T17:18:36.819Z | -addresses = ["192.168.1.30/32"] |
663 | 2023-10-21T17:18:36.853Z | +addresses = ["10.151.1.174/32"] |
664 | 2023-10-21T17:18:36.878Z | # Name of the uplink port. This should always be "qsfp0" when using softnpu. |
665 | 2023-10-21T17:18:36.902Z | port = "qsfp0" |
666 | 2023-10-21T17:18:36.926Z | # The speed of this port. |
667 | 2023-10-21T17:18:36.951Z | a pkg/config-rss.toml 7K |
668 | 2023-10-21T17:18:36.976Z | ...........+..........+.....+.+...........+.......+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.+.....+.+........+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......................+.....+....+.....+..........+..+..........+...........+.........+......+..........+............+.....................+.....+.+..............+.+........+.............+..+.+..+.......+..+.+........+.......+........+......+........................+.+...........+.......+...........+.+........+...+....+.....+.+............+..+..................+.+...........+....+..+.............+.....+.+......+..............+................+..+...+...+.+......+............+..+.+.........+.....+...+..........+.....+...+.........+...+...............+......................+...+..+...................+.........+....................+............+...+............+......+............+.......+......+............+.....+.......+...+.....+...+....+......+.........+.........+..............+...+...+......+.........+....+...+...+..............+.+..+.......+..+....+..+....+...+........+.......+...+...+......+......+............+...+...............+...+.....+..........+........................+.....+.............+...+......+.....+......+.........+.............+..+....+..+...+......+.+.....+............+.............+........+.+...+.....+.+...........+.........+....+..........................+..........+..+.........+..........+...+........+...+..............................+............+...+...................+..+.+..+..........+......+.....+...............+......+...+............+.+...+............+..+.............+...+..............+...+.......+......+............+..+......+.+......+...+...........+...+...+.......+..+......+...+.+.....+......+.................................+.+......+..+.......+......+..+......+.+..............+.+...........+.........+...................+..............................+......+...+..+...............+....+......+.....+.+.....+.........+...............+...+.+......+...+........+.......+...+..+.+.....................+......+...+.........+.....+...+.......+........+...+......+...+.+........................+...........+.........+............+....+...........+...+......+......+...............+......+....+...+......+............+........+.+......+..............+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
669 | 2023-10-21T17:18:37.001Z | a pkg/initial-tls-cert.pem 2K |
670 | 2023-10-21T17:18:37.025Z | ----- |
671 | 2023-10-21T17:18:37.050Z | a pkg/initial-tls-key.pem 4K |
672 | 2023-10-21T17:18:37.074Z | + tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
673 | 2023-10-21T17:18:37.102Z | + rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
674 | 2023-10-21T17:18:37.126Z | + rmdir pkg |
675 | 2023-10-21T17:18:37.151Z | + E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
676 | 2023-10-21T17:18:37.175Z | + pfexec mkdir -p /usr/oxide |
677 | 2023-10-21T17:18:37.617Z | + pfexec rm -f /usr/oxide/tcpproxy |
678 | 2023-10-21T17:18:37.643Z | + pfexec curl -sSfL -o /usr/oxide/tcpproxy http://catacomb.eng.oxide.computer:12346/tcpproxy |
679 | 2023-10-21T17:18:37.667Z | + pfexec chmod +x /usr/oxide/tcpproxy |
680 | 2023-10-21T17:18:37.699Z | + pfexec rm -f /var/svc/manifest/site/tcpproxy.xml |
681 | 2023-10-21T17:18:37.726Z | + pfexec curl -sSfL -o /var/svc/manifest/site/tcpproxy.xml http://catacomb.eng.oxide.computer:12346/tcpproxy.xml |
682 | 2023-10-21T17:18:37.751Z | + pfexec svccfg import /var/svc/manifest/site/tcpproxy.xml |
683 | 2023-10-21T17:18:37.776Z | + OMICRON_NO_UNINSTALL=1 |
684 | 2023-10-21T17:18:37.801Z | + ptime -m pfexec ./target/release/omicron-package -t test install |
685 | 2023-10-21T17:18:37.825Z | Oct 21 17:18:34.905 DEBG target[test]: Target({"image": "standard", "machine": "non-gimlet", "rack-topology": "single-sled", "switch": "softnpu"}) |
686 | 2023-10-21T17:18:37.867Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/ntp.tar.gz, src: out/ntp.tar.gz |
687 | 2023-10-21T17:18:37.899Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/cockroachdb.tar.gz, src: out/cockroachdb.tar.gz |
688 | 2023-10-21T17:18:37.923Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/clickhouse.tar.gz, src: out/clickhouse.tar.gz |
689 | 2023-10-21T17:18:37.949Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/overlay.tar.gz, src: out/overlay.tar.gz |
690 | 2023-10-21T17:18:37.973Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/crucible.tar.gz, src: out/crucible.tar.gz |
691 | 2023-10-21T17:18:37.997Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/nexus.tar.gz, src: out/omicron-nexus.tar.gz |
692 | 2023-10-21T17:18:38.022Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/clickhouse_keeper.tar.gz, src: out/clickhouse_keeper.tar.gz |
693 | 2023-10-21T17:18:38.047Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/sled-agent.tar, src: out/omicron-sled-agent.tar |
694 | 2023-10-21T17:18:38.072Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/mg-ddm.tar, src: out/mg-ddm-gz.tar |
695 | 2023-10-21T17:18:38.112Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/crucible_pantry.tar.gz, src: out/crucible-pantry.tar.gz |
696 | 2023-10-21T17:18:38.137Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/external_dns.tar.gz, src: out/external-dns.tar.gz |
697 | 2023-10-21T17:18:38.165Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/mgs.tar.gz, src: out/omicron-gateway-softnpu.tar.gz |
698 | 2023-10-21T17:18:38.191Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/oximeter.tar.gz, src: out/oximeter-collector.tar.gz |
699 | 2023-10-21T17:18:38.264Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/propolis-server.tar.gz, src: out/propolis-server.tar.gz |
700 | 2023-10-21T17:18:38.289Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/switch.tar.gz, src: out/switch-softnpu.tar.gz |
701 | 2023-10-21T17:18:38.313Z | Oct 21 17:18:34.907 INFO Installing service, dst: /opt/oxide/internal_dns.tar.gz, src: out/internal-dns.tar.gz |
702 | 2023-10-21T17:18:38.338Z | Oct 21 17:18:35.142 INFO Unpacking service tarball, service_path: /opt/oxide/mg-ddm, tar_path: /opt/oxide/mg-ddm.tar |
703 | 2023-10-21T17:18:38.362Z | Oct 21 17:18:35.180 INFO Unpacking service tarball, service_path: /opt/oxide/sled-agent, tar_path: /opt/oxide/sled-agent.tar |
704 | 2023-10-21T17:18:38.387Z | Oct 21 17:18:35.243 INFO Installing bootstrap service from /opt/oxide/sled-agent/pkg/manifest.xml |
705 | 2023-10-21T17:18:38.411Z | |
706 | 2023-10-21T17:18:38.435Z | real 0.477031506 |
707 | 2023-10-21T17:18:38.461Z | user 0.097488954 |
708 | 2023-10-21T17:18:38.486Z | sys 1.891369688 |
709 | 2023-10-21T17:18:38.511Z | trap 0.000000420 |
710 | 2023-10-21T17:18:38.535Z | tflt 0.000013759 |
711 | 2023-10-21T17:18:38.559Z | dflt 0.000347917 |
712 | 2023-10-21T17:18:38.583Z | kflt 0.000003850 |
713 | 2023-10-21T17:18:38.609Z | lock 42.876161137 |
714 | 2023-10-21T17:18:38.636Z | slp 0.685939285 |
715 | 2023-10-21T17:18:38.667Z | lat 0.003082684 |
716 | 2023-10-21T17:18:38.696Z | stop 0.211732022 |
717 | 2023-10-21T17:18:38.723Z | + retry=0 |
718 | 2023-10-21T17:18:38.747Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
719 | 2023-10-21T17:18:38.771Z | + [[ 0 -gt 30 ]] |
720 | 2023-10-21T17:18:38.796Z | + sleep 1 |
721 | 2023-10-21T17:18:38.820Z | + retry=1 |
722 | 2023-10-21T17:18:38.844Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
723 | 2023-10-21T17:18:38.868Z | + [[ 1 -gt 30 ]] |
724 | 2023-10-21T17:18:38.928Z | + sleep 1 |
725 | 2023-10-21T17:18:38.953Z | + retry=2 |
726 | 2023-10-21T17:18:38.977Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
727 | 2023-10-21T17:19:02.577Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
728 | 2023-10-21T17:19:02.629Z | local v6: |
729 | 2023-10-21T17:19:02.654Z | fe80::3c08:4eff:fed1:f73b |
730 | 2023-10-21T17:19:02.678Z | fd00:99::1 |
731 | 2023-10-21T17:19:02.705Z | local v4: |
732 | 2023-10-21T17:19:02.730Z | 10.151.1.174 |
733 | 2023-10-21T17:19:02.755Z | router v6: |
734 | 2023-10-21T17:19:02.780Z | fdb0:18c0:4d0d:9fb2::/64 -> fe80::b03d:c9ff:feb7:37a1 (1) vid=0 |
735 | 2023-10-21T17:19:02.805Z | fd00:1122:3344:101::/64 -> fe80::b03d:c9ff:feb7:37a1 (1) vid=0 |
736 | 2023-10-21T17:19:02.830Z | router v4: |
737 | 2023-10-21T17:19:02.857Z | 0.0.0.0/0 -> 10.151.1.100 (2) vid=0 |
738 | 2023-10-21T17:19:02.882Z | resolver v4: |
739 | 2023-10-21T17:19:02.907Z | 10.151.1.100 -> 18:c0:4d:0d:9f:b2 |
740 | 2023-10-21T17:19:02.932Z | 10.151.1.174 -> b2:78:b2:a1:ee:15 |
741 | 2023-10-21T17:19:02.958Z | resolver v6: |
742 | 2023-10-21T17:19:02.982Z | fe80::3c08:4eff:fed1:f73b -> 3e:08:4e:d1:f7:3b |
743 | 2023-10-21T17:19:03.007Z | fe80::b03d:c9ff:feb7:37a1 -> b2:3d:c9:b7:37:a1 |
744 | 2023-10-21T17:19:03.032Z | nat v4: |
745 | 2023-10-21T17:19:03.056Z | nat_v6: |
746 | 2023-10-21T17:19:03.081Z | port_mac: |
747 | 2023-10-21T17:19:03.106Z | 1000: a8:40:25:7a:9d:38 |
748 | 2023-10-21T17:19:03.130Z | 1: a8:40:25:7a:9d:39 |
749 | 2023-10-21T17:19:03.156Z | proxy arp: |
750 | 2023-10-21T17:19:03.180Z | 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d |
751 | 2023-10-21T17:19:03.204Z | + retry=0 |
752 | 2023-10-21T17:19:03.229Z | +++ zoneadm list -n |
753 | 2023-10-21T17:19:03.254Z | +++ grep oxz_ntp |
754 | 2023-10-21T17:19:03.289Z | ++ pfexec svcs -z -Hostate oxide/ntp |
755 | 2023-10-21T17:19:03.316Z | svcs: zone '-Hostate': entity not found |
756 | 2023-10-21T17:19:03.341Z | ++ true |
757 | 2023-10-21T17:19:03.365Z | + [[ '' != online ]] |
758 | 2023-10-21T17:19:03.391Z | + [[ 0 -gt 60 ]] |
759 | 2023-10-21T17:19:03.416Z | + sleep 1 |
760 | 2023-10-21T17:19:03.653Z | + retry=1 |
761 | 2023-10-21T17:19:03.678Z | +++ zoneadm list -n |
762 | 2023-10-21T17:19:03.702Z | +++ grep oxz_ntp |
763 | 2023-10-21T17:19:03.727Z | ++ pfexec svcs -z -Hostate oxide/ntp |
764 | 2023-10-21T17:19:03.751Z | svcs: zone '-Hostate': entity not found |
765 | 2023-10-21T17:19:03.776Z | ++ true |
766 | 2023-10-21T17:19:03.802Z | + [[ '' != online ]] |
767 | 2023-10-21T17:19:03.827Z | + [[ 1 -gt 60 ]] |
768 | 2023-10-21T17:19:03.852Z | + sleep 1 |
769 | 2023-10-21T17:19:04.679Z | + retry=2 |
770 | 2023-10-21T17:19:04.704Z | +++ zoneadm list -n |
771 | 2023-10-21T17:19:04.728Z | +++ grep oxz_ntp |
772 | 2023-10-21T17:19:04.753Z | ++ pfexec svcs -z -Hostate oxide/ntp |
773 | 2023-10-21T17:19:04.779Z | svcs: zone '-Hostate': entity not found |
774 | 2023-10-21T17:19:04.804Z | ++ true |
775 | 2023-10-21T17:19:04.828Z | + [[ '' != online ]] |
776 | 2023-10-21T17:19:04.853Z | + [[ 2 -gt 60 ]] |
777 | 2023-10-21T17:19:04.877Z | + sleep 1 |
778 | 2023-10-21T17:19:05.680Z | + retry=3 |
779 | 2023-10-21T17:19:05.706Z | +++ zoneadm list -n |
780 | 2023-10-21T17:19:05.731Z | +++ grep oxz_ntp |
781 | 2023-10-21T17:19:05.755Z | ++ pfexec svcs -z -Hostate oxide/ntp |
782 | 2023-10-21T17:19:05.780Z | svcs: zone '-Hostate': entity not found |
783 | 2023-10-21T17:19:05.809Z | ++ true |
784 | 2023-10-21T17:19:05.833Z | + [[ '' != online ]] |
785 | 2023-10-21T17:19:05.857Z | + [[ 3 -gt 60 ]] |
786 | 2023-10-21T17:19:05.882Z | + sleep 1 |
787 | 2023-10-21T17:19:06.704Z | + retry=4 |
788 | 2023-10-21T17:19:06.732Z | +++ zoneadm list -n |
789 | 2023-10-21T17:19:06.756Z | +++ grep oxz_ntp |
790 | 2023-10-21T17:19:06.780Z | ++ pfexec svcs -z -Hostate oxide/ntp |
791 | 2023-10-21T17:19:06.804Z | svcs: zone '-Hostate': entity not found |
792 | 2023-10-21T17:19:06.830Z | ++ true |
793 | 2023-10-21T17:19:06.857Z | + [[ '' != online ]] |
794 | 2023-10-21T17:19:06.880Z | + [[ 4 -gt 60 ]] |
795 | 2023-10-21T17:19:06.904Z | + sleep 1 |
796 | 2023-10-21T17:19:07.726Z | + retry=5 |
797 | 2023-10-21T17:19:07.756Z | +++ zoneadm list -n |
798 | 2023-10-21T17:19:07.780Z | +++ grep oxz_ntp |
799 | 2023-10-21T17:19:07.805Z | ++ pfexec svcs -z -Hostate oxide/ntp |
800 | 2023-10-21T17:19:07.828Z | svcs: zone '-Hostate': entity not found |
801 | 2023-10-21T17:19:07.852Z | ++ true |
802 | 2023-10-21T17:19:07.876Z | + [[ '' != online ]] |
803 | 2023-10-21T17:19:07.901Z | + [[ 5 -gt 60 ]] |
804 | 2023-10-21T17:19:07.925Z | + sleep 1 |
805 | 2023-10-21T17:19:08.747Z | + retry=6 |
806 | 2023-10-21T17:19:08.781Z | +++ zoneadm list -n |
807 | 2023-10-21T17:19:08.810Z | +++ grep oxz_ntp |
808 | 2023-10-21T17:19:08.834Z | ++ pfexec svcs -z -Hostate oxide/ntp |
809 | 2023-10-21T17:19:08.858Z | svcs: zone '-Hostate': entity not found |
810 | 2023-10-21T17:19:08.882Z | ++ true |
811 | 2023-10-21T17:19:08.906Z | + [[ '' != online ]] |
812 | 2023-10-21T17:19:08.930Z | + [[ 6 -gt 60 ]] |
813 | 2023-10-21T17:19:08.954Z | + sleep 1 |
814 | 2023-10-21T17:19:09.768Z | + retry=7 |
815 | 2023-10-21T17:19:09.804Z | +++ zoneadm list -n |
816 | 2023-10-21T17:19:09.829Z | +++ grep oxz_ntp |
817 | 2023-10-21T17:19:09.853Z | ++ pfexec svcs -z -Hostate oxide/ntp |
818 | 2023-10-21T17:19:09.877Z | svcs: zone '-Hostate': entity not found |
819 | 2023-10-21T17:19:09.901Z | ++ true |
820 | 2023-10-21T17:19:09.925Z | + [[ '' != online ]] |
821 | 2023-10-21T17:19:09.949Z | + [[ 7 -gt 60 ]] |
822 | 2023-10-21T17:19:09.974Z | + sleep 1 |
823 | 2023-10-21T17:19:10.791Z | + retry=8 |
824 | 2023-10-21T17:19:10.830Z | +++ zoneadm list -n |
825 | 2023-10-21T17:19:10.854Z | +++ grep oxz_ntp |
826 | 2023-10-21T17:19:10.878Z | ++ pfexec svcs -z -Hostate oxide/ntp |
827 | 2023-10-21T17:19:10.902Z | svcs: zone '-Hostate': entity not found |
828 | 2023-10-21T17:19:10.926Z | ++ true |
829 | 2023-10-21T17:19:10.951Z | + [[ '' != online ]] |
830 | 2023-10-21T17:19:10.974Z | + [[ 8 -gt 60 ]] |
831 | 2023-10-21T17:19:10.998Z | + sleep 1 |
832 | 2023-10-21T17:19:11.813Z | + retry=9 |
833 | 2023-10-21T17:19:11.855Z | +++ zoneadm list -n |
834 | 2023-10-21T17:19:11.879Z | +++ grep oxz_ntp |
835 | 2023-10-21T17:19:11.903Z | ++ pfexec svcs -z -Hostate oxide/ntp |
836 | 2023-10-21T17:19:11.927Z | svcs: zone '-Hostate': entity not found |
837 | 2023-10-21T17:19:11.951Z | ++ true |
838 | 2023-10-21T17:19:11.975Z | + [[ '' != online ]] |
839 | 2023-10-21T17:19:11.999Z | + [[ 9 -gt 60 ]] |
840 | 2023-10-21T17:19:12.027Z | + sleep 1 |
841 | 2023-10-21T17:19:12.836Z | + retry=10 |
842 | 2023-10-21T17:19:12.880Z | +++ zoneadm list -n |
843 | 2023-10-21T17:19:12.904Z | +++ grep oxz_ntp |
844 | 2023-10-21T17:19:12.928Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
845 | 2023-10-21T17:19:12.952Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
846 | 2023-10-21T17:19:12.976Z | ++ true |
847 | 2023-10-21T17:19:13.002Z | + [[ '' != online ]] |
848 | 2023-10-21T17:19:13.026Z | + [[ 10 -gt 60 ]] |
849 | 2023-10-21T17:19:13.050Z | + sleep 1 |
850 | 2023-10-21T17:19:13.905Z | + retry=11 |
851 | 2023-10-21T17:19:13.930Z | +++ zoneadm list -n |
852 | 2023-10-21T17:19:13.954Z | +++ grep oxz_ntp |
853 | 2023-10-21T17:19:13.978Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
854 | 2023-10-21T17:19:14.005Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
855 | 2023-10-21T17:19:14.467Z | ++ true |
856 | 2023-10-21T17:19:14.491Z | + [[ '' != online ]] |
857 | 2023-10-21T17:19:14.515Z | + [[ 11 -gt 60 ]] |
858 | 2023-10-21T17:19:14.538Z | + sleep 1 |
859 | 2023-10-21T17:19:14.935Z | + retry=12 |
860 | 2023-10-21T17:19:14.961Z | +++ zoneadm list -n |
861 | 2023-10-21T17:19:14.989Z | +++ grep oxz_ntp |
862 | 2023-10-21T17:19:15.017Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
863 | 2023-10-21T17:19:15.046Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
864 | 2023-10-21T17:19:15.070Z | ++ true |
865 | 2023-10-21T17:19:15.095Z | + [[ '' != online ]] |
866 | 2023-10-21T17:19:15.119Z | + [[ 12 -gt 60 ]] |
867 | 2023-10-21T17:19:15.143Z | + sleep 1 |
868 | 2023-10-21T17:19:15.965Z | + retry=13 |
869 | 2023-10-21T17:19:15.994Z | +++ zoneadm list -n |
870 | 2023-10-21T17:19:16.021Z | +++ grep oxz_ntp |
871 | 2023-10-21T17:19:16.045Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
872 | 2023-10-21T17:19:16.069Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
873 | 2023-10-21T17:19:16.093Z | ++ true |
874 | 2023-10-21T17:19:16.117Z | + [[ '' != online ]] |
875 | 2023-10-21T17:19:16.162Z | + [[ 13 -gt 60 ]] |
876 | 2023-10-21T17:19:16.186Z | + sleep 1 |
877 | 2023-10-21T17:19:16.992Z | + retry=14 |
878 | 2023-10-21T17:19:17.016Z | +++ zoneadm list -n |
879 | 2023-10-21T17:19:17.041Z | +++ grep oxz_ntp |
880 | 2023-10-21T17:19:17.065Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
881 | 2023-10-21T17:19:17.091Z | + [[ disabled != online ]] |
882 | 2023-10-21T17:19:17.115Z | + [[ 14 -gt 60 ]] |
883 | 2023-10-21T17:19:17.139Z | + sleep 1 |
884 | 2023-10-21T17:19:18.017Z | + retry=15 |
885 | 2023-10-21T17:19:18.041Z | +++ zoneadm list -n |
886 | 2023-10-21T17:19:18.065Z | +++ grep oxz_ntp |
887 | 2023-10-21T17:19:18.092Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
888 | 2023-10-21T17:19:18.119Z | + [[ disabled != online ]] |
889 | 2023-10-21T17:19:18.144Z | + [[ 15 -gt 60 ]] |
890 | 2023-10-21T17:19:18.168Z | + sleep 1 |
891 | 2023-10-21T17:19:19.045Z | + retry=16 |
892 | 2023-10-21T17:19:19.075Z | +++ zoneadm list -n |
893 | 2023-10-21T17:19:19.099Z | +++ grep oxz_ntp |
894 | 2023-10-21T17:19:19.123Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
895 | 2023-10-21T17:19:19.147Z | + [[ disabled != online ]] |
896 | 2023-10-21T17:19:19.173Z | + [[ 16 -gt 60 ]] |
897 | 2023-10-21T17:19:19.624Z | + sleep 1 |
898 | 2023-10-21T17:19:20.089Z | + retry=17 |
899 | 2023-10-21T17:19:20.524Z | +++ zoneadm list -n |
900 | 2023-10-21T17:19:20.966Z | +++ grep oxz_ntp |
901 | 2023-10-21T17:19:20.998Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
902 | 2023-10-21T17:19:21.044Z | + [[ disabled != online ]] |
903 | 2023-10-21T17:19:21.482Z | + [[ 17 -gt 60 ]] |
904 | 2023-10-21T17:19:21.536Z | + sleep 1 |
905 | 2023-10-21T17:19:21.574Z | + retry=18 |
906 | 2023-10-21T17:19:21.609Z | +++ zoneadm list -n |
907 | 2023-10-21T17:19:21.638Z | +++ grep oxz_ntp |
908 | 2023-10-21T17:19:21.662Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
909 | 2023-10-21T17:19:21.686Z | + [[ disabled != online ]] |
910 | 2023-10-21T17:19:21.711Z | + [[ 18 -gt 60 ]] |
911 | 2023-10-21T17:19:21.735Z | + sleep 1 |
912 | 2023-10-21T17:19:22.104Z | + retry=19 |
913 | 2023-10-21T17:19:22.151Z | +++ zoneadm list -n |
914 | 2023-10-21T17:19:22.176Z | +++ grep oxz_ntp |
915 | 2023-10-21T17:19:22.200Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
916 | 2023-10-21T17:19:22.224Z | + [[ disabled != online ]] |
917 | 2023-10-21T17:19:22.249Z | + [[ 19 -gt 60 ]] |
918 | 2023-10-21T17:19:22.273Z | + sleep 1 |
919 | 2023-10-21T17:19:23.129Z | + retry=20 |
920 | 2023-10-21T17:19:23.178Z | +++ zoneadm list -n |
921 | 2023-10-21T17:19:23.205Z | +++ grep oxz_ntp |
922 | 2023-10-21T17:19:23.231Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
923 | 2023-10-21T17:19:23.260Z | + [[ disabled != online ]] |
924 | 2023-10-21T17:19:23.287Z | + [[ 20 -gt 60 ]] |
925 | 2023-10-21T17:19:23.311Z | + sleep 1 |
926 | 2023-10-21T17:19:24.149Z | + retry=21 |
927 | 2023-10-21T17:19:24.174Z | +++ zoneadm list -n |
928 | 2023-10-21T17:19:24.203Z | +++ grep oxz_ntp |
929 | 2023-10-21T17:19:24.229Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
930 | 2023-10-21T17:19:24.255Z | + [[ disabled != online ]] |
931 | 2023-10-21T17:19:24.279Z | + [[ 21 -gt 60 ]] |
932 | 2023-10-21T17:19:24.303Z | + sleep 1 |
933 | 2023-10-21T17:19:25.178Z | + retry=22 |
934 | 2023-10-21T17:19:25.240Z | +++ zoneadm list -n |
935 | 2023-10-21T17:19:25.272Z | +++ grep oxz_ntp |
936 | 2023-10-21T17:19:25.303Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
937 | 2023-10-21T17:19:25.331Z | + [[ disabled != online ]] |
|
938 | 2023-10-21T17:19:25.346Z | buskin console login: Oct 21 17:19:24 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast |
|
939 | 2023-10-21T17:19:25.360Z | + [[ 22 -gt 60 ]] |
940 | 2023-10-21T17:19:25.394Z | + sleep 1 |
941 | 2023-10-21T17:19:26.195Z | + retry=23 |
942 | 2023-10-21T17:19:26.223Z | +++ zoneadm list -n |
943 | 2023-10-21T17:19:26.281Z | +++ grep oxz_ntp |
944 | 2023-10-21T17:19:26.313Z | ++ pfexec svcs -z oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf -Hostate oxide/ntp |
945 | 2023-10-21T17:19:26.343Z | + [[ online != online ]] |
946 | 2023-10-21T17:19:26.370Z | + echo 'Waited for chrony: 23s' |
947 | 2023-10-21T17:19:26.395Z | + export RUST_BACKTRACE=1 |
948 | 2023-10-21T17:19:26.419Z | + RUST_BACKTRACE=1 |
949 | 2023-10-21T17:19:26.443Z | Waited for chrony: 23s |
950 | 2023-10-21T17:19:26.467Z | + export E2E_TLS_CERT IPPOOL_START IPPOOL_END |
951 | 2023-10-21T17:19:26.519Z | + ./tests/bootstrap |
952 | 2023-10-21T17:19:26.547Z | Using external DNS server at 10.151.1.164:53 |
953 | 2023-10-21T17:19:26.577Z | 2023-10-21 17:19:26.246966533 UTC: attempting to log into API |
954 | 2023-10-21T17:19:41.289Z | 2023-10-21 17:19:41.278063139 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
955 | 2023-10-21T17:19:42.300Z | 2023-10-21 17:19:42.278973834 UTC: attempting to log into API |
956 | 2023-10-21T17:19:57.549Z | 2023-10-21 17:19:57.312489778 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
957 | 2023-10-21T17:19:58.347Z | 2023-10-21 17:19:58.312915926 UTC: attempting to log into API |
958 | 2023-10-21T17:20:13.358Z | 2023-10-21 17:20:13.345789630 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
959 | 2023-10-21T17:20:14.358Z | 2023-10-21 17:20:14.346921319 UTC: attempting to log into API |
960 | 2023-10-21T17:20:29.397Z | 2023-10-21 17:20:29.380859409 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
961 | 2023-10-21T17:20:30.395Z | 2023-10-21 17:20:30.382598717 UTC: attempting to log into API |
|
962 | 2023-10-21T17:20:36.959Z | Oct 21 17:20:36 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast |
963 | 2023-10-21T17:20:44.255Z | Oct 21 17:20:43 bukin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast |
|
964 | 2023-10-21T17:20:45.447Z | 2023-10-21 17:20:45.425694734 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
965 | 2023-10-21T17:20:46.437Z | 2023-10-21 17:20:46.426849854 UTC: attempting to log into API |
|
966 | 2023-10-21T17:20:51.561Z | Oct 21 17:20:50 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast |
967 | 2023-10-21T17:20:58.115Z | Oct 21 17:20:57 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast |
|
968 | 2023-10-21T17:21:01.471Z | 2023-10-21 17:21:01.460683702 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
969 | 2023-10-21T17:21:02.471Z | 2023-10-21 17:21:02.461458695 UTC: attempting to log into API |
|
970 | 2023-10-21T17:21:04.891Z | Oct 21 17:21:04 bukin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast |
|
971 | 2023-10-21T17:21:17.503Z | 2023-10-21 17:21:17.493750775 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
972 | 2023-10-21T17:21:18.504Z | 2023-10-21 17:21:18.494910454 UTC: attempting to log into API |
973 | 2023-10-21T17:21:24.295Z | 2023-10-21 17:21:24.283704375 UTC: login succeeded |
974 | 2023-10-21T17:21:24.327Z | waiting for nexus to come up... |
975 | 2023-10-21T17:21:24.389Z | creating IP pool... 10.151.1.175 - 10.151.1.227 |
976 | 2023-10-21T17:21:24.471Z | ensuring datasets are ready... |
977 | 2023-10-21T17:21:27.803Z | let's roll. |
978 | 2023-10-21T17:21:27.858Z | + rm ./tests/bootstrap |
979 | 2023-10-21T17:21:27.890Z | + for test_bin in tests/* |
980 | 2023-10-21T17:21:27.918Z | + ./tests/bootstrap-49e31e75b930b622 |
981 | 2023-10-21T17:21:27.948Z | |
982 | 2023-10-21T17:21:27.986Z | running 0 tests |
983 | 2023-10-21T17:21:28.024Z | |
984 | 2023-10-21T17:21:28.050Z | test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s |
985 | 2023-10-21T17:21:28.085Z | |
986 | 2023-10-21T17:21:28.111Z | + for test_bin in tests/* |
987 | 2023-10-21T17:21:28.134Z | + ./tests/end_to_end_tests-a91cf9af3457d280 |
988 | 2023-10-21T17:21:28.164Z | |
989 | 2023-10-21T17:21:28.188Z | running 2 tests |
990 | 2023-10-21T17:21:28.214Z | test no_spoof::no_spoof_here ... ok |
991 | 2023-10-21T17:22:27.858Z | test instance_launch::instance_launch has been running for over 60 seconds |
992 | 2023-10-21T17:24:26.957Z | test instance_launch::instance_launch ... ok |
993 | 2023-10-21T17:24:26.983Z | |
994 | 2023-10-21T17:24:27.007Z | test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 179.10s |
995 | 2023-10-21T17:24:27.035Z | |
996 | 2023-10-21T17:24:27.058Z | + _exit_trap |
997 | 2023-10-21T17:24:27.085Z | + local status=0 |
998 | 2023-10-21T17:24:27.114Z | + [[ 0 -eq 0 ]] |
999 | 2023-10-21T17:24:27.138Z | + exit 0 |
1000 | 2023-10-21T17:24:27.162Z | process exited: duration 398111 ms, exit code 0 |
|
1001 | 2023-10-21T17:24:27.245Z | found 47 output files |
1002 | 2023-10-21T17:24:27.295Z | uploading: /var/svc/log/oxide-sled-agent:default.log (442745 bytes) |
1003 | 2023-10-21T17:24:27.508Z | upload warning: file "/var/svc/log/oxide-sled-agent:default.log" changed size mid upload: 442745 -> 443145 |
1004 | 2023-10-21T17:24:28.602Z | uploaded: /var/svc/log/oxide-sled-agent:default.log |
1005 | 2023-10-21T17:24:28.630Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6781ac1a-5cf8-4254-8488-5bf9670ead92/root/var/svc/log/oxide-internal_dns:default.log (99076 bytes) |
1006 | 2023-10-21T17:24:29.872Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_6781ac1a-5cf8-4254-8488-5bf9670ead92/root/var/svc/log/oxide-internal_dns:default.log |
1007 | 2023-10-21T17:24:29.896Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/svc/log/oxide-ntp:default.log (783 bytes) |
1008 | 2023-10-21T17:24:30.964Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/svc/log/oxide-ntp:default.log |
1009 | 2023-10-21T17:24:30.993Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_56f34b31-da43-4675-8279-581de3be7384/root/var/svc/log/oxide-crucible-agent:default.log (3436 bytes) |
1010 | 2023-10-21T17:24:32.078Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_56f34b31-da43-4675-8279-581de3be7384/root/var/svc/log/oxide-crucible-agent:default.log |
1011 | 2023-10-21T17:24:32.104Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_56f34b31-da43-4675-8279-581de3be7384/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1012 | 2023-10-21T17:24:33.171Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_56f34b31-da43-4675-8279-581de3be7384/root/var/svc/log/oxide-crucible-downstairs:default.log |
1013 | 2023-10-21T17:24:33.195Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6bfebc1e-98c3-4d58-ab01-72e5cbef7726/root/var/svc/log/oxide-crucible-agent:default.log (3436 bytes) |
1014 | 2023-10-21T17:24:34.266Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6bfebc1e-98c3-4d58-ab01-72e5cbef7726/root/var/svc/log/oxide-crucible-agent:default.log |
1015 | 2023-10-21T17:24:34.290Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6bfebc1e-98c3-4d58-ab01-72e5cbef7726/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1016 | 2023-10-21T17:24:35.359Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_6bfebc1e-98c3-4d58-ab01-72e5cbef7726/root/var/svc/log/oxide-crucible-downstairs:default.log |
1017 | 2023-10-21T17:24:35.384Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4ae87c9e-f0f8-4b36-93a9-e9fd4dacc4d6/root/var/svc/log/oxide-external_dns:default.log (15612 bytes) |
1018 | 2023-10-21T17:24:36.519Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_4ae87c9e-f0f8-4b36-93a9-e9fd4dacc4d6/root/var/svc/log/oxide-external_dns:default.log |
1019 | 2023-10-21T17:24:37.006Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a1e208a4-26c3-4301-8068-c399578316ef/root/var/svc/log/oxide-oximeter:default.log (180886 bytes) |
1020 | 2023-10-21T17:24:37.032Z | upload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a1e208a4-26c3-4301-8068-c399578316ef/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 180886 -> 189101 |
1021 | 2023-10-21T17:24:37.770Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_a1e208a4-26c3-4301-8068-c399578316ef/root/var/svc/log/oxide-oximeter:default.log |
1022 | 2023-10-21T17:24:37.794Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_clickhouse_315062eb-4535-4068-90b1-47746a296c66/root/var/svc/log/oxide-clickhouse:default.log (650823 bytes) |
1023 | 2023-10-21T17:24:38.468Z | upload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_clickhouse_315062eb-4535-4068-90b1-47746a296c66/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 650823 -> 679586 |
1024 | 2023-10-21T17:24:39.162Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_clickhouse_315062eb-4535-4068-90b1-47746a296c66/root/var/svc/log/oxide-clickhouse:default.log |
1025 | 2023-10-21T17:24:39.195Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_540d66d1-e2b9-49af-aa03-11b43d103dd5/root/var/svc/log/oxide-crucible-agent:default.log (24397 bytes) |
1026 | 2023-10-21T17:24:40.736Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_540d66d1-e2b9-49af-aa03-11b43d103dd5/root/var/svc/log/oxide-crucible-agent:default.log |
1027 | 2023-10-21T17:24:40.770Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_540d66d1-e2b9-49af-aa03-11b43d103dd5/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1028 | 2023-10-21T17:24:41.849Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_540d66d1-e2b9-49af-aa03-11b43d103dd5/root/var/svc/log/oxide-crucible-downstairs:default.log |
1029 | 2023-10-21T17:24:41.879Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_540d66d1-e2b9-49af-aa03-11b43d103dd5/root/var/svc/log/oxide-crucible-downstairs:downstairs-c85ae805-be5a-457a-a4aa-870c4300d481.log (5534 bytes) |
1030 | 2023-10-21T17:24:43.444Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_540d66d1-e2b9-49af-aa03-11b43d103dd5/root/var/svc/log/oxide-crucible-downstairs:downstairs-c85ae805-be5a-457a-a4aa-870c4300d481.log |
1031 | 2023-10-21T17:24:43.470Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_540d66d1-e2b9-49af-aa03-11b43d103dd5/root/var/svc/log/oxide-crucible-downstairs:downstairs-c8d38ee6-5a2b-4138-a61e-af7406f65990.log (3049 bytes) |
1032 | 2023-10-21T17:24:44.567Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_540d66d1-e2b9-49af-aa03-11b43d103dd5/root/var/svc/log/oxide-crucible-downstairs:downstairs-c8d38ee6-5a2b-4138-a61e-af7406f65990.log |
1033 | 2023-10-21T17:24:44.601Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cefd3bbd-6e1c-4cc5-939e-624201378420/root/var/svc/log/oxide-crucible-agent:default.log (3435 bytes) |
1034 | 2023-10-21T17:24:45.702Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cefd3bbd-6e1c-4cc5-939e-624201378420/root/var/svc/log/oxide-crucible-agent:default.log |
1035 | 2023-10-21T17:24:45.737Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cefd3bbd-6e1c-4cc5-939e-624201378420/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1036 | 2023-10-21T17:24:46.811Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_cefd3bbd-6e1c-4cc5-939e-624201378420/root/var/svc/log/oxide-crucible-downstairs:default.log |
1037 | 2023-10-21T17:24:46.837Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_3cc9794e-cb06-48bb-8380-3b36a7caf6d9/root/var/svc/log/oxide-crucible-pantry:default.log (2333 bytes) |
1038 | 2023-10-21T17:24:47.920Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_3cc9794e-cb06-48bb-8380-3b36a7caf6d9/root/var/svc/log/oxide-crucible-pantry:default.log |
1039 | 2023-10-21T17:24:47.951Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_84f51e7e-4a6a-40b2-89f5-4ac7c16a2470/root/var/svc/log/oxide-internal_dns:default.log (103944 bytes) |
1040 | 2023-10-21T17:24:49.312Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_84f51e7e-4a6a-40b2-89f5-4ac7c16a2470/root/var/svc/log/oxide-internal_dns:default.log |
1041 | 2023-10-21T17:24:49.337Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_d98bfd1b-cefc-4fdf-8de5-0c6ab1cac9d6/root/var/svc/log/oxide-crucible-agent:default.log (25255 bytes) |
1042 | 2023-10-21T17:24:50.494Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_d98bfd1b-cefc-4fdf-8de5-0c6ab1cac9d6/root/var/svc/log/oxide-crucible-agent:default.log |
1043 | 2023-10-21T17:24:50.518Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_d98bfd1b-cefc-4fdf-8de5-0c6ab1cac9d6/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1044 | 2023-10-21T17:24:51.586Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_d98bfd1b-cefc-4fdf-8de5-0c6ab1cac9d6/root/var/svc/log/oxide-crucible-downstairs:default.log |
1045 | 2023-10-21T17:24:51.612Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_d98bfd1b-cefc-4fdf-8de5-0c6ab1cac9d6/root/var/svc/log/oxide-crucible-downstairs:downstairs-095e0d3d-60e7-49ae-b9f1-aa29ebf1c4f1.log (3051 bytes) |
1046 | 2023-10-21T17:24:52.715Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_d98bfd1b-cefc-4fdf-8de5-0c6ab1cac9d6/root/var/svc/log/oxide-crucible-downstairs:downstairs-095e0d3d-60e7-49ae-b9f1-aa29ebf1c4f1.log |
1047 | 2023-10-21T17:24:52.739Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_d98bfd1b-cefc-4fdf-8de5-0c6ab1cac9d6/root/var/svc/log/oxide-crucible-downstairs:downstairs-ef262c8a-c7fb-4127-a8aa-25b1a3e8eece.log (5536 bytes) |
1048 | 2023-10-21T17:24:53.830Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_d98bfd1b-cefc-4fdf-8de5-0c6ab1cac9d6/root/var/svc/log/oxide-crucible-downstairs:downstairs-ef262c8a-c7fb-4127-a8aa-25b1a3e8eece.log |
1049 | 2023-10-21T17:24:53.854Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_94339dd6-2a9e-4a76-8372-a1279cbc33dd/root/var/svc/log/oxide-crucible-pantry:default.log (2338 bytes) |
1050 | 2023-10-21T17:24:54.924Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_94339dd6-2a9e-4a76-8372-a1279cbc33dd/root/var/svc/log/oxide-crucible-pantry:default.log |
1051 | 2023-10-21T17:24:54.948Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_5466fb83-3627-4cdc-8964-d67e77ee7fb0/root/var/svc/log/oxide-cockroachdb:default.log (5367 bytes) |
1052 | 2023-10-21T17:24:56.027Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_5466fb83-3627-4cdc-8964-d67e77ee7fb0/root/var/svc/log/oxide-cockroachdb:default.log |
1053 | 2023-10-21T17:24:56.051Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7b1edb6b-ca9c-4081-b7db-10a84e008604/root/var/svc/log/oxide-cockroachdb:default.log (5366 bytes) |
1054 | 2023-10-21T17:24:57.121Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_7b1edb6b-ca9c-4081-b7db-10a84e008604/root/var/svc/log/oxide-cockroachdb:default.log |
1055 | 2023-10-21T17:24:57.145Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_c6fd47de-05a1-47aa-b2a5-6e755236fdae/root/var/svc/log/oxide-crucible-pantry:default.log (2338 bytes) |
1056 | 2023-10-21T17:24:58.230Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_c6fd47de-05a1-47aa-b2a5-6e755236fdae/root/var/svc/log/oxide-crucible-pantry:default.log |
1057 | 2023-10-21T17:24:58.261Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_external_dns_e2986a5e-5a4a-4ea2-b8eb-a180f669ff4f/root/var/svc/log/oxide-external_dns:default.log (15607 bytes) |
1058 | 2023-10-21T17:24:59.390Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_external_dns_e2986a5e-5a4a-4ea2-b8eb-a180f669ff4f/root/var/svc/log/oxide-external_dns:default.log |
1059 | 2023-10-21T17:24:59.414Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_81b58c34-c9f6-4010-a244-f19a1f147407/root/var/svc/log/oxide-nexus:default.log (562827 bytes) |
1060 | 2023-10-21T17:25:00.189Z | upload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_81b58c34-c9f6-4010-a244-f19a1f147407/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 562827 -> 564651 |
1061 | 2023-10-21T17:25:01.269Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_81b58c34-c9f6-4010-a244-f19a1f147407/root/var/svc/log/oxide-nexus:default.log |
1062 | 2023-10-21T17:25:01.303Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_c794c01e-a8b8-4e7e-a838-b95a384b7d27/root/var/svc/log/oxide-nexus:default.log (484848 bytes) |
1063 | 2023-10-21T17:25:02.375Z | upload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_c794c01e-a8b8-4e7e-a838-b95a384b7d27/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 484848 -> 486672 |
1064 | 2023-10-21T17:25:03.457Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_nexus_c794c01e-a8b8-4e7e-a838-b95a384b7d27/root/var/svc/log/oxide-nexus:default.log |
1065 | 2023-10-21T17:25:03.485Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_cockroachdb_c7d0803c-7204-455e-b287-d78706a7192c/root/var/svc/log/oxide-cockroachdb:default.log (5367 bytes) |
1066 | 2023-10-21T17:25:04.562Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_cockroachdb_c7d0803c-7204-455e-b287-d78706a7192c/root/var/svc/log/oxide-cockroachdb:default.log |
1067 | 2023-10-21T17:25:04.587Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_24919ab7-a3ff-49f2-8a8c-60dbae5e9f40/root/var/svc/log/oxide-crucible-agent:default.log (14584 bytes) |
1068 | 2023-10-21T17:25:05.715Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_24919ab7-a3ff-49f2-8a8c-60dbae5e9f40/root/var/svc/log/oxide-crucible-agent:default.log |
1069 | 2023-10-21T17:25:06.159Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_24919ab7-a3ff-49f2-8a8c-60dbae5e9f40/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1070 | 2023-10-21T17:25:07.379Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_24919ab7-a3ff-49f2-8a8c-60dbae5e9f40/root/var/svc/log/oxide-crucible-downstairs:default.log |
1071 | 2023-10-21T17:25:07.411Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_24919ab7-a3ff-49f2-8a8c-60dbae5e9f40/root/var/svc/log/oxide-crucible-downstairs:downstairs-cfca498b-73cc-4871-8bb6-ce7a1f026243.log (3051 bytes) |
1072 | 2023-10-21T17:25:07.952Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_24919ab7-a3ff-49f2-8a8c-60dbae5e9f40/root/var/svc/log/oxide-crucible-downstairs:downstairs-cfca498b-73cc-4871-8bb6-ce7a1f026243.log |
1073 | 2023-10-21T17:25:07.990Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c9f43b2a-a2e7-45c3-a9c7-d6412f04a757/root/var/svc/log/oxide-crucible-agent:default.log (3436 bytes) |
1074 | 2023-10-21T17:25:09.493Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c9f43b2a-a2e7-45c3-a9c7-d6412f04a757/root/var/svc/log/oxide-crucible-agent:default.log |
1075 | 2023-10-21T17:25:09.518Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c9f43b2a-a2e7-45c3-a9c7-d6412f04a757/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1076 | 2023-10-21T17:25:10.591Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c9f43b2a-a2e7-45c3-a9c7-d6412f04a757/root/var/svc/log/oxide-crucible-downstairs:default.log |
1077 | 2023-10-21T17:25:10.618Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_ed5b84c3-afde-4dee-a1b9-1beac74019df/root/var/svc/log/oxide-crucible-agent:default.log (13686 bytes) |
1078 | 2023-10-21T17:25:11.720Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_ed5b84c3-afde-4dee-a1b9-1beac74019df/root/var/svc/log/oxide-crucible-agent:default.log |
1079 | 2023-10-21T17:25:11.756Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_ed5b84c3-afde-4dee-a1b9-1beac74019df/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1080 | 2023-10-21T17:25:12.840Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_ed5b84c3-afde-4dee-a1b9-1beac74019df/root/var/svc/log/oxide-crucible-downstairs:default.log |
1081 | 2023-10-21T17:25:12.874Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_ed5b84c3-afde-4dee-a1b9-1beac74019df/root/var/svc/log/oxide-crucible-downstairs:downstairs-24ff5adc-1853-4203-87a5-22863762d673.log (5536 bytes) |
1082 | 2023-10-21T17:25:13.984Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_ed5b84c3-afde-4dee-a1b9-1beac74019df/root/var/svc/log/oxide-crucible-downstairs:downstairs-24ff5adc-1853-4203-87a5-22863762d673.log |
1083 | 2023-10-21T17:25:14.026Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_56e3551c-05ec-4be0-b5eb-93986572f140/root/var/svc/log/oxide-nexus:default.log (4570047 bytes) |
1084 | 2023-10-21T17:25:16.546Z | upload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_56e3551c-05ec-4be0-b5eb-93986572f140/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 4570047 -> 4631276 |
1085 | 2023-10-21T17:25:17.629Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_56e3551c-05ec-4be0-b5eb-93986572f140/root/var/svc/log/oxide-nexus:default.log |
1086 | 2023-10-21T17:25:17.655Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_5c8cf79f-14b4-477c-b047-2aab16e5cbd3/root/var/svc/log/oxide-crucible-agent:default.log (3435 bytes) |
1087 | 2023-10-21T17:25:18.726Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_5c8cf79f-14b4-477c-b047-2aab16e5cbd3/root/var/svc/log/oxide-crucible-agent:default.log |
1088 | 2023-10-21T17:25:18.750Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_5c8cf79f-14b4-477c-b047-2aab16e5cbd3/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1089 | 2023-10-21T17:25:19.820Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_5c8cf79f-14b4-477c-b047-2aab16e5cbd3/root/var/svc/log/oxide-crucible-downstairs:default.log |
1090 | 2023-10-21T17:25:19.846Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_internal_dns_ec283ed9-6ec8-49b5-950f-4ad017fb4124/root/var/svc/log/oxide-internal_dns:default.log (101989 bytes) |
1091 | 2023-10-21T17:25:20.052Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_internal_dns_ec283ed9-6ec8-49b5-950f-4ad017fb4124/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 101989 -> 105746 |
1092 | 2023-10-21T17:25:21.121Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_internal_dns_ec283ed9-6ec8-49b5-950f-4ad017fb4124/root/var/svc/log/oxide-internal_dns:default.log |
1093 | 2023-10-21T17:25:21.150Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_2e24bea2-1bd3-442c-b429-7fad5e1476e1/root/var/svc/log/oxide-cockroachdb:default.log (5343 bytes) |
1094 | 2023-10-21T17:25:22.219Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_2e24bea2-1bd3-442c-b429-7fad5e1476e1/root/var/svc/log/oxide-cockroachdb:default.log |
1095 | 2023-10-21T17:25:22.244Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_94a6202e-694a-4242-b8e1-96fcd32a23d3/root/var/svc/log/oxide-cockroachdb:default.log (5369 bytes) |
1096 | 2023-10-21T17:25:23.314Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_94a6202e-694a-4242-b8e1-96fcd32a23d3/root/var/svc/log/oxide-cockroachdb:default.log |
1097 | 2023-10-21T17:25:23.342Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/measurements.log (9042 bytes) |
1098 | 2023-10-21T17:25:23.392Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/measurements.log" changed size mid upload: 9042 -> 10549 |
1099 | 2023-10-21T17:25:24.464Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/measurements.log |
1100 | 2023-10-21T17:25:24.488Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/statistics.log (5850 bytes) |
1101 | 2023-10-21T17:25:24.512Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/statistics.log" changed size mid upload: 5850 -> 6786 |
1102 | 2023-10-21T17:25:25.581Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/statistics.log |
1103 | 2023-10-21T17:25:25.611Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/tracking.log (1323 bytes) |
1104 | 2023-10-21T17:25:25.636Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/tracking.log" changed size mid upload: 1323 -> 1455 |
1105 | 2023-10-21T17:25:26.707Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_3c13f373-0476-4552-974e-9e12dc2c1faf/root/var/log/chrony/tracking.log |