|
|
|
1 | 2023-12-11T18:33:34.390Z | job dependencies complete; ready to run (waiting for 45 m 50 s) |
2 | 2023-12-11T18:39:36.453Z | job assigned to worker 01HHD2FVZGXSSJSPY1Z6VP7D85 (queued for 6 m 2 s) |
3 | 2023-12-11T18:39:36.570Z | http://172.20.0.5:9969/ipxe/sock... ok |
4 | 2023-12-11T18:39:36.610Z | http://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok |
5 | 2023-12-11T18:39:36.643Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok |
6 | 2023-12-11T18:39:36.677Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok |
7 | 2023-12-11T18:39:36.711Z | http://172.20.0.5:9969/postboot/sock... ok |
8 | 2023-12-11T18:39:36.744Z | wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U |
9 | 2023-12-11T18:39:36.778Z | cpu0: microcode has been updated from version 0xa001133 to 0xa0011d1 |
10 | 2023-12-11T18:39:36.814Z | Oxide Helios Version helios-2.0.22333 64-bit |
11 | 2023-12-11T18:39:36.851Z | Configuring devices. |
12 | 2023-12-11T18:39:36.889Z | ################################################## |
13 | 2023-12-11T18:39:36.923Z | #### ############# ## |
14 | 2023-12-11T18:39:36.956Z | ### ### ############ ## |
15 | 2023-12-11T18:39:36.990Z | ## ### # ## ### ## Oxide Computer Company ## |
16 | 2023-12-11T18:39:37.024Z | ## ## ## ### # ### ## |
17 | 2023-12-11T18:39:37.066Z | ## # ### #### #### This Station Under ## |
18 | 2023-12-11T18:39:37.100Z | ### ### #### # ### Computer Control ## |
19 | 2023-12-11T18:39:37.134Z | #### #### ### ## ## |
20 | 2023-12-11T18:39:37.167Z | ################################################## |
21 | 2023-12-11T18:39:37.201Z | Hostname: sock |
22 | 2023-12-11T18:39:37.293Z | Loading smf(7) service descriptions: |
23 | 2023-12-11T18:39:37.926Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-8898bd4b8ded3394.gz |
24 | 2023-12-11T18:39:39.201Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-8898bd4b8ded3394.gz |
25 | 2023-12-11T18:39:39.226Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
26 | 2023-12-11T18:39:58.167Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
27 | 2023-12-11T18:39:58.192Z | downloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-76081d63fda74637.gz |
28 | 2023-12-11T18:40:18.369Z | downloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-76081d63fda74637.gz |
29 | 2023-12-11T18:40:18.394Z | downloading input: /input/ci-tools/work/caboose-util.gz |
30 | 2023-12-11T18:40:19.329Z | downloaded input: /input/ci-tools/work/caboose-util.gz |
31 | 2023-12-11T18:40:19.329Z | downloading input: /input/ci-tools/work/tufaceous.gz |
32 | 2023-12-11T18:40:24.245Z | downloaded input: /input/ci-tools/work/tufaceous.gz |
33 | 2023-12-11T18:40:24.245Z | downloading input: /input/package/work/version.txt |
34 | 2023-12-11T18:40:24.245Z | downloaded input: /input/package/work/version.txt |
35 | 2023-12-11T18:40:24.245Z | downloading input: /input/package/work/package.tar.gz |
36 | 2023-12-11T18:40:38.531Z | downloaded input: /input/package/work/package.tar.gz |
37 | 2023-12-11T18:40:38.531Z | downloading input: /input/package/work/global-zone-packages.tar.gz |
38 | 2023-12-11T18:41:00.548Z | downloaded input: /input/package/work/global-zone-packages.tar.gz |
39 | 2023-12-11T18:41:00.548Z | downloading input: /input/package/work/trampoline-global-zone-packages.tar.gz |
40 | 2023-12-11T18:41:07.881Z | downloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz |
41 | 2023-12-11T18:41:07.881Z | downloading input: /input/package/work/zones/clickhouse.tar.gz |
42 | 2023-12-11T18:41:39.515Z | downloaded input: /input/package/work/zones/clickhouse.tar.gz |
43 | 2023-12-11T18:41:39.515Z | downloading input: /input/package/work/zones/clickhouse_keeper.tar.gz |
44 | 2023-12-11T18:42:11.422Z | downloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz |
45 | 2023-12-11T18:42:11.422Z | downloading input: /input/package/work/zones/cockroachdb.tar.gz |
46 | 2023-12-11T18:42:33.375Z | downloaded input: /input/package/work/zones/cockroachdb.tar.gz |
47 | 2023-12-11T18:42:33.404Z | downloading input: /input/package/work/zones/crucible-pantry.tar.gz |
48 | 2023-12-11T18:42:38.336Z | downloaded input: /input/package/work/zones/crucible-pantry.tar.gz |
49 | 2023-12-11T18:42:38.361Z | downloading input: /input/package/work/zones/crucible.tar.gz |
50 | 2023-12-11T18:42:46.969Z | downloaded input: /input/package/work/zones/crucible.tar.gz |
51 | 2023-12-11T18:42:47.002Z | downloading input: /input/package/work/zones/external-dns.tar.gz |
52 | 2023-12-11T18:42:52.596Z | downloaded input: /input/package/work/zones/external-dns.tar.gz |
53 | 2023-12-11T18:42:52.596Z | downloading input: /input/package/work/zones/internal-dns.tar.gz |
54 | 2023-12-11T18:42:57.885Z | downloaded input: /input/package/work/zones/internal-dns.tar.gz |
55 | 2023-12-11T18:42:57.886Z | downloading input: /input/package/work/zones/ntp.tar.gz |
56 | 2023-12-11T18:42:57.931Z | downloaded input: /input/package/work/zones/ntp.tar.gz |
57 | 2023-12-11T18:42:57.957Z | downloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
58 | 2023-12-11T18:43:02.116Z | downloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
59 | 2023-12-11T18:43:02.117Z | downloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
60 | 2023-12-11T18:43:06.326Z | downloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
61 | 2023-12-11T18:43:06.326Z | downloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
62 | 2023-12-11T18:43:25.931Z | downloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
63 | 2023-12-11T18:43:25.931Z | downloading input: /input/package/work/zones/omicron-nexus.tar.gz |
64 | 2023-12-11T18:43:43.982Z | downloaded input: /input/package/work/zones/omicron-nexus.tar.gz |
65 | 2023-12-11T18:43:43.983Z | downloading input: /input/package/work/zones/overlay.tar.gz |
66 | 2023-12-11T18:43:44.048Z | downloaded input: /input/package/work/zones/overlay.tar.gz |
67 | 2023-12-11T18:43:44.048Z | downloading input: /input/package/work/zones/oximeter-collector.tar.gz |
68 | 2023-12-11T18:43:51.374Z | downloaded input: /input/package/work/zones/oximeter-collector.tar.gz |
69 | 2023-12-11T18:43:51.374Z | downloading input: /input/package/work/zones/propolis-server.tar.gz |
70 | 2023-12-11T18:44:05.483Z | downloaded input: /input/package/work/zones/propolis-server.tar.gz |
71 | 2023-12-11T18:44:05.484Z | downloading input: /input/package/work/zones/switch-asic.tar.gz |
72 | 2023-12-11T18:44:56.812Z | downloaded input: /input/package/work/zones/switch-asic.tar.gz |
73 | 2023-12-11T18:44:56.812Z | downloading input: /input/package/work/zones/switch-softnpu.tar.gz |
74 | 2023-12-11T18:45:36.295Z | downloaded input: /input/package/work/zones/switch-softnpu.tar.gz |
|
75 | 2023-12-11T18:45:36.321Z | starting task 0: "setup" |
76 | 2023-12-11T18:45:36.322Z | ++ uname -s |
77 | 2023-12-11T18:45:36.322Z | + kern=SunOS |
78 | 2023-12-11T18:45:36.322Z | + case "$kern" in |
79 | 2023-12-11T18:45:36.322Z | + groupadd -g 12345 build |
80 | 2023-12-11T18:45:36.322Z | + useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build |
81 | 2023-12-11T18:45:38.314Z | + zfs create -o mountpoint=/work rpool/work |
82 | 2023-12-11T18:45:38.338Z | ++ awk '$2 == "/home" { print $3 }' /etc/mnttab |
83 | 2023-12-11T18:45:38.363Z | + home_fs=zfs |
84 | 2023-12-11T18:45:38.363Z | + [[ zfs == autofs ]] |
85 | 2023-12-11T18:45:38.364Z | + mkdir -p /home/build |
86 | 2023-12-11T18:45:38.364Z | + chown build:build /home/build /work |
87 | 2023-12-11T18:45:40.364Z | + chmod 0700 /home/build /work |
88 | 2023-12-11T18:45:40.390Z | process exited: duration 4054 ms, exit code 0 |
|
89 | 2023-12-11T18:45:40.451Z | starting task 1: "authentication" |
90 | 2023-12-11T18:45:40.493Z | process exited: duration 43 ms, exit code 0 |
|
91 | 2023-12-11T18:45:40.542Z | starting task 2: "build" |
92 | 2023-12-11T18:45:40.568Z | + trap _exit_trap EXIT |
93 | 2023-12-11T18:45:40.568Z | + pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3' |
94 | 2023-12-11T18:45:40.744Z | secpolicy_fs_linkdir: 0x55 = 0x55 |
95 | 2023-12-11T18:45:40.744Z | secpolicy_fs_linkdir+1: 0xb8 = 0x48 |
96 | 2023-12-11T18:45:40.744Z | secpolicy_fs_linkdir+2: 0x1 = 0x89 |
97 | 2023-12-11T18:45:40.744Z | secpolicy_fs_linkdir+3: 0 = 0xe5 |
98 | 2023-12-11T18:45:40.744Z | secpolicy_fs_linkdir+4: 0 = 0xb8 |
99 | 2023-12-11T18:45:40.744Z | secpolicy_fs_linkdir+5: 0 = 0x1 |
100 | 2023-12-11T18:45:40.769Z | secpolicy_fs_linkdir+6: 0x48 = 0x0 |
101 | 2023-12-11T18:45:40.769Z | secpolicy_fs_linkdir+7: 0x89 = 0x0 |
102 | 2023-12-11T18:45:40.769Z | secpolicy_fs_linkdir+8: 0xe5 = 0x0 |
103 | 2023-12-11T18:45:40.769Z | secpolicy_fs_linkdir+9: 0x48 = 0x5d |
104 | 2023-12-11T18:45:40.769Z | secpolicy_fs_linkdir+0xa: 0x83 = 0xc3 |
105 | 2023-12-11T18:45:40.769Z | + [[ -d /opt/oxide ]] |
106 | 2023-12-11T18:45:40.769Z | + pfexec mv /opt/oxide /opt/oxide-underneath |
107 | 2023-12-11T18:45:40.769Z | + pfexec mkdir /opt/oxide |
108 | 2023-12-11T18:45:40.769Z | + pfexec mount -F tmpfs -O swap /opt/oxide |
109 | 2023-12-11T18:45:40.769Z | + [[ -d /opt/oxide-underneath ]] |
110 | 2023-12-11T18:45:40.769Z | + cd /opt/oxide-underneath |
111 | 2023-12-11T18:45:40.769Z | + pfexec tar ceEp@/f - . |
112 | 2023-12-11T18:45:40.769Z | + cd /opt/oxide |
113 | 2023-12-11T18:45:40.770Z | + pfexec tar xveEp@/f - |
114 | 2023-12-11T18:45:40.876Z | x ., 0 bytes, 0 tape blocks |
115 | 2023-12-11T18:45:40.877Z | x ./opte, 0 bytes, 0 tape blocks |
116 | 2023-12-11T18:45:40.877Z | x ./opte/bin, 0 bytes, 0 tape blocks |
117 | 2023-12-11T18:45:40.877Z | x ./opte/bin/opteadm, 52567720 bytes, 102672 tape blocks |
118 | 2023-12-11T18:45:40.908Z | + pfexec rm -rf /opt/oxide-underneath |
119 | 2023-12-11T18:45:40.909Z | + pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone |
120 | 2023-12-11T18:45:40.909Z | + pfexec mkdir /opt/oxide/work |
121 | 2023-12-11T18:45:40.909Z | + pfexec chown build:build /opt/oxide/work |
122 | 2023-12-11T18:45:40.939Z | + cd /opt/oxide/work |
123 | 2023-12-11T18:45:40.940Z | + ptime -m tar xvzf /input/package/work/package.tar.gz |
124 | 2023-12-11T18:45:42.463Z | Decompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'... |
125 | 2023-12-11T18:45:42.463Z | x out/mg-ddm-gz.tar, 62723072 bytes, 122506 tape blocks |
126 | 2023-12-11T18:45:42.464Z | x out/omicron-sled-agent.tar, 111842816 bytes, 218443 tape blocks |
127 | 2023-12-11T18:45:42.464Z | x out/target/test, 75 bytes, 1 tape blocks |
128 | 2023-12-11T18:45:42.464Z | x out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks |
129 | 2023-12-11T18:45:42.464Z | x package-manifest.toml, 22143 bytes, 44 tape blocks |
130 | 2023-12-11T18:45:42.464Z | x smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks |
131 | 2023-12-11T18:45:42.464Z | x target/release/omicron-package, 42512064 bytes, 83032 tape blocks |
132 | 2023-12-11T18:45:42.465Z | x tools/create_virtual_hardware.sh, 3176 bytes, 7 tape blocks |
133 | 2023-12-11T18:45:42.465Z | x tools/virtual_hardware.sh, 3408 bytes, 7 tape blocks |
134 | 2023-12-11T18:45:42.465Z | x tools/scrimlet/create-softnpu-zone.sh, 619 bytes, 2 tape blocks |
135 | 2023-12-11T18:45:42.465Z | x tools/scrimlet/destroy-softnpu-zone.sh, 195 bytes, 1 tape blocks |
136 | 2023-12-11T18:45:42.467Z | x tools/scrimlet/softnpu-init.sh, 2148 bytes, 5 tape blocks |
137 | 2023-12-11T18:45:42.467Z | x tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks |
138 | 2023-12-11T18:45:42.467Z | x tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks |
139 | 2023-12-11T18:45:42.497Z | |
140 | 2023-12-11T18:45:42.497Z | real 1.545462330 |
141 | 2023-12-11T18:45:42.498Z | user 1.383264634 |
142 | 2023-12-11T18:45:42.498Z | sys 0.279695128 |
143 | 2023-12-11T18:45:42.498Z | trap 0.000056352 |
144 | 2023-12-11T18:45:42.498Z | tflt 0.000000000 |
145 | 2023-12-11T18:45:42.498Z | dflt 0.000000000 |
146 | 2023-12-11T18:45:42.498Z | kflt 0.000000000 |
147 | 2023-12-11T18:45:42.498Z | lock 0.000000000 |
148 | 2023-12-11T18:45:42.498Z | slp 1.391505205 |
149 | 2023-12-11T18:45:42.498Z | lat 0.034177124 |
150 | 2023-12-11T18:45:42.498Z | stop 0.000127842 |
151 | 2023-12-11T18:45:42.499Z | + cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter-collector.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/ |
152 | 2023-12-11T18:45:43.543Z | + mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz |
153 | 2023-12-11T18:45:43.571Z | + mkdir tests |
154 | 2023-12-11T18:45:43.571Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
155 | 2023-12-11T18:45:43.571Z | + ptime -m gunzip |
156 | 2023-12-11T18:45:43.571Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-8898bd4b8ded3394 |
157 | 2023-12-11T18:45:43.696Z | |
158 | 2023-12-11T18:45:43.721Z | real 0.139917305 |
159 | 2023-12-11T18:45:43.721Z | user 0.126378737 |
160 | 2023-12-11T18:45:43.721Z | sys 0.013302221 |
161 | 2023-12-11T18:45:43.721Z | trap 0.000010130 |
162 | 2023-12-11T18:45:43.721Z | tflt 0.000000000 |
163 | 2023-12-11T18:45:43.721Z | dflt 0.000000000 |
164 | 2023-12-11T18:45:43.721Z | kflt 0.000000000 |
165 | 2023-12-11T18:45:43.721Z | lock 0.000000000 |
166 | 2023-12-11T18:45:43.721Z | slp 0.000024360 |
167 | 2023-12-11T18:45:43.721Z | lat 0.000024270 |
168 | 2023-12-11T18:45:43.721Z | stop 0.000122993 |
169 | 2023-12-11T18:45:43.722Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-8898bd4b8ded3394 |
170 | 2023-12-11T18:45:43.722Z | + chmod a+x tests/bootstrap-8898bd4b8ded3394 |
171 | 2023-12-11T18:45:43.722Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
172 | 2023-12-11T18:45:43.722Z | + ptime -m gunzip |
173 | 2023-12-11T18:45:43.722Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
174 | 2023-12-11T18:45:45.916Z | |
175 | 2023-12-11T18:45:45.940Z | real 2.207942699 |
176 | 2023-12-11T18:45:45.940Z | user 2.080229540 |
177 | 2023-12-11T18:45:45.941Z | sys 0.127333423 |
178 | 2023-12-11T18:45:45.941Z | trap 0.000170542 |
179 | 2023-12-11T18:45:45.941Z | tflt 0.000000000 |
180 | 2023-12-11T18:45:45.941Z | dflt 0.000000000 |
181 | 2023-12-11T18:45:45.941Z | kflt 0.000000000 |
182 | 2023-12-11T18:45:45.941Z | lock 0.000000000 |
183 | 2023-12-11T18:45:45.941Z | slp 0.000021570 |
184 | 2023-12-11T18:45:45.941Z | lat 0.000016740 |
185 | 2023-12-11T18:45:45.941Z | stop 0.000109012 |
186 | 2023-12-11T18:45:45.941Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
187 | 2023-12-11T18:45:45.941Z | + chmod a+x tests/bootstrap |
188 | 2023-12-11T18:45:45.941Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
189 | 2023-12-11T18:45:45.941Z | + ptime -m gunzip |
190 | 2023-12-11T18:45:45.941Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-76081d63fda74637 |
191 | 2023-12-11T18:45:48.217Z | |
192 | 2023-12-11T18:45:48.243Z | real 2.289204416 |
193 | 2023-12-11T18:45:48.243Z | user 2.158336588 |
194 | 2023-12-11T18:45:48.243Z | sys 0.130440550 |
195 | 2023-12-11T18:45:48.243Z | trap 0.000192553 |
196 | 2023-12-11T18:45:48.243Z | tflt 0.000000000 |
197 | 2023-12-11T18:45:48.243Z | dflt 0.000000000 |
198 | 2023-12-11T18:45:48.243Z | kflt 0.000000000 |
199 | 2023-12-11T18:45:48.243Z | lock 0.000000000 |
200 | 2023-12-11T18:45:48.243Z | slp 0.000022200 |
201 | 2023-12-11T18:45:48.243Z | lat 0.000022801 |
202 | 2023-12-11T18:45:48.243Z | stop 0.000123652 |
203 | 2023-12-11T18:45:48.243Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-76081d63fda74637 |
204 | 2023-12-11T18:45:48.243Z | + chmod a+x tests/end_to_end_tests-76081d63fda74637 |
205 | 2023-12-11T18:45:48.243Z | + bmat address ls |
206 | 2023-12-11T18:45:48.243Z | NAME CIDR FIRST LAST COUNT |
207 | 2023-12-11T18:45:48.243Z | extra 10.151.2.0/24 10.151.2.164 10.151.2.227 64 |
208 | 2023-12-11T18:45:48.244Z | ++ bmat address ls -f extra -Ho first,last,count |
209 | 2023-12-11T18:45:48.268Z | + set -- 10.151.2.164 10.151.2.227 64 |
210 | 2023-12-11T18:45:48.268Z | + EXTRA_IP_START=10.151.2.164 |
211 | 2023-12-11T18:45:48.268Z | + EXTRA_IP_END=10.151.2.227 |
212 | 2023-12-11T18:45:48.270Z | + EXTRA_IP_COUNT=64 |
213 | 2023-12-11T18:45:48.270Z | + (( EXTRA_IP_COUNT >= 32 )) |
214 | 2023-12-11T18:45:48.270Z | + EXTRA_IP_BASE=10.151.2 |
215 | 2023-12-11T18:45:48.270Z | + EXTRA_IP_FOCTET=164 |
216 | 2023-12-11T18:45:48.270Z | + EXTRA_IP_LOCTET=227 |
217 | 2023-12-11T18:45:48.270Z | + SERVICE_IP_POOL_START=10.151.2.164 |
218 | 2023-12-11T18:45:48.270Z | + SERVICE_IP_POOL_END=10.151.2.173 |
219 | 2023-12-11T18:45:48.270Z | + DNS_IP1=10.151.2.164 |
220 | 2023-12-11T18:45:48.270Z | + DNS_IP2=10.151.2.165 |
221 | 2023-12-11T18:45:48.270Z | + UPLINK_IP=10.151.2.174 |
222 | 2023-12-11T18:45:48.270Z | + IPPOOL_START=10.151.2.175 |
223 | 2023-12-11T18:45:48.270Z | + IPPOOL_END=10.151.2.227 |
224 | 2023-12-11T18:45:48.270Z | ++ ipadm show-addr -po type,addr |
225 | 2023-12-11T18:45:48.270Z | ++ awk '-F[:/]' '$1 == "dhcp" {print $2}' |
226 | 2023-12-11T18:45:48.270Z | + GATEWAY_IP=10.151.2.100 |
227 | 2023-12-11T18:45:48.270Z | + [[ -n 10.151.2.100 ]] |
228 | 2023-12-11T18:45:48.270Z | + ping -s 10.151.2.100 56 1 |
229 | 2023-12-11T18:45:48.271Z | PING 10.151.2.100: 56 data bytes |
230 | 2023-12-11T18:45:48.271Z | 64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms |
231 | 2023-12-11T18:45:48.271Z | |
232 | 2023-12-11T18:45:48.271Z | ----10.151.2.100 PING Statistics---- |
233 | 2023-12-11T18:45:48.273Z | 1 packets transmitted, 1 packets received, 0% packet loss |
234 | 2023-12-11T18:45:48.273Z | round-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan |
235 | 2023-12-11T18:45:48.273Z | ++ arp -an |
236 | 2023-12-11T18:45:48.273Z | ++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}' |
237 | 2023-12-11T18:45:48.298Z | + GATEWAY_MAC=18:c0:4d:0d:a0:2a |
238 | 2023-12-11T18:45:48.298Z | + routeadm -e ipv4-forwarding -u |
239 | 2023-12-11T18:45:48.379Z | + PXA_START=10.151.2.164 |
240 | 2023-12-11T18:45:48.410Z | + PXA_END=10.151.2.227 |
241 | 2023-12-11T18:45:48.410Z | + export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END |
242 | 2023-12-11T18:45:48.410Z | + pfexec zpool create -f scratch c1t1d0 c2t1d0 |
243 | 2023-12-11T18:45:48.572Z | + ZPOOL_VDEV_DIR=/scratch |
244 | 2023-12-11T18:45:48.572Z | + ptime -m pfexec ./tools/create_virtual_hardware.sh |
245 | 2023-12-11T18:45:48.597Z | +++ dirname ./tools/create_virtual_hardware.sh |
246 | 2023-12-11T18:45:48.597Z | ++ cd ./tools |
247 | 2023-12-11T18:45:48.597Z | ++ pwd |
248 | 2023-12-11T18:45:48.597Z | + SOURCE_DIR=/opt/oxide/work/tools |
249 | 2023-12-11T18:45:48.598Z | + OMICRON_TOP=/opt/oxide/work/tools/.. |
250 | 2023-12-11T18:45:48.598Z | + SOFTNPU_MODE=zone |
251 | 2023-12-11T18:45:48.598Z | + . /opt/oxide/work/tools/virtual_hardware.sh |
252 | 2023-12-11T18:45:48.598Z | ++ MARKER=/etc/opt/oxide/NO_INSTALL |
253 | 2023-12-11T18:45:48.598Z | ++ [[ -f /etc/opt/oxide/NO_INSTALL ]] |
254 | 2023-12-11T18:45:48.598Z | ++ dladm show-phys -p -o LINK |
255 | 2023-12-11T18:45:48.598Z | ++ head -1 |
256 | 2023-12-11T18:45:48.670Z | + PHYSICAL_LINK=igb0 |
257 | 2023-12-11T18:45:48.702Z | + echo 'Using igb0 as physical link' |
258 | 2023-12-11T18:45:48.702Z | Using igb0 as physical link |
259 | 2023-12-11T18:45:48.703Z | + ensure_run_as_root |
260 | 2023-12-11T18:45:48.703Z | ++ id -u |
261 | 2023-12-11T18:45:48.703Z | + [[ 0 -ne 0 ]] |
262 | 2023-12-11T18:45:48.703Z | + ensure_zpools |
263 | 2023-12-11T18:45:48.703Z | + ZPOOL_TYPES=('oxp_' 'oxi_') |
264 | 2023-12-11T18:45:48.704Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
265 | 2023-12-11T18:45:48.704Z | + readarray -t ZPOOLS |
266 | 2023-12-11T18:45:48.704Z | ++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
267 | 2023-12-11T18:45:48.704Z | ++ sed 's/[ ",]//g' |
268 | 2023-12-11T18:45:48.704Z | + for ZPOOL in "${ZPOOLS[@]}" |
269 | 2023-12-11T18:45:48.704Z | + echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
270 | 2023-12-11T18:45:48.704Z | Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b] |
271 | 2023-12-11T18:45:48.704Z | + VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
272 | 2023-12-11T18:45:48.704Z | + [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
273 | 2023-12-11T18:45:48.704Z | + dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
274 | 2023-12-11T18:45:48.704Z | 0+0 records in |
275 | 2023-12-11T18:45:48.704Z | 0+0 records out |
276 | 2023-12-11T18:45:48.704Z | 0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec) |
277 | 2023-12-11T18:45:48.704Z | + success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
278 | 2023-12-11T18:45:48.704Z | + set +x |
279 | 2023-12-11T18:45:48.704Z | ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
280 | 2023-12-11T18:45:48.704Z | ++ zpool list -o name |
281 | 2023-12-11T18:45:48.705Z | ++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b |
282 | 2023-12-11T18:45:48.705Z | + [[ -z '' ]] |
283 | 2023-12-11T18:45:48.705Z | + zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
284 | 2023-12-11T18:45:48.753Z | + success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
285 | 2023-12-11T18:45:48.779Z | + set +x |
286 | 2023-12-11T18:45:48.779Z | ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
287 | 2023-12-11T18:45:48.779Z | + for ZPOOL in "${ZPOOLS[@]}" |
288 | 2023-12-11T18:45:48.779Z | + echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
289 | 2023-12-11T18:45:48.779Z | Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
290 | 2023-12-11T18:45:48.779Z | + VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
291 | 2023-12-11T18:45:48.779Z | + [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
292 | 2023-12-11T18:45:48.779Z | + dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
293 | 2023-12-11T18:45:48.779Z | 0+0 records in |
294 | 2023-12-11T18:45:48.779Z | 0+0 records out |
295 | 2023-12-11T18:45:48.779Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
296 | 2023-12-11T18:45:48.779Z | + success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
297 | 2023-12-11T18:45:48.779Z | + set +x |
298 | 2023-12-11T18:45:48.779Z | ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
299 | 2023-12-11T18:45:48.780Z | ++ zpool list -o name |
300 | 2023-12-11T18:45:48.780Z | ++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
301 | 2023-12-11T18:45:48.780Z | + [[ -z '' ]] |
302 | 2023-12-11T18:45:48.780Z | + zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
303 | 2023-12-11T18:45:48.804Z | + success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
304 | 2023-12-11T18:45:48.804Z | + set +x |
305 | 2023-12-11T18:45:48.805Z | ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
306 | 2023-12-11T18:45:48.805Z | + for ZPOOL in "${ZPOOLS[@]}" |
307 | 2023-12-11T18:45:48.805Z | Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
308 | 2023-12-11T18:45:48.805Z | + echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
309 | 2023-12-11T18:45:48.805Z | + VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
310 | 2023-12-11T18:45:48.805Z | + [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
311 | 2023-12-11T18:45:48.805Z | + dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
312 | 2023-12-11T18:45:48.806Z | 0+0 records in |
313 | 2023-12-11T18:45:48.806Z | 0+0 records out |
314 | 2023-12-11T18:45:48.806Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
315 | 2023-12-11T18:45:48.806Z | + success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
316 | 2023-12-11T18:45:48.806Z | + set +x |
317 | 2023-12-11T18:45:48.806Z | ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
318 | 2023-12-11T18:45:48.830Z | ++ zpool list -o name |
319 | 2023-12-11T18:45:48.830Z | ++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
320 | 2023-12-11T18:45:48.830Z | + [[ -z '' ]] |
321 | 2023-12-11T18:45:48.830Z | + zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
322 | 2023-12-11T18:45:48.858Z | + success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
323 | 2023-12-11T18:45:48.859Z | + set +x |
324 | 2023-12-11T18:45:48.859Z | ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
325 | 2023-12-11T18:45:48.859Z | + for ZPOOL in "${ZPOOLS[@]}" |
326 | 2023-12-11T18:45:48.859Z | + echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
327 | 2023-12-11T18:45:48.859Z | Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03] |
328 | 2023-12-11T18:45:48.860Z | + VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
329 | 2023-12-11T18:45:48.860Z | + [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
330 | 2023-12-11T18:45:48.860Z | + dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
331 | 2023-12-11T18:45:48.860Z | 0+0 records in |
332 | 2023-12-11T18:45:48.860Z | 0+0 records out |
333 | 2023-12-11T18:45:48.860Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
334 | 2023-12-11T18:45:48.860Z | + success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
335 | 2023-12-11T18:45:48.861Z | + set +x |
336 | 2023-12-11T18:45:48.861Z | ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
337 | 2023-12-11T18:45:48.889Z | ++ zpool list -o name |
338 | 2023-12-11T18:45:48.889Z | ++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 |
339 | 2023-12-11T18:45:48.889Z | + [[ -z '' ]] |
340 | 2023-12-11T18:45:48.889Z | + zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
341 | 2023-12-11T18:45:48.915Z | + success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
342 | 2023-12-11T18:45:48.915Z | + set +x |
343 | 2023-12-11T18:45:48.915Z | ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
344 | 2023-12-11T18:45:48.915Z | + for ZPOOL in "${ZPOOLS[@]}" |
345 | 2023-12-11T18:45:48.915Z | + echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
346 | 2023-12-11T18:45:48.915Z | Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03] |
347 | 2023-12-11T18:45:48.915Z | + VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
348 | 2023-12-11T18:45:48.915Z | + [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
349 | 2023-12-11T18:45:48.916Z | + dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
350 | 2023-12-11T18:45:48.916Z | 0+0 records in |
351 | 2023-12-11T18:45:48.916Z | 0+0 records out |
352 | 2023-12-11T18:45:48.916Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
353 | 2023-12-11T18:45:48.916Z | + success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
354 | 2023-12-11T18:45:48.916Z | + set +x |
355 | 2023-12-11T18:45:48.916Z | ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
356 | 2023-12-11T18:45:48.916Z | ++ zpool list -o name |
357 | 2023-12-11T18:45:48.916Z | ++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 |
358 | 2023-12-11T18:45:48.942Z | + [[ -z '' ]] |
359 | 2023-12-11T18:45:48.942Z | + zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
360 | 2023-12-11T18:45:48.968Z | + success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
361 | 2023-12-11T18:45:48.968Z | + set +x |
362 | 2023-12-11T18:45:48.968Z | ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
363 | 2023-12-11T18:45:48.968Z | + for ZPOOL in "${ZPOOLS[@]}" |
364 | 2023-12-11T18:45:48.968Z | + echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]' |
365 | 2023-12-11T18:45:48.968Z | Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930] |
366 | 2023-12-11T18:45:48.969Z | + VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
367 | 2023-12-11T18:45:48.969Z | + [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]] |
368 | 2023-12-11T18:45:48.969Z | + dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G |
369 | 2023-12-11T18:45:48.969Z | 0+0 records in |
370 | 2023-12-11T18:45:48.969Z | 0+0 records out |
371 | 2023-12-11T18:45:48.969Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
372 | 2023-12-11T18:45:48.969Z | + success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists' |
373 | 2023-12-11T18:45:48.969Z | + set +x |
374 | 2023-12-11T18:45:48.969Z | ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists |
375 | 2023-12-11T18:45:48.969Z | ++ zpool list -o name |
376 | 2023-12-11T18:45:48.970Z | ++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 |
377 | 2023-12-11T18:45:48.994Z | + [[ -z '' ]] |
378 | 2023-12-11T18:45:48.994Z | + zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
379 | 2023-12-11T18:45:49.019Z | + success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists' |
380 | 2023-12-11T18:45:49.019Z | + set +x |
381 | 2023-12-11T18:45:49.019Z | ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists |
382 | 2023-12-11T18:45:49.019Z | + for ZPOOL in "${ZPOOLS[@]}" |
383 | 2023-12-11T18:45:49.019Z | + echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]' |
384 | 2023-12-11T18:45:49.019Z | + VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
385 | 2023-12-11T18:45:49.019Z | + [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]] |
386 | 2023-12-11T18:45:49.020Z | Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60] |
387 | 2023-12-11T18:45:49.020Z | + dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G |
388 | 2023-12-11T18:45:49.020Z | 0+0 records in |
389 | 2023-12-11T18:45:49.020Z | 0+0 records out |
390 | 2023-12-11T18:45:49.020Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
391 | 2023-12-11T18:45:49.020Z | + success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists' |
392 | 2023-12-11T18:45:49.020Z | + set +x |
393 | 2023-12-11T18:45:49.020Z | ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists |
394 | 2023-12-11T18:45:49.020Z | ++ zpool list -o name |
395 | 2023-12-11T18:45:49.020Z | ++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 |
396 | 2023-12-11T18:45:49.045Z | + [[ -z '' ]] |
397 | 2023-12-11T18:45:49.046Z | + zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
398 | 2023-12-11T18:45:49.070Z | + success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists' |
399 | 2023-12-11T18:45:49.070Z | + set +x |
400 | 2023-12-11T18:45:49.071Z | ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists |
401 | 2023-12-11T18:45:49.071Z | + for ZPOOL in "${ZPOOLS[@]}" |
402 | 2023-12-11T18:45:49.071Z | + echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]' |
403 | 2023-12-11T18:45:49.071Z | Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f] |
404 | 2023-12-11T18:45:49.071Z | + VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
405 | 2023-12-11T18:45:49.071Z | + [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]] |
406 | 2023-12-11T18:45:49.071Z | + dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G |
407 | 2023-12-11T18:45:49.071Z | 0+0 records in |
408 | 2023-12-11T18:45:49.072Z | 0+0 records out |
409 | 2023-12-11T18:45:49.072Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
410 | 2023-12-11T18:45:49.072Z | + success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists' |
411 | 2023-12-11T18:45:49.072Z | + set +x |
412 | 2023-12-11T18:45:49.072Z | ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists |
413 | 2023-12-11T18:45:49.072Z | ++ zpool list -o name |
414 | 2023-12-11T18:45:49.072Z | ++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f |
415 | 2023-12-11T18:45:49.096Z | + [[ -z '' ]] |
416 | 2023-12-11T18:45:49.097Z | + zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
417 | 2023-12-11T18:45:49.121Z | + success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists' |
418 | 2023-12-11T18:45:49.121Z | + set +x |
419 | 2023-12-11T18:45:49.121Z | ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists |
420 | 2023-12-11T18:45:49.121Z | + for ZPOOL in "${ZPOOLS[@]}" |
421 | 2023-12-11T18:45:49.121Z | + echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]' |
422 | 2023-12-11T18:45:49.121Z | Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7] |
423 | 2023-12-11T18:45:49.121Z | + VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
424 | 2023-12-11T18:45:49.121Z | + [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]] |
425 | 2023-12-11T18:45:49.121Z | + dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G |
426 | 2023-12-11T18:45:49.122Z | 0+0 records in |
427 | 2023-12-11T18:45:49.122Z | 0+0 records out |
428 | 2023-12-11T18:45:49.122Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
429 | 2023-12-11T18:45:49.122Z | + success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists' |
430 | 2023-12-11T18:45:49.122Z | + set +x |
431 | 2023-12-11T18:45:49.122Z | ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists |
432 | 2023-12-11T18:45:49.146Z | ++ zpool list -o name |
433 | 2023-12-11T18:45:49.147Z | ++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 |
434 | 2023-12-11T18:45:49.147Z | + [[ -z '' ]] |
435 | 2023-12-11T18:45:49.147Z | + zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
436 | 2023-12-11T18:45:49.172Z | + success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists' |
437 | 2023-12-11T18:45:49.172Z | + set +x |
438 | 2023-12-11T18:45:49.172Z | ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists |
439 | 2023-12-11T18:45:49.172Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
440 | 2023-12-11T18:45:49.172Z | + readarray -t ZPOOLS |
441 | 2023-12-11T18:45:49.172Z | ++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
442 | 2023-12-11T18:45:49.197Z | ++ sed 's/[ ",]//g' |
443 | 2023-12-11T18:45:49.197Z | + for ZPOOL in "${ZPOOLS[@]}" |
444 | 2023-12-11T18:45:49.197Z | + echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
445 | 2023-12-11T18:45:49.197Z | Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b] |
446 | 2023-12-11T18:45:49.197Z | + VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
447 | 2023-12-11T18:45:49.197Z | + [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
448 | 2023-12-11T18:45:49.197Z | + dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
449 | 2023-12-11T18:45:49.197Z | 0+0 records in |
450 | 2023-12-11T18:45:49.197Z | 0+0 records out |
451 | 2023-12-11T18:45:49.197Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
452 | 2023-12-11T18:45:49.197Z | + success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
453 | 2023-12-11T18:45:49.197Z | + set +x |
454 | 2023-12-11T18:45:49.197Z | ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
455 | 2023-12-11T18:45:49.197Z | ++ zpool list -o name |
456 | 2023-12-11T18:45:49.198Z | ++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b |
457 | 2023-12-11T18:45:49.198Z | + [[ -z '' ]] |
458 | 2023-12-11T18:45:49.198Z | + zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
459 | 2023-12-11T18:45:49.227Z | + success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
460 | 2023-12-11T18:45:49.227Z | + set +x |
461 | 2023-12-11T18:45:49.251Z | ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
462 | 2023-12-11T18:45:49.251Z | + for ZPOOL in "${ZPOOLS[@]}" |
463 | 2023-12-11T18:45:49.251Z | + echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
464 | 2023-12-11T18:45:49.251Z | Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b] |
465 | 2023-12-11T18:45:49.251Z | + VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
466 | 2023-12-11T18:45:49.251Z | + [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
467 | 2023-12-11T18:45:49.251Z | + dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
468 | 2023-12-11T18:45:49.252Z | 0+0 records in |
469 | 2023-12-11T18:45:49.252Z | 0+0 records out |
470 | 2023-12-11T18:45:49.252Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
471 | 2023-12-11T18:45:49.252Z | + success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
472 | 2023-12-11T18:45:49.252Z | + set +x |
473 | 2023-12-11T18:45:49.252Z | ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
474 | 2023-12-11T18:45:49.252Z | ++ zpool list -o name |
475 | 2023-12-11T18:45:49.252Z | ++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b |
476 | 2023-12-11T18:45:49.252Z | + [[ -z '' ]] |
477 | 2023-12-11T18:45:49.252Z | + zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
478 | 2023-12-11T18:45:49.287Z | + success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
479 | 2023-12-11T18:45:49.287Z | + set +x |
480 | 2023-12-11T18:45:49.321Z | ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
481 | 2023-12-11T18:45:49.322Z | + [[ zone == \z\o\n\e ]] |
482 | 2023-12-11T18:45:49.322Z | + ensure_simulated_links igb0 |
483 | 2023-12-11T18:45:49.322Z | + local PHYSICAL_LINK=igb0 |
484 | 2023-12-11T18:45:49.323Z | + INDICES=("0" "1") |
485 | 2023-12-11T18:45:49.323Z | + for I in "${INDICES[@]}" |
486 | 2023-12-11T18:45:49.323Z | ++ get_simnet_name_if_exists net0 |
487 | 2023-12-11T18:45:49.323Z | ++ dladm show-simnet -p -o LINK net0 |
488 | 2023-12-11T18:45:49.323Z | ++ echo '' |
489 | 2023-12-11T18:45:49.323Z | + [[ -z '' ]] |
490 | 2023-12-11T18:45:49.323Z | + dladm create-simnet -t net0 |
491 | 2023-12-11T18:45:49.324Z | + dladm create-simnet -t sc0_0 |
492 | 2023-12-11T18:45:49.324Z | + dladm modify-simnet -t -p net0 sc0_0 |
493 | 2023-12-11T18:45:49.324Z | + dladm set-linkprop -p mtu=9000 sc0_0 |
494 | 2023-12-11T18:45:49.325Z | + success 'Simnet net0/sc0_0 exists' |
495 | 2023-12-11T18:45:49.325Z | + set +x |
496 | 2023-12-11T18:45:49.325Z | Simnet net0/sc0_0 exists |
497 | 2023-12-11T18:45:49.325Z | + for I in "${INDICES[@]}" |
498 | 2023-12-11T18:45:49.325Z | ++ get_simnet_name_if_exists net1 |
499 | 2023-12-11T18:45:49.325Z | ++ dladm show-simnet -p -o LINK net1 |
500 | 2023-12-11T18:45:49.325Z | ++ echo '' |
501 | 2023-12-11T18:45:49.325Z | + [[ -z '' ]] |
502 | 2023-12-11T18:45:49.325Z | + dladm create-simnet -t net1 |
503 | 2023-12-11T18:45:49.325Z | + dladm create-simnet -t sc1_0 |
504 | 2023-12-11T18:45:49.351Z | + dladm modify-simnet -t -p net1 sc1_0 |
505 | 2023-12-11T18:45:49.352Z | + dladm set-linkprop -p mtu=9000 sc1_0 |
506 | 2023-12-11T18:45:49.352Z | + success 'Simnet net1/sc1_0 exists' |
507 | 2023-12-11T18:45:49.352Z | + set +x |
508 | 2023-12-11T18:45:49.352Z | Simnet net1/sc1_0 exists |
509 | 2023-12-11T18:45:49.352Z | ++ get_vnic_name_if_exists sc0_1 |
510 | 2023-12-11T18:45:49.352Z | ++ dladm show-vnic -p -o LINK sc0_1 |
511 | 2023-12-11T18:45:49.352Z | ++ echo '' |
512 | 2023-12-11T18:45:49.352Z | + [[ -z '' ]] |
513 | 2023-12-11T18:45:49.352Z | + dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d |
514 | 2023-12-11T18:45:49.353Z | + [[ -v PROMISC_FILT_OFF ]] |
515 | 2023-12-11T18:45:49.353Z | + success 'Vnic sc0_1 exists' |
516 | 2023-12-11T18:45:49.353Z | + set +x |
517 | 2023-12-11T18:45:49.353Z | Vnic sc0_1 exists |
518 | 2023-12-11T18:45:49.353Z | + warn_if_no_proxy_arp |
519 | 2023-12-11T18:45:49.353Z | + [[ -v PXA_START ]] |
520 | 2023-12-11T18:45:49.353Z | + [[ -v PXA_END ]] |
521 | 2023-12-11T18:45:49.353Z | + ensure_softnpu_zone |
522 | 2023-12-11T18:45:49.353Z | + zoneadm list |
523 | 2023-12-11T18:45:49.353Z | + grep -q sidecar_softnpu |
524 | 2023-12-11T18:45:49.354Z | + [[ -f out/npuzone/npuzone ]] |
525 | 2023-12-11T18:45:49.354Z | + out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit 45ed98fea5824feb4d42f45bbf218e597dc9fc58 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092 |
526 | 2023-12-11T18:45:49.378Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt |
527 | 2023-12-11T18:45:54.476Z | downloading softnpu ...done |
528 | 2023-12-11T18:45:54.500Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/45ed98fea5824feb4d42f45bbf218e597dc9fc58/libsidecar_lite.so.sha256.txt |
529 | 2023-12-11T18:45:59.029Z | downloading asic_program.so ...done |
530 | 2023-12-11T18:45:59.054Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/45ed98fea5824feb4d42f45bbf218e597dc9fc58/scadm.sha256.txt |
531 | 2023-12-11T18:46:04.517Z | downloading scadm ...done |
532 | 2023-12-11T18:46:04.542Z | creating port tfportrear0_0 for sc0_0 |
533 | 2023-12-11T18:46:04.542Z | creating port tfportqsfp0_0 for sc0_1 |
534 | 2023-12-11T18:46:04.542Z | softnpu zone setup |
535 | 2023-12-11T18:46:04.542Z | configure zone |
536 | 2023-12-11T18:46:04.566Z | install zone |
537 | 2023-12-11T18:46:05.624Z | boot zone |
538 | 2023-12-11T18:46:08.733Z | [sidecar_softnpu] svcs milestone/network |
539 | 2023-12-11T18:46:08.761Z | STATE STIME FMRI |
540 | 2023-12-11T18:46:08.761Z | online 18:46:07 svc:/milestone/network:default |
541 | 2023-12-11T18:46:08.762Z | [sidecar_softnpu] /softnpu/npu start |
542 | 2023-12-11T18:46:08.786Z | |
543 | 2023-12-11T18:46:08.811Z | + /opt/oxide/work/tools/scrimlet/softnpu-init.sh |
544 | 2023-12-11T18:46:08.811Z | + GATEWAY_IP=10.151.2.100 |
545 | 2023-12-11T18:46:08.811Z | Using 10.151.2.100 as gateway ip |
546 | 2023-12-11T18:46:08.811Z | + echo 'Using 10.151.2.100 as gateway ip' |
547 | 2023-12-11T18:46:08.811Z | + [[ ! -v GATEWAY_MAC ]] |
548 | 2023-12-11T18:46:08.811Z | + GATEWAY_MAC=18:c0:4d:0d:a0:2a |
549 | 2023-12-11T18:46:08.814Z | ++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63 |
550 | 2023-12-11T18:46:08.814Z | +++ echo 18:c0:4d:0d:a0:2a |
551 | 2023-12-11T18:46:08.814Z | + COUNT=1 |
552 | 2023-12-11T18:46:08.814Z | + [[ 1 -ne 1 ]] |
553 | 2023-12-11T18:46:08.814Z | + echo 'Using 18:c0:4d:0d:a0:2a as gateway mac' |
554 | 2023-12-11T18:46:08.814Z | Using 18:c0:4d:0d:a0:2a as gateway mac |
555 | 2023-12-11T18:46:08.814Z | + z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a |
556 | 2023-12-11T18:46:08.814Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a |
557 | 2023-12-11T18:46:08.839Z | + PXA_MAC=a8:e1:de:01:70:1d |
558 | 2023-12-11T18:46:08.839Z | + [[ -v PXA_START ]] |
559 | 2023-12-11T18:46:08.839Z | + z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d |
560 | 2023-12-11T18:46:08.839Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d |
561 | 2023-12-11T18:46:08.863Z | + z_scadm dump-state |
562 | 2023-12-11T18:46:08.864Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
563 | 2023-12-11T18:46:08.891Z | local v6: |
564 | 2023-12-11T18:46:08.891Z | local v4: |
565 | 2023-12-11T18:46:08.891Z | router v6: |
566 | 2023-12-11T18:46:08.891Z | router v4_idx: |
567 | 2023-12-11T18:46:08.891Z | router v4_routes: |
568 | 2023-12-11T18:46:08.892Z | resolver v4: |
569 | 2023-12-11T18:46:08.892Z | 10.151.2.100 -> 18:c0:4d:0d:a0:2a |
570 | 2023-12-11T18:46:08.892Z | resolver v6: |
571 | 2023-12-11T18:46:08.892Z | nat v4: |
572 | 2023-12-11T18:46:08.892Z | nat_v6: |
573 | 2023-12-11T18:46:08.892Z | port_mac: |
574 | 2023-12-11T18:46:08.892Z | proxy arp: |
575 | 2023-12-11T18:46:08.892Z | 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d |
576 | 2023-12-11T18:46:08.895Z | + success 'softnpu zone exists' |
577 | 2023-12-11T18:46:08.895Z | + set +x |
578 | 2023-12-11T18:46:08.895Z | softnpu zone exists |
579 | 2023-12-11T18:46:08.895Z | |
580 | 2023-12-11T18:46:08.895Z | real 20.305627313 |
581 | 2023-12-11T18:46:08.895Z | user 0.705856829 |
582 | 2023-12-11T18:46:08.895Z | sys 1.644845606 |
583 | 2023-12-11T18:46:08.895Z | trap 0.000088390 |
584 | 2023-12-11T18:46:08.902Z | tflt 0.000473193 |
585 | 2023-12-11T18:46:08.902Z | dflt 0.001545993 |
586 | 2023-12-11T18:46:08.902Z | kflt 0.000000000 |
587 | 2023-12-11T18:46:08.902Z | lock 15:31.166948460 |
588 | 2023-12-11T18:46:08.902Z | slp 1:00.776423175 |
589 | 2023-12-11T18:46:08.902Z | lat 0.079495784 |
590 | 2023-12-11T18:46:08.902Z | stop 0.356125122 |
591 | 2023-12-11T18:46:08.902Z | + tar xf out/omicron-sled-agent.tar pkg/config-rss.toml |
592 | 2023-12-11T18:46:08.928Z | ++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
593 | 2023-12-11T18:46:08.928Z | + SILO_NAME=recovery |
594 | 2023-12-11T18:46:08.928Z | ++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
595 | 2023-12-11T18:46:08.928Z | + EXTERNAL_DNS_DOMAIN=oxide.test |
596 | 2023-12-11T18:46:08.928Z | + sed -i~ ' |
597 | 2023-12-11T18:46:08.928Z | /^external_dns_ips/c\ |
598 | 2023-12-11T18:46:08.928Z | external_dns_ips = [ "10.151.2.164", "10.151.2.165" ] |
599 | 2023-12-11T18:46:08.928Z | /^\[\[internal_services_ip_pool_ranges/,/^$/ { |
600 | 2023-12-11T18:46:08.928Z | /^first/c\ |
601 | 2023-12-11T18:46:08.928Z | first = "10.151.2.164" |
602 | 2023-12-11T18:46:08.929Z | /^last/c\ |
603 | 2023-12-11T18:46:08.929Z | last = "10.151.2.173" |
604 | 2023-12-11T18:46:08.929Z | } |
605 | 2023-12-11T18:46:08.930Z | /^\[rack_network_config/,/^$/ { |
606 | 2023-12-11T18:46:08.930Z | /^infra_ip_first/c\ |
607 | 2023-12-11T18:46:08.930Z | infra_ip_first = "10.151.2.174" |
608 | 2023-12-11T18:46:08.930Z | /^infra_ip_last/c\ |
609 | 2023-12-11T18:46:08.930Z | infra_ip_last = "10.151.2.174" |
610 | 2023-12-11T18:46:08.930Z | } |
611 | 2023-12-11T18:46:08.930Z | /^\[\[rack_network_config.ports/,/^$/ { |
612 | 2023-12-11T18:46:08.930Z | /^routes/c\ |
613 | 2023-12-11T18:46:08.930Z | routes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\] |
614 | 2023-12-11T18:46:08.930Z | /^addresses/c\ |
615 | 2023-12-11T18:46:08.930Z | addresses = \["10.151.2.174/32"\] |
616 | 2023-12-11T18:46:08.930Z | } |
617 | 2023-12-11T18:46:08.931Z | ' pkg/config-rss.toml |
618 | 2023-12-11T18:46:08.931Z | + diff -u pkg/config-rss.toml~ pkg/config-rss.toml |
619 | 2023-12-11T18:46:08.931Z | --- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006 |
620 | 2023-12-11T18:46:08.931Z | +++ pkg/config-rss.toml Mon Dec 11 18:46:09 2023 |
621 | 2023-12-11T18:46:08.931Z | @@ -41,7 +41,7 @@ |
622 | 2023-12-11T18:46:08.931Z | # the DNS domain delegated to the rack by the customer. Each of these addresses |
623 | 2023-12-11T18:46:08.931Z | # must be contained in one of the "internal services" IP Pool ranges listed |
624 | 2023-12-11T18:46:08.931Z | # below. |
625 | 2023-12-11T18:46:08.931Z | -external_dns_ips = [ "192.168.1.20", "192.168.1.21" ] |
626 | 2023-12-11T18:46:08.931Z | +external_dns_ips = [ "10.151.2.164", "10.151.2.165" ] |
627 | 2023-12-11T18:46:08.931Z | |
628 | 2023-12-11T18:46:08.931Z | # Initial TLS certificates for the external API |
629 | 2023-12-11T18:46:08.931Z | # |
630 | 2023-12-11T18:46:08.931Z | @@ -77,8 +77,8 @@ |
631 | 2023-12-11T18:46:08.931Z | # |
632 | 2023-12-11T18:46:08.931Z | # For more on this and what to put here, see docs/how-to-run.adoc. |
633 | 2023-12-11T18:46:08.931Z | [[internal_services_ip_pool_ranges]] |
634 | 2023-12-11T18:46:08.931Z | -first = "192.168.1.20" |
635 | 2023-12-11T18:46:08.932Z | -last = "192.168.1.29" |
636 | 2023-12-11T18:46:08.932Z | +first = "10.151.2.164" |
637 | 2023-12-11T18:46:08.932Z | +last = "10.151.2.173" |
638 | 2023-12-11T18:46:08.932Z | |
639 | 2023-12-11T18:46:08.932Z | # TODO - this configuration is subject to change going forward. Ultimately these |
640 | 2023-12-11T18:46:08.932Z | # parameters should be provided to the control plane via wicket, but we need to |
641 | 2023-12-11T18:46:08.932Z | @@ -92,8 +92,8 @@ |
642 | 2023-12-11T18:46:08.932Z | # A range of IP addresses used by Boundary Services on the external network. In |
643 | 2023-12-11T18:46:08.932Z | # a real system, these would be addresses of the uplink ports on the Sidecar. |
644 | 2023-12-11T18:46:08.932Z | # With softnpu, only one address is used. |
645 | 2023-12-11T18:46:08.932Z | -infra_ip_first = "192.168.1.30" |
646 | 2023-12-11T18:46:08.932Z | -infra_ip_last = "192.168.1.30" |
647 | 2023-12-11T18:46:08.932Z | +infra_ip_first = "10.151.2.174" |
648 | 2023-12-11T18:46:08.932Z | +infra_ip_last = "10.151.2.174" |
649 | 2023-12-11T18:46:08.932Z | |
650 | 2023-12-11T18:46:08.932Z | # Configurations for BGP routers to run on the scrimlets. |
651 | 2023-12-11T18:46:08.932Z | bgp = [] |
652 | 2023-12-11T18:46:08.932Z | @@ -101,9 +101,9 @@ |
653 | 2023-12-11T18:46:08.932Z | # You can configure multiple uplinks by repeating the following stanza |
654 | 2023-12-11T18:46:08.933Z | [[rack_network_config.ports]] |
655 | 2023-12-11T18:46:08.933Z | # Routes associated with this port. |
656 | 2023-12-11T18:46:08.933Z | -routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}] |
657 | 2023-12-11T18:46:08.933Z | +routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}] |
658 | 2023-12-11T18:46:08.933Z | # Addresses associated with this port. |
659 | 2023-12-11T18:46:08.935Z | -addresses = ["192.168.1.30/32"] |
660 | 2023-12-11T18:46:08.935Z | +addresses = ["10.151.2.174/32"] |
661 | 2023-12-11T18:46:08.935Z | # Name of the uplink port. This should always be "qsfp0" when using softnpu. |
662 | 2023-12-11T18:46:08.935Z | port = "qsfp0" |
663 | 2023-12-11T18:46:08.935Z | # The speed of this port. |
664 | 2023-12-11T18:46:08.935Z | + true |
665 | 2023-12-11T18:46:08.936Z | + tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml |
666 | 2023-12-11T18:46:08.936Z | a pkg/config-rss.toml 7K |
667 | 2023-12-11T18:46:08.936Z | + rm -f pkg/config-rss.toml pkg/config-rss.toml~ |
668 | 2023-12-11T18:46:08.960Z | + TLS_NAME=recovery.sys.oxide.test |
669 | 2023-12-11T18:46:08.960Z | + openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin |
670 | 2023-12-11T18:46:09.164Z | .....+.....+.........+......+.+........+.+...+...............+...+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+....................+...+......+.+..............+.+...+...+.....+...+....+...+...+...........+...+.+.....+....+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+......+...+............+........+....+..+.+............+..+......+...+....+......+......+..............+.........+.+...........+.+..+..................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
671 | 2023-12-11T18:46:09.747Z | ..........+.........+...+..+.+........+.........+...+...+.+.....+...+......+.+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+......+....+..+.........+...+.+...........+......+...+.+.........+......+...+.....+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.....+.+........+.......+........+.......+..............+.+........+......+.+.........+.....+...+.+..+...............+.........+.+.................+.......+...+........+...+.+..................+..+..........+..............+.........+......+.+...+..+.+..+.......+...............+.....+.........+...................+...+.................+..........+...+........+.........+.......+.....+................+.....+...+....+..+....+...........+.+.........+...........+............+.......+...............+.....+....+..+.........+...+.......+...+......+.........+.....+...+.......+......+.....+.........+.+.........+...+.........+........+.+..+.........+..........+.....+.............+..+.............+.....+.+.........+.....+...+....+...............+........+.+...........+.........+.......+...+..+..........+...+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
672 | 2023-12-11T18:46:09.773Z | ----- |
673 | 2023-12-11T18:46:09.773Z | + tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
674 | 2023-12-11T18:46:09.797Z | a pkg/initial-tls-cert.pem 2K |
675 | 2023-12-11T18:46:09.797Z | a pkg/initial-tls-key.pem 4K |
676 | 2023-12-11T18:46:09.797Z | + rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
677 | 2023-12-11T18:46:09.797Z | + rmdir pkg |
678 | 2023-12-11T18:46:09.797Z | + E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
679 | 2023-12-11T18:46:09.797Z | + pfexec mkdir -p /usr/oxide |
680 | 2023-12-11T18:46:09.798Z | + pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0 |
681 | 2023-12-11T18:46:10.527Z | + pfexec chmod +x /usr/oxide/oxide |
682 | 2023-12-11T18:46:10.555Z | + curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw |
683 | 2023-12-11T18:46:28.800Z | + OMICRON_NO_UNINSTALL=1 |
684 | 2023-12-11T18:46:28.801Z | + ptime -m pfexec ./target/release/omicron-package -t test install |
685 | 2023-12-11T18:46:28.825Z | Dec 11 18:46:29.301 DEBG target[test]: Target({"image": "standard", "machine": "non-gimlet", "rack-topology": "single-sled", "switch": "softnpu"}) |
686 | 2023-12-11T18:46:28.825Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/ntp.tar.gz, src: out/ntp.tar.gz |
687 | 2023-12-11T18:46:28.825Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/clickhouse.tar.gz, src: out/clickhouse.tar.gz |
688 | 2023-12-11T18:46:28.825Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/oximeter.tar.gz, src: out/oximeter-collector.tar.gz |
689 | 2023-12-11T18:46:28.825Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/crucible_pantry.tar.gz, src: out/crucible-pantry.tar.gz |
690 | 2023-12-11T18:46:28.825Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/mgs.tar.gz, src: out/omicron-gateway-softnpu.tar.gz |
691 | 2023-12-11T18:46:28.826Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/sled-agent.tar, src: out/omicron-sled-agent.tar |
692 | 2023-12-11T18:46:28.826Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/mg-ddm.tar, src: out/mg-ddm-gz.tar |
693 | 2023-12-11T18:46:28.826Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/clickhouse_keeper.tar.gz, src: out/clickhouse_keeper.tar.gz |
694 | 2023-12-11T18:46:28.826Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/cockroachdb.tar.gz, src: out/cockroachdb.tar.gz |
695 | 2023-12-11T18:46:28.826Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/nexus.tar.gz, src: out/omicron-nexus.tar.gz |
696 | 2023-12-11T18:46:28.826Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/switch.tar.gz, src: out/switch-softnpu.tar.gz |
697 | 2023-12-11T18:46:28.826Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/crucible.tar.gz, src: out/crucible.tar.gz |
698 | 2023-12-11T18:46:28.826Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/internal_dns.tar.gz, src: out/internal-dns.tar.gz |
699 | 2023-12-11T18:46:28.827Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/overlay.tar.gz, src: out/overlay.tar.gz |
700 | 2023-12-11T18:46:28.827Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/external_dns.tar.gz, src: out/external-dns.tar.gz |
701 | 2023-12-11T18:46:28.827Z | Dec 11 18:46:29.304 INFO Installing service, dst: /opt/oxide/propolis-server.tar.gz, src: out/propolis-server.tar.gz |
702 | 2023-12-11T18:46:29.049Z | Dec 11 18:46:29.535 INFO Unpacking service tarball, service_path: /opt/oxide/mg-ddm, tar_path: /opt/oxide/mg-ddm.tar |
703 | 2023-12-11T18:46:29.085Z | Dec 11 18:46:29.571 INFO Unpacking service tarball, service_path: /opt/oxide/sled-agent, tar_path: /opt/oxide/sled-agent.tar |
704 | 2023-12-11T18:46:29.145Z | Dec 11 18:46:29.631 INFO Installing bootstrap service from /opt/oxide/sled-agent/pkg/manifest.xml |
705 | 2023-12-11T18:46:29.274Z | |
706 | 2023-12-11T18:46:29.299Z | real 0.468478464 |
707 | 2023-12-11T18:46:29.299Z | user 0.098381659 |
708 | 2023-12-11T18:46:29.299Z | sys 1.833116981 |
709 | 2023-12-11T18:46:29.299Z | trap 0.000000500 |
710 | 2023-12-11T18:46:29.299Z | tflt 0.000047090 |
711 | 2023-12-11T18:46:29.299Z | dflt 0.000937596 |
712 | 2023-12-11T18:46:29.299Z | kflt 0.000003120 |
713 | 2023-12-11T18:46:29.299Z | lock 42.057567943 |
714 | 2023-12-11T18:46:29.299Z | slp 0.679760433 |
715 | 2023-12-11T18:46:29.299Z | lat 0.003043049 |
716 | 2023-12-11T18:46:29.299Z | stop 0.220242703 |
717 | 2023-12-11T18:46:29.300Z | + retry=0 |
718 | 2023-12-11T18:46:29.300Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
719 | 2023-12-11T18:46:29.300Z | + [[ 0 -gt 30 ]] |
720 | 2023-12-11T18:46:29.300Z | + sleep 1 |
721 | 2023-12-11T18:46:30.288Z | + retry=1 |
722 | 2023-12-11T18:46:30.288Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
723 | 2023-12-11T18:46:30.313Z | + [[ 1 -gt 30 ]] |
724 | 2023-12-11T18:46:30.313Z | + sleep 1 |
725 | 2023-12-11T18:46:31.303Z | + retry=2 |
726 | 2023-12-11T18:46:31.304Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
727 | 2023-12-11T18:46:31.332Z | + [[ 2 -gt 30 ]] |
728 | 2023-12-11T18:46:31.332Z | + sleep 1 |
729 | 2023-12-11T18:46:32.317Z | + retry=3 |
730 | 2023-12-11T18:46:32.317Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
731 | 2023-12-11T18:46:32.342Z | + [[ 3 -gt 30 ]] |
732 | 2023-12-11T18:46:32.342Z | + sleep 1 |
733 | 2023-12-11T18:46:33.330Z | + retry=4 |
734 | 2023-12-11T18:46:33.331Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
735 | 2023-12-11T18:46:58.505Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
736 | 2023-12-11T18:46:58.533Z | local v6: |
737 | 2023-12-11T18:46:58.534Z | fe80::c036:ff:fe9f:e345 |
738 | 2023-12-11T18:46:58.534Z | fd00:99::1 |
739 | 2023-12-11T18:46:58.534Z | local v4: |
740 | 2023-12-11T18:46:58.534Z | 10.151.2.174 |
741 | 2023-12-11T18:46:58.534Z | router v6: |
742 | 2023-12-11T18:46:58.534Z | fdb0:18c0:4d0d:a02a::/64 -> fe80::acb8:d0ff:fea7:c8bf (1) |
743 | 2023-12-11T18:46:58.534Z | fd00:1122:3344:101::/64 -> fe80::acb8:d0ff:fea7:c8bf (1) |
744 | 2023-12-11T18:46:58.534Z | fd00:1122:3344:2::/64 -> fe80::acb8:d0ff:fea7:c8bf (1) |
745 | 2023-12-11T18:46:58.534Z | fd00:1122:3344:3::/64 -> fe80::acb8:d0ff:fea7:c8bf (1) |
746 | 2023-12-11T18:46:58.534Z | fd00:1122:3344:1::/64 -> fe80::acb8:d0ff:fea7:c8bf (1) |
747 | 2023-12-11T18:46:58.534Z | router v4_idx: |
748 | 2023-12-11T18:46:58.559Z | 0.0.0.0/0 -> 0 |
749 | 2023-12-11T18:46:58.559Z | router v4_routes: |
750 | 2023-12-11T18:46:58.559Z | 0 -> 10.151.2.100 (2) |
751 | 2023-12-11T18:46:58.559Z | resolver v4: |
752 | 2023-12-11T18:46:58.559Z | 10.151.2.174 -> 0a:94:cc:04:73:42 |
753 | 2023-12-11T18:46:58.559Z | 10.151.2.100 -> 18:c0:4d:0d:a0:2a |
754 | 2023-12-11T18:46:58.559Z | resolver v6: |
755 | 2023-12-11T18:46:58.559Z | fe80::acb8:d0ff:fea7:c8bf -> ae:b8:d0:a7:c8:bf |
756 | 2023-12-11T18:46:58.559Z | fe80::c036:ff:fe9f:e345 -> c2:36:00:9f:e3:45 |
757 | 2023-12-11T18:46:58.559Z | nat v4: |
758 | 2023-12-11T18:46:58.559Z | 10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:c7:65 |
759 | 2023-12-11T18:46:58.560Z | nat_v6: |
760 | 2023-12-11T18:46:58.560Z | port_mac: |
761 | 2023-12-11T18:46:58.560Z | 1: a8:40:25:16:92:99 |
762 | 2023-12-11T18:46:58.560Z | 1000: a8:40:25:16:92:98 |
763 | 2023-12-11T18:46:58.560Z | proxy arp: |
764 | 2023-12-11T18:46:58.560Z | 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d |
765 | 2023-12-11T18:46:58.560Z | + retry=0 |
766 | 2023-12-11T18:46:58.560Z | +++ zoneadm list -n |
767 | 2023-12-11T18:46:58.560Z | +++ grep oxz_ntp |
768 | 2023-12-11T18:46:58.560Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
769 | 2023-12-11T18:46:58.584Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
770 | 2023-12-11T18:46:58.591Z | ++ true |
771 | 2023-12-11T18:46:58.591Z | + [[ '' != online ]] |
772 | 2023-12-11T18:46:58.591Z | + [[ 0 -gt 60 ]] |
773 | 2023-12-11T18:46:58.591Z | + sleep 1 |
774 | 2023-12-11T18:46:59.574Z | + retry=1 |
775 | 2023-12-11T18:46:59.598Z | +++ zoneadm list -n |
776 | 2023-12-11T18:46:59.598Z | +++ grep oxz_ntp |
777 | 2023-12-11T18:46:59.598Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
778 | 2023-12-11T18:46:59.622Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
779 | 2023-12-11T18:46:59.623Z | ++ true |
780 | 2023-12-11T18:46:59.623Z | + [[ '' != online ]] |
781 | 2023-12-11T18:46:59.623Z | + [[ 1 -gt 60 ]] |
782 | 2023-12-11T18:46:59.623Z | + sleep 1 |
783 | 2023-12-11T18:47:00.605Z | + retry=2 |
784 | 2023-12-11T18:47:00.630Z | +++ zoneadm list -n |
785 | 2023-12-11T18:47:00.630Z | +++ grep oxz_ntp |
786 | 2023-12-11T18:47:00.630Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
787 | 2023-12-11T18:47:00.630Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
788 | 2023-12-11T18:47:00.657Z | ++ true |
789 | 2023-12-11T18:47:00.658Z | + [[ '' != online ]] |
790 | 2023-12-11T18:47:00.658Z | + [[ 2 -gt 60 ]] |
791 | 2023-12-11T18:47:00.658Z | + sleep 1 |
792 | 2023-12-11T18:47:01.634Z | + retry=3 |
793 | 2023-12-11T18:47:01.659Z | +++ zoneadm list -n |
794 | 2023-12-11T18:47:01.659Z | +++ grep oxz_ntp |
795 | 2023-12-11T18:47:01.660Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
796 | 2023-12-11T18:47:01.684Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
797 | 2023-12-11T18:47:01.684Z | ++ true |
798 | 2023-12-11T18:47:01.684Z | + [[ '' != online ]] |
799 | 2023-12-11T18:47:01.684Z | + [[ 3 -gt 60 ]] |
800 | 2023-12-11T18:47:01.685Z | + sleep 1 |
801 | 2023-12-11T18:47:02.664Z | + retry=4 |
802 | 2023-12-11T18:47:02.690Z | +++ zoneadm list -n |
803 | 2023-12-11T18:47:02.690Z | +++ grep oxz_ntp |
804 | 2023-12-11T18:47:02.690Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
805 | 2023-12-11T18:47:02.690Z | + [[ disabled != online ]] |
806 | 2023-12-11T18:47:02.690Z | + [[ 4 -gt 60 ]] |
807 | 2023-12-11T18:47:02.690Z | + sleep 1 |
808 | 2023-12-11T18:47:03.688Z | + retry=5 |
809 | 2023-12-11T18:47:03.714Z | +++ zoneadm list -n |
810 | 2023-12-11T18:47:03.714Z | +++ grep oxz_ntp |
811 | 2023-12-11T18:47:03.714Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
812 | 2023-12-11T18:47:03.714Z | + [[ disabled != online ]] |
813 | 2023-12-11T18:47:03.715Z | + [[ 5 -gt 60 ]] |
814 | 2023-12-11T18:47:03.715Z | + sleep 1 |
815 | 2023-12-11T18:47:04.709Z | + retry=6 |
816 | 2023-12-11T18:47:04.734Z | +++ zoneadm list -n |
817 | 2023-12-11T18:47:04.735Z | +++ grep oxz_ntp |
818 | 2023-12-11T18:47:04.735Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
819 | 2023-12-11T18:47:04.735Z | + [[ disabled != online ]] |
820 | 2023-12-11T18:47:04.735Z | + [[ 6 -gt 60 ]] |
821 | 2023-12-11T18:47:04.735Z | + sleep 1 |
822 | 2023-12-11T18:47:05.731Z | + retry=7 |
823 | 2023-12-11T18:47:05.756Z | +++ zoneadm list -n |
824 | 2023-12-11T18:47:05.756Z | +++ grep oxz_ntp |
825 | 2023-12-11T18:47:05.756Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
826 | 2023-12-11T18:47:05.756Z | + [[ disabled != online ]] |
827 | 2023-12-11T18:47:05.756Z | + [[ 7 -gt 60 ]] |
828 | 2023-12-11T18:47:05.756Z | + sleep 1 |
829 | 2023-12-11T18:47:06.753Z | + retry=8 |
830 | 2023-12-11T18:47:06.777Z | +++ zoneadm list -n |
831 | 2023-12-11T18:47:06.777Z | +++ grep oxz_ntp |
832 | 2023-12-11T18:47:06.777Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
833 | 2023-12-11T18:47:06.777Z | + [[ disabled != online ]] |
834 | 2023-12-11T18:47:06.777Z | + [[ 8 -gt 60 ]] |
835 | 2023-12-11T18:47:06.777Z | + sleep 1 |
836 | 2023-12-11T18:47:07.774Z | + retry=9 |
837 | 2023-12-11T18:47:07.799Z | +++ zoneadm list -n |
838 | 2023-12-11T18:47:07.799Z | +++ grep oxz_ntp |
839 | 2023-12-11T18:47:07.799Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
840 | 2023-12-11T18:47:07.799Z | + [[ disabled != online ]] |
841 | 2023-12-11T18:47:07.799Z | + [[ 9 -gt 60 ]] |
842 | 2023-12-11T18:47:07.799Z | + sleep 1 |
843 | 2023-12-11T18:47:08.797Z | + retry=10 |
844 | 2023-12-11T18:47:08.822Z | +++ zoneadm list -n |
845 | 2023-12-11T18:47:08.822Z | +++ grep oxz_ntp |
846 | 2023-12-11T18:47:08.822Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
847 | 2023-12-11T18:47:08.822Z | + [[ disabled != online ]] |
848 | 2023-12-11T18:47:08.822Z | + [[ 10 -gt 60 ]] |
849 | 2023-12-11T18:47:08.822Z | + sleep 1 |
|
850 | 2023-12-11T18:47:09.468Z | sock console login: Dec 11 18:47:09 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast |
|
851 | 2023-12-11T18:47:09.819Z | + retry=11 |
852 | 2023-12-11T18:47:09.843Z | +++ zoneadm list -n |
853 | 2023-12-11T18:47:09.843Z | +++ grep oxz_ntp |
854 | 2023-12-11T18:47:09.844Z | ++ pfexec svcs -z oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c -Hostate oxide/ntp |
855 | 2023-12-11T18:47:09.844Z | + [[ online != online ]] |
856 | 2023-12-11T18:47:09.844Z | + echo 'Waited for chrony: 11s' |
857 | 2023-12-11T18:47:09.844Z | + export RUST_BACKTRACE=1 |
858 | 2023-12-11T18:47:09.844Z | Waited for chrony: 11s |
859 | 2023-12-11T18:47:09.844Z | + RUST_BACKTRACE=1 |
860 | 2023-12-11T18:47:09.844Z | + export E2E_TLS_CERT IPPOOL_START IPPOOL_END |
861 | 2023-12-11T18:47:09.844Z | ++ ./tests/bootstrap |
862 | 2023-12-11T18:47:09.868Z | Using external DNS server at 10.151.2.164:53 |
863 | 2023-12-11T18:47:09.869Z | 2023-12-11 18:47:10.355422710 UTC: attempting to log into API |
864 | 2023-12-11T18:47:24.905Z | 2023-12-11 18:47:24.829041817 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
865 | 2023-12-11T18:47:25.906Z | 2023-12-11 18:47:25.830048737 UTC: attempting to log into API |
866 | 2023-12-11T18:47:40.943Z | 2023-12-11 18:47:40.862764431 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
867 | 2023-12-11T18:47:42.440Z | 2023-12-11 18:47:42.355209092 UTC: attempting to log into API |
868 | 2023-12-11T18:47:57.619Z | 2023-12-11 18:47:57.559947824 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
869 | 2023-12-11T18:47:58.620Z | 2023-12-11 18:47:58.564466410 UTC: attempting to log into API |
870 | 2023-12-11T18:48:13.653Z | 2023-12-11 18:48:13.637594119 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
871 | 2023-12-11T18:48:14.654Z | 2023-12-11 18:48:14.641326252 UTC: attempting to log into API |
872 | 2023-12-11T18:48:29.686Z | 2023-12-11 18:48:29.676944495 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
|
873 | 2023-12-11T18:48:29.907Z | Dec 11 18:48:29 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast |
|
874 | 2023-12-11T18:48:30.687Z | 2023-12-11 18:48:30.677969675 UTC: attempting to log into API |
|
875 | 2023-12-11T18:48:37.653Z | Dec 11 18:48:36 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast |
876 | 2023-12-11T18:48:44.838Z | Dec 11 18:48:44 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast |
|
877 | 2023-12-11T18:48:45.720Z | 2023-12-11 18:48:45.711247033 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
878 | 2023-12-11T18:48:46.722Z | 2023-12-11 18:48:46.711524365 UTC: attempting to log into API |
|
879 | 2023-12-11T18:48:52.049Z | Dec 11 18:48:51 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast |
880 | 2023-12-11T18:48:57.656Z | Dec 11 18:48:57 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast |
|
881 | 2023-12-11T18:49:01.840Z | 2023-12-11 18:49:01.744776806 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
882 | 2023-12-11T18:49:02.758Z | 2023-12-11 18:49:02.746623825 UTC: attempting to log into API |
883 | 2023-12-11T18:49:17.791Z | 2023-12-11 18:49:17.779397049 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
884 | 2023-12-11T18:49:19.205Z | 2023-12-11 18:49:18.780348407 UTC: attempting to log into API |
885 | 2023-12-11T18:49:29.591Z | 2023-12-11 18:49:29.580256476 UTC: login succeeded |
886 | 2023-12-11T18:49:29.624Z | waiting for nexus to come up... |
887 | 2023-12-11T18:49:29.692Z | creating IP pool... 10.151.2.175 - 10.151.2.227 |
888 | 2023-12-11T18:49:29.735Z | ensuring datasets are ready... |
889 | 2023-12-11T18:49:32.479Z | let's roll. |
890 | 2023-12-11T18:49:32.503Z | + eval 'OXIDE_HOST=https://recovery.sys.oxide.test |
891 | 2023-12-11T18:49:32.504Z | OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166 |
892 | 2023-12-11T18:49:32.504Z | OXIDE_TOKEN=oxide-token-d419296047012f9becdf5b80d83355a02c22955b' |
893 | 2023-12-11T18:49:32.504Z | ++ OXIDE_HOST=https://recovery.sys.oxide.test |
894 | 2023-12-11T18:49:32.504Z | ++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166 |
895 | 2023-12-11T18:49:32.504Z | ++ OXIDE_TOKEN=oxide-token-d419296047012f9becdf5b80d83355a02c22955b |
896 | 2023-12-11T18:49:32.504Z | + export OXIDE_HOST OXIDE_TOKEN |
897 | 2023-12-11T18:49:32.504Z | + retry=0 |
898 | 2023-12-11T18:49:32.504Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
899 | 2023-12-11T18:49:32.573Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images' |
900 | 2023-12-11T18:49:32.995Z | {"status":"ok"}success |
901 | 2023-12-11T18:49:32.996Z | Project { |
902 | 2023-12-11T18:49:32.996Z | description: "some images", |
903 | 2023-12-11T18:49:32.997Z | id: 1ac3c951-c4c8-4c91-9623-095cf29c9593, |
904 | 2023-12-11T18:49:32.997Z | name: Name( |
905 | 2023-12-11T18:49:32.997Z | "images", |
906 | 2023-12-11T18:49:32.997Z | ), |
907 | 2023-12-11T18:49:33.027Z | time_created: 2023-12-11T18:49:32.631608Z, |
908 | 2023-12-11T18:49:33.027Z | time_modified: 2023-12-11T18:49:32.631608Z, |
909 | 2023-12-11T18:49:33.027Z | } |
910 | 2023-12-11T18:49:33.028Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 |
911 | 2023-12-11T18:55:15.907Z | done! |
912 | 2023-12-11T18:55:15.908Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11 |
913 | 2023-12-11T18:55:15.908Z | success |
914 | 2023-12-11T18:55:15.908Z | Image { |
915 | 2023-12-11T18:55:15.908Z | block_size: ByteCount( |
916 | 2023-12-11T18:55:15.908Z | 512, |
917 | 2023-12-11T18:55:15.908Z | ), |
918 | 2023-12-11T18:55:15.908Z | description: "debian 11 original base image", |
919 | 2023-12-11T18:55:15.908Z | digest: None, |
920 | 2023-12-11T18:55:15.908Z | id: 20acedb8-3618-42f1-bdd9-2e398d7abd2b, |
921 | 2023-12-11T18:55:15.909Z | name: Name( |
922 | 2023-12-11T18:55:15.909Z | "debian11", |
923 | 2023-12-11T18:55:15.909Z | ), |
924 | 2023-12-11T18:55:15.909Z | os: "debian", |
925 | 2023-12-11T18:55:15.909Z | project_id: None, |
926 | 2023-12-11T18:55:15.909Z | size: ByteCount( |
927 | 2023-12-11T18:55:15.909Z | 2147483648, |
928 | 2023-12-11T18:55:15.909Z | ), |
929 | 2023-12-11T18:55:15.910Z | time_created: 2023-12-11T18:54:59.683874Z, |
930 | 2023-12-11T18:55:15.910Z | time_modified: 2023-12-11T18:54:59.931862Z, |
931 | 2023-12-11T18:55:15.910Z | url: None, |
932 | 2023-12-11T18:55:15.910Z | version: "11", |
933 | 2023-12-11T18:55:15.910Z | } |
934 | 2023-12-11T18:55:15.910Z | + rm ./tests/bootstrap |
935 | 2023-12-11T18:55:15.910Z | + for test_bin in tests/* |
936 | 2023-12-11T18:55:15.910Z | + ./tests/bootstrap-8898bd4b8ded3394 |
937 | 2023-12-11T18:55:15.910Z | |
938 | 2023-12-11T18:55:15.910Z | running 0 tests |
939 | 2023-12-11T18:55:15.910Z | |
940 | 2023-12-11T18:55:15.910Z | test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s |
941 | 2023-12-11T18:55:15.911Z | |
942 | 2023-12-11T18:55:15.911Z | + for test_bin in tests/* |
943 | 2023-12-11T18:55:15.911Z | + ./tests/end_to_end_tests-76081d63fda74637 |
944 | 2023-12-11T18:55:15.911Z | |
945 | 2023-12-11T18:55:15.911Z | running 2 tests |
946 | 2023-12-11T18:55:15.911Z | test no_spoof::no_spoof_here ... ok |
947 | 2023-12-11T18:55:33.468Z | test instance_launch::instance_launch ... ok |
948 | 2023-12-11T18:55:33.468Z | |
949 | 2023-12-11T18:55:33.468Z | test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 33.39s |
950 | 2023-12-11T18:55:33.468Z | |
951 | 2023-12-11T18:55:33.493Z | + _exit_trap |
952 | 2023-12-11T18:55:33.493Z | + local status=0 |
953 | 2023-12-11T18:55:33.493Z | + [[ 0 -eq 0 ]] |
954 | 2023-12-11T18:55:33.493Z | + exit 0 |
955 | 2023-12-11T18:55:33.494Z | process exited: duration 592935 ms, exit code 0 |
|
956 | 2023-12-11T18:55:33.632Z | found 56 output files |
957 | 2023-12-11T18:55:33.632Z | uploading: /var/svc/log/oxide-sled-agent:default.log (748199 bytes) |
958 | 2023-12-11T18:55:35.667Z | uploaded: /var/svc/log/oxide-sled-agent:default.log |
959 | 2023-12-11T18:55:35.667Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b5430a46-177b-4d96-8b94-95f0af63065e/root/var/svc/log/oxide-crucible-agent:default.log (14115 bytes) |
960 | 2023-12-11T18:55:36.806Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b5430a46-177b-4d96-8b94-95f0af63065e/root/var/svc/log/oxide-crucible-agent:default.log |
961 | 2023-12-11T18:55:36.806Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b5430a46-177b-4d96-8b94-95f0af63065e/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
962 | 2023-12-11T18:55:37.901Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b5430a46-177b-4d96-8b94-95f0af63065e/root/var/svc/log/oxide-crucible-downstairs:default.log |
963 | 2023-12-11T18:55:37.902Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b5430a46-177b-4d96-8b94-95f0af63065e/root/var/svc/log/oxide-crucible-downstairs:downstairs-6beab47c-aab0-47b3-9614-30f596e1f9c9.log (5537 bytes) |
964 | 2023-12-11T18:55:39.844Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b5430a46-177b-4d96-8b94-95f0af63065e/root/var/svc/log/oxide-crucible-downstairs:downstairs-6beab47c-aab0-47b3-9614-30f596e1f9c9.log |
965 | 2023-12-11T18:55:39.844Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_e7506722-e61d-49f1-83f3-7d2048591da3/root/var/svc/log/oxide-crucible-pantry:default.log (2338 bytes) |
966 | 2023-12-11T18:55:40.945Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_e7506722-e61d-49f1-83f3-7d2048591da3/root/var/svc/log/oxide-crucible-pantry:default.log |
967 | 2023-12-11T18:55:40.945Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_901bb9dd-000c-44f6-bc94-0359be972ae4/root/var/svc/log/oxide-external_dns:default.log (26943 bytes) |
968 | 2023-12-11T18:55:42.132Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_901bb9dd-000c-44f6-bc94-0359be972ae4/root/var/svc/log/oxide-external_dns:default.log |
969 | 2023-12-11T18:55:42.132Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_980e3db8-3c54-4bc8-9afd-a3f1c220fbaf/root/var/svc/log/oxide-nexus:default.log (884591 bytes) |
970 | 2023-12-11T18:55:43.261Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_980e3db8-3c54-4bc8-9afd-a3f1c220fbaf/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 884591 -> 885198 |
971 | 2023-12-11T18:55:44.334Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_980e3db8-3c54-4bc8-9afd-a3f1c220fbaf/root/var/svc/log/oxide-nexus:default.log |
972 | 2023-12-11T18:55:44.334Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_99a002d9-5a8f-4e13-95c6-d38321841b7d/root/var/svc/log/oxide-nexus:default.log (769071 bytes) |
973 | 2023-12-11T18:55:45.292Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_99a002d9-5a8f-4e13-95c6-d38321841b7d/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 769071 -> 769679 |
974 | 2023-12-11T18:55:46.363Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_99a002d9-5a8f-4e13-95c6-d38321841b7d/root/var/svc/log/oxide-nexus:default.log |
975 | 2023-12-11T18:55:46.364Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/svc/log/oxide-ntp:default.log (1383 bytes) |
976 | 2023-12-11T18:55:47.459Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/svc/log/oxide-ntp:default.log |
977 | 2023-12-11T18:55:47.459Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_30d596ff-e164-4d2c-9529-fdd70e26a7d0/root/var/svc/log/oxide-clickhouse:default.log (826943 bytes) |
978 | 2023-12-11T18:55:48.318Z | upload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_30d596ff-e164-4d2c-9529-fdd70e26a7d0/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 826943 -> 850949 |
979 | 2023-12-11T18:55:49.389Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_30d596ff-e164-4d2c-9529-fdd70e26a7d0/root/var/svc/log/oxide-clickhouse:default.log |
980 | 2023-12-11T18:55:49.389Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ad2c1469-e227-450e-8b24-2599848687cc/root/var/svc/log/oxide-cockroachdb:default.log (5413 bytes) |
981 | 2023-12-11T18:55:50.486Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_ad2c1469-e227-450e-8b24-2599848687cc/root/var/svc/log/oxide-cockroachdb:default.log |
982 | 2023-12-11T18:55:50.519Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bfe4a4d8-cade-49ec-a2e0-fb90bb53ab79/root/var/svc/log/oxide-crucible-agent:default.log (3436 bytes) |
983 | 2023-12-11T18:55:51.603Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bfe4a4d8-cade-49ec-a2e0-fb90bb53ab79/root/var/svc/log/oxide-crucible-agent:default.log |
984 | 2023-12-11T18:55:51.603Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bfe4a4d8-cade-49ec-a2e0-fb90bb53ab79/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
985 | 2023-12-11T18:55:52.740Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_bfe4a4d8-cade-49ec-a2e0-fb90bb53ab79/root/var/svc/log/oxide-crucible-downstairs:default.log |
986 | 2023-12-11T18:55:52.740Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-agent:default.log (28258 bytes) |
987 | 2023-12-11T18:55:53.880Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-agent:default.log |
988 | 2023-12-11T18:55:53.880Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
989 | 2023-12-11T18:55:54.976Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-downstairs:default.log |
990 | 2023-12-11T18:55:54.976Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-downstairs:downstairs-972c4021-f3ab-44db-b335-c26e403b7e27.log (5537 bytes) |
991 | 2023-12-11T18:55:56.071Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-downstairs:downstairs-972c4021-f3ab-44db-b335-c26e403b7e27.log |
992 | 2023-12-11T18:55:56.071Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-downstairs:downstairs-b0a3780e-689f-4ea9-bcbd-af5e5de60841.log (6436 bytes) |
993 | 2023-12-11T18:55:57.165Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-downstairs:downstairs-b0a3780e-689f-4ea9-bcbd-af5e5de60841.log |
994 | 2023-12-11T18:55:57.166Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-downstairs:snapshot-b0a3780e-689f-4ea9-bcbd-af5e5de60841-10d2c586-80aa-4e97-ab5c-713c478e9e4c.log (5175 bytes) |
995 | 2023-12-11T18:55:58.268Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_c2098b5c-e480-44ba-842f-4f1e20aea505/root/var/svc/log/oxide-crucible-downstairs:snapshot-b0a3780e-689f-4ea9-bcbd-af5e5de60841-10d2c586-80aa-4e97-ab5c-713c478e9e4c.log |
996 | 2023-12-11T18:55:58.268Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-agent:default.log (30293 bytes) |
997 | 2023-12-11T18:55:59.418Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-agent:default.log |
998 | 2023-12-11T18:55:59.418Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
999 | 2023-12-11T18:56:00.521Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-downstairs:default.log |
1000 | 2023-12-11T18:56:00.521Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-downstairs:downstairs-57134dce-1fa1-49cc-ab0a-053366523465.log (2944 bytes) |
1001 | 2023-12-11T18:56:01.617Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-downstairs:downstairs-57134dce-1fa1-49cc-ab0a-053366523465.log |
1002 | 2023-12-11T18:56:01.617Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-downstairs:downstairs-cdf761a9-4ae2-4d34-ad52-2338fcb7c99e.log (3051 bytes) |
1003 | 2023-12-11T18:56:03.126Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-downstairs:downstairs-cdf761a9-4ae2-4d34-ad52-2338fcb7c99e.log |
1004 | 2023-12-11T18:56:03.126Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-downstairs:downstairs-faf96056-b30d-4585-8e64-e76c69b4f3ee.log (5536 bytes) |
1005 | 2023-12-11T18:56:04.224Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_f50cdd25-ff5d-4df7-b45c-e80ee72485a7/root/var/svc/log/oxide-crucible-downstairs:downstairs-faf96056-b30d-4585-8e64-e76c69b4f3ee.log |
1006 | 2023-12-11T18:56:04.225Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_ba7ae14a-9687-4cd8-b97a-9174d9a7c5ef/root/var/svc/log/oxide-cockroachdb:default.log (5413 bytes) |
1007 | 2023-12-11T18:56:05.320Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_ba7ae14a-9687-4cd8-b97a-9174d9a7c5ef/root/var/svc/log/oxide-cockroachdb:default.log |
1008 | 2023-12-11T18:56:05.323Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_c3fbadc4-668a-44d4-a87e-40b26171d029/root/var/svc/log/oxide-oximeter:default.log (248368 bytes) |
1009 | 2023-12-11T18:56:05.526Z | upload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_c3fbadc4-668a-44d4-a87e-40b26171d029/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 248368 -> 266470 |
1010 | 2023-12-11T18:56:06.597Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_oximeter_c3fbadc4-668a-44d4-a87e-40b26171d029/root/var/svc/log/oxide-oximeter:default.log |
1011 | 2023-12-11T18:56:06.597Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_5c62c30b-23c8-48af-a54c-5811820263a4/root/var/svc/log/oxide-cockroachdb:default.log (5386 bytes) |
1012 | 2023-12-11T18:56:07.699Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_5c62c30b-23c8-48af-a54c-5811820263a4/root/var/svc/log/oxide-cockroachdb:default.log |
1013 | 2023-12-11T18:56:07.699Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_26a9da2e-7167-43d0-b868-67461e760d9a/root/var/svc/log/oxide-crucible-agent:default.log (20039 bytes) |
1014 | 2023-12-11T18:56:08.842Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_26a9da2e-7167-43d0-b868-67461e760d9a/root/var/svc/log/oxide-crucible-agent:default.log |
1015 | 2023-12-11T18:56:08.842Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_26a9da2e-7167-43d0-b868-67461e760d9a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1016 | 2023-12-11T18:56:10.339Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_26a9da2e-7167-43d0-b868-67461e760d9a/root/var/svc/log/oxide-crucible-downstairs:default.log |
1017 | 2023-12-11T18:56:10.339Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_26a9da2e-7167-43d0-b868-67461e760d9a/root/var/svc/log/oxide-crucible-downstairs:downstairs-1c8950b0-1732-4627-a3af-990badc71a1a.log (3051 bytes) |
1018 | 2023-12-11T18:56:11.438Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_26a9da2e-7167-43d0-b868-67461e760d9a/root/var/svc/log/oxide-crucible-downstairs:downstairs-1c8950b0-1732-4627-a3af-990badc71a1a.log |
1019 | 2023-12-11T18:56:11.438Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_26a9da2e-7167-43d0-b868-67461e760d9a/root/var/svc/log/oxide-crucible-downstairs:downstairs-adc9dbb6-7ce9-48cf-8402-10eef2523c0b.log (2941 bytes) |
1020 | 2023-12-11T18:56:12.533Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_26a9da2e-7167-43d0-b868-67461e760d9a/root/var/svc/log/oxide-crucible-downstairs:downstairs-adc9dbb6-7ce9-48cf-8402-10eef2523c0b.log |
1021 | 2023-12-11T18:56:12.533Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_faaa6142-7dd1-4eef-87e3-a6af2c8bc3a8/root/var/svc/log/oxide-crucible-agent:default.log (9788 bytes) |
1022 | 2023-12-11T18:56:13.649Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_faaa6142-7dd1-4eef-87e3-a6af2c8bc3a8/root/var/svc/log/oxide-crucible-agent:default.log |
1023 | 2023-12-11T18:56:13.649Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_faaa6142-7dd1-4eef-87e3-a6af2c8bc3a8/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1024 | 2023-12-11T18:56:14.744Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_faaa6142-7dd1-4eef-87e3-a6af2c8bc3a8/root/var/svc/log/oxide-crucible-downstairs:default.log |
1025 | 2023-12-11T18:56:14.744Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_faaa6142-7dd1-4eef-87e3-a6af2c8bc3a8/root/var/svc/log/oxide-crucible-downstairs:downstairs-dda951d1-38ef-44fd-b2a6-5c5638734385.log (2945 bytes) |
1026 | 2023-12-11T18:56:15.839Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_faaa6142-7dd1-4eef-87e3-a6af2c8bc3a8/root/var/svc/log/oxide-crucible-downstairs:downstairs-dda951d1-38ef-44fd-b2a6-5c5638734385.log |
1027 | 2023-12-11T18:56:15.839Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_b8ca3a50-57f8-4874-87a5-ed2c4bded51f/root/var/svc/log/oxide-internal_dns:default.log (116829 bytes) |
1028 | 2023-12-11T18:56:16.023Z | upload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_b8ca3a50-57f8-4874-87a5-ed2c4bded51f/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 116829 -> 120583 |
1029 | 2023-12-11T18:56:17.095Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_internal_dns_b8ca3a50-57f8-4874-87a5-ed2c4bded51f/root/var/svc/log/oxide-internal_dns:default.log |
1030 | 2023-12-11T18:56:17.095Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_5908292a-a899-4de9-97d1-1df3102fc535/root/var/svc/log/oxide-crucible-pantry:default.log (1227201 bytes) |
1031 | 2023-12-11T18:56:18.867Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_5908292a-a899-4de9-97d1-1df3102fc535/root/var/svc/log/oxide-crucible-pantry:default.log |
1032 | 2023-12-11T18:56:18.867Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_cockroachdb_f98d40aa-1f98-4b8a-a9a6-11245a64564f/root/var/svc/log/oxide-cockroachdb:default.log (5412 bytes) |
1033 | 2023-12-11T18:56:19.967Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_cockroachdb_f98d40aa-1f98-4b8a-a9a6-11245a64564f/root/var/svc/log/oxide-cockroachdb:default.log |
1034 | 2023-12-11T18:56:19.967Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_4d007c0d-a3fa-4a83-8e8b-2033ea605519/root/var/svc/log/oxide-internal_dns:default.log (110750 bytes) |
1035 | 2023-12-11T18:56:20.131Z | upload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_4d007c0d-a3fa-4a83-8e8b-2033ea605519/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 110750 -> 114506 |
1036 | 2023-12-11T18:56:21.202Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_4d007c0d-a3fa-4a83-8e8b-2033ea605519/root/var/svc/log/oxide-internal_dns:default.log |
1037 | 2023-12-11T18:56:21.280Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_03c32c3d-9f40-438f-ae6e-1c1787e67a78/root/var/svc/log/oxide-nexus:default.log (35978903 bytes) |
1038 | 2023-12-11T18:56:33.301Z | upload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_03c32c3d-9f40-438f-ae6e-1c1787e67a78/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 35978903 -> 36054514 |
1039 | 2023-12-11T18:56:34.371Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_03c32c3d-9f40-438f-ae6e-1c1787e67a78/root/var/svc/log/oxide-nexus:default.log |
1040 | 2023-12-11T18:56:34.396Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_external_dns_ef7c67e4-c471-4740-a2b5-8ac9dd0e3f1f/root/var/svc/log/oxide-external_dns:default.log (26940 bytes) |
1041 | 2023-12-11T18:56:34.484Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_external_dns_ef7c67e4-c471-4740-a2b5-8ac9dd0e3f1f/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26940 -> 30717 |
1042 | 2023-12-11T18:56:35.555Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_external_dns_ef7c67e4-c471-4740-a2b5-8ac9dd0e3f1f/root/var/svc/log/oxide-external_dns:default.log |
1043 | 2023-12-11T18:56:35.555Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69f8c42b-5f56-4300-a8b4-e60ca8a1147f/root/var/svc/log/oxide-crucible-agent:default.log (14113 bytes) |
1044 | 2023-12-11T18:56:37.109Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69f8c42b-5f56-4300-a8b4-e60ca8a1147f/root/var/svc/log/oxide-crucible-agent:default.log |
1045 | 2023-12-11T18:56:37.109Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69f8c42b-5f56-4300-a8b4-e60ca8a1147f/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1046 | 2023-12-11T18:56:38.215Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69f8c42b-5f56-4300-a8b4-e60ca8a1147f/root/var/svc/log/oxide-crucible-downstairs:default.log |
1047 | 2023-12-11T18:56:38.216Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69f8c42b-5f56-4300-a8b4-e60ca8a1147f/root/var/svc/log/oxide-crucible-downstairs:downstairs-1b2d532a-2f59-4e40-aaff-8590daf4e2ca.log (3050 bytes) |
1048 | 2023-12-11T18:56:39.310Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_69f8c42b-5f56-4300-a8b4-e60ca8a1147f/root/var/svc/log/oxide-crucible-downstairs:downstairs-1b2d532a-2f59-4e40-aaff-8590daf4e2ca.log |
1049 | 2023-12-11T18:56:39.310Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e6c1a482-0a9e-4de3-a288-389be088495a/root/var/svc/log/oxide-crucible-agent:default.log (17553 bytes) |
1050 | 2023-12-11T18:56:40.452Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e6c1a482-0a9e-4de3-a288-389be088495a/root/var/svc/log/oxide-crucible-agent:default.log |
1051 | 2023-12-11T18:56:40.452Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e6c1a482-0a9e-4de3-a288-389be088495a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1052 | 2023-12-11T18:56:41.547Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e6c1a482-0a9e-4de3-a288-389be088495a/root/var/svc/log/oxide-crucible-downstairs:default.log |
1053 | 2023-12-11T18:56:41.548Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e6c1a482-0a9e-4de3-a288-389be088495a/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d7ef9c4-5431-4cd9-b67a-2fc467af01cd.log (6438 bytes) |
1054 | 2023-12-11T18:56:42.644Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e6c1a482-0a9e-4de3-a288-389be088495a/root/var/svc/log/oxide-crucible-downstairs:downstairs-1d7ef9c4-5431-4cd9-b67a-2fc467af01cd.log |
1055 | 2023-12-11T18:56:42.668Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e6c1a482-0a9e-4de3-a288-389be088495a/root/var/svc/log/oxide-crucible-downstairs:snapshot-1d7ef9c4-5431-4cd9-b67a-2fc467af01cd-10d2c586-80aa-4e97-ab5c-713c478e9e4c.log (5176 bytes) |
1056 | 2023-12-11T18:56:43.738Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_e6c1a482-0a9e-4de3-a288-389be088495a/root/var/svc/log/oxide-crucible-downstairs:snapshot-1d7ef9c4-5431-4cd9-b67a-2fc467af01cd-10d2c586-80aa-4e97-ab5c-713c478e9e4c.log |
1057 | 2023-12-11T18:56:43.738Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_70bbb979-a57a-4be5-bfc1-4d0d6a336a0d/root/var/svc/log/oxide-crucible-pantry:default.log (2332 bytes) |
1058 | 2023-12-11T18:56:44.837Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_70bbb979-a57a-4be5-bfc1-4d0d6a336a0d/root/var/svc/log/oxide-crucible-pantry:default.log |
1059 | 2023-12-11T18:56:44.837Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_81aa7f9a-bae1-4364-ad60-9efbfaec1c70/root/var/svc/log/oxide-internal_dns:default.log (114799 bytes) |
1060 | 2023-12-11T18:56:44.997Z | upload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_81aa7f9a-bae1-4364-ad60-9efbfaec1c70/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 114799 -> 118554 |
1061 | 2023-12-11T18:56:46.076Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_81aa7f9a-bae1-4364-ad60-9efbfaec1c70/root/var/svc/log/oxide-internal_dns:default.log |
1062 | 2023-12-11T18:56:46.076Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9826eadc-70a4-4416-bb8b-526e8a5d88e7/root/var/svc/log/oxide-cockroachdb:default.log (5412 bytes) |
1063 | 2023-12-11T18:56:47.171Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_9826eadc-70a4-4416-bb8b-526e8a5d88e7/root/var/svc/log/oxide-cockroachdb:default.log |
1064 | 2023-12-11T18:56:47.171Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf7714fb-6191-42c7-8eb1-bc5b1a22b77d/root/var/svc/log/oxide-crucible-agent:default.log (17547 bytes) |
1065 | 2023-12-11T18:56:48.317Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf7714fb-6191-42c7-8eb1-bc5b1a22b77d/root/var/svc/log/oxide-crucible-agent:default.log |
1066 | 2023-12-11T18:56:48.318Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf7714fb-6191-42c7-8eb1-bc5b1a22b77d/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1067 | 2023-12-11T18:56:49.420Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf7714fb-6191-42c7-8eb1-bc5b1a22b77d/root/var/svc/log/oxide-crucible-downstairs:default.log |
1068 | 2023-12-11T18:56:49.421Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf7714fb-6191-42c7-8eb1-bc5b1a22b77d/root/var/svc/log/oxide-crucible-downstairs:downstairs-c2cacaf7-f4f3-4196-9d7a-d9b92a00ee56.log (6435 bytes) |
1069 | 2023-12-11T18:56:50.566Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf7714fb-6191-42c7-8eb1-bc5b1a22b77d/root/var/svc/log/oxide-crucible-downstairs:downstairs-c2cacaf7-f4f3-4196-9d7a-d9b92a00ee56.log |
1070 | 2023-12-11T18:56:50.566Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf7714fb-6191-42c7-8eb1-bc5b1a22b77d/root/var/svc/log/oxide-crucible-downstairs:snapshot-c2cacaf7-f4f3-4196-9d7a-d9b92a00ee56-10d2c586-80aa-4e97-ab5c-713c478e9e4c.log (5175 bytes) |
1071 | 2023-12-11T18:56:51.667Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_cf7714fb-6191-42c7-8eb1-bc5b1a22b77d/root/var/svc/log/oxide-crucible-downstairs:snapshot-c2cacaf7-f4f3-4196-9d7a-d9b92a00ee56-10d2c586-80aa-4e97-ab5c-713c478e9e4c.log |
1072 | 2023-12-11T18:56:51.670Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/measurements.log (22331 bytes) |
1073 | 2023-12-11T18:56:51.759Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/measurements.log" changed size mid upload: 22331 -> 24934 |
1074 | 2023-12-11T18:56:52.839Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/measurements.log |
1075 | 2023-12-11T18:56:52.839Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/statistics.log (14742 bytes) |
1076 | 2023-12-11T18:56:52.937Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/statistics.log" changed size mid upload: 14742 -> 16848 |
1077 | 2023-12-11T18:56:54.033Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/statistics.log |
1078 | 2023-12-11T18:56:54.033Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/tracking.log (2245 bytes) |
1079 | 2023-12-11T18:56:54.089Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/tracking.log" changed size mid upload: 2245 -> 2377 |
1080 | 2023-12-11T18:56:55.162Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_ntp_ecdb1628-5687-46dd-9307-db6642e8541c/root/var/log/chrony/tracking.log |