|
|
|
1 | 2023-12-13T05:00:48.015Z | job dependencies complete; ready to run (waiting for 53 m 16 s) |
2 | 2023-12-13T05:04:58.233Z | job assigned to worker 01HHGRNG6BV4146TAM6DWWKEBT (queued for 4 m 10 s) |
3 | 2023-12-13T05:04:58.524Z | http://172.20.0.5:9969/ipxe/sock... ok |
4 | 2023-12-13T05:04:58.600Z | http://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok |
5 | 2023-12-13T05:04:59.044Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok |
6 | 2023-12-13T05:04:59.077Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok |
7 | 2023-12-13T05:04:59.111Z | http://172.20.0.5:9969/postboot/sock... ok |
8 | 2023-12-13T05:04:59.175Z | wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U |
9 | 2023-12-13T05:04:59.222Z | cpu0: microcode has been updated from version 0xa001133 to 0xa0011d1 |
10 | 2023-12-13T05:04:59.273Z | Oxide Helios Version helios-2.0.22333 64-bit |
11 | 2023-12-13T05:04:59.314Z | Configuring devices. |
12 | 2023-12-13T05:04:59.347Z | ################################################## |
13 | 2023-12-13T05:04:59.418Z | #### ############# ## |
14 | 2023-12-13T05:04:59.505Z | ### ### ############ ## |
15 | 2023-12-13T05:04:59.548Z | ## ### # ## ### ## Oxide Computer Company ## |
16 | 2023-12-13T05:04:59.581Z | ## ## ## ### # ### ## |
17 | 2023-12-13T05:04:59.625Z | ## # ### #### #### This Station Under ## |
18 | 2023-12-13T05:04:59.658Z | ### ### #### # ### Computer Control ## |
19 | 2023-12-13T05:04:59.713Z | #### #### ### ## ## |
20 | 2023-12-13T05:04:59.752Z | ################################################## |
21 | 2023-12-13T05:04:59.848Z | Hostname: sock |
22 | 2023-12-13T05:04:59.896Z | Loading smf(7) service descriptions: |
23 | 2023-12-13T05:05:03.038Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-cc02af252c51050b.gz |
24 | 2023-12-13T05:05:05.319Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-cc02af252c51050b.gz |
25 | 2023-12-13T05:05:05.619Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
26 | 2023-12-13T05:05:56.850Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
27 | 2023-12-13T05:05:56.875Z | downloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-c0f56f9124e0823c.gz |
28 | 2023-12-13T05:06:34.090Z | downloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-c0f56f9124e0823c.gz |
29 | 2023-12-13T05:06:34.123Z | downloading input: /input/ci-tools/work/caboose-util.gz |
30 | 2023-12-13T05:06:35.236Z | downloaded input: /input/ci-tools/work/caboose-util.gz |
31 | 2023-12-13T05:06:35.263Z | downloading input: /input/ci-tools/work/tufaceous.gz |
32 | 2023-12-13T05:06:38.323Z | downloaded input: /input/ci-tools/work/tufaceous.gz |
33 | 2023-12-13T05:06:38.349Z | downloading input: /input/package/work/version.txt |
34 | 2023-12-13T05:06:38.349Z | downloaded input: /input/package/work/version.txt |
35 | 2023-12-13T05:06:38.349Z | downloading input: /input/package/work/package.tar.gz |
36 | 2023-12-13T05:06:57.641Z | downloaded input: /input/package/work/package.tar.gz |
37 | 2023-12-13T05:06:57.641Z | downloading input: /input/package/work/global-zone-packages.tar.gz |
38 | 2023-12-13T05:07:25.904Z | downloaded input: /input/package/work/global-zone-packages.tar.gz |
39 | 2023-12-13T05:07:25.935Z | downloading input: /input/package/work/trampoline-global-zone-packages.tar.gz |
40 | 2023-12-13T05:07:33.766Z | downloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz |
41 | 2023-12-13T05:07:33.791Z | downloading input: /input/package/work/zones/clickhouse.tar.gz |
42 | 2023-12-13T05:08:09.798Z | downloaded input: /input/package/work/zones/clickhouse.tar.gz |
43 | 2023-12-13T05:08:09.825Z | downloading input: /input/package/work/zones/clickhouse_keeper.tar.gz |
44 | 2023-12-13T05:08:43.350Z | downloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz |
45 | 2023-12-13T05:08:43.375Z | downloading input: /input/package/work/zones/cockroachdb.tar.gz |
46 | 2023-12-13T05:09:05.595Z | downloaded input: /input/package/work/zones/cockroachdb.tar.gz |
47 | 2023-12-13T05:09:05.622Z | downloading input: /input/package/work/zones/crucible-pantry.tar.gz |
48 | 2023-12-13T05:09:10.442Z | downloaded input: /input/package/work/zones/crucible-pantry.tar.gz |
49 | 2023-12-13T05:09:10.470Z | downloading input: /input/package/work/zones/crucible.tar.gz |
50 | 2023-12-13T05:09:19.164Z | downloaded input: /input/package/work/zones/crucible.tar.gz |
51 | 2023-12-13T05:09:19.190Z | downloading input: /input/package/work/zones/external-dns.tar.gz |
52 | 2023-12-13T05:09:25.781Z | downloaded input: /input/package/work/zones/external-dns.tar.gz |
53 | 2023-12-13T05:09:25.781Z | downloading input: /input/package/work/zones/internal-dns.tar.gz |
54 | 2023-12-13T05:09:30.840Z | downloaded input: /input/package/work/zones/internal-dns.tar.gz |
55 | 2023-12-13T05:09:30.840Z | downloading input: /input/package/work/zones/ntp.tar.gz |
56 | 2023-12-13T05:09:30.879Z | downloaded input: /input/package/work/zones/ntp.tar.gz |
57 | 2023-12-13T05:09:30.904Z | downloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
58 | 2023-12-13T05:09:34.434Z | downloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
59 | 2023-12-13T05:09:34.442Z | downloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
60 | 2023-12-13T05:09:38.466Z | downloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
61 | 2023-12-13T05:09:38.491Z | downloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
62 | 2023-12-13T05:09:52.536Z | downloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
63 | 2023-12-13T05:09:52.563Z | downloading input: /input/package/work/zones/omicron-nexus.tar.gz |
64 | 2023-12-13T05:10:06.614Z | downloaded input: /input/package/work/zones/omicron-nexus.tar.gz |
65 | 2023-12-13T05:10:06.615Z | downloading input: /input/package/work/zones/overlay.tar.gz |
66 | 2023-12-13T05:10:06.683Z | downloaded input: /input/package/work/zones/overlay.tar.gz |
67 | 2023-12-13T05:10:06.722Z | downloading input: /input/package/work/zones/oximeter-collector.tar.gz |
68 | 2023-12-13T05:10:13.978Z | downloaded input: /input/package/work/zones/oximeter-collector.tar.gz |
69 | 2023-12-13T05:10:13.980Z | downloading input: /input/package/work/zones/propolis-server.tar.gz |
70 | 2023-12-13T05:10:26.355Z | downloaded input: /input/package/work/zones/propolis-server.tar.gz |
71 | 2023-12-13T05:10:26.356Z | downloading input: /input/package/work/zones/switch-asic.tar.gz |
72 | 2023-12-13T05:11:19.661Z | downloaded input: /input/package/work/zones/switch-asic.tar.gz |
73 | 2023-12-13T05:11:19.697Z | downloading input: /input/package/work/zones/switch-softnpu.tar.gz |
74 | 2023-12-13T05:11:50.687Z | downloaded input: /input/package/work/zones/switch-softnpu.tar.gz |
|
75 | 2023-12-13T05:11:50.733Z | starting task 0: "setup" |
76 | 2023-12-13T05:11:50.733Z | ++ uname -s |
77 | 2023-12-13T05:11:50.734Z | + kern=SunOS |
78 | 2023-12-13T05:11:50.734Z | + case "$kern" in |
79 | 2023-12-13T05:11:50.735Z | + groupadd -g 12345 build |
80 | 2023-12-13T05:11:50.735Z | + useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build |
81 | 2023-12-13T05:11:52.704Z | + zfs create -o mountpoint=/work rpool/work |
82 | 2023-12-13T05:11:52.730Z | ++ awk '$2 == "/home" { print $3 }' /etc/mnttab |
83 | 2023-12-13T05:11:52.730Z | + home_fs=zfs |
84 | 2023-12-13T05:11:52.730Z | + [[ zfs == autofs ]] |
85 | 2023-12-13T05:11:52.731Z | + mkdir -p /home/build |
86 | 2023-12-13T05:11:52.731Z | + chown build:build /home/build /work |
87 | 2023-12-13T05:11:54.734Z | + chmod 0700 /home/build /work |
88 | 2023-12-13T05:11:54.764Z | process exited: duration 4048 ms, exit code 0 |
|
89 | 2023-12-13T05:11:54.821Z | starting task 1: "authentication" |
90 | 2023-12-13T05:11:54.865Z | process exited: duration 46 ms, exit code 0 |
|
91 | 2023-12-13T05:11:54.929Z | starting task 2: "build" |
92 | 2023-12-13T05:11:54.955Z | + trap _exit_trap EXIT |
93 | 2023-12-13T05:11:54.955Z | + pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3' |
94 | 2023-12-13T05:11:55.137Z | secpolicy_fs_linkdir: 0x55 = 0x55 |
95 | 2023-12-13T05:11:55.137Z | secpolicy_fs_linkdir+1: 0xb8 = 0x48 |
96 | 2023-12-13T05:11:55.137Z | secpolicy_fs_linkdir+2: 0x1 = 0x89 |
97 | 2023-12-13T05:11:55.137Z | secpolicy_fs_linkdir+3: 0 = 0xe5 |
98 | 2023-12-13T05:11:55.137Z | secpolicy_fs_linkdir+4: 0 = 0xb8 |
99 | 2023-12-13T05:11:55.138Z | secpolicy_fs_linkdir+5: 0 = 0x1 |
100 | 2023-12-13T05:11:55.138Z | secpolicy_fs_linkdir+6: 0x48 = 0x0 |
101 | 2023-12-13T05:11:55.188Z | secpolicy_fs_linkdir+7: 0x89 = 0x0 |
102 | 2023-12-13T05:11:55.188Z | secpolicy_fs_linkdir+8: 0xe5 = 0x0 |
103 | 2023-12-13T05:11:55.188Z | secpolicy_fs_linkdir+9: 0x48 = 0x5d |
104 | 2023-12-13T05:11:55.188Z | secpolicy_fs_linkdir+0xa: 0x83 = 0xc3 |
105 | 2023-12-13T05:11:55.188Z | + [[ -d /opt/oxide ]] |
106 | 2023-12-13T05:11:55.188Z | + pfexec mv /opt/oxide /opt/oxide-underneath |
107 | 2023-12-13T05:11:55.189Z | + pfexec mkdir /opt/oxide |
108 | 2023-12-13T05:11:55.189Z | + pfexec mount -F tmpfs -O swap /opt/oxide |
109 | 2023-12-13T05:11:55.189Z | + [[ -d /opt/oxide-underneath ]] |
110 | 2023-12-13T05:11:55.189Z | + cd /opt/oxide-underneath |
111 | 2023-12-13T05:11:55.189Z | + pfexec tar ceEp@/f - . |
112 | 2023-12-13T05:11:55.189Z | + cd /opt/oxide |
113 | 2023-12-13T05:11:55.189Z | + pfexec tar xveEp@/f - |
114 | 2023-12-13T05:11:55.265Z | x ., 0 bytes, 0 tape blocks |
115 | 2023-12-13T05:11:55.265Z | x ./opte, 0 bytes, 0 tape blocks |
116 | 2023-12-13T05:11:55.266Z | x ./opte/bin, 0 bytes, 0 tape blocks |
117 | 2023-12-13T05:11:55.266Z | x ./opte/bin/opteadm, 52567720 bytes, 102672 tape blocks |
118 | 2023-12-13T05:11:55.292Z | + pfexec rm -rf /opt/oxide-underneath |
119 | 2023-12-13T05:11:55.292Z | + pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone |
120 | 2023-12-13T05:11:55.325Z | + pfexec mkdir /opt/oxide/work |
121 | 2023-12-13T05:11:55.325Z | + pfexec chown build:build /opt/oxide/work |
122 | 2023-12-13T05:11:55.325Z | + cd /opt/oxide/work |
123 | 2023-12-13T05:11:55.325Z | + ptime -m tar xvzf /input/package/work/package.tar.gz |
124 | 2023-12-13T05:11:55.325Z | tar: blocksize = 10 |
125 | 2023-12-13T05:11:56.854Z | Decompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'... |
126 | 2023-12-13T05:11:56.854Z | x out/mg-ddm-gz.tar, 62723072 bytes, 122506 tape blocks |
127 | 2023-12-13T05:11:56.880Z | x out/omicron-sled-agent.tar, 111883264 bytes, 218522 tape blocks |
128 | 2023-12-13T05:11:56.880Z | x out/target/test, 75 bytes, 1 tape blocks |
129 | 2023-12-13T05:11:56.880Z | x out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks |
130 | 2023-12-13T05:11:56.880Z | x package-manifest.toml, 22143 bytes, 44 tape blocks |
131 | 2023-12-13T05:11:56.881Z | x smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks |
132 | 2023-12-13T05:11:56.881Z | x target/release/omicron-package, 42517232 bytes, 83042 tape blocks |
133 | 2023-12-13T05:11:56.881Z | x tools/create_virtual_hardware.sh, 3176 bytes, 7 tape blocks |
134 | 2023-12-13T05:11:56.881Z | x tools/virtual_hardware.sh, 3408 bytes, 7 tape blocks |
135 | 2023-12-13T05:11:56.881Z | x tools/scrimlet/create-softnpu-zone.sh, 619 bytes, 2 tape blocks |
136 | 2023-12-13T05:11:56.881Z | x tools/scrimlet/destroy-softnpu-zone.sh, 195 bytes, 1 tape blocks |
137 | 2023-12-13T05:11:56.881Z | x tools/scrimlet/softnpu-init.sh, 2148 bytes, 5 tape blocks |
138 | 2023-12-13T05:11:56.881Z | x tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks |
139 | 2023-12-13T05:11:56.881Z | x tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks |
140 | 2023-12-13T05:11:56.881Z | |
141 | 2023-12-13T05:11:56.882Z | real 1.550054973 |
142 | 2023-12-13T05:11:56.882Z | user 1.388559777 |
143 | 2023-12-13T05:11:56.882Z | sys 0.303208025 |
144 | 2023-12-13T05:11:56.882Z | trap 0.000058801 |
145 | 2023-12-13T05:11:56.882Z | tflt 0.000000000 |
146 | 2023-12-13T05:11:56.882Z | dflt 0.000000000 |
147 | 2023-12-13T05:11:56.883Z | kflt 0.000000000 |
148 | 2023-12-13T05:11:56.883Z | lock 0.000000000 |
149 | 2023-12-13T05:11:56.883Z | slp 1.363754303 |
150 | 2023-12-13T05:11:56.883Z | lat 0.042633808 |
151 | 2023-12-13T05:11:56.883Z | stop 0.000119690 |
152 | 2023-12-13T05:11:56.884Z | + cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter-collector.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/ |
153 | 2023-12-13T05:11:57.953Z | + mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz |
154 | 2023-12-13T05:11:57.980Z | + mkdir tests |
155 | 2023-12-13T05:11:57.980Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
156 | 2023-12-13T05:11:57.981Z | + ptime -m gunzip |
157 | 2023-12-13T05:11:57.981Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-cc02af252c51050b |
158 | 2023-12-13T05:11:58.109Z | |
159 | 2023-12-13T05:11:58.135Z | real 0.139298415 |
160 | 2023-12-13T05:11:58.136Z | user 0.128555968 |
161 | 2023-12-13T05:11:58.136Z | sys 0.010496972 |
162 | 2023-12-13T05:11:58.136Z | trap 0.000012169 |
163 | 2023-12-13T05:11:58.136Z | tflt 0.000000000 |
164 | 2023-12-13T05:11:58.136Z | dflt 0.000000000 |
165 | 2023-12-13T05:11:58.137Z | kflt 0.000000000 |
166 | 2023-12-13T05:11:58.137Z | lock 0.000000000 |
167 | 2023-12-13T05:11:58.137Z | slp 0.000017950 |
168 | 2023-12-13T05:11:58.137Z | lat 0.000029350 |
169 | 2023-12-13T05:11:58.138Z | stop 0.000116991 |
170 | 2023-12-13T05:11:58.138Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-cc02af252c51050b |
171 | 2023-12-13T05:11:58.138Z | + chmod a+x tests/bootstrap-cc02af252c51050b |
172 | 2023-12-13T05:11:58.138Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
173 | 2023-12-13T05:11:58.138Z | + ptime -m gunzip |
174 | 2023-12-13T05:11:58.138Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
175 | 2023-12-13T05:12:00.348Z | |
176 | 2023-12-13T05:12:00.374Z | real 2.218231299 |
177 | 2023-12-13T05:12:00.374Z | user 2.090006562 |
178 | 2023-12-13T05:12:00.374Z | sys 0.127839040 |
179 | 2023-12-13T05:12:00.374Z | trap 0.000170573 |
180 | 2023-12-13T05:12:00.374Z | tflt 0.000000000 |
181 | 2023-12-13T05:12:00.374Z | dflt 0.000000000 |
182 | 2023-12-13T05:12:00.374Z | kflt 0.000000000 |
183 | 2023-12-13T05:12:00.375Z | lock 0.000000000 |
184 | 2023-12-13T05:12:00.375Z | slp 0.000019030 |
185 | 2023-12-13T05:12:00.375Z | lat 0.000024340 |
186 | 2023-12-13T05:12:00.375Z | stop 0.000111662 |
187 | 2023-12-13T05:12:00.376Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
188 | 2023-12-13T05:12:00.376Z | + chmod a+x tests/bootstrap |
189 | 2023-12-13T05:12:00.376Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
190 | 2023-12-13T05:12:00.376Z | + ptime -m gunzip |
191 | 2023-12-13T05:12:00.376Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-c0f56f9124e0823c |
192 | 2023-12-13T05:12:02.666Z | |
193 | 2023-12-13T05:12:02.772Z | real 2.308621441 |
194 | 2023-12-13T05:12:02.772Z | user 2.157044225 |
195 | 2023-12-13T05:12:02.773Z | sys 0.151148238 |
196 | 2023-12-13T05:12:02.773Z | trap 0.000176194 |
197 | 2023-12-13T05:12:02.773Z | tflt 0.000000000 |
198 | 2023-12-13T05:12:02.773Z | dflt 0.000000000 |
199 | 2023-12-13T05:12:02.773Z | kflt 0.000000000 |
200 | 2023-12-13T05:12:02.773Z | lock 0.000000000 |
201 | 2023-12-13T05:12:02.773Z | slp 0.000021330 |
202 | 2023-12-13T05:12:02.773Z | lat 0.000033090 |
203 | 2023-12-13T05:12:02.774Z | stop 0.000115871 |
204 | 2023-12-13T05:12:02.774Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-c0f56f9124e0823c |
205 | 2023-12-13T05:12:02.774Z | + chmod a+x tests/end_to_end_tests-c0f56f9124e0823c |
206 | 2023-12-13T05:12:02.774Z | + bmat address ls |
207 | 2023-12-13T05:12:02.774Z | NAME CIDR FIRST LAST COUNT |
208 | 2023-12-13T05:12:02.774Z | extra 10.151.2.0/24 10.151.2.164 10.151.2.227 64 |
209 | 2023-12-13T05:12:02.775Z | ++ bmat address ls -f extra -Ho first,last,count |
210 | 2023-12-13T05:12:02.775Z | + set -- 10.151.2.164 10.151.2.227 64 |
211 | 2023-12-13T05:12:02.776Z | + EXTRA_IP_START=10.151.2.164 |
212 | 2023-12-13T05:12:02.776Z | + EXTRA_IP_END=10.151.2.227 |
213 | 2023-12-13T05:12:02.776Z | + EXTRA_IP_COUNT=64 |
214 | 2023-12-13T05:12:02.776Z | + (( EXTRA_IP_COUNT >= 32 )) |
215 | 2023-12-13T05:12:02.776Z | + EXTRA_IP_BASE=10.151.2 |
216 | 2023-12-13T05:12:02.776Z | + EXTRA_IP_FOCTET=164 |
217 | 2023-12-13T05:12:02.776Z | + EXTRA_IP_LOCTET=227 |
218 | 2023-12-13T05:12:02.777Z | + SERVICE_IP_POOL_START=10.151.2.164 |
219 | 2023-12-13T05:12:02.777Z | + SERVICE_IP_POOL_END=10.151.2.173 |
220 | 2023-12-13T05:12:02.777Z | + DNS_IP1=10.151.2.164 |
221 | 2023-12-13T05:12:02.777Z | + DNS_IP2=10.151.2.165 |
222 | 2023-12-13T05:12:02.777Z | + UPLINK_IP=10.151.2.174 |
223 | 2023-12-13T05:12:02.777Z | + IPPOOL_START=10.151.2.175 |
224 | 2023-12-13T05:12:02.778Z | + IPPOOL_END=10.151.2.227 |
225 | 2023-12-13T05:12:02.778Z | ++ ipadm show-addr -po type,addr |
226 | 2023-12-13T05:12:02.778Z | ++ awk '-F[:/]' '$1 == "dhcp" {print $2}' |
227 | 2023-12-13T05:12:02.778Z | + GATEWAY_IP=10.151.2.100 |
228 | 2023-12-13T05:12:02.778Z | + [[ -n 10.151.2.100 ]] |
229 | 2023-12-13T05:12:02.778Z | + ping -s 10.151.2.100 56 1 |
230 | 2023-12-13T05:12:02.779Z | PING 10.151.2.100: 56 data bytes |
231 | 2023-12-13T05:12:02.779Z | 64 bytes from 10.151.2.100: icmp_seq=0. time=0.010 ms |
232 | 2023-12-13T05:12:02.779Z | |
233 | 2023-12-13T05:12:02.779Z | ----10.151.2.100 PING Statistics---- |
234 | 2023-12-13T05:12:02.779Z | 1 packets transmitted, 1 packets received, 0% packet loss |
235 | 2023-12-13T05:12:02.779Z | round-trip (ms) min/avg/max/stddev = 0.010/0.010/0.010/-nan |
236 | 2023-12-13T05:12:02.780Z | ++ arp -an |
237 | 2023-12-13T05:12:02.781Z | ++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}' |
238 | 2023-12-13T05:12:02.808Z | + GATEWAY_MAC=18:c0:4d:0d:a0:2a |
239 | 2023-12-13T05:12:02.808Z | + routeadm -e ipv4-forwarding -u |
240 | 2023-12-13T05:12:02.836Z | + PXA_START=10.151.2.164 |
241 | 2023-12-13T05:12:02.836Z | + PXA_END=10.151.2.227 |
242 | 2023-12-13T05:12:02.836Z | + export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END |
243 | 2023-12-13T05:12:02.836Z | + pfexec zpool create -f scratch c1t1d0 c2t1d0 |
244 | 2023-12-13T05:12:02.964Z | + ZPOOL_VDEV_DIR=/scratch |
245 | 2023-12-13T05:12:02.964Z | + ptime -m pfexec ./tools/create_virtual_hardware.sh |
246 | 2023-12-13T05:12:02.991Z | +++ dirname ./tools/create_virtual_hardware.sh |
247 | 2023-12-13T05:12:02.991Z | ++ cd ./tools |
248 | 2023-12-13T05:12:02.991Z | ++ pwd |
249 | 2023-12-13T05:12:02.991Z | + SOURCE_DIR=/opt/oxide/work/tools |
250 | 2023-12-13T05:12:02.992Z | + OMICRON_TOP=/opt/oxide/work/tools/.. |
251 | 2023-12-13T05:12:02.992Z | + SOFTNPU_MODE=zone |
252 | 2023-12-13T05:12:02.992Z | + . /opt/oxide/work/tools/virtual_hardware.sh |
253 | 2023-12-13T05:12:02.992Z | ++ MARKER=/etc/opt/oxide/NO_INSTALL |
254 | 2023-12-13T05:12:02.992Z | ++ [[ -f /etc/opt/oxide/NO_INSTALL ]] |
255 | 2023-12-13T05:12:02.992Z | ++ dladm show-phys -p -o LINK |
256 | 2023-12-13T05:12:02.992Z | ++ head -1 |
257 | 2023-12-13T05:12:03.048Z | + PHYSICAL_LINK=igb0 |
258 | 2023-12-13T05:12:03.075Z | + echo 'Using igb0 as physical link' |
259 | 2023-12-13T05:12:03.076Z | Using igb0 as physical link |
260 | 2023-12-13T05:12:03.076Z | + ensure_run_as_root |
261 | 2023-12-13T05:12:03.076Z | ++ id -u |
262 | 2023-12-13T05:12:03.077Z | + [[ 0 -ne 0 ]] |
263 | 2023-12-13T05:12:03.077Z | + ensure_zpools |
264 | 2023-12-13T05:12:03.077Z | + ZPOOL_TYPES=('oxp_' 'oxi_') |
265 | 2023-12-13T05:12:03.077Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
266 | 2023-12-13T05:12:03.078Z | + readarray -t ZPOOLS |
267 | 2023-12-13T05:12:03.078Z | ++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
268 | 2023-12-13T05:12:03.078Z | ++ sed 's/[ ",]//g' |
269 | 2023-12-13T05:12:03.078Z | + for ZPOOL in "${ZPOOLS[@]}" |
270 | 2023-12-13T05:12:03.078Z | + echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
271 | 2023-12-13T05:12:03.078Z | Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b] |
272 | 2023-12-13T05:12:03.078Z | + VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
273 | 2023-12-13T05:12:03.078Z | + [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
274 | 2023-12-13T05:12:03.078Z | + dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
275 | 2023-12-13T05:12:03.105Z | 0+0 records in |
276 | 2023-12-13T05:12:03.105Z | 0+0 records out |
277 | 2023-12-13T05:12:03.105Z | 0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec) |
278 | 2023-12-13T05:12:03.106Z | + success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
279 | 2023-12-13T05:12:03.106Z | + set +x |
280 | 2023-12-13T05:12:03.106Z | ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
281 | 2023-12-13T05:12:03.106Z | ++ zpool list -o name |
282 | 2023-12-13T05:12:03.106Z | ++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b |
283 | 2023-12-13T05:12:03.106Z | + [[ -z '' ]] |
284 | 2023-12-13T05:12:03.106Z | + zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
285 | 2023-12-13T05:12:03.137Z | + success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
286 | 2023-12-13T05:12:03.163Z | + set +x |
287 | 2023-12-13T05:12:03.164Z | ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
288 | 2023-12-13T05:12:03.165Z | + for ZPOOL in "${ZPOOLS[@]}" |
289 | 2023-12-13T05:12:03.166Z | + echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
290 | 2023-12-13T05:12:03.166Z | Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
291 | 2023-12-13T05:12:03.166Z | + VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
292 | 2023-12-13T05:12:03.166Z | + [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
293 | 2023-12-13T05:12:03.166Z | + dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
294 | 2023-12-13T05:12:03.166Z | 0+0 records in |
295 | 2023-12-13T05:12:03.166Z | 0+0 records out |
296 | 2023-12-13T05:12:03.166Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
297 | 2023-12-13T05:12:03.166Z | + success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
298 | 2023-12-13T05:12:03.166Z | + set +x |
299 | 2023-12-13T05:12:03.166Z | ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
300 | 2023-12-13T05:12:03.166Z | ++ zpool list -o name |
301 | 2023-12-13T05:12:03.166Z | ++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
302 | 2023-12-13T05:12:03.167Z | + [[ -z '' ]] |
303 | 2023-12-13T05:12:03.167Z | + zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
304 | 2023-12-13T05:12:03.199Z | + success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
305 | 2023-12-13T05:12:03.200Z | + set +x |
306 | 2023-12-13T05:12:03.200Z | ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
307 | 2023-12-13T05:12:03.200Z | + for ZPOOL in "${ZPOOLS[@]}" |
308 | 2023-12-13T05:12:03.200Z | + echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
309 | 2023-12-13T05:12:03.200Z | Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
310 | 2023-12-13T05:12:03.200Z | + VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
311 | 2023-12-13T05:12:03.200Z | + [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
312 | 2023-12-13T05:12:03.201Z | + dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
313 | 2023-12-13T05:12:03.201Z | 0+0 records in |
314 | 2023-12-13T05:12:03.201Z | 0+0 records out |
315 | 2023-12-13T05:12:03.201Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
316 | 2023-12-13T05:12:03.202Z | + success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
317 | 2023-12-13T05:12:03.202Z | + set +x |
318 | 2023-12-13T05:12:03.202Z | ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
319 | 2023-12-13T05:12:03.202Z | ++ zpool list -o name |
320 | 2023-12-13T05:12:03.202Z | ++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
321 | 2023-12-13T05:12:03.202Z | + [[ -z '' ]] |
322 | 2023-12-13T05:12:03.202Z | + zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
323 | 2023-12-13T05:12:03.233Z | + success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
324 | 2023-12-13T05:12:03.233Z | + set +x |
325 | 2023-12-13T05:12:03.267Z | ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
326 | 2023-12-13T05:12:03.267Z | + for ZPOOL in "${ZPOOLS[@]}" |
327 | 2023-12-13T05:12:03.268Z | + echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
328 | 2023-12-13T05:12:03.268Z | Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03] |
329 | 2023-12-13T05:12:03.268Z | + VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
330 | 2023-12-13T05:12:03.268Z | + [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
331 | 2023-12-13T05:12:03.268Z | + dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
332 | 2023-12-13T05:12:03.268Z | 0+0 records in |
333 | 2023-12-13T05:12:03.268Z | 0+0 records out |
334 | 2023-12-13T05:12:03.268Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
335 | 2023-12-13T05:12:03.268Z | + success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
336 | 2023-12-13T05:12:03.269Z | + set +x |
337 | 2023-12-13T05:12:03.269Z | ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
338 | 2023-12-13T05:12:03.269Z | ++ zpool list -o name |
339 | 2023-12-13T05:12:03.269Z | ++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 |
340 | 2023-12-13T05:12:03.270Z | + [[ -z '' ]] |
341 | 2023-12-13T05:12:03.270Z | + zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
342 | 2023-12-13T05:12:03.297Z | + success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
343 | 2023-12-13T05:12:03.297Z | + set +x |
344 | 2023-12-13T05:12:03.297Z | ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
345 | 2023-12-13T05:12:03.297Z | + for ZPOOL in "${ZPOOLS[@]}" |
346 | 2023-12-13T05:12:03.297Z | + echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
347 | 2023-12-13T05:12:03.297Z | Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03] |
348 | 2023-12-13T05:12:03.298Z | + VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
349 | 2023-12-13T05:12:03.298Z | + [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
350 | 2023-12-13T05:12:03.298Z | + dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
351 | 2023-12-13T05:12:03.298Z | 0+0 records in |
352 | 2023-12-13T05:12:03.300Z | 0+0 records out |
353 | 2023-12-13T05:12:03.300Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
354 | 2023-12-13T05:12:03.300Z | + success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
355 | 2023-12-13T05:12:03.300Z | + set +x |
356 | 2023-12-13T05:12:03.300Z | ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
357 | 2023-12-13T05:12:03.300Z | ++ zpool list -o name |
358 | 2023-12-13T05:12:03.300Z | ++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 |
359 | 2023-12-13T05:12:03.301Z | + [[ -z '' ]] |
360 | 2023-12-13T05:12:03.301Z | + zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
361 | 2023-12-13T05:12:03.329Z | + success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
362 | 2023-12-13T05:12:03.329Z | + set +x |
363 | 2023-12-13T05:12:03.329Z | ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
364 | 2023-12-13T05:12:03.330Z | + for ZPOOL in "${ZPOOLS[@]}" |
365 | 2023-12-13T05:12:03.330Z | + echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]' |
366 | 2023-12-13T05:12:03.330Z | Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930] |
367 | 2023-12-13T05:12:03.330Z | + VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
368 | 2023-12-13T05:12:03.330Z | + [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]] |
369 | 2023-12-13T05:12:03.330Z | + dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G |
370 | 2023-12-13T05:12:03.357Z | 0+0 records in |
371 | 2023-12-13T05:12:03.357Z | 0+0 records out |
372 | 2023-12-13T05:12:03.357Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
373 | 2023-12-13T05:12:03.357Z | + success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists' |
374 | 2023-12-13T05:12:03.357Z | + set +x |
375 | 2023-12-13T05:12:03.357Z | ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists |
376 | 2023-12-13T05:12:03.357Z | ++ zpool list -o name |
377 | 2023-12-13T05:12:03.357Z | ++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 |
378 | 2023-12-13T05:12:03.358Z | + [[ -z '' ]] |
379 | 2023-12-13T05:12:03.358Z | + zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
380 | 2023-12-13T05:12:03.384Z | + success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists' |
381 | 2023-12-13T05:12:03.384Z | + set +x |
382 | 2023-12-13T05:12:03.384Z | ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists |
383 | 2023-12-13T05:12:03.384Z | + for ZPOOL in "${ZPOOLS[@]}" |
384 | 2023-12-13T05:12:03.384Z | + echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]' |
385 | 2023-12-13T05:12:03.384Z | Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60] |
386 | 2023-12-13T05:12:03.385Z | + VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
387 | 2023-12-13T05:12:03.385Z | + [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]] |
388 | 2023-12-13T05:12:03.385Z | + dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G |
389 | 2023-12-13T05:12:03.385Z | 0+0 records in |
390 | 2023-12-13T05:12:03.385Z | 0+0 records out |
391 | 2023-12-13T05:12:03.385Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
392 | 2023-12-13T05:12:03.385Z | + success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists' |
393 | 2023-12-13T05:12:03.385Z | + set +x |
394 | 2023-12-13T05:12:03.385Z | ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists |
395 | 2023-12-13T05:12:03.385Z | ++ zpool list -o name |
396 | 2023-12-13T05:12:03.385Z | ++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 |
397 | 2023-12-13T05:12:03.412Z | + [[ -z '' ]] |
398 | 2023-12-13T05:12:03.413Z | + zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
399 | 2023-12-13T05:12:03.439Z | + success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists' |
400 | 2023-12-13T05:12:03.439Z | + set +x |
401 | 2023-12-13T05:12:03.439Z | ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists |
402 | 2023-12-13T05:12:03.439Z | + for ZPOOL in "${ZPOOLS[@]}" |
403 | 2023-12-13T05:12:03.439Z | + echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]' |
404 | 2023-12-13T05:12:03.440Z | Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f] |
405 | 2023-12-13T05:12:03.440Z | + VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
406 | 2023-12-13T05:12:03.440Z | + [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]] |
407 | 2023-12-13T05:12:03.440Z | + dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G |
408 | 2023-12-13T05:12:03.440Z | 0+0 records in |
409 | 2023-12-13T05:12:03.441Z | 0+0 records out |
410 | 2023-12-13T05:12:03.441Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
411 | 2023-12-13T05:12:03.441Z | + success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists' |
412 | 2023-12-13T05:12:03.442Z | + set +x |
413 | 2023-12-13T05:12:03.442Z | ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists |
414 | 2023-12-13T05:12:03.442Z | ++ zpool list -o name |
415 | 2023-12-13T05:12:03.442Z | ++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f |
416 | 2023-12-13T05:12:03.469Z | + [[ -z '' ]] |
417 | 2023-12-13T05:12:03.469Z | + zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
418 | 2023-12-13T05:12:03.496Z | + success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists' |
419 | 2023-12-13T05:12:03.496Z | + set +x |
420 | 2023-12-13T05:12:03.496Z | ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists |
421 | 2023-12-13T05:12:03.496Z | + for ZPOOL in "${ZPOOLS[@]}" |
422 | 2023-12-13T05:12:03.496Z | + echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]' |
423 | 2023-12-13T05:12:03.496Z | Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7] |
424 | 2023-12-13T05:12:03.496Z | + VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
425 | 2023-12-13T05:12:03.497Z | + [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]] |
426 | 2023-12-13T05:12:03.497Z | + dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G |
427 | 2023-12-13T05:12:03.497Z | 0+0 records in |
428 | 2023-12-13T05:12:03.497Z | 0+0 records out |
429 | 2023-12-13T05:12:03.497Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
430 | 2023-12-13T05:12:03.497Z | + success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists' |
431 | 2023-12-13T05:12:03.497Z | + set +x |
432 | 2023-12-13T05:12:03.498Z | ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists |
433 | 2023-12-13T05:12:03.498Z | ++ zpool list -o name |
434 | 2023-12-13T05:12:03.499Z | ++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 |
435 | 2023-12-13T05:12:03.499Z | + [[ -z '' ]] |
436 | 2023-12-13T05:12:03.499Z | + zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
437 | 2023-12-13T05:12:03.552Z | + success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists' |
438 | 2023-12-13T05:12:03.552Z | + set +x |
439 | 2023-12-13T05:12:03.580Z | ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists |
440 | 2023-12-13T05:12:03.580Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
441 | 2023-12-13T05:12:03.580Z | + readarray -t ZPOOLS |
442 | 2023-12-13T05:12:03.580Z | ++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
443 | 2023-12-13T05:12:03.580Z | ++ sed 's/[ ",]//g' |
444 | 2023-12-13T05:12:03.580Z | + for ZPOOL in "${ZPOOLS[@]}" |
445 | 2023-12-13T05:12:03.581Z | + echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
446 | 2023-12-13T05:12:03.582Z | Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b] |
447 | 2023-12-13T05:12:03.582Z | + VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
448 | 2023-12-13T05:12:03.582Z | + [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
449 | 2023-12-13T05:12:03.582Z | + dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
450 | 2023-12-13T05:12:03.582Z | 0+0 records in |
451 | 2023-12-13T05:12:03.582Z | 0+0 records out |
452 | 2023-12-13T05:12:03.582Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
453 | 2023-12-13T05:12:03.582Z | + success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
454 | 2023-12-13T05:12:03.582Z | + set +x |
455 | 2023-12-13T05:12:03.582Z | ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
456 | 2023-12-13T05:12:03.582Z | ++ zpool list -o name |
457 | 2023-12-13T05:12:03.583Z | ++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b |
458 | 2023-12-13T05:12:03.583Z | + [[ -z '' ]] |
459 | 2023-12-13T05:12:03.584Z | + zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
460 | 2023-12-13T05:12:03.666Z | + success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
461 | 2023-12-13T05:12:03.666Z | + set +x |
462 | 2023-12-13T05:12:03.666Z | ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
463 | 2023-12-13T05:12:03.666Z | + for ZPOOL in "${ZPOOLS[@]}" |
464 | 2023-12-13T05:12:03.667Z | + echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
465 | 2023-12-13T05:12:03.667Z | Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b] |
466 | 2023-12-13T05:12:03.667Z | + VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
467 | 2023-12-13T05:12:03.667Z | + [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
468 | 2023-12-13T05:12:03.667Z | + dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
469 | 2023-12-13T05:12:03.667Z | 0+0 records in |
470 | 2023-12-13T05:12:03.667Z | 0+0 records out |
471 | 2023-12-13T05:12:03.667Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
472 | 2023-12-13T05:12:03.667Z | + success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
473 | 2023-12-13T05:12:03.667Z | + set +x |
474 | 2023-12-13T05:12:03.667Z | ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
475 | 2023-12-13T05:12:03.667Z | ++ zpool list -o name |
476 | 2023-12-13T05:12:03.668Z | ++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b |
477 | 2023-12-13T05:12:03.668Z | + [[ -z '' ]] |
478 | 2023-12-13T05:12:03.668Z | + zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
479 | 2023-12-13T05:12:03.668Z | + success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
480 | 2023-12-13T05:12:03.668Z | + set +x |
481 | 2023-12-13T05:12:03.668Z | ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
482 | 2023-12-13T05:12:03.668Z | + [[ zone == \z\o\n\e ]] |
483 | 2023-12-13T05:12:03.668Z | + ensure_simulated_links igb0 |
484 | 2023-12-13T05:12:03.691Z | + local PHYSICAL_LINK=igb0 |
485 | 2023-12-13T05:12:03.692Z | + INDICES=("0" "1") |
486 | 2023-12-13T05:12:03.692Z | + for I in "${INDICES[@]}" |
487 | 2023-12-13T05:12:03.692Z | ++ get_simnet_name_if_exists net0 |
488 | 2023-12-13T05:12:03.692Z | ++ dladm show-simnet -p -o LINK net0 |
489 | 2023-12-13T05:12:03.692Z | ++ echo '' |
490 | 2023-12-13T05:12:03.692Z | + [[ -z '' ]] |
491 | 2023-12-13T05:12:03.692Z | + dladm create-simnet -t net0 |
492 | 2023-12-13T05:12:03.692Z | + dladm create-simnet -t sc0_0 |
493 | 2023-12-13T05:12:03.725Z | + dladm modify-simnet -t -p net0 sc0_0 |
494 | 2023-12-13T05:12:03.725Z | + dladm set-linkprop -p mtu=9000 sc0_0 |
495 | 2023-12-13T05:12:03.726Z | + success 'Simnet net0/sc0_0 exists' |
496 | 2023-12-13T05:12:03.726Z | + set +x |
497 | 2023-12-13T05:12:03.726Z | Simnet net0/sc0_0 exists |
498 | 2023-12-13T05:12:03.726Z | + for I in "${INDICES[@]}" |
499 | 2023-12-13T05:12:03.726Z | ++ get_simnet_name_if_exists net1 |
500 | 2023-12-13T05:12:03.726Z | ++ dladm show-simnet -p -o LINK net1 |
501 | 2023-12-13T05:12:03.726Z | ++ echo '' |
502 | 2023-12-13T05:12:03.726Z | + [[ -z '' ]] |
503 | 2023-12-13T05:12:03.726Z | + dladm create-simnet -t net1 |
504 | 2023-12-13T05:12:03.726Z | + dladm create-simnet -t sc1_0 |
505 | 2023-12-13T05:12:03.726Z | + dladm modify-simnet -t -p net1 sc1_0 |
506 | 2023-12-13T05:12:03.726Z | + dladm set-linkprop -p mtu=9000 sc1_0 |
507 | 2023-12-13T05:12:03.726Z | + success 'Simnet net1/sc1_0 exists' |
508 | 2023-12-13T05:12:03.727Z | + set +x |
509 | 2023-12-13T05:12:03.727Z | Simnet net1/sc1_0 exists |
510 | 2023-12-13T05:12:03.728Z | ++ get_vnic_name_if_exists sc0_1 |
511 | 2023-12-13T05:12:03.728Z | ++ dladm show-vnic -p -o LINK sc0_1 |
512 | 2023-12-13T05:12:03.728Z | ++ echo '' |
513 | 2023-12-13T05:12:03.728Z | + [[ -z '' ]] |
514 | 2023-12-13T05:12:03.728Z | + dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d |
515 | 2023-12-13T05:12:03.728Z | + [[ -v PROMISC_FILT_OFF ]] |
516 | 2023-12-13T05:12:03.728Z | + success 'Vnic sc0_1 exists' |
517 | 2023-12-13T05:12:03.729Z | + set +x |
518 | 2023-12-13T05:12:03.729Z | Vnic sc0_1 exists |
519 | 2023-12-13T05:12:03.729Z | + warn_if_no_proxy_arp |
520 | 2023-12-13T05:12:03.729Z | + [[ -v PXA_START ]] |
521 | 2023-12-13T05:12:03.729Z | + [[ -v PXA_END ]] |
522 | 2023-12-13T05:12:03.729Z | + ensure_softnpu_zone |
523 | 2023-12-13T05:12:03.729Z | + zoneadm list |
524 | 2023-12-13T05:12:03.729Z | + grep -q sidecar_softnpu |
525 | 2023-12-13T05:12:03.729Z | + [[ -f out/npuzone/npuzone ]] |
526 | 2023-12-13T05:12:03.729Z | + out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit 45ed98fea5824feb4d42f45bbf218e597dc9fc58 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092 |
527 | 2023-12-13T05:12:03.763Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt |
528 | 2023-12-13T05:12:13.125Z | downloading softnpu ...done |
529 | 2023-12-13T05:12:13.163Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/45ed98fea5824feb4d42f45bbf218e597dc9fc58/libsidecar_lite.so.sha256.txt |
530 | 2023-12-13T05:12:21.001Z | downloading asic_program.so ...done |
531 | 2023-12-13T05:12:21.030Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/45ed98fea5824feb4d42f45bbf218e597dc9fc58/scadm.sha256.txt |
532 | 2023-12-13T05:12:28.792Z | downloading scadm ...done |
533 | 2023-12-13T05:12:28.820Z | creating port tfportrear0_0 for sc0_0 |
534 | 2023-12-13T05:12:28.820Z | creating port tfportqsfp0_0 for sc0_1 |
535 | 2023-12-13T05:12:28.846Z | softnpu zone setup |
536 | 2023-12-13T05:12:28.846Z | configure zone |
537 | 2023-12-13T05:12:28.846Z | install zone |
538 | 2023-12-13T05:12:29.902Z | boot zone |
539 | 2023-12-13T05:12:33.008Z | [sidecar_softnpu] svcs milestone/network |
540 | 2023-12-13T05:12:33.035Z | STATE STIME FMRI |
541 | 2023-12-13T05:12:33.035Z | online 5:12:32 svc:/milestone/network:default |
542 | 2023-12-13T05:12:33.035Z | [sidecar_softnpu] /softnpu/npu start |
543 | 2023-12-13T05:12:33.060Z | |
544 | 2023-12-13T05:12:33.086Z | + /opt/oxide/work/tools/scrimlet/softnpu-init.sh |
545 | 2023-12-13T05:12:33.086Z | + GATEWAY_IP=10.151.2.100 |
546 | 2023-12-13T05:12:33.086Z | + echo 'Using 10.151.2.100 as gateway ip' |
547 | 2023-12-13T05:12:33.086Z | Using 10.151.2.100 as gateway ip |
548 | 2023-12-13T05:12:33.086Z | + [[ ! -v GATEWAY_MAC ]] |
549 | 2023-12-13T05:12:33.086Z | + GATEWAY_MAC=18:c0:4d:0d:a0:2a |
550 | 2023-12-13T05:12:33.088Z | ++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63 |
551 | 2023-12-13T05:12:33.088Z | +++ echo 18:c0:4d:0d:a0:2a |
552 | 2023-12-13T05:12:33.088Z | + COUNT=1 |
553 | 2023-12-13T05:12:33.088Z | + [[ 1 -ne 1 ]] |
554 | 2023-12-13T05:12:33.088Z | + echo 'Using 18:c0:4d:0d:a0:2a as gateway mac' |
555 | 2023-12-13T05:12:33.088Z | Using 18:c0:4d:0d:a0:2a as gateway mac |
556 | 2023-12-13T05:12:33.088Z | + z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a |
557 | 2023-12-13T05:12:33.088Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a |
558 | 2023-12-13T05:12:33.140Z | + PXA_MAC=a8:e1:de:01:70:1d |
559 | 2023-12-13T05:12:33.140Z | + [[ -v PXA_START ]] |
560 | 2023-12-13T05:12:33.140Z | + z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d |
561 | 2023-12-13T05:12:33.140Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d |
562 | 2023-12-13T05:12:33.165Z | + z_scadm dump-state |
563 | 2023-12-13T05:12:33.165Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
564 | 2023-12-13T05:12:33.165Z | local v6: |
565 | 2023-12-13T05:12:33.165Z | local v4: |
566 | 2023-12-13T05:12:33.166Z | router v6: |
567 | 2023-12-13T05:12:33.166Z | router v4_idx: |
568 | 2023-12-13T05:12:33.166Z | router v4_routes: |
569 | 2023-12-13T05:12:33.166Z | resolver v4: |
570 | 2023-12-13T05:12:33.166Z | 10.151.2.100 -> 18:c0:4d:0d:a0:2a |
571 | 2023-12-13T05:12:33.166Z | resolver v6: |
572 | 2023-12-13T05:12:33.166Z | nat v4: |
573 | 2023-12-13T05:12:33.166Z | nat_v6: |
574 | 2023-12-13T05:12:33.166Z | port_mac: |
575 | 2023-12-13T05:12:33.166Z | proxy arp: |
576 | 2023-12-13T05:12:33.166Z | 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d |
577 | 2023-12-13T05:12:33.167Z | + success 'softnpu zone exists' |
578 | 2023-12-13T05:12:33.167Z | + set +x |
579 | 2023-12-13T05:12:33.167Z | softnpu zone exists |
580 | 2023-12-13T05:12:33.167Z | |
581 | 2023-12-13T05:12:33.167Z | real 30.193974037 |
582 | 2023-12-13T05:12:33.167Z | user 0.708860456 |
583 | 2023-12-13T05:12:33.167Z | sys 1.642786569 |
584 | 2023-12-13T05:12:33.167Z | trap 0.000079369 |
585 | 2023-12-13T05:12:33.167Z | tflt 0.000292456 |
586 | 2023-12-13T05:12:33.167Z | dflt 0.001104524 |
587 | 2023-12-13T05:12:33.167Z | kflt 0.000000000 |
588 | 2023-12-13T05:12:33.167Z | lock 23:26.225892175 |
589 | 2023-12-13T05:12:33.167Z | slp 1:30.377067533 |
590 | 2023-12-13T05:12:33.167Z | lat 0.080876347 |
591 | 2023-12-13T05:12:33.167Z | stop 0.345375179 |
592 | 2023-12-13T05:12:33.167Z | + tar xf out/omicron-sled-agent.tar pkg/config-rss.toml |
593 | 2023-12-13T05:12:33.203Z | ++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
594 | 2023-12-13T05:12:33.236Z | + SILO_NAME=recovery |
595 | 2023-12-13T05:12:33.237Z | ++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
596 | 2023-12-13T05:12:33.237Z | + EXTERNAL_DNS_DOMAIN=oxide.test |
597 | 2023-12-13T05:12:33.237Z | + sed -i~ ' |
598 | 2023-12-13T05:12:33.237Z | /^external_dns_ips/c\ |
599 | 2023-12-13T05:12:33.237Z | external_dns_ips = [ "10.151.2.164", "10.151.2.165" ] |
600 | 2023-12-13T05:12:33.237Z | /^\[\[internal_services_ip_pool_ranges/,/^$/ { |
601 | 2023-12-13T05:12:33.237Z | /^first/c\ |
602 | 2023-12-13T05:12:33.237Z | first = "10.151.2.164" |
603 | 2023-12-13T05:12:33.237Z | /^last/c\ |
604 | 2023-12-13T05:12:33.237Z | last = "10.151.2.173" |
605 | 2023-12-13T05:12:33.238Z | } |
606 | 2023-12-13T05:12:33.238Z | /^\[rack_network_config/,/^$/ { |
607 | 2023-12-13T05:12:33.238Z | /^infra_ip_first/c\ |
608 | 2023-12-13T05:12:33.238Z | infra_ip_first = "10.151.2.174" |
609 | 2023-12-13T05:12:33.238Z | /^infra_ip_last/c\ |
610 | 2023-12-13T05:12:33.238Z | infra_ip_last = "10.151.2.174" |
611 | 2023-12-13T05:12:33.238Z | } |
612 | 2023-12-13T05:12:33.238Z | /^\[\[rack_network_config.ports/,/^$/ { |
613 | 2023-12-13T05:12:33.238Z | /^routes/c\ |
614 | 2023-12-13T05:12:33.238Z | routes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\] |
615 | 2023-12-13T05:12:33.239Z | /^addresses/c\ |
616 | 2023-12-13T05:12:33.239Z | addresses = \["10.151.2.174/32"\] |
617 | 2023-12-13T05:12:33.239Z | } |
618 | 2023-12-13T05:12:33.239Z | ' pkg/config-rss.toml |
619 | 2023-12-13T05:12:33.239Z | + diff -u pkg/config-rss.toml~ pkg/config-rss.toml |
620 | 2023-12-13T05:12:33.239Z | --- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006 |
621 | 2023-12-13T05:12:33.239Z | +++ pkg/config-rss.toml Wed Dec 13 05:12:33 2023 |
622 | 2023-12-13T05:12:33.239Z | @@ -41,7 +41,7 @@ |
623 | 2023-12-13T05:12:33.239Z | # the DNS domain delegated to the rack by the customer. Each of these addresses |
624 | 2023-12-13T05:12:33.239Z | # must be contained in one of the "internal services" IP Pool ranges listed |
625 | 2023-12-13T05:12:33.239Z | # below. |
626 | 2023-12-13T05:12:33.239Z | -external_dns_ips = [ "192.168.1.20", "192.168.1.21" ] |
627 | 2023-12-13T05:12:33.239Z | +external_dns_ips = [ "10.151.2.164", "10.151.2.165" ] |
628 | 2023-12-13T05:12:33.239Z | |
629 | 2023-12-13T05:12:33.239Z | # Initial TLS certificates for the external API |
630 | 2023-12-13T05:12:33.239Z | # |
631 | 2023-12-13T05:12:33.241Z | @@ -77,8 +77,8 @@ |
632 | 2023-12-13T05:12:33.241Z | # |
633 | 2023-12-13T05:12:33.241Z | # For more on this and what to put here, see docs/how-to-run.adoc. |
634 | 2023-12-13T05:12:33.242Z | [[internal_services_ip_pool_ranges]] |
635 | 2023-12-13T05:12:33.242Z | -first = "192.168.1.20" |
636 | 2023-12-13T05:12:33.242Z | -last = "192.168.1.29" |
637 | 2023-12-13T05:12:33.242Z | +first = "10.151.2.164" |
638 | 2023-12-13T05:12:33.242Z | +last = "10.151.2.173" |
639 | 2023-12-13T05:12:33.242Z | |
640 | 2023-12-13T05:12:33.242Z | # TODO - this configuration is subject to change going forward. Ultimately these |
641 | 2023-12-13T05:12:33.242Z | # parameters should be provided to the control plane via wicket, but we need to |
642 | 2023-12-13T05:12:33.242Z | @@ -92,8 +92,8 @@ |
643 | 2023-12-13T05:12:33.242Z | # A range of IP addresses used by Boundary Services on the external network. In |
644 | 2023-12-13T05:12:33.242Z | # a real system, these would be addresses of the uplink ports on the Sidecar. |
645 | 2023-12-13T05:12:33.242Z | # With softnpu, only one address is used. |
646 | 2023-12-13T05:12:33.242Z | -infra_ip_first = "192.168.1.30" |
647 | 2023-12-13T05:12:33.242Z | -infra_ip_last = "192.168.1.30" |
648 | 2023-12-13T05:12:33.242Z | +infra_ip_first = "10.151.2.174" |
649 | 2023-12-13T05:12:33.242Z | +infra_ip_last = "10.151.2.174" |
650 | 2023-12-13T05:12:33.243Z | |
651 | 2023-12-13T05:12:33.243Z | # Configurations for BGP routers to run on the scrimlets. |
652 | 2023-12-13T05:12:33.243Z | bgp = [] |
653 | 2023-12-13T05:12:33.243Z | @@ -101,9 +101,9 @@ |
654 | 2023-12-13T05:12:33.243Z | # You can configure multiple uplinks by repeating the following stanza |
655 | 2023-12-13T05:12:33.243Z | [[rack_network_config.ports]] |
656 | 2023-12-13T05:12:33.243Z | # Routes associated with this port. |
657 | 2023-12-13T05:12:33.243Z | -routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}] |
658 | 2023-12-13T05:12:33.243Z | +routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}] |
659 | 2023-12-13T05:12:33.243Z | # Addresses associated with this port. |
660 | 2023-12-13T05:12:33.243Z | -addresses = ["192.168.1.30/32"] |
661 | 2023-12-13T05:12:33.243Z | +addresses = ["10.151.2.174/32"] |
662 | 2023-12-13T05:12:33.243Z | # Name of the uplink port. This should always be "qsfp0" when using softnpu. |
663 | 2023-12-13T05:12:33.243Z | port = "qsfp0" |
664 | 2023-12-13T05:12:33.243Z | # The speed of this port. |
665 | 2023-12-13T05:12:33.243Z | + true |
666 | 2023-12-13T05:12:33.243Z | + tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml |
667 | 2023-12-13T05:12:33.243Z | a pkg/config-rss.toml 7K |
668 | 2023-12-13T05:12:33.243Z | + rm -f pkg/config-rss.toml pkg/config-rss.toml~ |
669 | 2023-12-13T05:12:33.243Z | + TLS_NAME=recovery.sys.oxide.test |
670 | 2023-12-13T05:12:33.243Z | + openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin |
671 | 2023-12-13T05:12:34.173Z | ......+...+...+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.........................+......+...+...+...+..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+..+............+....+.................+...+....+...+...+...........+.+..+.......+...+......+..+....+...+........+....+.....+.+.........+........+..........+............+...+...+.....+...+.........................+..............+.+......+.....+...............+......+...+.+..............+.+..............+.......+...+.........+......+...............+......+.....+....+..............+.+..+....+.....+...............+.............+.....+.+...........+......+...+....+...+.....+...+....+..+.+...+...........+.........+......+......+.......+..+.........+....+...+.....+...................+......+............+..+....+............+..+.+.................+...+............+...+.........+...+...............+..................+....+..+.+..+.......+..............+............+..........+.....+...+........................+..........+........+..................+..........+..+......................+..+...............+.+..+.+.........+.....+......+.........+.......+......+..............+...+.+..+...+...............+.+..................+......+..+....+.....+.........+.......+........+.......+........+...............+....+...........+...........................+....+...+.....+.......+......+..+...+.......................................+.........+....+...+.....+.........+............................+...........+.+...............+.....+.........+.........+......+...............+......+.+.......................+...............+.+.....................+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
672 | 2023-12-13T05:12:35.285Z | ......+...+........+....+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+....+...+..+...+....+...............+...........+...+..........+..............+...............+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+..+.+.....+.........+............+.+..+......+.....................+....+..+....+...+............+........+.+.........+...+..................+.........+........+...........................+...+....+.....+....+..+....+...+........+...+......+...............+...............+.............+...+...+..+..........+..............+.............+......+..........................+.+........+......+..........+...+..+....+..+.........+..........+.....+......+............+.............+........+......+.+..+...+....+...........+.............+...........+.+...+......+...+....................+.+..+....+........+.+...........+....+.....+......+...+...+.......+........+.......+.....+............+....+..+.......+...+............+...+.......................+...............+.......+...............+.....+...........................+......+.......+.........+.........+..............+.......+...+........+.......+..+.+..+.+.........+...............+..................+.........+.........+..+...+......+.............+..+......+.........+...+.......+.........+.....................+.....+...............+.+..+...+..........+............+......+..+.........+...+...............+......+.+...+.....+.+..+...+.+...+............+...........+.......+...+..............+.+...+.........+............+...........+.......+.....+.+............+.........+........+.+.........+...+.....+....+.........+.....+.......+............+..+...+......+.........+.+..+.........+.........+.......+...+..+..........+..+...+.......+.............................................+...........+....+...........+......+.+..+.+......+.....+.+........+............+.........+.+...+.....................+......+..+......+......+...............+...+.+......+......+.....+.......+..+.............+.....+..........+......+.........+...+..+......+.........+............+.+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
673 | 2023-12-13T05:12:35.311Z | ----- |
674 | 2023-12-13T05:12:35.311Z | + tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
675 | 2023-12-13T05:12:35.336Z | a pkg/initial-tls-cert.pem 2K |
676 | 2023-12-13T05:12:35.337Z | a pkg/initial-tls-key.pem 4K |
677 | 2023-12-13T05:12:35.337Z | + rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
678 | 2023-12-13T05:12:35.337Z | + rmdir pkg |
679 | 2023-12-13T05:12:35.337Z | + E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
680 | 2023-12-13T05:12:35.337Z | + pfexec mkdir -p /usr/oxide |
681 | 2023-12-13T05:12:35.337Z | + pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0 |
682 | 2023-12-13T05:12:36.020Z | + pfexec chmod +x /usr/oxide/oxide |
683 | 2023-12-13T05:12:36.046Z | + curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw |
684 | 2023-12-13T05:12:54.328Z | + OMICRON_NO_UNINSTALL=1 |
685 | 2023-12-13T05:12:54.328Z | + ptime -m pfexec ./target/release/omicron-package -t test install |
686 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.017 DEBG target[test]: Target({"image": "standard", "machine": "non-gimlet", "rack-topology": "single-sled", "switch": "softnpu"}) |
687 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/clickhouse.tar.gz, src: out/clickhouse.tar.gz |
688 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/switch.tar.gz, src: out/switch-softnpu.tar.gz |
689 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/sled-agent.tar, src: out/omicron-sled-agent.tar |
690 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/internal_dns.tar.gz, src: out/internal-dns.tar.gz |
691 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/clickhouse_keeper.tar.gz, src: out/clickhouse_keeper.tar.gz |
692 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/mg-ddm.tar, src: out/mg-ddm-gz.tar |
693 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/mgs.tar.gz, src: out/omicron-gateway-softnpu.tar.gz |
694 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/propolis-server.tar.gz, src: out/propolis-server.tar.gz |
695 | 2023-12-13T05:12:54.353Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/ntp.tar.gz, src: out/ntp.tar.gz |
696 | 2023-12-13T05:12:54.354Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/crucible.tar.gz, src: out/crucible.tar.gz |
697 | 2023-12-13T05:12:54.355Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/nexus.tar.gz, src: out/omicron-nexus.tar.gz |
698 | 2023-12-13T05:12:54.355Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/overlay.tar.gz, src: out/overlay.tar.gz |
699 | 2023-12-13T05:12:54.355Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/crucible_pantry.tar.gz, src: out/crucible-pantry.tar.gz |
700 | 2023-12-13T05:12:54.355Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/oximeter.tar.gz, src: out/oximeter-collector.tar.gz |
701 | 2023-12-13T05:12:54.355Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/external_dns.tar.gz, src: out/external-dns.tar.gz |
702 | 2023-12-13T05:12:54.355Z | Dec 13 05:12:55.020 INFO Installing service, dst: /opt/oxide/cockroachdb.tar.gz, src: out/cockroachdb.tar.gz |
703 | 2023-12-13T05:12:54.557Z | Dec 13 05:12:55.232 INFO Unpacking service tarball, service_path: /opt/oxide/mg-ddm, tar_path: /opt/oxide/mg-ddm.tar |
704 | 2023-12-13T05:12:54.590Z | Dec 13 05:12:55.266 INFO Unpacking service tarball, service_path: /opt/oxide/sled-agent, tar_path: /opt/oxide/sled-agent.tar |
705 | 2023-12-13T05:12:54.652Z | Dec 13 05:12:55.324 INFO Installing bootstrap service from /opt/oxide/sled-agent/pkg/manifest.xml |
706 | 2023-12-13T05:12:54.779Z | |
707 | 2023-12-13T05:12:54.847Z | real 0.447458579 |
708 | 2023-12-13T05:12:54.847Z | user 0.100179777 |
709 | 2023-12-13T05:12:54.847Z | sys 1.762529179 |
710 | 2023-12-13T05:12:54.847Z | trap 0.000007050 |
711 | 2023-12-13T05:12:54.847Z | tflt 0.000051498 |
712 | 2023-12-13T05:12:54.847Z | dflt 0.000946868 |
713 | 2023-12-13T05:12:54.847Z | kflt 0.000001929 |
714 | 2023-12-13T05:12:54.847Z | lock 40.067924156 |
715 | 2023-12-13T05:12:54.847Z | slp 0.659577898 |
716 | 2023-12-13T05:12:54.848Z | lat 0.003119203 |
717 | 2023-12-13T05:12:54.848Z | stop 0.212059590 |
718 | 2023-12-13T05:12:54.848Z | + retry=0 |
719 | 2023-12-13T05:12:54.848Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
720 | 2023-12-13T05:12:54.848Z | + [[ 0 -gt 30 ]] |
721 | 2023-12-13T05:12:54.848Z | + sleep 1 |
722 | 2023-12-13T05:12:55.793Z | + retry=1 |
723 | 2023-12-13T05:12:55.795Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
724 | 2023-12-13T05:12:55.820Z | + [[ 1 -gt 30 ]] |
725 | 2023-12-13T05:12:55.820Z | + sleep 1 |
726 | 2023-12-13T05:12:56.807Z | + retry=2 |
727 | 2023-12-13T05:12:56.807Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
728 | 2023-12-13T05:12:56.832Z | + [[ 2 -gt 30 ]] |
729 | 2023-12-13T05:12:56.832Z | + sleep 1 |
730 | 2023-12-13T05:12:57.829Z | + retry=3 |
731 | 2023-12-13T05:12:57.829Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
732 | 2023-12-13T05:12:57.858Z | + [[ 3 -gt 30 ]] |
733 | 2023-12-13T05:12:57.858Z | + sleep 1 |
734 | 2023-12-13T05:12:58.837Z | + retry=4 |
735 | 2023-12-13T05:12:58.837Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
736 | 2023-12-13T05:13:24.228Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
737 | 2023-12-13T05:13:24.228Z | local v6: |
738 | 2023-12-13T05:13:24.228Z | fe80::c07f:f5ff:fe43:8887 |
739 | 2023-12-13T05:13:24.228Z | fd00:99::1 |
740 | 2023-12-13T05:13:24.228Z | local v4: |
741 | 2023-12-13T05:13:24.228Z | 10.151.2.174 |
742 | 2023-12-13T05:13:24.228Z | router v6: |
743 | 2023-12-13T05:13:24.228Z | fdb0:18c0:4d0d:a02a::/64 -> fe80::88e0:97ff:fe00:cbc6 (1) |
744 | 2023-12-13T05:13:24.228Z | fd00:1122:3344:1::/64 -> fe80::88e0:97ff:fe00:cbc6 (1) |
745 | 2023-12-13T05:13:24.228Z | fd00:1122:3344:3::/64 -> fe80::88e0:97ff:fe00:cbc6 (1) |
746 | 2023-12-13T05:13:24.228Z | fd00:1122:3344:101::/64 -> fe80::88e0:97ff:fe00:cbc6 (1) |
747 | 2023-12-13T05:13:24.229Z | fd00:1122:3344:2::/64 -> fe80::88e0:97ff:fe00:cbc6 (1) |
748 | 2023-12-13T05:13:24.229Z | router v4_idx: |
749 | 2023-12-13T05:13:24.230Z | 0.0.0.0/0 -> 0 |
750 | 2023-12-13T05:13:24.230Z | router v4_routes: |
751 | 2023-12-13T05:13:24.230Z | 0 -> 10.151.2.100 (2) |
752 | 2023-12-13T05:13:24.230Z | resolver v4: |
753 | 2023-12-13T05:13:24.230Z | 10.151.2.174 -> 96:a8:0e:3c:02:72 |
754 | 2023-12-13T05:13:24.231Z | 10.151.2.100 -> 18:c0:4d:0d:a0:2a |
755 | 2023-12-13T05:13:24.231Z | resolver v6: |
756 | 2023-12-13T05:13:24.231Z | fe80::88e0:97ff:fe00:cbc6 -> 8a:e0:97:00:cb:c6 |
757 | 2023-12-13T05:13:24.231Z | fe80::c07f:f5ff:fe43:8887 -> c2:7f:f5:43:88:87 |
758 | 2023-12-13T05:13:24.231Z | nat v4: |
759 | 2023-12-13T05:13:24.231Z | 10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:a8:2d |
760 | 2023-12-13T05:13:24.231Z | nat_v6: |
761 | 2023-12-13T05:13:24.231Z | port_mac: |
762 | 2023-12-13T05:13:24.262Z | 1000: a8:40:25:51:5e:6f |
763 | 2023-12-13T05:13:24.262Z | 1: a8:40:25:51:5e:70 |
764 | 2023-12-13T05:13:24.262Z | proxy arp: |
765 | 2023-12-13T05:13:24.262Z | 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d |
766 | 2023-12-13T05:13:24.262Z | + retry=0 |
767 | 2023-12-13T05:13:24.262Z | +++ zoneadm list -n |
768 | 2023-12-13T05:13:24.262Z | +++ grep oxz_ntp |
769 | 2023-12-13T05:13:24.262Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
770 | 2023-12-13T05:13:24.262Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
771 | 2023-12-13T05:13:24.262Z | ++ true |
772 | 2023-12-13T05:13:24.262Z | + [[ '' != online ]] |
773 | 2023-12-13T05:13:24.263Z | + [[ 0 -gt 60 ]] |
774 | 2023-12-13T05:13:24.263Z | + sleep 1 |
775 | 2023-12-13T05:13:25.086Z | + retry=1 |
776 | 2023-12-13T05:13:25.124Z | +++ zoneadm list -n |
777 | 2023-12-13T05:13:25.124Z | +++ grep oxz_ntp |
778 | 2023-12-13T05:13:25.124Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
779 | 2023-12-13T05:13:25.124Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
780 | 2023-12-13T05:13:25.124Z | ++ true |
781 | 2023-12-13T05:13:25.124Z | + [[ '' != online ]] |
782 | 2023-12-13T05:13:25.124Z | + [[ 1 -gt 60 ]] |
783 | 2023-12-13T05:13:25.124Z | + sleep 1 |
784 | 2023-12-13T05:13:26.116Z | + retry=2 |
785 | 2023-12-13T05:13:26.148Z | +++ zoneadm list -n |
786 | 2023-12-13T05:13:26.149Z | +++ grep oxz_ntp |
787 | 2023-12-13T05:13:26.149Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
788 | 2023-12-13T05:13:26.149Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
789 | 2023-12-13T05:13:26.149Z | ++ true |
790 | 2023-12-13T05:13:26.149Z | + [[ '' != online ]] |
791 | 2023-12-13T05:13:26.150Z | + [[ 2 -gt 60 ]] |
792 | 2023-12-13T05:13:26.150Z | + sleep 1 |
793 | 2023-12-13T05:13:27.147Z | + retry=3 |
794 | 2023-12-13T05:13:27.174Z | +++ zoneadm list -n |
795 | 2023-12-13T05:13:27.174Z | +++ grep oxz_ntp |
796 | 2023-12-13T05:13:27.175Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
797 | 2023-12-13T05:13:27.175Z | + [[ disabled != online ]] |
798 | 2023-12-13T05:13:27.175Z | + [[ 3 -gt 60 ]] |
799 | 2023-12-13T05:13:27.175Z | + sleep 1 |
800 | 2023-12-13T05:13:28.178Z | + retry=4 |
801 | 2023-12-13T05:13:28.216Z | +++ zoneadm list -n |
802 | 2023-12-13T05:13:28.217Z | +++ grep oxz_ntp |
803 | 2023-12-13T05:13:28.217Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
804 | 2023-12-13T05:13:28.217Z | + [[ disabled != online ]] |
805 | 2023-12-13T05:13:28.217Z | + [[ 4 -gt 60 ]] |
806 | 2023-12-13T05:13:28.218Z | + sleep 1 |
807 | 2023-12-13T05:13:29.198Z | + retry=5 |
808 | 2023-12-13T05:13:29.647Z | +++ zoneadm list -n |
809 | 2023-12-13T05:13:29.647Z | +++ grep oxz_ntp |
810 | 2023-12-13T05:13:29.649Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
811 | 2023-12-13T05:13:29.649Z | + [[ disabled != online ]] |
812 | 2023-12-13T05:13:29.649Z | + [[ 5 -gt 60 ]] |
813 | 2023-12-13T05:13:29.649Z | + sleep 1 |
814 | 2023-12-13T05:13:30.229Z | + retry=6 |
815 | 2023-12-13T05:13:30.724Z | +++ zoneadm list -n |
816 | 2023-12-13T05:13:30.724Z | +++ grep oxz_ntp |
817 | 2023-12-13T05:13:30.725Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
818 | 2023-12-13T05:13:30.725Z | + [[ disabled != online ]] |
819 | 2023-12-13T05:13:30.725Z | + [[ 6 -gt 60 ]] |
820 | 2023-12-13T05:13:30.725Z | + sleep 1 |
821 | 2023-12-13T05:13:31.304Z | + retry=7 |
822 | 2023-12-13T05:13:31.341Z | +++ zoneadm list -n |
823 | 2023-12-13T05:13:31.341Z | +++ grep oxz_ntp |
824 | 2023-12-13T05:13:31.341Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
825 | 2023-12-13T05:13:31.341Z | + [[ disabled != online ]] |
826 | 2023-12-13T05:13:31.342Z | + [[ 7 -gt 60 ]] |
827 | 2023-12-13T05:13:31.342Z | + sleep 1 |
828 | 2023-12-13T05:13:32.262Z | + retry=8 |
829 | 2023-12-13T05:13:32.389Z | +++ zoneadm list -n |
830 | 2023-12-13T05:13:32.389Z | +++ grep oxz_ntp |
831 | 2023-12-13T05:13:32.390Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
832 | 2023-12-13T05:13:32.391Z | + [[ disabled != online ]] |
833 | 2023-12-13T05:13:32.391Z | + [[ 8 -gt 60 ]] |
834 | 2023-12-13T05:13:32.391Z | + sleep 1 |
835 | 2023-12-13T05:13:33.281Z | + retry=9 |
836 | 2023-12-13T05:13:33.310Z | +++ zoneadm list -n |
837 | 2023-12-13T05:13:33.311Z | +++ grep oxz_ntp |
838 | 2023-12-13T05:13:33.311Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
839 | 2023-12-13T05:13:33.312Z | + [[ offline* != online ]] |
840 | 2023-12-13T05:13:33.312Z | + [[ 9 -gt 60 ]] |
841 | 2023-12-13T05:13:33.312Z | + sleep 1 |
|
842 | 2023-12-13T05:13:33.463Z | sock console login: Dec 13 05:13:33 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast |
|
843 | 2023-12-13T05:13:34.304Z | + retry=10 |
844 | 2023-12-13T05:13:34.333Z | +++ zoneadm list -n |
845 | 2023-12-13T05:13:34.334Z | +++ grep oxz_ntp |
846 | 2023-12-13T05:13:34.334Z | ++ pfexec svcs -z oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e -Hostate oxide/ntp |
847 | 2023-12-13T05:13:34.334Z | + [[ online != online ]] |
848 | 2023-12-13T05:13:34.334Z | + echo 'Waited for chrony: 10s' |
849 | 2023-12-13T05:13:34.334Z | Waited for chrony: 10s |
850 | 2023-12-13T05:13:34.334Z | + export RUST_BACKTRACE=1 |
851 | 2023-12-13T05:13:34.335Z | + RUST_BACKTRACE=1 |
852 | 2023-12-13T05:13:34.335Z | + export E2E_TLS_CERT IPPOOL_START IPPOOL_END |
853 | 2023-12-13T05:13:34.335Z | ++ ./tests/bootstrap |
854 | 2023-12-13T05:13:34.360Z | Using external DNS server at 10.151.2.164:53 |
855 | 2023-12-13T05:13:34.360Z | 2023-12-13 05:13:35.025480252 UTC: attempting to log into API |
856 | 2023-12-13T05:13:49.386Z | 2023-12-13 05:13:49.287756074 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
857 | 2023-12-13T05:13:50.387Z | 2023-12-13 05:13:50.288833136 UTC: attempting to log into API |
858 | 2023-12-13T05:14:05.421Z | 2023-12-13 05:14:05.322416408 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
859 | 2023-12-13T05:14:06.422Z | 2023-12-13 05:14:06.323921156 UTC: attempting to log into API |
860 | 2023-12-13T05:14:21.475Z | 2023-12-13 05:14:21.376598462 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
861 | 2023-12-13T05:14:22.485Z | 2023-12-13 05:14:22.378014849 UTC: attempting to log into API |
862 | 2023-12-13T05:14:37.605Z | 2023-12-13 05:14:37.507327845 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
863 | 2023-12-13T05:14:38.610Z | 2023-12-13 05:14:38.508465938 UTC: attempting to log into API |
|
864 | 2023-12-13T05:14:50.470Z | Dec 13 05:14:50 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast |
|
865 | 2023-12-13T05:14:53.638Z | 2023-12-13 05:14:53.563809554 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
866 | 2023-12-13T05:14:54.640Z | 2023-12-13 05:14:54.567567278 UTC: attempting to log into API |
|
867 | 2023-12-13T05:14:57.693Z | Dec 13 05:14:57 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast |
868 | 2023-12-13T05:15:04.375Z | Dec 13 05:15:03 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast |
|
869 | 2023-12-13T05:15:09.673Z | 2023-12-13 05:15:09.641009286 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
|
870 | 2023-12-13T05:15:10.460Z | Dec 13 05:15:10 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast |
|
871 | 2023-12-13T05:15:10.675Z | 2023-12-13 05:15:10.645762524 UTC: attempting to log into API |
|
872 | 2023-12-13T05:15:18.109Z | Dec 13 05:15:17 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast |
|
873 | 2023-12-13T05:15:25.708Z | 2023-12-13 05:15:25.695967367 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
874 | 2023-12-13T05:15:26.710Z | 2023-12-13 05:15:26.697961752 UTC: attempting to log into API |
875 | 2023-12-13T05:15:32.523Z | 2023-12-13 05:15:32.492533339 UTC: login succeeded |
876 | 2023-12-13T05:15:32.549Z | waiting for nexus to come up... |
877 | 2023-12-13T05:15:32.604Z | creating IP pool... 10.151.2.175 - 10.151.2.227 |
878 | 2023-12-13T05:15:32.648Z | ensuring datasets are ready... |
879 | 2023-12-13T05:15:34.965Z | let's roll. |
880 | 2023-12-13T05:15:34.992Z | + eval 'OXIDE_HOST=https://recovery.sys.oxide.test |
881 | 2023-12-13T05:15:34.992Z | OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166 |
882 | 2023-12-13T05:15:34.992Z | OXIDE_TOKEN=oxide-token-c759151e6f172dd7e8e0ba637ed2ea36a18060f2' |
883 | 2023-12-13T05:15:34.992Z | ++ OXIDE_HOST=https://recovery.sys.oxide.test |
884 | 2023-12-13T05:15:34.992Z | ++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166 |
885 | 2023-12-13T05:15:34.992Z | ++ OXIDE_TOKEN=oxide-token-c759151e6f172dd7e8e0ba637ed2ea36a18060f2 |
886 | 2023-12-13T05:15:34.993Z | + export OXIDE_HOST OXIDE_TOKEN |
887 | 2023-12-13T05:15:34.993Z | + retry=0 |
888 | 2023-12-13T05:15:34.993Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
889 | 2023-12-13T05:15:34.993Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
890 | 2023-12-13T05:15:34.993Z | + [[ 0 -gt 60 ]] |
891 | 2023-12-13T05:15:34.993Z | + sleep 1 |
892 | 2023-12-13T05:15:35.993Z | + retry=1 |
893 | 2023-12-13T05:15:35.993Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
894 | 2023-12-13T05:15:36.020Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
895 | 2023-12-13T05:15:36.020Z | + [[ 1 -gt 60 ]] |
896 | 2023-12-13T05:15:36.021Z | + sleep 1 |
897 | 2023-12-13T05:15:37.010Z | + retry=2 |
898 | 2023-12-13T05:15:37.010Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
899 | 2023-12-13T05:15:37.036Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
900 | 2023-12-13T05:15:37.036Z | + [[ 2 -gt 60 ]] |
901 | 2023-12-13T05:15:37.036Z | + sleep 1 |
902 | 2023-12-13T05:15:38.025Z | + retry=3 |
903 | 2023-12-13T05:15:38.025Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
904 | 2023-12-13T05:15:38.051Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
905 | 2023-12-13T05:15:38.051Z | + [[ 3 -gt 60 ]] |
906 | 2023-12-13T05:15:38.051Z | + sleep 1 |
907 | 2023-12-13T05:15:39.041Z | + retry=4 |
908 | 2023-12-13T05:15:39.042Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
909 | 2023-12-13T05:15:39.067Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
910 | 2023-12-13T05:15:39.068Z | + [[ 4 -gt 60 ]] |
911 | 2023-12-13T05:15:39.068Z | + sleep 1 |
912 | 2023-12-13T05:15:40.059Z | + retry=5 |
913 | 2023-12-13T05:15:40.059Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
914 | 2023-12-13T05:15:40.090Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
915 | 2023-12-13T05:15:40.090Z | + [[ 5 -gt 60 ]] |
916 | 2023-12-13T05:15:40.090Z | + sleep 1 |
917 | 2023-12-13T05:15:41.075Z | + retry=6 |
918 | 2023-12-13T05:15:41.075Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
919 | 2023-12-13T05:15:41.100Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
920 | 2023-12-13T05:15:41.100Z | + [[ 6 -gt 60 ]] |
921 | 2023-12-13T05:15:41.101Z | + sleep 1 |
922 | 2023-12-13T05:15:42.089Z | + retry=7 |
923 | 2023-12-13T05:15:42.089Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
924 | 2023-12-13T05:15:42.114Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
925 | 2023-12-13T05:15:42.114Z | + [[ 7 -gt 60 ]] |
926 | 2023-12-13T05:15:42.114Z | + sleep 1 |
927 | 2023-12-13T05:15:43.105Z | + retry=8 |
928 | 2023-12-13T05:15:43.105Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
929 | 2023-12-13T05:15:43.130Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
930 | 2023-12-13T05:15:43.131Z | + [[ 8 -gt 60 ]] |
931 | 2023-12-13T05:15:43.131Z | + sleep 1 |
932 | 2023-12-13T05:15:44.121Z | + retry=9 |
933 | 2023-12-13T05:15:44.121Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
934 | 2023-12-13T05:15:44.146Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
935 | 2023-12-13T05:15:44.146Z | + [[ 9 -gt 60 ]] |
936 | 2023-12-13T05:15:44.147Z | + sleep 1 |
937 | 2023-12-13T05:15:45.137Z | + retry=10 |
938 | 2023-12-13T05:15:45.137Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
939 | 2023-12-13T05:15:45.162Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
940 | 2023-12-13T05:15:45.162Z | + [[ 10 -gt 60 ]] |
941 | 2023-12-13T05:15:45.162Z | + sleep 1 |
942 | 2023-12-13T05:15:46.152Z | + retry=11 |
943 | 2023-12-13T05:15:46.152Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
944 | 2023-12-13T05:15:46.177Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
945 | 2023-12-13T05:15:46.177Z | + [[ 11 -gt 60 ]] |
946 | 2023-12-13T05:15:46.177Z | + sleep 1 |
947 | 2023-12-13T05:15:47.169Z | + retry=12 |
948 | 2023-12-13T05:15:47.169Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
949 | 2023-12-13T05:15:47.195Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
950 | 2023-12-13T05:15:47.195Z | + [[ 12 -gt 60 ]] |
951 | 2023-12-13T05:15:47.195Z | + sleep 1 |
952 | 2023-12-13T05:15:48.185Z | + retry=13 |
953 | 2023-12-13T05:15:48.186Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
954 | 2023-12-13T05:15:48.211Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
955 | 2023-12-13T05:15:48.212Z | + [[ 13 -gt 60 ]] |
956 | 2023-12-13T05:15:48.212Z | + sleep 1 |
957 | 2023-12-13T05:15:49.216Z | + retry=14 |
958 | 2023-12-13T05:15:49.217Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
959 | 2023-12-13T05:15:49.243Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
960 | 2023-12-13T05:15:49.243Z | + [[ 14 -gt 60 ]] |
961 | 2023-12-13T05:15:49.243Z | + sleep 1 |
962 | 2023-12-13T05:15:50.245Z | + retry=15 |
963 | 2023-12-13T05:15:50.245Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
964 | 2023-12-13T05:15:50.273Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
965 | 2023-12-13T05:15:50.273Z | + [[ 15 -gt 60 ]] |
966 | 2023-12-13T05:15:50.273Z | + sleep 1 |
967 | 2023-12-13T05:15:51.233Z | + retry=16 |
968 | 2023-12-13T05:15:51.233Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
969 | 2023-12-13T05:15:51.278Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
970 | 2023-12-13T05:15:51.279Z | + [[ 16 -gt 60 ]] |
971 | 2023-12-13T05:15:51.279Z | + sleep 1 |
972 | 2023-12-13T05:15:52.249Z | + retry=17 |
973 | 2023-12-13T05:15:52.249Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
974 | 2023-12-13T05:15:52.275Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
975 | 2023-12-13T05:15:52.275Z | + [[ 17 -gt 60 ]] |
976 | 2023-12-13T05:15:52.275Z | + sleep 1 |
977 | 2023-12-13T05:15:53.264Z | + retry=18 |
978 | 2023-12-13T05:15:53.289Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
979 | 2023-12-13T05:15:53.289Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
980 | 2023-12-13T05:15:53.289Z | + [[ 18 -gt 60 ]] |
981 | 2023-12-13T05:15:53.289Z | + sleep 1 |
982 | 2023-12-13T05:15:54.281Z | + retry=19 |
983 | 2023-12-13T05:15:54.281Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
984 | 2023-12-13T05:15:54.308Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
985 | 2023-12-13T05:15:54.308Z | + [[ 19 -gt 60 ]] |
986 | 2023-12-13T05:15:54.308Z | + sleep 1 |
987 | 2023-12-13T05:15:55.297Z | + retry=20 |
988 | 2023-12-13T05:15:55.297Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
989 | 2023-12-13T05:15:55.323Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
990 | 2023-12-13T05:15:55.323Z | + [[ 20 -gt 60 ]] |
991 | 2023-12-13T05:15:55.323Z | + sleep 1 |
992 | 2023-12-13T05:15:56.326Z | + retry=21 |
993 | 2023-12-13T05:15:56.326Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
994 | 2023-12-13T05:15:56.351Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
995 | 2023-12-13T05:15:56.351Z | + [[ 21 -gt 60 ]] |
996 | 2023-12-13T05:15:56.352Z | + sleep 1 |
997 | 2023-12-13T05:15:57.329Z | + retry=22 |
998 | 2023-12-13T05:15:57.329Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
999 | 2023-12-13T05:15:57.407Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1000 | 2023-12-13T05:15:57.407Z | + [[ 22 -gt 60 ]] |
1001 | 2023-12-13T05:15:57.407Z | + sleep 1 |
1002 | 2023-12-13T05:15:58.346Z | + retry=23 |
1003 | 2023-12-13T05:15:58.346Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1004 | 2023-12-13T05:15:58.371Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1005 | 2023-12-13T05:15:58.371Z | + [[ 23 -gt 60 ]] |
1006 | 2023-12-13T05:15:58.371Z | + sleep 1 |
1007 | 2023-12-13T05:15:59.363Z | + retry=24 |
1008 | 2023-12-13T05:15:59.363Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1009 | 2023-12-13T05:15:59.388Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1010 | 2023-12-13T05:15:59.388Z | + [[ 24 -gt 60 ]] |
1011 | 2023-12-13T05:15:59.388Z | + sleep 1 |
1012 | 2023-12-13T05:16:00.381Z | + retry=25 |
1013 | 2023-12-13T05:16:00.381Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1014 | 2023-12-13T05:16:00.410Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1015 | 2023-12-13T05:16:00.410Z | + [[ 25 -gt 60 ]] |
1016 | 2023-12-13T05:16:00.410Z | + sleep 1 |
1017 | 2023-12-13T05:16:01.397Z | + retry=26 |
1018 | 2023-12-13T05:16:01.397Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1019 | 2023-12-13T05:16:01.422Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1020 | 2023-12-13T05:16:01.422Z | + [[ 26 -gt 60 ]] |
1021 | 2023-12-13T05:16:01.422Z | + sleep 1 |
1022 | 2023-12-13T05:16:02.414Z | + retry=27 |
1023 | 2023-12-13T05:16:02.414Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1024 | 2023-12-13T05:16:02.439Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1025 | 2023-12-13T05:16:02.439Z | + [[ 27 -gt 60 ]] |
1026 | 2023-12-13T05:16:02.439Z | + sleep 1 |
1027 | 2023-12-13T05:16:03.432Z | + retry=28 |
1028 | 2023-12-13T05:16:03.432Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1029 | 2023-12-13T05:16:03.457Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1030 | 2023-12-13T05:16:03.457Z | + [[ 28 -gt 60 ]] |
1031 | 2023-12-13T05:16:03.458Z | + sleep 1 |
1032 | 2023-12-13T05:16:04.448Z | + retry=29 |
1033 | 2023-12-13T05:16:04.449Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1034 | 2023-12-13T05:16:04.473Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1035 | 2023-12-13T05:16:04.473Z | + [[ 29 -gt 60 ]] |
1036 | 2023-12-13T05:16:04.474Z | + sleep 1 |
1037 | 2023-12-13T05:16:05.472Z | + retry=30 |
1038 | 2023-12-13T05:16:05.472Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1039 | 2023-12-13T05:16:05.500Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1040 | 2023-12-13T05:16:05.500Z | + [[ 30 -gt 60 ]] |
1041 | 2023-12-13T05:16:05.500Z | + sleep 1 |
1042 | 2023-12-13T05:16:06.481Z | + retry=31 |
1043 | 2023-12-13T05:16:06.481Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1044 | 2023-12-13T05:16:06.506Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1045 | 2023-12-13T05:16:06.506Z | + [[ 31 -gt 60 ]] |
1046 | 2023-12-13T05:16:06.506Z | + sleep 1 |
1047 | 2023-12-13T05:16:07.497Z | + retry=32 |
1048 | 2023-12-13T05:16:07.521Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1049 | 2023-12-13T05:16:07.522Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1050 | 2023-12-13T05:16:07.522Z | + [[ 32 -gt 60 ]] |
1051 | 2023-12-13T05:16:07.522Z | + sleep 1 |
1052 | 2023-12-13T05:16:08.514Z | + retry=33 |
1053 | 2023-12-13T05:16:08.514Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1054 | 2023-12-13T05:16:08.539Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1055 | 2023-12-13T05:16:08.539Z | + [[ 33 -gt 60 ]] |
1056 | 2023-12-13T05:16:08.539Z | + sleep 1 |
1057 | 2023-12-13T05:16:09.530Z | + retry=34 |
1058 | 2023-12-13T05:16:09.530Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1059 | 2023-12-13T05:16:09.557Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1060 | 2023-12-13T05:16:09.557Z | + [[ 34 -gt 60 ]] |
1061 | 2023-12-13T05:16:09.557Z | + sleep 1 |
1062 | 2023-12-13T05:16:10.549Z | + retry=35 |
1063 | 2023-12-13T05:16:10.550Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1064 | 2023-12-13T05:16:10.577Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1065 | 2023-12-13T05:16:10.577Z | + [[ 35 -gt 60 ]] |
1066 | 2023-12-13T05:16:10.577Z | + sleep 1 |
1067 | 2023-12-13T05:16:11.564Z | + retry=36 |
1068 | 2023-12-13T05:16:11.564Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1069 | 2023-12-13T05:16:11.588Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1070 | 2023-12-13T05:16:11.589Z | + [[ 36 -gt 60 ]] |
1071 | 2023-12-13T05:16:11.589Z | + sleep 1 |
1072 | 2023-12-13T05:16:12.580Z | + retry=37 |
1073 | 2023-12-13T05:16:12.581Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1074 | 2023-12-13T05:16:12.673Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1075 | 2023-12-13T05:16:12.673Z | + [[ 37 -gt 60 ]] |
1076 | 2023-12-13T05:16:12.673Z | + sleep 1 |
1077 | 2023-12-13T05:16:13.598Z | + retry=38 |
1078 | 2023-12-13T05:16:13.626Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1079 | 2023-12-13T05:16:13.626Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1080 | 2023-12-13T05:16:13.626Z | + [[ 38 -gt 60 ]] |
1081 | 2023-12-13T05:16:13.626Z | + sleep 1 |
1082 | 2023-12-13T05:16:14.614Z | + retry=39 |
1083 | 2023-12-13T05:16:14.614Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1084 | 2023-12-13T05:16:14.638Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1085 | 2023-12-13T05:16:14.639Z | + [[ 39 -gt 60 ]] |
1086 | 2023-12-13T05:16:14.639Z | + sleep 1 |
1087 | 2023-12-13T05:16:15.630Z | + retry=40 |
1088 | 2023-12-13T05:16:15.630Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1089 | 2023-12-13T05:16:15.655Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1090 | 2023-12-13T05:16:15.656Z | + [[ 40 -gt 60 ]] |
1091 | 2023-12-13T05:16:15.656Z | + sleep 1 |
1092 | 2023-12-13T05:16:16.648Z | + retry=41 |
1093 | 2023-12-13T05:16:16.648Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1094 | 2023-12-13T05:16:16.674Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1095 | 2023-12-13T05:16:16.674Z | + [[ 41 -gt 60 ]] |
1096 | 2023-12-13T05:16:16.676Z | + sleep 1 |
1097 | 2023-12-13T05:16:17.666Z | + retry=42 |
1098 | 2023-12-13T05:16:17.668Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1099 | 2023-12-13T05:16:17.692Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1100 | 2023-12-13T05:16:17.692Z | + [[ 42 -gt 60 ]] |
1101 | 2023-12-13T05:16:17.692Z | + sleep 1 |
1102 | 2023-12-13T05:16:18.683Z | + retry=43 |
1103 | 2023-12-13T05:16:18.683Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1104 | 2023-12-13T05:16:18.707Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1105 | 2023-12-13T05:16:18.707Z | + [[ 43 -gt 60 ]] |
1106 | 2023-12-13T05:16:18.707Z | + sleep 1 |
1107 | 2023-12-13T05:16:19.700Z | + retry=44 |
1108 | 2023-12-13T05:16:19.700Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1109 | 2023-12-13T05:16:19.785Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images' |
1110 | 2023-12-13T05:16:20.268Z | {"status":"ok"}success |
1111 | 2023-12-13T05:16:20.268Z | Project { |
1112 | 2023-12-13T05:16:20.268Z | description: "some images", |
1113 | 2023-12-13T05:16:20.268Z | id: ff72cde7-b9a7-435a-b620-dea2af28a6bf, |
1114 | 2023-12-13T05:16:20.293Z | name: Name( |
1115 | 2023-12-13T05:16:20.293Z | "images", |
1116 | 2023-12-13T05:16:20.293Z | ), |
1117 | 2023-12-13T05:16:20.293Z | time_created: 2023-12-13T05:16:19.885023Z, |
1118 | 2023-12-13T05:16:20.293Z | time_modified: 2023-12-13T05:16:19.885023Z, |
1119 | 2023-12-13T05:16:20.293Z | } |
1120 | 2023-12-13T05:16:20.293Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 |
1121 | 2023-12-13T05:21:45.883Z | done! |
1122 | 2023-12-13T05:21:45.988Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11 |
1123 | 2023-12-13T05:21:46.096Z | success |
1124 | 2023-12-13T05:21:46.096Z | Image { |
1125 | 2023-12-13T05:21:46.120Z | block_size: ByteCount( |
1126 | 2023-12-13T05:21:46.121Z | 512, |
1127 | 2023-12-13T05:21:46.121Z | ), |
1128 | 2023-12-13T05:21:46.121Z | description: "debian 11 original base image", |
1129 | 2023-12-13T05:21:46.121Z | digest: None, |
1130 | 2023-12-13T05:21:46.121Z | id: 59eca61b-2d5b-4c36-91aa-a79a385ce4b5, |
1131 | 2023-12-13T05:21:46.121Z | name: Name( |
1132 | 2023-12-13T05:21:46.121Z | "debian11", |
1133 | 2023-12-13T05:21:46.121Z | ), |
1134 | 2023-12-13T05:21:46.121Z | os: "debian", |
1135 | 2023-12-13T05:21:46.121Z | project_id: None, |
1136 | 2023-12-13T05:21:46.121Z | size: ByteCount( |
1137 | 2023-12-13T05:21:46.121Z | 2147483648, |
1138 | 2023-12-13T05:21:46.121Z | ), |
1139 | 2023-12-13T05:21:46.121Z | time_created: 2023-12-13T05:21:45.809041Z, |
1140 | 2023-12-13T05:21:46.121Z | time_modified: 2023-12-13T05:21:46.067328Z, |
1141 | 2023-12-13T05:21:46.121Z | url: None, |
1142 | 2023-12-13T05:21:46.121Z | version: "11", |
1143 | 2023-12-13T05:21:46.121Z | } |
1144 | 2023-12-13T05:21:46.121Z | + rm ./tests/bootstrap |
1145 | 2023-12-13T05:21:46.156Z | + for test_bin in tests/* |
1146 | 2023-12-13T05:21:46.157Z | + ./tests/bootstrap-cc02af252c51050b |
1147 | 2023-12-13T05:21:46.183Z | |
1148 | 2023-12-13T05:21:46.183Z | running 0 tests |
1149 | 2023-12-13T05:21:46.183Z | |
1150 | 2023-12-13T05:21:46.183Z | test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s |
1151 | 2023-12-13T05:21:46.183Z | |
1152 | 2023-12-13T05:21:46.184Z | + for test_bin in tests/* |
1153 | 2023-12-13T05:21:46.184Z | + ./tests/end_to_end_tests-c0f56f9124e0823c |
1154 | 2023-12-13T05:21:46.215Z | |
1155 | 2023-12-13T05:21:46.215Z | running 2 tests |
1156 | 2023-12-13T05:21:46.411Z | test no_spoof::no_spoof_here ... ok |
1157 | 2023-12-13T05:22:22.067Z | test instance_launch::instance_launch ... ok |
1158 | 2023-12-13T05:22:22.067Z | |
1159 | 2023-12-13T05:22:22.067Z | test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 35.88s |
1160 | 2023-12-13T05:22:22.069Z | |
1161 | 2023-12-13T05:22:22.093Z | + _exit_trap |
1162 | 2023-12-13T05:22:22.093Z | + local status=0 |
1163 | 2023-12-13T05:22:22.094Z | + [[ 0 -eq 0 ]] |
1164 | 2023-12-13T05:22:22.094Z | + exit 0 |
1165 | 2023-12-13T05:22:22.094Z | process exited: duration 627144 ms, exit code 0 |
|
1166 | 2023-12-13T05:22:22.725Z | found 93 output files |
1167 | 2023-12-13T05:22:22.725Z | uploading: /var/svc/log/oxide-sled-agent:default.log (698307 bytes) |
1168 | 2023-12-13T05:22:24.898Z | uploaded: /var/svc/log/oxide-sled-agent:default.log |
1169 | 2023-12-13T05:22:24.898Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_60a7bc03-7bcd-431b-b092-e5c0d502d872/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1170 | 2023-12-13T05:22:25.968Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_60a7bc03-7bcd-431b-b092-e5c0d502d872/root/var/svc/log/oxide-cockroachdb:default.log |
1171 | 2023-12-13T05:22:25.993Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_60a7bc03-7bcd-431b-b092-e5c0d502d872/root/var/svc/log/oxide-cockroachdb:default.log.0 (5413 bytes) |
1172 | 2023-12-13T05:22:27.065Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_60a7bc03-7bcd-431b-b092-e5c0d502d872/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1173 | 2023-12-13T05:22:27.065Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-agent:default.log (21390 bytes) |
1174 | 2023-12-13T05:22:28.638Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-agent:default.log |
1175 | 2023-12-13T05:22:28.639Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1176 | 2023-12-13T05:22:29.737Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1177 | 2023-12-13T05:22:29.737Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1178 | 2023-12-13T05:22:30.815Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-downstairs:default.log |
1179 | 2023-12-13T05:22:30.815Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1180 | 2023-12-13T05:22:32.327Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1181 | 2023-12-13T05:22:32.327Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-downstairs:downstairs-176c0386-48db-48dc-b7e3-e0091c2eaa8c.log (5515 bytes) |
1182 | 2023-12-13T05:22:33.446Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-downstairs:downstairs-176c0386-48db-48dc-b7e3-e0091c2eaa8c.log |
1183 | 2023-12-13T05:22:33.446Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-downstairs:downstairs-25430967-e481-4332-9520-984fdffbd590.log (3038 bytes) |
1184 | 2023-12-13T05:22:34.547Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_160c3ac4-6b7d-494d-a36e-209ce3657189/root/var/svc/log/oxide-crucible-downstairs:downstairs-25430967-e481-4332-9520-984fdffbd590.log |
1185 | 2023-12-13T05:22:34.547Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10ae3a76-668f-4e88-b9f8-2597600c8207/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1186 | 2023-12-13T05:22:35.625Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10ae3a76-668f-4e88-b9f8-2597600c8207/root/var/svc/log/oxide-cockroachdb:default.log |
1187 | 2023-12-13T05:22:35.626Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10ae3a76-668f-4e88-b9f8-2597600c8207/root/var/svc/log/oxide-cockroachdb:default.log.0 (5386 bytes) |
1188 | 2023-12-13T05:22:36.718Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_10ae3a76-668f-4e88-b9f8-2597600c8207/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1189 | 2023-12-13T05:22:36.720Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_b084062d-0cec-4924-9778-1d4993e7e774/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1190 | 2023-12-13T05:22:37.789Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_b084062d-0cec-4924-9778-1d4993e7e774/root/var/svc/log/oxide-cockroachdb:default.log |
1191 | 2023-12-13T05:22:37.796Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_b084062d-0cec-4924-9778-1d4993e7e774/root/var/svc/log/oxide-cockroachdb:default.log.0 (5412 bytes) |
1192 | 2023-12-13T05:22:38.884Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_b084062d-0cec-4924-9778-1d4993e7e774/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1193 | 2023-12-13T05:22:38.884Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-agent:default.log (6358 bytes) |
1194 | 2023-12-13T05:22:40.007Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-agent:default.log |
1195 | 2023-12-13T05:22:40.007Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1196 | 2023-12-13T05:22:41.108Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1197 | 2023-12-13T05:22:41.108Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1198 | 2023-12-13T05:22:42.179Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-downstairs:default.log |
1199 | 2023-12-13T05:22:42.180Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1200 | 2023-12-13T05:22:43.272Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1201 | 2023-12-13T05:22:43.272Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-downstairs:downstairs-274dcaf4-70d4-438f-839e-d3b932665eed.log (2933 bytes) |
1202 | 2023-12-13T05:22:44.774Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_7157960a-b632-46cb-9291-e492c7092911/root/var/svc/log/oxide-crucible-downstairs:downstairs-274dcaf4-70d4-438f-839e-d3b932665eed.log |
1203 | 2023-12-13T05:22:44.774Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-agent:default.log (16607 bytes) |
1204 | 2023-12-13T05:22:46.381Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-agent:default.log |
1205 | 2023-12-13T05:22:46.381Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1206 | 2023-12-13T05:22:47.483Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1207 | 2023-12-13T05:22:47.484Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1208 | 2023-12-13T05:22:48.556Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-downstairs:default.log |
1209 | 2023-12-13T05:22:48.580Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1210 | 2023-12-13T05:22:49.707Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1211 | 2023-12-13T05:22:49.745Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-downstairs:downstairs-76898057-416e-4efe-9d0a-c1bc6d4bb799.log (5515 bytes) |
1212 | 2023-12-13T05:22:50.847Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-downstairs:downstairs-76898057-416e-4efe-9d0a-c1bc6d4bb799.log |
1213 | 2023-12-13T05:22:50.848Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-downstairs:downstairs-f0aa0671-4fa1-4375-aa74-1402ccc7b285.log (2932 bytes) |
1214 | 2023-12-13T05:22:51.953Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_e07445e9-2d22-48ee-9bc3-3ebfe83e423d/root/var/svc/log/oxide-crucible-downstairs:downstairs-f0aa0671-4fa1-4375-aa74-1402ccc7b285.log |
1215 | 2023-12-13T05:22:51.954Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_2725327c-6f52-48ab-b165-6a8f9f4945bd/root/var/svc/log/oxide-crucible-pantry:default.log (1222737 bytes) |
1216 | 2023-12-13T05:22:54.754Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_2725327c-6f52-48ab-b165-6a8f9f4945bd/root/var/svc/log/oxide-crucible-pantry:default.log |
1217 | 2023-12-13T05:22:54.754Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_2725327c-6f52-48ab-b165-6a8f9f4945bd/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2333 bytes) |
1218 | 2023-12-13T05:22:58.463Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_2725327c-6f52-48ab-b165-6a8f9f4945bd/root/var/svc/log/oxide-crucible-pantry:default.log.0 |
1219 | 2023-12-13T05:22:58.463Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_9df1ae5d-663b-47e8-a5d9-32b405dbe239/root/var/svc/log/oxide-nexus:default.log (33960780 bytes) |
1220 | 2023-12-13T05:23:10.533Z | upload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_9df1ae5d-663b-47e8-a5d9-32b405dbe239/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 33960780 -> 33968866 |
1221 | 2023-12-13T05:23:11.615Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_9df1ae5d-663b-47e8-a5d9-32b405dbe239/root/var/svc/log/oxide-nexus:default.log |
1222 | 2023-12-13T05:23:11.615Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_9df1ae5d-663b-47e8-a5d9-32b405dbe239/root/var/svc/log/oxide-nexus:default.log.0 (120 bytes) |
1223 | 2023-12-13T05:23:12.711Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_9df1ae5d-663b-47e8-a5d9-32b405dbe239/root/var/svc/log/oxide-nexus:default.log.0 |
1224 | 2023-12-13T05:23:12.711Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_dc8b0170-d0cb-407a-a361-7dd0dffdc2ee/root/var/svc/log/oxide-nexus:default.log (805445 bytes) |
1225 | 2023-12-13T05:23:13.379Z | upload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_dc8b0170-d0cb-407a-a361-7dd0dffdc2ee/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 805445 -> 813529 |
1226 | 2023-12-13T05:23:14.468Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_dc8b0170-d0cb-407a-a361-7dd0dffdc2ee/root/var/svc/log/oxide-nexus:default.log |
1227 | 2023-12-13T05:23:14.468Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_dc8b0170-d0cb-407a-a361-7dd0dffdc2ee/root/var/svc/log/oxide-nexus:default.log.0 (75 bytes) |
1228 | 2023-12-13T05:23:15.562Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_nexus_dc8b0170-d0cb-407a-a361-7dd0dffdc2ee/root/var/svc/log/oxide-nexus:default.log.0 |
1229 | 2023-12-13T05:23:15.562Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_6e958392-bbd9-4833-88f1-9698aeb350be/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1230 | 2023-12-13T05:23:16.632Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_6e958392-bbd9-4833-88f1-9698aeb350be/root/var/svc/log/oxide-cockroachdb:default.log |
1231 | 2023-12-13T05:23:16.632Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_6e958392-bbd9-4833-88f1-9698aeb350be/root/var/svc/log/oxide-cockroachdb:default.log.0 (5412 bytes) |
1232 | 2023-12-13T05:23:17.730Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_6e958392-bbd9-4833-88f1-9698aeb350be/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1233 | 2023-12-13T05:23:17.731Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_32e75302-03fb-4e17-8356-44b2cd27d525/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes) |
1234 | 2023-12-13T05:23:18.800Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_32e75302-03fb-4e17-8356-44b2cd27d525/root/var/svc/log/oxide-crucible-pantry:default.log |
1235 | 2023-12-13T05:23:18.801Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_32e75302-03fb-4e17-8356-44b2cd27d525/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes) |
1236 | 2023-12-13T05:23:19.891Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_32e75302-03fb-4e17-8356-44b2cd27d525/root/var/svc/log/oxide-crucible-pantry:default.log.0 |
1237 | 2023-12-13T05:23:19.891Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_cockroachdb_424b4534-e78a-4876-8feb-74b9789416d8/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1238 | 2023-12-13T05:23:20.962Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_cockroachdb_424b4534-e78a-4876-8feb-74b9789416d8/root/var/svc/log/oxide-cockroachdb:default.log |
1239 | 2023-12-13T05:23:20.963Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_cockroachdb_424b4534-e78a-4876-8feb-74b9789416d8/root/var/svc/log/oxide-cockroachdb:default.log.0 (5413 bytes) |
1240 | 2023-12-13T05:23:22.058Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_cockroachdb_424b4534-e78a-4876-8feb-74b9789416d8/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1241 | 2023-12-13T05:23:22.058Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-agent:default.log (10719 bytes) |
1242 | 2023-12-13T05:23:23.196Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-agent:default.log |
1243 | 2023-12-13T05:23:23.196Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1244 | 2023-12-13T05:23:24.716Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1245 | 2023-12-13T05:23:24.716Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1246 | 2023-12-13T05:23:26.194Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-downstairs:default.log |
1247 | 2023-12-13T05:23:26.194Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1248 | 2023-12-13T05:23:27.290Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1249 | 2023-12-13T05:23:27.316Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-downstairs:downstairs-01b41390-a0d3-43d1-8278-334f1e02aceb.log (3038 bytes) |
1250 | 2023-12-13T05:23:29.443Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_1bccd775-a5cd-49c3-bd84-00d0dab2f7ef/root/var/svc/log/oxide-crucible-downstairs:downstairs-01b41390-a0d3-43d1-8278-334f1e02aceb.log |
1251 | 2023-12-13T05:23:29.443Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-agent:default.log (6358 bytes) |
1252 | 2023-12-13T05:23:30.547Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-agent:default.log |
1253 | 2023-12-13T05:23:30.573Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-agent:default.log.0 (3434 bytes) |
1254 | 2023-12-13T05:23:31.665Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1255 | 2023-12-13T05:23:31.665Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1256 | 2023-12-13T05:23:32.736Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-downstairs:default.log |
1257 | 2023-12-13T05:23:32.736Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1258 | 2023-12-13T05:23:33.828Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1259 | 2023-12-13T05:23:33.828Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-ed833262-fbcc-424b-bd31-ce63911ef6c8.log (2929 bytes) |
1260 | 2023-12-13T05:23:34.924Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_cfe1623b-deb5-4bb2-ad1e-333e71bc87fb/root/var/svc/log/oxide-crucible-downstairs:downstairs-ed833262-fbcc-424b-bd31-ce63911ef6c8.log |
1261 | 2023-12-13T05:23:34.925Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_d5fa1d13-03d4-4377-bd02-a397af6d145f/root/var/svc/log/oxide-internal_dns:default.log (27543 bytes) |
1262 | 2023-12-13T05:23:35.038Z | upload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_d5fa1d13-03d4-4377-bd02-a397af6d145f/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27543 -> 31295 |
1263 | 2023-12-13T05:23:36.111Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_d5fa1d13-03d4-4377-bd02-a397af6d145f/root/var/svc/log/oxide-internal_dns:default.log |
1264 | 2023-12-13T05:23:36.112Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_d5fa1d13-03d4-4377-bd02-a397af6d145f/root/var/svc/log/oxide-internal_dns:default.log.0 (100445 bytes) |
1265 | 2023-12-13T05:23:37.318Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_d5fa1d13-03d4-4377-bd02-a397af6d145f/root/var/svc/log/oxide-internal_dns:default.log.0 |
1266 | 2023-12-13T05:23:37.318Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_clickhouse_f87ee328-6a8a-4b2d-9e67-97495dd78de0/root/var/svc/log/oxide-clickhouse:default.log (651008 bytes) |
1267 | 2023-12-13T05:23:37.596Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_clickhouse_f87ee328-6a8a-4b2d-9e67-97495dd78de0/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 651008 -> 765018 |
1268 | 2023-12-13T05:23:38.673Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_clickhouse_f87ee328-6a8a-4b2d-9e67-97495dd78de0/root/var/svc/log/oxide-clickhouse:default.log |
1269 | 2023-12-13T05:23:38.674Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_clickhouse_f87ee328-6a8a-4b2d-9e67-97495dd78de0/root/var/svc/log/oxide-clickhouse:default.log.0 (129730 bytes) |
1270 | 2023-12-13T05:23:39.966Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_clickhouse_f87ee328-6a8a-4b2d-9e67-97495dd78de0/root/var/svc/log/oxide-clickhouse:default.log.0 |
1271 | 2023-12-13T05:23:39.966Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-agent:default.log (14114 bytes) |
1272 | 2023-12-13T05:23:41.083Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-agent:default.log |
1273 | 2023-12-13T05:23:41.084Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1274 | 2023-12-13T05:23:42.644Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1275 | 2023-12-13T05:23:42.644Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1276 | 2023-12-13T05:23:43.719Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-downstairs:default.log |
1277 | 2023-12-13T05:23:43.719Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1278 | 2023-12-13T05:23:44.812Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1279 | 2023-12-13T05:23:44.814Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-downstairs:downstairs-c712842d-07e1-4f09-8808-120b6145df2e.log (6408 bytes) |
1280 | 2023-12-13T05:23:45.928Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-downstairs:downstairs-c712842d-07e1-4f09-8808-120b6145df2e.log |
1281 | 2023-12-13T05:23:45.928Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-downstairs:snapshot-c712842d-07e1-4f09-8808-120b6145df2e-8b254072-f4b4-466e-b1a6-8c3feab28c95.log (5156 bytes) |
1282 | 2023-12-13T05:23:47.047Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_30567c02-bab2-4f33-aae7-10e756deafff/root/var/svc/log/oxide-crucible-downstairs:snapshot-c712842d-07e1-4f09-8808-120b6145df2e-8b254072-f4b4-466e-b1a6-8c3feab28c95.log |
1283 | 2023-12-13T05:23:47.047Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_external_dns_bc7f3216-ef4b-4f2d-9f42-d8cde8af038b/root/var/svc/log/oxide-external_dns:default.log (28152 bytes) |
1284 | 2023-12-13T05:23:47.224Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_external_dns_bc7f3216-ef4b-4f2d-9f42-d8cde8af038b/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 28152 -> 31925 |
1285 | 2023-12-13T05:23:48.293Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_external_dns_bc7f3216-ef4b-4f2d-9f42-d8cde8af038b/root/var/svc/log/oxide-external_dns:default.log |
1286 | 2023-12-13T05:23:48.293Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_external_dns_bc7f3216-ef4b-4f2d-9f42-d8cde8af038b/root/var/svc/log/oxide-external_dns:default.log.0 (2554 bytes) |
1287 | 2023-12-13T05:23:49.391Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_external_dns_bc7f3216-ef4b-4f2d-9f42-d8cde8af038b/root/var/svc/log/oxide-external_dns:default.log.0 |
1288 | 2023-12-13T05:23:49.416Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/svc/log/oxide-ntp:default.log (66 bytes) |
1289 | 2023-12-13T05:23:50.487Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/svc/log/oxide-ntp:default.log |
1290 | 2023-12-13T05:23:50.487Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/svc/log/oxide-ntp:default.log.0 (982 bytes) |
1291 | 2023-12-13T05:23:51.590Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/svc/log/oxide-ntp:default.log.0 |
1292 | 2023-12-13T05:23:51.591Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31fa899e-2c91-47bf-8b75-f3e8976d6cf2/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes) |
1293 | 2023-12-13T05:23:52.663Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31fa899e-2c91-47bf-8b75-f3e8976d6cf2/root/var/svc/log/oxide-crucible-agent:default.log |
1294 | 2023-12-13T05:23:52.663Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31fa899e-2c91-47bf-8b75-f3e8976d6cf2/root/var/svc/log/oxide-crucible-agent:default.log.0 (3434 bytes) |
1295 | 2023-12-13T05:23:53.757Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31fa899e-2c91-47bf-8b75-f3e8976d6cf2/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1296 | 2023-12-13T05:23:53.757Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31fa899e-2c91-47bf-8b75-f3e8976d6cf2/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1297 | 2023-12-13T05:23:54.830Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31fa899e-2c91-47bf-8b75-f3e8976d6cf2/root/var/svc/log/oxide-crucible-downstairs:default.log |
1298 | 2023-12-13T05:23:54.830Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31fa899e-2c91-47bf-8b75-f3e8976d6cf2/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1299 | 2023-12-13T05:23:55.927Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31fa899e-2c91-47bf-8b75-f3e8976d6cf2/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1300 | 2023-12-13T05:23:55.928Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-agent:default.log (34184 bytes) |
1301 | 2023-12-13T05:23:57.176Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-agent:default.log |
1302 | 2023-12-13T05:23:57.176Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1303 | 2023-12-13T05:23:58.289Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1304 | 2023-12-13T05:23:58.289Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1305 | 2023-12-13T05:23:59.366Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:default.log |
1306 | 2023-12-13T05:23:59.366Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1307 | 2023-12-13T05:24:00.496Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1308 | 2023-12-13T05:24:00.496Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ebf14d5-9a00-4122-914a-ab79e2e1a77e.log (3038 bytes) |
1309 | 2023-12-13T05:24:01.601Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:downstairs-9ebf14d5-9a00-4122-914a-ab79e2e1a77e.log |
1310 | 2023-12-13T05:24:01.601Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:downstairs-d82c740f-3a42-48e0-bea2-d18319115b5d.log (6406 bytes) |
1311 | 2023-12-13T05:24:03.183Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:downstairs-d82c740f-3a42-48e0-bea2-d18319115b5d.log |
1312 | 2023-12-13T05:24:03.183Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3a51bde-6262-4118-8c4c-89edab205a97.log (5516 bytes) |
1313 | 2023-12-13T05:24:04.280Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:downstairs-f3a51bde-6262-4118-8c4c-89edab205a97.log |
1314 | 2023-12-13T05:24:04.280Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:snapshot-d82c740f-3a42-48e0-bea2-d18319115b5d-8b254072-f4b4-466e-b1a6-8c3feab28c95.log (5156 bytes) |
1315 | 2023-12-13T05:24:05.394Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_d04b9c38-9134-4b45-9f7c-ded66ffdc85f/root/var/svc/log/oxide-crucible-downstairs:snapshot-d82c740f-3a42-48e0-bea2-d18319115b5d-8b254072-f4b4-466e-b1a6-8c3feab28c95.log |
1316 | 2023-12-13T05:24:05.419Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3d1dbcf8-31c2-4907-9c33-76d8b31d3794/root/var/svc/log/oxide-external_dns:default.log (30548 bytes) |
1317 | 2023-12-13T05:24:05.553Z | upload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3d1dbcf8-31c2-4907-9c33-76d8b31d3794/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 30548 -> 34310 |
1318 | 2023-12-13T05:24:06.666Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3d1dbcf8-31c2-4907-9c33-76d8b31d3794/root/var/svc/log/oxide-external_dns:default.log |
1319 | 2023-12-13T05:24:06.666Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3d1dbcf8-31c2-4907-9c33-76d8b31d3794/root/var/svc/log/oxide-external_dns:default.log.0 (75 bytes) |
1320 | 2023-12-13T05:24:07.783Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_3d1dbcf8-31c2-4907-9c33-76d8b31d3794/root/var/svc/log/oxide-external_dns:default.log.0 |
1321 | 2023-12-13T05:24:07.783Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5643f65f-b1e6-4f36-9f00-ac36119962e3/root/var/svc/log/oxide-internal_dns:default.log (27542 bytes) |
1322 | 2023-12-13T05:24:08.340Z | upload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5643f65f-b1e6-4f36-9f00-ac36119962e3/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27542 -> 31297 |
1323 | 2023-12-13T05:24:09.415Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5643f65f-b1e6-4f36-9f00-ac36119962e3/root/var/svc/log/oxide-internal_dns:default.log |
1324 | 2023-12-13T05:24:09.415Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5643f65f-b1e6-4f36-9f00-ac36119962e3/root/var/svc/log/oxide-internal_dns:default.log.0 (104926 bytes) |
1325 | 2023-12-13T05:24:10.810Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_5643f65f-b1e6-4f36-9f00-ac36119962e3/root/var/svc/log/oxide-internal_dns:default.log.0 |
1326 | 2023-12-13T05:24:10.811Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_52fbf5fc-4b8d-45f3-95af-87bd85d3514c/root/var/svc/log/oxide-nexus:default.log (2666549 bytes) |
1327 | 2023-12-13T05:24:13.580Z | upload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_52fbf5fc-4b8d-45f3-95af-87bd85d3514c/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 2666549 -> 2751815 |
1328 | 2023-12-13T05:24:14.654Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_52fbf5fc-4b8d-45f3-95af-87bd85d3514c/root/var/svc/log/oxide-nexus:default.log |
1329 | 2023-12-13T05:24:14.654Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_52fbf5fc-4b8d-45f3-95af-87bd85d3514c/root/var/svc/log/oxide-nexus:default.log.0 (120 bytes) |
1330 | 2023-12-13T05:24:15.752Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_52fbf5fc-4b8d-45f3-95af-87bd85d3514c/root/var/svc/log/oxide-nexus:default.log.0 |
1331 | 2023-12-13T05:24:15.752Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_916c7ed2-6f94-4b70-b159-8507ba9f8d1b/root/var/svc/log/oxide-oximeter:default.log (239221 bytes) |
1332 | 2023-12-13T05:24:16.341Z | upload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_916c7ed2-6f94-4b70-b159-8507ba9f8d1b/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 239221 -> 297566 |
1333 | 2023-12-13T05:24:17.416Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_916c7ed2-6f94-4b70-b159-8507ba9f8d1b/root/var/svc/log/oxide-oximeter:default.log |
1334 | 2023-12-13T05:24:17.416Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_916c7ed2-6f94-4b70-b159-8507ba9f8d1b/root/var/svc/log/oxide-oximeter:default.log.0 (11980 bytes) |
1335 | 2023-12-13T05:24:18.566Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_916c7ed2-6f94-4b70-b159-8507ba9f8d1b/root/var/svc/log/oxide-oximeter:default.log.0 |
1336 | 2023-12-13T05:24:18.566Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-agent:default.log (14116 bytes) |
1337 | 2023-12-13T05:24:19.703Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-agent:default.log |
1338 | 2023-12-13T05:24:19.727Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1339 | 2023-12-13T05:24:20.808Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1340 | 2023-12-13T05:24:20.808Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1341 | 2023-12-13T05:24:21.878Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-downstairs:default.log |
1342 | 2023-12-13T05:24:21.878Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1343 | 2023-12-13T05:24:22.971Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1344 | 2023-12-13T05:24:22.971Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-downstairs:downstairs-3d3d907f-2e14-451d-bfa0-b028649e6ee4.log (6407 bytes) |
1345 | 2023-12-13T05:24:24.088Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-downstairs:downstairs-3d3d907f-2e14-451d-bfa0-b028649e6ee4.log |
1346 | 2023-12-13T05:24:24.088Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-downstairs:snapshot-3d3d907f-2e14-451d-bfa0-b028649e6ee4-8b254072-f4b4-466e-b1a6-8c3feab28c95.log (5157 bytes) |
1347 | 2023-12-13T05:24:25.195Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_0cb04175-0aee-40d5-ad7b-d155caa34d88/root/var/svc/log/oxide-crucible-downstairs:snapshot-3d3d907f-2e14-451d-bfa0-b028649e6ee4-8b254072-f4b4-466e-b1a6-8c3feab28c95.log |
1348 | 2023-12-13T05:24:25.195Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_b1a429fd-f5ac-4d28-9600-524ac191644c/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes) |
1349 | 2023-12-13T05:24:26.323Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_b1a429fd-f5ac-4d28-9600-524ac191644c/root/var/svc/log/oxide-crucible-pantry:default.log |
1350 | 2023-12-13T05:24:26.323Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_b1a429fd-f5ac-4d28-9600-524ac191644c/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes) |
1351 | 2023-12-13T05:24:27.466Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_b1a429fd-f5ac-4d28-9600-524ac191644c/root/var/svc/log/oxide-crucible-pantry:default.log.0 |
1352 | 2023-12-13T05:24:27.511Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_93218afa-3969-4308-aec1-fcf5b39775ff/root/var/svc/log/oxide-internal_dns:default.log (27536 bytes) |
1353 | 2023-12-13T05:24:28.257Z | upload warning: file "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_93218afa-3969-4308-aec1-fcf5b39775ff/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27536 -> 35047 |
1354 | 2023-12-13T05:24:29.899Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_93218afa-3969-4308-aec1-fcf5b39775ff/root/var/svc/log/oxide-internal_dns:default.log |
1355 | 2023-12-13T05:24:29.899Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_93218afa-3969-4308-aec1-fcf5b39775ff/root/var/svc/log/oxide-internal_dns:default.log.0 (102477 bytes) |
1356 | 2023-12-13T05:24:31.669Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_93218afa-3969-4308-aec1-fcf5b39775ff/root/var/svc/log/oxide-internal_dns:default.log.0 |
1357 | 2023-12-13T05:24:31.669Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/measurements.log (16714 bytes) |
1358 | 2023-12-13T05:24:31.959Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/measurements.log" changed size mid upload: 16714 -> 20687 |
1359 | 2023-12-13T05:24:33.550Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/measurements.log |
1360 | 2023-12-13T05:24:33.550Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/statistics.log (9360 bytes) |
1361 | 2023-12-13T05:24:33.821Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/statistics.log" changed size mid upload: 9360 -> 11817 |
1362 | 2023-12-13T05:24:38.377Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/statistics.log |
1363 | 2023-12-13T05:24:38.377Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/tracking.log (1984 bytes) |
1364 | 2023-12-13T05:24:58.866Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/tracking.log" changed size mid upload: 1984 -> 2248 |
1365 | 2023-12-13T05:24:59.767Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_ntp_12d9fff4-405b-4a0c-a4f4-b3d2413b256e/root/var/log/chrony/tracking.log |