|
|
|
1 | 2024-02-02T02:23:08.525Z | job dependencies complete; ready to run (waiting for 1 h 54 m 1 s) |
2 | 2024-02-02T03:01:23.348Z | job assigned to worker 01HNKVXTWH8PSNZZCTD19FDWBM (queued for 38 m 14 s) |
3 | 2024-02-02T03:01:23.578Z | http://172.20.0.5:9969/ipxe/buskin... ok |
4 | 2024-02-02T03:01:23.630Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/kernel/amd64/unix... ok |
5 | 2024-02-02T03:01:23.670Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive... ok |
6 | 2024-02-02T03:01:23.709Z | http://172.20.0.5:9969/os/buskin/platform/i86pc/amd64/boot_archive.hash... ok |
7 | 2024-02-02T03:01:23.748Z | http://172.20.0.5:9969/postboot/buskin... ok |
8 | 2024-02-02T03:01:23.788Z | wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U |
9 | 2024-02-02T03:01:23.827Z | cpu0: microcode has been updated from version 0xa001133 to 0xa0011d1 |
10 | 2024-02-02T03:01:23.868Z | Oxide Helios Version helios-2.0.22418 64-bit |
11 | 2024-02-02T03:01:24.342Z | Configuring devices. |
12 | 2024-02-02T03:01:24.392Z | ################################################## |
13 | 2024-02-02T03:01:24.441Z | #### ############# ## |
14 | 2024-02-02T03:01:24.479Z | ### ### ############ ## |
15 | 2024-02-02T03:01:24.518Z | ## ### # ## ### ## Oxide Computer Company ## |
16 | 2024-02-02T03:01:24.561Z | ## ## ## ### # ### ## |
17 | 2024-02-02T03:01:24.594Z | ## # ### #### #### This Station Under ## |
18 | 2024-02-02T03:01:24.635Z | ### ### #### # ### Computer Control ## |
19 | 2024-02-02T03:01:24.683Z | #### #### ### ## ## |
20 | 2024-02-02T03:01:24.720Z | ################################################## |
21 | 2024-02-02T03:01:24.757Z | Hostname: buskin |
22 | 2024-02-02T03:01:24.804Z | Loading smf(7) service descriptions: |
23 | 2024-02-02T03:01:25.231Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-4fa0aa7f5e8d8c20.gz |
24 | 2024-02-02T03:01:28.435Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-4fa0aa7f5e8d8c20.gz |
25 | 2024-02-02T03:01:28.435Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
26 | 2024-02-02T03:02:27.134Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
27 | 2024-02-02T03:02:27.135Z | downloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-378ef3b1593728ce.gz |
28 | 2024-02-02T03:03:11.300Z | downloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-378ef3b1593728ce.gz |
29 | 2024-02-02T03:03:11.300Z | downloading input: /input/ci-tools/work/caboose-util.gz |
30 | 2024-02-02T03:03:15.231Z | downloaded input: /input/ci-tools/work/caboose-util.gz |
31 | 2024-02-02T03:03:15.269Z | downloading input: /input/ci-tools/work/tufaceous.gz |
32 | 2024-02-02T03:03:20.857Z | downloaded input: /input/ci-tools/work/tufaceous.gz |
33 | 2024-02-02T03:03:20.893Z | downloading input: /input/package/work/version.txt |
34 | 2024-02-02T03:03:20.983Z | downloaded input: /input/package/work/version.txt |
35 | 2024-02-02T03:03:20.983Z | downloading input: /input/package/work/package.tar.gz |
36 | 2024-02-02T03:03:47.578Z | downloaded input: /input/package/work/package.tar.gz |
37 | 2024-02-02T03:03:47.579Z | downloading input: /input/package/work/global-zone-packages.tar.gz |
38 | 2024-02-02T03:04:36.434Z | downloaded input: /input/package/work/global-zone-packages.tar.gz |
39 | 2024-02-02T03:04:36.434Z | downloading input: /input/package/work/trampoline-global-zone-packages.tar.gz |
40 | 2024-02-02T03:05:07.627Z | downloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz |
41 | 2024-02-02T03:05:07.653Z | downloading input: /input/package/work/zones/clickhouse.tar.gz |
42 | 2024-02-02T03:07:23.573Z | downloaded input: /input/package/work/zones/clickhouse.tar.gz |
43 | 2024-02-02T03:07:23.573Z | downloading input: /input/package/work/zones/clickhouse_keeper.tar.gz |
44 | 2024-02-02T03:08:03.328Z | downloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz |
45 | 2024-02-02T03:08:03.329Z | downloading input: /input/package/work/zones/cockroachdb.tar.gz |
46 | 2024-02-02T03:08:26.701Z | downloaded input: /input/package/work/zones/cockroachdb.tar.gz |
47 | 2024-02-02T03:08:26.701Z | downloading input: /input/package/work/zones/crucible-pantry.tar.gz |
48 | 2024-02-02T03:08:29.918Z | downloaded input: /input/package/work/zones/crucible-pantry.tar.gz |
49 | 2024-02-02T03:08:29.919Z | downloading input: /input/package/work/zones/crucible.tar.gz |
50 | 2024-02-02T03:08:36.370Z | downloaded input: /input/package/work/zones/crucible.tar.gz |
51 | 2024-02-02T03:08:36.371Z | downloading input: /input/package/work/zones/external-dns.tar.gz |
52 | 2024-02-02T03:08:40.906Z | downloaded input: /input/package/work/zones/external-dns.tar.gz |
53 | 2024-02-02T03:08:40.932Z | downloading input: /input/package/work/zones/internal-dns.tar.gz |
54 | 2024-02-02T03:08:45.578Z | downloaded input: /input/package/work/zones/internal-dns.tar.gz |
55 | 2024-02-02T03:08:45.578Z | downloading input: /input/package/work/zones/ntp.tar.gz |
56 | 2024-02-02T03:08:45.615Z | downloaded input: /input/package/work/zones/ntp.tar.gz |
57 | 2024-02-02T03:08:45.615Z | downloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
58 | 2024-02-02T03:08:50.216Z | downloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
59 | 2024-02-02T03:08:50.216Z | downloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
60 | 2024-02-02T03:08:54.558Z | downloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
61 | 2024-02-02T03:08:54.583Z | downloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
62 | 2024-02-02T03:09:09.950Z | downloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
63 | 2024-02-02T03:09:09.950Z | downloading input: /input/package/work/zones/omicron-nexus.tar.gz |
64 | 2024-02-02T03:09:37.689Z | downloaded input: /input/package/work/zones/omicron-nexus.tar.gz |
65 | 2024-02-02T03:09:37.737Z | downloading input: /input/package/work/zones/overlay.tar.gz |
66 | 2024-02-02T03:09:37.773Z | downloaded input: /input/package/work/zones/overlay.tar.gz |
67 | 2024-02-02T03:09:37.773Z | downloading input: /input/package/work/zones/oximeter.tar.gz |
68 | 2024-02-02T03:09:52.510Z | downloaded input: /input/package/work/zones/oximeter.tar.gz |
69 | 2024-02-02T03:09:52.510Z | downloading input: /input/package/work/zones/propolis-server.tar.gz |
70 | 2024-02-02T03:10:00.352Z | buskin console login: Feb 2 03:10:00 buskin cron[810]: Solaris_audit getaddrinfo(buskin) failed[node name or service name not known]: Error 0 |
71 | 2024-02-02T03:10:00.400Z | Feb 2 03:10:00 buskin cron[810]: Solaris_audit mapping buskin to 10.151.1.100: Error 0 |
72 | 2024-02-02T03:10:07.245Z | downloaded input: /input/package/work/zones/propolis-server.tar.gz |
73 | 2024-02-02T03:10:07.681Z | downloading input: /input/package/work/zones/switch-asic.tar.gz |
74 | 2024-02-02T03:11:00.585Z | downloaded input: /input/package/work/zones/switch-asic.tar.gz |
75 | 2024-02-02T03:11:00.585Z | downloading input: /input/package/work/zones/switch-softnpu.tar.gz |
76 | 2024-02-02T03:11:41.402Z | downloaded input: /input/package/work/zones/switch-softnpu.tar.gz |
|
77 | 2024-02-02T03:11:41.594Z | starting task 0: "setup" |
78 | 2024-02-02T03:11:41.595Z | ++ uname -s |
79 | 2024-02-02T03:11:41.595Z | + kern=SunOS |
80 | 2024-02-02T03:11:41.595Z | + case "$kern" in |
81 | 2024-02-02T03:11:41.595Z | + groupadd -g 12345 build |
82 | 2024-02-02T03:11:41.595Z | + useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build |
83 | 2024-02-02T03:11:41.740Z | + zfs create -o mountpoint=/work rpool/work |
84 | 2024-02-02T03:11:41.740Z | ++ awk '$2 == "/home" { print $3 }' /etc/mnttab |
85 | 2024-02-02T03:11:41.740Z | + home_fs=zfs |
86 | 2024-02-02T03:11:41.740Z | + [[ zfs == autofs ]] |
87 | 2024-02-02T03:11:41.740Z | + mkdir -p /home/build |
88 | 2024-02-02T03:11:41.740Z | + chown build:build /home/build /work |
89 | 2024-02-02T03:11:43.069Z | + chmod 0700 /home/build /work |
90 | 2024-02-02T03:11:43.097Z | process exited: duration 4060 ms, exit code 0 |
|
91 | 2024-02-02T03:11:43.234Z | starting task 1: "authentication" |
92 | 2024-02-02T03:11:43.291Z | process exited: duration 57 ms, exit code 0 |
|
93 | 2024-02-02T03:11:43.368Z | starting task 2: "build" |
94 | 2024-02-02T03:11:43.457Z | + trap _exit_trap EXIT |
95 | 2024-02-02T03:11:43.457Z | + set +x |
96 | 2024-02-02T03:12:26.027Z | + pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3' |
97 | 2024-02-02T03:12:26.264Z | secpolicy_fs_linkdir: 0x55 = 0x55 |
98 | 2024-02-02T03:12:26.264Z | secpolicy_fs_linkdir+1: 0xb8 = 0x48 |
99 | 2024-02-02T03:12:26.264Z | secpolicy_fs_linkdir+2: 0x1 = 0x89 |
100 | 2024-02-02T03:12:26.264Z | secpolicy_fs_linkdir+3: 0 = 0xe5 |
101 | 2024-02-02T03:12:26.291Z | secpolicy_fs_linkdir+4: 0 = 0xb8 |
102 | 2024-02-02T03:12:26.291Z | secpolicy_fs_linkdir+5: 0 = 0x1 |
103 | 2024-02-02T03:12:26.291Z | secpolicy_fs_linkdir+6: 0x48 = 0x0 |
104 | 2024-02-02T03:12:26.291Z | secpolicy_fs_linkdir+7: 0x89 = 0x0 |
105 | 2024-02-02T03:12:26.292Z | secpolicy_fs_linkdir+8: 0xe5 = 0x0 |
106 | 2024-02-02T03:12:26.292Z | secpolicy_fs_linkdir+9: 0x48 = 0x5d |
107 | 2024-02-02T03:12:26.292Z | secpolicy_fs_linkdir+0xa: 0x83 = 0xc3 |
108 | 2024-02-02T03:12:26.292Z | + [[ -d /opt/oxide ]] |
109 | 2024-02-02T03:12:26.292Z | + pfexec mv /opt/oxide /opt/oxide-underneath |
110 | 2024-02-02T03:12:26.292Z | + pfexec mkdir /opt/oxide |
111 | 2024-02-02T03:12:26.292Z | + pfexec mount -F tmpfs -O swap /opt/oxide |
112 | 2024-02-02T03:12:26.292Z | + [[ -d /opt/oxide-underneath ]] |
113 | 2024-02-02T03:12:26.292Z | + cd /opt/oxide-underneath |
114 | 2024-02-02T03:12:26.292Z | + pfexec tar ceEp@/f - . |
115 | 2024-02-02T03:12:26.292Z | + cd /opt/oxide |
116 | 2024-02-02T03:12:26.292Z | + pfexec tar xveEp@/f - |
117 | 2024-02-02T03:12:26.326Z | x ., 0 bytes, 0 tape blocks |
118 | 2024-02-02T03:12:26.326Z | x ./opte, 0 bytes, 0 tape blocks |
119 | 2024-02-02T03:12:26.326Z | x ./opte/bin, 0 bytes, 0 tape blocks |
120 | 2024-02-02T03:12:26.326Z | x ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks |
121 | 2024-02-02T03:12:26.359Z | + pfexec rm -rf /opt/oxide-underneath |
122 | 2024-02-02T03:12:26.359Z | + pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone |
123 | 2024-02-02T03:12:26.385Z | + pfexec mkdir /opt/oxide/work |
124 | 2024-02-02T03:12:26.385Z | + pfexec chown build:build /opt/oxide/work |
125 | 2024-02-02T03:12:26.385Z | + cd /opt/oxide/work |
126 | 2024-02-02T03:12:26.385Z | + ptime -m tar xvzf /input/package/work/package.tar.gz |
127 | 2024-02-02T03:12:28.041Z | Decompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'... |
128 | 2024-02-02T03:12:28.041Z | x out/mg-ddm-gz.tar, 63076864 bytes, 123197 tape blocks |
129 | 2024-02-02T03:12:28.041Z | x out/omicron-sled-agent.tar, 122424320 bytes, 239110 tape blocks |
130 | 2024-02-02T03:12:28.041Z | x out/oxlog.tar, 8382464 bytes, 16372 tape blocks |
131 | 2024-02-02T03:12:28.041Z | x out/target/test, 75 bytes, 1 tape blocks |
132 | 2024-02-02T03:12:28.041Z | x out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks |
133 | 2024-02-02T03:12:28.041Z | x package-manifest.toml, 23732 bytes, 47 tape blocks |
134 | 2024-02-02T03:12:28.041Z | x smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks |
135 | 2024-02-02T03:12:28.041Z | x target/release/omicron-package, 45618880 bytes, 89100 tape blocks |
136 | 2024-02-02T03:12:28.041Z | x tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks |
137 | 2024-02-02T03:12:28.041Z | x tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks |
138 | 2024-02-02T03:12:28.041Z | x tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks |
139 | 2024-02-02T03:12:28.042Z | x tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks |
140 | 2024-02-02T03:12:28.042Z | x tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks |
141 | 2024-02-02T03:12:28.042Z | x tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks |
142 | 2024-02-02T03:12:28.042Z | x tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks |
143 | 2024-02-02T03:12:28.068Z | |
144 | 2024-02-02T03:12:28.068Z | real 1.674082626 |
145 | 2024-02-02T03:12:28.068Z | user 1.504502846 |
146 | 2024-02-02T03:12:28.068Z | sys 0.301831195 |
147 | 2024-02-02T03:12:28.068Z | trap 0.000071300 |
148 | 2024-02-02T03:12:28.068Z | tflt 0.000000000 |
149 | 2024-02-02T03:12:28.068Z | dflt 0.000000000 |
150 | 2024-02-02T03:12:28.068Z | kflt 0.000000000 |
151 | 2024-02-02T03:12:28.068Z | lock 0.000000000 |
152 | 2024-02-02T03:12:28.068Z | slp 1.501885474 |
153 | 2024-02-02T03:12:28.068Z | lat 0.037656227 |
154 | 2024-02-02T03:12:28.068Z | stop 0.000128961 |
155 | 2024-02-02T03:12:28.068Z | + cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/ |
156 | 2024-02-02T03:12:29.275Z | + mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz |
157 | 2024-02-02T03:12:29.731Z | + mkdir tests |
158 | 2024-02-02T03:12:29.731Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
159 | 2024-02-02T03:12:29.731Z | + ptime -m gunzip |
160 | 2024-02-02T03:12:29.731Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-4fa0aa7f5e8d8c20 |
161 | 2024-02-02T03:12:29.772Z | |
162 | 2024-02-02T03:12:29.772Z | real 0.236333740 |
163 | 2024-02-02T03:12:29.772Z | user 0.217409093 |
164 | 2024-02-02T03:12:29.772Z | sys 0.018680455 |
165 | 2024-02-02T03:12:29.772Z | trap 0.000018949 |
166 | 2024-02-02T03:12:29.772Z | tflt 0.000000000 |
167 | 2024-02-02T03:12:29.772Z | dflt 0.000000000 |
168 | 2024-02-02T03:12:29.772Z | kflt 0.000000000 |
169 | 2024-02-02T03:12:29.772Z | lock 0.000000000 |
170 | 2024-02-02T03:12:29.773Z | slp 0.000020040 |
171 | 2024-02-02T03:12:29.773Z | lat 0.000022840 |
172 | 2024-02-02T03:12:29.773Z | stop 0.000129400 |
173 | 2024-02-02T03:12:29.773Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-4fa0aa7f5e8d8c20 |
174 | 2024-02-02T03:12:29.773Z | + chmod a+x tests/bootstrap-4fa0aa7f5e8d8c20 |
175 | 2024-02-02T03:12:29.773Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
176 | 2024-02-02T03:12:29.773Z | + ptime -m gunzip |
177 | 2024-02-02T03:12:29.773Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
178 | 2024-02-02T03:12:32.094Z | |
179 | 2024-02-02T03:12:32.128Z | real 2.539276494 |
180 | 2024-02-02T03:12:32.128Z | user 2.369716427 |
181 | 2024-02-02T03:12:32.129Z | sys 0.169110405 |
182 | 2024-02-02T03:12:32.129Z | trap 0.000209461 |
183 | 2024-02-02T03:12:32.129Z | tflt 0.000000000 |
184 | 2024-02-02T03:12:32.130Z | dflt 0.000000000 |
185 | 2024-02-02T03:12:32.130Z | kflt 0.000000000 |
186 | 2024-02-02T03:12:32.131Z | lock 0.000000000 |
187 | 2024-02-02T03:12:32.131Z | slp 0.000014850 |
188 | 2024-02-02T03:12:32.131Z | lat 0.000024779 |
189 | 2024-02-02T03:12:32.132Z | stop 0.000131961 |
190 | 2024-02-02T03:12:32.132Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
191 | 2024-02-02T03:12:32.132Z | + chmod a+x tests/bootstrap |
192 | 2024-02-02T03:12:32.132Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
193 | 2024-02-02T03:12:32.133Z | + ptime -m gunzip |
194 | 2024-02-02T03:12:32.133Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-378ef3b1593728ce |
195 | 2024-02-02T03:12:34.655Z | |
196 | 2024-02-02T03:12:34.681Z | real 2.558150775 |
197 | 2024-02-02T03:12:34.682Z | user 2.404184906 |
198 | 2024-02-02T03:12:34.682Z | sys 0.153493784 |
199 | 2024-02-02T03:12:34.682Z | trap 0.000208393 |
200 | 2024-02-02T03:12:34.682Z | tflt 0.000000000 |
201 | 2024-02-02T03:12:34.682Z | dflt 0.000000000 |
202 | 2024-02-02T03:12:34.682Z | kflt 0.000000000 |
203 | 2024-02-02T03:12:34.683Z | lock 0.000000000 |
204 | 2024-02-02T03:12:34.683Z | slp 0.000044320 |
205 | 2024-02-02T03:12:34.683Z | lat 0.000025280 |
206 | 2024-02-02T03:12:34.683Z | stop 0.000131141 |
207 | 2024-02-02T03:12:34.683Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-378ef3b1593728ce |
208 | 2024-02-02T03:12:34.683Z | + chmod a+x tests/end_to_end_tests-378ef3b1593728ce |
209 | 2024-02-02T03:12:34.683Z | + bmat address ls |
210 | 2024-02-02T03:12:34.683Z | NAME CIDR FIRST LAST COUNT |
211 | 2024-02-02T03:12:34.683Z | extra 10.151.1.0/24 10.151.1.164 10.151.1.227 64 |
212 | 2024-02-02T03:12:34.684Z | ++ bmat address ls -f extra -Ho first,last,count |
213 | 2024-02-02T03:12:34.711Z | + set -- 10.151.1.164 10.151.1.227 64 |
214 | 2024-02-02T03:12:34.711Z | + EXTRA_IP_START=10.151.1.164 |
215 | 2024-02-02T03:12:34.712Z | + EXTRA_IP_END=10.151.1.227 |
216 | 2024-02-02T03:12:34.712Z | + EXTRA_IP_COUNT=64 |
217 | 2024-02-02T03:12:34.712Z | + (( EXTRA_IP_COUNT >= 32 )) |
218 | 2024-02-02T03:12:34.712Z | + EXTRA_IP_BASE=10.151.1 |
219 | 2024-02-02T03:12:34.712Z | + EXTRA_IP_FOCTET=164 |
220 | 2024-02-02T03:12:34.713Z | + EXTRA_IP_LOCTET=227 |
221 | 2024-02-02T03:12:34.713Z | + SERVICE_IP_POOL_START=10.151.1.164 |
222 | 2024-02-02T03:12:34.713Z | + SERVICE_IP_POOL_END=10.151.1.173 |
223 | 2024-02-02T03:12:34.713Z | + DNS_IP1=10.151.1.164 |
224 | 2024-02-02T03:12:34.714Z | + DNS_IP2=10.151.1.165 |
225 | 2024-02-02T03:12:34.714Z | + UPLINK_IP=10.151.1.174 |
226 | 2024-02-02T03:12:34.714Z | + IPPOOL_START=10.151.1.175 |
227 | 2024-02-02T03:12:34.714Z | + IPPOOL_END=10.151.1.227 |
228 | 2024-02-02T03:12:34.714Z | ++ ipadm show-addr -po type,addr |
229 | 2024-02-02T03:12:34.714Z | ++ awk '-F[:/]' '$1 == "dhcp" {print $2}' |
230 | 2024-02-02T03:12:34.715Z | + GATEWAY_IP=10.151.1.100 |
231 | 2024-02-02T03:12:34.715Z | + [[ -n 10.151.1.100 ]] |
232 | 2024-02-02T03:12:34.715Z | + ping -s 10.151.1.100 56 1 |
233 | 2024-02-02T03:12:34.715Z | PING 10.151.1.100: 56 data bytes |
234 | 2024-02-02T03:12:34.715Z | 64 bytes from 10.151.1.100: icmp_seq=0. time=0.012 ms |
235 | 2024-02-02T03:12:34.716Z | |
236 | 2024-02-02T03:12:34.716Z | ----10.151.1.100 PING Statistics---- |
237 | 2024-02-02T03:12:34.716Z | 1 packets transmitted, 1 packets received, 0% packet loss |
238 | 2024-02-02T03:12:34.716Z | round-trip (ms) min/avg/max/stddev = 0.012/0.012/0.012/-nan |
239 | 2024-02-02T03:12:34.716Z | ++ arp -an |
240 | 2024-02-02T03:12:34.717Z | ++ awk -vgw=10.151.1.100 '$2 == gw {print $NF}' |
241 | 2024-02-02T03:12:34.717Z | + GATEWAY_MAC=18:c0:4d:0d:9f:b2 |
242 | 2024-02-02T03:12:34.717Z | + routeadm -e ipv4-forwarding -u |
243 | 2024-02-02T03:12:34.824Z | + PXA_START=10.151.1.164 |
244 | 2024-02-02T03:12:34.825Z | + PXA_END=10.151.1.227 |
245 | 2024-02-02T03:12:34.862Z | + export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END |
246 | 2024-02-02T03:12:34.863Z | + pfexec zpool create -f scratch c1t1d0 c2t1d0 |
247 | 2024-02-02T03:12:36.364Z | + ZPOOL_VDEV_DIR=/scratch |
248 | 2024-02-02T03:12:36.364Z | + ptime -m pfexec ./tools/create_virtual_hardware.sh |
249 | 2024-02-02T03:12:36.434Z | +++ dirname ./tools/create_virtual_hardware.sh |
250 | 2024-02-02T03:12:36.435Z | ++ cd ./tools |
251 | 2024-02-02T03:12:36.435Z | ++ pwd |
252 | 2024-02-02T03:12:36.435Z | + SOURCE_DIR=/opt/oxide/work/tools |
253 | 2024-02-02T03:12:36.435Z | + OMICRON_TOP=/opt/oxide/work/tools/.. |
254 | 2024-02-02T03:12:36.435Z | + SOFTNPU_MODE=zone |
255 | 2024-02-02T03:12:36.435Z | + . /opt/oxide/work/tools/virtual_hardware.sh |
256 | 2024-02-02T03:12:36.435Z | ++ MARKER=/etc/opt/oxide/NO_INSTALL |
257 | 2024-02-02T03:12:36.436Z | ++ [[ -f /etc/opt/oxide/NO_INSTALL ]] |
258 | 2024-02-02T03:12:36.436Z | ++ dladm show-phys -p -o LINK |
259 | 2024-02-02T03:12:36.436Z | ++ head -1 |
260 | 2024-02-02T03:12:36.436Z | + PHYSICAL_LINK=igb0 |
261 | 2024-02-02T03:12:36.436Z | + echo 'Using igb0 as physical link' |
262 | 2024-02-02T03:12:36.436Z | Using igb0 as physical link |
263 | 2024-02-02T03:12:36.437Z | + ensure_run_as_root |
264 | 2024-02-02T03:12:36.437Z | ++ id -u |
265 | 2024-02-02T03:12:36.437Z | + [[ 0 -ne 0 ]] |
266 | 2024-02-02T03:12:36.437Z | + ensure_zpools |
267 | 2024-02-02T03:12:36.437Z | + ZPOOL_TYPES=('oxp_' 'oxi_') |
268 | 2024-02-02T03:12:36.437Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
269 | 2024-02-02T03:12:36.437Z | + readarray -t ZPOOLS |
270 | 2024-02-02T03:12:36.437Z | ++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
271 | 2024-02-02T03:12:36.438Z | ++ sed 's/[ ",]//g' |
272 | 2024-02-02T03:12:36.438Z | + for ZPOOL in "${ZPOOLS[@]}" |
273 | 2024-02-02T03:12:36.438Z | + echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
274 | 2024-02-02T03:12:36.438Z | Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b] |
275 | 2024-02-02T03:12:36.438Z | + VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
276 | 2024-02-02T03:12:36.438Z | + [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
277 | 2024-02-02T03:12:36.438Z | + dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
278 | 2024-02-02T03:12:36.438Z | 0+0 records in |
279 | 2024-02-02T03:12:36.438Z | 0+0 records out |
280 | 2024-02-02T03:12:36.438Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
281 | 2024-02-02T03:12:36.438Z | + success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
282 | 2024-02-02T03:12:36.439Z | + set +x |
283 | 2024-02-02T03:12:36.439Z | ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
284 | 2024-02-02T03:12:36.439Z | ++ zpool list -o name |
285 | 2024-02-02T03:12:36.439Z | ++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b |
286 | 2024-02-02T03:12:36.439Z | + [[ -z '' ]] |
287 | 2024-02-02T03:12:36.439Z | + zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
288 | 2024-02-02T03:12:36.439Z | + success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
289 | 2024-02-02T03:12:36.439Z | + set +x |
290 | 2024-02-02T03:12:36.439Z | ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
291 | 2024-02-02T03:12:36.440Z | + for ZPOOL in "${ZPOOLS[@]}" |
292 | 2024-02-02T03:12:36.440Z | + echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
293 | 2024-02-02T03:12:36.440Z | + VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
294 | 2024-02-02T03:12:36.440Z | Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
295 | 2024-02-02T03:12:36.440Z | + [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
296 | 2024-02-02T03:12:36.440Z | + dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
297 | 2024-02-02T03:12:36.440Z | 0+0 records in |
298 | 2024-02-02T03:12:36.440Z | 0+0 records out |
299 | 2024-02-02T03:12:36.440Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
300 | 2024-02-02T03:12:36.440Z | + success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
301 | 2024-02-02T03:12:36.441Z | + set +x |
302 | 2024-02-02T03:12:36.441Z | ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
303 | 2024-02-02T03:12:36.441Z | ++ zpool list -o name |
304 | 2024-02-02T03:12:36.441Z | ++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
305 | 2024-02-02T03:12:36.441Z | + [[ -z '' ]] |
306 | 2024-02-02T03:12:36.441Z | + zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
307 | 2024-02-02T03:12:36.441Z | + success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
308 | 2024-02-02T03:12:36.441Z | + set +x |
309 | 2024-02-02T03:12:36.441Z | ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
310 | 2024-02-02T03:12:36.441Z | + for ZPOOL in "${ZPOOLS[@]}" |
311 | 2024-02-02T03:12:36.441Z | + echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
312 | 2024-02-02T03:12:36.442Z | Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
313 | 2024-02-02T03:12:36.442Z | + VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
314 | 2024-02-02T03:12:36.442Z | + [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
315 | 2024-02-02T03:12:36.442Z | + dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
316 | 2024-02-02T03:12:36.442Z | 0+0 records in |
317 | 2024-02-02T03:12:36.442Z | 0+0 records out |
318 | 2024-02-02T03:12:36.442Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
319 | 2024-02-02T03:12:36.442Z | + success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
320 | 2024-02-02T03:12:36.442Z | + set +x |
321 | 2024-02-02T03:12:36.442Z | ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
322 | 2024-02-02T03:12:36.442Z | ++ zpool list -o name |
323 | 2024-02-02T03:12:36.442Z | ++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
324 | 2024-02-02T03:12:36.443Z | + [[ -z '' ]] |
325 | 2024-02-02T03:12:36.443Z | + zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
326 | 2024-02-02T03:12:36.443Z | + success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
327 | 2024-02-02T03:12:36.443Z | + set +x |
328 | 2024-02-02T03:12:36.443Z | ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
329 | 2024-02-02T03:12:36.443Z | + for ZPOOL in "${ZPOOLS[@]}" |
330 | 2024-02-02T03:12:36.443Z | + echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
331 | 2024-02-02T03:12:36.443Z | Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03] |
332 | 2024-02-02T03:12:36.443Z | + VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
333 | 2024-02-02T03:12:36.443Z | + [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
334 | 2024-02-02T03:12:36.443Z | + dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
335 | 2024-02-02T03:12:36.443Z | 0+0 records in |
336 | 2024-02-02T03:12:36.444Z | 0+0 records out |
337 | 2024-02-02T03:12:36.444Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
338 | 2024-02-02T03:12:36.444Z | + success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
339 | 2024-02-02T03:12:36.444Z | + set +x |
340 | 2024-02-02T03:12:36.444Z | ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
341 | 2024-02-02T03:12:36.444Z | ++ zpool list -o name |
342 | 2024-02-02T03:12:36.444Z | ++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 |
343 | 2024-02-02T03:12:36.444Z | + [[ -z '' ]] |
344 | 2024-02-02T03:12:36.444Z | + zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
345 | 2024-02-02T03:12:36.444Z | + success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
346 | 2024-02-02T03:12:36.445Z | + set +x |
347 | 2024-02-02T03:12:36.445Z | ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
348 | 2024-02-02T03:12:36.445Z | + for ZPOOL in "${ZPOOLS[@]}" |
349 | 2024-02-02T03:12:36.496Z | + echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
350 | 2024-02-02T03:12:36.496Z | Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03] |
351 | 2024-02-02T03:12:36.496Z | + VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
352 | 2024-02-02T03:12:36.496Z | + [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
353 | 2024-02-02T03:12:36.496Z | + dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
354 | 2024-02-02T03:12:36.496Z | 0+0 records in |
355 | 2024-02-02T03:12:36.496Z | 0+0 records out |
356 | 2024-02-02T03:12:36.497Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
357 | 2024-02-02T03:12:36.497Z | + success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
358 | 2024-02-02T03:12:36.497Z | + set +x |
359 | 2024-02-02T03:12:36.497Z | ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
360 | 2024-02-02T03:12:36.497Z | ++ zpool list -o name |
361 | 2024-02-02T03:12:36.497Z | ++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 |
362 | 2024-02-02T03:12:36.497Z | + [[ -z '' ]] |
363 | 2024-02-02T03:12:36.497Z | + zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
364 | 2024-02-02T03:12:36.498Z | + success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
365 | 2024-02-02T03:12:36.498Z | + set +x |
366 | 2024-02-02T03:12:36.498Z | ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
367 | 2024-02-02T03:12:36.498Z | + for ZPOOL in "${ZPOOLS[@]}" |
368 | 2024-02-02T03:12:36.498Z | + echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]' |
369 | 2024-02-02T03:12:36.498Z | Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930] |
370 | 2024-02-02T03:12:36.498Z | + VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
371 | 2024-02-02T03:12:36.499Z | + [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]] |
372 | 2024-02-02T03:12:36.499Z | + dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G |
373 | 2024-02-02T03:12:36.499Z | 0+0 records in |
374 | 2024-02-02T03:12:36.499Z | 0+0 records out |
375 | 2024-02-02T03:12:36.499Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
376 | 2024-02-02T03:12:36.499Z | + success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists' |
377 | 2024-02-02T03:12:36.499Z | + set +x |
378 | 2024-02-02T03:12:36.499Z | ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists |
379 | 2024-02-02T03:12:36.499Z | ++ zpool list -o name |
380 | 2024-02-02T03:12:36.499Z | ++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 |
381 | 2024-02-02T03:12:36.499Z | + [[ -z '' ]] |
382 | 2024-02-02T03:12:36.500Z | + zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
383 | 2024-02-02T03:12:36.500Z | + success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists' |
384 | 2024-02-02T03:12:36.500Z | + set +x |
385 | 2024-02-02T03:12:36.500Z | ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists |
386 | 2024-02-02T03:12:36.500Z | + for ZPOOL in "${ZPOOLS[@]}" |
387 | 2024-02-02T03:12:36.500Z | + echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]' |
388 | 2024-02-02T03:12:36.500Z | Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60] |
389 | 2024-02-02T03:12:36.500Z | + VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
390 | 2024-02-02T03:12:36.501Z | + [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]] |
391 | 2024-02-02T03:12:36.501Z | + dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G |
392 | 2024-02-02T03:12:36.501Z | 0+0 records in |
393 | 2024-02-02T03:12:36.501Z | 0+0 records out |
394 | 2024-02-02T03:12:36.501Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
395 | 2024-02-02T03:12:36.501Z | + success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists' |
396 | 2024-02-02T03:12:36.501Z | + set +x |
397 | 2024-02-02T03:12:36.501Z | ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists |
398 | 2024-02-02T03:12:36.501Z | ++ zpool list -o name |
399 | 2024-02-02T03:12:36.501Z | ++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 |
400 | 2024-02-02T03:12:36.501Z | + [[ -z '' ]] |
401 | 2024-02-02T03:12:36.501Z | + zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
402 | 2024-02-02T03:12:36.501Z | + success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists' |
403 | 2024-02-02T03:12:36.502Z | + set +x |
404 | 2024-02-02T03:12:36.502Z | ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists |
405 | 2024-02-02T03:12:36.502Z | + for ZPOOL in "${ZPOOLS[@]}" |
406 | 2024-02-02T03:12:36.502Z | + echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]' |
407 | 2024-02-02T03:12:36.502Z | Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f] |
408 | 2024-02-02T03:12:36.502Z | + VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
409 | 2024-02-02T03:12:36.502Z | + [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]] |
410 | 2024-02-02T03:12:36.502Z | + dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G |
411 | 2024-02-02T03:12:36.502Z | 0+0 records in |
412 | 2024-02-02T03:12:36.502Z | 0+0 records out |
413 | 2024-02-02T03:12:36.502Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
414 | 2024-02-02T03:12:36.502Z | + success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists' |
415 | 2024-02-02T03:12:36.502Z | + set +x |
416 | 2024-02-02T03:12:36.503Z | ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists |
417 | 2024-02-02T03:12:36.503Z | ++ zpool list -o name |
418 | 2024-02-02T03:12:36.503Z | ++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f |
419 | 2024-02-02T03:12:36.503Z | + [[ -z '' ]] |
420 | 2024-02-02T03:12:36.503Z | + zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
421 | 2024-02-02T03:12:36.503Z | + success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists' |
422 | 2024-02-02T03:12:36.503Z | + set +x |
423 | 2024-02-02T03:12:36.503Z | ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists |
424 | 2024-02-02T03:12:36.503Z | Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7] |
425 | 2024-02-02T03:12:36.503Z | + for ZPOOL in "${ZPOOLS[@]}" |
426 | 2024-02-02T03:12:36.503Z | + echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]' |
427 | 2024-02-02T03:12:36.503Z | + VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
428 | 2024-02-02T03:12:36.503Z | + [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]] |
429 | 2024-02-02T03:12:36.504Z | + dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G |
430 | 2024-02-02T03:12:36.504Z | 0+0 records in |
431 | 2024-02-02T03:12:36.504Z | 0+0 records out |
432 | 2024-02-02T03:12:36.504Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
433 | 2024-02-02T03:12:36.504Z | + success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists' |
434 | 2024-02-02T03:12:36.504Z | + set +x |
435 | 2024-02-02T03:12:36.504Z | ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists |
436 | 2024-02-02T03:12:36.504Z | ++ zpool list -o name |
437 | 2024-02-02T03:12:36.504Z | ++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 |
438 | 2024-02-02T03:12:36.504Z | + [[ -z '' ]] |
439 | 2024-02-02T03:12:36.504Z | + zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
440 | 2024-02-02T03:12:36.504Z | + success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists' |
441 | 2024-02-02T03:12:36.505Z | + set +x |
442 | 2024-02-02T03:12:36.505Z | ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists |
443 | 2024-02-02T03:12:36.505Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
444 | 2024-02-02T03:12:36.505Z | + readarray -t ZPOOLS |
445 | 2024-02-02T03:12:36.505Z | ++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
446 | 2024-02-02T03:12:36.506Z | ++ sed 's/[ ",]//g' |
447 | 2024-02-02T03:12:36.506Z | + for ZPOOL in "${ZPOOLS[@]}" |
448 | 2024-02-02T03:12:36.506Z | + echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
449 | 2024-02-02T03:12:36.568Z | Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b] |
450 | 2024-02-02T03:12:36.569Z | + VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
451 | 2024-02-02T03:12:36.569Z | + [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
452 | 2024-02-02T03:12:36.569Z | + dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
453 | 2024-02-02T03:12:36.569Z | 0+0 records in |
454 | 2024-02-02T03:12:36.569Z | 0+0 records out |
455 | 2024-02-02T03:12:36.569Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
456 | 2024-02-02T03:12:36.569Z | + success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
457 | 2024-02-02T03:12:36.570Z | + set +x |
458 | 2024-02-02T03:12:36.570Z | ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
459 | 2024-02-02T03:12:36.570Z | ++ zpool list -o name |
460 | 2024-02-02T03:12:36.570Z | ++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b |
461 | 2024-02-02T03:12:36.570Z | + [[ -z '' ]] |
462 | 2024-02-02T03:12:36.570Z | + zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
463 | 2024-02-02T03:12:36.570Z | + success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
464 | 2024-02-02T03:12:36.570Z | + set +x |
465 | 2024-02-02T03:12:36.571Z | ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
466 | 2024-02-02T03:12:36.571Z | + for ZPOOL in "${ZPOOLS[@]}" |
467 | 2024-02-02T03:12:36.571Z | + echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
468 | 2024-02-02T03:12:36.571Z | Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b] |
469 | 2024-02-02T03:12:36.571Z | + VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
470 | 2024-02-02T03:12:36.571Z | + [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
471 | 2024-02-02T03:12:36.571Z | + dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
472 | 2024-02-02T03:12:36.571Z | 0+0 records in |
473 | 2024-02-02T03:12:36.571Z | 0+0 records out |
474 | 2024-02-02T03:12:36.571Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
475 | 2024-02-02T03:12:36.572Z | + success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
476 | 2024-02-02T03:12:36.572Z | + set +x |
477 | 2024-02-02T03:12:36.572Z | ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
478 | 2024-02-02T03:12:36.572Z | ++ zpool list -o name |
479 | 2024-02-02T03:12:36.572Z | ++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b |
480 | 2024-02-02T03:12:36.572Z | + [[ -z '' ]] |
481 | 2024-02-02T03:12:36.572Z | + zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
482 | 2024-02-02T03:12:36.573Z | + success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
483 | 2024-02-02T03:12:36.573Z | + set +x |
484 | 2024-02-02T03:12:36.573Z | ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
485 | 2024-02-02T03:12:36.573Z | + [[ zone == \z\o\n\e ]] |
486 | 2024-02-02T03:12:36.573Z | + ensure_simulated_links igb0 |
487 | 2024-02-02T03:12:36.573Z | + local PHYSICAL_LINK=igb0 |
488 | 2024-02-02T03:12:36.573Z | + INDICES=("0" "1") |
489 | 2024-02-02T03:12:36.573Z | + for I in "${INDICES[@]}" |
490 | 2024-02-02T03:12:36.574Z | ++ get_simnet_name_if_exists net0 |
491 | 2024-02-02T03:12:36.574Z | ++ dladm show-simnet -p -o LINK net0 |
492 | 2024-02-02T03:12:36.574Z | ++ echo '' |
493 | 2024-02-02T03:12:36.574Z | + [[ -z '' ]] |
494 | 2024-02-02T03:12:36.574Z | + dladm create-simnet -t net0 |
495 | 2024-02-02T03:12:36.574Z | + dladm create-simnet -t sc0_0 |
496 | 2024-02-02T03:12:36.574Z | + dladm modify-simnet -t -p net0 sc0_0 |
497 | 2024-02-02T03:12:36.574Z | + dladm set-linkprop -p mtu=9000 sc0_0 |
498 | 2024-02-02T03:12:36.574Z | + success 'Simnet net0/sc0_0 exists' |
499 | 2024-02-02T03:12:36.574Z | + set +x |
500 | 2024-02-02T03:12:36.575Z | Simnet net0/sc0_0 exists |
501 | 2024-02-02T03:12:36.575Z | + for I in "${INDICES[@]}" |
502 | 2024-02-02T03:12:36.575Z | ++ get_simnet_name_if_exists net1 |
503 | 2024-02-02T03:12:36.575Z | ++ dladm show-simnet -p -o LINK net1 |
504 | 2024-02-02T03:12:36.575Z | ++ echo '' |
505 | 2024-02-02T03:12:36.575Z | + [[ -z '' ]] |
506 | 2024-02-02T03:12:36.576Z | + dladm create-simnet -t net1 |
507 | 2024-02-02T03:12:36.576Z | + dladm create-simnet -t sc1_0 |
508 | 2024-02-02T03:12:36.576Z | + dladm modify-simnet -t -p net1 sc1_0 |
509 | 2024-02-02T03:12:36.576Z | + dladm set-linkprop -p mtu=9000 sc1_0 |
510 | 2024-02-02T03:12:36.576Z | + success 'Simnet net1/sc1_0 exists' |
511 | 2024-02-02T03:12:36.577Z | + set +x |
512 | 2024-02-02T03:12:36.577Z | Simnet net1/sc1_0 exists |
513 | 2024-02-02T03:12:36.577Z | ++ get_vnic_name_if_exists sc0_1 |
514 | 2024-02-02T03:12:36.577Z | ++ dladm show-vnic -p -o LINK sc0_1 |
515 | 2024-02-02T03:12:36.577Z | ++ echo '' |
516 | 2024-02-02T03:12:36.577Z | + [[ -z '' ]] |
517 | 2024-02-02T03:12:36.577Z | + dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d |
518 | 2024-02-02T03:12:36.577Z | + [[ -v PROMISC_FILT_OFF ]] |
519 | 2024-02-02T03:12:36.577Z | + success 'Vnic sc0_1 exists' |
520 | 2024-02-02T03:12:36.577Z | + set +x |
521 | 2024-02-02T03:12:36.577Z | Vnic sc0_1 exists |
522 | 2024-02-02T03:12:36.577Z | + warn_if_no_proxy_arp |
523 | 2024-02-02T03:12:36.577Z | + [[ -v PXA_START ]] |
524 | 2024-02-02T03:12:36.578Z | + [[ -v PXA_END ]] |
525 | 2024-02-02T03:12:36.578Z | + ensure_softnpu_zone |
526 | 2024-02-02T03:12:36.578Z | + zoneadm list |
527 | 2024-02-02T03:12:36.578Z | + grep -q sidecar_softnpu |
528 | 2024-02-02T03:12:36.578Z | + [[ -f out/npuzone/npuzone ]] |
529 | 2024-02-02T03:12:36.578Z | + out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092 |
530 | 2024-02-02T03:12:36.578Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt |
531 | 2024-02-02T03:12:46.901Z | downloading softnpu ...done |
532 | 2024-02-02T03:12:46.927Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt |
533 | 2024-02-02T03:12:54.015Z | downloading asic_program.so ...done |
534 | 2024-02-02T03:12:54.015Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt |
535 | 2024-02-02T03:13:14.549Z | downloading scadm ...done |
536 | 2024-02-02T03:13:14.578Z | creating port tfportrear0_0 for sc0_0 |
537 | 2024-02-02T03:13:14.578Z | creating port tfportqsfp0_0 for sc0_1 |
538 | 2024-02-02T03:13:14.578Z | softnpu zone setup |
539 | 2024-02-02T03:13:14.578Z | configure zone |
540 | 2024-02-02T03:13:14.604Z | install zone |
541 | 2024-02-02T03:13:15.625Z | boot zone |
542 | 2024-02-02T03:13:18.806Z | [sidecar_softnpu] svcs milestone/network |
543 | 2024-02-02T03:13:18.836Z | STATE STIME FMRI |
544 | 2024-02-02T03:13:18.836Z | online 3:13:17 svc:/milestone/network:default |
545 | 2024-02-02T03:13:18.836Z | [sidecar_softnpu] /softnpu/npu start |
546 | 2024-02-02T03:13:18.836Z | |
547 | 2024-02-02T03:13:18.836Z | + /opt/oxide/work/tools/scrimlet/softnpu-init.sh |
548 | 2024-02-02T03:13:18.836Z | + GATEWAY_IP=10.151.1.100 |
549 | 2024-02-02T03:13:18.836Z | + echo 'Using 10.151.1.100 as gateway ip' |
550 | 2024-02-02T03:13:18.837Z | Using 10.151.1.100 as gateway ip |
551 | 2024-02-02T03:13:18.837Z | + [[ ! -v GATEWAY_MAC ]] |
552 | 2024-02-02T03:13:18.837Z | + GATEWAY_MAC=18:c0:4d:0d:9f:b2 |
553 | 2024-02-02T03:13:18.837Z | ++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63 |
554 | 2024-02-02T03:13:18.837Z | +++ echo 18:c0:4d:0d:9f:b2 |
555 | 2024-02-02T03:13:18.837Z | + COUNT=1 |
556 | 2024-02-02T03:13:18.837Z | + [[ 1 -ne 1 ]] |
557 | 2024-02-02T03:13:18.837Z | + echo 'Using 18:c0:4d:0d:9f:b2 as gateway mac' |
558 | 2024-02-02T03:13:18.837Z | Using 18:c0:4d:0d:9f:b2 as gateway mac |
559 | 2024-02-02T03:13:18.837Z | + z_scadm add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2 |
560 | 2024-02-02T03:13:18.837Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.1.100 18:c0:4d:0d:9f:b2 |
561 | 2024-02-02T03:13:18.837Z | + PXA_MAC=a8:e1:de:01:70:1d |
562 | 2024-02-02T03:13:18.837Z | + [[ -v PXA_START ]] |
563 | 2024-02-02T03:13:18.837Z | + z_scadm add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d |
564 | 2024-02-02T03:13:18.837Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.1.164 10.151.1.227 a8:e1:de:01:70:1d |
565 | 2024-02-02T03:13:18.970Z | + z_scadm dump-state |
566 | 2024-02-02T03:13:18.970Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
567 | 2024-02-02T03:13:19.021Z | local v6: |
568 | 2024-02-02T03:13:19.021Z | local v4: |
569 | 2024-02-02T03:13:19.021Z | router v6: |
570 | 2024-02-02T03:13:19.021Z | router v4_idx: |
571 | 2024-02-02T03:13:19.021Z | router v4_routes: |
572 | 2024-02-02T03:13:19.022Z | resolver v4: |
573 | 2024-02-02T03:13:19.022Z | 10.151.1.100 -> 18:c0:4d:0d:9f:b2 |
574 | 2024-02-02T03:13:19.022Z | resolver v6: |
575 | 2024-02-02T03:13:19.022Z | nat v4: |
576 | 2024-02-02T03:13:19.022Z | nat_v6: |
577 | 2024-02-02T03:13:19.022Z | port_mac: |
578 | 2024-02-02T03:13:19.022Z | proxy arp: |
579 | 2024-02-02T03:13:19.022Z | 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d |
580 | 2024-02-02T03:13:19.022Z | + success 'softnpu zone exists' |
581 | 2024-02-02T03:13:19.022Z | + set +x |
582 | 2024-02-02T03:13:19.022Z | softnpu zone exists |
583 | 2024-02-02T03:13:19.022Z | |
584 | 2024-02-02T03:13:19.022Z | real 43.853576441 |
585 | 2024-02-02T03:13:19.022Z | user 0.689447674 |
586 | 2024-02-02T03:13:19.022Z | sys 1.513095112 |
587 | 2024-02-02T03:13:19.022Z | trap 0.000091271 |
588 | 2024-02-02T03:13:19.022Z | tflt 0.000186106 |
589 | 2024-02-02T03:13:19.022Z | dflt 0.001087738 |
590 | 2024-02-02T03:13:19.022Z | kflt 0.000000000 |
591 | 2024-02-02T03:13:19.022Z | lock 34:30.713061683 |
592 | 2024-02-02T03:13:19.022Z | slp 2:11.309538431 |
593 | 2024-02-02T03:13:19.022Z | lat 0.065675419 |
594 | 2024-02-02T03:13:19.022Z | stop 0.368018335 |
595 | 2024-02-02T03:13:19.022Z | + tar xf out/omicron-sled-agent.tar pkg/config-rss.toml |
596 | 2024-02-02T03:13:19.023Z | ++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
597 | 2024-02-02T03:13:19.023Z | + SILO_NAME=recovery |
598 | 2024-02-02T03:13:19.023Z | ++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
599 | 2024-02-02T03:13:19.023Z | + EXTERNAL_DNS_DOMAIN=oxide.test |
600 | 2024-02-02T03:13:19.023Z | + sed -i~ ' |
601 | 2024-02-02T03:13:19.023Z | /^external_dns_ips/c\ |
602 | 2024-02-02T03:13:19.023Z | external_dns_ips = [ "10.151.1.164", "10.151.1.165" ] |
603 | 2024-02-02T03:13:19.023Z | /^\[\[internal_services_ip_pool_ranges/,/^$/ { |
604 | 2024-02-02T03:13:19.023Z | /^first/c\ |
605 | 2024-02-02T03:13:19.023Z | first = "10.151.1.164" |
606 | 2024-02-02T03:13:19.023Z | /^last/c\ |
607 | 2024-02-02T03:13:19.023Z | last = "10.151.1.173" |
608 | 2024-02-02T03:13:19.023Z | } |
609 | 2024-02-02T03:13:19.023Z | /^\[rack_network_config/,/^$/ { |
610 | 2024-02-02T03:13:19.023Z | /^infra_ip_first/c\ |
611 | 2024-02-02T03:13:19.023Z | infra_ip_first = "10.151.1.174" |
612 | 2024-02-02T03:13:19.023Z | /^infra_ip_last/c\ |
613 | 2024-02-02T03:13:19.023Z | infra_ip_last = "10.151.1.174" |
614 | 2024-02-02T03:13:19.023Z | } |
615 | 2024-02-02T03:13:19.023Z | /^\[\[rack_network_config.ports/,/^$/ { |
616 | 2024-02-02T03:13:19.023Z | /^routes/c\ |
617 | 2024-02-02T03:13:19.023Z | routes = \[{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}\] |
618 | 2024-02-02T03:13:19.023Z | /^addresses/c\ |
619 | 2024-02-02T03:13:19.023Z | addresses = \["10.151.1.174/24"\] |
620 | 2024-02-02T03:13:19.023Z | } |
621 | 2024-02-02T03:13:19.024Z | ' pkg/config-rss.toml |
622 | 2024-02-02T03:13:19.024Z | + diff -u pkg/config-rss.toml~ pkg/config-rss.toml |
623 | 2024-02-02T03:13:19.024Z | --- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006 |
624 | 2024-02-02T03:13:19.024Z | +++ pkg/config-rss.toml Fri Feb 2 03:13:19 2024 |
625 | 2024-02-02T03:13:19.024Z | @@ -41,7 +41,7 @@ |
626 | 2024-02-02T03:13:19.024Z | # the DNS domain delegated to the rack by the customer. Each of these addresses |
627 | 2024-02-02T03:13:19.024Z | # must be contained in one of the "internal services" IP Pool ranges listed |
628 | 2024-02-02T03:13:19.024Z | # below. |
629 | 2024-02-02T03:13:19.024Z | -external_dns_ips = [ "192.168.1.20", "192.168.1.21" ] |
630 | 2024-02-02T03:13:19.024Z | +external_dns_ips = [ "10.151.1.164", "10.151.1.165" ] |
631 | 2024-02-02T03:13:19.024Z | |
632 | 2024-02-02T03:13:19.024Z | # Initial TLS certificates for the external API |
633 | 2024-02-02T03:13:19.024Z | # |
634 | 2024-02-02T03:13:19.024Z | @@ -77,8 +77,8 @@ |
635 | 2024-02-02T03:13:19.024Z | # |
636 | 2024-02-02T03:13:19.024Z | # For more on this and what to put here, see docs/how-to-run.adoc. |
637 | 2024-02-02T03:13:19.024Z | [[internal_services_ip_pool_ranges]] |
638 | 2024-02-02T03:13:19.024Z | -first = "192.168.1.20" |
639 | 2024-02-02T03:13:19.024Z | -last = "192.168.1.29" |
640 | 2024-02-02T03:13:19.024Z | +first = "10.151.1.164" |
641 | 2024-02-02T03:13:19.024Z | +last = "10.151.1.173" |
642 | 2024-02-02T03:13:19.024Z | |
643 | 2024-02-02T03:13:19.024Z | # TODO - this configuration is subject to change going forward. Ultimately these |
644 | 2024-02-02T03:13:19.024Z | # parameters should be provided to the control plane via wicket, but we need to |
645 | 2024-02-02T03:13:19.025Z | @@ -92,8 +92,8 @@ |
646 | 2024-02-02T03:13:19.025Z | # A range of IP addresses used by Boundary Services on the external network. In |
647 | 2024-02-02T03:13:19.025Z | # a real system, these would be addresses of the uplink ports on the Sidecar. |
648 | 2024-02-02T03:13:19.025Z | # With softnpu, only one address is used. |
649 | 2024-02-02T03:13:19.025Z | -infra_ip_first = "192.168.1.30" |
650 | 2024-02-02T03:13:19.025Z | -infra_ip_last = "192.168.1.30" |
651 | 2024-02-02T03:13:19.025Z | +infra_ip_first = "10.151.1.174" |
652 | 2024-02-02T03:13:19.025Z | +infra_ip_last = "10.151.1.174" |
653 | 2024-02-02T03:13:19.025Z | |
654 | 2024-02-02T03:13:19.025Z | # Configurations for BGP routers to run on the scrimlets. |
655 | 2024-02-02T03:13:19.025Z | bgp = [] |
656 | 2024-02-02T03:13:19.025Z | @@ -101,9 +101,9 @@ |
657 | 2024-02-02T03:13:19.025Z | # You can configure multiple uplinks by repeating the following stanza |
658 | 2024-02-02T03:13:19.025Z | [[rack_network_config.ports]] |
659 | 2024-02-02T03:13:19.025Z | # Routes associated with this port. |
660 | 2024-02-02T03:13:19.025Z | -routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}] |
661 | 2024-02-02T03:13:19.025Z | +routes = [{nexthop = "10.151.1.100", destination = "0.0.0.0/0"}] |
662 | 2024-02-02T03:13:19.025Z | # Addresses associated with this port. |
663 | 2024-02-02T03:13:19.025Z | -addresses = ["192.168.1.30/24"] |
664 | 2024-02-02T03:13:19.025Z | +addresses = ["10.151.1.174/24"] |
665 | 2024-02-02T03:13:19.025Z | # Name of the uplink port. This should always be "qsfp0" when using softnpu. |
666 | 2024-02-02T03:13:19.025Z | port = "qsfp0" |
667 | 2024-02-02T03:13:19.059Z | # The speed of this port. |
668 | 2024-02-02T03:13:19.059Z | + true |
669 | 2024-02-02T03:13:19.059Z | + tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml |
670 | 2024-02-02T03:13:19.059Z | a pkg/config-rss.toml 7K |
671 | 2024-02-02T03:13:19.059Z | + rm -f pkg/config-rss.toml pkg/config-rss.toml~ |
672 | 2024-02-02T03:13:19.059Z | + TLS_NAME=recovery.sys.oxide.test |
673 | 2024-02-02T03:13:19.059Z | + openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin |
674 | 2024-02-02T03:13:19.245Z | .+....+..+..........+..+...+....+........................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.+..+......+.......+.....+...+......+...+..........+...+...+.....+......+.+.....+....+.....+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..+......+.......+...........+.........+.+......+...............+...+...+..+............+...+.+.....+.+.....+......+...+.+.....+......+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
675 | 2024-02-02T03:13:19.946Z | .........+.........+......+..........+.........+...+.....+.........+....+..+...+......+.+...+......+...+............+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.........+....+..+..........+.........+...+..+...+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.........+...+..........+......+...+..+.........+.+......+..+...+....+.....+.............+........+.........+...............+......+...+.......+...............+..+.+......+.....+.........+.+...+..+......+.......+......+...........+.....................+.......+.....+...+..................+.......+...+.....+............+.......+...+.....+...+......+...+...+.........+.........+.+.........+...........................+...+......+...........+.......................................+.........+.+........+..........+...........+......+...+.......+......+........+....+..+...............+.+..+.......+...+.....+.......+......+...............+........+.+........+..................+.........+...................+...............+......+...+...+...+..+...+.+.....................+........+......+......+..........+...+.........+......+...........+...+......+.......+...+......+........+.......+......+.....+.......+..............................+......+.............................+......+.........+.+............+...+........................+......+.........+........+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
676 | 2024-02-02T03:13:19.971Z | ----- |
677 | 2024-02-02T03:13:19.971Z | + tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
678 | 2024-02-02T03:13:19.971Z | a pkg/initial-tls-cert.pem 2K |
679 | 2024-02-02T03:13:19.971Z | a pkg/initial-tls-key.pem 4K |
680 | 2024-02-02T03:13:19.971Z | + rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
681 | 2024-02-02T03:13:19.971Z | + rmdir pkg |
682 | 2024-02-02T03:13:19.971Z | + E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
683 | 2024-02-02T03:13:19.971Z | + pfexec mkdir -p /usr/oxide |
684 | 2024-02-02T03:13:19.971Z | + pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0 |
685 | 2024-02-02T03:13:20.700Z | + pfexec chmod +x /usr/oxide/oxide |
686 | 2024-02-02T03:13:20.740Z | + curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw |
687 | 2024-02-02T03:13:38.939Z | + OMICRON_NO_UNINSTALL=1 |
688 | 2024-02-02T03:13:38.939Z | + ptime -m pfexec ./target/release/omicron-package -t test install |
689 | 2024-02-02T03:13:38.966Z | Logging to: /opt/oxide/work/out/LOG |
690 | 2024-02-02T03:13:41.168Z | |
691 | 2024-02-02T03:13:41.210Z | real 0.512291606 |
692 | 2024-02-02T03:13:41.211Z | user 0.108329222 |
693 | 2024-02-02T03:13:41.211Z | sys 2.263608523 |
694 | 2024-02-02T03:13:41.211Z | trap 0.000005009 |
695 | 2024-02-02T03:13:41.211Z | tflt 0.000021439 |
696 | 2024-02-02T03:13:41.211Z | dflt 0.001609311 |
697 | 2024-02-02T03:13:41.211Z | kflt 0.000008020 |
698 | 2024-02-02T03:13:41.211Z | lock 46.270212713 |
699 | 2024-02-02T03:13:41.212Z | slp 0.733630221 |
700 | 2024-02-02T03:13:41.212Z | lat 0.003140247 |
701 | 2024-02-02T03:13:41.212Z | stop 0.215691085 |
702 | 2024-02-02T03:13:41.212Z | + retry=0 |
703 | 2024-02-02T03:13:41.212Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
704 | 2024-02-02T03:13:41.212Z | + [[ 0 -gt 30 ]] |
705 | 2024-02-02T03:13:41.212Z | + sleep 1 |
706 | 2024-02-02T03:13:41.293Z | + retry=1 |
707 | 2024-02-02T03:13:41.293Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
708 | 2024-02-02T03:13:41.293Z | + [[ 1 -gt 30 ]] |
709 | 2024-02-02T03:13:41.293Z | + sleep 1 |
710 | 2024-02-02T03:13:41.484Z | + retry=2 |
711 | 2024-02-02T03:13:41.484Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
712 | 2024-02-02T03:13:41.528Z | + [[ 2 -gt 30 ]] |
713 | 2024-02-02T03:13:41.528Z | + sleep 1 |
714 | 2024-02-02T03:13:42.497Z | + retry=3 |
715 | 2024-02-02T03:13:42.497Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
716 | 2024-02-02T03:13:42.522Z | + [[ 3 -gt 30 ]] |
717 | 2024-02-02T03:13:42.522Z | + sleep 1 |
718 | 2024-02-02T03:13:43.512Z | + retry=4 |
719 | 2024-02-02T03:13:43.512Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
720 | 2024-02-02T03:14:08.699Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
721 | 2024-02-02T03:14:08.726Z | local v6: |
722 | 2024-02-02T03:14:08.726Z | fd37:3afd:1e1:586e::1 |
723 | 2024-02-02T03:14:08.726Z | fe80::4f3:81ff:fee7:77b7 |
724 | 2024-02-02T03:14:08.726Z | local v4: |
725 | 2024-02-02T03:14:08.726Z | 10.151.1.174 |
726 | 2024-02-02T03:14:08.726Z | router v6: |
727 | 2024-02-02T03:14:08.726Z | fd00:1122:3344:3::/64 -> fe80::d4d7:7aff:fe66:24c1 (1) |
728 | 2024-02-02T03:14:08.726Z | fd00:1122:3344:101::/64 -> fe80::d4d7:7aff:fe66:24c1 (1) |
729 | 2024-02-02T03:14:08.727Z | fd00:1122:3344:2::/64 -> fe80::d4d7:7aff:fe66:24c1 (1) |
730 | 2024-02-02T03:14:08.727Z | fdb0:18c0:4d0d:9fb2::/64 -> fe80::d4d7:7aff:fe66:24c1 (1) |
731 | 2024-02-02T03:14:08.727Z | fd00:1122:3344:1::/64 -> fe80::d4d7:7aff:fe66:24c1 (1) |
732 | 2024-02-02T03:14:08.727Z | router v4_idx: |
733 | 2024-02-02T03:14:08.727Z | 0.0.0.0/0 -> 0 |
734 | 2024-02-02T03:14:08.727Z | router v4_routes: |
735 | 2024-02-02T03:14:08.727Z | 0 -> 10.151.1.100 (2) |
736 | 2024-02-02T03:14:08.727Z | resolver v4: |
737 | 2024-02-02T03:14:08.727Z | 10.151.1.174 -> 32:c7:e1:d3:2f:f8 |
738 | 2024-02-02T03:14:08.727Z | 10.151.1.100 -> 18:c0:4d:0d:9f:b2 |
739 | 2024-02-02T03:14:08.727Z | resolver v6: |
740 | 2024-02-02T03:14:08.727Z | fe80::4f3:81ff:fee7:77b7 -> 06:f3:81:e7:77:b7 |
741 | 2024-02-02T03:14:08.727Z | fe80::d4d7:7aff:fe66:24c1 -> d6:d7:7a:66:24:c1 |
742 | 2024-02-02T03:14:08.727Z | nat v4: |
743 | 2024-02-02T03:14:08.727Z | 10.151.1.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:9e:21 |
744 | 2024-02-02T03:14:08.727Z | nat_v6: |
745 | 2024-02-02T03:14:08.727Z | port_mac: |
746 | 2024-02-02T03:14:08.727Z | 1000: a8:40:25:26:bc:8c |
747 | 2024-02-02T03:14:08.727Z | 1: a8:40:25:26:bc:8d |
748 | 2024-02-02T03:14:08.727Z | proxy arp: |
749 | 2024-02-02T03:14:08.727Z | 10.151.1.164/10.151.1.227: a8:e1:de:01:70:1d |
750 | 2024-02-02T03:14:08.727Z | + retry=0 |
751 | 2024-02-02T03:14:08.752Z | +++ zoneadm list -n |
752 | 2024-02-02T03:14:08.753Z | +++ grep oxz_ntp |
753 | 2024-02-02T03:14:08.753Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
754 | 2024-02-02T03:14:08.753Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
755 | 2024-02-02T03:14:08.753Z | ++ true |
756 | 2024-02-02T03:14:08.753Z | + [[ '' != online ]] |
757 | 2024-02-02T03:14:08.753Z | + [[ 0 -gt 60 ]] |
758 | 2024-02-02T03:14:08.753Z | + sleep 1 |
759 | 2024-02-02T03:14:09.753Z | + retry=1 |
760 | 2024-02-02T03:14:09.780Z | +++ zoneadm list -n |
761 | 2024-02-02T03:14:09.780Z | +++ grep oxz_ntp |
762 | 2024-02-02T03:14:09.780Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
763 | 2024-02-02T03:14:09.780Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
764 | 2024-02-02T03:14:09.780Z | ++ true |
765 | 2024-02-02T03:14:09.805Z | + [[ '' != online ]] |
766 | 2024-02-02T03:14:09.805Z | + [[ 1 -gt 60 ]] |
767 | 2024-02-02T03:14:09.805Z | + sleep 1 |
768 | 2024-02-02T03:14:10.785Z | + retry=2 |
769 | 2024-02-02T03:14:10.814Z | +++ zoneadm list -n |
770 | 2024-02-02T03:14:10.814Z | +++ grep oxz_ntp |
771 | 2024-02-02T03:14:10.814Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
772 | 2024-02-02T03:14:10.814Z | + [[ disabled != online ]] |
773 | 2024-02-02T03:14:10.814Z | + [[ 2 -gt 60 ]] |
774 | 2024-02-02T03:14:10.814Z | + sleep 1 |
775 | 2024-02-02T03:14:11.807Z | + retry=3 |
776 | 2024-02-02T03:14:11.835Z | +++ zoneadm list -n |
777 | 2024-02-02T03:14:11.835Z | +++ grep oxz_ntp |
778 | 2024-02-02T03:14:11.836Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
779 | 2024-02-02T03:14:11.836Z | + [[ disabled != online ]] |
780 | 2024-02-02T03:14:11.836Z | + [[ 3 -gt 60 ]] |
781 | 2024-02-02T03:14:11.836Z | + sleep 1 |
782 | 2024-02-02T03:14:12.828Z | + retry=4 |
783 | 2024-02-02T03:14:12.855Z | +++ zoneadm list -n |
784 | 2024-02-02T03:14:12.856Z | +++ grep oxz_ntp |
785 | 2024-02-02T03:14:12.856Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
786 | 2024-02-02T03:14:12.856Z | + [[ disabled != online ]] |
787 | 2024-02-02T03:14:12.857Z | + [[ 4 -gt 60 ]] |
788 | 2024-02-02T03:14:12.857Z | + sleep 1 |
789 | 2024-02-02T03:14:13.853Z | + retry=5 |
790 | 2024-02-02T03:14:13.890Z | +++ zoneadm list -n |
791 | 2024-02-02T03:14:13.890Z | +++ grep oxz_ntp |
792 | 2024-02-02T03:14:13.890Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
793 | 2024-02-02T03:14:13.890Z | + [[ disabled != online ]] |
794 | 2024-02-02T03:14:13.890Z | + [[ 5 -gt 60 ]] |
795 | 2024-02-02T03:14:13.890Z | + sleep 1 |
796 | 2024-02-02T03:14:14.878Z | + retry=6 |
797 | 2024-02-02T03:14:14.906Z | +++ zoneadm list -n |
798 | 2024-02-02T03:14:14.906Z | +++ grep oxz_ntp |
799 | 2024-02-02T03:14:14.906Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
800 | 2024-02-02T03:14:14.906Z | + [[ disabled != online ]] |
801 | 2024-02-02T03:14:14.906Z | + [[ 6 -gt 60 ]] |
802 | 2024-02-02T03:14:14.906Z | + sleep 1 |
803 | 2024-02-02T03:14:15.897Z | + retry=7 |
804 | 2024-02-02T03:14:15.927Z | +++ zoneadm list -n |
805 | 2024-02-02T03:14:15.927Z | +++ grep oxz_ntp |
806 | 2024-02-02T03:14:15.927Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
807 | 2024-02-02T03:14:15.927Z | + [[ disabled != online ]] |
808 | 2024-02-02T03:14:15.927Z | + [[ 7 -gt 60 ]] |
809 | 2024-02-02T03:14:15.927Z | + sleep 1 |
|
810 | 2024-02-02T03:14:16.813Z | Feb 2 03:14:17 buskin ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast |
|
811 | 2024-02-02T03:14:16.916Z | + retry=8 |
812 | 2024-02-02T03:14:16.941Z | +++ zoneadm list -n |
813 | 2024-02-02T03:14:16.941Z | +++ grep oxz_ntp |
814 | 2024-02-02T03:14:16.941Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
815 | 2024-02-02T03:14:16.941Z | + [[ disabled != online ]] |
816 | 2024-02-02T03:14:16.941Z | + [[ 8 -gt 60 ]] |
817 | 2024-02-02T03:14:16.941Z | + sleep 1 |
818 | 2024-02-02T03:14:17.944Z | + retry=9 |
819 | 2024-02-02T03:14:17.969Z | +++ zoneadm list -n |
820 | 2024-02-02T03:14:17.969Z | +++ grep oxz_ntp |
821 | 2024-02-02T03:14:17.969Z | ++ pfexec svcs -z oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4 -Hostate oxide/ntp |
822 | 2024-02-02T03:14:17.969Z | + [[ online != online ]] |
823 | 2024-02-02T03:14:17.969Z | + echo 'Waited for chrony: 9s' |
824 | 2024-02-02T03:14:17.969Z | Waited for chrony: 9s |
825 | 2024-02-02T03:14:17.969Z | + export RUST_BACKTRACE=1 |
826 | 2024-02-02T03:14:17.969Z | + RUST_BACKTRACE=1 |
827 | 2024-02-02T03:14:17.969Z | + export E2E_TLS_CERT IPPOOL_START IPPOOL_END |
828 | 2024-02-02T03:14:17.969Z | ++ ./tests/bootstrap |
829 | 2024-02-02T03:14:17.993Z | Using external DNS server at 10.151.1.164:53 |
830 | 2024-02-02T03:14:17.994Z | 2024-02-02 03:14:18.563687909 UTC: attempting to log into API |
831 | 2024-02-02T03:14:33.029Z | 2024-02-02 03:14:33.368064143 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
832 | 2024-02-02T03:14:34.034Z | 2024-02-02 03:14:34.369876992 UTC: attempting to log into API |
833 | 2024-02-02T03:14:49.066Z | 2024-02-02 03:14:49.403219275 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
834 | 2024-02-02T03:14:50.069Z | 2024-02-02 03:14:50.404996625 UTC: attempting to log into API |
835 | 2024-02-02T03:15:05.101Z | 2024-02-02 03:15:05.437350630 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
836 | 2024-02-02T03:15:06.100Z | 2024-02-02 03:15:06.438182821 UTC: attempting to log into API |
837 | 2024-02-02T03:15:21.133Z | 2024-02-02 03:15:21.470903499 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
838 | 2024-02-02T03:15:22.539Z | 2024-02-02 03:15:22.472629748 UTC: attempting to log into API |
839 | 2024-02-02T03:15:37.169Z | 2024-02-02 03:15:36.918254141 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
840 | 2024-02-02T03:15:38.170Z | 2024-02-02 03:15:37.919020981 UTC: attempting to log into API |
841 | 2024-02-02T03:15:53.619Z | 2024-02-02 03:15:52.951761440 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
842 | 2024-02-02T03:15:54.204Z | 2024-02-02 03:15:53.952571361 UTC: attempting to log into API |
843 | 2024-02-02T03:16:09.237Z | 2024-02-02 03:16:08.985872484 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
844 | 2024-02-02T03:16:10.244Z | 2024-02-02 03:16:09.986596894 UTC: attempting to log into API |
845 | 2024-02-02T03:16:25.938Z | 2024-02-02 03:16:25.019331352 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
846 | 2024-02-02T03:16:26.274Z | 2024-02-02 03:16:26.020161814 UTC: attempting to log into API |
847 | 2024-02-02T03:16:41.306Z | 2024-02-02 03:16:41.085740581 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
848 | 2024-02-02T03:16:42.306Z | 2024-02-02 03:16:42.090084883 UTC: attempting to log into API |
849 | 2024-02-02T03:16:57.753Z | 2024-02-02 03:16:57.163429571 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
850 | 2024-02-02T03:16:58.341Z | 2024-02-02 03:16:58.167322414 UTC: attempting to log into API |
851 | 2024-02-02T03:17:13.376Z | 2024-02-02 03:17:13.241224131 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
852 | 2024-02-02T03:17:14.381Z | 2024-02-02 03:17:14.244722399 UTC: attempting to log into API |
853 | 2024-02-02T03:17:29.411Z | 2024-02-02 03:17:29.318317088 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
854 | 2024-02-02T03:17:30.418Z | 2024-02-02 03:17:30.321888997 UTC: attempting to log into API |
855 | 2024-02-02T03:17:45.446Z | 2024-02-02 03:17:45.396754450 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
856 | 2024-02-02T03:17:46.444Z | 2024-02-02 03:17:46.401012444 UTC: attempting to log into API |
857 | 2024-02-02T03:18:01.493Z | 2024-02-02 03:18:01.467018144 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
858 | 2024-02-02T03:18:02.481Z | 2024-02-02 03:18:02.468942544 UTC: attempting to log into API |
859 | 2024-02-02T03:18:18.444Z | 2024-02-02 03:18:17.503179163 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
860 | 2024-02-02T03:18:18.606Z | 2024-02-02 03:18:18.506322453 UTC: attempting to log into API |
861 | 2024-02-02T03:18:33.595Z | 2024-02-02 03:18:33.558041287 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
862 | 2024-02-02T03:18:34.574Z | 2024-02-02 03:18:34.559071390 UTC: attempting to log into API |
863 | 2024-02-02T03:18:50.078Z | 2024-02-02 03:18:49.592566072 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
864 | 2024-02-02T03:18:51.245Z | 2024-02-02 03:18:50.593228602 UTC: attempting to log into API |
865 | 2024-02-02T03:19:18.810Z | 2024-02-02 03:19:05.627200148 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
866 | 2024-02-02T03:19:18.810Z | 2024-02-02 03:19:06.629234299 UTC: attempting to log into API |
867 | 2024-02-02T03:19:21.680Z | 2024-02-02 03:19:21.664560897 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
868 | 2024-02-02T03:19:22.689Z | 2024-02-02 03:19:22.665959002 UTC: attempting to log into API |
869 | 2024-02-02T03:19:37.731Z | 2024-02-02 03:19:37.716361151 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
870 | 2024-02-02T03:19:38.731Z | 2024-02-02 03:19:38.716750339 UTC: attempting to log into API |
|
871 | 2024-02-02T03:19:40.181Z | Feb 2 03:19:39 buskin ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast |
872 | 2024-02-02T03:19:46.318Z | Feb 2 03:19:46 buskin ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast |
873 | 2024-02-02T03:19:52.447Z | Feb 2 03:19:51 buskin ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast |
|
874 | 2024-02-02T03:19:53.769Z | 2024-02-02 03:19:53.752450043 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
875 | 2024-02-02T03:19:54.768Z | 2024-02-02 03:19:54.753134632 UTC: attempting to log into API |
876 | 2024-02-02T03:20:09.807Z | 2024-02-02 03:20:09.786164881 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
877 | 2024-02-02T03:20:10.806Z | 2024-02-02 03:20:10.787202944 UTC: attempting to log into API |
|
878 | 2024-02-02T03:20:14.779Z | Feb 2 03:19:57 buskin ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast |
879 | 2024-02-02T03:20:14.820Z | Feb 2 03:20:04 buskin ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast |
|
880 | 2024-02-02T03:20:21.776Z | 2024-02-02 03:20:21.598000747 UTC: login succeeded |
881 | 2024-02-02T03:20:21.919Z | waiting for nexus to come up... |
882 | 2024-02-02T03:20:21.919Z | creating IP pool... 10.151.1.175 - 10.151.1.227 |
883 | 2024-02-02T03:20:21.947Z | setting up quotas... |
884 | 2024-02-02T03:20:21.972Z | ensuring datasets are ready... |
885 | 2024-02-02T03:20:29.013Z | let's roll. |
886 | 2024-02-02T03:20:29.416Z | + eval 'OXIDE_HOST=https://recovery.sys.oxide.test |
887 | 2024-02-02T03:20:29.417Z | OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166 |
888 | 2024-02-02T03:20:29.417Z | OXIDE_TOKEN=oxide-token-741421d2af144595b3e463d6312383d8afd30f6e' |
889 | 2024-02-02T03:20:29.417Z | ++ OXIDE_HOST=https://recovery.sys.oxide.test |
890 | 2024-02-02T03:20:29.417Z | ++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.1.166 |
891 | 2024-02-02T03:20:29.417Z | ++ OXIDE_TOKEN=oxide-token-741421d2af144595b3e463d6312383d8afd30f6e |
892 | 2024-02-02T03:20:29.417Z | + export OXIDE_HOST OXIDE_TOKEN |
893 | 2024-02-02T03:20:29.417Z | + retry=0 |
894 | 2024-02-02T03:20:29.417Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
895 | 2024-02-02T03:20:29.417Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images' |
896 | 2024-02-02T03:20:29.417Z | {"status":"ok"}success |
897 | 2024-02-02T03:20:29.417Z | Project { |
898 | 2024-02-02T03:20:29.417Z | description: "some images", |
899 | 2024-02-02T03:20:29.417Z | id: e50403dc-d229-465e-a9bd-c8e2315a3a99, |
900 | 2024-02-02T03:20:29.417Z | name: Name( |
901 | 2024-02-02T03:20:29.417Z | "images", |
902 | 2024-02-02T03:20:29.417Z | ), |
903 | 2024-02-02T03:20:29.417Z | time_created: 2024-02-02T03:20:24.807380Z, |
904 | 2024-02-02T03:20:29.417Z | time_modified: 2024-02-02T03:20:24.807380Z, |
905 | 2024-02-02T03:20:29.417Z | } |
906 | 2024-02-02T03:20:29.417Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 |
907 | 2024-02-02T03:26:21.907Z | done! |
908 | 2024-02-02T03:26:22.005Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.1.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11 |
909 | 2024-02-02T03:26:22.104Z | success |
910 | 2024-02-02T03:26:22.104Z | Image { |
911 | 2024-02-02T03:26:22.104Z | block_size: ByteCount( |
912 | 2024-02-02T03:26:22.104Z | 512, |
913 | 2024-02-02T03:26:22.104Z | ), |
914 | 2024-02-02T03:26:22.138Z | description: "debian 11 original base image", |
915 | 2024-02-02T03:26:22.139Z | digest: None, |
916 | 2024-02-02T03:26:22.139Z | id: 2cbeae47-63cb-456a-b759-0b5555b1ae94, |
917 | 2024-02-02T03:26:22.139Z | name: Name( |
918 | 2024-02-02T03:26:22.139Z | "debian11", |
919 | 2024-02-02T03:26:22.139Z | ), |
920 | 2024-02-02T03:26:22.139Z | os: "debian", |
921 | 2024-02-02T03:26:22.139Z | project_id: None, |
922 | 2024-02-02T03:26:22.139Z | size: ByteCount( |
923 | 2024-02-02T03:26:22.139Z | 2147483648, |
924 | 2024-02-02T03:26:22.139Z | ), |
925 | 2024-02-02T03:26:22.139Z | time_created: 2024-02-02T03:26:21.871292Z, |
926 | 2024-02-02T03:26:22.139Z | time_modified: 2024-02-02T03:26:22.079154Z, |
927 | 2024-02-02T03:26:22.139Z | url: None, |
928 | 2024-02-02T03:26:22.139Z | version: "11", |
929 | 2024-02-02T03:26:22.139Z | } |
930 | 2024-02-02T03:26:22.139Z | + rm ./tests/bootstrap |
931 | 2024-02-02T03:26:22.176Z | + for test_bin in tests/* |
932 | 2024-02-02T03:26:22.176Z | + ./tests/bootstrap-4fa0aa7f5e8d8c20 |
933 | 2024-02-02T03:26:22.216Z | |
934 | 2024-02-02T03:26:22.216Z | running 0 tests |
935 | 2024-02-02T03:26:22.245Z | |
936 | 2024-02-02T03:26:22.245Z | test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s |
937 | 2024-02-02T03:26:22.245Z | |
938 | 2024-02-02T03:26:22.245Z | + for test_bin in tests/* |
939 | 2024-02-02T03:26:22.245Z | + ./tests/end_to_end_tests-378ef3b1593728ce |
940 | 2024-02-02T03:26:22.320Z | |
941 | 2024-02-02T03:26:22.320Z | running 2 tests |
942 | 2024-02-02T03:26:22.556Z | test no_spoof::no_spoof_here ... ok |
943 | 2024-02-02T03:26:57.116Z | test instance_launch::instance_launch ... ok |
944 | 2024-02-02T03:26:57.142Z | |
945 | 2024-02-02T03:26:57.142Z | test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 34.80s |
946 | 2024-02-02T03:26:57.143Z | |
947 | 2024-02-02T03:26:57.143Z | + _exit_trap |
948 | 2024-02-02T03:26:57.143Z | + local status=0 |
949 | 2024-02-02T03:26:57.143Z | + [[ 0 -eq 0 ]] |
950 | 2024-02-02T03:26:57.144Z | + exit 0 |
951 | 2024-02-02T03:26:57.144Z | process exited: duration 913767 ms, exit code 0 |
|
952 | 2024-02-02T03:26:57.281Z | found 85 output files |
953 | 2024-02-02T03:26:57.281Z | uploading: /var/svc/log/oxide-sled-agent:default.log (751265 bytes) |
954 | 2024-02-02T03:26:59.765Z | uploaded: /var/svc/log/oxide-sled-agent:default.log |
955 | 2024-02-02T03:26:59.794Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (2994010 bytes) |
956 | 2024-02-02T03:27:03.473Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 2994010 -> 3020381 |
957 | 2024-02-02T03:27:04.547Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log |
958 | 2024-02-02T03:27:04.547Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (315900 bytes) |
959 | 2024-02-02T03:27:05.965Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 |
960 | 2024-02-02T03:27:05.965Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (102153 bytes) |
961 | 2024-02-02T03:27:06.163Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log" changed size mid upload: 102153 -> 103404 |
962 | 2024-02-02T03:27:07.241Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log |
963 | 2024-02-02T03:27:07.242Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (12732 bytes) |
964 | 2024-02-02T03:27:08.370Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 |
965 | 2024-02-02T03:27:08.370Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (122210 bytes) |
966 | 2024-02-02T03:27:08.556Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log" changed size mid upload: 122210 -> 125041 |
967 | 2024-02-02T03:27:09.642Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log |
968 | 2024-02-02T03:27:09.643Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (16565 bytes) |
969 | 2024-02-02T03:27:10.784Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 |
970 | 2024-02-02T03:27:10.784Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1497235 bytes) |
971 | 2024-02-02T03:27:11.912Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1497235 -> 1528392 |
972 | 2024-02-02T03:27:12.989Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log |
973 | 2024-02-02T03:27:12.989Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (149506 bytes) |
974 | 2024-02-02T03:27:14.384Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 |
975 | 2024-02-02T03:27:14.385Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (935222 bytes) |
976 | 2024-02-02T03:27:15.117Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 935222 -> 954612 |
977 | 2024-02-02T03:27:16.233Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log |
978 | 2024-02-02T03:27:16.233Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (80527 bytes) |
979 | 2024-02-02T03:27:17.461Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 |
980 | 2024-02-02T03:27:17.461Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes) |
981 | 2024-02-02T03:27:18.599Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log |
982 | 2024-02-02T03:27:18.599Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes) |
983 | 2024-02-02T03:27:19.702Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 |
984 | 2024-02-02T03:27:19.702Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (346524 bytes) |
985 | 2024-02-02T03:27:20.521Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 346524 -> 357106 |
986 | 2024-02-02T03:27:21.605Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log |
987 | 2024-02-02T03:27:21.605Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (30101 bytes) |
988 | 2024-02-02T03:27:23.274Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 |
989 | 2024-02-02T03:27:23.274Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes) |
990 | 2024-02-02T03:27:24.349Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log |
991 | 2024-02-02T03:27:24.349Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes) |
992 | 2024-02-02T03:27:25.454Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 |
993 | 2024-02-02T03:27:25.455Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (19125 bytes) |
994 | 2024-02-02T03:27:25.978Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log" changed size mid upload: 19125 -> 19922 |
995 | 2024-02-02T03:27:27.054Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log |
996 | 2024-02-02T03:27:27.054Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (6987 bytes) |
997 | 2024-02-02T03:27:28.176Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 |
998 | 2024-02-02T03:27:28.176Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_348ff6f1-1bf1-4c0e-ba53-2fa860e9379b/root/var/svc/log/oxide-clickhouse:default.log (788220 bytes) |
999 | 2024-02-02T03:27:29.329Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_348ff6f1-1bf1-4c0e-ba53-2fa860e9379b/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 788220 -> 852402 |
1000 | 2024-02-02T03:27:30.401Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_348ff6f1-1bf1-4c0e-ba53-2fa860e9379b/root/var/svc/log/oxide-clickhouse:default.log |
1001 | 2024-02-02T03:27:30.402Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_348ff6f1-1bf1-4c0e-ba53-2fa860e9379b/root/var/svc/log/oxide-zone-network-setup:default.log (1708 bytes) |
1002 | 2024-02-02T03:27:31.499Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_348ff6f1-1bf1-4c0e-ba53-2fa860e9379b/root/var/svc/log/oxide-zone-network-setup:default.log |
1003 | 2024-02-02T03:27:31.499Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_55bf3ccb-3ee9-4a5c-b9c8-ff6e61b6cae6/root/var/svc/log/oxide-cockroachdb:default.log (4408 bytes) |
1004 | 2024-02-02T03:27:32.615Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_55bf3ccb-3ee9-4a5c-b9c8-ff6e61b6cae6/root/var/svc/log/oxide-cockroachdb:default.log |
1005 | 2024-02-02T03:27:32.615Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_55bf3ccb-3ee9-4a5c-b9c8-ff6e61b6cae6/root/var/svc/log/oxide-zone-network-setup:default.log (1710 bytes) |
1006 | 2024-02-02T03:27:33.724Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_55bf3ccb-3ee9-4a5c-b9c8-ff6e61b6cae6/root/var/svc/log/oxide-zone-network-setup:default.log |
1007 | 2024-02-02T03:27:33.724Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_14a41c99-5d3b-43d0-bc7f-44355e6a8df4/root/var/svc/log/oxide-crucible-agent:default.log (3435 bytes) |
1008 | 2024-02-02T03:27:34.841Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_14a41c99-5d3b-43d0-bc7f-44355e6a8df4/root/var/svc/log/oxide-crucible-agent:default.log |
1009 | 2024-02-02T03:27:34.841Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_14a41c99-5d3b-43d0-bc7f-44355e6a8df4/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1010 | 2024-02-02T03:27:35.944Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_14a41c99-5d3b-43d0-bc7f-44355e6a8df4/root/var/svc/log/oxide-crucible-downstairs:default.log |
1011 | 2024-02-02T03:27:35.944Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_30ac3b78-37a6-47ce-91a9-2963356cf58a/root/var/svc/log/oxide-external_dns:default.log (26945 bytes) |
1012 | 2024-02-02T03:27:36.063Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_30ac3b78-37a6-47ce-91a9-2963356cf58a/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26945 -> 30722 |
1013 | 2024-02-02T03:27:37.147Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_30ac3b78-37a6-47ce-91a9-2963356cf58a/root/var/svc/log/oxide-external_dns:default.log |
1014 | 2024-02-02T03:27:37.147Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4f5fe18a-4d8d-4ac4-8886-31f22a291127/root/var/svc/log/oxide-internal_dns:default.log (103162 bytes) |
1015 | 2024-02-02T03:27:37.386Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4f5fe18a-4d8d-4ac4-8886-31f22a291127/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 103162 -> 106918 |
1016 | 2024-02-02T03:27:38.477Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4f5fe18a-4d8d-4ac4-8886-31f22a291127/root/var/svc/log/oxide-internal_dns:default.log |
1017 | 2024-02-02T03:27:38.477Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4f5fe18a-4d8d-4ac4-8886-31f22a291127/root/var/svc/log/oxide-internal_dns:default.log.0 (7536 bytes) |
1018 | 2024-02-02T03:27:39.604Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_4f5fe18a-4d8d-4ac4-8886-31f22a291127/root/var/svc/log/oxide-internal_dns:default.log.0 |
1019 | 2024-02-02T03:27:39.604Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_53fc7ec7-6b35-4853-ad4a-3310d65bc67f/root/var/svc/log/oxide-oximeter:default.log (247510 bytes) |
1020 | 2024-02-02T03:27:40.040Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_53fc7ec7-6b35-4853-ad4a-3310d65bc67f/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 247510 -> 275387 |
1021 | 2024-02-02T03:27:41.123Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_53fc7ec7-6b35-4853-ad4a-3310d65bc67f/root/var/svc/log/oxide-oximeter:default.log |
1022 | 2024-02-02T03:27:41.123Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_53fc7ec7-6b35-4853-ad4a-3310d65bc67f/root/var/svc/log/oxide-zone-network-setup:default.log (1697 bytes) |
1023 | 2024-02-02T03:27:42.635Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_oximeter_53fc7ec7-6b35-4853-ad4a-3310d65bc67f/root/var/svc/log/oxide-zone-network-setup:default.log |
1024 | 2024-02-02T03:27:42.635Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_5fa5b8e5-75bb-44b3-bdce-b6977a5c7e58/root/var/svc/log/oxide-cockroachdb:default.log (4408 bytes) |
1025 | 2024-02-02T03:27:43.741Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_5fa5b8e5-75bb-44b3-bdce-b6977a5c7e58/root/var/svc/log/oxide-cockroachdb:default.log |
1026 | 2024-02-02T03:27:43.741Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_5fa5b8e5-75bb-44b3-bdce-b6977a5c7e58/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes) |
1027 | 2024-02-02T03:27:44.859Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_5fa5b8e5-75bb-44b3-bdce-b6977a5c7e58/root/var/svc/log/oxide-zone-network-setup:default.log |
1028 | 2024-02-02T03:27:44.859Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-agent:default.log (28676 bytes) |
1029 | 2024-02-02T03:27:46.023Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-agent:default.log |
1030 | 2024-02-02T03:27:46.023Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1031 | 2024-02-02T03:27:47.138Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-downstairs:default.log |
1032 | 2024-02-02T03:27:47.138Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-downstairs:downstairs-21e4aec7-7ba3-41ec-9549-6b6ca2f0b3dd.log (2943 bytes) |
1033 | 2024-02-02T03:27:48.234Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-downstairs:downstairs-21e4aec7-7ba3-41ec-9549-6b6ca2f0b3dd.log |
1034 | 2024-02-02T03:27:48.234Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-downstairs:downstairs-616c8f13-4b1a-4fce-932f-30f898d60b1a.log (5623 bytes) |
1035 | 2024-02-02T03:27:49.337Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-downstairs:downstairs-616c8f13-4b1a-4fce-932f-30f898d60b1a.log |
1036 | 2024-02-02T03:27:49.337Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-downstairs:snapshot-616c8f13-4b1a-4fce-932f-30f898d60b1a-67e3f87d-f7ac-4c8e-a7f9-d0b6f02f8cba.log (5180 bytes) |
1037 | 2024-02-02T03:27:50.447Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5c1ddb1b-ccc1-48a1-90b0-5d6c264bfa2a/root/var/svc/log/oxide-crucible-downstairs:snapshot-616c8f13-4b1a-4fce-932f-30f898d60b1a-67e3f87d-f7ac-4c8e-a7f9-d0b6f02f8cba.log |
1038 | 2024-02-02T03:27:50.448Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_502c734e-4a17-49a0-a04b-e3804beb4df6/root/var/svc/log/oxide-external_dns:default.log (26946 bytes) |
1039 | 2024-02-02T03:27:50.544Z | upload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_502c734e-4a17-49a0-a04b-e3804beb4df6/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 26946 -> 30721 |
1040 | 2024-02-02T03:27:51.619Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_502c734e-4a17-49a0-a04b-e3804beb4df6/root/var/svc/log/oxide-external_dns:default.log |
1041 | 2024-02-02T03:27:51.619Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0298f24c-9439-4ebe-8e21-97865df71c75/root/var/svc/log/oxide-internal_dns:default.log (103168 bytes) |
1042 | 2024-02-02T03:27:51.832Z | upload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0298f24c-9439-4ebe-8e21-97865df71c75/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 103168 -> 106925 |
1043 | 2024-02-02T03:27:52.930Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0298f24c-9439-4ebe-8e21-97865df71c75/root/var/svc/log/oxide-internal_dns:default.log |
1044 | 2024-02-02T03:27:52.930Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0298f24c-9439-4ebe-8e21-97865df71c75/root/var/svc/log/oxide-internal_dns:default.log.0 (9161 bytes) |
1045 | 2024-02-02T03:27:54.101Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_0298f24c-9439-4ebe-8e21-97865df71c75/root/var/svc/log/oxide-internal_dns:default.log.0 |
1046 | 2024-02-02T03:27:54.101Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_78fbf059-aec9-4f39-b88f-72adf16cf12b/root/var/svc/log/oxide-cockroachdb:default.log (4408 bytes) |
1047 | 2024-02-02T03:27:55.216Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_78fbf059-aec9-4f39-b88f-72adf16cf12b/root/var/svc/log/oxide-cockroachdb:default.log |
1048 | 2024-02-02T03:27:55.217Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_78fbf059-aec9-4f39-b88f-72adf16cf12b/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes) |
1049 | 2024-02-02T03:27:56.322Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_78fbf059-aec9-4f39-b88f-72adf16cf12b/root/var/svc/log/oxide-zone-network-setup:default.log |
1050 | 2024-02-02T03:27:56.351Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_5f05ad59-a7f0-4780-a071-ed2775cdf0d9/root/var/svc/log/oxide-crucible-agent:default.log (24361 bytes) |
1051 | 2024-02-02T03:27:57.475Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_5f05ad59-a7f0-4780-a071-ed2775cdf0d9/root/var/svc/log/oxide-crucible-agent:default.log |
1052 | 2024-02-02T03:27:57.475Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_5f05ad59-a7f0-4780-a071-ed2775cdf0d9/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1053 | 2024-02-02T03:27:58.579Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_5f05ad59-a7f0-4780-a071-ed2775cdf0d9/root/var/svc/log/oxide-crucible-downstairs:default.log |
1054 | 2024-02-02T03:27:58.579Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_5f05ad59-a7f0-4780-a071-ed2775cdf0d9/root/var/svc/log/oxide-crucible-downstairs:downstairs-c5a77696-8e4c-4173-9c96-651848a0454b.log (5530 bytes) |
1055 | 2024-02-02T03:27:59.679Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_5f05ad59-a7f0-4780-a071-ed2775cdf0d9/root/var/svc/log/oxide-crucible-downstairs:downstairs-c5a77696-8e4c-4173-9c96-651848a0454b.log |
1056 | 2024-02-02T03:27:59.679Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_5f05ad59-a7f0-4780-a071-ed2775cdf0d9/root/var/svc/log/oxide-crucible-downstairs:downstairs-cb3359ee-835b-4d7d-a8b0-d004931577a8.log (3049 bytes) |
1057 | 2024-02-02T03:28:00.774Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_5f05ad59-a7f0-4780-a071-ed2775cdf0d9/root/var/svc/log/oxide-crucible-downstairs:downstairs-cb3359ee-835b-4d7d-a8b0-d004931577a8.log |
1058 | 2024-02-02T03:28:00.774Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_1bcd2619-aa8a-49c7-b8bf-d52fab0e71d9/root/var/svc/log/oxide-crucible-pantry:default.log (2338 bytes) |
1059 | 2024-02-02T03:28:01.871Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_pantry_1bcd2619-aa8a-49c7-b8bf-d52fab0e71d9/root/var/svc/log/oxide-crucible-pantry:default.log |
1060 | 2024-02-02T03:28:01.871Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_f176cc3a-d69c-446d-927e-39ae8db5a39c/root/var/svc/log/oxide-internal_dns:default.log (103158 bytes) |
1061 | 2024-02-02T03:28:02.489Z | upload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_f176cc3a-d69c-446d-927e-39ae8db5a39c/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 103158 -> 106914 |
1062 | 2024-02-02T03:28:03.234Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_f176cc3a-d69c-446d-927e-39ae8db5a39c/root/var/svc/log/oxide-internal_dns:default.log |
1063 | 2024-02-02T03:28:03.234Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_f176cc3a-d69c-446d-927e-39ae8db5a39c/root/var/svc/log/oxide-internal_dns:default.log.0 (5998 bytes) |
1064 | 2024-02-02T03:28:04.343Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_f176cc3a-d69c-446d-927e-39ae8db5a39c/root/var/svc/log/oxide-internal_dns:default.log.0 |
1065 | 2024-02-02T03:28:04.343Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_632ffcfb-8557-4efc-9009-17a48d1c4f52/root/var/svc/log/oxide-cockroachdb:default.log (4408 bytes) |
1066 | 2024-02-02T03:28:05.456Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_632ffcfb-8557-4efc-9009-17a48d1c4f52/root/var/svc/log/oxide-cockroachdb:default.log |
1067 | 2024-02-02T03:28:05.456Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_632ffcfb-8557-4efc-9009-17a48d1c4f52/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes) |
1068 | 2024-02-02T03:28:08.281Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_632ffcfb-8557-4efc-9009-17a48d1c4f52/root/var/svc/log/oxide-zone-network-setup:default.log |
1069 | 2024-02-02T03:28:08.281Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_bede069f-b11e-4218-a83f-355a288a17ce/root/var/svc/log/oxide-crucible-agent:default.log (14584 bytes) |
1070 | 2024-02-02T03:28:09.442Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_bede069f-b11e-4218-a83f-355a288a17ce/root/var/svc/log/oxide-crucible-agent:default.log |
1071 | 2024-02-02T03:28:09.442Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_bede069f-b11e-4218-a83f-355a288a17ce/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1072 | 2024-02-02T03:28:21.431Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_bede069f-b11e-4218-a83f-355a288a17ce/root/var/svc/log/oxide-crucible-downstairs:default.log |
1073 | 2024-02-02T03:28:21.431Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_bede069f-b11e-4218-a83f-355a288a17ce/root/var/svc/log/oxide-crucible-downstairs:downstairs-0295ed86-a904-4f5b-a389-80a8dcc64c59.log (5537 bytes) |
1074 | 2024-02-02T03:28:22.559Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_bede069f-b11e-4218-a83f-355a288a17ce/root/var/svc/log/oxide-crucible-downstairs:downstairs-0295ed86-a904-4f5b-a389-80a8dcc64c59.log |
1075 | 2024-02-02T03:28:22.559Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_01f58fff-6bee-4c25-ab5a-a2924ae7ff1e/root/var/svc/log/oxide-crucible-pantry:default.log (1226092 bytes) |
1076 | 2024-02-02T03:28:24.125Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_pantry_01f58fff-6bee-4c25-ab5a-a2924ae7ff1e/root/var/svc/log/oxide-crucible-pantry:default.log |
1077 | 2024-02-02T03:28:24.125Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_27215e88-e4f1-4448-bf03-92854a6b545a/root/var/svc/log/oxide-cockroachdb:default.log (4380 bytes) |
1078 | 2024-02-02T03:28:25.679Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_27215e88-e4f1-4448-bf03-92854a6b545a/root/var/svc/log/oxide-cockroachdb:default.log |
1079 | 2024-02-02T03:28:25.679Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_27215e88-e4f1-4448-bf03-92854a6b545a/root/var/svc/log/oxide-zone-network-setup:default.log (1711 bytes) |
1080 | 2024-02-02T03:28:26.333Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_27215e88-e4f1-4448-bf03-92854a6b545a/root/var/svc/log/oxide-zone-network-setup:default.log |
1081 | 2024-02-02T03:28:26.334Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_dfd9d160-3ddd-48c2-900a-680b3a5739ea/root/var/svc/log/oxide-crucible-agent:default.log (14116 bytes) |
1082 | 2024-02-02T03:28:27.455Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_dfd9d160-3ddd-48c2-900a-680b3a5739ea/root/var/svc/log/oxide-crucible-agent:default.log |
1083 | 2024-02-02T03:28:27.456Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_dfd9d160-3ddd-48c2-900a-680b3a5739ea/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1084 | 2024-02-02T03:28:28.547Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_dfd9d160-3ddd-48c2-900a-680b3a5739ea/root/var/svc/log/oxide-crucible-downstairs:default.log |
1085 | 2024-02-02T03:28:28.547Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_dfd9d160-3ddd-48c2-900a-680b3a5739ea/root/var/svc/log/oxide-crucible-downstairs:downstairs-e6cb7fc0-1dcd-4e36-a166-9219314c9258.log (3047 bytes) |
1086 | 2024-02-02T03:28:29.640Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_dfd9d160-3ddd-48c2-900a-680b3a5739ea/root/var/svc/log/oxide-crucible-downstairs:downstairs-e6cb7fc0-1dcd-4e36-a166-9219314c9258.log |
1087 | 2024-02-02T03:28:29.640Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/svc/log/oxide-ntp:default.log (272 bytes) |
1088 | 2024-02-02T03:28:30.736Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/svc/log/oxide-ntp:default.log |
1089 | 2024-02-02T03:28:30.736Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/svc/log/oxide-ntp:default.log.0 (915 bytes) |
1090 | 2024-02-02T03:28:31.844Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/svc/log/oxide-ntp:default.log.0 |
1091 | 2024-02-02T03:28:31.844Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c0e888bd-9e93-47d5-9184-281ba5aa14d0/root/var/svc/log/oxide-crucible-agent:default.log (9792 bytes) |
1092 | 2024-02-02T03:28:33.376Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c0e888bd-9e93-47d5-9184-281ba5aa14d0/root/var/svc/log/oxide-crucible-agent:default.log |
1093 | 2024-02-02T03:28:33.376Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c0e888bd-9e93-47d5-9184-281ba5aa14d0/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1094 | 2024-02-02T03:28:34.485Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c0e888bd-9e93-47d5-9184-281ba5aa14d0/root/var/svc/log/oxide-crucible-downstairs:default.log |
1095 | 2024-02-02T03:28:34.485Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c0e888bd-9e93-47d5-9184-281ba5aa14d0/root/var/svc/log/oxide-crucible-downstairs:downstairs-e46743a0-49f9-45ed-a53b-f7a40793aae2.log (2944 bytes) |
1096 | 2024-02-02T03:28:35.587Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_c0e888bd-9e93-47d5-9184-281ba5aa14d0/root/var/svc/log/oxide-crucible-downstairs:downstairs-e46743a0-49f9-45ed-a53b-f7a40793aae2.log |
1097 | 2024-02-02T03:28:35.587Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_d5d5da3c-933b-4a79-9a85-844780875988/root/var/svc/log/oxide-crucible-agent:default.log (9792 bytes) |
1098 | 2024-02-02T03:28:36.707Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_d5d5da3c-933b-4a79-9a85-844780875988/root/var/svc/log/oxide-crucible-agent:default.log |
1099 | 2024-02-02T03:28:36.707Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_d5d5da3c-933b-4a79-9a85-844780875988/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1100 | 2024-02-02T03:28:38.250Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_d5d5da3c-933b-4a79-9a85-844780875988/root/var/svc/log/oxide-crucible-downstairs:default.log |
1101 | 2024-02-02T03:28:38.250Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_d5d5da3c-933b-4a79-9a85-844780875988/root/var/svc/log/oxide-crucible-downstairs:downstairs-a426a032-e7c5-4cb7-89c6-263c16c5fef6.log (2943 bytes) |
1102 | 2024-02-02T03:28:39.364Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_d5d5da3c-933b-4a79-9a85-844780875988/root/var/svc/log/oxide-crucible-downstairs:downstairs-a426a032-e7c5-4cb7-89c6-263c16c5fef6.log |
1103 | 2024-02-02T03:28:39.364Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_21e36a94-38d5-45fc-ab4b-209e754ca0fc/root/var/svc/log/oxide-crucible-pantry:default.log (2333 bytes) |
1104 | 2024-02-02T03:28:40.472Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_pantry_21e36a94-38d5-45fc-ab4b-209e754ca0fc/root/var/svc/log/oxide-crucible-pantry:default.log |
1105 | 2024-02-02T03:28:40.472Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_64d4576c-1f4f-4c7e-93c5-389d0ae27e57/root/var/svc/log/oxide-nexus:default.log (1186564 bytes) |
1106 | 2024-02-02T03:28:42.458Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_64d4576c-1f4f-4c7e-93c5-389d0ae27e57/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1186564 -> 1406720 |
1107 | 2024-02-02T03:28:43.540Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_64d4576c-1f4f-4c7e-93c5-389d0ae27e57/root/var/svc/log/oxide-nexus:default.log |
1108 | 2024-02-02T03:28:43.540Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8e267ec8-0a68-4db1-9401-3d93e73979ad/root/var/svc/log/oxide-crucible-agent:default.log (20151 bytes) |
1109 | 2024-02-02T03:28:44.701Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8e267ec8-0a68-4db1-9401-3d93e73979ad/root/var/svc/log/oxide-crucible-agent:default.log |
1110 | 2024-02-02T03:28:44.701Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8e267ec8-0a68-4db1-9401-3d93e73979ad/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1111 | 2024-02-02T03:28:45.803Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8e267ec8-0a68-4db1-9401-3d93e73979ad/root/var/svc/log/oxide-crucible-downstairs:default.log |
1112 | 2024-02-02T03:28:45.803Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8e267ec8-0a68-4db1-9401-3d93e73979ad/root/var/svc/log/oxide-crucible-downstairs:downstairs-5bb82bf2-4a77-4c19-b33c-fe26618a48be.log (5623 bytes) |
1113 | 2024-02-02T03:28:46.927Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8e267ec8-0a68-4db1-9401-3d93e73979ad/root/var/svc/log/oxide-crucible-downstairs:downstairs-5bb82bf2-4a77-4c19-b33c-fe26618a48be.log |
1114 | 2024-02-02T03:28:46.927Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8e267ec8-0a68-4db1-9401-3d93e73979ad/root/var/svc/log/oxide-crucible-downstairs:snapshot-5bb82bf2-4a77-4c19-b33c-fe26618a48be-67e3f87d-f7ac-4c8e-a7f9-d0b6f02f8cba.log (5179 bytes) |
1115 | 2024-02-02T03:28:48.021Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_8e267ec8-0a68-4db1-9401-3d93e73979ad/root/var/svc/log/oxide-crucible-downstairs:snapshot-5bb82bf2-4a77-4c19-b33c-fe26618a48be-67e3f87d-f7ac-4c8e-a7f9-d0b6f02f8cba.log |
1116 | 2024-02-02T03:28:48.152Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_3996313f-af0d-4861-9365-e5a7349b7fb7/root/var/svc/log/oxide-nexus:default.log (35983403 bytes) |
1117 | 2024-02-02T03:29:08.156Z | upload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_3996313f-af0d-4861-9365-e5a7349b7fb7/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 35983403 -> 36298022 |
1118 | 2024-02-02T03:29:10.886Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_3996313f-af0d-4861-9365-e5a7349b7fb7/root/var/svc/log/oxide-nexus:default.log |
1119 | 2024-02-02T03:29:10.886Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_af9a77bd-b2fa-4d26-9dd0-54df7fe3e247/root/var/svc/log/oxide-nexus:default.log (1206647 bytes) |
1120 | 2024-02-02T03:29:12.502Z | upload warning: file "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_af9a77bd-b2fa-4d26-9dd0-54df7fe3e247/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 1206647 -> 1513471 |
1121 | 2024-02-02T03:29:13.606Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_nexus_af9a77bd-b2fa-4d26-9dd0-54df7fe3e247/root/var/svc/log/oxide-nexus:default.log |
1122 | 2024-02-02T03:29:13.606Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-agent:default.log (38511 bytes) |
1123 | 2024-02-02T03:29:15.102Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-agent:default.log |
1124 | 2024-02-02T03:29:15.229Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:default.log (75 bytes) |
1125 | 2024-02-02T03:29:16.283Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:default.log |
1126 | 2024-02-02T03:29:16.283Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:downstairs-6034cee5-0613-4a69-ad22-5514069da8f7.log (3046 bytes) |
1127 | 2024-02-02T03:29:17.494Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:downstairs-6034cee5-0613-4a69-ad22-5514069da8f7.log |
1128 | 2024-02-02T03:29:17.494Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:downstairs-61c73bc0-f061-4dd0-8cd1-8789bfc6b071.log (5537 bytes) |
1129 | 2024-02-02T03:29:19.340Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:downstairs-61c73bc0-f061-4dd0-8cd1-8789bfc6b071.log |
1130 | 2024-02-02T03:29:19.340Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:downstairs-747c1f60-0b56-4d70-ac84-92e9b99e6820.log (5623 bytes) |
1131 | 2024-02-02T03:29:20.476Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:downstairs-747c1f60-0b56-4d70-ac84-92e9b99e6820.log |
1132 | 2024-02-02T03:29:20.476Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:snapshot-747c1f60-0b56-4d70-ac84-92e9b99e6820-67e3f87d-f7ac-4c8e-a7f9-d0b6f02f8cba.log (5176 bytes) |
1133 | 2024-02-02T03:29:39.111Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_b4cf0e43-886a-44eb-8562-ff1c8783c4ed/root/var/svc/log/oxide-crucible-downstairs:snapshot-747c1f60-0b56-4d70-ac84-92e9b99e6820-67e3f87d-f7ac-4c8e-a7f9-d0b6f02f8cba.log |
1134 | 2024-02-02T03:29:39.111Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/measurements.log (27537 bytes) |
1135 | 2024-02-02T03:29:39.633Z | upload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/measurements.log" changed size mid upload: 27537 -> 34250 |
1136 | 2024-02-02T03:29:40.727Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/measurements.log |
1137 | 2024-02-02T03:29:40.727Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/statistics.log (17784 bytes) |
1138 | 2024-02-02T03:29:40.820Z | upload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/statistics.log" changed size mid upload: 17784 -> 23166 |
1139 | 2024-02-02T03:29:41.893Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/statistics.log |
1140 | 2024-02-02T03:29:41.893Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/tracking.log (2250 bytes) |
1141 | 2024-02-02T03:29:41.944Z | upload warning: file "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/tracking.log" changed size mid upload: 2250 -> 2646 |
1142 | 2024-02-02T03:29:43.025Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_ntp_43646849-4b66-4fd4-8e91-88c4322bccd4/root/var/log/chrony/tracking.log |