|
|
|
1 | 2024-02-10T00:43:26.365Z | job dependencies complete; ready to run (waiting for 35 m 30 s) |
2 | 2024-02-10T00:45:18.805Z | job assigned to worker 01HP87J65BW6MSF25AMPHTHA4G (queued for 1 m 52 s) |
3 | 2024-02-10T00:45:18.821Z | http://172.20.0.5:9969/ipxe/sock... ok |
4 | 2024-02-10T00:45:18.885Z | http://172.20.0.5:9969/os/sock/platform/i86pc/kernel/amd64/unix... ok |
5 | 2024-02-10T00:45:18.931Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive... ok |
6 | 2024-02-10T00:45:18.971Z | http://172.20.0.5:9969/os/sock/platform/i86pc/amd64/boot_archive.hash... ok |
7 | 2024-02-10T00:45:19.005Z | http://172.20.0.5:9969/postboot/sock... ok |
8 | 2024-02-10T00:45:19.039Z | wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U wcnCroia6U |
9 | 2024-02-10T00:45:19.072Z | cpu0: microcode has been updated from version 0xa001133 to 0xa0011d1 |
10 | 2024-02-10T00:45:19.107Z | Oxide Helios Version helios-2.0.22451 64-bit |
11 | 2024-02-10T00:45:19.163Z | Configuring devices. |
12 | 2024-02-10T00:45:19.201Z | ################################################## |
13 | 2024-02-10T00:45:19.238Z | #### ############# ## |
14 | 2024-02-10T00:45:19.271Z | ### ### ############ ## |
15 | 2024-02-10T00:45:19.309Z | ## ### # ## ### ## Oxide Computer Company ## |
16 | 2024-02-10T00:45:19.346Z | ## ## ## ### # ### ## |
17 | 2024-02-10T00:45:19.388Z | ## # ### #### #### This Station Under ## |
18 | 2024-02-10T00:45:19.429Z | ### ### #### # ### Computer Control ## |
19 | 2024-02-10T00:45:19.467Z | #### #### ### ## ## |
20 | 2024-02-10T00:45:19.507Z | ################################################## |
21 | 2024-02-10T00:45:20.528Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap-814497ffe476019b.gz |
22 | 2024-02-10T00:45:22.527Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap-814497ffe476019b.gz |
23 | 2024-02-10T00:45:22.552Z | downloading input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
24 | 2024-02-10T00:45:41.876Z | downloaded input: /input/ci-tools/work/end-to-end-tests/bootstrap.gz |
25 | 2024-02-10T00:45:41.876Z | downloading input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7c7bf8ffe79eb016.gz |
26 | 2024-02-10T00:46:05.613Z | downloaded input: /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7c7bf8ffe79eb016.gz |
27 | 2024-02-10T00:46:05.639Z | downloading input: /input/ci-tools/work/caboose-util.gz |
28 | 2024-02-10T00:46:07.179Z | downloaded input: /input/ci-tools/work/caboose-util.gz |
29 | 2024-02-10T00:46:07.179Z | downloading input: /input/ci-tools/work/tufaceous.gz |
30 | 2024-02-10T00:46:10.068Z | downloaded input: /input/ci-tools/work/tufaceous.gz |
31 | 2024-02-10T00:46:10.095Z | downloading input: /input/package/work/version.txt |
32 | 2024-02-10T00:46:10.125Z | downloaded input: /input/package/work/version.txt |
33 | 2024-02-10T00:46:10.125Z | downloading input: /input/package/work/package.tar.gz |
34 | 2024-02-10T00:46:23.733Z | Error: No response to keepalive - Terminating session |
35 | 2024-02-10T00:46:30.743Z | downloaded input: /input/package/work/package.tar.gz |
36 | 2024-02-10T00:46:30.767Z | downloading input: /input/package/work/global-zone-packages.tar.gz |
37 | 2024-02-10T00:46:33.673Z | Error: No response de-activating SOL payload |
38 | 2024-02-10T00:46:34.835Z | [SOL Session operational. Use ~? for help] |
39 | 2024-02-10T00:46:52.853Z | downloaded input: /input/package/work/global-zone-packages.tar.gz |
40 | 2024-02-10T00:46:52.853Z | downloading input: /input/package/work/trampoline-global-zone-packages.tar.gz |
41 | 2024-02-10T00:46:59.717Z | downloaded input: /input/package/work/trampoline-global-zone-packages.tar.gz |
42 | 2024-02-10T00:46:59.742Z | downloading input: /input/package/work/zones/clickhouse.tar.gz |
43 | 2024-02-10T00:47:32.469Z | downloaded input: /input/package/work/zones/clickhouse.tar.gz |
44 | 2024-02-10T00:47:32.469Z | downloading input: /input/package/work/zones/clickhouse_keeper.tar.gz |
45 | 2024-02-10T00:48:05.161Z | downloaded input: /input/package/work/zones/clickhouse_keeper.tar.gz |
46 | 2024-02-10T00:48:05.161Z | downloading input: /input/package/work/zones/cockroachdb.tar.gz |
47 | 2024-02-10T00:48:27.248Z | downloaded input: /input/package/work/zones/cockroachdb.tar.gz |
48 | 2024-02-10T00:48:27.273Z | downloading input: /input/package/work/zones/crucible-pantry.tar.gz |
49 | 2024-02-10T00:48:29.861Z | downloaded input: /input/package/work/zones/crucible-pantry.tar.gz |
50 | 2024-02-10T00:48:29.861Z | downloading input: /input/package/work/zones/crucible.tar.gz |
51 | 2024-02-10T00:48:34.923Z | downloaded input: /input/package/work/zones/crucible.tar.gz |
52 | 2024-02-10T00:48:34.923Z | downloading input: /input/package/work/zones/external-dns.tar.gz |
53 | 2024-02-10T00:48:38.960Z | downloaded input: /input/package/work/zones/external-dns.tar.gz |
54 | 2024-02-10T00:48:38.960Z | downloading input: /input/package/work/zones/internal-dns.tar.gz |
55 | 2024-02-10T00:48:43.032Z | downloaded input: /input/package/work/zones/internal-dns.tar.gz |
56 | 2024-02-10T00:48:43.056Z | downloading input: /input/package/work/zones/ntp.tar.gz |
57 | 2024-02-10T00:48:43.081Z | downloaded input: /input/package/work/zones/ntp.tar.gz |
58 | 2024-02-10T00:48:43.081Z | downloading input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
59 | 2024-02-10T00:48:46.471Z | downloaded input: /input/package/work/zones/omicron-gateway-asic.tar.gz |
60 | 2024-02-10T00:48:46.471Z | downloading input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
61 | 2024-02-10T00:48:49.855Z | downloaded input: /input/package/work/zones/omicron-gateway-softnpu.tar.gz |
62 | 2024-02-10T00:48:49.856Z | downloading input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
63 | 2024-02-10T00:49:04.630Z | downloaded input: /input/package/work/zones/omicron-nexus-single-sled.tar.gz |
64 | 2024-02-10T00:49:04.630Z | downloading input: /input/package/work/zones/omicron-nexus.tar.gz |
65 | 2024-02-10T00:49:19.460Z | downloaded input: /input/package/work/zones/omicron-nexus.tar.gz |
66 | 2024-02-10T00:49:19.460Z | downloading input: /input/package/work/zones/overlay.tar.gz |
67 | 2024-02-10T00:49:19.547Z | downloaded input: /input/package/work/zones/overlay.tar.gz |
68 | 2024-02-10T00:49:19.571Z | downloading input: /input/package/work/zones/oximeter.tar.gz |
69 | 2024-02-10T00:49:23.704Z | Error: No response to keepalive - Terminating session |
70 | 2024-02-10T00:49:29.055Z | downloaded input: /input/package/work/zones/oximeter.tar.gz |
71 | 2024-02-10T00:49:29.055Z | downloading input: /input/package/work/zones/propolis-server.tar.gz |
72 | 2024-02-10T00:49:33.640Z | Error: No response de-activating SOL payload |
73 | 2024-02-10T00:49:34.859Z | [SOL Session operational. Use ~? for help] |
74 | 2024-02-10T00:49:40.220Z | downloaded input: /input/package/work/zones/propolis-server.tar.gz |
75 | 2024-02-10T00:49:40.220Z | downloading input: /input/package/work/zones/switch-asic.tar.gz |
76 | 2024-02-10T00:50:28.010Z | downloaded input: /input/package/work/zones/switch-asic.tar.gz |
77 | 2024-02-10T00:50:28.010Z | downloading input: /input/package/work/zones/switch-softnpu.tar.gz |
78 | 2024-02-10T00:51:03.168Z | downloaded input: /input/package/work/zones/switch-softnpu.tar.gz |
|
79 | 2024-02-10T00:51:03.195Z | starting task 0: "setup" |
80 | 2024-02-10T00:51:03.195Z | ++ uname -s |
81 | 2024-02-10T00:51:03.195Z | + kern=SunOS |
82 | 2024-02-10T00:51:03.195Z | + case "$kern" in |
83 | 2024-02-10T00:51:03.195Z | + groupadd -g 12345 build |
84 | 2024-02-10T00:51:03.195Z | + useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build |
85 | 2024-02-10T00:51:05.185Z | + zfs create -o mountpoint=/work rpool/work |
86 | 2024-02-10T00:51:05.210Z | ++ awk '$2 == "/home" { print $3 }' /etc/mnttab |
87 | 2024-02-10T00:51:05.210Z | + home_fs=zfs |
88 | 2024-02-10T00:51:05.210Z | + [[ zfs == autofs ]] |
89 | 2024-02-10T00:51:05.210Z | + mkdir -p /home/build |
90 | 2024-02-10T00:51:05.234Z | + chown build:build /home/build /work |
91 | 2024-02-10T00:51:07.213Z | + chmod 0700 /home/build /work |
92 | 2024-02-10T00:51:07.237Z | process exited: duration 4048 ms, exit code 0 |
|
93 | 2024-02-10T00:51:07.285Z | starting task 1: "authentication" |
94 | 2024-02-10T00:51:07.329Z | process exited: duration 43 ms, exit code 0 |
|
95 | 2024-02-10T00:51:07.379Z | starting task 2: "build" |
96 | 2024-02-10T00:51:07.404Z | + trap _exit_trap EXIT |
97 | 2024-02-10T00:51:07.404Z | + set +x |
98 | 2024-02-10T00:51:33.030Z | + pfexec mdb -kwe 'secpolicy_fs_linkdir/v 55 48 89 e5 b8 01 00 00 00 5d c3' |
99 | 2024-02-10T00:51:33.271Z | secpolicy_fs_linkdir: 0x55 = 0x55 |
100 | 2024-02-10T00:51:33.271Z | secpolicy_fs_linkdir+1: 0xb8 = 0x48 |
101 | 2024-02-10T00:51:33.271Z | secpolicy_fs_linkdir+2: 0x1 = 0x89 |
102 | 2024-02-10T00:51:33.271Z | secpolicy_fs_linkdir+3: 0 = 0xe5 |
103 | 2024-02-10T00:51:33.271Z | secpolicy_fs_linkdir+4: 0 = 0xb8 |
104 | 2024-02-10T00:51:33.272Z | secpolicy_fs_linkdir+5: 0 = 0x1 |
105 | 2024-02-10T00:51:33.272Z | secpolicy_fs_linkdir+6: 0x48 = 0x0 |
106 | 2024-02-10T00:51:33.296Z | secpolicy_fs_linkdir+7: 0x89 = 0x0 |
107 | 2024-02-10T00:51:33.296Z | secpolicy_fs_linkdir+8: 0xe5 = 0x0 |
108 | 2024-02-10T00:51:33.297Z | secpolicy_fs_linkdir+9: 0x48 = 0x5d |
109 | 2024-02-10T00:51:33.297Z | secpolicy_fs_linkdir+0xa: 0x83 = 0xc3 |
110 | 2024-02-10T00:51:33.297Z | + [[ -d /opt/oxide ]] |
111 | 2024-02-10T00:51:33.297Z | + pfexec mv /opt/oxide /opt/oxide-underneath |
112 | 2024-02-10T00:51:33.297Z | + pfexec mkdir /opt/oxide |
113 | 2024-02-10T00:51:33.297Z | + pfexec mount -F tmpfs -O swap /opt/oxide |
114 | 2024-02-10T00:51:33.297Z | + [[ -d /opt/oxide-underneath ]] |
115 | 2024-02-10T00:51:33.297Z | + cd /opt/oxide-underneath |
116 | 2024-02-10T00:51:33.297Z | + pfexec tar ceEp@/f - . |
117 | 2024-02-10T00:51:33.297Z | + cd /opt/oxide |
118 | 2024-02-10T00:51:33.297Z | + pfexec tar xveEp@/f - |
119 | 2024-02-10T00:51:33.332Z | x ., 0 bytes, 0 tape blocks |
120 | 2024-02-10T00:51:33.332Z | x ./opte, 0 bytes, 0 tape blocks |
121 | 2024-02-10T00:51:33.332Z | x ./opte/bin, 0 bytes, 0 tape blocks |
122 | 2024-02-10T00:51:33.332Z | x ./opte/bin/opteadm, 51799224 bytes, 101171 tape blocks |
123 | 2024-02-10T00:51:33.356Z | + pfexec rm -rf /opt/oxide-underneath |
124 | 2024-02-10T00:51:33.357Z | + pfexec /sbin/zfs create -o mountpoint=/zone rpool/zone |
125 | 2024-02-10T00:51:33.381Z | + pfexec mkdir /opt/oxide/work |
126 | 2024-02-10T00:51:33.381Z | + pfexec chown build:build /opt/oxide/work |
127 | 2024-02-10T00:51:33.381Z | + cd /opt/oxide/work |
128 | 2024-02-10T00:51:33.381Z | + ptime -m tar xvzf /input/package/work/package.tar.gz |
129 | 2024-02-10T00:51:35.082Z | Decompressing '/input/package/work/package.tar.gz' with '/usr/bin/gzcat'... |
130 | 2024-02-10T00:51:35.082Z | x out/mg-ddm-gz.tar, 69308416 bytes, 135368 tape blocks |
131 | 2024-02-10T00:51:35.082Z | x out/omicron-sled-agent.tar, 122573824 bytes, 239402 tape blocks |
132 | 2024-02-10T00:51:35.083Z | x out/oxlog.tar, 8382464 bytes, 16372 tape blocks |
133 | 2024-02-10T00:51:35.083Z | x out/target/test, 75 bytes, 1 tape blocks |
134 | 2024-02-10T00:51:35.083Z | x out/npuzone/npuzone, 37184104 bytes, 72626 tape blocks |
135 | 2024-02-10T00:51:35.083Z | x package-manifest.toml, 23732 bytes, 47 tape blocks |
136 | 2024-02-10T00:51:35.083Z | x smf/sled-agent/non-gimlet/config.toml, 3448 bytes, 7 tape blocks |
137 | 2024-02-10T00:51:35.083Z | x target/release/omicron-package, 45717632 bytes, 89293 tape blocks |
138 | 2024-02-10T00:51:35.083Z | x tools/create_virtual_hardware.sh, 3184 bytes, 7 tape blocks |
139 | 2024-02-10T00:51:35.083Z | x tools/virtual_hardware.sh, 3416 bytes, 7 tape blocks |
140 | 2024-02-10T00:51:35.083Z | x tools/scrimlet/create-softnpu-zone.sh, 627 bytes, 2 tape blocks |
141 | 2024-02-10T00:51:35.083Z | x tools/scrimlet/destroy-softnpu-zone.sh, 203 bytes, 1 tape blocks |
142 | 2024-02-10T00:51:35.083Z | x tools/scrimlet/softnpu-init.sh, 2157 bytes, 5 tape blocks |
143 | 2024-02-10T00:51:35.083Z | x tools/scrimlet/softnpu-zone.txt, 330 bytes, 1 tape blocks |
144 | 2024-02-10T00:51:35.083Z | x tools/scrimlet/softnpu.toml, 171 bytes, 1 tape blocks |
145 | 2024-02-10T00:51:35.108Z | |
146 | 2024-02-10T00:51:35.108Z | real 1.711561709 |
147 | 2024-02-10T00:51:35.108Z | user 1.541411288 |
148 | 2024-02-10T00:51:35.108Z | sys 0.299502779 |
149 | 2024-02-10T00:51:35.108Z | trap 0.000054169 |
150 | 2024-02-10T00:51:35.109Z | tflt 0.000000000 |
151 | 2024-02-10T00:51:35.109Z | dflt 0.000000000 |
152 | 2024-02-10T00:51:35.109Z | kflt 0.000000000 |
153 | 2024-02-10T00:51:35.109Z | lock 0.000000000 |
154 | 2024-02-10T00:51:35.109Z | slp 1.540461238 |
155 | 2024-02-10T00:51:35.109Z | lat 0.039590265 |
156 | 2024-02-10T00:51:35.109Z | stop 0.000126593 |
157 | 2024-02-10T00:51:35.109Z | + cp /input/package/work/zones/clickhouse_keeper.tar.gz /input/package/work/zones/clickhouse.tar.gz /input/package/work/zones/cockroachdb.tar.gz /input/package/work/zones/crucible-pantry.tar.gz /input/package/work/zones/crucible.tar.gz /input/package/work/zones/external-dns.tar.gz /input/package/work/zones/internal-dns.tar.gz /input/package/work/zones/ntp.tar.gz /input/package/work/zones/omicron-gateway-asic.tar.gz /input/package/work/zones/omicron-gateway-softnpu.tar.gz /input/package/work/zones/omicron-nexus-single-sled.tar.gz /input/package/work/zones/omicron-nexus.tar.gz /input/package/work/zones/overlay.tar.gz /input/package/work/zones/oximeter.tar.gz /input/package/work/zones/propolis-server.tar.gz /input/package/work/zones/switch-asic.tar.gz /input/package/work/zones/switch-softnpu.tar.gz out/ |
158 | 2024-02-10T00:51:36.291Z | + mv out/omicron-nexus-single-sled.tar.gz out/omicron-nexus.tar.gz |
159 | 2024-02-10T00:51:36.316Z | + mkdir tests |
160 | 2024-02-10T00:51:36.316Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
161 | 2024-02-10T00:51:36.316Z | + ptime -m gunzip |
162 | 2024-02-10T00:51:36.316Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-814497ffe476019b |
163 | 2024-02-10T00:51:36.537Z | |
164 | 2024-02-10T00:51:36.565Z | real 0.230516240 |
165 | 2024-02-10T00:51:36.565Z | user 0.213926051 |
166 | 2024-02-10T00:51:36.565Z | sys 0.016349113 |
167 | 2024-02-10T00:51:36.565Z | trap 0.000015030 |
168 | 2024-02-10T00:51:36.566Z | tflt 0.000000000 |
169 | 2024-02-10T00:51:36.566Z | dflt 0.000000000 |
170 | 2024-02-10T00:51:36.566Z | kflt 0.000000000 |
171 | 2024-02-10T00:51:36.566Z | lock 0.000000000 |
172 | 2024-02-10T00:51:36.566Z | slp 0.000018410 |
173 | 2024-02-10T00:51:36.566Z | lat 0.000020750 |
174 | 2024-02-10T00:51:36.566Z | stop 0.000121513 |
175 | 2024-02-10T00:51:36.566Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap-814497ffe476019b |
176 | 2024-02-10T00:51:36.566Z | + chmod a+x tests/bootstrap-814497ffe476019b |
177 | 2024-02-10T00:51:36.566Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
178 | 2024-02-10T00:51:36.566Z | + ptime -m gunzip |
179 | 2024-02-10T00:51:36.566Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
180 | 2024-02-10T00:51:39.046Z | |
181 | 2024-02-10T00:51:39.071Z | real 2.494931986 |
182 | 2024-02-10T00:51:39.071Z | user 2.336507312 |
183 | 2024-02-10T00:51:39.071Z | sys 0.158015572 |
184 | 2024-02-10T00:51:39.071Z | trap 0.000170774 |
185 | 2024-02-10T00:51:39.071Z | tflt 0.000000000 |
186 | 2024-02-10T00:51:39.071Z | dflt 0.000000000 |
187 | 2024-02-10T00:51:39.071Z | kflt 0.000000000 |
188 | 2024-02-10T00:51:39.071Z | lock 0.000000000 |
189 | 2024-02-10T00:51:39.071Z | slp 0.000019010 |
190 | 2024-02-10T00:51:39.071Z | lat 0.000024860 |
191 | 2024-02-10T00:51:39.072Z | stop 0.000126952 |
192 | 2024-02-10T00:51:39.072Z | ++ basename /input/ci-tools/work/end-to-end-tests/bootstrap |
193 | 2024-02-10T00:51:39.072Z | + chmod a+x tests/bootstrap |
194 | 2024-02-10T00:51:39.072Z | + for p in /input/ci-tools/work/end-to-end-tests/*.gz |
195 | 2024-02-10T00:51:39.072Z | + ptime -m gunzip |
196 | 2024-02-10T00:51:39.072Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7c7bf8ffe79eb016 |
197 | 2024-02-10T00:51:41.613Z | |
198 | 2024-02-10T00:51:41.637Z | real 2.555876541 |
199 | 2024-02-10T00:51:41.638Z | user 2.401708988 |
200 | 2024-02-10T00:51:41.638Z | sys 0.153735981 |
201 | 2024-02-10T00:51:41.638Z | trap 0.000192286 |
202 | 2024-02-10T00:51:41.638Z | tflt 0.000000000 |
203 | 2024-02-10T00:51:41.638Z | dflt 0.000000000 |
204 | 2024-02-10T00:51:41.638Z | kflt 0.000000000 |
205 | 2024-02-10T00:51:41.638Z | lock 0.000000000 |
206 | 2024-02-10T00:51:41.638Z | slp 0.000026070 |
207 | 2024-02-10T00:51:41.638Z | lat 0.000021000 |
208 | 2024-02-10T00:51:41.638Z | stop 0.000126562 |
209 | 2024-02-10T00:51:41.638Z | ++ basename /input/ci-tools/work/end-to-end-tests/end_to_end_tests-7c7bf8ffe79eb016 |
210 | 2024-02-10T00:51:41.638Z | + chmod a+x tests/end_to_end_tests-7c7bf8ffe79eb016 |
211 | 2024-02-10T00:51:41.638Z | + bmat address ls |
212 | 2024-02-10T00:51:41.638Z | NAME CIDR FIRST LAST COUNT |
213 | 2024-02-10T00:51:41.638Z | extra 10.151.2.0/24 10.151.2.164 10.151.2.227 64 |
214 | 2024-02-10T00:51:41.638Z | ++ bmat address ls -f extra -Ho first,last,count |
215 | 2024-02-10T00:51:41.663Z | + set -- 10.151.2.164 10.151.2.227 64 |
216 | 2024-02-10T00:51:41.663Z | + EXTRA_IP_START=10.151.2.164 |
217 | 2024-02-10T00:51:41.663Z | + EXTRA_IP_END=10.151.2.227 |
218 | 2024-02-10T00:51:41.664Z | + EXTRA_IP_COUNT=64 |
219 | 2024-02-10T00:51:41.664Z | + (( EXTRA_IP_COUNT >= 32 )) |
220 | 2024-02-10T00:51:41.664Z | + EXTRA_IP_BASE=10.151.2 |
221 | 2024-02-10T00:51:41.664Z | + EXTRA_IP_FOCTET=164 |
222 | 2024-02-10T00:51:41.664Z | + EXTRA_IP_LOCTET=227 |
223 | 2024-02-10T00:51:41.664Z | + SERVICE_IP_POOL_START=10.151.2.164 |
224 | 2024-02-10T00:51:41.664Z | + SERVICE_IP_POOL_END=10.151.2.173 |
225 | 2024-02-10T00:51:41.664Z | + DNS_IP1=10.151.2.164 |
226 | 2024-02-10T00:51:41.664Z | + DNS_IP2=10.151.2.165 |
227 | 2024-02-10T00:51:41.664Z | + UPLINK_IP=10.151.2.174 |
228 | 2024-02-10T00:51:41.664Z | + IPPOOL_START=10.151.2.175 |
229 | 2024-02-10T00:51:41.664Z | + IPPOOL_END=10.151.2.227 |
230 | 2024-02-10T00:51:41.664Z | ++ ipadm show-addr -po type,addr |
231 | 2024-02-10T00:51:41.664Z | ++ awk '-F[:/]' '$1 == "dhcp" {print $2}' |
232 | 2024-02-10T00:51:41.664Z | + GATEWAY_IP=10.151.2.100 |
233 | 2024-02-10T00:51:41.664Z | + [[ -n 10.151.2.100 ]] |
234 | 2024-02-10T00:51:41.664Z | + ping -s 10.151.2.100 56 1 |
235 | 2024-02-10T00:51:41.664Z | PING 10.151.2.100: 56 data bytes |
236 | 2024-02-10T00:51:41.664Z | 64 bytes from 10.151.2.100: icmp_seq=0. time=0.011 ms |
237 | 2024-02-10T00:51:41.664Z | |
238 | 2024-02-10T00:51:41.664Z | ----10.151.2.100 PING Statistics---- |
239 | 2024-02-10T00:51:41.664Z | 1 packets transmitted, 1 packets received, 0% packet loss |
240 | 2024-02-10T00:51:41.664Z | round-trip (ms) min/avg/max/stddev = 0.011/0.011/0.011/-nan |
241 | 2024-02-10T00:51:41.664Z | ++ arp -an |
242 | 2024-02-10T00:51:41.664Z | ++ awk -vgw=10.151.2.100 '$2 == gw {print $NF}' |
243 | 2024-02-10T00:51:41.692Z | + GATEWAY_MAC=18:c0:4d:0d:a0:2a |
244 | 2024-02-10T00:51:41.692Z | + routeadm -e ipv4-forwarding -u |
245 | 2024-02-10T00:51:41.777Z | + PXA_START=10.151.2.164 |
246 | 2024-02-10T00:51:41.777Z | + PXA_END=10.151.2.227 |
247 | 2024-02-10T00:51:41.777Z | + export GATEWAY_IP GATEWAY_MAC PXA_START PXA_END |
248 | 2024-02-10T00:51:41.801Z | + pfexec zpool create -f scratch c1t1d0 c2t1d0 |
249 | 2024-02-10T00:51:41.978Z | + ZPOOL_VDEV_DIR=/scratch |
250 | 2024-02-10T00:51:41.978Z | + ptime -m pfexec ./tools/create_virtual_hardware.sh |
251 | 2024-02-10T00:51:42.004Z | +++ dirname ./tools/create_virtual_hardware.sh |
252 | 2024-02-10T00:51:42.004Z | ++ cd ./tools |
253 | 2024-02-10T00:51:42.004Z | ++ pwd |
254 | 2024-02-10T00:51:42.004Z | + SOURCE_DIR=/opt/oxide/work/tools |
255 | 2024-02-10T00:51:42.004Z | + OMICRON_TOP=/opt/oxide/work/tools/.. |
256 | 2024-02-10T00:51:42.004Z | + SOFTNPU_MODE=zone |
257 | 2024-02-10T00:51:42.004Z | + . /opt/oxide/work/tools/virtual_hardware.sh |
258 | 2024-02-10T00:51:42.004Z | ++ MARKER=/etc/opt/oxide/NO_INSTALL |
259 | 2024-02-10T00:51:42.004Z | ++ [[ -f /etc/opt/oxide/NO_INSTALL ]] |
260 | 2024-02-10T00:51:42.004Z | ++ dladm show-phys -p -o LINK |
261 | 2024-02-10T00:51:42.004Z | ++ head -1 |
262 | 2024-02-10T00:51:42.004Z | + PHYSICAL_LINK=igb0 |
263 | 2024-02-10T00:51:42.004Z | + echo 'Using igb0 as physical link' |
264 | 2024-02-10T00:51:42.004Z | Using igb0 as physical link |
265 | 2024-02-10T00:51:42.004Z | + ensure_run_as_root |
266 | 2024-02-10T00:51:42.032Z | ++ id -u |
267 | 2024-02-10T00:51:42.032Z | + [[ 0 -ne 0 ]] |
268 | 2024-02-10T00:51:42.032Z | + ensure_zpools |
269 | 2024-02-10T00:51:42.032Z | + ZPOOL_TYPES=('oxp_' 'oxi_') |
270 | 2024-02-10T00:51:42.032Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
271 | 2024-02-10T00:51:42.032Z | + readarray -t ZPOOLS |
272 | 2024-02-10T00:51:42.032Z | ++ grep '"oxp_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
273 | 2024-02-10T00:51:42.032Z | ++ sed 's/[ ",]//g' |
274 | 2024-02-10T00:51:42.032Z | + for ZPOOL in "${ZPOOLS[@]}" |
275 | 2024-02-10T00:51:42.032Z | + echo 'Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
276 | 2024-02-10T00:51:42.032Z | + VDEV_PATH=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
277 | 2024-02-10T00:51:42.032Z | Zpool: [oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b] |
278 | 2024-02-10T00:51:42.032Z | + [[ -f /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
279 | 2024-02-10T00:51:42.032Z | + dd if=/dev/zero of=/scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
280 | 2024-02-10T00:51:42.032Z | 0+0 records in |
281 | 2024-02-10T00:51:42.032Z | 0+0 records out |
282 | 2024-02-10T00:51:42.032Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
283 | 2024-02-10T00:51:42.032Z | + success 'ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
284 | 2024-02-10T00:51:42.032Z | + set +x |
285 | 2024-02-10T00:51:42.032Z | ZFS vdev /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
286 | 2024-02-10T00:51:42.033Z | ++ zpool list -o name |
287 | 2024-02-10T00:51:42.033Z | ++ grep oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b |
288 | 2024-02-10T00:51:42.033Z | + [[ -z '' ]] |
289 | 2024-02-10T00:51:42.033Z | + zpool create -f oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
290 | 2024-02-10T00:51:42.057Z | + success 'ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
291 | 2024-02-10T00:51:42.058Z | + set +x |
292 | 2024-02-10T00:51:42.058Z | ZFS zpool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
293 | 2024-02-10T00:51:42.058Z | + for ZPOOL in "${ZPOOLS[@]}" |
294 | 2024-02-10T00:51:42.058Z | + echo 'Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
295 | 2024-02-10T00:51:42.058Z | Zpool: [oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
296 | 2024-02-10T00:51:42.058Z | + VDEV_PATH=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
297 | 2024-02-10T00:51:42.058Z | + [[ -f /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
298 | 2024-02-10T00:51:42.058Z | + dd if=/dev/zero of=/scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
299 | 2024-02-10T00:51:42.083Z | 0+0 records in |
300 | 2024-02-10T00:51:42.083Z | 0+0 records out |
301 | 2024-02-10T00:51:42.083Z | 0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec) |
302 | 2024-02-10T00:51:42.083Z | + success 'ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
303 | 2024-02-10T00:51:42.083Z | + set +x |
304 | 2024-02-10T00:51:42.083Z | ZFS vdev /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
305 | 2024-02-10T00:51:42.084Z | ++ zpool list -o name |
306 | 2024-02-10T00:51:42.084Z | ++ grep oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
307 | 2024-02-10T00:51:42.084Z | + [[ -z '' ]] |
308 | 2024-02-10T00:51:42.084Z | + zpool create -f oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
309 | 2024-02-10T00:51:42.109Z | + success 'ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
310 | 2024-02-10T00:51:42.109Z | + set +x |
311 | 2024-02-10T00:51:42.109Z | ZFS zpool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
312 | 2024-02-10T00:51:42.109Z | + for ZPOOL in "${ZPOOLS[@]}" |
313 | 2024-02-10T00:51:42.109Z | + echo 'Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
314 | 2024-02-10T00:51:42.109Z | Zpool: [oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03] |
315 | 2024-02-10T00:51:42.110Z | + VDEV_PATH=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
316 | 2024-02-10T00:51:42.110Z | + [[ -f /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
317 | 2024-02-10T00:51:42.110Z | + dd if=/dev/zero of=/scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
318 | 2024-02-10T00:51:42.110Z | 0+0 records in |
319 | 2024-02-10T00:51:42.110Z | 0+0 records out |
320 | 2024-02-10T00:51:42.110Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
321 | 2024-02-10T00:51:42.110Z | + success 'ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
322 | 2024-02-10T00:51:42.110Z | + set +x |
323 | 2024-02-10T00:51:42.110Z | ZFS vdev /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
324 | 2024-02-10T00:51:42.110Z | ++ zpool list -o name |
325 | 2024-02-10T00:51:42.110Z | ++ grep oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 |
326 | 2024-02-10T00:51:42.135Z | + [[ -z '' ]] |
327 | 2024-02-10T00:51:42.136Z | + zpool create -f oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
328 | 2024-02-10T00:51:42.172Z | + success 'ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
329 | 2024-02-10T00:51:42.172Z | + set +x |
330 | 2024-02-10T00:51:42.173Z | ZFS zpool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
331 | 2024-02-10T00:51:42.173Z | + for ZPOOL in "${ZPOOLS[@]}" |
332 | 2024-02-10T00:51:42.173Z | + echo 'Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
333 | 2024-02-10T00:51:42.173Z | Zpool: [oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03] |
334 | 2024-02-10T00:51:42.173Z | + VDEV_PATH=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
335 | 2024-02-10T00:51:42.173Z | + [[ -f /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
336 | 2024-02-10T00:51:42.173Z | + dd if=/dev/zero of=/scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
337 | 2024-02-10T00:51:42.173Z | 0+0 records in |
338 | 2024-02-10T00:51:42.173Z | 0+0 records out |
339 | 2024-02-10T00:51:42.173Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
340 | 2024-02-10T00:51:42.173Z | + success 'ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
341 | 2024-02-10T00:51:42.173Z | + set +x |
342 | 2024-02-10T00:51:42.173Z | ZFS vdev /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
343 | 2024-02-10T00:51:42.174Z | ++ zpool list -o name |
344 | 2024-02-10T00:51:42.174Z | ++ grep oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 |
345 | 2024-02-10T00:51:42.174Z | + [[ -z '' ]] |
346 | 2024-02-10T00:51:42.174Z | + zpool create -f oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
347 | 2024-02-10T00:51:42.199Z | + success 'ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
348 | 2024-02-10T00:51:42.199Z | + set +x |
349 | 2024-02-10T00:51:42.199Z | ZFS zpool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
350 | 2024-02-10T00:51:42.199Z | + for ZPOOL in "${ZPOOLS[@]}" |
351 | 2024-02-10T00:51:42.199Z | + echo 'Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03]' |
352 | 2024-02-10T00:51:42.200Z | Zpool: [oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03] |
353 | 2024-02-10T00:51:42.200Z | + VDEV_PATH=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
354 | 2024-02-10T00:51:42.200Z | + [[ -f /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev ]] |
355 | 2024-02-10T00:51:42.200Z | + dd if=/dev/zero of=/scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev bs=1 count=0 seek=20G |
356 | 2024-02-10T00:51:42.200Z | 0+0 records in |
357 | 2024-02-10T00:51:42.200Z | 0+0 records out |
358 | 2024-02-10T00:51:42.200Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
359 | 2024-02-10T00:51:42.200Z | + success 'ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists' |
360 | 2024-02-10T00:51:42.200Z | + set +x |
361 | 2024-02-10T00:51:42.200Z | ZFS vdev /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev exists |
362 | 2024-02-10T00:51:42.200Z | ++ zpool list -o name |
363 | 2024-02-10T00:51:42.200Z | ++ grep oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 |
364 | 2024-02-10T00:51:42.200Z | + [[ -z '' ]] |
365 | 2024-02-10T00:51:42.201Z | + zpool create -f oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 /scratch/oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03.vdev |
366 | 2024-02-10T00:51:42.226Z | + success 'ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists' |
367 | 2024-02-10T00:51:42.226Z | + set +x |
368 | 2024-02-10T00:51:42.226Z | ZFS zpool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 exists |
369 | 2024-02-10T00:51:42.226Z | + for ZPOOL in "${ZPOOLS[@]}" |
370 | 2024-02-10T00:51:42.226Z | + echo 'Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930]' |
371 | 2024-02-10T00:51:42.226Z | Zpool: [oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930] |
372 | 2024-02-10T00:51:42.226Z | + VDEV_PATH=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
373 | 2024-02-10T00:51:42.226Z | + [[ -f /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev ]] |
374 | 2024-02-10T00:51:42.226Z | + dd if=/dev/zero of=/scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev bs=1 count=0 seek=20G |
375 | 2024-02-10T00:51:42.227Z | 0+0 records in |
376 | 2024-02-10T00:51:42.227Z | 0+0 records out |
377 | 2024-02-10T00:51:42.227Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
378 | 2024-02-10T00:51:42.227Z | + success 'ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists' |
379 | 2024-02-10T00:51:42.227Z | + set +x |
380 | 2024-02-10T00:51:42.227Z | ZFS vdev /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev exists |
381 | 2024-02-10T00:51:42.227Z | ++ zpool list -o name |
382 | 2024-02-10T00:51:42.227Z | ++ grep oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 |
383 | 2024-02-10T00:51:42.252Z | + [[ -z '' ]] |
384 | 2024-02-10T00:51:42.252Z | + zpool create -f oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 /scratch/oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930.vdev |
385 | 2024-02-10T00:51:42.277Z | + success 'ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists' |
386 | 2024-02-10T00:51:42.277Z | + set +x |
387 | 2024-02-10T00:51:42.277Z | ZFS zpool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 exists |
388 | 2024-02-10T00:51:42.277Z | + for ZPOOL in "${ZPOOLS[@]}" |
389 | 2024-02-10T00:51:42.277Z | + echo 'Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60]' |
390 | 2024-02-10T00:51:42.278Z | Zpool: [oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60] |
391 | 2024-02-10T00:51:42.278Z | + VDEV_PATH=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
392 | 2024-02-10T00:51:42.278Z | + [[ -f /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev ]] |
393 | 2024-02-10T00:51:42.278Z | + dd if=/dev/zero of=/scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev bs=1 count=0 seek=20G |
394 | 2024-02-10T00:51:42.278Z | 0+0 records in |
395 | 2024-02-10T00:51:42.278Z | 0+0 records out |
396 | 2024-02-10T00:51:42.278Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
397 | 2024-02-10T00:51:42.278Z | + success 'ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists' |
398 | 2024-02-10T00:51:42.278Z | + set +x |
399 | 2024-02-10T00:51:42.278Z | ZFS vdev /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev exists |
400 | 2024-02-10T00:51:42.278Z | ++ zpool list -o name |
401 | 2024-02-10T00:51:42.278Z | ++ grep oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 |
402 | 2024-02-10T00:51:42.278Z | + [[ -z '' ]] |
403 | 2024-02-10T00:51:42.278Z | + zpool create -f oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 /scratch/oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60.vdev |
404 | 2024-02-10T00:51:42.303Z | + success 'ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists' |
405 | 2024-02-10T00:51:42.303Z | + set +x |
406 | 2024-02-10T00:51:42.304Z | ZFS zpool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 exists |
407 | 2024-02-10T00:51:42.304Z | + for ZPOOL in "${ZPOOLS[@]}" |
408 | 2024-02-10T00:51:42.304Z | Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f] |
409 | 2024-02-10T00:51:42.304Z | + echo 'Zpool: [oxp_31bd71cd-4736-4a12-a387-9b74b050396f]' |
410 | 2024-02-10T00:51:42.304Z | + VDEV_PATH=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
411 | 2024-02-10T00:51:42.304Z | + [[ -f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev ]] |
412 | 2024-02-10T00:51:42.304Z | + dd if=/dev/zero of=/scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev bs=1 count=0 seek=20G |
413 | 2024-02-10T00:51:42.329Z | 0+0 records in |
414 | 2024-02-10T00:51:42.329Z | 0+0 records out |
415 | 2024-02-10T00:51:42.329Z | 0 bytes (0 iB) transferred in 0.000005 secs (0 iB/sec) |
416 | 2024-02-10T00:51:42.329Z | + success 'ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists' |
417 | 2024-02-10T00:51:42.329Z | + set +x |
418 | 2024-02-10T00:51:42.329Z | ZFS vdev /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev exists |
419 | 2024-02-10T00:51:42.330Z | ++ zpool list -o name |
420 | 2024-02-10T00:51:42.330Z | ++ grep oxp_31bd71cd-4736-4a12-a387-9b74b050396f |
421 | 2024-02-10T00:51:42.330Z | + [[ -z '' ]] |
422 | 2024-02-10T00:51:42.330Z | + zpool create -f oxp_31bd71cd-4736-4a12-a387-9b74b050396f /scratch/oxp_31bd71cd-4736-4a12-a387-9b74b050396f.vdev |
423 | 2024-02-10T00:51:42.356Z | + success 'ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists' |
424 | 2024-02-10T00:51:42.356Z | + set +x |
425 | 2024-02-10T00:51:42.356Z | ZFS zpool oxp_31bd71cd-4736-4a12-a387-9b74b050396f exists |
426 | 2024-02-10T00:51:42.356Z | + for ZPOOL in "${ZPOOLS[@]}" |
427 | 2024-02-10T00:51:42.356Z | + echo 'Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7]' |
428 | 2024-02-10T00:51:42.356Z | Zpool: [oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7] |
429 | 2024-02-10T00:51:42.357Z | + VDEV_PATH=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
430 | 2024-02-10T00:51:42.357Z | + [[ -f /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev ]] |
431 | 2024-02-10T00:51:42.357Z | + dd if=/dev/zero of=/scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev bs=1 count=0 seek=20G |
432 | 2024-02-10T00:51:42.357Z | 0+0 records in |
433 | 2024-02-10T00:51:42.357Z | 0+0 records out |
434 | 2024-02-10T00:51:42.357Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
435 | 2024-02-10T00:51:42.357Z | + success 'ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists' |
436 | 2024-02-10T00:51:42.357Z | + set +x |
437 | 2024-02-10T00:51:42.357Z | ZFS vdev /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev exists |
438 | 2024-02-10T00:51:42.357Z | ++ zpool list -o name |
439 | 2024-02-10T00:51:42.358Z | ++ grep oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 |
440 | 2024-02-10T00:51:42.382Z | + [[ -z '' ]] |
441 | 2024-02-10T00:51:42.383Z | + zpool create -f oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 /scratch/oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7.vdev |
442 | 2024-02-10T00:51:42.408Z | + success 'ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists' |
443 | 2024-02-10T00:51:42.408Z | + set +x |
444 | 2024-02-10T00:51:42.408Z | ZFS zpool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 exists |
445 | 2024-02-10T00:51:42.408Z | + for ZPOOL_TYPE in "${ZPOOL_TYPES[@]}" |
446 | 2024-02-10T00:51:42.408Z | + readarray -t ZPOOLS |
447 | 2024-02-10T00:51:42.408Z | ++ grep '"oxi_' /opt/oxide/work/tools/../smf/sled-agent/non-gimlet/config.toml |
448 | 2024-02-10T00:51:42.408Z | ++ sed 's/[ ",]//g' |
449 | 2024-02-10T00:51:42.409Z | + for ZPOOL in "${ZPOOLS[@]}" |
450 | 2024-02-10T00:51:42.409Z | + echo 'Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
451 | 2024-02-10T00:51:42.409Z | Zpool: [oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b] |
452 | 2024-02-10T00:51:42.409Z | + VDEV_PATH=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
453 | 2024-02-10T00:51:42.409Z | + [[ -f /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
454 | 2024-02-10T00:51:42.409Z | + dd if=/dev/zero of=/scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
455 | 2024-02-10T00:51:42.409Z | 0+0 records in |
456 | 2024-02-10T00:51:42.409Z | 0+0 records out |
457 | 2024-02-10T00:51:42.409Z | 0 bytes (0 iB) transferred in 0.000003 secs (0 iB/sec) |
458 | 2024-02-10T00:51:42.409Z | + success 'ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
459 | 2024-02-10T00:51:42.409Z | + set +x |
460 | 2024-02-10T00:51:42.409Z | ZFS vdev /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
461 | 2024-02-10T00:51:42.409Z | ++ zpool list -o name |
462 | 2024-02-10T00:51:42.409Z | ++ grep oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b |
463 | 2024-02-10T00:51:42.434Z | + [[ -z '' ]] |
464 | 2024-02-10T00:51:42.434Z | + zpool create -f oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
465 | 2024-02-10T00:51:42.459Z | + success 'ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
466 | 2024-02-10T00:51:42.459Z | + set +x |
467 | 2024-02-10T00:51:42.459Z | ZFS zpool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
468 | 2024-02-10T00:51:42.459Z | + for ZPOOL in "${ZPOOLS[@]}" |
469 | 2024-02-10T00:51:42.459Z | + echo 'Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b]' |
470 | 2024-02-10T00:51:42.459Z | Zpool: [oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b] |
471 | 2024-02-10T00:51:42.459Z | + VDEV_PATH=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
472 | 2024-02-10T00:51:42.459Z | + [[ -f /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev ]] |
473 | 2024-02-10T00:51:42.459Z | + dd if=/dev/zero of=/scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev bs=1 count=0 seek=20G |
474 | 2024-02-10T00:51:42.459Z | 0+0 records in |
475 | 2024-02-10T00:51:42.459Z | 0+0 records out |
476 | 2024-02-10T00:51:42.459Z | 0 bytes (0 iB) transferred in 0.000004 secs (0 iB/sec) |
477 | 2024-02-10T00:51:42.460Z | + success 'ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists' |
478 | 2024-02-10T00:51:42.460Z | + set +x |
479 | 2024-02-10T00:51:42.460Z | ZFS vdev /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev exists |
480 | 2024-02-10T00:51:42.460Z | ++ zpool list -o name |
481 | 2024-02-10T00:51:42.460Z | ++ grep oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b |
482 | 2024-02-10T00:51:42.460Z | + [[ -z '' ]] |
483 | 2024-02-10T00:51:42.460Z | + zpool create -f oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b /scratch/oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b.vdev |
484 | 2024-02-10T00:51:42.485Z | + success 'ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists' |
485 | 2024-02-10T00:51:42.485Z | + set +x |
486 | 2024-02-10T00:51:42.485Z | ZFS zpool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b exists |
487 | 2024-02-10T00:51:42.485Z | + [[ zone == \z\o\n\e ]] |
488 | 2024-02-10T00:51:42.485Z | + ensure_simulated_links igb0 |
489 | 2024-02-10T00:51:42.485Z | + local PHYSICAL_LINK=igb0 |
490 | 2024-02-10T00:51:42.485Z | + INDICES=("0" "1") |
491 | 2024-02-10T00:51:42.485Z | + for I in "${INDICES[@]}" |
492 | 2024-02-10T00:51:42.485Z | ++ get_simnet_name_if_exists net0 |
493 | 2024-02-10T00:51:42.485Z | ++ dladm show-simnet -p -o LINK net0 |
494 | 2024-02-10T00:51:42.510Z | ++ echo '' |
495 | 2024-02-10T00:51:42.511Z | + [[ -z '' ]] |
496 | 2024-02-10T00:51:42.511Z | + dladm create-simnet -t net0 |
497 | 2024-02-10T00:51:42.511Z | + dladm create-simnet -t sc0_0 |
498 | 2024-02-10T00:51:42.511Z | + dladm modify-simnet -t -p net0 sc0_0 |
499 | 2024-02-10T00:51:42.511Z | + dladm set-linkprop -p mtu=9000 sc0_0 |
500 | 2024-02-10T00:51:42.511Z | + success 'Simnet net0/sc0_0 exists' |
501 | 2024-02-10T00:51:42.511Z | + set +x |
502 | 2024-02-10T00:51:42.511Z | Simnet net0/sc0_0 exists |
503 | 2024-02-10T00:51:42.511Z | + for I in "${INDICES[@]}" |
504 | 2024-02-10T00:51:42.511Z | ++ get_simnet_name_if_exists net1 |
505 | 2024-02-10T00:51:42.511Z | ++ dladm show-simnet -p -o LINK net1 |
506 | 2024-02-10T00:51:42.511Z | ++ echo '' |
507 | 2024-02-10T00:51:42.511Z | + [[ -z '' ]] |
508 | 2024-02-10T00:51:42.512Z | + dladm create-simnet -t net1 |
509 | 2024-02-10T00:51:42.536Z | + dladm create-simnet -t sc1_0 |
510 | 2024-02-10T00:51:42.536Z | + dladm modify-simnet -t -p net1 sc1_0 |
511 | 2024-02-10T00:51:42.537Z | + dladm set-linkprop -p mtu=9000 sc1_0 |
512 | 2024-02-10T00:51:42.537Z | + success 'Simnet net1/sc1_0 exists' |
513 | 2024-02-10T00:51:42.537Z | + set +x |
514 | 2024-02-10T00:51:42.537Z | Simnet net1/sc1_0 exists |
515 | 2024-02-10T00:51:42.537Z | ++ get_vnic_name_if_exists sc0_1 |
516 | 2024-02-10T00:51:42.537Z | ++ dladm show-vnic -p -o LINK sc0_1 |
517 | 2024-02-10T00:51:42.537Z | ++ echo '' |
518 | 2024-02-10T00:51:42.537Z | + [[ -z '' ]] |
519 | 2024-02-10T00:51:42.537Z | + dladm create-vnic -t sc0_1 -l igb0 -m a8:e1:de:01:70:1d |
520 | 2024-02-10T00:51:42.537Z | + [[ -v PROMISC_FILT_OFF ]] |
521 | 2024-02-10T00:51:42.537Z | + success 'Vnic sc0_1 exists' |
522 | 2024-02-10T00:51:42.537Z | + set +x |
523 | 2024-02-10T00:51:42.537Z | Vnic sc0_1 exists |
524 | 2024-02-10T00:51:42.537Z | + warn_if_no_proxy_arp |
525 | 2024-02-10T00:51:42.537Z | + [[ -v PXA_START ]] |
526 | 2024-02-10T00:51:42.537Z | + [[ -v PXA_END ]] |
527 | 2024-02-10T00:51:42.537Z | + ensure_softnpu_zone |
528 | 2024-02-10T00:51:42.537Z | + zoneadm list |
529 | 2024-02-10T00:51:42.562Z | + grep -q sidecar_softnpu |
530 | 2024-02-10T00:51:42.562Z | + [[ -f out/npuzone/npuzone ]] |
531 | 2024-02-10T00:51:42.562Z | + out/npuzone/npuzone create sidecar --omicron-zone --ports sc0_0,tfportrear0_0 --ports sc0_1,tfportqsfp0_0 --sidecar-lite-commit e3ea4b495ba0a71801ded0776ae4bbd31df57e26 --softnpu-commit dbab082dfa89da5db5ca2325c257089d2f130092 |
532 | 2024-02-10T00:51:42.562Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/softnpu/image/dbab082dfa89da5db5ca2325c257089d2f130092/softnpu.sha256.txt |
533 | 2024-02-10T00:51:47.049Z | downloading softnpu ...done |
534 | 2024-02-10T00:51:47.073Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/libsidecar_lite.so.sha256.txt |
535 | 2024-02-10T00:51:51.606Z | downloading asic_program.so ...done |
536 | 2024-02-10T00:51:51.631Z | remote url: https://buildomat.eng.oxide.computer/public/file/oxidecomputer/sidecar-lite/release/e3ea4b495ba0a71801ded0776ae4bbd31df57e26/scadm.sha256.txt |
537 | 2024-02-10T00:51:57.061Z | downloading scadm ...done |
538 | 2024-02-10T00:51:57.086Z | creating port tfportrear0_0 for sc0_0 |
539 | 2024-02-10T00:51:57.086Z | creating port tfportqsfp0_0 for sc0_1 |
540 | 2024-02-10T00:51:57.110Z | softnpu zone setup |
541 | 2024-02-10T00:51:57.110Z | configure zone |
542 | 2024-02-10T00:51:57.110Z | install zone |
543 | 2024-02-10T00:51:58.153Z | boot zone |
544 | 2024-02-10T00:52:01.263Z | [sidecar_softnpu] svcs milestone/network |
545 | 2024-02-10T00:52:01.290Z | STATE STIME FMRI |
546 | 2024-02-10T00:52:01.290Z | online 0:51:59 svc:/milestone/network:default |
547 | 2024-02-10T00:52:01.290Z | [sidecar_softnpu] /softnpu/npu start |
548 | 2024-02-10T00:52:01.315Z | |
549 | 2024-02-10T00:52:01.344Z | + /opt/oxide/work/tools/scrimlet/softnpu-init.sh |
550 | 2024-02-10T00:52:01.344Z | + GATEWAY_IP=10.151.2.100 |
551 | 2024-02-10T00:52:01.344Z | + echo 'Using 10.151.2.100 as gateway ip' |
552 | 2024-02-10T00:52:01.344Z | Using 10.151.2.100 as gateway ip |
553 | 2024-02-10T00:52:01.344Z | + [[ ! -v GATEWAY_MAC ]] |
554 | 2024-02-10T00:52:01.344Z | + GATEWAY_MAC=18:c0:4d:0d:a0:2a |
555 | 2024-02-10T00:52:01.344Z | ++ grep -c -E '^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$' /dev/fd/63 |
556 | 2024-02-10T00:52:01.344Z | +++ echo 18:c0:4d:0d:a0:2a |
557 | 2024-02-10T00:52:01.344Z | + COUNT=1 |
558 | 2024-02-10T00:52:01.344Z | + [[ 1 -ne 1 ]] |
559 | 2024-02-10T00:52:01.344Z | + echo 'Using 18:c0:4d:0d:a0:2a as gateway mac' |
560 | 2024-02-10T00:52:01.344Z | Using 18:c0:4d:0d:a0:2a as gateway mac |
561 | 2024-02-10T00:52:01.344Z | + z_scadm add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a |
562 | 2024-02-10T00:52:01.344Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-arp-entry 10.151.2.100 18:c0:4d:0d:a0:2a |
563 | 2024-02-10T00:52:01.370Z | + PXA_MAC=a8:e1:de:01:70:1d |
564 | 2024-02-10T00:52:01.370Z | + [[ -v PXA_START ]] |
565 | 2024-02-10T00:52:01.370Z | + z_scadm add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d |
566 | 2024-02-10T00:52:01.370Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone add-proxy-arp 10.151.2.164 10.151.2.227 a8:e1:de:01:70:1d |
567 | 2024-02-10T00:52:01.396Z | + z_scadm dump-state |
568 | 2024-02-10T00:52:01.396Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
569 | 2024-02-10T00:52:01.422Z | local v6: |
570 | 2024-02-10T00:52:01.422Z | local v4: |
571 | 2024-02-10T00:52:01.422Z | router v6: |
572 | 2024-02-10T00:52:01.422Z | router v4_idx: |
573 | 2024-02-10T00:52:01.422Z | router v4_routes: |
574 | 2024-02-10T00:52:01.422Z | resolver v4: |
575 | 2024-02-10T00:52:01.422Z | 10.151.2.100 -> 18:c0:4d:0d:a0:2a |
576 | 2024-02-10T00:52:01.422Z | resolver v6: |
577 | 2024-02-10T00:52:01.422Z | nat v4: |
578 | 2024-02-10T00:52:01.422Z | nat_v6: |
579 | 2024-02-10T00:52:01.422Z | port_mac: |
580 | 2024-02-10T00:52:01.422Z | proxy arp: |
581 | 2024-02-10T00:52:01.422Z | 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d |
582 | 2024-02-10T00:52:01.422Z | + success 'softnpu zone exists' |
583 | 2024-02-10T00:52:01.422Z | + set +x |
584 | 2024-02-10T00:52:01.422Z | softnpu zone exists |
585 | 2024-02-10T00:52:01.422Z | |
586 | 2024-02-10T00:52:01.422Z | real 19.430400811 |
587 | 2024-02-10T00:52:01.422Z | user 0.704090694 |
588 | 2024-02-10T00:52:01.423Z | sys 1.559039746 |
589 | 2024-02-10T00:52:01.423Z | trap 0.000088006 |
590 | 2024-02-10T00:52:01.423Z | tflt 0.000098897 |
591 | 2024-02-10T00:52:01.423Z | dflt 0.001365291 |
592 | 2024-02-10T00:52:01.423Z | kflt 0.000000000 |
593 | 2024-02-10T00:52:01.423Z | lock 14:55.110715769 |
594 | 2024-02-10T00:52:01.423Z | slp 57.999607031 |
595 | 2024-02-10T00:52:01.423Z | lat 0.087106667 |
596 | 2024-02-10T00:52:01.423Z | stop 0.362202447 |
597 | 2024-02-10T00:52:01.423Z | + tar xf out/omicron-sled-agent.tar pkg/config-rss.toml |
598 | 2024-02-10T00:52:01.451Z | ++ sed -n 's/silo_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
599 | 2024-02-10T00:52:01.478Z | + SILO_NAME=recovery |
600 | 2024-02-10T00:52:01.479Z | ++ sed -n 's/external_dns_zone_name = "\(.*\)"/\1/p' pkg/config-rss.toml |
601 | 2024-02-10T00:52:01.479Z | + EXTERNAL_DNS_DOMAIN=oxide.test |
602 | 2024-02-10T00:52:01.479Z | + sed -i~ ' |
603 | 2024-02-10T00:52:01.479Z | /^external_dns_ips/c\ |
604 | 2024-02-10T00:52:01.479Z | external_dns_ips = [ "10.151.2.164", "10.151.2.165" ] |
605 | 2024-02-10T00:52:01.479Z | /^\[\[internal_services_ip_pool_ranges/,/^$/ { |
606 | 2024-02-10T00:52:01.479Z | /^first/c\ |
607 | 2024-02-10T00:52:01.479Z | first = "10.151.2.164" |
608 | 2024-02-10T00:52:01.479Z | /^last/c\ |
609 | 2024-02-10T00:52:01.479Z | last = "10.151.2.173" |
610 | 2024-02-10T00:52:01.479Z | } |
611 | 2024-02-10T00:52:01.479Z | /^\[rack_network_config/,/^$/ { |
612 | 2024-02-10T00:52:01.479Z | /^infra_ip_first/c\ |
613 | 2024-02-10T00:52:01.479Z | infra_ip_first = "10.151.2.174" |
614 | 2024-02-10T00:52:01.479Z | /^infra_ip_last/c\ |
615 | 2024-02-10T00:52:01.479Z | infra_ip_last = "10.151.2.174" |
616 | 2024-02-10T00:52:01.479Z | } |
617 | 2024-02-10T00:52:01.479Z | /^\[\[rack_network_config.ports/,/^$/ { |
618 | 2024-02-10T00:52:01.479Z | /^routes/c\ |
619 | 2024-02-10T00:52:01.479Z | routes = \[{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}\] |
620 | 2024-02-10T00:52:01.479Z | /^addresses/c\ |
621 | 2024-02-10T00:52:01.479Z | addresses = \["10.151.2.174/24"\] |
622 | 2024-02-10T00:52:01.479Z | } |
623 | 2024-02-10T00:52:01.479Z | ' pkg/config-rss.toml |
624 | 2024-02-10T00:52:01.480Z | + diff -u pkg/config-rss.toml~ pkg/config-rss.toml |
625 | 2024-02-10T00:52:01.480Z | --- pkg/config-rss.toml~ Mon Jul 24 01:21:28 2006 |
626 | 2024-02-10T00:52:01.480Z | +++ pkg/config-rss.toml Sat Feb 10 00:52:01 2024 |
627 | 2024-02-10T00:52:01.480Z | @@ -33,7 +33,7 @@ |
628 | 2024-02-10T00:52:01.480Z | # the DNS domain delegated to the rack by the customer. Each of these addresses |
629 | 2024-02-10T00:52:01.480Z | # must be contained in one of the "internal services" IP Pool ranges listed |
630 | 2024-02-10T00:52:01.480Z | # below. |
631 | 2024-02-10T00:52:01.480Z | -external_dns_ips = [ "192.168.1.20", "192.168.1.21" ] |
632 | 2024-02-10T00:52:01.480Z | +external_dns_ips = [ "10.151.2.164", "10.151.2.165" ] |
633 | 2024-02-10T00:52:01.480Z | |
634 | 2024-02-10T00:52:01.480Z | # Initial TLS certificates for the external API |
635 | 2024-02-10T00:52:01.480Z | # |
636 | 2024-02-10T00:52:01.480Z | @@ -69,8 +69,8 @@ |
637 | 2024-02-10T00:52:01.480Z | # |
638 | 2024-02-10T00:52:01.480Z | # For more on this and what to put here, see docs/how-to-run.adoc. |
639 | 2024-02-10T00:52:01.480Z | [[internal_services_ip_pool_ranges]] |
640 | 2024-02-10T00:52:01.480Z | -first = "192.168.1.20" |
641 | 2024-02-10T00:52:01.480Z | -last = "192.168.1.29" |
642 | 2024-02-10T00:52:01.480Z | +first = "10.151.2.164" |
643 | 2024-02-10T00:52:01.480Z | +last = "10.151.2.173" |
644 | 2024-02-10T00:52:01.480Z | |
645 | 2024-02-10T00:52:01.480Z | # TODO - this configuration is subject to change going forward. Ultimately these |
646 | 2024-02-10T00:52:01.480Z | # parameters should be provided to the control plane via wicket, but we need to |
647 | 2024-02-10T00:52:01.480Z | @@ -100,9 +100,9 @@ |
648 | 2024-02-10T00:52:01.480Z | # You can configure multiple uplinks by repeating the following stanza |
649 | 2024-02-10T00:52:01.481Z | [[rack_network_config.ports]] |
650 | 2024-02-10T00:52:01.481Z | # Routes associated with this port. |
651 | 2024-02-10T00:52:01.481Z | -routes = [{nexthop = "192.168.1.199", destination = "0.0.0.0/0"}] |
652 | 2024-02-10T00:52:01.481Z | +routes = [{nexthop = "10.151.2.100", destination = "0.0.0.0/0"}] |
653 | 2024-02-10T00:52:01.481Z | # Addresses associated with this port. |
654 | 2024-02-10T00:52:01.481Z | -addresses = ["192.168.1.30/24"] |
655 | 2024-02-10T00:52:01.481Z | +addresses = ["10.151.2.174/24"] |
656 | 2024-02-10T00:52:01.481Z | # Name of the uplink port. This should always be "qsfp0" when using softnpu. |
657 | 2024-02-10T00:52:01.481Z | port = "qsfp0" |
658 | 2024-02-10T00:52:01.481Z | # The speed of this port. |
659 | 2024-02-10T00:52:01.481Z | + true |
660 | 2024-02-10T00:52:01.481Z | + tar rvf out/omicron-sled-agent.tar pkg/config-rss.toml |
661 | 2024-02-10T00:52:01.481Z | a pkg/config-rss.toml 7K |
662 | 2024-02-10T00:52:01.481Z | + rm -f pkg/config-rss.toml pkg/config-rss.toml~ |
663 | 2024-02-10T00:52:01.481Z | + TLS_NAME=recovery.sys.oxide.test |
664 | 2024-02-10T00:52:01.481Z | + openssl req -newkey rsa:4096 -x509 -sha256 -days 3 -nodes -out pkg/initial-tls-cert.pem -keyout pkg/initial-tls-key.pem -subj /CN=recovery.sys.oxide.test -addext subjectAltName=DNS:recovery.sys.oxide.test -addext basicConstraints=critical,CA:FALSE -config /dev/stdin |
665 | 2024-02-10T00:52:02.051Z | .+...+.+.....+.+...+........+...+...............+.......+..+.......+...+..+...+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+......+..+..........+..+.+.....+.......+.....+.+..+.......+........+...+.+...........+....+......+...+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+...........+................+......+.....+..........+.....+.......+...+...+...........+...+..........+...........+.......+...+......+...+...........+......+.........+.+.....+.+.....+...+............+........................+......+...+..........+..+............+......................+........+...+.........+.+...............+.....+...................+...+.....+...+...+....+..+...+................+..............+.......+...+......+.....+....+...............+..+...+.+...............+..+...+......+....+......+.....+.+.....+....+.....+.........+.....................+..........+...+.....+...+....+......+.....+....+......+...+.....+...............+....+...+............+...........+......+..........+....................................+...............+.....+...+.........+.......+.....+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
666 | 2024-02-10T00:52:02.791Z | .+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+......+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.......+......+...+.....+....+.....+..........+..+....+........................+..+.+...+.....+.+...............+........+..........+...........................+...+.....+.+......+...+...........+....+...........+.......+.........+.....+.........+......+....+.....+....+...+..............+...+...+....+.........+..............+.+...........................+...............+........................+...+........+....+...+.................+...+...............+.+............................................+................+......+...+...+........+.......+..+...............+.+..+.........+.+........+.+.....+..............................+...+.+............+........+......+.+..................+..............+.......+......+........+....+........+..................+.......+..+...+...+.+.....+.+.........+........+.+.....+...............+.......+...+..+.........+....+......+...+.....+...+...+....+......+.....+......+...............+..........+......+.....+...+.+.....+......+........................+....+...........................+...+.....+.........+.+..+...............+...+..........+.........+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ |
667 | 2024-02-10T00:52:02.816Z | ----- |
668 | 2024-02-10T00:52:02.817Z | + tar rvf out/omicron-sled-agent.tar pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
669 | 2024-02-10T00:52:02.845Z | a pkg/initial-tls-cert.pem 2K |
670 | 2024-02-10T00:52:02.845Z | a pkg/initial-tls-key.pem 4K |
671 | 2024-02-10T00:52:02.845Z | + rm -f pkg/initial-tls-cert.pem pkg/initial-tls-key.pem |
672 | 2024-02-10T00:52:02.845Z | + rmdir pkg |
673 | 2024-02-10T00:52:02.845Z | + E2E_TLS_CERT=/opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
674 | 2024-02-10T00:52:02.845Z | + pfexec mkdir -p /usr/oxide |
675 | 2024-02-10T00:52:02.845Z | + pfexec curl -sSfL -o /usr/oxide/oxide http://catacomb.eng.oxide.computer:12346/oxide-v0.1.0 |
676 | 2024-02-10T00:52:03.649Z | + pfexec chmod +x /usr/oxide/oxide |
677 | 2024-02-10T00:52:03.674Z | + curl -sSfL -o debian-11-genericcloud-amd64.raw http://catacomb.eng.oxide.computer:12346/debian-11-genericcloud-amd64.raw |
678 | 2024-02-10T00:52:21.983Z | + OMICRON_NO_UNINSTALL=1 |
679 | 2024-02-10T00:52:21.983Z | + ptime -m pfexec ./target/release/omicron-package -t test install |
680 | 2024-02-10T00:52:22.008Z | Logging to: /opt/oxide/work/out/LOG |
681 | 2024-02-10T00:52:22.503Z | |
682 | 2024-02-10T00:52:22.529Z | real 0.518718368 |
683 | 2024-02-10T00:52:22.529Z | user 0.108404598 |
684 | 2024-02-10T00:52:22.529Z | sys 2.192793997 |
685 | 2024-02-10T00:52:22.529Z | trap 0.000007839 |
686 | 2024-02-10T00:52:22.529Z | tflt 0.000010810 |
687 | 2024-02-10T00:52:22.529Z | dflt 0.000409227 |
688 | 2024-02-10T00:52:22.529Z | kflt 0.000001480 |
689 | 2024-02-10T00:52:22.529Z | lock 47.063202557 |
690 | 2024-02-10T00:52:22.529Z | slp 0.731688933 |
691 | 2024-02-10T00:52:22.529Z | lat 0.003401387 |
692 | 2024-02-10T00:52:22.529Z | stop 0.215239494 |
693 | 2024-02-10T00:52:22.529Z | + retry=0 |
694 | 2024-02-10T00:52:22.529Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
695 | 2024-02-10T00:52:22.529Z | + [[ 0 -gt 30 ]] |
696 | 2024-02-10T00:52:22.529Z | + sleep 1 |
697 | 2024-02-10T00:52:23.518Z | + retry=1 |
698 | 2024-02-10T00:52:23.518Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
699 | 2024-02-10T00:52:23.543Z | + [[ 1 -gt 30 ]] |
700 | 2024-02-10T00:52:23.543Z | + sleep 1 |
|
701 | 2024-02-10T00:52:23.773Z | Error: No response to keepalive - Terminating session |
|
702 | 2024-02-10T00:52:24.533Z | + retry=2 |
703 | 2024-02-10T00:52:24.533Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
704 | 2024-02-10T00:52:24.559Z | + [[ 2 -gt 30 ]] |
705 | 2024-02-10T00:52:24.559Z | + sleep 1 |
706 | 2024-02-10T00:52:25.555Z | + retry=3 |
707 | 2024-02-10T00:52:25.556Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
708 | 2024-02-10T00:52:25.581Z | + [[ 3 -gt 30 ]] |
709 | 2024-02-10T00:52:25.581Z | + sleep 1 |
710 | 2024-02-10T00:52:26.561Z | + retry=4 |
711 | 2024-02-10T00:52:26.561Z | + curl --head --silent -o /dev/null 'http://[fd00:1122:3344:101::2]:12224/' |
|
712 | 2024-02-10T00:52:33.765Z | Error: No response de-activating SOL payload |
713 | 2024-02-10T00:52:34.815Z | [SOL Session operational. Use ~? for help] |
|
714 | 2024-02-10T00:52:51.741Z | + pfexec zlogin sidecar_softnpu /softnpu/scadm --server /softnpu/server --client /softnpu/client standalone dump-state |
715 | 2024-02-10T00:52:51.768Z | local v6: |
716 | 2024-02-10T00:52:51.768Z | fd86:9062:c409:5250::1 |
717 | 2024-02-10T00:52:51.768Z | fe80::ac4b:c5ff:fe22:bbf |
718 | 2024-02-10T00:52:51.768Z | local v4: |
719 | 2024-02-10T00:52:51.768Z | 10.151.2.174 |
720 | 2024-02-10T00:52:51.768Z | router v6: |
721 | 2024-02-10T00:52:51.768Z | fd00:1122:3344:101::/64 -> fe80::d8eb:32ff:feac:3a1c (1) |
722 | 2024-02-10T00:52:51.768Z | fd00:1122:3344:1::/64 -> fe80::d8eb:32ff:feac:3a1c (1) |
723 | 2024-02-10T00:52:51.768Z | fdb0:18c0:4d0d:a02a::/64 -> fe80::d8eb:32ff:feac:3a1c (1) |
724 | 2024-02-10T00:52:51.768Z | fd00:1122:3344:2::/64 -> fe80::d8eb:32ff:feac:3a1c (1) |
725 | 2024-02-10T00:52:51.768Z | fd00:1122:3344:3::/64 -> fe80::d8eb:32ff:feac:3a1c (1) |
726 | 2024-02-10T00:52:51.768Z | router v4_idx: |
727 | 2024-02-10T00:52:51.768Z | 0.0.0.0/0 -> 0 |
728 | 2024-02-10T00:52:51.768Z | router v4_routes: |
729 | 2024-02-10T00:52:51.769Z | 0 -> 10.151.2.100 (2) |
730 | 2024-02-10T00:52:51.769Z | resolver v4: |
731 | 2024-02-10T00:52:51.794Z | 10.151.2.174 -> 0e:34:6c:f1:34:0c |
732 | 2024-02-10T00:52:51.794Z | 10.151.2.100 -> 18:c0:4d:0d:a0:2a |
733 | 2024-02-10T00:52:51.794Z | resolver v6: |
734 | 2024-02-10T00:52:51.794Z | fe80::ac4b:c5ff:fe22:bbf -> ae:4b:c5:22:0b:bf |
735 | 2024-02-10T00:52:51.794Z | fe80::d8eb:32ff:feac:3a1c -> da:eb:32:ac:3a:1c |
736 | 2024-02-10T00:52:51.794Z | nat v4: |
737 | 2024-02-10T00:52:51.794Z | 10.151.2.169 0/16383 -> fd00:1122:3344:101::1 100/a8:40:25:ff:ee:37 |
738 | 2024-02-10T00:52:51.794Z | nat_v6: |
739 | 2024-02-10T00:52:51.794Z | port_mac: |
740 | 2024-02-10T00:52:51.794Z | 1: a8:40:25:1f:7a:84 |
741 | 2024-02-10T00:52:51.794Z | 1000: a8:40:25:1f:7a:83 |
742 | 2024-02-10T00:52:51.794Z | proxy arp: |
743 | 2024-02-10T00:52:51.794Z | 10.151.2.164/10.151.2.227: a8:e1:de:01:70:1d |
744 | 2024-02-10T00:52:51.794Z | + retry=0 |
745 | 2024-02-10T00:52:51.794Z | +++ zoneadm list -n |
746 | 2024-02-10T00:52:51.794Z | +++ grep oxz_ntp |
747 | 2024-02-10T00:52:51.794Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
748 | 2024-02-10T00:52:51.822Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
749 | 2024-02-10T00:52:51.822Z | ++ true |
750 | 2024-02-10T00:52:51.822Z | + [[ '' != online ]] |
751 | 2024-02-10T00:52:51.822Z | + [[ 0 -gt 60 ]] |
752 | 2024-02-10T00:52:51.822Z | + sleep 1 |
753 | 2024-02-10T00:52:52.802Z | + retry=1 |
754 | 2024-02-10T00:52:52.827Z | +++ zoneadm list -n |
755 | 2024-02-10T00:52:52.827Z | +++ grep oxz_ntp |
756 | 2024-02-10T00:52:52.827Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
757 | 2024-02-10T00:52:52.852Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
758 | 2024-02-10T00:52:52.852Z | ++ true |
759 | 2024-02-10T00:52:52.852Z | + [[ '' != online ]] |
760 | 2024-02-10T00:52:52.852Z | + [[ 1 -gt 60 ]] |
761 | 2024-02-10T00:52:52.852Z | + sleep 1 |
762 | 2024-02-10T00:52:53.833Z | + retry=2 |
763 | 2024-02-10T00:52:53.859Z | +++ zoneadm list -n |
764 | 2024-02-10T00:52:53.859Z | +++ grep oxz_ntp |
765 | 2024-02-10T00:52:53.859Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
766 | 2024-02-10T00:52:53.859Z | svcs: Pattern 'oxide/ntp' doesn't match any instances |
767 | 2024-02-10T00:52:53.884Z | ++ true |
768 | 2024-02-10T00:52:53.884Z | + [[ '' != online ]] |
769 | 2024-02-10T00:52:53.884Z | + [[ 2 -gt 60 ]] |
770 | 2024-02-10T00:52:53.884Z | + sleep 1 |
771 | 2024-02-10T00:52:54.863Z | + retry=3 |
772 | 2024-02-10T00:52:54.888Z | +++ zoneadm list -n |
773 | 2024-02-10T00:52:54.888Z | +++ grep oxz_ntp |
774 | 2024-02-10T00:52:54.888Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
775 | 2024-02-10T00:52:54.888Z | + [[ disabled != online ]] |
776 | 2024-02-10T00:52:54.888Z | + [[ 3 -gt 60 ]] |
777 | 2024-02-10T00:52:54.888Z | + sleep 1 |
778 | 2024-02-10T00:52:55.886Z | + retry=4 |
779 | 2024-02-10T00:52:55.911Z | +++ zoneadm list -n |
780 | 2024-02-10T00:52:55.911Z | +++ grep oxz_ntp |
781 | 2024-02-10T00:52:55.911Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
782 | 2024-02-10T00:52:55.911Z | + [[ disabled != online ]] |
783 | 2024-02-10T00:52:55.911Z | + [[ 4 -gt 60 ]] |
784 | 2024-02-10T00:52:55.911Z | + sleep 1 |
785 | 2024-02-10T00:52:56.907Z | + retry=5 |
786 | 2024-02-10T00:52:56.932Z | +++ zoneadm list -n |
787 | 2024-02-10T00:52:56.932Z | +++ grep oxz_ntp |
788 | 2024-02-10T00:52:56.933Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
789 | 2024-02-10T00:52:56.933Z | + [[ disabled != online ]] |
790 | 2024-02-10T00:52:56.933Z | + [[ 5 -gt 60 ]] |
791 | 2024-02-10T00:52:56.933Z | + sleep 1 |
792 | 2024-02-10T00:52:57.930Z | + retry=6 |
793 | 2024-02-10T00:52:57.960Z | +++ zoneadm list -n |
794 | 2024-02-10T00:52:57.960Z | +++ grep oxz_ntp |
795 | 2024-02-10T00:52:57.961Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
796 | 2024-02-10T00:52:57.961Z | + [[ disabled != online ]] |
797 | 2024-02-10T00:52:57.961Z | + [[ 6 -gt 60 ]] |
798 | 2024-02-10T00:52:57.961Z | + sleep 1 |
799 | 2024-02-10T00:52:58.953Z | + retry=7 |
800 | 2024-02-10T00:52:58.979Z | +++ zoneadm list -n |
801 | 2024-02-10T00:52:58.979Z | +++ grep oxz_ntp |
802 | 2024-02-10T00:52:58.979Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
803 | 2024-02-10T00:52:58.979Z | + [[ disabled != online ]] |
804 | 2024-02-10T00:52:58.979Z | + [[ 7 -gt 60 ]] |
805 | 2024-02-10T00:52:58.979Z | + sleep 1 |
806 | 2024-02-10T00:52:59.978Z | + retry=8 |
807 | 2024-02-10T00:53:00.003Z | +++ zoneadm list -n |
808 | 2024-02-10T00:53:00.003Z | +++ grep oxz_ntp |
809 | 2024-02-10T00:53:00.004Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
810 | 2024-02-10T00:53:00.004Z | + [[ disabled != online ]] |
811 | 2024-02-10T00:53:00.004Z | + [[ 8 -gt 60 ]] |
812 | 2024-02-10T00:53:00.004Z | + sleep 1 |
813 | 2024-02-10T00:53:01.000Z | + retry=9 |
814 | 2024-02-10T00:53:01.026Z | +++ zoneadm list -n |
815 | 2024-02-10T00:53:01.026Z | +++ grep oxz_ntp |
816 | 2024-02-10T00:53:01.026Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
817 | 2024-02-10T00:53:01.026Z | + [[ disabled != online ]] |
818 | 2024-02-10T00:53:01.026Z | + [[ 9 -gt 60 ]] |
819 | 2024-02-10T00:53:01.026Z | + sleep 1 |
820 | 2024-02-10T00:53:02.020Z | + retry=10 |
821 | 2024-02-10T00:53:02.046Z | +++ zoneadm list -n |
822 | 2024-02-10T00:53:02.046Z | +++ grep oxz_ntp |
823 | 2024-02-10T00:53:02.046Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
824 | 2024-02-10T00:53:02.046Z | + [[ disabled != online ]] |
825 | 2024-02-10T00:53:02.046Z | + [[ 10 -gt 60 ]] |
826 | 2024-02-10T00:53:02.046Z | + sleep 1 |
|
827 | 2024-02-10T00:53:02.855Z | Feb 10 00:53:02 sock ip: ip: joining multicasts failed (4) on vopte0 - will use link layer broadcasts for multicast |
|
828 | 2024-02-10T00:53:03.043Z | + retry=11 |
829 | 2024-02-10T00:53:03.081Z | +++ zoneadm list -n |
830 | 2024-02-10T00:53:03.081Z | +++ grep oxz_ntp |
831 | 2024-02-10T00:53:03.081Z | ++ pfexec svcs -z oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd -Hostate oxide/ntp |
832 | 2024-02-10T00:53:03.081Z | + [[ online != online ]] |
833 | 2024-02-10T00:53:03.081Z | + echo 'Waited for chrony: 11s' |
834 | 2024-02-10T00:53:03.081Z | + export RUST_BACKTRACE=1 |
835 | 2024-02-10T00:53:03.081Z | Waited for chrony: 11s |
836 | 2024-02-10T00:53:03.081Z | + RUST_BACKTRACE=1 |
837 | 2024-02-10T00:53:03.081Z | + export E2E_TLS_CERT IPPOOL_START IPPOOL_END |
838 | 2024-02-10T00:53:03.082Z | ++ ./tests/bootstrap |
839 | 2024-02-10T00:53:03.108Z | Using external DNS server at 10.151.2.164:53 |
840 | 2024-02-10T00:53:03.109Z | 2024-02-10 00:53:03.221183314 UTC: attempting to log into API |
841 | 2024-02-10T00:53:18.129Z | 2024-02-10 00:53:18.270347314 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
842 | 2024-02-10T00:53:19.131Z | 2024-02-10 00:53:19.272094333 UTC: attempting to log into API |
843 | 2024-02-10T00:53:34.163Z | 2024-02-10 00:53:34.304383162 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
844 | 2024-02-10T00:53:35.164Z | 2024-02-10 00:53:35.306121821 UTC: attempting to log into API |
845 | 2024-02-10T00:53:50.197Z | 2024-02-10 00:53:50.338210385 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
846 | 2024-02-10T00:53:51.198Z | 2024-02-10 00:53:51.340112426 UTC: attempting to log into API |
847 | 2024-02-10T00:54:06.230Z | 2024-02-10 00:54:06.371997666 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
848 | 2024-02-10T00:54:07.232Z | 2024-02-10 00:54:07.373790156 UTC: attempting to log into API |
849 | 2024-02-10T00:54:22.262Z | 2024-02-10 00:54:22.722660056 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
850 | 2024-02-10T00:54:23.263Z | 2024-02-10 00:54:23.720955086 UTC: attempting to log into API |
851 | 2024-02-10T00:54:38.295Z | 2024-02-10 00:54:38.711564741 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
852 | 2024-02-10T00:54:39.295Z | 2024-02-10 00:54:39.709463891 UTC: attempting to log into API |
853 | 2024-02-10T00:54:54.326Z | 2024-02-10 00:54:54.699874762 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
854 | 2024-02-10T00:54:55.327Z | 2024-02-10 00:54:55.698153463 UTC: attempting to log into API |
855 | 2024-02-10T00:55:10.358Z | 2024-02-10 00:55:10.688246554 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
856 | 2024-02-10T00:55:11.358Z | 2024-02-10 00:55:11.686372001 UTC: attempting to log into API |
857 | 2024-02-10T00:55:26.390Z | 2024-02-10 00:55:26.677747517 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
858 | 2024-02-10T00:55:27.393Z | 2024-02-10 00:55:27.676682933 UTC: attempting to log into API |
|
859 | 2024-02-10T00:55:39.504Z | Error: No response to keepalive - Terminating session |
|
860 | 2024-02-10T00:55:42.425Z | 2024-02-10 00:55:42.667946219 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
861 | 2024-02-10T00:55:43.426Z | 2024-02-10 00:55:43.666969748 UTC: attempting to log into API |
|
862 | 2024-02-10T00:55:49.473Z | Error: No response de-activating SOL payload |
863 | 2024-02-10T00:55:50.956Z | [SOL Session operational. Use ~? for help] |
|
864 | 2024-02-10T00:55:58.456Z | 2024-02-10 00:55:58.656896171 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
865 | 2024-02-10T00:55:59.458Z | 2024-02-10 00:55:59.655124380 UTC: attempting to log into API |
866 | 2024-02-10T00:56:14.488Z | 2024-02-10 00:56:14.644989310 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
867 | 2024-02-10T00:56:15.489Z | 2024-02-10 00:56:15.643060975 UTC: attempting to log into API |
868 | 2024-02-10T00:56:30.521Z | 2024-02-10 00:56:30.633937799 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
869 | 2024-02-10T00:56:31.522Z | 2024-02-10 00:56:31.632144108 UTC: attempting to log into API |
870 | 2024-02-10T00:56:46.552Z | 2024-02-10 00:56:46.622115120 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
871 | 2024-02-10T00:56:47.554Z | 2024-02-10 00:56:47.620191255 UTC: attempting to log into API |
872 | 2024-02-10T00:57:02.585Z | 2024-02-10 00:57:02.611222254 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
873 | 2024-02-10T00:57:03.587Z | 2024-02-10 00:57:03.610358356 UTC: attempting to log into API |
874 | 2024-02-10T00:57:18.617Z | 2024-02-10 00:57:18.604555193 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
875 | 2024-02-10T00:57:19.619Z | 2024-02-10 00:57:19.605357469 UTC: attempting to log into API |
876 | 2024-02-10T00:57:34.650Z | 2024-02-10 00:57:34.636887320 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
877 | 2024-02-10T00:57:35.651Z | 2024-02-10 00:57:35.638661500 UTC: attempting to log into API |
878 | 2024-02-10T00:57:50.682Z | 2024-02-10 00:57:50.669531886 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
879 | 2024-02-10T00:57:51.683Z | 2024-02-10 00:57:51.670380514 UTC: attempting to log into API |
880 | 2024-02-10T00:58:06.714Z | 2024-02-10 00:58:06.700857109 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
881 | 2024-02-10T00:58:07.714Z | 2024-02-10 00:58:07.701979302 UTC: attempting to log into API |
882 | 2024-02-10T00:58:22.752Z | 2024-02-10 00:58:22.739569185 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
883 | 2024-02-10T00:58:23.756Z | 2024-02-10 00:58:23.740668656 UTC: attempting to log into API |
884 | 2024-02-10T00:58:38.787Z | 2024-02-10 00:58:38.775221371 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
|
885 | 2024-02-10T00:58:39.465Z | Error: No response to keepalive - Terminating session |
|
886 | 2024-02-10T00:58:39.788Z | 2024-02-10 00:58:39.776337643 UTC: attempting to log into API |
|
887 | 2024-02-10T00:58:49.736Z | Error: No response de-activating SOL payload |
888 | 2024-02-10T00:58:50.948Z | [SOL Session operational. Use ~? for help] |
|
889 | 2024-02-10T00:58:54.826Z | 2024-02-10 00:58:54.812747043 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
890 | 2024-02-10T00:58:55.826Z | 2024-02-10 00:58:55.814331227 UTC: attempting to log into API |
891 | 2024-02-10T00:59:10.874Z | 2024-02-10 00:59:10.863058648 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
892 | 2024-02-10T00:59:11.875Z | 2024-02-10 00:59:11.863953466 UTC: attempting to log into API |
|
893 | 2024-02-10T00:59:23.319Z | Feb 10 00:59:23 sock ip: ip: joining multicasts failed (4) on vopte3 - will use link layer broadcasts for multicast |
|
894 | 2024-02-10T00:59:26.913Z | 2024-02-10 00:59:26.902898832 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
895 | 2024-02-10T00:59:27.914Z | 2024-02-10 00:59:27.904061345 UTC: attempting to log into API |
|
896 | 2024-02-10T00:59:31.487Z | Feb 10 00:59:30 sock ip: ip: joining multicasts failed (4) on vopte1 - will use link layer broadcasts for multicast |
897 | 2024-02-10T00:59:38.831Z | Feb 10 00:59:37 sock ip: ip: joining multicasts failed (4) on vopte2 - will use link layer broadcasts for multicast |
|
898 | 2024-02-10T00:59:42.945Z | 2024-02-10 00:59:42.935447916 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
899 | 2024-02-10T00:59:43.946Z | 2024-02-10 00:59:43.936382562 UTC: attempting to log into API |
|
900 | 2024-02-10T00:59:44.226Z | Feb 10 00:59:43 sock ip: ip: joining multicasts failed (4) on vopte4 - will use link layer broadcasts for multicast |
901 | 2024-02-10T00:59:50.938Z | Feb 10 00:59:50 sock ip: ip: joining multicasts failed (4) on vopte5 - will use link layer broadcasts for multicast |
|
902 | 2024-02-10T00:59:58.977Z | 2024-02-10 00:59:58.967558501 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
903 | 2024-02-10T00:59:59.978Z | 2024-02-10 00:59:59.968672614 UTC: attempting to log into API |
904 | 2024-02-10T01:00:15.009Z | 2024-02-10 01:00:14.999641267 UTC: login failed: logging in: error sending request for url (https://recovery.sys.oxide.test/v1/login/recovery/local): error trying to connect: operation timed out |
905 | 2024-02-10T01:00:16.010Z | 2024-02-10 01:00:16.000742630 UTC: attempting to log into API |
906 | 2024-02-10T01:00:16.781Z | 2024-02-10 01:00:16.772078490 UTC: login succeeded |
907 | 2024-02-10T01:00:16.813Z | waiting for nexus to come up... |
908 | 2024-02-10T01:00:16.885Z | creating IP pool... 10.151.2.175 - 10.151.2.227 |
909 | 2024-02-10T01:00:17.044Z | setting up quotas... |
910 | 2024-02-10T01:00:17.083Z | ensuring datasets are ready... |
911 | 2024-02-10T01:00:19.571Z | let's roll. |
912 | 2024-02-10T01:00:19.596Z | + eval 'OXIDE_HOST=https://recovery.sys.oxide.test |
913 | 2024-02-10T01:00:19.596Z | OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166 |
914 | 2024-02-10T01:00:19.596Z | OXIDE_TOKEN=oxide-token-1109d99b19a30df72fdc13884bb9495630525c2f' |
915 | 2024-02-10T01:00:19.596Z | ++ OXIDE_HOST=https://recovery.sys.oxide.test |
916 | 2024-02-10T01:00:19.596Z | ++ OXIDE_RESOLVE=recovery.sys.oxide.test:443:10.151.2.166 |
917 | 2024-02-10T01:00:19.596Z | ++ OXIDE_TOKEN=oxide-token-1109d99b19a30df72fdc13884bb9495630525c2f |
918 | 2024-02-10T01:00:19.596Z | + export OXIDE_HOST OXIDE_TOKEN |
919 | 2024-02-10T01:00:19.596Z | + retry=0 |
920 | 2024-02-10T01:00:19.596Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
921 | 2024-02-10T01:00:19.621Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
922 | 2024-02-10T01:00:19.621Z | + [[ 0 -gt 60 ]] |
923 | 2024-02-10T01:00:19.621Z | + sleep 1 |
924 | 2024-02-10T01:00:20.610Z | + retry=1 |
925 | 2024-02-10T01:00:20.610Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
926 | 2024-02-10T01:00:20.637Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
927 | 2024-02-10T01:00:20.637Z | + [[ 1 -gt 60 ]] |
928 | 2024-02-10T01:00:20.637Z | + sleep 1 |
929 | 2024-02-10T01:00:21.625Z | + retry=2 |
930 | 2024-02-10T01:00:21.626Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
931 | 2024-02-10T01:00:21.650Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
932 | 2024-02-10T01:00:21.650Z | + [[ 2 -gt 60 ]] |
933 | 2024-02-10T01:00:21.650Z | + sleep 1 |
934 | 2024-02-10T01:00:22.642Z | + retry=3 |
935 | 2024-02-10T01:00:22.642Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
936 | 2024-02-10T01:00:22.667Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
937 | 2024-02-10T01:00:22.667Z | + [[ 3 -gt 60 ]] |
938 | 2024-02-10T01:00:22.667Z | + sleep 1 |
939 | 2024-02-10T01:00:23.660Z | + retry=4 |
940 | 2024-02-10T01:00:23.660Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
941 | 2024-02-10T01:00:23.687Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
942 | 2024-02-10T01:00:23.687Z | + [[ 4 -gt 60 ]] |
943 | 2024-02-10T01:00:23.687Z | + sleep 1 |
944 | 2024-02-10T01:00:24.673Z | + retry=5 |
945 | 2024-02-10T01:00:24.673Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
946 | 2024-02-10T01:00:24.698Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
947 | 2024-02-10T01:00:24.698Z | + [[ 5 -gt 60 ]] |
948 | 2024-02-10T01:00:24.698Z | + sleep 1 |
949 | 2024-02-10T01:00:25.689Z | + retry=6 |
950 | 2024-02-10T01:00:25.689Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
951 | 2024-02-10T01:00:25.715Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
952 | 2024-02-10T01:00:25.715Z | + [[ 6 -gt 60 ]] |
953 | 2024-02-10T01:00:25.715Z | + sleep 1 |
954 | 2024-02-10T01:00:26.708Z | + retry=7 |
955 | 2024-02-10T01:00:26.708Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
956 | 2024-02-10T01:00:26.733Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
957 | 2024-02-10T01:00:26.733Z | + [[ 7 -gt 60 ]] |
958 | 2024-02-10T01:00:26.733Z | + sleep 1 |
959 | 2024-02-10T01:00:27.721Z | + retry=8 |
960 | 2024-02-10T01:00:27.721Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
961 | 2024-02-10T01:00:27.746Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
962 | 2024-02-10T01:00:27.746Z | + [[ 8 -gt 60 ]] |
963 | 2024-02-10T01:00:27.746Z | + sleep 1 |
964 | 2024-02-10T01:00:28.737Z | + retry=9 |
965 | 2024-02-10T01:00:28.737Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
966 | 2024-02-10T01:00:28.761Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
967 | 2024-02-10T01:00:28.762Z | + [[ 9 -gt 60 ]] |
968 | 2024-02-10T01:00:28.762Z | + sleep 1 |
969 | 2024-02-10T01:00:29.754Z | + retry=10 |
970 | 2024-02-10T01:00:29.754Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
971 | 2024-02-10T01:00:29.778Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
972 | 2024-02-10T01:00:29.779Z | + [[ 10 -gt 60 ]] |
973 | 2024-02-10T01:00:29.779Z | + sleep 1 |
974 | 2024-02-10T01:00:30.770Z | + retry=11 |
975 | 2024-02-10T01:00:30.770Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
976 | 2024-02-10T01:00:30.795Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
977 | 2024-02-10T01:00:30.795Z | + [[ 11 -gt 60 ]] |
978 | 2024-02-10T01:00:30.795Z | + sleep 1 |
979 | 2024-02-10T01:00:31.786Z | + retry=12 |
980 | 2024-02-10T01:00:31.786Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
981 | 2024-02-10T01:00:31.813Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
982 | 2024-02-10T01:00:31.813Z | + [[ 12 -gt 60 ]] |
983 | 2024-02-10T01:00:31.813Z | + sleep 1 |
984 | 2024-02-10T01:00:32.801Z | + retry=13 |
985 | 2024-02-10T01:00:32.801Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
986 | 2024-02-10T01:00:32.825Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
987 | 2024-02-10T01:00:32.825Z | + [[ 13 -gt 60 ]] |
988 | 2024-02-10T01:00:32.825Z | + sleep 1 |
989 | 2024-02-10T01:00:33.817Z | + retry=14 |
990 | 2024-02-10T01:00:33.817Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
991 | 2024-02-10T01:00:33.841Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
992 | 2024-02-10T01:00:33.842Z | + [[ 14 -gt 60 ]] |
993 | 2024-02-10T01:00:33.842Z | + sleep 1 |
994 | 2024-02-10T01:00:34.833Z | + retry=15 |
995 | 2024-02-10T01:00:34.833Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
996 | 2024-02-10T01:00:38.235Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 3392 ms: Couldn't connect to server |
997 | 2024-02-10T01:00:38.260Z | + [[ 15 -gt 60 ]] |
998 | 2024-02-10T01:00:38.260Z | + sleep 1 |
999 | 2024-02-10T01:00:39.242Z | + retry=16 |
1000 | 2024-02-10T01:00:39.242Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1001 | 2024-02-10T01:00:39.267Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1002 | 2024-02-10T01:00:39.267Z | + [[ 16 -gt 60 ]] |
1003 | 2024-02-10T01:00:39.267Z | + sleep 1 |
1004 | 2024-02-10T01:00:40.259Z | + retry=17 |
1005 | 2024-02-10T01:00:40.259Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1006 | 2024-02-10T01:00:40.284Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1007 | 2024-02-10T01:00:40.284Z | + [[ 17 -gt 60 ]] |
1008 | 2024-02-10T01:00:40.284Z | + sleep 1 |
1009 | 2024-02-10T01:00:41.275Z | + retry=18 |
1010 | 2024-02-10T01:00:41.275Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1011 | 2024-02-10T01:00:41.300Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1012 | 2024-02-10T01:00:41.300Z | + [[ 18 -gt 60 ]] |
1013 | 2024-02-10T01:00:41.300Z | + sleep 1 |
1014 | 2024-02-10T01:00:42.290Z | + retry=19 |
1015 | 2024-02-10T01:00:42.290Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1016 | 2024-02-10T01:00:42.315Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1017 | 2024-02-10T01:00:42.315Z | + [[ 19 -gt 60 ]] |
1018 | 2024-02-10T01:00:42.315Z | + sleep 1 |
1019 | 2024-02-10T01:00:43.307Z | + retry=20 |
1020 | 2024-02-10T01:00:43.307Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1021 | 2024-02-10T01:00:43.332Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1022 | 2024-02-10T01:00:43.332Z | + [[ 20 -gt 60 ]] |
1023 | 2024-02-10T01:00:43.332Z | + sleep 1 |
1024 | 2024-02-10T01:00:44.322Z | + retry=21 |
1025 | 2024-02-10T01:00:44.322Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1026 | 2024-02-10T01:00:44.347Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1027 | 2024-02-10T01:00:44.348Z | + [[ 21 -gt 60 ]] |
1028 | 2024-02-10T01:00:44.348Z | + sleep 1 |
1029 | 2024-02-10T01:00:45.338Z | + retry=22 |
1030 | 2024-02-10T01:00:45.338Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1031 | 2024-02-10T01:00:45.363Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1032 | 2024-02-10T01:00:45.363Z | + [[ 22 -gt 60 ]] |
1033 | 2024-02-10T01:00:45.363Z | + sleep 1 |
1034 | 2024-02-10T01:00:46.356Z | + retry=23 |
1035 | 2024-02-10T01:00:46.356Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1036 | 2024-02-10T01:00:46.380Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1037 | 2024-02-10T01:00:46.381Z | + [[ 23 -gt 60 ]] |
1038 | 2024-02-10T01:00:46.381Z | + sleep 1 |
1039 | 2024-02-10T01:00:47.368Z | + retry=24 |
1040 | 2024-02-10T01:00:47.369Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1041 | 2024-02-10T01:00:47.393Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1042 | 2024-02-10T01:00:47.393Z | + [[ 24 -gt 60 ]] |
1043 | 2024-02-10T01:00:47.393Z | + sleep 1 |
1044 | 2024-02-10T01:00:48.384Z | + retry=25 |
1045 | 2024-02-10T01:00:48.384Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1046 | 2024-02-10T01:00:48.409Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1047 | 2024-02-10T01:00:48.409Z | + [[ 25 -gt 60 ]] |
1048 | 2024-02-10T01:00:48.409Z | + sleep 1 |
1049 | 2024-02-10T01:00:49.401Z | + retry=26 |
1050 | 2024-02-10T01:00:49.402Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1051 | 2024-02-10T01:00:49.428Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1052 | 2024-02-10T01:00:49.428Z | + [[ 26 -gt 60 ]] |
1053 | 2024-02-10T01:00:49.429Z | + sleep 1 |
1054 | 2024-02-10T01:00:50.417Z | + retry=27 |
1055 | 2024-02-10T01:00:50.418Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1056 | 2024-02-10T01:00:50.442Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1057 | 2024-02-10T01:00:50.442Z | + [[ 27 -gt 60 ]] |
1058 | 2024-02-10T01:00:50.442Z | + sleep 1 |
1059 | 2024-02-10T01:00:51.433Z | + retry=28 |
1060 | 2024-02-10T01:00:51.433Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1061 | 2024-02-10T01:00:51.458Z | curl: (7) Failed to connect to recovery.sys.oxide.test port 443 after 0 ms: Couldn't connect to server |
1062 | 2024-02-10T01:00:51.458Z | + [[ 28 -gt 60 ]] |
1063 | 2024-02-10T01:00:51.458Z | + sleep 1 |
1064 | 2024-02-10T01:00:52.448Z | + retry=29 |
1065 | 2024-02-10T01:00:52.448Z | + curl -sSf https://recovery.sys.oxide.test/v1/ping --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem |
1066 | 2024-02-10T01:00:52.530Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem project create --name images --description 'some images' |
1067 | 2024-02-10T01:00:52.837Z | {"status":"ok"}success |
1068 | 2024-02-10T01:00:52.837Z | Project { |
1069 | 2024-02-10T01:00:52.837Z | description: "some images", |
1070 | 2024-02-10T01:00:52.837Z | id: 866627b8-dc4c-4187-9740-1069608de3c2, |
1071 | 2024-02-10T01:00:52.837Z | name: Name( |
1072 | 2024-02-10T01:00:52.837Z | "images", |
1073 | 2024-02-10T01:00:52.837Z | ), |
1074 | 2024-02-10T01:00:52.837Z | time_created: 2024-02-10T01:00:52.604609Z, |
1075 | 2024-02-10T01:00:52.837Z | time_modified: 2024-02-10T01:00:52.604609Z, |
1076 | 2024-02-10T01:00:52.837Z | } |
1077 | 2024-02-10T01:00:52.862Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem disk import --path debian-11-genericcloud-amd64.raw --disk debian11-boot --project images --description 'debian 11 cloud image from distros' --snapshot debian11-snapshot --image debian11 --image-description 'debian 11 original base image' --image-os debian --image-version 11 |
|
1078 | 2024-02-10T01:01:39.697Z | Error: No response to keepalive - Terminating session |
1079 | 2024-02-10T01:01:49.631Z | Error: No response de-activating SOL payload |
1080 | 2024-02-10T01:01:50.831Z | [SOL Session operational. Use ~? for help] |
1081 | 2024-02-10T01:04:55.567Z | Error: No response to keepalive - Terminating session |
1082 | 2024-02-10T01:05:05.736Z | Error: No response de-activating SOL payload |
1083 | 2024-02-10T01:05:06.935Z | [SOL Session operational. Use ~? for help] |
|
1084 | 2024-02-10T01:06:27.083Z | done! |
1085 | 2024-02-10T01:06:27.178Z | + /usr/oxide/oxide --resolve recovery.sys.oxide.test:443:10.151.2.166 --cacert /opt/oxide/sled-agent/pkg/initial-tls-cert.pem image promote --project images --image debian11 |
1086 | 2024-02-10T01:06:27.299Z | success |
1087 | 2024-02-10T01:06:27.299Z | Image { |
1088 | 2024-02-10T01:06:27.299Z | block_size: ByteCount( |
1089 | 2024-02-10T01:06:27.299Z | 512, |
1090 | 2024-02-10T01:06:27.299Z | ), |
1091 | 2024-02-10T01:06:27.326Z | description: "debian 11 original base image", |
1092 | 2024-02-10T01:06:27.326Z | digest: None, |
1093 | 2024-02-10T01:06:27.326Z | id: ab4bcf28-8a42-4d2c-a5e3-533636dbe218, |
1094 | 2024-02-10T01:06:27.326Z | name: Name( |
1095 | 2024-02-10T01:06:27.327Z | "debian11", |
1096 | 2024-02-10T01:06:27.327Z | ), |
1097 | 2024-02-10T01:06:27.327Z | os: "debian", |
1098 | 2024-02-10T01:06:27.327Z | project_id: None, |
1099 | 2024-02-10T01:06:27.327Z | size: ByteCount( |
1100 | 2024-02-10T01:06:27.327Z | 2147483648, |
1101 | 2024-02-10T01:06:27.327Z | ), |
1102 | 2024-02-10T01:06:27.327Z | time_created: 2024-02-10T01:06:27.022730Z, |
1103 | 2024-02-10T01:06:27.327Z | time_modified: 2024-02-10T01:06:27.262902Z, |
1104 | 2024-02-10T01:06:27.327Z | url: None, |
1105 | 2024-02-10T01:06:27.327Z | version: "11", |
1106 | 2024-02-10T01:06:27.328Z | } |
1107 | 2024-02-10T01:06:27.328Z | + rm ./tests/bootstrap |
1108 | 2024-02-10T01:06:27.370Z | + for test_bin in tests/* |
1109 | 2024-02-10T01:06:27.370Z | + ./tests/bootstrap-814497ffe476019b |
1110 | 2024-02-10T01:06:27.407Z | |
1111 | 2024-02-10T01:06:27.407Z | running 0 tests |
1112 | 2024-02-10T01:06:27.407Z | |
1113 | 2024-02-10T01:06:27.538Z | test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s |
1114 | 2024-02-10T01:06:27.538Z | |
1115 | 2024-02-10T01:06:27.539Z | + for test_bin in tests/* |
1116 | 2024-02-10T01:06:27.539Z | + ./tests/end_to_end_tests-7c7bf8ffe79eb016 |
1117 | 2024-02-10T01:06:27.569Z | |
1118 | 2024-02-10T01:06:27.569Z | running 2 tests |
1119 | 2024-02-10T01:06:27.824Z | test no_spoof::no_spoof_here ... ok |
1120 | 2024-02-10T01:07:03.999Z | test instance_launch::instance_launch ... ok |
1121 | 2024-02-10T01:07:04.000Z | |
1122 | 2024-02-10T01:07:04.000Z | test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 36.43s |
1123 | 2024-02-10T01:07:04.000Z | |
1124 | 2024-02-10T01:07:04.025Z | + _exit_trap |
1125 | 2024-02-10T01:07:04.025Z | + local status=0 |
1126 | 2024-02-10T01:07:04.025Z | + [[ 0 -eq 0 ]] |
1127 | 2024-02-10T01:07:04.025Z | + exit 0 |
1128 | 2024-02-10T01:07:04.025Z | process exited: duration 956637 ms, exit code 0 |
|
1129 | 2024-02-10T01:07:04.144Z | found 125 output files |
1130 | 2024-02-10T01:07:04.144Z | uploading: /var/svc/log/oxide-sled-agent:default.log (947947 bytes) |
1131 | 2024-02-10T01:07:05.990Z | uploaded: /var/svc/log/oxide-sled-agent:default.log |
1132 | 2024-02-10T01:07:05.990Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log (1788446 bytes) |
1133 | 2024-02-10T01:07:06.810Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log" changed size mid upload: 1788446 -> 1801506 |
1134 | 2024-02-10T01:07:07.882Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log |
1135 | 2024-02-10T01:07:07.882Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 (1892018 bytes) |
1136 | 2024-02-10T01:07:10.513Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-dendrite:default.log.0 |
1137 | 2024-02-10T01:07:10.513Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log (0 bytes) |
1138 | 2024-02-10T01:07:11.570Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log |
1139 | 2024-02-10T01:07:11.570Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 (22944 bytes) |
1140 | 2024-02-10T01:07:12.713Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mg-ddm:default.log.0 |
1141 | 2024-02-10T01:07:12.713Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log (14628 bytes) |
1142 | 2024-02-10T01:07:13.831Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log |
1143 | 2024-02-10T01:07:13.831Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 (10858 bytes) |
1144 | 2024-02-10T01:07:14.951Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgd:default.log.0 |
1145 | 2024-02-10T01:07:14.951Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log (1106474 bytes) |
1146 | 2024-02-10T01:07:15.261Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log" changed size mid upload: 1106474 -> 1125641 |
1147 | 2024-02-10T01:07:16.333Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log |
1148 | 2024-02-10T01:07:16.333Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 (956009 bytes) |
1149 | 2024-02-10T01:07:18.184Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-mgs:default.log.0 |
1150 | 2024-02-10T01:07:18.184Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log (656378 bytes) |
1151 | 2024-02-10T01:07:19.096Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log" changed size mid upload: 656378 -> 676466 |
1152 | 2024-02-10T01:07:20.167Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log |
1153 | 2024-02-10T01:07:20.192Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 (578275 bytes) |
1154 | 2024-02-10T01:07:21.482Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-sp-sim:default.log.0 |
1155 | 2024-02-10T01:07:21.482Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log (0 bytes) |
1156 | 2024-02-10T01:07:22.555Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log |
1157 | 2024-02-10T01:07:22.555Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 (1388 bytes) |
1158 | 2024-02-10T01:07:23.651Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-switch_zone_setup:default.log.0 |
1159 | 2024-02-10T01:07:23.651Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log (206506 bytes) |
1160 | 2024-02-10T01:07:23.860Z | upload warning: file "/zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log" changed size mid upload: 206506 -> 217586 |
1161 | 2024-02-10T01:07:24.932Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log |
1162 | 2024-02-10T01:07:24.956Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 (217394 bytes) |
1163 | 2024-02-10T01:07:26.189Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-tfport:default.log.0 |
1164 | 2024-02-10T01:07:26.189Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log (0 bytes) |
1165 | 2024-02-10T01:07:27.261Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log |
1166 | 2024-02-10T01:07:27.261Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 (617 bytes) |
1167 | 2024-02-10T01:07:28.357Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-uplink:default.log.0 |
1168 | 2024-02-10T01:07:28.357Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log (0 bytes) |
1169 | 2024-02-10T01:07:29.429Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log |
1170 | 2024-02-10T01:07:29.429Z | uploading: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 (5393 bytes) |
1171 | 2024-02-10T01:07:30.526Z | uploaded: /zone/oxz_switch/root/var/svc/log/oxide-wicketd:default.log.0 |
1172 | 2024-02-10T01:07:30.526Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-clickhouse:default.log (757461 bytes) |
1173 | 2024-02-10T01:07:30.794Z | upload warning: file "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-clickhouse:default.log" changed size mid upload: 757461 -> 815972 |
1174 | 2024-02-10T01:07:31.866Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-clickhouse:default.log |
1175 | 2024-02-10T01:07:31.891Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-clickhouse:default.log.0 (129037 bytes) |
1176 | 2024-02-10T01:07:33.100Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-clickhouse:default.log.0 |
1177 | 2024-02-10T01:07:33.126Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes) |
1178 | 2024-02-10T01:07:34.172Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-zone-network-setup:default.log |
1179 | 2024-02-10T01:07:34.172Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1709 bytes) |
1180 | 2024-02-10T01:07:35.274Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_clickhouse_29b24b25-dc89-4b2b-b01c-3391f82a85a1/root/var/svc/log/oxide-zone-network-setup:default.log.0 |
1181 | 2024-02-10T01:07:35.274Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_bd7b8992-1cd6-4e1f-b56b-4fa304b616d0/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1182 | 2024-02-10T01:07:36.346Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_bd7b8992-1cd6-4e1f-b56b-4fa304b616d0/root/var/svc/log/oxide-cockroachdb:default.log |
1183 | 2024-02-10T01:07:36.347Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_bd7b8992-1cd6-4e1f-b56b-4fa304b616d0/root/var/svc/log/oxide-cockroachdb:default.log.0 (4407 bytes) |
1184 | 2024-02-10T01:07:37.443Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_bd7b8992-1cd6-4e1f-b56b-4fa304b616d0/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1185 | 2024-02-10T01:07:37.443Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_bd7b8992-1cd6-4e1f-b56b-4fa304b616d0/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes) |
1186 | 2024-02-10T01:07:38.519Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_bd7b8992-1cd6-4e1f-b56b-4fa304b616d0/root/var/svc/log/oxide-zone-network-setup:default.log |
1187 | 2024-02-10T01:07:38.544Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_bd7b8992-1cd6-4e1f-b56b-4fa304b616d0/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1710 bytes) |
1188 | 2024-02-10T01:07:39.622Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_bd7b8992-1cd6-4e1f-b56b-4fa304b616d0/root/var/svc/log/oxide-zone-network-setup:default.log.0 |
1189 | 2024-02-10T01:07:39.622Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e2c9fb1-6f8e-4058-a6be-2880e6eb7e39/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes) |
1190 | 2024-02-10T01:07:40.695Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e2c9fb1-6f8e-4058-a6be-2880e6eb7e39/root/var/svc/log/oxide-crucible-agent:default.log |
1191 | 2024-02-10T01:07:40.695Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e2c9fb1-6f8e-4058-a6be-2880e6eb7e39/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1192 | 2024-02-10T01:07:41.806Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e2c9fb1-6f8e-4058-a6be-2880e6eb7e39/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1193 | 2024-02-10T01:07:41.838Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e2c9fb1-6f8e-4058-a6be-2880e6eb7e39/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1194 | 2024-02-10T01:07:42.900Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e2c9fb1-6f8e-4058-a6be-2880e6eb7e39/root/var/svc/log/oxide-crucible-downstairs:default.log |
1195 | 2024-02-10T01:07:42.934Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e2c9fb1-6f8e-4058-a6be-2880e6eb7e39/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1196 | 2024-02-10T01:07:44.015Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e2c9fb1-6f8e-4058-a6be-2880e6eb7e39/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1197 | 2024-02-10T01:07:44.040Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_697047f9-91d0-427b-9cbd-ae924403ec96/root/var/svc/log/oxide-external_dns:default.log (28172 bytes) |
1198 | 2024-02-10T01:07:45.157Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_697047f9-91d0-427b-9cbd-ae924403ec96/root/var/svc/log/oxide-external_dns:default.log |
1199 | 2024-02-10T01:07:45.157Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_697047f9-91d0-427b-9cbd-ae924403ec96/root/var/svc/log/oxide-external_dns:default.log.0 (2554 bytes) |
1200 | 2024-02-10T01:07:46.260Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_697047f9-91d0-427b-9cbd-ae924403ec96/root/var/svc/log/oxide-external_dns:default.log.0 |
1201 | 2024-02-10T01:07:46.260Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d9ab4f79-dc1a-4957-9b44-712fa636641e/root/var/svc/log/oxide-internal_dns:default.log (29222 bytes) |
1202 | 2024-02-10T01:07:47.433Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d9ab4f79-dc1a-4957-9b44-712fa636641e/root/var/svc/log/oxide-internal_dns:default.log |
1203 | 2024-02-10T01:07:47.433Z | uploading: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d9ab4f79-dc1a-4957-9b44-712fa636641e/root/var/svc/log/oxide-internal_dns:default.log.0 (93515 bytes) |
1204 | 2024-02-10T01:07:48.652Z | uploaded: /pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_d9ab4f79-dc1a-4957-9b44-712fa636641e/root/var/svc/log/oxide-internal_dns:default.log.0 |
1205 | 2024-02-10T01:07:48.652Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4ca37014-cccd-41fc-b295-e0dffab7bca1/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1206 | 2024-02-10T01:07:49.737Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4ca37014-cccd-41fc-b295-e0dffab7bca1/root/var/svc/log/oxide-cockroachdb:default.log |
1207 | 2024-02-10T01:07:49.738Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4ca37014-cccd-41fc-b295-e0dffab7bca1/root/var/svc/log/oxide-cockroachdb:default.log.0 (4381 bytes) |
1208 | 2024-02-10T01:07:51.721Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4ca37014-cccd-41fc-b295-e0dffab7bca1/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1209 | 2024-02-10T01:07:51.754Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4ca37014-cccd-41fc-b295-e0dffab7bca1/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes) |
1210 | 2024-02-10T01:07:53.222Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4ca37014-cccd-41fc-b295-e0dffab7bca1/root/var/svc/log/oxide-zone-network-setup:default.log |
1211 | 2024-02-10T01:07:53.260Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4ca37014-cccd-41fc-b295-e0dffab7bca1/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes) |
1212 | 2024-02-10T01:07:54.792Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_cockroachdb_4ca37014-cccd-41fc-b295-e0dffab7bca1/root/var/svc/log/oxide-zone-network-setup:default.log.0 |
1213 | 2024-02-10T01:07:54.792Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-agent:default.log (10674 bytes) |
1214 | 2024-02-10T01:07:55.594Z | Error: No response to keepalive - Terminating session |
1215 | 2024-02-10T01:07:55.909Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-agent:default.log |
1216 | 2024-02-10T01:07:55.909Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1217 | 2024-02-10T01:07:57.006Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1218 | 2024-02-10T01:07:57.006Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1219 | 2024-02-10T01:07:58.094Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-downstairs:default.log |
1220 | 2024-02-10T01:07:58.094Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1221 | 2024-02-10T01:07:59.209Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1222 | 2024-02-10T01:07:59.209Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-downstairs:downstairs-6a9cadc7-19aa-475d-b180-657b3fe0b385.log (5612 bytes) |
1223 | 2024-02-10T01:08:00.317Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_3e488748-2952-4d8c-a951-a6215f3843b9/root/var/svc/log/oxide-crucible-downstairs:downstairs-6a9cadc7-19aa-475d-b180-657b3fe0b385.log |
1224 | 2024-02-10T01:08:00.318Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_a82e4bd9-7419-4610-8b39-c9e6c2b412b8/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes) |
1225 | 2024-02-10T01:08:01.398Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_a82e4bd9-7419-4610-8b39-c9e6c2b412b8/root/var/svc/log/oxide-crucible-pantry:default.log |
1226 | 2024-02-10T01:08:01.427Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_a82e4bd9-7419-4610-8b39-c9e6c2b412b8/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes) |
1227 | 2024-02-10T01:08:02.507Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_pantry_a82e4bd9-7419-4610-8b39-c9e6c2b412b8/root/var/svc/log/oxide-crucible-pantry:default.log.0 |
1228 | 2024-02-10T01:08:02.507Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_191252b0-6b52-41f2-bcc2-9c2e77cf6382/root/var/svc/log/oxide-external_dns:default.log (28169 bytes) |
1229 | 2024-02-10T01:08:03.110Z | upload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_191252b0-6b52-41f2-bcc2-9c2e77cf6382/root/var/svc/log/oxide-external_dns:default.log" changed size mid upload: 28169 -> 31945 |
1230 | 2024-02-10T01:08:04.183Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_191252b0-6b52-41f2-bcc2-9c2e77cf6382/root/var/svc/log/oxide-external_dns:default.log |
1231 | 2024-02-10T01:08:04.183Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_191252b0-6b52-41f2-bcc2-9c2e77cf6382/root/var/svc/log/oxide-external_dns:default.log.0 (2554 bytes) |
1232 | 2024-02-10T01:08:05.281Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_external_dns_191252b0-6b52-41f2-bcc2-9c2e77cf6382/root/var/svc/log/oxide-external_dns:default.log.0 |
1233 | 2024-02-10T01:08:05.281Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e1579bb6-e1fc-413a-ba36-3384300f77dd/root/var/svc/log/oxide-internal_dns:default.log (27540 bytes) |
1234 | 2024-02-10T01:08:05.512Z | upload warning: file "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e1579bb6-e1fc-413a-ba36-3384300f77dd/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 27540 -> 31296 |
1235 | 2024-02-10T01:08:05.596Z | Error: No response de-activating SOL payload |
1236 | 2024-02-10T01:08:06.526Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e1579bb6-e1fc-413a-ba36-3384300f77dd/root/var/svc/log/oxide-internal_dns:default.log |
1237 | 2024-02-10T01:08:06.526Z | uploading: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e1579bb6-e1fc-413a-ba36-3384300f77dd/root/var/svc/log/oxide-internal_dns:default.log.0 (91936 bytes) |
1238 | 2024-02-10T01:08:07.091Z | [SOL Session operational. Use ~? for help] |
1239 | 2024-02-10T01:08:07.753Z | uploaded: /pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_internal_dns_e1579bb6-e1fc-413a-ba36-3384300f77dd/root/var/svc/log/oxide-internal_dns:default.log.0 |
1240 | 2024-02-10T01:08:07.753Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_d5221bc8-57fc-4eda-82f1-74ed7aedde65/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1241 | 2024-02-10T01:08:08.826Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_d5221bc8-57fc-4eda-82f1-74ed7aedde65/root/var/svc/log/oxide-cockroachdb:default.log |
1242 | 2024-02-10T01:08:08.826Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_d5221bc8-57fc-4eda-82f1-74ed7aedde65/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes) |
1243 | 2024-02-10T01:08:09.939Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_d5221bc8-57fc-4eda-82f1-74ed7aedde65/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1244 | 2024-02-10T01:08:09.971Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_d5221bc8-57fc-4eda-82f1-74ed7aedde65/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes) |
1245 | 2024-02-10T01:08:11.023Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_d5221bc8-57fc-4eda-82f1-74ed7aedde65/root/var/svc/log/oxide-zone-network-setup:default.log |
1246 | 2024-02-10T01:08:11.023Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_d5221bc8-57fc-4eda-82f1-74ed7aedde65/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes) |
1247 | 2024-02-10T01:08:12.122Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_cockroachdb_d5221bc8-57fc-4eda-82f1-74ed7aedde65/root/var/svc/log/oxide-zone-network-setup:default.log.0 |
1248 | 2024-02-10T01:08:12.122Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-agent:default.log (23934 bytes) |
1249 | 2024-02-10T01:08:13.291Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-agent:default.log |
1250 | 2024-02-10T01:08:13.291Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-agent:default.log.0 (3434 bytes) |
1251 | 2024-02-10T01:08:14.395Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1252 | 2024-02-10T01:08:14.396Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1253 | 2024-02-10T01:08:15.468Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:default.log |
1254 | 2024-02-10T01:08:15.468Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1255 | 2024-02-10T01:08:17.048Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1256 | 2024-02-10T01:08:17.049Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-103b0472-4995-4c28-8f77-1664c15ed232.log (3113 bytes) |
1257 | 2024-02-10T01:08:18.176Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-103b0472-4995-4c28-8f77-1664c15ed232.log |
1258 | 2024-02-10T01:08:18.176Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-74bc702b-a172-4a05-9ef8-3cf8da26402d.log (5667 bytes) |
1259 | 2024-02-10T01:08:19.313Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:downstairs-74bc702b-a172-4a05-9ef8-3cf8da26402d.log |
1260 | 2024-02-10T01:08:19.313Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:snapshot-74bc702b-a172-4a05-9ef8-3cf8da26402d-fb4d62a3-a3c9-48d2-a9b8-a73ced585137.log (5306 bytes) |
1261 | 2024-02-10T01:08:20.431Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_crucible_b11982a0-3f25-4aa8-a6fc-88293660a81a/root/var/svc/log/oxide-crucible-downstairs:snapshot-74bc702b-a172-4a05-9ef8-3cf8da26402d-fb4d62a3-a3c9-48d2-a9b8-a73ced585137.log |
1262 | 2024-02-10T01:08:20.431Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_45c87c2e-7707-4792-a32b-6354545300df/root/var/svc/log/oxide-internal_dns:default.log (29218 bytes) |
1263 | 2024-02-10T01:08:20.624Z | upload warning: file "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_45c87c2e-7707-4792-a32b-6354545300df/root/var/svc/log/oxide-internal_dns:default.log" changed size mid upload: 29218 -> 32970 |
1264 | 2024-02-10T01:08:21.726Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_45c87c2e-7707-4792-a32b-6354545300df/root/var/svc/log/oxide-internal_dns:default.log |
1265 | 2024-02-10T01:08:21.727Z | uploading: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_45c87c2e-7707-4792-a32b-6354545300df/root/var/svc/log/oxide-internal_dns:default.log.0 (88247 bytes) |
1266 | 2024-02-10T01:08:23.106Z | uploaded: /pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone/oxz_internal_dns_45c87c2e-7707-4792-a32b-6354545300df/root/var/svc/log/oxide-internal_dns:default.log.0 |
1267 | 2024-02-10T01:08:23.107Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e7af2bc8-471b-455f-b9c7-f0233816fb3d/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1268 | 2024-02-10T01:08:24.182Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e7af2bc8-471b-455f-b9c7-f0233816fb3d/root/var/svc/log/oxide-cockroachdb:default.log |
1269 | 2024-02-10T01:08:24.182Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e7af2bc8-471b-455f-b9c7-f0233816fb3d/root/var/svc/log/oxide-cockroachdb:default.log.0 (4408 bytes) |
1270 | 2024-02-10T01:08:25.278Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e7af2bc8-471b-455f-b9c7-f0233816fb3d/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1271 | 2024-02-10T01:08:25.304Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e7af2bc8-471b-455f-b9c7-f0233816fb3d/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes) |
1272 | 2024-02-10T01:08:26.359Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e7af2bc8-471b-455f-b9c7-f0233816fb3d/root/var/svc/log/oxide-zone-network-setup:default.log |
1273 | 2024-02-10T01:08:26.359Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e7af2bc8-471b-455f-b9c7-f0233816fb3d/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes) |
1274 | 2024-02-10T01:08:28.715Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_cockroachdb_e7af2bc8-471b-455f-b9c7-f0233816fb3d/root/var/svc/log/oxide-zone-network-setup:default.log.0 |
1275 | 2024-02-10T01:08:28.715Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_c0f67f2e-74a9-4639-9642-16cbb618f03f/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes) |
1276 | 2024-02-10T01:08:29.812Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_c0f67f2e-74a9-4639-9642-16cbb618f03f/root/var/svc/log/oxide-crucible-agent:default.log |
1277 | 2024-02-10T01:08:29.812Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_c0f67f2e-74a9-4639-9642-16cbb618f03f/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1278 | 2024-02-10T01:08:30.917Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_c0f67f2e-74a9-4639-9642-16cbb618f03f/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1279 | 2024-02-10T01:08:30.917Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_c0f67f2e-74a9-4639-9642-16cbb618f03f/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1280 | 2024-02-10T01:08:31.993Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_c0f67f2e-74a9-4639-9642-16cbb618f03f/root/var/svc/log/oxide-crucible-downstairs:default.log |
1281 | 2024-02-10T01:08:31.993Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_c0f67f2e-74a9-4639-9642-16cbb618f03f/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1282 | 2024-02-10T01:08:33.121Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_crucible_c0f67f2e-74a9-4639-9642-16cbb618f03f/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1283 | 2024-02-10T01:08:33.121Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/svc/log/oxide-ntp:default.log (0 bytes) |
1284 | 2024-02-10T01:08:34.193Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/svc/log/oxide-ntp:default.log |
1285 | 2024-02-10T01:08:34.193Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/svc/log/oxide-ntp:default.log.0 (1391 bytes) |
1286 | 2024-02-10T01:08:35.295Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/svc/log/oxide-ntp:default.log.0 |
1287 | 2024-02-10T01:08:35.327Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9d14b3c6-c26b-4dd0-8df6-1a5fad9ecfca/root/var/svc/log/oxide-cockroachdb:default.log (0 bytes) |
1288 | 2024-02-10T01:08:36.370Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9d14b3c6-c26b-4dd0-8df6-1a5fad9ecfca/root/var/svc/log/oxide-cockroachdb:default.log |
1289 | 2024-02-10T01:08:36.370Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9d14b3c6-c26b-4dd0-8df6-1a5fad9ecfca/root/var/svc/log/oxide-cockroachdb:default.log.0 (4406 bytes) |
1290 | 2024-02-10T01:08:37.467Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9d14b3c6-c26b-4dd0-8df6-1a5fad9ecfca/root/var/svc/log/oxide-cockroachdb:default.log.0 |
1291 | 2024-02-10T01:08:37.467Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9d14b3c6-c26b-4dd0-8df6-1a5fad9ecfca/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes) |
1292 | 2024-02-10T01:08:38.538Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9d14b3c6-c26b-4dd0-8df6-1a5fad9ecfca/root/var/svc/log/oxide-zone-network-setup:default.log |
1293 | 2024-02-10T01:08:38.563Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9d14b3c6-c26b-4dd0-8df6-1a5fad9ecfca/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1711 bytes) |
1294 | 2024-02-10T01:08:39.652Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_cockroachdb_9d14b3c6-c26b-4dd0-8df6-1a5fad9ecfca/root/var/svc/log/oxide-zone-network-setup:default.log.0 |
1295 | 2024-02-10T01:08:39.691Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-agent:default.log (30723 bytes) |
1296 | 2024-02-10T01:08:40.884Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-agent:default.log |
1297 | 2024-02-10T01:08:40.884Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1298 | 2024-02-10T01:08:42.010Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1299 | 2024-02-10T01:08:42.037Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1300 | 2024-02-10T01:08:43.083Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:default.log |
1301 | 2024-02-10T01:08:43.083Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1302 | 2024-02-10T01:08:44.182Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1303 | 2024-02-10T01:08:44.206Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:downstairs-1ec6b31b-12de-4a44-b129-b992b581f7a7.log (3019 bytes) |
1304 | 2024-02-10T01:08:45.289Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:downstairs-1ec6b31b-12de-4a44-b129-b992b581f7a7.log |
1305 | 2024-02-10T01:08:45.289Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:downstairs-41296c4c-138c-485e-b2e9-ace4530b10d5.log (5608 bytes) |
1306 | 2024-02-10T01:08:46.408Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:downstairs-41296c4c-138c-485e-b2e9-ace4530b10d5.log |
1307 | 2024-02-10T01:08:46.408Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4dd44b7-14fd-4fd1-ae5c-8b9cc2a7ad36.log (5670 bytes) |
1308 | 2024-02-10T01:08:47.526Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:downstairs-b4dd44b7-14fd-4fd1-ae5c-8b9cc2a7ad36.log |
1309 | 2024-02-10T01:08:47.527Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:snapshot-b4dd44b7-14fd-4fd1-ae5c-8b9cc2a7ad36-fb4d62a3-a3c9-48d2-a9b8-a73ced585137.log (5306 bytes) |
1310 | 2024-02-10T01:08:48.643Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_406054ce-d4e0-4f4a-ae07-73c80ee7d669/root/var/svc/log/oxide-crucible-downstairs:snapshot-b4dd44b7-14fd-4fd1-ae5c-8b9cc2a7ad36-fb4d62a3-a3c9-48d2-a9b8-a73ced585137.log |
1311 | 2024-02-10T01:08:48.644Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_69a3ffd6-8283-4bdf-b696-4ce6ac789b80/root/var/svc/log/oxide-crucible-pantry:default.log (1213262 bytes) |
1312 | 2024-02-10T01:08:51.489Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_69a3ffd6-8283-4bdf-b696-4ce6ac789b80/root/var/svc/log/oxide-crucible-pantry:default.log |
1313 | 2024-02-10T01:08:51.489Z | uploading: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_69a3ffd6-8283-4bdf-b696-4ce6ac789b80/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2333 bytes) |
1314 | 2024-02-10T01:08:52.585Z | uploaded: /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_crucible_pantry_69a3ffd6-8283-4bdf-b696-4ce6ac789b80/root/var/svc/log/oxide-crucible-pantry:default.log.0 |
1315 | 2024-02-10T01:08:52.585Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-agent:default.log (27292 bytes) |
1316 | 2024-02-10T01:08:53.771Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-agent:default.log |
1317 | 2024-02-10T01:08:53.771Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-agent:default.log.0 (3435 bytes) |
1318 | 2024-02-10T01:08:55.518Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1319 | 2024-02-10T01:08:55.519Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1320 | 2024-02-10T01:08:56.590Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:default.log |
1321 | 2024-02-10T01:08:56.590Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1322 | 2024-02-10T01:08:57.686Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1323 | 2024-02-10T01:08:57.686Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c5df18a-015e-44f1-bc27-41e89ec97cf8.log (5613 bytes) |
1324 | 2024-02-10T01:08:58.813Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:downstairs-2c5df18a-015e-44f1-bc27-41e89ec97cf8.log |
1325 | 2024-02-10T01:08:58.813Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:downstairs-729c9cd3-aa22-489e-a37e-c9e7d86937e0.log (3017 bytes) |
1326 | 2024-02-10T01:08:59.911Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:downstairs-729c9cd3-aa22-489e-a37e-c9e7d86937e0.log |
1327 | 2024-02-10T01:08:59.911Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:downstairs-a82821e7-37f0-4574-ab63-21ae8ad6a549.log (3114 bytes) |
1328 | 2024-02-10T01:09:01.014Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_096129bb-1c81-426c-8dfb-0bb588b1da82/root/var/svc/log/oxide-crucible-downstairs:downstairs-a82821e7-37f0-4574-ab63-21ae8ad6a549.log |
1329 | 2024-02-10T01:09:01.014Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_c16058f4-8054-47b2-a4f6-be7c79dfde05/root/var/svc/log/oxide-crucible-pantry:default.log (0 bytes) |
1330 | 2024-02-10T01:09:02.092Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_c16058f4-8054-47b2-a4f6-be7c79dfde05/root/var/svc/log/oxide-crucible-pantry:default.log |
1331 | 2024-02-10T01:09:02.092Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_c16058f4-8054-47b2-a4f6-be7c79dfde05/root/var/svc/log/oxide-crucible-pantry:default.log.0 (2338 bytes) |
1332 | 2024-02-10T01:09:03.653Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_crucible_pantry_c16058f4-8054-47b2-a4f6-be7c79dfde05/root/var/svc/log/oxide-crucible-pantry:default.log.0 |
1333 | 2024-02-10T01:09:03.653Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_d7d0d11b-254b-4c2c-8f46-d89660215854/root/var/svc/log/oxide-nexus:default.log (34251975 bytes) |
1334 | 2024-02-10T01:09:20.169Z | upload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_d7d0d11b-254b-4c2c-8f46-d89660215854/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 34251975 -> 34490022 |
1335 | 2024-02-10T01:09:21.250Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_d7d0d11b-254b-4c2c-8f46-d89660215854/root/var/svc/log/oxide-nexus:default.log |
1336 | 2024-02-10T01:09:21.250Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_d7d0d11b-254b-4c2c-8f46-d89660215854/root/var/svc/log/oxide-nexus:default.log.0 (316252 bytes) |
1337 | 2024-02-10T01:09:22.560Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_nexus_d7d0d11b-254b-4c2c-8f46-d89660215854/root/var/svc/log/oxide-nexus:default.log.0 |
1338 | 2024-02-10T01:09:22.560Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-oximeter:default.log (255447 bytes) |
1339 | 2024-02-10T01:09:22.996Z | upload warning: file "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-oximeter:default.log" changed size mid upload: 255447 -> 341564 |
1340 | 2024-02-10T01:09:24.078Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-oximeter:default.log |
1341 | 2024-02-10T01:09:24.079Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-oximeter:default.log.0 (17448 bytes) |
1342 | 2024-02-10T01:09:25.249Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-oximeter:default.log.0 |
1343 | 2024-02-10T01:09:25.249Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-zone-network-setup:default.log (0 bytes) |
1344 | 2024-02-10T01:09:26.320Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-zone-network-setup:default.log |
1345 | 2024-02-10T01:09:26.320Z | uploading: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-zone-network-setup:default.log.0 (1697 bytes) |
1346 | 2024-02-10T01:09:27.439Z | uploaded: /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_oximeter_2f4ffe01-86e1-4e04-8984-f3e3f9b1c2fc/root/var/svc/log/oxide-zone-network-setup:default.log.0 |
1347 | 2024-02-10T01:09:27.439Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-agent:default.log (30722 bytes) |
1348 | 2024-02-10T01:09:28.633Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-agent:default.log |
1349 | 2024-02-10T01:09:28.633Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1350 | 2024-02-10T01:09:29.749Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1351 | 2024-02-10T01:09:29.749Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1352 | 2024-02-10T01:09:30.821Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:default.log |
1353 | 2024-02-10T01:09:30.821Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1354 | 2024-02-10T01:09:31.919Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1355 | 2024-02-10T01:09:31.919Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:downstairs-263619b2-b2f3-4613-b1d2-b39155e84a08.log (3112 bytes) |
1356 | 2024-02-10T01:09:33.012Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:downstairs-263619b2-b2f3-4613-b1d2-b39155e84a08.log |
1357 | 2024-02-10T01:09:33.012Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:downstairs-aacd046c-8410-4703-9c8f-0e1150b8f32c.log (5672 bytes) |
1358 | 2024-02-10T01:09:34.108Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:downstairs-aacd046c-8410-4703-9c8f-0e1150b8f32c.log |
1359 | 2024-02-10T01:09:34.133Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:downstairs-fbd0c589-d290-47ec-9e55-d37cfe6b2f5f.log (3018 bytes) |
1360 | 2024-02-10T01:09:35.205Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:downstairs-fbd0c589-d290-47ec-9e55-d37cfe6b2f5f.log |
1361 | 2024-02-10T01:09:35.205Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:snapshot-aacd046c-8410-4703-9c8f-0e1150b8f32c-fb4d62a3-a3c9-48d2-a9b8-a73ced585137.log (5306 bytes) |
1362 | 2024-02-10T01:09:36.304Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_crucible_6115edfd-8cb9-4781-9203-50ab8a6a4ae1/root/var/svc/log/oxide-crucible-downstairs:snapshot-aacd046c-8410-4703-9c8f-0e1150b8f32c-fb4d62a3-a3c9-48d2-a9b8-a73ced585137.log |
1363 | 2024-02-10T01:09:36.347Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_233d8416-2f72-45f0-9f6d-34fa461c5161/root/var/svc/log/oxide-nexus:default.log (4977699 bytes) |
1364 | 2024-02-10T01:09:39.951Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_233d8416-2f72-45f0-9f6d-34fa461c5161/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 4977699 -> 5606526 |
1365 | 2024-02-10T01:09:41.061Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_233d8416-2f72-45f0-9f6d-34fa461c5161/root/var/svc/log/oxide-nexus:default.log |
1366 | 2024-02-10T01:09:41.062Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_233d8416-2f72-45f0-9f6d-34fa461c5161/root/var/svc/log/oxide-nexus:default.log.0 (817979 bytes) |
1367 | 2024-02-10T01:09:42.697Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_233d8416-2f72-45f0-9f6d-34fa461c5161/root/var/svc/log/oxide-nexus:default.log.0 |
1368 | 2024-02-10T01:09:42.697Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_2ae39a75-f383-430a-b1ef-050e27775ae3/root/var/svc/log/oxide-nexus:default.log (993191 bytes) |
1369 | 2024-02-10T01:09:43.505Z | upload warning: file "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_2ae39a75-f383-430a-b1ef-050e27775ae3/root/var/svc/log/oxide-nexus:default.log" changed size mid upload: 993191 -> 1260104 |
1370 | 2024-02-10T01:09:44.589Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_2ae39a75-f383-430a-b1ef-050e27775ae3/root/var/svc/log/oxide-nexus:default.log |
1371 | 2024-02-10T01:09:44.589Z | uploading: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_2ae39a75-f383-430a-b1ef-050e27775ae3/root/var/svc/log/oxide-nexus:default.log.0 (314204 bytes) |
1372 | 2024-02-10T01:09:45.932Z | uploaded: /pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone/oxz_nexus_2ae39a75-f383-430a-b1ef-050e27775ae3/root/var/svc/log/oxide-nexus:default.log.0 |
1373 | 2024-02-10T01:09:45.932Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31f7305e-61e6-4174-981a-94a9ac1918a9/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes) |
1374 | 2024-02-10T01:09:47.020Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31f7305e-61e6-4174-981a-94a9ac1918a9/root/var/svc/log/oxide-crucible-agent:default.log |
1375 | 2024-02-10T01:09:47.021Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31f7305e-61e6-4174-981a-94a9ac1918a9/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1376 | 2024-02-10T01:09:48.176Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31f7305e-61e6-4174-981a-94a9ac1918a9/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1377 | 2024-02-10T01:09:48.177Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31f7305e-61e6-4174-981a-94a9ac1918a9/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1378 | 2024-02-10T01:09:49.258Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31f7305e-61e6-4174-981a-94a9ac1918a9/root/var/svc/log/oxide-crucible-downstairs:default.log |
1379 | 2024-02-10T01:09:49.290Z | uploading: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31f7305e-61e6-4174-981a-94a9ac1918a9/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1380 | 2024-02-10T01:09:50.370Z | uploaded: /pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_31f7305e-61e6-4174-981a-94a9ac1918a9/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1381 | 2024-02-10T01:09:50.371Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5b60df67-4ed3-49c2-970a-dc1ebb09fddd/root/var/svc/log/oxide-crucible-agent:default.log (0 bytes) |
1382 | 2024-02-10T01:09:51.871Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5b60df67-4ed3-49c2-970a-dc1ebb09fddd/root/var/svc/log/oxide-crucible-agent:default.log |
1383 | 2024-02-10T01:09:51.872Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5b60df67-4ed3-49c2-970a-dc1ebb09fddd/root/var/svc/log/oxide-crucible-agent:default.log.0 (3436 bytes) |
1384 | 2024-02-10T01:09:52.585Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5b60df67-4ed3-49c2-970a-dc1ebb09fddd/root/var/svc/log/oxide-crucible-agent:default.log.0 |
1385 | 2024-02-10T01:09:52.585Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5b60df67-4ed3-49c2-970a-dc1ebb09fddd/root/var/svc/log/oxide-crucible-downstairs:default.log (0 bytes) |
1386 | 2024-02-10T01:09:53.670Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5b60df67-4ed3-49c2-970a-dc1ebb09fddd/root/var/svc/log/oxide-crucible-downstairs:default.log |
1387 | 2024-02-10T01:09:53.670Z | uploading: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5b60df67-4ed3-49c2-970a-dc1ebb09fddd/root/var/svc/log/oxide-crucible-downstairs:default.log.0 (75 bytes) |
1388 | 2024-02-10T01:09:54.773Z | uploaded: /pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone/oxz_crucible_5b60df67-4ed3-49c2-970a-dc1ebb09fddd/root/var/svc/log/oxide-crucible-downstairs:default.log.0 |
1389 | 2024-02-10T01:09:54.773Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/measurements.log (27400 bytes) |
1390 | 2024-02-10T01:09:54.953Z | upload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/measurements.log" changed size mid upload: 27400 -> 34113 |
1391 | 2024-02-10T01:09:56.035Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/measurements.log |
1392 | 2024-02-10T01:09:56.035Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/statistics.log (19539 bytes) |
1393 | 2024-02-10T01:09:56.178Z | upload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/statistics.log" changed size mid upload: 19539 -> 25038 |
1394 | 2024-02-10T01:09:57.261Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/statistics.log |
1395 | 2024-02-10T01:09:57.261Z | uploading: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/tracking.log (2778 bytes) |
1396 | 2024-02-10T01:09:57.328Z | upload warning: file "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/tracking.log" changed size mid upload: 2778 -> 3042 |
1397 | 2024-02-10T01:09:58.418Z | uploaded: /pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone/oxz_ntp_85555833-a405-43da-ad45-3f5518dd38dd/root/var/log/chrony/tracking.log |