Max level shown:
1 [ Aug 22 17:49:12 Enabled. ]
2 [ Aug 22 17:49:12 Rereading configuration. ]
3 [ Aug 22 17:49:16 Rereading configuration. ]
4 [ Aug 22 17:49:22 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_38de2928-c5e7-4728-8a94-bef08f284b20/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-22T17:49:22.555ZINFOcrucible-agent: dataset: "oxp_38de2928-c5e7-4728-8a94-bef08f284b20/crucible"
72024-08-22T17:49:22.557ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-08-22T17:49:22.557ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-22T17:49:22.569ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-22T17:49:22.715ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-08-22T17:50:02.451ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:52013
122024-08-22T17:50:02.475ZINFOcrucible-agent (datafile): region b4cd37c3-c416-4d1f-9b50-e94c5d9e911c state: Requested
132024-08-22T17:50:02.479ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-08-22T17:50:02.484ZINFOcrucible-agent (dropshot): request completed latency_us = 16236 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52013 req_id = cd221425-1ba4-4ab4-869f-970b11c6af5e response_code = 200 uri = /crucible/0/regions
152024-08-22T17:50:02.492ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_38de2928-c5e7-4728-8a94-bef08f284b20/crucible/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
162024-08-22T17:50:02.492ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_38de2928-c5e7-4728-8a94-bef08f284b20/crucible/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
172024-08-22T17:50:02.553ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b4cd37c3-c416-4d1f-9b50-e94c5d9e911c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c" region = b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
182024-08-22T17:50:02.555ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b4cd37c3-c416-4d1f-9b50-e94c5d9e911c" "--data" "/data/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
192024-08-22T17:50:02.764ZINFOcrucible-agent (worker): region files created ok region = b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
202024-08-22T17:50:02.764ZINFOcrucible-agent (datafile): region b4cd37c3-c416-4d1f-9b50-e94c5d9e911c state: Requested -> Created
212024-08-22T17:50:02.764ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-08-22T17:50:02.764ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
232024-08-22T17:50:02.769ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
242024-08-22T17:50:02.789ZINFOcrucible-agent (worker): creating config property group
252024-08-22T17:50:02.792ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
262024-08-22T17:50:02.797ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
272024-08-22T17:50:02.800ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-08-22T17:50:02.800ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
292024-08-22T17:50:02.800ZINFOcrucible-agent (worker): commit
302024-08-22T17:50:02.803ZINFOcrucible-agent (worker): ok!
312024-08-22T17:50:02.807ZINFOcrucible-agent (worker): SMF ok!
322024-08-22T17:50:02.827ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52013 req_id = 633cdbb7-ea9d-464f-ac2c-b3a425ec4554 response_code = 200 uri = /crucible/0/regions
332024-08-22T17:50:03.612ZINFOcrucible-agent (dropshot): request completed latency_us = 885 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52013 req_id = e74b8f68-9e4d-468e-9042-c71d14e1411a response_code = 200 uri = /crucible/0/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
342024-08-22T17:50:03.616ZINFOcrucible-agent (datafile): path is "/data/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c"
352024-08-22T17:50:03.625ZINFOcrucible-agent (datafile): dataset is oxp_38de2928-c5e7-4728-8a94-bef08f284b20/crucible/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
362024-08-22T17:50:03.633ZINFOcrucible-agent (datafile): region b4cd37c3-c416-4d1f-9b50-e94c5d9e911c state: Created -> Tombstoned
372024-08-22T17:50:03.633ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-08-22T17:50:03.633ZINFOcrucible-agent (dropshot): request completed latency_us = 17626 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:52013 req_id = 227fca51-ab1f-48f4-838e-d25fab40a0e1 response_code = 204 uri = /crucible/0/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
392024-08-22T17:50:03.634ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b4cd37c3-c416-4d1f-9b50-e94c5d9e911c (instance states: (Some(Online), None))
402024-08-22T17:50:03.636ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52013 req_id = e00287fb-234e-41dc-8291-73c25fb6b0ad response_code = 200 uri = /crucible/0/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
412024-08-22T17:50:03.639ZINFOcrucible-agent (worker): SMF ok!
422024-08-22T17:50:03.647ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_38de2928-c5e7-4728-8a94-bef08f284b20/crucible/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c" region = b4cd37c3-c416-4d1f-9b50-e94c5d9e911c
432024-08-22T17:50:03.696ZINFOcrucible-agent (datafile): region b4cd37c3-c416-4d1f-9b50-e94c5d9e911c state: Tombstoned -> Destroyed
442024-08-22T17:50:03.779ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52013 req_id = 88db4102-d032-4726-8eb3-47af52a50e82 response_code = 200 uri = /crucible/0/regions/b4cd37c3-c416-4d1f-9b50-e94c5d9e911c