Max level shown:
12026-01-24T01:05:08.245ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:60813
22026-01-24T01:05:08.362ZINFOcrucible-agent (datafile): region dd37d884-1027-4e2c-bbf9-52e6792c2515 state: Requested
32026-01-24T01:05:08.379ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-24T01:05:08.379ZINFOcrucible-agent (dropshot): request completed latency_us = 94384 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60813 req_id = 858bcfdf-91bc-4f4d-a4c2-c40211ad4235 response_code = 200 uri = /crucible/0/regions
52026-01-24T01:05:08.388ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9f54b40c-123c-46d2-b148-a5339b12f1fd/crucible/regions/dd37d884-1027-4e2c-bbf9-52e6792c2515
62026-01-24T01:05:08.388ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9f54b40c-123c-46d2-b148-a5339b12f1fd/crucible/regions/dd37d884-1027-4e2c-bbf9-52e6792c2515
72026-01-24T01:05:08.561ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60813 req_id = 1396400d-9340-4537-979a-58f916c719fe response_code = 200 uri = /crucible/0/regions
82026-01-24T01:05:08.597ZINFOcrucible-agent (worker): creating region Region { id: RegionId("dd37d884-1027-4e2c-bbf9-52e6792c2515"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/dd37d884-1027-4e2c-bbf9-52e6792c2515" region = dd37d884-1027-4e2c-bbf9-52e6792c2515
92026-01-24T01:05:08.599ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "dd37d884-1027-4e2c-bbf9-52e6792c2515" "--data" "/data/regions/dd37d884-1027-4e2c-bbf9-52e6792c2515" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = dd37d884-1027-4e2c-bbf9-52e6792c2515
102026-01-24T01:05:08.920ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60813 req_id = b51c65e6-b422-467f-9e87-daf2b7f00e0d response_code = 200 uri = /crucible/0/regions
112026-01-24T01:05:09.495ZINFOcrucible-agent (worker): region files created ok region = dd37d884-1027-4e2c-bbf9-52e6792c2515
122026-01-24T01:05:09.495ZINFOcrucible-agent (datafile): region dd37d884-1027-4e2c-bbf9-52e6792c2515 state: Requested -> Created
132026-01-24T01:05:09.495ZINFOcrucible-agent (worker): applying SMF actions post create...
142026-01-24T01:05:09.496ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-dd37d884-1027-4e2c-bbf9-52e6792c2515
152026-01-24T01:05:09.514ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60813 req_id = bdeae536-9501-44f1-bc6c-3c172fbaaefe response_code = 200 uri = /crucible/0/regions
162026-01-24T01:05:09.530ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-dd37d884-1027-4e2c-bbf9-52e6792c2515
172026-01-24T01:05:09.592ZINFOcrucible-agent (worker): creating config property group
182026-01-24T01:05:09.616ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-dd37d884-1027-4e2c-bbf9-52e6792c2515
192026-01-24T01:05:09.617ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dd37d884-1027-4e2c-bbf9-52e6792c2515
202026-01-24T01:05:09.617ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
212026-01-24T01:05:09.617ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
222026-01-24T01:05:09.617ZINFOcrucible-agent (worker): commit
232026-01-24T01:05:09.640ZINFOcrucible-agent (worker): ok!
242026-01-24T01:05:09.654ZINFOcrucible-agent (worker): SMF ok!
252026-01-24T01:05:17.954ZINFOcrucible-agent (datafile): region d5fb3cea-2b22-4f99-bf7f-4b5597709cbc state: Requested
262026-01-24T01:05:17.954ZINFOcrucible-agent (dropshot): request completed latency_us = 224 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60813 req_id = b33994ab-41b9-4700-943a-d1c3635c5bc8 response_code = 200 uri = /crucible/0/regions
272026-01-24T01:05:17.954ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
282026-01-24T01:05:17.961ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9f54b40c-123c-46d2-b148-a5339b12f1fd/crucible/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
292026-01-24T01:05:17.961ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9f54b40c-123c-46d2-b148-a5339b12f1fd/crucible/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
302026-01-24T01:05:18.049ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d5fb3cea-2b22-4f99-bf7f-4b5597709cbc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc" region = d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
312026-01-24T01:05:18.049ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d5fb3cea-2b22-4f99-bf7f-4b5597709cbc" "--data" "/data/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
322026-01-24T01:05:18.191ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60813 req_id = 4f3645f3-cb55-4aa1-b19d-1d0d19579227 response_code = 200 uri = /crucible/0/regions
332026-01-24T01:05:18.221ZINFOcrucible-agent (worker): region files created ok region = d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
342026-01-24T01:05:18.221ZINFOcrucible-agent (datafile): region d5fb3cea-2b22-4f99-bf7f-4b5597709cbc state: Requested -> Created
352026-01-24T01:05:18.221ZINFOcrucible-agent (worker): applying SMF actions post create...
362026-01-24T01:05:18.222ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
372026-01-24T01:05:18.230ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
382026-01-24T01:05:18.251ZINFOcrucible-agent (worker): creating config property group
392026-01-24T01:05:18.267ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
402026-01-24T01:05:18.267ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
412026-01-24T01:05:18.267ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422026-01-24T01:05:18.267ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432026-01-24T01:05:18.267ZINFOcrucible-agent (worker): commit
442026-01-24T01:05:18.278ZINFOcrucible-agent (worker): ok!
452026-01-24T01:05:18.307ZINFOcrucible-agent (worker): SMF ok!
462026-01-24T01:05:18.619ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60813 req_id = 0ca5c433-e559-4814-aeba-133ce96b08c2 response_code = 200 uri = /crucible/0/regions
472026-01-24T01:05:46.786ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60813 req_id = 3d05484c-6b58-4e44-9bc2-d55dc8d6606c response_code = 200 uri = /crucible/0/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
482026-01-24T01:05:46.790ZINFOcrucible-agent (datafile): path is "/data/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc"
492026-01-24T01:05:46.798ZINFOcrucible-agent (datafile): dataset is oxp_9f54b40c-123c-46d2-b148-a5339b12f1fd/crucible/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
502026-01-24T01:05:46.806ZINFOcrucible-agent (datafile): region d5fb3cea-2b22-4f99-bf7f-4b5597709cbc state: Created -> Tombstoned
512026-01-24T01:05:46.806ZINFOcrucible-agent (dropshot): request completed latency_us = 16490 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:60813 req_id = cd32aeb6-cbb4-42e4-babc-2a6c912d0741 response_code = 204 uri = /crucible/0/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
522026-01-24T01:05:46.806ZINFOcrucible-agent (worker): applying SMF actions before removal...
532026-01-24T01:05:46.807ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d5fb3cea-2b22-4f99-bf7f-4b5597709cbc (instance states: (Some(Online), None))
542026-01-24T01:05:46.809ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60813 req_id = 4e1c3eab-ab06-4695-95ed-4bf1b2505df3 response_code = 200 uri = /crucible/0/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
552026-01-24T01:05:46.815ZINFOcrucible-agent (worker): SMF ok!
562026-01-24T01:05:46.824ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9f54b40c-123c-46d2-b148-a5339b12f1fd/crucible/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc" region = d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
572026-01-24T01:05:46.869ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60813 req_id = 1937a221-c634-4ff2-945b-83940cb1c02b response_code = 200 uri = /crucible/0/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc
582026-01-24T01:05:46.884ZINFOcrucible-agent (datafile): region d5fb3cea-2b22-4f99-bf7f-4b5597709cbc state: Tombstoned -> Destroyed
592026-01-24T01:05:46.999ZINFOcrucible-agent (dropshot): request completed latency_us = 39 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60813 req_id = 4b698968-1246-4e42-ae84-bc55b1145d49 response_code = 200 uri = /crucible/0/regions/d5fb3cea-2b22-4f99-bf7f-4b5597709cbc