Max level shown:
12026-01-14T02:46:34.683ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:34823
22026-01-14T02:46:34.729ZINFOcrucible-agent (datafile): region ffbc7299-13bd-4b12-9fc9-ba5c99c20830 state: Requested
32026-01-14T02:46:34.732ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-14T02:46:34.732ZINFOcrucible-agent (dropshot): request completed latency_us = 18857 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34823 req_id = b9d7e6b5-a065-4689-9944-ba73f5984d66 response_code = 200 uri = /crucible/0/regions
52026-01-14T02:46:34.743ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2158a005-c28f-4c4e-8087-33e56c339922/crucible/regions/ffbc7299-13bd-4b12-9fc9-ba5c99c20830
62026-01-14T02:46:34.743ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2158a005-c28f-4c4e-8087-33e56c339922/crucible/regions/ffbc7299-13bd-4b12-9fc9-ba5c99c20830
72026-01-14T02:46:34.787ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ffbc7299-13bd-4b12-9fc9-ba5c99c20830"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ffbc7299-13bd-4b12-9fc9-ba5c99c20830" region = ffbc7299-13bd-4b12-9fc9-ba5c99c20830
82026-01-14T02:46:34.789ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ffbc7299-13bd-4b12-9fc9-ba5c99c20830" "--data" "/data/regions/ffbc7299-13bd-4b12-9fc9-ba5c99c20830" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ffbc7299-13bd-4b12-9fc9-ba5c99c20830
92026-01-14T02:46:34.903ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34823 req_id = a4916cc3-d11b-493c-8d40-d69d2f25189d response_code = 200 uri = /crucible/0/regions
102026-01-14T02:46:35.148ZINFOcrucible-agent (worker): region files created ok region = ffbc7299-13bd-4b12-9fc9-ba5c99c20830
112026-01-14T02:46:35.148ZINFOcrucible-agent (datafile): region ffbc7299-13bd-4b12-9fc9-ba5c99c20830 state: Requested -> Created
122026-01-14T02:46:35.148ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-14T02:46:35.148ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ffbc7299-13bd-4b12-9fc9-ba5c99c20830
142026-01-14T02:46:35.159ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ffbc7299-13bd-4b12-9fc9-ba5c99c20830
152026-01-14T02:46:35.179ZINFOcrucible-agent (worker): creating config property group
162026-01-14T02:46:35.183ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ffbc7299-13bd-4b12-9fc9-ba5c99c20830
172026-01-14T02:46:35.183ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ffbc7299-13bd-4b12-9fc9-ba5c99c20830
182026-01-14T02:46:35.183ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-01-14T02:46:35.184ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-01-14T02:46:35.184ZINFOcrucible-agent (worker): commit
212026-01-14T02:46:35.187ZINFOcrucible-agent (worker): ok!
222026-01-14T02:46:35.191ZINFOcrucible-agent (worker): SMF ok!
232026-01-14T02:46:35.280ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34823 req_id = d551f5f9-5abb-4f41-bfa4-d011b8c98b7b response_code = 200 uri = /crucible/0/regions
242026-01-14T02:46:41.699ZINFOcrucible-agent (datafile): region 1245b9b4-7547-4293-945b-98646914abe9 state: Requested
252026-01-14T02:46:41.699ZINFOcrucible-agent (dropshot): request completed latency_us = 210 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34823 req_id = 23267615-f278-4a37-9ea1-f93340feac7a response_code = 200 uri = /crucible/0/regions
262026-01-14T02:46:41.699ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-01-14T02:46:41.705ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2158a005-c28f-4c4e-8087-33e56c339922/crucible/regions/1245b9b4-7547-4293-945b-98646914abe9
282026-01-14T02:46:41.705ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2158a005-c28f-4c4e-8087-33e56c339922/crucible/regions/1245b9b4-7547-4293-945b-98646914abe9
292026-01-14T02:46:41.753ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1245b9b4-7547-4293-945b-98646914abe9"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1245b9b4-7547-4293-945b-98646914abe9" region = 1245b9b4-7547-4293-945b-98646914abe9
302026-01-14T02:46:41.753ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1245b9b4-7547-4293-945b-98646914abe9" "--data" "/data/regions/1245b9b4-7547-4293-945b-98646914abe9" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1245b9b4-7547-4293-945b-98646914abe9
312026-01-14T02:46:41.832ZINFOcrucible-agent (worker): region files created ok region = 1245b9b4-7547-4293-945b-98646914abe9
322026-01-14T02:46:41.832ZINFOcrucible-agent (datafile): region 1245b9b4-7547-4293-945b-98646914abe9 state: Requested -> Created
332026-01-14T02:46:41.832ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-01-14T02:46:41.833ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1245b9b4-7547-4293-945b-98646914abe9
352026-01-14T02:46:41.835ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1245b9b4-7547-4293-945b-98646914abe9
362026-01-14T02:46:41.842ZINFOcrucible-agent (worker): creating config property group
372026-01-14T02:46:41.845ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1245b9b4-7547-4293-945b-98646914abe9
382026-01-14T02:46:41.845ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1245b9b4-7547-4293-945b-98646914abe9
392026-01-14T02:46:41.845ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-01-14T02:46:41.845ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
412026-01-14T02:46:41.845ZINFOcrucible-agent (worker): commit
422026-01-14T02:46:41.848ZINFOcrucible-agent (worker): ok!
432026-01-14T02:46:41.858ZINFOcrucible-agent (worker): SMF ok!
442026-01-14T02:46:41.865ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34823 req_id = 42266c42-f121-4c6d-83e4-f495c7c80e89 response_code = 200 uri = /crucible/0/regions
452026-01-14T02:47:13.219ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:64357
462026-01-14T02:47:13.219ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64357 req_id = 8b83ccc6-86af-4f9d-9735-b2e3ac3e5edd response_code = 200 uri = /crucible/0/regions/1245b9b4-7547-4293-945b-98646914abe9
472026-01-14T02:47:13.223ZINFOcrucible-agent (datafile): path is "/data/regions/1245b9b4-7547-4293-945b-98646914abe9"
482026-01-14T02:47:13.233ZINFOcrucible-agent (datafile): dataset is oxp_2158a005-c28f-4c4e-8087-33e56c339922/crucible/regions/1245b9b4-7547-4293-945b-98646914abe9
492026-01-14T02:47:13.241ZINFOcrucible-agent (datafile): region 1245b9b4-7547-4293-945b-98646914abe9 state: Created -> Tombstoned
502026-01-14T02:47:13.242ZINFOcrucible-agent (dropshot): request completed latency_us = 18966 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:64357 req_id = 90d55dd5-2ce9-43c0-9f28-4b685f0e81b7 response_code = 204 uri = /crucible/0/regions/1245b9b4-7547-4293-945b-98646914abe9
512026-01-14T02:47:13.242ZINFOcrucible-agent (worker): applying SMF actions before removal...
522026-01-14T02:47:13.243ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-1245b9b4-7547-4293-945b-98646914abe9 (instance states: (Some(Online), None))
532026-01-14T02:47:13.245ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64357 req_id = d8fa30b1-bbff-4f90-a687-767787f2f073 response_code = 200 uri = /crucible/0/regions/1245b9b4-7547-4293-945b-98646914abe9
542026-01-14T02:47:13.257ZINFOcrucible-agent (worker): SMF ok!
552026-01-14T02:47:13.265ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_2158a005-c28f-4c4e-8087-33e56c339922/crucible/regions/1245b9b4-7547-4293-945b-98646914abe9" region = 1245b9b4-7547-4293-945b-98646914abe9
562026-01-14T02:47:13.313ZINFOcrucible-agent (datafile): region 1245b9b4-7547-4293-945b-98646914abe9 state: Tombstoned -> Destroyed
572026-01-14T02:47:13.362ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64357 req_id = e806c085-44be-45cd-b286-4bf1b4ec33f6 response_code = 200 uri = /crucible/0/regions/1245b9b4-7547-4293-945b-98646914abe9