Max level shown:
12026-04-24T17:41:15.532ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:55539
22026-04-24T17:41:15.579ZINFOcrucible-agent (datafile): region 06a59867-6c20-4b41-854c-26898ec54a7e state: Requested
32026-04-24T17:41:15.583ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-04-24T17:41:15.583ZINFOcrucible-agent (dropshot): request completed latency_us = 20364 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55539 req_id = 1a263432-536c-45ab-8731-4d7aa570aec4 response_code = 200 uri = /crucible/0/regions
52026-04-24T17:41:15.595ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1b662c64-5f00-480b-83d5-e955e3628f63/crucible/regions/06a59867-6c20-4b41-854c-26898ec54a7e
62026-04-24T17:41:15.595ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1b662c64-5f00-480b-83d5-e955e3628f63/crucible/regions/06a59867-6c20-4b41-854c-26898ec54a7e
72026-04-24T17:41:15.644ZINFOcrucible-agent (worker): creating region Region { id: RegionId("06a59867-6c20-4b41-854c-26898ec54a7e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/06a59867-6c20-4b41-854c-26898ec54a7e" region = 06a59867-6c20-4b41-854c-26898ec54a7e
82026-04-24T17:41:15.646ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "06a59867-6c20-4b41-854c-26898ec54a7e" "--data" "/data/regions/06a59867-6c20-4b41-854c-26898ec54a7e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 06a59867-6c20-4b41-854c-26898ec54a7e
92026-04-24T17:41:15.909ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55539 req_id = 3a6b6e1a-1507-4f59-a203-c297d375cc8f response_code = 200 uri = /crucible/0/regions
102026-04-24T17:41:16.049ZINFOcrucible-agent (worker): region files created ok region = 06a59867-6c20-4b41-854c-26898ec54a7e
112026-04-24T17:41:16.049ZINFOcrucible-agent (datafile): region 06a59867-6c20-4b41-854c-26898ec54a7e state: Requested -> Created
122026-04-24T17:41:16.049ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-04-24T17:41:16.049ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-06a59867-6c20-4b41-854c-26898ec54a7e
142026-04-24T17:41:16.065ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-06a59867-6c20-4b41-854c-26898ec54a7e
152026-04-24T17:41:16.091ZINFOcrucible-agent (worker): creating config property group
162026-04-24T17:41:16.094ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-06a59867-6c20-4b41-854c-26898ec54a7e
172026-04-24T17:41:16.095ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/06a59867-6c20-4b41-854c-26898ec54a7e
182026-04-24T17:41:16.095ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-04-24T17:41:16.095ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-04-24T17:41:16.095ZINFOcrucible-agent (worker): commit
212026-04-24T17:41:16.099ZINFOcrucible-agent (worker): ok!
222026-04-24T17:41:16.103ZINFOcrucible-agent (worker): SMF ok!
232026-04-24T17:41:16.190ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55539 req_id = d7174843-89c1-43ac-b5e3-7c0aeb8d79c6 response_code = 200 uri = /crucible/0/regions
242026-04-24T17:41:22.786ZINFOcrucible-agent (datafile): region e4b4033e-11eb-4bba-8d58-663facf6b596 state: Requested
252026-04-24T17:41:22.786ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-04-24T17:41:22.786ZINFOcrucible-agent (dropshot): request completed latency_us = 250 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55539 req_id = f5da1c39-7645-4ef8-964f-3e13f3b78bc9 response_code = 200 uri = /crucible/0/regions
272026-04-24T17:41:22.793ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1b662c64-5f00-480b-83d5-e955e3628f63/crucible/regions/e4b4033e-11eb-4bba-8d58-663facf6b596
282026-04-24T17:41:22.793ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1b662c64-5f00-480b-83d5-e955e3628f63/crucible/regions/e4b4033e-11eb-4bba-8d58-663facf6b596
292026-04-24T17:41:22.845ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e4b4033e-11eb-4bba-8d58-663facf6b596"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e4b4033e-11eb-4bba-8d58-663facf6b596" region = e4b4033e-11eb-4bba-8d58-663facf6b596
302026-04-24T17:41:22.845ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e4b4033e-11eb-4bba-8d58-663facf6b596" "--data" "/data/regions/e4b4033e-11eb-4bba-8d58-663facf6b596" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e4b4033e-11eb-4bba-8d58-663facf6b596
312026-04-24T17:41:22.921ZINFOcrucible-agent (worker): region files created ok region = e4b4033e-11eb-4bba-8d58-663facf6b596
322026-04-24T17:41:22.921ZINFOcrucible-agent (datafile): region e4b4033e-11eb-4bba-8d58-663facf6b596 state: Requested -> Created
332026-04-24T17:41:22.921ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-04-24T17:41:22.924ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e4b4033e-11eb-4bba-8d58-663facf6b596
352026-04-24T17:41:22.928ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e4b4033e-11eb-4bba-8d58-663facf6b596
362026-04-24T17:41:22.936ZINFOcrucible-agent (worker): creating config property group
372026-04-24T17:41:22.939ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e4b4033e-11eb-4bba-8d58-663facf6b596
382026-04-24T17:41:22.939ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e4b4033e-11eb-4bba-8d58-663facf6b596
392026-04-24T17:41:22.939ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-04-24T17:41:22.939ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
412026-04-24T17:41:22.940ZINFOcrucible-agent (worker): commit
422026-04-24T17:41:22.943ZINFOcrucible-agent (worker): ok!
432026-04-24T17:41:22.948ZINFOcrucible-agent (worker): SMF ok!
442026-04-24T17:41:23.092ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:55539 req_id = 16173bde-0dff-4ab0-a5d8-a7a78fbe2887 response_code = 200 uri = /crucible/0/regions
452026-04-24T17:41:48.417ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55539 req_id = 50217cb8-101c-4512-a828-0502e1c0e078 response_code = 200 uri = /crucible/0/regions/e4b4033e-11eb-4bba-8d58-663facf6b596
462026-04-24T17:41:48.420ZINFOcrucible-agent (datafile): path is "/data/regions/e4b4033e-11eb-4bba-8d58-663facf6b596"
472026-04-24T17:41:48.431ZINFOcrucible-agent (datafile): dataset is oxp_1b662c64-5f00-480b-83d5-e955e3628f63/crucible/regions/e4b4033e-11eb-4bba-8d58-663facf6b596
482026-04-24T17:41:48.438ZINFOcrucible-agent (datafile): region e4b4033e-11eb-4bba-8d58-663facf6b596 state: Created -> Tombstoned
492026-04-24T17:41:48.439ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-04-24T17:41:48.439ZINFOcrucible-agent (dropshot): request completed latency_us = 18769 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:55539 req_id = 48eda0a0-9fdb-44f9-b5c3-565e90d3c0cb response_code = 204 uri = /crucible/0/regions/e4b4033e-11eb-4bba-8d58-663facf6b596
512026-04-24T17:41:48.440ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e4b4033e-11eb-4bba-8d58-663facf6b596 (instance states: (Some(Online), None))
522026-04-24T17:41:48.442ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55539 req_id = b3b61fdb-b43b-441d-9f3e-884b0ad3a4e1 response_code = 200 uri = /crucible/0/regions/e4b4033e-11eb-4bba-8d58-663facf6b596
532026-04-24T17:41:48.453ZINFOcrucible-agent (worker): SMF ok!
542026-04-24T17:41:48.461ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1b662c64-5f00-480b-83d5-e955e3628f63/crucible/regions/e4b4033e-11eb-4bba-8d58-663facf6b596" region = e4b4033e-11eb-4bba-8d58-663facf6b596
552026-04-24T17:41:48.507ZINFOcrucible-agent (datafile): region e4b4033e-11eb-4bba-8d58-663facf6b596 state: Tombstoned -> Destroyed
562026-04-24T17:41:48.540ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:55539 req_id = eb73cc04-dd39-4da7-9d5c-e6eb3c64bb08 response_code = 200 uri = /crucible/0/regions/e4b4033e-11eb-4bba-8d58-663facf6b596