Max level shown:
12026-05-26T21:55:31.728ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:39767
22026-05-26T21:55:31.779ZINFOcrucible-agent (datafile): region a1cf7745-56ea-400f-97c3-9dacfd018ed5 state: Requested
32026-05-26T21:55:31.785ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-26T21:55:31.785ZINFOcrucible-agent (dropshot): request completed latency_us = 19418 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39767 req_id = 8877281c-1e0a-40b7-86a7-394e9a94e15c response_code = 200 uri = /crucible/0/regions
52026-05-26T21:55:31.798ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0eff52e4-cc98-4008-a167-ddd483814836/crucible/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5
62026-05-26T21:55:31.798ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0eff52e4-cc98-4008-a167-ddd483814836/crucible/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5
72026-05-26T21:55:31.867ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a1cf7745-56ea-400f-97c3-9dacfd018ed5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5" region = a1cf7745-56ea-400f-97c3-9dacfd018ed5
82026-05-26T21:55:31.869ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a1cf7745-56ea-400f-97c3-9dacfd018ed5" "--data" "/data/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a1cf7745-56ea-400f-97c3-9dacfd018ed5
92026-05-26T21:55:32.039ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39767 req_id = 0b277a2a-39a6-41b9-a695-2a92307bb6c8 response_code = 200 uri = /crucible/0/regions
102026-05-26T21:55:32.293ZINFOcrucible-agent (worker): region files created ok region = a1cf7745-56ea-400f-97c3-9dacfd018ed5
112026-05-26T21:55:32.293ZINFOcrucible-agent (datafile): region a1cf7745-56ea-400f-97c3-9dacfd018ed5 state: Requested -> Created
122026-05-26T21:55:32.293ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-05-26T21:55:32.296ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a1cf7745-56ea-400f-97c3-9dacfd018ed5
142026-05-26T21:55:32.307ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a1cf7745-56ea-400f-97c3-9dacfd018ed5
152026-05-26T21:55:32.324ZINFOcrucible-agent (worker): creating config property group
162026-05-26T21:55:32.326ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a1cf7745-56ea-400f-97c3-9dacfd018ed5
172026-05-26T21:55:32.327ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5
182026-05-26T21:55:32.327ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-05-26T21:55:32.327ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202026-05-26T21:55:32.327ZINFOcrucible-agent (worker): commit
212026-05-26T21:55:32.339ZINFOcrucible-agent (dropshot): request completed latency_us = 93 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39767 req_id = f8f2ed61-5874-4390-9081-f52d11796131 response_code = 200 uri = /crucible/0/regions
222026-05-26T21:55:32.344ZINFOcrucible-agent (worker): ok!
232026-05-26T21:55:32.348ZINFOcrucible-agent (worker): SMF ok!
242026-05-26T21:55:38.091ZINFOcrucible-agent (datafile): region 5f20e9f8-fdff-4e4a-8b80-adb195ec43b4 state: Requested
252026-05-26T21:55:38.091ZINFOcrucible-agent (dropshot): request completed latency_us = 254 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39767 req_id = 16b8dc0d-ac12-4099-855b-0f9f0284976a response_code = 200 uri = /crucible/0/regions
262026-05-26T21:55:38.091ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-05-26T21:55:38.098ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0eff52e4-cc98-4008-a167-ddd483814836/crucible/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
282026-05-26T21:55:38.098ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0eff52e4-cc98-4008-a167-ddd483814836/crucible/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
292026-05-26T21:55:38.134ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5f20e9f8-fdff-4e4a-8b80-adb195ec43b4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4" region = 5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
302026-05-26T21:55:38.134ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5f20e9f8-fdff-4e4a-8b80-adb195ec43b4" "--data" "/data/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
312026-05-26T21:55:38.184ZINFOcrucible-agent (worker): region files created ok region = 5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
322026-05-26T21:55:38.184ZINFOcrucible-agent (datafile): region 5f20e9f8-fdff-4e4a-8b80-adb195ec43b4 state: Requested -> Created
332026-05-26T21:55:38.184ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-05-26T21:55:38.185ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
352026-05-26T21:55:38.186ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
362026-05-26T21:55:38.189ZINFOcrucible-agent (worker): creating config property group
372026-05-26T21:55:38.190ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
382026-05-26T21:55:38.191ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
392026-05-26T21:55:38.191ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-05-26T21:55:38.191ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
412026-05-26T21:55:38.191ZINFOcrucible-agent (worker): commit
422026-05-26T21:55:38.193ZINFOcrucible-agent (worker): ok!
432026-05-26T21:55:38.196ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5
442026-05-26T21:55:38.196ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
452026-05-26T21:55:38.196ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
462026-05-26T21:55:38.196ZINFOcrucible-agent (worker): reconfig required
472026-05-26T21:55:38.196ZINFOcrucible-agent (worker): using existing config property group
482026-05-26T21:55:38.197ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a1cf7745-56ea-400f-97c3-9dacfd018ed5
492026-05-26T21:55:38.197ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5
502026-05-26T21:55:38.197ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
512026-05-26T21:55:38.197ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
522026-05-26T21:55:38.197ZINFOcrucible-agent (worker): commit
532026-05-26T21:55:38.201ZINFOcrucible-agent (worker): ok!
542026-05-26T21:55:38.201ZINFOcrucible-agent (worker): SMF ok!
552026-05-26T21:55:38.404ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39767 req_id = 6e05a851-67c9-4fd9-b884-33770728f987 response_code = 200 uri = /crucible/0/regions
562026-05-26T21:56:02.937ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39767 req_id = 51e86e12-e441-4956-a4f7-41162889cc04 response_code = 200 uri = /crucible/0/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
572026-05-26T21:56:02.940ZINFOcrucible-agent (datafile): path is "/data/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4"
582026-05-26T21:56:02.949ZINFOcrucible-agent (datafile): dataset is oxp_0eff52e4-cc98-4008-a167-ddd483814836/crucible/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
592026-05-26T21:56:02.957ZINFOcrucible-agent (datafile): region 5f20e9f8-fdff-4e4a-8b80-adb195ec43b4 state: Created -> Tombstoned
602026-05-26T21:56:02.957ZINFOcrucible-agent (worker): applying SMF actions before removal...
612026-05-26T21:56:02.957ZINFOcrucible-agent (dropshot): request completed latency_us = 17291 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:39767 req_id = 6f80e480-5820-4fea-93aa-426bf52f7471 response_code = 204 uri = /crucible/0/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
622026-05-26T21:56:02.959ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5f20e9f8-fdff-4e4a-8b80-adb195ec43b4 (instance states: (Some(Online), None))
632026-05-26T21:56:02.961ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5
642026-05-26T21:56:02.961ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
652026-05-26T21:56:02.961ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
662026-05-26T21:56:02.961ZINFOcrucible-agent (worker): reconfig required
672026-05-26T21:56:02.961ZINFOcrucible-agent (worker): using existing config property group
682026-05-26T21:56:02.961ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39767 req_id = ee173ead-4a5a-4b42-85e8-61ee36e70e43 response_code = 200 uri = /crucible/0/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
692026-05-26T21:56:02.961ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a1cf7745-56ea-400f-97c3-9dacfd018ed5
702026-05-26T21:56:02.962ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a1cf7745-56ea-400f-97c3-9dacfd018ed5
712026-05-26T21:56:02.962ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
722026-05-26T21:56:02.962ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
732026-05-26T21:56:02.962ZINFOcrucible-agent (worker): commit
742026-05-26T21:56:02.964ZINFOcrucible-agent (worker): ok!
752026-05-26T21:56:02.965ZINFOcrucible-agent (worker): SMF ok!
762026-05-26T21:56:02.973ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_0eff52e4-cc98-4008-a167-ddd483814836/crucible/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4" region = 5f20e9f8-fdff-4e4a-8b80-adb195ec43b4
772026-05-26T21:56:03.023ZINFOcrucible-agent (datafile): region 5f20e9f8-fdff-4e4a-8b80-adb195ec43b4 state: Tombstoned -> Destroyed
782026-05-26T21:56:03.043ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39767 req_id = 6e25843e-8827-4f48-a135-99df0c64b575 response_code = 200 uri = /crucible/0/regions/5f20e9f8-fdff-4e4a-8b80-adb195ec43b4