Max level shown:
12026-02-24T15:56:32.742ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:42360
22026-02-24T15:56:32.789ZINFOcrucible-agent (datafile): region 6242290c-3d06-491b-9dae-3bdbcb4734b2 state: Requested
32026-02-24T15:56:32.792ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-02-24T15:56:32.792ZINFOcrucible-agent (dropshot): request completed latency_us = 19555 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42360 req_id = 4705e1be-e4d6-420d-bb81-b78476dccfc0 response_code = 200 uri = /crucible/0/regions
52026-02-24T15:56:32.805ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_026adbbd-4696-443f-9676-f22e55ab49a8/crucible/regions/6242290c-3d06-491b-9dae-3bdbcb4734b2
62026-02-24T15:56:32.805ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_026adbbd-4696-443f-9676-f22e55ab49a8/crucible/regions/6242290c-3d06-491b-9dae-3bdbcb4734b2
72026-02-24T15:56:32.860ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6242290c-3d06-491b-9dae-3bdbcb4734b2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6242290c-3d06-491b-9dae-3bdbcb4734b2" region = 6242290c-3d06-491b-9dae-3bdbcb4734b2
82026-02-24T15:56:32.862ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6242290c-3d06-491b-9dae-3bdbcb4734b2" "--data" "/data/regions/6242290c-3d06-491b-9dae-3bdbcb4734b2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6242290c-3d06-491b-9dae-3bdbcb4734b2
92026-02-24T15:56:33.139ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42360 req_id = 72e8cac1-477f-4507-a814-a2e2bfa59f7b response_code = 200 uri = /crucible/0/regions
102026-02-24T15:56:33.284ZINFOcrucible-agent (worker): region files created ok region = 6242290c-3d06-491b-9dae-3bdbcb4734b2
112026-02-24T15:56:33.284ZINFOcrucible-agent (datafile): region 6242290c-3d06-491b-9dae-3bdbcb4734b2 state: Requested -> Created
122026-02-24T15:56:33.284ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-02-24T15:56:33.284ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6242290c-3d06-491b-9dae-3bdbcb4734b2
142026-02-24T15:56:33.298ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6242290c-3d06-491b-9dae-3bdbcb4734b2
152026-02-24T15:56:33.323ZINFOcrucible-agent (worker): creating config property group
162026-02-24T15:56:33.326ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6242290c-3d06-491b-9dae-3bdbcb4734b2
172026-02-24T15:56:33.327ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6242290c-3d06-491b-9dae-3bdbcb4734b2
182026-02-24T15:56:33.327ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-02-24T15:56:33.327ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-02-24T15:56:33.328ZINFOcrucible-agent (worker): commit
212026-02-24T15:56:33.332ZINFOcrucible-agent (worker): ok!
222026-02-24T15:56:33.336ZINFOcrucible-agent (worker): SMF ok!
232026-02-24T15:56:33.703ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42360 req_id = c7e5c0d7-3c9d-4c27-9a06-227b748c96cd response_code = 200 uri = /crucible/0/regions
242026-02-24T15:56:40.080ZINFOcrucible-agent (datafile): region 9141c360-e9da-407d-882e-27f68db9c3f5 state: Requested
252026-02-24T15:56:40.080ZINFOcrucible-agent (dropshot): request completed latency_us = 232 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42360 req_id = 20a61f09-111b-48df-977f-f53c48100447 response_code = 200 uri = /crucible/0/regions
262026-02-24T15:56:40.080ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-02-24T15:56:40.086ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_026adbbd-4696-443f-9676-f22e55ab49a8/crucible/regions/9141c360-e9da-407d-882e-27f68db9c3f5
282026-02-24T15:56:40.086ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_026adbbd-4696-443f-9676-f22e55ab49a8/crucible/regions/9141c360-e9da-407d-882e-27f68db9c3f5
292026-02-24T15:56:40.137ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9141c360-e9da-407d-882e-27f68db9c3f5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9141c360-e9da-407d-882e-27f68db9c3f5" region = 9141c360-e9da-407d-882e-27f68db9c3f5
302026-02-24T15:56:40.138ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9141c360-e9da-407d-882e-27f68db9c3f5" "--data" "/data/regions/9141c360-e9da-407d-882e-27f68db9c3f5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9141c360-e9da-407d-882e-27f68db9c3f5
312026-02-24T15:56:40.214ZINFOcrucible-agent (worker): region files created ok region = 9141c360-e9da-407d-882e-27f68db9c3f5
322026-02-24T15:56:40.214ZINFOcrucible-agent (datafile): region 9141c360-e9da-407d-882e-27f68db9c3f5 state: Requested -> Created
332026-02-24T15:56:40.214ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-02-24T15:56:40.218ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9141c360-e9da-407d-882e-27f68db9c3f5
352026-02-24T15:56:40.220ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9141c360-e9da-407d-882e-27f68db9c3f5
362026-02-24T15:56:40.227ZINFOcrucible-agent (worker): creating config property group
372026-02-24T15:56:40.231ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9141c360-e9da-407d-882e-27f68db9c3f5
382026-02-24T15:56:40.231ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9141c360-e9da-407d-882e-27f68db9c3f5
392026-02-24T15:56:40.231ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-02-24T15:56:40.231ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
412026-02-24T15:56:40.231ZINFOcrucible-agent (worker): commit
422026-02-24T15:56:40.235ZINFOcrucible-agent (worker): ok!
432026-02-24T15:56:40.239ZINFOcrucible-agent (worker): SMF ok!
442026-02-24T15:56:40.401ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42360 req_id = 0533537e-f19e-4ae2-b6d3-1b8f39385f7c response_code = 200 uri = /crucible/0/regions
452026-02-24T15:57:05.401ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:42360 req_id = 65121acf-3489-4c4c-a176-b7c94bf4a64a response_code = 200 uri = /crucible/0/regions/9141c360-e9da-407d-882e-27f68db9c3f5
462026-02-24T15:57:05.404ZINFOcrucible-agent (datafile): path is "/data/regions/9141c360-e9da-407d-882e-27f68db9c3f5"
472026-02-24T15:57:05.412ZINFOcrucible-agent (datafile): dataset is oxp_026adbbd-4696-443f-9676-f22e55ab49a8/crucible/regions/9141c360-e9da-407d-882e-27f68db9c3f5
482026-02-24T15:57:05.419ZINFOcrucible-agent (datafile): region 9141c360-e9da-407d-882e-27f68db9c3f5 state: Created -> Tombstoned
492026-02-24T15:57:05.420ZINFOcrucible-agent (dropshot): request completed latency_us = 16323 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:42360 req_id = b66fba09-4a99-43a4-82c3-a00ed04b4911 response_code = 204 uri = /crucible/0/regions/9141c360-e9da-407d-882e-27f68db9c3f5
502026-02-24T15:57:05.420ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-02-24T15:57:05.420ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9141c360-e9da-407d-882e-27f68db9c3f5 (instance states: (Some(Online), None))
522026-02-24T15:57:05.423ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:42360 req_id = 223b7f7d-f68f-4ac2-9429-eed9b93c8c58 response_code = 200 uri = /crucible/0/regions/9141c360-e9da-407d-882e-27f68db9c3f5
532026-02-24T15:57:05.434ZINFOcrucible-agent (worker): SMF ok!
542026-02-24T15:57:05.442ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_026adbbd-4696-443f-9676-f22e55ab49a8/crucible/regions/9141c360-e9da-407d-882e-27f68db9c3f5" region = 9141c360-e9da-407d-882e-27f68db9c3f5
552026-02-24T15:57:05.493ZINFOcrucible-agent (datafile): region 9141c360-e9da-407d-882e-27f68db9c3f5 state: Tombstoned -> Destroyed
562026-02-24T15:57:05.557ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:42360 req_id = 03f63067-b142-4e9f-adcb-5f65049688b2 response_code = 200 uri = /crucible/0/regions/9141c360-e9da-407d-882e-27f68db9c3f5