Max level shown:
12026-09-05T01:47:01.154ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::b]:41970
22026-09-05T01:47:01.198ZINFOcrucible-agent (datafile): region 66c55190-9eda-44f2-972a-5d4b190f2404 state: Requested
32026-09-05T01:47:01.203ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-09-05T01:47:01.209ZINFOcrucible-agent (dropshot): request completed latency_us = 20621 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41970 req_id = 6a19acfd-93c7-436d-bc03-bcb83a715a81 response_code = 200 uri = /crucible/0/regions
52026-09-05T01:47:01.216ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_32b648d9-a1da-41c8-bf56-63a5cf13bfd0/crucible/regions/66c55190-9eda-44f2-972a-5d4b190f2404
62026-09-05T01:47:01.216ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_32b648d9-a1da-41c8-bf56-63a5cf13bfd0/crucible/regions/66c55190-9eda-44f2-972a-5d4b190f2404
72026-09-05T01:47:01.262ZINFOcrucible-agent (worker): creating region Region { id: RegionId("66c55190-9eda-44f2-972a-5d4b190f2404"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/66c55190-9eda-44f2-972a-5d4b190f2404" region = 66c55190-9eda-44f2-972a-5d4b190f2404
82026-09-05T01:47:01.265ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "66c55190-9eda-44f2-972a-5d4b190f2404" "--data" "/data/regions/66c55190-9eda-44f2-972a-5d4b190f2404" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 66c55190-9eda-44f2-972a-5d4b190f2404
92026-09-05T01:47:01.470ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41970 req_id = 9825bfb7-062b-475b-a29d-b89541eca680 response_code = 200 uri = /crucible/0/regions
102026-09-05T01:47:01.600ZINFOcrucible-agent (worker): region files created ok region = 66c55190-9eda-44f2-972a-5d4b190f2404
112026-09-05T01:47:01.604ZINFOcrucible-agent (datafile): region 66c55190-9eda-44f2-972a-5d4b190f2404 state: Requested -> Created
122026-09-05T01:47:01.605ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-09-05T01:47:01.607ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-66c55190-9eda-44f2-972a-5d4b190f2404
142026-09-05T01:47:01.614ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-66c55190-9eda-44f2-972a-5d4b190f2404
152026-09-05T01:47:01.624ZINFOcrucible-agent (worker): creating config property group
162026-09-05T01:47:01.625ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-66c55190-9eda-44f2-972a-5d4b190f2404
172026-09-05T01:47:01.626ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/66c55190-9eda-44f2-972a-5d4b190f2404
182026-09-05T01:47:01.626ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-09-05T01:47:01.626ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-09-05T01:47:01.626ZINFOcrucible-agent (worker): commit
212026-09-05T01:47:01.628ZINFOcrucible-agent (worker): ok!
222026-09-05T01:47:01.630ZINFOcrucible-agent (worker): SMF ok!
232026-09-05T01:47:02.060ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41970 req_id = 3b41789e-975e-41f4-8c97-f544d2d14781 response_code = 200 uri = /crucible/0/regions
242026-09-05T01:47:07.921ZINFOcrucible-agent (datafile): region c1079432-2398-4409-beb2-98f13c759efa state: Requested
252026-09-05T01:47:07.921ZINFOcrucible-agent (dropshot): request completed latency_us = 244 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41970 req_id = 96ad04c9-a1ea-4e5f-88d9-09ea1d90d82f response_code = 200 uri = /crucible/0/regions
262026-09-05T01:47:07.921ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-09-05T01:47:07.928ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_32b648d9-a1da-41c8-bf56-63a5cf13bfd0/crucible/regions/c1079432-2398-4409-beb2-98f13c759efa
282026-09-05T01:47:07.928ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_32b648d9-a1da-41c8-bf56-63a5cf13bfd0/crucible/regions/c1079432-2398-4409-beb2-98f13c759efa
292026-09-05T01:47:07.967ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c1079432-2398-4409-beb2-98f13c759efa"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c1079432-2398-4409-beb2-98f13c759efa" region = c1079432-2398-4409-beb2-98f13c759efa
302026-09-05T01:47:07.967ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c1079432-2398-4409-beb2-98f13c759efa" "--data" "/data/regions/c1079432-2398-4409-beb2-98f13c759efa" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c1079432-2398-4409-beb2-98f13c759efa
312026-09-05T01:47:08.014ZINFOcrucible-agent (worker): region files created ok region = c1079432-2398-4409-beb2-98f13c759efa
322026-09-05T01:47:08.014ZINFOcrucible-agent (datafile): region c1079432-2398-4409-beb2-98f13c759efa state: Requested -> Created
332026-09-05T01:47:08.014ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-09-05T01:47:08.016ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c1079432-2398-4409-beb2-98f13c759efa
352026-09-05T01:47:08.017ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c1079432-2398-4409-beb2-98f13c759efa
362026-09-05T01:47:08.020ZINFOcrucible-agent (worker): creating config property group
372026-09-05T01:47:08.021ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c1079432-2398-4409-beb2-98f13c759efa
382026-09-05T01:47:08.022ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c1079432-2398-4409-beb2-98f13c759efa
392026-09-05T01:47:08.022ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-09-05T01:47:08.022ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
412026-09-05T01:47:08.022ZINFOcrucible-agent (worker): commit
422026-09-05T01:47:08.024ZINFOcrucible-agent (worker): ok!
432026-09-05T01:47:08.026ZINFOcrucible-agent (worker): SMF ok!
442026-09-05T01:47:08.255ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:41970 req_id = bbc40027-2983-47bf-b2d6-b0d7ec1edb24 response_code = 200 uri = /crucible/0/regions
452026-09-05T01:47:32.787ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41970 req_id = 29f68dde-2914-4534-9d20-d94c2a7c8dd5 response_code = 200 uri = /crucible/0/regions/c1079432-2398-4409-beb2-98f13c759efa
462026-09-05T01:47:32.790ZINFOcrucible-agent (datafile): path is "/data/regions/c1079432-2398-4409-beb2-98f13c759efa"
472026-09-05T01:47:32.798ZINFOcrucible-agent (datafile): dataset is oxp_32b648d9-a1da-41c8-bf56-63a5cf13bfd0/crucible/regions/c1079432-2398-4409-beb2-98f13c759efa
482026-09-05T01:47:32.805ZINFOcrucible-agent (datafile): region c1079432-2398-4409-beb2-98f13c759efa state: Created -> Tombstoned
492026-09-05T01:47:32.806ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-09-05T01:47:32.806ZINFOcrucible-agent (dropshot): request completed latency_us = 15291 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:41970 req_id = e0527e9d-7f2e-4100-bc0c-c91ae02fdbe7 response_code = 204 uri = /crucible/0/regions/c1079432-2398-4409-beb2-98f13c759efa
512026-09-05T01:47:32.806ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c1079432-2398-4409-beb2-98f13c759efa (instance states: (Some(Online), None))
522026-09-05T01:47:32.809ZINFOcrucible-agent (worker): SMF ok!
532026-09-05T01:47:32.810ZINFOcrucible-agent (dropshot): request completed latency_us = 637 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41970 req_id = 13a61f9a-7107-4935-b613-4c9fc130f5cd response_code = 200 uri = /crucible/0/regions/c1079432-2398-4409-beb2-98f13c759efa
542026-09-05T01:47:32.817ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_32b648d9-a1da-41c8-bf56-63a5cf13bfd0/crucible/regions/c1079432-2398-4409-beb2-98f13c759efa" region = c1079432-2398-4409-beb2-98f13c759efa
552026-09-05T01:47:32.863ZINFOcrucible-agent (datafile): region c1079432-2398-4409-beb2-98f13c759efa state: Tombstoned -> Destroyed
562026-09-05T01:47:32.894ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:41970 req_id = 9dcfd1b4-2bec-48bb-8944-62ca16d22c8b response_code = 200 uri = /crucible/0/regions/c1079432-2398-4409-beb2-98f13c759efa