Max level shown:
12026-04-29T22:02:35.931ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:48292
22026-04-29T22:02:35.986ZINFOcrucible-agent (datafile): region c8bde353-91c3-424b-9a0f-eb78240e8191 state: Requested
32026-04-29T22:02:35.989ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-04-29T22:02:35.989ZINFOcrucible-agent (dropshot): request completed latency_us = 25961 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 4c9d30ac-59b6-4f40-a8ab-75b4a039acaf response_code = 200 uri = /crucible/0/regions
52026-04-29T22:02:36.001ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_408fd175-927a-46b8-b8ff-750970ae5527/crucible/regions/c8bde353-91c3-424b-9a0f-eb78240e8191
62026-04-29T22:02:36.001ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_408fd175-927a-46b8-b8ff-750970ae5527/crucible/regions/c8bde353-91c3-424b-9a0f-eb78240e8191
72026-04-29T22:02:36.067ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c8bde353-91c3-424b-9a0f-eb78240e8191"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c8bde353-91c3-424b-9a0f-eb78240e8191" region = c8bde353-91c3-424b-9a0f-eb78240e8191
82026-04-29T22:02:36.069ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c8bde353-91c3-424b-9a0f-eb78240e8191" "--data" "/data/regions/c8bde353-91c3-424b-9a0f-eb78240e8191" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c8bde353-91c3-424b-9a0f-eb78240e8191
92026-04-29T22:02:36.373ZINFOcrucible-agent (dropshot): request completed latency_us = 94 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 02aa686b-61e7-4a60-8eed-ef9abc5aa46f response_code = 200 uri = /crucible/0/regions
102026-04-29T22:02:36.520ZINFOcrucible-agent (worker): region files created ok region = c8bde353-91c3-424b-9a0f-eb78240e8191
112026-04-29T22:02:36.521ZINFOcrucible-agent (datafile): region c8bde353-91c3-424b-9a0f-eb78240e8191 state: Requested -> Created
122026-04-29T22:02:36.521ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-04-29T22:02:36.521ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c8bde353-91c3-424b-9a0f-eb78240e8191
142026-04-29T22:02:36.537ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c8bde353-91c3-424b-9a0f-eb78240e8191
152026-04-29T22:02:36.564ZINFOcrucible-agent (worker): creating config property group
162026-04-29T22:02:36.572ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c8bde353-91c3-424b-9a0f-eb78240e8191
172026-04-29T22:02:36.573ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c8bde353-91c3-424b-9a0f-eb78240e8191
182026-04-29T22:02:36.573ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-04-29T22:02:36.573ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202026-04-29T22:02:36.573ZINFOcrucible-agent (worker): commit
212026-04-29T22:02:36.580ZINFOcrucible-agent (worker): ok!
222026-04-29T22:02:36.587ZINFOcrucible-agent (worker): SMF ok!
232026-04-29T22:02:36.913ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 92aaa7cf-4d2c-4811-a93c-0e258c271104 response_code = 200 uri = /crucible/0/regions
242026-04-29T22:02:44.101ZINFOcrucible-agent (datafile): region 6dab323b-33d8-4a07-96d4-38e7f6bbb7b0 state: Requested
252026-04-29T22:02:44.101ZINFOcrucible-agent (dropshot): request completed latency_us = 223 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48292 req_id = a4c27be1-9167-4b2a-a04b-e6a9bd7732b4 response_code = 200 uri = /crucible/0/regions
262026-04-29T22:02:44.101ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-04-29T22:02:44.108ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_408fd175-927a-46b8-b8ff-750970ae5527/crucible/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
282026-04-29T22:02:44.108ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_408fd175-927a-46b8-b8ff-750970ae5527/crucible/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
292026-04-29T22:02:44.200ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6dab323b-33d8-4a07-96d4-38e7f6bbb7b0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0" region = 6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
302026-04-29T22:02:44.200ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6dab323b-33d8-4a07-96d4-38e7f6bbb7b0" "--data" "/data/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
312026-04-29T22:02:44.251ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 8c844fa6-1ebe-4095-a8d0-31ec9f303b34 response_code = 200 uri = /crucible/0/regions
322026-04-29T22:02:44.313ZINFOcrucible-agent (worker): region files created ok region = 6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
332026-04-29T22:02:44.313ZINFOcrucible-agent (datafile): region 6dab323b-33d8-4a07-96d4-38e7f6bbb7b0 state: Requested -> Created
342026-04-29T22:02:44.313ZINFOcrucible-agent (worker): applying SMF actions post create...
352026-04-29T22:02:44.313ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
362026-04-29T22:02:44.319ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
372026-04-29T22:02:44.331ZINFOcrucible-agent (worker): creating config property group
382026-04-29T22:02:44.340ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
392026-04-29T22:02:44.341ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
402026-04-29T22:02:44.341ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412026-04-29T22:02:44.341ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
422026-04-29T22:02:44.341ZINFOcrucible-agent (worker): commit
432026-04-29T22:02:44.349ZINFOcrucible-agent (worker): ok!
442026-04-29T22:02:44.365ZINFOcrucible-agent (worker): SMF ok!
452026-04-29T22:02:44.787ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 2cb31aae-a9c5-4a19-baec-0f360e2a2864 response_code = 200 uri = /crucible/0/regions
462026-04-29T22:03:09.348ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 6149f71e-2e2c-44cf-b499-0799694eb730 response_code = 200 uri = /crucible/0/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
472026-04-29T22:03:09.353ZINFOcrucible-agent (datafile): path is "/data/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0"
482026-04-29T22:03:09.363ZINFOcrucible-agent (datafile): dataset is oxp_408fd175-927a-46b8-b8ff-750970ae5527/crucible/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
492026-04-29T22:03:09.371ZINFOcrucible-agent (datafile): region 6dab323b-33d8-4a07-96d4-38e7f6bbb7b0 state: Created -> Tombstoned
502026-04-29T22:03:09.371ZINFOcrucible-agent (dropshot): request completed latency_us = 18929 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 28108994-f799-4f69-985b-3a0140e1fcda response_code = 204 uri = /crucible/0/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
512026-04-29T22:03:09.371ZINFOcrucible-agent (worker): applying SMF actions before removal...
522026-04-29T22:03:09.373ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6dab323b-33d8-4a07-96d4-38e7f6bbb7b0 (instance states: (Some(Online), None))
532026-04-29T22:03:09.374ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 7b974411-c0ca-4d40-a31c-ccc893d1e3bb response_code = 200 uri = /crucible/0/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
542026-04-29T22:03:09.383ZINFOcrucible-agent (worker): SMF ok!
552026-04-29T22:03:09.392ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_408fd175-927a-46b8-b8ff-750970ae5527/crucible/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0" region = 6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
562026-04-29T22:03:09.450ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48292 req_id = 7d5b1183-444d-4111-9aef-c6555e0b8885 response_code = 200 uri = /crucible/0/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0
572026-04-29T22:03:09.463ZINFOcrucible-agent (datafile): region 6dab323b-33d8-4a07-96d4-38e7f6bbb7b0 state: Tombstoned -> Destroyed
582026-04-29T22:03:09.616ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48292 req_id = bb57a276-d542-4a6f-95f0-057edc5c3fa6 response_code = 200 uri = /crucible/0/regions/6dab323b-33d8-4a07-96d4-38e7f6bbb7b0