Max level shown:
12025-02-24T21:55:37.437ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:57988
22025-02-24T21:55:37.471ZINFOcrucible-agent (datafile): region d3796efb-460d-4b20-8983-c2d2a0c7c4ac state: Requested
32025-02-24T21:55:37.473ZINFOcrucible-agent (dropshot): request completed latency_us = 13573 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57988 req_id = f2913be2-0052-42c6-a19b-9bcdb479c4c1 response_code = 200 uri = /crucible/0/regions
42025-02-24T21:55:37.479ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-02-24T21:55:37.491ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_bae8251b-0f09-499a-b88a-830964735267/crucible/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac
62025-02-24T21:55:37.491ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_bae8251b-0f09-499a-b88a-830964735267/crucible/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac
72025-02-24T21:55:37.552ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d3796efb-460d-4b20-8983-c2d2a0c7c4ac"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac" region = d3796efb-460d-4b20-8983-c2d2a0c7c4ac
82025-02-24T21:55:37.555ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d3796efb-460d-4b20-8983-c2d2a0c7c4ac" "--data" "/data/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d3796efb-460d-4b20-8983-c2d2a0c7c4ac
92025-02-24T21:55:37.692ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57988 req_id = 859f9449-ee64-41e1-b44f-cf401fa92d45 response_code = 200 uri = /crucible/0/regions
102025-02-24T21:55:37.863ZINFOcrucible-agent (worker): region files created ok region = d3796efb-460d-4b20-8983-c2d2a0c7c4ac
112025-02-24T21:55:37.863ZINFOcrucible-agent (datafile): region d3796efb-460d-4b20-8983-c2d2a0c7c4ac state: Requested -> Created
122025-02-24T21:55:37.863ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-02-24T21:55:37.864ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d3796efb-460d-4b20-8983-c2d2a0c7c4ac
142025-02-24T21:55:37.871ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d3796efb-460d-4b20-8983-c2d2a0c7c4ac
152025-02-24T21:55:37.884ZINFOcrucible-agent (worker): creating config property group
162025-02-24T21:55:37.887ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d3796efb-460d-4b20-8983-c2d2a0c7c4ac
172025-02-24T21:55:37.888ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac
182025-02-24T21:55:37.890ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-02-24T21:55:37.890ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202025-02-24T21:55:37.890ZINFOcrucible-agent (worker): commit
212025-02-24T21:55:37.904ZINFOcrucible-agent (worker): ok!
222025-02-24T21:55:37.907ZINFOcrucible-agent (worker): SMF ok!
232025-02-24T21:55:38.055ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57988 req_id = c21d0ad5-c6f7-4c59-ada9-9c96762df728 response_code = 200 uri = /crucible/0/regions
242025-02-24T21:55:42.980ZINFOcrucible-agent (datafile): region 2fd354f0-174e-4871-9af2-99da2060cedf state: Requested
252025-02-24T21:55:42.983ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-02-24T21:55:42.983ZINFOcrucible-agent (dropshot): request completed latency_us = 2718 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57988 req_id = e4cdff1f-410e-484d-b3ce-ad30c3e4ac13 response_code = 200 uri = /crucible/0/regions
272025-02-24T21:55:42.992ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_bae8251b-0f09-499a-b88a-830964735267/crucible/regions/2fd354f0-174e-4871-9af2-99da2060cedf
282025-02-24T21:55:42.992ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_bae8251b-0f09-499a-b88a-830964735267/crucible/regions/2fd354f0-174e-4871-9af2-99da2060cedf
292025-02-24T21:55:43.057ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2fd354f0-174e-4871-9af2-99da2060cedf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2fd354f0-174e-4871-9af2-99da2060cedf" region = 2fd354f0-174e-4871-9af2-99da2060cedf
302025-02-24T21:55:43.057ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2fd354f0-174e-4871-9af2-99da2060cedf" "--data" "/data/regions/2fd354f0-174e-4871-9af2-99da2060cedf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2fd354f0-174e-4871-9af2-99da2060cedf
312025-02-24T21:55:43.116ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57988 req_id = d5a551b9-07f9-4c79-80ab-385c69d3eda1 response_code = 200 uri = /crucible/0/regions
322025-02-24T21:55:43.134ZINFOcrucible-agent (worker): region files created ok region = 2fd354f0-174e-4871-9af2-99da2060cedf
332025-02-24T21:55:43.134ZINFOcrucible-agent (datafile): region 2fd354f0-174e-4871-9af2-99da2060cedf state: Requested -> Created
342025-02-24T21:55:43.135ZINFOcrucible-agent (worker): applying SMF actions post create...
352025-02-24T21:55:43.135ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2fd354f0-174e-4871-9af2-99da2060cedf
362025-02-24T21:55:43.139ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2fd354f0-174e-4871-9af2-99da2060cedf
372025-02-24T21:55:43.146ZINFOcrucible-agent (worker): creating config property group
382025-02-24T21:55:43.149ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2fd354f0-174e-4871-9af2-99da2060cedf
392025-02-24T21:55:43.150ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2fd354f0-174e-4871-9af2-99da2060cedf
402025-02-24T21:55:43.150ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412025-02-24T21:55:43.150ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
422025-02-24T21:55:43.150ZINFOcrucible-agent (worker): commit
432025-02-24T21:55:43.154ZINFOcrucible-agent (worker): ok!
442025-02-24T21:55:43.161ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac
452025-02-24T21:55:43.161ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
462025-02-24T21:55:43.161ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
472025-02-24T21:55:43.161ZINFOcrucible-agent (worker): reconfig required
482025-02-24T21:55:43.161ZINFOcrucible-agent (worker): using existing config property group
492025-02-24T21:55:43.161ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d3796efb-460d-4b20-8983-c2d2a0c7c4ac
502025-02-24T21:55:43.161ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac
512025-02-24T21:55:43.161ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522025-02-24T21:55:43.161ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
532025-02-24T21:55:43.162ZINFOcrucible-agent (worker): commit
542025-02-24T21:55:43.169ZINFOcrucible-agent (worker): ok!
552025-02-24T21:55:43.169ZINFOcrucible-agent (worker): SMF ok!
562025-02-24T21:55:43.372ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57988 req_id = 19f6ab3a-b597-4e2b-af38-d5cd76d02ec5 response_code = 200 uri = /crucible/0/regions
572025-02-24T21:56:09.047ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57988 req_id = a527516c-3e8d-4e7a-ab77-6ee2b9c99a2b response_code = 200 uri = /crucible/0/regions/2fd354f0-174e-4871-9af2-99da2060cedf
582025-02-24T21:56:09.051ZINFOcrucible-agent (datafile): path is "/data/regions/2fd354f0-174e-4871-9af2-99da2060cedf"
592025-02-24T21:56:09.062ZINFOcrucible-agent (datafile): dataset is oxp_bae8251b-0f09-499a-b88a-830964735267/crucible/regions/2fd354f0-174e-4871-9af2-99da2060cedf
602025-02-24T21:56:09.072ZINFOcrucible-agent (datafile): region 2fd354f0-174e-4871-9af2-99da2060cedf state: Created -> Tombstoned
612025-02-24T21:56:09.073ZINFOcrucible-agent (worker): applying SMF actions before removal...
622025-02-24T21:56:09.074ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-2fd354f0-174e-4871-9af2-99da2060cedf (instance states: (Some(Online), None))
632025-02-24T21:56:09.075ZINFOcrucible-agent (dropshot): request completed latency_us = 24030 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:57988 req_id = 07a8a0e0-2335-44d3-820d-2873361de55d response_code = 204 uri = /crucible/0/regions/2fd354f0-174e-4871-9af2-99da2060cedf
642025-02-24T21:56:09.079ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57988 req_id = b0103fdd-f905-4994-bc3b-6708820fef96 response_code = 200 uri = /crucible/0/regions/2fd354f0-174e-4871-9af2-99da2060cedf
652025-02-24T21:56:09.091ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac
662025-02-24T21:56:09.091ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
672025-02-24T21:56:09.091ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
682025-02-24T21:56:09.091ZINFOcrucible-agent (worker): reconfig required
692025-02-24T21:56:09.091ZINFOcrucible-agent (worker): using existing config property group
702025-02-24T21:56:09.091ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d3796efb-460d-4b20-8983-c2d2a0c7c4ac
712025-02-24T21:56:09.091ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d3796efb-460d-4b20-8983-c2d2a0c7c4ac
722025-02-24T21:56:09.092ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
732025-02-24T21:56:09.092ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
742025-02-24T21:56:09.092ZINFOcrucible-agent (worker): commit
752025-02-24T21:56:09.123ZINFOcrucible-agent (worker): ok!
762025-02-24T21:56:09.124ZINFOcrucible-agent (worker): SMF ok!
772025-02-24T21:56:09.135ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_bae8251b-0f09-499a-b88a-830964735267/crucible/regions/2fd354f0-174e-4871-9af2-99da2060cedf" region = 2fd354f0-174e-4871-9af2-99da2060cedf
782025-02-24T21:56:09.162ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57988 req_id = 98076859-b269-43e4-819d-97e9143d8fca response_code = 200 uri = /crucible/0/regions/2fd354f0-174e-4871-9af2-99da2060cedf
792025-02-24T21:56:09.271ZINFOcrucible-agent (datafile): region 2fd354f0-174e-4871-9af2-99da2060cedf state: Tombstoned -> Destroyed
802025-02-24T21:56:09.296ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57988 req_id = abd4c7e0-064a-43c7-9d78-7319de730b85 response_code = 200 uri = /crucible/0/regions/2fd354f0-174e-4871-9af2-99da2060cedf