Max level shown:
12025-12-24T00:41:36.910ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:56031
22025-12-24T00:41:36.967ZINFOcrucible-agent (datafile): region 932493b0-75df-48c3-a086-22940e5f715f state: Requested
32025-12-24T00:41:36.971ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-24T00:41:36.971ZINFOcrucible-agent (dropshot): request completed latency_us = 26105 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56031 req_id = 7609a751-6ae3-447e-8a7b-f031279713f9 response_code = 200 uri = /crucible/0/regions
52025-12-24T00:41:36.984ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_136efa7f-ebeb-4fa1-baa7-fc08ebbe6ad7/crucible/regions/932493b0-75df-48c3-a086-22940e5f715f
62025-12-24T00:41:36.985ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_136efa7f-ebeb-4fa1-baa7-fc08ebbe6ad7/crucible/regions/932493b0-75df-48c3-a086-22940e5f715f
72025-12-24T00:41:37.042ZINFOcrucible-agent (worker): creating region Region { id: RegionId("932493b0-75df-48c3-a086-22940e5f715f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/932493b0-75df-48c3-a086-22940e5f715f" region = 932493b0-75df-48c3-a086-22940e5f715f
82025-12-24T00:41:37.045ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "932493b0-75df-48c3-a086-22940e5f715f" "--data" "/data/regions/932493b0-75df-48c3-a086-22940e5f715f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 932493b0-75df-48c3-a086-22940e5f715f
92025-12-24T00:41:37.188ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56031 req_id = 535b6bb1-6c9a-4a94-8286-7a6b44e98b16 response_code = 200 uri = /crucible/0/regions
102025-12-24T00:41:37.406ZINFOcrucible-agent (worker): region files created ok region = 932493b0-75df-48c3-a086-22940e5f715f
112025-12-24T00:41:37.406ZINFOcrucible-agent (datafile): region 932493b0-75df-48c3-a086-22940e5f715f state: Requested -> Created
122025-12-24T00:41:37.406ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-24T00:41:37.406ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-932493b0-75df-48c3-a086-22940e5f715f
142025-12-24T00:41:37.419ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-932493b0-75df-48c3-a086-22940e5f715f
152025-12-24T00:41:37.441ZINFOcrucible-agent (worker): creating config property group
162025-12-24T00:41:37.444ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-932493b0-75df-48c3-a086-22940e5f715f
172025-12-24T00:41:37.445ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/932493b0-75df-48c3-a086-22940e5f715f
182025-12-24T00:41:37.445ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-24T00:41:37.445ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202025-12-24T00:41:37.445ZINFOcrucible-agent (worker): commit
212025-12-24T00:41:37.449ZINFOcrucible-agent (worker): ok!
222025-12-24T00:41:37.454ZINFOcrucible-agent (worker): SMF ok!
232025-12-24T00:41:37.767ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56031 req_id = 9f96c2df-79f3-4080-b5e8-74a3f6e7ef5f response_code = 200 uri = /crucible/0/regions
242025-12-24T00:41:44.853ZINFOcrucible-agent (datafile): region 88c8f296-6a2b-48b1-8531-d4178b45469f state: Requested
252025-12-24T00:41:44.853ZINFOcrucible-agent (dropshot): request completed latency_us = 250 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56031 req_id = b6c77107-665f-4e1a-b404-bb36952fd931 response_code = 200 uri = /crucible/0/regions
262025-12-24T00:41:44.853ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-12-24T00:41:44.860ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_136efa7f-ebeb-4fa1-baa7-fc08ebbe6ad7/crucible/regions/88c8f296-6a2b-48b1-8531-d4178b45469f
282025-12-24T00:41:44.860ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_136efa7f-ebeb-4fa1-baa7-fc08ebbe6ad7/crucible/regions/88c8f296-6a2b-48b1-8531-d4178b45469f
292025-12-24T00:41:44.913ZINFOcrucible-agent (worker): creating region Region { id: RegionId("88c8f296-6a2b-48b1-8531-d4178b45469f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/88c8f296-6a2b-48b1-8531-d4178b45469f" region = 88c8f296-6a2b-48b1-8531-d4178b45469f
302025-12-24T00:41:44.913ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "88c8f296-6a2b-48b1-8531-d4178b45469f" "--data" "/data/regions/88c8f296-6a2b-48b1-8531-d4178b45469f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 88c8f296-6a2b-48b1-8531-d4178b45469f
312025-12-24T00:41:44.994ZINFOcrucible-agent (worker): region files created ok region = 88c8f296-6a2b-48b1-8531-d4178b45469f
322025-12-24T00:41:44.994ZINFOcrucible-agent (datafile): region 88c8f296-6a2b-48b1-8531-d4178b45469f state: Requested -> Created
332025-12-24T00:41:44.994ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-12-24T00:41:44.994ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-88c8f296-6a2b-48b1-8531-d4178b45469f
352025-12-24T00:41:44.997ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-88c8f296-6a2b-48b1-8531-d4178b45469f
362025-12-24T00:41:45.006ZINFOcrucible-agent (worker): creating config property group
372025-12-24T00:41:45.009ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-88c8f296-6a2b-48b1-8531-d4178b45469f
382025-12-24T00:41:45.009ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/88c8f296-6a2b-48b1-8531-d4178b45469f
392025-12-24T00:41:45.009ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-12-24T00:41:45.009ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
412025-12-24T00:41:45.009ZINFOcrucible-agent (worker): commit
422025-12-24T00:41:45.013ZINFOcrucible-agent (worker): ok!
432025-12-24T00:41:45.025ZINFOcrucible-agent (worker): SMF ok!
442025-12-24T00:41:45.178ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:56031 req_id = 37852025-7a79-4001-a7fe-910a0433072e response_code = 200 uri = /crucible/0/regions
452025-12-24T00:42:12.126ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:56031 req_id = 589af470-9f21-4863-bd02-4b3cd3611df5 response_code = 200 uri = /crucible/0/regions/88c8f296-6a2b-48b1-8531-d4178b45469f
462025-12-24T00:42:12.129ZINFOcrucible-agent (datafile): path is "/data/regions/88c8f296-6a2b-48b1-8531-d4178b45469f"
472025-12-24T00:42:12.139ZINFOcrucible-agent (datafile): dataset is oxp_136efa7f-ebeb-4fa1-baa7-fc08ebbe6ad7/crucible/regions/88c8f296-6a2b-48b1-8531-d4178b45469f
482025-12-24T00:42:12.146ZINFOcrucible-agent (datafile): region 88c8f296-6a2b-48b1-8531-d4178b45469f state: Created -> Tombstoned
492025-12-24T00:42:12.147ZINFOcrucible-agent (dropshot): request completed latency_us = 17964 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:56031 req_id = a221c423-985e-42c1-8d27-4192eac2ff81 response_code = 204 uri = /crucible/0/regions/88c8f296-6a2b-48b1-8531-d4178b45469f
502025-12-24T00:42:12.147ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-12-24T00:42:12.147ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-88c8f296-6a2b-48b1-8531-d4178b45469f (instance states: (Some(Online), None))
522025-12-24T00:42:12.149ZINFOcrucible-agent (dropshot): request completed latency_us = 41 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:56031 req_id = b5541fa9-e840-4570-8086-ac69a400dc8f response_code = 200 uri = /crucible/0/regions/88c8f296-6a2b-48b1-8531-d4178b45469f
532025-12-24T00:42:12.160ZINFOcrucible-agent (worker): SMF ok!
542025-12-24T00:42:12.168ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_136efa7f-ebeb-4fa1-baa7-fc08ebbe6ad7/crucible/regions/88c8f296-6a2b-48b1-8531-d4178b45469f" region = 88c8f296-6a2b-48b1-8531-d4178b45469f
552025-12-24T00:42:12.216ZINFOcrucible-agent (datafile): region 88c8f296-6a2b-48b1-8531-d4178b45469f state: Tombstoned -> Destroyed
562025-12-24T00:42:12.301ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:56031 req_id = 1eab923a-b779-44a9-a9e4-268e69364545 response_code = 200 uri = /crucible/0/regions/88c8f296-6a2b-48b1-8531-d4178b45469f