Max level shown:
12025-03-25T01:30:39.284ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:58265
22025-03-25T01:30:39.329ZINFOcrucible-agent (datafile): region 15349717-0eda-45a7-818d-7b5344f61c54 state: Requested
32025-03-25T01:30:39.334ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-03-25T01:30:39.334ZINFOcrucible-agent (dropshot): request completed latency_us = 23048 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58265 req_id = c93ea460-b8bd-428e-a0a6-81e8830b7997 response_code = 200 uri = /crucible/0/regions
52025-03-25T01:30:39.344ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_96356b02-ed5e-43cc-9ce9-8746b327b41f/crucible/regions/15349717-0eda-45a7-818d-7b5344f61c54
62025-03-25T01:30:39.344ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_96356b02-ed5e-43cc-9ce9-8746b327b41f/crucible/regions/15349717-0eda-45a7-818d-7b5344f61c54
72025-03-25T01:30:39.396ZINFOcrucible-agent (worker): creating region Region { id: RegionId("15349717-0eda-45a7-818d-7b5344f61c54"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/15349717-0eda-45a7-818d-7b5344f61c54" region = 15349717-0eda-45a7-818d-7b5344f61c54
82025-03-25T01:30:39.396ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "15349717-0eda-45a7-818d-7b5344f61c54" "--data" "/data/regions/15349717-0eda-45a7-818d-7b5344f61c54" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 15349717-0eda-45a7-818d-7b5344f61c54
92025-03-25T01:30:39.701ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58265 req_id = ea0de13b-6e77-4142-8ee0-53e72f0e0d3e response_code = 200 uri = /crucible/0/regions
102025-03-25T01:30:39.751ZINFOcrucible-agent (worker): region files created ok region = 15349717-0eda-45a7-818d-7b5344f61c54
112025-03-25T01:30:39.751ZINFOcrucible-agent (datafile): region 15349717-0eda-45a7-818d-7b5344f61c54 state: Requested -> Created
122025-03-25T01:30:39.751ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-03-25T01:30:39.752ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-15349717-0eda-45a7-818d-7b5344f61c54
142025-03-25T01:30:39.759ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-15349717-0eda-45a7-818d-7b5344f61c54
152025-03-25T01:30:39.777ZINFOcrucible-agent (worker): creating config property group
162025-03-25T01:30:39.782ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-15349717-0eda-45a7-818d-7b5344f61c54
172025-03-25T01:30:39.783ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/15349717-0eda-45a7-818d-7b5344f61c54
182025-03-25T01:30:39.783ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-03-25T01:30:39.783ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202025-03-25T01:30:39.783ZINFOcrucible-agent (worker): commit
212025-03-25T01:30:39.792ZINFOcrucible-agent (worker): ok!
222025-03-25T01:30:39.811ZINFOcrucible-agent (worker): SMF ok!
232025-03-25T01:30:40.319ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58265 req_id = e5f4d6f3-fd7d-402e-ba90-2684ebc94f3e response_code = 200 uri = /crucible/0/regions
242025-03-25T01:30:45.595ZINFOcrucible-agent (datafile): region 216dd0ad-7d05-40a1-8e37-866eaa102483 state: Requested
252025-03-25T01:30:45.595ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-03-25T01:30:45.595ZINFOcrucible-agent (dropshot): request completed latency_us = 253 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58265 req_id = 5ff48f34-ee5c-43ce-91bf-1c812c6a1ee9 response_code = 200 uri = /crucible/0/regions
272025-03-25T01:30:45.604ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_96356b02-ed5e-43cc-9ce9-8746b327b41f/crucible/regions/216dd0ad-7d05-40a1-8e37-866eaa102483
282025-03-25T01:30:45.604ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_96356b02-ed5e-43cc-9ce9-8746b327b41f/crucible/regions/216dd0ad-7d05-40a1-8e37-866eaa102483
292025-03-25T01:30:45.660ZINFOcrucible-agent (worker): creating region Region { id: RegionId("216dd0ad-7d05-40a1-8e37-866eaa102483"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/216dd0ad-7d05-40a1-8e37-866eaa102483" region = 216dd0ad-7d05-40a1-8e37-866eaa102483
302025-03-25T01:30:45.662ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "216dd0ad-7d05-40a1-8e37-866eaa102483" "--data" "/data/regions/216dd0ad-7d05-40a1-8e37-866eaa102483" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 216dd0ad-7d05-40a1-8e37-866eaa102483
312025-03-25T01:30:45.789ZINFOcrucible-agent (worker): region files created ok region = 216dd0ad-7d05-40a1-8e37-866eaa102483
322025-03-25T01:30:45.789ZINFOcrucible-agent (datafile): region 216dd0ad-7d05-40a1-8e37-866eaa102483 state: Requested -> Created
332025-03-25T01:30:45.789ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-03-25T01:30:45.791ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-216dd0ad-7d05-40a1-8e37-866eaa102483
352025-03-25T01:30:45.797ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-216dd0ad-7d05-40a1-8e37-866eaa102483
362025-03-25T01:30:45.809ZINFOcrucible-agent (worker): creating config property group
372025-03-25T01:30:45.815ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-216dd0ad-7d05-40a1-8e37-866eaa102483
382025-03-25T01:30:45.815ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/216dd0ad-7d05-40a1-8e37-866eaa102483
392025-03-25T01:30:45.815ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-03-25T01:30:45.815ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
412025-03-25T01:30:45.815ZINFOcrucible-agent (worker): commit
422025-03-25T01:30:45.821ZINFOcrucible-agent (worker): ok!
432025-03-25T01:30:45.828ZINFOcrucible-agent (worker): SMF ok!
442025-03-25T01:30:45.927ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58265 req_id = 0c20a8fc-ee08-4824-9bd7-da8d36a31882 response_code = 200 uri = /crucible/0/regions
452025-03-25T01:31:11.270ZINFOcrucible-agent (dropshot): request completed latency_us = 2508 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58265 req_id = 49b91afb-e143-46b7-9cda-01a486230cb6 response_code = 200 uri = /crucible/0/regions/216dd0ad-7d05-40a1-8e37-866eaa102483
462025-03-25T01:31:11.272ZINFOcrucible-agent (datafile): path is "/data/regions/216dd0ad-7d05-40a1-8e37-866eaa102483"
472025-03-25T01:31:11.284ZINFOcrucible-agent (datafile): dataset is oxp_96356b02-ed5e-43cc-9ce9-8746b327b41f/crucible/regions/216dd0ad-7d05-40a1-8e37-866eaa102483
482025-03-25T01:31:11.294ZINFOcrucible-agent (datafile): region 216dd0ad-7d05-40a1-8e37-866eaa102483 state: Created -> Tombstoned
492025-03-25T01:31:11.294ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-03-25T01:31:11.294ZINFOcrucible-agent (dropshot): request completed latency_us = 22103 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:58265 req_id = b9bd6afb-5c63-4d69-a5a9-a698132dd819 response_code = 204 uri = /crucible/0/regions/216dd0ad-7d05-40a1-8e37-866eaa102483
512025-03-25T01:31:11.296ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-216dd0ad-7d05-40a1-8e37-866eaa102483 (instance states: (Some(Online), None))
522025-03-25T01:31:11.298ZINFOcrucible-agent (dropshot): request completed latency_us = 623 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58265 req_id = e2f77af0-97ac-4bc4-a63f-93929c2a4d7b response_code = 200 uri = /crucible/0/regions/216dd0ad-7d05-40a1-8e37-866eaa102483
532025-03-25T01:31:11.302ZINFOcrucible-agent (worker): SMF ok!
542025-03-25T01:31:11.313ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_96356b02-ed5e-43cc-9ce9-8746b327b41f/crucible/regions/216dd0ad-7d05-40a1-8e37-866eaa102483" region = 216dd0ad-7d05-40a1-8e37-866eaa102483
552025-03-25T01:31:11.356ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58265 req_id = 459d9c7f-3d47-40ae-9365-a0b7b2744e8f response_code = 200 uri = /crucible/0/regions/216dd0ad-7d05-40a1-8e37-866eaa102483
562025-03-25T01:31:11.370ZINFOcrucible-agent (datafile): region 216dd0ad-7d05-40a1-8e37-866eaa102483 state: Tombstoned -> Destroyed
572025-03-25T01:31:11.539ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58265 req_id = 28b9a7ad-562b-422f-b9b5-653ed4187424 response_code = 200 uri = /crucible/0/regions/216dd0ad-7d05-40a1-8e37-866eaa102483