Max level shown:
12026-05-19T19:40:30.730ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:33081
22026-05-19T19:40:30.777ZINFOcrucible-agent (datafile): region e244e7f8-8af9-405b-99bd-7d98874ea3eb state: Requested
32026-05-19T19:40:30.780ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-19T19:40:30.780ZINFOcrucible-agent (dropshot): request completed latency_us = 19750 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33081 req_id = bcd60b15-fd29-4ad1-a9f4-16cbbcf650f4 response_code = 200 uri = /crucible/0/regions
52026-05-19T19:40:30.790ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4bf571ae-1ff8-4abf-882f-fbf93149ed2d/crucible/regions/e244e7f8-8af9-405b-99bd-7d98874ea3eb
62026-05-19T19:40:30.790ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4bf571ae-1ff8-4abf-882f-fbf93149ed2d/crucible/regions/e244e7f8-8af9-405b-99bd-7d98874ea3eb
72026-05-19T19:40:30.847ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e244e7f8-8af9-405b-99bd-7d98874ea3eb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e244e7f8-8af9-405b-99bd-7d98874ea3eb" region = e244e7f8-8af9-405b-99bd-7d98874ea3eb
82026-05-19T19:40:30.849ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e244e7f8-8af9-405b-99bd-7d98874ea3eb" "--data" "/data/regions/e244e7f8-8af9-405b-99bd-7d98874ea3eb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e244e7f8-8af9-405b-99bd-7d98874ea3eb
92026-05-19T19:40:30.944ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33081 req_id = 3e40ec9d-7a96-457f-ae8d-4fd21d6c1086 response_code = 200 uri = /crucible/0/regions
102026-05-19T19:40:31.108ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:33446
112026-05-19T19:40:31.108ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33446 req_id = 3f5b34dc-ba83-43a7-a9b9-7318f27232d5 response_code = 200 uri = /crucible/0/regions/e244e7f8-8af9-405b-99bd-7d98874ea3eb
122026-05-19T19:40:31.190ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:39629
132026-05-19T19:40:31.190ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39629 req_id = 6069cdf4-d1a5-4050-9ce8-630f8aea3ff7 response_code = 200 uri = /crucible/0/regions/e244e7f8-8af9-405b-99bd-7d98874ea3eb
142026-05-19T19:40:31.289ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:41378
152026-05-19T19:40:31.289ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41378 req_id = caad1d80-f198-4395-b963-0b3ef7d071b6 response_code = 200 uri = /crucible/0/regions/e244e7f8-8af9-405b-99bd-7d98874ea3eb
162026-05-19T19:40:31.316ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33081 req_id = 950a47b8-2ea8-419b-b5fc-89b20f5def5d response_code = 200 uri = /crucible/0/regions
172026-05-19T19:40:31.359ZINFOcrucible-agent (worker): region files created ok region = e244e7f8-8af9-405b-99bd-7d98874ea3eb
182026-05-19T19:40:31.359ZINFOcrucible-agent (datafile): region e244e7f8-8af9-405b-99bd-7d98874ea3eb state: Requested -> Created
192026-05-19T19:40:31.359ZINFOcrucible-agent (worker): applying SMF actions post create...
202026-05-19T19:40:31.360ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e244e7f8-8af9-405b-99bd-7d98874ea3eb
212026-05-19T19:40:31.385ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e244e7f8-8af9-405b-99bd-7d98874ea3eb
222026-05-19T19:40:31.418ZINFOcrucible-agent (worker): creating config property group
232026-05-19T19:40:31.422ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e244e7f8-8af9-405b-99bd-7d98874ea3eb
242026-05-19T19:40:31.423ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e244e7f8-8af9-405b-99bd-7d98874ea3eb
252026-05-19T19:40:31.423ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262026-05-19T19:40:31.423ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
272026-05-19T19:40:31.423ZINFOcrucible-agent (worker): commit
282026-05-19T19:40:31.428ZINFOcrucible-agent (worker): ok!
292026-05-19T19:40:31.434ZINFOcrucible-agent (worker): SMF ok!
302026-05-19T19:40:32.482ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33081 req_id = b14df119-50d8-4d7b-916a-ef56e99227ac response_code = 200 uri = /crucible/0/regions
312026-05-19T19:40:38.301ZINFOcrucible-agent (datafile): region 8ea3b66f-5152-4591-b9b1-4771f97bc706 state: Requested
322026-05-19T19:40:38.301ZINFOcrucible-agent (dropshot): request completed latency_us = 236 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33081 req_id = 003aa38d-39f3-4b36-9e5c-7dd45612d055 response_code = 200 uri = /crucible/0/regions
332026-05-19T19:40:38.301ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
342026-05-19T19:40:38.308ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4bf571ae-1ff8-4abf-882f-fbf93149ed2d/crucible/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706
352026-05-19T19:40:38.308ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4bf571ae-1ff8-4abf-882f-fbf93149ed2d/crucible/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706
362026-05-19T19:40:38.359ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8ea3b66f-5152-4591-b9b1-4771f97bc706"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706" region = 8ea3b66f-5152-4591-b9b1-4771f97bc706
372026-05-19T19:40:38.359ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8ea3b66f-5152-4591-b9b1-4771f97bc706" "--data" "/data/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8ea3b66f-5152-4591-b9b1-4771f97bc706
382026-05-19T19:40:38.433ZINFOcrucible-agent (worker): region files created ok region = 8ea3b66f-5152-4591-b9b1-4771f97bc706
392026-05-19T19:40:38.433ZINFOcrucible-agent (datafile): region 8ea3b66f-5152-4591-b9b1-4771f97bc706 state: Requested -> Created
402026-05-19T19:40:38.433ZINFOcrucible-agent (worker): applying SMF actions post create...
412026-05-19T19:40:38.434ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8ea3b66f-5152-4591-b9b1-4771f97bc706
422026-05-19T19:40:38.437ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8ea3b66f-5152-4591-b9b1-4771f97bc706
432026-05-19T19:40:38.444ZINFOcrucible-agent (worker): creating config property group
442026-05-19T19:40:38.448ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8ea3b66f-5152-4591-b9b1-4771f97bc706
452026-05-19T19:40:38.449ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706
462026-05-19T19:40:38.449ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
472026-05-19T19:40:38.449ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
482026-05-19T19:40:38.449ZINFOcrucible-agent (worker): commit
492026-05-19T19:40:38.453ZINFOcrucible-agent (worker): ok!
502026-05-19T19:40:38.463ZINFOcrucible-agent (worker): SMF ok!
512026-05-19T19:40:38.470ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33081 req_id = 7288c391-754e-4a08-bc68-5ba1c6ba24a7 response_code = 200 uri = /crucible/0/regions
522026-05-19T19:41:04.638ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33081 req_id = d53032bf-e211-4b3b-a55d-4781774d21a0 response_code = 200 uri = /crucible/0/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706
532026-05-19T19:41:04.642ZINFOcrucible-agent (datafile): path is "/data/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706"
542026-05-19T19:41:04.652ZINFOcrucible-agent (datafile): dataset is oxp_4bf571ae-1ff8-4abf-882f-fbf93149ed2d/crucible/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706
552026-05-19T19:41:04.659ZINFOcrucible-agent (datafile): region 8ea3b66f-5152-4591-b9b1-4771f97bc706 state: Created -> Tombstoned
562026-05-19T19:41:04.659ZINFOcrucible-agent (dropshot): request completed latency_us = 16792 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:33081 req_id = 2bf9dc7c-3cf2-47db-b5a2-bc2edca52d63 response_code = 204 uri = /crucible/0/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706
572026-05-19T19:41:04.659ZINFOcrucible-agent (worker): applying SMF actions before removal...
582026-05-19T19:41:04.660ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-8ea3b66f-5152-4591-b9b1-4771f97bc706 (instance states: (Some(Online), None))
592026-05-19T19:41:04.662ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33081 req_id = 29fba0e5-125d-498d-9f0b-29158ad4181f response_code = 200 uri = /crucible/0/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706
602026-05-19T19:41:04.676ZINFOcrucible-agent (worker): SMF ok!
612026-05-19T19:41:04.684ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_4bf571ae-1ff8-4abf-882f-fbf93149ed2d/crucible/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706" region = 8ea3b66f-5152-4591-b9b1-4771f97bc706
622026-05-19T19:41:04.754ZINFOcrucible-agent (datafile): region 8ea3b66f-5152-4591-b9b1-4771f97bc706 state: Tombstoned -> Destroyed
632026-05-19T19:41:04.764ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33081 req_id = fcbe87e1-243b-4aff-abd1-85d92acb1093 response_code = 200 uri = /crucible/0/regions/8ea3b66f-5152-4591-b9b1-4771f97bc706