Max level shown:
12026-03-24T15:38:12.939ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:57503
22026-03-24T15:38:12.939ZINFOcrucible-agent (datafile): region 35b96206-4934-4dc2-b1bb-6c4ae57eb943 state: Requested
32026-03-24T15:38:12.940ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-24T15:38:12.940ZINFOcrucible-agent (dropshot): request completed latency_us = 753 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57503 req_id = 79badc41-9a9a-4781-bc8c-dfea2b7fee71 response_code = 200 uri = /crucible/0/regions
52026-03-24T15:38:12.948ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b9833686-06aa-48ba-bf6b-b30bc48ba0d9/crucible/regions/35b96206-4934-4dc2-b1bb-6c4ae57eb943
62026-03-24T15:38:12.948ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b9833686-06aa-48ba-bf6b-b30bc48ba0d9/crucible/regions/35b96206-4934-4dc2-b1bb-6c4ae57eb943
72026-03-24T15:38:13.007ZINFOcrucible-agent (worker): creating region Region { id: RegionId("35b96206-4934-4dc2-b1bb-6c4ae57eb943"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/35b96206-4934-4dc2-b1bb-6c4ae57eb943" region = 35b96206-4934-4dc2-b1bb-6c4ae57eb943
82026-03-24T15:38:13.007ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "35b96206-4934-4dc2-b1bb-6c4ae57eb943" "--data" "/data/regions/35b96206-4934-4dc2-b1bb-6c4ae57eb943" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 35b96206-4934-4dc2-b1bb-6c4ae57eb943
92026-03-24T15:38:13.080ZINFOcrucible-agent (worker): region files created ok region = 35b96206-4934-4dc2-b1bb-6c4ae57eb943
102026-03-24T15:38:13.080ZINFOcrucible-agent (datafile): region 35b96206-4934-4dc2-b1bb-6c4ae57eb943 state: Requested -> Created
112026-03-24T15:38:13.080ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-03-24T15:38:13.081ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-35b96206-4934-4dc2-b1bb-6c4ae57eb943
132026-03-24T15:38:13.090ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-35b96206-4934-4dc2-b1bb-6c4ae57eb943
142026-03-24T15:38:13.111ZINFOcrucible-agent (worker): creating config property group
152026-03-24T15:38:13.113ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-35b96206-4934-4dc2-b1bb-6c4ae57eb943
162026-03-24T15:38:13.114ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/35b96206-4934-4dc2-b1bb-6c4ae57eb943
172026-03-24T15:38:13.114ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-03-24T15:38:13.114ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192026-03-24T15:38:13.114ZINFOcrucible-agent (worker): commit
202026-03-24T15:38:13.117ZINFOcrucible-agent (worker): ok!
212026-03-24T15:38:13.122ZINFOcrucible-agent (worker): SMF ok!
222026-03-24T15:38:13.159ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57503 req_id = 2cbfdeac-66e5-442f-b7c8-bd235ede1773 response_code = 200 uri = /crucible/0/regions
232026-03-24T15:38:19.412ZINFOcrucible-agent (datafile): region f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3 state: Requested
242026-03-24T15:38:19.412ZINFOcrucible-agent (dropshot): request completed latency_us = 277 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57503 req_id = 20ad88f3-a20c-49fb-aed2-80234d25269f response_code = 200 uri = /crucible/0/regions
252026-03-24T15:38:19.412ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-03-24T15:38:19.418ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b9833686-06aa-48ba-bf6b-b30bc48ba0d9/crucible/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
272026-03-24T15:38:19.418ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b9833686-06aa-48ba-bf6b-b30bc48ba0d9/crucible/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
282026-03-24T15:38:19.465ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3" region = f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
292026-03-24T15:38:19.465ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3" "--data" "/data/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
302026-03-24T15:38:19.549ZINFOcrucible-agent (worker): region files created ok region = f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
312026-03-24T15:38:19.549ZINFOcrucible-agent (datafile): region f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3 state: Requested -> Created
322026-03-24T15:38:19.549ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-03-24T15:38:19.554ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
342026-03-24T15:38:19.563ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
352026-03-24T15:38:19.570ZINFOcrucible-agent (worker): creating config property group
362026-03-24T15:38:19.573ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
372026-03-24T15:38:19.573ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
382026-03-24T15:38:19.573ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-03-24T15:38:19.573ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
402026-03-24T15:38:19.573ZINFOcrucible-agent (worker): commit
412026-03-24T15:38:19.577ZINFOcrucible-agent (worker): ok!
422026-03-24T15:38:19.581ZINFOcrucible-agent (worker): SMF ok!
432026-03-24T15:38:19.699ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57503 req_id = 9b0b6e7e-08dd-42c0-9ff5-b28e03611ee3 response_code = 200 uri = /crucible/0/regions
442026-03-24T15:38:45.658ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57503 req_id = ec4157ba-bdf3-4a56-85d7-061dbe3a7c05 response_code = 200 uri = /crucible/0/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
452026-03-24T15:38:45.661ZINFOcrucible-agent (datafile): path is "/data/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3"
462026-03-24T15:38:45.672ZINFOcrucible-agent (datafile): dataset is oxp_b9833686-06aa-48ba-bf6b-b30bc48ba0d9/crucible/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
472026-03-24T15:38:45.679ZINFOcrucible-agent (datafile): region f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3 state: Created -> Tombstoned
482026-03-24T15:38:45.680ZINFOcrucible-agent (dropshot): request completed latency_us = 19142 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:57503 req_id = 3c01a925-b993-4eda-a6ca-f490f74900e2 response_code = 204 uri = /crucible/0/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
492026-03-24T15:38:45.680ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-03-24T15:38:45.681ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3 (instance states: (Some(Online), None))
512026-03-24T15:38:45.683ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57503 req_id = 302ef5e6-3333-4713-b160-e0186237db8b response_code = 200 uri = /crucible/0/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
522026-03-24T15:38:45.691ZINFOcrucible-agent (worker): SMF ok!
532026-03-24T15:38:45.700ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b9833686-06aa-48ba-bf6b-b30bc48ba0d9/crucible/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3" region = f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
542026-03-24T15:38:45.743ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57503 req_id = 6910bad7-5466-45d1-a18d-9da2cd285d26 response_code = 200 uri = /crucible/0/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3
552026-03-24T15:38:45.758ZINFOcrucible-agent (datafile): region f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3 state: Tombstoned -> Destroyed
562026-03-24T15:38:45.911ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57503 req_id = 93934f23-e3c1-42bd-af87-2bccd2fdde98 response_code = 200 uri = /crucible/0/regions/f3bf3848-0ce4-4eaf-8dc0-0d3add43d3b3