Max level shown:
12026-03-24T15:09:50.938ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:36094
22026-03-24T15:09:50.938ZINFOcrucible-agent (datafile): region 98b2da03-97ed-41b0-8214-75d216cc7426 state: Requested
32026-03-24T15:09:50.939ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-24T15:09:50.939ZINFOcrucible-agent (dropshot): request completed latency_us = 704 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36094 req_id = 360ec654-6333-4564-9b29-81701c2bbc79 response_code = 200 uri = /crucible/0/regions
52026-03-24T15:09:50.949ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1d984a29-960e-4d3b-aa86-3f4f1d8a0de8/crucible/regions/98b2da03-97ed-41b0-8214-75d216cc7426
62026-03-24T15:09:50.949ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1d984a29-960e-4d3b-aa86-3f4f1d8a0de8/crucible/regions/98b2da03-97ed-41b0-8214-75d216cc7426
72026-03-24T15:09:51.010ZINFOcrucible-agent (worker): creating region Region { id: RegionId("98b2da03-97ed-41b0-8214-75d216cc7426"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/98b2da03-97ed-41b0-8214-75d216cc7426" region = 98b2da03-97ed-41b0-8214-75d216cc7426
82026-03-24T15:09:51.010ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "98b2da03-97ed-41b0-8214-75d216cc7426" "--data" "/data/regions/98b2da03-97ed-41b0-8214-75d216cc7426" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 98b2da03-97ed-41b0-8214-75d216cc7426
92026-03-24T15:09:51.094ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36094 req_id = fd088181-e030-4264-9318-2d92e8de486f response_code = 200 uri = /crucible/0/regions
102026-03-24T15:09:51.102ZINFOcrucible-agent (worker): region files created ok region = 98b2da03-97ed-41b0-8214-75d216cc7426
112026-03-24T15:09:51.102ZINFOcrucible-agent (datafile): region 98b2da03-97ed-41b0-8214-75d216cc7426 state: Requested -> Created
122026-03-24T15:09:51.102ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-24T15:09:51.103ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-98b2da03-97ed-41b0-8214-75d216cc7426
142026-03-24T15:09:51.113ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-98b2da03-97ed-41b0-8214-75d216cc7426
152026-03-24T15:09:51.136ZINFOcrucible-agent (worker): creating config property group
162026-03-24T15:09:51.139ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-98b2da03-97ed-41b0-8214-75d216cc7426
172026-03-24T15:09:51.139ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/98b2da03-97ed-41b0-8214-75d216cc7426
182026-03-24T15:09:51.140ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-03-24T15:09:51.140ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202026-03-24T15:09:51.140ZINFOcrucible-agent (worker): commit
212026-03-24T15:09:51.143ZINFOcrucible-agent (worker): ok!
222026-03-24T15:09:51.147ZINFOcrucible-agent (worker): SMF ok!
232026-03-24T15:09:51.485ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36094 req_id = e8d8796d-c48d-4d20-9ae4-f3f210c50878 response_code = 200 uri = /crucible/0/regions
242026-03-24T15:09:56.891ZINFOcrucible-agent (datafile): region 54d19741-d153-4962-af8d-e0343d47e443 state: Requested
252026-03-24T15:09:56.891ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-03-24T15:09:56.891ZINFOcrucible-agent (dropshot): request completed latency_us = 207 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36094 req_id = 479e6522-ad89-4fb6-87bd-011a503e889e response_code = 200 uri = /crucible/0/regions
272026-03-24T15:09:56.898ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1d984a29-960e-4d3b-aa86-3f4f1d8a0de8/crucible/regions/54d19741-d153-4962-af8d-e0343d47e443
282026-03-24T15:09:56.898ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1d984a29-960e-4d3b-aa86-3f4f1d8a0de8/crucible/regions/54d19741-d153-4962-af8d-e0343d47e443
292026-03-24T15:09:56.941ZINFOcrucible-agent (worker): creating region Region { id: RegionId("54d19741-d153-4962-af8d-e0343d47e443"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/54d19741-d153-4962-af8d-e0343d47e443" region = 54d19741-d153-4962-af8d-e0343d47e443
302026-03-24T15:09:56.941ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "54d19741-d153-4962-af8d-e0343d47e443" "--data" "/data/regions/54d19741-d153-4962-af8d-e0343d47e443" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 54d19741-d153-4962-af8d-e0343d47e443
312026-03-24T15:09:57.014ZINFOcrucible-agent (worker): region files created ok region = 54d19741-d153-4962-af8d-e0343d47e443
322026-03-24T15:09:57.014ZINFOcrucible-agent (datafile): region 54d19741-d153-4962-af8d-e0343d47e443 state: Requested -> Created
332026-03-24T15:09:57.014ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-03-24T15:09:57.015ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-54d19741-d153-4962-af8d-e0343d47e443
352026-03-24T15:09:57.023ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-54d19741-d153-4962-af8d-e0343d47e443
362026-03-24T15:09:57.030ZINFOcrucible-agent (worker): creating config property group
372026-03-24T15:09:57.034ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-54d19741-d153-4962-af8d-e0343d47e443
382026-03-24T15:09:57.034ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/54d19741-d153-4962-af8d-e0343d47e443
392026-03-24T15:09:57.034ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-03-24T15:09:57.034ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
412026-03-24T15:09:57.034ZINFOcrucible-agent (worker): commit
422026-03-24T15:09:57.038ZINFOcrucible-agent (worker): ok!
432026-03-24T15:09:57.047ZINFOcrucible-agent (worker): SMF ok!
442026-03-24T15:09:57.087ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36094 req_id = d6acda33-5792-4d7e-b7b6-76ae7a28ca64 response_code = 200 uri = /crucible/0/regions
452026-03-24T15:10:22.778ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36094 req_id = f95b25c3-2c7b-49cb-97f9-3cb6103cd48c response_code = 200 uri = /crucible/0/regions/54d19741-d153-4962-af8d-e0343d47e443
462026-03-24T15:10:22.782ZINFOcrucible-agent (datafile): path is "/data/regions/54d19741-d153-4962-af8d-e0343d47e443"
472026-03-24T15:10:22.792ZINFOcrucible-agent (datafile): dataset is oxp_1d984a29-960e-4d3b-aa86-3f4f1d8a0de8/crucible/regions/54d19741-d153-4962-af8d-e0343d47e443
482026-03-24T15:10:22.799ZINFOcrucible-agent (datafile): region 54d19741-d153-4962-af8d-e0343d47e443 state: Created -> Tombstoned
492026-03-24T15:10:22.799ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-03-24T15:10:22.799ZINFOcrucible-agent (dropshot): request completed latency_us = 17257 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:36094 req_id = 365dcc69-80a3-4224-a695-1b5785bef693 response_code = 204 uri = /crucible/0/regions/54d19741-d153-4962-af8d-e0343d47e443
512026-03-24T15:10:22.800ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-54d19741-d153-4962-af8d-e0343d47e443 (instance states: (Some(Online), None))
522026-03-24T15:10:22.803ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36094 req_id = 080d220b-245d-4ae4-8f5d-1f60ef1aa3c0 response_code = 200 uri = /crucible/0/regions/54d19741-d153-4962-af8d-e0343d47e443
532026-03-24T15:10:22.815ZINFOcrucible-agent (worker): SMF ok!
542026-03-24T15:10:22.822ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1d984a29-960e-4d3b-aa86-3f4f1d8a0de8/crucible/regions/54d19741-d153-4962-af8d-e0343d47e443" region = 54d19741-d153-4962-af8d-e0343d47e443
552026-03-24T15:10:22.872ZINFOcrucible-agent (datafile): region 54d19741-d153-4962-af8d-e0343d47e443 state: Tombstoned -> Destroyed
562026-03-24T15:10:22.955ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36094 req_id = 7ebf32a1-56e4-48bb-a123-8ec290c344ae response_code = 200 uri = /crucible/0/regions/54d19741-d153-4962-af8d-e0343d47e443