Max level shown:
12026-01-05T19:19:07.663ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:54996
22026-01-05T19:19:07.712ZINFOcrucible-agent (datafile): region 50f5c925-002b-462f-9c28-d7b73b424013 state: Requested
32026-01-05T19:19:07.716ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-05T19:19:07.716ZINFOcrucible-agent (dropshot): request completed latency_us = 22638 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54996 req_id = 35cdce00-c340-4d5e-a3a0-0128b0b50ccf response_code = 200 uri = /crucible/0/regions
52026-01-05T19:19:07.728ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7fb62588-1c1e-452f-9918-84f1f6b7aabc/crucible/regions/50f5c925-002b-462f-9c28-d7b73b424013
62026-01-05T19:19:07.728ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7fb62588-1c1e-452f-9918-84f1f6b7aabc/crucible/regions/50f5c925-002b-462f-9c28-d7b73b424013
72026-01-05T19:19:07.781ZINFOcrucible-agent (worker): creating region Region { id: RegionId("50f5c925-002b-462f-9c28-d7b73b424013"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/50f5c925-002b-462f-9c28-d7b73b424013" region = 50f5c925-002b-462f-9c28-d7b73b424013
82026-01-05T19:19:07.784ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "50f5c925-002b-462f-9c28-d7b73b424013" "--data" "/data/regions/50f5c925-002b-462f-9c28-d7b73b424013" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 50f5c925-002b-462f-9c28-d7b73b424013
92026-01-05T19:19:08.031ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54996 req_id = ceaca995-15a9-41d0-82fb-327346074c1e response_code = 200 uri = /crucible/0/regions
102026-01-05T19:19:08.154ZINFOcrucible-agent (worker): region files created ok region = 50f5c925-002b-462f-9c28-d7b73b424013
112026-01-05T19:19:08.154ZINFOcrucible-agent (datafile): region 50f5c925-002b-462f-9c28-d7b73b424013 state: Requested -> Created
122026-01-05T19:19:08.154ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-05T19:19:08.154ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-50f5c925-002b-462f-9c28-d7b73b424013
142026-01-05T19:19:08.167ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-50f5c925-002b-462f-9c28-d7b73b424013
152026-01-05T19:19:08.188ZINFOcrucible-agent (worker): creating config property group
162026-01-05T19:19:08.191ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-50f5c925-002b-462f-9c28-d7b73b424013
172026-01-05T19:19:08.194ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/50f5c925-002b-462f-9c28-d7b73b424013
182026-01-05T19:19:08.194ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-01-05T19:19:08.194ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-01-05T19:19:08.194ZINFOcrucible-agent (worker): commit
212026-01-05T19:19:08.198ZINFOcrucible-agent (worker): ok!
222026-01-05T19:19:08.219ZINFOcrucible-agent (worker): SMF ok!
232026-01-05T19:19:08.354ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54996 req_id = 40b484a0-6ec1-45ad-88f2-cff4170e5e71 response_code = 200 uri = /crucible/0/regions
242026-01-05T19:19:14.365ZINFOcrucible-agent (datafile): region 1d375bfa-aa14-4965-8c6b-0e9ecf456432 state: Requested
252026-01-05T19:19:14.365ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-01-05T19:19:14.365ZINFOcrucible-agent (dropshot): request completed latency_us = 220 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54996 req_id = 01abadd3-5a2f-4f6e-86c2-30cdcc0de7f4 response_code = 200 uri = /crucible/0/regions
272026-01-05T19:19:14.372ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7fb62588-1c1e-452f-9918-84f1f6b7aabc/crucible/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432
282026-01-05T19:19:14.372ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7fb62588-1c1e-452f-9918-84f1f6b7aabc/crucible/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432
292026-01-05T19:19:14.435ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1d375bfa-aa14-4965-8c6b-0e9ecf456432"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432" region = 1d375bfa-aa14-4965-8c6b-0e9ecf456432
302026-01-05T19:19:14.435ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1d375bfa-aa14-4965-8c6b-0e9ecf456432" "--data" "/data/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1d375bfa-aa14-4965-8c6b-0e9ecf456432
312026-01-05T19:19:14.513ZINFOcrucible-agent (worker): region files created ok region = 1d375bfa-aa14-4965-8c6b-0e9ecf456432
322026-01-05T19:19:14.513ZINFOcrucible-agent (datafile): region 1d375bfa-aa14-4965-8c6b-0e9ecf456432 state: Requested -> Created
332026-01-05T19:19:14.513ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-01-05T19:19:14.513ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1d375bfa-aa14-4965-8c6b-0e9ecf456432
352026-01-05T19:19:14.516ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1d375bfa-aa14-4965-8c6b-0e9ecf456432
362026-01-05T19:19:14.523ZINFOcrucible-agent (worker): creating config property group
372026-01-05T19:19:14.527ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1d375bfa-aa14-4965-8c6b-0e9ecf456432
382026-01-05T19:19:14.527ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432
392026-01-05T19:19:14.527ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-01-05T19:19:14.527ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412026-01-05T19:19:14.527ZINFOcrucible-agent (worker): commit
422026-01-05T19:19:14.531ZINFOcrucible-agent (worker): ok!
432026-01-05T19:19:14.542ZINFOcrucible-agent (worker): SMF ok!
442026-01-05T19:19:14.546ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:54996 req_id = efd92caf-a3dd-4525-ba01-ecf5effa5f31 response_code = 200 uri = /crucible/0/regions
452026-01-05T19:19:41.720ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54996 req_id = cd7346cf-0d8b-43de-860e-3316bb96068e response_code = 200 uri = /crucible/0/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432
462026-01-05T19:19:41.723ZINFOcrucible-agent (datafile): path is "/data/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432"
472026-01-05T19:19:41.734ZINFOcrucible-agent (datafile): dataset is oxp_7fb62588-1c1e-452f-9918-84f1f6b7aabc/crucible/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432
482026-01-05T19:19:41.741ZINFOcrucible-agent (datafile): region 1d375bfa-aa14-4965-8c6b-0e9ecf456432 state: Created -> Tombstoned
492026-01-05T19:19:41.742ZINFOcrucible-agent (dropshot): request completed latency_us = 18549 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:54996 req_id = 0aaba043-4c49-4af4-9478-5d3bbbbf369d response_code = 204 uri = /crucible/0/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432
502026-01-05T19:19:41.742ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-01-05T19:19:41.743ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-1d375bfa-aa14-4965-8c6b-0e9ecf456432 (instance states: (Some(Online), None))
522026-01-05T19:19:41.745ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54996 req_id = 7652f2d6-05da-4190-a2cb-c307605ec0d8 response_code = 200 uri = /crucible/0/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432
532026-01-05T19:19:41.757ZINFOcrucible-agent (worker): SMF ok!
542026-01-05T19:19:41.764ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_7fb62588-1c1e-452f-9918-84f1f6b7aabc/crucible/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432" region = 1d375bfa-aa14-4965-8c6b-0e9ecf456432
552026-01-05T19:19:41.809ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54996 req_id = fde5b96a-b39d-4b5a-995f-263a0fc4ab75 response_code = 200 uri = /crucible/0/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432
562026-01-05T19:19:41.832ZINFOcrucible-agent (datafile): region 1d375bfa-aa14-4965-8c6b-0e9ecf456432 state: Tombstoned -> Destroyed
572026-01-05T19:19:41.986ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:54996 req_id = 1acc2c1d-3399-4d9e-98e9-d917be0b983b response_code = 200 uri = /crucible/0/regions/1d375bfa-aa14-4965-8c6b-0e9ecf456432