Max level shown:
12026-05-16T01:09:43.216ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:36528
22026-05-16T01:09:43.262ZINFOcrucible-agent (datafile): region 491bcf50-409a-469d-bb84-a4e28f6226fa state: Requested
32026-05-16T01:09:43.266ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-16T01:09:43.266ZINFOcrucible-agent (dropshot): request completed latency_us = 18993 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36528 req_id = e26ccaf9-995c-4540-8615-c22a1cb2be02 response_code = 200 uri = /crucible/0/regions
52026-05-16T01:09:43.274ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0c0169f2-244f-4103-bd11-3ed8e5f72b90/crucible/regions/491bcf50-409a-469d-bb84-a4e28f6226fa
62026-05-16T01:09:43.274ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0c0169f2-244f-4103-bd11-3ed8e5f72b90/crucible/regions/491bcf50-409a-469d-bb84-a4e28f6226fa
72026-05-16T01:09:43.316ZINFOcrucible-agent (worker): creating region Region { id: RegionId("491bcf50-409a-469d-bb84-a4e28f6226fa"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/491bcf50-409a-469d-bb84-a4e28f6226fa" region = 491bcf50-409a-469d-bb84-a4e28f6226fa
82026-05-16T01:09:43.318ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "491bcf50-409a-469d-bb84-a4e28f6226fa" "--data" "/data/regions/491bcf50-409a-469d-bb84-a4e28f6226fa" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 491bcf50-409a-469d-bb84-a4e28f6226fa
92026-05-16T01:09:43.546ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:53047
102026-05-16T01:09:43.546ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53047 req_id = 3a5771df-53c6-443c-a61e-a0ad7c5d6e4b response_code = 200 uri = /crucible/0/regions/491bcf50-409a-469d-bb84-a4e28f6226fa
112026-05-16T01:09:43.626ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 1a5a7b3f-ae7e-4f26-8023-276eb5ee33f1 response_code = 200 uri = /crucible/0/regions
122026-05-16T01:09:43.716ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:33889
132026-05-16T01:09:43.716ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33889 req_id = 76d38dec-ee64-4f41-a28f-6368ef5b1ee0 response_code = 200 uri = /crucible/0/regions/491bcf50-409a-469d-bb84-a4e28f6226fa
142026-05-16T01:09:43.725ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:48436
152026-05-16T01:09:43.726ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48436 req_id = 6ea2810e-017d-4a40-b497-48f827d91fc0 response_code = 200 uri = /crucible/0/regions/491bcf50-409a-469d-bb84-a4e28f6226fa
162026-05-16T01:09:43.864ZINFOcrucible-agent (worker): region files created ok region = 491bcf50-409a-469d-bb84-a4e28f6226fa
172026-05-16T01:09:43.864ZINFOcrucible-agent (datafile): region 491bcf50-409a-469d-bb84-a4e28f6226fa state: Requested -> Created
182026-05-16T01:09:43.864ZINFOcrucible-agent (worker): applying SMF actions post create...
192026-05-16T01:09:43.865ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-491bcf50-409a-469d-bb84-a4e28f6226fa
202026-05-16T01:09:43.882ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-491bcf50-409a-469d-bb84-a4e28f6226fa
212026-05-16T01:09:43.904ZINFOcrucible-agent (worker): creating config property group
222026-05-16T01:09:43.906ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-491bcf50-409a-469d-bb84-a4e28f6226fa
232026-05-16T01:09:43.907ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/491bcf50-409a-469d-bb84-a4e28f6226fa
242026-05-16T01:09:43.907ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
252026-05-16T01:09:43.907ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
262026-05-16T01:09:43.907ZINFOcrucible-agent (worker): commit
272026-05-16T01:09:43.911ZINFOcrucible-agent (worker): ok!
282026-05-16T01:09:43.914ZINFOcrucible-agent (worker): SMF ok!
292026-05-16T01:09:44.247ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 836f7632-a467-4b32-be6f-be0d792bc1b2 response_code = 200 uri = /crucible/0/regions
302026-05-16T01:09:50.277ZINFOcrucible-agent (datafile): region 43642537-0042-4183-be31-ad23415143ba state: Requested
312026-05-16T01:09:50.277ZINFOcrucible-agent (dropshot): request completed latency_us = 219 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 90023c76-685c-4638-9684-df6c656fddd6 response_code = 200 uri = /crucible/0/regions
322026-05-16T01:09:50.277ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
332026-05-16T01:09:50.283ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0c0169f2-244f-4103-bd11-3ed8e5f72b90/crucible/regions/43642537-0042-4183-be31-ad23415143ba
342026-05-16T01:09:50.283ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0c0169f2-244f-4103-bd11-3ed8e5f72b90/crucible/regions/43642537-0042-4183-be31-ad23415143ba
352026-05-16T01:09:50.324ZINFOcrucible-agent (worker): creating region Region { id: RegionId("43642537-0042-4183-be31-ad23415143ba"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/43642537-0042-4183-be31-ad23415143ba" region = 43642537-0042-4183-be31-ad23415143ba
362026-05-16T01:09:50.324ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "43642537-0042-4183-be31-ad23415143ba" "--data" "/data/regions/43642537-0042-4183-be31-ad23415143ba" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 43642537-0042-4183-be31-ad23415143ba
372026-05-16T01:09:50.376ZINFOcrucible-agent (worker): region files created ok region = 43642537-0042-4183-be31-ad23415143ba
382026-05-16T01:09:50.376ZINFOcrucible-agent (datafile): region 43642537-0042-4183-be31-ad23415143ba state: Requested -> Created
392026-05-16T01:09:50.376ZINFOcrucible-agent (worker): applying SMF actions post create...
402026-05-16T01:09:50.376ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-43642537-0042-4183-be31-ad23415143ba
412026-05-16T01:09:50.378ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-43642537-0042-4183-be31-ad23415143ba
422026-05-16T01:09:50.386ZINFOcrucible-agent (worker): creating config property group
432026-05-16T01:09:50.389ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-43642537-0042-4183-be31-ad23415143ba
442026-05-16T01:09:50.389ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/43642537-0042-4183-be31-ad23415143ba
452026-05-16T01:09:50.389ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
462026-05-16T01:09:50.389ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
472026-05-16T01:09:50.389ZINFOcrucible-agent (worker): commit
482026-05-16T01:09:50.392ZINFOcrucible-agent (worker): ok!
492026-05-16T01:09:50.400ZINFOcrucible-agent (worker): SMF ok!
502026-05-16T01:09:50.629ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 2b50dad6-fa6b-4381-b6e6-ef6ab9ffb389 response_code = 200 uri = /crucible/0/regions
512026-05-16T01:10:15.503ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 28bf0653-6ab4-4e81-b9cf-94a3f9e20bbf response_code = 200 uri = /crucible/0/regions/43642537-0042-4183-be31-ad23415143ba
522026-05-16T01:10:15.507ZINFOcrucible-agent (datafile): path is "/data/regions/43642537-0042-4183-be31-ad23415143ba"
532026-05-16T01:10:15.515ZINFOcrucible-agent (datafile): dataset is oxp_0c0169f2-244f-4103-bd11-3ed8e5f72b90/crucible/regions/43642537-0042-4183-be31-ad23415143ba
542026-05-16T01:10:15.521ZINFOcrucible-agent (datafile): region 43642537-0042-4183-be31-ad23415143ba state: Created -> Tombstoned
552026-05-16T01:10:15.522ZINFOcrucible-agent (worker): applying SMF actions before removal...
562026-05-16T01:10:15.522ZINFOcrucible-agent (dropshot): request completed latency_us = 15146 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 85e369e3-f0aa-42e7-8987-36b77f7a1fcd response_code = 204 uri = /crucible/0/regions/43642537-0042-4183-be31-ad23415143ba
572026-05-16T01:10:15.523ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-43642537-0042-4183-be31-ad23415143ba (instance states: (Some(Online), None))
582026-05-16T01:10:15.525ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 53152bfd-be09-4eea-8fc3-29463d599347 response_code = 200 uri = /crucible/0/regions/43642537-0042-4183-be31-ad23415143ba
592026-05-16T01:10:15.527ZINFOcrucible-agent (worker): SMF ok!
602026-05-16T01:10:15.535ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_0c0169f2-244f-4103-bd11-3ed8e5f72b90/crucible/regions/43642537-0042-4183-be31-ad23415143ba" region = 43642537-0042-4183-be31-ad23415143ba
612026-05-16T01:10:15.580ZINFOcrucible-agent (datafile): region 43642537-0042-4183-be31-ad23415143ba state: Tombstoned -> Destroyed
622026-05-16T01:10:15.595ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 8cd33952-4d94-4b5e-82bf-45a5f1cef95e response_code = 200 uri = /crucible/0/regions/43642537-0042-4183-be31-ad23415143ba