Max level shown:
12026-03-18T21:24:07.429ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:35197
22026-03-18T21:24:07.554ZINFOcrucible-agent (datafile): region 2d52cbf2-f7b9-4d6d-b184-3690aa483f21 state: Requested
32026-03-18T21:24:07.576ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-18T21:24:07.576ZINFOcrucible-agent (dropshot): request completed latency_us = 61212 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35197 req_id = 6625e921-bc65-4008-bb9d-8fbb3e819669 response_code = 200 uri = /crucible/0/regions
52026-03-18T21:24:07.617ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f328bbb3-294c-4cef-89bf-ab6a3fc9f5eb/crucible/regions/2d52cbf2-f7b9-4d6d-b184-3690aa483f21
62026-03-18T21:24:07.617ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f328bbb3-294c-4cef-89bf-ab6a3fc9f5eb/crucible/regions/2d52cbf2-f7b9-4d6d-b184-3690aa483f21
72026-03-18T21:24:07.805ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2d52cbf2-f7b9-4d6d-b184-3690aa483f21"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2d52cbf2-f7b9-4d6d-b184-3690aa483f21" region = 2d52cbf2-f7b9-4d6d-b184-3690aa483f21
82026-03-18T21:24:07.808ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2d52cbf2-f7b9-4d6d-b184-3690aa483f21" "--data" "/data/regions/2d52cbf2-f7b9-4d6d-b184-3690aa483f21" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2d52cbf2-f7b9-4d6d-b184-3690aa483f21
92026-03-18T21:24:07.920ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35197 req_id = 4c6617fa-fbda-46db-b833-bf213d53e376 response_code = 200 uri = /crucible/0/regions
102026-03-18T21:24:08.374ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35197 req_id = 7d08e170-72b7-4a92-a26b-c50f404e4111 response_code = 200 uri = /crucible/0/regions
112026-03-18T21:24:08.971ZINFOcrucible-agent (worker): region files created ok region = 2d52cbf2-f7b9-4d6d-b184-3690aa483f21
122026-03-18T21:24:08.971ZINFOcrucible-agent (datafile): region 2d52cbf2-f7b9-4d6d-b184-3690aa483f21 state: Requested -> Created
132026-03-18T21:24:08.971ZINFOcrucible-agent (worker): applying SMF actions post create...
142026-03-18T21:24:08.971ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2d52cbf2-f7b9-4d6d-b184-3690aa483f21
152026-03-18T21:24:09.007ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2d52cbf2-f7b9-4d6d-b184-3690aa483f21
162026-03-18T21:24:09.060ZINFOcrucible-agent (worker): creating config property group
172026-03-18T21:24:09.085ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2d52cbf2-f7b9-4d6d-b184-3690aa483f21
182026-03-18T21:24:09.086ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2d52cbf2-f7b9-4d6d-b184-3690aa483f21
192026-03-18T21:24:09.086ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
202026-03-18T21:24:09.086ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
212026-03-18T21:24:09.086ZINFOcrucible-agent (worker): commit
222026-03-18T21:24:09.111ZINFOcrucible-agent (worker): ok!
232026-03-18T21:24:09.137ZINFOcrucible-agent (worker): SMF ok!
242026-03-18T21:24:09.689ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35197 req_id = 4b337929-6e0b-4684-897e-8d86a274adba response_code = 200 uri = /crucible/0/regions
252026-03-18T21:24:19.007ZINFOcrucible-agent (datafile): region c886348e-e8fd-4b84-a452-afc0feea291c state: Requested
262026-03-18T21:24:19.008ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-03-18T21:24:19.008ZINFOcrucible-agent (dropshot): request completed latency_us = 249 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35197 req_id = de27197b-c909-4c5b-b431-54418eabaf51 response_code = 200 uri = /crucible/0/regions
282026-03-18T21:24:19.014ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f328bbb3-294c-4cef-89bf-ab6a3fc9f5eb/crucible/regions/c886348e-e8fd-4b84-a452-afc0feea291c
292026-03-18T21:24:19.014ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f328bbb3-294c-4cef-89bf-ab6a3fc9f5eb/crucible/regions/c886348e-e8fd-4b84-a452-afc0feea291c
302026-03-18T21:24:19.082ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c886348e-e8fd-4b84-a452-afc0feea291c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c886348e-e8fd-4b84-a452-afc0feea291c" region = c886348e-e8fd-4b84-a452-afc0feea291c
312026-03-18T21:24:19.082ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c886348e-e8fd-4b84-a452-afc0feea291c" "--data" "/data/regions/c886348e-e8fd-4b84-a452-afc0feea291c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c886348e-e8fd-4b84-a452-afc0feea291c
322026-03-18T21:24:19.304ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35197 req_id = ce42574e-46ce-4143-a7b9-9990ef408cdd response_code = 200 uri = /crucible/0/regions
332026-03-18T21:24:19.307ZINFOcrucible-agent (worker): region files created ok region = c886348e-e8fd-4b84-a452-afc0feea291c
342026-03-18T21:24:19.307ZINFOcrucible-agent (datafile): region c886348e-e8fd-4b84-a452-afc0feea291c state: Requested -> Created
352026-03-18T21:24:19.307ZINFOcrucible-agent (worker): applying SMF actions post create...
362026-03-18T21:24:19.313ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c886348e-e8fd-4b84-a452-afc0feea291c
372026-03-18T21:24:19.321ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c886348e-e8fd-4b84-a452-afc0feea291c
382026-03-18T21:24:19.345ZINFOcrucible-agent (worker): creating config property group
392026-03-18T21:24:19.359ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c886348e-e8fd-4b84-a452-afc0feea291c
402026-03-18T21:24:19.360ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c886348e-e8fd-4b84-a452-afc0feea291c
412026-03-18T21:24:19.360ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422026-03-18T21:24:19.360ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432026-03-18T21:24:19.360ZINFOcrucible-agent (worker): commit
442026-03-18T21:24:19.368ZINFOcrucible-agent (worker): ok!
452026-03-18T21:24:19.379ZINFOcrucible-agent (worker): SMF ok!
462026-03-18T21:24:19.610ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35197 req_id = 07eeea87-e6dc-4107-b7ec-80a410265684 response_code = 200 uri = /crucible/0/regions
472026-03-18T21:24:51.812ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:44119
482026-03-18T21:24:51.812ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44119 req_id = c390bce5-d525-4b83-8a95-536374ac1485 response_code = 200 uri = /crucible/0/regions/c886348e-e8fd-4b84-a452-afc0feea291c
492026-03-18T21:24:51.815ZINFOcrucible-agent (datafile): path is "/data/regions/c886348e-e8fd-4b84-a452-afc0feea291c"
502026-03-18T21:24:51.826ZINFOcrucible-agent (datafile): dataset is oxp_f328bbb3-294c-4cef-89bf-ab6a3fc9f5eb/crucible/regions/c886348e-e8fd-4b84-a452-afc0feea291c
512026-03-18T21:24:51.834ZINFOcrucible-agent (datafile): region c886348e-e8fd-4b84-a452-afc0feea291c state: Created -> Tombstoned
522026-03-18T21:24:51.834ZINFOcrucible-agent (worker): applying SMF actions before removal...
532026-03-18T21:24:51.834ZINFOcrucible-agent (dropshot): request completed latency_us = 19448 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:44119 req_id = 7bb002e4-dad5-4506-9025-8396d9bc9dd2 response_code = 204 uri = /crucible/0/regions/c886348e-e8fd-4b84-a452-afc0feea291c
542026-03-18T21:24:51.835ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c886348e-e8fd-4b84-a452-afc0feea291c (instance states: (Some(Online), None))
552026-03-18T21:24:51.837ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44119 req_id = ae359d26-a51c-49a8-819e-a321fa3180a1 response_code = 200 uri = /crucible/0/regions/c886348e-e8fd-4b84-a452-afc0feea291c
562026-03-18T21:24:51.845ZINFOcrucible-agent (worker): SMF ok!
572026-03-18T21:24:51.855ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f328bbb3-294c-4cef-89bf-ab6a3fc9f5eb/crucible/regions/c886348e-e8fd-4b84-a452-afc0feea291c" region = c886348e-e8fd-4b84-a452-afc0feea291c
582026-03-18T21:24:51.906ZINFOcrucible-agent (datafile): region c886348e-e8fd-4b84-a452-afc0feea291c state: Tombstoned -> Destroyed
592026-03-18T21:24:51.986ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44119 req_id = f6bf97b6-6820-4fef-b46a-6e5f5b920870 response_code = 200 uri = /crucible/0/regions/c886348e-e8fd-4b84-a452-afc0feea291c