Max level shown:
12025-11-03T20:24:48.216ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:48221
22025-11-03T20:24:48.276ZINFOcrucible-agent (datafile): region 992068ed-9013-44a7-a839-aeff7e876c4c state: Requested
32025-11-03T20:24:48.284ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-11-03T20:24:48.284ZINFOcrucible-agent (dropshot): request completed latency_us = 28640 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48221 req_id = 37967948-5f4f-4453-8370-c69f7347be99 response_code = 200 uri = /crucible/0/regions
52025-11-03T20:24:48.294ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d28886dc-c6ef-4b39-a02f-58710e48ccc3/crucible/regions/992068ed-9013-44a7-a839-aeff7e876c4c
62025-11-03T20:24:48.294ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d28886dc-c6ef-4b39-a02f-58710e48ccc3/crucible/regions/992068ed-9013-44a7-a839-aeff7e876c4c
72025-11-03T20:24:48.370ZINFOcrucible-agent (worker): creating region Region { id: RegionId("992068ed-9013-44a7-a839-aeff7e876c4c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/992068ed-9013-44a7-a839-aeff7e876c4c" region = 992068ed-9013-44a7-a839-aeff7e876c4c
82025-11-03T20:24:48.373ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "992068ed-9013-44a7-a839-aeff7e876c4c" "--data" "/data/regions/992068ed-9013-44a7-a839-aeff7e876c4c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 992068ed-9013-44a7-a839-aeff7e876c4c
92025-11-03T20:24:48.606ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48221 req_id = 0a20559a-acf9-4e5f-bbdc-7bbc2f2659b6 response_code = 200 uri = /crucible/0/regions
102025-11-03T20:24:48.829ZINFOcrucible-agent (worker): region files created ok region = 992068ed-9013-44a7-a839-aeff7e876c4c
112025-11-03T20:24:48.829ZINFOcrucible-agent (datafile): region 992068ed-9013-44a7-a839-aeff7e876c4c state: Requested -> Created
122025-11-03T20:24:48.829ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-11-03T20:24:48.829ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-992068ed-9013-44a7-a839-aeff7e876c4c
142025-11-03T20:24:48.844ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-992068ed-9013-44a7-a839-aeff7e876c4c
152025-11-03T20:24:48.866ZINFOcrucible-agent (worker): creating config property group
162025-11-03T20:24:48.871ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-992068ed-9013-44a7-a839-aeff7e876c4c
172025-11-03T20:24:48.872ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/992068ed-9013-44a7-a839-aeff7e876c4c
182025-11-03T20:24:48.872ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-11-03T20:24:48.872ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202025-11-03T20:24:48.872ZINFOcrucible-agent (worker): commit
212025-11-03T20:24:48.877ZINFOcrucible-agent (worker): ok!
222025-11-03T20:24:48.881ZINFOcrucible-agent (worker): SMF ok!
232025-11-03T20:24:49.240ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48221 req_id = 57bf85cc-1ffe-4fb0-a4e0-930aa7dfbebd response_code = 200 uri = /crucible/0/regions
242025-11-03T20:24:56.452ZINFOcrucible-agent (datafile): region a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f state: Requested
252025-11-03T20:24:56.453ZINFOcrucible-agent (dropshot): request completed latency_us = 233 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48221 req_id = b0e60e6c-02df-4b4c-b0f4-e50a4dd97822 response_code = 200 uri = /crucible/0/regions
262025-11-03T20:24:56.453ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-11-03T20:24:56.459ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d28886dc-c6ef-4b39-a02f-58710e48ccc3/crucible/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
282025-11-03T20:24:56.459ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d28886dc-c6ef-4b39-a02f-58710e48ccc3/crucible/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
292025-11-03T20:24:56.580ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f" region = a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
302025-11-03T20:24:56.580ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f" "--data" "/data/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
312025-11-03T20:24:56.603ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48221 req_id = fe2eb7ba-4666-42c1-bba6-6101a5527bdf response_code = 200 uri = /crucible/0/regions
322025-11-03T20:24:56.860ZINFOcrucible-agent (worker): region files created ok region = a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
332025-11-03T20:24:56.860ZINFOcrucible-agent (datafile): region a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f state: Requested -> Created
342025-11-03T20:24:56.860ZINFOcrucible-agent (worker): applying SMF actions post create...
352025-11-03T20:24:56.862ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
362025-11-03T20:24:56.870ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
372025-11-03T20:24:56.881ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48221 req_id = 1e3c62d9-153a-453e-be54-92b749b5dab7 response_code = 200 uri = /crucible/0/regions
382025-11-03T20:24:56.899ZINFOcrucible-agent (worker): creating config property group
392025-11-03T20:24:56.914ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
402025-11-03T20:24:56.915ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
412025-11-03T20:24:56.915ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422025-11-03T20:24:56.915ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
432025-11-03T20:24:56.915ZINFOcrucible-agent (worker): commit
442025-11-03T20:24:56.943ZINFOcrucible-agent (worker): ok!
452025-11-03T20:24:56.963ZINFOcrucible-agent (worker): SMF ok!
462025-11-03T20:24:57.005ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:59573
472025-11-03T20:24:57.005ZINFOcrucible-agent (dropshot): request completed latency_us = 94 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59573 req_id = d0d18e37-e5ec-4fa8-825a-dd7feb51ec86 response_code = 200 uri = /crucible/0/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
482025-11-03T20:24:57.137ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:58629
492025-11-03T20:24:57.137ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:58629 req_id = 2efec5a4-3365-4bc4-b269-ff288fefa8b4 response_code = 200 uri = /crucible/0/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
502025-11-03T20:25:31.851ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:40627
512025-11-03T20:25:31.851ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:40627 req_id = c43f23d1-e8e1-4313-b813-e438407be352 response_code = 200 uri = /crucible/0/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
522025-11-03T20:25:31.853ZINFOcrucible-agent (datafile): path is "/data/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f"
532025-11-03T20:25:31.864ZINFOcrucible-agent (datafile): dataset is oxp_d28886dc-c6ef-4b39-a02f-58710e48ccc3/crucible/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
542025-11-03T20:25:31.871ZINFOcrucible-agent (datafile): region a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f state: Created -> Tombstoned
552025-11-03T20:25:31.871ZINFOcrucible-agent (dropshot): request completed latency_us = 18095 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:40627 req_id = dfef264d-b3a1-4200-a9c3-9f0c29e3c8bb response_code = 204 uri = /crucible/0/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
562025-11-03T20:25:31.871ZINFOcrucible-agent (worker): applying SMF actions before removal...
572025-11-03T20:25:31.872ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f (instance states: (Some(Online), None))
582025-11-03T20:25:31.874ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:40627 req_id = eee9da85-bbdc-4270-9c2b-520174fb0bd5 response_code = 200 uri = /crucible/0/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
592025-11-03T20:25:31.888ZINFOcrucible-agent (worker): SMF ok!
602025-11-03T20:25:31.896ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d28886dc-c6ef-4b39-a02f-58710e48ccc3/crucible/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f" region = a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f
612025-11-03T20:25:31.961ZINFOcrucible-agent (datafile): region a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f state: Tombstoned -> Destroyed
622025-11-03T20:25:31.995ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:40627 req_id = d8939855-d964-4692-892a-f5a75774e123 response_code = 200 uri = /crucible/0/regions/a39f7fbb-cc1d-4b7e-82b1-b41b78910b6f