Max level shown:
12026-08-31T13:55:10.928ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:34318
22026-08-31T13:55:10.928ZINFOcrucible-agent (datafile): region d2a61a4b-8e33-4d87-ab96-231001392e53 state: Requested
32026-08-31T13:55:10.933ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-08-31T13:55:10.933ZINFOcrucible-agent (dropshot): request completed latency_us = 4464 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34318 req_id = ce47dd27-6f09-4b39-a062-79fb379f8967 response_code = 200 uri = /crucible/0/regions
52026-08-31T13:55:10.943ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a7bc560b-e562-4c19-aa76-89d049579809/crucible/regions/d2a61a4b-8e33-4d87-ab96-231001392e53
62026-08-31T13:55:10.943ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a7bc560b-e562-4c19-aa76-89d049579809/crucible/regions/d2a61a4b-8e33-4d87-ab96-231001392e53
72026-08-31T13:55:11.108ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d2a61a4b-8e33-4d87-ab96-231001392e53"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d2a61a4b-8e33-4d87-ab96-231001392e53" region = d2a61a4b-8e33-4d87-ab96-231001392e53
82026-08-31T13:55:11.108ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d2a61a4b-8e33-4d87-ab96-231001392e53" "--data" "/data/regions/d2a61a4b-8e33-4d87-ab96-231001392e53" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d2a61a4b-8e33-4d87-ab96-231001392e53
92026-08-31T13:55:11.145ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34318 req_id = 99c6dc4a-205a-467d-b7d7-476615bcfe44 response_code = 200 uri = /crucible/0/regions
102026-08-31T13:55:11.459ZINFOcrucible-agent (worker): region files created ok region = d2a61a4b-8e33-4d87-ab96-231001392e53
112026-08-31T13:55:11.459ZINFOcrucible-agent (datafile): region d2a61a4b-8e33-4d87-ab96-231001392e53 state: Requested -> Created
122026-08-31T13:55:11.459ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-08-31T13:55:11.460ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d2a61a4b-8e33-4d87-ab96-231001392e53
142026-08-31T13:55:11.474ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d2a61a4b-8e33-4d87-ab96-231001392e53
152026-08-31T13:55:11.530ZINFOcrucible-agent (worker): creating config property group
162026-08-31T13:55:11.573ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d2a61a4b-8e33-4d87-ab96-231001392e53
172026-08-31T13:55:11.573ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d2a61a4b-8e33-4d87-ab96-231001392e53
182026-08-31T13:55:11.573ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-08-31T13:55:11.573ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-08-31T13:55:11.573ZINFOcrucible-agent (worker): commit
212026-08-31T13:55:11.586ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34318 req_id = d64b028b-4711-42f9-98fe-67b37a30d857 response_code = 200 uri = /crucible/0/regions
222026-08-31T13:55:11.623ZINFOcrucible-agent (worker): ok!
232026-08-31T13:55:11.637ZINFOcrucible-agent (worker): SMF ok!
242026-08-31T13:55:23.457ZINFOcrucible-agent (datafile): region a4338566-37df-4147-8ab5-1ba7cf221f7f state: Requested
252026-08-31T13:55:23.457ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-08-31T13:55:23.458ZINFOcrucible-agent (dropshot): request completed latency_us = 220 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34318 req_id = 21870b2d-dc93-4822-a885-077988577327 response_code = 200 uri = /crucible/0/regions
272026-08-31T13:55:23.465ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_a7bc560b-e562-4c19-aa76-89d049579809/crucible/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f
282026-08-31T13:55:23.465ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_a7bc560b-e562-4c19-aa76-89d049579809/crucible/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f
292026-08-31T13:55:23.590ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a4338566-37df-4147-8ab5-1ba7cf221f7f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f" region = a4338566-37df-4147-8ab5-1ba7cf221f7f
302026-08-31T13:55:23.590ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a4338566-37df-4147-8ab5-1ba7cf221f7f" "--data" "/data/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a4338566-37df-4147-8ab5-1ba7cf221f7f
312026-08-31T13:55:23.761ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34318 req_id = d722492d-df22-4b80-9bf0-76b0792e7426 response_code = 200 uri = /crucible/0/regions
322026-08-31T13:55:23.803ZINFOcrucible-agent (worker): region files created ok region = a4338566-37df-4147-8ab5-1ba7cf221f7f
332026-08-31T13:55:23.803ZINFOcrucible-agent (datafile): region a4338566-37df-4147-8ab5-1ba7cf221f7f state: Requested -> Created
342026-08-31T13:55:23.803ZINFOcrucible-agent (worker): applying SMF actions post create...
352026-08-31T13:55:23.804ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a4338566-37df-4147-8ab5-1ba7cf221f7f
362026-08-31T13:55:23.828ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a4338566-37df-4147-8ab5-1ba7cf221f7f
372026-08-31T13:55:23.858ZINFOcrucible-agent (worker): creating config property group
382026-08-31T13:55:23.874ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a4338566-37df-4147-8ab5-1ba7cf221f7f
392026-08-31T13:55:23.875ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f
402026-08-31T13:55:23.875ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412026-08-31T13:55:23.875ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
422026-08-31T13:55:23.875ZINFOcrucible-agent (worker): commit
432026-08-31T13:55:23.892ZINFOcrucible-agent (worker): ok!
442026-08-31T13:55:23.908ZINFOcrucible-agent (worker): SMF ok!
452026-08-31T13:55:24.402ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34318 req_id = f7847f53-4f48-407b-b239-4d6b969f7090 response_code = 200 uri = /crucible/0/regions
462026-08-31T13:55:50.430ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34318 req_id = 0d27516a-e4b1-440c-988f-b75974f1ecbd response_code = 200 uri = /crucible/0/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f
472026-08-31T13:55:50.433ZINFOcrucible-agent (datafile): path is "/data/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f"
482026-08-31T13:55:50.442ZINFOcrucible-agent (datafile): dataset is oxp_a7bc560b-e562-4c19-aa76-89d049579809/crucible/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f
492026-08-31T13:55:50.450ZINFOcrucible-agent (datafile): region a4338566-37df-4147-8ab5-1ba7cf221f7f state: Created -> Tombstoned
502026-08-31T13:55:50.450ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-08-31T13:55:50.450ZINFOcrucible-agent (dropshot): request completed latency_us = 17078 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:34318 req_id = 4baa2a07-eddc-43d7-9ce4-dfdf9fc95497 response_code = 204 uri = /crucible/0/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f
522026-08-31T13:55:50.451ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-a4338566-37df-4147-8ab5-1ba7cf221f7f (instance states: (Some(Online), None))
532026-08-31T13:55:50.454ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34318 req_id = d8546b64-70dc-4576-bd8f-efdcf79af585 response_code = 200 uri = /crucible/0/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f
542026-08-31T13:55:50.459ZINFOcrucible-agent (worker): SMF ok!
552026-08-31T13:55:50.466ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_a7bc560b-e562-4c19-aa76-89d049579809/crucible/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f" region = a4338566-37df-4147-8ab5-1ba7cf221f7f
562026-08-31T13:55:50.534ZINFOcrucible-agent (datafile): region a4338566-37df-4147-8ab5-1ba7cf221f7f state: Tombstoned -> Destroyed
572026-08-31T13:55:50.607ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34318 req_id = e4577f98-e119-414c-ab26-0f6612fa70a2 response_code = 200 uri = /crucible/0/regions/a4338566-37df-4147-8ab5-1ba7cf221f7f