Max level shown:
12026-10-29T02:50:18.423ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:37716
22026-10-29T02:50:18.423ZINFOcrucible-agent (datafile): region c65d5654-0166-4a04-a25f-2abb133e386e state: Requested
32026-10-29T02:50:18.424ZINFOcrucible-agent (dropshot): request completed latency_us = 767 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37716 req_id = 70d252d6-5887-4be8-8a87-f939132654c9 response_code = 200 uri = /crucible/0/regions
42026-10-29T02:50:18.424ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-10-29T02:50:18.433ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e56faa36-3f5d-439b-aa30-fe4f01a36d9a/crucible/regions/c65d5654-0166-4a04-a25f-2abb133e386e
62026-10-29T02:50:18.433ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e56faa36-3f5d-439b-aa30-fe4f01a36d9a/crucible/regions/c65d5654-0166-4a04-a25f-2abb133e386e
72026-10-29T02:50:18.476ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c65d5654-0166-4a04-a25f-2abb133e386e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c65d5654-0166-4a04-a25f-2abb133e386e" region = c65d5654-0166-4a04-a25f-2abb133e386e
82026-10-29T02:50:18.477ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c65d5654-0166-4a04-a25f-2abb133e386e" "--data" "/data/regions/c65d5654-0166-4a04-a25f-2abb133e386e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c65d5654-0166-4a04-a25f-2abb133e386e
92026-10-29T02:50:18.524ZINFOcrucible-agent (worker): region files created ok region = c65d5654-0166-4a04-a25f-2abb133e386e
102026-10-29T02:50:18.524ZINFOcrucible-agent (datafile): region c65d5654-0166-4a04-a25f-2abb133e386e state: Requested -> Created
112026-10-29T02:50:18.524ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-10-29T02:50:18.525ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c65d5654-0166-4a04-a25f-2abb133e386e
132026-10-29T02:50:18.528ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c65d5654-0166-4a04-a25f-2abb133e386e
142026-10-29T02:50:18.543ZINFOcrucible-agent (worker): creating config property group
152026-10-29T02:50:18.544ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c65d5654-0166-4a04-a25f-2abb133e386e
162026-10-29T02:50:18.544ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c65d5654-0166-4a04-a25f-2abb133e386e
172026-10-29T02:50:18.544ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-10-29T02:50:18.544ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192026-10-29T02:50:18.545ZINFOcrucible-agent (worker): commit
202026-10-29T02:50:18.546ZINFOcrucible-agent (worker): ok!
212026-10-29T02:50:18.550ZINFOcrucible-agent (worker): SMF ok!
222026-10-29T02:50:18.661ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37716 req_id = 00ad1237-08b2-4703-9875-74d1336a547f response_code = 200 uri = /crucible/0/regions
232026-10-29T02:50:25.276ZINFOcrucible-agent (datafile): region c3640612-f60b-47b8-b929-6e02ab8697fb state: Requested
242026-10-29T02:50:25.276ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252026-10-29T02:50:25.276ZINFOcrucible-agent (dropshot): request completed latency_us = 211 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37716 req_id = 37ba3ce4-c105-4416-8459-03fbedaca2f7 response_code = 200 uri = /crucible/0/regions
262026-10-29T02:50:25.282ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e56faa36-3f5d-439b-aa30-fe4f01a36d9a/crucible/regions/c3640612-f60b-47b8-b929-6e02ab8697fb
272026-10-29T02:50:25.282ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e56faa36-3f5d-439b-aa30-fe4f01a36d9a/crucible/regions/c3640612-f60b-47b8-b929-6e02ab8697fb
282026-10-29T02:50:25.320ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c3640612-f60b-47b8-b929-6e02ab8697fb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c3640612-f60b-47b8-b929-6e02ab8697fb" region = c3640612-f60b-47b8-b929-6e02ab8697fb
292026-10-29T02:50:25.320ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c3640612-f60b-47b8-b929-6e02ab8697fb" "--data" "/data/regions/c3640612-f60b-47b8-b929-6e02ab8697fb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c3640612-f60b-47b8-b929-6e02ab8697fb
302026-10-29T02:50:25.369ZINFOcrucible-agent (worker): region files created ok region = c3640612-f60b-47b8-b929-6e02ab8697fb
312026-10-29T02:50:25.369ZINFOcrucible-agent (datafile): region c3640612-f60b-47b8-b929-6e02ab8697fb state: Requested -> Created
322026-10-29T02:50:25.369ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-10-29T02:50:25.370ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c3640612-f60b-47b8-b929-6e02ab8697fb
342026-10-29T02:50:25.374ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c3640612-f60b-47b8-b929-6e02ab8697fb
352026-10-29T02:50:25.378ZINFOcrucible-agent (worker): creating config property group
362026-10-29T02:50:25.379ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c3640612-f60b-47b8-b929-6e02ab8697fb
372026-10-29T02:50:25.379ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c3640612-f60b-47b8-b929-6e02ab8697fb
382026-10-29T02:50:25.379ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-10-29T02:50:25.379ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
402026-10-29T02:50:25.379ZINFOcrucible-agent (worker): commit
412026-10-29T02:50:25.381ZINFOcrucible-agent (worker): ok!
422026-10-29T02:50:25.385ZINFOcrucible-agent (worker): SMF ok!
432026-10-29T02:50:25.573ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37716 req_id = e8509aad-64fc-41fd-bad8-6369ffd6dc68 response_code = 200 uri = /crucible/0/regions
442026-10-29T02:50:52.816ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37716 req_id = 0e52deed-51c7-46a7-830d-693a632e15a3 response_code = 200 uri = /crucible/0/regions/c3640612-f60b-47b8-b929-6e02ab8697fb
452026-10-29T02:50:52.818ZINFOcrucible-agent (datafile): path is "/data/regions/c3640612-f60b-47b8-b929-6e02ab8697fb"
462026-10-29T02:50:52.828ZINFOcrucible-agent (datafile): dataset is oxp_e56faa36-3f5d-439b-aa30-fe4f01a36d9a/crucible/regions/c3640612-f60b-47b8-b929-6e02ab8697fb
472026-10-29T02:50:52.835ZINFOcrucible-agent (datafile): region c3640612-f60b-47b8-b929-6e02ab8697fb state: Created -> Tombstoned
482026-10-29T02:50:52.835ZINFOcrucible-agent (worker): applying SMF actions before removal...
492026-10-29T02:50:52.835ZINFOcrucible-agent (dropshot): request completed latency_us = 16756 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:37716 req_id = 31b7462c-5298-46aa-bbf7-336b58f20eda response_code = 204 uri = /crucible/0/regions/c3640612-f60b-47b8-b929-6e02ab8697fb
502026-10-29T02:50:52.837ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c3640612-f60b-47b8-b929-6e02ab8697fb (instance states: (Some(Online), None))
512026-10-29T02:50:52.840ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37716 req_id = 198e077f-64b4-48b4-91db-3dddf7e01c6e response_code = 200 uri = /crucible/0/regions/c3640612-f60b-47b8-b929-6e02ab8697fb
522026-10-29T02:50:52.840ZINFOcrucible-agent (worker): SMF ok!
532026-10-29T02:50:52.848ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_e56faa36-3f5d-439b-aa30-fe4f01a36d9a/crucible/regions/c3640612-f60b-47b8-b929-6e02ab8697fb" region = c3640612-f60b-47b8-b929-6e02ab8697fb
542026-10-29T02:50:52.891ZINFOcrucible-agent (datafile): region c3640612-f60b-47b8-b929-6e02ab8697fb state: Tombstoned -> Destroyed
552026-10-29T02:50:52.986ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37716 req_id = ea58dee4-31b1-43d0-b582-8a0d0930ef05 response_code = 200 uri = /crucible/0/regions/c3640612-f60b-47b8-b929-6e02ab8697fb