Max level shown:
1 [ Oct 9 04:56:26 Enabled. ]
2 [ Oct 9 04:56:26 Rereading configuration. ]
3 [ Oct 9 04:56:29 Rereading configuration. ]
4 [ Oct 9 04:56:34 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_b51d1830-b729-429a-a767-758ff0a11f53/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-09T04:56:34.853ZINFOcrucible-agent: dataset: "oxp_b51d1830-b729-429a-a767-758ff0a11f53/crucible"
72024-10-09T04:56:34.854ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82024-10-09T04:56:34.854ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-09T04:56:34.871ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-09T04:56:34.988ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
112024-10-09T04:56:57.343ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:39283
122024-10-09T04:56:57.360ZINFOcrucible-agent (datafile): region 3c340698-8c42-4b01-974e-5d9de731d8fa state: Requested
132024-10-09T04:56:57.362ZINFOcrucible-agent (dropshot): request completed latency_us = 4342 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39283 req_id = 9fbafbd5-2483-42dc-a2e4-1da2e958a6ce response_code = 200 uri = /crucible/0/regions
142024-10-09T04:56:57.363ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-10-09T04:56:57.372ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_b51d1830-b729-429a-a767-758ff0a11f53/crucible/regions/3c340698-8c42-4b01-974e-5d9de731d8fa
162024-10-09T04:56:57.372ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_b51d1830-b729-429a-a767-758ff0a11f53/crucible/regions/3c340698-8c42-4b01-974e-5d9de731d8fa
172024-10-09T04:56:57.455ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3c340698-8c42-4b01-974e-5d9de731d8fa"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3c340698-8c42-4b01-974e-5d9de731d8fa" region = 3c340698-8c42-4b01-974e-5d9de731d8fa
182024-10-09T04:56:57.459ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3c340698-8c42-4b01-974e-5d9de731d8fa" "--data" "/data/regions/3c340698-8c42-4b01-974e-5d9de731d8fa" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 3c340698-8c42-4b01-974e-5d9de731d8fa
192024-10-09T04:56:57.573ZINFOcrucible-agent (worker): region files created ok region = 3c340698-8c42-4b01-974e-5d9de731d8fa
202024-10-09T04:56:57.573ZINFOcrucible-agent (datafile): region 3c340698-8c42-4b01-974e-5d9de731d8fa state: Requested -> Created
212024-10-09T04:56:57.574ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-10-09T04:56:57.576ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3c340698-8c42-4b01-974e-5d9de731d8fa
232024-10-09T04:56:57.580ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3c340698-8c42-4b01-974e-5d9de731d8fa
242024-10-09T04:56:57.594ZINFOcrucible-agent (worker): creating config property group
252024-10-09T04:56:57.598ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3c340698-8c42-4b01-974e-5d9de731d8fa
262024-10-09T04:56:57.607ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3c340698-8c42-4b01-974e-5d9de731d8fa
272024-10-09T04:56:57.608ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-10-09T04:56:57.608ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
292024-10-09T04:56:57.608ZINFOcrucible-agent (worker): commit
302024-10-09T04:56:57.611ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39283 req_id = e62dfe6d-e9cf-426e-81f7-2b37923573cf response_code = 200 uri = /crucible/0/regions
312024-10-09T04:56:57.614ZINFOcrucible-agent (worker): ok!
322024-10-09T04:56:57.618ZINFOcrucible-agent (worker): SMF ok!
332024-10-09T04:56:58.135ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39283 req_id = b3a31623-bef6-43c4-982f-356b4c916802 response_code = 200 uri = /crucible/0/regions/3c340698-8c42-4b01-974e-5d9de731d8fa
342024-10-09T04:56:58.138ZINFOcrucible-agent (datafile): path is "/data/regions/3c340698-8c42-4b01-974e-5d9de731d8fa"
352024-10-09T04:56:58.150ZINFOcrucible-agent (datafile): dataset is oxp_b51d1830-b729-429a-a767-758ff0a11f53/crucible/regions/3c340698-8c42-4b01-974e-5d9de731d8fa
362024-10-09T04:56:58.161ZINFOcrucible-agent (datafile): region 3c340698-8c42-4b01-974e-5d9de731d8fa state: Created -> Tombstoned
372024-10-09T04:56:58.161ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-10-09T04:56:58.161ZINFOcrucible-agent (dropshot): request completed latency_us = 23308 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:39283 req_id = 9b1c9c99-aaef-4c40-9648-ef81319f3f4c response_code = 204 uri = /crucible/0/regions/3c340698-8c42-4b01-974e-5d9de731d8fa
392024-10-09T04:56:58.162ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3c340698-8c42-4b01-974e-5d9de731d8fa (instance states: (Some(Online), None))
402024-10-09T04:56:58.165ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39283 req_id = 2b1c3185-c1ed-4ba0-bf63-b10f04cee95b response_code = 200 uri = /crucible/0/regions/3c340698-8c42-4b01-974e-5d9de731d8fa
412024-10-09T04:56:58.169ZINFOcrucible-agent (worker): SMF ok!
422024-10-09T04:56:58.182ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b51d1830-b729-429a-a767-758ff0a11f53/crucible/regions/3c340698-8c42-4b01-974e-5d9de731d8fa" region = 3c340698-8c42-4b01-974e-5d9de731d8fa
432024-10-09T04:56:58.273ZINFOcrucible-agent (datafile): region 3c340698-8c42-4b01-974e-5d9de731d8fa state: Tombstoned -> Destroyed
442024-10-09T04:56:58.311ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39283 req_id = e1d34fe5-7c02-4dc2-ad29-45dfea7826ce response_code = 200 uri = /crucible/0/regions/3c340698-8c42-4b01-974e-5d9de731d8fa
452024-10-09T04:57:00.130ZINFOcrucible-agent (datafile): region 33103b27-b86b-43b0-bb9d-fcaa110441cb state: Requested
462024-10-09T04:57:00.131ZINFOcrucible-agent (dropshot): request completed latency_us = 890 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39283 req_id = b79ee3af-ecee-4cb0-959b-0ae4389c0915 response_code = 200 uri = /crucible/0/regions
472024-10-09T04:57:00.131ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-10-09T04:57:00.140ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b51d1830-b729-429a-a767-758ff0a11f53/crucible/regions/33103b27-b86b-43b0-bb9d-fcaa110441cb
492024-10-09T04:57:00.140ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b51d1830-b729-429a-a767-758ff0a11f53/crucible/regions/33103b27-b86b-43b0-bb9d-fcaa110441cb
502024-10-09T04:57:00.210ZINFOcrucible-agent (worker): creating region Region { id: RegionId("33103b27-b86b-43b0-bb9d-fcaa110441cb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/33103b27-b86b-43b0-bb9d-fcaa110441cb" region = 33103b27-b86b-43b0-bb9d-fcaa110441cb
512024-10-09T04:57:00.212ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "33103b27-b86b-43b0-bb9d-fcaa110441cb" "--data" "/data/regions/33103b27-b86b-43b0-bb9d-fcaa110441cb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 33103b27-b86b-43b0-bb9d-fcaa110441cb
522024-10-09T04:57:00.288ZINFOcrucible-agent (worker): region files created ok region = 33103b27-b86b-43b0-bb9d-fcaa110441cb
532024-10-09T04:57:00.288ZINFOcrucible-agent (datafile): region 33103b27-b86b-43b0-bb9d-fcaa110441cb state: Requested -> Created
542024-10-09T04:57:00.288ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-10-09T04:57:00.290ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-33103b27-b86b-43b0-bb9d-fcaa110441cb
562024-10-09T04:57:00.314ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-33103b27-b86b-43b0-bb9d-fcaa110441cb
572024-10-09T04:57:00.334ZINFOcrucible-agent (worker): creating config property group
582024-10-09T04:57:00.339ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-33103b27-b86b-43b0-bb9d-fcaa110441cb
592024-10-09T04:57:00.339ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/33103b27-b86b-43b0-bb9d-fcaa110441cb
602024-10-09T04:57:00.339ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-10-09T04:57:00.339ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
622024-10-09T04:57:00.339ZINFOcrucible-agent (worker): commit
632024-10-09T04:57:00.344ZINFOcrucible-agent (worker): ok!
642024-10-09T04:57:00.350ZINFOcrucible-agent (worker): SMF ok!
652024-10-09T04:57:00.467ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39283 req_id = 66a0e761-cdb0-4eab-b8b1-ce999f3d7ad4 response_code = 200 uri = /crucible/0/regions