Max level shown:
1 [ Feb 28 11:58:58 Enabled. ]
2 [ Feb 28 11:58:58 Rereading configuration. ]
3 [ Feb 28 11:58:59 Rereading configuration. ]
4 [ Feb 28 11:59:03 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_f96ce34c-5b3d-42fa-9a17-9690acddcca7/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-02-28T11:59:03.258ZINFOcrucible-agent: dataset: "oxp_f96ce34c-5b3d-42fa-9a17-9690acddcca7/crucible"
72025-02-28T11:59:03.261ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82025-02-28T11:59:03.261ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-02-28T11:59:03.277ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-02-28T11:59:03.353ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112025-02-28T11:59:58.016ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:60393
122025-02-28T11:59:58.038ZINFOcrucible-agent (datafile): region 016adaa6-6dd9-47d6-ac8a-1eb1e26b513b state: Requested
132025-02-28T11:59:58.043ZINFOcrucible-agent (dropshot): request completed latency_us = 14188 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60393 req_id = fa26eb2c-5339-4840-9ef4-b40da8729654 response_code = 200 uri = /crucible/0/regions
142025-02-28T11:59:58.043ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-02-28T11:59:58.053ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_f96ce34c-5b3d-42fa-9a17-9690acddcca7/crucible/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
162025-02-28T11:59:58.053ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_f96ce34c-5b3d-42fa-9a17-9690acddcca7/crucible/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
172025-02-28T11:59:58.138ZINFOcrucible-agent (worker): creating region Region { id: RegionId("016adaa6-6dd9-47d6-ac8a-1eb1e26b513b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b" region = 016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
182025-02-28T11:59:58.141ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "016adaa6-6dd9-47d6-ac8a-1eb1e26b513b" "--data" "/data/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
192025-02-28T11:59:58.222ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60393 req_id = 9ca18925-a1a6-495a-b5c9-f683ab44cff6 response_code = 200 uri = /crucible/0/regions
202025-02-28T11:59:58.256ZINFOcrucible-agent (worker): region files created ok region = 016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
212025-02-28T11:59:58.257ZINFOcrucible-agent (datafile): region 016adaa6-6dd9-47d6-ac8a-1eb1e26b513b state: Requested -> Created
222025-02-28T11:59:58.257ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-02-28T11:59:58.257ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
242025-02-28T11:59:58.263ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
252025-02-28T11:59:58.272ZINFOcrucible-agent (worker): creating config property group
262025-02-28T11:59:58.275ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
272025-02-28T11:59:58.276ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
282025-02-28T11:59:58.276ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-02-28T11:59:58.276ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
302025-02-28T11:59:58.276ZINFOcrucible-agent (worker): commit
312025-02-28T11:59:58.280ZINFOcrucible-agent (worker): ok!
322025-02-28T11:59:58.295ZINFOcrucible-agent (worker): SMF ok!
332025-02-28T11:59:58.511ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60393 req_id = 1a384930-498e-4105-aa3b-c2feccf78b88 response_code = 200 uri = /crucible/0/regions
342025-02-28T11:59:59.198ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60393 req_id = dfbada71-c227-4716-bf22-ac4a81cd1dfb response_code = 200 uri = /crucible/0/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
352025-02-28T11:59:59.201ZINFOcrucible-agent (datafile): path is "/data/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b"
362025-02-28T11:59:59.212ZINFOcrucible-agent (datafile): dataset is oxp_f96ce34c-5b3d-42fa-9a17-9690acddcca7/crucible/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
372025-02-28T11:59:59.223ZINFOcrucible-agent (datafile): region 016adaa6-6dd9-47d6-ac8a-1eb1e26b513b state: Created -> Tombstoned
382025-02-28T11:59:59.223ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-02-28T11:59:59.223ZINFOcrucible-agent (dropshot): request completed latency_us = 21954 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:60393 req_id = 93491372-b4c3-4d73-8650-3ae2fc325f21 response_code = 204 uri = /crucible/0/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
402025-02-28T11:59:59.224ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-016adaa6-6dd9-47d6-ac8a-1eb1e26b513b (instance states: (Some(Online), None))
412025-02-28T11:59:59.226ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60393 req_id = d35cc00b-b319-4dac-a5e6-4c23bbbad9fb response_code = 200 uri = /crucible/0/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
422025-02-28T11:59:59.230ZINFOcrucible-agent (worker): SMF ok!
432025-02-28T11:59:59.241ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f96ce34c-5b3d-42fa-9a17-9690acddcca7/crucible/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b" region = 016adaa6-6dd9-47d6-ac8a-1eb1e26b513b
442025-02-28T11:59:59.317ZINFOcrucible-agent (datafile): region 016adaa6-6dd9-47d6-ac8a-1eb1e26b513b state: Tombstoned -> Destroyed
452025-02-28T11:59:59.345ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60393 req_id = ac504751-18d3-4d9a-a061-de6f6e7ac617 response_code = 200 uri = /crucible/0/regions/016adaa6-6dd9-47d6-ac8a-1eb1e26b513b