Max level shown:
1 [ Dec 19 21:41:13 Enabled. ]
2 [ Dec 19 21:41:13 Rereading configuration. ]
3 [ Dec 19 21:41:15 Rereading configuration. ]
4 [ Dec 19 21:41:20 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-19T21:41:20.553ZINFOcrucible-agent: dataset: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible"
72024-12-19T21:41:20.556ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-12-19T21:41:20.556ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-19T21:41:20.572ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-19T21:41:20.988ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-12-19T21:41:50.116ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:64750
122024-12-19T21:41:50.144ZINFOcrucible-agent (datafile): region 26af22e0-202e-497e-9eb4-7eb1976cb69f state: Requested
132024-12-19T21:41:50.149ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-12-19T21:41:50.155ZINFOcrucible-agent (dropshot): request completed latency_us = 14498 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64750 req_id = 94ab5927-7da2-4381-b4ee-49fe0e6aa86d response_code = 200 uri = /crucible/0/regions
152024-12-19T21:41:50.162ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
162024-12-19T21:41:50.162ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
172024-12-19T21:41:50.278ZINFOcrucible-agent (worker): creating region Region { id: RegionId("26af22e0-202e-497e-9eb4-7eb1976cb69f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f" region = 26af22e0-202e-497e-9eb4-7eb1976cb69f
182024-12-19T21:41:50.280ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "26af22e0-202e-497e-9eb4-7eb1976cb69f" "--data" "/data/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 26af22e0-202e-497e-9eb4-7eb1976cb69f
192024-12-19T21:41:50.405ZINFOcrucible-agent (worker): region files created ok region = 26af22e0-202e-497e-9eb4-7eb1976cb69f
202024-12-19T21:41:50.405ZINFOcrucible-agent (datafile): region 26af22e0-202e-497e-9eb4-7eb1976cb69f state: Requested -> Created
212024-12-19T21:41:50.405ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-12-19T21:41:50.406ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-26af22e0-202e-497e-9eb4-7eb1976cb69f
232024-12-19T21:41:50.418ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-26af22e0-202e-497e-9eb4-7eb1976cb69f
242024-12-19T21:41:50.446ZINFOcrucible-agent (worker): creating config property group
252024-12-19T21:41:50.451ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-26af22e0-202e-497e-9eb4-7eb1976cb69f
262024-12-19T21:41:50.452ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
272024-12-19T21:41:50.452ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-12-19T21:41:50.452ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
292024-12-19T21:41:50.452ZINFOcrucible-agent (worker): commit
302024-12-19T21:41:50.453ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64750 req_id = 0d6a52dd-b842-4944-a8ba-566ce850574b response_code = 200 uri = /crucible/0/regions
312024-12-19T21:41:50.458ZINFOcrucible-agent (worker): ok!
322024-12-19T21:41:50.466ZINFOcrucible-agent (worker): SMF ok!
332024-12-19T21:41:51.509ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64750 req_id = d4f8a6e3-b7f4-41ce-ba08-c20d1bee5ccb response_code = 200 uri = /crucible/0/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
342024-12-19T21:41:51.513ZINFOcrucible-agent (datafile): path is "/data/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f"
352024-12-19T21:41:51.526ZINFOcrucible-agent (datafile): dataset is oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
362024-12-19T21:41:51.538ZINFOcrucible-agent (datafile): region 26af22e0-202e-497e-9eb4-7eb1976cb69f state: Created -> Tombstoned
372024-12-19T21:41:51.538ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-12-19T21:41:51.538ZINFOcrucible-agent (dropshot): request completed latency_us = 24735 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:64750 req_id = 6896b114-d554-439b-9866-5516e473a0d3 response_code = 204 uri = /crucible/0/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
392024-12-19T21:41:51.539ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-26af22e0-202e-497e-9eb4-7eb1976cb69f (instance states: (Some(Online), None))
402024-12-19T21:41:51.542ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64750 req_id = 758aa91e-d33b-4398-ab3c-a20dbba2dc02 response_code = 200 uri = /crucible/0/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
412024-12-19T21:41:51.549ZINFOcrucible-agent (worker): SMF ok!
422024-12-19T21:41:51.562ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f" region = 26af22e0-202e-497e-9eb4-7eb1976cb69f
432024-12-19T21:41:51.627ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64750 req_id = b8f9594e-0581-4516-b676-a1ac5e232e6c response_code = 200 uri = /crucible/0/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
442024-12-19T21:41:51.692ZINFOcrucible-agent (datafile): region 26af22e0-202e-497e-9eb4-7eb1976cb69f state: Tombstoned -> Destroyed
452024-12-19T21:41:51.702ZINFOcrucible-agent (dropshot): request completed latency_us = 42 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64750 req_id = aa2920b8-300a-4bbe-9110-e1b3db432e57 response_code = 200 uri = /crucible/0/regions/26af22e0-202e-497e-9eb4-7eb1976cb69f
462024-12-19T21:41:53.912ZINFOcrucible-agent (datafile): region c2e08d21-26f5-4194-9a2c-235f9413967f state: Requested
472024-12-19T21:41:53.913ZINFOcrucible-agent (dropshot): request completed latency_us = 223 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64750 req_id = 88936630-04f4-4d37-aa0d-3181e9a80cca response_code = 200 uri = /crucible/0/regions
482024-12-19T21:41:53.913ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-12-19T21:41:53.921ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f
502024-12-19T21:41:53.921ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible/regions/c2e08d21-26f5-4194-9a2c-235f9413967f
512024-12-19T21:41:54.014ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c2e08d21-26f5-4194-9a2c-235f9413967f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c2e08d21-26f5-4194-9a2c-235f9413967f" region = c2e08d21-26f5-4194-9a2c-235f9413967f
522024-12-19T21:41:54.014ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c2e08d21-26f5-4194-9a2c-235f9413967f" "--data" "/data/regions/c2e08d21-26f5-4194-9a2c-235f9413967f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c2e08d21-26f5-4194-9a2c-235f9413967f
532024-12-19T21:41:54.091ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64750 req_id = 84dfc1a9-929e-4588-aa75-628197734a5f response_code = 200 uri = /crucible/0/regions
542024-12-19T21:41:54.092ZINFOcrucible-agent (worker): region files created ok region = c2e08d21-26f5-4194-9a2c-235f9413967f
552024-12-19T21:41:54.092ZINFOcrucible-agent (datafile): region c2e08d21-26f5-4194-9a2c-235f9413967f state: Requested -> Created
562024-12-19T21:41:54.092ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-12-19T21:41:54.094ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c2e08d21-26f5-4194-9a2c-235f9413967f
582024-12-19T21:41:54.097ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c2e08d21-26f5-4194-9a2c-235f9413967f
592024-12-19T21:41:54.106ZINFOcrucible-agent (worker): creating config property group
602024-12-19T21:41:54.113ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c2e08d21-26f5-4194-9a2c-235f9413967f
612024-12-19T21:41:54.114ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c2e08d21-26f5-4194-9a2c-235f9413967f
622024-12-19T21:41:54.114ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-12-19T21:41:54.114ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
642024-12-19T21:41:54.114ZINFOcrucible-agent (worker): commit
652024-12-19T21:41:54.120ZINFOcrucible-agent (worker): ok!
662024-12-19T21:41:54.125ZINFOcrucible-agent (worker): SMF ok!
672024-12-19T21:41:54.585ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64750 req_id = 5337602f-60a1-4e55-9216-6a260373a0f2 response_code = 200 uri = /crucible/0/regions