Max level shown:
1 [ Sep 27 04:18:19 Enabled. ]
2 [ Sep 27 04:18:19 Rereading configuration. ]
3 [ Sep 27 04:18:20 Rereading configuration. ]
4 [ Sep 27 04:18:23 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_48604733-34f0-4c7d-a800-bc2d35a9bd55/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-09-27T04:18:23.787ZINFOcrucible-agent: dataset: "oxp_48604733-34f0-4c7d-a800-bc2d35a9bd55/crucible"
72024-09-27T04:18:23.790ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-09-27T04:18:23.790ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-09-27T04:18:23.810ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-09-27T04:18:24.007ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112024-09-27T04:24:24.337ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:48415
122024-09-27T04:24:24.382ZINFOcrucible-agent (datafile): region 635f694f-c42a-4b67-9fba-2b4e16844596 state: Requested
132024-09-27T04:24:24.387ZINFOcrucible-agent (dropshot): request completed latency_us = 30747 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48415 req_id = 3bda1e26-825a-45b7-bf80-7a9c07c5a53e response_code = 200 uri = /crucible/0/regions
142024-09-27T04:24:24.392ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-09-27T04:24:24.401ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_48604733-34f0-4c7d-a800-bc2d35a9bd55/crucible/regions/635f694f-c42a-4b67-9fba-2b4e16844596
162024-09-27T04:24:24.401ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_48604733-34f0-4c7d-a800-bc2d35a9bd55/crucible/regions/635f694f-c42a-4b67-9fba-2b4e16844596
172024-09-27T04:24:24.453ZINFOcrucible-agent (worker): creating region Region { id: RegionId("635f694f-c42a-4b67-9fba-2b4e16844596"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/635f694f-c42a-4b67-9fba-2b4e16844596" region = 635f694f-c42a-4b67-9fba-2b4e16844596
182024-09-27T04:24:24.457ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "635f694f-c42a-4b67-9fba-2b4e16844596" "--data" "/data/regions/635f694f-c42a-4b67-9fba-2b4e16844596" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 635f694f-c42a-4b67-9fba-2b4e16844596
192024-09-27T04:24:24.554ZINFOcrucible-agent (dropshot): request completed latency_us = 612 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48415 req_id = bb6b684d-00fd-4aeb-a51e-692056142f3f response_code = 200 uri = /crucible/0/regions
202024-09-27T04:24:24.744ZINFOcrucible-agent (worker): region files created ok region = 635f694f-c42a-4b67-9fba-2b4e16844596
212024-09-27T04:24:24.744ZINFOcrucible-agent (datafile): region 635f694f-c42a-4b67-9fba-2b4e16844596 state: Requested -> Created
222024-09-27T04:24:24.744ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-09-27T04:24:24.747ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-635f694f-c42a-4b67-9fba-2b4e16844596
242024-09-27T04:24:24.753ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-635f694f-c42a-4b67-9fba-2b4e16844596
252024-09-27T04:24:24.768ZINFOcrucible-agent (worker): creating config property group
262024-09-27T04:24:24.771ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-635f694f-c42a-4b67-9fba-2b4e16844596
272024-09-27T04:24:24.782ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/635f694f-c42a-4b67-9fba-2b4e16844596
282024-09-27T04:24:24.784ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-09-27T04:24:24.784ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302024-09-27T04:24:24.784ZINFOcrucible-agent (worker): commit
312024-09-27T04:24:24.788ZINFOcrucible-agent (worker): ok!
322024-09-27T04:24:24.796ZINFOcrucible-agent (worker): SMF ok!
332024-09-27T04:24:25.046ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48415 req_id = a89ecbee-bdf6-40e1-9d21-820ed1b2b1a4 response_code = 200 uri = /crucible/0/regions
342024-09-27T04:24:52.297ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48415 req_id = accb89d4-2805-4216-a314-c4c010d95051 response_code = 200 uri = /crucible/0/regions/635f694f-c42a-4b67-9fba-2b4e16844596
352024-09-27T04:24:52.300ZINFOcrucible-agent (datafile): path is "/data/regions/635f694f-c42a-4b67-9fba-2b4e16844596"
362024-09-27T04:24:52.312ZINFOcrucible-agent (datafile): dataset is oxp_48604733-34f0-4c7d-a800-bc2d35a9bd55/crucible/regions/635f694f-c42a-4b67-9fba-2b4e16844596
372024-09-27T04:24:52.323ZINFOcrucible-agent (datafile): region 635f694f-c42a-4b67-9fba-2b4e16844596 state: Created -> Tombstoned
382024-09-27T04:24:52.323ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-09-27T04:24:52.323ZINFOcrucible-agent (dropshot): request completed latency_us = 23039 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:48415 req_id = 38b4cdd7-4582-4e26-8e5e-aca4ee3a9242 response_code = 204 uri = /crucible/0/regions/635f694f-c42a-4b67-9fba-2b4e16844596
402024-09-27T04:24:52.324ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-635f694f-c42a-4b67-9fba-2b4e16844596 (instance states: (Some(Online), None))
412024-09-27T04:24:52.326ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48415 req_id = 3a5fddac-4273-4188-8214-e8e64c8f5040 response_code = 200 uri = /crucible/0/regions/635f694f-c42a-4b67-9fba-2b4e16844596
422024-09-27T04:24:52.329ZINFOcrucible-agent (worker): SMF ok!
432024-09-27T04:24:52.340ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_48604733-34f0-4c7d-a800-bc2d35a9bd55/crucible/regions/635f694f-c42a-4b67-9fba-2b4e16844596" region = 635f694f-c42a-4b67-9fba-2b4e16844596
442024-09-27T04:24:52.399ZINFOcrucible-agent (datafile): region 635f694f-c42a-4b67-9fba-2b4e16844596 state: Tombstoned -> Destroyed
452024-09-27T04:24:52.419ZINFOcrucible-agent (dropshot): request completed latency_us = 631 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48415 req_id = 5f724c68-146f-465d-ac7a-39463fd5c6e3 response_code = 200 uri = /crucible/0/regions/635f694f-c42a-4b67-9fba-2b4e16844596