Max level shown:
1 [ Dec 12 22:34:12 Enabled. ]
2 [ Dec 12 22:34:12 Rereading configuration. ]
3 [ Dec 12 22:34:14 Rereading configuration. ]
4 [ Dec 12 22:34:18 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-12T22:34:18.718ZINFOcrucible-agent: dataset: "oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible"
72024-12-12T22:34:18.722ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-12-12T22:34:18.722ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-12T22:34:18.740ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-12T22:34:18.812ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112024-12-12T22:34:42.393ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:53324
122024-12-12T22:34:42.410ZINFOcrucible-agent (datafile): region a2305878-ac55-4959-a16b-25869678b69d state: Requested
132024-12-12T22:34:42.412ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-12-12T22:34:42.412ZINFOcrucible-agent (dropshot): request completed latency_us = 6640 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53324 req_id = b6d1a443-4bdf-4f86-916a-86732f7abcdd response_code = 200 uri = /crucible/0/regions
152024-12-12T22:34:42.422ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible/regions/a2305878-ac55-4959-a16b-25869678b69d
162024-12-12T22:34:42.422ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible/regions/a2305878-ac55-4959-a16b-25869678b69d
172024-12-12T22:34:42.511ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a2305878-ac55-4959-a16b-25869678b69d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a2305878-ac55-4959-a16b-25869678b69d" region = a2305878-ac55-4959-a16b-25869678b69d
182024-12-12T22:34:42.512ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a2305878-ac55-4959-a16b-25869678b69d" "--data" "/data/regions/a2305878-ac55-4959-a16b-25869678b69d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = a2305878-ac55-4959-a16b-25869678b69d
192024-12-12T22:34:42.573ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53324 req_id = 744b7cac-d695-4c8e-bd9d-3ed81d79ffb1 response_code = 200 uri = /crucible/0/regions
202024-12-12T22:34:42.721ZINFOcrucible-agent (worker): region files created ok region = a2305878-ac55-4959-a16b-25869678b69d
212024-12-12T22:34:42.721ZINFOcrucible-agent (datafile): region a2305878-ac55-4959-a16b-25869678b69d state: Requested -> Created
222024-12-12T22:34:42.721ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-12-12T22:34:42.722ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a2305878-ac55-4959-a16b-25869678b69d
242024-12-12T22:34:42.727ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a2305878-ac55-4959-a16b-25869678b69d
252024-12-12T22:34:42.739ZINFOcrucible-agent (worker): creating config property group
262024-12-12T22:34:42.742ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a2305878-ac55-4959-a16b-25869678b69d
272024-12-12T22:34:42.743ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a2305878-ac55-4959-a16b-25869678b69d
282024-12-12T22:34:42.743ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-12-12T22:34:42.743ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302024-12-12T22:34:42.743ZINFOcrucible-agent (worker): commit
312024-12-12T22:34:42.746ZINFOcrucible-agent (worker): ok!
322024-12-12T22:34:42.750ZINFOcrucible-agent (worker): SMF ok!
332024-12-12T22:34:43.164ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:53324 req_id = 3071b109-e7c4-4547-b6f5-1894b4148bab response_code = 200 uri = /crucible/0/regions
342024-12-12T22:34:43.456ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53324 req_id = 16d11404-f40b-4a17-a046-99953b5ad6a7 response_code = 200 uri = /crucible/0/regions/a2305878-ac55-4959-a16b-25869678b69d
352024-12-12T22:34:43.460ZINFOcrucible-agent (datafile): path is "/data/regions/a2305878-ac55-4959-a16b-25869678b69d"
362024-12-12T22:34:43.471ZINFOcrucible-agent (datafile): dataset is oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible/regions/a2305878-ac55-4959-a16b-25869678b69d
372024-12-12T22:34:43.481ZINFOcrucible-agent (datafile): region a2305878-ac55-4959-a16b-25869678b69d state: Created -> Tombstoned
382024-12-12T22:34:43.481ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-12-12T22:34:43.481ZINFOcrucible-agent (dropshot): request completed latency_us = 21419 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:53324 req_id = 18ed4388-7491-49cc-b04b-efefc63c8e25 response_code = 204 uri = /crucible/0/regions/a2305878-ac55-4959-a16b-25869678b69d
402024-12-12T22:34:43.482ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-a2305878-ac55-4959-a16b-25869678b69d (instance states: (Some(Online), None))
412024-12-12T22:34:43.484ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53324 req_id = eb4e18b2-6493-4fd6-89e9-ca3f29f93bf3 response_code = 200 uri = /crucible/0/regions/a2305878-ac55-4959-a16b-25869678b69d
422024-12-12T22:34:43.487ZINFOcrucible-agent (worker): SMF ok!
432024-12-12T22:34:43.498ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible/regions/a2305878-ac55-4959-a16b-25869678b69d" region = a2305878-ac55-4959-a16b-25869678b69d
442024-12-12T22:34:43.567ZINFOcrucible-agent (datafile): region a2305878-ac55-4959-a16b-25869678b69d state: Tombstoned -> Destroyed
452024-12-12T22:34:43.615ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53324 req_id = 925edbcc-57a3-4687-bf9e-acd10928533d response_code = 200 uri = /crucible/0/regions/a2305878-ac55-4959-a16b-25869678b69d
462024-12-12T22:35:27.446ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:43940
472024-12-12T22:35:27.446ZINFOcrucible-agent (datafile): region 78edf723-0bdd-4eea-9681-b6cadfdc9368 state: Requested
482024-12-12T22:35:27.446ZINFOcrucible-agent (dropshot): request completed latency_us = 199 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43940 req_id = 8e7ae23d-8d6c-43ff-ad56-9f9b11fac7b1 response_code = 200 uri = /crucible/0/regions
492024-12-12T22:35:27.446ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502024-12-12T22:35:27.456ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible/regions/78edf723-0bdd-4eea-9681-b6cadfdc9368
512024-12-12T22:35:27.456ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible/regions/78edf723-0bdd-4eea-9681-b6cadfdc9368
522024-12-12T22:35:27.513ZINFOcrucible-agent (worker): creating region Region { id: RegionId("78edf723-0bdd-4eea-9681-b6cadfdc9368"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/78edf723-0bdd-4eea-9681-b6cadfdc9368" region = 78edf723-0bdd-4eea-9681-b6cadfdc9368
532024-12-12T22:35:27.517ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "78edf723-0bdd-4eea-9681-b6cadfdc9368" "--data" "/data/regions/78edf723-0bdd-4eea-9681-b6cadfdc9368" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 78edf723-0bdd-4eea-9681-b6cadfdc9368
542024-12-12T22:35:27.592ZINFOcrucible-agent (worker): region files created ok region = 78edf723-0bdd-4eea-9681-b6cadfdc9368
552024-12-12T22:35:27.592ZINFOcrucible-agent (datafile): region 78edf723-0bdd-4eea-9681-b6cadfdc9368 state: Requested -> Created
562024-12-12T22:35:27.592ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-12-12T22:35:27.594ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-78edf723-0bdd-4eea-9681-b6cadfdc9368
582024-12-12T22:35:27.598ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-78edf723-0bdd-4eea-9681-b6cadfdc9368
592024-12-12T22:35:27.608ZINFOcrucible-agent (worker): creating config property group
602024-12-12T22:35:27.614ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-78edf723-0bdd-4eea-9681-b6cadfdc9368
612024-12-12T22:35:27.615ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/78edf723-0bdd-4eea-9681-b6cadfdc9368
622024-12-12T22:35:27.615ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-12-12T22:35:27.615ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
642024-12-12T22:35:27.615ZINFOcrucible-agent (worker): commit
652024-12-12T22:35:27.622ZINFOcrucible-agent (worker): ok!
662024-12-12T22:35:27.631ZINFOcrucible-agent (worker): SMF ok!
672024-12-12T22:35:27.774ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43940 req_id = c31c79ea-ffeb-4f0d-a3f1-ada7817339fa response_code = 200 uri = /crucible/0/regions