Max level shown:
12024-05-14T04:18:43.270ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:61342
22024-05-14T04:18:43.330ZINFOcrucible-agent (datafile): region bd522f1b-7829-4bf2-8783-ff498b118147 state: Requested
32024-05-14T04:18:43.334ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-05-14T04:18:43.334ZINFOcrucible-agent (dropshot): request completed latency_us = 3678 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61342 req_id = 289870b7-b95d-4a18-9581-0389df9bbd3e response_code = 200 uri = /crucible/0/regions
52024-05-14T04:18:43.343ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c2258885-c5c9-4963-9582-ed47aee72863/crucible/regions/bd522f1b-7829-4bf2-8783-ff498b118147
62024-05-14T04:18:43.343ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c2258885-c5c9-4963-9582-ed47aee72863/crucible/regions/bd522f1b-7829-4bf2-8783-ff498b118147
72024-05-14T04:18:43.391ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bd522f1b-7829-4bf2-8783-ff498b118147"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bd522f1b-7829-4bf2-8783-ff498b118147" region = bd522f1b-7829-4bf2-8783-ff498b118147
82024-05-14T04:18:43.391ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bd522f1b-7829-4bf2-8783-ff498b118147" "--data" "/data/regions/bd522f1b-7829-4bf2-8783-ff498b118147" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = bd522f1b-7829-4bf2-8783-ff498b118147
92024-05-14T04:18:43.453ZINFOcrucible-agent (worker): region files created ok region = bd522f1b-7829-4bf2-8783-ff498b118147
102024-05-14T04:18:43.454ZINFOcrucible-agent (datafile): region bd522f1b-7829-4bf2-8783-ff498b118147 state: Requested -> Created
112024-05-14T04:18:43.454ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-05-14T04:18:43.464ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
132024-05-14T04:18:43.464ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
142024-05-14T04:18:43.464ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
152024-05-14T04:18:43.464ZINFOcrucible-agent (worker): reconfig required
162024-05-14T04:18:43.465ZINFOcrucible-agent (worker): using existing config property group
172024-05-14T04:18:43.465ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
182024-05-14T04:18:43.465ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
192024-05-14T04:18:43.465ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
202024-05-14T04:18:43.465ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
212024-05-14T04:18:43.465ZINFOcrucible-agent (worker): commit
222024-05-14T04:18:43.471ZINFOcrucible-agent (worker): ok!
232024-05-14T04:18:43.472ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bd522f1b-7829-4bf2-8783-ff498b118147
242024-05-14T04:18:43.475ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bd522f1b-7829-4bf2-8783-ff498b118147
252024-05-14T04:18:43.483ZINFOcrucible-agent (worker): creating config property group
262024-05-14T04:18:43.486ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bd522f1b-7829-4bf2-8783-ff498b118147
272024-05-14T04:18:43.486ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bd522f1b-7829-4bf2-8783-ff498b118147
282024-05-14T04:18:43.486ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
292024-05-14T04:18:43.486ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
302024-05-14T04:18:43.487ZINFOcrucible-agent (worker): commit
312024-05-14T04:18:43.489ZINFOcrucible-agent (worker): ok!
322024-05-14T04:18:43.493ZINFOcrucible-agent (worker): SMF ok!
332024-05-14T04:18:43.650ZINFOcrucible-agent (dropshot): request completed latency_us = 100 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61342 req_id = b0ed55c6-e9aa-46c5-8472-be66c909c4dc response_code = 200 uri = /crucible/0/regions
342024-05-14T04:18:44.369ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:45557
352024-05-14T04:18:44.369ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45557 req_id = 8c5dcd1c-3259-4d8b-98ce-fed57306db3c response_code = 200 uri = /crucible/0/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
362024-05-14T04:18:44.370ZINFOcrucible-agent (datafile): path is "/data/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d"
372024-05-14T04:18:44.378ZINFOcrucible-agent (datafile): dataset is oxp_c2258885-c5c9-4963-9582-ed47aee72863/crucible/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
382024-05-14T04:18:44.387ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c2258885-c5c9-4963-9582-ed47aee72863/crucible/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d@6645342d-f69d-4fc4-9f31-4f4877cb4df6
392024-05-14T04:18:44.387ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c2258885-c5c9-4963-9582-ed47aee72863/crucible/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d", "6645342d-f69d-4fc4-9f31-4f4877cb4df6"]
402024-05-14T04:18:44.404ZINFOcrucible-agent (dropshot): request completed latency_us = 33970 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45557 req_id = 66572225-01e0-421a-83f5-ddfdf4e78ec8 response_code = 200 uri = /crucible/0/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d/snapshots/6645342d-f69d-4fc4-9f31-4f4877cb4df6
412024-05-14T04:18:44.404ZINFOcrucible-agent (datafile): path is "/data/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d"
422024-05-14T04:18:44.412ZINFOcrucible-agent (datafile): dataset is oxp_c2258885-c5c9-4963-9582-ed47aee72863/crucible/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
432024-05-14T04:18:44.419ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c2258885-c5c9-4963-9582-ed47aee72863/crucible/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d@6645342d-f69d-4fc4-9f31-4f4877cb4df6
442024-05-14T04:18:44.419ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c2258885-c5c9-4963-9582-ed47aee72863/crucible/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d", "6645342d-f69d-4fc4-9f31-4f4877cb4df6"]
452024-05-14T04:18:44.428ZINFOcrucible-agent (datafile): requesting running snapshot 341b909d-9a7c-48ad-8fe3-7ad6ab5f880d-6645342d-f69d-4fc4-9f31-4f4877cb4df6 state: Requested
462024-05-14T04:18:44.429ZINFOcrucible-agent (worker): applying SMF actions for region 341b909d-9a7c-48ad-8fe3-7ad6ab5f880d running snapshot 6645342d-f69d-4fc4-9f31-4f4877cb4df6 (state Requested)...
472024-05-14T04:18:44.429ZINFOcrucible-agent (dropshot): request completed latency_us = 24932 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45557 req_id = 186034f5-e271-4b58-8a0d-b67d2cb4d9fd response_code = 200 uri = /crucible/0/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d/snapshots/6645342d-f69d-4fc4-9f31-4f4877cb4df6/run
482024-05-14T04:18:44.429ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
492024-05-14T04:18:44.429ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
502024-05-14T04:18:44.430ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
512024-05-14T04:18:44.430ZINFOcrucible-agent (worker): reconfig required
522024-05-14T04:18:44.430ZINFOcrucible-agent (worker): using existing config property group
532024-05-14T04:18:44.430ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
542024-05-14T04:18:44.430ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d
552024-05-14T04:18:44.430ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
562024-05-14T04:18:44.430ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
572024-05-14T04:18:44.430ZINFOcrucible-agent (worker): commit
582024-05-14T04:18:44.433ZINFOcrucible-agent (worker): ok!
592024-05-14T04:18:44.435ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-341b909d-9a7c-48ad-8fe3-7ad6ab5f880d-6645342d-f69d-4fc4-9f31-4f4877cb4df6
602024-05-14T04:18:44.440ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-341b909d-9a7c-48ad-8fe3-7ad6ab5f880d-6645342d-f69d-4fc4-9f31-4f4877cb4df6
612024-05-14T04:18:44.448ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-341b909d-9a7c-48ad-8fe3-7ad6ab5f880d-6645342d-f69d-4fc4-9f31-4f4877cb4df6
622024-05-14T04:18:44.449ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/341b909d-9a7c-48ad-8fe3-7ad6ab5f880d/.zfs/snapshot/6645342d-f69d-4fc4-9f31-4f4877cb4df6
632024-05-14T04:18:44.449ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
642024-05-14T04:18:44.449ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-05-14T04:18:44.449ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
662024-05-14T04:18:44.449ZINFOcrucible-agent (worker): commit
672024-05-14T04:18:44.453ZINFOcrucible-agent (worker): ok!
682024-05-14T04:18:44.456ZINFOcrucible-agent (worker): SMF ok!
692024-05-14T04:18:44.456ZINFOcrucible-agent (datafile): region 341b909d-9a7c-48ad-8fe3-7ad6ab5f880d running snapshot 6645342d-f69d-4fc4-9f31-4f4877cb4df6 state: Requested -> Created