Max level shown:
12024-12-21T07:15:32.154ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:60478
22024-12-21T07:15:32.201ZINFOcrucible-agent (datafile): region cd9559ab-a451-45ae-b6bf-465b39be539b state: Requested
32024-12-21T07:15:32.207ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-21T07:15:32.212ZINFOcrucible-agent (dropshot): request completed latency_us = 18269 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60478 req_id = f8593afc-d8f3-4fe4-bd99-819a4bac5441 response_code = 200 uri = /crucible/0/regions
52024-12-21T07:15:32.219ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b
62024-12-21T07:15:32.219ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b
72024-12-21T07:15:32.280ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cd9559ab-a451-45ae-b6bf-465b39be539b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cd9559ab-a451-45ae-b6bf-465b39be539b" region = cd9559ab-a451-45ae-b6bf-465b39be539b
82024-12-21T07:15:32.283ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cd9559ab-a451-45ae-b6bf-465b39be539b" "--data" "/data/regions/cd9559ab-a451-45ae-b6bf-465b39be539b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cd9559ab-a451-45ae-b6bf-465b39be539b
92024-12-21T07:15:32.576ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60478 req_id = 1a157fc7-1983-4bf4-b3a9-69b42790915b response_code = 200 uri = /crucible/0/regions
102024-12-21T07:15:32.626ZINFOcrucible-agent (worker): region files created ok region = cd9559ab-a451-45ae-b6bf-465b39be539b
112024-12-21T07:15:32.627ZINFOcrucible-agent (datafile): region cd9559ab-a451-45ae-b6bf-465b39be539b state: Requested -> Created
122024-12-21T07:15:32.627ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-12-21T07:15:32.627ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cd9559ab-a451-45ae-b6bf-465b39be539b
142024-12-21T07:15:32.634ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cd9559ab-a451-45ae-b6bf-465b39be539b
152024-12-21T07:15:32.648ZINFOcrucible-agent (worker): creating config property group
162024-12-21T07:15:32.651ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cd9559ab-a451-45ae-b6bf-465b39be539b
172024-12-21T07:15:32.652ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cd9559ab-a451-45ae-b6bf-465b39be539b
182024-12-21T07:15:32.652ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-12-21T07:15:32.652ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202024-12-21T07:15:32.652ZINFOcrucible-agent (worker): commit
212024-12-21T07:15:32.657ZINFOcrucible-agent (worker): ok!
222024-12-21T07:15:32.661ZINFOcrucible-agent (worker): SMF ok!
232024-12-21T07:15:33.019ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60478 req_id = d7295de9-739c-4a8b-a8c6-6958dcfc1c43 response_code = 200 uri = /crucible/0/regions
242024-12-21T07:26:24.083ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:37400
252024-12-21T07:26:24.086ZINFOcrucible-agent (dropshot): request completed latency_us = 2921 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37400 req_id = f73ea457-b9aa-4a84-9502-5384af0a6ff2 response_code = 200 uri = /crucible/0/regions/cd9559ab-a451-45ae-b6bf-465b39be539b
262024-12-21T07:26:24.090ZINFOcrucible-agent (datafile): path is "/data/regions/cd9559ab-a451-45ae-b6bf-465b39be539b"
272024-12-21T07:26:24.099ZINFOcrucible-agent (datafile): dataset is oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b
282024-12-21T07:26:24.108ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b@7f7566db-9859-4847-b89f-c07e9599a3b1
292024-12-21T07:26:24.108ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b", "7f7566db-9859-4847-b89f-c07e9599a3b1"]
302024-12-21T07:26:24.119ZINFOcrucible-agent (dropshot): request completed latency_us = 29402 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37400 req_id = e31a95df-1f4f-4029-bbf0-d3a9ba6e390a response_code = 200 uri = /crucible/0/regions/cd9559ab-a451-45ae-b6bf-465b39be539b/snapshots/7f7566db-9859-4847-b89f-c07e9599a3b1
312024-12-21T07:26:24.123ZINFOcrucible-agent (datafile): path is "/data/regions/cd9559ab-a451-45ae-b6bf-465b39be539b"
322024-12-21T07:26:24.132ZINFOcrucible-agent (datafile): dataset is oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b
332024-12-21T07:26:24.140ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b@7f7566db-9859-4847-b89f-c07e9599a3b1
342024-12-21T07:26:24.140ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b", "7f7566db-9859-4847-b89f-c07e9599a3b1"]
352024-12-21T07:26:24.148ZINFOcrucible-agent (datafile): requesting running snapshot cd9559ab-a451-45ae-b6bf-465b39be539b-7f7566db-9859-4847-b89f-c07e9599a3b1 state: Requested
362024-12-21T07:26:24.149ZINFOcrucible-agent (worker): applying SMF actions for region cd9559ab-a451-45ae-b6bf-465b39be539b running snapshot 7f7566db-9859-4847-b89f-c07e9599a3b1 (state Requested)...
372024-12-21T07:26:24.149ZINFOcrucible-agent (dropshot): request completed latency_us = 26079 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37400 req_id = 44a51c58-410b-43e1-8b99-596b53a1175d response_code = 200 uri = /crucible/0/regions/cd9559ab-a451-45ae-b6bf-465b39be539b/snapshots/7f7566db-9859-4847-b89f-c07e9599a3b1/run
382024-12-21T07:26:24.158ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-cd9559ab-a451-45ae-b6bf-465b39be539b-7f7566db-9859-4847-b89f-c07e9599a3b1
392024-12-21T07:26:24.163ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-cd9559ab-a451-45ae-b6bf-465b39be539b-7f7566db-9859-4847-b89f-c07e9599a3b1
402024-12-21T07:26:24.175ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-cd9559ab-a451-45ae-b6bf-465b39be539b-7f7566db-9859-4847-b89f-c07e9599a3b1
412024-12-21T07:26:24.176ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cd9559ab-a451-45ae-b6bf-465b39be539b/.zfs/snapshot/7f7566db-9859-4847-b89f-c07e9599a3b1
422024-12-21T07:26:24.176ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432024-12-21T07:26:24.176ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442024-12-21T07:26:24.176ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
452024-12-21T07:26:24.176ZINFOcrucible-agent (worker): commit
462024-12-21T07:26:24.180ZINFOcrucible-agent (worker): ok!
472024-12-21T07:26:24.185ZINFOcrucible-agent (worker): SMF ok!
482024-12-21T07:26:24.185ZINFOcrucible-agent (datafile): region cd9559ab-a451-45ae-b6bf-465b39be539b running snapshot 7f7566db-9859-4847-b89f-c07e9599a3b1 state: Requested -> Created
492024-12-21T07:26:24.451ZINFOcrucible-agent (datafile): path is "/data/regions/cd9559ab-a451-45ae-b6bf-465b39be539b"
502024-12-21T07:26:24.460ZINFOcrucible-agent (datafile): dataset is oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b
512024-12-21T07:26:24.469ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b@7f7566db-9859-4847-b89f-c07e9599a3b1
522024-12-21T07:26:24.469ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fadfb876-c963-4445-9c43-71efe781331c/crucible/regions/cd9559ab-a451-45ae-b6bf-465b39be539b", "7f7566db-9859-4847-b89f-c07e9599a3b1"]
532024-12-21T07:26:24.477ZINFOcrucible-agent (dropshot): request completed latency_us = 26198 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37400 req_id = e68377e4-1570-4032-bb66-be4e71445f53 response_code = 200 uri = /crucible/0/regions/cd9559ab-a451-45ae-b6bf-465b39be539b/snapshots/7f7566db-9859-4847-b89f-c07e9599a3b1/run