Max level shown:
12024-05-23T04:17:09.079ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:43361
22024-05-23T04:17:09.139ZINFOcrucible-agent (datafile): region 80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a state: Requested
32024-05-23T04:17:09.139ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-05-23T04:17:09.139ZINFOcrucible-agent (dropshot): request completed latency_us = 932 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43361 req_id = db18d1e2-b4f7-4dc1-8fae-52b1977d0645 response_code = 200 uri = /crucible/0/regions
52024-05-23T04:17:09.151ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible/regions/80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
62024-05-23T04:17:09.151ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible/regions/80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
72024-05-23T04:17:09.206ZINFOcrucible-agent (worker): creating region Region { id: RegionId("80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a" region = 80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
82024-05-23T04:17:09.208ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a" "--data" "/data/regions/80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
92024-05-23T04:17:09.271ZINFOcrucible-agent (worker): region files created ok region = 80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
102024-05-23T04:17:09.271ZINFOcrucible-agent (datafile): region 80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a state: Requested -> Created
112024-05-23T04:17:09.271ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-05-23T04:17:09.277ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/20e82801-6dae-4e12-976f-a5dc03405e0a
132024-05-23T04:17:09.277ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
142024-05-23T04:17:09.277ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
152024-05-23T04:17:09.277ZINFOcrucible-agent (worker): reconfig required
162024-05-23T04:17:09.277ZINFOcrucible-agent (worker): using existing config property group
172024-05-23T04:17:09.277ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-20e82801-6dae-4e12-976f-a5dc03405e0a
182024-05-23T04:17:09.277ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/20e82801-6dae-4e12-976f-a5dc03405e0a
192024-05-23T04:17:09.277ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
202024-05-23T04:17:09.277ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
212024-05-23T04:17:09.277ZINFOcrucible-agent (worker): commit
222024-05-23T04:17:09.283ZINFOcrucible-agent (worker): ok!
232024-05-23T04:17:09.283ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
242024-05-23T04:17:09.287ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
252024-05-23T04:17:09.298ZINFOcrucible-agent (worker): creating config property group
262024-05-23T04:17:09.300ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
272024-05-23T04:17:09.301ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/80cdbab9-dd92-4b63-b17c-e5b4b4e6d21a
282024-05-23T04:17:09.301ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
292024-05-23T04:17:09.301ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
302024-05-23T04:17:09.301ZINFOcrucible-agent (worker): commit
312024-05-23T04:17:09.304ZINFOcrucible-agent (worker): ok!
322024-05-23T04:17:09.309ZINFOcrucible-agent (worker): SMF ok!
332024-05-23T04:17:09.338ZINFOcrucible-agent (dropshot): request completed latency_us = 114 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43361 req_id = 6380fba9-36fd-40e9-9637-58ee75ce80f5 response_code = 200 uri = /crucible/0/regions
342024-05-23T04:17:09.960ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:53393
352024-05-23T04:17:09.963ZINFOcrucible-agent (dropshot): request completed latency_us = 2895 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53393 req_id = 4acaed08-da90-4aae-ae1b-66256d0f4445 response_code = 200 uri = /crucible/0/regions/20e82801-6dae-4e12-976f-a5dc03405e0a
362024-05-23T04:17:09.963ZINFOcrucible-agent (datafile): path is "/data/regions/20e82801-6dae-4e12-976f-a5dc03405e0a"
372024-05-23T04:17:09.972ZINFOcrucible-agent (datafile): dataset is oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible/regions/20e82801-6dae-4e12-976f-a5dc03405e0a
382024-05-23T04:17:09.981ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible/regions/20e82801-6dae-4e12-976f-a5dc03405e0a@ec7abecb-7823-4fde-926c-f2dd06af4fe6
392024-05-23T04:17:09.981ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible/regions/20e82801-6dae-4e12-976f-a5dc03405e0a", "ec7abecb-7823-4fde-926c-f2dd06af4fe6"]
402024-05-23T04:17:09.995ZINFOcrucible-agent (dropshot): request completed latency_us = 31940 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53393 req_id = 0b11821d-977b-4db9-a15d-34d97b712577 response_code = 200 uri = /crucible/0/regions/20e82801-6dae-4e12-976f-a5dc03405e0a/snapshots/ec7abecb-7823-4fde-926c-f2dd06af4fe6
412024-05-23T04:17:09.996ZINFOcrucible-agent (datafile): path is "/data/regions/20e82801-6dae-4e12-976f-a5dc03405e0a"
422024-05-23T04:17:10.006ZINFOcrucible-agent (datafile): dataset is oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible/regions/20e82801-6dae-4e12-976f-a5dc03405e0a
432024-05-23T04:17:10.014ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible/regions/20e82801-6dae-4e12-976f-a5dc03405e0a@ec7abecb-7823-4fde-926c-f2dd06af4fe6
442024-05-23T04:17:10.014ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible/regions/20e82801-6dae-4e12-976f-a5dc03405e0a", "ec7abecb-7823-4fde-926c-f2dd06af4fe6"]
452024-05-23T04:17:10.024ZINFOcrucible-agent (datafile): requesting running snapshot 20e82801-6dae-4e12-976f-a5dc03405e0a-ec7abecb-7823-4fde-926c-f2dd06af4fe6 state: Requested
462024-05-23T04:17:10.025ZINFOcrucible-agent (worker): applying SMF actions for region 20e82801-6dae-4e12-976f-a5dc03405e0a running snapshot ec7abecb-7823-4fde-926c-f2dd06af4fe6 (state Requested)...
472024-05-23T04:17:10.025ZINFOcrucible-agent (dropshot): request completed latency_us = 29468 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53393 req_id = 68c69f4f-1b34-443d-a1bd-485f976073f0 response_code = 200 uri = /crucible/0/regions/20e82801-6dae-4e12-976f-a5dc03405e0a/snapshots/ec7abecb-7823-4fde-926c-f2dd06af4fe6/run
482024-05-23T04:17:10.025ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/20e82801-6dae-4e12-976f-a5dc03405e0a
492024-05-23T04:17:10.025ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
502024-05-23T04:17:10.025ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
512024-05-23T04:17:10.025ZINFOcrucible-agent (worker): reconfig required
522024-05-23T04:17:10.026ZINFOcrucible-agent (worker): using existing config property group
532024-05-23T04:17:10.026ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-20e82801-6dae-4e12-976f-a5dc03405e0a
542024-05-23T04:17:10.026ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/20e82801-6dae-4e12-976f-a5dc03405e0a
552024-05-23T04:17:10.026ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
562024-05-23T04:17:10.026ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
572024-05-23T04:17:10.026ZINFOcrucible-agent (worker): commit
582024-05-23T04:17:10.030ZINFOcrucible-agent (worker): ok!
592024-05-23T04:17:10.031ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-20e82801-6dae-4e12-976f-a5dc03405e0a-ec7abecb-7823-4fde-926c-f2dd06af4fe6
602024-05-23T04:17:10.039ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-20e82801-6dae-4e12-976f-a5dc03405e0a-ec7abecb-7823-4fde-926c-f2dd06af4fe6
612024-05-23T04:17:10.047ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-20e82801-6dae-4e12-976f-a5dc03405e0a-ec7abecb-7823-4fde-926c-f2dd06af4fe6
622024-05-23T04:17:10.048ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/20e82801-6dae-4e12-976f-a5dc03405e0a/.zfs/snapshot/ec7abecb-7823-4fde-926c-f2dd06af4fe6
632024-05-23T04:17:10.048ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
642024-05-23T04:17:10.048ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
652024-05-23T04:17:10.048ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
662024-05-23T04:17:10.048ZINFOcrucible-agent (worker): commit
672024-05-23T04:17:10.051ZINFOcrucible-agent (worker): ok!
682024-05-23T04:17:10.056ZINFOcrucible-agent (worker): SMF ok!
692024-05-23T04:17:10.056ZINFOcrucible-agent (datafile): region 20e82801-6dae-4e12-976f-a5dc03405e0a running snapshot ec7abecb-7823-4fde-926c-f2dd06af4fe6 state: Requested -> Created