Max level shown:
12024-02-04T18:30:29.703ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:58204
22024-02-04T18:30:29.735ZINFOcrucible-agent (datafile): region 340a3223-2c66-4d5a-8f4d-cd21b7ec67fb state: Requested
32024-02-04T18:30:29.738ZINFOcrucible-agent (dropshot): request completed latency_us = 4227 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58204 req_id = 8aa8cba1-6d8d-4411-b8bd-2edcbbc7d709 response_code = 200 uri = /crucible/0/regions
42024-02-04T18:30:29.738ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-02-04T18:30:29.749ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/340a3223-2c66-4d5a-8f4d-cd21b7ec67fb
62024-02-04T18:30:29.749ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/340a3223-2c66-4d5a-8f4d-cd21b7ec67fb
72024-02-04T18:30:29.811ZINFOcrucible-agent (worker): creating region Region { id: RegionId("340a3223-2c66-4d5a-8f4d-cd21b7ec67fb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/340a3223-2c66-4d5a-8f4d-cd21b7ec67fb" region = 340a3223-2c66-4d5a-8f4d-cd21b7ec67fb
82024-02-04T18:30:29.891ZINFOcrucible-agent (worker): region files created ok region = 340a3223-2c66-4d5a-8f4d-cd21b7ec67fb
92024-02-04T18:30:29.891ZINFOcrucible-agent (datafile): region 340a3223-2c66-4d5a-8f4d-cd21b7ec67fb state: Requested -> Created
102024-02-04T18:30:29.891ZINFOcrucible-agent (worker): applying SMF actions post create...
112024-02-04T18:30:29.892ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-340a3223-2c66-4d5a-8f4d-cd21b7ec67fb
122024-02-04T18:30:29.896ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-340a3223-2c66-4d5a-8f4d-cd21b7ec67fb
132024-02-04T18:30:29.912ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58204 req_id = 785e490f-f18e-4704-bd22-c12d1581d573 response_code = 200 uri = /crucible/0/regions
142024-02-04T18:30:29.912ZINFOcrucible-agent (worker): creating config property group
152024-02-04T18:30:29.915ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-340a3223-2c66-4d5a-8f4d-cd21b7ec67fb
162024-02-04T18:30:29.915ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/340a3223-2c66-4d5a-8f4d-cd21b7ec67fb
172024-02-04T18:30:29.915ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-02-04T18:30:29.916ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192024-02-04T18:30:29.916ZINFOcrucible-agent (worker): commit
202024-02-04T18:30:29.919ZINFOcrucible-agent (worker): ok!
212024-02-04T18:30:29.924ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864
222024-02-04T18:30:29.924ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
232024-02-04T18:30:29.924ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
242024-02-04T18:30:29.924ZINFOcrucible-agent (worker): reconfig required
252024-02-04T18:30:29.924ZINFOcrucible-agent (worker): using existing config property group
262024-02-04T18:30:29.924ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ab2bf2a4-be12-44cf-adec-4504bf7fc864
272024-02-04T18:30:29.925ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864
282024-02-04T18:30:29.925ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-02-04T18:30:29.925ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302024-02-04T18:30:29.925ZINFOcrucible-agent (worker): commit
312024-02-04T18:30:29.936ZINFOcrucible-agent (worker): ok!
322024-02-04T18:30:29.936ZINFOcrucible-agent (worker): SMF ok!
332024-02-04T18:30:30.699ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:57922
342024-02-04T18:30:30.699ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57922 req_id = 56d2d08f-d219-40c4-b99e-cd455d8700d8 response_code = 200 uri = /crucible/0/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864
352024-02-04T18:30:30.701ZINFOcrucible-agent (datafile): path is "/data/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864"
362024-02-04T18:30:30.710ZINFOcrucible-agent (datafile): dataset is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864
372024-02-04T18:30:30.719ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864@a4ec9a18-f661-45e4-b717-edc4e9e22dcd
382024-02-04T18:30:30.719ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864", "a4ec9a18-f661-45e4-b717-edc4e9e22dcd"]
392024-02-04T18:30:30.726ZINFOcrucible-agent (dropshot): request completed latency_us = 27142 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57922 req_id = 345734a8-b37d-4bc2-8cad-d5f05cdda596 response_code = 200 uri = /crucible/0/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864/snapshots/a4ec9a18-f661-45e4-b717-edc4e9e22dcd
402024-02-04T18:30:30.727ZINFOcrucible-agent (datafile): path is "/data/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864"
412024-02-04T18:30:30.734ZINFOcrucible-agent (datafile): dataset is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864
422024-02-04T18:30:30.742ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864@a4ec9a18-f661-45e4-b717-edc4e9e22dcd
432024-02-04T18:30:30.742ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864", "a4ec9a18-f661-45e4-b717-edc4e9e22dcd"]
442024-02-04T18:30:30.751ZINFOcrucible-agent (datafile): requesting running snapshot ab2bf2a4-be12-44cf-adec-4504bf7fc864-a4ec9a18-f661-45e4-b717-edc4e9e22dcd state: Requested
452024-02-04T18:30:30.751ZINFOcrucible-agent (worker): applying SMF actions for region ab2bf2a4-be12-44cf-adec-4504bf7fc864 running snapshot a4ec9a18-f661-45e4-b717-edc4e9e22dcd (state Requested)...
462024-02-04T18:30:30.751ZINFOcrucible-agent (dropshot): request completed latency_us = 24602 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57922 req_id = 7136ec18-4d59-4f2a-9da4-3194795c0db4 response_code = 200 uri = /crucible/0/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864/snapshots/a4ec9a18-f661-45e4-b717-edc4e9e22dcd/run
472024-02-04T18:30:30.752ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864
482024-02-04T18:30:30.752ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
492024-02-04T18:30:30.753ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
502024-02-04T18:30:30.753ZINFOcrucible-agent (worker): reconfig required
512024-02-04T18:30:30.753ZINFOcrucible-agent (worker): using existing config property group
522024-02-04T18:30:30.753ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ab2bf2a4-be12-44cf-adec-4504bf7fc864
532024-02-04T18:30:30.753ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864
542024-02-04T18:30:30.753ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
552024-02-04T18:30:30.753ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
562024-02-04T18:30:30.753ZINFOcrucible-agent (worker): commit
572024-02-04T18:30:30.757ZINFOcrucible-agent (worker): ok!
582024-02-04T18:30:30.757ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-ab2bf2a4-be12-44cf-adec-4504bf7fc864-a4ec9a18-f661-45e4-b717-edc4e9e22dcd
592024-02-04T18:30:30.763ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-ab2bf2a4-be12-44cf-adec-4504bf7fc864-a4ec9a18-f661-45e4-b717-edc4e9e22dcd
602024-02-04T18:30:30.773ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-ab2bf2a4-be12-44cf-adec-4504bf7fc864-a4ec9a18-f661-45e4-b717-edc4e9e22dcd
612024-02-04T18:30:30.773ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ab2bf2a4-be12-44cf-adec-4504bf7fc864/.zfs/snapshot/a4ec9a18-f661-45e4-b717-edc4e9e22dcd
622024-02-04T18:30:30.773ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
632024-02-04T18:30:30.773ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
642024-02-04T18:30:30.773ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
652024-02-04T18:30:30.773ZINFOcrucible-agent (worker): commit
662024-02-04T18:30:30.777ZINFOcrucible-agent (worker): ok!
672024-02-04T18:30:30.782ZINFOcrucible-agent (worker): SMF ok!
682024-02-04T18:30:30.782ZINFOcrucible-agent (datafile): region ab2bf2a4-be12-44cf-adec-4504bf7fc864 running snapshot a4ec9a18-f661-45e4-b717-edc4e9e22dcd state: Requested -> Created