Max level shown:
12024-05-20T17:19:27.131ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:60991
22024-05-20T17:19:27.191ZINFOcrucible-agent (datafile): region 7c30a3ea-ec7e-4da8-bdd0-004a56c3da91 state: Requested
32024-05-20T17:19:27.195ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-05-20T17:19:27.195ZINFOcrucible-agent (dropshot): request completed latency_us = 4047 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60991 req_id = 0bb184ae-40bb-4522-b42d-6c66949a6520 response_code = 200 uri = /crucible/0/regions
52024-05-20T17:19:27.206ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cbceefe6-63f1-4c53-8403-bc7136c5b1fa/crucible/regions/7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
62024-05-20T17:19:27.206ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cbceefe6-63f1-4c53-8403-bc7136c5b1fa/crucible/regions/7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
72024-05-20T17:19:27.415ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7c30a3ea-ec7e-4da8-bdd0-004a56c3da91"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7c30a3ea-ec7e-4da8-bdd0-004a56c3da91" region = 7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
82024-05-20T17:19:27.415ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7c30a3ea-ec7e-4da8-bdd0-004a56c3da91" "--data" "/data/regions/7c30a3ea-ec7e-4da8-bdd0-004a56c3da91" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
92024-05-20T17:19:27.418ZINFOcrucible-agent (dropshot): request completed latency_us = 104 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60991 req_id = b36abeee-9b0c-4188-9b96-282c47f44bb9 response_code = 200 uri = /crucible/0/regions
102024-05-20T17:19:27.726ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60991 req_id = b221457e-1543-421b-9ddf-3165beca4628 response_code = 200 uri = /crucible/0/regions
112024-05-20T17:19:27.754ZINFOcrucible-agent (worker): region files created ok region = 7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
122024-05-20T17:19:27.754ZINFOcrucible-agent (datafile): region 7c30a3ea-ec7e-4da8-bdd0-004a56c3da91 state: Requested -> Created
132024-05-20T17:19:27.754ZINFOcrucible-agent (worker): applying SMF actions post create...
142024-05-20T17:19:27.754ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
152024-05-20T17:19:27.782ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
162024-05-20T17:19:27.882ZINFOcrucible-agent (worker): creating config property group
172024-05-20T17:19:27.897ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
182024-05-20T17:19:27.898ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7c30a3ea-ec7e-4da8-bdd0-004a56c3da91
192024-05-20T17:19:27.898ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
202024-05-20T17:19:27.898ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
212024-05-20T17:19:27.898ZINFOcrucible-agent (worker): commit
222024-05-20T17:19:27.920ZINFOcrucible-agent (worker): ok!
232024-05-20T17:19:27.956ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36
242024-05-20T17:19:27.956ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
252024-05-20T17:19:27.956ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
262024-05-20T17:19:27.956ZINFOcrucible-agent (worker): reconfig required
272024-05-20T17:19:27.956ZINFOcrucible-agent (worker): using existing config property group
282024-05-20T17:19:27.957ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-868eecc5-fdc7-4155-9b8b-1b4193a91a36
292024-05-20T17:19:27.957ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36
302024-05-20T17:19:27.957ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
312024-05-20T17:19:27.957ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
322024-05-20T17:19:27.957ZINFOcrucible-agent (worker): commit
332024-05-20T17:19:27.993ZINFOcrucible-agent (worker): ok!
342024-05-20T17:19:27.993ZINFOcrucible-agent (worker): SMF ok!
352024-05-20T17:19:28.787ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60991 req_id = 6d3ef71b-9657-4ede-b6e9-6d2516773789 response_code = 200 uri = /crucible/0/regions
362024-05-20T17:19:29.405ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:62074
372024-05-20T17:19:29.405ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:62074 req_id = c64f063b-5424-4c9f-86c8-333d159902a7 response_code = 200 uri = /crucible/0/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36
382024-05-20T17:19:29.405ZINFOcrucible-agent (datafile): path is "/data/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36"
392024-05-20T17:19:29.414ZINFOcrucible-agent (datafile): dataset is oxp_cbceefe6-63f1-4c53-8403-bc7136c5b1fa/crucible/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36
402024-05-20T17:19:29.423ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cbceefe6-63f1-4c53-8403-bc7136c5b1fa/crucible/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36@10c501b7-845a-4af4-aefe-217b19d44430
412024-05-20T17:19:29.423ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cbceefe6-63f1-4c53-8403-bc7136c5b1fa/crucible/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36", "10c501b7-845a-4af4-aefe-217b19d44430"]
422024-05-20T17:19:29.439ZINFOcrucible-agent (dropshot): request completed latency_us = 33826 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:62074 req_id = 3157657d-967e-48f3-9219-5a5d376adbf7 response_code = 200 uri = /crucible/0/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36/snapshots/10c501b7-845a-4af4-aefe-217b19d44430
432024-05-20T17:19:29.439ZINFOcrucible-agent (datafile): path is "/data/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36"
442024-05-20T17:19:29.448ZINFOcrucible-agent (datafile): dataset is oxp_cbceefe6-63f1-4c53-8403-bc7136c5b1fa/crucible/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36
452024-05-20T17:19:29.456ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cbceefe6-63f1-4c53-8403-bc7136c5b1fa/crucible/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36@10c501b7-845a-4af4-aefe-217b19d44430
462024-05-20T17:19:29.456ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cbceefe6-63f1-4c53-8403-bc7136c5b1fa/crucible/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36", "10c501b7-845a-4af4-aefe-217b19d44430"]
472024-05-20T17:19:29.466ZINFOcrucible-agent (datafile): requesting running snapshot 868eecc5-fdc7-4155-9b8b-1b4193a91a36-10c501b7-845a-4af4-aefe-217b19d44430 state: Requested
482024-05-20T17:19:29.466ZINFOcrucible-agent (worker): applying SMF actions for region 868eecc5-fdc7-4155-9b8b-1b4193a91a36 running snapshot 10c501b7-845a-4af4-aefe-217b19d44430 (state Requested)...
492024-05-20T17:19:29.466ZINFOcrucible-agent (dropshot): request completed latency_us = 26470 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62074 req_id = a60553ae-7ac6-47fa-a0a2-82de23aebdba response_code = 200 uri = /crucible/0/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36/snapshots/10c501b7-845a-4af4-aefe-217b19d44430/run
502024-05-20T17:19:29.467ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36
512024-05-20T17:19:29.467ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
522024-05-20T17:19:29.468ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::16
532024-05-20T17:19:29.468ZINFOcrucible-agent (worker): reconfig required
542024-05-20T17:19:29.468ZINFOcrucible-agent (worker): using existing config property group
552024-05-20T17:19:29.468ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-868eecc5-fdc7-4155-9b8b-1b4193a91a36
562024-05-20T17:19:29.468ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36
572024-05-20T17:19:29.468ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
582024-05-20T17:19:29.468ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
592024-05-20T17:19:29.468ZINFOcrucible-agent (worker): commit
602024-05-20T17:19:29.475ZINFOcrucible-agent (worker): ok!
612024-05-20T17:19:29.476ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-868eecc5-fdc7-4155-9b8b-1b4193a91a36-10c501b7-845a-4af4-aefe-217b19d44430
622024-05-20T17:19:29.482ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-868eecc5-fdc7-4155-9b8b-1b4193a91a36-10c501b7-845a-4af4-aefe-217b19d44430
632024-05-20T17:19:29.499ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-868eecc5-fdc7-4155-9b8b-1b4193a91a36-10c501b7-845a-4af4-aefe-217b19d44430
642024-05-20T17:19:29.499ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/868eecc5-fdc7-4155-9b8b-1b4193a91a36/.zfs/snapshot/10c501b7-845a-4af4-aefe-217b19d44430
652024-05-20T17:19:29.500ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
662024-05-20T17:19:29.500ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
672024-05-20T17:19:29.500ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
682024-05-20T17:19:29.500ZINFOcrucible-agent (worker): commit
692024-05-20T17:19:29.505ZINFOcrucible-agent (worker): ok!
702024-05-20T17:19:29.513ZINFOcrucible-agent (worker): SMF ok!
712024-05-20T17:19:29.513ZINFOcrucible-agent (datafile): region 868eecc5-fdc7-4155-9b8b-1b4193a91a36 running snapshot 10c501b7-845a-4af4-aefe-217b19d44430 state: Requested -> Created