Max level shown:
1 [ Jan 18 05:33:10 Enabled. ]
2 [ Jan 18 05:33:10 Rereading configuration. ]
3 [ Jan 18 05:33:15 Rereading configuration. ]
4 [ Jan 18 05:33:21 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-01-18T05:33:21.961ZINFOcrucible-agent: dataset: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible"
72025-01-18T05:33:21.962ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82025-01-18T05:33:21.962ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-01-18T05:33:21.982ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-01-18T05:33:22.120ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
112025-01-18T05:34:10.394ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:49368
122025-01-18T05:34:10.420ZINFOcrucible-agent (datafile): region c9a9186a-9d34-472c-9bbc-198747552ab1 state: Requested
132025-01-18T05:34:10.425ZINFOcrucible-agent (dropshot): request completed latency_us = 13538 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:49368 req_id = 17adfd48-fe61-4eaa-b8cc-0ac69dad0086 response_code = 200 uri = /crucible/0/regions
142025-01-18T05:34:10.425ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152025-01-18T05:34:10.434ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
162025-01-18T05:34:10.434ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
172025-01-18T05:34:10.493ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c9a9186a-9d34-472c-9bbc-198747552ab1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1" region = c9a9186a-9d34-472c-9bbc-198747552ab1
182025-01-18T05:34:10.495ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c9a9186a-9d34-472c-9bbc-198747552ab1" "--data" "/data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c9a9186a-9d34-472c-9bbc-198747552ab1
192025-01-18T05:34:10.638ZINFOcrucible-agent (dropshot): request completed latency_us = 109 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:49368 req_id = f923c444-5ce5-4777-bebd-4c4d794cd618 response_code = 200 uri = /crucible/0/regions
202025-01-18T05:34:10.647ZINFOcrucible-agent (worker): region files created ok region = c9a9186a-9d34-472c-9bbc-198747552ab1
212025-01-18T05:34:10.647ZINFOcrucible-agent (datafile): region c9a9186a-9d34-472c-9bbc-198747552ab1 state: Requested -> Created
222025-01-18T05:34:10.648ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-01-18T05:34:10.648ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c9a9186a-9d34-472c-9bbc-198747552ab1
242025-01-18T05:34:10.652ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c9a9186a-9d34-472c-9bbc-198747552ab1
252025-01-18T05:34:10.665ZINFOcrucible-agent (worker): creating config property group
262025-01-18T05:34:10.675ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c9a9186a-9d34-472c-9bbc-198747552ab1
272025-01-18T05:34:10.675ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
282025-01-18T05:34:10.677ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-01-18T05:34:10.677ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
302025-01-18T05:34:10.677ZINFOcrucible-agent (worker): commit
312025-01-18T05:34:10.682ZINFOcrucible-agent (worker): ok!
322025-01-18T05:34:10.685ZINFOcrucible-agent (worker): SMF ok!
332025-01-18T05:34:11.353ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:49368 req_id = f81d1750-d16e-46c2-b4f4-6262fa936749 response_code = 200 uri = /crucible/0/regions
342025-01-18T05:44:07.714ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:48773
352025-01-18T05:44:07.714ZINFOcrucible-agent (datafile): region b0740894-8f8e-4b9f-977d-73ad3a41efaf state: Requested
362025-01-18T05:44:07.715ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372025-01-18T05:44:07.715ZINFOcrucible-agent (dropshot): request completed latency_us = 697 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48773 req_id = 7dd72778-a89b-40eb-b0d7-87a40a0817f5 response_code = 200 uri = /crucible/0/regions
382025-01-18T05:44:07.726ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/b0740894-8f8e-4b9f-977d-73ad3a41efaf
392025-01-18T05:44:07.726ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/b0740894-8f8e-4b9f-977d-73ad3a41efaf
402025-01-18T05:44:07.779ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b0740894-8f8e-4b9f-977d-73ad3a41efaf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b0740894-8f8e-4b9f-977d-73ad3a41efaf" region = b0740894-8f8e-4b9f-977d-73ad3a41efaf
412025-01-18T05:44:07.779ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b0740894-8f8e-4b9f-977d-73ad3a41efaf" "--data" "/data/regions/b0740894-8f8e-4b9f-977d-73ad3a41efaf" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b0740894-8f8e-4b9f-977d-73ad3a41efaf
422025-01-18T05:44:07.845ZINFOcrucible-agent (worker): region files created ok region = b0740894-8f8e-4b9f-977d-73ad3a41efaf
432025-01-18T05:44:07.845ZINFOcrucible-agent (datafile): region b0740894-8f8e-4b9f-977d-73ad3a41efaf state: Requested -> Created
442025-01-18T05:44:07.845ZINFOcrucible-agent (worker): applying SMF actions post create...
452025-01-18T05:44:07.846ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b0740894-8f8e-4b9f-977d-73ad3a41efaf
462025-01-18T05:44:07.851ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b0740894-8f8e-4b9f-977d-73ad3a41efaf
472025-01-18T05:44:07.864ZINFOcrucible-agent (worker): creating config property group
482025-01-18T05:44:07.868ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b0740894-8f8e-4b9f-977d-73ad3a41efaf
492025-01-18T05:44:07.868ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b0740894-8f8e-4b9f-977d-73ad3a41efaf
502025-01-18T05:44:07.869ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512025-01-18T05:44:07.869ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
522025-01-18T05:44:07.869ZINFOcrucible-agent (worker): commit
532025-01-18T05:44:07.873ZINFOcrucible-agent (worker): ok!
542025-01-18T05:44:07.877ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
552025-01-18T05:44:07.877ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
562025-01-18T05:44:07.877ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
572025-01-18T05:44:07.877ZINFOcrucible-agent (worker): reconfig required
582025-01-18T05:44:07.877ZINFOcrucible-agent (worker): using existing config property group
592025-01-18T05:44:07.877ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c9a9186a-9d34-472c-9bbc-198747552ab1
602025-01-18T05:44:07.878ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
612025-01-18T05:44:07.878ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622025-01-18T05:44:07.878ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
632025-01-18T05:44:07.878ZINFOcrucible-agent (worker): commit
642025-01-18T05:44:07.889ZINFOcrucible-agent (worker): ok!
652025-01-18T05:44:07.889ZINFOcrucible-agent (worker): SMF ok!
662025-01-18T05:44:07.911ZINFOcrucible-agent (dropshot): request completed latency_us = 92 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48773 req_id = 7c089e3e-e6af-4cb0-baa7-f0b7c3363d3f response_code = 200 uri = /crucible/0/regions
672025-01-18T05:44:08.813ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48773 req_id = e6db38a4-ea58-4b15-b99e-64635343c6b2 response_code = 200 uri = /crucible/0/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
682025-01-18T05:44:08.819ZINFOcrucible-agent (datafile): path is "/data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1"
692025-01-18T05:44:08.828ZINFOcrucible-agent (datafile): dataset is oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
702025-01-18T05:44:08.837ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1@55708258-8abd-4c4b-8508-8aec30cbe904
712025-01-18T05:44:08.837ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1", "55708258-8abd-4c4b-8508-8aec30cbe904"]
722025-01-18T05:44:08.848ZINFOcrucible-agent (dropshot): request completed latency_us = 28920 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48773 req_id = e70322cc-31ff-471a-bdbe-e9f5fe690f7c response_code = 200 uri = /crucible/0/regions/c9a9186a-9d34-472c-9bbc-198747552ab1/snapshots/55708258-8abd-4c4b-8508-8aec30cbe904
732025-01-18T05:44:08.851ZINFOcrucible-agent (datafile): path is "/data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1"
742025-01-18T05:44:08.859ZINFOcrucible-agent (datafile): dataset is oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
752025-01-18T05:44:08.867ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1@55708258-8abd-4c4b-8508-8aec30cbe904
762025-01-18T05:44:08.867ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1", "55708258-8abd-4c4b-8508-8aec30cbe904"]
772025-01-18T05:44:08.876ZINFOcrucible-agent (datafile): requesting running snapshot c9a9186a-9d34-472c-9bbc-198747552ab1-55708258-8abd-4c4b-8508-8aec30cbe904 state: Requested
782025-01-18T05:44:08.876ZINFOcrucible-agent (worker): applying SMF actions for region c9a9186a-9d34-472c-9bbc-198747552ab1 running snapshot 55708258-8abd-4c4b-8508-8aec30cbe904 (state Requested)...
792025-01-18T05:44:08.876ZINFOcrucible-agent (dropshot): request completed latency_us = 25173 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48773 req_id = 2aca71cf-770b-4679-9228-2688000b1fc9 response_code = 200 uri = /crucible/0/regions/c9a9186a-9d34-472c-9bbc-198747552ab1/snapshots/55708258-8abd-4c4b-8508-8aec30cbe904/run
802025-01-18T05:44:08.877ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
812025-01-18T05:44:08.877ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
822025-01-18T05:44:08.877ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
832025-01-18T05:44:08.877ZINFOcrucible-agent (worker): reconfig required
842025-01-18T05:44:08.877ZINFOcrucible-agent (worker): using existing config property group
852025-01-18T05:44:08.878ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c9a9186a-9d34-472c-9bbc-198747552ab1
862025-01-18T05:44:08.878ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
872025-01-18T05:44:08.878ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
882025-01-18T05:44:08.878ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
892025-01-18T05:44:08.878ZINFOcrucible-agent (worker): commit
902025-01-18T05:44:08.881ZINFOcrucible-agent (worker): ok!
912025-01-18T05:44:08.882ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-c9a9186a-9d34-472c-9bbc-198747552ab1-55708258-8abd-4c4b-8508-8aec30cbe904
922025-01-18T05:44:08.888ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-c9a9186a-9d34-472c-9bbc-198747552ab1-55708258-8abd-4c4b-8508-8aec30cbe904
932025-01-18T05:44:08.897ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-c9a9186a-9d34-472c-9bbc-198747552ab1-55708258-8abd-4c4b-8508-8aec30cbe904
942025-01-18T05:44:08.898ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1/.zfs/snapshot/55708258-8abd-4c4b-8508-8aec30cbe904
952025-01-18T05:44:08.898ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
962025-01-18T05:44:08.898ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
972025-01-18T05:44:08.898ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
982025-01-18T05:44:08.898ZINFOcrucible-agent (worker): commit
992025-01-18T05:44:08.901ZINFOcrucible-agent (worker): ok!
1002025-01-18T05:44:08.906ZINFOcrucible-agent (worker): SMF ok!
1012025-01-18T05:44:08.906ZINFOcrucible-agent (datafile): region c9a9186a-9d34-472c-9bbc-198747552ab1 running snapshot 55708258-8abd-4c4b-8508-8aec30cbe904 state: Requested -> Created
1022025-01-18T05:44:09.200ZINFOcrucible-agent (datafile): path is "/data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1"
1032025-01-18T05:44:09.208ZINFOcrucible-agent (datafile): dataset is oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
1042025-01-18T05:44:09.217ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1@55708258-8abd-4c4b-8508-8aec30cbe904
1052025-01-18T05:44:09.217ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/c9a9186a-9d34-472c-9bbc-198747552ab1", "55708258-8abd-4c4b-8508-8aec30cbe904"]
1062025-01-18T05:44:09.225ZINFOcrucible-agent (dropshot): request completed latency_us = 25238 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48773 req_id = f4fbb4bf-a91b-4b96-b733-d2371f16a442 response_code = 200 uri = /crucible/0/regions/c9a9186a-9d34-472c-9bbc-198747552ab1/snapshots/55708258-8abd-4c4b-8508-8aec30cbe904/run
1072025-01-18T05:44:13.419ZINFOcrucible-agent (datafile): region cc4e200c-7f04-4d22-8319-b9ac1aa171ef state: Requested
1082025-01-18T05:44:13.419ZINFOcrucible-agent (dropshot): request completed latency_us = 869 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48773 req_id = c92aa69a-4977-4bb7-81a7-b22f09d404b3 response_code = 200 uri = /crucible/0/regions
1092025-01-18T05:44:13.419ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1102025-01-18T05:44:13.429ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1112025-01-18T05:44:13.429ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1122025-01-18T05:44:13.494ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cc4e200c-7f04-4d22-8319-b9ac1aa171ef"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef" region = cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1132025-01-18T05:44:13.494ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cc4e200c-7f04-4d22-8319-b9ac1aa171ef" "--data" "/data/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1142025-01-18T05:44:13.570ZINFOcrucible-agent (worker): region files created ok region = cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1152025-01-18T05:44:13.570ZINFOcrucible-agent (datafile): region cc4e200c-7f04-4d22-8319-b9ac1aa171ef state: Requested -> Created
1162025-01-18T05:44:13.570ZINFOcrucible-agent (worker): applying SMF actions post create...
1172025-01-18T05:44:13.571ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
1182025-01-18T05:44:13.571ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1192025-01-18T05:44:13.572ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
1202025-01-18T05:44:13.572ZINFOcrucible-agent (worker): reconfig required
1212025-01-18T05:44:13.572ZINFOcrucible-agent (worker): using existing config property group
1222025-01-18T05:44:13.572ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c9a9186a-9d34-472c-9bbc-198747552ab1
1232025-01-18T05:44:13.572ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
1242025-01-18T05:44:13.572ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1252025-01-18T05:44:13.572ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
1262025-01-18T05:44:13.572ZINFOcrucible-agent (worker): commit
1272025-01-18T05:44:13.579ZINFOcrucible-agent (worker): ok!
1282025-01-18T05:44:13.579ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1292025-01-18T05:44:13.584ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1302025-01-18T05:44:13.591ZINFOcrucible-agent (worker): creating config property group
1312025-01-18T05:44:13.594ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1322025-01-18T05:44:13.594ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1332025-01-18T05:44:13.594ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1342025-01-18T05:44:13.594ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
1352025-01-18T05:44:13.594ZINFOcrucible-agent (worker): commit
1362025-01-18T05:44:13.598ZINFOcrucible-agent (worker): ok!
1372025-01-18T05:44:13.603ZINFOcrucible-agent (worker): SMF ok!
1382025-01-18T05:44:13.756ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48773 req_id = c2deb96c-db6e-433e-98b5-e0b444cd0c17 response_code = 200 uri = /crucible/0/regions
1392025-01-18T05:44:38.101ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48773 req_id = ecd1dd19-4317-4432-87e1-ea3860888531 response_code = 200 uri = /crucible/0/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1402025-01-18T05:44:38.105ZINFOcrucible-agent (datafile): path is "/data/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef"
1412025-01-18T05:44:38.118ZINFOcrucible-agent (datafile): dataset is oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1422025-01-18T05:44:38.127ZINFOcrucible-agent (datafile): region cc4e200c-7f04-4d22-8319-b9ac1aa171ef state: Created -> Tombstoned
1432025-01-18T05:44:38.127ZINFOcrucible-agent (worker): applying SMF actions before removal...
1442025-01-18T05:44:38.129ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-cc4e200c-7f04-4d22-8319-b9ac1aa171ef (instance states: (Some(Online), None))
1452025-01-18T05:44:38.130ZINFOcrucible-agent (dropshot): request completed latency_us = 25868 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:48773 req_id = f441d182-a9a1-402f-8613-652e69063821 response_code = 204 uri = /crucible/0/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1462025-01-18T05:44:38.134ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
1472025-01-18T05:44:38.134ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1482025-01-18T05:44:38.134ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
1492025-01-18T05:44:38.134ZINFOcrucible-agent (worker): reconfig required
1502025-01-18T05:44:38.134ZINFOcrucible-agent (worker): using existing config property group
1512025-01-18T05:44:38.134ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c9a9186a-9d34-472c-9bbc-198747552ab1
1522025-01-18T05:44:38.135ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48773 req_id = d802e415-c601-4444-b3b8-c2f5df93bdb1 response_code = 200 uri = /crucible/0/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1532025-01-18T05:44:38.135ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c9a9186a-9d34-472c-9bbc-198747552ab1
1542025-01-18T05:44:38.135ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1552025-01-18T05:44:38.135ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
1562025-01-18T05:44:38.135ZINFOcrucible-agent (worker): commit
1572025-01-18T05:44:38.140ZINFOcrucible-agent (worker): ok!
1582025-01-18T05:44:38.142ZINFOcrucible-agent (worker): SMF ok!
1592025-01-18T05:44:38.153ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef" region = cc4e200c-7f04-4d22-8319-b9ac1aa171ef
1602025-01-18T05:44:38.207ZINFOcrucible-agent (datafile): region cc4e200c-7f04-4d22-8319-b9ac1aa171ef state: Tombstoned -> Destroyed
1612025-01-18T05:44:38.262ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48773 req_id = 6d661569-2d4d-4c47-a4f0-4b0fab102aea response_code = 200 uri = /crucible/0/regions/cc4e200c-7f04-4d22-8319-b9ac1aa171ef