Max level shown:
1 [ Jun 5 18:46:34 Enabled. ]
2 [ Jun 5 18:46:34 Rereading configuration. ]
3 [ Jun 5 18:46:35 Rereading configuration. ]
4 [ Jun 5 18:46:39 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-06-05T18:46:39.211ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: bd9a0e2abe6b6b89aec8c85f4ee57474144ed150 Commit timestamp: 2026-05-14T15:48:00.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-06-05T18:46:39.211ZINFOcrucible-agent: dataset: "oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible"
82026-06-05T18:46:39.211ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
92026-06-05T18:46:39.211ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-06-05T18:46:39.225ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-06-05T18:46:39.334ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
122026-06-05T18:47:15.207ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:42462
132026-06-05T18:47:15.228ZINFOcrucible-agent (datafile): region 23c68f94-476e-4753-9904-ca4a629096f1 state: Requested
142026-06-05T18:47:15.233ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152026-06-05T18:47:15.233ZINFOcrucible-agent (dropshot): request completed latency_us = 11977 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42462 req_id = fbc72209-5782-41e6-945e-1acba767a01b response_code = 200 uri = /crucible/0/regions
162026-06-05T18:47:15.242ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1
172026-06-05T18:47:15.242ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1
182026-06-05T18:47:15.316ZINFOcrucible-agent (worker): creating region Region { id: RegionId("23c68f94-476e-4753-9904-ca4a629096f1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/23c68f94-476e-4753-9904-ca4a629096f1" region = 23c68f94-476e-4753-9904-ca4a629096f1
192026-06-05T18:47:15.316ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "23c68f94-476e-4753-9904-ca4a629096f1" "--data" "/data/regions/23c68f94-476e-4753-9904-ca4a629096f1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 23c68f94-476e-4753-9904-ca4a629096f1
202026-06-05T18:47:15.382ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42462 req_id = a5299d78-3e08-4d2a-a5d4-9a8069ec9659 response_code = 200 uri = /crucible/0/regions
212026-06-05T18:47:15.677ZINFOcrucible-agent (worker): region files created ok region = 23c68f94-476e-4753-9904-ca4a629096f1
222026-06-05T18:47:15.677ZINFOcrucible-agent (datafile): region 23c68f94-476e-4753-9904-ca4a629096f1 state: Requested -> Created
232026-06-05T18:47:15.677ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-06-05T18:47:15.680ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-23c68f94-476e-4753-9904-ca4a629096f1
252026-06-05T18:47:15.687ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-23c68f94-476e-4753-9904-ca4a629096f1
262026-06-05T18:47:15.702ZINFOcrucible-agent (worker): creating config property group
272026-06-05T18:47:15.705ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-23c68f94-476e-4753-9904-ca4a629096f1
282026-06-05T18:47:15.706ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
292026-06-05T18:47:15.706ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-06-05T18:47:15.706ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
312026-06-05T18:47:15.706ZINFOcrucible-agent (worker): commit
322026-06-05T18:47:15.721ZINFOcrucible-agent (worker): ok!
332026-06-05T18:47:15.725ZINFOcrucible-agent (worker): SMF ok!
342026-06-05T18:47:16.119ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:42462 req_id = 72d7bf1a-fc95-46c2-bd01-17d1a089f794 response_code = 200 uri = /crucible/0/regions
352026-06-05T18:57:43.419ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:44077
362026-06-05T18:57:43.419ZINFOcrucible-agent (datafile): region 58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b state: Requested
372026-06-05T18:57:43.423ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
382026-06-05T18:57:43.423ZINFOcrucible-agent (dropshot): request completed latency_us = 4053 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 161b6eb4-7d3d-43f5-80f0-5779ccdc1f4c response_code = 200 uri = /crucible/0/regions
392026-06-05T18:57:43.430ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
402026-06-05T18:57:43.430ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
412026-06-05T18:57:43.492ZINFOcrucible-agent (worker): creating region Region { id: RegionId("58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b" region = 58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
422026-06-05T18:57:43.492ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b" "--data" "/data/regions/58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
432026-06-05T18:57:43.567ZINFOcrucible-agent (worker): region files created ok region = 58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
442026-06-05T18:57:43.567ZINFOcrucible-agent (datafile): region 58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b state: Requested -> Created
452026-06-05T18:57:43.567ZINFOcrucible-agent (worker): applying SMF actions post create...
462026-06-05T18:57:43.586ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
472026-06-05T18:57:43.586ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
482026-06-05T18:57:43.586ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
492026-06-05T18:57:43.586ZINFOcrucible-agent (worker): reconfig required
502026-06-05T18:57:43.586ZINFOcrucible-agent (worker): using existing config property group
512026-06-05T18:57:43.586ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-23c68f94-476e-4753-9904-ca4a629096f1
522026-06-05T18:57:43.586ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
532026-06-05T18:57:43.586ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
542026-06-05T18:57:43.586ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
552026-06-05T18:57:43.586ZINFOcrucible-agent (worker): commit
562026-06-05T18:57:43.594ZINFOcrucible-agent (worker): ok!
572026-06-05T18:57:43.594ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
582026-06-05T18:57:43.597ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
592026-06-05T18:57:43.606ZINFOcrucible-agent (worker): creating config property group
602026-06-05T18:57:43.608ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
612026-06-05T18:57:43.609ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/58ed4cff-fd1f-4bc2-a2d3-e2e826388f4b
622026-06-05T18:57:43.609ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
632026-06-05T18:57:43.609ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
642026-06-05T18:57:43.609ZINFOcrucible-agent (worker): commit
652026-06-05T18:57:43.612ZINFOcrucible-agent (worker): ok!
662026-06-05T18:57:43.616ZINFOcrucible-agent (worker): SMF ok!
672026-06-05T18:57:43.779ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44077 req_id = c78e8ad6-ae59-4d81-8bb6-6d079c07e12b response_code = 200 uri = /crucible/0/regions
682026-06-05T18:57:45.245ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 1d80e734-7f97-45a5-8c36-741b67a81d84 response_code = 200 uri = /crucible/0/regions/23c68f94-476e-4753-9904-ca4a629096f1
692026-06-05T18:57:45.249ZINFOcrucible-agent (datafile): path is "/data/regions/23c68f94-476e-4753-9904-ca4a629096f1"
702026-06-05T18:57:45.254ZINFOcrucible-agent (datafile): dataset is oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1
712026-06-05T18:57:45.261ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1@4f552317-4be0-438f-bd87-f1080a96b169
722026-06-05T18:57:45.261ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1", "4f552317-4be0-438f-bd87-f1080a96b169"]
732026-06-05T18:57:45.270ZINFOcrucible-agent (dropshot): request completed latency_us = 21140 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44077 req_id = f8de3a69-3d82-4d9b-ba34-fe4fa3932eb0 response_code = 200 uri = /crucible/0/regions/23c68f94-476e-4753-9904-ca4a629096f1/snapshots/4f552317-4be0-438f-bd87-f1080a96b169
742026-06-05T18:57:45.274ZINFOcrucible-agent (datafile): path is "/data/regions/23c68f94-476e-4753-9904-ca4a629096f1"
752026-06-05T18:57:45.279ZINFOcrucible-agent (datafile): dataset is oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1
762026-06-05T18:57:45.284ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1@4f552317-4be0-438f-bd87-f1080a96b169
772026-06-05T18:57:45.284ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1", "4f552317-4be0-438f-bd87-f1080a96b169"]
782026-06-05T18:57:45.290ZINFOcrucible-agent (datafile): requesting running snapshot 23c68f94-476e-4753-9904-ca4a629096f1-4f552317-4be0-438f-bd87-f1080a96b169 state: Requested
792026-06-05T18:57:45.291ZINFOcrucible-agent (dropshot): request completed latency_us = 17062 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 54f373ba-1c77-4565-bf04-90815d802df0 response_code = 200 uri = /crucible/0/regions/23c68f94-476e-4753-9904-ca4a629096f1/snapshots/4f552317-4be0-438f-bd87-f1080a96b169/run
802026-06-05T18:57:45.291ZINFOcrucible-agent (worker): applying SMF actions for region 23c68f94-476e-4753-9904-ca4a629096f1 running snapshot 4f552317-4be0-438f-bd87-f1080a96b169 (state Requested)...
812026-06-05T18:57:45.291ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
822026-06-05T18:57:45.291ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
832026-06-05T18:57:45.291ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
842026-06-05T18:57:45.291ZINFOcrucible-agent (worker): reconfig required
852026-06-05T18:57:45.291ZINFOcrucible-agent (worker): using existing config property group
862026-06-05T18:57:45.291ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-23c68f94-476e-4753-9904-ca4a629096f1
872026-06-05T18:57:45.292ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
882026-06-05T18:57:45.292ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
892026-06-05T18:57:45.292ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
902026-06-05T18:57:45.292ZINFOcrucible-agent (worker): commit
912026-06-05T18:57:45.295ZINFOcrucible-agent (worker): ok!
922026-06-05T18:57:45.299ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-23c68f94-476e-4753-9904-ca4a629096f1-4f552317-4be0-438f-bd87-f1080a96b169
932026-06-05T18:57:45.309ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-23c68f94-476e-4753-9904-ca4a629096f1-4f552317-4be0-438f-bd87-f1080a96b169
942026-06-05T18:57:45.319ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-23c68f94-476e-4753-9904-ca4a629096f1-4f552317-4be0-438f-bd87-f1080a96b169
952026-06-05T18:57:45.319ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23c68f94-476e-4753-9904-ca4a629096f1/.zfs/snapshot/4f552317-4be0-438f-bd87-f1080a96b169
962026-06-05T18:57:45.319ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
972026-06-05T18:57:45.319ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
982026-06-05T18:57:45.319ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
992026-06-05T18:57:45.319ZINFOcrucible-agent (worker): commit
1002026-06-05T18:57:45.323ZINFOcrucible-agent (worker): ok!
1012026-06-05T18:57:45.327ZINFOcrucible-agent (worker): SMF ok!
1022026-06-05T18:57:45.327ZINFOcrucible-agent (datafile): region 23c68f94-476e-4753-9904-ca4a629096f1 running snapshot 4f552317-4be0-438f-bd87-f1080a96b169 state: Requested -> Created
1032026-06-05T18:57:45.422ZINFOcrucible-agent (datafile): path is "/data/regions/23c68f94-476e-4753-9904-ca4a629096f1"
1042026-06-05T18:57:45.428ZINFOcrucible-agent (datafile): dataset is oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1
1052026-06-05T18:57:45.434ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1@4f552317-4be0-438f-bd87-f1080a96b169
1062026-06-05T18:57:45.434ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/23c68f94-476e-4753-9904-ca4a629096f1", "4f552317-4be0-438f-bd87-f1080a96b169"]
1072026-06-05T18:57:45.440ZINFOcrucible-agent (dropshot): request completed latency_us = 17650 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 6a860bfc-1d02-408a-b4d4-35c0f6e1ef65 response_code = 200 uri = /crucible/0/regions/23c68f94-476e-4753-9904-ca4a629096f1/snapshots/4f552317-4be0-438f-bd87-f1080a96b169/run
1082026-06-05T18:57:50.377ZINFOcrucible-agent (datafile): region da34f5e4-1e9b-4f03-aae5-f869272fdbc1 state: Requested
1092026-06-05T18:57:50.377ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1102026-06-05T18:57:50.377ZINFOcrucible-agent (dropshot): request completed latency_us = 277 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44077 req_id = a1cb9ef8-8d23-429a-b824-bbd71a18fad0 response_code = 200 uri = /crucible/0/regions
1112026-06-05T18:57:50.385ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1122026-06-05T18:57:50.385ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1132026-06-05T18:57:50.453ZINFOcrucible-agent (worker): creating region Region { id: RegionId("da34f5e4-1e9b-4f03-aae5-f869272fdbc1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1" region = da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1142026-06-05T18:57:50.453ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "da34f5e4-1e9b-4f03-aae5-f869272fdbc1" "--data" "/data/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1152026-06-05T18:57:50.538ZINFOcrucible-agent (worker): region files created ok region = da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1162026-06-05T18:57:50.538ZINFOcrucible-agent (datafile): region da34f5e4-1e9b-4f03-aae5-f869272fdbc1 state: Requested -> Created
1172026-06-05T18:57:50.538ZINFOcrucible-agent (worker): applying SMF actions post create...
1182026-06-05T18:57:50.539ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
1192026-06-05T18:57:50.539ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1202026-06-05T18:57:50.539ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
1212026-06-05T18:57:50.539ZINFOcrucible-agent (worker): reconfig required
1222026-06-05T18:57:50.539ZINFOcrucible-agent (worker): using existing config property group
1232026-06-05T18:57:50.539ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-23c68f94-476e-4753-9904-ca4a629096f1
1242026-06-05T18:57:50.540ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
1252026-06-05T18:57:50.540ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1262026-06-05T18:57:50.540ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1272026-06-05T18:57:50.540ZINFOcrucible-agent (worker): commit
1282026-06-05T18:57:50.545ZINFOcrucible-agent (worker): ok!
1292026-06-05T18:57:50.546ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1302026-06-05T18:57:50.549ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1312026-06-05T18:57:50.550ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 02b2b018-504b-4bc0-81b1-f7b06eeea0fe response_code = 200 uri = /crucible/0/regions
1322026-06-05T18:57:50.556ZINFOcrucible-agent (worker): creating config property group
1332026-06-05T18:57:50.559ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1342026-06-05T18:57:50.559ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1352026-06-05T18:57:50.559ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1362026-06-05T18:57:50.559ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1372026-06-05T18:57:50.559ZINFOcrucible-agent (worker): commit
1382026-06-05T18:57:50.564ZINFOcrucible-agent (worker): ok!
1392026-06-05T18:57:50.570ZINFOcrucible-agent (worker): SMF ok!
1402026-06-05T18:58:16.398ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 48a42524-c408-42b0-8c31-9b2d8092f401 response_code = 200 uri = /crucible/0/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1412026-06-05T18:58:16.405ZINFOcrucible-agent (datafile): path is "/data/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1"
1422026-06-05T18:58:16.416ZINFOcrucible-agent (datafile): dataset is oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1432026-06-05T18:58:16.423ZINFOcrucible-agent (datafile): region da34f5e4-1e9b-4f03-aae5-f869272fdbc1 state: Created -> Tombstoned
1442026-06-05T18:58:16.424ZINFOcrucible-agent (worker): applying SMF actions before removal...
1452026-06-05T18:58:16.424ZINFOcrucible-agent (dropshot): request completed latency_us = 18728 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 618e0b90-16d2-45ac-81b0-de835eefc097 response_code = 204 uri = /crucible/0/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1462026-06-05T18:58:16.425ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-da34f5e4-1e9b-4f03-aae5-f869272fdbc1 (instance states: (Some(Online), None))
1472026-06-05T18:58:16.428ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 6eabbec0-2c71-4929-8e49-6fdda967ecd7 response_code = 200 uri = /crucible/0/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1482026-06-05T18:58:16.435ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
1492026-06-05T18:58:16.435ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1502026-06-05T18:58:16.435ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::12
1512026-06-05T18:58:16.435ZINFOcrucible-agent (worker): reconfig required
1522026-06-05T18:58:16.435ZINFOcrucible-agent (worker): using existing config property group
1532026-06-05T18:58:16.435ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-23c68f94-476e-4753-9904-ca4a629096f1
1542026-06-05T18:58:16.436ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23c68f94-476e-4753-9904-ca4a629096f1
1552026-06-05T18:58:16.436ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1562026-06-05T18:58:16.436ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1572026-06-05T18:58:16.436ZINFOcrucible-agent (worker): commit
1582026-06-05T18:58:16.440ZINFOcrucible-agent (worker): ok!
1592026-06-05T18:58:16.442ZINFOcrucible-agent (worker): SMF ok!
1602026-06-05T18:58:16.449ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_79084af0-baaa-47e9-9707-8fcb3567227e/crucible/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1" region = da34f5e4-1e9b-4f03-aae5-f869272fdbc1
1612026-06-05T18:58:16.501ZINFOcrucible-agent (datafile): region da34f5e4-1e9b-4f03-aae5-f869272fdbc1 state: Tombstoned -> Destroyed
1622026-06-05T18:58:16.572ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:44077 req_id = 1a2cb80f-738a-4654-981f-705a5978b168 response_code = 200 uri = /crucible/0/regions/da34f5e4-1e9b-4f03-aae5-f869272fdbc1