Max level shown:
1 [ Jul 30 01:30:26 Enabled. ]
2 [ Jul 30 01:30:26 Rereading configuration. ]
3 [ Jul 30 01:30:27 Rereading configuration. ]
4 [ Jul 30 01:30:29 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-30T01:30:29.373ZINFOcrucible-agent: dataset: "oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible"
72024-07-30T01:30:29.375ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-07-30T01:30:29.375ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-30T01:30:29.416ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-30T01:30:29.515ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-07-30T01:31:43.590ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:54734
122024-07-30T01:31:43.611ZINFOcrucible-agent (datafile): region 666741d8-40c8-4e26-86bf-3f5682e66bf4 state: Requested
132024-07-30T01:31:43.616ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-07-30T01:31:43.619ZINFOcrucible-agent (dropshot): request completed latency_us = 14927 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54734 req_id = 712e9674-759c-4f1f-914a-da74ca733fcc response_code = 200 uri = /crucible/0/regions
152024-07-30T01:31:43.627ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4
162024-07-30T01:31:43.627ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4
172024-07-30T01:31:43.733ZINFOcrucible-agent (worker): creating region Region { id: RegionId("666741d8-40c8-4e26-86bf-3f5682e66bf4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4" region = 666741d8-40c8-4e26-86bf-3f5682e66bf4
182024-07-30T01:31:43.735ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "666741d8-40c8-4e26-86bf-3f5682e66bf4" "--data" "/data/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 666741d8-40c8-4e26-86bf-3f5682e66bf4
192024-07-30T01:31:43.930ZINFOcrucible-agent (worker): region files created ok region = 666741d8-40c8-4e26-86bf-3f5682e66bf4
202024-07-30T01:31:43.930ZINFOcrucible-agent (datafile): region 666741d8-40c8-4e26-86bf-3f5682e66bf4 state: Requested -> Created
212024-07-30T01:31:43.930ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-07-30T01:31:43.930ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-666741d8-40c8-4e26-86bf-3f5682e66bf4
232024-07-30T01:31:43.957ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-666741d8-40c8-4e26-86bf-3f5682e66bf4
242024-07-30T01:31:43.972ZINFOcrucible-agent (worker): creating config property group
252024-07-30T01:31:43.975ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-666741d8-40c8-4e26-86bf-3f5682e66bf4
262024-07-30T01:31:43.977ZINFOcrucible-agent (dropshot): request completed latency_us = 264 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54734 req_id = c9a395b4-240c-431b-bfa0-b1dd896c1d70 response_code = 200 uri = /crucible/0/regions
272024-07-30T01:31:43.984ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4
282024-07-30T01:31:43.986ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-30T01:31:43.987ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
302024-07-30T01:31:43.987ZINFOcrucible-agent (worker): commit
312024-07-30T01:31:43.991ZINFOcrucible-agent (worker): ok!
322024-07-30T01:31:43.996ZINFOcrucible-agent (worker): SMF ok!
332024-07-30T01:31:45.143ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54734 req_id = 42adff0b-9046-48f0-b9e9-e8f66029c4fa response_code = 200 uri = /crucible/0/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4
342024-07-30T01:31:45.145ZINFOcrucible-agent (datafile): path is "/data/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4"
352024-07-30T01:31:45.155ZINFOcrucible-agent (datafile): dataset is oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4
362024-07-30T01:31:45.163ZINFOcrucible-agent (datafile): region 666741d8-40c8-4e26-86bf-3f5682e66bf4 state: Created -> Tombstoned
372024-07-30T01:31:45.163ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-07-30T01:31:45.163ZINFOcrucible-agent (dropshot): request completed latency_us = 18006 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:54734 req_id = 56071eaa-e60f-4fb2-a7d3-2ceca13d3799 response_code = 204 uri = /crucible/0/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4
392024-07-30T01:31:45.164ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-666741d8-40c8-4e26-86bf-3f5682e66bf4 (instance states: (Some(Online), None))
402024-07-30T01:31:45.167ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54734 req_id = 8731f853-f8f7-4a1e-bb0c-0c262d4d9dff response_code = 200 uri = /crucible/0/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4
412024-07-30T01:31:45.168ZINFOcrucible-agent (worker): SMF ok!
422024-07-30T01:31:45.178ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4" region = 666741d8-40c8-4e26-86bf-3f5682e66bf4
432024-07-30T01:31:45.234ZINFOcrucible-agent (datafile): region 666741d8-40c8-4e26-86bf-3f5682e66bf4 state: Tombstoned -> Destroyed
442024-07-30T01:31:45.263ZINFOcrucible-agent (dropshot): request completed latency_us = 497 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54734 req_id = b8102cd4-0002-4261-8c38-bb7037cc724a response_code = 200 uri = /crucible/0/regions/666741d8-40c8-4e26-86bf-3f5682e66bf4
452024-07-30T01:31:46.463ZINFOcrucible-agent (datafile): region 6f247614-4250-4c35-9213-fbe29f96b4b7 state: Requested
462024-07-30T01:31:46.463ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
472024-07-30T01:31:46.463ZINFOcrucible-agent (dropshot): request completed latency_us = 782 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54734 req_id = 66304cb7-ac1c-4f09-808c-28e5fb30a8c3 response_code = 200 uri = /crucible/0/regions
482024-07-30T01:31:46.473ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/6f247614-4250-4c35-9213-fbe29f96b4b7
492024-07-30T01:31:46.473ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/6f247614-4250-4c35-9213-fbe29f96b4b7
502024-07-30T01:31:46.518ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6f247614-4250-4c35-9213-fbe29f96b4b7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6f247614-4250-4c35-9213-fbe29f96b4b7" region = 6f247614-4250-4c35-9213-fbe29f96b4b7
512024-07-30T01:31:46.518ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6f247614-4250-4c35-9213-fbe29f96b4b7" "--data" "/data/regions/6f247614-4250-4c35-9213-fbe29f96b4b7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6f247614-4250-4c35-9213-fbe29f96b4b7
522024-07-30T01:31:46.593ZINFOcrucible-agent (worker): region files created ok region = 6f247614-4250-4c35-9213-fbe29f96b4b7
532024-07-30T01:31:46.593ZINFOcrucible-agent (datafile): region 6f247614-4250-4c35-9213-fbe29f96b4b7 state: Requested -> Created
542024-07-30T01:31:46.594ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-07-30T01:31:46.595ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6f247614-4250-4c35-9213-fbe29f96b4b7
562024-07-30T01:31:46.598ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6f247614-4250-4c35-9213-fbe29f96b4b7
572024-07-30T01:31:46.606ZINFOcrucible-agent (worker): creating config property group
582024-07-30T01:31:46.609ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6f247614-4250-4c35-9213-fbe29f96b4b7
592024-07-30T01:31:46.610ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f247614-4250-4c35-9213-fbe29f96b4b7
602024-07-30T01:31:46.610ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-07-30T01:31:46.610ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
622024-07-30T01:31:46.610ZINFOcrucible-agent (worker): commit
632024-07-30T01:31:46.613ZINFOcrucible-agent (worker): ok!
642024-07-30T01:31:46.617ZINFOcrucible-agent (worker): SMF ok!
652024-07-30T01:31:46.760ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54734 req_id = 239c4f0e-2bc8-4fc7-ba22-6dcd688e42a2 response_code = 200 uri = /crucible/0/regions
662024-07-30T01:37:06.908ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:60774
672024-07-30T01:37:06.909ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60774 req_id = cec0af1e-5154-469d-999d-863142e0f007 response_code = 200 uri = /crucible/0/regions/6f247614-4250-4c35-9213-fbe29f96b4b7
682024-07-30T01:37:06.912ZINFOcrucible-agent (datafile): path is "/data/regions/6f247614-4250-4c35-9213-fbe29f96b4b7"
692024-07-30T01:37:06.920ZINFOcrucible-agent (datafile): dataset is oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/6f247614-4250-4c35-9213-fbe29f96b4b7
702024-07-30T01:37:06.929ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/6f247614-4250-4c35-9213-fbe29f96b4b7@f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b
712024-07-30T01:37:06.929ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/6f247614-4250-4c35-9213-fbe29f96b4b7", "f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b"]
722024-07-30T01:37:06.940ZINFOcrucible-agent (dropshot): request completed latency_us = 31083 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60774 req_id = b58bc5da-bb89-4196-9caa-3b1189b44d62 response_code = 200 uri = /crucible/0/regions/6f247614-4250-4c35-9213-fbe29f96b4b7/snapshots/f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b
732024-07-30T01:37:06.940ZINFOcrucible-agent (datafile): path is "/data/regions/6f247614-4250-4c35-9213-fbe29f96b4b7"
742024-07-30T01:37:06.949ZINFOcrucible-agent (datafile): dataset is oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/6f247614-4250-4c35-9213-fbe29f96b4b7
752024-07-30T01:37:06.957ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/6f247614-4250-4c35-9213-fbe29f96b4b7@f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b
762024-07-30T01:37:06.957ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/6f247614-4250-4c35-9213-fbe29f96b4b7", "f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b"]
772024-07-30T01:37:06.966ZINFOcrucible-agent (datafile): requesting running snapshot 6f247614-4250-4c35-9213-fbe29f96b4b7-f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b state: Requested
782024-07-30T01:37:06.967ZINFOcrucible-agent (worker): applying SMF actions for region 6f247614-4250-4c35-9213-fbe29f96b4b7 running snapshot f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b (state Requested)...
792024-07-30T01:37:06.967ZINFOcrucible-agent (dropshot): request completed latency_us = 27222 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60774 req_id = 841a2369-3d2f-4a7c-a5c1-f2ae846d685f response_code = 200 uri = /crucible/0/regions/6f247614-4250-4c35-9213-fbe29f96b4b7/snapshots/f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b/run
802024-07-30T01:37:06.974ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-6f247614-4250-4c35-9213-fbe29f96b4b7-f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b
812024-07-30T01:37:06.982ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-6f247614-4250-4c35-9213-fbe29f96b4b7-f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b
822024-07-30T01:37:06.996ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-6f247614-4250-4c35-9213-fbe29f96b4b7-f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b
832024-07-30T01:37:06.996ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f247614-4250-4c35-9213-fbe29f96b4b7/.zfs/snapshot/f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b
842024-07-30T01:37:06.996ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
852024-07-30T01:37:06.996ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
862024-07-30T01:37:06.996ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
872024-07-30T01:37:06.996ZINFOcrucible-agent (worker): commit
882024-07-30T01:37:07.001ZINFOcrucible-agent (worker): ok!
892024-07-30T01:37:07.006ZINFOcrucible-agent (worker): SMF ok!
902024-07-30T01:37:07.006ZINFOcrucible-agent (datafile): region 6f247614-4250-4c35-9213-fbe29f96b4b7 running snapshot f5199ea3-dcee-4c01-98b8-ff5c9bf72a4b state: Requested -> Created
912024-07-30T01:37:09.800ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:56569
922024-07-30T01:37:09.801ZINFOcrucible-agent (datafile): region c27bd160-968a-45de-a3e8-142fe074d377 state: Requested
932024-07-30T01:37:09.801ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
942024-07-30T01:37:09.801ZINFOcrucible-agent (dropshot): request completed latency_us = 511 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56569 req_id = 402083b7-be7d-4970-859e-59709d451bd4 response_code = 200 uri = /crucible/0/regions
952024-07-30T01:37:09.811ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/c27bd160-968a-45de-a3e8-142fe074d377
962024-07-30T01:37:09.811ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/c27bd160-968a-45de-a3e8-142fe074d377
972024-07-30T01:37:09.864ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c27bd160-968a-45de-a3e8-142fe074d377"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c27bd160-968a-45de-a3e8-142fe074d377" region = c27bd160-968a-45de-a3e8-142fe074d377
982024-07-30T01:37:09.864ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c27bd160-968a-45de-a3e8-142fe074d377" "--data" "/data/regions/c27bd160-968a-45de-a3e8-142fe074d377" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c27bd160-968a-45de-a3e8-142fe074d377
992024-07-30T01:37:09.931ZINFOcrucible-agent (worker): region files created ok region = c27bd160-968a-45de-a3e8-142fe074d377
1002024-07-30T01:37:09.931ZINFOcrucible-agent (datafile): region c27bd160-968a-45de-a3e8-142fe074d377 state: Requested -> Created
1012024-07-30T01:37:09.932ZINFOcrucible-agent (worker): applying SMF actions post create...
1022024-07-30T01:37:09.933ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c27bd160-968a-45de-a3e8-142fe074d377
1032024-07-30T01:37:09.936ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c27bd160-968a-45de-a3e8-142fe074d377
1042024-07-30T01:37:09.944ZINFOcrucible-agent (worker): creating config property group
1052024-07-30T01:37:09.947ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c27bd160-968a-45de-a3e8-142fe074d377
1062024-07-30T01:37:09.947ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c27bd160-968a-45de-a3e8-142fe074d377
1072024-07-30T01:37:09.947ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1082024-07-30T01:37:09.947ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1092024-07-30T01:37:09.947ZINFOcrucible-agent (worker): commit
1102024-07-30T01:37:09.951ZINFOcrucible-agent (worker): ok!
1112024-07-30T01:37:09.956ZINFOcrucible-agent (worker): SMF ok!
1122024-07-30T01:37:10.047ZINFOcrucible-agent (dropshot): request completed latency_us = 810 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56569 req_id = 313fb16e-8b2d-4497-ba60-58327ae6b38f response_code = 200 uri = /crucible/0/regions
1132024-07-30T01:37:34.063ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56569 req_id = 47440f5e-dce9-4296-a06c-4f5b510b03f6 response_code = 200 uri = /crucible/0/regions/c27bd160-968a-45de-a3e8-142fe074d377
1142024-07-30T01:37:34.066ZINFOcrucible-agent (datafile): path is "/data/regions/c27bd160-968a-45de-a3e8-142fe074d377"
1152024-07-30T01:37:34.077ZINFOcrucible-agent (datafile): dataset is oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/c27bd160-968a-45de-a3e8-142fe074d377
1162024-07-30T01:37:34.085ZINFOcrucible-agent (datafile): region c27bd160-968a-45de-a3e8-142fe074d377 state: Created -> Tombstoned
1172024-07-30T01:37:34.086ZINFOcrucible-agent (worker): applying SMF actions before removal...
1182024-07-30T01:37:34.086ZINFOcrucible-agent (dropshot): request completed latency_us = 20136 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:56569 req_id = 78178b50-2462-49f9-8c32-87b381db5573 response_code = 204 uri = /crucible/0/regions/c27bd160-968a-45de-a3e8-142fe074d377
1192024-07-30T01:37:34.087ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c27bd160-968a-45de-a3e8-142fe074d377 (instance states: (Some(Online), None))
1202024-07-30T01:37:34.088ZINFOcrucible-agent (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56569 req_id = e16aca1f-47ba-4560-a10f-e3a01432aadb response_code = 200 uri = /crucible/0/regions/c27bd160-968a-45de-a3e8-142fe074d377
1212024-07-30T01:37:34.093ZINFOcrucible-agent (worker): SMF ok!
1222024-07-30T01:37:34.102ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_33b09d10-f4a7-481b-a7f4-12388d3ec2fd/crucible/regions/c27bd160-968a-45de-a3e8-142fe074d377" region = c27bd160-968a-45de-a3e8-142fe074d377
1232024-07-30T01:37:34.150ZINFOcrucible-agent (datafile): region c27bd160-968a-45de-a3e8-142fe074d377 state: Tombstoned -> Destroyed
1242024-07-30T01:37:34.177ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56569 req_id = b6e987dc-29f5-42f9-aea7-f4c9a54bd94c response_code = 200 uri = /crucible/0/regions/c27bd160-968a-45de-a3e8-142fe074d377