Max level shown:
1 [ Oct 10 04:25:16 Enabled. ]
2 [ Oct 10 04:25:16 Rereading configuration. ]
3 [ Oct 10 04:25:18 Rereading configuration. ]
4 [ Oct 10 04:25:22 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-10T04:25:22.049ZINFOcrucible-agent: dataset: "oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible"
72024-10-10T04:25:22.051ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-10-10T04:25:22.051ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-10T04:25:22.064ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-10T04:25:22.396ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-10-10T04:25:54.109ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:37903
122024-10-10T04:25:54.139ZINFOcrucible-agent (datafile): region 6730447f-d856-45f6-802f-11b29cb0c18e state: Requested
132024-10-10T04:25:54.144ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-10-10T04:25:54.144ZINFOcrucible-agent (dropshot): request completed latency_us = 12159 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37903 req_id = 11938dd4-a511-4744-ab30-24f46bf707c7 response_code = 200 uri = /crucible/0/regions
152024-10-10T04:25:54.155ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/6730447f-d856-45f6-802f-11b29cb0c18e
162024-10-10T04:25:54.155ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/6730447f-d856-45f6-802f-11b29cb0c18e
172024-10-10T04:25:54.214ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6730447f-d856-45f6-802f-11b29cb0c18e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6730447f-d856-45f6-802f-11b29cb0c18e" region = 6730447f-d856-45f6-802f-11b29cb0c18e
182024-10-10T04:25:54.218ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6730447f-d856-45f6-802f-11b29cb0c18e" "--data" "/data/regions/6730447f-d856-45f6-802f-11b29cb0c18e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 6730447f-d856-45f6-802f-11b29cb0c18e
192024-10-10T04:25:54.339ZINFOcrucible-agent (worker): region files created ok region = 6730447f-d856-45f6-802f-11b29cb0c18e
202024-10-10T04:25:54.339ZINFOcrucible-agent (datafile): region 6730447f-d856-45f6-802f-11b29cb0c18e state: Requested -> Created
212024-10-10T04:25:54.339ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-10-10T04:25:54.341ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6730447f-d856-45f6-802f-11b29cb0c18e
232024-10-10T04:25:54.347ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6730447f-d856-45f6-802f-11b29cb0c18e
242024-10-10T04:25:54.363ZINFOcrucible-agent (worker): creating config property group
252024-10-10T04:25:54.367ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6730447f-d856-45f6-802f-11b29cb0c18e
262024-10-10T04:25:54.377ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6730447f-d856-45f6-802f-11b29cb0c18e
272024-10-10T04:25:54.377ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-10-10T04:25:54.377ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
292024-10-10T04:25:54.377ZINFOcrucible-agent (worker): commit
302024-10-10T04:25:54.382ZINFOcrucible-agent (worker): ok!
312024-10-10T04:25:54.387ZINFOcrucible-agent (worker): SMF ok!
322024-10-10T04:25:54.521ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37903 req_id = 165fa3ce-3245-4939-bc84-2d436d98ab40 response_code = 200 uri = /crucible/0/regions
332024-10-10T04:25:55.232ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37903 req_id = 059a387e-60f6-433d-bea2-40ddedd268bd response_code = 200 uri = /crucible/0/regions/6730447f-d856-45f6-802f-11b29cb0c18e
342024-10-10T04:25:55.234ZINFOcrucible-agent (datafile): path is "/data/regions/6730447f-d856-45f6-802f-11b29cb0c18e"
352024-10-10T04:25:55.245ZINFOcrucible-agent (datafile): dataset is oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/6730447f-d856-45f6-802f-11b29cb0c18e
362024-10-10T04:25:55.254ZINFOcrucible-agent (datafile): region 6730447f-d856-45f6-802f-11b29cb0c18e state: Created -> Tombstoned
372024-10-10T04:25:55.255ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-10-10T04:25:55.255ZINFOcrucible-agent (dropshot): request completed latency_us = 20299 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:37903 req_id = 4eff8f87-b4be-467e-87cd-cfcef72f389a response_code = 204 uri = /crucible/0/regions/6730447f-d856-45f6-802f-11b29cb0c18e
392024-10-10T04:25:55.256ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6730447f-d856-45f6-802f-11b29cb0c18e (instance states: (Some(Online), None))
402024-10-10T04:25:55.258ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37903 req_id = 1d70be2f-01da-4f4a-822b-8c270a7f311e response_code = 200 uri = /crucible/0/regions/6730447f-d856-45f6-802f-11b29cb0c18e
412024-10-10T04:25:55.261ZINFOcrucible-agent (worker): SMF ok!
422024-10-10T04:25:55.271ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/6730447f-d856-45f6-802f-11b29cb0c18e" region = 6730447f-d856-45f6-802f-11b29cb0c18e
432024-10-10T04:25:55.335ZINFOcrucible-agent (datafile): region 6730447f-d856-45f6-802f-11b29cb0c18e state: Tombstoned -> Destroyed
442024-10-10T04:25:55.335ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37903 req_id = 9a895a8a-1f9d-400c-b25a-97c31efdf192 response_code = 200 uri = /crucible/0/regions/6730447f-d856-45f6-802f-11b29cb0c18e
452024-10-10T04:25:56.976ZINFOcrucible-agent (datafile): region abc60eeb-0d3f-4100-81ea-0c8b93864beb state: Requested
462024-10-10T04:25:56.976ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
472024-10-10T04:25:56.976ZINFOcrucible-agent (dropshot): request completed latency_us = 222 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37903 req_id = ea897f4e-22a1-4c29-b120-eae258fa45ba response_code = 200 uri = /crucible/0/regions
482024-10-10T04:25:56.985ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb
492024-10-10T04:25:56.985ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb
502024-10-10T04:25:57.036ZINFOcrucible-agent (worker): creating region Region { id: RegionId("abc60eeb-0d3f-4100-81ea-0c8b93864beb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb" region = abc60eeb-0d3f-4100-81ea-0c8b93864beb
512024-10-10T04:25:57.038ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "abc60eeb-0d3f-4100-81ea-0c8b93864beb" "--data" "/data/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = abc60eeb-0d3f-4100-81ea-0c8b93864beb
522024-10-10T04:25:57.134ZINFOcrucible-agent (worker): region files created ok region = abc60eeb-0d3f-4100-81ea-0c8b93864beb
532024-10-10T04:25:57.134ZINFOcrucible-agent (datafile): region abc60eeb-0d3f-4100-81ea-0c8b93864beb state: Requested -> Created
542024-10-10T04:25:57.134ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-10-10T04:25:57.135ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-abc60eeb-0d3f-4100-81ea-0c8b93864beb
562024-10-10T04:25:57.139ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-abc60eeb-0d3f-4100-81ea-0c8b93864beb
572024-10-10T04:25:57.145ZINFOcrucible-agent (worker): creating config property group
582024-10-10T04:25:57.151ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-abc60eeb-0d3f-4100-81ea-0c8b93864beb
592024-10-10T04:25:57.151ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb
602024-10-10T04:25:57.151ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-10-10T04:25:57.151ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
622024-10-10T04:25:57.151ZINFOcrucible-agent (worker): commit
632024-10-10T04:25:57.154ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:37903 req_id = 6839a64f-b39e-4c1e-86f4-a1d279a7fe2e response_code = 200 uri = /crucible/0/regions
642024-10-10T04:25:57.156ZINFOcrucible-agent (worker): ok!
652024-10-10T04:25:57.161ZINFOcrucible-agent (worker): SMF ok!
662024-10-10T04:29:28.825ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:46860
672024-10-10T04:29:28.825ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46860 req_id = ec93926f-4b46-4b20-ae0d-d64de859642e response_code = 200 uri = /crucible/0/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb
682024-10-10T04:29:28.829ZINFOcrucible-agent (datafile): path is "/data/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb"
692024-10-10T04:29:28.838ZINFOcrucible-agent (datafile): dataset is oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb
702024-10-10T04:29:28.847ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb@820f0574-233f-439d-931a-9a53095da01e
712024-10-10T04:29:28.847ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb", "820f0574-233f-439d-931a-9a53095da01e"]
722024-10-10T04:29:28.862ZINFOcrucible-agent (dropshot): request completed latency_us = 33403 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46860 req_id = 00dfade0-2f3d-4f93-ba98-d228c2a27ab7 response_code = 200 uri = /crucible/0/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb/snapshots/820f0574-233f-439d-931a-9a53095da01e
732024-10-10T04:29:28.865ZINFOcrucible-agent (datafile): path is "/data/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb"
742024-10-10T04:29:28.875ZINFOcrucible-agent (datafile): dataset is oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb
752024-10-10T04:29:28.883ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb@820f0574-233f-439d-931a-9a53095da01e
762024-10-10T04:29:28.883ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb", "820f0574-233f-439d-931a-9a53095da01e"]
772024-10-10T04:29:28.893ZINFOcrucible-agent (datafile): requesting running snapshot abc60eeb-0d3f-4100-81ea-0c8b93864beb-820f0574-233f-439d-931a-9a53095da01e state: Requested
782024-10-10T04:29:28.894ZINFOcrucible-agent (worker): applying SMF actions for region abc60eeb-0d3f-4100-81ea-0c8b93864beb running snapshot 820f0574-233f-439d-931a-9a53095da01e (state Requested)...
792024-10-10T04:29:28.894ZINFOcrucible-agent (dropshot): request completed latency_us = 28598 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46860 req_id = 1556a66e-a360-4eca-9ba3-22cf8430b709 response_code = 200 uri = /crucible/0/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb/snapshots/820f0574-233f-439d-931a-9a53095da01e/run
802024-10-10T04:29:28.903ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-abc60eeb-0d3f-4100-81ea-0c8b93864beb-820f0574-233f-439d-931a-9a53095da01e
812024-10-10T04:29:28.908ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-abc60eeb-0d3f-4100-81ea-0c8b93864beb-820f0574-233f-439d-931a-9a53095da01e
822024-10-10T04:29:28.918ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-abc60eeb-0d3f-4100-81ea-0c8b93864beb-820f0574-233f-439d-931a-9a53095da01e
832024-10-10T04:29:28.918ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb/.zfs/snapshot/820f0574-233f-439d-931a-9a53095da01e
842024-10-10T04:29:28.918ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
852024-10-10T04:29:28.919ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
862024-10-10T04:29:28.919ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
872024-10-10T04:29:28.919ZINFOcrucible-agent (worker): commit
882024-10-10T04:29:28.922ZINFOcrucible-agent (worker): ok!
892024-10-10T04:29:28.927ZINFOcrucible-agent (worker): SMF ok!
902024-10-10T04:29:28.927ZINFOcrucible-agent (datafile): region abc60eeb-0d3f-4100-81ea-0c8b93864beb running snapshot 820f0574-233f-439d-931a-9a53095da01e state: Requested -> Created
912024-10-10T04:29:29.188ZINFOcrucible-agent (datafile): path is "/data/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb"
922024-10-10T04:29:29.197ZINFOcrucible-agent (datafile): dataset is oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb
932024-10-10T04:29:29.206ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb@820f0574-233f-439d-931a-9a53095da01e
942024-10-10T04:29:29.206ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb", "820f0574-233f-439d-931a-9a53095da01e"]
952024-10-10T04:29:29.214ZINFOcrucible-agent (dropshot): request completed latency_us = 26248 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46860 req_id = 02d312b1-b352-4076-9bee-48263b7b1d0a response_code = 200 uri = /crucible/0/regions/abc60eeb-0d3f-4100-81ea-0c8b93864beb/snapshots/820f0574-233f-439d-931a-9a53095da01e/run
962024-10-10T04:29:32.873ZINFOcrucible-agent (datafile): region 8da712fa-aab6-48f3-84f3-923e2d00385e state: Requested
972024-10-10T04:29:32.873ZINFOcrucible-agent (dropshot): request completed latency_us = 210 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46860 req_id = dd5663b2-dc35-4b20-81af-84ccc79e9e56 response_code = 200 uri = /crucible/0/regions
982024-10-10T04:29:32.873ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
992024-10-10T04:29:32.882ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/8da712fa-aab6-48f3-84f3-923e2d00385e
1002024-10-10T04:29:32.882ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/8da712fa-aab6-48f3-84f3-923e2d00385e
1012024-10-10T04:29:32.937ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8da712fa-aab6-48f3-84f3-923e2d00385e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8da712fa-aab6-48f3-84f3-923e2d00385e" region = 8da712fa-aab6-48f3-84f3-923e2d00385e
1022024-10-10T04:29:32.939ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8da712fa-aab6-48f3-84f3-923e2d00385e" "--data" "/data/regions/8da712fa-aab6-48f3-84f3-923e2d00385e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8da712fa-aab6-48f3-84f3-923e2d00385e
1032024-10-10T04:29:33.004ZINFOcrucible-agent (worker): region files created ok region = 8da712fa-aab6-48f3-84f3-923e2d00385e
1042024-10-10T04:29:33.005ZINFOcrucible-agent (datafile): region 8da712fa-aab6-48f3-84f3-923e2d00385e state: Requested -> Created
1052024-10-10T04:29:33.005ZINFOcrucible-agent (worker): applying SMF actions post create...
1062024-10-10T04:29:33.006ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8da712fa-aab6-48f3-84f3-923e2d00385e
1072024-10-10T04:29:33.010ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8da712fa-aab6-48f3-84f3-923e2d00385e
1082024-10-10T04:29:33.018ZINFOcrucible-agent (worker): creating config property group
1092024-10-10T04:29:33.022ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8da712fa-aab6-48f3-84f3-923e2d00385e
1102024-10-10T04:29:33.022ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8da712fa-aab6-48f3-84f3-923e2d00385e
1112024-10-10T04:29:33.022ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1122024-10-10T04:29:33.022ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1132024-10-10T04:29:33.022ZINFOcrucible-agent (worker): commit
1142024-10-10T04:29:33.026ZINFOcrucible-agent (worker): ok!
1152024-10-10T04:29:33.036ZINFOcrucible-agent (worker): SMF ok!
1162024-10-10T04:29:33.228ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:46860 req_id = daabe4c2-b29a-4bbb-acc1-cf01e1bfc111 response_code = 200 uri = /crucible/0/regions
1172024-10-10T04:30:00.628ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46860 req_id = 185abdfc-83d6-48d1-8d37-2826f8fcdccd response_code = 200 uri = /crucible/0/regions/8da712fa-aab6-48f3-84f3-923e2d00385e
1182024-10-10T04:30:00.634ZINFOcrucible-agent (datafile): path is "/data/regions/8da712fa-aab6-48f3-84f3-923e2d00385e"
1192024-10-10T04:30:00.649ZINFOcrucible-agent (datafile): dataset is oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/8da712fa-aab6-48f3-84f3-923e2d00385e
1202024-10-10T04:30:00.659ZINFOcrucible-agent (datafile): region 8da712fa-aab6-48f3-84f3-923e2d00385e state: Created -> Tombstoned
1212024-10-10T04:30:00.659ZINFOcrucible-agent (worker): applying SMF actions before removal...
1222024-10-10T04:30:00.659ZINFOcrucible-agent (dropshot): request completed latency_us = 24931 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:46860 req_id = 5815e557-d8fd-4b63-93cc-6f56b1f469b1 response_code = 204 uri = /crucible/0/regions/8da712fa-aab6-48f3-84f3-923e2d00385e
1232024-10-10T04:30:00.661ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-8da712fa-aab6-48f3-84f3-923e2d00385e (instance states: (Some(Online), None))
1242024-10-10T04:30:00.665ZINFOcrucible-agent (dropshot): request completed latency_us = 1192 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46860 req_id = 5832f0ab-c6a9-4a3b-99d3-f122e0e0e74c response_code = 200 uri = /crucible/0/regions/8da712fa-aab6-48f3-84f3-923e2d00385e
1252024-10-10T04:30:00.683ZINFOcrucible-agent (worker): SMF ok!
1262024-10-10T04:30:00.696ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_42fe4b6b-f61c-47ef-99e9-fb5d758266c6/crucible/regions/8da712fa-aab6-48f3-84f3-923e2d00385e" region = 8da712fa-aab6-48f3-84f3-923e2d00385e
1272024-10-10T04:30:00.739ZINFOcrucible-agent (dropshot): request completed latency_us = 101 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46860 req_id = f4a1f6b3-0d89-4ef6-8e88-c3bcd70d9557 response_code = 200 uri = /crucible/0/regions/8da712fa-aab6-48f3-84f3-923e2d00385e
1282024-10-10T04:30:00.784ZINFOcrucible-agent (datafile): region 8da712fa-aab6-48f3-84f3-923e2d00385e state: Tombstoned -> Destroyed
1292024-10-10T04:30:00.912ZINFOcrucible-agent (dropshot): request completed latency_us = 827 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:46860 req_id = 95980e6b-8780-4c64-91f1-b646857acedb response_code = 200 uri = /crucible/0/regions/8da712fa-aab6-48f3-84f3-923e2d00385e