Max level shown:
1 [ Mar 17 21:02:05 Enabled. ]
2 [ Mar 17 21:02:05 Rereading configuration. ]
3 [ Mar 17 21:02:08 Rereading configuration. ]
4 [ Mar 17 21:02:18 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-03-17T21:02:18.272ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-03-17T21:02:18.272ZINFOcrucible-agent: dataset: "oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible"
82026-03-17T21:02:18.272ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
92026-03-17T21:02:18.272ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-03-17T21:02:18.284ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-03-17T21:02:18.551ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
122026-03-17T21:02:59.056ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:38999
132026-03-17T21:02:59.082ZINFOcrucible-agent (datafile): region 25f3f4f5-142a-4809-8e1c-333a3bba94ce state: Requested
142026-03-17T21:02:59.085ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152026-03-17T21:02:59.085ZINFOcrucible-agent (dropshot): request completed latency_us = 14273 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38999 req_id = 4bffab5f-6f10-492f-87c5-768bd8922909 response_code = 200 uri = /crucible/0/regions
162026-03-17T21:02:59.096ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce
172026-03-17T21:02:59.096ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce
182026-03-17T21:02:59.176ZINFOcrucible-agent (worker): creating region Region { id: RegionId("25f3f4f5-142a-4809-8e1c-333a3bba94ce"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce" region = 25f3f4f5-142a-4809-8e1c-333a3bba94ce
192026-03-17T21:02:59.178ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "25f3f4f5-142a-4809-8e1c-333a3bba94ce" "--data" "/data/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 25f3f4f5-142a-4809-8e1c-333a3bba94ce
202026-03-17T21:02:59.466ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38999 req_id = 7a825672-77f9-496e-9e1a-f5a81e523040 response_code = 200 uri = /crucible/0/regions
212026-03-17T21:02:59.624ZINFOcrucible-agent (worker): region files created ok region = 25f3f4f5-142a-4809-8e1c-333a3bba94ce
222026-03-17T21:02:59.624ZINFOcrucible-agent (datafile): region 25f3f4f5-142a-4809-8e1c-333a3bba94ce state: Requested -> Created
232026-03-17T21:02:59.624ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-03-17T21:02:59.625ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-25f3f4f5-142a-4809-8e1c-333a3bba94ce
252026-03-17T21:02:59.631ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-25f3f4f5-142a-4809-8e1c-333a3bba94ce
262026-03-17T21:02:59.647ZINFOcrucible-agent (worker): creating config property group
272026-03-17T21:02:59.651ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-25f3f4f5-142a-4809-8e1c-333a3bba94ce
282026-03-17T21:02:59.652ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce
292026-03-17T21:02:59.652ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-03-17T21:02:59.652ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
312026-03-17T21:02:59.652ZINFOcrucible-agent (worker): commit
322026-03-17T21:02:59.659ZINFOcrucible-agent (worker): ok!
332026-03-17T21:02:59.664ZINFOcrucible-agent (worker): SMF ok!
342026-03-17T21:02:59.731ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38999 req_id = c6f79185-0885-4d81-9358-0eaa5a21643e response_code = 200 uri = /crucible/0/regions
352026-03-17T21:13:28.623ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:63727
362026-03-17T21:13:28.624ZINFOcrucible-agent (datafile): region ae1af704-3c1f-4f11-9b6a-74a2d35b40ae state: Requested
372026-03-17T21:13:28.624ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
382026-03-17T21:13:28.624ZINFOcrucible-agent (dropshot): request completed latency_us = 1110 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63727 req_id = 59e121f4-4ddc-441f-857e-47b024b06601 response_code = 200 uri = /crucible/0/regions
392026-03-17T21:13:28.631ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
402026-03-17T21:13:28.631ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
412026-03-17T21:13:28.743ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ae1af704-3c1f-4f11-9b6a-74a2d35b40ae"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ae1af704-3c1f-4f11-9b6a-74a2d35b40ae" region = ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
422026-03-17T21:13:28.743ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ae1af704-3c1f-4f11-9b6a-74a2d35b40ae" "--data" "/data/regions/ae1af704-3c1f-4f11-9b6a-74a2d35b40ae" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
432026-03-17T21:13:28.977ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63727 req_id = 38fb7491-39a5-47a1-9446-925f562c977c response_code = 200 uri = /crucible/0/regions
442026-03-17T21:13:29.026ZINFOcrucible-agent (worker): region files created ok region = ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
452026-03-17T21:13:29.026ZINFOcrucible-agent (datafile): region ae1af704-3c1f-4f11-9b6a-74a2d35b40ae state: Requested -> Created
462026-03-17T21:13:29.026ZINFOcrucible-agent (worker): applying SMF actions post create...
472026-03-17T21:13:29.047ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
482026-03-17T21:13:29.061ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
492026-03-17T21:13:29.080ZINFOcrucible-agent (worker): creating config property group
502026-03-17T21:13:29.086ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
512026-03-17T21:13:29.087ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
522026-03-17T21:13:29.087ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
532026-03-17T21:13:29.087ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
542026-03-17T21:13:29.087ZINFOcrucible-agent (worker): commit
552026-03-17T21:13:29.098ZINFOcrucible-agent (worker): ok!
562026-03-17T21:13:29.113ZINFOcrucible-agent (worker): SMF ok!
572026-03-17T21:13:29.573ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:49573
582026-03-17T21:13:29.573ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:49573 req_id = f5c98b64-1e4b-4466-8053-bbba5646931b response_code = 200 uri = /crucible/0/regions/ae1af704-3c1f-4f11-9b6a-74a2d35b40ae
592026-03-17T21:13:29.715ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63727 req_id = f1736210-e947-4bd8-80ba-b653250736c2 response_code = 200 uri = /crucible/0/regions
602026-03-17T21:13:30.689ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63727 req_id = da705a3b-9a43-4a43-af28-04622d99eae9 response_code = 200 uri = /crucible/0/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce
612026-03-17T21:13:30.693ZINFOcrucible-agent (datafile): path is "/data/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce"
622026-03-17T21:13:30.701ZINFOcrucible-agent (datafile): dataset is oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce
632026-03-17T21:13:30.707ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce@6965c5a7-4b95-451c-a31c-bfdf67f893c4
642026-03-17T21:13:30.707ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce", "6965c5a7-4b95-451c-a31c-bfdf67f893c4"]
652026-03-17T21:13:30.716ZINFOcrucible-agent (dropshot): request completed latency_us = 23158 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63727 req_id = 522c98a4-546f-4003-b0e0-0eba7e3b2604 response_code = 200 uri = /crucible/0/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce/snapshots/6965c5a7-4b95-451c-a31c-bfdf67f893c4
662026-03-17T21:13:30.720ZINFOcrucible-agent (datafile): path is "/data/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce"
672026-03-17T21:13:30.726ZINFOcrucible-agent (datafile): dataset is oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce
682026-03-17T21:13:30.734ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce@6965c5a7-4b95-451c-a31c-bfdf67f893c4
692026-03-17T21:13:30.734ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce", "6965c5a7-4b95-451c-a31c-bfdf67f893c4"]
702026-03-17T21:13:30.743ZINFOcrucible-agent (datafile): requesting running snapshot 25f3f4f5-142a-4809-8e1c-333a3bba94ce-6965c5a7-4b95-451c-a31c-bfdf67f893c4 state: Requested
712026-03-17T21:13:30.743ZINFOcrucible-agent (worker): applying SMF actions for region 25f3f4f5-142a-4809-8e1c-333a3bba94ce running snapshot 6965c5a7-4b95-451c-a31c-bfdf67f893c4 (state Requested)...
722026-03-17T21:13:30.744ZINFOcrucible-agent (dropshot): request completed latency_us = 23459 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63727 req_id = 2c9439fb-d57b-4b7c-a571-d3be5373eb4c response_code = 200 uri = /crucible/0/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce/snapshots/6965c5a7-4b95-451c-a31c-bfdf67f893c4/run
732026-03-17T21:13:30.749ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-25f3f4f5-142a-4809-8e1c-333a3bba94ce-6965c5a7-4b95-451c-a31c-bfdf67f893c4
742026-03-17T21:13:30.772ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-25f3f4f5-142a-4809-8e1c-333a3bba94ce-6965c5a7-4b95-451c-a31c-bfdf67f893c4
752026-03-17T21:13:30.794ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-25f3f4f5-142a-4809-8e1c-333a3bba94ce-6965c5a7-4b95-451c-a31c-bfdf67f893c4
762026-03-17T21:13:30.794ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce/.zfs/snapshot/6965c5a7-4b95-451c-a31c-bfdf67f893c4
772026-03-17T21:13:30.794ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
782026-03-17T21:13:30.794ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
792026-03-17T21:13:30.794ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
802026-03-17T21:13:30.795ZINFOcrucible-agent (worker): commit
812026-03-17T21:13:30.808ZINFOcrucible-agent (worker): ok!
822026-03-17T21:13:30.822ZINFOcrucible-agent (worker): SMF ok!
832026-03-17T21:13:30.822ZINFOcrucible-agent (datafile): region 25f3f4f5-142a-4809-8e1c-333a3bba94ce running snapshot 6965c5a7-4b95-451c-a31c-bfdf67f893c4 state: Requested -> Created
842026-03-17T21:13:30.980ZINFOcrucible-agent (datafile): path is "/data/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce"
852026-03-17T21:13:30.987ZINFOcrucible-agent (datafile): dataset is oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce
862026-03-17T21:13:30.994ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce@6965c5a7-4b95-451c-a31c-bfdf67f893c4
872026-03-17T21:13:30.994ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce", "6965c5a7-4b95-451c-a31c-bfdf67f893c4"]
882026-03-17T21:13:31.000ZINFOcrucible-agent (dropshot): request completed latency_us = 20243 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63727 req_id = c9073714-5224-444c-b62b-1aed86f70c56 response_code = 200 uri = /crucible/0/regions/25f3f4f5-142a-4809-8e1c-333a3bba94ce/snapshots/6965c5a7-4b95-451c-a31c-bfdf67f893c4/run
892026-03-17T21:13:36.408ZINFOcrucible-agent (datafile): region 96327489-0902-458e-8e27-696ff120293d state: Requested
902026-03-17T21:13:36.408ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
912026-03-17T21:13:36.408ZINFOcrucible-agent (dropshot): request completed latency_us = 243 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63727 req_id = c54a9142-47ed-4853-90c1-618647ad286f response_code = 200 uri = /crucible/0/regions
922026-03-17T21:13:36.416ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/96327489-0902-458e-8e27-696ff120293d
932026-03-17T21:13:36.416ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/96327489-0902-458e-8e27-696ff120293d
942026-03-17T21:13:36.480ZINFOcrucible-agent (worker): creating region Region { id: RegionId("96327489-0902-458e-8e27-696ff120293d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/96327489-0902-458e-8e27-696ff120293d" region = 96327489-0902-458e-8e27-696ff120293d
952026-03-17T21:13:36.480ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "96327489-0902-458e-8e27-696ff120293d" "--data" "/data/regions/96327489-0902-458e-8e27-696ff120293d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 96327489-0902-458e-8e27-696ff120293d
962026-03-17T21:13:36.574ZINFOcrucible-agent (worker): region files created ok region = 96327489-0902-458e-8e27-696ff120293d
972026-03-17T21:13:36.574ZINFOcrucible-agent (datafile): region 96327489-0902-458e-8e27-696ff120293d state: Requested -> Created
982026-03-17T21:13:36.574ZINFOcrucible-agent (worker): applying SMF actions post create...
992026-03-17T21:13:36.575ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-96327489-0902-458e-8e27-696ff120293d
1002026-03-17T21:13:36.579ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-96327489-0902-458e-8e27-696ff120293d
1012026-03-17T21:13:36.587ZINFOcrucible-agent (worker): creating config property group
1022026-03-17T21:13:36.591ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-96327489-0902-458e-8e27-696ff120293d
1032026-03-17T21:13:36.591ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/96327489-0902-458e-8e27-696ff120293d
1042026-03-17T21:13:36.591ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1052026-03-17T21:13:36.591ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
1062026-03-17T21:13:36.592ZINFOcrucible-agent (worker): commit
1072026-03-17T21:13:36.595ZINFOcrucible-agent (worker): ok!
1082026-03-17T21:13:36.606ZINFOcrucible-agent (worker): SMF ok!
1092026-03-17T21:13:36.713ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63727 req_id = f81f16e4-1f4c-40ec-9dff-d9f2cb5df46a response_code = 200 uri = /crucible/0/regions
1102026-03-17T21:14:02.314ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63727 req_id = cd16ef55-c80f-4955-9fd1-7793236ac082 response_code = 200 uri = /crucible/0/regions/96327489-0902-458e-8e27-696ff120293d
1112026-03-17T21:14:02.317ZINFOcrucible-agent (datafile): path is "/data/regions/96327489-0902-458e-8e27-696ff120293d"
1122026-03-17T21:14:02.329ZINFOcrucible-agent (datafile): dataset is oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/96327489-0902-458e-8e27-696ff120293d
1132026-03-17T21:14:02.336ZINFOcrucible-agent (datafile): region 96327489-0902-458e-8e27-696ff120293d state: Created -> Tombstoned
1142026-03-17T21:14:02.336ZINFOcrucible-agent (worker): applying SMF actions before removal...
1152026-03-17T21:14:02.336ZINFOcrucible-agent (dropshot): request completed latency_us = 18562 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:63727 req_id = 29913d7b-8c99-42d0-a9ef-13e8e0060a31 response_code = 204 uri = /crucible/0/regions/96327489-0902-458e-8e27-696ff120293d
1162026-03-17T21:14:02.337ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-96327489-0902-458e-8e27-696ff120293d (instance states: (Some(Online), None))
1172026-03-17T21:14:02.339ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63727 req_id = 32efbdb4-6350-4fd2-b498-c4f76ccde133 response_code = 200 uri = /crucible/0/regions/96327489-0902-458e-8e27-696ff120293d
1182026-03-17T21:14:02.349ZINFOcrucible-agent (worker): SMF ok!
1192026-03-17T21:14:02.357ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8df4ff9f-dc53-43ab-9fe2-057d66770894/crucible/regions/96327489-0902-458e-8e27-696ff120293d" region = 96327489-0902-458e-8e27-696ff120293d
1202026-03-17T21:14:02.412ZINFOcrucible-agent (datafile): region 96327489-0902-458e-8e27-696ff120293d state: Tombstoned -> Destroyed
1212026-03-17T21:14:02.441ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63727 req_id = fc6b1082-c756-4c89-8ca3-dc245c32f309 response_code = 200 uri = /crucible/0/regions/96327489-0902-458e-8e27-696ff120293d