Max level shown:
1 [ Jul 10 23:01:41 Enabled. ]
2 [ Jul 10 23:01:41 Rereading configuration. ]
3 [ Jul 10 23:01:43 Rereading configuration. ]
4 [ Jul 10 23:01:45 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-10T23:01:45.371ZINFOcrucible-agent: dataset: "oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible"
72024-07-10T23:01:45.377ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82024-07-10T23:01:45.377ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-10T23:01:45.392ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-10T23:01:45.500ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112024-07-10T23:02:06.694ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:57077
122024-07-10T23:02:06.706ZINFOcrucible-agent (datafile): region 9b7eea31-55cb-4ef2-900b-05c30732737b state: Requested
132024-07-10T23:02:06.706ZINFOcrucible-agent (dropshot): request completed latency_us = 5054 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57077 req_id = 880b56a3-8bda-4f36-a923-e1010dcc78ee response_code = 200 uri = /crucible/0/regions
142024-07-10T23:02:06.709ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-07-10T23:02:06.719ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
162024-07-10T23:02:06.719ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
172024-07-10T23:02:06.802ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9b7eea31-55cb-4ef2-900b-05c30732737b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b" region = 9b7eea31-55cb-4ef2-900b-05c30732737b
182024-07-10T23:02:06.802ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9b7eea31-55cb-4ef2-900b-05c30732737b" "--data" "/data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9b7eea31-55cb-4ef2-900b-05c30732737b
192024-07-10T23:02:07.029ZINFOcrucible-agent (dropshot): request completed latency_us = 817 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57077 req_id = 5009b9ff-0813-432e-89b2-3f74bc60daf0 response_code = 200 uri = /crucible/0/regions
202024-07-10T23:02:07.045ZINFOcrucible-agent (worker): region files created ok region = 9b7eea31-55cb-4ef2-900b-05c30732737b
212024-07-10T23:02:07.045ZINFOcrucible-agent (datafile): region 9b7eea31-55cb-4ef2-900b-05c30732737b state: Requested -> Created
222024-07-10T23:02:07.046ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-07-10T23:02:07.046ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9b7eea31-55cb-4ef2-900b-05c30732737b
242024-07-10T23:02:07.051ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9b7eea31-55cb-4ef2-900b-05c30732737b
252024-07-10T23:02:07.064ZINFOcrucible-agent (worker): creating config property group
262024-07-10T23:02:07.068ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9b7eea31-55cb-4ef2-900b-05c30732737b
272024-07-10T23:02:07.069ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
282024-07-10T23:02:07.073ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-10T23:02:07.073ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
302024-07-10T23:02:07.073ZINFOcrucible-agent (worker): commit
312024-07-10T23:02:07.080ZINFOcrucible-agent (worker): ok!
322024-07-10T23:02:07.088ZINFOcrucible-agent (worker): SMF ok!
332024-07-10T23:02:07.342ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57077 req_id = 866ae835-deaa-45ef-8cf4-1349417fad4f response_code = 200 uri = /crucible/0/regions
342024-07-10T23:07:25.068ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:48554
352024-07-10T23:07:25.068ZINFOcrucible-agent (datafile): region e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b state: Requested
362024-07-10T23:07:25.071ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372024-07-10T23:07:25.071ZINFOcrucible-agent (dropshot): request completed latency_us = 2858 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48554 req_id = 353109bd-b8dc-421a-ac17-15f7c4ffbb48 response_code = 200 uri = /crucible/0/regions
382024-07-10T23:07:25.082ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
392024-07-10T23:07:25.082ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
402024-07-10T23:07:25.165ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b" region = e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
412024-07-10T23:07:25.165ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b" "--data" "/data/regions/e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
422024-07-10T23:07:25.254ZINFOcrucible-agent (worker): region files created ok region = e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
432024-07-10T23:07:25.255ZINFOcrucible-agent (datafile): region e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b state: Requested -> Created
442024-07-10T23:07:25.255ZINFOcrucible-agent (worker): applying SMF actions post create...
452024-07-10T23:07:25.263ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
462024-07-10T23:07:25.263ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
472024-07-10T23:07:25.263ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
482024-07-10T23:07:25.263ZINFOcrucible-agent (worker): reconfig required
492024-07-10T23:07:25.263ZINFOcrucible-agent (worker): using existing config property group
502024-07-10T23:07:25.263ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9b7eea31-55cb-4ef2-900b-05c30732737b
512024-07-10T23:07:25.263ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
522024-07-10T23:07:25.263ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532024-07-10T23:07:25.264ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
542024-07-10T23:07:25.264ZINFOcrucible-agent (worker): commit
552024-07-10T23:07:25.272ZINFOcrucible-agent (worker): ok!
562024-07-10T23:07:25.272ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
572024-07-10T23:07:25.277ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
582024-07-10T23:07:25.287ZINFOcrucible-agent (worker): creating config property group
592024-07-10T23:07:25.290ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
602024-07-10T23:07:25.290ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e4a0cdf5-cc13-4137-8dc5-a1cbfa90d40b
612024-07-10T23:07:25.290ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
622024-07-10T23:07:25.290ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
632024-07-10T23:07:25.290ZINFOcrucible-agent (worker): commit
642024-07-10T23:07:25.294ZINFOcrucible-agent (worker): ok!
652024-07-10T23:07:25.299ZINFOcrucible-agent (worker): SMF ok!
662024-07-10T23:07:25.335ZINFOcrucible-agent (dropshot): request completed latency_us = 768 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48554 req_id = 6ef17a1b-062b-489a-84f7-5994e1ae409f response_code = 200 uri = /crucible/0/regions
672024-07-10T23:07:26.728ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:45748
682024-07-10T23:07:26.731ZINFOcrucible-agent (dropshot): request completed latency_us = 2295 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45748 req_id = 51a93b33-712e-415a-adf5-287da7494c22 response_code = 200 uri = /crucible/0/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
692024-07-10T23:07:26.733ZINFOcrucible-agent (datafile): path is "/data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b"
702024-07-10T23:07:26.743ZINFOcrucible-agent (datafile): dataset is oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
712024-07-10T23:07:26.752ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/9b7eea31-55cb-4ef2-900b-05c30732737b@9afadc7e-5ad8-44de-833e-b82e207e996e
722024-07-10T23:07:26.752ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/9b7eea31-55cb-4ef2-900b-05c30732737b", "9afadc7e-5ad8-44de-833e-b82e207e996e"]
732024-07-10T23:07:26.763ZINFOcrucible-agent (dropshot): request completed latency_us = 32197 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45748 req_id = 60b723bc-f97f-4f71-bdce-7c395a7f980d response_code = 200 uri = /crucible/0/regions/9b7eea31-55cb-4ef2-900b-05c30732737b/snapshots/9afadc7e-5ad8-44de-833e-b82e207e996e
742024-07-10T23:07:26.763ZINFOcrucible-agent (datafile): path is "/data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b"
752024-07-10T23:07:26.772ZINFOcrucible-agent (datafile): dataset is oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
762024-07-10T23:07:26.781ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/9b7eea31-55cb-4ef2-900b-05c30732737b@9afadc7e-5ad8-44de-833e-b82e207e996e
772024-07-10T23:07:26.781ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/9b7eea31-55cb-4ef2-900b-05c30732737b", "9afadc7e-5ad8-44de-833e-b82e207e996e"]
782024-07-10T23:07:26.791ZINFOcrucible-agent (datafile): requesting running snapshot 9b7eea31-55cb-4ef2-900b-05c30732737b-9afadc7e-5ad8-44de-833e-b82e207e996e state: Requested
792024-07-10T23:07:26.791ZINFOcrucible-agent (worker): applying SMF actions for region 9b7eea31-55cb-4ef2-900b-05c30732737b running snapshot 9afadc7e-5ad8-44de-833e-b82e207e996e (state Requested)...
802024-07-10T23:07:26.791ZINFOcrucible-agent (dropshot): request completed latency_us = 28019 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45748 req_id = eacdc149-d355-47a8-85b4-02e29b5bd19e response_code = 200 uri = /crucible/0/regions/9b7eea31-55cb-4ef2-900b-05c30732737b/snapshots/9afadc7e-5ad8-44de-833e-b82e207e996e/run
812024-07-10T23:07:26.792ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
822024-07-10T23:07:26.792ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
832024-07-10T23:07:26.792ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
842024-07-10T23:07:26.792ZINFOcrucible-agent (worker): reconfig required
852024-07-10T23:07:26.792ZINFOcrucible-agent (worker): using existing config property group
862024-07-10T23:07:26.792ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9b7eea31-55cb-4ef2-900b-05c30732737b
872024-07-10T23:07:26.792ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
882024-07-10T23:07:26.793ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
892024-07-10T23:07:26.793ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
902024-07-10T23:07:26.793ZINFOcrucible-agent (worker): commit
912024-07-10T23:07:26.797ZINFOcrucible-agent (worker): ok!
922024-07-10T23:07:26.799ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-9b7eea31-55cb-4ef2-900b-05c30732737b-9afadc7e-5ad8-44de-833e-b82e207e996e
932024-07-10T23:07:26.804ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-9b7eea31-55cb-4ef2-900b-05c30732737b-9afadc7e-5ad8-44de-833e-b82e207e996e
942024-07-10T23:07:26.815ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-9b7eea31-55cb-4ef2-900b-05c30732737b-9afadc7e-5ad8-44de-833e-b82e207e996e
952024-07-10T23:07:26.815ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b/.zfs/snapshot/9afadc7e-5ad8-44de-833e-b82e207e996e
962024-07-10T23:07:26.815ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
972024-07-10T23:07:26.815ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
982024-07-10T23:07:26.815ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
992024-07-10T23:07:26.815ZINFOcrucible-agent (worker): commit
1002024-07-10T23:07:26.819ZINFOcrucible-agent (worker): ok!
1012024-07-10T23:07:26.823ZINFOcrucible-agent (worker): SMF ok!
1022024-07-10T23:07:26.823ZINFOcrucible-agent (datafile): region 9b7eea31-55cb-4ef2-900b-05c30732737b running snapshot 9afadc7e-5ad8-44de-833e-b82e207e996e state: Requested -> Created
1032024-07-10T23:07:29.735ZINFOcrucible-agent (datafile): region 964a6e16-0226-4a55-a600-b8b5d2278991 state: Requested
1042024-07-10T23:07:29.736ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1052024-07-10T23:07:29.736ZINFOcrucible-agent (dropshot): request completed latency_us = 220 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48554 req_id = 1ba51662-f1ea-4ab3-b3af-47dadfdee435 response_code = 200 uri = /crucible/0/regions
1062024-07-10T23:07:29.744ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/964a6e16-0226-4a55-a600-b8b5d2278991
1072024-07-10T23:07:29.744ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/964a6e16-0226-4a55-a600-b8b5d2278991
1082024-07-10T23:07:29.793ZINFOcrucible-agent (worker): creating region Region { id: RegionId("964a6e16-0226-4a55-a600-b8b5d2278991"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19003, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/964a6e16-0226-4a55-a600-b8b5d2278991" region = 964a6e16-0226-4a55-a600-b8b5d2278991
1092024-07-10T23:07:29.795ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "964a6e16-0226-4a55-a600-b8b5d2278991" "--data" "/data/regions/964a6e16-0226-4a55-a600-b8b5d2278991" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 964a6e16-0226-4a55-a600-b8b5d2278991
1102024-07-10T23:07:29.860ZINFOcrucible-agent (worker): region files created ok region = 964a6e16-0226-4a55-a600-b8b5d2278991
1112024-07-10T23:07:29.860ZINFOcrucible-agent (datafile): region 964a6e16-0226-4a55-a600-b8b5d2278991 state: Requested -> Created
1122024-07-10T23:07:29.860ZINFOcrucible-agent (worker): applying SMF actions post create...
1132024-07-10T23:07:29.860ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-964a6e16-0226-4a55-a600-b8b5d2278991
1142024-07-10T23:07:29.863ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-964a6e16-0226-4a55-a600-b8b5d2278991
1152024-07-10T23:07:29.870ZINFOcrucible-agent (worker): creating config property group
1162024-07-10T23:07:29.873ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-964a6e16-0226-4a55-a600-b8b5d2278991
1172024-07-10T23:07:29.873ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/964a6e16-0226-4a55-a600-b8b5d2278991
1182024-07-10T23:07:29.873ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19003
1192024-07-10T23:07:29.873ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
1202024-07-10T23:07:29.874ZINFOcrucible-agent (worker): commit
1212024-07-10T23:07:29.877ZINFOcrucible-agent (worker): ok!
1222024-07-10T23:07:29.882ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
1232024-07-10T23:07:29.882ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1242024-07-10T23:07:29.882ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
1252024-07-10T23:07:29.882ZINFOcrucible-agent (worker): reconfig required
1262024-07-10T23:07:29.882ZINFOcrucible-agent (worker): using existing config property group
1272024-07-10T23:07:29.882ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9b7eea31-55cb-4ef2-900b-05c30732737b
1282024-07-10T23:07:29.886ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
1292024-07-10T23:07:29.886ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1302024-07-10T23:07:29.886ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
1312024-07-10T23:07:29.886ZINFOcrucible-agent (worker): commit
1322024-07-10T23:07:29.890ZINFOcrucible-agent (worker): ok!
1332024-07-10T23:07:29.892ZINFOcrucible-agent (worker): SMF ok!
1342024-07-10T23:07:29.981ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48554 req_id = 2163f0e5-40d7-4484-a68b-09332060e8e6 response_code = 200 uri = /crucible/0/regions
1352024-07-10T23:07:52.771ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48554 req_id = 2a709bfd-3ebe-42ac-8abf-c0b4c0cbe623 response_code = 200 uri = /crucible/0/regions/964a6e16-0226-4a55-a600-b8b5d2278991
1362024-07-10T23:07:52.774ZINFOcrucible-agent (datafile): path is "/data/regions/964a6e16-0226-4a55-a600-b8b5d2278991"
1372024-07-10T23:07:52.786ZINFOcrucible-agent (datafile): dataset is oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/964a6e16-0226-4a55-a600-b8b5d2278991
1382024-07-10T23:07:52.794ZINFOcrucible-agent (datafile): region 964a6e16-0226-4a55-a600-b8b5d2278991 state: Created -> Tombstoned
1392024-07-10T23:07:52.795ZINFOcrucible-agent (worker): applying SMF actions before removal...
1402024-07-10T23:07:52.795ZINFOcrucible-agent (dropshot): request completed latency_us = 20810 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:48554 req_id = 67a1a787-2cfd-4790-bcb4-c14cfe14488a response_code = 204 uri = /crucible/0/regions/964a6e16-0226-4a55-a600-b8b5d2278991
1412024-07-10T23:07:52.796ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-964a6e16-0226-4a55-a600-b8b5d2278991 (instance states: (Some(Online), None))
1422024-07-10T23:07:52.798ZINFOcrucible-agent (dropshot): request completed latency_us = 21 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48554 req_id = fe81c5aa-3e8b-4609-9df7-daa360323ba8 response_code = 200 uri = /crucible/0/regions/964a6e16-0226-4a55-a600-b8b5d2278991
1432024-07-10T23:07:52.800ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
1442024-07-10T23:07:52.800ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
1452024-07-10T23:07:52.800ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::13
1462024-07-10T23:07:52.800ZINFOcrucible-agent (worker): reconfig required
1472024-07-10T23:07:52.800ZINFOcrucible-agent (worker): using existing config property group
1482024-07-10T23:07:52.800ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9b7eea31-55cb-4ef2-900b-05c30732737b
1492024-07-10T23:07:52.800ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9b7eea31-55cb-4ef2-900b-05c30732737b
1502024-07-10T23:07:52.801ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
1512024-07-10T23:07:52.801ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
1522024-07-10T23:07:52.801ZINFOcrucible-agent (worker): commit
1532024-07-10T23:07:52.804ZINFOcrucible-agent (worker): ok!
1542024-07-10T23:07:52.806ZINFOcrucible-agent (worker): SMF ok!
1552024-07-10T23:07:52.816ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_fb82893c-b4be-46f2-994c-7b8318094f4c/crucible/regions/964a6e16-0226-4a55-a600-b8b5d2278991" region = 964a6e16-0226-4a55-a600-b8b5d2278991
1562024-07-10T23:07:52.868ZINFOcrucible-agent (datafile): region 964a6e16-0226-4a55-a600-b8b5d2278991 state: Tombstoned -> Destroyed
1572024-07-10T23:07:52.915ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48554 req_id = 23fda4cd-a6fe-48d1-a68e-98505ce42b3a response_code = 200 uri = /crucible/0/regions/964a6e16-0226-4a55-a600-b8b5d2278991