Max level shown:
1 [ Oct 10 06:01:12 Enabled. ]
2 [ Oct 10 06:01:12 Rereading configuration. ]
3 [ Oct 10 06:01:13 Rereading configuration. ]
4 [ Oct 10 06:01:15 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-10T06:01:15.785ZINFOcrucible-agent: dataset: "oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible"
72024-10-10T06:01:15.787ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82024-10-10T06:01:15.787ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-10T06:01:15.805ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-10T06:01:15.954ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
112024-10-10T06:02:05.915ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:48320
122024-10-10T06:02:05.929ZINFOcrucible-agent (datafile): region aa180cea-c0a5-4ff0-999a-9e57361e1b30 state: Requested
132024-10-10T06:02:05.931ZINFOcrucible-agent (dropshot): request completed latency_us = 3236 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48320 req_id = 60872d6e-3ce5-4a6e-91e8-79f62a32b815 response_code = 200 uri = /crucible/0/regions
142024-10-10T06:02:05.932ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-10-10T06:02:05.942ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30
162024-10-10T06:02:05.942ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30
172024-10-10T06:02:06.007ZINFOcrucible-agent (worker): creating region Region { id: RegionId("aa180cea-c0a5-4ff0-999a-9e57361e1b30"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30" region = aa180cea-c0a5-4ff0-999a-9e57361e1b30
182024-10-10T06:02:06.007ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "aa180cea-c0a5-4ff0-999a-9e57361e1b30" "--data" "/data/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = aa180cea-c0a5-4ff0-999a-9e57361e1b30
192024-10-10T06:02:06.109ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48320 req_id = b8d25bd8-019f-455b-b918-4f8c6268f5d0 response_code = 200 uri = /crucible/0/regions
202024-10-10T06:02:06.127ZINFOcrucible-agent (worker): region files created ok region = aa180cea-c0a5-4ff0-999a-9e57361e1b30
212024-10-10T06:02:06.128ZINFOcrucible-agent (datafile): region aa180cea-c0a5-4ff0-999a-9e57361e1b30 state: Requested -> Created
222024-10-10T06:02:06.128ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-10-10T06:02:06.128ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-aa180cea-c0a5-4ff0-999a-9e57361e1b30
242024-10-10T06:02:06.136ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-aa180cea-c0a5-4ff0-999a-9e57361e1b30
252024-10-10T06:02:06.151ZINFOcrucible-agent (worker): creating config property group
262024-10-10T06:02:06.158ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-aa180cea-c0a5-4ff0-999a-9e57361e1b30
272024-10-10T06:02:06.159ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30
282024-10-10T06:02:06.159ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-10-10T06:02:06.159ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
302024-10-10T06:02:06.159ZINFOcrucible-agent (worker): commit
312024-10-10T06:02:06.163ZINFOcrucible-agent (worker): ok!
322024-10-10T06:02:06.173ZINFOcrucible-agent (worker): SMF ok!
332024-10-10T06:02:06.475ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48320 req_id = 902e016c-34a8-407c-974e-fcd401e8b005 response_code = 200 uri = /crucible/0/regions
342024-10-10T06:02:06.887ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48320 req_id = 6dded52e-6073-4bc4-ab84-ab5b9dd3bcbd response_code = 200 uri = /crucible/0/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30
352024-10-10T06:02:06.891ZINFOcrucible-agent (datafile): path is "/data/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30"
362024-10-10T06:02:06.902ZINFOcrucible-agent (datafile): dataset is oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30
372024-10-10T06:02:06.912ZINFOcrucible-agent (datafile): region aa180cea-c0a5-4ff0-999a-9e57361e1b30 state: Created -> Tombstoned
382024-10-10T06:02:06.912ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-10-10T06:02:06.912ZINFOcrucible-agent (dropshot): request completed latency_us = 22035 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:48320 req_id = b21450c7-7a10-433e-a5fd-e182fad7a38e response_code = 204 uri = /crucible/0/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30
402024-10-10T06:02:06.913ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-aa180cea-c0a5-4ff0-999a-9e57361e1b30 (instance states: (Some(Online), None))
412024-10-10T06:02:06.915ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48320 req_id = 7be019e4-b46f-43a2-a7a1-d8c03dd2cac5 response_code = 200 uri = /crucible/0/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30
422024-10-10T06:02:06.919ZINFOcrucible-agent (worker): SMF ok!
432024-10-10T06:02:06.930ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30" region = aa180cea-c0a5-4ff0-999a-9e57361e1b30
442024-10-10T06:02:06.998ZINFOcrucible-agent (datafile): region aa180cea-c0a5-4ff0-999a-9e57361e1b30 state: Tombstoned -> Destroyed
452024-10-10T06:02:07.065ZINFOcrucible-agent (dropshot): request completed latency_us = 679 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48320 req_id = d41691f4-ed81-435e-8cfe-532f6b07fc2d response_code = 200 uri = /crucible/0/regions/aa180cea-c0a5-4ff0-999a-9e57361e1b30
462024-10-10T06:02:30.759ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:63613
472024-10-10T06:02:30.759ZINFOcrucible-agent (datafile): region 461afc55-6a75-4f89-9a22-af0763a741c8 state: Requested
482024-10-10T06:02:30.759ZINFOcrucible-agent (dropshot): request completed latency_us = 212 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63613 req_id = aa2841c9-8979-4bb2-bdce-fc537ace70bc response_code = 200 uri = /crucible/0/regions
492024-10-10T06:02:30.759ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502024-10-10T06:02:30.769ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8
512024-10-10T06:02:30.769ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8
522024-10-10T06:02:30.827ZINFOcrucible-agent (worker): creating region Region { id: RegionId("461afc55-6a75-4f89-9a22-af0763a741c8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/461afc55-6a75-4f89-9a22-af0763a741c8" region = 461afc55-6a75-4f89-9a22-af0763a741c8
532024-10-10T06:02:30.829ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "461afc55-6a75-4f89-9a22-af0763a741c8" "--data" "/data/regions/461afc55-6a75-4f89-9a22-af0763a741c8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 461afc55-6a75-4f89-9a22-af0763a741c8
542024-10-10T06:02:30.896ZINFOcrucible-agent (worker): region files created ok region = 461afc55-6a75-4f89-9a22-af0763a741c8
552024-10-10T06:02:30.896ZINFOcrucible-agent (datafile): region 461afc55-6a75-4f89-9a22-af0763a741c8 state: Requested -> Created
562024-10-10T06:02:30.896ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-10-10T06:02:30.897ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-461afc55-6a75-4f89-9a22-af0763a741c8
582024-10-10T06:02:30.901ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-461afc55-6a75-4f89-9a22-af0763a741c8
592024-10-10T06:02:30.908ZINFOcrucible-agent (worker): creating config property group
602024-10-10T06:02:30.912ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-461afc55-6a75-4f89-9a22-af0763a741c8
612024-10-10T06:02:30.912ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/461afc55-6a75-4f89-9a22-af0763a741c8
622024-10-10T06:02:30.913ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-10-10T06:02:30.913ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
642024-10-10T06:02:30.913ZINFOcrucible-agent (worker): commit
652024-10-10T06:02:30.917ZINFOcrucible-agent (worker): ok!
662024-10-10T06:02:30.917ZINFOcrucible-agent (dropshot): request completed latency_us = 717 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63613 req_id = cb742579-ec86-4c62-90d9-51511cc81eb3 response_code = 200 uri = /crucible/0/regions
672024-10-10T06:02:30.922ZINFOcrucible-agent (worker): SMF ok!
682024-10-10T06:05:51.965ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:52955
692024-10-10T06:05:51.965ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52955 req_id = 4c72945f-6a7c-4442-b5cd-29b4bd3954c5 response_code = 200 uri = /crucible/0/regions/461afc55-6a75-4f89-9a22-af0763a741c8
702024-10-10T06:05:51.969ZINFOcrucible-agent (datafile): path is "/data/regions/461afc55-6a75-4f89-9a22-af0763a741c8"
712024-10-10T06:05:51.978ZINFOcrucible-agent (datafile): dataset is oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8
722024-10-10T06:05:51.986ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8@d2914df5-b7af-458e-8e86-4c22bc095323
732024-10-10T06:05:51.986ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8", "d2914df5-b7af-458e-8e86-4c22bc095323"]
742024-10-10T06:05:52.000ZINFOcrucible-agent (dropshot): request completed latency_us = 31070 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52955 req_id = 031f9ff2-690f-49cc-b021-27a3ed869a09 response_code = 200 uri = /crucible/0/regions/461afc55-6a75-4f89-9a22-af0763a741c8/snapshots/d2914df5-b7af-458e-8e86-4c22bc095323
752024-10-10T06:05:52.004ZINFOcrucible-agent (datafile): path is "/data/regions/461afc55-6a75-4f89-9a22-af0763a741c8"
762024-10-10T06:05:52.013ZINFOcrucible-agent (datafile): dataset is oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8
772024-10-10T06:05:52.022ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8@d2914df5-b7af-458e-8e86-4c22bc095323
782024-10-10T06:05:52.022ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8", "d2914df5-b7af-458e-8e86-4c22bc095323"]
792024-10-10T06:05:52.031ZINFOcrucible-agent (datafile): requesting running snapshot 461afc55-6a75-4f89-9a22-af0763a741c8-d2914df5-b7af-458e-8e86-4c22bc095323 state: Requested
802024-10-10T06:05:52.032ZINFOcrucible-agent (worker): applying SMF actions for region 461afc55-6a75-4f89-9a22-af0763a741c8 running snapshot d2914df5-b7af-458e-8e86-4c22bc095323 (state Requested)...
812024-10-10T06:05:52.032ZINFOcrucible-agent (dropshot): request completed latency_us = 28646 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52955 req_id = 5ebdcb82-6ee3-409c-b34e-3acc4fdff332 response_code = 200 uri = /crucible/0/regions/461afc55-6a75-4f89-9a22-af0763a741c8/snapshots/d2914df5-b7af-458e-8e86-4c22bc095323/run
822024-10-10T06:05:52.042ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-461afc55-6a75-4f89-9a22-af0763a741c8-d2914df5-b7af-458e-8e86-4c22bc095323
832024-10-10T06:05:52.048ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-461afc55-6a75-4f89-9a22-af0763a741c8-d2914df5-b7af-458e-8e86-4c22bc095323
842024-10-10T06:05:52.069ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-461afc55-6a75-4f89-9a22-af0763a741c8-d2914df5-b7af-458e-8e86-4c22bc095323
852024-10-10T06:05:52.069ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/461afc55-6a75-4f89-9a22-af0763a741c8/.zfs/snapshot/d2914df5-b7af-458e-8e86-4c22bc095323
862024-10-10T06:05:52.069ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
872024-10-10T06:05:52.070ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
882024-10-10T06:05:52.070ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
892024-10-10T06:05:52.070ZINFOcrucible-agent (worker): commit
902024-10-10T06:05:52.077ZINFOcrucible-agent (worker): ok!
912024-10-10T06:05:52.087ZINFOcrucible-agent (worker): SMF ok!
922024-10-10T06:05:52.087ZINFOcrucible-agent (datafile): region 461afc55-6a75-4f89-9a22-af0763a741c8 running snapshot d2914df5-b7af-458e-8e86-4c22bc095323 state: Requested -> Created
932024-10-10T06:05:52.246ZINFOcrucible-agent (datafile): path is "/data/regions/461afc55-6a75-4f89-9a22-af0763a741c8"
942024-10-10T06:05:52.255ZINFOcrucible-agent (datafile): dataset is oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8
952024-10-10T06:05:52.262ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8@d2914df5-b7af-458e-8e86-4c22bc095323
962024-10-10T06:05:52.262ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/461afc55-6a75-4f89-9a22-af0763a741c8", "d2914df5-b7af-458e-8e86-4c22bc095323"]
972024-10-10T06:05:52.271ZINFOcrucible-agent (dropshot): request completed latency_us = 24726 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52955 req_id = 6f41b37e-0ae2-41e4-b90f-fb7ac9581fd5 response_code = 200 uri = /crucible/0/regions/461afc55-6a75-4f89-9a22-af0763a741c8/snapshots/d2914df5-b7af-458e-8e86-4c22bc095323/run
982024-10-10T06:05:56.106ZINFOcrucible-agent (datafile): region fe3ba128-8694-4f83-a640-b24eb7cda690 state: Requested
992024-10-10T06:05:56.107ZINFOcrucible-agent (dropshot): request completed latency_us = 763 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52955 req_id = b13d7c08-6ce3-4279-bac7-b142db3dacb7 response_code = 200 uri = /crucible/0/regions
1002024-10-10T06:05:56.107ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1012024-10-10T06:05:56.116ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/fe3ba128-8694-4f83-a640-b24eb7cda690
1022024-10-10T06:05:56.116ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/fe3ba128-8694-4f83-a640-b24eb7cda690
1032024-10-10T06:05:56.209ZINFOcrucible-agent (worker): creating region Region { id: RegionId("fe3ba128-8694-4f83-a640-b24eb7cda690"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/fe3ba128-8694-4f83-a640-b24eb7cda690" region = fe3ba128-8694-4f83-a640-b24eb7cda690
1042024-10-10T06:05:56.211ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "fe3ba128-8694-4f83-a640-b24eb7cda690" "--data" "/data/regions/fe3ba128-8694-4f83-a640-b24eb7cda690" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = fe3ba128-8694-4f83-a640-b24eb7cda690
1052024-10-10T06:05:56.332ZINFOcrucible-agent (worker): region files created ok region = fe3ba128-8694-4f83-a640-b24eb7cda690
1062024-10-10T06:05:56.332ZINFOcrucible-agent (datafile): region fe3ba128-8694-4f83-a640-b24eb7cda690 state: Requested -> Created
1072024-10-10T06:05:56.333ZINFOcrucible-agent (worker): applying SMF actions post create...
1082024-10-10T06:05:56.334ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-fe3ba128-8694-4f83-a640-b24eb7cda690
1092024-10-10T06:05:56.345ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-fe3ba128-8694-4f83-a640-b24eb7cda690
1102024-10-10T06:05:56.371ZINFOcrucible-agent (worker): creating config property group
1112024-10-10T06:05:56.380ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-fe3ba128-8694-4f83-a640-b24eb7cda690
1122024-10-10T06:05:56.381ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/fe3ba128-8694-4f83-a640-b24eb7cda690
1132024-10-10T06:05:56.381ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1142024-10-10T06:05:56.381ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
1152024-10-10T06:05:56.381ZINFOcrucible-agent (worker): commit
1162024-10-10T06:05:56.392ZINFOcrucible-agent (worker): ok!
1172024-10-10T06:05:56.403ZINFOcrucible-agent (worker): SMF ok!
1182024-10-10T06:05:56.414ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52955 req_id = 8187af13-e2e8-446f-a20b-44af2069adac response_code = 200 uri = /crucible/0/regions
1192024-10-10T06:06:21.975ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52955 req_id = 70208875-7192-4bf6-8d47-881f43990769 response_code = 200 uri = /crucible/0/regions/fe3ba128-8694-4f83-a640-b24eb7cda690
1202024-10-10T06:06:21.979ZINFOcrucible-agent (datafile): path is "/data/regions/fe3ba128-8694-4f83-a640-b24eb7cda690"
1212024-10-10T06:06:21.992ZINFOcrucible-agent (datafile): dataset is oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/fe3ba128-8694-4f83-a640-b24eb7cda690
1222024-10-10T06:06:22.002ZINFOcrucible-agent (datafile): region fe3ba128-8694-4f83-a640-b24eb7cda690 state: Created -> Tombstoned
1232024-10-10T06:06:22.002ZINFOcrucible-agent (worker): applying SMF actions before removal...
1242024-10-10T06:06:22.002ZINFOcrucible-agent (dropshot): request completed latency_us = 23387 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:52955 req_id = fd26e904-6650-4410-b2ba-5b9dcd874c59 response_code = 204 uri = /crucible/0/regions/fe3ba128-8694-4f83-a640-b24eb7cda690
1252024-10-10T06:06:22.004ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-fe3ba128-8694-4f83-a640-b24eb7cda690 (instance states: (Some(Online), None))
1262024-10-10T06:06:22.006ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52955 req_id = b036a211-dd42-42ef-8182-0715a89e61b2 response_code = 200 uri = /crucible/0/regions/fe3ba128-8694-4f83-a640-b24eb7cda690
1272024-10-10T06:06:22.011ZINFOcrucible-agent (worker): SMF ok!
1282024-10-10T06:06:22.022ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_04a4d872-e8d3-4824-9983-be2c2e2c0cf7/crucible/regions/fe3ba128-8694-4f83-a640-b24eb7cda690" region = fe3ba128-8694-4f83-a640-b24eb7cda690
1292024-10-10T06:06:22.074ZINFOcrucible-agent (datafile): region fe3ba128-8694-4f83-a640-b24eb7cda690 state: Tombstoned -> Destroyed
1302024-10-10T06:06:22.123ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52955 req_id = 673f9d4c-3d18-4d85-8ddf-71d654f6818d response_code = 200 uri = /crucible/0/regions/fe3ba128-8694-4f83-a640-b24eb7cda690