Max level shown:
1 [ Feb 22 01:10:44 Enabled. ]
2 [ Feb 22 01:10:44 Rereading configuration. ]
3 [ Feb 22 01:10:46 Rereading configuration. ]
4 [ Feb 22 01:10:49 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-02-22T01:10:49.332ZINFOcrucible-agent: dataset: "oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible"
72024-02-22T01:10:49.333ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82024-02-22T01:10:49.333ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-02-22T01:10:49.487ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
102024-02-22T01:11:42.946ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:35930
112024-02-22T01:11:42.948ZINFOcrucible-agent (datafile): region 3ea0fab0-2d62-4972-bc8b-83c2de32c822 state: Requested
122024-02-22T01:11:42.949ZINFOcrucible-agent (dropshot): request completed latency_us = 2053 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35930 req_id = 17ce0720-dfd3-49a9-a8e3-32b381560ab2 response_code = 200 uri = /crucible/0/regions
132024-02-22T01:11:42.950ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-02-22T01:11:42.959ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822
152024-02-22T01:11:42.959ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822
162024-02-22T01:11:43.030ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3ea0fab0-2d62-4972-bc8b-83c2de32c822"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822" region = 3ea0fab0-2d62-4972-bc8b-83c2de32c822
172024-02-22T01:11:43.123ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35930 req_id = 21bef02d-37f9-4f9b-83ba-381277d89388 response_code = 200 uri = /crucible/0/regions
182024-02-22T01:11:43.149ZINFOcrucible-agent (worker): region files created ok region = 3ea0fab0-2d62-4972-bc8b-83c2de32c822
192024-02-22T01:11:43.149ZINFOcrucible-agent (datafile): region 3ea0fab0-2d62-4972-bc8b-83c2de32c822 state: Requested -> Created
202024-02-22T01:11:43.149ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-02-22T01:11:43.149ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3ea0fab0-2d62-4972-bc8b-83c2de32c822
222024-02-22T01:11:43.154ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3ea0fab0-2d62-4972-bc8b-83c2de32c822
232024-02-22T01:11:43.161ZINFOcrucible-agent (worker): creating config property group
242024-02-22T01:11:43.164ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3ea0fab0-2d62-4972-bc8b-83c2de32c822
252024-02-22T01:11:43.164ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822
262024-02-22T01:11:43.164ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-02-22T01:11:43.164ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
282024-02-22T01:11:43.164ZINFOcrucible-agent (worker): commit
292024-02-22T01:11:43.168ZINFOcrucible-agent (worker): ok!
302024-02-22T01:11:43.173ZINFOcrucible-agent (worker): SMF ok!
312024-02-22T01:11:43.391ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35930 req_id = a716c7eb-e704-4a5e-8a81-d36238628770 response_code = 200 uri = /crucible/0/regions
322024-02-22T01:11:44.314ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:38189
332024-02-22T01:11:44.314ZINFOcrucible-agent (dropshot): request completed latency_us = 118 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38189 req_id = f459545a-438b-450a-844c-47e719f9281b response_code = 200 uri = /crucible/0/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822
342024-02-22T01:11:44.314ZINFOcrucible-agent (datafile): path is "/data/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822"
352024-02-22T01:11:44.324ZINFOcrucible-agent (datafile): dataset is oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822
362024-02-22T01:11:44.333ZINFOcrucible-agent (datafile): region 3ea0fab0-2d62-4972-bc8b-83c2de32c822 state: Created -> Tombstoned
372024-02-22T01:11:44.333ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-02-22T01:11:44.333ZINFOcrucible-agent (dropshot): request completed latency_us = 19111 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:38189 req_id = 0e3397a6-dead-4744-9373-d89ea63663ed response_code = 204 uri = /crucible/0/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822
392024-02-22T01:11:44.333ZINFOcrucible-agent (dropshot): request completed latency_us = 21 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38189 req_id = d64bfada-a9da-49e3-989a-f3512ead2a10 response_code = 200 uri = /crucible/0/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822
402024-02-22T01:11:44.334ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3ea0fab0-2d62-4972-bc8b-83c2de32c822 (instance states: (Some(Online), None))
412024-02-22T01:11:44.338ZINFOcrucible-agent (worker): SMF ok!
422024-02-22T01:11:44.348ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822" region = 3ea0fab0-2d62-4972-bc8b-83c2de32c822
432024-02-22T01:11:44.400ZINFOcrucible-agent (datafile): region 3ea0fab0-2d62-4972-bc8b-83c2de32c822 state: Tombstoned -> Destroyed
442024-02-22T01:11:44.415ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38189 req_id = da363a1e-2797-49cd-a9d3-36011cbdde56 response_code = 200 uri = /crucible/0/regions/3ea0fab0-2d62-4972-bc8b-83c2de32c822
452024-02-22T01:12:25.202ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:54598
462024-02-22T01:12:25.232ZINFOcrucible-agent (datafile): region 90bbc30a-2152-462a-abd9-8748cfbcf1f5 state: Requested
472024-02-22T01:12:25.232ZINFOcrucible-agent (dropshot): request completed latency_us = 292 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54598 req_id = ee0df10a-0a7b-4259-9392-05cf2abac6de response_code = 200 uri = /crucible/0/regions
482024-02-22T01:12:25.232ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-02-22T01:12:25.242ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/90bbc30a-2152-462a-abd9-8748cfbcf1f5
502024-02-22T01:12:25.242ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible/regions/90bbc30a-2152-462a-abd9-8748cfbcf1f5
512024-02-22T01:12:25.312ZINFOcrucible-agent (worker): creating region Region { id: RegionId("90bbc30a-2152-462a-abd9-8748cfbcf1f5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/90bbc30a-2152-462a-abd9-8748cfbcf1f5" region = 90bbc30a-2152-462a-abd9-8748cfbcf1f5
522024-02-22T01:12:25.442ZINFOcrucible-agent (worker): region files created ok region = 90bbc30a-2152-462a-abd9-8748cfbcf1f5
532024-02-22T01:12:25.442ZINFOcrucible-agent (datafile): region 90bbc30a-2152-462a-abd9-8748cfbcf1f5 state: Requested -> Created
542024-02-22T01:12:25.442ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-02-22T01:12:25.443ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-90bbc30a-2152-462a-abd9-8748cfbcf1f5
562024-02-22T01:12:25.451ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-90bbc30a-2152-462a-abd9-8748cfbcf1f5
572024-02-22T01:12:25.470ZINFOcrucible-agent (worker): creating config property group
582024-02-22T01:12:25.480ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-90bbc30a-2152-462a-abd9-8748cfbcf1f5
592024-02-22T01:12:25.481ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/90bbc30a-2152-462a-abd9-8748cfbcf1f5
602024-02-22T01:12:25.481ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-02-22T01:12:25.481ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
622024-02-22T01:12:25.481ZINFOcrucible-agent (worker): commit
632024-02-22T01:12:25.489ZINFOcrucible-agent (worker): ok!
642024-02-22T01:12:25.497ZINFOcrucible-agent (worker): SMF ok!
652024-02-22T01:12:25.499ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54598 req_id = cf33a849-7400-4937-ba58-47b7c7869b8f response_code = 200 uri = /crucible/0/regions