Max level shown:
1 [ Feb 22 01:10:44 Enabled. ]
2 [ Feb 22 01:10:44 Rereading configuration. ]
3 [ Feb 22 01:10:46 Rereading configuration. ]
4 [ Feb 22 01:10:49 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-02-22T01:10:49.380ZINFOcrucible-agent: dataset: "oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible"
72024-02-22T01:10:49.381ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
82024-02-22T01:10:49.381ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-02-22T01:10:49.513ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
102024-02-22T01:11:42.870ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:62600
112024-02-22T01:11:42.947ZINFOcrucible-agent (datafile): region 6457d1f2-6a4f-4f79-9208-83b5f58a3e2b state: Requested
122024-02-22T01:11:42.948ZINFOcrucible-agent (dropshot): request completed latency_us = 1148 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:62600 req_id = 16ebdb4c-0d34-4a3c-9945-0a5ac37883c1 response_code = 200 uri = /crucible/0/regions
132024-02-22T01:11:42.948ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-02-22T01:11:42.958ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
152024-02-22T01:11:42.958ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
162024-02-22T01:11:43.013ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6457d1f2-6a4f-4f79-9208-83b5f58a3e2b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b" region = 6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
172024-02-22T01:11:43.129ZINFOcrucible-agent (worker): region files created ok region = 6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
182024-02-22T01:11:43.129ZINFOcrucible-agent (datafile): region 6457d1f2-6a4f-4f79-9208-83b5f58a3e2b state: Requested -> Created
192024-02-22T01:11:43.129ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-02-22T01:11:43.129ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
212024-02-22T01:11:43.133ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
222024-02-22T01:11:43.143ZINFOcrucible-agent (worker): creating config property group
232024-02-22T01:11:43.146ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
242024-02-22T01:11:43.146ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
252024-02-22T01:11:43.147ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-02-22T01:11:43.147ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
272024-02-22T01:11:43.147ZINFOcrucible-agent (worker): commit
282024-02-22T01:11:43.150ZINFOcrucible-agent (worker): ok!
292024-02-22T01:11:43.154ZINFOcrucible-agent (worker): SMF ok!
302024-02-22T01:11:43.318ZINFOcrucible-agent (dropshot): request completed latency_us = 718 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:62600 req_id = ec5141c4-92f7-4921-9a3c-77086ca743b7 response_code = 200 uri = /crucible/0/regions
312024-02-22T01:11:44.136ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:45776
322024-02-22T01:11:44.136ZINFOcrucible-agent (dropshot): request completed latency_us = 243 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45776 req_id = 8f601ac5-216d-4a21-baed-65318fc7894f response_code = 200 uri = /crucible/0/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
332024-02-22T01:11:44.137ZINFOcrucible-agent (datafile): path is "/data/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b"
342024-02-22T01:11:44.146ZINFOcrucible-agent (datafile): dataset is oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
352024-02-22T01:11:44.155ZINFOcrucible-agent (datafile): region 6457d1f2-6a4f-4f79-9208-83b5f58a3e2b state: Created -> Tombstoned
362024-02-22T01:11:44.155ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-02-22T01:11:44.155ZINFOcrucible-agent (dropshot): request completed latency_us = 18505 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:45776 req_id = 563c79d8-0278-4918-8fba-2309c7c4c2e5 response_code = 204 uri = /crucible/0/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
382024-02-22T01:11:44.155ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45776 req_id = 0506d8cc-7a4a-4e4b-beee-c7f6b93eb1b0 response_code = 200 uri = /crucible/0/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
392024-02-22T01:11:44.156ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6457d1f2-6a4f-4f79-9208-83b5f58a3e2b (instance states: (Some(Online), None))
402024-02-22T01:11:44.160ZINFOcrucible-agent (worker): SMF ok!
412024-02-22T01:11:44.169ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b" region = 6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
422024-02-22T01:11:44.220ZINFOcrucible-agent (datafile): region 6457d1f2-6a4f-4f79-9208-83b5f58a3e2b state: Tombstoned -> Destroyed
432024-02-22T01:11:44.273ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45776 req_id = 12cc1243-662a-4092-9c1f-eb153b2ef92e response_code = 200 uri = /crucible/0/regions/6457d1f2-6a4f-4f79-9208-83b5f58a3e2b
442024-02-22T01:12:25.172ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:61130
452024-02-22T01:12:25.233ZINFOcrucible-agent (datafile): region ec0ef140-0c76-426c-8a31-b89eab9bf1d0 state: Requested
462024-02-22T01:12:25.233ZINFOcrucible-agent (dropshot): request completed latency_us = 1118 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61130 req_id = 44f7a8ee-7fd1-4482-bf23-3aded95077a9 response_code = 200 uri = /crucible/0/regions
472024-02-22T01:12:25.233ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-02-22T01:12:25.242ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/ec0ef140-0c76-426c-8a31-b89eab9bf1d0
492024-02-22T01:12:25.243ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible/regions/ec0ef140-0c76-426c-8a31-b89eab9bf1d0
502024-02-22T01:12:25.305ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ec0ef140-0c76-426c-8a31-b89eab9bf1d0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/ec0ef140-0c76-426c-8a31-b89eab9bf1d0" region = ec0ef140-0c76-426c-8a31-b89eab9bf1d0
512024-02-22T01:12:25.417ZINFOcrucible-agent (worker): region files created ok region = ec0ef140-0c76-426c-8a31-b89eab9bf1d0
522024-02-22T01:12:25.417ZINFOcrucible-agent (datafile): region ec0ef140-0c76-426c-8a31-b89eab9bf1d0 state: Requested -> Created
532024-02-22T01:12:25.417ZINFOcrucible-agent (worker): applying SMF actions post create...
542024-02-22T01:12:25.419ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ec0ef140-0c76-426c-8a31-b89eab9bf1d0
552024-02-22T01:12:25.426ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ec0ef140-0c76-426c-8a31-b89eab9bf1d0
562024-02-22T01:12:25.433ZINFOcrucible-agent (dropshot): request completed latency_us = 621 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:61130 req_id = 4504042a-b137-4a60-acd3-648bba66481f response_code = 200 uri = /crucible/0/regions
572024-02-22T01:12:25.444ZINFOcrucible-agent (worker): creating config property group
582024-02-22T01:12:25.451ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ec0ef140-0c76-426c-8a31-b89eab9bf1d0
592024-02-22T01:12:25.451ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ec0ef140-0c76-426c-8a31-b89eab9bf1d0
602024-02-22T01:12:25.452ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-02-22T01:12:25.452ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
622024-02-22T01:12:25.452ZINFOcrucible-agent (worker): commit
632024-02-22T01:12:25.461ZINFOcrucible-agent (worker): ok!
642024-02-22T01:12:25.471ZINFOcrucible-agent (worker): SMF ok!