Max level shown:
12023-12-11T21:46:02.346ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:45685
22023-12-11T21:46:02.427ZINFOcrucible-agent (datafile): region e68a32e3-5fc5-4431-9e40-5e338ffa2b60 state: Requested
32023-12-11T21:46:02.428ZINFOcrucible-agent (dropshot): request completed latency_us = 16863 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45685 req_id = 3f115e83-6a91-4c18-9ffc-b8335b81971b response_code = 200 uri = /crucible/0/regions
42023-12-11T21:46:02.430ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
52023-12-11T21:46:02.440ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60
62023-12-11T21:46:02.440ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60
72023-12-11T21:46:02.486ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e68a32e3-5fc5-4431-9e40-5e338ffa2b60"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60" region = e68a32e3-5fc5-4431-9e40-5e338ffa2b60
82023-12-11T21:46:02.646ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45685 req_id = 422bc776-aba3-4297-b453-4d362863e3bf response_code = 200 uri = /crucible/0/regions
92023-12-11T21:46:02.785ZINFOcrucible-agent (worker): region files created ok region = e68a32e3-5fc5-4431-9e40-5e338ffa2b60
102023-12-11T21:46:02.785ZINFOcrucible-agent (datafile): region e68a32e3-5fc5-4431-9e40-5e338ffa2b60 state: Requested -> Created
112023-12-11T21:46:02.785ZINFOcrucible-agent (worker): applying SMF actions post create...
122023-12-11T21:46:02.788ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e68a32e3-5fc5-4431-9e40-5e338ffa2b60
132023-12-11T21:46:02.796ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e68a32e3-5fc5-4431-9e40-5e338ffa2b60
142023-12-11T21:46:02.820ZINFOcrucible-agent (worker): creating config property group
152023-12-11T21:46:02.826ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e68a32e3-5fc5-4431-9e40-5e338ffa2b60
162023-12-11T21:46:02.827ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60
172023-12-11T21:46:02.827ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182023-12-11T21:46:02.827ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192023-12-11T21:46:02.827ZINFOcrucible-agent (worker): commit
202023-12-11T21:46:02.837ZINFOcrucible-agent (worker): ok!
212023-12-11T21:46:02.855ZINFOcrucible-agent (worker): SMF ok!
222023-12-11T21:46:03.103ZINFOcrucible-agent (dropshot): request completed latency_us = 110 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45685 req_id = 5d566382-bf3a-4bc7-b93f-bf317819f016 response_code = 200 uri = /crucible/0/regions
232023-12-11T21:46:03.619ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:37059
242023-12-11T21:46:03.619ZINFOcrucible-agent (dropshot): request completed latency_us = 312 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37059 req_id = 82cb8f8b-3724-45e6-bee8-90ddf2ce6155 response_code = 200 uri = /crucible/0/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60
252023-12-11T21:46:03.620ZINFOcrucible-agent (datafile): path is "/data/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60"
262023-12-11T21:46:03.629ZINFOcrucible-agent (datafile): dataset is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60
272023-12-11T21:46:03.637ZINFOcrucible-agent (datafile): region e68a32e3-5fc5-4431-9e40-5e338ffa2b60 state: Created -> Tombstoned
282023-12-11T21:46:03.637ZINFOcrucible-agent (worker): applying SMF actions before removal...
292023-12-11T21:46:03.637ZINFOcrucible-agent (dropshot): request completed latency_us = 17681 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:37059 req_id = 13340c96-71f6-452a-875f-2d7a1e977c95 response_code = 204 uri = /crucible/0/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60
302023-12-11T21:46:03.637ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37059 req_id = df6295ef-1bbe-4bc3-8164-bad0e792c42e response_code = 200 uri = /crucible/0/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60
312023-12-11T21:46:03.639ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e68a32e3-5fc5-4431-9e40-5e338ffa2b60 (instance states: (Some(Online), None))
322023-12-11T21:46:03.643ZINFOcrucible-agent (worker): SMF ok!
332023-12-11T21:46:03.652ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60" region = e68a32e3-5fc5-4431-9e40-5e338ffa2b60
342023-12-11T21:46:03.706ZINFOcrucible-agent (datafile): region e68a32e3-5fc5-4431-9e40-5e338ffa2b60 state: Tombstoned -> Destroyed
352023-12-11T21:46:03.740ZINFOcrucible-agent (dropshot): request completed latency_us = 784 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:37059 req_id = 022bede2-fb9a-4550-971e-8b2d989eb98c response_code = 200 uri = /crucible/0/regions/e68a32e3-5fc5-4431-9e40-5e338ffa2b60
362023-12-11T21:51:24.276ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:65518
372023-12-11T21:51:24.276ZINFOcrucible-agent (datafile): region 5a68ca05-9d01-4699-9119-ee9a1ad1ca79 state: Requested
382023-12-11T21:51:24.280ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
392023-12-11T21:51:24.280ZINFOcrucible-agent (dropshot): request completed latency_us = 3833 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65518 req_id = 781850d2-3a01-4dcb-9765-dea0eaf23154 response_code = 200 uri = /crucible/0/regions
402023-12-11T21:51:24.291ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79
412023-12-11T21:51:24.291ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79
422023-12-11T21:51:24.348ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5a68ca05-9d01-4699-9119-ee9a1ad1ca79"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79" region = 5a68ca05-9d01-4699-9119-ee9a1ad1ca79
432023-12-11T21:51:24.423ZINFOcrucible-agent (worker): region files created ok region = 5a68ca05-9d01-4699-9119-ee9a1ad1ca79
442023-12-11T21:51:24.423ZINFOcrucible-agent (datafile): region 5a68ca05-9d01-4699-9119-ee9a1ad1ca79 state: Requested -> Created
452023-12-11T21:51:24.423ZINFOcrucible-agent (worker): applying SMF actions post create...
462023-12-11T21:51:24.424ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5a68ca05-9d01-4699-9119-ee9a1ad1ca79
472023-12-11T21:51:24.429ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5a68ca05-9d01-4699-9119-ee9a1ad1ca79
482023-12-11T21:51:24.450ZINFOcrucible-agent (worker): creating config property group
492023-12-11T21:51:24.454ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5a68ca05-9d01-4699-9119-ee9a1ad1ca79
502023-12-11T21:51:24.454ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79
512023-12-11T21:51:24.454ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522023-12-11T21:51:24.455ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
532023-12-11T21:51:24.455ZINFOcrucible-agent (worker): commit
542023-12-11T21:51:24.458ZINFOcrucible-agent (worker): ok!
552023-12-11T21:51:24.462ZINFOcrucible-agent (worker): SMF ok!
562023-12-11T21:51:24.651ZINFOcrucible-agent (dropshot): request completed latency_us = 98 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65518 req_id = 0511bad8-94e4-4d35-b91b-331f15bb87be response_code = 200 uri = /crucible/0/regions
572023-12-11T21:51:54.239ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:43917
582023-12-11T21:51:54.239ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43917 req_id = fff3aa62-6685-4c61-920f-7dccb314d3cc response_code = 200 uri = /crucible/0/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79
592023-12-11T21:51:54.240ZINFOcrucible-agent (datafile): path is "/data/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79"
602023-12-11T21:51:54.252ZINFOcrucible-agent (datafile): dataset is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79
612023-12-11T21:51:54.261ZINFOcrucible-agent (datafile): region 5a68ca05-9d01-4699-9119-ee9a1ad1ca79 state: Created -> Tombstoned
622023-12-11T21:51:54.261ZINFOcrucible-agent (worker): applying SMF actions before removal...
632023-12-11T21:51:54.261ZINFOcrucible-agent (dropshot): request completed latency_us = 21618 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:43917 req_id = da100d80-7ced-4c9a-bb42-75e9c96092a6 response_code = 204 uri = /crucible/0/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79
642023-12-11T21:51:54.261ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43917 req_id = 5c8598c6-6727-4920-b82b-8d470adf9ed9 response_code = 200 uri = /crucible/0/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79
652023-12-11T21:51:54.263ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5a68ca05-9d01-4699-9119-ee9a1ad1ca79 (instance states: (Some(Online), None))
662023-12-11T21:51:54.270ZINFOcrucible-agent (worker): SMF ok!
672023-12-11T21:51:54.280ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79" region = 5a68ca05-9d01-4699-9119-ee9a1ad1ca79
682023-12-11T21:51:54.322ZINFOcrucible-agent (datafile): region 5a68ca05-9d01-4699-9119-ee9a1ad1ca79 state: Tombstoned -> Destroyed
692023-12-11T21:51:54.352ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43917 req_id = 1bbd0f17-4269-418c-bfcd-ca5e2e04abb5 response_code = 200 uri = /crucible/0/regions/5a68ca05-9d01-4699-9119-ee9a1ad1ca79