Max level shown:
12024-03-30T05:45:18.006ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:35062
22024-03-30T05:45:18.039ZINFOcrucible-agent (datafile): region 5533c111-2905-41b6-b14a-cf7a0e39e42c state: Requested
32024-03-30T05:45:18.040ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42024-03-30T05:45:18.040ZINFOcrucible-agent (dropshot): request completed latency_us = 3790 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35062 req_id = 49bffcc1-5e58-4d34-a157-0fdebc36cd2d response_code = 200 uri = /crucible/0/regions
52024-03-30T05:45:18.050ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_82347231-68ab-4934-8007-b28d9a3a3777/crucible/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
62024-03-30T05:45:18.050ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_82347231-68ab-4934-8007-b28d9a3a3777/crucible/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
72024-03-30T05:45:18.111ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5533c111-2905-41b6-b14a-cf7a0e39e42c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c" region = 5533c111-2905-41b6-b14a-cf7a0e39e42c
82024-03-30T05:45:18.211ZINFOcrucible-agent (worker): region files created ok region = 5533c111-2905-41b6-b14a-cf7a0e39e42c
92024-03-30T05:45:18.211ZINFOcrucible-agent (datafile): region 5533c111-2905-41b6-b14a-cf7a0e39e42c state: Requested -> Created
102024-03-30T05:45:18.211ZINFOcrucible-agent (worker): applying SMF actions post create...
112024-03-30T05:45:18.212ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5533c111-2905-41b6-b14a-cf7a0e39e42c
122024-03-30T05:45:18.214ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5533c111-2905-41b6-b14a-cf7a0e39e42c
132024-03-30T05:45:18.224ZINFOcrucible-agent (worker): creating config property group
142024-03-30T05:45:18.227ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5533c111-2905-41b6-b14a-cf7a0e39e42c
152024-03-30T05:45:18.227ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
162024-03-30T05:45:18.227ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
172024-03-30T05:45:18.227ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
182024-03-30T05:45:18.228ZINFOcrucible-agent (worker): commit
192024-03-30T05:45:18.231ZINFOcrucible-agent (worker): ok!
202024-03-30T05:45:18.235ZINFOcrucible-agent (worker): SMF ok!
212024-03-30T05:45:18.387ZINFOcrucible-agent (dropshot): request completed latency_us = 103 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35062 req_id = 6ed07f33-aa9a-4f4d-bb14-b2e50fbbc6b6 response_code = 200 uri = /crucible/0/regions
222024-03-30T05:45:19.343ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:49008
232024-03-30T05:45:19.343ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:49008 req_id = f4e1887d-aa6c-4851-b10f-749cf57caca3 response_code = 200 uri = /crucible/0/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
242024-03-30T05:45:19.343ZINFOcrucible-agent (datafile): path is "/data/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c"
252024-03-30T05:45:19.352ZINFOcrucible-agent (datafile): dataset is oxp_82347231-68ab-4934-8007-b28d9a3a3777/crucible/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
262024-03-30T05:45:19.361ZINFOcrucible-agent (datafile): region 5533c111-2905-41b6-b14a-cf7a0e39e42c state: Created -> Tombstoned
272024-03-30T05:45:19.361ZINFOcrucible-agent (worker): applying SMF actions before removal...
282024-03-30T05:45:19.361ZINFOcrucible-agent (dropshot): request completed latency_us = 17682 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:49008 req_id = 635d7737-b4d9-461a-9b56-cd9ac7c72bf7 response_code = 204 uri = /crucible/0/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
292024-03-30T05:45:19.361ZINFOcrucible-agent (dropshot): request completed latency_us = 19 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:49008 req_id = 469b6fc5-c8c1-4425-86f0-1bad5a925c03 response_code = 200 uri = /crucible/0/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
302024-03-30T05:45:19.362ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5533c111-2905-41b6-b14a-cf7a0e39e42c (instance states: (Some(Online), None))
312024-03-30T05:45:19.366ZINFOcrucible-agent (worker): SMF ok!
322024-03-30T05:45:19.375ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_82347231-68ab-4934-8007-b28d9a3a3777/crucible/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c" region = 5533c111-2905-41b6-b14a-cf7a0e39e42c
332024-03-30T05:45:19.413ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:49008 req_id = 2f8dc711-f3de-4097-98e8-95fb0adcb544 response_code = 200 uri = /crucible/0/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
342024-03-30T05:45:19.434ZINFOcrucible-agent (datafile): region 5533c111-2905-41b6-b14a-cf7a0e39e42c state: Tombstoned -> Destroyed
352024-03-30T05:45:19.578ZINFOcrucible-agent (dropshot): request completed latency_us = 41 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:49008 req_id = 9e1cff8c-f88f-4141-8f0f-f14c4e19ce37 response_code = 200 uri = /crucible/0/regions/5533c111-2905-41b6-b14a-cf7a0e39e42c
362024-03-30T05:51:47.923ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:35095
372024-03-30T05:51:47.953ZINFOcrucible-agent (datafile): region 6892b899-3348-4d71-89d9-f540ef51190d state: Requested
382024-03-30T05:51:47.954ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
392024-03-30T05:51:47.954ZINFOcrucible-agent (dropshot): request completed latency_us = 924 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35095 req_id = 78268c12-f3ef-4f0e-b28f-cbebaf840fc7 response_code = 200 uri = /crucible/0/regions
402024-03-30T05:51:47.963ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_82347231-68ab-4934-8007-b28d9a3a3777/crucible/regions/6892b899-3348-4d71-89d9-f540ef51190d
412024-03-30T05:51:47.963ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_82347231-68ab-4934-8007-b28d9a3a3777/crucible/regions/6892b899-3348-4d71-89d9-f540ef51190d
422024-03-30T05:51:48.043ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6892b899-3348-4d71-89d9-f540ef51190d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/6892b899-3348-4d71-89d9-f540ef51190d" region = 6892b899-3348-4d71-89d9-f540ef51190d
432024-03-30T05:51:48.110ZINFOcrucible-agent (worker): region files created ok region = 6892b899-3348-4d71-89d9-f540ef51190d
442024-03-30T05:51:48.110ZINFOcrucible-agent (datafile): region 6892b899-3348-4d71-89d9-f540ef51190d state: Requested -> Created
452024-03-30T05:51:48.111ZINFOcrucible-agent (worker): applying SMF actions post create...
462024-03-30T05:51:48.112ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6892b899-3348-4d71-89d9-f540ef51190d
472024-03-30T05:51:48.117ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6892b899-3348-4d71-89d9-f540ef51190d
482024-03-30T05:51:48.134ZINFOcrucible-agent (worker): creating config property group
492024-03-30T05:51:48.137ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6892b899-3348-4d71-89d9-f540ef51190d
502024-03-30T05:51:48.137ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6892b899-3348-4d71-89d9-f540ef51190d
512024-03-30T05:51:48.137ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
522024-03-30T05:51:48.137ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
532024-03-30T05:51:48.137ZINFOcrucible-agent (worker): commit
542024-03-30T05:51:48.140ZINFOcrucible-agent (worker): ok!
552024-03-30T05:51:48.144ZINFOcrucible-agent (worker): SMF ok!
562024-03-30T05:51:48.244ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35095 req_id = 6977ed01-998f-4d53-b16c-b3436a79d381 response_code = 200 uri = /crucible/0/regions
572024-03-30T05:52:11.246ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:48827
582024-03-30T05:52:11.246ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48827 req_id = 3887410c-ad18-4d68-a13f-4aa6bfe22ee7 response_code = 200 uri = /crucible/0/regions/6892b899-3348-4d71-89d9-f540ef51190d
592024-03-30T05:52:11.246ZINFOcrucible-agent (datafile): path is "/data/regions/6892b899-3348-4d71-89d9-f540ef51190d"
602024-03-30T05:52:11.258ZINFOcrucible-agent (datafile): dataset is oxp_82347231-68ab-4934-8007-b28d9a3a3777/crucible/regions/6892b899-3348-4d71-89d9-f540ef51190d
612024-03-30T05:52:11.267ZINFOcrucible-agent (datafile): region 6892b899-3348-4d71-89d9-f540ef51190d state: Created -> Tombstoned
622024-03-30T05:52:11.267ZINFOcrucible-agent (worker): applying SMF actions before removal...
632024-03-30T05:52:11.267ZINFOcrucible-agent (dropshot): request completed latency_us = 20866 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:48827 req_id = d93a75ae-297c-47fb-908b-9251e4ee368c response_code = 204 uri = /crucible/0/regions/6892b899-3348-4d71-89d9-f540ef51190d
642024-03-30T05:52:11.267ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48827 req_id = d7044dba-6c25-4380-a84a-52f3814aa1bc response_code = 200 uri = /crucible/0/regions/6892b899-3348-4d71-89d9-f540ef51190d
652024-03-30T05:52:11.269ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6892b899-3348-4d71-89d9-f540ef51190d (instance states: (Some(Online), None))
662024-03-30T05:52:11.273ZINFOcrucible-agent (worker): SMF ok!
672024-03-30T05:52:11.283ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_82347231-68ab-4934-8007-b28d9a3a3777/crucible/regions/6892b899-3348-4d71-89d9-f540ef51190d" region = 6892b899-3348-4d71-89d9-f540ef51190d
682024-03-30T05:52:11.332ZINFOcrucible-agent (datafile): region 6892b899-3348-4d71-89d9-f540ef51190d state: Tombstoned -> Destroyed
692024-03-30T05:52:11.368ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48827 req_id = 9ea0b70b-fdc5-4d5b-9b2c-e35af378fac3 response_code = 200 uri = /crucible/0/regions/6892b899-3348-4d71-89d9-f540ef51190d