Max level shown:
12024-08-23T22:03:49.788ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:51375
22024-08-23T22:03:49.788ZINFOcrucible-agent (datafile): region d73b1827-f0ea-4265-9f9c-a81c8c3b7860 state: Requested
32024-08-23T22:03:49.789ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-08-23T22:03:49.789ZINFOcrucible-agent (dropshot): request completed latency_us = 1006 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51375 req_id = f681af49-d1b3-4d3d-94dd-ccdd56566144 response_code = 200 uri = /crucible/0/regions
52024-08-23T22:03:49.799ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c4fe4e01-40de-4c9e-857a-e6870bd84153/crucible/regions/d73b1827-f0ea-4265-9f9c-a81c8c3b7860
62024-08-23T22:03:49.799ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c4fe4e01-40de-4c9e-857a-e6870bd84153/crucible/regions/d73b1827-f0ea-4265-9f9c-a81c8c3b7860
72024-08-23T22:03:49.878ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d73b1827-f0ea-4265-9f9c-a81c8c3b7860"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d73b1827-f0ea-4265-9f9c-a81c8c3b7860" region = d73b1827-f0ea-4265-9f9c-a81c8c3b7860
82024-08-23T22:03:49.878ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d73b1827-f0ea-4265-9f9c-a81c8c3b7860" "--data" "/data/regions/d73b1827-f0ea-4265-9f9c-a81c8c3b7860" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d73b1827-f0ea-4265-9f9c-a81c8c3b7860
92024-08-23T22:03:50.003ZINFOcrucible-agent (worker): region files created ok region = d73b1827-f0ea-4265-9f9c-a81c8c3b7860
102024-08-23T22:03:50.003ZINFOcrucible-agent (datafile): region d73b1827-f0ea-4265-9f9c-a81c8c3b7860 state: Requested -> Created
112024-08-23T22:03:50.003ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-08-23T22:03:50.005ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d73b1827-f0ea-4265-9f9c-a81c8c3b7860
132024-08-23T22:03:50.010ZINFOcrucible-agent (dropshot): request completed latency_us = 634 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51375 req_id = 6c649d45-a9f5-41f5-a5ba-8ac12f27f17e response_code = 200 uri = /crucible/0/regions
142024-08-23T22:03:50.013ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d73b1827-f0ea-4265-9f9c-a81c8c3b7860
152024-08-23T22:03:50.040ZINFOcrucible-agent (worker): creating config property group
162024-08-23T22:03:50.053ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d73b1827-f0ea-4265-9f9c-a81c8c3b7860
172024-08-23T22:03:50.053ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d73b1827-f0ea-4265-9f9c-a81c8c3b7860
182024-08-23T22:03:50.053ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-08-23T22:03:50.053ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202024-08-23T22:03:50.053ZINFOcrucible-agent (worker): commit
212024-08-23T22:03:50.061ZINFOcrucible-agent (worker): ok!
222024-08-23T22:03:50.070ZINFOcrucible-agent (worker): SMF ok!
232024-08-23T22:03:55.518ZINFOcrucible-agent (datafile): region e8175f29-e435-4b17-bd3a-b0957d035884 state: Requested
242024-08-23T22:03:55.518ZINFOcrucible-agent (dropshot): request completed latency_us = 253 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51375 req_id = 8bee821d-f1aa-427c-a5f7-2e2bade66621 response_code = 200 uri = /crucible/0/regions
252024-08-23T22:03:55.518ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262024-08-23T22:03:55.528ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c4fe4e01-40de-4c9e-857a-e6870bd84153/crucible/regions/e8175f29-e435-4b17-bd3a-b0957d035884
272024-08-23T22:03:55.528ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c4fe4e01-40de-4c9e-857a-e6870bd84153/crucible/regions/e8175f29-e435-4b17-bd3a-b0957d035884
282024-08-23T22:03:55.668ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e8175f29-e435-4b17-bd3a-b0957d035884"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e8175f29-e435-4b17-bd3a-b0957d035884" region = e8175f29-e435-4b17-bd3a-b0957d035884
292024-08-23T22:03:55.668ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e8175f29-e435-4b17-bd3a-b0957d035884" "--data" "/data/regions/e8175f29-e435-4b17-bd3a-b0957d035884" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e8175f29-e435-4b17-bd3a-b0957d035884
302024-08-23T22:03:55.690ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51375 req_id = 51ec5093-610b-42c5-9ab6-d692e2f5a478 response_code = 200 uri = /crucible/0/regions
312024-08-23T22:03:56.005ZINFOcrucible-agent (worker): region files created ok region = e8175f29-e435-4b17-bd3a-b0957d035884
322024-08-23T22:03:56.005ZINFOcrucible-agent (datafile): region e8175f29-e435-4b17-bd3a-b0957d035884 state: Requested -> Created
332024-08-23T22:03:56.005ZINFOcrucible-agent (worker): applying SMF actions post create...
342024-08-23T22:03:56.007ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e8175f29-e435-4b17-bd3a-b0957d035884
352024-08-23T22:03:56.009ZINFOcrucible-agent (dropshot): request completed latency_us = 41 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51375 req_id = 563125db-828c-4211-8bd2-6e5452856dda response_code = 200 uri = /crucible/0/regions
362024-08-23T22:03:56.040ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e8175f29-e435-4b17-bd3a-b0957d035884
372024-08-23T22:03:56.082ZINFOcrucible-agent (worker): creating config property group
382024-08-23T22:03:56.097ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e8175f29-e435-4b17-bd3a-b0957d035884
392024-08-23T22:03:56.097ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e8175f29-e435-4b17-bd3a-b0957d035884
402024-08-23T22:03:56.097ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412024-08-23T22:03:56.097ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
422024-08-23T22:03:56.097ZINFOcrucible-agent (worker): commit
432024-08-23T22:03:56.121ZINFOcrucible-agent (worker): ok!
442024-08-23T22:03:56.140ZINFOcrucible-agent (worker): SMF ok!
452024-08-23T22:04:42.066ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51375 req_id = a6a82316-d6c8-4498-9e4f-295de3bb1c05 response_code = 200 uri = /crucible/0/regions/e8175f29-e435-4b17-bd3a-b0957d035884
462024-08-23T22:04:42.068ZINFOcrucible-agent (datafile): path is "/data/regions/e8175f29-e435-4b17-bd3a-b0957d035884"
472024-08-23T22:04:42.079ZINFOcrucible-agent (datafile): dataset is oxp_c4fe4e01-40de-4c9e-857a-e6870bd84153/crucible/regions/e8175f29-e435-4b17-bd3a-b0957d035884
482024-08-23T22:04:42.088ZINFOcrucible-agent (datafile): region e8175f29-e435-4b17-bd3a-b0957d035884 state: Created -> Tombstoned
492024-08-23T22:04:42.089ZINFOcrucible-agent (worker): applying SMF actions before removal...
502024-08-23T22:04:42.089ZINFOcrucible-agent (dropshot): request completed latency_us = 20275 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:51375 req_id = 3d4f1f34-2ea1-4caf-8128-d7d472803596 response_code = 204 uri = /crucible/0/regions/e8175f29-e435-4b17-bd3a-b0957d035884
512024-08-23T22:04:42.091ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e8175f29-e435-4b17-bd3a-b0957d035884 (instance states: (Some(Online), None))
522024-08-23T22:04:42.092ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51375 req_id = 2dfd1f70-6df0-49c4-89c7-12d359f12040 response_code = 200 uri = /crucible/0/regions/e8175f29-e435-4b17-bd3a-b0957d035884
532024-08-23T22:04:42.100ZINFOcrucible-agent (worker): SMF ok!
542024-08-23T22:04:42.109ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c4fe4e01-40de-4c9e-857a-e6870bd84153/crucible/regions/e8175f29-e435-4b17-bd3a-b0957d035884" region = e8175f29-e435-4b17-bd3a-b0957d035884
552024-08-23T22:04:42.162ZINFOcrucible-agent (datafile): region e8175f29-e435-4b17-bd3a-b0957d035884 state: Tombstoned -> Destroyed
562024-08-23T22:04:42.225ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51375 req_id = 87a6f67d-b95f-45e5-bf09-0ad5b5cf3cb9 response_code = 200 uri = /crucible/0/regions/e8175f29-e435-4b17-bd3a-b0957d035884