Max level shown:
12024-03-30T05:46:09.637ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:65505
22024-03-30T05:46:09.653ZINFOcrucible-agent (datafile): region 33319bcb-7e2f-4a5d-8bd4-b6106958ab2f state: Requested
32024-03-30T05:46:09.656ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-03-30T05:46:09.656ZINFOcrucible-agent (dropshot): request completed latency_us = 5335 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65505 req_id = d9b6a868-4dd1-44ae-8983-1426a6ac9c17 response_code = 200 uri = /crucible/0/regions
52024-03-30T05:46:09.670ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
62024-03-30T05:46:09.670ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
72024-03-30T05:46:09.721ZINFOcrucible-agent (worker): creating region Region { id: RegionId("33319bcb-7e2f-4a5d-8bd4-b6106958ab2f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f" region = 33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
82024-03-30T05:46:09.815ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65505 req_id = 820ea70f-14c0-4607-a47e-146f54a02b54 response_code = 200 uri = /crucible/0/regions
92024-03-30T05:46:09.851ZINFOcrucible-agent (worker): region files created ok region = 33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
102024-03-30T05:46:09.851ZINFOcrucible-agent (datafile): region 33319bcb-7e2f-4a5d-8bd4-b6106958ab2f state: Requested -> Created
112024-03-30T05:46:09.852ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-03-30T05:46:09.852ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
132024-03-30T05:46:09.855ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
142024-03-30T05:46:09.867ZINFOcrucible-agent (worker): creating config property group
152024-03-30T05:46:09.870ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
162024-03-30T05:46:09.871ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
172024-03-30T05:46:09.871ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-03-30T05:46:09.871ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192024-03-30T05:46:09.871ZINFOcrucible-agent (worker): commit
202024-03-30T05:46:09.875ZINFOcrucible-agent (worker): ok!
212024-03-30T05:46:09.883ZINFOcrucible-agent (worker): SMF ok!
222024-03-30T05:46:10.440ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65505 req_id = 5f257045-d07f-4da4-adec-d917713fc920 response_code = 200 uri = /crucible/0/regions
232024-03-30T05:51:43.834ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:62208
242024-03-30T05:51:43.894ZINFOcrucible-agent (datafile): region 49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3 state: Requested
252024-03-30T05:51:43.895ZINFOcrucible-agent (dropshot): request completed latency_us = 695 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62208 req_id = eb6712b9-c2ab-4629-8668-68df4331e3d2 response_code = 200 uri = /crucible/0/regions
262024-03-30T05:51:43.895ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272024-03-30T05:51:43.905ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3
282024-03-30T05:51:43.905ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3
292024-03-30T05:51:43.970ZINFOcrucible-agent (worker): creating region Region { id: RegionId("49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3" region = 49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3
302024-03-30T05:51:44.046ZINFOcrucible-agent (worker): region files created ok region = 49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3
312024-03-30T05:51:44.046ZINFOcrucible-agent (datafile): region 49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3 state: Requested -> Created
322024-03-30T05:51:44.046ZINFOcrucible-agent (worker): applying SMF actions post create...
332024-03-30T05:51:44.055ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3
342024-03-30T05:51:44.059ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3
352024-03-30T05:51:44.068ZINFOcrucible-agent (worker): creating config property group
362024-03-30T05:51:44.072ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3
372024-03-30T05:51:44.072ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/49ca3cfc-c9b9-44dd-8f14-0fe2f36594e3
382024-03-30T05:51:44.073ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392024-03-30T05:51:44.073ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
402024-03-30T05:51:44.073ZINFOcrucible-agent (worker): commit
412024-03-30T05:51:44.076ZINFOcrucible-agent (worker): ok!
422024-03-30T05:51:44.081ZINFOcrucible-agent (worker): SMF ok!
432024-03-30T05:51:44.253ZINFOcrucible-agent (dropshot): request completed latency_us = 96 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:62208 req_id = 68e3820e-be17-4a6c-a4a3-b37f9c2bf1fe response_code = 200 uri = /crucible/0/regions
442024-03-30T05:51:44.783ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:45649
452024-03-30T05:51:44.783ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45649 req_id = fc0ea1fd-da60-4ebc-a44f-42fd2a80287f response_code = 200 uri = /crucible/0/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
462024-03-30T05:51:44.783ZINFOcrucible-agent (datafile): path is "/data/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f"
472024-03-30T05:51:44.793ZINFOcrucible-agent (datafile): dataset is oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
482024-03-30T05:51:44.802ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f@df132503-9198-4173-b67d-ac960c2931e9
492024-03-30T05:51:44.802ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f", "df132503-9198-4173-b67d-ac960c2931e9"]
502024-03-30T05:51:44.813ZINFOcrucible-agent (dropshot): request completed latency_us = 29306 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45649 req_id = 28b31559-1b4d-45cd-b8f8-ea3f86a71deb response_code = 200 uri = /crucible/0/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f/snapshots/df132503-9198-4173-b67d-ac960c2931e9
512024-03-30T05:51:44.813ZINFOcrucible-agent (datafile): path is "/data/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f"
522024-03-30T05:51:44.821ZINFOcrucible-agent (datafile): dataset is oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f
532024-03-30T05:51:44.830ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f@df132503-9198-4173-b67d-ac960c2931e9
542024-03-30T05:51:44.830ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_e43353e3-7e66-4e6f-bd56-19f8143ee8b5/crucible/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f", "df132503-9198-4173-b67d-ac960c2931e9"]
552024-03-30T05:51:44.839ZINFOcrucible-agent (datafile): requesting running snapshot 33319bcb-7e2f-4a5d-8bd4-b6106958ab2f-df132503-9198-4173-b67d-ac960c2931e9 state: Requested
562024-03-30T05:51:44.839ZINFOcrucible-agent (worker): applying SMF actions for region 33319bcb-7e2f-4a5d-8bd4-b6106958ab2f running snapshot df132503-9198-4173-b67d-ac960c2931e9 (state Requested)...
572024-03-30T05:51:44.839ZINFOcrucible-agent (dropshot): request completed latency_us = 26405 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45649 req_id = 90b91155-f884-46fb-85ee-91c8e39db43b response_code = 200 uri = /crucible/0/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f/snapshots/df132503-9198-4173-b67d-ac960c2931e9/run
582024-03-30T05:51:44.842ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f-df132503-9198-4173-b67d-ac960c2931e9
592024-03-30T05:51:44.847ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f-df132503-9198-4173-b67d-ac960c2931e9
602024-03-30T05:51:44.860ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-33319bcb-7e2f-4a5d-8bd4-b6106958ab2f-df132503-9198-4173-b67d-ac960c2931e9
612024-03-30T05:51:44.861ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/33319bcb-7e2f-4a5d-8bd4-b6106958ab2f/.zfs/snapshot/df132503-9198-4173-b67d-ac960c2931e9
622024-03-30T05:51:44.861ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
632024-03-30T05:51:44.861ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
642024-03-30T05:51:44.861ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
652024-03-30T05:51:44.861ZINFOcrucible-agent (worker): commit
662024-03-30T05:51:44.865ZINFOcrucible-agent (worker): ok!
672024-03-30T05:51:44.871ZINFOcrucible-agent (worker): SMF ok!
682024-03-30T05:51:44.871ZINFOcrucible-agent (datafile): region 33319bcb-7e2f-4a5d-8bd4-b6106958ab2f running snapshot df132503-9198-4173-b67d-ac960c2931e9 state: Requested -> Created