Max level shown:
1 [ Mar 21 18:03:38 Enabled. ]
2 [ Mar 21 18:03:38 Rereading configuration. ]
3 [ Mar 21 18:03:39 Rereading configuration. ]
4 [ Mar 21 18:03:43 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-21T18:03:43.157ZINFOcrucible-agent: dataset: "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible"
72024-03-21T18:03:43.161ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-03-21T18:03:43.161ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-21T18:03:43.288ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
102024-03-21T18:04:14.301ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:55179
112024-03-21T18:04:14.314ZINFOcrucible-agent (datafile): region 7bd351a8-f34b-44ab-9289-818aa53413e5 state: Requested
122024-03-21T18:04:14.315ZINFOcrucible-agent (dropshot): request completed latency_us = 6221 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55179 req_id = 32f084b5-8637-4e36-af02-9adb6f11e4b3 response_code = 200 uri = /crucible/0/regions
132024-03-21T18:04:14.315ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-03-21T18:04:14.325ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/7bd351a8-f34b-44ab-9289-818aa53413e5
152024-03-21T18:04:14.325ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/7bd351a8-f34b-44ab-9289-818aa53413e5
162024-03-21T18:04:14.394ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7bd351a8-f34b-44ab-9289-818aa53413e5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/7bd351a8-f34b-44ab-9289-818aa53413e5" region = 7bd351a8-f34b-44ab-9289-818aa53413e5
172024-03-21T18:04:14.496ZINFOcrucible-agent (dropshot): request completed latency_us = 608 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55179 req_id = fe962ef9-c061-4c32-ad70-a88d297d92e3 response_code = 200 uri = /crucible/0/regions
182024-03-21T18:04:14.544ZINFOcrucible-agent (worker): region files created ok region = 7bd351a8-f34b-44ab-9289-818aa53413e5
192024-03-21T18:04:14.544ZINFOcrucible-agent (datafile): region 7bd351a8-f34b-44ab-9289-818aa53413e5 state: Requested -> Created
202024-03-21T18:04:14.544ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-03-21T18:04:14.545ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7bd351a8-f34b-44ab-9289-818aa53413e5
222024-03-21T18:04:14.549ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7bd351a8-f34b-44ab-9289-818aa53413e5
232024-03-21T18:04:14.560ZINFOcrucible-agent (worker): creating config property group
242024-03-21T18:04:14.564ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7bd351a8-f34b-44ab-9289-818aa53413e5
252024-03-21T18:04:14.564ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7bd351a8-f34b-44ab-9289-818aa53413e5
262024-03-21T18:04:14.564ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-03-21T18:04:14.565ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
282024-03-21T18:04:14.565ZINFOcrucible-agent (worker): commit
292024-03-21T18:04:14.569ZINFOcrucible-agent (worker): ok!
302024-03-21T18:04:14.578ZINFOcrucible-agent (worker): SMF ok!
312024-03-21T18:04:14.826ZINFOcrucible-agent (dropshot): request completed latency_us = 113 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55179 req_id = c118b863-5a0b-4066-9871-d2f61f28e687 response_code = 200 uri = /crucible/0/regions
322024-03-21T18:10:02.898ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:33247
332024-03-21T18:10:02.898ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33247 req_id = 0b32e8ec-5611-4e72-a956-2b35e824180b response_code = 200 uri = /crucible/0/regions/7bd351a8-f34b-44ab-9289-818aa53413e5
342024-03-21T18:10:02.899ZINFOcrucible-agent (datafile): path is "/data/regions/7bd351a8-f34b-44ab-9289-818aa53413e5"
352024-03-21T18:10:02.908ZINFOcrucible-agent (datafile): dataset is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/7bd351a8-f34b-44ab-9289-818aa53413e5
362024-03-21T18:10:02.917ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/7bd351a8-f34b-44ab-9289-818aa53413e5@fe1e7c32-a3e0-469a-9e5c-10034bec5870
372024-03-21T18:10:02.917ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/7bd351a8-f34b-44ab-9289-818aa53413e5", "fe1e7c32-a3e0-469a-9e5c-10034bec5870"]
382024-03-21T18:10:02.931ZINFOcrucible-agent (dropshot): request completed latency_us = 32609 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33247 req_id = 922b0830-dab5-48f0-b073-81359802a60e response_code = 200 uri = /crucible/0/regions/7bd351a8-f34b-44ab-9289-818aa53413e5/snapshots/fe1e7c32-a3e0-469a-9e5c-10034bec5870
392024-03-21T18:10:02.931ZINFOcrucible-agent (datafile): path is "/data/regions/7bd351a8-f34b-44ab-9289-818aa53413e5"
402024-03-21T18:10:02.940ZINFOcrucible-agent (datafile): dataset is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/7bd351a8-f34b-44ab-9289-818aa53413e5
412024-03-21T18:10:02.949ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/7bd351a8-f34b-44ab-9289-818aa53413e5@fe1e7c32-a3e0-469a-9e5c-10034bec5870
422024-03-21T18:10:02.949ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/7bd351a8-f34b-44ab-9289-818aa53413e5", "fe1e7c32-a3e0-469a-9e5c-10034bec5870"]
432024-03-21T18:10:02.958ZINFOcrucible-agent (datafile): requesting running snapshot 7bd351a8-f34b-44ab-9289-818aa53413e5-fe1e7c32-a3e0-469a-9e5c-10034bec5870 state: Requested
442024-03-21T18:10:02.958ZINFOcrucible-agent (worker): applying SMF actions for region 7bd351a8-f34b-44ab-9289-818aa53413e5 running snapshot fe1e7c32-a3e0-469a-9e5c-10034bec5870 (state Requested)...
452024-03-21T18:10:02.958ZINFOcrucible-agent (dropshot): request completed latency_us = 27004 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33247 req_id = 257eb0de-1b2a-42cb-a3eb-f9544ff2a048 response_code = 200 uri = /crucible/0/regions/7bd351a8-f34b-44ab-9289-818aa53413e5/snapshots/fe1e7c32-a3e0-469a-9e5c-10034bec5870/run
462024-03-21T18:10:02.970ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-7bd351a8-f34b-44ab-9289-818aa53413e5-fe1e7c32-a3e0-469a-9e5c-10034bec5870
472024-03-21T18:10:02.974ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-7bd351a8-f34b-44ab-9289-818aa53413e5-fe1e7c32-a3e0-469a-9e5c-10034bec5870
482024-03-21T18:10:02.985ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-7bd351a8-f34b-44ab-9289-818aa53413e5-fe1e7c32-a3e0-469a-9e5c-10034bec5870
492024-03-21T18:10:02.986ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7bd351a8-f34b-44ab-9289-818aa53413e5/.zfs/snapshot/fe1e7c32-a3e0-469a-9e5c-10034bec5870
502024-03-21T18:10:02.986ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512024-03-21T18:10:02.986ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
522024-03-21T18:10:02.986ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
532024-03-21T18:10:02.986ZINFOcrucible-agent (worker): commit
542024-03-21T18:10:02.990ZINFOcrucible-agent (worker): ok!
552024-03-21T18:10:02.994ZINFOcrucible-agent (worker): SMF ok!
562024-03-21T18:10:02.994ZINFOcrucible-agent (datafile): region 7bd351a8-f34b-44ab-9289-818aa53413e5 running snapshot fe1e7c32-a3e0-469a-9e5c-10034bec5870 state: Requested -> Created