Max level shown:
1 [ Apr 3 10:09:32 Enabled. ]
2 [ Apr 3 10:09:33 Rereading configuration. ]
3 [ Apr 3 10:09:36 Rereading configuration. ]
4 [ Apr 3 10:09:43 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-04-03T10:09:43.621ZINFOcrucible-agent: dataset: "oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible"
72024-04-03T10:09:43.621ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-04-03T10:09:43.621ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-04-03T10:09:43.771ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
102024-04-03T10:10:32.766ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:49999
112024-04-03T10:10:32.802ZINFOcrucible-agent (datafile): region 141660de-7ef1-4018-be2f-3a3c01faac1a state: Requested
122024-04-03T10:10:32.808ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
132024-04-03T10:10:32.808ZINFOcrucible-agent (dropshot): request completed latency_us = 10019 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:49999 req_id = 7e73ef3b-d141-4a41-b767-07f711fe1073 response_code = 200 uri = /crucible/0/regions
142024-04-03T10:10:32.821ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible/regions/141660de-7ef1-4018-be2f-3a3c01faac1a
152024-04-03T10:10:32.821ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible/regions/141660de-7ef1-4018-be2f-3a3c01faac1a
162024-04-03T10:10:32.890ZINFOcrucible-agent (worker): creating region Region { id: RegionId("141660de-7ef1-4018-be2f-3a3c01faac1a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/141660de-7ef1-4018-be2f-3a3c01faac1a" region = 141660de-7ef1-4018-be2f-3a3c01faac1a
172024-04-03T10:10:33.022ZINFOcrucible-agent (worker): region files created ok region = 141660de-7ef1-4018-be2f-3a3c01faac1a
182024-04-03T10:10:33.022ZINFOcrucible-agent (datafile): region 141660de-7ef1-4018-be2f-3a3c01faac1a state: Requested -> Created
192024-04-03T10:10:33.022ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-04-03T10:10:33.023ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-141660de-7ef1-4018-be2f-3a3c01faac1a
212024-04-03T10:10:33.029ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-141660de-7ef1-4018-be2f-3a3c01faac1a
222024-04-03T10:10:33.041ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:49999 req_id = c7dbe111-cff0-4ff9-837e-4ef7ce56526c response_code = 200 uri = /crucible/0/regions
232024-04-03T10:10:33.042ZINFOcrucible-agent (worker): creating config property group
242024-04-03T10:10:33.046ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-141660de-7ef1-4018-be2f-3a3c01faac1a
252024-04-03T10:10:33.047ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/141660de-7ef1-4018-be2f-3a3c01faac1a
262024-04-03T10:10:33.047ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-04-03T10:10:33.047ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
282024-04-03T10:10:33.047ZINFOcrucible-agent (worker): commit
292024-04-03T10:10:33.052ZINFOcrucible-agent (worker): ok!
302024-04-03T10:10:33.057ZINFOcrucible-agent (worker): SMF ok!
312024-04-03T10:10:33.594ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:45926
322024-04-03T10:10:33.594ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45926 req_id = 13ae7c62-fd44-48d9-b348-7d73bd83cf93 response_code = 200 uri = /crucible/0/regions/141660de-7ef1-4018-be2f-3a3c01faac1a
332024-04-03T10:10:33.594ZINFOcrucible-agent (datafile): path is "/data/regions/141660de-7ef1-4018-be2f-3a3c01faac1a"
342024-04-03T10:10:33.603ZINFOcrucible-agent (datafile): dataset is oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible/regions/141660de-7ef1-4018-be2f-3a3c01faac1a
352024-04-03T10:10:33.611ZINFOcrucible-agent (datafile): region 141660de-7ef1-4018-be2f-3a3c01faac1a state: Created -> Tombstoned
362024-04-03T10:10:33.611ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-04-03T10:10:33.611ZINFOcrucible-agent (dropshot): request completed latency_us = 16927 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:45926 req_id = fdcd85c9-c339-47ca-a23a-eb660748c871 response_code = 204 uri = /crucible/0/regions/141660de-7ef1-4018-be2f-3a3c01faac1a
382024-04-03T10:10:33.612ZINFOcrucible-agent (dropshot): request completed latency_us = 589 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45926 req_id = 086f05ff-49ac-4330-8c56-06c982e740c1 response_code = 200 uri = /crucible/0/regions/141660de-7ef1-4018-be2f-3a3c01faac1a
392024-04-03T10:10:33.612ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-141660de-7ef1-4018-be2f-3a3c01faac1a (instance states: (Some(Online), None))
402024-04-03T10:10:33.616ZINFOcrucible-agent (worker): SMF ok!
412024-04-03T10:10:33.626ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible/regions/141660de-7ef1-4018-be2f-3a3c01faac1a" region = 141660de-7ef1-4018-be2f-3a3c01faac1a
422024-04-03T10:10:33.687ZINFOcrucible-agent (datafile): region 141660de-7ef1-4018-be2f-3a3c01faac1a state: Tombstoned -> Destroyed
432024-04-03T10:10:33.719ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45926 req_id = 97032347-cf17-46a8-be9a-59f9b6f0d80f response_code = 200 uri = /crucible/0/regions/141660de-7ef1-4018-be2f-3a3c01faac1a
442024-04-03T10:10:55.400ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:52972
452024-04-03T10:10:55.430ZINFOcrucible-agent (datafile): region eafdd8dd-11e7-485f-9292-848016ea93f0 state: Requested
462024-04-03T10:10:55.431ZINFOcrucible-agent (dropshot): request completed latency_us = 431 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52972 req_id = 8133ed24-259d-4104-a5f2-df22e0d093c6 response_code = 200 uri = /crucible/0/regions
472024-04-03T10:10:55.431ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-04-03T10:10:55.440ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible/regions/eafdd8dd-11e7-485f-9292-848016ea93f0
492024-04-03T10:10:55.440ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_5df238e3-5630-4184-a188-36117b1a7b7b/crucible/regions/eafdd8dd-11e7-485f-9292-848016ea93f0
502024-04-03T10:10:55.506ZINFOcrucible-agent (worker): creating region Region { id: RegionId("eafdd8dd-11e7-485f-9292-848016ea93f0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/eafdd8dd-11e7-485f-9292-848016ea93f0" region = eafdd8dd-11e7-485f-9292-848016ea93f0
512024-04-03T10:10:55.579ZINFOcrucible-agent (worker): region files created ok region = eafdd8dd-11e7-485f-9292-848016ea93f0
522024-04-03T10:10:55.580ZINFOcrucible-agent (datafile): region eafdd8dd-11e7-485f-9292-848016ea93f0 state: Requested -> Created
532024-04-03T10:10:55.580ZINFOcrucible-agent (worker): applying SMF actions post create...
542024-04-03T10:10:55.581ZINFOcrucible-agent (dropshot): request completed latency_us = 684 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52972 req_id = a5d2eae0-a444-48c3-89c9-97168c5d799d response_code = 200 uri = /crucible/0/regions
552024-04-03T10:10:55.581ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-eafdd8dd-11e7-485f-9292-848016ea93f0
562024-04-03T10:10:55.584ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-eafdd8dd-11e7-485f-9292-848016ea93f0
572024-04-03T10:10:55.592ZINFOcrucible-agent (worker): creating config property group
582024-04-03T10:10:55.595ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-eafdd8dd-11e7-485f-9292-848016ea93f0
592024-04-03T10:10:55.596ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eafdd8dd-11e7-485f-9292-848016ea93f0
602024-04-03T10:10:55.596ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-04-03T10:10:55.596ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
622024-04-03T10:10:55.596ZINFOcrucible-agent (worker): commit
632024-04-03T10:10:55.600ZINFOcrucible-agent (worker): ok!
642024-04-03T10:10:55.605ZINFOcrucible-agent (worker): SMF ok!