Max level shown:
1 [ Apr 3 10:09:32 Enabled. ]
2 [ Apr 3 10:09:32 Rereading configuration. ]
3 [ Apr 3 10:09:37 Rereading configuration. ]
4 [ Apr 3 10:09:43 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-04-03T10:09:43.958ZINFOcrucible-agent: dataset: "oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible"
72024-04-03T10:09:43.959ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82024-04-03T10:09:43.959ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-04-03T10:09:44.115ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
102024-04-03T10:10:32.795ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:40681
112024-04-03T10:10:32.808ZINFOcrucible-agent (datafile): region bdd73775-8068-4988-83cf-2f005c4e16e1 state: Requested
122024-04-03T10:10:32.811ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
132024-04-03T10:10:32.811ZINFOcrucible-agent (dropshot): request completed latency_us = 7807 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:40681 req_id = 58c6c02f-938e-4040-aa7d-a197c3e80981 response_code = 200 uri = /crucible/0/regions
142024-04-03T10:10:32.824ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible/regions/bdd73775-8068-4988-83cf-2f005c4e16e1
152024-04-03T10:10:32.824ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible/regions/bdd73775-8068-4988-83cf-2f005c4e16e1
162024-04-03T10:10:32.906ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bdd73775-8068-4988-83cf-2f005c4e16e1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/bdd73775-8068-4988-83cf-2f005c4e16e1" region = bdd73775-8068-4988-83cf-2f005c4e16e1
172024-04-03T10:10:33.036ZINFOcrucible-agent (worker): region files created ok region = bdd73775-8068-4988-83cf-2f005c4e16e1
182024-04-03T10:10:33.036ZINFOcrucible-agent (datafile): region bdd73775-8068-4988-83cf-2f005c4e16e1 state: Requested -> Created
192024-04-03T10:10:33.036ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-04-03T10:10:33.037ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bdd73775-8068-4988-83cf-2f005c4e16e1
212024-04-03T10:10:33.040ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bdd73775-8068-4988-83cf-2f005c4e16e1
222024-04-03T10:10:33.057ZINFOcrucible-agent (worker): creating config property group
232024-04-03T10:10:33.061ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bdd73775-8068-4988-83cf-2f005c4e16e1
242024-04-03T10:10:33.062ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bdd73775-8068-4988-83cf-2f005c4e16e1
252024-04-03T10:10:33.064ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-04-03T10:10:33.064ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
272024-04-03T10:10:33.064ZINFOcrucible-agent (worker): commit
282024-04-03T10:10:33.072ZINFOcrucible-agent (worker): ok!
292024-04-03T10:10:33.077ZINFOcrucible-agent (worker): SMF ok!
302024-04-03T10:10:33.169ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:40681 req_id = eece4189-c2d7-4679-a8f1-c553ee970a39 response_code = 200 uri = /crucible/0/regions
312024-04-03T10:10:33.395ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:46871
322024-04-03T10:10:33.395ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:46871 req_id = c9a5c34e-914c-496d-b5dd-67bdd08702a1 response_code = 200 uri = /crucible/0/regions/bdd73775-8068-4988-83cf-2f005c4e16e1
332024-04-03T10:10:33.396ZINFOcrucible-agent (datafile): path is "/data/regions/bdd73775-8068-4988-83cf-2f005c4e16e1"
342024-04-03T10:10:33.404ZINFOcrucible-agent (datafile): dataset is oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible/regions/bdd73775-8068-4988-83cf-2f005c4e16e1
352024-04-03T10:10:33.413ZINFOcrucible-agent (datafile): region bdd73775-8068-4988-83cf-2f005c4e16e1 state: Created -> Tombstoned
362024-04-03T10:10:33.414ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-04-03T10:10:33.414ZINFOcrucible-agent (dropshot): request completed latency_us = 18231 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:46871 req_id = 6c7a777c-b23f-40b2-a812-20ae22ba0fb3 response_code = 204 uri = /crucible/0/regions/bdd73775-8068-4988-83cf-2f005c4e16e1
382024-04-03T10:10:33.414ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:46871 req_id = 68789310-da99-4275-a2df-2aff333fe7c7 response_code = 200 uri = /crucible/0/regions/bdd73775-8068-4988-83cf-2f005c4e16e1
392024-04-03T10:10:33.415ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-bdd73775-8068-4988-83cf-2f005c4e16e1 (instance states: (Some(Online), None))
402024-04-03T10:10:33.420ZINFOcrucible-agent (worker): SMF ok!
412024-04-03T10:10:33.430ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible/regions/bdd73775-8068-4988-83cf-2f005c4e16e1" region = bdd73775-8068-4988-83cf-2f005c4e16e1
422024-04-03T10:10:33.493ZINFOcrucible-agent (datafile): region bdd73775-8068-4988-83cf-2f005c4e16e1 state: Tombstoned -> Destroyed
432024-04-03T10:10:33.547ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:46871 req_id = a442ed27-8cdd-405f-b5fd-8607cef525af response_code = 200 uri = /crucible/0/regions/bdd73775-8068-4988-83cf-2f005c4e16e1
442024-04-03T10:10:55.430ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:40870
452024-04-03T10:10:55.430ZINFOcrucible-agent (datafile): region df1b7f84-1f6b-4855-a38e-403a76a91cdf state: Requested
462024-04-03T10:10:55.431ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
472024-04-03T10:10:55.431ZINFOcrucible-agent (dropshot): request completed latency_us = 388 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40870 req_id = 850ab783-4874-4a93-a864-8531f08944d8 response_code = 200 uri = /crucible/0/regions
482024-04-03T10:10:55.440ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible/regions/df1b7f84-1f6b-4855-a38e-403a76a91cdf
492024-04-03T10:10:55.440ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_5735529a-b898-4275-88a6-00a9444d8997/crucible/regions/df1b7f84-1f6b-4855-a38e-403a76a91cdf
502024-04-03T10:10:55.507ZINFOcrucible-agent (worker): creating region Region { id: RegionId("df1b7f84-1f6b-4855-a38e-403a76a91cdf"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/df1b7f84-1f6b-4855-a38e-403a76a91cdf" region = df1b7f84-1f6b-4855-a38e-403a76a91cdf
512024-04-03T10:10:55.582ZINFOcrucible-agent (worker): region files created ok region = df1b7f84-1f6b-4855-a38e-403a76a91cdf
522024-04-03T10:10:55.582ZINFOcrucible-agent (datafile): region df1b7f84-1f6b-4855-a38e-403a76a91cdf state: Requested -> Created
532024-04-03T10:10:55.582ZINFOcrucible-agent (worker): applying SMF actions post create...
542024-04-03T10:10:55.584ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-df1b7f84-1f6b-4855-a38e-403a76a91cdf
552024-04-03T10:10:55.587ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-df1b7f84-1f6b-4855-a38e-403a76a91cdf
562024-04-03T10:10:55.594ZINFOcrucible-agent (worker): creating config property group
572024-04-03T10:10:55.597ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-df1b7f84-1f6b-4855-a38e-403a76a91cdf
582024-04-03T10:10:55.598ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/df1b7f84-1f6b-4855-a38e-403a76a91cdf
592024-04-03T10:10:55.598ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
602024-04-03T10:10:55.598ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
612024-04-03T10:10:55.598ZINFOcrucible-agent (worker): commit
622024-04-03T10:10:55.602ZINFOcrucible-agent (worker): ok!
632024-04-03T10:10:55.607ZINFOcrucible-agent (worker): SMF ok!
642024-04-03T10:10:55.697ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40870 req_id = a9623e07-bfa5-4403-8cd1-d6c038d1b13a response_code = 200 uri = /crucible/0/regions