Max level shown:
1 [ Mar 28 08:13:23 Enabled. ]
2 [ Mar 28 08:13:23 Rereading configuration. ]
3 [ Mar 28 08:13:25 Rereading configuration. ]
4 [ Mar 28 08:13:27 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-28T08:13:27.745ZINFOcrucible-agent: dataset: "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible"
72024-03-28T08:13:27.745ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-03-28T08:13:27.745ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-28T08:13:27.828ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
102024-03-28T08:13:47.748ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:49111
112024-03-28T08:13:47.779ZINFOcrucible-agent (datafile): region 9cf882bc-371b-4fc6-989f-f3179d04f13a state: Requested
122024-03-28T08:13:47.780ZINFOcrucible-agent (dropshot): request completed latency_us = 1373 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49111 req_id = 66c06432-ef6c-4864-a0d6-50e3c0c75d8a response_code = 200 uri = /crucible/0/regions
132024-03-28T08:13:47.780ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-03-28T08:13:47.793ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a
152024-03-28T08:13:47.793ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a
162024-03-28T08:13:47.863ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9cf882bc-371b-4fc6-989f-f3179d04f13a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a" region = 9cf882bc-371b-4fc6-989f-f3179d04f13a
172024-03-28T08:13:47.967ZINFOcrucible-agent (worker): region files created ok region = 9cf882bc-371b-4fc6-989f-f3179d04f13a
182024-03-28T08:13:47.967ZINFOcrucible-agent (datafile): region 9cf882bc-371b-4fc6-989f-f3179d04f13a state: Requested -> Created
192024-03-28T08:13:47.967ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-03-28T08:13:47.967ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9cf882bc-371b-4fc6-989f-f3179d04f13a
212024-03-28T08:13:47.970ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9cf882bc-371b-4fc6-989f-f3179d04f13a
222024-03-28T08:13:47.976ZINFOcrucible-agent (worker): creating config property group
232024-03-28T08:13:47.982ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9cf882bc-371b-4fc6-989f-f3179d04f13a
242024-03-28T08:13:47.982ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a
252024-03-28T08:13:47.982ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-03-28T08:13:47.983ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
272024-03-28T08:13:47.983ZINFOcrucible-agent (worker): commit
282024-03-28T08:13:47.986ZINFOcrucible-agent (worker): ok!
292024-03-28T08:13:47.990ZINFOcrucible-agent (worker): SMF ok!
302024-03-28T08:13:48.064ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:49111 req_id = 7ce8e78f-30e9-4d84-b132-76fad25ee734 response_code = 200 uri = /crucible/0/regions
312024-03-28T08:13:49.136ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:53013
322024-03-28T08:13:49.136ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53013 req_id = 9a3ed8ff-938e-4668-8f50-1bb85dbb2125 response_code = 200 uri = /crucible/0/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a
332024-03-28T08:13:49.136ZINFOcrucible-agent (datafile): path is "/data/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a"
342024-03-28T08:13:49.145ZINFOcrucible-agent (datafile): dataset is oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a
352024-03-28T08:13:49.154ZINFOcrucible-agent (datafile): region 9cf882bc-371b-4fc6-989f-f3179d04f13a state: Created -> Tombstoned
362024-03-28T08:13:49.154ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-03-28T08:13:49.154ZINFOcrucible-agent (dropshot): request completed latency_us = 17443 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:53013 req_id = 41d9d840-62bb-4964-bff7-9af33244ae46 response_code = 204 uri = /crucible/0/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a
382024-03-28T08:13:49.154ZINFOcrucible-agent (dropshot): request completed latency_us = 547 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53013 req_id = 36fdd933-0c3e-42da-b307-d1acad71932b response_code = 200 uri = /crucible/0/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a
392024-03-28T08:13:49.155ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9cf882bc-371b-4fc6-989f-f3179d04f13a (instance states: (Some(Online), None))
402024-03-28T08:13:49.159ZINFOcrucible-agent (worker): SMF ok!
412024-03-28T08:13:49.168ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a" region = 9cf882bc-371b-4fc6-989f-f3179d04f13a
422024-03-28T08:13:49.219ZINFOcrucible-agent (datafile): region 9cf882bc-371b-4fc6-989f-f3179d04f13a state: Tombstoned -> Destroyed
432024-03-28T08:13:49.267ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:53013 req_id = bc5eb433-095a-499f-9ed4-9c0d3707269c response_code = 200 uri = /crucible/0/regions/9cf882bc-371b-4fc6-989f-f3179d04f13a
442024-03-28T08:14:36.138ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:49886
452024-03-28T08:14:36.196ZINFOcrucible-agent (datafile): region eda73f40-12d8-43f8-bd3f-4ee43bc2011c state: Requested
462024-03-28T08:14:36.196ZINFOcrucible-agent (dropshot): request completed latency_us = 281 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49886 req_id = 60dbb93b-bb1b-4037-830a-7c272d3bf810 response_code = 200 uri = /crucible/0/regions
472024-03-28T08:14:36.196ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-03-28T08:14:36.205ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/eda73f40-12d8-43f8-bd3f-4ee43bc2011c
492024-03-28T08:14:36.205ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible/regions/eda73f40-12d8-43f8-bd3f-4ee43bc2011c
502024-03-28T08:14:36.266ZINFOcrucible-agent (worker): creating region Region { id: RegionId("eda73f40-12d8-43f8-bd3f-4ee43bc2011c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/eda73f40-12d8-43f8-bd3f-4ee43bc2011c" region = eda73f40-12d8-43f8-bd3f-4ee43bc2011c
512024-03-28T08:14:36.335ZINFOcrucible-agent (worker): region files created ok region = eda73f40-12d8-43f8-bd3f-4ee43bc2011c
522024-03-28T08:14:36.335ZINFOcrucible-agent (datafile): region eda73f40-12d8-43f8-bd3f-4ee43bc2011c state: Requested -> Created
532024-03-28T08:14:36.335ZINFOcrucible-agent (worker): applying SMF actions post create...
542024-03-28T08:14:36.336ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-eda73f40-12d8-43f8-bd3f-4ee43bc2011c
552024-03-28T08:14:36.339ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-eda73f40-12d8-43f8-bd3f-4ee43bc2011c
562024-03-28T08:14:36.346ZINFOcrucible-agent (worker): creating config property group
572024-03-28T08:14:36.349ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-eda73f40-12d8-43f8-bd3f-4ee43bc2011c
582024-03-28T08:14:36.349ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eda73f40-12d8-43f8-bd3f-4ee43bc2011c
592024-03-28T08:14:36.349ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
602024-03-28T08:14:36.349ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
612024-03-28T08:14:36.349ZINFOcrucible-agent (worker): commit
622024-03-28T08:14:36.352ZINFOcrucible-agent (worker): ok!
632024-03-28T08:14:36.356ZINFOcrucible-agent (worker): SMF ok!
642024-03-28T08:14:36.533ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49886 req_id = 1d1f2fdd-b970-4a70-bb63-998a7cc64a3e response_code = 200 uri = /crucible/0/regions