Max level shown:
1 [ Feb 28 13:20:41 Enabled. ]
2 [ Feb 28 13:20:41 Rereading configuration. ]
3 [ Feb 28 13:20:43 Rereading configuration. ]
4 [ Feb 28 13:20:46 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-02-28T13:20:46.768ZINFOcrucible-agent: dataset: "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible"
72024-02-28T13:20:46.770ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82024-02-28T13:20:46.770ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-02-28T13:20:46.974ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
102024-02-28T13:21:30.602ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:58920
112024-02-28T13:21:30.604ZINFOcrucible-agent (datafile): region 86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8 state: Requested
122024-02-28T13:21:30.604ZINFOcrucible-agent (dropshot): request completed latency_us = 1032 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58920 req_id = 79990398-1b6b-4ff7-a13a-23823ec51667 response_code = 200 uri = /crucible/0/regions
132024-02-28T13:21:30.605ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-02-28T13:21:30.614ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
152024-02-28T13:21:30.614ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
162024-02-28T13:21:30.787ZINFOcrucible-agent (worker): creating region Region { id: RegionId("86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8" region = 86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
172024-02-28T13:21:30.907ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58920 req_id = 9ae3152d-8ce5-4535-be83-a8dbf13cdcc5 response_code = 200 uri = /crucible/0/regions
182024-02-28T13:21:31.087ZINFOcrucible-agent (worker): region files created ok region = 86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
192024-02-28T13:21:31.087ZINFOcrucible-agent (datafile): region 86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8 state: Requested -> Created
202024-02-28T13:21:31.087ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-02-28T13:21:31.087ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
222024-02-28T13:21:31.125ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
232024-02-28T13:21:31.201ZINFOcrucible-agent (worker): creating config property group
242024-02-28T13:21:31.237ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
252024-02-28T13:21:31.238ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
262024-02-28T13:21:31.238ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-02-28T13:21:31.238ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
282024-02-28T13:21:31.238ZINFOcrucible-agent (worker): commit
292024-02-28T13:21:31.258ZINFOcrucible-agent (worker): ok!
302024-02-28T13:21:31.302ZINFOcrucible-agent (worker): SMF ok!
312024-02-28T13:21:31.607ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58920 req_id = d2bca50f-e730-4914-be38-39e6138900aa response_code = 200 uri = /crucible/0/regions
322024-02-28T13:21:33.130ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:52867
332024-02-28T13:21:33.131ZINFOcrucible-agent (dropshot): request completed latency_us = 1045 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52867 req_id = 061a03d8-d001-4e14-972c-338744cd7095 response_code = 200 uri = /crucible/0/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
342024-02-28T13:21:33.132ZINFOcrucible-agent (datafile): path is "/data/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8"
352024-02-28T13:21:33.141ZINFOcrucible-agent (datafile): dataset is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
362024-02-28T13:21:33.149ZINFOcrucible-agent (datafile): region 86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8 state: Created -> Tombstoned
372024-02-28T13:21:33.150ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-02-28T13:21:33.150ZINFOcrucible-agent (dropshot): request completed latency_us = 18119 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:52867 req_id = 35ebf57e-064c-47ee-85cc-504645ccc715 response_code = 204 uri = /crucible/0/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
392024-02-28T13:21:33.150ZINFOcrucible-agent (dropshot): request completed latency_us = 21 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52867 req_id = e9f94d8a-a3b4-4a0c-ae57-0e14eb2eb49b response_code = 200 uri = /crucible/0/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
402024-02-28T13:21:33.151ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8 (instance states: (Some(Online), None))
412024-02-28T13:21:33.174ZINFOcrucible-agent (worker): SMF ok!
422024-02-28T13:21:33.184ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8" region = 86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
432024-02-28T13:21:33.281ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52867 req_id = f72199c7-f970-423a-aa3c-81d8def05cfb response_code = 200 uri = /crucible/0/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
442024-02-28T13:21:33.282ZINFOcrucible-agent (datafile): region 86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8 state: Tombstoned -> Destroyed
452024-02-28T13:21:33.396ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:52867 req_id = f3ed50e0-2f33-4e9c-aee2-3c7d354cc635 response_code = 200 uri = /crucible/0/regions/86d0971b-a7ac-4000-b5e6-2ef8d7ce2ac8
462024-02-28T13:27:33.522ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:43145
472024-02-28T13:27:33.523ZINFOcrucible-agent (datafile): region be1cb226-7df7-4c87-8daf-1f117e6d2ad4 state: Requested
482024-02-28T13:27:33.524ZINFOcrucible-agent (dropshot): request completed latency_us = 1308 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43145 req_id = c67e147c-eb3d-42fc-a0dc-b82fb4609346 response_code = 200 uri = /crucible/0/regions
492024-02-28T13:27:33.524ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502024-02-28T13:27:33.534ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/be1cb226-7df7-4c87-8daf-1f117e6d2ad4
512024-02-28T13:27:33.534ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/be1cb226-7df7-4c87-8daf-1f117e6d2ad4
522024-02-28T13:27:33.598ZINFOcrucible-agent (worker): creating region Region { id: RegionId("be1cb226-7df7-4c87-8daf-1f117e6d2ad4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/be1cb226-7df7-4c87-8daf-1f117e6d2ad4" region = be1cb226-7df7-4c87-8daf-1f117e6d2ad4
532024-02-28T13:27:33.663ZINFOcrucible-agent (worker): region files created ok region = be1cb226-7df7-4c87-8daf-1f117e6d2ad4
542024-02-28T13:27:33.663ZINFOcrucible-agent (datafile): region be1cb226-7df7-4c87-8daf-1f117e6d2ad4 state: Requested -> Created
552024-02-28T13:27:33.663ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-02-28T13:27:33.664ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-be1cb226-7df7-4c87-8daf-1f117e6d2ad4
572024-02-28T13:27:33.670ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-be1cb226-7df7-4c87-8daf-1f117e6d2ad4
582024-02-28T13:27:33.679ZINFOcrucible-agent (worker): creating config property group
592024-02-28T13:27:33.681ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-be1cb226-7df7-4c87-8daf-1f117e6d2ad4
602024-02-28T13:27:33.682ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/be1cb226-7df7-4c87-8daf-1f117e6d2ad4
612024-02-28T13:27:33.682ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-02-28T13:27:33.682ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
632024-02-28T13:27:33.682ZINFOcrucible-agent (worker): commit
642024-02-28T13:27:33.686ZINFOcrucible-agent (worker): ok!
652024-02-28T13:27:33.691ZINFOcrucible-agent (worker): SMF ok!
662024-02-28T13:27:33.693ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43145 req_id = 420d7b2e-7d1b-434f-88c0-0bc5d6173777 response_code = 200 uri = /crucible/0/regions