Max level shown:
12024-08-06T04:01:07.766ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:52528
22024-08-06T04:01:07.786ZINFOcrucible-agent (datafile): region 2b5257a9-8f7d-4e4d-bf30-3397b1423d3f state: Requested
32024-08-06T04:01:07.791ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-08-06T04:01:07.795ZINFOcrucible-agent (dropshot): request completed latency_us = 14379 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52528 req_id = 6896c2c5-ce81-48c4-ac65-0834d9caf50c response_code = 200 uri = /crucible/0/regions
52024-08-06T04:01:07.803ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_43bd0426-06a8-4302-8efa-5b4d637f93b6/crucible/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
62024-08-06T04:01:07.803ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_43bd0426-06a8-4302-8efa-5b4d637f93b6/crucible/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
72024-08-06T04:01:07.862ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2b5257a9-8f7d-4e4d-bf30-3397b1423d3f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f" region = 2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
82024-08-06T04:01:07.864ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2b5257a9-8f7d-4e4d-bf30-3397b1423d3f" "--data" "/data/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
92024-08-06T04:01:07.989ZINFOcrucible-agent (worker): region files created ok region = 2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
102024-08-06T04:01:07.989ZINFOcrucible-agent (datafile): region 2b5257a9-8f7d-4e4d-bf30-3397b1423d3f state: Requested -> Created
112024-08-06T04:01:07.989ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-08-06T04:01:07.989ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
132024-08-06T04:01:07.989ZINFOcrucible-agent (dropshot): request completed latency_us = 544 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52528 req_id = 310a92b1-fc75-4cce-b2aa-d7d3680b2eeb response_code = 200 uri = /crucible/0/regions
142024-08-06T04:01:07.994ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
152024-08-06T04:01:08.012ZINFOcrucible-agent (worker): creating config property group
162024-08-06T04:01:08.016ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
172024-08-06T04:01:08.024ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
182024-08-06T04:01:08.026ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-08-06T04:01:08.027ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202024-08-06T04:01:08.027ZINFOcrucible-agent (worker): commit
212024-08-06T04:01:08.032ZINFOcrucible-agent (worker): ok!
222024-08-06T04:01:08.037ZINFOcrucible-agent (worker): SMF ok!
232024-08-06T04:06:31.794ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:33626
242024-08-06T04:06:31.794ZINFOcrucible-agent (dropshot): request completed latency_us = 100 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33626 req_id = 5b717cf7-4765-47ea-a482-66cac8031cf5 response_code = 200 uri = /crucible/0/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
252024-08-06T04:06:31.797ZINFOcrucible-agent (datafile): path is "/data/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f"
262024-08-06T04:06:31.805ZINFOcrucible-agent (datafile): dataset is oxp_43bd0426-06a8-4302-8efa-5b4d637f93b6/crucible/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
272024-08-06T04:06:31.813ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_43bd0426-06a8-4302-8efa-5b4d637f93b6/crucible/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f@71195216-cfec-47d4-9ea7-f59b10c8f429
282024-08-06T04:06:31.813ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_43bd0426-06a8-4302-8efa-5b4d637f93b6/crucible/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f", "71195216-cfec-47d4-9ea7-f59b10c8f429"]
292024-08-06T04:06:31.824ZINFOcrucible-agent (dropshot): request completed latency_us = 29843 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33626 req_id = 3b8fc0a7-8cd1-471e-8e8f-aa136b6ccbbd response_code = 200 uri = /crucible/0/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f/snapshots/71195216-cfec-47d4-9ea7-f59b10c8f429
302024-08-06T04:06:31.824ZINFOcrucible-agent (datafile): path is "/data/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f"
312024-08-06T04:06:31.833ZINFOcrucible-agent (datafile): dataset is oxp_43bd0426-06a8-4302-8efa-5b4d637f93b6/crucible/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
322024-08-06T04:06:31.841ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_43bd0426-06a8-4302-8efa-5b4d637f93b6/crucible/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f@71195216-cfec-47d4-9ea7-f59b10c8f429
332024-08-06T04:06:31.841ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_43bd0426-06a8-4302-8efa-5b4d637f93b6/crucible/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f", "71195216-cfec-47d4-9ea7-f59b10c8f429"]
342024-08-06T04:06:31.850ZINFOcrucible-agent (datafile): requesting running snapshot 2b5257a9-8f7d-4e4d-bf30-3397b1423d3f-71195216-cfec-47d4-9ea7-f59b10c8f429 state: Requested
352024-08-06T04:06:31.851ZINFOcrucible-agent (worker): applying SMF actions for region 2b5257a9-8f7d-4e4d-bf30-3397b1423d3f running snapshot 71195216-cfec-47d4-9ea7-f59b10c8f429 (state Requested)...
362024-08-06T04:06:31.851ZINFOcrucible-agent (dropshot): request completed latency_us = 26551 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33626 req_id = 343a6323-1b42-4944-8c2f-9e522b7799f6 response_code = 200 uri = /crucible/0/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f/snapshots/71195216-cfec-47d4-9ea7-f59b10c8f429/run
372024-08-06T04:06:31.856ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
382024-08-06T04:06:31.856ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
392024-08-06T04:06:31.856ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::15
402024-08-06T04:06:31.856ZINFOcrucible-agent (worker): reconfig required
412024-08-06T04:06:31.856ZINFOcrucible-agent (worker): using existing config property group
422024-08-06T04:06:31.856ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
432024-08-06T04:06:31.856ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f
442024-08-06T04:06:31.857ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
452024-08-06T04:06:31.857ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
462024-08-06T04:06:31.857ZINFOcrucible-agent (worker): commit
472024-08-06T04:06:31.865ZINFOcrucible-agent (worker): ok!
482024-08-06T04:06:31.866ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-2b5257a9-8f7d-4e4d-bf30-3397b1423d3f-71195216-cfec-47d4-9ea7-f59b10c8f429
492024-08-06T04:06:31.872ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-2b5257a9-8f7d-4e4d-bf30-3397b1423d3f-71195216-cfec-47d4-9ea7-f59b10c8f429
502024-08-06T04:06:31.884ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-2b5257a9-8f7d-4e4d-bf30-3397b1423d3f-71195216-cfec-47d4-9ea7-f59b10c8f429
512024-08-06T04:06:31.884ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2b5257a9-8f7d-4e4d-bf30-3397b1423d3f/.zfs/snapshot/71195216-cfec-47d4-9ea7-f59b10c8f429
522024-08-06T04:06:31.884ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
532024-08-06T04:06:31.884ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
542024-08-06T04:06:31.884ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
552024-08-06T04:06:31.884ZINFOcrucible-agent (worker): commit
562024-08-06T04:06:31.888ZINFOcrucible-agent (worker): ok!
572024-08-06T04:06:31.893ZINFOcrucible-agent (worker): SMF ok!
582024-08-06T04:06:31.893ZINFOcrucible-agent (datafile): region 2b5257a9-8f7d-4e4d-bf30-3397b1423d3f running snapshot 71195216-cfec-47d4-9ea7-f59b10c8f429 state: Requested -> Created