Max level shown:
1 [ Feb 13 05:08:07 Enabled. ]
2 [ Feb 13 05:08:07 Rereading configuration. ]
3 [ Feb 13 05:08:12 Rereading configuration. ]
4 [ Feb 13 05:08:19 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_8e93081f-e6c7-48d4-8f2b-cc48a61e4a47/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-02-13T05:08:19.551ZINFOcrucible-agent: dataset: "oxp_8e93081f-e6c7-48d4-8f2b-cc48a61e4a47/crucible"
72025-02-13T05:08:19.555ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
82025-02-13T05:08:19.555ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-02-13T05:08:19.581ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-02-13T05:08:19.644ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
112025-02-13T05:08:34.502ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:48189
122025-02-13T05:08:34.515ZINFOcrucible-agent (datafile): region 96f58697-6422-4c5e-a900-a83fc7120c11 state: Requested
132025-02-13T05:08:34.515ZINFOcrucible-agent (dropshot): request completed latency_us = 7745 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48189 req_id = 7c0ce348-1f96-4c3c-a326-749f4af897f6 response_code = 200 uri = /crucible/0/regions
142025-02-13T05:08:34.517ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-02-13T05:08:34.527ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_8e93081f-e6c7-48d4-8f2b-cc48a61e4a47/crucible/regions/96f58697-6422-4c5e-a900-a83fc7120c11
162025-02-13T05:08:34.527ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_8e93081f-e6c7-48d4-8f2b-cc48a61e4a47/crucible/regions/96f58697-6422-4c5e-a900-a83fc7120c11
172025-02-13T05:08:34.579ZINFOcrucible-agent (worker): creating region Region { id: RegionId("96f58697-6422-4c5e-a900-a83fc7120c11"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/96f58697-6422-4c5e-a900-a83fc7120c11" region = 96f58697-6422-4c5e-a900-a83fc7120c11
182025-02-13T05:08:34.587ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "96f58697-6422-4c5e-a900-a83fc7120c11" "--data" "/data/regions/96f58697-6422-4c5e-a900-a83fc7120c11" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 96f58697-6422-4c5e-a900-a83fc7120c11
192025-02-13T05:08:34.718ZINFOcrucible-agent (worker): region files created ok region = 96f58697-6422-4c5e-a900-a83fc7120c11
202025-02-13T05:08:34.718ZINFOcrucible-agent (datafile): region 96f58697-6422-4c5e-a900-a83fc7120c11 state: Requested -> Created
212025-02-13T05:08:34.718ZINFOcrucible-agent (worker): applying SMF actions post create...
222025-02-13T05:08:34.719ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-96f58697-6422-4c5e-a900-a83fc7120c11
232025-02-13T05:08:34.723ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-96f58697-6422-4c5e-a900-a83fc7120c11
242025-02-13T05:08:34.734ZINFOcrucible-agent (worker): creating config property group
252025-02-13T05:08:34.738ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-96f58697-6422-4c5e-a900-a83fc7120c11
262025-02-13T05:08:34.739ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/96f58697-6422-4c5e-a900-a83fc7120c11
272025-02-13T05:08:34.739ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282025-02-13T05:08:34.739ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
292025-02-13T05:08:34.739ZINFOcrucible-agent (worker): commit
302025-02-13T05:08:34.745ZINFOcrucible-agent (worker): ok!
312025-02-13T05:08:34.750ZINFOcrucible-agent (worker): SMF ok!
322025-02-13T05:08:34.777ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48189 req_id = 48022788-b1e6-4aab-8d31-066a5d993cb3 response_code = 200 uri = /crucible/0/regions
332025-02-13T05:08:35.169ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48189 req_id = 91a92ae0-08b3-424c-8d8c-386673b9979d response_code = 200 uri = /crucible/0/regions/96f58697-6422-4c5e-a900-a83fc7120c11
342025-02-13T05:08:35.172ZINFOcrucible-agent (datafile): path is "/data/regions/96f58697-6422-4c5e-a900-a83fc7120c11"
352025-02-13T05:08:35.184ZINFOcrucible-agent (datafile): dataset is oxp_8e93081f-e6c7-48d4-8f2b-cc48a61e4a47/crucible/regions/96f58697-6422-4c5e-a900-a83fc7120c11
362025-02-13T05:08:35.194ZINFOcrucible-agent (datafile): region 96f58697-6422-4c5e-a900-a83fc7120c11 state: Created -> Tombstoned
372025-02-13T05:08:35.194ZINFOcrucible-agent (worker): applying SMF actions before removal...
382025-02-13T05:08:35.194ZINFOcrucible-agent (dropshot): request completed latency_us = 21415 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:48189 req_id = a0e645b5-b345-46a6-9eb0-6c6800ee7bbb response_code = 204 uri = /crucible/0/regions/96f58697-6422-4c5e-a900-a83fc7120c11
392025-02-13T05:08:35.195ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-96f58697-6422-4c5e-a900-a83fc7120c11 (instance states: (Some(Online), None))
402025-02-13T05:08:35.197ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48189 req_id = ab23d810-d4db-4707-98e9-da186d419e60 response_code = 200 uri = /crucible/0/regions/96f58697-6422-4c5e-a900-a83fc7120c11
412025-02-13T05:08:35.203ZINFOcrucible-agent (worker): SMF ok!
422025-02-13T05:08:35.216ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8e93081f-e6c7-48d4-8f2b-cc48a61e4a47/crucible/regions/96f58697-6422-4c5e-a900-a83fc7120c11" region = 96f58697-6422-4c5e-a900-a83fc7120c11
432025-02-13T05:08:35.285ZINFOcrucible-agent (datafile): region 96f58697-6422-4c5e-a900-a83fc7120c11 state: Tombstoned -> Destroyed
442025-02-13T05:08:35.316ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48189 req_id = 6aa53560-9907-4cbd-a6f4-99b93c6883a2 response_code = 200 uri = /crucible/0/regions/96f58697-6422-4c5e-a900-a83fc7120c11
452025-02-13T05:08:37.517ZINFOcrucible-agent (datafile): region d9b28a44-19e1-40bc-abcd-5d24699e0c38 state: Requested
462025-02-13T05:08:37.520ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
472025-02-13T05:08:37.520ZINFOcrucible-agent (dropshot): request completed latency_us = 2690 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48189 req_id = 93402e4c-9128-4e26-87d6-1ae9bb66b136 response_code = 200 uri = /crucible/0/regions
482025-02-13T05:08:37.529ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8e93081f-e6c7-48d4-8f2b-cc48a61e4a47/crucible/regions/d9b28a44-19e1-40bc-abcd-5d24699e0c38
492025-02-13T05:08:37.529ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8e93081f-e6c7-48d4-8f2b-cc48a61e4a47/crucible/regions/d9b28a44-19e1-40bc-abcd-5d24699e0c38
502025-02-13T05:08:37.601ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d9b28a44-19e1-40bc-abcd-5d24699e0c38"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d9b28a44-19e1-40bc-abcd-5d24699e0c38" region = d9b28a44-19e1-40bc-abcd-5d24699e0c38
512025-02-13T05:08:37.603ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d9b28a44-19e1-40bc-abcd-5d24699e0c38" "--data" "/data/regions/d9b28a44-19e1-40bc-abcd-5d24699e0c38" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d9b28a44-19e1-40bc-abcd-5d24699e0c38
522025-02-13T05:08:37.681ZINFOcrucible-agent (worker): region files created ok region = d9b28a44-19e1-40bc-abcd-5d24699e0c38
532025-02-13T05:08:37.681ZINFOcrucible-agent (datafile): region d9b28a44-19e1-40bc-abcd-5d24699e0c38 state: Requested -> Created
542025-02-13T05:08:37.682ZINFOcrucible-agent (worker): applying SMF actions post create...
552025-02-13T05:08:37.683ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d9b28a44-19e1-40bc-abcd-5d24699e0c38
562025-02-13T05:08:37.686ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d9b28a44-19e1-40bc-abcd-5d24699e0c38
572025-02-13T05:08:37.696ZINFOcrucible-agent (worker): creating config property group
582025-02-13T05:08:37.700ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d9b28a44-19e1-40bc-abcd-5d24699e0c38
592025-02-13T05:08:37.700ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d9b28a44-19e1-40bc-abcd-5d24699e0c38
602025-02-13T05:08:37.700ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612025-02-13T05:08:37.700ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
622025-02-13T05:08:37.700ZINFOcrucible-agent (worker): commit
632025-02-13T05:08:37.705ZINFOcrucible-agent (worker): ok!
642025-02-13T05:08:37.710ZINFOcrucible-agent (worker): SMF ok!
652025-02-13T05:08:37.748ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48189 req_id = b4cc4b87-375a-4d29-a7d1-bf26aa297247 response_code = 200 uri = /crucible/0/regions