Max level shown:
1 [ Mar 3 23:31:14 Enabled. ]
2 [ Mar 3 23:31:14 Rereading configuration. ]
3 [ Mar 3 23:31:16 Rereading configuration. ]
4 [ Mar 3 23:31:20 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_d984dabe-878c-4fe6-a385-4fd19a2c7ee9/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-03-03T23:31:21.015ZINFOcrucible-agent: dataset: "oxp_d984dabe-878c-4fe6-a385-4fd19a2c7ee9/crucible"
72025-03-03T23:31:21.018ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82025-03-03T23:31:21.018ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-03-03T23:31:21.035ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-03-03T23:31:21.314ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112025-03-03T23:32:04.696ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:35458
122025-03-03T23:32:04.735ZINFOcrucible-agent (datafile): region 98fbbd3d-ecaa-47be-8207-2c7de2a4225b state: Requested
132025-03-03T23:32:04.738ZINFOcrucible-agent (dropshot): request completed latency_us = 17397 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35458 req_id = 2747f568-a4c7-4f5c-b9c7-11dda0f17ad8 response_code = 200 uri = /crucible/0/regions
142025-03-03T23:32:04.738ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-03-03T23:32:04.746ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_d984dabe-878c-4fe6-a385-4fd19a2c7ee9/crucible/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b
162025-03-03T23:32:04.746ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_d984dabe-878c-4fe6-a385-4fd19a2c7ee9/crucible/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b
172025-03-03T23:32:04.802ZINFOcrucible-agent (worker): creating region Region { id: RegionId("98fbbd3d-ecaa-47be-8207-2c7de2a4225b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b" region = 98fbbd3d-ecaa-47be-8207-2c7de2a4225b
182025-03-03T23:32:04.804ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "98fbbd3d-ecaa-47be-8207-2c7de2a4225b" "--data" "/data/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 98fbbd3d-ecaa-47be-8207-2c7de2a4225b
192025-03-03T23:32:04.949ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35458 req_id = d583d346-3fb9-45c9-8bc6-468b47b8ec96 response_code = 200 uri = /crucible/0/regions
202025-03-03T23:32:04.950ZINFOcrucible-agent (worker): region files created ok region = 98fbbd3d-ecaa-47be-8207-2c7de2a4225b
212025-03-03T23:32:04.950ZINFOcrucible-agent (datafile): region 98fbbd3d-ecaa-47be-8207-2c7de2a4225b state: Requested -> Created
222025-03-03T23:32:04.950ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-03-03T23:32:04.950ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-98fbbd3d-ecaa-47be-8207-2c7de2a4225b
242025-03-03T23:32:04.958ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-98fbbd3d-ecaa-47be-8207-2c7de2a4225b
252025-03-03T23:32:04.969ZINFOcrucible-agent (worker): creating config property group
262025-03-03T23:32:04.972ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-98fbbd3d-ecaa-47be-8207-2c7de2a4225b
272025-03-03T23:32:04.973ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b
282025-03-03T23:32:04.973ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-03-03T23:32:04.973ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302025-03-03T23:32:04.973ZINFOcrucible-agent (worker): commit
312025-03-03T23:32:04.979ZINFOcrucible-agent (worker): ok!
322025-03-03T23:32:04.993ZINFOcrucible-agent (worker): SMF ok!
332025-03-03T23:32:05.594ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35458 req_id = dfb524ab-1537-4482-a097-cb11466bb568 response_code = 200 uri = /crucible/0/regions
342025-03-03T23:32:06.012ZINFOcrucible-agent (dropshot): request completed latency_us = 2033 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35458 req_id = 49051566-6759-4e95-a1c1-7f11ffce7243 response_code = 200 uri = /crucible/0/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b
352025-03-03T23:32:06.017ZINFOcrucible-agent (datafile): path is "/data/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b"
362025-03-03T23:32:06.031ZINFOcrucible-agent (datafile): dataset is oxp_d984dabe-878c-4fe6-a385-4fd19a2c7ee9/crucible/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b
372025-03-03T23:32:06.043ZINFOcrucible-agent (datafile): region 98fbbd3d-ecaa-47be-8207-2c7de2a4225b state: Created -> Tombstoned
382025-03-03T23:32:06.043ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-03-03T23:32:06.043ZINFOcrucible-agent (dropshot): request completed latency_us = 25757 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:35458 req_id = e1fa1d4a-61ec-46af-8fd7-b982d43db18b response_code = 204 uri = /crucible/0/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b
402025-03-03T23:32:06.044ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-98fbbd3d-ecaa-47be-8207-2c7de2a4225b (instance states: (Some(Online), None))
412025-03-03T23:32:06.049ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35458 req_id = b72f9e75-2cdf-4531-b961-a2e1b0faf46b response_code = 200 uri = /crucible/0/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b
422025-03-03T23:32:06.052ZINFOcrucible-agent (worker): SMF ok!
432025-03-03T23:32:06.065ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d984dabe-878c-4fe6-a385-4fd19a2c7ee9/crucible/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b" region = 98fbbd3d-ecaa-47be-8207-2c7de2a4225b
442025-03-03T23:32:06.150ZINFOcrucible-agent (datafile): region 98fbbd3d-ecaa-47be-8207-2c7de2a4225b state: Tombstoned -> Destroyed
452025-03-03T23:32:06.165ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35458 req_id = 7d63357c-66b5-43f6-ac6c-028d684ea4ae response_code = 200 uri = /crucible/0/regions/98fbbd3d-ecaa-47be-8207-2c7de2a4225b