Max level shown:
1 [ Feb 25 03:48:28 Enabled. ]
2 [ Feb 25 03:48:28 Rereading configuration. ]
3 [ Feb 25 03:48:31 Rereading configuration. ]
4 [ Feb 25 03:48:36 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_6b9444de-c21c-4d5a-9da3-4f3837fdf8f8/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-02-25T03:48:36.549ZINFOcrucible-agent: dataset: "oxp_6b9444de-c21c-4d5a-9da3-4f3837fdf8f8/crucible"
72025-02-25T03:48:36.552ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82025-02-25T03:48:36.552ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-02-25T03:48:36.567ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-02-25T03:48:36.677ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112025-02-25T03:49:20.941ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:40920
122025-02-25T03:49:20.964ZINFOcrucible-agent (datafile): region 3e817daa-8941-4029-82b0-f521e745de6d state: Requested
132025-02-25T03:49:20.967ZINFOcrucible-agent (dropshot): request completed latency_us = 11315 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:40920 req_id = 70ec7707-a0ad-4597-bb44-5ec0aa9007e8 response_code = 200 uri = /crucible/0/regions
142025-02-25T03:49:20.967ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-02-25T03:49:20.977ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_6b9444de-c21c-4d5a-9da3-4f3837fdf8f8/crucible/regions/3e817daa-8941-4029-82b0-f521e745de6d
162025-02-25T03:49:20.977ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_6b9444de-c21c-4d5a-9da3-4f3837fdf8f8/crucible/regions/3e817daa-8941-4029-82b0-f521e745de6d
172025-02-25T03:49:21.034ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3e817daa-8941-4029-82b0-f521e745de6d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3e817daa-8941-4029-82b0-f521e745de6d" region = 3e817daa-8941-4029-82b0-f521e745de6d
182025-02-25T03:49:21.036ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3e817daa-8941-4029-82b0-f521e745de6d" "--data" "/data/regions/3e817daa-8941-4029-82b0-f521e745de6d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 3e817daa-8941-4029-82b0-f521e745de6d
192025-02-25T03:49:21.152ZINFOcrucible-agent (worker): region files created ok region = 3e817daa-8941-4029-82b0-f521e745de6d
202025-02-25T03:49:21.152ZINFOcrucible-agent (datafile): region 3e817daa-8941-4029-82b0-f521e745de6d state: Requested -> Created
212025-02-25T03:49:21.152ZINFOcrucible-agent (worker): applying SMF actions post create...
222025-02-25T03:49:21.152ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3e817daa-8941-4029-82b0-f521e745de6d
232025-02-25T03:49:21.156ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3e817daa-8941-4029-82b0-f521e745de6d
242025-02-25T03:49:21.167ZINFOcrucible-agent (worker): creating config property group
252025-02-25T03:49:21.171ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3e817daa-8941-4029-82b0-f521e745de6d
262025-02-25T03:49:21.172ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3e817daa-8941-4029-82b0-f521e745de6d
272025-02-25T03:49:21.174ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282025-02-25T03:49:21.174ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
292025-02-25T03:49:21.174ZINFOcrucible-agent (worker): commit
302025-02-25T03:49:21.184ZINFOcrucible-agent (worker): ok!
312025-02-25T03:49:21.189ZINFOcrucible-agent (worker): SMF ok!
322025-02-25T03:49:21.222ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:40920 req_id = b82a3a20-efab-4510-95cf-43cf19c370fd response_code = 200 uri = /crucible/0/regions
332025-02-25T03:49:21.853ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:40920 req_id = a85e4497-a48d-4593-9815-822bfe25fb6b response_code = 200 uri = /crucible/0/regions/3e817daa-8941-4029-82b0-f521e745de6d
342025-02-25T03:49:21.856ZINFOcrucible-agent (datafile): path is "/data/regions/3e817daa-8941-4029-82b0-f521e745de6d"
352025-02-25T03:49:21.867ZINFOcrucible-agent (datafile): dataset is oxp_6b9444de-c21c-4d5a-9da3-4f3837fdf8f8/crucible/regions/3e817daa-8941-4029-82b0-f521e745de6d
362025-02-25T03:49:21.878ZINFOcrucible-agent (datafile): region 3e817daa-8941-4029-82b0-f521e745de6d state: Created -> Tombstoned
372025-02-25T03:49:21.878ZINFOcrucible-agent (worker): applying SMF actions before removal...
382025-02-25T03:49:21.879ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3e817daa-8941-4029-82b0-f521e745de6d (instance states: (Some(Online), None))
392025-02-25T03:49:21.880ZINFOcrucible-agent (dropshot): request completed latency_us = 23955 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:40920 req_id = a5c33ba7-0807-453a-a8d7-e8388a9d90f7 response_code = 204 uri = /crucible/0/regions/3e817daa-8941-4029-82b0-f521e745de6d
402025-02-25T03:49:21.883ZINFOcrucible-agent (dropshot): request completed latency_us = 35 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:40920 req_id = a295fd5e-2edb-46f9-892c-065d5fafce98 response_code = 200 uri = /crucible/0/regions/3e817daa-8941-4029-82b0-f521e745de6d
412025-02-25T03:49:21.884ZINFOcrucible-agent (worker): SMF ok!
422025-02-25T03:49:21.896ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_6b9444de-c21c-4d5a-9da3-4f3837fdf8f8/crucible/regions/3e817daa-8941-4029-82b0-f521e745de6d" region = 3e817daa-8941-4029-82b0-f521e745de6d
432025-02-25T03:49:21.960ZINFOcrucible-agent (datafile): region 3e817daa-8941-4029-82b0-f521e745de6d state: Tombstoned -> Destroyed
442025-02-25T03:49:22.009ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:40920 req_id = cf2773cc-bece-47d3-9a26-2a345b67a68f response_code = 200 uri = /crucible/0/regions/3e817daa-8941-4029-82b0-f521e745de6d
452025-02-25T03:59:35.755ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:38782
462025-02-25T03:59:35.755ZINFOcrucible-agent (datafile): region f6b3e5cd-4e1e-412c-94a9-a195850bb9e8 state: Requested
472025-02-25T03:59:35.759ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482025-02-25T03:59:35.759ZINFOcrucible-agent (dropshot): request completed latency_us = 4181 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38782 req_id = 94ca8102-1f35-475e-9c80-bf9eb4995470 response_code = 200 uri = /crucible/0/regions
492025-02-25T03:59:35.769ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6b9444de-c21c-4d5a-9da3-4f3837fdf8f8/crucible/regions/f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
502025-02-25T03:59:35.769ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6b9444de-c21c-4d5a-9da3-4f3837fdf8f8/crucible/regions/f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
512025-02-25T03:59:35.847ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f6b3e5cd-4e1e-412c-94a9-a195850bb9e8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f6b3e5cd-4e1e-412c-94a9-a195850bb9e8" region = f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
522025-02-25T03:59:35.849ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f6b3e5cd-4e1e-412c-94a9-a195850bb9e8" "--data" "/data/regions/f6b3e5cd-4e1e-412c-94a9-a195850bb9e8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
532025-02-25T03:59:36.030ZINFOcrucible-agent (dropshot): request completed latency_us = 908 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38782 req_id = 6feb4406-52d3-4849-8ae3-93ef92a31f36 response_code = 200 uri = /crucible/0/regions
542025-02-25T03:59:36.193ZINFOcrucible-agent (worker): region files created ok region = f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
552025-02-25T03:59:36.193ZINFOcrucible-agent (datafile): region f6b3e5cd-4e1e-412c-94a9-a195850bb9e8 state: Requested -> Created
562025-02-25T03:59:36.193ZINFOcrucible-agent (worker): applying SMF actions post create...
572025-02-25T03:59:36.194ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
582025-02-25T03:59:36.200ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
592025-02-25T03:59:36.210ZINFOcrucible-agent (worker): creating config property group
602025-02-25T03:59:36.213ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
612025-02-25T03:59:36.213ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f6b3e5cd-4e1e-412c-94a9-a195850bb9e8
622025-02-25T03:59:36.213ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632025-02-25T03:59:36.213ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
642025-02-25T03:59:36.213ZINFOcrucible-agent (worker): commit
652025-02-25T03:59:36.217ZINFOcrucible-agent (worker): ok!
662025-02-25T03:59:36.222ZINFOcrucible-agent (worker): SMF ok!
672025-02-25T03:59:36.288ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38782 req_id = a131f813-e49c-4f27-a514-cfd8478285dd response_code = 200 uri = /crucible/0/regions