Max level shown:
1 [ Mar 1 23:17:32 Enabled. ]
2 [ Mar 1 23:17:32 Rereading configuration. ]
3 [ Mar 1 23:17:37 Rereading configuration. ]
4 [ Mar 1 23:17:43 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-01T23:17:43.875ZINFOcrucible-agent: dataset: "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible"
72024-03-01T23:17:43.876ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82024-03-01T23:17:43.876ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-01T23:17:44.289ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
102024-03-01T23:18:24.356ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:61425
112024-03-01T23:18:24.366ZINFOcrucible-agent (datafile): region 77115e99-3a1f-406f-bb6f-eaa5f35c2a84 state: Requested
122024-03-01T23:18:24.367ZINFOcrucible-agent (dropshot): request completed latency_us = 5828 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61425 req_id = a0aa53f6-19ca-40da-8f12-27e06a125f6b response_code = 200 uri = /crucible/0/regions
132024-03-01T23:18:24.368ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-03-01T23:18:24.376ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84
152024-03-01T23:18:24.376ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84
162024-03-01T23:18:24.440ZINFOcrucible-agent (worker): creating region Region { id: RegionId("77115e99-3a1f-406f-bb6f-eaa5f35c2a84"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84" region = 77115e99-3a1f-406f-bb6f-eaa5f35c2a84
172024-03-01T23:18:24.573ZINFOcrucible-agent (worker): region files created ok region = 77115e99-3a1f-406f-bb6f-eaa5f35c2a84
182024-03-01T23:18:24.573ZINFOcrucible-agent (datafile): region 77115e99-3a1f-406f-bb6f-eaa5f35c2a84 state: Requested -> Created
192024-03-01T23:18:24.573ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-03-01T23:18:24.573ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-77115e99-3a1f-406f-bb6f-eaa5f35c2a84
212024-03-01T23:18:24.581ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-77115e99-3a1f-406f-bb6f-eaa5f35c2a84
222024-03-01T23:18:24.591ZINFOcrucible-agent (worker): creating config property group
232024-03-01T23:18:24.596ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-77115e99-3a1f-406f-bb6f-eaa5f35c2a84
242024-03-01T23:18:24.596ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84
252024-03-01T23:18:24.596ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-03-01T23:18:24.596ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
272024-03-01T23:18:24.596ZINFOcrucible-agent (worker): commit
282024-03-01T23:18:24.602ZINFOcrucible-agent (worker): ok!
292024-03-01T23:18:24.608ZINFOcrucible-agent (worker): SMF ok!
302024-03-01T23:18:24.729ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61425 req_id = b3454ec5-6982-467a-98e4-7e9e2f470b04 response_code = 200 uri = /crucible/0/regions
312024-03-01T23:18:25.661ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:46348
322024-03-01T23:18:25.661ZINFOcrucible-agent (dropshot): request completed latency_us = 110 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46348 req_id = 8fd06b0c-7da5-4ba7-b708-2973c71708f0 response_code = 200 uri = /crucible/0/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84
332024-03-01T23:18:25.662ZINFOcrucible-agent (datafile): path is "/data/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84"
342024-03-01T23:18:25.671ZINFOcrucible-agent (datafile): dataset is oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84
352024-03-01T23:18:25.679ZINFOcrucible-agent (datafile): region 77115e99-3a1f-406f-bb6f-eaa5f35c2a84 state: Created -> Tombstoned
362024-03-01T23:18:25.679ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-03-01T23:18:25.679ZINFOcrucible-agent (dropshot): request completed latency_us = 17421 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:46348 req_id = 40388d7a-8363-493e-bec4-0371ba9d648b response_code = 204 uri = /crucible/0/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84
382024-03-01T23:18:25.679ZINFOcrucible-agent (dropshot): request completed latency_us = 21 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46348 req_id = d1c0b373-64b7-4dc2-aa6f-2f8bfb95c7ba response_code = 200 uri = /crucible/0/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84
392024-03-01T23:18:25.680ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-77115e99-3a1f-406f-bb6f-eaa5f35c2a84 (instance states: (Some(Online), None))
402024-03-01T23:18:25.684ZINFOcrucible-agent (worker): SMF ok!
412024-03-01T23:18:25.693ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84" region = 77115e99-3a1f-406f-bb6f-eaa5f35c2a84
422024-03-01T23:18:25.745ZINFOcrucible-agent (datafile): region 77115e99-3a1f-406f-bb6f-eaa5f35c2a84 state: Tombstoned -> Destroyed
432024-03-01T23:18:25.794ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46348 req_id = d7a614c7-9af9-4ce0-a4ba-bfa6b20fc08b response_code = 200 uri = /crucible/0/regions/77115e99-3a1f-406f-bb6f-eaa5f35c2a84
442024-03-01T23:24:29.822ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:39214
452024-03-01T23:24:29.822ZINFOcrucible-agent (datafile): region 4191742d-78a6-4330-b3c4-72d2bb7984f4 state: Requested
462024-03-01T23:24:29.823ZINFOcrucible-agent (dropshot): request completed latency_us = 1187 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39214 req_id = 8c855b23-dbeb-43fe-833b-c7c4ec7f6679 response_code = 200 uri = /crucible/0/regions
472024-03-01T23:24:29.823ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-03-01T23:24:29.833ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/4191742d-78a6-4330-b3c4-72d2bb7984f4
492024-03-01T23:24:29.833ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible/regions/4191742d-78a6-4330-b3c4-72d2bb7984f4
502024-03-01T23:24:29.922ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4191742d-78a6-4330-b3c4-72d2bb7984f4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/4191742d-78a6-4330-b3c4-72d2bb7984f4" region = 4191742d-78a6-4330-b3c4-72d2bb7984f4
512024-03-01T23:24:30.168ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39214 req_id = cb784e8f-e5af-4951-b4fa-e00962a8c2aa response_code = 200 uri = /crucible/0/regions
522024-03-01T23:24:30.241ZINFOcrucible-agent (worker): region files created ok region = 4191742d-78a6-4330-b3c4-72d2bb7984f4
532024-03-01T23:24:30.242ZINFOcrucible-agent (datafile): region 4191742d-78a6-4330-b3c4-72d2bb7984f4 state: Requested -> Created
542024-03-01T23:24:30.242ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-03-01T23:24:30.243ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4191742d-78a6-4330-b3c4-72d2bb7984f4
562024-03-01T23:24:30.261ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4191742d-78a6-4330-b3c4-72d2bb7984f4
572024-03-01T23:24:30.292ZINFOcrucible-agent (worker): creating config property group
582024-03-01T23:24:30.305ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4191742d-78a6-4330-b3c4-72d2bb7984f4
592024-03-01T23:24:30.305ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4191742d-78a6-4330-b3c4-72d2bb7984f4
602024-03-01T23:24:30.305ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-03-01T23:24:30.305ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
622024-03-01T23:24:30.305ZINFOcrucible-agent (worker): commit
632024-03-01T23:24:30.316ZINFOcrucible-agent (worker): ok!
642024-03-01T23:24:30.329ZINFOcrucible-agent (worker): SMF ok!
652024-03-01T23:24:30.551ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39214 req_id = fe93c7ea-8065-4a50-aa7f-303d6406dae7 response_code = 200 uri = /crucible/0/regions