The \emph{eccentricity} of a vertex $u$ in a graph $G$, denoted by $e_G(u)$, is the maximum distance from $u$ to other vertices in $G$. We study extremal problems for the average eccentricity and the first and second Zagreb eccentricity indices, denoted by $σ_0(G)$, $σ_1(G)$, and $σ_2(G)$, respectively. These are defined by $σ_0(G)=\frac{1}{|V(G)|}\sum_{u\in V(G)}e_G(u)$, $σ_1(G)=\sum_{u\in V(G)}e_G^2(u)$, and $σ_2(G)=\sum_{uv\in E(G)}e_G(u)e_G(v)$. We study lower and upper bounds on these parameters among $n$-vertex connected graphs with fixed diameter, chromatic number, clique number, or matching number. Most of the bounds are sharp, with the corresponding extremal graphs characterized.