First, we consider a nonnegative homogeneous block tri-diagonal matrix and obtain its convergence parameter, where some results in the field of matrix analytic method are extended to the case where block matrices have countably infinite dimension. Second, we apply our results to a multi-dimensional QBD process and obtain lower bounds for the directional asymptotic decay rates of the stationary distribution.