This paper shows that a finite discrete convolution involving Stirling numbers of both kinds and harmonic numbers can be expressed in terms of the Bernoulli numbers. As applications of this expression, the linear recurrence relation for the Bernoulli numbers given by Agoh is reproved, and a new recurrence relation for the Bernoulli numbers is obtained. Furthermore, it is shown that a cumulative sum of the Bernoulli numbers can be written in terms of the Bernoulli and di-Bernoulli numbers. Finally, congruences for the sums of the Bernoulli and Euler numbers are established.