Using probability theory we derive an expression for the sum of a series of definite integrals involving upper incomplete Gamma functions. In the proof, a normal variance mixture distribution with Beta mixing distributions plays a crucial role. We also give an interesting application of our result, namely, a new summation formula for some derivatives of the Bessel functions of the first kind and the Struve functions with respect to the order.