Apéry's remarkable discovery of rapidly converging continued fractions with small coefficients for $ζ(2)$ and $ζ(3)$ has led to a flurry of important activity in an incredible variety of different directions. Our purpose is to show that modifications of Apéry's continued fractions can give interesting results including new rapidly convergent continued fractions for certain interesting constants.