Baxter numbers are known as the enumeration of Baxter permutations and numerous other discrete structures, playing a significant role across combinatorics, algebra, and analysis. In this paper, we focus on the analytic properties related to Baxter numbers. We prove that the descent polynomials of Baxter permutations have interlacing zeros, which is a property stronger than real-rootedness. Our approach is based on Dilks' framework of $(q,t)$-Hoggatt sums, which is a $q$-analog for Baxter permutations. Within this framework, we show that the family of $(1,t)$-Hoggatt sums satisfies the interlacing property using fundamental results on Hadamard products of polynomials. For Baxter numbers, we prove their asymptotic $r$-log-convexity via asymptotic expansions of $P$-recursive sequences. In particular, we confirm their $2$-log-convexity using symbolic computation techniques.