Let $G_1, \dots, G_k$ be vector spaces over a finite field $\mathbb{F} = \mathbb{F}_q$ with a non-trivial additive character $χ$. The analytic rank of a multilinear form $α\colon G_1 \times \dots \times G_k \to \mathbb{F}$ is defined as $\operatorname{arank}(α) = -\log_q \mathbb{E}_{x_1 \in G_1, \dots, x_k\in G_k} χ\big(α(x_1,\dots, x_k)\big)$. The partition rank $\operatorname{prank}(α)$ of $α$ is the smallest number of maps of partition rank 1 that add up to $α$, where a map is of partition rank 1 if it can be written as a product of two multilinear forms, depending on different coordinates. It is easy to see that $\operatorname{arank}(α) \leq O\Big(\operatorname{prank}(α)\Big)$ and it has been known that $\operatorname{prank}(α)$ can be bounded from above in terms of $\operatorname{arank}(α)$. In this paper, we improve the latter bound to polynomial, i.e. we show that there are quantities $C, D$ depending on $k$ only such that $\operatorname{prank}(α) \leq C (\operatorname{arank}(α)^D + 1)$. As a consequence, we prove a conjecture of Kazhdan and Ziegler. The same result was obtained independently and simultaneously by Janzer.