In recent years, many useful applications of the polynomial method have emerged in finite geometry. Indeed, algebraic curves, especially those defined by Rédei-type polynomials, are powerful in studying blocking sets. In this paper, we reverse the engine and study when blocking sets can arise from rational points on plane curves over finite fields. We show that irreducible curves of low degree cannot provide blocking sets and prove more refined results for cubic and quartic curves. On the other hand, using tools from number theory, we construct smooth plane curves defined over $\mathbb{F}_p$ of degree at most $4p^{3/4}+1$ whose points form blocking sets.