The use of a reconfigurable intelligent surface (RIS) for aiding user-specific transmission has been widely explored. However, little attention has been devoted to utilizing RIS for assisting cell-specific transmission, where the RIS needs to reflect signals in a broad angular range. Furthermore, although modern communication systems operate in two polarizations, the majority of the works on RIS consider a uni-polarized surface, only reflecting the signals in one polarization. To fill these gaps, we study a downlink broadcasting scenario where a base station (BS) sends a cell-specific signal to all the users residing at unknown locations with the assistance of a dual-polarized RIS. We utilize the duality between the auto-correlation function and power spectrum in the space/spatial frequency domain to design configurations for broad-beam reflection. We first consider a free-space line-of-sight BS-RIS channel and show that the RIS configuration matrices must form a Golay complementary array pair for broad-beam radiation. We also present how to form Golay complementary array pairs based on known Golay complementary sequence pairs. We then consider an arbitrary BS-RIS channel and propose an algorithm based on stochastic optimization to find RIS configurations that produce a practically broad beam by relaxing the requirement on uniform broadness. Numerical simulations are finally conducted to corroborate the analyses and evaluate the performance.