To mitigate Electromagnetic Fields (EMF) human exposure from base stations, international standards bodies define EMF emission requirements that can be translated into limits on the "actual" Equivalent Isotropic Radiated Power (EIRP), i.e., averaged over a sliding time window. We aim to enable base stations to adhere to these constraints while mitigating any impact on user performance. Specifically, our objectives are to: i) ensure EMF exposure compliance using actual EIRP control when implementing the "actual maximum approach" described in IEC 62232:2022, ii) guarantee a minimum EIRP level, and iii) prevent resource shortages at all times. We first investigate exact and conservative algorithms, with linear and constant complexity, respectively, to compute the maximum allowed EIRP consumption under constraints i) and ii), referred to as EIRP "budget". Subsequently, we design a control method based on Drift-Plus-Penalty theory that preemptively curbs EIRP consumption only when needed to avoid future resource shortages.