Site-specific wireless channel simulations via ray tracers can be used to effectively study wireless, decreasing the need for extensive site-specific radio propagation measurements. To ensure that ray tracer simulations faithfully reproduce wireless channels, calibration of simulation results against real-world measurements is required. In this study we introduce NYURay, a 3D ray tracer specifically tailored for mmWave and sub-THz frequencies. To reliably generate site-specific wireless channel parameters, NYURay is calibrated using radio propagation measurements conducted at 28, 73, and 142 GHz in diverse scenarios such as outdoor areas, indoor offices, and factories. Traditional ray tracing calibration assumes angle-dependent reflection, requiring slow iterative optimization techniques with no closed form solution. We propose a simpler and quicker novel calibration method that assumes angle-independent reflection. The effectiveness of the proposed calibration approach is demonstrated using NYURay. When comparing the directional multipath power predicted by NYURay to the actual measured power, the standard deviation in error was less than 3 dB in indoor office environments and less than 2 dB in outdoor and factory environments. The root mean square (RMS) delay spread and angular spread was underpredicted by NYURay due to incomplete environmental maps available for calibration, however an overall agreement between the measured and simulated values was observed. These results highlight the high level of accuracy NYURay provides in generating the site-specific real-world wireless channel, that could be used to generate synthetic data for machine learning.