Future cellular systems will make use of millimeter wave (mmWave) frequency bands. Many users in these bands are located indoors, i.e., inside buildings, homes, and offices. Typical building material attenuations in these high frequency ranges are of interest for link budget calculations. In this paper, we report on a collaborative measurement campaign to find the attenuation of several typical building materials in three potential mmWave bands (28, 73, 91 GHz). Using directional antennas, we took multiple measurements at multiple locations using narrow-band and wide-band signals, and averaged out residual small-scale fading effects. Materials include clear glass, drywall (plasterboard), plywood, acoustic ceiling tile, and cinder blocks. Specific attenuations range from approximately 0.5 dB/cm for ceiling tile at 28 GHz to approximately 19 dB/cm for clear glass at 91 GHz.