With a small suitable modification, dropping the projectivity condition, we extend the notion of a Frobenius algebra to grant that a Frobenius algebra over a Frobenius commutative ring is itself a Frobenius ring. The modification introduced here also allows Frobenius finite rings to be precisely those rings which are Frobenius finite algebras over their characteristic subrings. From the perspective of linear codes, our work expands one's options to construct new finite Frobenius rings from old ones. We close with a discussion of generalized versions of the MacWilliams identities that may be obtained in this context.