The $q^k$ (full) factorial design with replication $λ$ is the multi-set consisting of $λ$ occurrences of each element of each $q$-ary vector of length $k$; we denote this by $λ\times [q]^k$. An $m\times n$ row-column factorial design $q^k$ of strength $t$ is an arrangement of the elements of $λ\times [q]^k$ into an $m\times n$ array (which we say is of type $I_k(m,n,q,t)$) such that for each row (column), the set of vectors therein are the rows of an orthogonal array of degree $k$, size $n$ (respectively, $m$), $q$ levels and strength $t$. Such arrays are used in experimental design. In this context, for a row-column factorial design of strength $t$, all subsets of interactions of size at most $t$ can be estimated without confounding by the row and column blocking factors. In this manuscript, we study row-column factorial designs with strength $t\geq 2$. Our results for strength $t=2$ are as follows. For any prime power $q$ and assuming $2\leq M\leq N$, we show that there exists an array of type $I_k(q^M,q^N,q,2)$ if and only if $k\leq M+N$, $k\leq (q^M-1)/(q-1)$ and $(k,M,q)\neq (3,2,2)$. We find necessary and sufficient conditions for the existence of $I_{k}(4m,n,2,2)$ for small parameters. We also show that $I_{k+α}(2^αb,2^k,2,2)$ exists whenever $α\geq 2$ and $2^α+α+1\leq k<2^αb-α$, assuming there exists a Hadamard matrix of order $4b$. For $t=3$ we focus on the binary case. Assuming $M\leq N$, there exists an array of type $I_k(2^M,2^N,2,3)$ if and only if $M\geq 5$, $k\leq M+N$ and $k\leq 2^{M-1}$. Most of our constructions use linear algebra, often in application to existing orthogonal arrays and Hadamard matrices.