Fully Homomorphic Encryption (FHE) gives the ability to evaluate any function over encrypted data. However, despite numerous improvements during the last decade, the computational overhead caused by homomorphic computations is still very important. As a consequence, optimizing the way of performing the computations homomorphically remains fundamental. Several popular FHE schemes such as BGV and BFV encode their data, and thus perform their computations, in finite fields. In this work, we study and exploit algebraic relations occurring in prime characteristic allowing to speed-up the homomorphic evaluation of several functions over prime fields. More specifically we give several examples of unary functions: “modulo”, “is power of b”, “Hamming weight” and “Mod2” whose homomorphic evaluation complexity over Fp can be reduced from the generic bound (2p)^(1/2) + O(log(p)) homomorphic multiplications, to (p)^(1/2) + O(log(p)), O(log(p)), O((p/ log(p))^(1/2) ) and O((p/ log(p))^(1/2) ) respectively. Additionally we provide a proof of a recent claim regarding the structure of the polynomial interpolation of the “less-than” bivariate function which confirms that this function can be evaluated in 2p − 6 homomorphic multiplications instead of 3p − 5 over Fp for p >= 5.