This paper aims to provide a review of the conceptual design and theoretical framework of the main control schemes proposed in the literature for unmanned underwater vehicles (UUVs). Additionally, the objective of the paper is not only to present an overview of the recent control architectures validated on UUVs but also to give detailed experimental-based comparative studies of the proposed control schemes. To this end, the main control schemes, including proportional-integral-derivative (PID) based, sliding mode control (SMC) based, adaptive based, observation-based, model predictive control (MPC) based, combined control techniques, are revisited in order to consolidate the principal efforts made in the last two decades by the automatic control community in the field. Besides implementing some key tracking control schemes from the classification mentioned above on Leonard UUV, several real-time experimental scenarios are tested, under different operating conditions, to evaluate and compare the efficiency of the selected tracking control schemes. Furthermore, we point out potential investigation gaps and future research trends at the end of this survey.