Controversy refers to content attracting different point-of-views, as well as positive and negative feedback on a specific event, gathering users into different communities. Research on controversy led to two main categories of works: controversy detection/quantification and controversy explainability. When the former aims to quantify controversy on a topic, the latter aims to understand why a topic is controversial or not. This paper mainly contributes to the controversy explainability. We analyze topic discussions on Twitter from the community perspective to investigate the power of text in classifying tweets into the right community. We propose a SHAP-based pipeline to quantify impactful text features on predictions of three tweet classifiers. We also rely on the use of different text features namely BERT, TF − IDF, and LIWC. The results we obtain from both SHAP plots and statistical analysis show clearly significant impacts of some text features in classifying tweets.It also highlights the relevance of the study as well as the potential benefits of combining text and user interactions to quantify controversy.