Sequential pattern mining is the method that has received much attention in sequence data mining research and applications, however, a drawback is that it does not profit from prior knowledge of domains. In our previous work, we proposed a belief-driven method with fuzzy set theory for discovering the unexpected sequences that contradict existing knowledge of data, including occurrence constraints and semantic contradictions. In this paper, we present a new approach that discovers unexpected sequences with determining semantic contradictions by using concept hierarchies associated with the data. We evaluate the effectiveness of our approach with experiments on Web usage analysis.