Exception handling and replication are two mechanisms that increase the reliability of applications. Exception handling helps programmers to control situations in which the normal flow of a program execution cannot continue. Replication handles system failures. Exceptions handling and replication do not apply to the same situations and are two complementary mechanisms to increase the reliability of applications. Moreover, each technique can benefit from the other: exception handling capabilities can rely on replication mechanisms while replication can be further secured by using exceptions. The paper proposes a specification of an execution history oriented exception handling system for an agent language and middleware providing replication. The paper proposes an original signaling algorithms taking into account replicated agents and a rationale of how exception handling and replication mechanisms can combine to increase the capability of programmers to achieve reliable agent-based applications.