Intelligent duplicate check