Integrated Clustering and Anomaly Detection (INCAD) for Streaming Data

Guggilam, Sreelekha, Zaidi, Syed Mohammed Arshad, Chandola, Varun and Patra, Abani K. (2019) . In Proceedings of International Conference on Computational Science.


Most current clustering based anomaly detection methods use scoring schema and thresholds to classify anomalies. These methods are often tailored to target specific data sets with known number of clusters. The paper provides a streaming clustering and anomaly detection algorithm that does not require strict arbitrary thresholds on the anomaly scores or knowledge of the number of clusters while performing probabilistic anomaly detection and clustering simultaneously. This ensures that the cluster formation is not impacted by the presence of anomalous data, thereby leading to more reliable definition of ``normal vs abnormal’’ behavior. The motivations behind developing the INCAD model [17] and the path that leads to the streaming model are discussed.


 author="Guggilam, Sreelekha and Zaidi, Syed Mohammed Arshad and Chandola, Varun and Patra, Abani K.",
 booktitle="Proceedings of International Conference on Computational Science",