Detecção de anomalias em dados meteorológicos do sertão de Pernambuco utilizando Isolation Forest e DBSCAN

Abstract

Anomalous values are one of the problems present in the Big Data age. Robust techniques are required to manipulate correct and incorrect information that is generated at each time. Using non-supervised machine learning algorithms gives the confidence of good performance in the final results. This research will use meteorological data on air temperature and relative humidity from the Instituto Nacional de Meteorologia, of Petrolina, with DBSCAN (Density Based Spatial Clustering of Application with Noise) and IF (Isolation Forest) implemented to detect anomalies present in the data, since weathering meteorological anomalies may appear through defects, bad sensor configuration and even extreme climate effects.