Web scraping based online consumer price index: The "iPC Online" case

Abstract

We describe a case of web scraping data-based price indices implemented in a mid-size city in a moderate inflationary country. Full consumer price (CPI) and construction cost (CCI) indices were implemented for an entire city obtaining efficient results compared to statistics using traditional data collection methods. We state that web scraping combined with big data techniques will allow estimating more individualized and efficient metrics comparable in quality to official statistics. Web scraping technologies empower civil society and small research groups alike by allowing them gather and interpret socioeconomic data. It also helps to create new dimensions of analysis by allowing changes in frequency and focus on specific groups of products and services.