Online data collection
Online data are a huge resources for research as well as in practice. Although it is often tempting to “scrape everything” using technologies like web-crawling, it is extremely important to keep the goal of the analysis in mind. Are you trying to build a predictive model? A descriptive model? How will the model be used? Deployed to new records? etc. Dean Tau from Co-soft recently posted an interesting and useful comment in the Linked-in group Data Mining, Statistics, and Data Visualization. With his permission, I am reproducing his post: What you need to do before online data collection? Data colllection … Continue reading Online data collection