• Fosca Giannotti ISTI-CNR, Knowledge Discovery and Data Mining Lab fosca [dot] giannotti [at] isti [dot] cnr [dot] it

• Dino Pedreschi Università di Pisa, Knowledge Discovery and Data Mining Lab pedre [at] di [dot] unipi [dot] it

• Assistente: Anna Monreale, Università di PIsa, Knowledge Discovery and Data Mining Lab annam [at] di [dot] unipi [dot] it

• Before Wednesday 13 May 2015: install KNIME (http://www.knime.org).
• Before Tuesday 19 June 2015: install Cytoscape (http://www.cytoscape.org/download.html).

Organizations and business are overwhelmed by the flood of data continuously collected into their data warehouses and arriving from external sources – the Web above all. Traditional exploratory techniques may fail to make sense of the data, due to its inherent complexity and size. Data mining and knowledge discovery techniques emerged as an alternative approach, aimed at revealing patterns, rules and models hidden in the data, and at supporting the analytical user to develop descriptive and predictive models for a number of business problems. This short course focusses on the main applications scenarios of data mining to challenging problems in the broad CRM domain - Customer Relationship Management.

• Clustering models for customer segmentation. Discussion of real cases. Hands-on project: segmentation of a base of anonymized customers from the retail industry. Clustering models for competitive intelligence.
• Patterns and association rule mining for market basket analysis. Hands-on project: mining association rules from sales data of the retail industry.
• Prediction models for promotion performance and churn analysis. Discussion of real cases. Hands-on project: churn prediction from a base of anonymized customers from the retail industry.
• Analysis of human mobility patterns by mobility data mining from big data. Mining official data for understanding of human behavior.
• Social network analysis for undestanding diffusion phenomena. Viral marketing.
• Application of data mining to geo-marketing. Analysis of innovators. Predictive models for fraud detection.

• Slides (see Calendar).

• Gordon S. Linoff e Michael J. Berry. Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management. Wiley, 2011.

• Pang-Ning Tan, Michael Steinbach, Vipin Kumar. Introduction to Data Mining. Addison Wesley, ISBN 0-321-32136-7, 2006
  • http://www-users.cs.umn.edu/~kumar/dmbook/index.php

• Data, data everywhere. The Economist, Feb. 2010 download
• Data scientist: The hot new gig in tech, CNN & Fortune, Sept. 2011 link
• Welcome to the yotta world. The Economist, Sept. 2011 download

slides: case studies | Giannotti |

slides data understanding | Pedreschi, Monreale |

0. Iris dataset. Iris

1. Shuttle dataset. Shuttle

1. Market Basket Analysis. Problem: given a database of transactions of customers of a supermarket, find the set of frequent items co-purchased and analyse the association rules that is possible to derive from the frequent patterns. Provide a short document (max three pages in pdf, excluding figures/plots) which illustrates the input dataset, the adopted frequent pattern algorithm and the association rule analysis.

Guidelines for the report: The report has to illustrate the input dataset, the adopted frequent pattern algorithm and the association rule analysis discussing your findings related to the most interesting rules by using the different measure introduced in the course.

2. Customer segmentation with k-means. Problem: given the dataset of RFM (Recency, Frequency and Monetary value) measurements of a set of customers of a supermarket, find a high-quality clustering using K-means and discuss the profile of each found cluster (in terms of the purchasing behavior of the customers of each cluster). Provide a short document (max three pages in pdf, excluding figures/plots) which illustrates the input dataset, the adopted clustering methodology and the cluster interpretation. Dataset legend: for each customer, the dataset contains the recency, frequency and monetary value variables (relative to all purchases, to purchases of fresh food articles, to canned food articles and no-food articles; the variables are present both with original and normalized values):

• Recency: no. of days since last purchase
• Frequency: no. of visits (shopping in the supermarket) in the observation period
• Monetary value: total amount spent in purchases during the observation period.

Guidelines for the report:

* Data Understanding: useful as a preliminary step to capture some data property that can help the clustering analysis (Distribution analysis, statistics computation, suitable transformation of variables and Elimination of redundant variables by correlation analysis);

* Clustering Analysis by K-means: Identification of the best value of k and Characterization of the obtained clusters by using both analysis of the k centroids and comparison of the statistics of variables within the clusters and that in the whole dataset.

3. Churn analysis with decision trees. Problem: given a dataset of measurements over a set of customers of an e-commenrce site, find a high-quality classifier, using decision trees, which predicts whether each customers will place only one or more orders to the shop. The explanation of the available variables is here. Provide a short document (max three pages in pdf, excluding figures/plots) which illustrates the input dataset, the adopted classification methodology and the decision tree validation and interpretation.

Guidelines for the report: The report has to illustrate the input dataset, the adopted classification methodology and the decision tree validation and interpretation. Describe the process adopted to select the proposed tree, together with its quality evaluation.

Deadline: the three documents must be sent email to all instructors within 15 July 2014. Specify [MAINS] in the subject of the email.

The exam of the CRM module consists in the evaluation of the reports of the proposed exercises.

* Data Mining for Customer Relationship Management 2014

* Data Mining for Customer Relationship Management 2013