DidaWiki

Questa pagina è in sola lettura. Puoi visualizzare il sorgente, ma non puoi modificarlo. Contatta l'amministratore se pensi che ci sia un errore.
====== Data Mining for Customer Relationship Management 2014 ======

  * **Fosca Giannotti** ISTI-CNR, Knowledge Discovery and Data Mining Lab [[fosca.giannotti@isti.cnr.it]]

  * **Dino Pedreschi** Università di Pisa, Knowledge Discovery and Data Mining Lab [[pedre@di.unipi.it]]

  * Assistente: **Anna Monreale**, Università di PIsa, Knowledge Discovery and Data Mining Lab [[annam@di.unipi.it]]

===== News =====

  * **Instruction for report delivery: send all reports by email (in pdf) to all three instructors (Dino, Fosca, Anna) within June 30, 2014. Specify [MAINS] in the subject of the email.**
  * **Before Wednesday 4 June 2013: install KNIME (http://www.knime.org).**
  * **Before Tuesday 10 June 2013: install Cytoscape (http://www.cytoscape.org/download.html).**
====== Goals ======

Organizations and business are overwhelmed by the flood of data continuously collected into their data warehouses and arriving from external sources – the Web above all. Traditional exploratory techniques may fail to make sense of the data, due to its inherent complexity and size. Data mining and knowledge discovery techniques emerged as an alternative approach, aimed at revealing patterns, rules and models hidden in the data, and at supporting the analytical user to develop descriptive and predictive models for a number of business problems. This short course focusses on the main applications scenarios of data mining to challenging problems in the broad CRM domain - Customer Relationship Management. 

====== Syllabus ====== 

  * Clustering models for customer segmentation. Discussion of real cases. Hands-on project: segmentation of a base of anonymized customers from the retail industry. Clustering models for competitive intelligence.
  * Patterns and association rule mining for market basket analysis. Hands-on project: mining association rules from sales data of the retail industry.
  * Prediction models for promotion performance and churn analysis. Discussion of real cases. Hands-on project: churn prediction from a base of anonymized customers from the retail industry.
  * Analysis of human mobility patterns by mobility data mining from big data. Mining official data for understanding of human behavior.
  * Social network analysis for undestanding diffusion phenomena. Viral marketing.
  * Application of data mining to geo-marketing. Analysis of innovators. Predictive models for fraud detection.


====== Textbooks ======

  * Slides (see Calendar).

  * Gordon S. Linoff e Michael J. Berry. //Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management.// Wiley, 2011.

  * Pang-Ning Tan, Michael Steinbach, Vipin Kumar. //Introduction to Data Mining//. Addison Wesley, ISBN 0-321-32136-7, 2006
    * [[http://www-users.cs.umn.edu/~kumar/dmbook/index.php]]



====== Reading about the "data analyst" job ======

  * Data, data everywhere. The Economist, Feb. 2010 {{:dm:economist--010.pdf|download}}
  * Data scientist: The hot new gig in tech, CNN & Fortune, Sept. 2011 [[http://tech.fortune.cnn.com/2011/09/06/data-scientist-the-hot-new-gig-in-tech/|link]]
  * Welcome to the yotta world. The Economist, Sept. 2011 {{:dm:economist-2012-dm.pdf|download}}
====== Calendar ======

^ ^ Date ^ Topic ^ Learning material ^ 
|0.   | 11.04.2014 - 09:00-18:00  | Introduction to data mining and big data analytics | {{:dm:introductiondm.pdf|intro dm slides}} |
|1.   | 03.06.2014 - 09:00-18:00  | Pattern and association rule mining & market basket analysis + Exercises | {{:dm:associationrules.pdf|pattern mining slides}} |
|2.   | 04.06.2014 - 09:00-18:00  | Clustering analysis & customer segmentation + Exercises | {{:dm:dm.pedreschi.clustering.pdf|clustering slides}} {{:dm:12.mains_crm_customersegmentation-airmiles.pdf|air miles slides}} {{:dm:11-mains_competitor_analysis_loreal_.pdf|l'oreal slides}} | 
|3.   | 05.06.2014 - 09:00-18:00  | Prediction models for promotion performance and churn analysis + Exercises | {{:dm:dm.giannotti.pedreschi.classification.pdf|classification slides}} {{:dm:1.mains_crm_churn_intro.ppt.pdf|slides}}  {{:dm:2.mains_crm_churn_coop.ppt.pdf|slides}} {{:dm:4.mains_crm_promozionipromorank.pdf|slides}}   {{:dm:4.mains_crm_promozioni.ppt.pdf|slides}} |
|4.   | 09.06.2014 - 09:00-18:00  | Mobility data mining & analysis of human movement behavior. Fraud detection | {{:dm:vldbj_kddlab_matlas.pdf|paper}} {{:dm:kddlab_ki2011.pdf|paper}} |
|5.   | 10.06.2014 - 09:00-18:00  | Social network analysis: fundamentals. Network metrics. Small world. Strength of weak ties. Centrality. Preferential attachment. + Exercises| {{:dm:snacrashcourse.pdf|slides}}   [[http://didawiki.cli.di.unipi.it/doku.php/dm/sna.imt.2011|link]] |
|6.   | 11.06.2014 - 09:00-18:00  | Models of social contagion, spreading, diffusion and epidemics, with applications to viral marketing. Analysis of innovators/early adopters. + Privacy & Data Mining | {{:dm:07-cascading_leskovec_.pdf|slides}} {{:dm:08-cascades_leskovec_.pdf|slides}} {{:dm:09-contagion.pdf|slides}}  {{:dm:privacy_lezione14-16.ppt.pdf|slides}} | 
|7.   |   | Tutorial on Knime | {{:dm:knime_slides_2014.pdf| KNIME slides}} Workflows: {{:dm:data-manipulation.zip|Data Manipulation}}; {{:dm:clustering.zip| Clustering}} {{:dm:itemsets.zip|FP and AR}}; {{:dm:002001_decisiontree.zip|Decision Trees}}| 
===== Datasets =====


0. Iris dataset. {{:dm:data.txt.zip|Iris}} 

1. Shuttle dataset.{{:dm:shuttle.data.zip| Shuttle }}


===== Exercises =====

**1. Market Basket Analysis. ** Problem: given a database of transactions of customers of a supermarket, find the set of frequent items co-purchased and analyse the association rules that is possible to derive from the frequent patterns.  Provide a short document (max three pages in pdf, excluding figures/plots) which illustrates the input dataset, the adopted frequent pattern algorithm and the association rule analysis. 

**Guidelines for the report:** The report has to illustrate the input dataset, the adopted frequent pattern algorithm and the association rule analysis discussing your findings related to the most interesting rules by using the different measure introduced in the course.

**2. Customer segmentation with k-means.** Problem: given the dataset of RFM (Recency, Frequency and Monetary value) measurements of a set of customers of a supermarket, find a high-quality clustering using K-means and discuss the profile of each found cluster (in terms of the purchasing behavior of the customers of each cluster). Provide a short document (max three pages in pdf, excluding figures/plots) which illustrates the input dataset, the adopted clustering methodology and the cluster interpretation. Dataset legend: for each customer, the dataset contains the recency, frequency and monetary value variables (relative to all purchases, to purchases of fresh food articles, to canned food articles and no-food articles; the variables are present both with original and normalized values): 
  * Recency: no. of days since last purchase
  * Frequency: no. of visits (shopping in the supermarket) in the observation period
  * Monetary value: total amount spent in purchases during the observation period.

**Guidelines for the report:**

 * **Data Understanding**: useful as a preliminary step to capture some data property that can help the clustering analysis (Distribution analysis, statistics computation, suitable transformation of variables and Elimination of redundant variables by correlation analysis);

 * **Clustering Analysis by K-means**: Identification of the best value of k and Characterization of the obtained clusters by using both analysis of the k centroids and comparison of the statistics of variables within the clusters and that in the whole dataset.


**3. Churn analysis with decision trees. ** Problem: given a dataset of measurements over a set of customers of an e-commenrce site, find a high-quality classifier, using decision trees, which predicts whether each customers will place only one or more orders to the shop. The explanation of the available variables is {{:dm:churnanalysislegenda.pdf|here}}. Provide a short document (max three pages in pdf, excluding figures/plots) which illustrates the input dataset, the adopted classification methodology and the decision tree validation and interpretation.

**Guidelines for the report:** The report has to illustrate the input dataset, the adopted classification methodology and the decision tree validation and interpretation. Describe the process adopted to select the proposed tree, together with its quality evaluation.



**Deadline**: the three documents must be sent email to all instructors within **15 July 2014**. Specify [MAINS] in the subject of the email. 
====== Exams ======

The exam of the CRM module consists in the evaluation of the reports of the proposed exercises.


====== Previous editions ======

 * [[MAINS.SANTANNA.DM4CRM.2013]]