| Prossima revisione | Revisione precedente |
| mds:lbi:lds_2019-2020 [09/09/2020 alle 15:28 (5 anni fa)] – creata Anna Monreale | mds:lbi:lds_2019-2020 [04/11/2022 alle 12:17 (2 anni fa)] (versione attuale) – Salvatore Ruggieri |
|---|
| <html> | |
| <!-- Google Analytics --> | |
| <script type="text/javascript" charset="utf-8"> | |
| (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ | |
| (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), | |
| m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) | |
| })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); | |
| |
| ga('create', 'UA-34685760-1', 'auto', 'personalTracker', {'allowLinker': true}); | |
| ga('personalTracker.require', 'linker'); | |
| ga('personalTracker.linker:autoLink', ['pages.di.unipi.it', 'enforce.di.unipi.it', 'didawiki.di.unipi.it'] ); | |
| | |
| ga('personalTracker.require', 'displayfeatures'); | |
| ga('personalTracker.send', 'pageview', 'ruggieri/teaching/lbi/'); | |
| setTimeout("ga('send','event','adjusted bounce rate','30 seconds')",30000); | |
| </script> | |
| <!-- End Google Analytics --> | |
| <!-- Capture clicks --> | |
| <script> | |
| jQuery(document).ready(function(){ | |
| jQuery('a[href$=".pdf"]').click(function() { | |
| var fname = this.href.split('/').pop(); | |
| ga('personalTracker.send', 'event', 'PDS', 'PDFs', fname); | |
| }); | |
| jQuery('a[href$=".r"]').click(function() { | |
| var fname = this.href.split('/').pop(); | |
| ga('personalTracker.send', 'event', 'LBI', 'Rs', fname); | |
| }); | |
| jQuery('a[href$=".zip"]').click(function() { | |
| var fname = this.href.split('/').pop(); | |
| ga('personalTracker.send', 'event', 'LBI', 'ZIPs', fname); | |
| }); | |
| jQuery('a[href$=".mp4"]').click(function() { | |
| var fname = this.href.split('/').pop(); | |
| ga('personalTracker.send', 'event', 'LBI', 'Videos', fname); | |
| }); | |
| jQuery('a[href$=".flv"]').click(function() { | |
| var fname = this.href.split('/').pop(); | |
| ga('personalTracker.send', 'event', 'LBI', 'Videos', fname); | |
| }); | |
| }); | |
| </script> | |
| </html> | |
| ====== LABORATORY OF DATA SCIENCE (2019/2020) ====== | ====== LABORATORY OF DATA SCIENCE (2019/2020) ====== |
| |
| | | 17.09 11:00-13:00 | Canceled - The lesson will be recovered. | | | | | | | 17.09 11:00-13:00 | Canceled - The lesson will be recovered. | | | | |
| | | 19.09 11:00-13:00 | Canceled - The lesson will be recovered. | | | | | | | 19.09 11:00-13:00 | Canceled - The lesson will be recovered. | | | | |
| |1. | 24.09 11:00-13:00 | Introduction. File data access. Representation formats: CSV, FLV, ARFF, XML|{{ :mds:lbi:2019-lds.01.introduction.pdf |}} {{:mds:lbi:2019-lds.02.bi_architectures.pdf |}} {{:mds:lbi:lds.03.file_data_access.pdf |}}| [[http://apa.di.unipi.it/apa/video/2019-Video/2019-Introduction.flv|Video on Introduction]] [[http://apa.di.unipi.it/apa/video/2019-Video/2019-FileAccess.flv|Video on File Access]] | | -** BI technology:** [[https://cacm.acm.org/magazines/2011/8/114953-an-overview-of-business-intelligence-technology/fulltext | An Overview of Business Intelligence Technology]] - **File access:** {{ :mds:lbi:filesystem.pdf | File System Interface}} - **File Formats:** [[http://www.stat.auckland.ac.nz/~paul/ItDT | Introduction to data technologies(Chps. 5, 6)]], [[http://weka.wikispaces.com/ARFF+(stable+version)|Weka ARFF Format]], [[http://weka.wikispaces.com/XRFF|XRFF Format]] | | |1. | 24.09 11:00-13:00 | Introduction. File data access. Representation formats: CSV, FLV, ARFF, XML|{{ :mds:lbi:2019-lds.01.introduction.pdf |}} {{:mds:lbi:2019-lds.02.bi_architectures.pdf |}} {{:mds:lbi:lds.03.file_data_access.pdf |}}| [[http://lds.di.unipi.it/apa/video/2019-Video/2019-Introduction.flv|Video on Introduction]] [[http://lds.di.unipi.it/apa/video/2019-Video/2019-FileAccess.flv|Video on File Access]] | | -** BI technology:** [[https://cacm.acm.org/magazines/2011/8/114953-an-overview-of-business-intelligence-technology/fulltext | An Overview of Business Intelligence Technology]] - **File access:** {{ :mds:lbi:filesystem.pdf | File System Interface}} - **File Formats:** [[http://www.stat.auckland.ac.nz/~paul/ItDT | Introduction to data technologies(Chps. 5, 6)]], [[http://weka.wikispaces.com/ARFF+(stable+version)|Weka ARFF Format]], [[http://weka.wikispaces.com/XRFF|XRFF Format]] | |
| |2. | 26.09 11:00-13:00 | Python Recap | {{ :mds:lbi:lds.04.python.pdf | Python Recap}} | [[http://apa.di.unipi.it/apa/video/2019-Video/2019-PythonRecap.flv|Video 26/09/2019]] | | | | |2. | 26.09 11:00-13:00 | Python Recap | {{ :mds:lbi:lds.04.python.pdf | Python Recap}} | [[http://lds.di.unipi.it/apa/video/2019-Video/2019-PythonRecap.flv|Video 26/09/2019]] | | | |
| |3. | 01.10 11:00-13:00 | File data access in Python. Lab practice on file access. | {{ :mds:lbi:lds.05.fileaccess-python.pdf |}} | [[http://apa.di.unipi.it/apa/video/2018-Video/2018-10-01.flv|Video File Access - Python]] | {{ :mds:lbi:data.zip | Sample data}} {{ :mds:lbi:code-2019-09-26.zip |}}| | |3. | 01.10 11:00-13:00 | File data access in Python. Lab practice on file access. | {{ :mds:lbi:lds.05.fileaccess-python.pdf |}} | [[http://lds.di.unipi.it/apa/video/2018-Video/2018-10-01.flv|Video File Access - Python]] | {{ :mds:lbi:data.zip | Sample data}} {{ :mds:lbi:code-2019-09-26.zip |}}| |
| |4. | 03.10 11:00-13:00 |Lab practice on file access and transformation from CSV2ARFF file format. | | [[http://apa.di.unipi.it/apa/video/2018-Video/2018-10-02.flv|Video CSV2ARFF ]] | {{ :mds:lbi:code-2019-10-1.zip |}}| | | |4. | 03.10 11:00-13:00 |Lab practice on file access and transformation from CSV2ARFF file format. | | [[http://lds.di.unipi.it/apa/video/2018-Video/2018-10-02.flv|Video CSV2ARFF ]] | {{ :mds:lbi:code-2019-10-1.zip |}}| | |
| |5. | 08.10 11:00-13:00 | Lab practice on file access. | |[[http://apa.di.unipi.it/apa/video/2018-Video/2018-10-08.flv|Video]] | {{ :mds:lbi:ex-customers.pdf |}} {{ :mds:lbi:data-customers.zip |}} {{ :mds:lbi:lds.file.format.zip |}}| | | |5. | 08.10 11:00-13:00 | Lab practice on file access. | |[[http://lds.di.unipi.it/apa/video/2018-Video/2018-10-08.flv|Video]] | {{ :mds:lbi:ex-customers.pdf |}} {{ :mds:lbi:data-customers.zip |}} {{ :mds:lbi:lds.file.format.zip |}}| | |
| |6. | 10.10 11:00-13:00 | Practice + RDBMS access protocols: ODBC, OLE DB, JDBC. ODBC Programming. | {{ :mds:lbi:lbi.06.relationaldataaccess-1.pdf |}} |[[http://apa.di.unipi.it/apa/video/2018-Video/2018-10-09.flv|Video on RDBMS access - Part1]] |{{ :mds:lbi:2018-10-09-ex.zip | SolutionEx: 2018-10-09}} | | | |6. | 10.10 11:00-13:00 | Practice + RDBMS access protocols: ODBC, OLE DB, JDBC. ODBC Programming. | {{ :mds:lbi:lbi.06.relationaldataaccess-1.pdf |}} |[[http://lds.di.unipi.it/apa/video/2018-Video/2018-10-09.flv|Video on RDBMS access - Part1]] |{{ :mds:lbi:2018-10-09-ex.zip | SolutionEx: 2018-10-09}} | | |
| |7. | 15.10 11:00-13:00 | Lab practice: stratified sampling in ODBC. | {{ :mds:lbi:lbi.06.relational_data_access-complete.pdf |}} |[[http://apa.di.unipi.it/apa/video/2018-Video/2018-10-15.flv|Video on RDBMS access - Part2]] | {{ :mds:lbi:code-db-samples.zip |}}| | | |7. | 15.10 11:00-13:00 | Lab practice: stratified sampling in ODBC. | {{ :mds:lbi:lbi.06.relational_data_access-complete.pdf |}} |[[http://lds.di.unipi.it/apa/video/2018-Video/2018-10-15.flv|Video on RDBMS access - Part2]] | {{ :mds:lbi:code-db-samples.zip |}}| | |
| |8. | 17.10 11:00-13:00 | Introduction to SQL Server. ETL tools: SQL Server Integration Services (SSIS). | {{ :mds:lbi:lds.07.sqlserver.pdf |}} {{ :mds:lbi:lds.08.etlandssis.pdf |}}|[[http://apa.di.unipi.it/apa/video/2018-Video/2018-10-16.flv|Video on Sol. Stratified Sampling and ETL tools]] | {{ :mds:lbi:stratifiedsampling.zip |}}| | | |8. | 17.10 11:00-13:00 | Introduction to SQL Server. ETL tools: SQL Server Integration Services (SSIS). | {{ :mds:lbi:lds.07.sqlserver.pdf |}} {{ :mds:lbi:lds.08.etlandssis.pdf |}}|[[http://lds.di.unipi.it/apa/video/2018-Video/2018-10-16.flv|Video on Sol. Stratified Sampling and ETL tools]] | {{ :mds:lbi:stratifiedsampling.zip |}}| | |
| |9. | 22.10 11:00-13:00 | SSIS samples and lab practice pipeline. | | [[http://apa.di.unipi.it/apa/video/2018-Video/2018-10-19.flv|Video on SISS]]| {{ :mds:lbi:lds-ssis-samples.zip |}} {{ :mds:lbi:ex-midterm.pdf |}}| | |9. | 22.10 11:00-13:00 | SSIS samples and lab practice pipeline. | | [[http://lds.di.unipi.it/apa/video/2018-Video/2018-10-19.flv|Video on SISS]]| {{ :mds:lbi:lds-ssis-samples.zip |}} {{ :mds:lbi:ex-midterm.pdf |}}| |
| |10. | 24.10 11:00-13:00 | SSIS Dissimilarity - Mid-term practice| | | {{ :mds:lbi:dissimilarity.zip |Dissimilarity.py}} {{ :mds:lbi:mdp.zip | MDP.py exam 14/4/2015 }} {{ :mds:lbi:siss-mdp.zip |}} {{ :mds:lbi:ssis-dissimilarityindex.zip |}} | | |10. | 24.10 11:00-13:00 | SSIS Dissimilarity - Mid-term practice| | | {{ :mds:lbi:dissimilarity.zip |Dissimilarity.py}} {{ :mds:lbi:mdp.zip | MDP.py exam 14/4/2015 }} {{ :mds:lbi:siss-mdp.zip |}} {{ :mds:lbi:ssis-dissimilarityindex.zip |}} | |
| |11. | 29.10 11:00-13:00 | Stratified Sampling + Update| | | {{ :mds:lbi:stratifiedsampling.zip |}} Exercises: {{ :mds:lbi:20190618.pdf |}} {{ :mds:lbi:20190401.pdf |}} | | |11. | 29.10 11:00-13:00 | Stratified Sampling + Update| | | {{ :mds:lbi:stratifiedsampling.zip |}} Exercises: {{ :mds:lbi:20190618.pdf |}} {{ :mds:lbi:20190401.pdf |}} | |
| |12. | 31.10 11:00-13:00 | Practice for Midterm {{ :mds:lbi:20190206.pdf |}}| | | {{ :mds:lbi:progettohealty_food.zip |}} {{ :mds:lbi:lbi06022019.py.zip |}} | | |12. | 31.10 11:00-13:00 | Practice for Midterm {{ :mds:lbi:20190206.pdf |}}| | | {{ :mds:lbi:progettohealty_food.zip |}} {{ :mds:lbi:lbi06022019.py.zip |}} | |
| |13. | 04.11 11:00-13:00 | Practice for Midterm | | | {{ :mds:lbi:exercises-siss.zip |}} {{ :mds:lbi:esercizio4112019.zip | Ex. Python}} | | |13. | 04.11 11:00-13:00 | Practice for Midterm | | | {{ :mds:lbi:exercises-siss.zip |}} {{ :mds:lbi:esercizio4112019.zip | Ex. Python}} | |
| |14. | 12.11 11:00-13:00 | SSIS: surrogate keys, slowly changing dimensions| | [[http://apa.di.unipi.it/apa/video/2019-Video/2019-11-12.flv|Video 2019-11-12]] | {{ :mds:lbi:2016ssis.zip |}} | | |14. | 12.11 11:00-13:00 | SSIS: surrogate keys, slowly changing dimensions| | [[http://lds.di.unipi.it/apa/video/2019-Video/2019-11-12.flv|Video 2019-11-12]] | {{ :mds:lbi:2016ssis.zip |}} | |
| |15. | 14.11 11:00-13:00 | Datawarehousing and OLAP recap. Data cubes, analytic SQL, and materialized views in SQL Server. |{{ :mds:lbi:lds.09.dwandolap.pdf |}} | [[http://apa.di.unipi.it/apa/video/2019-Video/2019-11-14.flv|Video 2019-11-14]] | {{ :mds:lbi:lbi.08.afdemo.sql.zip |}} | | |15. | 14.11 11:00-13:00 | Datawarehousing and OLAP recap. Data cubes, analytic SQL, and materialized views in SQL Server. |{{ :mds:lbi:lds.09.dwandolap.pdf |}} | [[http://lds.di.unipi.it/apa/video/2019-Video/2019-11-14.flv|Video 2019-11-14]] | {{ :mds:lbi:lbi.08.afdemo.sql.zip |}} | |
| | |10.11 11:00-13:00 | Cancelled | | | | | | | |10.11 11:00-13:00 | Cancelled | | | | | |
| |16. | 21.11 11:00-13:00 |OLAP with SQL Server Analysis Services (SSAS): data source views, dimensions, hierarchies. Data cubes.| {{ :mds:lbi:lds.10.ssas.pdf |}} | [[http://apa.di.unipi.it/apa/video/2019-Video/2019-11-21-1.flv|First Video 21/11/2019]] [[http://apa.di.unipi.it/apa/video/2019-Video/2019-11-21.flv|Second Video 21/11/2019]] | {{ :mds:lbi:monreale_foodmart.zip |}} **Notice:** Please read the instructions in the Section NEWS! | **1) SSAS (olap):** [[http://msdn.microsoft.com/en-us/library/bb522607.aspx|documentation]]; 2) S. Harinath et al. {{ :mds:lbi:ssas2012ch456.pdf |Professional Microsoft SQL Server Analysis Services 2012 with MDX and DAX, Wrox publisher, 2012. Chps. 4-6}}. | | |16. | 21.11 11:00-13:00 |OLAP with SQL Server Analysis Services (SSAS): data source views, dimensions, hierarchies. Data cubes.| {{ :mds:lbi:lds.10.ssas.pdf |}} | [[http://lds.di.unipi.it/apa/video/2019-Video/2019-11-21-1.flv|First Video 21/11/2019]] [[http://lds.di.unipi.it/apa/video/2019-Video/2019-11-21.flv|Second Video 21/11/2019]] | {{ :mds:lbi:monreale_foodmart.zip |}} **Notice:** Please read the instructions in the Section NEWS! | **1) SSAS (olap):** [[http://msdn.microsoft.com/en-us/library/bb522607.aspx|documentation]]; 2) S. Harinath et al. {{ :mds:lbi:ssas2012ch456.pdf |Professional Microsoft SQL Server Analysis Services 2012 with MDX and DAX, Wrox publisher, 2012. Chps. 4-6}}. | |
| |17.|26.11 11:00-13:00 |Parent-child hierarchies. OLAP explorative data analysis with Pivot Tables in Excel. | | [[http://apa.di.unipi.it/apa/video/2019-Video/2019-11-26-1.flv|Video 26/11/2019]] | | **Pivot Tables in Excel:** G. Harvey. {{ :mds:lbi:pivottable2013bookviichpt2.pdf |Excel 2013 All-in-One For Dummies, 2013. Chp. VII-2}}. | | |17.|26.11 11:00-13:00 |Parent-child hierarchies. OLAP explorative data analysis with Pivot Tables in Excel. | | [[http://lds.di.unipi.it/apa/video/2019-Video/2019-11-26-1.flv|Video 26/11/2019]] | | **Pivot Tables in Excel:** G. Harvey. {{ :mds:lbi:pivottable2013bookviichpt2.pdf |Excel 2013 All-in-One For Dummies, 2013. Chp. VII-2}}. | |
| |18.|28.11 11:00-13:00 |ROLAP and MOLAP in SSAS. MDX. | | [[http://apa.di.unipi.it/apa/video/2019-Video/2019-11-28.flv|Video 28/11/2019]] | | **MDX:** 1) [[http://msdn.microsoft.com/en-us/library/bb500184.aspx|documentation]] and a [[https://www.mssqltips.com/sqlservertip/3129/order-and-sort-with-mdx-in-sql-server-analysis-services/|useful guide on ordering]]; 2) S. Harinath ed al. {{ :mds:lbi:ssas2012ch3.pdf |Professional Microsoft SQL Server Analysis Services 2012 with MDX and DAX, Wrox publisher, 2012. Chp. 3.}} | | |18.|28.11 11:00-13:00 |ROLAP and MOLAP in SSAS. MDX. | | [[http://lds.di.unipi.it/apa/video/2019-Video/2019-11-28.flv|Video 28/11/2019]] | | **MDX:** 1) [[http://msdn.microsoft.com/en-us/library/bb500184.aspx|documentation]] and a [[https://www.mssqltips.com/sqlservertip/3129/order-and-sort-with-mdx-in-sql-server-analysis-services/|useful guide on ordering]]; 2) S. Harinath ed al. {{ :mds:lbi:ssas2012ch3.pdf |Professional Microsoft SQL Server Analysis Services 2012 with MDX and DAX, Wrox publisher, 2012. Chp. 3.}} | |
| |19.|29.11 11:00-13:00 |Calculated metrics. MDX Demo. | | [[http://apa.di.unipi.it/apa/video/2019-Video/2019-11-29-Excel.flv|Video on ExcelReport]] [[http://apa.di.unipi.it/apa/video/2019-Video/2019-11-29-MDX.flv|Video on MDXQuries]] | {{ :mds:lbi:foodmartexplorative.xlsx |}} {{ :mds:lbi:monreale_foodmart_2.zip |}}| | | |19.|29.11 11:00-13:00 |Calculated metrics. MDX Demo. | | [[http://lds.di.unipi.it/apa/video/2019-Video/2019-11-29-Excel.flv|Video on ExcelReport]] [[http://lds.di.unipi.it/apa/video/2019-Video/2019-11-29-MDX.flv|Video on MDXQuries]] | {{ :mds:lbi:foodmartexplorative.xlsx |}} {{ :mds:lbi:monreale_foodmart_2.zip |}}| | |
| |20.|03.12 11:00-13:00 |Practice with MDX. | | Thi part is covered by the previous video | {{ :mds:lbi:lbi.09.mdxsample.mdx.zip |}} | | | |20.|03.12 11:00-13:00 |Practice with MDX. | | Thi part is covered by the previous video | {{ :mds:lbi:lbi.09.mdxsample.mdx.zip |}} | | |
| |21.|05.12 11:00-13:00 | Practice with MDX | | [[https://kdd.isti.cnr.it/sites/default/files/video/2019-12-05.flv|Video 5/12/19]] | {{ :mds:lbi:lbi.09.mdxpractice.mdx.zip |}} | | | |21.|05.12 11:00-13:00 | Practice with MDX | | [[https://kdd.isti.cnr.it/sites/default/files/video/2019-12-05.flv|Video 5/12/19]] | {{ :mds:lbi:lbi.09.mdxpractice.mdx.zip |}} | | |
| |22.|06.12 11:00-13:00 | Reporting with Power BI Desktop. Data Mining pre-processing in WEKA. | {{ :mds:lbi:lds.12.powerbi.pdf |}} {{ :mds:lbi:lds.13.weka.pdf |}}| [[https://kdd.isti.cnr.it/sites/default/files/video/2019-12-6.flv|Video 6/12/19]]| {{ :mds:lbi:weka.3.7.9.light.zip |}}{{ :mds:lbi:wekapatch.zip |}} {{ :mds:lbi:exercises-2midterm.txt.zip |}}| | |22.|06.12 11:00-13:00 | Reporting with Power BI Desktop. Data Mining pre-processing in WEKA. | {{ :mds:lbi:lds.12.powerbi.pdf |}} {{ :mds:lbi:lds.13.weka.pdf |}}| [[https://kdd.isti.cnr.it/sites/default/files/video/2019-12-6.flv|Video 6/12/19]]| {{ :mds:lbi:weka.3.7.9.light.zip |}}{{ :mds:lbi:wekapatch.zip |}} {{ :mds:lbi:exercises-2midterm.txt.zip |}}| |
| |23.|10.12 11:00-13:00 | API WEKA |{{ :mds:lbi:lds.15.wekaapi.pdf |}} {{ :mds:lbi:lsd.practice.ee-2019.pdf|}} | [[http://apa.di.unipi.it/apa/video/2019-Video/2019-12-10.flv|Video 10/12/2019]]| {{:mds:lbi:ee_dataset.zip | training set for exercise on Weka}} {{ :mds:lbi:ee_validation.arff.zip | validation set for exercise on Weka }} {{:mds:lbi:wekaapi-example.zip | Python example for WEKA API}}| | |23.|10.12 11:00-13:00 | API WEKA |{{ :mds:lbi:lds.15.wekaapi.pdf |}} {{ :mds:lbi:lsd.practice.ee-2019.pdf|}} | [[http://lds.di.unipi.it/apa/video/2019-Video/2019-12-10.flv|Video 10/12/2019]]| {{:mds:lbi:ee_dataset.zip | training set for exercise on Weka}} {{ :mds:lbi:ee_validation.arff.zip | validation set for exercise on Weka }} {{:mds:lbi:wekaapi-example.zip | Python example for WEKA API}}| |
| |24.|12.12 11:00-13:00 | Practice for the second midterm| | | {{ :mds:lbi:ex-mdx.pdf | Queries to solve with MDX (this file is a more complete version of that one published the last lecture) }} {{ :mds:lbi:20140205.pdf | Exercise on MDX}} {{ :mds:lbi:2019-exercises-2midterm.zip |Solution Ex.}}| | | |24.|12.12 11:00-13:00 | Practice for the second midterm| | | {{ :mds:lbi:ex-mdx.pdf | Queries to solve with MDX (this file is a more complete version of that one published the last lecture) }} {{ :mds:lbi:20140205.pdf | Exercise on MDX}} {{ :mds:lbi:2019-exercises-2midterm.zip |Solution Ex.}}| | |
| ====== Exams ====== | ====== Exams ====== |
| * [[LDS 2018-2019]] | * [[LDS 2018-2019]] |
| * [[LBI 2017-2018]] | * [[LBI 2017-2018]] |
| * [[http://pages.di.unipi.it/ruggieri/teaching/_lbi/|LBI 2016/2017]] | |
