Course Introduction - Simon Fraser University

Course Introduction - Simon Fraser University

Big Data Programming II Course Introduction CMPT 733, SPRING 2017 JIANNAN WANG Who am I? Assistant Professor from Simon Fraser University Postdoc from UC Berkeley AMPLab 8+ years of research experience in the database field Ph.D. from Tsinghua University 01/30/2020 JIANNAN WANG - CMPT 733

2 Database: Research Success I am so proud of being a database guy! 4 Turing Award Winners in 50 years 1973 Network database Charles W. Bachman 01/30/2020 1981 Relational database 1998 Transactional database Edgar Codd Jim Gray

JIANNAN WANG - CMPT 733 2014 Modern database systems Michael Stonebraker 3 Database: Industry Success I am so proud of being a database guy! $30~$50 billion market per year 3x faster growth ... 01/30/2020 JIANNAN WANG - CMPT 733

4 But, what has changed in the Big Data world? People have different opinions on this question. You should have your own opinion! I believe there are two major changes: Cloud Computing and Machine Learning 01/30/2020 JIANNAN WANG - CMPT 733 5 Cloud Computing Making it tremendously easier and cheaper to run applications on a cluster (e.g., 50 nodes) How to Program?

Oracles Biggest Competitor? CMPT 732. http://bit.ly/2iaNKuT 01/30/2020 JIANNAN WANG - CMPT 733 6 Machine Learning (ML) People are not only interested in understanding the past but also in predicting the future Imagine your boss asks you the following questions Understanding the past (SQL Analytics) 01/30/2020 Predicating the future

(Machine Learning) How many Apple Watches did we sell in 2015? How many Apple Watches will we sell in 2016? Which movies did Bob watch before? Which movies will Bob like to watch in the future? JIANNAN WANG - CMPT 733 7

ML in Class vs. ML in Practice ML in Class Data is clean, and comes from a single source Developing a new ML model is quite important A model should have good properties in theory ML in Practice Data is messy, and often comes from multiple sources Feature selection and parameter tuning are quite important A model should have good performance in production 01/30/2020 JIANNAN WANG - CMPT 733 8 Whats this course about? Goals

Advanced analytics (beyond SQL analytics) Tools Spark MLlib, Scikit-Learn, Caffee Lecture style More why less how Assignment style Problem centric instead of tool centric 01/30/2020 JIANNAN WANG - CMPT 733 9 Course Plan Part I: Advanced Analytics with Spark 1.

2. 3. 4. 5. Introduction & MLlib Basics Sentiment Analysis (Feature Representation + Linear Regression) Anomaly Detection (Unsupervised Learning) Data Integration and Cleaning Movie Recommendation Dr. Jiannan Wang Dr. Apala Guha Part II: Advanced Analytics with Other Tools 6. 7. 8. 9. 10.

01/30/2020 Small Data (Scikit-Learn) Deep Learning (caffee) Data Labeling (Crowdsourcing, Active Learning) Project Proposal Presentation Visualization (D3) & AWS JIANNAN WANG - CMPT 733 10 Course Setup Marking Assignments: 9 x 8 = 72% Project: (proposal + poster + report): 28% Lectures (1 hour/week) Group A, B: Monday 9:30-10:20 Labs (5 hours/week)

Group A: Tues 9:3011:20, Thurs 9:0011:50 Group B: Tues 14:3016:20, Thurs 13:3016:20 TAs Venkatesh Palani Prabhu Angalakurichi Ramaraj Jaypratap Naidu 01/30/2020 JIANNAN WANG - CMPT 733 11

Recently Viewed Presentations

  • SOME MEN SUCCEED BECAUSE THEY ARE DESTINED TO,

    SOME MEN SUCCEED BECAUSE THEY ARE DESTINED TO,

    Decreased oxygen delivery. Anaerobic metabolism. Decreased ATP production. Lactic acid formation. Failure of Na+/K+ pump *Accumulation of Na+ in cell. Cellular swelling AND organelle swelling
  • Dec 25, 2018 Merry Christmas to you all.

    Dec 25, 2018 Merry Christmas to you all.

    Thank You! Dear Wonderful Father, You have granted me another day of life to be your light on this world. Thank you for allowing me to enjoy your sunshine, my family, Your Word and Jesus today! It truly was another...
  • In-Depth Research on RANS Modeling in Pressure Gradients

    In-Depth Research on RANS Modeling in Pressure Gradients

    RANS will outlive us, and is a highly justified field of work. In transportation, pure LES will not be possible for decades, if ever (DNS?) Within hybrids, the switch RANS-> LES will occur earlier, in the attached BL. ... (with...
  • YOUR HEALTH TRIANGLE - Sault Schools

    YOUR HEALTH TRIANGLE - Sault Schools

    evaluating your results. what is the strongest side of your triangle? what is the weakest side of your triangle? write a few sentences about one thing that you can work on to better yourself.
  • UN - Peace and conflict studies

    UN - Peace and conflict studies

    Why Dept of Field Support. DFS for mobilization all human, material and support services necessary to ensure that UN field missions are largely self-sufficient and can succeed under a wide range of post-conflict conditions.. Local markets . for goods and...
  • Variable-Reluctance Stepper Motor Half-Step Operation

    Variable-Reluctance Stepper Motor Half-Step Operation

    Variable-Reluctance Stepper Motor Half-Step Operation Modify the sequence of the applied pulses A A&B B B&C C C&D D Variable-Reluctance Stepper Motor Half-Step Operation Variable-Reluctance Stepper Motor Half-Step Operation Variable-Reluctance Stepper Motor Holding Torque Variable-Reluctance Stepper Motor Holding Torque Variable-Reluctance...
  • STFC Corporate PowerPoint Template

    STFC Corporate PowerPoint Template

    a new SCRFlinac producing evenly spaced pulses at 1 MHz (termed 'continuous wave' (CW) operation) will deliver high-repetition rate beam at up to 4GeV to the SXR and HXR FELs and the existing copper linac will deliver beam at up...
  • Reminders 8/23/17 - DR. SPRUILL

    Reminders 8/23/17 - DR. SPRUILL

    Share a key quote that relates to the conflict or key issue of the novel . ... The thematic concept of appearance versus reality presents itself in the play Othello. What is the message about appearance versus reality so far?...