36-602 Perspectives in Data Science II

Note: This page contains course material for Carnegie Mellon University, Department of Statistics & Data Science, Masters In Statistical Practice course 36-602, "Perspectives in Data Science".

Jump to 36601 Homework

Course Information

Instructors: Howard Seltman, hseltman@stat.cmu.edu, Baker Hall 232H
Christopher Peter Makris, cmakris@stat.cmu.edu, Baker Hall 232L
Meeting times: M/W 10:30-11:50 in BH 235B
syllabus (pdf)

Course Content

Python
- Feb 6: Python for R Users Part 5 Stat.pdf Python for R Users Part 5 Stat.py
- Apr 17: 602L0PyReview.pdf fileHandling.py fileHandlingWin.py accts.py counting.txt
- Apr 22+24: 602L1PyClasses.pdf StringPlus.py testStringPlus.py in class Apr 24: fibonacci.py Rectangle.py
- Apr 26: Decorators.pdf Decorators.py
- May 1: Dash.pdf dash1.py dashSlider.py chain.py
R
- Jan 16: Object Classes in R
Data Scraping
- Jan 23: WebScrapingInR.pdf
  scrape1.R scrape2.R stations.R cmuPeople.R statsci.R avcodes.R pinos.R
- Jan 28 WebScrapingInPython.pdf scrape1.py scrape2.py stations.py soup.py
- Feb 4: nihAlzheimer.py
SAS Macros
- April 1: Macros1.pdf Macros1.sas fy2017.sas7bdat ExpensesJan2017.dat ExpensesFeb2017.dat experiment3.dat
- April 3:Macros2.pdf Macros2.sas addRatio.sas
- April 8: Macros3.pdf Macros3.sas DSD4.dat ContrastsInSAS.pdf
- April 10: Macros4.pdf Macros4.sas magicString.sas
- April 15: Macros5.pdf Macros5.sas secSal.dat
Miscellaneous Topics
- Jan 14: Review of Regression Interpretation
Linux, Scripting, Big Data, and Hadoop
- Feb 8+11: IntroToLinuxOnUbuntuVM.pdf
- Feb 13: Intro to Unix Scripting.pdf
- Feb 18: BashSupplement.pdf hospital.csv fileByLine
- Feb 20+25: IntroToBigData.pdf
  IntroToHadoop.pdf WordCount.java mapperWC.py reducerWC.py streets.txt
- Feb 27: IntroToPig.pdf id0.pig id.pig data/school.csv SalesJan2009.csv
- March 4: ApachePig2.pdf purchases.zip sales.zip pig2.pig
- March 6: pipelineExample.pdf mallWartStart.pig (to complete in class)
  Solutions: mallWart.pig buyRates (full bash script) prodPlot.R (R plotter)
- March 18: IntroToHive.pdf
- March 20: IntroToSpark.pdf cust.dat purchase.dat In class code: highPurch.py
- March 25: SparkPart2.pdf spark2.py
- March 27: SparkPart3.pdf spark3.py regLR.dat imp85.csv

Homework

Python:
- Due Feb 15: pythonScrapeHW.pdf nowAtISS.py
- Due May 7: Clusters.pdf Clusters.py
SAS:
- Due April 3: QuickSASHW.pdf data: cust.sas7bdat purchase.sas7bdat
- Due April 23: quadTest.pdf template: quatTest.sas sample data: test.sas7bdat
R:
- Due Feb 3: RScrapeHW.pdf UNGDP.R pieFaq.R
Big data:
- Due 10 PM Tue Feb 19: UnixHW1.pdf Template: nv Input files: nouns.txt verbs.txt
- Due 10 PM Tue Mar 26: PigHW.pdf company1.tab company2.tab evilCorp.tab pigHW.pig
- Due 10 PM Fri Apr 12: SparkHW.pdf Template: sparkHW.py Data: train.csv test.csv