Code

The following list provides links to the code used in the guided coding sessions. The code may be be updated as the course progresses. The solutions to the challenges will be available on the course’s shared Dropbox folder (link to be sent via email).

Week 1: 08/24. Version control and GitHub.

• Slides: Introduction to GitHub (.pdf file)

• Code: Introduction to RMarkdown (.Rmd file)

• Additional reading: How Pew Research Center uses git and GitHub for version control

• GitHub Classroom: Challenge 0

Week 2: 08/31. Advanced R.

• Slides: Good coding / programming practices (.pdf file)

• Code: Functions and loops in R (.Rmd file)

• Code: Brief overview of algorithm complexity (.Rmd file)

• Code: Efficient programming with R (.Rmd file)

• GitHub Classroom: Challenge 1

Week 3: 09/07. Webscraping.

• Slides: Webscraping (.pdf file)

• Code: Scraping tables from websites (.Rmd file)

• Code: Scraping unstructured data (.Rmd file)

• GitHub Classroom: Challenge 2

Week 4: 09/14. Text (I).

• Code: Introduction to text analysis with R (.Rmd file)

• Code: Text analysis with the quanteda package (.Rmd file)

• Slides: APIs (.pdf file)

• Code: APIs (.Rmd file)

• GitHub Classroom: Challenge 3

Week 5: 09/21. Text (II).

• Code: Describing and comparing documents (.Rmd file)

• GitHub Classroom: Challenge 4

Week 6: 09/28. Text (III).

• Code: Dictionary methods applied to sentiment analysis (.Rmd file)

• Code: Dictionary methods - advanced applications (.Rmd file)

• GitHub Classroom: Challenge 5

Week 7: 10/05. Text (IV).

• Code: Supervised learning applied to text classification (.Rmd file)

• GitHub Classroom: Challenge 6

Week 8: 10/12. Text (V).

• Code: Topic models (.Rmd file)

• GitHub Classroom: Challenge 7

Week 9: 10/19. Text (VI).

• Code: Introduction to word2vec (.Rmd file)

• Code: Applications of word embeddings (.Rmd file)

• GitHub Classroom: Challenge 8

Week 10: 10/26. Networks (I).

• Code: Introduction to social network analysis with igraph (.Rmd file)

• Code: Community detection (.Rmd file)

Week 11: 11/02. Networks (II).

• Code: Collecting Twitter data from the Streaming API (.Rmd file)

• Code: Collecting Twitter data from the REST API (.Rmd file)

• GitHub Classroom: Challenge 9 + 10

Week 12: 11/09. Networks (III).

• Code: Principal component analysis (.Rmd file)

• Code: Latent space network models (.Rmd file)

Week 13: 11/16. Big Data (I).

• Slides: Introduction to SQL

• Code: Basics of SQL queries

• Code: Querying multiple tables. Grouping and aggregating operations.

• Code: Querying large-scale databases.

Week 15: 11/30. Big Data (II).

• Slides: Parallel computing

• Code: Parallel computing with R (.Rmd file)

• Code: Parsing text in PDF files (.Rmd file)

© Website design: Jeffrey Arnold, 2016, Creative Commons Attribution 4.0 International License.