Web-Scraping: the Basics

Slides from the first session of my course about web scraping through R: Web scraping for the humanities and social sciences

Includes an introduction to the paste function, working with URLs, functions and loops.
Putting it all together we fetch data in JSON format about Wikipedia page views from http://stats.grok.se/

Solutions here:

Download the .Rpres file to use in Rstudio here

Slides from part two can be seen here

Slides from part three here

Slides from the fourth and final session here

UPDATE March 2015:
New 2015 version of slides here
PDFs of slides available here

Slides from part two can be seen here


  1. Here is a shiny app that covers one of your examples

  2. Very nice, thanks. Hope to see the material from the other classes as well.

  3. Thanks for sharing the nice information with us and you have incredible work in this blog and i have to sure bookmark this blog .

    data scraping services

  4. Thank you for sharing this awesome material!!!

    I am a very newbie in web scrapping, but I want to analize my spotify data, can you adress me to anywhere to achieve this goal?? I dont find any use of these APIs in R.

  5. Many thanks for this. Just in case others hit the same issues:
    When I pasted in your code from slides, it did not work because the quotes pasted as curly quotes. All fine when turned into straight quotes.

    I am using R2.15.3.
    rjson is not compatible with this, but RJSONIO works fine

  6. Thanks for sharing.
    Very nice work.


  7. Finally I understand some about this, thank you very much !!!!

    Regards from Mexico =")

  8. 100% Safe and Authentic Weight Loss Pills
    Buy PhenQ Now

    Naturally melt down the excessive fat without affecting your muscle mass.

    PhenQ Australia

  9. 10 Diet Myths That Circulating Around Us since Our Birth
    When it comes to weight loss, everyone seems to have some advice. But how do you separate fact from fiction?


  10. Web Scraping Company provides web scraping, data scraping, website scraping, web data extraction, big data service, big data solution and data mining services. We provides any kind of data from any online web resource.

  11. Wow amazing, Nice content I found so many interesting stuff in your blog especially its discussion Thanks to sharing thanks!
    web data extraction tools

  12. Web Scraping Services or website scraping service is like a boon to grow business and reach your business to new heights and success. Website scraping services is nothing but a process of extracting data from website for your business need.

  13. I am expecting more interesting topics from you. And this was nice content and definitely it will be useful for many people.school prospectus design uk

  14. I really appreciate your post and you explain each and every point very well. Thanks for sharing this information. And I’ll love to read your next post too. growth hacking

  15. จีคลับ Online gambling sites that provide good bets are played to be liked. Make a good profit every area. Gamblers play this way. Gamblers will like it. I want to make good money like this. Make every single bet with a unique gambler. Who wants to make good money like this? Gamblers play every day. Very good profit.

    In addition, it is interesting. Nutritious properties help kidney. The liver and kidney. Diuretic Can be cooked in several menus together. Pitcher is a type of carbohydrate. The juice is so concentrated. It contains essential amino acids for brain function and hormone melatonin. Warm millet helps to sleep. The effect of blood circulation on the skin better. Hair growth good.

    Have fun every day, make all the bets with easy gambling. To play all areas. There are many fun betting games to play with. Make great profits with every gambler. I like to play gambling. There are good betting games every day. Enjoy Do gamers always play professionally. บาคาร่า