Web Scraping: Scaling up Digital Data Collection

The latest slides from web scraping through R: Web scraping for the humanities and social sciences

Slides from the first session here

Slides from the second session here


Slides from the fourth and final session here


This week we look in greater detail at scaling up digital data-collection: coercing scraper output into dataframes, how to download files (along with a cursory look at the state of IP law), cover basic text-manipulation in R, and take a first look at working with the APIs (share counts on Facebook).

Download the .Rpres file to use in Rstudio here

A regular R script with code-snippets only can be accessed here

UPDATE March 2015:
New 2015 version of slides here
PDFs of slides available here

103 comments:

  1. This is great! This information becomes obsolete fast so it is quite useful.
    Is there any chance of a downloadable form for your slides? For whatever reason, I don't feel comfortable unless I have PDF files that I can annotate myself!
    Thanks

    ReplyDelete
    Replies
    1. Glad you find it useful! I've added PDF slides. Fingers crossed they work properly - a bit hard to get the formatting right

      Delete
  2. This comment has been removed by a blog administrator.

    ReplyDelete
  3. Web Scraping, in general, means looking a webpage as a table in database and website as a database.

    ReplyDelete
  4. I don't feel comfortable unless I have PDF files that I can annotate myself!

    scrape a website

    ReplyDelete
  5. R is best when it comes to web scraping. I am using R to develop web scraper as per my clients requirements.Thanks for sharing this information with us.

    ReplyDelete
  6. Great post! I have read through your tutorial from part I and they are awesome! Thanks for sharing your knowledge!

    ReplyDelete
  7. Web Scraping Services or website scraping service is like a boon to grow business and reach your business to new heights and success. Website scraping services is nothing but a process of extracting data from website for your business need.

    ReplyDelete
  8. Finding the time and actual effort to create a superb article like this is great thing. I’ll learn many new stuff right here! Good luck for the next post buddy..
    Java Training in Chennai

    ReplyDelete

  9. Finance and investment cannot give improvement. It depends on business ideas. e for exploring.eHow-why,will show you insights of new trends for success. Read More

    ReplyDelete
  10. Please click on this post if you wanna paly with online casino.Thank you.
    ทางเข้าจีคลับ
    บาคาร่า

    ReplyDelete
  11. Great post! I have read through your tutorial from part I and they are awesome! Thanks for sharing your knowledge!>>>

    goldenslot casino
    บาคาร่าออนไลน์
    gclub casino




    ReplyDelete
  12. G club Online gambling sites are fully playable every day. To play more easily. Where to gamble yourself every day. Bet at all Choose to gamble yourself at all times. Full of play to play easily. There are gambling games that will give you more profit. To play well is to play to give more money, and then ready to gamble is fun every time.

    In addition, it is interesting with figs. Not only gives you high fiber You have a lot of drugs. The fig fruits are very nutritious. Specific properties that help eliminate waste in the body. Stimulates excretion And help prevent gallstones. Help inhibit the growth of colon cancer.

    There are many gambling games that will be liked to play all kinds of gambling. To play very easily. To play well with this gambler. It is fun to play all the gamblers who will love to make good money everywhere. You can play gambling every day with a much easier playing. Make a bet to gamble yourself every day. All bets are fun. Gclub มือถือ

    ReplyDelete
  13. the owner of the casino does not allow it because employees do not have the right to gamble (excuse).


    gclub

    ReplyDelete
  14. Wow! That's really great information guys.I know lot of new things here. Really great contribution.Thank you ...salesforce training hyderabad

    ReplyDelete
  15. Please keep updating this blog, it's been too long. Great post! We adore this blog and This information is very good.

    SCR888th

    ACE333

    ReplyDelete
  16. Thank for your very good article! i always enjoy & read the post you are sharing!

    ดูหนังออนไลน์

    ReplyDelete
  17. its very nice article. thanks for sharing such great article hope keep sharing such kind of article Web data scraper

    ReplyDelete
  18. helloGood website. Keep posting more informative articles like these one. These are very good articles to visit thank you
    Lsm99
    Gclub
    ทางเข้า Gclub
    ทางเข้า Lsm99

    ReplyDelete
  19. เงินฝากครั้งแรก รับไปเลย โบนัส 30%, โปรโมชั่นโบนัสต้อนรับสำหรับลูกค้าใหม่ นอกจากนั้นยังมีโปรโมชั่นเติมเงิน และโปรโมชั่นคืนเงิน ให้กับสมาชิกปัจจุบันอีกด้วย
    goldenslot
    โกลเด้นสล็อต
    สล็อตออนไลน์

    ReplyDelete
  20. เงินฝากครั้งแรก รับไปเลย โบนัส 30%, โปรโมชั่นโบนัสต้อนรับสำหรับลูกค้าใหม่ นอกจากนั้นยังมีโปรโมชั่นเติมเงิน และโปรโมชั่นคืนเงิน ให้กับสมาชิกปัจจุบันอีกด้วย
    goldenslot
    โกลเด้นสล็อต
    สล็อตออนไลน์

    ReplyDelete
  21. โปรโมชั่น Goldenslot sport
    สมัครสมาชิกใหม่ พร้อมโปรโมชั่นเติมเงิน แบบครบวงจร รับสูงสุด 1,000 บาท
    สมัครสมาชิกคลิก>>> แทงบอลออนไลน์ โกลเด้นสล็อต

    ReplyDelete
  22. Good job in presenting the correct content with the clear explanation. The content looks real with valid information. Good Work

    DevOps is currently a popular model currently organizations all over the world moving towards to it. Your post gave a clear idea about knowing the DevOps model and its importance.

    Good to learn about DevOps at this time.


    devops training in chennai | devops training in chennai with placement | devops training in chennai omr | devops training in velachery | devops training in chennai tambaram | devops institutes in chennai | devops certification in chennai | trending technologies list 2018 | Top 100 DevOps Interview Questions and Answers

    ReplyDelete
  23. Very nice post here thanks for it .I always like and such a super contents of these post.Excellent and very cool idea and great content of different kinds of the valuable information's.

    Check out : machine learning course fees in chennai
    machine learning training center in chennai
    machine learning with python course in chennai
    artificial intelligence and machine learning course in chennai

    ReplyDelete
  24. Appericated the efforts you put in the content of Data Science .The Content provided by you for Data Science is up to date and its explained in very detailed for Data Science like even beginers can able to catch.Requesting you to please keep updating the content on regular basis so the peoples who follwing this content for Data Science can easily gets the updated data.
    Thanks and regards,
    Data Science training in Chennai
    Data Science course in chennai with placement
    Data Science certification in chennai
    Data Science course in Omr

    ReplyDelete
  25. Really useful information. Thank you so much for sharing.It will help everyone.Keep Post. RPA training in chennai | RPA training in Chennai with placement

    ReplyDelete
  26. gclub-vip.com สมัคร Vip วันนี้รับทันที 1,000 บาท
    คลิก>>> gclub
    คลิก>>> จีคลับ
    คลิก>>> gclub casino

    ReplyDelete
  27. The only website that offers online casino betting services. The most complete device at this time There are many gambling games to choose from, including Baccarat, Roulette, Sic Bo and many more, through live broadcasts directly from abroad. Can play thousands of times, no minimum Open for 24 hours, ready to win promotion at any time, just apply for gclub

    คาสิโน

    ReplyDelete
  28. Appericated the efforts you put in the content of Data Science .The Content provided by you for Data Science is up to date and its explained in very detailed for Data Science like even beginers can able to catch.Requesting you to please keep updating the content on regular basis so the peoples who follwing this content for Data Science can easily gets the updated data.
    Thanks and regards,
    Data Science training in Chennai
    Data Science course in chennai with placement
    Data Science certification in chennai
    Data Science course in Omr

    ReplyDelete
  29. Hey Nice Blog!! Thanks For Sharing!!!Wonderful blog & good post.Its really helpful for me, waiting for a more new post. Keep Blogging!
    SEO company in coimbatore
    SEO company
    web design in coimbatore

    ReplyDelete
  30. โปรโมชั่นใหม่ “แจกโบนัส สูงสุดทันที 1,000 บาท”
    gclub online โปรโมชั่น แบบครบวงจรที่คอยอัพเดทข่าวสารเกี่ยวกับโปรโมชั่น จีคลับ บาคาร่าออนไลน์ สล็อตออนไลน์ ตลอดทั้ง 24 ชั่วโมง เพื่อให้ท่านได้สามารถเข้าร่วมสนุกไปกับเกมออนไลน์ของเราได้ตลอดเวลาโปรโมชั่นสำหรับสมาชิก Premium, VIP ที่แจกโบนัสให้สูงที่สุด 10% และโปรโมชั่นแบบรายวัน สำหรับคำขอบคุณที่มอบให้กับ โปรโมชั่น gclub

    ReplyDelete
  31. It has been simply incredibly generous with you to provide openly what exactly many individuals would’ve marketed for an eBook to end up making some cash for their end, primarily given that you could have tried it in the event you wanted.
    linux Training in Chennai | Best linux Training in Chennai
    Unix Training in Chennai | Best Unix Training in Chennai
    Sql Training in Chennai | Best Sql Training in Chennai
    Oracle Training in Chennai | Best Oracle Training in Chennai
    Digital Marketing Training in Chennai | Best Digital Marketing Training in Chennai

    ReplyDelete
  32. gclub-vip.com สมัคร Vip วันนี้รับทันที 1,000 บาท
    คลิก>>> gclub
    คลิก>>> จีคลับ
    คลิก>>> gclub casino

    ReplyDelete
  33. Thanks for sharing such a nice thing

    โปรโมชั่นGclub ของทางทีมงานตอนนี้แจกฟรีโบนัส 50%
    เพียงแค่คุณสมัคร Gclub กับทางทีมงานของเราเพียงเท่านั้น
    ร่วมมาเป็นส่วนหนึ่งกับเว็บไซต์คาสิโนออนไลน์ของเราได้เลยค่ะ
    สมัครสมาชิกที่นี่ >>> Gclub online

    ReplyDelete
  34. Good job .

    เว็บไซต์คาสิโนออนไลน์ที่ได้คุณภาพอับดับ 1 ของประเทศ
    เป็นเว็บไซต์การพนันออนไลน์ที่มีคนมา สมัคร Gclub Royal1688
    และยังมีเกมส์สล็อตออนไลน์ 1688 slot อีกมากมายให้คุณได้ลอง
    สมัครสมาชิกที่นี่ >>> Gclub Royal1688

    ReplyDelete


  35. Nice blog..very usefull..keep going.."web design company in coimbatore" kindly visit us

    Web Design Company in Coimbatore

    ReplyDelete
  36. Just seen your Article, it amazed me and surpised me with god thoughts that eveyone will benefit from it. It is really a very informative post for all those budding entreprenuers planning to take advantage of post for business expansions. You always share such a wonderful articlewhich helps us to gain knowledge .Thanks for sharing such a wonderful article, It will be deinitely helpful and fruitful article.
    Thanks
    DedicatedHosting4u.com


    ReplyDelete
  37. They are useful to people reading greatly. Thank you again!
    fifa55

    ReplyDelete
  38. Thanks for sharing an informative blog keep rocking bring more details.I like the helpful info you provide in your articles. I’ll bookmark your weblog and check again here regularly. I am quite sure I will learn much new stuff right here! Good luck for the next!
    web designing classes in chennai | web designing training institute in chennai
    web designing and development course in chennai | web designing courses in Chennai
    best institute for web designing in chennai | web designing course with placement in chennai

    ReplyDelete
  39. Thanks for sharing an informative blog keep rocking bring more details.I like the helpful info you provide in your articles. I’ll bookmark your weblog and check again here regularly. I am quite sure I will learn much new stuff right here! Good luck for the next!
    web designing classes in chennai | web designing training institute in chennai
    web designing and development course in chennai | web designing courses in Chennai
    best institute for web designing in chennai | web designing course with placement in chennai

    ReplyDelete
  40. Soma pill is very effective as a painkiller that helps us to get effective relief from pain. This cannot cure pain. Yet when it is taken with proper rest, it can offer you effective relief from pain.
    This painkiller can offer you relief from any kind of pain. But Soma 350 mg is best in treating acute pain. Acute pain is a type of short-term pain which is sharp in nature. Buy Soma 350 mg online to get relief from your acute pain.

    https://globalonlinepills.com/product/soma-350-mg/


    Buy Soma 350 mg
    Soma Pill
    Buy Soma 350 mg online



    Buy Soma 350 mg online
    Soma Pill
    Buy Soma 350 mg

    ReplyDelete



  41. Soma pill is very effective as a painkiller that helps us to get effective relief from pain. This cannot cure pain. Yet when it is taken with proper rest, it can offer you effective relief from pain.
    This painkiller can offer you relief from any kind of pain. But Soma 350 mg is best in treating acute pain. Acute pain is a type of short-term pain which is sharp in nature. Buy Soma 350 mg online to get relief from your acute pain.

    https://globalonlinepills.com/product/soma-350-mg/


    Buy Soma 350 mg
    Soma Pill
    Buy Soma 350 mg online



    Buy Soma 350 mg online
    Soma Pill
    Buy Soma 350 mg

    ReplyDelete
  42. http://sbowin.club ialah salah satu link alternatif sbobet yang amat sangatlah terkenal sekali di indonesia.

    Bahkan link ini telah memiliki lisensi resmi tentu dengan anda bermain dengan mempergunakan link http://playsbo.best maka anda pun akan memperoleh pengalaman permain yang terbaik.

    Dengan begitu anda pun akan merasa sangatlah nyaman sekali pada saat anda bermain di http://playsbo.xyz sehingga anda pun akan merasa senang sekali.

    Oleh karena hal itulah kami merekomendasikan http://jimwater.club untuk para pemain setia kami.

    Sehingga mereka pun tidak akan menemui kendala yang menghambat permainan mereka di http://bubukpisau.club tersebut.

    Dengan anda mengetahui hal tersebut dengan baik tentu anda pun akan nyaman sekali pada saat bermain dengan http://gadogado198.club yang kami sediakan.

    ReplyDelete
  43. Oleh karena hal itulah kami merekomendasikan link http://gadogado198.co untuk anda semua.

    Anda tidak perlu khawatir lagi pada saat bermain di http://moneyyellow.club karena kami telah banyak sekali melakukan riset terhadap link ini.

    Dengan begitu kami pun berani menjamin kenyamanan anda pada saat bermain di http://harybox.club.

    Alhasil anda pun dapat dengan mudah menang pada saat bermain di http://mousebin.club yang kami sediakan untuk anda semua.

    Ceme Online Terpercaya

    Ceme Online

    ReplyDelete
  44. Untuk permainan Ceme Online Terbaik yang yang sediakan sudah memiliki kualitsa yang sangatlah baik sekali.

    ReplyDelete
  45. Oleh karena itu anda harus melakukan Daftar Poker Online bersama dengan kami.

    ReplyDelete
  46. Untuk melakukan Daftar Sakong Online Terpercaya pun terbilang sangatlah mudah sekali untuk dilakukan.

    ReplyDelete
  47. Hal tersebut ddapat terjadi dikarenakan kami menyediakan banyak sekali panduan untuk anda di Agen Asiapoker77 Terpercaya

    ReplyDelete