Digital Data Collection course

Another year, another web scraping course. Taught through SSRMC at the University of Cambridge. Below are slides from all three sessions.

In the course I tried to achieve the following:
- Show how to connect R to resources online
- Use loops and functions to iteratively access online content
- How to work with APIs
- How to harvest data manually using Xpath expressions.

What's new?
- Many more examples and practice tasks
- Updated API usage
- Some bug fixes (and probably many new bugs introduced)

UPDATE 21/03/2015:
PDF slides now added here:
- Session one
- Session two
- Session three

For raw R scripts, see the course landing page

Slides from 2015 version are embedded below, alternatively access through course landing page. For reference I've included slides from last year's course, too:
- Session one: the basics
- Session two: digging deeper
- Session three: scaling up
- Session four: APIs








31 comments:

  1. Replies
    1. KARNA RASA HATI YANG GEMBIRA BERKAT BANTUAN AKI SOLEH
      MAKANYA SENGAJA NAMA BELIAU SAYA CANTUNKAN DI INTERNET !!!

      assalamualaikum wr, wb, saya IBU PUSPITA WATI saya Mengucapkan banyak2
      Terima kasih kepada: AKI SOLEH
      atas nomor togelnya yang kemarin AKI berikan "4D"
      alhamdulillah ternyata itu benar2 tembus AKI
      dan berkat bantuan AKI SOLEH saya bisa melunasi semua hutan2…
      orang tua saya yang ada di BANK BRI dan bukan hanya itu AKI alhamdulillah,
      sekarang saya sudah bisa bermodal sedikit untuk mencukupi kebutuhan keluarga saya sehari2.
      Itu semua berkat bantuan AKI SOLEH sekali lagi makasih banyak ya, AKI
      yang ingin merubah nasib
      seperti saya...?
      SILAHKAN GABUNG SAMA AKI SOLEH No; { 082-313-336-747 }

      Sebelum Gabung Sama AKI Baca Duluh Kata2 Yang Dibawah Ini
      Apakah anda termasuk dalam kategori di bawah ini...!!
      1: Di kejar2 tagihan hutang..
      2: Selaluh kalah dalam bermain togel
      3: Barang berharga sudah
      terjual buat judi togel..
      4: Sudah kemana2 tapi tidak
      menghasilkan, solusi yang tepat..!
      5: Sudah banyak dukun ditempati minta angka ritual blom dapat juga,
      satu jalan menyelesaikan masalah anda..
      Dijamin anda akan berhasil
      silahkan buktikan sendiri
      Atau Chat/Tlpn di WhatsApp (WA)
      No WA Aki : 082313336747

      TERIMA KASIH YANG PUNYA
      ROOM ATAS TUMPANGANYA SALAM KOMPAK SELALU
      "KLIK DISINI BOCORAN TOGEL SGP HK SDY DAN DLL"

      Delete
    2. KARNA RASA HATI YANG GEMBIRA BERKAT BANTUAN AKI SOLEH
      MAKANYA SENGAJA NAMA BELIAU SAYA CANTUNKAN DI INTERNET !!!

      assalamualaikum wr, wb, saya IBU PUSPITA WATI saya Mengucapkan banyak2
      Terima kasih kepada: AKI SOLEH
      atas nomor togelnya yang kemarin AKI berikan "4D"
      alhamdulillah ternyata itu benar2 tembus AKI
      dan berkat bantuan AKI SOLEH saya bisa melunasi semua hutan2…
      orang tua saya yang ada di BANK BRI dan bukan hanya itu AKI alhamdulillah,
      sekarang saya sudah bisa bermodal sedikit untuk mencukupi kebutuhan keluarga saya sehari2.
      Itu semua berkat bantuan AKI SOLEH sekali lagi makasih banyak ya, AKI
      yang ingin merubah nasib
      seperti saya...?
      SILAHKAN GABUNG SAMA AKI SOLEH No; { 082-313-336-747 }

      Sebelum Gabung Sama AKI Baca Duluh Kata2 Yang Dibawah Ini
      Apakah anda termasuk dalam kategori di bawah ini...!!
      1: Di kejar2 tagihan hutang..
      2: Selaluh kalah dalam bermain togel
      3: Barang berharga sudah
      terjual buat judi togel..
      4: Sudah kemana2 tapi tidak
      menghasilkan, solusi yang tepat..!
      5: Sudah banyak dukun ditempati minta angka ritual blom dapat juga,
      satu jalan menyelesaikan masalah anda..
      Dijamin anda akan berhasil
      silahkan buktikan sendiri
      Atau Chat/Tlpn di WhatsApp (WA)
      No WA Aki : 082313336747

      TERIMA KASIH YANG PUNYA
      ROOM ATAS TUMPANGANYA SALAM KOMPAK SELALU
      "KLIK DISINI BOCORAN TOGEL SGP HK SDY DAN DLL"

      Delete
  2. Casino G Club makes you rich not difficult.
    รอยัล1688 It is a casino website. Gclub has a long way to go, fun fun filled with hundreds of famous online gambling games. The player can convert into a winner by just playing a little skill, because the game of online betting now we can easily beat whoever is playing the game. All online casinos that want to play.

    Because on our casino website, there are many online gambling games available to players, including bonus offers and jackpots. All players are eligible to win bonus prizes after the player has subscribed to the casino site. Our club, whether it is a bonus or jackpot, the player is eligible to win the prize.

    The gambler can join in with the online gambling game is not difficult, just sign up to join the gambling club. Our online casino can only play online casino games that you would like to play today at the web viva3388

    ReplyDelete
  3. Do you need Personal Loan?
    Business Cash Loan?
    Unsecured Loan
    Fast and Simple Loan?
    Quick Application Process?
    Approvals within 24-72 Hours?
    No Hidden Fees Loan?
    Funding in less than 1 Week?
    Get unsecured working capital?
    Contact Us At :fivestarfinancecompany@gmail.com.
    Phone number :+15165910949 (Whatsapp Only)

    LOAN SERVICES AVAILABLE INCLUDE:
    ================================
    *Commercial Loans.
    *Personal Loans.
    *Business Loans.
    *Investments Loans.
    *Development Loans.
    *Acquisition Loans .
    *Construction loans.
    *Credit Card Clearance Loan
    *Debt Consolidation Loan
    *Business Loans And many More:

    LOAN APPLICATION FORM:
    =================
    Full Name:................
    Loan Amount Needed:.
    Purpose of loan:.......
    Loan Duration:..
    Gender:.............
    Marital status:....
    Location:..........
    Home Address:..
    City:............
    Country:......
    Phone:..........
    Mobile / Cell:....
    Occupation:......
    Monthly Income:....

    Contact Us At fivestarfinancecompany@gmail.com
    Phone number :For call or watssap us +15165910949

    ReplyDelete
  4. nerve shield plus is mainly for neurotransmission but also its an effective supp for other diseases too like aging symptoms,joint pains,mainting blood sugar level and much more it is absolutely natural no other chemicals are included in this. so the reliability of the product is higher than others for more info about overcoming such diseases check out the video link and know how to get your hands on this supp easily.

    https://www.youtube.com/watch?v=VwE-Q_M8kJc

    ReplyDelete
  5. Failures Make You Nd10x Review Better Only If You Understand These 6 Things https://www.reviewengin.com/nd10x-review/

    ReplyDelete
  6. Unhustled 6 Figure Freedom Review Doesn't Have To Be Hard. Read These 9 Tips https://www.reviewengin.com/unhustled-6-figure-freedom-review/

    ReplyDelete
  7. Knowing These 10 Secrets Will Make Your The Kibo Code Review Look Amazing https://www.reviewengin.com/the-kibo-code-review/

    ReplyDelete
  8. You could say, then, that agile marketing is more of an attitude than a strategy. We put your website to work with a mix of internet marketing services that drive new prospects. But you can more add tracking guidelines to your marketing plan if you see the need to. You may also want to include a template that your team or client can follow, to ensure that the right metrics are being tracked. These loans allow you to strike a balance between your Business fund and company capital fund by providing investment that can be repaid in instalments. Shopper marketing is designed to influence consumers at every level. Just as it sounds, personalised marketing revolves around creating bespoke messages for customers. Marmite has a consistent brand message that we'll either love their product or hate it. This is a company that demands we take up a position. For some people, it means marketing product features effectively. This guide will show you how to successfully promote your brand, attract more qualified leads, and nurture customer relationships through content marketing.

    Marketing should be telling stories, not selling products. The information you gather in your research will help you define your marketing strategy and create an advertising campaign. If you have creativity this could be one of the best online business ideas without any investment. Video marketing is the use of video to advertise a product or service. Likewise increasing your social proof (e.g., showing testimonials of past clients who were satisfied with your company) will nearly always boost conversions and sales. Dr Anita Basalingappa is a professor in Marketing and Chairperson of Online Programs at MICA. 46) Online flight booking services - For this business; you do not need to get the required IATA certificate. Learn Advanced Digital Marketing strategies to take your business to new heights. Retargeting - Contacting existing or potential customers after they have already had an interaction with your brand to get them to come back or convert into a sale. Don't allow your customers to fall behind and keep in mind that by reaching the full potential of your audience, you are effectively creating a stronger ROI. https://www.reviewengin.com/7-places-to-sell-website-for-huge-profits/

    ReplyDelete
  9. Believing These 8 Myths About Niche Profit Fast Track Keeps You From Growing https://www.reviewengin.com/niche-profit-fast-track-review/

    ReplyDelete
  10. Apply These 8 Secret Techniques To Improve Kindle Cash Flow Review https://www.reviewengin.com/kindle-cash-flow-review/

    ReplyDelete
  11. If you know the courses that help you make money, Kibo Code is one of them. I mean the Kibo code is a very profitable course for e-commerce companies. It is unique and highly predictable due to the business strategies presented in the course. Read this Kibo Code Review carefully so that you can make an easy decision of whether to register in the Kibo Code System or not

    ReplyDelete
  12. If you know the courses that help you make money, Kibo Code is one of them. I mean the Kibo code is a very profitable course for e-commerce companies. It is unique and highly predictable due to the business strategies presented in the course. Read this Kibo Code Review carefully so that you can make an easy decision of whether to register in the Kibo Code System or not

    ReplyDelete
  13. Learn tally from a renowned institute. High technologies Solutions provides the best tally training in Delhi and Noida with 100% placement help. Trainers are subject specialist having 5+ years experience. For free demo class call at +919311002620.
    Tally training institute in delhi
    Tally training institute in Noida

    ReplyDelete
  14. Thank you for your excellent article. I feel good about your article.
    slotxo

    ReplyDelete
  15. Thank you so much for this nice information. Hope so many people will get aware of this and useful as well. And please keep update like this.

    Text Analytics Software

    Data Scraping Tools

    ReplyDelete
  16. Grow your career with Python in machine learning. High technologies solutions is the best Python training institute in Delhi and Noida with 100% placement help. 5+ years experienced trainers.Join now!! Call at +919311002620.
    Python with machine learning training in delhi
    Python with machine learning training in Noida

    ReplyDelete
  17. Business Analytics Certification Course Overview
    The Professional Certification in Business Analytics is a foundation course for students and professionals who want to develop niche data skills for their chosen industry domain or function area. Become a Business Intelligence and Data Visualisation expert and surge ahead in your career. The nine-day Business Analytics certification course covers all the essential Analytical and Statistical techniques for effective business decision making. This programme introduces the student to the basic concepts of Python language.
    business analytics course

    ReplyDelete
  18. Thank you so much for this nice information. Hope so many people will get aware of this and useful as well. And please keep update like this.

    Text Analytics Software

    Data Scraping Tools

    ReplyDelete
  19. Sites like Flippa give you a huge opportunity to find great websites which you buy for a small amount and later resell for a huge amount It completely depends on how good you are at picking the right kind of sites that have potential to make more money in the future. I have tried and worked on most of these online jobs however I still feel that blogging is still no 1 online business. But i make money primarily through affiliate marketing and sponsored post. Some people create and build out websites with the sole goal of selling them for a profit as soon as they can. You can basically create an online course Udemy on literally any topic that you specialize and get paid forever after as users enroll and take your course. Whenever we talk about earning cash online, we also understand there is some kind of time commitment also required. https://www.reviewengin.com/how-media-buying-will-help-you-to-make-money-online/

    ReplyDelete
  20. Fox School Of Business

    Economists will debate the merits of inflation at this point in the economic cycle. This can be an effective way of testing and of course it is much quicker than watching the prices in a demo account to wait for a trading opportunity to arise. The FX Nuke Trading System provides traders with the most accurate signals. Foreign exchange trading was once something that people only did when they needed foreign currency to use when traveling in other countries. As we already said in this ND10X review, the Forex market is a kind of remote trade market. Every trade you make ought to be excellent because the software program never ever makes a mistake.

    Foreign exchange trading can attract unregulated operators. While the forex OTC market is decentralized, it is massive, with data from a 2019 Triennial Central Bank Survey of Foreign Exchange showing that more than $6 trillion worth of currencies trade each day. Plus, you can trade on our proprietary Trading Station, one of the most innovative trading platforms in the market. Tradeology blogreview: ‘the predator' is b-grade action motion picture fun. You may also require stop-losses to protect your account in case you lose some trades.

    This will be ample enough for you to take trades and grow your account steadily over time. For all account types on the MT4 and MT5 platforms, the leverage for EURDKK, EURHKD, GBPDKK, USDDKK, USDHKD, USDCNH, EURRUB and USDRUB is capped at 1:50, and for USDTRY, EURTRY it is capped at 1:100. Main foreign exchange market turnover, 1988-2007, measured in billions of USD. The constant stream of webinars helps you to keep up with the market and make informed decisions on your trades. That is the kind of Immortal Wealth” instant information made possible even back then… And with the Scientific Trading Machine you now get the information you need to make money in a Nanosecond.

    It is a simple price action trading system, designed to capture the breakout of the high and low of the 2nd-hour candlestick after the London forex market opens. As Forex trading can be an income-generating activity, it's important to treat your trading as a business activity - one where you consider both how to maximise your income, how to minimise your costs, and how to minimise the risks. Forex master level will teach you everything about the forex market and how to make money from it. This course was developed to accommodate a wide range of experience levels, including the more novice traders.

    To trade forex, you need an online broker. ND10X by Tradeology is a one-time investment that can help you to get rid of the brokers and boost your profit. It's perfect if you're new to trading and want to learn by copying other professional traders. It is also about how traders are trying to escape from it so persistently. Since the introduction of an interbank foreign currency market in February last year, the central bank has exercised control over forex trading. Tradeology claim that forex profit boost can be victimised on any pair, and traded with success on any time frame.

    Many Forex trading beginners are also tempted to purchase FX robots, also known as Expert Advisers (EAs) While some EAs can be helpful, it can be hard for them to remain profitable when the market changes. A forex platform with zero-commission trading is preferable. Above all else, it is important to realize that the only way to really make a determination as to which Forex trading system is best for you is to actually experiment with a wide variety of different systems to see what kind of results you get. https://www.reviewengin.com/infinite-profit-system-review/

    ReplyDelete