Web Scraping

Web Scraping with AutoHotkeyWeb Scraping with AutoHotkey is an incredible asset to have at your disposal.  One of my favorite things to do with it is Web Scraping & Pasting.  This page links to the tutorials I have walking through how to get started with Web Scraping in AutoHotkey.  I also have added a lot of example links of work I’ve done (to help stimulate ideas)

Right now I’m only using IE because I’m relying on COM however I’ve been working with Selenium which will allow automating any browser.

Before watching my videos I highly recommend you familiarize yourself with the DOM (Document Object Model) by watching these videos:

  1. What is the Document Object Model Lynda.com video
  2. Manipulating the Document Object Model in JavaScript
  3. Introduction to Document Object Model

Don’t forget to download my Web Scraping AutoHotkey syntax writer and here is a link to the iWB2 Learner tool.  Check out my review of use various developer tools (and have three versions of the iWB2.)

Web Scraping with AutoHotkey

1) Intro Pointer, Get values & Page Navigation
1.5) Intro Troubleshooting & getting correct content from page
2) Intro Set values & clicks / Buttons
3) Intermediate Isolating area & leveraging the DOM/HTML
4) Advanced Dealing with Frames
5) Intro Troubleshooting tips
6) Intermediate Loop over pages & extract data
7) Intermediate Web scraping with AutoHotkey using ClassName
8) Intermediate Webscraping using QuerySelector & QuerySelectorAll
9) Intro Webinar on Intro to Web Scraping
10) Intro Update to Web Scraping Syntax Writer

 

 

Videos and scripts to Login to Websites:

  1. Login to Facebook This first video is much longer & in-depth!  I cover many of the reasons why I pick one method over another.  I also have HellBent sit-in and ask questions so it should be a great starting point for noobs to Web Scraping.
  2. Login to Amazon
  3. Login to LinkedIn
  4. Login to Gmail / Google / YouTube
  5. Login to Pinterest
  6. Login to Twitter
  7. Login to Reddit

Examples of work automated via Web Scraping with AutoHotkey

  1. Submit StumbleUpon submissions
  2. Transfer data from one website/system to another
  3. How I exported over 4 million contacts from Lexis Nexis
  4. Extract status from SharePoint and email colleagues
  5. Select “x” number of items on website form
  6. Obtain Behavioral Targeting Data from your own Web Site
  7. Determine House status on Real Estate site
  8. Extract meta data about videos from website

Comments are closed