Web Scraping with AutoHotKey 108- use querySelctorAll for added flexibility

Web Scraping with AutoHotkeyWeb Scraping with AutoHotkey is fun and easy however some web pages don’t have Names, IDs, or classNames set up.  Other times the pages are pretty sophisticated and you want to grab something very specific (w/out writing a lot of code).   I recently learned about QuerySelctor which uses the CSS Selector.

This W3schools page has a great, dynamic tool, that is very helpful to understand what is being grabbed.  Here is a screenshot of clicking around on the above tool which will help you get the concept.
Web Scraping with AutoHotkey QuerySelectorAll

Below is a video documenting various method calls.

Web Scraping with AutoHotkey Tutorial 8- QuerySelectorAll

Web Scraping 8 QuerySelectorAll-2

And lastly here is the script I used walking through the video.

 

Web Scraping with AutoHotKey 107- using ClassName

web scraping with AutoHotkeyWhen I did my original posts on web scraping with AutoHotkey, I was unaware of ClassName  (getElementsByClassName).

About a year ago I was speaking with Jackie Sztuck from http://jszapp.com (BlackHolyman on the AHK forum) and he introduced me to ClassName.  In the past year I’ve really come to rely on it as my “go-to” for grabbing specific values from a page.   If Name or ID are present I’ll still use them however more and more sites don’t take the time to provide them.

This video demonstrates a few examples where I grab the ClassName.

Web Scraping with AutoHotkey– ClassName

Web Scraping with AutoHotKey 107- Classname

 

Web Scraping with AutoHotKey 106- Web Scraping multiple pages

Web Scraping multiple pages

 Web Scraping multiple pages

Example of how to Web Scraping multiple pages with some simple URL manipulation.  This is where being able to make sure you’ve loaded a page fully, scrape it, then navigate to the next is critical.  Looking for patterns in the URL will help you understand how you’ll be able to navigate to the next page.

A copy of the AutoHotKey syntax writer can be found here.  Remember patience is a virtue and Happy Scraping!

Webscraping with AHK 106- Looping over pages

Business Objects- Creating alerts to alert your query is done executing

Business ObjectsSAP Business Objects doesn’t make it easy to know when the query is completed running (at least not while you’re working on something else). I wrote an AutoHotKey script to alert me it is completed running (and boy does it alert me! LOL).

This way I can put BO in the background and continue working on other tasks.  When the query is complete, I get both a visual and audio alert informing me it is complete.

I had a hard time “hooking” into Business Objects but I was able to monitor status bar to see when it changes/updates.

Video showing Business Objects Alert

Alerts in Business Objects