BY CATEGORY
VBA CATEGORIES
VBA - SCRAPING WEBSITES VIDEOS
VBA - scraping websites videos | Excel VBA Part 48 - Scraping Multiple Web Pages
Posted by Andrew Gould on 17 November 2016
What's better than scraping one web page? Scraping lots of them with the same procedure, of couse! This video explains how to loop over multiple pages using Microsoft's HTML and XML object libraries. You'll learn about HTML tags and classes, the Document Object Model and how to loop over elements on a page.
You can download any files that you need to follow the video here.
You can increase the size of the video:
You can view the video in full screen mode as shown on the left, using the icon at the bottom right of the frame.
You can also increase the quality of the video:
You can improve the resolution of the video using another icon at the bottom right of the frame. This will slow down the connection speed, but increase the display and sound quality. This icon only becomes visible when you start playing the video.
Finally, if nothing happens when you play the video, check that you're not using IE in compatibility view.
Thank you sir for your tutorials
please help me, i'm trying to run your example code, but it gives me error "access denied",
how can I solve this kind of error?
Hi, the most likely reason for the error is that the Wise Owl website has been updated to use https rather than http since the video was made. You should be able to replace any reference to "http" in the code to "https" to solve the problem.
I hope that helps!
Viewed Video #47 on youtube.
Any plans to expand on XHR in Excel VBA, especially with session cookies?
There aren't, I'm afraid!
Please could you point in the direction of any instructional material or course or video that details only XHR and session cookies within an Excel VBA environment?
'Fraid i don't know of any, beyond Googling!
Hi Andrew,
Thank you so much for the 3 videos about Web scraping. It did guide me a lot on how to identify HTML code. Your approach is great. I seem unable to find any routine of auto login (username, password) to web site via VBA code.
Greetings,
Dude6571
Hi, we don't have a video on how to do this but there are plenty of suggestions out there for ways to do this:
https://stackoverflow.com/questions/48919491/login-to-a-website-using-vba
https://stackoverflow.com/questions/21244051/using-vba-to-automate-ie-login-having-errors
https://stackoverflow.com/questions/24038230/fill-user-name-and-password-in-a-webpage-using-vba
Of course the exact technique you'll use will depend on the page you're using to login but hopefully that's enough to point you in the right direction!