Hi All,
I come from a programming background and have built many custom web scrapers over the years. I just wanted to add some information and clarity that some might find useful.
Selenium (which has been mentioned a lot here) is an automated web browser that can be programmed to navigate to certain URLs, fill forms, click buttons, etc. In my experience, I would only use Selenium if the site produces dynamic content within a single page.
If you are looking to build a web scraper on your own, Python is the probably the best choice -- especially if you are new to programming. it has packages built to use Selenium. It also has packages for making the web requests (requests) and for parsing the HTML of the webpages (BeautifulSoup, lxml, etc.).
I would become familiar with the webpage you are targeting by inspecting the HTML, which can be done in any web browser by clicking CTRL+U, and/or by using your browser's web developer tools -- in Chrome, you can access this by clicking CTRL+SHIFT+I.
Good luck and happy scraping!
-Dylan