Selenium automates browsers. The selenium module can make the browser do anything you want including automated testing, automating web tasks and data extraction. In this article we’ll use it for data mining, extracting the links from a web page.
Install it using:
pip install selenium
To use the module, you need a selenium web driver. All the popular browsers are supported including Chrome and Firefox.
After installing the web driver, you may need to add it to path:
Test if selenium is installed correctly using:
Depending on your setup, you can start it without parameters:
To get links from webpage, use the code below: