Is it possible to make a script to automate that web scraping scenario?
I need a script to automate the following web scraping process:
-
Use search filter on the webpage by entering a pre-given ID in a TextInput field.
-
Mark one of the listed results by clicking an icon next to it.
-
Press a button and wait for a data fetching process to complete
-
Extract HTML embedded text from the fetched data.
Answer
For Python I would recommend:
Selenium: Selenium is a web testing library. It is used to automate browser activities.
BeautifulSoup: Beautiful Soup is a Python package for parsing HTML and XML documents. It creates parse-trees that are helpful in extracting data easily.