Serverless is a term referring to the execution of code inside ephemeral containers (Function As A Service, or FaaS). It is a hot topic in 2019, after the “micro-service” hype,…

list. Then we will iterate through this list, and for each item select title, the URL, author etc with a relative Xpath and then print the text content or value.HackerNewsScraper.javaHtmlPage…

IntroductionFor those of you who don't know, Hacker News is a successful social news website focusing on computer science and entrepreneurship visited by more than 10m people per month (source:…

Most modern websites use a client-side JavaScript framework such as React, Vue or Angular. Scraping data from a dynamic website without server-side rendering often requires executing JavaScript code.I’ve scraped hundreds…

Why node-fetch?Node-fetch is a popular HTTP client library, with around twenty million downloads per week; according to NPM, it is also one of the most downloaded NPM packages of all-time.Node-fetch's…

Charles proxy is an HTTP debugging proxy that can inspect network calls and debug SSL traffic. With Charles, you are able to inspect requests/responses, headers and cookies. Today we will…

The introduction of the Fetch API changed how Javascript developers make HTTP calls. This means that developers no longer have to download third-party packages just to make an HTTP request.…

You can find elements by CSS selectors in Selenium by utilizing the find_element and find_elements methods and the By.CSS_SELECTOR argument.find_element returns the first occurence of the CSS selector being used,…

You can find elements by XPath selectors in Selenium by utilizing the find_element and find_elements methods and the By.XPATH argument.find_element returns the first occurence of the XPath selector being used,…

You can save and load cookies in Selenium using the get_cookies method of the web driver object and the pickle library.Here is some sample code to save and load cookies…