How does one choose the perfect HTTP Client? The Ruby ecosystem offers a wealth of gems to make an HTTP request. Some are pure Ruby, some are based on Ruby's…

In this article, we will take a look at how to automate form submission using Puppeteer. Puppeteer is an open source Node library that provides a high-level API to control…

There are many ways that businesses and individuals can gather information about their customers and web crawling and web scraping are some of the most common approaches. You'll hear these…

In this article, we will take a look at how to block specific resources (HTTP requests, CSS, video, images) from loading in Puppeteer. Puppeteer is one of the most widely…

Data parsing is the process of taking data in one format and transforming it to another format. You'll find parsers used everywhere. They are commonly used in compilers when we…

A POST request is a particular type of HTTP method used when we send data to services on the web. We use them on web sites that use forms -…

In this article, you will learn how to use the command line tool cURL to transfer data using a proxy server. A proxy server acts as a middleman between a…

For any project that pulls content from the web in C# and parses it to a usable format, you will most likely find the HTML Agility Pack. The Agility Pack…

Web scraping is automating the process of data collection from the web. This usually means deploying a “crawler” that automatically searches the web and scrapes data from selected pages. Data…

IntroductionWorking with images in Python gives you a range of development capabilities, from downloading image with an URL to retrieving photo attributes. But, how exactly can you get access to…