WEBVTT

00:00.230 --> 00:07.700
So let's see how we can develop a scraper without actually making a request on the site all of the time,

00:07.700 --> 00:14.720
hence lowering the amount of demands we make on the site and lowering the risk of getting banned on

00:14.720 --> 00:17.330
a site if we're trying to make a scraper for it.

00:17.480 --> 00:20.470
So I'm going to make a directory here.

00:20.480 --> 00:30.950
Let's call it CD scraper, and then I'm going to go inside the directory and initialize NPM.

00:32.820 --> 00:33.750
NPM init.

00:33.780 --> 00:34.080
Dash.

00:34.080 --> 00:34.380
Dash.

00:34.380 --> 00:34.950
Yes.

00:35.280 --> 00:39.660
Then I'm going to open it up inside of Visual studio code.

00:39.900 --> 00:44.610
First, let's go ahead and import the packages that we need for this project.

00:44.610 --> 00:53.640
So go inside the terminal and in here I will add Cheerio request and request promise.

00:54.240 --> 01:01.980
And then we're going to add a new package that you haven't seen before, which is called chest and chest

01:01.980 --> 01:12.060
is a test runner or a test framework that is built by Facebook, just like Facebook has built React

01:12.060 --> 01:13.890
for the Facebook app.

01:14.190 --> 01:22.860
And they also have built a chest testing framework for JavaScript and it's usually associated with React,

01:22.860 --> 01:27.720
but you can also use it as they write here for Node Angular and Vue.

01:28.970 --> 01:35.900
So it's basically going to run our test and deliver a testing framework that we can write test in.