This code imports puppeteer for web scraping. It creates a schema with date, subject and contractor and pushes it into mainData array. It also writes data from mainData array to a json file.
- Node
- Puppeteer
- Clone this repo
git clone https://github.com/thisisyashgarg/nodejs-crawler.git
- Install npm
npm init -y
- Install dependencies
npm i puppeteer
npm i dotenv
- Finally, run the code
node index.js
The output of this program will be a JSON file containing arrays of objects, each with the data of date, subject and contractors.