>set up express server and scraper

0xTony143 answered on May 24, 2022 Popularity 4/10 Helpfulness 2/10

answer >set up express server and scraper

>set up express server and scraper

Comment

const PORT = 8000;
const express = require('express');
const axios = require('axios');
const cheerio = require('cheerio');

const app = express();

const articles = [];

app.get('/', (req, res) => {
    res.json('Welcome to my Climate Change News API')
})

app.get('/news', (req, res) => {
    axios.get('https://www.theguardian.com/environment/climate-crisis')
        .then((response) => {
            const html = response.data
            const $ = cheerio.load(html)

            $('a:contains("climate")', html).each(function () {
                const title = $(this).text()
                const url = $(this).attr('href')
                articles.push({
                    title,
                    url
                })
            })
            res.json(articles)
        }).catch((err) => console.log(err))
})

app.listen(PORT, () => console.log(`server running on PORT ${PORT}`));

Popularity 4/10 Helpfulness 2/10 Language javascript

Source: Grepper

Tags: express javascript scraper server

Link to this answer
Share Copy Link

Contributed on May 24 2022

0xTony143

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

>set up express server and scraper

Contents

More Related Answers

>set up express server and scraper

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.