Data Scraping Of Jumia Product Using Selenium And Flask In An API Format - Programming

Data Scraping Of Jumia Product Using Selenium And Flask In An API Format - Programming - Nairaland

Nairaland Forum › Science/Technology › Programming › Data Scraping Of Jumia Product Using Selenium And Flask In An API Format (684 Views)

1 Reply (Go Down)

Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote(op): 11:01am On Mar 25, 2024

In time of high cost of goods we can leverage the deal of scraping different product and compere the price to get the best deal out of everything. Building data acquisition and transformation pipelines. Leave a star grin

https://github.com/Arinze1020/jumia_market_scraper

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by ShoeGetSize: 11:14am On Mar 25, 2024

Isn't this illegal?

1 Like

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote(op): 11:47am On Mar 25, 2024

ShoeGetSize:
Isn't this illegal?

You can scrap check their robots.txt file check the git link everything is there.

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Felixitie(m): 9:34pm On Mar 27, 2024

This is cool bro.

Why not just use BS4 only instead of starting with selenium, since bs4 is faster and lighter, also considering the fact that the jumia site is not dynamically loaded by Javascript.

1 Like

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by airsaylongcome: 10:32pm On Mar 27, 2024

ShoeGetSize:
Isn't this illegal?

How is scrapping illegal?

1 Like

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote(op): 1:19pm On Mar 29, 2024

Felixitie:
This is cool bro.

Why not just use BS4 only instead of starting with selenium, since bs4 is faster and lighter, also considering the fact that the jumia site is not dynamically loaded by Javascript.

They have Javascript which I have to load first. Using only BS4 won't get me the data I needed.

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote(op): 1:20pm On Mar 29, 2024

airsaylongcome:
How is scrapping illegal?

In most case it's illegal, but you just have to look up the robots.txt file to see what the site allows and what they don't allow.

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Felixitie(m): 11:06pm On Mar 29, 2024

Mrquote:
In most case it's illegal, but you just have to look up the robots.txt file to see what the site allows and what they don't allow.

I doubt if it is illegal to scrape . Site owners are only scared of the effect of bombarding their site with series of request on their website. So, The way you make use of the data you finally scraped makes it illegal or legal!

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by CORPSEFUCKER: 5:09am On Mar 30, 2024

Based Chad

Selenium is only for chads

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote(op): 12:50pm On Mar 30, 2024

CORPSEFUCKER:
Based Chad

Selenium is only for chads

What do you mean by chad?

Re: Data Scraping Of Jumia Product Using Selenium And Flask In An API Format by Mrquote(op): 12:51pm On Mar 30, 2024

Felixitie:
I doubt if it is illegal to scrape . Site owners are only scared of the effect of bombarding their site with series of request on their website. So, The way you make use of the data you finally scraped makes it illegal or legal!

In all that's why you have to read their robots.txt

1 Reply

Does Opay Have An Api • How To Retrieve Data From An Api Using Fetch Api In Javascript • Django And Flask Users, Your Help Is Needed Please • 2 • 3 • 4

How To Find Doordash Promo Codes On Reddit • I Want To Fund My UBA USD Prepaid Card • Edited