₦airaland Forum

DataMina:
I can scrap Jiji for phone numbers but the validation on Whatsapp is what I don't know about

That's also a good one if it can scrape

BlackhatMentor:
A scrapper that scrapes emails, phone numbers with their usernames will be better.

This one u did isn't very useful

Bro can u help in getting leads for an affiliate targeted niche adverts?

alterego17:
Bro can u help in getting leads for an affiliate targeted niche adverts?

Sure it's very much doable. I have been able to write a scraper that scraps leads/ phone number from Jiji. The project is in my GitHub and I would be dropping how I was able to do the project here very soon

alterego17:
Bro can u help in getting leads for an affiliate targeted niche adverts?

From which website

BlackhatMentor:
From which website

It's for an affiliate product I'm promoting

Babangidapikin:
Good for practice, can you scrap LinkedIn for email address.

Yes I can, that's not an issue. I usual go through the Google route after which I use regex and data wrangling techniques to clean and extract the emails

DataMina:
Yes I can, that's not an issue. I usual go through the Google route after which I use regex and data wrangling techniques to clean and extract the emails

Won't that be stressful

DataMina:
Yes I can, that's not an issue. I usual go through the Google route after which I use regex and data wrangling techniques to clean and extract the emails

Did somebody say REGEX!

Regex:
Did somebody say REGEX!

Your username means regular expression here in this domain. Lol

Can this scrapper give me clean scrapping just like I scrapped jobs from relocate.me here - https://afrkd.ng/1mWQyw ?

Maxxim:
Your username means regular expression here in this domain. Lol

That thing show me shege...😂

Regex:
That thing show me shege...😂

Na your fate, you're not getting off anytime soon😂

Maxxim:
Na your fate, you're not getting off anytime soon😂

Na why I say make I answer am.

Regex:
Na why I say make I answer am.

Naso boss

The good news is that chatgpt can generate regex now for the lazy minds

africoders18:
The good news is that chatgpt can generate regex now for the lazy minds

No need. Nature already generated me...🌚

africoders18:
Can this scrapper give me clean scrapping just like I scrapped jobs from relocate.me here - https://afrkd.ng/1mWQyw ?

Seems the website is JavaScript rendered. Selenium can be used here as well

jbrennaniii91:
Scraping LinkedIn for emails is a serious challenge these days, I’ve tried it a few times just for research. LinkedIn is especially tough since they block bots fast and use all kinds of anti-bot systems, including persistent captchas. I tried Selenium and some headless browsers, but you spend half your time troubleshooting blocks and the rest trying to parse messy data. Even when you try clever stuff like using Google dorking to find cached profiles, you barely get anything useful before hitting a wall.

I have a way of scraping targeted linkedin emails. If you have a good paying deal for it let me know

DataMina:
Hello everyone. I am a data analyst who enjoys webscraping. Nairaland has been my go to place to keep up with trending news asides Twitter, and being a lover of this platform I decided to build a webscrapper with Selenium and Python.

This scraper is designed to extract the thread topics the count of views, users, and guests from Nairaland.

The Scraped data can be used to develop a power bi report that can be refreshed each time Scraping is done. The published dashboard can be used to morning threads that generate the highest and lowest views. You can check out the project in my GitHub repository:https://github.com/StephDAnalyst/Nairaland

I need your services. Please, how can we chat up privately?

DataMina:
I use a different trick to do it. If you need the service you can let me know

I need your services ooo. But I need it to scrape phon numbers, names and emails. Can you do it. How can I reach you?

airsaylongcome:
Ehhhh...what's the point? How about the OP learning? How about having a visual Dashboard instead of Nairaland bland numbers only without any visual perception of how those numbers compare? I don't get up and make random comments. But to say the OP's work isn't useful is absolutely not correct. It is useful. I find it useful and I'm sure there are loads and loads of non-data science or data engineering folks that will find it very useful

I will like you to teach me how you scrap the data from the website.

airsaylongcome:
OP,

Is it possible to do the "impossible"? Scrape the entire site's content and dump in an LLM

I did this. Trained a tiny LLM on nairaland data sets from 2017-2023 where nairaland users were too political. Ran a bot to demonstrate it in action and it came with multiple bans.


Well-done seun for banning my bot .

I’ve built similar scrapers, and your approach feels clean and easy to tweak if Nairaland changes its layout. I usually keep small helper functions for pagination so things don’t get messy. Side note: while doing outreach projects, I’ve used a youtube email scraper, and having structured data ready to plug into tools like that makes life smoother.

I’ve built similar scrapers, and your approach feels clean and easy to tweak if Nairaland changes its layout. I usually keep small helper functions for pagination so things don’t get messy. Side note: while doing outreach projects, I’ve used a youtube email scraper, and having structured data ready to plug into tools like that makes life smoother.