Hello Guys,

I am looking for web scraping/automation tasks I will do to enhance my knowledge in this field. So feel free to comment on this thread if you have any site to scrape leads from or drop your contact.

VinCheckr:
Hello Guys,

I am looking for web scraping/automation tasks I will do to enhance my knowledge in this field. So feel free to comment on this thread if you have any site to scrape leads from or drop your contact.

WhatsApp me 070301SixOne207

Ntwrk:

WhatsApp me 070301SixOne207

If you can scrap people search site, it then means there is not site on earth you would find difficult to scrape

If you can scrape people search sites, there is no site you would find difficult to scrape

DataMina:
If you can scrape people search sites, there is no site you would find difficult to scrape

What do you mean by people search sites? Please give an example.

Ok try scrap googlenews

mundi111:
Ok try scrap googlenews

That is easy, what to do with the news.

VinCheckr:

That is easy, what to do with the news.

Visit the top 10 news links and get the news content into like a text file for each news also name each file after the news heading

VinCheckr:

What do you mean by people search sites? Please give an example.

They are US site you have to use VPN to access. You can access people's private phone numbers and emails from there. Sites such as that always throws recapchta issues

mundi111:

Visit the top 10 news links and get the news content into like a text file for each news also name each file after the news heading

Done


https://www.youtube.com/watch?v=MhrbcxxfQTM

DataMina:

They are US site you have to use VPN to access. You can access people's private phone numbers and emails from there. Sites such as that always throws recapchta issues

There are 3rd party solutions that solves recaptchta, I can try my luck if you can give an example.

I need more tasks to do.

VinCheckr:

There are 3rd party solutions that solves recaptchta, I can try my luck if you can give an example.

Truepeople search.com . Also ensure you use clientgatevpn because it seems that's the only type of vpn that works

[b]Build a web crawler: [/b] Create a script that automatically crawls through websites, following links and extracting data from various pages. This is a great way to explore large websites and discover hidden information.
Automate data cleaning and processing: Develop scripts that can automatically clean and format scraped data, making it ready for analysis or visualization.
Build a real-time data dashboard: Combine your scraping skills with data visualization tools to create a dashboard that updates with the latest data in real-time. This could be anything from a live news feed to a stock market tracker.

Robertwillson65:
[b]Build a web crawler: [/b] Create a script that automatically crawls through websites, following links and extracting data from various pages. This is a great way to explore large websites and discover hidden information.
Automate data cleaning and processing: Develop scripts that can automatically clean and format scraped data, making it ready for analysis or visualization.
Build a real-time data dashboard: Combine your scraping skills with data visualization tools to create a dashboard that updates with the latest data in real-time. This could be anything from a live news feed to a stock market tracker.

I asked for a task not a project.

DataMina:

Truepeople search.com . Also ensure you use clientgatevpn because it seems that's the only type of vpn that works

Nice one.

VinCheckr:
Hello Guys,

I am looking for web scraping/automation tasks I will do to enhance my knowledge in this field. So feel free to comment on this thread if you have any site to scrape leads from or drop your contact.

Scrap m.forebet.com for me on US basketball. Lastest first three months.

Beautifulday:


Scrap m.forebet.com for me on US basketball. Lastest first three months.

Be more specific, can't find US basketball on that site. What specific info you want to be scraped?

VinCheckr:


Be more specific, can't find US basketball on that site. What specific info you want to be scraped?

NCAA is college basketball division in USA.

The name of the teams, prediction percentage, prediction scores for at least 3 months. Any other relevant info you may get.

DataMina:

Truepeople search.com . Also ensure you use clientgatevpn because it seems that's the only type of vpn that works

I was able to access the truepeoplesearch website with a proxy now, kind of old user interface and very easy to scrape. In my opinion the data in this site is incorrect more of auto generated junk.

VinCheckr:

I was able to access the truepeoplesearch website with a proxy now, kind of old user interface and very easy to scrape. In my opinion the data in this site is incorrect more of auto generated junk.

Were you able to access the one I sent you?

Beautifulday:


Were you able to access the one I sent you?

Really I tried but I didn't understand the site's navigation, not used to betting sites.

VinCheckr:

Really I tried but I didn't understand the site's navigation, not used to betting sites.

Ok

VinCheckr:

Done


https://www.youtube.com/watch?v=MhrbcxxfQTM

Just remembered one site I tried once can you scrap statarea.com extract the team names home/ away then the percentage of and 2.5 goals put into an excel file or csv

mundi111:

Just remembered one site I tried once can you scrap statarea.com extract the team names home/ away then the percentage of and 2.5 goals put into an excel file or csv

I am not into betting, I don't understand where the teams are and all those stuffs you wrote above.

VinCheckr:


I am not into betting, I don't understand where the teams are and all those stuffs you wrote above.

it not a betting site it a data site but built a little bit complicated it just a table

mundi111:
it not a betting site it a data site but built a little bit complicated it just a table

It is a very simple website, nothing much just that I dont understand the info you want. I did something, check if it is what you want.

VinCheckr:

It is a very simple website, nothing much just that I dont understand the info you want. I did something, check if it is what you want.

You did exactly what I was talking about only missing the BTS field have you thought about implementing the automation aspect of you are in chat me up on WhatsApp because I sometimes miss this update here o7o666o5222

More tasks needed

Are you on telegram??

CHRISTFUCKER:
Are you on telegram??

Yes I am on TG, you can drop your id but it will be nice to give a hint on the task here so that I know if I can do it.

VinCheckr:


Yes I am on TG, you can drop your id but it will be nice to give a hint on the task here so that I know if I can do it.

Tochi2