Urgent Please Who Is Into Python Web Scraping. - Programming - Nairaland
Nairaland Forum › Science/Technology › Programming › Urgent Please Who Is Into Python Web Scraping. (369 Views)
| Urgent Please Who Is Into Python Web Scraping. by Hope2014(op): 8:17am On Sep 23, 2022 |
Please I am also a web scraper using python.but this particular site is rejecting many proxies. Out of a list of 400 only one works rarely and it is a cron job to scrape once every hour. i am using some daily and hourly updated proxies on some GitHub repos. Please if you know any list of free proxies that can help, I will gladly pay. |
| Re: Urgent Please Who Is Into Python Web Scraping. by Hope2014(op): 8:18am On Sep 23, 2022 |
I think the issue if the url is deep inside the site with many filters according to the client wish. |
| Re: Urgent Please Who Is Into Python Web Scraping. by Hope2014(op): 8:19am On Sep 23, 2022 |
I would have paid for premium proxies but the trial ones I was given all have me 403 error, so I lost faith in it. |
| Re: Urgent Please Who Is Into Python Web Scraping. by hostman: 8:50am On Sep 23, 2022 |
Hope2014:Trial proxy given u 403 error doesn't mean their premium will also give 403, I have encountered this many times, try websharedotio, you can get 100 premium proxies as low as $2.99 |
| Re: Urgent Please Who Is Into Python Web Scraping. by Hope2014(op): 9:14am On Sep 23, 2022 |
hostman:Okay I will do it |
Unleash Playwright On Replit - Python Web Automation Made Easy! • Integrating AI Into Python Pandas Using Sketch. • Jumia Black Friday Web Scraping Program • 2 • 3 • 4
How To Gain A Free Computer Science And IT Degree. • How To Design A Crypto Investment Website - Part 2 • Simulation Hypothesis And Simulation Reality