Nairaland Forum

Welcome, Guest: Join Nairaland / Login / Trending / Recent / New
Stats: 1274194 members, 1751513 topics. Date: Wednesday, 26 November 2014 at 08:46 AM

Did/does This Site Scrape Nigerian Newspaper Websites? - Webmasters - Nairaland

Nairaland Forum / Science/Technology / Webmasters / Did/does This Site Scrape Nigerian Newspaper Websites? (452 Views)

Punch Newspaper Website Free Again? / Which Software/script Do Newspaper Websites Use? / What Do You Think Of Nigerian Newspaper Sites? (1) (2) (3) (4)

(0) (Reply) (Go Down)

Did/does This Site Scrape Nigerian Newspaper Websites? by Nobody: 7:10pm On Dec 18, 2012
Have a look at the web site below and explain what is going on. For me I think they scraping the sites with perl and most of these newsmedia do not have the expertise to find out. What do you think, I may be wrong
http://www.nigeriaworld.com/
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by JideTheBlogger(m): 12:20pm On Dec 19, 2012
I am seeing the list of the sources on the sidebar
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by soloqy: 1:19pm On Dec 19, 2012
Oh well, they are just aggregating news from Nigerian news media sites(This can be done with RSS readers or some custom aggregators). They are not claiming to be the source of the news because when you click on any news item, the logo, name and menu links of the website the news originates from , shows and you can choose to move there.

I dont think the websites would mind. Its also a source of traffic to those sites.
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by yawatide(f): 1:34pm On Dec 19, 2012
I would say they are scraping. I think it is obvious. Scraping isn't good for the "scrapee" because server resources are being consumed unnecessarily. Also, the scrapee is losing out on potential ad revenue that would have accrued to them if that site had sent the traffic over to them instead.

I once worked for a company where we had an entire department devoted to detecting scrapers (even MSFT was scraping from us!). Once found, they would block their IP. One person went as far as suggesting that once detecting, we should send a worm out on their site as punishment but cooler heads prevailed.

In the case of Nigerian sites that are being scraped, it could be they either don't have copyright laws covering them or do but lack the resources to pursue. Listing their names on the site isn't enough. I have a news site, I merely provided links to those sites and still list their names as sources. Those people have spent time and money hiring people etc to gather news. I can't just use it without rewarding them. As a matter of fact, google ads won't even show up on a news aggregator website once you are found out as it violates their Ts&Cs.
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by soloqy: 2:03pm On Dec 19, 2012
^^^^

So even if they point and direct you back to the source?

A lot of news sites even make available their rss feeds for you to place on your own websites.

As long as you credit them as source and get the news item linking back or redirecting to them, they are ok with it.

I guess it depends on the company.
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by yawatide(f): 2:13pm On Dec 19, 2012
^^^ So going back to my post, though I guess I didn't make it clear (sorry about that):
Either they have copyright laws but lack the resources to pursue violations, or they don't have them or they do and these scrapers are not in violation (which I doubt).

Again, the business person in me says the scraping, even with backlinking is wrong - I am losing out on potential eyeballs and potential revenue (why visit punch online when I can go to nigeriaworld.com?) to these scrapers, while at the same time I am giving up much of my bandwidth. Now, if there is an arrangement (again, which I doubt) b/w both parties, that is a different issue and I assume it would be stated clearly on the site.

Don't get me wrong, I like going to one site and viewing news from many sources in one place. It saves a lot of time. I visit nigeriaworld daily. Having said that, every now and then I wonder about the scraping. E no too good sha.
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by soloqy: 2:46pm On Dec 19, 2012
What am trying to say is that, most online news sites(even the likes of BBC, CNN , Guardian uk, etc), provide rss links on their site asking websites/webmasters to use on their own site. Its a win for both parties in that, the webmaster can have content(or an appearance of rich content) on his site, while also redirecting traffic to the news sites/originators. There are people who dont know the web address of punch online. Those set of people while searching for news about Nigeria, may happen on the Nigeria world news items and from there gets a link to The Punch website. That would be a new converted lead for The Punch online.
On the issue of agreements, The Punch already provides a news feed here : http://www.punchng.com/feed/ . The mere fact that this is visible and available, somehow waters down the strict agreement part.
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by yawatide(f): 8:10pm On Dec 19, 2012
^^^ Sooo, a feed, where the owners actually say, "here, take news from my site and digest it or share it as you please" is different from scraping where you are doing it without the site owner's permission.

Make sense? Like 7Up, is the difference clear? tongue
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by Nobody: 4:15pm On Dec 21, 2012
Bro watch the link well, if it the source of the news says Sun Newspapers, then the link will be after visiting it odilisomething.net. Most of them do not bro provide rss feeds. check well. watch the ax.pl
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by soloqy: 8:40pm On Dec 21, 2012
oluwa12002: Bro watch the link well, if it the source of the news says Sun Newspapers, then the link will be after visiting it odilisomething.net. Most of them do not bro provide rss feeds. check well. watch the ax.pl

Ok, seen that
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by Frosti(m): 8:20pm On Dec 25, 2012
Do you guys know the biggest scrapper of them all?
Google.com
Scraps your content and sends you good traffic. What's there to hate?
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by yawatide(f): 10:14pm On Dec 25, 2012
^^^ I doubt it scrapes. When it gives you search results, you click the link to go to the particular site. This differs from scraping where a site presents another site's content as if it were theirs.
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by Afam4eva(m): 10:30pm On Dec 25, 2012
This is not illegal because most of these website allow you to subscribe to their rss feed and to put on your website.
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by yawatide(f): 12:33pm On Dec 26, 2012
^^^ Read my responses on December 19
Re: Did/does This Site Scrape Nigerian Newspaper Websites? by Afam4eva(m): 12:41pm On Dec 26, 2012
yawa-ti-de:
^^^ Read my responses on December 19
So, it has to be ascertained whether they did it the legal or illegal way.

(0) (Reply)

What CMS Would Fit An Advert Based Website? / How Do I Create A Comment Box. Like What You Have On Blogs? / Nairaland Went Offline Today (pics)

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (0) (1) (2) (3) (4) (5) (6) (7) (8) (9)

Nairaland - Copyright © 2005 - 2014 Oluwaseun Osewa. All rights reserved. See Nairalist and How To Advertise. 32
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.