₦airaland Forum

A mod banned 1 of my Nl accounts till 2026. That mod dey vex o

^^^ got banned again. Every time I tried to reply a guy that asked if after 3 years of using Laravel I know how it works here https://www.nairaland.com/3132255/please-knows-laravel-mvc-php#46046698

Sbot is a micro messenger right inside of whatsapp. Its actually similar to the wiki bot if you have used it but Sbot comes with more features like getting pictures, movie trailers, dictionary meaning of words, basic calculations and conversions and lots more...

To get started add 09055668142 to any whatsapp group and type 'sbot help' to see the list of its commands

I'm looking to integrate blogs to a whatsapp bot. The bot has been installed on over 10,000 whatsapp groups and counting. So you can imagine the amount of users that use it.

Kindly send me a pm if you are interested in adding your blog.

Please note that this is for blogs with natural contents, not all those copy & paste entertainment blogs.

Also, this is for free.


Check this thread to know more about the bot
https://www.nairaland.com/2936138/how-install-sbot-whatsapp-group

Learn how to extend your Whatsapp features
https://www.nairaland.com/2936138/how-install-sbot-whatsapp-group

@Dhtml18 payment received. Thanks!

imohchard:
yes.. Have you worked with aws before?

Yh. Create a cname from your domain dns settings and point it to the public ip address of your ec2 instance.

Then the way you map the domain to your app's folder is the way you would on any vps.

Edit /etc/hosts and add this line
127.0.1.1 subdomain.example.com

And setup your apache or nginx server.

If you are not familiar with any of the above steps, you can do a Google search or let me know.

imohchard is it on an ec2 instance?

.

.

Cool

^^^ skipped the topic comments. The bots have now indexed all the topics in this section. @asalimpo can confirm.

@asalimpo this may not count again but Check my crawler. I have made the modifications you were looking for. And like I promised, I commented out the loop that tries to get all the comments then made sure you are searching for topics title.

http://search.djade.net

I can't continue to say the same thing. But can the judges allow me to make a modification. I will just be deleting a block of code, then I guarantee I will have all the topics here in less than 1 hour.

If not then we need one more judge to balance

@Danielthegeek you are right. But I had to do everything I could to speed the development time as we were having exams then. I was able to squeeze little time and the challenge was too enticing to resist.

asalimpo:
What are you saying! One crawler, I strongly suspect it was yours, didnt even catch the title.
I entered "programming competition" expecting to see this thread listed and it didnt.
It produced a page full of all kinds of results - junk results.
c'mon guy.

The challenge said crawl the programming section not the title of the topics. What I'm now saying is my bot tries to crawl and index everything in this section including topic titles and their comments. It is obvious that a bot that only crawls the topic title will definitely finish faster than 1 that also tries to visit the topic and index all the posts underneath.

So my database contains both the topics and the comments, you should know that it's merely a line of code that is needed to be changed to effect title searches instead of posts.

So all you need to do is type anything from the topic content not the title.

I think that's also how nairaland search works.

Cool

Follow more school news at http://schoolnetwork.io

asalimpo:
decent crawlers produce relevant results.
A crawler that can't fetch something as prominent as the title is wacked.
other crawlers caught the title.

Ofcourse it fetches the title. I'm saying a decent crawler should crawl everything on a page not just the title.

I have used Google and Nairaland search, they search topic contents as well not just the title

asalimpo:
I'm not.
this is on page 170 - none of the the bots could find it.
https://www.nairaland.com/18002/visual-fortran

this crawler does however:
http://crawler.ademuanthony.com/

fincoApps doesnt. It's results are not even filtered (lots of irrelevant results)
try "programming competition" and you see a page full of results without "programming" or "competition"
in them!

One other thing I think you should consider is the posts/comments not only the title.

If its just crawling the title of topics then its way easier than crawling and indexing the topic contents (including comments) as well, which is why it seems my bots are slower.

@blenyo11 great work. What server language/framework did you use?

OK. I think I understand how blenyo11 crawler works. It's only indexing all the topics' title While mine tries to index everything include all the comments, with time my crawlers can get to the last page.

^^ So does google search engine only index the title of topics?

asalimpo:
just to chip in.
Functionality wise, only one app could fetch me a result that ran into very distant pages of this section.
I entered queries for pages created in say 2007, and only blenyo's did it.
Not a fanboy but ... that stands for something.
i.e His search was more complete than the others.

I think you are jumping to conclusion

This is on page 4 https://www.nairaland.com/2906247/need-evaluate-apps

Try searching for "you can now share your installed android apps"
on http://crawler.ademuanthony.com/ and http://search.djade.net/

Infact check this topic that is the first on this section
https://www.nairaland.com/1147325/want-learn-programming-which-language
search posts between pages 0 - 2 on the two crawlers

Seun should just delete this thread. Its obvious I wasted my time in picking up the challenge.

*Modified *
@Danielthegeek no problem I would have been more patient but the crawlers were eating up my server resources

Danielthegeek?

A grieving husband was left completely stunned when the wife he thought had died in a car accident two years previous was spotted on a TV show.
Abragh Mohamed, from Azilal, Morocco, thought he had lost his beloved wife from injuries sustained in a car crash and even held a funeral for her in their hometown in 2014.

Doctors informed him that she probably wouldn’t survive but her medical bills would still need to be paid.
When he returned with the money, he was told his wife had died.

The woman was spotted on the TV programme Al Mokhtafoun, which translates as ‘The Disappeared’, designed to reconnect loved ones who have lost contact over the years

He told Nuevo Dia: ‘I had to receive her body, apparently wrapped in a shroud and coffin already inside.’
But in a startling twist of events, she showed up on TV programme Al Mokhtafoun, which translates as ‘The Disappeared’, designed to reconnect loved ones who have lost contact over the years.
The unnamed woman called in, saying she had lost contact with her husband and gave his name and former address.

Friends watching the show were shocked when they saw her and broke the news to Mohamed.
He told Spanish press: ‘I did not know it was a different body that we buried and my wife was still alive.’

It is not clear what went wrong or why the woman took two years to get in touch with her husband, but one theory is that she lost her memory.
According to Nuevo Dia, medical or administrative incompetence is being blamed for the error.

https://schoolnetwork.io/256/husband-stunned-as-dead-wife-spotted-on-tv-show-two-years-after-he-buried-her

Built with WordPress nice

Am I the only one waiting for the result?

asalimpo:
By the test criteria, all the contestants would lose major points. Y? Their search results dont exceed the first page of nairaland.

Nope, mine is still reaching the 4th page of the programming section. 2 bots are crawling this section every one hour. I can just increase the number of bots and the interval to make it faster.

http://search.djade.net

source code: https://github.com/djade007/crawler

Cool