Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,150,799 members, 7,810,078 topics. Date: Friday, 26 April 2024 at 08:11 PM

A New Search Engine - Programming (2) - Nairaland

Nairaland Forum / Science/Technology / Programming / A New Search Engine (7570 Views)

Meet The 19-year-old Who Built A New Search Engine To Rival Google And Youtube / Do You Think You Can Develop A Search Engine From Scratch? / Programming Competition: Search Engine Task. Rewards up for grabs. (2) (3) (4)

(1) (2) (3) (4) (Reply) (Go Down)

Re: A New Search Engine by kosytedy(m): 3:26pm On May 14, 2016
Great idea.

Please use <form method="get"...> and <input type="text" name="q"...>, the call the searched item with $_GET['q'].

Don't use caching, it's better to optimise your database and database queries to act faster (check stackoverflow).

I need to tell u many things but, don't have time now. Good work, and more grease to ur elbow. I have a robot that scrapes site and stores relevant keywords for the site in the database (that might be helpful too). Keep it up. I love ideas

1 Like

Re: A New Search Engine by Nobody: 3:37pm On May 14, 2016
You need to write a daemon that scrap sites, i too have a library somewhere that can do that.
Doing a search engine means you need to do an intensive research before implementation.

And do you know that if you search google for goaat - the first result will be goat. There is a term for that, which i don't fully remember now.
That is possible even in mysql database, but i dont recommend mysql for this kind of thing. This your search will be much better if you use NODE.JS.
Imagine a million people searching at the same time. . .how do you handle concurrency? that your ajax script will just die and rest in pieces.
Re: A New Search Engine by Sambayour(m): 5:55pm On May 14, 2016
all complaint made by dhtml are all true, I was so exited when I saw Nigerian made search engine but was disappointed when words like Ikeja, even Lagos shows no result.

as if the database is empty or not querying any data.
Re: A New Search Engine by Nobody: 6:24pm On May 14, 2016
It is a good start, with proper work, it can be done. Keep up the good work dude. If you need my assistance, just PM me right away. I have a few libraries that can help you get started.
Re: A New Search Engine by Nobody: 8:00pm On May 14, 2016
Funny enough, [s]Your search engine can't even find your own site[/s] I'm not going to blast this one... With the big picture in mind and future possibilities I would like to index my page on your engine on one condition:

1. PURCHASE AND INSTALL A SSL CERTIFICATE.
Re: A New Search Engine by FincoApps(m): 9:10pm On May 14, 2016
COMMON GUYS.... Dhtml5 points are all valid.... however, the point most of us are giving that "the engine cannot find some keywords" is somehow unfair considering the age of this search engine.

This engine just started today right ? How on earth is it supposed to gather most of the internet in 1 day??

Even AI bots that use machine learning to get smarter always seem very dumb during the initial days of deployment so guys calm down
Re: A New Search Engine by Nobody: 9:17pm On May 14, 2016
I know my own mouth is a bit sharp, but @op, i need test keywords that i can use to search to even see how the result page looks like.
I search for nairaland, go and brush my mouth come back (a little exagerrated sha), wait small before the result shows - nothing.

Imagine if this thread has hit FP, what would ave happened? I can answer that - a full scale war followed by relegation of the entire programming section for good (this section will never see FP ever ever again)
Re: A New Search Engine by guru01(m): 6:44am On May 16, 2016
dhtml18:
You need to write a daemon that scrap sites, i too have a library somewhere that can do that.
Doing a search engine means you need to do an intensive research before implementation.

And do you know that if you search google for goaat - the first result will be goat. There is a term for that, which i don't fully remember now.
That is possible even in mysql database, but i dont recommend mysql for this kind of thing. This your search will be much better if you use NODE.JS.
Imagine a million people searching at the same time. . .how do you handle concurrency? that your ajax script will just die and rest in pieces.

kosytedy:
Great idea.
Please use <form method="get"...> and <input type="text" name="q"...>, the call the searched item with $_GET['q'].

Don't use caching, it's better to optimise your database and database queries to act faster (check stackoverflow).

I need to tell u many things but, don't have time now. Good work, and more grease to ur elbow. I have a robot that scrapes site and stores relevant keywords for the site in the database (that might be helpful too). Keep it up. I love ideas

Thanks guys for the info, I have an active engine that crawl and index webpage content as we speak.
Re: A New Search Engine by guru01(m): 6:47am On May 16, 2016
Sambayour:
all complaint made by dhtml are all true, I was so exited when I saw Nigerian made search engine but was disappointed when words like Ikeja, even Lagos shows no result.

as if the database is empty or not querying any data.
Next version will be better, I am working on improving the user experience and result as we speak.

1 Like

Re: A New Search Engine by guru01(m): 6:49am On May 16, 2016
dhtml18:
It is a good start, with proper work, it can be done. Keep up the good work dude. If you need my assistance, just PM me right away. I have a few libraries that can help you get started.
Thanks for all your input so far, at least they will help me improve the thing, you will be amaze at the next update.
Re: A New Search Engine by guru01(m): 6:51am On May 16, 2016
DanielTheGeek:
Funny enough, [s]Your search engine can't even find your own site[/s] I'm not going to blast this one... With the big picture in mind and future possibilities I would like to index my page on your engine on one condition:

1. PURCHASE AND INSTALL A SSL CERTIFICATE.
I don't think that is a problem for now, all I want to focus improving user experience and search result.
Re: A New Search Engine by guru01(m): 6:54am On May 16, 2016
FincoApps:
COMMON GUYS.... Dhtml5 points are all valid.... however, the point most of us are giving that "the engine cannot find some keywords" is somehow unfair considering the age of this search engine.

This engine just started today right ? How on earth is it supposed to gather most of the internet in 1 day??

Even AI bots that use machine learning to get smarter always seem very dumb during the initial days of deployment so guys calm down
Thanks bro, so far the engine has already indexed 200k+ webpages.

1 Like

Re: A New Search Engine by guru01(m): 6:57am On May 16, 2016
dhtml18:
I know my own mouth is a bit sharp, but @op, i need test keywords that i can use to search to even see how the result page looks like.
I search for nairaland, go and brush my mouth come back (a little exagerrated sha), wait small before the result shows - nothing.

Imagine if this thread has hit FP, what would ave happened? I can answer that - a full scale war followed by relegation of the entire programming section for good (this section will never see FP ever ever again)
Sorry about that, soon enough you will get better experience. Will remove the ajax thing for now.
Re: A New Search Engine by Sambayour(m): 1:49pm On May 16, 2016
guru01:

Next version will be better, I am working on improving the user experience and result as we speak.

Patiently waiting
Re: A New Search Engine by Laolballs: 2:46pm On May 16, 2016
Hello search engine guy, check out this class i wrote sometimes ago, it would really help to improve your search engine.
www.phpclasses.org/package/8926-PHP-Perform-full-text-search-on-MySQL-with-autocorrect.html

Kudos and welldone
Re: A New Search Engine by larisoft: 2:49pm On May 16, 2016
uhmm...nice try bro. But this does not a search engine make.

Plus the fact that you are trying to make money off something this ...under developed... makes me wonder if you are in this for the love or for money?

2 Likes

Re: A New Search Engine by Nobody: 3:20pm On May 16, 2016
Trollin'
Re: A New Search Engine by micodon(m): 3:49pm On May 16, 2016
My guess is that you are using a LAMP stack for this search NG. That's like swallowing a timed explosive.

You want to do it right, do It right.... You need a language that can handle concurrency with breeze. Someone said Nodejs. I wouldn't advice that. By default, it doesn't use all the cores of your server.

Spring up something with Golang (go routines and channels are the bomb), Rust, even JAVA.

UNLESS ITS A SCHOOL PROJECT, JUST DITCH PHP.
Re: A New Search Engine by Nobody: 3:53pm On May 16, 2016
^^^Santa maria! I actually sniffed his server (with my very long nose) and smelt out php/mysql. . . . .to my greatest surprise!!
Re: A New Search Engine by micodon(m): 4:02pm On May 16, 2016
dhtml18:
^^^Santa maria! I actually invested his server and smelled out php/mysql. . . . .to my greatest surprise!!

You wicked sha
Re: A New Search Engine by FincoApps(m): 5:11pm On May 16, 2016
dhtml18:
^^^Santa maria! I actually sniffed his server (with my very long nose) and smelt out php/mysql. . . . .to my greatest surprise!!

Your nose eh....
Re: A New Search Engine by Nobody: 5:21pm On May 16, 2016
FincoApps:


Your nose eh....
is quite long. . .
Re: A New Search Engine by trytillmake(m): 6:02pm On May 16, 2016
dhtml18:
Wait, before programming section is disgraced on FP, @OP, you need to see my evaluation - this thing is not a search engine!!!

Issues:

1. Due to unscalable large image, it does not scale well to some certain small screens. Resize your browser to see. So i will say it is semi-responsive.

2. The search dey tale too much - even when it has no result to show.

3. The search does not save the searched data into the browser. So if you search and was able to get results to show, refreshing the browser will 'lost your result' so you got to search all over again.

4. Due to error number 3, you cannot bookmark a search result page.

5. I cannot see any search result even when i used popular keywords like goat, oloshi.

6. When you search and the search thing start rolling (sometimes for like 20 minutes - without showing results), you cannot cancel the search and search for another thing.

7. I observed that nairaland is already submitted to the search engine - and yet i cannot search for anything on nairaland and have the result displayed.

8. When you search for something and it does not exist, the search engine just keep quiet.

It is freaking slow. . . . . . . . .and slugggggish. . . . . .

Disclaimer: I mean no offence but it is what i saw that i say, if you are in doubt, please check for yourself.

OP Nice concept, na somewhere google take start, but seriously if u wanna get somewhere with this,
1.go with the above advice, the search is too slow,
2.yr ajax use is a non issue use "get" abeg,
3 yr green color boring and dull, yr favicon dull not catchy/sharp not standing out,
4 spacing of the search items too wide apart, no pagination to determine how many pages,
5 meta details of each search not provided(i cannot just click for clicking sake) and
6 please it is too early for advert you can say contact us here simple, wetin, na so u like advert, dn't give yrself away too fast na, money go come but do am well.

Nice job sha,
Re: A New Search Engine by Nobody: 6:05pm On May 16, 2016
@op, you need to pay me for my comment o. . .
Re: A New Search Engine by FincoApps(m): 10:36pm On May 16, 2016
There's nothing like "It's too early for advert".

Do a good job and let people know it's open to advert, no matter how young it is and you'll be surprised about the result.

The message simple makes it known it is open to adverts. I've designed some apps where the client did the same and within days after release, they started getting requests.... sometime Adverts is not really to make money from what you are selling, but just for awareness
Re: A New Search Engine by sleepingdemon: 11:28pm On May 16, 2016
in all of this, that guy that asked you to use golang, i need to flog him very hard. ehen, that advice on java is still fair, on the other hand, what do i know, just in case you're more comfy with php, you can use mongodb as your database instead, when the app outgrows php, you can move to another lang. or if ure a javascript person, mean stack is actually useful.
Re: A New Search Engine by micodon(m): 11:41pm On May 16, 2016
sleepingdemon:
in all of this, that guy that asked you to use golang, i need to flog him very hard. ehen, that advice on java is still fair, on the other hand, what do i know, just in case you're more comfy with php, you can use mongodb as your database instead, when the app outgrows php, you can move to another lang. or if ure a javascript person, mean stack is actually useful.

What do you know about golang? Java is fair but golang is not? Jeez!!
Re: A New Search Engine by guru01(m): 3:21pm On May 17, 2016
micodon:
My guess is that you are using a LAMP stack for this search NG. That's like swallowing a timed explosive.

You want to do it right, do It right.... You need a language that can handle concurrency with breeze. Someone said Nodejs. I wouldn't advice that. By default, it doesn't use all the cores of your server.

Spring up something with Golang (go routines and channels are the bomb), Rust, even JAVA.

UNLESS ITS A SCHOOL PROJECT, JUST DITCH PHP.
How do you know that Php is not powerful enough for this task?
Re: A New Search Engine by guru01(m): 3:22pm On May 17, 2016
dhtml18:
^^^Santa maria! I actually sniffed his server (with my very long nose) and smelt out php/mysql. . . . .to my greatest surprise!!
Why are you surprised?
Re: A New Search Engine by guru01(m): 3:23pm On May 17, 2016
Laolballs:
Hello search engine guy, check out this class i wrote sometimes ago, it would really help to improve your search engine.
www.phpclasses.org/package/8926-PHP-Perform-full-text-search-on-MySQL-with-autocorrect.html

Kudos and welldone
Thanks.
Re: A New Search Engine by guru01(m): 3:27pm On May 17, 2016
trytillmake:


OP Nice concept, na somewhere google take start, but seriously if u wanna get somewhere with this,
1.go with the above advice, the search is too slow,
2.yr ajax use is a non issue use "get" abeg,
3 yr green color boring and dull, yr favicon dull not catchy/sharp not standing out,
4 spacing of the search items too wide apart, no pagination to determine how many pages,
5 meta details of each search not provided(i cannot just click for clicking sake) and
6 please it is too early for advert you can say contact us here simple, wetin, na so u like advert, dn't give yrself away too fast na, money go come but do am well.

Nice job sha,
Thanks working already on some of these issues. The ads things dey make me laugh self, I no say people go talk about this.
Re: A New Search Engine by guru01(m): 3:31pm On May 17, 2016
sleepingdemon:
in all of this, that guy that asked you to use golang, i need to flog him very hard. ehen, that advice on java is still fair, on the other hand, what do i know, just in case you're more comfy with php, you can use mongodb as your database instead, when the app outgrows php, you can move to another lang. or if ure a javascript person, mean stack is actually useful.
Thanks, just wanted to kick off with my favourite language, looking at nodejs in the near future.
It seems like some people don't realise how much it cost to host on a dedicated server.

(1) (2) (3) (4) (Reply)

*~ Omo-to-dun Voted Programming Section Poster Of The Year *~ Congratulations!! / Signs That You Are Not Meant To Be A Programmer / Data Science Or Cyber Security?

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 53
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.