|
You now have all the information you need to make a site search engine. If you're going for a general Internet search engine there's a lot more details you need to include. Like robots.txt, site maps, redirects, proxies, recognizing content types, advanced ranking algorithms as well as handling terabytes of data.
I'll cover more detail in a future article. Good luck with your next search engine project.
Simon Byholm is building a new search engine where he will test and describe new and old search algorithms. Simon is a software engineer living on the west coast of Finland and has a B.Sc degree in telecommunication and a burning interest for search engine algorithms.
|