An open source .NET web crawler written in C# using SQL 2005/2008. Arachnode.net is a complete and comprehensive .NET web crawler for downloading, indexing and storing Internet content including e-mail addresses, files, hyperlinks, images, and Web pages. Its features include
 <UL>
	<LI>.NET architecture</LI>
	<LI>Configurable Rules and Actions</LI>
	<LI>Lucene.NET Integration</LI>
	<LI>SQL Server 2008 and full-text indexing</LI>
	<LI>.DOC/.PDF/.PPT/.XLS Indexing</LI>
	<LI>HTML to XML and XHTML</LI>
	<LI>Multi-threading and Throttling</LI>
	<LI>Respectful Crawling</LI>
	<LI>Analysis Services</LI>
	<LI>SQL Server 2008 and SSIS</LI>
	<LI>EXIF data extraction</LI>
 </UL>

An open source .NET web crawler written in C# using SQL 2005/2008. Arachnode.net is a complete and comprehensive .NET web crawler for downloading, indexing and storing Internet content including e-mail addresses, files, hyperlinks, images, and Web pages.

Arachnode.net

Jumper 2.0 is a collaborative community search platform that revolutionizes search by crowdsourcing knowledge management powered by a shared bookmarking engine. It is easily and quickly deployed into a community of practice that benefits users with complex and specialized search requirements. Jumper delivers universal search of any databases, flat files, fileshares, content systems, web pages, blogs and wikis, even people - through one simple search box. Jumper 2.0 collaborative search is an open source, web-based platform written in PHP and Javascript. Jumper uses peer and social-networking principles to tag and link distributed information resources to create an interactive, user-submitted, recommendation engine that allows you to search any content, media, or data regardless of format or location. Like Wikipedia, Jumper allows users to become contributors and editors of the service by creating, editing, and managing tag profiles. Jumper allows users to tag any information resource with keywords just like Delicious. Jumper delivers a comment and rating system that is similar to Amazon.

Jumper 2.0 is a collaborative community search platform that revolutionizes search by crowdsourcing knowledge management powered by a shared bookmarking engine. It is easily and quickly deployed into a community of practice that benefits users with complex and specialized search requirements. Jumper delivers universal search of any databases, flat files, fileshares, content systems, web pages, blogs and wikis, even people - through one simple search box.

Jumper - Collaborative search engine in PHP

Searchdaimon is an open source search engine for corporate data and websites. It comes with a powerful administrator interface and can index websites and several common enterprise systems like SharePoint, Exchange, SQL databases, Windows file shares etc. It also supports many data sources (e.g., Word, PDF, Excel) and the possibility of faceted search, attribute navigation and collection sorting.

Searchdaimon - Enterprise Search

YaCy (read "ya see") is a free distributed search engine, built on principles of peer-to-peer (P2P) networks. It is distributed on several hundred computers so-called YaCy-peers. Each YaCy-peer independently crawls through the Internet, analyzes and indexes found web pages, and stores indexing results in a common database which is shared with other YaCy-peers using principles of P2P networks.

YaCy - Decentralized Web Search

It is a standalone search engine, meant to provide fast, size-efficient and relevant fulltext search functions to other applications. Sphinx was specially designed to integrate well with SQL databases and scripting languages. Currently built-in data sources support fetching data either via direct connection to MySQL or PostgreSQL, or using XML pipe mechanism (a pipe to indexer in special XML-based format which Sphinx recognizes). Official APIs for PHP, Python, Java, Ruby, pure C are included in Sphinx distribution. 
 Its feature includes: 
 <ul type="disc"><li>high indexing speed (upto 10 MB/sec on modern CPUs);</li><li>high search speed (avg query is under 0.1 sec on 2-4 GB text collections);</li><li>high scalability (upto 100 GB of text, upto 100 M documents on a single CPU);</li><li>provides good relevance ranking through combination of phrase proximity ranking and statistical (BM25) ranking;</li><li>provides distributed searching capabilities;</li><li>provides document exceprts generation;</li><li>provides searching from within MySQL through pluggable storage engine;</li><li>supports boolean, phrase, and word proximity queries;</li><li>supports multiple full-text fields per document (upto 32 by default);</li><li>supports multiple additional attributes per document (ie. groups, timestamps, etc);</li><li>supports stopwords;</li><li>supports both single-byte encodings and UTF-8;</li><li>supports English stemming, Russian stemming, and Soundex for morphology;</li><li>supports MySQL natively (MyISAM and InnoDB tables are both supported);</li><li>supports PostgreSQL natively.</li></ul>

Sphinix is free open-source SQL full-text search engine. How do you implement full-text search for that 10+ million row table, keep up with the load, and stay relevant? Sphinx is good at those kinds of riddles.

Sphinix - Search server

Manticore Search is an open source high performance full-text search oriented engine. It is a fork of Sphinx Search. Manticore Search is written in C++. It means speed and low resource consumption, it means you don’t have to worry about a garbage collector that suddenly makes a trouble.
<ul>
<li>Over 20 full-text operators and over 20 ranking factors, custom rankers</li>
<li>Advanced tokenization at character and word level</li>
<li>Morphology preprocessors</li>
<li>Real-time and offline indexes</li>
<li>JSON attributes</li>
<li>Distributed indexes</li>
<li>Built-in load balancer</li>
<li>Text highlighting and word correction</li>
<li>Geo search</li>
<li>Source data connectors for MySQL, PostgreSQL, MSSQL, ODBC, XML and CSV files</li>
<li>Connectivity: MySQL-based protocol, HTTP, native libraries</li>
</ul>

Manticore Search is an open source high performance full-text search oriented engine. It is a fork of  Sphinx Search. Manticore Search is written in C++. It means speed and low resource consumption, it means you don’t have to worry about a garbage collector that suddenly makes a trouble.

Manticore Search - High performance full-text search engine with SQL and JSON support

Discover open source projects across all platforms

Projects

Arachnode.net

Jumper - Collaborative search engine in PHP

Searchdaimon - Enterprise Search

YaCy - Decentralized Web Search

Sphinix - Search server

Manticore Search - High performance full-text search engine with SQL and JSON support

TechStack

Tagcloud

Suggested keywords:

Projects

Arachnode.net

Jumper - Collaborative search engine in PHP

Searchdaimon - Enterprise Search

YaCy - Decentralized Web Search

Sphinix - Search server

Manticore Search - High performance full-text search engine with SQL and JSON support

TechStack

Tagcloud