MKSearch

A new kind of search engine

MKSearch is a research project to develop a metadata search engine. The system is composed of two linked systems; an indexing Web crawler and a public query interface. The indexing component extracts Dublin Core metadata from Web documents and stores them in RDF format. The query interface matches documents in the index using an RDF query language and can return the results in a variety of formats including standard HTML and as a standing RSS feed.

Project status

On 2 November 2005 the MKSearch project made its first beta release. The system is available in pre-compiled binary format and source-only in the downloads section. We welcome your comments and questions on the MKSearch mailing list.

The MKSearch system is being developed using the Java programming language and is licenced under the GNU General Public Licence. All software is compiled and tested using both the Sun and GNU Java compilers. All project source material is available through the public MKSearch Subversion repository.

The MKSearch Java documentation is periodically updated in the project's Subversion repository.

System composition

The MKSearch system is composed of several other free software components. Further details are provided in the MKSearch development plans.

JSpider: JSpider is a Java Web crawler engine that has pluggable interfaces that can be used to add custom processing and content handling. MKSearch uses custom SAX-based content handlers for extracting metadata from Web documents.
Sesame: Sesame is a set of RDF processing and storage APIs and applications that includes RDF data query facilities. MKSearch uses Sesame to store indexed metadata in RDF format and to search the repository via the public query interface.
JTidy: JTidy is a utility for correcting common HTML markup errors and is used to convert HTML documents to XHTML so they can be processed using SAX.

Document Links

MKSearch development plans: Development plans for MKSearch
http://www.mksearch.mkdoc.org/plans/

MKSearch Subversion repository: The Web interface to the MKSearch Subversion repository
https://svn.mkdoc.com/mksearch/

MKSearch mailing list: The MKSearch developers' email list
http://www.email-lists.org/mailman/listinfo/mksearch-dev

MKSearch Java documentation: Java documentation for the MKSearch system
https://svn.mkdoc.com/mksearch/trunk/doc/javadoc/index.html

downloads section: Download the MKSearch system
http://www.mksearch.mkdoc.org/downloads

This document was last modified on 2005-11-21 08:16:49.
Copyright MKDoc Ltd. and others.
The Free Documentation License http://www.gnu.org/copyleft/fdl.html