Meresco Suite
Meresco Harvester
The Meresco Harvester retrieves the information stored in OAI-repositories and upload it to Meresco Core implementations or designated filesystems. The advanced technology in Meresco Harvester makes it possible to harvest repositories that are often offline and handle variations in meta-data formats or expired resumption tokens.
Meresco Crawler
The webcrawler follows hyperlink-trails in order to capture document metadata within the designated domain.
The Meresco Webcrawler uses a combination of the Open Source Heritrix Crawler for the crawling functionality and the Meresco Core OAI-Repository. These two components are connected by a metadata extraction unit which receives the crawled content extracts metadata and stores it in the repository, ready to be harvested.
Meresco Core
Meresco Core provides a toolbox which can be used to create metadata-applications. It's prime implementation is an index-based Search Engine.
The Core Framework provides an index for storage of metadata as well as a component for scalable data storage. Meresco can handle all types of metadata sets, provided they are XML-based. In its current version Meresco supports the DC and LOM metadata sets. The available output-pluginstandards are OAI-PMH, SRU/SRW (SOAP), Term and Field Drill Down (Facetted Search) and RSS.
The OAI-PMH output interface and the flexible management of metadata allows for a second Core implementation: a Repository. The Repository implementation is currently used in the Meresco Webcrawler.
Meresco Search
The Meresco search engine is a fast and lightweight metadata search appliance. It communicates with OAI-Harvesters to collect the desired metadata. Collected metadata are stored in it's index and served out to search engine users through SRU/SRW, Term and Field Drill Down and RSS interfaces.
Unlike many other search-engines, Meresco does not store data in the index, but limits itself to the storage record identifiers. This way the index is kept small in size and will be easier to hold in the server memory completely. This approach speeds up searching and increases searchability.
Technical information can be found on:
www.meresco.com
|
|
