基于Lucene的AEP垂直搜索引擎的研究与实现.pdf

华中科技大学硕士学位论文
Abstract
With the increase of software on the Alisoft Economic PlatForm(AEP),finding the
necessary software simply rely on directory-style method is unable to meet the needs of
users, also can not enhance the Customer Experience Index(CEI). A search engine must
been developed in the near future. A vertical search engine which can get software details
is established based on the open-source tool kits . This can be applied to
practical application.
The major works in this thesis are as follows: Analyze search engine theory including
the model of information retrieval; introduce the related technology of search engine,
including the theory and application of Heritrix and DWR; extend the spider Heritrix and
crawl information on AEP; DWR is applied to the search module of AEP search engine,
which can save the system resource to a large extent; During the design and
implementation, Htmlparser is used to deal with the document. It transforms html page to
txt document that includes all the valuable information; The open-source
framework—Lucene, the principle of search engine was analyzed in this thesis; The
corresponding module of a vertical search engine was implemented after going deep into
the implementation of Lucene, including index construction, search module, results sort &
filter; Also in the implementation of search module, the prevalent framework Spring+
Hibernate + Mysql was applied. Forward Maximum Matching method was applied in
Chinese word segmentation.
In a word, not only the vertical search engine of AEP was implemented in this thesis,
but also new technique was adopted to the best. At the same time an investigation on the
related tools was made, The method of Chinese word segmentation and sort arithmetic
was studied and implemented. The research can be widely applied in all kinds of search
module of website or web project. Developers also can customize this search module
according