php_sphinx扩展加coreseek实现中文分词搜索

系统环境
rhel6.5
php5.3.6
mysql5.1.55
nginx1.0.8

第一步：解压sphinx扩展包

tar -zxvf sphinx-1.3.3.tgz

第二步，进入shpinx目录，生成configure文件

cd sphinx-1.3.3
/usr/local/php/bin/phpize
./configure --with-php-config=/usr/local/php/bin/php-config --with-sphinx

执行完这一步报错"configure: error: Cannot find libsphinxclient headers",导致没有生成configure文件，编译不能继续

网上查找资料，解决办法如下
下载coreseek软件包

tar -zxvf coreseek-3.2.14.tar.gz

cd ./coreseek-3.2.14/csft-3.2.14/api/libsphinxclient
make && make install

再回到sphinx-1.3.3目录中继续执行

./configure --with-php-config=/usr/local/php/bin/php-config --with-sphinx
make && make install

第三步修改php.ini文件添加sphinx扩展
在文件最后加上一行

extentsion=sphinx.so

重启服务器，访问phpinfo文件如下所示：

第四步安装mmseg和coreseek(都在coreseek包里面)

tar -zxvf coreseek-3.2.14.tar.gz

mmseg的安装

cd ./coreseek-3.2.14/mmseg-3.2.14

./configure --prefix=/usr/local/mmseg

这一步报错config.status: error: cannot find input file: src/Makefile.in
解决办法如下

yum -y install libtool  
  
aclocal  
libtoolize --force  
automake --add-missing  
autoconf  
autoheader

在重新执行./configure --prefix=/usr/local/mmseg就成功了。

make && make install

coreseek的安装

cd ../csft-3.2.14/
sh buildconf.sh
./configure --prefix=/usr/local/coreseek --without-unixodbc --with-mmseg --with-mmseg-includes=/usr/local/mmseg/include/mmseg/ --with-mmseg-libs=/usr/local/mmseg/lib/ --with-mysql=/usr/local/mysql

make && make install

cd ..

cat ./testpack/var/test/test.xml

这时候看到的应该是中文文本

测试

cd testpack
/usr/local/mmseg/bin/mmseg -d /usr/local/mmseg/etc var/test/test.xml

如图下图所示

/usr/local/coreseek/bin/indexer -c etc/csft.conf --all          #生成索引

这一步报错ERROR: index 'xml': failed to configure some of the sources, will not index.
重新编译coreseek,所以rm -rf /usr/local/coreseek

cd ../csft-3.2.14/
make clean

重新执行./configure,make,make install

重新编译后在生成索引时，报错如下

Unigram dictionary load Error
Segmentation fault (core dumped)

编辑csft.conf

vim ./etc/csft.conf

23行左右，将/usr/local/mmseg3/etc/改为/usr/local/mmseg/etc/
一般情况不会出现这种问题，是由于我将mmseg安装在/usr/local/mmseg目录中导致找不到词典

/usr/local/coreseek/bin/search -c etc/csft.conf 网络搜索

第五步：创建配置sphinx与mysql的文件

vim /usr/local/coreseek/etc/csft_mysql.conf

内容如下

source main
{
    type                    = mysql
    sql_host                = 127.0.0.1
    sql_user                = root
    sql_pass                = dbpassword
    sql_db                  = test
    sql_port                = 3306
    sql_query_info_pre      = SET NAMES utf8
    sql_attr_uint           = id
    sql_query_info          = SELECT id,article_title,article_content,article_time FROM articles where id=$id


}



index main{
   source     = main
   path       = /usr/local/coreseek/var/data/articles
   docinfo    = extern
   min_word_len = 1
   html_strip = 0
   charset_dictpath = /usr/local/mmseg/etc/
   charset_type = zh_cn.utf-8

}
indexer{
   mem_limit  = 128M

}


searchd{
        listen                          = 9312
        log                             = /usr/local/coreseek/var/log/searchd.log
        query_log                       = /usr/local/coreseek/var/log/query.log
        read_timeout                    = 5
        max_children                    = 30
        pid_file                        = /usr/local/coreseek/var/log/searchd.pid
        max_matches                     = 1000
        seamless_rotate                 = 1
        preopen_indexes                 = 0
        unlink_old                      = 1

}

保存文件退出

/usr/local/coreseek/bin/indexer -c /usr/local/coreseek/etc/csft_mysql.conf -rotate  #生成索引

第六步，编写php代码测试中文搜索

vim  /var/www/index.php

代码如下

<?php
header("Content-type: text/html; charset=utf-8");

$sph = new SphinxClient();

$sph->setServer('127.0.0.1',9312);

$sph->setMatchMode(SPH_MATCH_PHRASE);

$word = '阿里巴巴';

$result = $sph->query($word,'main');

$article_ids = implode(array_keys($result['matches']),',');

$link = mysql_connect('localhost','root','dbpassword') or die('链接失败');

mysql_select_db('test');

$sql = "select * from articles where id in ($article_ids)";

$article_res = mysql_query($sql);

$highlight = array(
        'before_match'=>'<font style="font-weight:bold;color:#F00">',
        'after_match'=>'</font>'

);

while($article = mysql_fetch_assoc($article_res)){

        $a = $sph->buildExcerpts($article,'main',$word,$highlight);
        print_r($a);
}

mysql_close($link);

打开浏览器访问测试，如下图所示

附上文章表articles建表语句及部分数据截图，数据是抓取来的，网站华尔街见闻。

mysql> show create table articles G
*************************** 1. row ***************************
       Table: articles
Create Table: CREATE TABLE `articles` (
  `id` int(10) unsigned NOT NULL AUTO_INCREMENT,
  `article_content` text NOT NULL,
  `article_title` varchar(255) NOT NULL DEFAULT '',
  `article_time` varchar(64) NOT NULL DEFAULT '',
  PRIMARY KEY (`id`)
) ENGINE=MyISAM AUTO_INCREMENT=5101 DEFAULT CHARSET=utf8
1 row in set (0.00 sec)

mysql> 

部分数据如下