如何在Lucene搜索中精确匹配文本？

wz1wpwve  于 2022-11-07  发布在  Lucene
关注(0)|答案(3)|浏览(292)

我正在尝试匹配标题列中的文本从ASA5505 8.2到ASA5516的配置迁移。
我的程序看起来像这样。

  1. Directory directory = FSDirectory.open(indexDir);
  3. MultiFieldQueryParser queryParser = new MultiFieldQueryParser(Version.LUCENE_35,new String[] {"TITLE"}, new StandardAnalyzer(Version.LUCENE_35));        
  4. IndexReader reader = IndexReader.open(directory);
  5. IndexSearcher searcher = new IndexSearcher(reader);       
  6. queryParser.setPhraseSlop(0);
  7. queryParser.setLowercaseExpandedTerms(true);
  8. Query query = queryParser.parse("TITLE:Config migration from ASA5505 8.2 to ASA5516");
  9. System.out.println(queryStr);
  10. TopDocs topDocs = searcher.search(query,100);
  11. System.out.println(topDocs.totalHits);
  12. ScoreDoc[] hits = topDocs.scoreDocs;
  13. System.out.println(hits.length + " Record(s) Found");
  14. for (int i = 0; i < hits.length; i++) {
  15.     int docId = hits[i].doc;
  16.     Document d = searcher.doc(docId);
  17.     System.out.println("\"Title :\" " +d.get("TITLE") );
  18. }

但它的回归

  1. "Title :" Config migration from ASA5505 8.2 to ASA5516
  2. "Title :" Firewall  migration from ASA5585 to  ASA5555
  3. "Title :" Firewall  migration from ASA5585 to  ASA5555

后2个结果不是预期结果。那么，需要进行哪些修改才能完全匹配文本从ASA5505 8.2到ASA5516的配置迁移
我的索引函数如下所示

  1. public class Lucene {
  2. public static final String INDEX_DIR = "./Lucene";
  3. private static final String JDBC_DRIVER = "oracle.jdbc.OracleDriver";
  4. private static final String CONNECTION_URL = "jdbc:oracle:thin:xxxxxxx"
  6. private static final String USER_NAME = "localhost";
  7. private static final String PASSWORD = "localhost";
  8. private static final String QUERY = "select * from TITLE_TABLE";
  10. public static void main(String[] args) throws Exception {
  11.     File indexDir = new File(INDEX_DIR);
  12.     Lucene indexer = new Lucene();
  13.     try {
  14.         Date start = new Date();
  15.         Class.forName(JDBC_DRIVER).newInstance();
  16.         Connection conn = DriverManager.getConnection(CONNECTION_URL, USER_NAME, PASSWORD);
  17.         SimpleAnalyzer analyzer = new SimpleAnalyzer(Version.LUCENE_35);
  18.         IndexWriterConfig indexWriterConfig = new IndexWriterConfig(Version.LUCENE_35, analyzer);
  19.         IndexWriter indexWriter = new IndexWriter(FSDirectory.open(indexDir), indexWriterConfig);
  20.         System.out.println("Indexing to directory '" + indexDir + "'...");
  21.         int indexedDocumentCount = indexer.indexDocs(indexWriter, conn);
  22.         indexWriter.close();
  23.         System.out.println(indexedDocumentCount + " records have been indexed successfully");
  24.         System.out.println("Total Time:" + (new Date().getTime() - start.getTime()) / (1000));
  25.     } catch (Exception e) {
  26.         e.printStackTrace();
  27.     }
  28. }
  30. int indexDocs(IndexWriter writer, Connection conn) throws Exception {
  31.     String sql = QUERY;
  32.     Statement stmt = conn.createStatement();
  33.     stmt.setFetchSize(100000);
  34.     ResultSet rs = stmt.executeQuery(sql);
  35.     int i = 0;
  36.     while (rs.next()) {
  37.         System.out.println("Addind Doc No:" + i);
  38.         Document d = new Document();
  39.         System.out.println(rs.getString("TITLE"));
  40.         d.add(new Field("TITLE", rs.getString("TITLE"), Field.Store.YES, Field.Index.ANALYZED));
  41.         d.add(new Field("NAME", rs.getString("NAME"), Field.Store.YES, Field.Index.ANALYZED));
  42.         writer.addDocument(d);
  43.         i++;
  44.     }
  45.     return i;
  46. }
  47. }
lucene

3条答案

按热度按时间
dz6r00yl

dz6r00yl1#

PVR是正确的，使用短语查询可能是正确的解决方案，但是他们遗漏了如何使用PhraseQuery类。尽管您已经在使用QueryParser，所以只需使用查询解析器语法，将搜索文本括在引号中：

  1. Query query = queryParser.parse("TITLE:\"Config migration from ASA5505 8.2 to ASA5516\"");

根据您的更新，您在索引时间和查询时间使用了不同的分析器。SimpleAnalyzer和StandardAnalyzer做的事情不同。除非您有很好的理由不这样做，否则您应该在索引和查询时使用相同的分析方法。
因此，将索引代码中的分析器更改为StandardAnalyzer（反之亦然，查询时使用SimpleAnalyzer），您应该会看到更好的结果。

赞(0）分享  回复(0）举报  2022-11-07
f0ofjuux

f0ofjuux2#

这是我为你写的完美作品：
用途：queryParser.parse("\"Config migration from ASA5505 8.2 to ASA5516\"");
1.若要建立索引

  1. public static void main(String[] args) 
  2. {
  4.     IndexWriter writer = getIndexWriter();
  5.     Document doc = new Document();
  6.     Document doc1 = new Document();
  7.     Document doc2 = new Document();
  8.     doc.add(new Field("TITLE", "Config migration from ASA5505 8.2 to ASA5516",Field.Store.YES,Field.Index.ANALYZED));
  9.     doc1.add(new Field("TITLE", "Firewall  migration from ASA5585 to ASA5555",Field.Store.YES,Field.Index.ANALYZED));
  10.     doc2.add(new Field("TITLE", "Firewall  migration from ASA5585 to ASA5555",Field.Store.YES,Field.Index.ANALYZED));
  11.     try 
  12.     {
  13.         writer.addDocument(doc);
  14.         writer.addDocument(doc1);
  15.         writer.addDocument(doc2);
  16.         writer.close();
  17.     } catch (IOException e) {
  18.         // TODO Auto-generated catch block
  19.         e.printStackTrace();
  20.     }
  21. }
  23. public static IndexWriter getIndexWriter()
  24. {
  25.     IndexWriter indexWriter=null;
  27.     try 
  28.     {
  29.     File file=new File("D://index//");
  30.     if(!file.exists())
  31.         file.mkdir();
  32.     IndexWriterConfig conf=new IndexWriterConfig(Version.LUCENE_34, new StandardAnalyzer(Version.LUCENE_34));
  33.     Directory directory=FSDirectory.open(file);
  34.     indexWriter=new IndexWriter(directory, conf);
  35.     } catch (IOException e) {
  36.         // TODO Auto-generated catch block
  37.         e.printStackTrace();
  38.     }
  39.     return indexWriter;
  40. }

}
2.搜索字符串

  1. public static void main(String[] args) 
  2.     {
  4.     IndexReader reader=getIndexReader();
  6.     IndexSearcher searcher = new IndexSearcher(reader);
  8.     QueryParser parser = new QueryParser(Version.LUCENE_34, "TITLE" ,new StandardAnalyzer(Version.LUCENE_34));
  10.     Query query;
  11.     try 
  12.     {
  13.     query = parser.parse("\"Config migration from ASA5505 8.2 to ASA5516\"");
  15.     TopDocs hits = searcher.search(query,3);
  17.     ScoreDoc[] document = hits.scoreDocs;
  18.     int i=0;
  19.     for(i=0;i<document.length;i++)
  20.     {
  21.         Document doc = searcher.doc(i);
  23.         System.out.println("TITLE=" + doc.get("TITLE"));
  24.     }
  25.         searcher.close();
  27.     } 
  28.     catch (Exception e) 
  29.     {
  30.         // TODO Auto-generated catch block
  31.         e.printStackTrace();
  32.     } 
  33.             }
  35. public static IndexReader getIndexReader()
  36. {
  37.     IndexReader reader=null;
  39.     Directory dir;
  40.     try 
  41.     {
  42.         dir = FSDirectory.open(new File("D://index//"));
  43.         reader=IndexReader.open(dir);
  44.     } catch (IOException e) 
  45.     {
  46.         // TODO Auto-generated catch block
  47.         e.printStackTrace();
  48.     }
  50.     return reader;
  51. }
展开查看全部
赞(0）分享  回复(0）举报  2022-11-07
fzwojiic

fzwojiic3#

尝试PhraseQuery，如下所示：

  1. BooleanQuery mainQuery= new BooleanQuery(); 
  2. String searchTerm="config migration from asa5505 8.2 to asa5516";
  3. String strArray[]= searchTerm.split(" ");
  4. for(int index=0;index<strArray.length;index++)
  5. {
  6.     PhraseQuery query1 = new PhraseQuery();
  7.      query1.add(new Term("TITLE",strArray[index]));
  8.      mainQuery.add(query1,BooleanClause.Occur.MUST);
  9. }

然后执行mainQuery。
检查堆栈溢出的this线程，它可以帮助您使用PhraseQuery进行精确搜索。

赞(0）分享  回复(0）举报  2022-11-07
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com