org.apache.lucene.util.fst.Builder.finish()方法的使用及代码示例

x33g5p2x  于2022-01-17 转载在 其他  
字(8.1k)|赞(0)|评价(0)|浏览(83)

本文整理了Java中org.apache.lucene.util.fst.Builder.finish()方法的一些代码示例，展示了Builder.finish()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Builder.finish()方法的具体详情如下：
包路径：org.apache.lucene.util.fst.Builder
类名称：Builder
方法名：finish

Builder.finish介绍

[英]Returns final FST. NOTE: this will return null if nothing is accepted by the FST.
[中]返回最终的FST。注意：如果FST不接受任何内容，则返回null。

代码示例

代码示例来源：origin: org.apache.lucene/lucene-core

index = indexBuilder.finish();

代码示例来源：origin: org.elasticsearch/elasticsearch

public FST<Pair<Long, BytesRef>> build() throws IOException {
  return builder.finish();
}

代码示例来源：origin: org.apache.lucene/lucene-analyzers-common

private FST<CharsRef> parseConversions(LineNumberReader reader, int num) throws IOException, ParseException {
 Map<String,String> mappings = new TreeMap<>();
 
 for (int i = 0; i < num; i++) {
  String line = reader.readLine();
  String parts[] = line.split("\\s+");
  if (parts.length != 3) {
   throw new ParseException("invalid syntax: " + line, reader.getLineNumber());
  }
  if (mappings.put(parts[1], parts[2]) != null) {
   throw new IllegalStateException("duplicate mapping specified for: " + parts[1]);
  }
 }
 
 Outputs<CharsRef> outputs = CharSequenceOutputs.getSingleton();
 Builder<CharsRef> builder = new Builder<>(FST.INPUT_TYPE.BYTE2, outputs);
 IntsRefBuilder scratchInts = new IntsRefBuilder();
 for (Map.Entry<String,String> entry : mappings.entrySet()) {
  Util.toUTF16(entry.getKey(), scratchInts);
  builder.add(scratchInts.get(), new CharsRef(entry.getValue()));
 }
 
 return builder.finish();
}

代码示例来源：origin: org.apache.lucene/lucene-analyzers-common

private FST<IntsRef> affixFST(TreeMap<String,List<Integer>> affixes) throws IOException {
 IntSequenceOutputs outputs = IntSequenceOutputs.getSingleton();
 Builder<IntsRef> builder = new Builder<>(FST.INPUT_TYPE.BYTE4, outputs);
 IntsRefBuilder scratch = new IntsRefBuilder();
 for (Map.Entry<String,List<Integer>> entry : affixes.entrySet()) {
  Util.toUTF32(entry.getKey(), scratch);
  List<Integer> entries = entry.getValue();
  IntsRef output = new IntsRef(entries.size());
  for (Integer c : entries) {
   output.ints[output.length++] = c;
  }
  builder.add(scratch.get(), output);
 }
 return builder.finish();
}

代码示例来源：origin: org.apache.lucene/lucene-analyzers-common

/** Builds the NormalizeCharMap; call this once you
  *  are done calling {@link #add}. */
 public NormalizeCharMap build() {
  final FST<CharsRef> map;
  try {
   final Outputs<CharsRef> outputs = CharSequenceOutputs.getSingleton();
   final org.apache.lucene.util.fst.Builder<CharsRef> builder = new org.apache.lucene.util.fst.Builder<>(FST.INPUT_TYPE.BYTE2, outputs);
   final IntsRefBuilder scratch = new IntsRefBuilder();
   for(Map.Entry<String,String> ent : pendingPairs.entrySet()) {
    builder.add(Util.toUTF16(ent.getKey(), scratch),
          new CharsRef(ent.getValue()));
   }
   map = builder.finish();
   pendingPairs.clear();
  } catch (IOException ioe) {
   // Bogus FST IOExceptions!!  (will never happen)
   throw new RuntimeException(ioe);
  }
  return new NormalizeCharMap(map);
 }
}

代码示例来源：origin: org.apache.lucene/lucene-analyzers-common

Builder<IntsRef> b = new Builder<>(FST.INPUT_TYPE.BYTE4, o);
readDictionaryFiles(tempDir, tempFileNamePrefix, dictionaries, decoder, b);
words = b.finish();

代码示例来源：origin: org.apache.lucene/lucene-analyzers-common

FST<BytesRef> fst = builder.finish();
return new SynonymMap(fst, words, maxHorizontalContext);

代码示例来源：origin: com.strapdata.elasticsearch/elasticsearch

public FST<Pair<Long, BytesRef>> build() throws IOException {
  return builder.finish();
}

代码示例来源：origin: org.apache.servicemix.bundles/org.apache.servicemix.bundles.elasticsearch

public FST<Pair<Long, BytesRef>> build() throws IOException {
  return builder.finish();
}

代码示例来源：origin: apache/servicemix-bundles

public FST<Pair<Long, BytesRef>> build() throws IOException {
  return builder.finish();
}

代码示例来源：origin: harbby/presto-connectors

public FST<Pair<Long, BytesRef>> build() throws IOException {
  return builder.finish();
}

代码示例来源：origin: org.apache.lucene/lucene-analyzers-common

/**
 * Returns an {@link StemmerOverrideMap} to be used with the {@link StemmerOverrideFilter}
 * @return an {@link StemmerOverrideMap} to be used with the {@link StemmerOverrideFilter}
 * @throws IOException if an {@link IOException} occurs;
 */
public StemmerOverrideMap build() throws IOException {
 ByteSequenceOutputs outputs = ByteSequenceOutputs.getSingleton();
 org.apache.lucene.util.fst.Builder<BytesRef> builder = new org.apache.lucene.util.fst.Builder<>(
   FST.INPUT_TYPE.BYTE4, outputs);
 final int[] sort = hash.sort();
 IntsRefBuilder intsSpare = new IntsRefBuilder();
 final int size = hash.size();
 BytesRef spare = new BytesRef();
 for (int i = 0; i < size; i++) {
  int id = sort[i];
  BytesRef bytesRef = hash.get(id, spare);
  intsSpare.copyUTF8Bytes(bytesRef);
  builder.add(intsSpare.get(), new BytesRef(outputValues.get(id)));
 }
 return new StemmerOverrideMap(builder.finish(), ignoreCase);
}

代码示例来源：origin: org.apache.lucene/lucene-codecs

@Override
 public void finish(long termsFilePointer) throws IOException {
  fst = fstBuilder.finish();
  if (fst != null) {
   fst.save(out);
  }
 }
}

代码示例来源：origin: org.apache.lucene/lucene-codecs

public void finish(long sumTotalTermFreq, long sumDocFreq, int docCount) throws IOException {
  // save FST dict
  if (numTerms > 0) {
   final FST<FSTTermOutputs.TermData> fst = builder.finish();
   fields.add(new FieldMetaData(fieldInfo, numTerms, sumTotalTermFreq, sumDocFreq, docCount, longsSize, fst));
  }
 }
}

代码示例来源：origin: org.apache.lucene/lucene-codecs

public void finish(long sumTotalTermFreq, long sumDocFreq, int docCount) throws IOException {
 if (numTerms > 0) {
  final FieldMetaData metadata = new FieldMetaData();
  metadata.fieldInfo = fieldInfo;
  metadata.numTerms = numTerms;
  metadata.sumTotalTermFreq = sumTotalTermFreq;
  metadata.sumDocFreq = sumDocFreq;
  metadata.docCount = docCount;
  metadata.longsSize = longsSize;
  metadata.skipOut = skipOut;
  metadata.statsOut = statsOut;
  metadata.metaLongsOut = metaLongsOut;
  metadata.metaBytesOut = metaBytesOut;
  metadata.dict = builder.finish();
  fields.add(metadata);
 }
}

代码示例来源：origin: org.elasticsearch/elasticsearch

fst = builder.finish();

代码示例来源：origin: org.apache.lucene/lucene-classification

private void updateFST(SortedMap<String, Double> weights) throws IOException {
 PositiveIntOutputs outputs = PositiveIntOutputs.getSingleton();
 Builder<Long> fstBuilder = new Builder<>(FST.INPUT_TYPE.BYTE1, outputs);
 BytesRefBuilder scratchBytes = new BytesRefBuilder();
 IntsRefBuilder scratchInts = new IntsRefBuilder();
 for (Map.Entry<String, Double> entry : weights.entrySet()) {
  scratchBytes.copyChars(entry.getKey());
  fstBuilder.add(Util.toIntsRef(scratchBytes.get(), scratchInts), entry
      .getValue().longValue());
 }
 fst = fstBuilder.finish();
}

代码示例来源：origin: org.infinispan/infinispan-embedded-query

private FST<IntsRef> affixFST(TreeMap<String,List<Integer>> affixes) throws IOException {
 IntSequenceOutputs outputs = IntSequenceOutputs.getSingleton();
 Builder<IntsRef> builder = new Builder<>(FST.INPUT_TYPE.BYTE4, outputs);
 IntsRefBuilder scratch = new IntsRefBuilder();
 for (Map.Entry<String,List<Integer>> entry : affixes.entrySet()) {
  Util.toUTF32(entry.getKey(), scratch);
  List<Integer> entries = entry.getValue();
  IntsRef output = new IntsRef(entries.size());
  for (Integer c : entries) {
   output.ints[output.length++] = c;
  }
  builder.add(scratch.get(), output);
 }
 return builder.finish();
}

代码示例来源：origin: dweiss/compound-splitter

private static void serialize(String file, BytesRef [] all) throws IOException
  {
    final Object nothing = NoOutputs.getSingleton().getNoOutput();
    final Builder<Object> builder = new Builder<Object>(INPUT_TYPE.BYTE4, NoOutputs.getSingleton());
    final IntsRefBuilder intsRef = new IntsRefBuilder();
    for (BytesRef br : all)
    {
      intsRef.clear();
      intsRef.copyUTF8Bytes(br);
      builder.add(intsRef.get(), nothing);
    }
    final FST<Object> fst = builder.finish();

    final OutputStreamDataOutput out = new OutputStreamDataOutput(new FileOutputStream(file));
    fst.save(out);
    out.close();
  }
}

代码示例来源：origin: org.apache.lucene/lucene-codecs

public void finish(long sumTotalTermFreq, long sumDocFreq, int docCount) throws IOException {
  if (termCount > 0) {
   out.writeVInt(termCount);
   out.writeVInt(field.number);
   if (field.getIndexOptions() != IndexOptions.DOCS) {
    out.writeVLong(sumTotalTermFreq);
   }
   out.writeVLong(sumDocFreq);
   out.writeVInt(docCount);
   FST<BytesRef> fst = builder.finish();
   fst.save(out);
   //System.out.println("finish field=" + field.name + " fp=" + out.getFilePointer());
  }
 }
}

内容来源于网络，如有侵权，请联系作者删除！

Builder

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com