proj.zoie.impl.indexing.ZoieConfig类的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(8.6k)|赞(0)|评价(0)|浏览(96)

本文整理了Java中proj.zoie.impl.indexing.ZoieConfig类的一些代码示例，展示了ZoieConfig类的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。ZoieConfig类的具体详情如下：
包路径：proj.zoie.impl.indexing.ZoieConfig
类名称：ZoieConfig

ZoieConfig介绍

[英]Configuration parameters for building a ZoieSystem.
[中]用于构建ZoieSystem的配置参数。

代码示例

代码示例来源：origin: senseidb/zoie

/**
 * Creates a new ZoieSystem.
 *
 * @param dirMgr
 *          Directory manager, mandatory.
 * @param interpreter
 *          data interpreter, mandatory.
 * @param indexReaderDecorator
 *          index reader decorator,optional. If not specified,
 *          {@link proj.zoie.impl.indexing.DefaultIndexReaderDecorator} is
 *          used.
 * @param zoieConfig
 *          configuration object
 */
@SuppressWarnings({ "deprecation", "unchecked" })
public ZoieSystem(DirectoryManager dirMgr, ZoieIndexableInterpreter<D> interpreter,
  IndexReaderDecorator<R> indexReaderDecorator, ZoieConfig zoieConfig) {
 this(dirMgr, interpreter, indexReaderDecorator, zoieConfig.getDocidMapperFactory(), zoieConfig
   .getAnalyzer(), zoieConfig.getSimilarity(), zoieConfig.getBatchSize(), zoieConfig
   .getBatchDelay(), zoieConfig.isRtIndexing(), zoieConfig.getMaxBatchSize(), zoieConfig
   .getReadercachefactory(), (RAMIndexFactory<R>) zoieConfig.getRamIndexFactory(), zoieConfig
   .getVersionComparator(), zoieConfig.isSkipBadRecord());
 readercache.setFreshness(zoieConfig.getFreshness());
}

代码示例来源：origin: com.senseidb/sensei-core

zoieConfig = new ZoieConfig(_gateway.getVersionComparator());
} else {
 zoieConfig = new ZoieConfig();
zoieConfig.setAnalyzer(analyzer);
zoieConfig.setSimilarity(similarity);
zoieConfig.setBatchSize(_senseiConf.getInt(SENSEI_INDEX_BATCH_SIZE,
 ZoieConfig.DEFAULT_SETTING_BATCHSIZE));
zoieConfig.setBatchDelay(_senseiConf.getLong(SENSEI_INDEX_BATCH_DELAY,
 ZoieConfig.DEFAULT_SETTING_BATCHDELAY));
zoieConfig.setMaxBatchSize(_senseiConf.getInt(SENSEI_INDEX_BATCH_MAXSIZE,
 ZoieConfig.DEFAULT_MAX_BATCH_SIZE));
zoieConfig.setRtIndexing(_senseiConf.getBoolean(SENSEI_INDEX_REALTIME,
 ZoieConfig.DEFAULT_SETTING_REALTIME));
zoieConfig.setSkipBadRecord(_senseiConf.getBoolean(SENSEI_SKIP_BAD_RECORDS, false));
int delay = _senseiConf.getInt(SENSEI_INDEX_FRESHNESS, 10);
ReaderCacheFactory readercachefactory;
if (delay > 0) {
 readercachefactory = DefaultReaderCache.FACTORY;
 zoieConfig.setFreshness(delay * 1000);
} else {
 readercachefactory = SimpleReaderCache.FACTORY;
zoieConfig.setReadercachefactory(readercachefactory);
ShardingStrategy strategy = pluginRegistry.getBeanByFullPrefix(SENSEI_SHARDING_STRATEGY,
 ShardingStrategy.class);
 _senseiSchema, zoieConfig.getVersionComparator(), pluginRegistry, strategy);

代码示例来源：origin: senseidb/zoie

static PerfTestHandler buildZoieHandler(File idxDir, Configuration topConf, Configuration conf)
  throws Exception {
 ZoieConfig zoieConfig = new ZoieConfig();
 zoieConfig.setAnalyzer(new StandardAnalyzer(Version.LUCENE_43));
 zoieConfig.setBatchSize(100000);
 zoieConfig.setBatchDelay(10000);
 zoieConfig.setMaxBatchSize(100000);
 zoieConfig.setRtIndexing(true);
 zoieConfig.setVersionComparator(ZoiePerfVersion.COMPARATOR);
 zoieConfig.setReadercachefactory(SimpleReaderCache.FACTORY);
 String modeConf = topConf.getString("perf.directory.type", "file");
 DIRECTORY_MODE mode = modeMap.get(modeConf);
 if (mode == null) mode = DIRECTORY_MODE.SIMPLE;
 DirectoryManager dirMgr = new DefaultDirectoryManager(idxDir, mode);
 IndexReaderDecorator<IndexReader> indexReaderDecorator = new DefaultIndexReaderDecorator();
 File queryFile = new File(topConf.getString("perf.query.file"));
 if (!queryFile.exists()) {
  throw new ConfigurationException(queryFile.getAbsolutePath() + " does not exist!");
 }
 ZoieSystem<IndexReader, String> zoieSystem = new ZoieSystem<IndexReader, String>(dirMgr,
   interpreter, indexReaderDecorator, zoieConfig);
 SearchQueryHandler queryHandler = new SearchQueryHandler(queryFile, zoieSystem);
 return new PerfTestHandler(zoieSystem, queryHandler);
}

代码示例来源：origin: senseidb/zoie

@Override
public Comparator<String> getVersionComparator() {
 return _zConfig.getVersionComparator();
}

代码示例来源：origin: senseidb/zoie

@Override
public void setBatchSize(int batchSize) {
 hourglass.getzConfig().setBatchSize(batchSize);
 hourglass.getCurrentZoie().getAdminMBean().setBatchSize(batchSize);
}

代码示例来源：origin: com.senseidb.zoie/zoie-core

@Override
public void setBatchDelay(long delay) {
 hourglass.getzConfig().setBatchDelay(delay);
 hourglass.getCurrentZoie().getAdminMBean().setBatchDelay(delay);
}

代码示例来源：origin: senseidb/zoie

@Override
public void setMaxBatchSize(int maxBatchSize) {
 hourglass.getzConfig().setMaxBatchSize(maxBatchSize);
 hourglass.getCurrentZoie().getAdminMBean().setMaxBatchSize(maxBatchSize);
}

代码示例来源：origin: com.linkedin.zoie/zoie-core

public Analyzer getAnalyzer()
{
 return _zConfig.getAnalyzer();
}

代码示例来源：origin: senseidb/zoie

protected List<ZoieMultiReader<R>> loadArchives() {
 List<ZoieMultiReader<R>> archives = new ArrayList<ZoieMultiReader<R>>();
 long t0 = System.currentTimeMillis();
 List<Directory> dirs = _dirMgrFactory.getAllArchivedDirectories();
 for (Directory dir : dirs) {
  DirectoryReader reader;
  try {
   reader = DirectoryReader.open(dir);
   ZoieMultiReader<R> zoiereader = new ZoieMultiReader<R>(reader, _decorator);
   // Initialize docIdMapper
   DocIDMapper mapper = _zConfig.getDocidMapperFactory().getDocIDMapper(zoiereader);
   zoiereader.setDocIDMapper(mapper);
   archives.add(zoiereader);
  } catch (CorruptIndexException e) {
   log.error("corruptedIndex", e);
  } catch (IOException e) {
   log.error("IOException", e);
  }
 }
 log.info("load " + dirs.size() + " archived indices of " + getSizeBytes() + " bytes in "
   + (System.currentTimeMillis() - t0) + "ms");
 return archives;
}

代码示例来源：origin: com.senseidb/sensei-core

@SuppressWarnings({ "unchecked", "rawtypes" })
public LocalQueryOnlySenseiServiceImpl(File idxDir) throws Exception {
 ZoieConfig zoieConfig = new ZoieConfig();
 zoieConfig.setReadercachefactory(SimpleReaderCache.FACTORY);
 DemoZoieSystemFactory zoieFactory = new DemoZoieSystemFactory(idxDir,
   new AbstractZoieIndexableInterpreter<JSONObject>() {
    @Override
    public ZoieIndexable convertAndInterpret(JSONObject src) {
     return null;
    }
   }, zoieConfig);
 QueryParser queryParser = new QueryParser(Version.LUCENE_43, "contents", new StandardAnalyzer(
   Version.LUCENE_43));
 DefaultJsonQueryBuilderFactory queryBuilderFactory = new DefaultJsonQueryBuilderFactory(
   queryParser);
 _core = new SenseiCore(1, new int[] { 0 }, zoieFactory, null, queryBuilderFactory,
   new DefaultFieldAccessorFactory(), zoieFactory.getDecorator());
 _coreService = new CoreSenseiServiceImpl(_core);
 _core.start();
}

代码示例来源：origin: com.linkedin.zoie/zoie-core

@Override
public int getBatchSize()
{
 return hourglass.getzConfig().getBatchSize();
}

代码示例来源：origin: com.senseidb.zoie/zoie-core

@Override
public long getBatchDelay() {
 return hourglass.getzConfig().getBatchDelay();
}

代码示例来源：origin: senseidb/zoie

_currentZoie = _readerMgr.retireAndNew(null);
_currentZoie.start();
_freshness = zoieConfig.getFreshness();
log.info("start Hourglass at version: " + _currentVersion);

代码示例来源：origin: senseidb/zoie

@Override
public Comparator<String> getVersionComparator() {
 return _zoieConfig.getVersionComparator();
}

代码示例来源：origin: com.linkedin.zoie/zoie-core

@Override
public void setBatchSize(int batchSize)
{
 hourglass.getzConfig().setBatchSize(batchSize);
 hourglass.getCurrentZoie().getAdminMBean().setBatchSize(batchSize);
}

代码示例来源：origin: senseidb/zoie

@Override
public void setBatchDelay(long delay) {
 hourglass.getzConfig().setBatchDelay(delay);
 hourglass.getCurrentZoie().getAdminMBean().setBatchDelay(delay);
}

代码示例来源：origin: com.senseidb.zoie/zoie-core

@Override
public void setMaxBatchSize(int maxBatchSize) {
 hourglass.getzConfig().setMaxBatchSize(maxBatchSize);
 hourglass.getCurrentZoie().getAdminMBean().setMaxBatchSize(maxBatchSize);
}

代码示例来源：origin: com.linkedin.zoie/zoie-core

public Analyzer getAnalyzer()
{
 return _zoieConfig.getAnalyzer();
}

代码示例来源：origin: com.senseidb.zoie/zoie-core

protected List<ZoieMultiReader<R>> loadArchives() {
 List<ZoieMultiReader<R>> archives = new ArrayList<ZoieMultiReader<R>>();
 long t0 = System.currentTimeMillis();
 List<Directory> dirs = _dirMgrFactory.getAllArchivedDirectories();
 for (Directory dir : dirs) {
  DirectoryReader reader;
  try {
   reader = DirectoryReader.open(dir);
   ZoieMultiReader<R> zoiereader = new ZoieMultiReader<R>(reader, _decorator);
   // Initialize docIdMapper
   DocIDMapper mapper = _zConfig.getDocidMapperFactory().getDocIDMapper(zoiereader);
   zoiereader.setDocIDMapper(mapper);
   archives.add(zoiereader);
  } catch (CorruptIndexException e) {
   log.error("corruptedIndex", e);
  } catch (IOException e) {
   log.error("IOException", e);
  }
 }
 log.info("load " + dirs.size() + " archived indices of " + getSizeBytes() + " bytes in "
   + (System.currentTimeMillis() - t0) + "ms");
 return archives;
}

代码示例来源：origin: senseidb/zoie

@Override
public int getBatchSize() {
 return hourglass.getzConfig().getBatchSize();
}

内容来源于网络，如有侵权，请联系作者删除！

ZoieConfig

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com