我可以在mapreduce作业中为Map器提供定制的输入吗?

7ajki6be  于 2021-06-02  发布在  Hadoop
关注(0)|答案(0)|浏览(240)

如果您想用mapreduce处理文本文件或日志文件,默认情况下,mapper输入值将按换行符排列,但我想处理日志文件

A (18:18:43,703 [ERROR] AccStmtGeneratorImpl - Statement not generated for::304005)

B (11:40:04,202 [ERROR] JobStoreTX - Failed to close Connection
 java.sql.SQLException: Already closed.
    at org.apache.commons.dbcp.PoolableConnection.close(PoolableConnection.java:114)
    at `enter code here`org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.close(PoolingDataSource.java:191)
    at org.quartz.impl.jdbcjobstore.JobStoreSupport.closeConnection(JobStoreSupport.java:3579)
    at org.quartz.impl.jdbcjobstore.JobStoreSupport.cleanupConnection(JobStoreSupport.java:3555)
    at org.quartz.impl.jdbcjobstore.JobStoreSupport.executeInNonManagedTXLock(JobStoreSupport.java:3783)
    at org.quartz.impl.jdbcjobstore.JobStoreSupport.acquireNextTrigger(JobStoreSupport.java:2728)
    at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:264)
)

在这里,我的Map器应该从11:40:04202取一个值到新的时间戳,这意味着a将是一个值,而整个b将是另一个值,所以我如何做到这一点。。?提前谢谢请帮忙。。。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题