为什么Map程序抛出arrayindexoutofboundexception？

tjrkku2a 于 2021-05-29 发布在 Hadoop

关注(0)|答案(2)|浏览(393)

我试图逐行读取csv文件，并发送包含“india”作为子字符串的那些行的键值对。为此，我开发了以下代码。
Map程序代码

import java.io.IOException;

import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.LongWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Mapper;

public class MapperCode extends Mapper<LongWritable,Text,Text,IntWritable> {
    public void map(LongWritable key,Text value,Context context) throws IOException,InterruptedException
    {
        String Line=value.toString();
        String out="";
        String search_line=Line;
        String splitter[]=Line.split(" ");
        String searchStr="india";
        for(String words:splitter)
        {
            if(searchStr.equals(words))
            {
                 out=out+"\n"+search_line;
                 System.out.println(out);
            }
        }
        String keyvalpair[]=out.split(",");
        context.write(new Text(keyvalpair[2].trim()), new IntWritable(Integer.parseInt(keyvalpair[9].trim())));
    }
}

数据集

Clarissa Chun,30,United States,2012,08-12-2012,Wrestling,0,0,1,1
Yogeshwar Dutt,29,India,2012,08-12-2012,Wrestling,0,0,1,1
Jaime Espinal,27,Puerto Rico,2012,08-12-2012,Wrestling,0,1,0,1
Johan Eurén,27,Sweden,2012,08-12-2012,Wrestling,0,0,1,1
Karam Gaber,32,Egypt,2012,08-12-2012,Wrestling,0,1,0,1

例外

17/03/17 21:11:08 INFO mapred.JobClient: Task Id :        attempt_201703140915_0030_m_000000_1, Status : FAILED
java.lang.ArrayIndexOutOfBoundsException: 2
        at MapperCode.map(MapperCode.java:26)
        at MapperCode.map(MapperCode.java:1)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.mapred.Child.main(Child.java:264)

请帮帮我。提前谢谢！

hadoop mapreduce hadoop2

来源：https://stackoverflow.com/questions/42870541/why-mapper-throws-arrayindexoutofboundexception

2条答案

按热度按时间

jv4diomz1#

问题就在这里。

String splitter[]=Line.split(" ");

你正试图用“空格”来拆分。在这种情况下，你可以用“，”

String splitter[]=Line.split(",");

这应该很管用。

赞(0）回复(0）举报 2021-05-29

ncecgwcz2#

这仅仅是因为您试图访问的数组中的索引不是那么大。让我跟踪一个小线索。

1- Clarissa Chun,30,United States,2012,08-12-2012,Wrestling,0,0,1,1 
    2- splitter = ["Clarissa", "Chun,30,United", "States,2012,08-12-2012,Wrestling,0,0,1,1]
    3- keyvalpair = ["Clarissa"]
    4. keyvalpair[2] ==> ????

你拿到了吗？希望这有帮助。
对于特定的目标，尝试更简单的方法，您只需执行以下操作：

public class MapperCode extends Mapper<LongWritable,Text,Text,IntWritable> {
    public void map(LongWritable key,Text value,Context context) throws IOException,InterruptedException {
        String line = value.toString();
        if(line.contains("india")) {
            String keyvalpair[] = line.split(",");
            context.write(new Text(keyvalpair[2].trim()), new IntWritable(Integer.parseInt(line)));
        } 
    }
}

赞(0）回复(0）举报 2021-05-29

我来回答

为什么Map程序抛出arrayindexoutofboundexception？

2条答案

相关问题

热门标签

最新问答