mapreduce - Hadoop maps but not reduce -


When I start a MapReduce job on my server, it will get a job to reduce 100% and then hang it .

By opening the web console, it shows that all map jobs have been completed and 1 "new" is low but 0 "running" reduces.

The console output for the job is:

  15/01/22 10:26:01 information client.RMProxy: /0.0.0.0:8032 15/01/22 Warned to connect to the resource manager at 10:26:01 mapreduce.JobSubmitter: Hadoop did not parsing command-line options. Apply device transfer and execute your application with ToolRanner so that this can be done. 15/01/22 10:26:02 Information input.FileInputFormat: 1 15/01/22 10:26:02 Information mapreduce.JobSubmitter: Total investment path for the process Number of divisions: 1 15/01/22 10: 26: 02 INFO Configuration.deprecation: user.name dislikes, instead, use mapreduce.job.user.name 15/01/22 10:26:02 INFO Configuration.deprecation: mapred.jar dislikes. Instead, use mapreduce.job.jar 15/01/22 10:26:02 INFO Configuration.deprecation: mapred.output.value.class dislikes. Instead, use mapreduce.job.output.value.class 15/01/22 10:26:02 INFO Configuration.deprecation: mapreduce.combine.class Dislikes. Instead, use mapreduce.job.combine.class 15/01/22 10:26:02 INFO Configuration.deprecation: mapreduce.map.class dislikes. Instead, use mapreduce.job.map.class 15/01/22 10:26:02 INFO Configuration.deprecation: mapred.job.name dislikes. Instead, use mapreduce.job.name 15/01/22 10:26:02 INFO Configuration.deprecation: mapreduce.reduce.class Dislikes. Instead, use mapreduce.job.reduce.class 15/01/22 10:26:02 INFO Configuration.deprecation: mapred.input.dir Dislikes Instead, use mapreduce.input.fileinputformat.inputdir 15 / 01/22 10:26:02 INFO Configuration.deprecation: mapred.output.dir dislikes, instead, use mapreduce.output.fileoutputformat.outputdir 15/01/22 10:26:02 INFO Configuration.deprecation: mapred. Map.tasks dislikes. Instead, use mapreduce.job.maps 15/01/22 10:26:02 INFO Configuration.deprecation: mapred.output.key.class dislikes. Instead, use mapreduce.job.output.key.class 15/01/22 10:26:02 INFO Configuration.deprecation: mapred.working.dir dislikes, instead, use mapreduce.job.working.dir 15 / 01/22 10:26:03 Information mapreduce.JobSubmitter: job_1421950773318_0001 15/01/22 10:26:04 Information: impl.YarnClientImpl: submitted application application_1421950773318_0001 to sending the token to this work /0.0.0.0:8032 15/01 / 22 10:26:04 Information: info manager at mapreduce.job: http: // localhost: 8088 / proxy / application_1421950773318_0001 / 15/01/22 10:26 URL to work track: 04 info mapreduce.Job: running Work: job_1421950773318_0001 15/01/22 10:26:15 information mapre Duce.Job: Job job_1421950773318_0001 running in uber mode: false 15/01/22 10:26:15 information mapreduce.Job: Map 0% less 0% 15/01/22 10:26:33 information mapreduce.Job: map 

  • 64 bit CentOS Release 6.4 3.1.0.0

I tried Wordcount Example

The example example was not working but to reduce the opera, I was able to fix my problem by assigning less memory to Tion.


Comments

Popular posts from this blog

python - Overriding the save method in Django ModelForm -

html - CSS autoheight, but fit content to height of div -

qt - How to prevent QAudioInput from automatically boosting the master volume to 100%? -