Commit Graph

1619 Commits

Author SHA1 Message Date
Tsuyoshi Ozawa bb243cea93 MAPREDUCE-5755. MapTask.MapOutputBuffer#compare/swap should have @Override annotation. (ozawa) 2015-03-17 14:55:15 +09:00
Harsh J f222bde273 MAPREDUCE-6100. replace mapreduce.job.credentials.binary with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. Contributed by Zhihai Xu. 2015-03-17 11:06:35 +05:30
Harsh J 685dbafbe2 MAPREDUCE-6105. nconsistent configuration in property mapreduce.reduce.shuffle.merge.percent. Contributed by Ray Chiang. 2015-03-17 02:28:09 +05:30
Harsh J 587d8be17b MAPREDUCE-4414. Add main methods to JobConf and YarnConfiguration, for debug purposes. Contributed by Plamen Jeliazkov. 2015-03-17 01:03:08 +05:30
Tsuyoshi Ozawa bd0a9ba8e3 Moving CHANGES.txt entry for MAPREDUCE-4742 to branch-2.7. 2015-03-14 16:53:50 +09:00
Tsuyoshi Ozawa 9d38520c8e MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers. Contributed by Zhihai Xu 2015-03-14 16:44:02 +09:00
Gera Shegalov aa92b764a7 MAPREDUCE-4815. Speed up FileOutputCommitter#commitJob for many output files. (Siqi Li via gera) 2015-03-10 11:32:08 -07:00
Tsuyoshi Ozawa 20b8ee1350 MAPREDUCE-4742. Fix typo in nnbench#displayUsage. Contributed by Liang Xie. 2015-03-11 00:41:12 +09:00
Junping Du d39bc903a0 Configurable timeout between YARNRunner terminate the application and forcefully kill. Contributed by Eric Payne. 2015-03-10 06:21:59 -07:00
Vinod Kumar Vavilapalli b3e699271b Adding 2.8 section in CHANGES.txt 2015-03-08 20:24:33 -07:00
Tsuyoshi Ozawa dfd8da777f Moving CHANGES.txt entry for MAPREDUCE-5657 to branch-2. 2015-03-09 12:05:08 +09:00
Tsuyoshi Ozawa 348208014b MAPREDUCE-6136. MRAppMaster doesn't shutdown file systems. Contributed by Brahma Reddy Battula. 2015-03-05 14:12:47 +09:00
Karthik Kambatla c66c3ac6bf MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own class. (Chris Trezzo via kasha) 2015-03-04 14:42:07 -08:00
Vinod Kumar Vavilapalli 5af693fde2 MAPREDUCE-6248. Exposed the internal MapReduce job's information as a public API in DistCp. Contributed by Jing Zhao. 2015-03-03 16:28:41 -08:00
Junping Du 4228de9402 MAPREDUCE-5583. Ability to limit running map and reduce tasks. Contributed by Jason Lowe. 2015-03-03 02:02:28 -08:00
Tsuyoshi Ozawa 9ae7f9eb7b MAPREDUCE-5657. Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA. 2015-03-03 18:06:26 +09:00
Tsuyoshi Ozawa 742f9d90c0 MAPREDUCE-6268. Fix typo in Task Attempt API's URL. Contributed by Ryu Kobayashi. 2015-03-03 16:21:16 +09:00
Allen Wittenauer 039366e3b4 MAPREDUCE-5653. DistCp does not honour config-overrides for mapreduce.[map,reduce].memory.mb (Ratandeep Ratti via aw) 2015-02-28 22:53:38 -08:00
Akira Ajisaka bfbf076b7d MAPREDUCE-5612. Add javadoc for TaskCompletionEvent.Status. Contributed by Chris Palmer. 2015-02-26 15:05:17 -08:00
Karthik Kambatla 1047c883ba MAPREDUCE-6223. TestJobConf#testNegativeValueForTaskVmem failures. (Varun Saxena via kasha) 2015-02-26 14:24:19 -08:00
Akira Ajisaka 9a37247a67 MAPREDUCE-2815. JavaDoc does not generate correctly for MultithreadedMapRunner. Contributed by Chris Palmer. 2015-02-24 12:10:17 -08:00
Akira Ajisaka 0d7d508c82 MAPREDUCE-6264. Remove httpclient dependency from hadoop-mapreduce-client. Contributed by Brahma Reddy Battula. 2015-02-24 11:34:26 -08:00
Plamen Jeliazkov a19820f2fb MAPREDUCE-6228. Add truncate operation to SLive. Constributed by Plamen Jeliazkov. 2015-02-19 00:02:49 -08:00
Jason Lowe 4981d082d4 MAPREDUCE-6261. NullPointerException if MapOutputBuffer.flush invoked twice. Contributed by Tsuyoshi OZAWA 2015-02-18 19:28:02 +00:00
Tsuyoshi Ozawa 7c782047c6 MAPREDUCE-4286. TestClientProtocolProviderImpls passes on failure conditions. Contributed by Devaraj K. 2015-02-18 15:45:52 +09:00
Karthik Kambatla 409113d8f9 MAPREDUCE-6234. TestHighRamJob fails due to the change in MAPREDUCE-5785. (Masatake Iwasaki via kasha) 2015-02-17 14:38:00 -08:00
Allen Wittenauer 8b787e2fdb MAPREDUCE-6260. Convert site documentation to markdown (Masatake Iwasaki via aw) 2015-02-17 06:52:14 -10:00
Junping Du 814afa46ef MAPREDUCE-6225. Fix new findbug warnings in hadoop-mapreduce-client-core. Contributed by Varun Saxena 2015-02-16 09:38:05 -08:00
Tsuyoshi Ozawa 3338f6d907 MAPREDUCE-6256. Removed unused private methods in o.a.h.mapreduce.Job.java. Contributed by Naganarasimha G R. 2015-02-15 10:09:42 +09:00
Tsuyoshi Ozawa ba3c80a5ca MAPREDUCE-6255. Fix JobCounter's format to use grouping separator. Contributed by Ryu Kobayashi. 2015-02-13 16:11:00 +09:00
Allen Wittenauer 6f5290b030 MAPREDUCE-6250. deprecate sbin/mr-jobhistory-daemon.sh (aw) 2015-02-12 13:48:47 -08:00
Tsuyoshi Ozawa 9b0ba59b82 MAPREDUCE-6221. Stringifier is left unclosed in Chain#getChainElementConf(). Contributed by Ted Yu. 2015-02-13 02:27:54 +09:00
Tsuyoshi Ozawa ac8d52bf50 MAPREDUCE-4431. mapred command should print the reason on killing already completed jobs. Contributed by Devaraj K. 2015-02-12 20:35:57 +09:00
Tsuyoshi Ozawa b42d09eb62 MAPREDUCE-5335. Rename Job Tracker terminology in ShuffleSchedulerImpl. Contributed by Devaraj K. 2015-02-12 20:08:29 +09:00
Devaraj K 76e309ead0 MAPREDUCE-6253. Update use of Iterator to Iterable. Contributed by Ray
Chiang.
2015-02-12 13:45:19 +05:30
Allen Wittenauer aab459c904 MAPREDUCE-4413. MR lib dir contains jdiff (which is gpl) (Nemon Lou via aw) 2015-02-09 14:02:47 -08:00
Tsuyoshi Ozawa 241336ca2b MAPREDUCE-6237. Multiple mappers with DBInputFormat don't work because of reusing conections. Contributed by Kannan Rajah. 2015-02-10 03:52:42 +09:00
yliu ef01768333 MAPREDUCE-6227. DFSIO for truncate. (shv via yliu) 2015-02-08 02:43:43 +08:00
Robert Kanter e2ee2ff7d7 MAPREDUCE-6233. org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort failed in trunk (zxu via rkanter) 2015-02-05 14:20:28 -08:00
Jason Lowe e1990ab427 MAPREDUCE-6186. Redundant call to requireJob() while displaying the conf page. Contributed by Rohit Agarwal 2015-02-05 20:13:31 +00:00
Jason Lowe afbecbb2cc Update CHANGES.txt to move MR-6059 to 2.7 2015-02-05 16:43:08 +00:00
Akira Ajisaka cc6bbfceae MAPREDUCE-5988. Fix dead links to the javadocs in mapreduce project. (aajisaka) 2015-02-04 17:46:01 -08:00
Allen Wittenauer fd57ab2002 MAPREDUCE-6059. Speed up history server startup time (Siqi Li via aw) 2015-02-04 17:36:28 -08:00
Akira Ajisaka 34fe11c987 MAPREDUCE-6243. Fix findbugs warnings in hadoop-rumen. Contributed by Masatake Iwasaki. 2015-02-04 09:25:44 -08:00
Akira Ajisaka bd69fb2d44 MAPREDUCE-5800. Use Job#getInstance instead of deprecated constructors. (aajisaka) 2015-02-03 14:30:09 -08:00
Robert Kanter 8acc5e9b4b MAPREDUCE-6143. add configuration for mapreduce speculative execution in MR2 (zxu via rkanter) 2015-02-02 13:51:08 -08:00
Allen Wittenauer 12e883007c MAPREDUCE-6151. Update document of GridMix (Masatake Iwasaki via aw) 2015-01-30 11:08:20 -08:00
Allen Wittenauer 3f982c5c26 MAPREDUCE-6150. Update document of Rumen (Masatake Iwasaki via aw) 2015-01-29 14:17:44 -08:00
Akira Ajisaka fe2188a042 MAPREDUCE-6231. Grep example job is not working on a fully-distributed cluster. (aajisaka) 2015-01-30 01:10:02 +09:00
Jian He cff05bff1f MAPREDUCE-6230. Fixed RMContainerAllocator to update the new AMRMToken service name properly. Contributed by Jason Lowe 2015-01-28 15:51:30 -08:00