Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,558 Commits 326 Branches 371 Tags
Commit Graph

1731 Commits

Author SHA1 Message Date
Zhijie Shen
3b03ea6b50 YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He. 
(cherry picked from commit 0f3b6900be1a3b2e4624f31f84656f4a32dadce9)
 2014-10-23 22:03:30 -07:00
Jian He
1c235a4448 YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu 
(cherry picked from commit 3b12fd6cfbf4cc91ef8e8616c7aafa9de006cde5)
 2014-10-22 15:58:26 -07:00
Jian He
9b973b7c83 MAPREDUCE-6126. Fixed Rumen JobBuilder to ignore NormalizedResourceEvent. Contributed by Junping Du 
Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2014-10-22 10:57:32 -07:00
Ivan Mitic
b4668f41e8 Revert "MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita." 
This reverts commit 767a3fd0b718a1d0b38c030438f0be4f426ba5b5.
 2014-10-19 23:50:42 -04:00
Ivan Mitic
767a3fd0b7 MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita. 
(cherry picked from commit 7bbda6ef92e9bf4a28e67b8736067b38defab51e)
 2014-10-19 19:10:31 -04:00
Jason Lowe
8885b75d78 MAPREDUCE-5542. Killing a job just as it finishes can generate an NPE in client. Contributed by Rohith 
(cherry picked from commit 209b1699fcd150676d4cc47e8e817796086c1986)
 2014-10-17 19:53:17 +00:00
Jian He
f93d2ea27e YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA 2014-10-15 15:28:26 -07:00
Jason Lowe
025b6c13e9 MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. Contributed by Gera Shegalov 
(cherry picked from commit f19771a24c2f90982cf6dec35889836a6146c968)
 2014-10-15 17:51:53 +00:00
Jason Lowe
1179a0cb07 MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting for maps. Contributed by Siqi Li 
(cherry picked from commit b9edad64034a9c8a121ec2b37792c190ba561e26)
 2014-10-15 15:54:57 +00:00
Jason Lowe
942fb67a04 MAPREDUCE-6115. TestPipeApplication#testSubmitter fails in trunk. Contributed by Binglin Chang 
(cherry picked from commit 793dbf2465c01426a93bb26d08e377ffd3915340)
 2014-10-13 16:05:29 +00:00
Jason Lowe
e17e3bdbc4 MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails. Contributed by Mit Desai 
(cherry picked from commit bbe80cdc7b37cae50e46eaa00e75240d4a2aac68)
 2014-10-13 15:09:26 +00:00
Karthik Kambatla
7bfd9e068d MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha) 
(cherry picked from commit ed0e0ef9748ce5b231de677ab41c3035137bbde4)
 2014-10-11 22:49:46 -07:00
cnauroth
f6278cbac5 MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth. 
(cherry picked from commit 777877d079ecb025c293deac741800800e413179)
 2014-10-09 22:38:25 -07:00
cnauroth
61be28f501 MAPREDUCE-6122. Fix CHANGES.txt. 
(cherry picked from commit 2f0166db560b180e8d07c10ba9ad4bfaf2aa7b36)
 2014-10-09 22:32:38 -07:00
cnauroth
85a2b90740 MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth. 
(cherry picked from commit 684170d5efdc11bcd9967168f44a428d1a72af3c)
 2014-10-09 22:27:40 -07:00
Jason Lowe
979b915ecc MAPREDUCE-6029. TestCommitterEventHandler fails in trunk. Contributed by Mit Desai 
(cherry picked from commit 2e789eb2261fa607489d8ae630fb77e8147d0266)
 2014-10-07 14:11:48 +00:00
subru
30a370e705 MAPREDUCE-6103.Adding reservation APIs to MR resource manager delegate. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit aa92dd45f2d8c89a8a17ad2e4449aa3ff08bc53a)
(cherry picked from commit 3f282762d1afc916de9207d3adeda852ca344853)
 2014-10-06 10:21:06 -07:00
Arun C. Murthy
6a60fa279a Preparing to branch hadoop-2.6 2014-09-30 10:37:03 -07:00
Jason Lowe
7b8f2f5b1d MAPREDUCE-6094. TestMRCJCFileInputFormat.testAddInputPath() fails on trunk. Contributed by Akira AJISAKA 
(cherry picked from commit 23fbfe36c31674907a26c8ecc6fd47888dfcc1ea)
 2014-09-29 18:14:11 +00:00
Allen Wittenauer
c65ef9ca1e MAPREDUCE-6072. Remove INSTALL document (Akira AJISAKA via aw) 2014-09-29 08:31:10 -07:00
Jason Lowe
0cfff28f57 HADOOP-11049. javax package system class default is too broad. Contributed by Sangjin Lee 
(cherry picked from commit cf4631d7c9448205f4952341c071e1650e7922dc)
 2014-09-29 14:37:28 +00:00
Jian He
a6879b606e MAPREDUCE-6087. Fixed wrong config name of MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by Akira AJISAKA 
(cherry picked from commit 5f16c98ad66b562760d5d947151a38f14875d21a)
 2014-09-26 18:06:19 -07:00
Allen Wittenauer
67d6fc3f01 MAPREDUCE-5945. Update the description of GenericOptionsParser -jt option (Akira AJISAKA via aw) 2014-09-26 14:26:36 -07:00
Allen Wittenauer
e5d284664b MAPREDUCE-5796. Use current version of the archive name in DistributedCacheDeploy document (Akira AJISAKA via aw) 2014-09-26 12:59:59 -07:00
Allen Wittenauer
fe8222998f MAPREDUCE-6073. Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags (Tsuyoshi OZAWA via aw) 2014-09-26 11:17:11 -07:00
Zhijie Shen
7b3ecc547f MAPREDUCE-5831. Make MR client ignore unknown counters received from AM. Contributed by Junping Du. 
(cherry picked from commit 662fc11ae7ccea9d05dfe54b2a794bb08cfd70a4)
 2014-09-25 23:46:57 -07:00
Allen Wittenauer
7ffb636a54 MAPREDUCE-6093. minor distcp doc edits (Charles Lamb via aw) 2014-09-25 11:33:01 -07:00
Allen Wittenauer
afde00a0f5 MAPREDUCE-6109. Fix minor typo in distcp -p usage text (Charles Lamb via aw) 2014-09-25 11:28:50 -07:00
Jason Lowe
d5d9fd3255 MAPREDUCE-6104. TestJobHistoryParsing.testPartialJob fails in branch-2. Contributed by Mit Desai 
(cherry picked from commit 7af4c3888bf7be0822dc880170e5e3d09e9280f1)
 2014-09-24 16:10:28 +00:00
Zhijie Shen
b8d645539d MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev. 2014-09-22 10:41:55 -07:00
Jason Lowe
f4534746fb MAPREDUCE-6095. Enable DistributedCache for uber-mode Jobs. Contributed by Gera Shegalov 
(cherry picked from commit 7039b98e1c459e9e0d8caa28cdaa2868e2bde2eb)
 2014-09-22 15:22:58 +00:00
Allen Wittenauer
0037b8f67b YARN-2460. Remove obsolete entries from yarn-default.xml (Ray Chiang via aw) 2014-09-19 14:08:04 -07:00
Jason Lowe
bdb864e5e1 MAPREDUCE-6091. YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view. Contributed by Sangjin Lee 
(cherry picked from commit 951847ba94442b8d928435decfbea9ea20882912)
 2014-09-19 20:17:44 +00:00
Zhijie Shen
9333ee3068 YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He. 
(cherry picked from commit 6fe5c6b746a40019b9a43676c33efec0f971c4b9)
 2014-09-18 22:02:53 -07:00
Karthik Kambatla
372bf54072 MAPREDUCE-6086. mapreduce.job.credentials.binary should allow all URIs. (Zhihai Xu via kasha) 
(cherry picked from commit 52945a33cc3fcb3b961cce0e7e3ca01291f2a223)
 2014-09-18 15:47:21 -07:00
Jason Lowe
44c7113133 MAPREDUCE-5891. Improved shuffle error handling across NM restarts. Contributed by Junping Du 
(cherry picked from commit 2c3da25fd718b3a9c1ed67f05b577975ae613f4e)
 2014-09-18 22:01:42 +00:00
Andrew Wang
5bc71071d1 HADOOP-11106. Document considerations of HAR and Encryption. (clamb via wang) 
(cherry picked from commit fe2f54d4cbd4b02bc3b8f642d0689b17dbfe169b)
 2014-09-18 14:51:27 -07:00
Jason Lowe
4b4e44a8aa MAPREDUCE-6090. mapred hsadmin getGroups fails to connect in some cases. Contributed by Robert Kanter 
(cherry picked from commit 1cf31980474bf9ac28e51b6f014eae09eda9e15f)
 2014-09-18 21:02:13 +00:00
Vinod Kumar Vavilapalli
5cdb24d4b1 YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong. 
(cherry picked from commit 14e2639fd0d53f7e0b58f2f4744af44983d4e867)
 2014-09-13 18:05:02 -07:00
Karthik Kambatla
d22cd065ed Update CHANGES.txt to set the release date for 2.5.1 
(cherry picked from commit 17ffbe08642c622f099dd1cd9cb9e008ba98ea52)
 2014-09-11 17:36:06 -07:00
Jason Lowe
6f8abe7efe MAPREDUCE-6070. yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 9e28e089c6bcb0b264751bdfa1f994ce002ef2de)
 2014-09-11 16:20:51 +00:00
Jason Lowe
e6f108c99b MAPREDUCE-6075. HistoryServerFileSystemStateStore can create zero-length files. Contributed by Jason Lowe 
(cherry picked from commit 17a025d9dda9949f191b650e3ef96090880f568a)
 2014-09-10 22:12:24 +00:00
Jason Lowe
0b3f918b3b MAPREDUCE-6071. JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 45efc966ee1a1bda0271464dcee2564862d53b1f)
 2014-09-05 13:48:16 +00:00
Chris Douglas
69ee11dc93 MAPREDUCE-6063. Correct spill size calculation for spills wrapping the circular buffer. Contributed by zhihai xu. 2014-09-03 17:02:17 -07:00
Karthik Kambatla
9855e884cb HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha) 
(cherry picked from commit ce0462129fe09898fd9b169cae0564cb6d9bc419)
 2014-09-03 09:39:32 -07:00
Andrew Wang
075bb9e380 HADOOP-11021. Configurable replication factor in the hadoop archive command. Contributed by Zhe Zhang. 
(cherry picked from commit ea1c6f31c2d2ea5b38ed57e2aa241d122103a721)
 2014-08-29 14:47:28 -07:00
Jason Lowe
27086f5942 MAPREDUCE-5931. Validate SleepJob command line parameters. Contributed by Gera Shegalov 
(cherry picked from commit 15366d922772afaa9457ed946533cdf4b5d01e2f)
 2014-08-29 19:52:10 +00:00
Chris Douglas
4f95017602 Fix typos in log messages. Contributed by Ray Chiang 2014-08-28 16:30:13 -07:00
Alejandro Abdelnur
1a65717ffa Removing CHANGES-fs-encryption.txt files 2014-08-28 15:13:24 -07:00
Alejandro Abdelnur
5c37f02e27 Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-08-28 15:05:07 -07:00