Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,395 Commits 326 Branches 371 Tags
Commit Graph

1483 Commits

Author SHA1 Message Date
Junping Du
7e36b9159e MAPREDUCE-6657. Job history server can fail on startup when NameNode is in start phase. Contributed by Haibo Chen. 
(cherry picked from commit f6ef876fe158a5334cad7075f1966573a1c4dec9)
 2016-05-17 14:42:11 -07:00
Jason Lowe
9c47862d87 MAPREDUCE-6698. Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser. Contributed by Haibo Chen 
(cherry picked from commit 34fddd1e912dcd9f898e500b8df11295ee49c0d8)
 2016-05-17 15:04:02 +00:00
Jason Lowe
51e06c085f MAPREDUCE-6701. application master log can not be available when clicking jobhistory's am logs link. Contributed by Haibo Chen 
(cherry picked from commit 12fa4ec141f8d0cb105b6f60c3739a4b26890fd5)
 2016-05-17 14:56:23 +00:00
Akira Ajisaka
19db965c27 MAPREDUCE-6693. ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit. Contributed by Ajith S. 
(cherry picked from commit b3579305268bffc44a8041c5b75f15f01ebb9ce4)
 2016-05-17 20:22:46 +09:00
Jason Lowe
08743edd70 MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg 
(cherry picked from commit 9227dfc25f373a99cb66ad7d6bacef8dcf336f77)
 2016-05-13 14:35:34 +00:00
Steve Loughran
eab6e633ee MAPREDUCE-6639 Process hangs in LocatedFileStatusFetcher if FileSystem.get throws. Ryan Blue via stevel 2016-05-12 19:00:08 +01:00
Jason Lowe
d3dfed3fd0 MAPREDUCE-6684. High contention on scanning of user directory under immediate_done in Job History Server. Contributed by Haibo Chen 
(cherry picked from commit 5ffb54694b52657f3b7de4560474ab740734e1b2)
 2016-05-10 16:06:26 +00:00
Eric Payne
77d147e0ec MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. Contributed by Nathan Roberts. 
(cherry picked from commit cd35b692de88e3afe7f41405da635c3fbd9b4650)
 2016-05-10 16:04:09 +00:00
Jason Lowe
d1aa3e0f89 MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan 
(cherry picked from commit c9bb96fa81fc925e33ccc0b02c98cc2d929df120)
 2016-05-06 22:27:24 +00:00
Vinod Kumar Vavilapalli
e9c7a17bc8 MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan. 
(cherry picked from commit 8d48266720dcf0e71cfd87fef18b60a53aa1bef9)
 2016-05-05 19:05:44 -07:00
Robert Kanter
f9d6092108 MAPREDUCE-6675. TestJobImpl.testUnusableNode failed (haibochen via rkanter) 
(cherry picked from commit 9d3fcdfbb314c83ba6185e4ac8de649dad51a279)
 2016-05-04 22:42:34 -07:00
Robert Kanter
cca8e9b90c MAPREDUCE-6677. LocalContainerAllocator doesn't specify resource of the containers allocated (haibochen via rkanter) 
(cherry picked from commit ecce3b7d53ab624c9931273716326c76641ea11d)
 2016-05-04 22:19:42 -07:00
Harsh J
2d7e4a8228 MAPREDUCE-2398. MRBench: setting the baseDir parameter has no effect. Contributed by Michael Noll and Wilfred Spiegelenburg. 
(cherry picked from commit 7da5847cf10bc61f2131d578f16ee37cb32c4639)
 2016-04-21 17:54:24 +05:30
Jian He
70a31458e0 MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du 
(cherry picked from commit 1e48eefe5800975ea0c4295c9911ae3f572ed37d)
 2016-04-20 19:02:58 -07:00
Xuan
94e4d349b0 YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du 
(cherry picked from commit e6c0742012ffeacad2bcaf712d86a7e5d1420b26)
 2016-04-16 19:40:11 -07:00
Eric Payne
edb096eab7 MAPREDUCE-6649. getFailureInfo not returning any failure info. Contributed by Eric Badger 2016-04-16 22:22:42 +00:00
Wangda Tan
ab23acdfda MAPREDUCE-6513. MR job got hanged forever when one NM unstable for some time. (Varun Saxena via wangda) 2016-04-14 11:16:37 -07:00
Eric Payne
17c4f34b3d MAPREDUCE-6633. AM should retry map attempts if the reduce task encounters commpression related errors. Contributed by Rushabh Shah 
(cherry picked from commit 1fec06e037d2b22dafc64f33d4f1231bef4ceba8)
 2016-04-09 18:27:03 +00:00
Robert Kanter
3584cbc355 MAPREDUCE-6647. MR usage counters use the resources requested instead of the resources allocated (haibochen via rkanter) 
(cherry picked from commit 3be1ab485f557c8a3c6a5066453f24d8d61f30be)
 2016-04-06 17:16:10 -07:00
Junping Du
5574f82799 MAPREDUCE-6670. TestJobListCache#testEviction sometimes fails on Windows with timeout. Contributed by Gergely Novák. 
(cherry picked from commit de96d7c88a42cd54bd88ce2de63122998e967efa)
 2016-04-06 08:35:51 -07:00
Akira Ajisaka
94b2ba89a4 MAPREDUCE-6663. [NNBench] Refactor nnbench as a Tool implementation. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 690d8a368d3e967495eafea27659b6124989c89e)
 2016-03-30 11:44:33 +09:00
Akira Ajisaka
7b2cf29f4f MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote. 
(cherry picked from commit 0050fa5f1c20087009bd76a0bb2183a479f787f0)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
 2016-03-29 18:20:01 +09:00
Rohith Sharma K S
f22ce96b50 MAPREDUCE-6662. Clear ASF Warnings on test data files. Contributed by Vinayakumar B 
(cherry picked from commit 0ef8bbfd8791899c7cfed3dd9c1670182fd87575)
 2016-03-29 10:35:04 +08:00
Junping Du
ae29b1a17b MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 90fcb16c0fc7cded2593948f1cc08f3d1ae88bda)
 2016-03-28 05:31:46 -07:00
Akira Ajisaka
2b1f066d2d Revert "MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote." 
This reverts commit 0dc145362642f6e5f9def8f50775b5c16599f6e6.
 2016-03-28 16:05:55 +09:00
Jason Lowe
8360d98d6a MAPREDUCE-6535. TaskID default constructor results in NPE on toString(). Contributed by Daniel Templeton 
(cherry picked from commit 3f622a143c5fb15fee7e5dded99e4a4136f19810)
 2016-03-25 20:07:56 +00:00
Akira Ajisaka
0dc1453626 MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote. 
(cherry picked from commit 2c268cc9365851f5b02d967d13c8c0cbca850a86)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
 2016-03-25 15:23:23 +09:00
Akira Ajisaka
7a3fd1bc1a MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina. 
(cherry picked from commit 368c77376a3704e3fa395d72b1816d388b5cd782)
 2016-03-23 23:24:30 +09:00
Akira Ajisaka
12c1cc889a MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger. 
(cherry picked from commit 0bfe5a0167f0af65f1d7a8bc251a1c404ed41316)
 2016-03-23 13:19:08 +09:00
Li Lu
8bbb5efbfb MAPREDUCE-6110. JobHistoryServer CLI throws NullPointerException with job ids that do not exist. (Kai Sasaki via gtcarrera9) 
(cherry picked from commit 57ead18a85e15aef1993f49157cf05aed38f1c87)
 2016-03-22 14:29:12 -07:00
Karthik Kambatla
95b59c17a7 YARN-4732. *ProcessTree classes have too many whitespace issues 
(cherry picked from commit 7fae4c68e6d599d0c01bb2cb2c8d5e52925b3e1e)
 2016-03-20 10:47:56 -07:00
Wangda Tan
abfb2957d1 MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda) 
(cherry picked from commit 6529c87551e07e9da1e1b273eff4c6bad6b3e838)
 2016-03-15 17:30:37 -07:00
Akira Ajisaka
c2e14d1bbb MAPREDUCE-6520. Migrate MR Client test cases part 1. Contributed by Dustin Cote. 
(cherry picked from commit 247a7906092065289ea81139e71badcac6abef1e)
 2016-03-11 22:54:40 +09:00
Akira Ajisaka
99f61afcdd Revert "MAPREDUCE-6520. Migrate MR Client test cases part 1." 
This reverts commit 7d665f0a987c17dcf8a26113c61a70dee196ee3d.
 2016-03-11 22:52:10 +09:00
Akira Ajisaka
7d665f0a98 MAPREDUCE-6520. Migrate MR Client test cases part 1. 
(cherry picked from commit ef68b441957c6deb65adae2272d60ac929d00733)
 2016-03-11 22:25:29 +09:00
Varun Vasudev
e9a0ffc7f1 YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron. 
(cherry picked from commit 43416187c07afb35e3267f94d0a41d8d3cfb5735)
 2016-03-07 15:23:36 +05:30
Harsh J
ed22444a60 MAPREDUCE-6648. Add yarn.app.mapreduce.am.log.level to mapred-default.xml (harsh) 2016-03-07 13:13:05 +05:30
Masatake Iwasaki
722182fdfb HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a61252f253aa2bcdb9cad70f7876d231)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
 2016-03-04 14:12:44 +09:00
Robert Kanter
f9f57265cf MAPREDUCE-4785. TestMRApp occasionally fails (haibochen via rkanter) 
(cherry picked from commit ff0ee84d77d9438f0954ae4e1497d63997bb7347)
 2016-03-03 16:38:25 -08:00
Robert Kanter
48cb4b9ba7 MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter) 
(cherry picked from commit 0f72da7e281376f4fcbfbf3fb33f5d7fedcdb1aa)
 2016-02-26 17:57:45 -08:00
Robert Kanter
ec48848711 YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter) 
(cherry picked from commit c4d4df8de09ee0c89ea8176bd8149900becd3c0c)
 2016-02-25 12:48:29 -08:00
Robert Kanter
d9f01f28a0 MAPREDUCE-6640. mapred job -history command should be able to take Job ID (rkanter) 
(cherry picked from commit 4343a4cf7790b47dc7ecd18f8634e6b9c805e775)
 2016-02-23 17:38:25 -08:00
Varun Vasudev
f1999fe275 MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du. 
(cherry picked from commit c6f2d761d5430eac6b9f07f137a7028de4e0660c)
 2016-02-23 13:05:52 +05:30
Tsuyoshi Ozawa
929e869ae0 YARN-4708. Missing default mapper type in TimelineServer performance test tool usage. Contributed by Kai Sasaki. 
(cherry picked from commit b68901d7dde9cb48545fcf0b94f2ac266b909a5d)
 2016-02-22 07:55:35 +09:00
Andrew Wang
7f6737951a MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 37577852ba54ba506b0b6c4db5e95d176f5e9b63)
 2016-02-19 16:33:40 -08:00
Robert Kanter
a33109a0b8 MAPREDUCE-6627. Add machine-readable output to mapred job -history command (rkanter) 
(cherry picked from commit 8eee59ce6b3044cb73bb41fed6b7ece959e7c2f8)
 2016-02-18 17:58:40 -08:00
Robert Kanter
f864faaafa HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter) 
(cherry picked from commit a365a3941cf96a31c289cb22678a602738880f74)
 2016-02-18 11:11:32 -08:00
Varun Vasudev
212c519ad3 MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana. 
(cherry picked from commit c50d1e54000c76880a041ce5959a2eb23c86bd35)
 2016-02-18 14:19:01 +05:30
Tsuyoshi Ozawa
a33cdfb875 MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy. 
(cherry picked from commit 453e7e0d1091cf795152c8992c6c5cbc772d80d6)
 2016-02-17 14:18:04 +09:00
Jason Lowe
303c650d0d MAPREDUCE-6191. Improve clearing stale state of Java serialization 
testcase.  (Sam Liu via Eric Yang)
(cherry picked from commit c379e102ddab1b83fd69e4492a40c9901fb50675)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2016-02-10 16:44:12 +00:00