Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,589 Commits 326 Branches 371 Tags
Commit Graph

2327 Commits

Author SHA1 Message Date
Akira Ajisaka
7d665f0a98 MAPREDUCE-6520. Migrate MR Client test cases part 1. 
(cherry picked from commit ef68b441957c6deb65adae2272d60ac929d00733)
 2016-03-11 22:25:29 +09:00
Allen Wittenauer
9f4b3eaac0 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 45bb467918ce986760ba5f7a948cf016656f0e57.
 2016-03-09 09:59:19 -08:00
Chris Nauroth
38a031ce68 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml
 2016-03-08 21:22:57 -08:00
Varun Vasudev
e9a0ffc7f1 YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron. 
(cherry picked from commit 43416187c07afb35e3267f94d0a41d8d3cfb5735)
 2016-03-07 15:23:36 +05:30
Harsh J
ed22444a60 MAPREDUCE-6648. Add yarn.app.mapreduce.am.log.level to mapred-default.xml (harsh) 2016-03-07 13:13:05 +05:30
Masatake Iwasaki
722182fdfb HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a61252f253aa2bcdb9cad70f7876d231)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
 2016-03-04 14:12:44 +09:00
Andrew Wang
670944810c HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:58 -08:00
Robert Kanter
f9f57265cf MAPREDUCE-4785. TestMRApp occasionally fails (haibochen via rkanter) 
(cherry picked from commit ff0ee84d77d9438f0954ae4e1497d63997bb7347)
 2016-03-03 16:38:25 -08:00
Robert Kanter
48cb4b9ba7 MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter) 
(cherry picked from commit 0f72da7e281376f4fcbfbf3fb33f5d7fedcdb1aa)
 2016-02-26 17:57:45 -08:00
Robert Kanter
ec48848711 YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter) 
(cherry picked from commit c4d4df8de09ee0c89ea8176bd8149900becd3c0c)
 2016-02-25 12:48:29 -08:00
Robert Kanter
d9f01f28a0 MAPREDUCE-6640. mapred job -history command should be able to take Job ID (rkanter) 
(cherry picked from commit 4343a4cf7790b47dc7ecd18f8634e6b9c805e775)
 2016-02-23 17:38:25 -08:00
Varun Vasudev
f1999fe275 MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du. 
(cherry picked from commit c6f2d761d5430eac6b9f07f137a7028de4e0660c)
 2016-02-23 13:05:52 +05:30
Tsuyoshi Ozawa
929e869ae0 YARN-4708. Missing default mapper type in TimelineServer performance test tool usage. Contributed by Kai Sasaki. 
(cherry picked from commit b68901d7dde9cb48545fcf0b94f2ac266b909a5d)
 2016-02-22 07:55:35 +09:00
Andrew Wang
7f6737951a MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 37577852ba54ba506b0b6c4db5e95d176f5e9b63)
 2016-02-19 16:33:40 -08:00
Robert Kanter
a33109a0b8 MAPREDUCE-6627. Add machine-readable output to mapred job -history command (rkanter) 
(cherry picked from commit 8eee59ce6b3044cb73bb41fed6b7ece959e7c2f8)
 2016-02-18 17:58:40 -08:00
Robert Kanter
f864faaafa HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter) 
(cherry picked from commit a365a3941cf96a31c289cb22678a602738880f74)
 2016-02-18 11:11:32 -08:00
Varun Vasudev
212c519ad3 MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana. 
(cherry picked from commit c50d1e54000c76880a041ce5959a2eb23c86bd35)
 2016-02-18 14:19:01 +05:30
Tsuyoshi Ozawa
a33cdfb875 MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy. 
(cherry picked from commit 453e7e0d1091cf795152c8992c6c5cbc772d80d6)
 2016-02-17 14:18:04 +09:00
Junping Du
a28be9edc7 Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
 2016-02-13 01:44:12 -08:00
Jason Lowe
303c650d0d MAPREDUCE-6191. Improve clearing stale state of Java serialization 
testcase.  (Sam Liu via Eric Yang)
(cherry picked from commit c379e102ddab1b83fd69e4492a40c9901fb50675)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2016-02-10 16:44:12 +00:00
Akira Ajisaka
15ef3a85d9 Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta." 
This reverts commit e4c01b8b1ce511de24db00afacef1e737845a4f7.
 2016-02-10 23:45:15 +09:00
Akira Ajisaka
9a55d3a7cb MAPREDUCE-6626. Reuse ObjectMapper instance in MapReduce. Contributed by Lin Yiqun. 
(cherry picked from commit 10393d9a666419a5d8dc0cfb48da96e9c690c11e)
 2016-02-10 03:05:16 +09:00
Jason Lowe
57d79f908e Update CHANGES.txt to reflect recent commits to branch-2.7 and branch-2.6. 
(cherry picked from commit fba6e9f5ef3d032986888117b3e53808e7dcf873)
 2016-02-09 16:55:40 +00:00
Akira Ajisaka
e4c01b8b1c HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit fe124da5ffc16e4795c3dd5542accd58361e1b08)
 2016-02-06 19:32:50 +09:00
Junping Du
3583c77ee8 Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:09:17 -08:00
Robert Kanter
358c49d830 MAPREDUCE-6620. Jobs that did not start are shown as starting in 1969 in the JHS web UI (haibochen via rkanter) 
(cherry picked from commit ccbba4a4deb8ade54a04137c993526e461bcb46e)
 2016-02-02 15:21:51 -08:00
Jason Lowe
4ee0977687 MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong 
(cherry picked from commit 43e669b22d9ac0b81ab8cc397c5d6d92bac986c6)
 2016-02-02 19:31:33 +00:00
Wangda Tan
9591363ad8 YARN-4340. Add list API to reservation system. (Sean Po via wangda) 
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
 2016-02-02 10:19:19 +08:00
Jason Lowe
f5f6652137 MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong 
(cherry picked from commit 59a212b6e1265adfa9b55c71b65a22157dfccf77)
 2016-02-01 16:06:42 +00:00
Akira Ajisaka
6ce9b1240e MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte characters in the job name. Contributed by Kousuke Saruta. 
(cherry picked from commit d314a3f99d5d03c62a3b8fb8883886440ab7d1db)
 2016-01-29 16:20:37 +09:00
cnauroth
bd01fdb64d MAPREDUCE-6563. Streaming documentation contains a stray % character. Contributed by Chris Nauroth. 
(cherry picked from commit 41da9a07738c6d019e2467f139750b7e2f50a914)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-01-28 14:46:42 -08:00
Junping Du
db7ff115c0 MAPREDUCE-6595. Fix findbugs warnings in OutputCommitter and FileOutputCommitter. Contributed by Akira AJISAKA. 
(cherry picked from commit 86560a4978c498bd5e892c509a466807a812b8a7)
 2016-01-28 06:18:59 -08:00
Robert Kanter
a99fa74490 MAPREDUCE-6431. JobClient should be an AutoClosable (haibochen via rkanter) 
(cherry picked from commit dca0dc8ac28e843acd8b79c9560245638a539fde)
 2016-01-27 17:11:41 -08:00
Jian He
da18bbedaf MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du 2016-01-27 13:16:59 -08:00
Jian He
ad42229683 MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response. Contributed by Li Lu 2016-01-25 23:01:29 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
97f6cfa94b Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
 2016-01-25 15:47:02 -08:00
Akira Ajisaka
a9386cae6e MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki. 2016-01-25 11:39:42 +09:00
Akira Ajisaka
7f215ffdd5 MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. Contributed by Kai Sasaki. 2016-01-22 18:37:17 +09:00
Karthik Kambatla
ef59521094 YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha) 
(cherry picked from commit d40859fab1ad977636457a6cc96b6a4f9b903afc)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapred/TestTaskAttemptListenerImpl.java
 2016-01-18 10:59:34 +01:00
Jason Lowe
5923f50797 MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt 
(cherry picked from commit 9fbd579ab50f051c8ad63d316ca5a3e24822dcdd)
 2016-01-15 16:53:34 +00:00
Akira Ajisaka
7c4be15991 MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. Contributed by Kai Sasaki. 
(cherry picked from commit 5cc44d18aa946ce2a7a9ffbd7bcce57b07e9e1cb)
 2016-01-15 00:44:42 +09:00
Akira Ajisaka
6efee8907a MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt. 
(cherry picked from commit 7b0964f354e90968c2dac2f7acc17214732aed64)
 2016-01-14 10:41:22 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
8de365a11c MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
Removed multiple duplicate CHANGES.txt entries.

(cherry picked from commit 9b33a03900c9ffdb9f4b4c59161fdce39ca8c73d)
 2016-01-13 15:04:09 -08:00
Jason Lowe
0af01092b6 MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla 
(cherry picked from commit f657b54281d517c69df0a23b97b47befa77d1dc2)
 2016-01-12 23:58:01 +00:00
Wangda Tan
15e174fe79 YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda) 
(cherry picked from commit 9e792da01419998c2ebfafd7161070150d85d3ac)
 2016-01-12 12:54:09 +08:00
Jason Lowe
6944e7ef44 Add MR-5982 and MR-6492 to 2.6.4 
(cherry picked from commit e5df366707e326d869f72db03b08228b33ff6e46)
 2016-01-11 18:32:48 +00:00
Junping Du
51073c910c MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang. 
(cherry picked from commit 8c1adeaa26a7eaaca891dccdb71ff085e598a7de)
 2016-01-11 06:13:53 -08:00
Sangjin Lee
7458854888 MAPREDUCE-6577 addendum. Moved the changelog to 2.6.4 which is the earliest target. 
(cherry picked from commit 355c0ce7237c5208557bb32ec0423819bb9b47b3)
 2016-01-05 15:45:01 -08:00
Sangjin Lee
2dfa0613a1 MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee) 
(cherry picked from commit f6f16118d38fcfe3b724f05fad752cb223f441ec)
 2016-01-05 15:25:47 -08:00
Akira Ajisaka
6d235f0b91 MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE. Contributed by Naganarasimha G R. 
(cherry picked from commit 7dafee11d865c7c121c7886ac66aa9d088ea13f7)
 2016-01-04 16:31:28 +09:00