Commit Graph

9306 Commits

Author SHA1 Message Date
Sangjin Lee 856a131c65 YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee)
(cherry picked from commit 6d67420dbc)
2016-03-31 10:52:39 -07:00
Akira Ajisaka 480b01ba95 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak.
(cherry picked from commit acca149ec9)
(cherry picked from commit b4fbc22688)
2016-03-31 16:07:22 +09:00
Arpit Agarwal 7f14dc3294 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 13:07:31 -07:00
Kihwal Lee efb210cc30 Fix CHANGES.txt 2016-03-28 11:31:07 -05:00
Walter Su ec459e3966 HDFS-10182. Hedged read might overwrite user's buf. Contributed by zhouyingchao.
(cherry picked from commit d8383c687c)
2016-03-28 15:46:15 +08:00
Aaron T. Myers 17dbf82f54 HDFS-8101. DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime. Contributed by Sean Busbey.
(cherry picked from commit 3fe61e0bb0)
2016-03-26 17:54:09 -07:00
Jason Lowe 02e81caa21 HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
(cherry picked from commit 9a09200a1f)
2016-03-25 23:03:39 +00:00
Akira Ajisaka a112c0138a MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina.
(cherry picked from commit 368c77376a)
(cherry picked from commit 7a3fd1bc1a)
2016-03-23 23:26:33 +09:00
Akira Ajisaka 04cc99152f MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger.
(cherry picked from commit 0bfe5a0167)
(cherry picked from commit 12c1cc889a)
2016-03-23 13:23:29 +09:00
Xiaoyu Yao 54dd9a14ab HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang.
(cherry picked from commit ab725cff66)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-03-22 14:01:43 -07:00
Xiaoyu Yao c6f68a7f98 HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang.
Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-03-18 17:48:56 -07:00
Eric Payne f0c278469b YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 2016-03-18 21:01:53 +00:00
Kihwal Lee a66d2a2a85 HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah.
(cherry picked from commit 63c966a3fb)
(cherry picked from commit 242c7f1fee)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java
2016-03-18 10:38:33 -05:00
Junping Du bb5749b1e0 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. Contributed by Varun Vasudev. 2016-03-17 09:44:06 -07:00
Akira Ajisaka d593976ffc MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak.
(cherry picked from commit 80fa70c4e1)
(cherry picked from commit 365d236175)
2016-03-17 18:13:20 +09:00
Akira Ajisaka 6902789a92 HDFS-9860. Backport HDFS-9638 to branch-2.7. Contributed by Wei-Chiu Chuang. 2016-03-17 02:59:51 +09:00
Kihwal Lee b8e73cff8f HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun.
(cherry picked from commit d457401784)
2016-03-15 10:56:46 -05:00
Steve Loughran b409ce89e9 Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)"
This reverts commit acafc950d9.
2016-03-11 16:59:09 +00:00
Masatake Iwasaki acafc950d9 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 2016-03-11 15:12:22 +09:00
Akira Ajisaka cff6db1f92 HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak.
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
(cherry picked from commit 0d8ad99e0d)
2016-03-09 15:35:12 +09:00
Ming Ma d6e40fd270 Update CHANGES.txt for HADOOP-12789 2016-03-07 20:50:09 -08:00
Ming Ma f01f1940c4 HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma)
(cherry picked from commit 49eedc7ff0)
2016-03-07 20:43:07 -08:00
Akira Ajisaka 7f43eb9547 HDFS-9812. Streamer threads leak if failure happens when closing DFSOutputStream. Contributed by Lin Yiqun.
(cherry picked from commit 352d299cf8)
(cherry picked from commit fe0009a2bd)
2016-03-08 11:15:27 +09:00
Masatake Iwasaki e768f8b771 HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims) 2016-03-08 02:13:50 +09:00
Jason Lowe 63b2019ab4 YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger
(cherry picked from commit 4163e36c2b)
2016-03-07 15:59:45 +00:00
Zhihai Xu 274e182860 YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee
(cherry picked from commit e1ccc9622b)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java
2016-03-06 20:46:56 -08:00
Robert Kanter 66e1e92ffd MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter)
(cherry picked from commit 0f72da7e28)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
2016-03-06 18:34:46 -08:00
Akira Ajisaka 71e89e82e9 HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0a9f00af5e)
(cherry picked from commit 899715a15e)
2016-03-03 23:33:09 +09:00
Akira Ajisaka 53106a3a4c HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1c3136cbd8)
(cherry picked from commit 96a0939d5b)
2016-03-03 23:23:39 +09:00
Masatake Iwasaki 08fc048018 HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims)
(cherry picked from commit 33a412e8a4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 55f7ceb0db)
2016-03-03 19:00:50 +09:00
Akira Ajisaka 06d9a245fe HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
(cherry picked from commit eb864d35d6)
(cherry picked from commit 9e87f59dea)
2016-03-03 18:52:18 +09:00
Akira Ajisaka 8f2d0d4cea HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula. 2016-03-02 14:45:33 +09:00
Akira Ajisaka 2f3ceb8c65 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 81fbc40f084eab85750cc7d4cc967d43d70d8333)
(cherry picked from commit e840141726)
2016-03-02 14:16:58 +09:00
Kihwal Lee 006ed54a16 HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee.
(cherry picked from commit e76b13c415)
2016-03-01 17:02:43 -06:00
Kihwal Lee 9bc9e13a97 HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo.
(cherry picked from commit b8dbffbef87c0ee0bee5e17649586fc9f0e1f55b)
2016-03-01 15:01:04 -06:00
Kihwal Lee 9fa300ad1f HDFS-9198. Coalesce IBR processing in the NN. Contributed by Daryn Sharp. 2016-03-01 13:02:05 -06:00
Akira Ajisaka e14ab939bf HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula.
(cherry picked from commit 056f9013122dc3f0effc62d620261c312dd7f8ed)
(cherry picked from commit 6a9f8d95b7c4f9c66253d975ebbca1d186267d4e)
2016-02-29 18:41:57 +09:00
Suresh Srinivas 0481817381 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
(cherry picked from commit fca24fbbaa)
2016-02-29 11:36:40 +09:00
Jason Lowe f68e1401b8 YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla 2016-02-26 20:28:29 +00:00
Suresh Srinivas 3bcca662bc HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
2016-02-27 01:26:47 +09:00
Kihwal Lee 25b3531eb4 HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 2016-02-26 09:45:52 -06:00
Sangjin Lee 8ceb9f38af YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
(cherry picked from commit 553b591ba0)
2016-02-24 09:35:23 -08:00
Jason Lowe b406dcaff2 YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma 2016-02-23 20:53:30 +00:00
Varun Vasudev 0edc764184 MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du.
(cherry picked from commit c6f2d761d5)
(cherry picked from commit f1999fe275)

 Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
2016-02-23 14:45:07 +05:30
Vinayakumar B 33b961ee88 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo
Addendum to fix compilation
2016-02-23 14:39:24 +05:30
Tsz-Wo Nicholas Sze 1b139593c5 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:18:46 -08:00
Zhe Zhang 79027309c9 HDFS-9688. Test the effect of nested encryption zones in HDFS downgrade.
Change-Id: I2a802325a2bc82c97012d2c9fb388b292fe3af8f
2016-02-22 15:10:31 -08:00
Akira Ajisaka 541dc02a6a YARN-4707. Remove the extra char (>) from SecureContainer.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 5e7d4d51f8)
(cherry picked from commit 34635f9e37)
2016-02-22 17:18:26 +09:00
Andrew Wang 403934c011 MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula.
(cherry picked from commit 37577852ba)
(cherry picked from commit 7f6737951a)
2016-02-19 16:37:28 -08:00
Zhe Zhang c420dfeffb HADOOP-12800. Copy docker directory from 2.8 to 2.7/2.6 repos to enable pre-commit Jenkins runs. (zhz)
Change-Id: I893319c53e497420e2b20511f0d5c0803d8515ba
2016-02-19 14:34:16 -08:00