Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,067 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12067 Commits

Author SHA1 Message Date
Xuan 120f3a0ff9 YARN-4438. Implement RM leader election with curator. Contributed by Jian He 
(cherry picked from commit 89022f8d4b)
(cherry picked from commit 2cbbf76c3d)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-12-13 13:30:15 -08:00
Wangda Tan 6a18ae849f YARN-2009. CapacityScheduler: Add intra-queue preemption for app priority support. (Sunil G via wangda) 
(cherry-picked from commit 90dd3a8148)
 2016-12-12 23:13:08 +00:00
Mingliang Liu 01b50b36b6 HADOOP-13871. ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awful. Contributed by Steve Loughran 
(cherry picked from commit c6a3923245)
 2016-12-12 15:11:11 -08:00
Vinayakumar B 69db9eecfa HDFS-10570. Remove classpath conflicts of netty-all jar in hadoop-hdfs-client (Contributed by Vinayakumar B) 
(cherry picked from commit c6fb9f0d0b)
 2016-12-12 12:12:30 +05:30
Karthik Kambatla a0fa1f8386 YARN-5677. RM should transition to standby when connection is lost for an extended period. (Daniel Templeton via kasha) 
(cherry picked from commit aedd5c4c1b)
 2016-12-10 09:05:33 -08:00
Xiaoyu Yao bd4e5bc501 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4c38f11cec)
 2016-12-09 21:38:42 -08:00
Akira Ajisaka 0c58241b22 MAPREDUCE-6820. Fix dead links in Job relevant classes. Contributed by Yiqun Lin. 
(cherry picked from commit 92a8917ca5)
(cherry picked from commit 1e1ab9bc1b)
 2016-12-10 10:57:33 +09:00
Wei-Chiu Chuang fa3b2bee61 HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 292bd78b44)
 2016-12-09 16:12:09 -08:00
Wei-Chiu Chuang 983d487e98 HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge. 
(cherry picked from commit b606e025f1)

Conflicts:
   hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShell.java

(cherry picked from commit 6c93c1870c)
 2016-12-09 15:40:14 -08:00
Andrew Wang e8b0ef0618 HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore. 2016-12-09 14:56:49 -08:00
Jian He 40367c8da3 YARN-4390. Do surgical preemption based on reserved container in CapacityScheduler. Contributed by Wangda Tan 
(cherry picked from commit bb62e05925)
 2016-12-09 20:33:54 +00:00
Andrew Wang bced9e2e5b HDFS-11217. Annotate NameNode and DataNode MXBean interfaces as Private/Stable. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 5bd7dece92)
(cherry picked from commit 85adc6677b)
 2016-12-09 12:05:50 -08:00
Brahma Reddy Battula 3957161a97 HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin. 
(cherry picked from commit 80b8023276)
 2016-12-09 18:44:27 +05:30
Vinayakumar B b1c08737d8 HDFS-11224. Lifeline message should be ignored for dead nodes (Contributed by Vinayakumar B) 
(cherry picked from commit d1d4aba71b)
(cherry picked from commit 199d8b5594)
 2016-12-09 14:58:28 +05:30
Xiao Chen 892ee3f191 HDFS-11197. Listing encryption zones fails when deleting a EZ that is on a snapshotted directory. Contributed by Wellington Chevreuil. 
(cherry picked from commit 401c731872)
 2016-12-08 12:41:31 -08:00
Akira Ajisaka 39bf840398 HDFS-11223. Fix typos in HttpFs documentations. Contributed by Yiqun Lin. 
(cherry picked from commit 4c2cf5560f)
(cherry picked from commit 0478597ea9)
 2016-12-08 20:53:36 +09:00
Akira Ajisaka 59b0857c6b HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin. 
(cherry picked from commit 9ef89ede2f)
(cherry picked from commit e00a124cb5)
 2016-12-08 13:42:02 +09:00
Naganarasimha 5b44b0c9ed YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena 
(cherry picked from commit f3b8ff54ab)
 2016-12-08 07:37:12 +05:30
Vinayakumar B 7dc22dbe0c HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 6d2332ae37)
(cherry picked from commit 4b21b47f56)
 2016-12-07 15:58:29 -08:00
Junping Du 879caf688b YARN-5184. Fix up incompatible changes introduced on ContainerStatus and NodeReport. Contributed by Sangjin Lee. 2016-12-06 14:48:36 -08:00
Akira Ajisaka 460fe6594a MAPREDUCE-6816. Progress bars in Web UI always at 100%. Contributed by Shen Yinjie. 
(cherry picked from commit da4ecc9f82)
(cherry picked from commit 03854f0bc5)
 2016-12-07 06:44:31 +09:00
Kihwal Lee ac9801fec8 HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang. 2016-12-06 08:08:28 -06:00
Andrew Wang 092d0602c2 HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn. 
(cherry picked from commit 7b988e8899)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/util/GF256.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/KDiag.java

(cherry picked from commit 6bd600eef2)
 2016-12-05 23:21:17 -08:00
Andrew Wang 1a7b2ab9bb Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang" 
This reverts commit 3b80424d4f.
 2016-12-05 23:09:30 -08:00
Andrew Wang 79f830ed22 HDFS-10581. Hide redundant table on NameNode WebUI when no nodes are decomissioning. Contributed by Weiwei Yang. 
(cherry picked from commit 8e63fa98ea)
(cherry picked from commit 2fdae7324b)
 2016-12-05 18:14:09 -08:00
Jian He 802a1fb2fc YARN-5559. Analyse 2.8.0/3.0.0 jdiff reports and fix any issues. Contributed by Akira Ajisaka & Wangda Tan 
(cherry picked from commit 43ebff2e35)
 2016-12-05 11:40:46 -08:00
Xiao Chen 49f9e7cf71 HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge. 
(cherry picked from commit 291df5c7fb)
 2016-12-05 09:35:54 -08:00
Wei-Chiu Chuang 590c7f0d78 HDFS-11181. Fuse wrapper has a typo. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit b36af9b76c)
 2016-12-05 08:56:24 -08:00
Wangda Tan a87abf9b69 YARN-4934. Reserved Resource for QueueMetrics needs to be handled correctly in few cases. (Sunil G via wangda) 
(cherry picked from commit fdc46bfb37)
 2016-12-02 22:53:19 +00:00
Mingliang Liu 3232f5ffe6 HADOOP-13855. Fix a couple of the s3a statistic names to be consistent with the rest. Contributed by Steve Loughran 
(cherry picked from commit 6b6bc4705d2b608e810ae7d1912eac49bfd4c6ca)
 2016-12-02 13:55:17 -08:00
Mingliang Liu 4a1b7d6dee HADOOP-13857. S3AUtils.translateException to map (wrapped) InterruptedExceptions to InterruptedIOEs. Contributed by Steve Loughran 
(cherry picked from commit 2ff84a0040)
 2016-12-02 13:42:58 -08:00
Wangda Tan f9ef3e3719 YARN-4865. Track Reserved resources in ResourceUsage and QueueCapacities. (Sunil G via wangda) 2016-12-02 21:17:18 +00:00
Mingliang Liu 3b80424d4f HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang 
(cherry picked from commit c7ff34f8dc)
(cherry picked from commit be969e5918)
 2016-12-02 11:38:36 -08:00
Jason Lowe 69f66424b9 MAPREDUCE-6815. Fix flaky TestKill.testKillTask(). Contributed by Haibo Chen 
(cherry picked from commit 0cfd7ad21f)
 2016-12-02 17:23:33 +00:00
Jason Lowe e6394e3a35 YARN-5915. ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event write. Contributed by Atul Sikaria 
(cherry picked from commit 6b17d449bf)
 2016-12-02 17:00:05 +00:00
Akira Ajisaka 5025a898e1 HDFS-11180. Intermittent deadlock in NameNode when failover happens. 
(cherry picked from commit 5a7941a4fc)
 2016-12-02 11:35:22 +09:00
Kihwal Lee dd4acebb41 HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp. 
(cherry picked from commit 0d8a35bd6d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2016-12-01 12:20:30 -06:00
Mingliang Liu afad13f8d9 HADOOP-13830. Intermittent failure of ITestS3NContractRootDir#testRecursiveRootListing: "Can not create a Path from an empty string". Contributed by Steve Loughran 
(cherry picked from commit 3fd844b99f)
 2016-11-30 13:06:22 -08:00
Junping Du 7f4bd1af52 Revert "MAPREDUCE-6565. Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution. Contributed by Li Lu." 
This reverts commit f2284f44dd.
 2016-11-30 11:23:00 -08:00
Akira Ajisaka 9a99d8c334 HADOOP-13790. Make qbt script executable. Contributed by Andrew Wang. 
(cherry picked from commit be5a757096)
(cherry picked from commit 20c544d117)
 2016-12-01 03:53:44 +09:00
Junping Du f2284f44dd MAPREDUCE-6565. Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution. Contributed by Li Lu. 
(cherry picked from commit 8f6e14399a)
(cherry picked from commit 376a2439db)
(cherry picked from commit 05a570a1981597ab8d2615ed4752e63f0a21b32b)
 2016-11-29 16:52:11 -08:00
Akira Ajisaka 129beeeddd HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 
(cherry picked from commit 00096dcc0c)
(cherry picked from commit 0c895e8a62)
 2016-11-29 19:51:38 +09:00
Robert Kanter 92ee5e2077 HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 
(cherry picked from commit 47ca9e26fb)
(cherry picked from commit 285edf691d)
 2016-11-28 18:23:23 -08:00
Mingliang Liu 59f6067568 HADOOP-13823. s3a rename: fail if dest file exists. Contributed by Steve Loughran 
(cherry picked from commit d60a60be8a)
 2016-11-28 16:42:41 -08:00
Brahma Reddy Battula 713d800e7b HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula. 
(cherry picked from commit ee3d437a33)
(cherry picked from commit 1c0fa25dc1)
 2016-11-25 20:20:37 +05:30
Steve Loughran db37ad0ebf HADOOP-12804. Read Proxy Password from Credential Providers in S3 FileSystem. Contributed by Larry McCay. 2016-11-25 13:33:32 +00:00
Akira Ajisaka c9297b608c HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 
(cherry picked from commit bb1b5e083b)
(cherry picked from commit 6fe5ffd05d)
 2016-11-25 21:29:48 +09:00
Akira Ajisaka 011d478aab HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin. 
(cherry picked from commit 636f7547b7)
(cherry picked from commit 0df7f5cdf6)
 2016-11-25 17:50:43 +09:00
Steve Loughran 24715cefe8 HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli 2016-11-24 17:51:49 +00:00
Brahma Reddy Battula 1e25fd6b3b HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula. 
(cherry picked from commit 13501053dd)
 2016-11-24 22:25:36 +05:30