Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,731 Commits 326 Branches 371 Tags
Commit Graph

11731 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Rohith Sharma K S
a29f8bdc3d YARN-5118. Tests fails with localizer port bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit bddea5fe5fe72eee8e2ecfcec616bd8ceb4d72e7)
 2016-06-07 11:23:02 +05:30
Wangda Tan
d30e194dda Revert "HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster." 
This reverts commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9.
 2016-06-06 22:17:30 -07:00
Arun Suresh
d3655f4123 YARN-4525. Fix bug in RLESparseResourceAllocation.getRangeOverlapping(). (Ishai Menache and Carlo Curino via asuresh) 
(cherry picked from commit 3a154f75ed85d864b3ffd35818992418f2b6aa59)
 2016-06-06 21:18:53 -07:00
Arun Suresh
f0a869b52a YARN-5185. StageAllocaterGreedyRLE: Fix NPE in corner case. (Carlo Curino via asuresh) 
(cherry picked from commit 7a9b7372a1a917c7b5e1beca7e13c0419e3dbfef)
 2016-06-06 21:07:24 -07:00
Zhe Zhang
06e38c835d HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
 2016-06-06 15:53:12 -07:00
Steve Loughran
0cbbc2f0db HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables. Contributed by Tobin Baker. 2016-06-06 23:41:54 +02:00
Ming Ma
74e2b5efa2 MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma) 
(cherry picked from commit 4a1cedc010d3fa1d8ef3f2773ca12acadfee5ba5)
 2016-06-06 14:34:47 -07:00
Tsz-Wo Nicholas Sze
074588d78b Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 5bfadb8e6bd9af791890da84707f4ebee0f664d8.
 2016-06-06 16:52:24 +08:00
Tsz-Wo Nicholas Sze
48323b6636 Revert "Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou."" 
This reverts commit 6f8f40b2a5c01fc10eb7da1e8e9c3fc7c7b8f957.
 2016-06-06 16:52:19 +08:00
Tsz-Wo Nicholas Sze
6762855f67 Revert "Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou"" 
This reverts commit 8e2245d0a4d1ee7630c65162630b9627a5b585ca.
 2016-06-06 16:52:14 +08:00
Tsz-Wo Nicholas Sze
136d3b6414 Revert "Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit 87ea0784eb5f2f39f89f951c119c0fe7c5d6786a.
 2016-06-06 16:52:09 +08:00
Tsz-Wo Nicholas Sze
09a543fc86 Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit 071aeab5853087314efd6252b9b7e4b64979a0fd.
 2016-06-06 16:52:02 +08:00
Tsz-Wo Nicholas Sze
428dc52e56 Revert "Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit 2529cabf12e2c37740723fe7f52cc7bd94d92f0d.
 2016-06-06 16:51:54 +08:00
Tsz-Wo Nicholas Sze
7b9062f405 Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 7d4c16bae9b69a722807b3ca200f97bb8cc95f61.
 2016-06-06 16:51:48 +08:00
Tsz-Wo Nicholas Sze
c1947a71ff Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit c11c2ee649a186d211cea0b85cb33dab0b3f96db.
 2016-06-06 16:51:41 +08:00
Andrew Wang
c11c2ee649 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit d316f44059c4417ed30064470a590991dd160857.
 2016-06-03 18:11:12 -07:00
Andrew Wang
7d4c16bae9 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit 7e0824faa9970de608fabd8101bdb2652db4362b.
 2016-06-03 18:10:49 -07:00
Andrew Wang
2529cabf12 Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit 69768bf9e057cb0b433e398b328c40fe8f1586c8.
 2016-06-03 18:10:49 -07:00
Andrew Wang
071aeab585 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit 658072d62e856c65632f1a66b10808de625649f1.
 2016-06-03 18:10:49 -07:00
Andrew Wang
87ea0784eb Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit 56745a0cf4cd17a348225bc28a16e9280c9db4a5.
 2016-06-03 18:10:48 -07:00
Andrew Wang
8e2245d0a4 Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou" 
This reverts commit 72773f8ea896b125882025666084802873c59963.
 2016-06-03 18:10:48 -07:00
Andrew Wang
6f8f40b2a5 Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou." 
This reverts commit 193f822b9a6e95575e90e2703e30abde70c6ba6c.
 2016-06-03 18:10:48 -07:00
Andrew Wang
5bfadb8e6b Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit f7189d6a1c08075920bb6f8efd41a8730a4eb7c7.
 2016-06-03 18:10:47 -07:00
Andrew Wang
d5609e3499 HDFS-10481. HTTPFS server should correctly impersonate as end user to open file. Contributed by Xiao Chen. 
(cherry picked from commit 47e0321ee91149331e6ae72e7caa41d1de078b6c)
 2016-06-03 17:21:27 -07:00
Andrew Wang
03c4724c88 HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 713cb71820ad94a5436f35824d07aa12fcba5cc6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
 2016-06-03 17:01:11 -07:00
Chris Nauroth
5e6ee5aafb HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu. 
(cherry picked from commit d82bc8501869be78780fc09752dbf7af918c14af)
 2016-06-03 16:38:38 -07:00
Arun Suresh
8ebd89dcfb YARN-5165. Fix NoOvercommitPolicy to take advantage of RLE representation of plan. (Carlo Curino via asuresh) 
(cherry picked from commit db54670e83a84c1d7deff2c225725687cf9e5f14)
 2016-06-03 14:50:51 -07:00
Vinod Kumar Vavilapalli
029888871f YARN-5098. Fixed ResourceManager's DelegationTokenRenewer to replace expiring system-tokens if RM stops and only restarts after a long time. Contributed by Jian He. 
Made one minor edit for branch-2 patch.

(cherry picked from commit f10ebc67f57a4a2e3cc916c41154ab9b6a4635c9)
 2016-06-03 13:11:17 -07:00
Jian He
7f865bf438 YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du 
(cherry picked from commit 99cc439e29794f8e61bebe03b2a7ca4b6743ec92)
 2016-06-03 11:11:20 -07:00
Jian He
a022776c2e YARN-1815. Work preserving recovery of Unmanged AMs. Contributed by Subru Krishnan 
(cherry picked from commit 097baaaebae021c47bb7d69aa1ff1a2440df5166)
 2016-06-03 10:49:54 -07:00
Chris Nauroth
043a0c2e6c HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran. 2016-06-03 08:56:07 -07:00
Akira Ajisaka
b6d5546e24 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka) 2016-06-03 16:04:11 +09:00
Akira Ajisaka
cddf6b4fc7 HDFS-10471. DFSAdmin#SetQuotaCommand's help msg is not correct. Contributed by Yiqun Lin. 
(cherry picked from commit 1df6f5735c9d85e644d99d3ebfc4459490657004)
 2016-06-03 04:11:03 +09:00
Akira Ajisaka
cbf6cacf64 HDFS-10449. TestRollingFileSystemSinkWithHdfs#testFailedClose() fails on branch-2. Contributed by Takanobu Asanuma. 2016-06-03 03:08:22 +09:00
Arun Suresh
384a84828f YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh) 
(cherry picked from commit dc26601d8fe27a4223a50601bf7522cc42e8e2f3)
 2016-06-02 09:14:30 -07:00
Masatake Iwasaki
3740974413 HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit aadb77e412ab9d4ad05a0bd8b37d547ba5adad03)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
 2016-06-02 20:59:40 +09:00
Akira Ajisaka
6843e55208 HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou. 
(cherry picked from commit 99675e00df65e84dcc02082b795f1f93c90b794e)
 2016-06-02 19:15:48 +09:00
Akira Ajisaka
3dd557e4b6 HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca066815053dd9168ebe15868a5c02cdcd)
 2016-06-02 18:53:27 +09:00
Chris Nauroth
e9942c5b34 HADOOP-13131. Add tests to verify that S3A supports SSE-S3 encryption. Contributed by Steve Loughran. 
(cherry picked from commit 16b1cc7af9bd63b65ef50e1056f275a7baf111a2)
 2016-06-01 14:49:31 -07:00
Wangda Tan
b63ebca9dd Addendum patch for YARN-4844, to supress few more deprecation warnings. 2016-06-01 14:37:20 -07:00
Xuan
04062593b4 YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong 
(cherry picked from commit 0bc05e40fa7e183efe8463ada459c621da3ce3bf)
 2016-06-01 13:45:24 -07:00
Andrew Wang
55eda958cc HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 35356de1ba1cad0fa469ff546263290109c61b77)
 2016-06-01 13:13:28 -07:00
Steve Loughran
b29bf5d335 HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel) 2016-06-01 14:17:50 +01:00
Colin Patrick Mccabe
a64e1425ed HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 8ceb06e2392763726210f96bb1c176e6a9fe7b53)
 2016-05-31 18:05:28 -07:00
Colin Patrick Mccabe
14907d9b8c HDFS-10415. TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called (Mingliang Liu via cmccabe) 2016-05-31 17:19:25 -07:00
Tsz-Wo Nicholas Sze
f7189d6a1c HADOOP-13226 Support async call retry and failover. 2016-05-31 17:01:43 -07:00
Andrew Wang
cbf87869b8 HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit bca31fe276ccf7d02b13f25d43c81cca0b0b905b)
 2016-05-31 09:35:28 -07:00
Varun Vasudev
bd01153ddf YARN-5141. Get Container logs for the Running application from Yarn Logs CommandLine. Contributed by Xuan Gong. 
(cherry picked from commit 4e1f56e111a88c2bc600aaa601010295075676c9)
 2016-05-29 21:54:29 +05:30
Varun Vasudev
d7bb28f15b YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana. 
(cherry picked from commit 86fb58b7dc832c2df30469d128598a6a1bed8df5)
 2016-05-29 21:33:43 +05:30
Varun Vasudev
4f36c3d214 YARN-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan. 2016-05-29 20:55:39 +05:30