Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,515 Commits 326 Branches 371 Tags
Commit Graph

11515 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
7d4c16bae9 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit 7e0824faa9970de608fabd8101bdb2652db4362b.
 2016-06-03 18:10:49 -07:00
Andrew Wang
2529cabf12 Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit 69768bf9e057cb0b433e398b328c40fe8f1586c8.
 2016-06-03 18:10:49 -07:00
Andrew Wang
071aeab585 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit 658072d62e856c65632f1a66b10808de625649f1.
 2016-06-03 18:10:49 -07:00
Andrew Wang
87ea0784eb Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit 56745a0cf4cd17a348225bc28a16e9280c9db4a5.
 2016-06-03 18:10:48 -07:00
Andrew Wang
8e2245d0a4 Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou" 
This reverts commit 72773f8ea896b125882025666084802873c59963.
 2016-06-03 18:10:48 -07:00
Andrew Wang
6f8f40b2a5 Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou." 
This reverts commit 193f822b9a6e95575e90e2703e30abde70c6ba6c.
 2016-06-03 18:10:48 -07:00
Andrew Wang
5bfadb8e6b Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit f7189d6a1c08075920bb6f8efd41a8730a4eb7c7.
 2016-06-03 18:10:47 -07:00
Andrew Wang
d5609e3499 HDFS-10481. HTTPFS server should correctly impersonate as end user to open file. Contributed by Xiao Chen. 
(cherry picked from commit 47e0321ee91149331e6ae72e7caa41d1de078b6c)
 2016-06-03 17:21:27 -07:00
Andrew Wang
03c4724c88 HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 713cb71820ad94a5436f35824d07aa12fcba5cc6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
 2016-06-03 17:01:11 -07:00
Chris Nauroth
5e6ee5aafb HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu. 
(cherry picked from commit d82bc8501869be78780fc09752dbf7af918c14af)
 2016-06-03 16:38:38 -07:00
Arun Suresh
8ebd89dcfb YARN-5165. Fix NoOvercommitPolicy to take advantage of RLE representation of plan. (Carlo Curino via asuresh) 
(cherry picked from commit db54670e83a84c1d7deff2c225725687cf9e5f14)
 2016-06-03 14:50:51 -07:00
Vinod Kumar Vavilapalli
029888871f YARN-5098. Fixed ResourceManager's DelegationTokenRenewer to replace expiring system-tokens if RM stops and only restarts after a long time. Contributed by Jian He. 
Made one minor edit for branch-2 patch.

(cherry picked from commit f10ebc67f57a4a2e3cc916c41154ab9b6a4635c9)
 2016-06-03 13:11:17 -07:00
Jian He
7f865bf438 YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du 
(cherry picked from commit 99cc439e29794f8e61bebe03b2a7ca4b6743ec92)
 2016-06-03 11:11:20 -07:00
Jian He
a022776c2e YARN-1815. Work preserving recovery of Unmanged AMs. Contributed by Subru Krishnan 
(cherry picked from commit 097baaaebae021c47bb7d69aa1ff1a2440df5166)
 2016-06-03 10:49:54 -07:00
Chris Nauroth
043a0c2e6c HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran. 2016-06-03 08:56:07 -07:00
Akira Ajisaka
b6d5546e24 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka) 2016-06-03 16:04:11 +09:00
Akira Ajisaka
cddf6b4fc7 HDFS-10471. DFSAdmin#SetQuotaCommand's help msg is not correct. Contributed by Yiqun Lin. 
(cherry picked from commit 1df6f5735c9d85e644d99d3ebfc4459490657004)
 2016-06-03 04:11:03 +09:00
Akira Ajisaka
cbf6cacf64 HDFS-10449. TestRollingFileSystemSinkWithHdfs#testFailedClose() fails on branch-2. Contributed by Takanobu Asanuma. 2016-06-03 03:08:22 +09:00
Arun Suresh
384a84828f YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh) 
(cherry picked from commit dc26601d8fe27a4223a50601bf7522cc42e8e2f3)
 2016-06-02 09:14:30 -07:00
Masatake Iwasaki
3740974413 HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit aadb77e412ab9d4ad05a0bd8b37d547ba5adad03)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
 2016-06-02 20:59:40 +09:00
Akira Ajisaka
6843e55208 HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou. 
(cherry picked from commit 99675e00df65e84dcc02082b795f1f93c90b794e)
 2016-06-02 19:15:48 +09:00
Akira Ajisaka
3dd557e4b6 HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca066815053dd9168ebe15868a5c02cdcd)
 2016-06-02 18:53:27 +09:00
Chris Nauroth
e9942c5b34 HADOOP-13131. Add tests to verify that S3A supports SSE-S3 encryption. Contributed by Steve Loughran. 
(cherry picked from commit 16b1cc7af9bd63b65ef50e1056f275a7baf111a2)
 2016-06-01 14:49:31 -07:00
Wangda Tan
b63ebca9dd Addendum patch for YARN-4844, to supress few more deprecation warnings. 2016-06-01 14:37:20 -07:00
Xuan
04062593b4 YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong 
(cherry picked from commit 0bc05e40fa7e183efe8463ada459c621da3ce3bf)
 2016-06-01 13:45:24 -07:00
Andrew Wang
55eda958cc HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 35356de1ba1cad0fa469ff546263290109c61b77)
 2016-06-01 13:13:28 -07:00
Steve Loughran
b29bf5d335 HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel) 2016-06-01 14:17:50 +01:00
Colin Patrick Mccabe
a64e1425ed HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 8ceb06e2392763726210f96bb1c176e6a9fe7b53)
 2016-05-31 18:05:28 -07:00
Colin Patrick Mccabe
14907d9b8c HDFS-10415. TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called (Mingliang Liu via cmccabe) 2016-05-31 17:19:25 -07:00
Tsz-Wo Nicholas Sze
f7189d6a1c HADOOP-13226 Support async call retry and failover. 2016-05-31 17:01:43 -07:00
Andrew Wang
cbf87869b8 HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit bca31fe276ccf7d02b13f25d43c81cca0b0b905b)
 2016-05-31 09:35:28 -07:00
Varun Vasudev
bd01153ddf YARN-5141. Get Container logs for the Running application from Yarn Logs CommandLine. Contributed by Xuan Gong. 
(cherry picked from commit 4e1f56e111a88c2bc600aaa601010295075676c9)
 2016-05-29 21:54:29 +05:30
Varun Vasudev
d7bb28f15b YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana. 
(cherry picked from commit 86fb58b7dc832c2df30469d128598a6a1bed8df5)
 2016-05-29 21:33:43 +05:30
Varun Vasudev
4f36c3d214 YARN-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan. 2016-05-29 20:55:39 +05:30
Karthik Kambatla
b3f5337bb3 YARN-5132. Exclude generated protobuf sources from YARN Javadoc build. (Subru Krishnan via kasha) 
(cherry picked from commit f5ff05cc8a67c125717261392c996136ba66785b)
 2016-05-28 08:10:16 -07:00
Xiaoyu Yao
001c8f5d7b HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4ca8859583839761663fc1fc1de1b3ce2e3fc5b5)
 2016-05-27 18:48:55 -07:00
Arun Suresh
de28ca1e92 YARN-5117. QueuingContainerManager does not start GUARANTEED Container even if Resources are available. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit 4fc09a897b25914a9b9321cc443f3f3ff3d776d5)
 2016-05-27 17:50:34 -07:00
Chris Nauroth
193f822b9a HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou. 
(cherry picked from commit 21890c4239b6a82fd6aab3454ce3922226efe7b5)
 2016-05-27 14:20:30 -07:00
Chris Nauroth
03c6854c30 HADOOP-13193. Upgrade to Apache Yetus 0.3.0. Contributed by Kengo Seki. 
(cherry picked from commit da074771977fe3de8acea441b096291c96cf59d9)
 2016-05-27 14:10:06 -07:00
Arun Suresh
0b1472fbc0 YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh) 
(cherry picked from commit aa975bc7811fc7c52b814ad9635bff8c2d34655b)
 2016-05-27 14:07:15 -07:00
Yongjun Zhang
2dfaedeb43 HDFS-10276. HDFS should not expose path info that user has no permission to see. (Yuanbo Liu via Yongjun Zhang) 
(cherry picked from commit 5ea6fd85c7aff6df28b87789f607bb57ee920639)
 2016-05-27 10:14:30 -07:00
Akira Ajisaka
ec811909e4 YARN-5166. javadoc:javadoc goal fails on hadoop-yarn-client. Contributed by Andras Bokor. 
(cherry picked from commit e4022debf717083ab9192164af9978500035d1be)
 2016-05-27 23:15:48 +09:00
Junping Du
dea79a7dd6 YARN-4987. Read cache concurrency issue between read and evict in EntityGroupFS timeline store. Contributed by Li Lu. 
(cherry picked from commit 705286ccaeea36941d97ec1c1700746b74264924)
 2016-05-27 06:59:15 -07:00
Xuan
38ae5954df YARN-5089. Improve "yarn log" command-line "logFiles" option to support 
regex. Contributed by Xuan Gong

(cherry picked from commit bde819abbbcea940cfa6426a9e4920e6c8dc9cf1)
 2016-05-26 23:50:14 -07:00
Yongjun Zhang
82a88c7e67 HADOOP-13199. Add doc for distcp -filters. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit cfb860dee72a27382a26bf450bb8b16784aeebbb)
 2016-05-26 23:32:46 -07:00
Yongjun Zhang
41c02757a5 HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang) 2016-05-26 22:54:07 -07:00
Rohith Sharma K S
ef3e0c6fd6 YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt. 
(cherry picked from commit 0a544f8a3e52f3467003a731d77380f56343d322)
 2016-05-27 10:48:47 +05:30
Karthik Kambatla
59335b4d7a YARN-5035. FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on. (kasha) 
(cherry picked from commit 04ded558b03ee0fbf68a611cf1f25508b4447e44)
 2016-05-26 15:09:47 -07:00
Arun Suresh
44cbf5b7f5 YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh) 
(cherry picked from commit 5b41b288d01b0124664ddf6a3d6b545058bcfe6f)
 2016-05-26 14:58:15 -07:00
Karthik Kambatla
b4c8729cf9 HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha) 2016-05-26 14:39:07 -07:00