Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,647 Commits 326 Branches 371 Tags
Commit Graph

11647 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arun Suresh
384a84828f YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh) 
(cherry picked from commit dc26601d8fe27a4223a50601bf7522cc42e8e2f3)
 2016-06-02 09:14:30 -07:00
Masatake Iwasaki
3740974413 HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit aadb77e412ab9d4ad05a0bd8b37d547ba5adad03)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
 2016-06-02 20:59:40 +09:00
Akira Ajisaka
6843e55208 HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou. 
(cherry picked from commit 99675e00df65e84dcc02082b795f1f93c90b794e)
 2016-06-02 19:15:48 +09:00
Akira Ajisaka
3dd557e4b6 HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca066815053dd9168ebe15868a5c02cdcd)
 2016-06-02 18:53:27 +09:00
Chris Nauroth
e9942c5b34 HADOOP-13131. Add tests to verify that S3A supports SSE-S3 encryption. Contributed by Steve Loughran. 
(cherry picked from commit 16b1cc7af9bd63b65ef50e1056f275a7baf111a2)
 2016-06-01 14:49:31 -07:00
Wangda Tan
b63ebca9dd Addendum patch for YARN-4844, to supress few more deprecation warnings. 2016-06-01 14:37:20 -07:00
Xuan
04062593b4 YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong 
(cherry picked from commit 0bc05e40fa7e183efe8463ada459c621da3ce3bf)
 2016-06-01 13:45:24 -07:00
Andrew Wang
55eda958cc HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 35356de1ba1cad0fa469ff546263290109c61b77)
 2016-06-01 13:13:28 -07:00
Steve Loughran
b29bf5d335 HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel) 2016-06-01 14:17:50 +01:00
Colin Patrick Mccabe
a64e1425ed HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 8ceb06e2392763726210f96bb1c176e6a9fe7b53)
 2016-05-31 18:05:28 -07:00
Colin Patrick Mccabe
14907d9b8c HDFS-10415. TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called (Mingliang Liu via cmccabe) 2016-05-31 17:19:25 -07:00
Tsz-Wo Nicholas Sze
f7189d6a1c HADOOP-13226 Support async call retry and failover. 2016-05-31 17:01:43 -07:00
Andrew Wang
cbf87869b8 HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit bca31fe276ccf7d02b13f25d43c81cca0b0b905b)
 2016-05-31 09:35:28 -07:00
Varun Vasudev
bd01153ddf YARN-5141. Get Container logs for the Running application from Yarn Logs CommandLine. Contributed by Xuan Gong. 
(cherry picked from commit 4e1f56e111a88c2bc600aaa601010295075676c9)
 2016-05-29 21:54:29 +05:30
Varun Vasudev
d7bb28f15b YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana. 
(cherry picked from commit 86fb58b7dc832c2df30469d128598a6a1bed8df5)
 2016-05-29 21:33:43 +05:30
Varun Vasudev
4f36c3d214 YARN-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan. 2016-05-29 20:55:39 +05:30
Karthik Kambatla
b3f5337bb3 YARN-5132. Exclude generated protobuf sources from YARN Javadoc build. (Subru Krishnan via kasha) 
(cherry picked from commit f5ff05cc8a67c125717261392c996136ba66785b)
 2016-05-28 08:10:16 -07:00
Xiaoyu Yao
001c8f5d7b HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4ca8859583839761663fc1fc1de1b3ce2e3fc5b5)
 2016-05-27 18:48:55 -07:00
Arun Suresh
de28ca1e92 YARN-5117. QueuingContainerManager does not start GUARANTEED Container even if Resources are available. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit 4fc09a897b25914a9b9321cc443f3f3ff3d776d5)
 2016-05-27 17:50:34 -07:00
Chris Nauroth
193f822b9a HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou. 
(cherry picked from commit 21890c4239b6a82fd6aab3454ce3922226efe7b5)
 2016-05-27 14:20:30 -07:00
Chris Nauroth
03c6854c30 HADOOP-13193. Upgrade to Apache Yetus 0.3.0. Contributed by Kengo Seki. 
(cherry picked from commit da074771977fe3de8acea441b096291c96cf59d9)
 2016-05-27 14:10:06 -07:00
Arun Suresh
0b1472fbc0 YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh) 
(cherry picked from commit aa975bc7811fc7c52b814ad9635bff8c2d34655b)
 2016-05-27 14:07:15 -07:00
Yongjun Zhang
2dfaedeb43 HDFS-10276. HDFS should not expose path info that user has no permission to see. (Yuanbo Liu via Yongjun Zhang) 
(cherry picked from commit 5ea6fd85c7aff6df28b87789f607bb57ee920639)
 2016-05-27 10:14:30 -07:00
Akira Ajisaka
ec811909e4 YARN-5166. javadoc:javadoc goal fails on hadoop-yarn-client. Contributed by Andras Bokor. 
(cherry picked from commit e4022debf717083ab9192164af9978500035d1be)
 2016-05-27 23:15:48 +09:00
Junping Du
dea79a7dd6 YARN-4987. Read cache concurrency issue between read and evict in EntityGroupFS timeline store. Contributed by Li Lu. 
(cherry picked from commit 705286ccaeea36941d97ec1c1700746b74264924)
 2016-05-27 06:59:15 -07:00
Xuan
38ae5954df YARN-5089. Improve "yarn log" command-line "logFiles" option to support 
regex. Contributed by Xuan Gong

(cherry picked from commit bde819abbbcea940cfa6426a9e4920e6c8dc9cf1)
 2016-05-26 23:50:14 -07:00
Yongjun Zhang
82a88c7e67 HADOOP-13199. Add doc for distcp -filters. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit cfb860dee72a27382a26bf450bb8b16784aeebbb)
 2016-05-26 23:32:46 -07:00
Yongjun Zhang
41c02757a5 HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang) 2016-05-26 22:54:07 -07:00
Rohith Sharma K S
ef3e0c6fd6 YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt. 
(cherry picked from commit 0a544f8a3e52f3467003a731d77380f56343d322)
 2016-05-27 10:48:47 +05:30
Karthik Kambatla
59335b4d7a YARN-5035. FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on. (kasha) 
(cherry picked from commit 04ded558b03ee0fbf68a611cf1f25508b4447e44)
 2016-05-26 15:09:47 -07:00
Arun Suresh
44cbf5b7f5 YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh) 
(cherry picked from commit 5b41b288d01b0124664ddf6a3d6b545058bcfe6f)
 2016-05-26 14:58:15 -07:00
Karthik Kambatla
b4c8729cf9 HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha) 2016-05-26 14:39:07 -07:00
Tsz-Wo Nicholas Sze
72773f8ea8 HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou 2016-05-26 12:16:40 -07:00
Kai Zheng
4c8ab5e162 HADOOP-12782. Faster LDAP group name resolution with ActiveDirectory. Contributed by Wei-Chiu Chuang 2016-05-27 17:16:32 +08:00
Karthik Kambatla
999cdd91b7 YARN-4866. FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy. (Yufei Gu via kasha) 
(cherry picked from commit 4f513a4a8ed73beec89b7b28c0cd056ee5f4ed0d)
 2016-05-25 22:13:42 -07:00
Carlo Curino
c656977961 YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino) 
(cherry picked from commit 013532a95e63d7c53e601be530021d6d5a15ab7f)
 2016-05-25 16:58:19 -07:00
Jason Lowe
da77040793 YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong 
(cherry picked from commit 1ba31fe9e906dbd093afd4b254216601967a4a7b)
 2016-05-25 21:29:27 +00:00
Tsz-Wo Nicholas Sze
e5dab68066 HDFS-8057 Move BlockReader implementation to the client implementation package. Contributed by Takanobu Asanuma 2016-05-25 12:12:27 -07:00
Karthik Kambatla
0ac8c098e8 YARN-3344. Fix warning - procfs stat file is not in the expected format. (Ravindra Kumar Naik and Akira Ajisaka via kasha) 
(cherry picked from commit 77d5ce9069b9ad64673f04edac9b1b1beddfd403)
 2016-05-25 10:51:09 -07:00
Robert Kanter
71e5b36763 YARN-4766. NM should not aggregate logs older than the retention policy (haibochen via rkanter) 
(cherry picked from commit e07519b8dbb96d73c48e910a4de12563c5c2f8aa)
 2016-05-25 10:25:59 -07:00
Varun Vasudev
5361a91909 YARN-5115. Avoid setting CONTENT-DISPOSITION header in the container-logs web-service. Contributed by Xuan Gong. 
(cherry picked from commit c52c15dd2df5050c6c3ddbe5ee708404f1920721)
 2016-05-25 19:01:22 +05:30
Varun Vasudev
36f2ae0692 YARN-857. Localization failures should be available in container diagnostics. Contributed by Vinod Kumar Vavilapalli. 
(cherry picked from commit f440a9d8c4a177bc5062d21d4b4bc4d9b2944344)
 2016-05-25 19:01:22 +05:30
Junping Du
2e42bafdc8 YARN-5131. Distributed shell AM fails when extra container arrives during finishing. Contributed by Wangda Tan. 
(cherry picked from commit 48c931331cc43970e31866732f9ac82ee806ee03)
 2016-05-25 06:19:29 -07:00
Vinayakumar B
e28a51e988 HDFS-10217. show 'blockScheduled' tooltip in datanodes table. 
(cherry picked from commit 2dab64da2ff50bbb7937aad2d376eacd4ed320aa)
 2016-05-25 12:35:15 +05:30
Rohith Sharma K S
b9567b89b9 YARN-5024. TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure. Contributed by Bibin A Chundatt 
(cherry picked from commit 28bd63e92b2ef6717cd3dcbe04ac9d9ca5420cf4)
 2016-05-25 10:24:59 +05:30
Jian He
396d222d7a MAPREDUCE-6703. Add flag to allow MapReduce AM to request for OPPORTUNISTIC containers. Contributed by Arun Suresh 
(cherry picked from commit ae353ea96993ec664090c5d84f6675c29d9f0f5f)
 2016-05-24 19:48:11 -07:00
Andrew Wang
2ea17f4578 HADOOP-13198. Add support for OWASP's dependency-check. Contributed by Mike Yoder. 
(cherry picked from commit 09b866fd45664ff977702b58b6338ce209729a97)
 2016-05-24 18:29:48 -07:00
Karthik Kambatla
afe603d973 HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha) 
(cherry picked from commit 57c31a3fef625f1ec609d7e8873d4941f7ed5cbc)
 2016-05-24 16:34:45 -07:00
Naganarasimha
02323603e2 YARN-5114. Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8. Contributed by Bibin A Chundatt 
(cherry picked from commit edd716e99cb57e7804eb7d699b9456372f65c6bc)
 2016-05-25 06:15:50 +08:00
Tsz-Wo Nicholas Sze
56745a0cf4 HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-24 14:52:50 -07:00