Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,662 Commits 326 Branches 371 Tags
Commit Graph

11662 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arun Suresh
fccb641942 YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. (asuresh) 
(cherry picked from commit 51432779588fdd741b4840601f5db637ec783d92)
 2016-06-12 09:43:19 -07:00
Arun Suresh
5985221b46 YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit (sandflee via asuresh) 
(cherry picked from commit 5279af7cd4afb090da742a96b5786d9dee6224bc)
 2016-06-10 22:34:33 -07:00
Rohith Sharma K S
efdfa68911 YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe. 
(cherry picked from commit e0f4620cc7db3db4b781e6042ab7dd754af28f18)
 2016-06-11 10:31:00 +05:30
Akira Ajisaka
035eea4d12 HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis. 
This closes #97.

(cherry picked from commit 8a1dcceccea5cfe9fb0c94daa2517cd64a16b3c0)
 2016-06-11 03:33:19 +09:00
Jing Zhao
9c7002b122 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. 
(cherry picked from commit 0bbb4ddd793063c87927035969884a34f60f2076)
 2016-06-10 10:40:53 -07:00
Wangda Tan
e91e9e596d YARN-3426. Add jdiff support to YARN. (vinodkv via wangda) 
(cherry picked from commit 03fc6b1bb0f5c0844cd5477ffba43de8a14d4d60)
 2016-06-10 09:53:40 -07:00
Wangda Tan
a4094ddb5a YARN-5208. Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled. (Rohith Sharma K S via wangda) 
(cherry picked from commit 244506f9c8953029283aa8e0eb2006ae2f30025e)
 2016-06-10 09:37:35 -07:00
Akira Ajisaka
db2d96b378 MAPREDUCE-6741. Refactor UncompressedSplitLineReader.fillBuffer(). Contributed by Daniel Templeton. 
(cherry picked from commit 0b7b8a377611b2a3041a2995504a437c36dfa6e6)
 2016-06-10 19:17:05 +09:00
Chris Nauroth
1925942294 Revert "HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane." 
This reverts commit a8f03ef7ea8163c00ce5d72a4e1c77284befe5aa.
 2016-06-09 15:17:18 -07:00
Chris Nauroth
a8f03ef7ea HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane. 
(cherry picked from commit 9581fb715cbc8a6ad28566e83c6d0242a7306688)

Conflicts:
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
 2016-06-09 14:49:05 -07:00
Steve Loughran
6350e4b1fb HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:59:54 +01:00
Vinod Kumar Vavilapalli
f6cd1bcf89 YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv) 
(cherry picked from commit 9378d9428f127eff7acd6c13544016cdbf2d65fb)
 2016-06-09 12:32:53 -07:00
Wangda Tan
aef6e455b1 YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda) 2016-06-09 10:08:31 -07:00
Steve Loughran
df29f77846 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:27 +01:00
Allen Wittenauer
a086fd9040 HADOOP-12743. Fix git environment check during test-patch (aw) 
(cherry picked from commit d323639686eab28f1510031e52e4390f82d78989)
 2016-06-09 23:27:07 +09:00
Masatake Iwasaki
0b7388b5d2 HDFS-10508. DFSInputStream should set thread's interrupt status after catching InterruptException from sleep. Contributed by Jing Zhao. 
(cherry picked from commit 8ea9bbce2614e8eb499af73589f021ed1789e78f)
 2016-06-09 14:53:56 +09:00
Naganarasimha
27fc225558 YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G 
(cherry picked from commit 1500a0a3009e453c9f05a93df7a78b4e185eef30)
 2016-06-09 05:44:41 +05:30
Gera Shegalov
5a9929e19b MAPREDUCE-6240. Hadoop client displays confusing error message. (gera) 
(cherry picked from commit 0af96a1c08594c809ecb254cee4f60dd22399772)
 2016-06-08 13:49:31 -07:00
Ravi Prakash
9c5f7f290e HDFS-10220. A large number of expired leases can make namenode unresponsive and cause failover (Nicolas Fraison via raviprak) 
(cherry picked from commit ae047655f4355288406cd5396fb4e3ea7c307b14)
 2016-06-08 13:46:41 -07:00
Andrew Wang
9319665461 Remove redundant TestMiniDFSCluster.testDualClusters. Contributed by Jiayi Zhou. 
(cherry picked from commit 1ee9ea002609971ad58082bf525d57fca8a37035)
 2016-06-08 12:58:59 -07:00
Vinod Kumar Vavilapalli
67dbd4c466 YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong 
(cherry picked from commit 5a43583c0bbb9650ea6a9f48d9544ec3ec24b580)
 2016-06-08 09:51:36 -07:00
Arun Suresh
c29fbdd8ac YARN-5204. Properly report status of killed/stopped queued containers. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit 3344ba70e027c929e07bad5e6877c796d41181e9)
 2016-06-08 08:32:17 -07:00
Jason Lowe
c6f33e096e YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran 
(cherry picked from commit 8c8a377cac10b086a7ff37ee366b79e6b04d2738)
 2016-06-08 14:13:19 +00:00
Arun Suresh
154c7c343b YARN-5176. More test cases for queuing of containers at the NM. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit 76f0800c21f49fba01694cbdc870103053da802c)
 2016-06-07 17:17:22 -07:00
Xuan
10f0c0475e YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and 
FileInputStream in NMWebServices#getLogs. Contributed by Xuan Gong

(cherry picked from commit 58be55b6e07b94aa55ed87c461f3e5c04cc61630)
 2016-06-07 16:08:54 -07:00
Arun Suresh
6a9f38ebaf Addendum patch for YARN-5180 updating findbugs-exclude.xml 
(cherry picked from commit 8554aee1bef5aff9e49e5e9119d6a7a4abf1c432)
 2016-06-07 16:00:59 -07:00
Jing Zhao
8b34040cb9 HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao 
(cherry picked from commit be34e85e682880f46eee0310bf00ecc7d39cd5bd)
 2016-06-07 10:52:33 -07:00
Junping Du
19eb997f67 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe. 
(cherry picked from commit c14c1b298e29e799f7c8f15ff24d7eba6e0cd39b)
 2016-06-07 09:20:51 -07:00
Zhe Zhang
0499907466 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
(cherry picked from commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9)
 2016-06-07 08:57:27 -07:00
Jason Lowe
5b4c80b27e HDFS-9580. TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. Contributed by Wei-Chiu Chuang. 
Change-Id: I9411dfb1dd4605cbcc515ca3361218d35d7c5fe3
(cherry picked from commit 0087734cc1e18e029ea39f06ca25c8a7d60af004)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-06-07 15:33:43 +00:00
Akira Ajisaka
b8c1db6f63 HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka) 
(cherry picked from commit e620530301fd3e62537d4b7bc3d8ed296bda1ffc)
 2016-06-07 17:53:09 +09:00
Rohith Sharma K S
a29f8bdc3d YARN-5118. Tests fails with localizer port bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit bddea5fe5fe72eee8e2ecfcec616bd8ceb4d72e7)
 2016-06-07 11:23:02 +05:30
Wangda Tan
d30e194dda Revert "HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster." 
This reverts commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9.
 2016-06-06 22:17:30 -07:00
Arun Suresh
d3655f4123 YARN-4525. Fix bug in RLESparseResourceAllocation.getRangeOverlapping(). (Ishai Menache and Carlo Curino via asuresh) 
(cherry picked from commit 3a154f75ed85d864b3ffd35818992418f2b6aa59)
 2016-06-06 21:18:53 -07:00
Arun Suresh
f0a869b52a YARN-5185. StageAllocaterGreedyRLE: Fix NPE in corner case. (Carlo Curino via asuresh) 
(cherry picked from commit 7a9b7372a1a917c7b5e1beca7e13c0419e3dbfef)
 2016-06-06 21:07:24 -07:00
Zhe Zhang
06e38c835d HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
 2016-06-06 15:53:12 -07:00
Steve Loughran
0cbbc2f0db HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables. Contributed by Tobin Baker. 2016-06-06 23:41:54 +02:00
Ming Ma
74e2b5efa2 MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma) 
(cherry picked from commit 4a1cedc010d3fa1d8ef3f2773ca12acadfee5ba5)
 2016-06-06 14:34:47 -07:00
Tsz-Wo Nicholas Sze
074588d78b Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 5bfadb8e6bd9af791890da84707f4ebee0f664d8.
 2016-06-06 16:52:24 +08:00
Tsz-Wo Nicholas Sze
48323b6636 Revert "Revert "HDFS-10430. Reuse FileSystem#access in TestAsyncDFS. Contributed by Xiaobing Zhou."" 
This reverts commit 6f8f40b2a5c01fc10eb7da1e8e9c3fc7c7b8f957.
 2016-06-06 16:52:19 +08:00
Tsz-Wo Nicholas Sze
6762855f67 Revert "Revert "HDFS-10431 Refactor and speedup TestAsyncDFSRename. Contributed by Xiaobing Zhou"" 
This reverts commit 8e2245d0a4d1ee7630c65162630b9627a5b585ca.
 2016-06-06 16:52:14 +08:00
Tsz-Wo Nicholas Sze
136d3b6414 Revert "Revert "HDFS-10390. Implement asynchronous setAcl/getAclStatus for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit 87ea0784eb5f2f39f89f951c119c0fe7c5d6786a.
 2016-06-06 16:52:09 +08:00
Tsz-Wo Nicholas Sze
09a543fc86 Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit 071aeab5853087314efd6252b9b7e4b64979a0fd.
 2016-06-06 16:52:02 +08:00
Tsz-Wo Nicholas Sze
428dc52e56 Revert "Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit 2529cabf12e2c37740723fe7f52cc7bd94d92f0d.
 2016-06-06 16:51:54 +08:00
Tsz-Wo Nicholas Sze
7b9062f405 Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 7d4c16bae9b69a722807b3ca200f97bb8cc95f61.
 2016-06-06 16:51:48 +08:00
Tsz-Wo Nicholas Sze
c1947a71ff Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit c11c2ee649a186d211cea0b85cb33dab0b3f96db.
 2016-06-06 16:51:41 +08:00
Andrew Wang
c11c2ee649 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit d316f44059c4417ed30064470a590991dd160857.
 2016-06-03 18:11:12 -07:00
Andrew Wang
7d4c16bae9 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit 7e0824faa9970de608fabd8101bdb2652db4362b.
 2016-06-03 18:10:49 -07:00
Andrew Wang
2529cabf12 Revert "HDFS-10346. Implement asynchronous setPermission/setOwner for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit 69768bf9e057cb0b433e398b328c40fe8f1586c8.
 2016-06-03 18:10:49 -07:00
Andrew Wang
071aeab585 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit 658072d62e856c65632f1a66b10808de625649f1.
 2016-06-03 18:10:49 -07:00