Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,730 Commits 326 Branches 371 Tags
Commit Graph

11730 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ming Ma
32b115da1d HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma) 
(cherry picked from commit b48f27e794e42ba90836314834e872616437d7c9)
 2016-06-15 22:03:20 -07:00
Junping Du
6dd34baf3c YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong. 
(cherry picked from commit 5dfc38ff57669cba9078146e91ed990a1d25a3f0)
 2016-06-15 16:20:07 -07:00
Jitendra Pandey
14b849489a HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin. 2016-06-15 13:29:29 -07:00
Varun Vasudev
75235149af YARN-5223. Container line in yarn logs output for a live application should include the hostname for the container. Contributed by Xuan Gong. 
(cherry picked from commit 25064fb2fb79751cedbb8019900d811e07549ecf)
 2016-06-15 12:43:26 +05:30
Varun Vasudev
5bd39d2f3c YARN-5122. "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete. Contributed by Jian He. 
(cherry picked from commit d6284428e8bd09a06cf18ff81a7064d744ef47d0)
 2016-06-15 12:37:51 +05:30
Akira Ajisaka
6ffb557521 HADOOP-12893. Verify LICENSE.txt and NOTICE.txt. Contributed by Xiao Chen, Andrew Wang, and Akira Ajisaka. 2016-06-15 13:32:13 +09:00
Ming Ma
b7436f4468 HDFS-9016. Display upgrade domain information in fsck. (mingma) 2016-06-14 20:07:37 -07:00
Wangda Tan
863bfa4d6a YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda) 2016-06-14 15:12:00 -07:00
Masatake Iwasaki
9c66fffe4a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki. 
(cherry picked from commit 20b13d109a1f66d8911936d26bdde38d81a1c4c6)
 2016-06-14 19:46:33 +09:00
Vinayakumar B
06b76f1586 HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma) 
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
 2016-06-14 15:59:07 +05:30
Wangda Tan
cd3bdbc70a YARN-4887. Add allocation request ID to AM-RM protocol for identifying resource-requests explicitly. (Subru Krishnan via wangda) 
(cherry picked from commit eec835ec17f77bf713d90dbc2f77dea45f3ee660)
 2016-06-13 21:57:55 -07:00
Akira Ajisaka
d219550e8b HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki. 
(cherry picked from commit e3ba9ad3f116306910f74645ded91506345b9f6e)
 2016-06-14 10:20:43 +09:00
Andrew Wang
ff4466fe15 HDFS-10516. Fix bug when warming up EDEK cache of more than one encryption zone. Contributed by Xiao Chen. 
(cherry picked from commit 709a814fe0153e86a37806796ea27c8252d9c6d1)
 2016-06-13 11:50:25 -07:00
Andrew Wang
6a8d3233fc HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 
(cherry picked from commit 0accc3306d830c3f2b16c4b8abf68729c7aba6cb)
 2016-06-13 11:43:56 -07:00
Rohith Sharma K S
c540b9bd7b YARN-4989. TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently. Contributed by Ajith S. 
(cherry picked from commit 28b66ae919e348123f4c05a4787c9ec56c087c25)
 2016-06-13 11:23:10 +05:30
Karthik Kambatla
63da641910 HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha) 
(cherry picked from commit 49b4064644b242921af4ddf1de9932bc7bcf5f0e)
 2016-06-12 14:28:19 -07:00
Karthik Kambatla
a92be02c2e YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. Addendum to fix compilation. (Arun Suresh via kasha) 2016-06-12 14:28:14 -07:00
Arun Suresh
f3c7a99e33 YARN-5212. Run existing ContainerManager tests using QueuingContainerManagerImpl. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit 7dae2b3bc4cebbb186b3edd14e31074be02af329)
 2016-06-12 10:06:18 -07:00
Arun Suresh
fccb641942 YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. (asuresh) 
(cherry picked from commit 51432779588fdd741b4840601f5db637ec783d92)
 2016-06-12 09:43:19 -07:00
Arun Suresh
5985221b46 YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit (sandflee via asuresh) 
(cherry picked from commit 5279af7cd4afb090da742a96b5786d9dee6224bc)
 2016-06-10 22:34:33 -07:00
Rohith Sharma K S
efdfa68911 YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe. 
(cherry picked from commit e0f4620cc7db3db4b781e6042ab7dd754af28f18)
 2016-06-11 10:31:00 +05:30
Akira Ajisaka
035eea4d12 HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis. 
This closes #97.

(cherry picked from commit 8a1dcceccea5cfe9fb0c94daa2517cd64a16b3c0)
 2016-06-11 03:33:19 +09:00
Jing Zhao
9c7002b122 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. 
(cherry picked from commit 0bbb4ddd793063c87927035969884a34f60f2076)
 2016-06-10 10:40:53 -07:00
Wangda Tan
e91e9e596d YARN-3426. Add jdiff support to YARN. (vinodkv via wangda) 
(cherry picked from commit 03fc6b1bb0f5c0844cd5477ffba43de8a14d4d60)
 2016-06-10 09:53:40 -07:00
Wangda Tan
a4094ddb5a YARN-5208. Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled. (Rohith Sharma K S via wangda) 
(cherry picked from commit 244506f9c8953029283aa8e0eb2006ae2f30025e)
 2016-06-10 09:37:35 -07:00
Akira Ajisaka
db2d96b378 MAPREDUCE-6741. Refactor UncompressedSplitLineReader.fillBuffer(). Contributed by Daniel Templeton. 
(cherry picked from commit 0b7b8a377611b2a3041a2995504a437c36dfa6e6)
 2016-06-10 19:17:05 +09:00
Chris Nauroth
1925942294 Revert "HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane." 
This reverts commit a8f03ef7ea8163c00ce5d72a4e1c77284befe5aa.
 2016-06-09 15:17:18 -07:00
Chris Nauroth
a8f03ef7ea HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane. 
(cherry picked from commit 9581fb715cbc8a6ad28566e83c6d0242a7306688)

Conflicts:
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
 2016-06-09 14:49:05 -07:00
Steve Loughran
6350e4b1fb HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:59:54 +01:00
Vinod Kumar Vavilapalli
f6cd1bcf89 YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv) 
(cherry picked from commit 9378d9428f127eff7acd6c13544016cdbf2d65fb)
 2016-06-09 12:32:53 -07:00
Wangda Tan
aef6e455b1 YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda) 2016-06-09 10:08:31 -07:00
Steve Loughran
df29f77846 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:27 +01:00
Allen Wittenauer
a086fd9040 HADOOP-12743. Fix git environment check during test-patch (aw) 
(cherry picked from commit d323639686eab28f1510031e52e4390f82d78989)
 2016-06-09 23:27:07 +09:00
Masatake Iwasaki
0b7388b5d2 HDFS-10508. DFSInputStream should set thread's interrupt status after catching InterruptException from sleep. Contributed by Jing Zhao. 
(cherry picked from commit 8ea9bbce2614e8eb499af73589f021ed1789e78f)
 2016-06-09 14:53:56 +09:00
Naganarasimha
27fc225558 YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G 
(cherry picked from commit 1500a0a3009e453c9f05a93df7a78b4e185eef30)
 2016-06-09 05:44:41 +05:30
Gera Shegalov
5a9929e19b MAPREDUCE-6240. Hadoop client displays confusing error message. (gera) 
(cherry picked from commit 0af96a1c08594c809ecb254cee4f60dd22399772)
 2016-06-08 13:49:31 -07:00
Ravi Prakash
9c5f7f290e HDFS-10220. A large number of expired leases can make namenode unresponsive and cause failover (Nicolas Fraison via raviprak) 
(cherry picked from commit ae047655f4355288406cd5396fb4e3ea7c307b14)
 2016-06-08 13:46:41 -07:00
Andrew Wang
9319665461 Remove redundant TestMiniDFSCluster.testDualClusters. Contributed by Jiayi Zhou. 
(cherry picked from commit 1ee9ea002609971ad58082bf525d57fca8a37035)
 2016-06-08 12:58:59 -07:00
Vinod Kumar Vavilapalli
67dbd4c466 YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong 
(cherry picked from commit 5a43583c0bbb9650ea6a9f48d9544ec3ec24b580)
 2016-06-08 09:51:36 -07:00
Arun Suresh
c29fbdd8ac YARN-5204. Properly report status of killed/stopped queued containers. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit 3344ba70e027c929e07bad5e6877c796d41181e9)
 2016-06-08 08:32:17 -07:00
Jason Lowe
c6f33e096e YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran 
(cherry picked from commit 8c8a377cac10b086a7ff37ee366b79e6b04d2738)
 2016-06-08 14:13:19 +00:00
Arun Suresh
154c7c343b YARN-5176. More test cases for queuing of containers at the NM. (Konstantinos Karanasos via asuresh) 
(cherry picked from commit 76f0800c21f49fba01694cbdc870103053da802c)
 2016-06-07 17:17:22 -07:00
Xuan
10f0c0475e YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and 
FileInputStream in NMWebServices#getLogs. Contributed by Xuan Gong

(cherry picked from commit 58be55b6e07b94aa55ed87c461f3e5c04cc61630)
 2016-06-07 16:08:54 -07:00
Arun Suresh
6a9f38ebaf Addendum patch for YARN-5180 updating findbugs-exclude.xml 
(cherry picked from commit 8554aee1bef5aff9e49e5e9119d6a7a4abf1c432)
 2016-06-07 16:00:59 -07:00
Jing Zhao
8b34040cb9 HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao 
(cherry picked from commit be34e85e682880f46eee0310bf00ecc7d39cd5bd)
 2016-06-07 10:52:33 -07:00
Junping Du
19eb997f67 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe. 
(cherry picked from commit c14c1b298e29e799f7c8f15ff24d7eba6e0cd39b)
 2016-06-07 09:20:51 -07:00
Zhe Zhang
0499907466 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df111a9a4ed875db995d67af72d08a798)
(cherry picked from commit 06e38c835d0ad9619d4bea662f2dd7d0f62007a9)
 2016-06-07 08:57:27 -07:00
Jason Lowe
5b4c80b27e HDFS-9580. TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. Contributed by Wei-Chiu Chuang. 
Change-Id: I9411dfb1dd4605cbcc515ca3361218d35d7c5fe3
(cherry picked from commit 0087734cc1e18e029ea39f06ca25c8a7d60af004)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-06-07 15:33:43 +00:00
Akira Ajisaka
b8c1db6f63 HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka) 
(cherry picked from commit e620530301fd3e62537d4b7bc3d8ed296bda1ffc)
 2016-06-07 17:53:09 +09:00
Rohith Sharma K S
a29f8bdc3d YARN-5118. Tests fails with localizer port bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit bddea5fe5fe72eee8e2ecfcec616bd8ceb4d72e7)
 2016-06-07 11:23:02 +05:30