Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,616 Commits 326 Branches 371 Tags
Commit Graph

9616 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Haibo Chen
3f5c67df77 MAPREDUCE-6937. Backport MAPREDUCE-6870 to branch-2 while preserving compatibility. (Peter Bacsko via Haibo Chen) 2017-08-30 09:39:50 -07:00
Jian He
8e675d93df YARN-6959. RM may allocate wrong AM Container for new attempt. Contributed by Yuqi Wang 2017-08-17 11:22:01 -07:00
Kihwal Lee
ae854076c7 HDFS-12157. Do fsyncDirectory(..) outside of FSDataset lock. Contributed by Vinayakumar B. 2017-08-09 09:36:08 -05:00
Konstantin V Shvachko
4ed7df2c50 Set the release date for 2.7.4. 2017-08-05 13:56:08 -07:00
Masatake Iwasaki
c521acdc50 HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu. 
(cherry picked from commit d9a07b39046c323d430b98eff6603eaf58e18372)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md

(cherry picked from commit a01d92156d9a7bf008374c04786d37aabad3f3b6)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
 2017-08-02 06:51:00 +00:00
Konstantin V Shvachko
7be489822c Preparing for 2.7.5 development 2017-07-27 21:05:02 -07:00
Brahma Reddy Battula
f90b9d2b25 HDFS-11896. Non-dfsUsed will be doubled on dead node re-registration. Contributed by Brahma Reddy Battula. 
(cherry picked from commit c4a85c694fae3f814ab4e7f3c172da1df0e0e353)
 2017-07-27 12:40:09 -07:00
Sean Busbey
b51623503f HADOOP-14686. Add patchprocess/ to .gitignore. Contributed by Sean Busbey. 2017-07-26 16:27:48 -07:00
Konstantin V Shvachko
c2c40b4703 Revert "HADOOP-14686 update .gitignore" 
This reverts commit ca523c9ce4a3310cd53cc83fe5846b02e608abb6.
 2017-07-26 16:12:37 -07:00
Sean Busbey
ca523c9ce4
HADOOP-14686 update .gitignore 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-07-26 09:03:25 -07:00
Mingliang Liu
e53c489941 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 
(cherry picked from commit d35e79abc2fee7153a6168e6088f100de59d8c81)
(cherry picked from commit 47d3c29e300e0d43ce4a26807432c9c0361e172e)
 2017-07-26 07:45:30 -07:00
Zhe Zhang
964e192d1e Addendum fix for HADOOP-10829 to update CHANGES.txt 2017-07-25 09:13:28 -07:00
Jitendra Pandey
18fe88ac63 HADOOP-10829. Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe. Contributed by Benoy Antony and Rakesh R. 
(cherry picked from commit b82485d6fed2194bf0dc2eedfab7e226e30a7cf0)
(cherry picked from commit c0e294ffc82d611a64b352e3962bce9399ddbe5f)
 2017-07-25 09:07:40 -07:00
Kihwal Lee
62ce8f0430 HDFS-11742. Improve balancer usability after HDFS-8818. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit e229ffee64e8abd1df4d819b81151582ed3a16e2)
 2017-07-21 10:09:56 -05:00
Brahma Reddy Battula
1865cc5bd6 HDFS-12177. NameNode exits due to setting BlockPlacementPolicy loglevel to Debug. Contributed by Jiandan Yang. 2017-07-21 21:23:31 +08:00
Brahma Reddy Battula
ef371dd187 HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B. 
(cherry picked from commit 0ef796174ecb5383f79cfecfcbfc4f309d093cd7)
 2017-07-21 20:53:24 +08:00
Konstantin V Shvachko
1edefb52e6 HDFS-11472. Fix inconsistent replica size after a data pipeline failure. Contributed by Erik Krogen and Wei-Chiu Chuang. 
(cherry picked from commit 2a5a313539e211736fef12010918a60f9edad030)
 2017-07-20 16:23:28 -07:00
Akira Ajisaka
aa5d4330b2
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen. 
(cherry picked from commit 2c769167dbdb66c52d2ba7b7193a686444085570)
(cherry picked from commit 6b3c13d543ddaba3b4a2e6a5649420982a107603)
 2017-07-19 10:32:09 +09:00
Brahma Reddy Battula
978ba21bd0 HADOOP-14356. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula. 2017-07-17 22:56:56 +08:00
Jonathan Hung
f41d7b18dd YARN-6818. User limit per partition is not honored in branch-2.7. Contributed by Jonathan Hung. 2017-07-17 11:19:18 -07:00
Jason Lowe
7b2609d479 Add CHANGES entry for YARN-3260 2017-07-14 15:15:23 -05:00
Jason Lowe
e8d49c7ce7 YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt 
(cherry picked from commit a5ae5ac50e97cf829c41dcf01655cd9bd4d36a00)
 2017-07-14 15:09:55 -05:00
Akira Ajisaka
7d24d4751e MAPREDUCE-6697. Concurrent task limits should only be applied when necessary. Contributed by Nathan Roberts. 
(cherry picked from commit a5c0476a990ec1e7eb34ce2462a45aa52cc1350d)
 2017-07-13 14:20:17 -07:00
Xiao Chen
187bb77ddb HDFS-11741. Long running balancer may fail due to expired DataEncryptionKey. Contributed by Wei-Chiu Chuang and Xiao Chen. 
(cherry picked from commit 068e23b896c63b0f817e6b91d73c994be1551eb2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/security/token/block/BlockTokenSecretManager.java
(cherry picked from commit 6f2391e0ad6fbaa6786cc9f0e3a09b955e0cb21c)

(cherry picked from commit ec10a81bdbc4f5799ae40cd9fe5f6109dfbfa9ae)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/security/token/block/BlockTokenSecretManager.java
 2017-07-11 16:59:25 -07:00
Konstantin V Shvachko
c5e9a15e1e HADOOP-14586. StringIndexOutOfBoundsException breaks org.apache.hadoop.util.Shell on 2.7.x with Java 9. Contributed by Uwe Schindler. 2017-07-11 16:01:58 -07:00
Xiao Chen
0ee637f849 HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 
(cherry picked from commit ba75bc759334c8987e5f7dd4b21d025f0cccbde7)
(cherry picked from commit 05ed48b75a53df9ad4456ecddc981250006540ae)
(cherry picked from commit e2e18501ab1a0a1ebee739fa825b6411b2350a26)
 2017-07-10 13:48:19 -07:00
Konstantin V Shvachko
53907b66cb HDFS-9503. Use generic option -fs for NNThroughputBenchmark instead of -namenode. Contributed by Mingliang Liu. 
(cherry picked from commit 81ef1a1f55ee0104f267316e44596463a78f87ea)
 2017-07-03 12:23:00 -07:00
Xiaoyu Yao
2af5548212 HDFS-9421. NNThroughputBenchmark replication test NPE with -namenode option. Contributed by Mingliang Liu. 
(cherry picked from commit a4f62a2d58d4e00cda3632411c6abda6eaa12a0e)
 2017-07-03 11:42:59 -07:00
Colin Patrick Mccabe
51f012aec4 HDFS-7847. Modify NNThroughputBenchmark to be able to operate on a remote NameNode (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit ffce9a3413277a69444fcb890460c885de56db69)
 2017-07-03 11:32:45 -07:00
Akira Ajisaka
9c7585020b
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu. 2017-06-26 17:34:15 +09:00
Akira Ajisaka
80ed1050b9
Update CHANGES.txt for YARN-6719. 2017-06-19 16:49:59 +09:00
Naganarasimha
0dcd73749d YARN-6719. Fix findbugs warnings in SLSCapacityScheduler.java. Contributed by Akira Ajisaka. 
(cherry picked from commit 582bdfd423a1c163ed945cf0e686e58de1de39c0)
 2017-06-19 12:53:56 +05:30
Akira Ajisaka
f36da00c1f
HDFS-11583. Parent spans are not initialized to NullScope for every DFSPacket. Contributed by Masatake Iwasaki. 2017-06-15 14:15:36 +09:00
Akira Ajisaka
59fab4ea04
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 2017-06-15 13:49:53 +09:00
Kihwal Lee
11e6c96788 HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger. 
(cherry picked from commit abdd609e51a80388493417126c3bc9b1badc0ac1)
(cherry picked from commit 9854682ea46006d98b6d865739b228db804c72ca)
 2017-06-12 09:45:52 -07:00
Chris Nauroth
b6f3e1acae YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer. Backport YARN-6698 by Akira Ajisaka 
(cherry picked from commit ef501b1a0b4c34a2cc43eb082d1c2364684cd7f1)
(cherry picked from commit 384803d09ac45886e74a0501f4b419a2b756c20c)
 2017-06-09 18:04:46 -07:00
Varun Vasudev
b5f25a1a56
YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana 
(cherry picked from commit 5b6bae00942c495e4be6ea2b8eb0676a48468dc6)
(cherry picked from commit 34b8142802eb4af99b3bb7586bc2f8a47f6d73c7)
 2017-06-08 14:53:59 +09:00
Zhe Zhang
a91a1031e3 HDFS-11743. Revert the incompatible fsck reporting output in HDFS-7933 from branch-2.7. 2017-06-07 08:59:28 -07:00
Vinayakumar B
d2ec34d556 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened (Contributed by Vinayakumar B) 2017-06-07 10:53:01 +05:30
Andrew Wang
db81fbbab1 HDFS-8549. Abort the balancer if an upgrade is in progress. Contributed by Andrew Wang. Backport HDFS-11808 by Akira Ajisaka. 
(cherry picked from commit a7a7768341f1b7d3a8f2686e2f4d00c57f2e1d4f)
 2017-06-05 17:27:52 -07:00
Christopher Douglas
f8969e2208 YARN-1471. Preserve scheduler typeinfo in simulator to work with resource monitors. 
Contributed by Carlo Curino. Backport by Ye Zhou.

(cherry picked from commit e07f3c87cd3542760efcf713f909375b69eec00f)
 2017-06-05 16:35:00 -07:00
Karthik Kambatla
abf959f57a YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha) 
(cherry picked from commit ff95fd547b3030529983fa4e701ac728c54ab63a)
 2017-06-05 21:46:12 +05:30
Sunil G
d1f71aaf02 YARN-5988. RM unable to start in secure setup. Contributed by Ajith S. 2017-06-04 14:04:12 +05:30
rohithsharmaks
647077f3f1 YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks) 
(cherry picked from commit d6c8bad86964dbad3cc810914f786c7c4722227a)
 2017-06-03 14:04:49 -07:00
Wangda Tan
12f819a6b7 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) Backport by Jonathan Hung. 
(cherry picked from commit def374e666ed0c1d665aeb1b7307e09769448138)
 2017-06-03 13:59:36 -07:00
Naganarasimha
4f2ff8540b YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt 
(cherry picked from commit f04c81c9ce93512bc714531a7731debbe6b794ce)
 2017-06-02 16:53:38 -07:00
Xiao Chen
67e87c9aff HADOOP-14474. Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures. Contributed by Akira Ajisaka. 
(cherry picked from commit 5e40efe0ec38f1e1228846a5448d93bf040868ff)
(cherry picked from commit d946387850ae2fe383df90dd2722560986236e31)

Conflicts:
	dev-support/docker/Dockerfile
 2017-06-02 09:36:08 -07:00
Kihwal Lee
d3b86234b2 HDFS-11856. Ability to re-add upgrading nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-06-01 16:45:55 -05:00
Kihwal Lee
01cdea732f HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B. 2017-06-01 12:41:00 -05:00
Brahma Reddy Battula
38bc12c683 Updating CHANGES.txt for HDFS-11078 2017-06-02 00:21:12 +08:00