Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,658 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9658 Commits

Author SHA1 Message Date
Konstantin V Shvachko c2c40b4703 Revert "HADOOP-14686 update .gitignore" 
This reverts commit ca523c9ce4.
 2017-07-26 16:12:37 -07:00
Sean Busbey ca523c9ce4
HADOOP-14686 update .gitignore 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2017-07-26 09:03:25 -07:00
Mingliang Liu e53c489941 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 
(cherry picked from commit d35e79abc2)
(cherry picked from commit 47d3c29e30)
 2017-07-26 07:45:30 -07:00
Zhe Zhang 964e192d1e Addendum fix for HADOOP-10829 to update CHANGES.txt 2017-07-25 09:13:28 -07:00
Jitendra Pandey 18fe88ac63 HADOOP-10829. Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe. Contributed by Benoy Antony and Rakesh R. 
(cherry picked from commit b82485d6fe)
(cherry picked from commit c0e294ffc8)
 2017-07-25 09:07:40 -07:00
Kihwal Lee 62ce8f0430 HDFS-11742. Improve balancer usability after HDFS-8818. Contributed by Kihwal Lee 
Updated CHANGES.txt
(cherry picked from commit e229ffee64)
 2017-07-21 10:09:56 -05:00
Brahma Reddy Battula 1865cc5bd6 HDFS-12177. NameNode exits due to setting BlockPlacementPolicy loglevel to Debug. Contributed by Jiandan Yang. 2017-07-21 21:23:31 +08:00
Brahma Reddy Battula ef371dd187 HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B. 
(cherry picked from commit 0ef796174e)
 2017-07-21 20:53:24 +08:00
Konstantin V Shvachko 1edefb52e6 HDFS-11472. Fix inconsistent replica size after a data pipeline failure. Contributed by Erik Krogen and Wei-Chiu Chuang. 
(cherry picked from commit 2a5a313539)
 2017-07-20 16:23:28 -07:00
Akira Ajisaka aa5d4330b2
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen. 
(cherry picked from commit 2c769167db)
(cherry picked from commit 6b3c13d543)
 2017-07-19 10:32:09 +09:00
Brahma Reddy Battula 978ba21bd0 HADOOP-14356. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula. 2017-07-17 22:56:56 +08:00
Jonathan Hung f41d7b18dd YARN-6818. User limit per partition is not honored in branch-2.7. Contributed by Jonathan Hung. 2017-07-17 11:19:18 -07:00
Jason Lowe 7b2609d479 Add CHANGES entry for YARN-3260 2017-07-14 15:15:23 -05:00
Jason Lowe e8d49c7ce7 YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt 
(cherry picked from commit a5ae5ac50e)
 2017-07-14 15:09:55 -05:00
Akira Ajisaka 7d24d4751e MAPREDUCE-6697. Concurrent task limits should only be applied when necessary. Contributed by Nathan Roberts. 
(cherry picked from commit a5c0476a99)
 2017-07-13 14:20:17 -07:00
Xiao Chen 187bb77ddb HDFS-11741. Long running balancer may fail due to expired DataEncryptionKey. Contributed by Wei-Chiu Chuang and Xiao Chen. 
(cherry picked from commit 068e23b896c63b0f817e6b91d73c994be1551eb2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/security/token/block/BlockTokenSecretManager.java
(cherry picked from commit 6f2391e0ad6fbaa6786cc9f0e3a09b955e0cb21c)

(cherry picked from commit ec10a81bdb)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/security/token/block/BlockTokenSecretManager.java
 2017-07-11 16:59:25 -07:00
Konstantin V Shvachko c5e9a15e1e HADOOP-14586. StringIndexOutOfBoundsException breaks org.apache.hadoop.util.Shell on 2.7.x with Java 9. Contributed by Uwe Schindler. 2017-07-11 16:01:58 -07:00
Xiao Chen 0ee637f849 HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 
(cherry picked from commit ba75bc7593)
(cherry picked from commit 05ed48b75a)
(cherry picked from commit e2e18501ab1a0a1ebee739fa825b6411b2350a26)
 2017-07-10 13:48:19 -07:00
Konstantin V Shvachko 53907b66cb HDFS-9503. Use generic option -fs for NNThroughputBenchmark instead of -namenode. Contributed by Mingliang Liu. 
(cherry picked from commit 81ef1a1f55)
 2017-07-03 12:23:00 -07:00
Xiaoyu Yao 2af5548212 HDFS-9421. NNThroughputBenchmark replication test NPE with -namenode option. Contributed by Mingliang Liu. 
(cherry picked from commit a4f62a2d58)
 2017-07-03 11:42:59 -07:00
Colin Patrick Mccabe 51f012aec4 HDFS-7847. Modify NNThroughputBenchmark to be able to operate on a remote NameNode (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit ffce9a3413)
 2017-07-03 11:32:45 -07:00
Akira Ajisaka 9c7585020b
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu. 2017-06-26 17:34:15 +09:00
Akira Ajisaka 80ed1050b9
Update CHANGES.txt for YARN-6719. 2017-06-19 16:49:59 +09:00
Naganarasimha 0dcd73749d YARN-6719. Fix findbugs warnings in SLSCapacityScheduler.java. Contributed by Akira Ajisaka. 
(cherry picked from commit 582bdfd423)
 2017-06-19 12:53:56 +05:30
Akira Ajisaka f36da00c1f
HDFS-11583. Parent spans are not initialized to NullScope for every DFSPacket. Contributed by Masatake Iwasaki. 2017-06-15 14:15:36 +09:00
Akira Ajisaka 59fab4ea04
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 2017-06-15 13:49:53 +09:00
Kihwal Lee 11e6c96788 HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger. 
(cherry picked from commit abdd609e51)
(cherry picked from commit 9854682ea4)
 2017-06-12 09:45:52 -07:00
Chris Nauroth b6f3e1acae YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer. Backport YARN-6698 by Akira Ajisaka 
(cherry picked from commit ef501b1a0b)
(cherry picked from commit 384803d09ac45886e74a0501f4b419a2b756c20c)
 2017-06-09 18:04:46 -07:00
Varun Vasudev b5f25a1a56
YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana 
(cherry picked from commit 5b6bae0094)
(cherry picked from commit 34b8142802)
 2017-06-08 14:53:59 +09:00
Zhe Zhang a91a1031e3 HDFS-11743. Revert the incompatible fsck reporting output in HDFS-7933 from branch-2.7. 2017-06-07 08:59:28 -07:00
Vinayakumar B d2ec34d556 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened (Contributed by Vinayakumar B) 2017-06-07 10:53:01 +05:30
Andrew Wang db81fbbab1 HDFS-8549. Abort the balancer if an upgrade is in progress. Contributed by Andrew Wang. Backport HDFS-11808 by Akira Ajisaka. 
(cherry picked from commit a7a7768341)
 2017-06-05 17:27:52 -07:00
Christopher Douglas f8969e2208 YARN-1471. Preserve scheduler typeinfo in simulator to work with resource monitors. 
Contributed by Carlo Curino. Backport by Ye Zhou.

(cherry picked from commit e07f3c87cd)
 2017-06-05 16:35:00 -07:00
Karthik Kambatla abf959f57a YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha) 
(cherry picked from commit ff95fd547b)
 2017-06-05 21:46:12 +05:30
Sunil G d1f71aaf02 YARN-5988. RM unable to start in secure setup. Contributed by Ajith S. 2017-06-04 14:04:12 +05:30
rohithsharmaks 647077f3f1 YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks) 
(cherry picked from commit d6c8bad869)
 2017-06-03 14:04:49 -07:00
Wangda Tan 12f819a6b7 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) Backport by Jonathan Hung. 
(cherry picked from commit def374e666)
 2017-06-03 13:59:36 -07:00
Naganarasimha 4f2ff8540b YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt 
(cherry picked from commit f04c81c9ce)
 2017-06-02 16:53:38 -07:00
Xiao Chen 67e87c9aff HADOOP-14474. Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures. Contributed by Akira Ajisaka. 
(cherry picked from commit 5e40efe0ec)
(cherry picked from commit d946387850)

Conflicts:
	dev-support/docker/Dockerfile
 2017-06-02 09:36:08 -07:00
Kihwal Lee d3b86234b2 HDFS-11856. Ability to re-add upgrading nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-06-01 16:45:55 -05:00
Kihwal Lee 01cdea732f HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B. 2017-06-01 12:41:00 -05:00
Brahma Reddy Battula 38bc12c683 Updating CHANGES.txt for HDFS-11078 2017-06-02 00:21:12 +08:00
Brahma Reddy Battula 2b19c7b3ff HDFS-11893. Fix TestDFSShell.testMoveWithTargetPortEmpty failure. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0dcf843c00)
 2017-06-01 22:53:06 +08:00
Sunil G fd112535c8 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong. 2017-06-01 11:19:37 +05:30
Kihwal Lee 1903665b23 HDFS-11648. Lazy construct the IIP pathname. Contributed by Daryn Sharp. 
(cherry picked from commit 8ed230c805)
(cherry picked from commit 9dfe0b3515)
 2017-05-31 08:50:26 -07:00
Kihwal Lee 81712e84fb HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 90020624b0)
(cherry picked from commit 3a89a8814f)
 2017-05-31 08:50:26 -07:00
Akira Ajisaka fd834915f2
Update CHANGES.txt for YARN-6304. 2017-05-30 18:05:05 +09:00
Junping Du b60e11e6bf YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6ed9d36224)
 2017-05-30 14:19:27 +05:30
Kihwal Lee cafee1109c HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp. 
(cherry picked from commit 0d8a35bd6d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2017-05-26 19:00:03 -07:00
Inigo Goiri 948d0ac72d Fix NPE in LazyPersistFileScrubber. Contributed by Inigo Goiri. 
(cherry picked from commit 303c8dc9b6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2017-05-26 13:36:34 -07:00