Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,448 Commits 326 Branches 371 Tags
Commit Graph

12448 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
1f9255672d Revert "HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee." 
This reverts commit 40e3cd24b068d08be8cf05668290b908f6b43c11.
 2017-06-20 09:22:25 -05:00
Kihwal Lee
40e3cd24b0 HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 
(cherry picked from commit 8f533ca76b3f3592dc8ec6e318382a54becf10f5)
 2017-06-20 09:20:02 -05:00
Brahma Reddy Battula
a526c3b0bf HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han. 
(cherry picked from commit 2e9daa2e27536484846d9c5f020c6afaf27932ce)
 2017-06-20 20:46:21 +08:00
Akira Ajisaka
f16524ec9f
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang. 
(cherry picked from commit 099dfe92a9743bcb7e27506f8877b8b23b0ff95a)
(cherry picked from commit 35f6c7c9c78b2749c6527dd7829546970821ae30)
 2017-06-20 17:47:25 +09:00
Akira Ajisaka
189e39a90d
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen. 
(cherry picked from commit 2c769167dbdb66c52d2ba7b7193a686444085570)
(cherry picked from commit 6b3c13d543ddaba3b4a2e6a5649420982a107603)
 2017-06-20 16:41:10 +09:00
Xiao Chen
b89783e00e HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j. 
(cherry picked from commit 4cdae5d88ef7851ae284a115868dc4bbe24ae1bd)
 2017-06-19 23:12:35 -07:00
Akira Ajisaka
6a4a63b0fd
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 
(cherry picked from commit 71626fd0b92ee70ee113fde237352266aa599bfb)
 2017-06-20 13:56:20 +09:00
Masatake Iwasaki
6032511239 HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar. 
(cherry picked from commit d954a64730c00346476322743462cde857164177)
 2017-06-20 09:25:05 +09:00
Naganarasimha
363ef7b8ad YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp 
(cherry picked from commit ee89ac84e68d3e181b75c63f74a0444f9d28146f)
 2017-06-19 22:49:28 +05:30
Akira Ajisaka
4250250c7b
HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong. 
(cherry picked from commit 300804595e5b8fd447ecb530fcd0ae5b0e59bb63)
(cherry picked from commit 6d82db40d59684fdb7fcdc6159a975b3ca483c27)
 2017-06-19 19:40:44 +09:00
Naganarasimha
582bdfd423 YARN-6719. Fix findbugs warnings in SLSCapacityScheduler.java. Contributed by Akira Ajisaka. 2017-06-19 12:47:25 +05:30
Jason Lowe
e47ec9413a Revert "MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko" 
This reverts commit ea26ccb7dd9026f0bbc5101c97581952d15a3a74.
 2017-06-16 14:49:56 -05:00
Jason Lowe
ea26ccb7dd MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko 
(cherry picked from commit e78542f4bea90e8545e9e06af9c07e89d2be43d9)
 2017-06-16 14:26:36 -05:00
Akira Ajisaka
4eb577c9f0
Revert "HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin." 
This reverts commit a52315d2c3f758fff2be75e42928576752616bcd.
 2017-06-16 00:22:24 +09:00
Akira Ajisaka
a52315d2c3
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 
(cherry picked from commit 315f07700dcfe32513b87f63070db854ecb3cf48)
(cherry picked from commit 88fa17c2383baafbfb6b43b69e08cf40493c774a)
 2017-06-15 13:47:40 +09:00
Arpit Agarwal
6ca195997b HDFS-11967. TestJMXGet fails occasionally. Contributed by Arpit Agarwal. 2017-06-12 16:04:02 -07:00
Eric Payne
9849b5a489 YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G. 
(cherry picked from commit 5578af860335ae44c9780082508c3dcf726f60fc)
 2017-06-09 16:44:30 -05:00
Mingliang Liu
7eee4fed89 HADOOP-14512. WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename. Contributed by Duo Xu 
(cherry picked from commit 325163f23f727e82379d4a385b73aa3a04a510f6)
 2017-06-09 13:07:55 -07:00
Anu Engineer
182c3f8398 HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal. 
(cherry picked from commit 1f384b617d101f61ac61b5b030c9cbaf8fc9a9b1)
 2017-06-09 14:12:25 +05:30
Naganarasimha
cdac9a4d9d YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp. 2017-06-09 11:59:01 +05:30
John Zhuge
a86081408d HADOOP-14511. WritableRpcEngine.Invocation#toString NPE on null parameters. Contributed by John Zhuge. 
(cherry picked from commit 87f4428de017e5bfc4358304728bd2281d501d52)
 2017-06-08 21:31:00 -07:00
Mingliang Liu
72d895a11f HDFS-11945. Internal lease recovery may not be retried for a long time. Contributed by Kihwal Lee 
(cherry picked from commit facb6812d9004ae509b2564150bbe28317a293f1)
 2017-06-08 14:49:37 -07:00
wenxin he
2c12102edd
HADOOP-14208. Fix typo in the top page in branch-2.8 
This closes #230

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2017-06-08 11:36:24 +09:00
John Zhuge
01b6c6c3b2 HDFS-11861. ipc.Client.Connection#sendRpcRequest should log request name. Contributed by John Zhuge. 
(cherry picked from commit 5672ae7b37ce75086a1cb5bb9a388288fc913eb7)
 2017-06-07 15:54:45 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
396de0fd8f Preparing for 2.8.3 development 2017-06-07 15:38:20 -07:00
Brahma Reddy Battula
c60516aee5 MAPREDUCE-6676. NNBench should Throw IOException when rename and delete fails. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 24181f559f008fc7945702c0fad7d1028f75bfc6)
 2017-06-07 16:38:05 +08:00
Brahma Reddy Battula
8a16846f5d HDFS-11711. DN should not delete the block On "Too many open files" Exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit fca08f8362f0332b064f28c2625fd535004ef85d)
 2017-06-07 16:59:26 +08:00
Vinayakumar B
4a391c72d4 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened. Contributed by Vinayakumar B. 2017-06-07 10:59:04 +05:30
Arpit Agarwal
5fc4b8567b HDFS-11932. BPServiceActor thread name is not correctly set. Contributed by Chen Liang. 2017-06-06 13:52:20 -07:00
Kihwal Lee
a83d7ef605 HADOOP-14035. Reduce fair call queue backoff's impact on clients. Contributed by Daryn Sharp. 2017-06-06 13:09:54 -05:00
Christopher Douglas
d013f4134b YARN-1471. Preserve scheduler typeinfo in simulator to work with resource monitors. 
Contributed by Carlo Curino. Backport by Ye Zhou.

(cherry picked from commit e07f3c87cd3542760efcf713f909375b69eec00f)
 2017-06-05 16:19:55 -07:00
Kihwal Lee
1d3fa87011 HDFS-10816. TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor. Contributed by Eric Badger. 
(cherry picked from commit e2ea6012311c927cd7bc1524f811411fda4fd6cc)
 2017-06-05 15:28:01 -05:00
Kihwal Lee
9854682ea4 HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger. 
(cherry picked from commit abdd609e51a80388493417126c3bc9b1badc0ac1)
 2017-06-05 11:34:40 -05:00
Karthik Kambatla
5410ec995d YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha) 
(cherry picked from commit ff95fd547b3030529983fa4e701ac728c54ab63a)
 2017-06-05 21:46:59 +05:30
Sunil G
34958e358b YARN-5988. RM unable to start in secure setup. Contributed by Ajith S. 2017-06-04 14:09:08 +05:30
Sunil G
13b4a6b2b9 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong. 2017-06-04 10:46:47 +05:30
Xiao Chen
d946387850 HADOOP-14474. Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures. Contributed by Akira Ajisaka. 
(cherry picked from commit 5e40efe0ec38f1e1228846a5448d93bf040868ff)
 2017-06-02 09:30:08 -07:00
Xiao Chen
ec10a81bdb HDFS-11741. Long running balancer may fail due to expired DataEncryptionKey. Contributed by Wei-Chiu Chuang and Xiao Chen. 
(cherry picked from commit 068e23b896c63b0f817e6b91d73c994be1551eb2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/security/token/block/BlockTokenSecretManager.java
(cherry picked from commit 6f2391e0ad6fbaa6786cc9f0e3a09b955e0cb21c)
 2017-06-01 14:05:31 -07:00
Kihwal Lee
89d59c292f HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B. 2017-06-01 12:25:27 -05:00
Brahma Reddy Battula
0cba282261 HDFS-11893. Fix TestDFSShell.testMoveWithTargetPortEmpty failure. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0dcf843c008f2b9cece8c0a0cef78140398ac464)
 2017-06-01 22:40:43 +08:00
Kihwal Lee
fe6de5e594 HDFS-11856. Ability to re-add upgrading nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-05-31 13:08:51 -05:00
Nathan Roberts
1f077f45f9 YARN-6649. RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exception. Contributed by Jon Eagles. 
(cherry picked from commit 4369690ce63566131aee28696bf2683a3cb20205)
 2017-05-31 12:47:38 -05:00
John Zhuge
f8a3de64f8 HADOOP-14464. hadoop-aws doc header warning #5 line wrapped. Contributed by John Zhuge. 
(cherry picked from commit 6c6a7a59622ba7c1e4faa5534f4479de0cd84993)
 2017-05-28 22:29:49 -07:00
Arpit Agarwal
76c15121d8 HDFS-11891. DU#refresh should print the path of the directory when an exception is caught. Contributed by Chen Liang. 2017-05-26 16:03:04 -07:00
Inigo Goiri
a20789f299 Fix NPE in LazyPersistFileScrubber. Contributed by Inigo Goiri. 
(cherry picked from commit 303c8dc9b6c853c0939ea9ba14388897cc258071)
 2017-05-26 13:42:55 -07:00
Jason Lowe
b89d59e21e YARN-6641. Non-public resource localization on a bad disk causes subsequent containers failure. Contributed by Kuhu Shukla 2017-05-26 09:45:49 -05:00
Kihwal Lee
bbef16b84e HDFS-11817. A faulty node can cause a lease leak and NPE on accessing data. Contributed by Kihwal Lee. 
(Updated TestBlockUnderConstruction for nextGenerationStamp method)
(cherry picked from commit 2cb63433abb21cd2b74bd266b70a682caf9e2d98)
 2017-05-25 17:34:56 -05:00
Jason Lowe
8739c4d2f8 YARN-6643. TestRMFailover fails rarely due to port conflict. Contributed by Robert Kanter 
(cherry picked from commit 3fd6a2da4e537423d1462238e10cc9e1f698d1c2)
 2017-05-25 16:09:29 -05:00
Brahma Reddy Battula
4f5846f1e3 HDFS-11445. FSCK shows overall health stauts as corrupt even one replica is corrupt. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 7bad748091b6a5f90e919c781a915e13000e1be6)
 2017-05-25 22:40:11 +08:00
Varun Vasudev
c1f3cd765f Addendum patch to fix Docker sanitization. 
(cherry picked from commit 2ff2a1f50e8c7c0f33676b010b256d6c8daf912d)
(cherry picked from commit 983c4437c2b1aaafddfc97b19371cdb992389a61)
 2017-05-25 14:54:17 +05:30