Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,274 Commits 326 Branches 371 Tags
Commit Graph

12274 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xiao Chen
83eacccc17 HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 
(cherry picked from commit ba75bc759334c8987e5f7dd4b21d025f0cccbde7)
(cherry picked from commit 05ed48b75a53df9ad4456ecddc981250006540ae)
 2017-07-10 13:48:12 -07:00
Naganarasimha
0f9f7bb0c6 YARN-6770. A small mistake in the example of TimelineClient. Contributed by Jinjiang Ling. 
(cherry picked from commit ba5b056e8a151fad9d7573c6e62cffc40cde7da3)
 2017-07-09 21:40:16 +05:30
Naganarasimha
ad70e929b2 YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundutt. 2017-07-09 17:34:47 +05:30
Junping Du
5ad710bc7a MAPREDUCE-6246. DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2. Contributed by ramtin and Gergely Novák. 
(cherry picked from commit f484a6ff602d48413556a1d046670e2003c71c2e)
(cherry picked from commit f823f9fd784fa4944178247a82df24fba03c2051)
 2017-07-07 13:32:21 -07:00
Wei-Chiu Chuang
d657c05177 HADOOP-14563. LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException. Contributed by Rushabh S Shah. 
(cherry picked from commit 8153fe2bd35fb4df0b64f93ac0046e34d4807ac3)
(cherry picked from commit 730b21e9f90524673932411b48e1cb04dd3633d0)
 2017-07-07 06:14:32 -07:00
Eric Payne
8949a9d541 YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Contributed by Sunil G) 2017-07-06 10:53:47 -05:00
Jason Lowe
cd895d0586 YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt 
(cherry picked from commit 7576a688ea84aed7206321b1f03594e43a5f216e)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ContainerLocalizer.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestContainerLocalizer.java
 2017-07-06 09:53:13 -05:00
Jason Lowe
c8e6012f62 MAPREDUCE-6911. TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistently. Contributed by Eric Badger 
(cherry picked from commit f0435db0891fd51b54241edf5bda42125490a06c)
 2017-07-06 09:24:01 -05:00
Mingliang Liu
db6e8ff747 HDFS-12089. Fix ambiguous NN retry log message in WebHDFS. Contributed by Eric Badger 
(cherry picked from commit 6436768baf1b2ac05f6786edcd76fd3a66c03eaa)
 2017-07-05 11:12:41 -07:00
Vinayakumar B
cd6ee04274 HADOOP-13414. Hide Jetty Server version header in HTTP responses. Contributed by Surendra Singth Lilhore. 
(cherry picked from commit 1e8301b215f79d48bbb58e2348945144d4c37997)
 2017-07-05 16:07:18 +05:30
Akira Ajisaka
71f49406f2
MAPREDUCE-6909. LocalJobRunner fails when run on a node from multiple users. Contributed by Jason Lowe. 
(cherry picked from commit ac333155fbcbbc50477869fb29c8da124e5968c0)
 2017-07-04 15:26:46 +09:00
Akira Ajisaka
9f9d554edf
HDFS-12078. Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml. Contributed by Weiwei Yang. 
(cherry picked from commit 186650d21d482e2f3bc4523ae989ebe76081b0e3)
(cherry picked from commit 063f2132ef54436e8a537d437e7a39256a74214f)
 2017-07-04 14:53:02 +09:00
Naganarasimha
acc504dc58 MAPREDUCE-6905. HADOOP_JOB_HISTORY_OPTS should be HADOOP_JOB_HISTORYSERVER_OPTS in mapred-config.sh. Contributed by LiXin Ge. 
(cherry picked from commit bf1f59937dd5d860c9ed7fefce203d6a9f645182)
 2017-07-02 16:18:30 +05:30
Naganarasimha
69480ba686 YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp. 2017-07-01 12:58:36 +05:30
Wei-Chiu Chuang
8027246306 HDFS-12042. Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption. Contributed by Misha Dmitriev. 
(cherry picked from commit bcba844d1144cc334e2babbc34c9d42eac1c203a)
(cherry picked from commit 94bc5cdbb3d0fd9133a8cab9d3daac6798e8d8dd)
 2017-06-30 11:43:41 -07:00
bibinchundatt
f6fcbf426f YARN-6749. TestAppSchedulingInfo.testPriorityAccounting fails consistently. Contributed by Naganarasimha G R 2017-06-30 21:52:16 +05:30
John Zhuge
2956c584c3 HADOOP-14024. KMS JMX endpoint throws ClassNotFoundException. Contributed by John Zhuge. 
(cherry picked from commit 1272ee153b1a1578abf822b2141d8336d9c5652f)
 2017-06-29 16:27:50 -07:00
Wei-Chiu Chuang
7c076f917f HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy. 
(cherry picked from commit 16c8dbde574f49827fde5ee9add1861ee65d4645)
(cherry picked from commit 6917c19167060df7879b0e0ead4db1ded62714b3)
 2017-06-29 06:44:37 -07:00
Naganarasimha
29c68ccc6f YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R. 2017-06-29 00:25:32 +05:30
Xiao Chen
ddd3e7a4db HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j. 
(cherry picked from commit aff7a3f8eddd55501366a43d2f44f531c6e8ef48)
 2017-06-27 23:49:23 -07:00
Jason Lowe
486dc3f9eb YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich 
(cherry picked from commit 63ce1593c5b78eb172773e7498d9c321debe81e8)
 2017-06-27 17:14:30 -05:00
Kihwal Lee
bdbf737ef3 Addendum for HADOOP-14146. Use commons Base64 instead of jdk8 Base64. 
(cherry picked from commit 07193459091cfaf372634637096485154d39a176)
 2017-06-23 13:28:16 -05:00
Kihwal Lee
fa695817e5 Addendum for HADOOP-14146 jdk7 support. 
(cherry picked from commit 4c6184b41cfdab589a2fea4fb7665e28d044c681)
 2017-06-23 10:00:26 -05:00
Daryn Sharp
81eb06b553 HADOOP-14146. KerberosAuthenticationHandler should authenticate with SPN in AP-REQ. Contributed by Daryn Sharp 2017-06-21 11:48:05 -05:00
Kihwal Lee
a560104fab HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 
(cherry picked from commit 8f533ca76b3f3592dc8ec6e318382a54becf10f5)
 2017-06-20 12:12:33 -05:00
Kihwal Lee
e87bf17129 HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao. 
(cherry picked from commit 972782d9568e0849484c027f27c1638ba50ec56e)
(cherry picked from commit f8c9c0ff0e2d977fc0f69bde4cdbb03371c0bac4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMetadataConsistency.java
 2017-06-20 12:10:43 -05:00
Kihwal Lee
1f9255672d Revert "HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee." 
This reverts commit 40e3cd24b068d08be8cf05668290b908f6b43c11.
 2017-06-20 09:22:25 -05:00
Kihwal Lee
40e3cd24b0 HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 
(cherry picked from commit 8f533ca76b3f3592dc8ec6e318382a54becf10f5)
 2017-06-20 09:20:02 -05:00
Brahma Reddy Battula
a526c3b0bf HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han. 
(cherry picked from commit 2e9daa2e27536484846d9c5f020c6afaf27932ce)
 2017-06-20 20:46:21 +08:00
Akira Ajisaka
f16524ec9f
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang. 
(cherry picked from commit 099dfe92a9743bcb7e27506f8877b8b23b0ff95a)
(cherry picked from commit 35f6c7c9c78b2749c6527dd7829546970821ae30)
 2017-06-20 17:47:25 +09:00
Akira Ajisaka
189e39a90d
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen. 
(cherry picked from commit 2c769167dbdb66c52d2ba7b7193a686444085570)
(cherry picked from commit 6b3c13d543ddaba3b4a2e6a5649420982a107603)
 2017-06-20 16:41:10 +09:00
Xiao Chen
b89783e00e HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j. 
(cherry picked from commit 4cdae5d88ef7851ae284a115868dc4bbe24ae1bd)
 2017-06-19 23:12:35 -07:00
Akira Ajisaka
6a4a63b0fd
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 
(cherry picked from commit 71626fd0b92ee70ee113fde237352266aa599bfb)
 2017-06-20 13:56:20 +09:00
Masatake Iwasaki
6032511239 HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar. 
(cherry picked from commit d954a64730c00346476322743462cde857164177)
 2017-06-20 09:25:05 +09:00
Naganarasimha
363ef7b8ad YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp 
(cherry picked from commit ee89ac84e68d3e181b75c63f74a0444f9d28146f)
 2017-06-19 22:49:28 +05:30
Akira Ajisaka
4250250c7b
HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong. 
(cherry picked from commit 300804595e5b8fd447ecb530fcd0ae5b0e59bb63)
(cherry picked from commit 6d82db40d59684fdb7fcdc6159a975b3ca483c27)
 2017-06-19 19:40:44 +09:00
Naganarasimha
582bdfd423 YARN-6719. Fix findbugs warnings in SLSCapacityScheduler.java. Contributed by Akira Ajisaka. 2017-06-19 12:47:25 +05:30
Jason Lowe
e47ec9413a Revert "MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko" 
This reverts commit ea26ccb7dd9026f0bbc5101c97581952d15a3a74.
 2017-06-16 14:49:56 -05:00
Jason Lowe
ea26ccb7dd MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko 
(cherry picked from commit e78542f4bea90e8545e9e06af9c07e89d2be43d9)
 2017-06-16 14:26:36 -05:00
Akira Ajisaka
4eb577c9f0
Revert "HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin." 
This reverts commit a52315d2c3f758fff2be75e42928576752616bcd.
 2017-06-16 00:22:24 +09:00
Akira Ajisaka
a52315d2c3
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 
(cherry picked from commit 315f07700dcfe32513b87f63070db854ecb3cf48)
(cherry picked from commit 88fa17c2383baafbfb6b43b69e08cf40493c774a)
 2017-06-15 13:47:40 +09:00
Arpit Agarwal
6ca195997b HDFS-11967. TestJMXGet fails occasionally. Contributed by Arpit Agarwal. 2017-06-12 16:04:02 -07:00
Eric Payne
9849b5a489 YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G. 
(cherry picked from commit 5578af860335ae44c9780082508c3dcf726f60fc)
 2017-06-09 16:44:30 -05:00
Mingliang Liu
7eee4fed89 HADOOP-14512. WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename. Contributed by Duo Xu 
(cherry picked from commit 325163f23f727e82379d4a385b73aa3a04a510f6)
 2017-06-09 13:07:55 -07:00
Anu Engineer
182c3f8398 HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal. 
(cherry picked from commit 1f384b617d101f61ac61b5b030c9cbaf8fc9a9b1)
 2017-06-09 14:12:25 +05:30
Naganarasimha
cdac9a4d9d YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp. 2017-06-09 11:59:01 +05:30
John Zhuge
a86081408d HADOOP-14511. WritableRpcEngine.Invocation#toString NPE on null parameters. Contributed by John Zhuge. 
(cherry picked from commit 87f4428de017e5bfc4358304728bd2281d501d52)
 2017-06-08 21:31:00 -07:00
Mingliang Liu
72d895a11f HDFS-11945. Internal lease recovery may not be retried for a long time. Contributed by Kihwal Lee 
(cherry picked from commit facb6812d9004ae509b2564150bbe28317a293f1)
 2017-06-08 14:49:37 -07:00
wenxin he
2c12102edd
HADOOP-14208. Fix typo in the top page in branch-2.8 
This closes #230

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2017-06-08 11:36:24 +09:00
John Zhuge
01b6c6c3b2 HDFS-11861. ipc.Client.Connection#sendRpcRequest should log request name. Contributed by John Zhuge. 
(cherry picked from commit 5672ae7b37ce75086a1cb5bb9a388288fc913eb7)
 2017-06-07 15:54:45 -07:00