Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,326 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12326 Commits

Author SHA1 Message Date
Akira Ajisaka ebb66d2038
YARN-6809. Fix typo in ResourceManagerHA.md. Contributed by Yeliang Cang. 
(cherry picked from commit b628d0da51)
(cherry picked from commit 3419381e98)
 2017-07-12 19:39:29 +09:00
Akira Ajisaka d1fb4948d2
HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor. 
(cherry picked from commit 9144fd9e9b)
(cherry picked from commit 2653cf4466)
 2017-07-12 11:44:15 +09:00
Xiao Chen 83eacccc17 HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 
(cherry picked from commit ba75bc7593)
(cherry picked from commit 05ed48b75a)
 2017-07-10 13:48:12 -07:00
Naganarasimha 0f9f7bb0c6 YARN-6770. A small mistake in the example of TimelineClient. Contributed by Jinjiang Ling. 
(cherry picked from commit ba5b056e8a)
 2017-07-09 21:40:16 +05:30
Naganarasimha ad70e929b2 YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundutt. 2017-07-09 17:34:47 +05:30
Junping Du 5ad710bc7a MAPREDUCE-6246. DBOutputFormat.java appending extra semicolon to query which is incompatible with DB2. Contributed by ramtin and Gergely Novák. 
(cherry picked from commit f484a6ff60)
(cherry picked from commit f823f9fd78)
 2017-07-07 13:32:21 -07:00
Wei-Chiu Chuang d657c05177 HADOOP-14563. LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException. Contributed by Rushabh S Shah. 
(cherry picked from commit 8153fe2bd3)
(cherry picked from commit 730b21e9f9)
 2017-07-07 06:14:32 -07:00
Eric Payne 8949a9d541 YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Contributed by Sunil G) 2017-07-06 10:53:47 -05:00
Jason Lowe cd895d0586 YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt 
(cherry picked from commit 7576a688ea)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ContainerLocalizer.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestContainerLocalizer.java
 2017-07-06 09:53:13 -05:00
Jason Lowe c8e6012f62 MAPREDUCE-6911. TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistently. Contributed by Eric Badger 
(cherry picked from commit f0435db089)
 2017-07-06 09:24:01 -05:00
Mingliang Liu db6e8ff747 HDFS-12089. Fix ambiguous NN retry log message in WebHDFS. Contributed by Eric Badger 
(cherry picked from commit 6436768baf)
 2017-07-05 11:12:41 -07:00
Vinayakumar B cd6ee04274 HADOOP-13414. Hide Jetty Server version header in HTTP responses. Contributed by Surendra Singth Lilhore. 
(cherry picked from commit 1e8301b215)
 2017-07-05 16:07:18 +05:30
Akira Ajisaka 71f49406f2
MAPREDUCE-6909. LocalJobRunner fails when run on a node from multiple users. Contributed by Jason Lowe. 
(cherry picked from commit ac333155fb)
 2017-07-04 15:26:46 +09:00
Akira Ajisaka 9f9d554edf
HDFS-12078. Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml. Contributed by Weiwei Yang. 
(cherry picked from commit 186650d21d)
(cherry picked from commit 063f2132ef)
 2017-07-04 14:53:02 +09:00
Naganarasimha acc504dc58 MAPREDUCE-6905. HADOOP_JOB_HISTORY_OPTS should be HADOOP_JOB_HISTORYSERVER_OPTS in mapred-config.sh. Contributed by LiXin Ge. 
(cherry picked from commit bf1f59937d)
 2017-07-02 16:18:30 +05:30
Naganarasimha 69480ba686 YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp. 2017-07-01 12:58:36 +05:30
Wei-Chiu Chuang 8027246306 HDFS-12042. Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption. Contributed by Misha Dmitriev. 
(cherry picked from commit bcba844d11)
(cherry picked from commit 94bc5cdbb3)
 2017-06-30 11:43:41 -07:00
bibinchundatt f6fcbf426f YARN-6749. TestAppSchedulingInfo.testPriorityAccounting fails consistently. Contributed by Naganarasimha G R 2017-06-30 21:52:16 +05:30
John Zhuge 2956c584c3 HADOOP-14024. KMS JMX endpoint throws ClassNotFoundException. Contributed by John Zhuge. 
(cherry picked from commit 1272ee153b)
 2017-06-29 16:27:50 -07:00
Wei-Chiu Chuang 7c076f917f HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy. 
(cherry picked from commit 16c8dbde57)
(cherry picked from commit 6917c19167)
 2017-06-29 06:44:37 -07:00
Naganarasimha 29c68ccc6f YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R. 2017-06-29 00:25:32 +05:30
Xiao Chen ddd3e7a4db HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j. 
(cherry picked from commit aff7a3f8eddd55501366a43d2f44f531c6e8ef48)
 2017-06-27 23:49:23 -07:00
Jason Lowe 486dc3f9eb YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich 
(cherry picked from commit 63ce1593c5)
 2017-06-27 17:14:30 -05:00
Kihwal Lee bdbf737ef3 Addendum for HADOOP-14146. Use commons Base64 instead of jdk8 Base64. 
(cherry picked from commit 0719345909)
 2017-06-23 13:28:16 -05:00
Kihwal Lee fa695817e5 Addendum for HADOOP-14146 jdk7 support. 
(cherry picked from commit 4c6184b41c)
 2017-06-23 10:00:26 -05:00
Daryn Sharp 81eb06b553 HADOOP-14146. KerberosAuthenticationHandler should authenticate with SPN in AP-REQ. Contributed by Daryn Sharp 2017-06-21 11:48:05 -05:00
Kihwal Lee a560104fab HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 
(cherry picked from commit 8f533ca76b)
 2017-06-20 12:12:33 -05:00
Kihwal Lee e87bf17129 HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao. 
(cherry picked from commit 972782d956)
(cherry picked from commit f8c9c0ff0e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMetadataConsistency.java
 2017-06-20 12:10:43 -05:00
Kihwal Lee 1f9255672d Revert "HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee." 
This reverts commit 40e3cd24b0.
 2017-06-20 09:22:25 -05:00
Kihwal Lee 40e3cd24b0 HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 
(cherry picked from commit 8f533ca76b)
 2017-06-20 09:20:02 -05:00
Brahma Reddy Battula a526c3b0bf HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han. 
(cherry picked from commit 2e9daa2e27)
 2017-06-20 20:46:21 +08:00
Akira Ajisaka f16524ec9f
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang. 
(cherry picked from commit 099dfe92a9)
(cherry picked from commit 35f6c7c9c7)
 2017-06-20 17:47:25 +09:00
Akira Ajisaka 189e39a90d
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen. 
(cherry picked from commit 2c769167db)
(cherry picked from commit 6b3c13d543)
 2017-06-20 16:41:10 +09:00
Xiao Chen b89783e00e HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j. 
(cherry picked from commit 4cdae5d88ef7851ae284a115868dc4bbe24ae1bd)
 2017-06-19 23:12:35 -07:00
Akira Ajisaka 6a4a63b0fd
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 
(cherry picked from commit 71626fd0b9)
 2017-06-20 13:56:20 +09:00
Masatake Iwasaki 6032511239 HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar. 
(cherry picked from commit d954a64730)
 2017-06-20 09:25:05 +09:00
Naganarasimha 363ef7b8ad YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp 
(cherry picked from commit ee89ac84e6)
 2017-06-19 22:49:28 +05:30
Akira Ajisaka 4250250c7b
HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong. 
(cherry picked from commit 300804595e)
(cherry picked from commit 6d82db40d5)
 2017-06-19 19:40:44 +09:00
Naganarasimha 582bdfd423 YARN-6719. Fix findbugs warnings in SLSCapacityScheduler.java. Contributed by Akira Ajisaka. 2017-06-19 12:47:25 +05:30
Jason Lowe e47ec9413a Revert "MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko" 
This reverts commit ea26ccb7dd.
 2017-06-16 14:49:56 -05:00
Jason Lowe ea26ccb7dd MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko 
(cherry picked from commit e78542f4be)
 2017-06-16 14:26:36 -05:00
Akira Ajisaka 4eb577c9f0
Revert "HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin." 
This reverts commit a52315d2c3.
 2017-06-16 00:22:24 +09:00
Akira Ajisaka a52315d2c3
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 
(cherry picked from commit 315f07700d)
(cherry picked from commit 88fa17c238)
 2017-06-15 13:47:40 +09:00
Arpit Agarwal 6ca195997b HDFS-11967. TestJMXGet fails occasionally. Contributed by Arpit Agarwal. 2017-06-12 16:04:02 -07:00
Eric Payne 9849b5a489 YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G. 
(cherry picked from commit 5578af8603)
 2017-06-09 16:44:30 -05:00
Mingliang Liu 7eee4fed89 HADOOP-14512. WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename. Contributed by Duo Xu 
(cherry picked from commit 325163f23f)
 2017-06-09 13:07:55 -07:00
Anu Engineer 182c3f8398 HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal. 
(cherry picked from commit 1f384b617d)
 2017-06-09 14:12:25 +05:30
Naganarasimha cdac9a4d9d YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp. 2017-06-09 11:59:01 +05:30
John Zhuge a86081408d HADOOP-14511. WritableRpcEngine.Invocation#toString NPE on null parameters. Contributed by John Zhuge. 
(cherry picked from commit 87f4428de0)
 2017-06-08 21:31:00 -07:00
Mingliang Liu 72d895a11f HDFS-11945. Internal lease recovery may not be retried for a long time. Contributed by Kihwal Lee 
(cherry picked from commit facb6812d9)
 2017-06-08 14:49:37 -07:00