Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,436 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12436 Commits

Author SHA1 Message Date
Rohith Sharma K S 528ef2407c YARN-5874. RM -format-state-store and -remove-application-from-state-store commands fail with NPE. Contributed by Varun Saxena. 
(cherry picked from commit b7070f3308)
 2016-11-15 11:03:38 +05:30
Rohith Sharma K S fad6de3080 YARN-5873. RM crashes with NPE if generic application history is enabled. Contributed by Varun Saxena. 
(cherry picked from commit 296c5de0cf)
 2016-11-15 11:03:27 +05:30
Mingliang Liu 0b428075a2 HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran 
This closes #158

(cherry picked from commit 04014c4c73)
 2016-11-14 19:41:32 -08:00
Zhe Zhang 818915aabb HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 16:33:15 -08:00
Jason Lowe 5ffb26c2a9 MAPREDUCE-6797. Job history server scans can become blocked on a single, slow entry. Contributed by Prabhu Joseph 
(cherry picked from commit 99c2bbd337)
 2016-11-14 20:30:36 +00:00
Brahma Reddy Battula 399abe7c74 HDFS-11135. The tests in TestBalancer run fails due to NPE. Contributed By Yiqun Lin 
(cherry picked from commit 6efb8c9c60)
 2016-11-14 20:41:55 +05:30
Karthik Kambatla ea74c7b7ae YARN-4033. In FairScheduler, parent queues should also display queue status. (Siqi Li via kasha) 
(cherry picked from commit 79448d4ab1)
 2016-11-13 21:39:44 -08:00
Erik Krogen 98d9e9c4c8 HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 2016-11-13 14:50:33 -08:00
Mingliang Liu fb3a5085e8 HADOOP-13813. TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing. Contributed by Mingliang Liu 2016-11-12 10:36:14 -08:00
Mingliang Liu 685d753d07 HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. Contributed by Brahma Reddy Battula 
(cherry picked from commit 2ee18fc15e)
 2016-11-11 22:16:05 -08:00
Jian He 9b0a2cb321 YARN-5825. ProportionalPreemptionalPolicy should use readLock over LeafQueue instead of synchronized block. Contributed by Sunil G 
(cherry picked from commit fad9609d13)
 2016-11-11 15:16:43 -08:00
Xiaoyu Yao 5613b0818c HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498)
 2016-11-11 14:31:54 -08:00
Wangda Tan a76e214556 YARN-5552. Add Builder methods for common yarn API records. (Tao Jie via wangda) 
(cherry picked from commit ede1a473f5)
 2016-11-11 13:42:45 -08:00
Mingliang Liu 289f03e49e HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. Contributed by Yiqun Lin 
(cherry picked from commit aa6010ccca)
 2016-11-11 12:30:22 -08:00
Naganarasimha bde95f90e7 YARN-5545, Fix issues related to Max App in capacity scheduler. Contributed by Bibin A Chundatt 2016-11-12 00:52:35 +05:30
Brahma Reddy Battula b51806b45f HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru. 
(cherry picked from commit 1ae57f0f75)
 2016-11-11 20:09:49 +05:30
Yongjun Zhang c684a00ed3 HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang. 
(cherry picked from commit fd2f22adec)
 2016-11-10 23:06:09 -08:00
Eric Payne dd5b9dabf9 YARN-4218. Metric for resource*time that was preempted. Contributed by Chang Li. 2016-11-10 23:02:42 +00:00
Karthik Kambatla f4c8dc4783 YARN-5834. TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value. (Chang Li via kasha) 
(cherry picked from commit 3a98419532)
 2016-11-10 14:09:33 -08:00
Mingliang Liu d064d5dbb2 HADOOP-13687. Provide a unified dependency artifact that transitively includes the cloud storage modules shipped with Hadoop. Contributed by Chris Nauroth 
(cherry picked from commit 89354f0475)
 2016-11-10 08:59:07 -08:00
Karthik Kambatla f7b25420a1 YARN-5453. FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource. (sandflee via kasha) 
(cherry picked from commit 86ac1ad9fd)
 2016-11-09 23:44:26 -08:00
Varun Saxena 06c8ebdb83 YARN-5862. TestDiskFailures.testLocalDirsFailures failed (Yufei Gu via Varun Saxena) 
(cherry picked from commit c202a10923)
 2016-11-10 11:43:57 +05:30
Xiao Chen a6146a1026 HDFS-11120. TestEncryptionZones should waitActive. Contributed by John Zhuge. 
(cherry picked from commit 907b1431c0ead934e26cf7dbc51bfab5d7cc5ddc)
 2016-11-09 17:16:31 -08:00
Jian He a422740bd7 YARN-5611. Provide an API to update lifetime of an application. Contributed by Rohith Sharma K S 2016-11-09 16:39:46 -08:00
Naganarasimha 8a2998c08c YARN-4498. Application level node labels stats to be available in REST (addendum patch). Contributed by Bibin A Chundatt. 2016-11-10 05:21:07 +05:30
Wei-Chiu Chuang 16430c64b7 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-09 13:28:16 -08:00
Daniel Templeton 42147bbbf7 YARN-4329. [YARN-5437] Allow fetching exact reason as to why a submitted app 
is in ACCEPTED state in Fair Scheduler (Contributed by Yufei Gu)

(cherry picked from commit 59ee8b7a88)
 2016-11-09 13:18:28 -08:00
Xiao Chen ede909144d HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception. 
(cherry picked from commit 367c3d4121)
 2016-11-09 09:09:13 -08:00
Arun Suresh 4a023b4414 YARN-5833. Addendum patch to include missing changes to yarn-default.xml 
(cherry picked from commit 280357c29f)
 2016-11-09 07:16:39 -08:00
Brahma Reddy Battula 53ff3c9e03 HDFS-9482. Replace DatanodeInfo constructors with a builder pattern. Contributed by Brahma Reddy Battula. 2016-11-09 09:58:36 +05:30
Mingliang Liu f5c9f9f1b2 HDFS-11083. Add unit test for DFSAdmin -report command. Contributed by Xiaobing Zhou 
(cherry picked from commit 62d8c17dfd)
 2016-11-08 17:05:34 -08:00
Subru Krishnan 6685a0a064 YARN-5833. Addendum patch to fix JDK7 compile issue. 2016-11-08 16:54:19 -08:00
Andrew Wang 4f25fd975e HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey. 
(cherry picked from commit e1c6ef2efa)
 2016-11-08 16:33:58 -08:00
Zhe Zhang 758638d08d HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen. 
(cherry picked from commit 77c13c3857)
 2016-11-08 16:08:03 -08:00
Mingliang Liu 38b1ed18ef HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn 
(cherry picked from commit 2a65eb121e)
 2016-11-08 15:40:54 -08:00
Subru Krishnan 797c7bfab9 YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru). 
(cherry picked from commit 29e3b3417c)
 2016-11-08 14:39:09 -08:00
Jason Lowe 8bb264c70d YARN-5356. NodeManager should communicate physical resource capability to ResourceManager. Contributed by Inigo Goiri 
(cherry picked from commit 3f93ac0733)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/monitor/ContainersMonitorImpl.java
 2016-11-08 22:16:53 +00:00
Arpit Agarwal b77239b46d Revert "HDFS-11114. Support for running async disk checks in DataNode." 
This reverts commit 732eaadddb.
 2016-11-08 09:04:58 -08:00
Varun Saxena a942d968c9 MAPREDUCE-6782. JHS task page search based on each individual column not working (Ajith S via Varun Saxena) 
(cherry picked from commit 026b39ad9d)
 2016-11-08 15:02:46 +05:30
Arpit Agarwal 732eaadddb HDFS-11114. Support for running async disk checks in DataNode. 
This closes #153.
 2016-11-07 18:46:37 -08:00
Zhe Zhang b245e9ce2f HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen. 
(cherry picked from commit 3dbad5d823)
 2016-11-07 16:11:27 -08:00
Jian He 6cdcab9078 YARN-5716. Add global scheduler interface definition and update CapacityScheduler to use it. Contributed by Wangda Tan 2016-11-07 10:31:43 -08:00
Steve Loughran 29c6a0be0d HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt 2016-11-07 12:36:25 +00:00
Akira Ajisaka 3b279fe426 HADOOP-13798. TestHadoopArchives times out. 
(cherry picked from commit b970446b2c)
 2016-11-07 19:54:50 +09:00
Xiao Chen f30d338766 HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu. 
(cherry picked from commit d8bab3dcb6)
 2016-11-04 18:08:46 -07:00
Xiaoyu Yao 9628f3da93 Revert "HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao." 
This reverts commit 874402a295.
 2016-11-04 16:06:20 -07:00
Jason Lowe 27ed2c526a YARN-5837. NPE when getting node status of a decommissioned node after an RM restart. Contributed by Robert Kanter 
(cherry picked from commit 6bb741ff0e)
 2016-11-04 22:21:45 +00:00
Mingliang Liu 4cee535aa5 HDFS-11085. Add unit test for NameNode failing to start when name dir is unwritable. Contributed by Xiaobing Zhou 
(cherry picked from commit 0c0ab102ab)
 2016-11-04 14:39:54 -07:00
Robert Kanter 0b36dcda7c HADOOP-7930. Kerberos relogin interval in UserGroupInformation should be configurable (xiaochen via rkanter) 2016-11-04 09:24:21 -07:00
Sunil 3eed75a9ab YARN-5802. updateApplicationPriority api in scheduler should ensure to re-insert app to correct ordering policy. Contributred by Bibin A Chundatt 
(cherry picked from commit 19b3779ae7)
 2016-11-04 17:09:19 +05:30