Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,449 Commits 326 Branches 371 Tags
Commit Graph

12449 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Varun Saxena
6cb1fda99d YARN-5891. yarn rmadmin -help contains a misspelled ResourceManager (Grant Sohn via Varun Saxena) 
(cherry picked from commit 6a11877ab5b4e81769dc097e91198abd994d103f)
 2016-11-17 03:28:08 +05:30
Arpit Agarwal
da8c24bbad HDFS-11114. Support for running async disk checks in DataNode. 2016-11-16 13:38:15 -08:00
Mingliang Liu
57a0f84860 HDFS-11105. TestRBWBlockInvalidation#testRWRInvalidation fails intermittently. Contributed by Yiqun Lin 
(cherry picked from commit c90891e7b3afaa66dbca967b83a9997e80e893d8)
 2016-11-16 13:06:25 -08:00
Varun Saxena
bcfa6d5384 MAPREDUCE-6811. TestPipeApplication#testSubmitter fails after HADOOP-13802 (Brahma Reddy Battula via Varun Saxena) 
(cherry picked from commit b8690a9d25cb212d53a92bfa1f76a33b8c74413c)
 2016-11-17 00:55:12 +05:30
Varun Saxena
2893316dd0 YARN-5843. Incorrect documentation for timeline service entityType/events REST end points (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit c8bc7a84758f360849b96c2e19c8c41b7e9dbb65)
 2016-11-17 00:52:08 +05:30
Jason Lowe
41f8275c50 MAPREDUCE-6804. Add timeout when starting JobHistoryServer in MiniMRYarnCluster. Contributed by Andras Bokor 2016-11-16 15:26:19 +00:00
Rohith Sharma K S
74ac78b3c0 YARN-5375. invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures. Contributed by sandflee. 
(cherry picked from commit d65603517e52843f11cd9d3b6f6e28fca9336ee3)
 2016-11-16 15:17:46 +05:30
Xiao Chen
efc9ffc3b6 HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk. 
(cherry picked from commit 61c0bedf775e6e794d4704485ec2c41a95aecae9)
 2016-11-15 16:26:49 -08:00
Xiao Chen
3497221fcc YARN-5875. TestTokenClientRMService#testTokenRenewalWrongUser fails. Contributed by Gergely Novák. 
(cherry picked from commit d5c396ccb361e1a0cf4307ce1d1b37fae0eec250)
 2016-11-15 13:58:02 -08:00
Kihwal Lee
f08e227671 HDFS-8870. Lease is leaked on write failure. Contributed by Kuhu Shukla. 
(cherry picked from commit 4fcea8a0c8019d6d9a5e6f315c83659938b93a40)
 2016-11-15 14:51:34 -06:00
Mingliang Liu
4e0fcff8ab HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu 
(cherry picked from commit 5af572b6443715b7a741296c1bd520a1840f9a7c)
 2016-11-15 11:36:08 -08:00
Naganarasimha
260f3a9dc9 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung. 
(cherry picked from commit 7ffb9943b8838a3bb56684e0722db40d800743a2)
 2016-11-15 15:44:25 +05:30
Naganarasimha
7e9a6b653e Reverting the patch due to the issue raised in YARN-5765 
Revert "YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang."

This reverts commit 93b768d0d16ea7d1123905e38f8a93430d0e70db.
 2016-11-15 11:05:03 +05:30
Rohith Sharma K S
528ef2407c YARN-5874. RM -format-state-store and -remove-application-from-state-store commands fail with NPE. Contributed by Varun Saxena. 
(cherry picked from commit b7070f3308fc4c6a8a9a25021562169cae87d223)
 2016-11-15 11:03:38 +05:30
Rohith Sharma K S
fad6de3080 YARN-5873. RM crashes with NPE if generic application history is enabled. Contributed by Varun Saxena. 
(cherry picked from commit 296c5de0cfee88389cf9f90263280b2034e54cd5)
 2016-11-15 11:03:27 +05:30
Mingliang Liu
0b428075a2 HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran 
This closes #158

(cherry picked from commit 04014c4c739bb4e3bc3fdf9299abc0f47521e8fd)
 2016-11-14 19:41:32 -08:00
Zhe Zhang
818915aabb HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 16:33:15 -08:00
Jason Lowe
5ffb26c2a9 MAPREDUCE-6797. Job history server scans can become blocked on a single, slow entry. Contributed by Prabhu Joseph 
(cherry picked from commit 99c2bbd337942e4bc7b246a88dff53f98e530651)
 2016-11-14 20:30:36 +00:00
Brahma Reddy Battula
399abe7c74 HDFS-11135. The tests in TestBalancer run fails due to NPE. Contributed By Yiqun Lin 
(cherry picked from commit 6efb8c9c6018ec688eeba8c61c220009ec350a44)
 2016-11-14 20:41:55 +05:30
Karthik Kambatla
ea74c7b7ae YARN-4033. In FairScheduler, parent queues should also display queue status. (Siqi Li via kasha) 
(cherry picked from commit 79448d4ab1f298e50565b161e6605d994ee5e058)
 2016-11-13 21:39:44 -08:00
Erik Krogen
98d9e9c4c8 HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 2016-11-13 14:50:33 -08:00
Mingliang Liu
fb3a5085e8 HADOOP-13813. TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing. Contributed by Mingliang Liu 2016-11-12 10:36:14 -08:00
Mingliang Liu
685d753d07 HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. Contributed by Brahma Reddy Battula 
(cherry picked from commit 2ee18fc15e60dff9a42a80eb0c30e8bd8cedc26a)
 2016-11-11 22:16:05 -08:00
Jian He
9b0a2cb321 YARN-5825. ProportionalPreemptionalPolicy should use readLock over LeafQueue instead of synchronized block. Contributed by Sunil G 
(cherry picked from commit fad9609d13e76e9e3a4e01c96f698bb60b03807e)
 2016-11-11 15:16:43 -08:00
Xiaoyu Yao
5613b0818c HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498b2ab2a40a404c487c7a4e875df10dc)
 2016-11-11 14:31:54 -08:00
Wangda Tan
a76e214556 YARN-5552. Add Builder methods for common yarn API records. (Tao Jie via wangda) 
(cherry picked from commit ede1a473f5061cf40f6affc1c8c30a645c1fef6c)
 2016-11-11 13:42:45 -08:00
Mingliang Liu
289f03e49e HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. Contributed by Yiqun Lin 
(cherry picked from commit aa6010ccca3045ce9f0bb819fb2cb7ff65e1822b)
 2016-11-11 12:30:22 -08:00
Naganarasimha
bde95f90e7 YARN-5545, Fix issues related to Max App in capacity scheduler. Contributed by Bibin A Chundatt 2016-11-12 00:52:35 +05:30
Brahma Reddy Battula
b51806b45f HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru. 
(cherry picked from commit 1ae57f0f75695178dc135b0c259d066f7da31c9d)
 2016-11-11 20:09:49 +05:30
Yongjun Zhang
c684a00ed3 HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang. 
(cherry picked from commit fd2f22adec5c2f21f792045dbfde9385c21403ec)
 2016-11-10 23:06:09 -08:00
Eric Payne
dd5b9dabf9 YARN-4218. Metric for resource*time that was preempted. Contributed by Chang Li. 2016-11-10 23:02:42 +00:00
Karthik Kambatla
f4c8dc4783 YARN-5834. TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value. (Chang Li via kasha) 
(cherry picked from commit 3a98419532687e4362ffc26abbc1264232820db7)
 2016-11-10 14:09:33 -08:00
Mingliang Liu
d064d5dbb2 HADOOP-13687. Provide a unified dependency artifact that transitively includes the cloud storage modules shipped with Hadoop. Contributed by Chris Nauroth 
(cherry picked from commit 89354f0475efa8e393697b1ddc227c94a76b5923)
 2016-11-10 08:59:07 -08:00
Karthik Kambatla
f7b25420a1 YARN-5453. FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource. (sandflee via kasha) 
(cherry picked from commit 86ac1ad9fd65c7dd12278372b369de38dc4616db)
 2016-11-09 23:44:26 -08:00
Varun Saxena
06c8ebdb83 YARN-5862. TestDiskFailures.testLocalDirsFailures failed (Yufei Gu via Varun Saxena) 
(cherry picked from commit c202a10923a46a6e7f7f518e6e3dbb6545dbb971)
 2016-11-10 11:43:57 +05:30
Xiao Chen
a6146a1026 HDFS-11120. TestEncryptionZones should waitActive. Contributed by John Zhuge. 
(cherry picked from commit 907b1431c0ead934e26cf7dbc51bfab5d7cc5ddc)
 2016-11-09 17:16:31 -08:00
Jian He
a422740bd7 YARN-5611. Provide an API to update lifetime of an application. Contributed by Rohith Sharma K S 2016-11-09 16:39:46 -08:00
Naganarasimha
8a2998c08c YARN-4498. Application level node labels stats to be available in REST (addendum patch). Contributed by Bibin A Chundatt. 2016-11-10 05:21:07 +05:30
Wei-Chiu Chuang
16430c64b7 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-09 13:28:16 -08:00
Daniel Templeton
42147bbbf7 YARN-4329. [YARN-5437] Allow fetching exact reason as to why a submitted app 
is in ACCEPTED state in Fair Scheduler (Contributed by Yufei Gu)

(cherry picked from commit 59ee8b7a88603e94b5661a8d5d088f7aa99fe049)
 2016-11-09 13:18:28 -08:00
Xiao Chen
ede909144d HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception. 
(cherry picked from commit 367c3d41217728c2e61252c5a5235e5bc1f9822f)
 2016-11-09 09:09:13 -08:00
Arun Suresh
4a023b4414 YARN-5833. Addendum patch to include missing changes to yarn-default.xml 
(cherry picked from commit 280357c29f867e3ef6386ea5bd0f7b7ca6fe04eb)
 2016-11-09 07:16:39 -08:00
Brahma Reddy Battula
53ff3c9e03 HDFS-9482. Replace DatanodeInfo constructors with a builder pattern. Contributed by Brahma Reddy Battula. 2016-11-09 09:58:36 +05:30
Mingliang Liu
f5c9f9f1b2 HDFS-11083. Add unit test for DFSAdmin -report command. Contributed by Xiaobing Zhou 
(cherry picked from commit 62d8c17dfda75a6a6de06aedad2f22699a1cbad6)
 2016-11-08 17:05:34 -08:00
Subru Krishnan
6685a0a064 YARN-5833. Addendum patch to fix JDK7 compile issue. 2016-11-08 16:54:19 -08:00
Andrew Wang
4f25fd975e HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey. 
(cherry picked from commit e1c6ef2efa9d87fdfc7474ca63998a13a3929874)
 2016-11-08 16:33:58 -08:00
Zhe Zhang
758638d08d HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen. 
(cherry picked from commit 77c13c385774c51766fe505397fa916754ac08d4)
 2016-11-08 16:08:03 -08:00
Mingliang Liu
38b1ed18ef HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn 
(cherry picked from commit 2a65eb121e23243fcb642d28b3f74241536485d8)
 2016-11-08 15:40:54 -08:00
Subru Krishnan
797c7bfab9 YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru). 
(cherry picked from commit 29e3b3417c16c83dc8e753f94d7ca9957dddbedd)
 2016-11-08 14:39:09 -08:00
Jason Lowe
8bb264c70d YARN-5356. NodeManager should communicate physical resource capability to ResourceManager. Contributed by Inigo Goiri 
(cherry picked from commit 3f93ac0733058238a2c8f23960c986c71dca0e02)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/monitor/ContainersMonitorImpl.java
 2016-11-08 22:16:53 +00:00