Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,960 Commits 326 Branches 371 Tags
Commit Graph

12960 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
d29e3d0f52 HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka. 
(cherry picked from commit c65d6b65415742288b53f8e38314b71794e47ecc)
 2016-11-21 11:28:33 +09:00
Varun Saxena
ca3b40306b MAPREDUCE-6801. Fix flaky TestKill.testKillJob (Haibo Chen via Varun Saxena) 
(cherry picked from commit 7584fbf4cbafd34fac4b362cefe4e06cec16a2af)
 2016-11-19 01:39:47 +05:30
Wei-Chiu Chuang
c5a3ec493b YARN-5271. ATS client doesn't work with Jersey 2 on the classpath. Contributed by Weiwei Yang. 
(cherry picked from commit 09520cb439f8b002e3f2f3d8f5080ffc34f4bd5c)
 2016-11-17 22:23:58 -06:00
Subru Krishnan
e5a5a5a618 YARN-5904. Reduce the number of default server threads for AMRMProxyService. 
(cherry picked from commit 140b9939da71ec51c178162501740a429b344cac)
 2016-11-17 18:27:17 -08:00
Junping Du
a8ad6b6171 YARN-3538. TimelineWebService doesn't catch runtime exception. Contributed by Steve Loughran and Tsuyoshi Ozawa. 
(cherry picked from commit f05a9ceb4a9623517aa1c8d995805e26ae1bde5a)
 2016-11-17 16:56:21 -08:00
Mingliang Liu
92767f956f HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran 
(cherry picked from commit ae8849fe378e11b9db642ef7784c8e6a08199b96)

This closes #50
 2016-11-17 14:26:44 -08:00
Kihwal Lee
d3fa53a52b HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula. 
(cherry picked from commit bd3735554fa5c3bc064c57ec78f4308430b14b48)
 2016-11-17 12:19:23 -06:00
Brahma Reddy Battula
3e5a85f35e HDFS-11134. Fix bind exception threw in TestRenameWhileOpen. Contributed By Yiqun Lin. 
(cherry picked from commit b2d4b7b1b902aa830d44889d7747a4e1b816ab9d)
 2016-11-17 10:24:21 +05:30
Mingliang Liu
47526a25cc HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula 
(cherry picked from commit aab9737a058c0bdeeb17c173e530b7e571315a56)
 2016-11-16 20:09:07 -08:00
Rohith Sharma K S
bbe993238d YARN-5870. Expose getApplications API in YarnClient with GetApplicationsRequest parameter. Contributed by Jian He. 
(cherry picked from commit ce2847e79441881eeca888b581c7be2cc3ac74f4)
 2016-11-17 08:54:33 +05:30
Jason Lowe
46b7d6233c YARN-5836. Malicious AM can kill containers of other apps running in any node its containers are running. Contributed by Botong Huang 
(cherry picked from commit 59bfcbf3579e45ddf96db3aafccf669c8e03648f)
 2016-11-16 22:25:15 +00:00
Varun Saxena
6cb1fda99d YARN-5891. yarn rmadmin -help contains a misspelled ResourceManager (Grant Sohn via Varun Saxena) 
(cherry picked from commit 6a11877ab5b4e81769dc097e91198abd994d103f)
 2016-11-17 03:28:08 +05:30
Arpit Agarwal
da8c24bbad HDFS-11114. Support for running async disk checks in DataNode. 2016-11-16 13:38:15 -08:00
Mingliang Liu
57a0f84860 HDFS-11105. TestRBWBlockInvalidation#testRWRInvalidation fails intermittently. Contributed by Yiqun Lin 
(cherry picked from commit c90891e7b3afaa66dbca967b83a9997e80e893d8)
 2016-11-16 13:06:25 -08:00
Varun Saxena
bcfa6d5384 MAPREDUCE-6811. TestPipeApplication#testSubmitter fails after HADOOP-13802 (Brahma Reddy Battula via Varun Saxena) 
(cherry picked from commit b8690a9d25cb212d53a92bfa1f76a33b8c74413c)
 2016-11-17 00:55:12 +05:30
Varun Saxena
2893316dd0 YARN-5843. Incorrect documentation for timeline service entityType/events REST end points (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit c8bc7a84758f360849b96c2e19c8c41b7e9dbb65)
 2016-11-17 00:52:08 +05:30
Jason Lowe
41f8275c50 MAPREDUCE-6804. Add timeout when starting JobHistoryServer in MiniMRYarnCluster. Contributed by Andras Bokor 2016-11-16 15:26:19 +00:00
Rohith Sharma K S
74ac78b3c0 YARN-5375. invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures. Contributed by sandflee. 
(cherry picked from commit d65603517e52843f11cd9d3b6f6e28fca9336ee3)
 2016-11-16 15:17:46 +05:30
Xiao Chen
efc9ffc3b6 HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk. 
(cherry picked from commit 61c0bedf775e6e794d4704485ec2c41a95aecae9)
 2016-11-15 16:26:49 -08:00
Xiao Chen
3497221fcc YARN-5875. TestTokenClientRMService#testTokenRenewalWrongUser fails. Contributed by Gergely Novák. 
(cherry picked from commit d5c396ccb361e1a0cf4307ce1d1b37fae0eec250)
 2016-11-15 13:58:02 -08:00
Kihwal Lee
f08e227671 HDFS-8870. Lease is leaked on write failure. Contributed by Kuhu Shukla. 
(cherry picked from commit 4fcea8a0c8019d6d9a5e6f315c83659938b93a40)
 2016-11-15 14:51:34 -06:00
Mingliang Liu
4e0fcff8ab HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu 
(cherry picked from commit 5af572b6443715b7a741296c1bd520a1840f9a7c)
 2016-11-15 11:36:08 -08:00
Naganarasimha
260f3a9dc9 YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung. 
(cherry picked from commit 7ffb9943b8838a3bb56684e0722db40d800743a2)
 2016-11-15 15:44:25 +05:30
Naganarasimha
7e9a6b653e Reverting the patch due to the issue raised in YARN-5765 
Revert "YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang."

This reverts commit 93b768d0d16ea7d1123905e38f8a93430d0e70db.
 2016-11-15 11:05:03 +05:30
Rohith Sharma K S
528ef2407c YARN-5874. RM -format-state-store and -remove-application-from-state-store commands fail with NPE. Contributed by Varun Saxena. 
(cherry picked from commit b7070f3308fc4c6a8a9a25021562169cae87d223)
 2016-11-15 11:03:38 +05:30
Rohith Sharma K S
fad6de3080 YARN-5873. RM crashes with NPE if generic application history is enabled. Contributed by Varun Saxena. 
(cherry picked from commit 296c5de0cfee88389cf9f90263280b2034e54cd5)
 2016-11-15 11:03:27 +05:30
Mingliang Liu
0b428075a2 HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran 
This closes #158

(cherry picked from commit 04014c4c739bb4e3bc3fdf9299abc0f47521e8fd)
 2016-11-14 19:41:32 -08:00
Zhe Zhang
818915aabb HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 16:33:15 -08:00
Jason Lowe
5ffb26c2a9 MAPREDUCE-6797. Job history server scans can become blocked on a single, slow entry. Contributed by Prabhu Joseph 
(cherry picked from commit 99c2bbd337942e4bc7b246a88dff53f98e530651)
 2016-11-14 20:30:36 +00:00
Brahma Reddy Battula
399abe7c74 HDFS-11135. The tests in TestBalancer run fails due to NPE. Contributed By Yiqun Lin 
(cherry picked from commit 6efb8c9c6018ec688eeba8c61c220009ec350a44)
 2016-11-14 20:41:55 +05:30
Karthik Kambatla
ea74c7b7ae YARN-4033. In FairScheduler, parent queues should also display queue status. (Siqi Li via kasha) 
(cherry picked from commit 79448d4ab1f298e50565b161e6605d994ee5e058)
 2016-11-13 21:39:44 -08:00
Erik Krogen
98d9e9c4c8 HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen. 2016-11-13 14:50:33 -08:00
Mingliang Liu
fb3a5085e8 HADOOP-13813. TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing. Contributed by Mingliang Liu 2016-11-12 10:36:14 -08:00
Mingliang Liu
685d753d07 HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. Contributed by Brahma Reddy Battula 
(cherry picked from commit 2ee18fc15e60dff9a42a80eb0c30e8bd8cedc26a)
 2016-11-11 22:16:05 -08:00
Jian He
9b0a2cb321 YARN-5825. ProportionalPreemptionalPolicy should use readLock over LeafQueue instead of synchronized block. Contributed by Sunil G 
(cherry picked from commit fad9609d13e76e9e3a4e01c96f698bb60b03807e)
 2016-11-11 15:16:43 -08:00
Xiaoyu Yao
5613b0818c HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang. 
(cherry picked from commit 4484b48498b2ab2a40a404c487c7a4e875df10dc)
 2016-11-11 14:31:54 -08:00
Wangda Tan
a76e214556 YARN-5552. Add Builder methods for common yarn API records. (Tao Jie via wangda) 
(cherry picked from commit ede1a473f5061cf40f6affc1c8c30a645c1fef6c)
 2016-11-11 13:42:45 -08:00
Mingliang Liu
289f03e49e HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. Contributed by Yiqun Lin 
(cherry picked from commit aa6010ccca3045ce9f0bb819fb2cb7ff65e1822b)
 2016-11-11 12:30:22 -08:00
Naganarasimha
bde95f90e7 YARN-5545, Fix issues related to Max App in capacity scheduler. Contributed by Bibin A Chundatt 2016-11-12 00:52:35 +05:30
Brahma Reddy Battula
b51806b45f HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru. 
(cherry picked from commit 1ae57f0f75695178dc135b0c259d066f7da31c9d)
 2016-11-11 20:09:49 +05:30
Yongjun Zhang
c684a00ed3 HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang. 
(cherry picked from commit fd2f22adec5c2f21f792045dbfde9385c21403ec)
 2016-11-10 23:06:09 -08:00
Eric Payne
dd5b9dabf9 YARN-4218. Metric for resource*time that was preempted. Contributed by Chang Li. 2016-11-10 23:02:42 +00:00
Karthik Kambatla
f4c8dc4783 YARN-5834. TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value. (Chang Li via kasha) 
(cherry picked from commit 3a98419532687e4362ffc26abbc1264232820db7)
 2016-11-10 14:09:33 -08:00
Mingliang Liu
d064d5dbb2 HADOOP-13687. Provide a unified dependency artifact that transitively includes the cloud storage modules shipped with Hadoop. Contributed by Chris Nauroth 
(cherry picked from commit 89354f0475efa8e393697b1ddc227c94a76b5923)
 2016-11-10 08:59:07 -08:00
Karthik Kambatla
f7b25420a1 YARN-5453. FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource. (sandflee via kasha) 
(cherry picked from commit 86ac1ad9fd65c7dd12278372b369de38dc4616db)
 2016-11-09 23:44:26 -08:00
Varun Saxena
06c8ebdb83 YARN-5862. TestDiskFailures.testLocalDirsFailures failed (Yufei Gu via Varun Saxena) 
(cherry picked from commit c202a10923a46a6e7f7f518e6e3dbb6545dbb971)
 2016-11-10 11:43:57 +05:30
Xiao Chen
a6146a1026 HDFS-11120. TestEncryptionZones should waitActive. Contributed by John Zhuge. 
(cherry picked from commit 907b1431c0ead934e26cf7dbc51bfab5d7cc5ddc)
 2016-11-09 17:16:31 -08:00
Jian He
a422740bd7 YARN-5611. Provide an API to update lifetime of an application. Contributed by Rohith Sharma K S 2016-11-09 16:39:46 -08:00
Naganarasimha
8a2998c08c YARN-4498. Application level node labels stats to be available in REST (addendum patch). Contributed by Bibin A Chundatt. 2016-11-10 05:21:07 +05:30
Wei-Chiu Chuang
16430c64b7 HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang. 2016-11-09 13:28:16 -08:00