Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,190 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

14190 Commits

Author SHA1 Message Date
Wei Yan 17289ca677 YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat. 
(cherry picked from commit 333ef303ff)
 2017-11-29 14:48:19 -08:00
Kihwal Lee 7d2b13f0be HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b)
 2017-11-29 15:16:17 -06:00
Wei Yan 5e31b109c6 HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d)
 2017-11-29 09:49:51 -08:00
Konstantin V Shvachko 3f9f0055eb HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24)
 2017-11-28 18:11:38 -08:00
Yiqun Lin 83c40758fa HDFS-12858. RBF: Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin. 
(cherry picked from commit 3d73d2f097)
 2017-11-28 13:46:02 +08:00
Kihwal Lee 3516ef45f3 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 
(cherry picked from commit 45f59bde60)
 2017-11-27 17:01:34 -06:00
Sammi Chen b756beb679 HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2. Contributed by Sammi Chen. 
The consolidated commits in this backport are as follows:
        HADOOP-14787. AliyunOSS: Implement the `createNonRecursive` operator.
        HADOOP-14649. Update aliyun-sdk-oss version to 2.8.1. (Genmao Yu via rchiang)
        HADOOP-14194. Aliyun OSS should not use empty endpoint as default. Contributed by Genmao Yu
        HADOOP-14466. Remove useless document from TestAliyunOSSFileSystemContract.java. Contributed by Chen Liang.
        HADOOP-14458. Add missing imports to TestAliyunOSSFileSystemContract.java. Contributed by Mingliang Liu.
        HADOOP-14192. AliyunOSS FileSystem contract test should implement getTestBaseDir(). Contributed by Mingliang Liu
        HADOOP-14072. AliyunOSS: Failed to read from stream when seek beyond the download size. Contributed by Genmao Yu
        HADOOP-13769. AliyunOSS: update oss sdk version. Contributed by Genmao Yu
        HADOOP-14069. AliyunOSS: listStatus returns wrong file info. Contributed by Fei Hui
        HADOOP-13768. AliyunOSS: handle the failure in the batch delete operation `deleteDirs`. Contributed by Genmao Yu
        HADOOP-14065. AliyunOSS: oss directory filestatus should use meta time. Contributed by Fei Hui
        HADOOP-14045. Aliyun OSS documentation missing from website. Contributed by Yiqun Lin.
        HADOOP-13723. AliyunOSSInputStream#read() should update read bytes stat correctly. Contributed by Mingliang Liu
        HADOOP-13624.  Rename TestAliyunOSSContractDispCp. Contributed by Genmao Yu
        HADOOP-13591. Unit test failure in TestOSSContractGetFileStatus and TestOSSContractRootDir. Contributed by Genmao Yu
        HADOOP-13481. User documents for Aliyun OSS FileSystem. Contributed by Genmao Yu.
        HADOOP-12756. Incorporate Aliyun OSS file system implementation. Contributed by Mingfei Shi and Lin Zhou

 (cherry picked from commit 30ab9b6aef)
 2017-11-27 11:35:17 +08:00
Sammi Chen 12901cdcee Revert "HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches. Contributed by Sammi Chen." 
This reverts commit 32a88442d0.
 2017-11-27 10:46:15 +08:00
Sammi Chen 32a88442d0 HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches. Contributed by Sammi Chen. 2017-11-24 14:06:01 +08:00
Haibo Chen c08a0bcad8 YARN-7390. All reservation related test cases failed when TestYarnClient runs against Fair Scheduler. 
(cherry picked from commit db2651cc9d)
 2017-11-21 13:29:00 -08:00
Akira Ajisaka 6388273539
HADOOP-15045. ISA-L bulid options are documented in branch-2. 
(cherry picked from commit 4eb4f37bcf)
 2017-11-21 13:52:24 +09:00
Subru Krishnan a6db6c9855 YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru). 
(cherry picked from commit ed31091361)
 2017-11-20 14:22:59 -08:00
bibinchundatt 49ba091f71 YARN-7525. Incorrect query parameters in cluster nodes REST API document. Contributed by Tao Yang. 
(cherry picked from commit ea8a121423)
 2017-11-21 00:32:49 +05:30
bibinchundatt dc4132395e YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. Contributed by Tao Yang. 
(cherry picked from commit 5c2986e58d)
 2017-11-20 23:29:14 +05:30
Inigo Goiri ee267565b5 HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri. 
(cherry picked from commit e182e77794)
 2017-11-17 10:06:46 -08:00
Sunil G 9eab9a25c6 YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne. 
(cherry picked from commit 61ace174cd)
 2017-11-17 19:42:00 +05:30
Varun Vasudev f23f49d4ee YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang. 
(cherry picked from commit 5f0b238a11)
(cherry picked from commit 9cf9627e20)
 2017-11-17 12:05:55 +05:30
Jason Lowe e4344d45cb YARN-7361. Improve the docker container runtime documentation. Contributed by Shane Kumpf 
(cherry picked from commit fac72eef23)
 2017-11-15 12:34:22 -06:00
Junping Du 9229fb3523 YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi. 
(cherry picked from commit a72dcb9cad)
 2017-11-14 12:50:21 -08:00
Arun Suresh 12bd1aaac5 HADOOP-15036. Update LICENSE.txt for HADOOP-14840. (asuresh) 
(cherry picked from commit f871b7541a)
 2017-11-13 14:38:32 -08:00
Arun Suresh ed0658a579 Addendum patch for Configuration fix. (Jason Lowe via asuresh) 
(cherry picked from commit 4e847d63a3)
 2017-11-13 13:50:44 -08:00
Arun Suresh 238a70c6c3 YARN-5049. Addendum patch for branch-2. (asuresh) 
(cherry picked from commit c153bed6e3)
 2017-11-12 10:17:01 -08:00
Eric Yang 45c5b7f71d YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger) 
(cherry picked from commit 7a49ddfdde)
(cherry picked from commit 90ac8cd5a1)
 2017-11-12 10:13:49 -08:00
Subru Krishnan 8bcd1d62c8 YARN-7476. Fix miscellaneous issues in ATSv2 after merge to branch-2. (Varun Saxena via Subru). 
(cherry picked from commit 0282efab14)
 2017-11-12 09:25:12 -08:00
Subru Krishnan 8251601003 YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). 
(cherry picked from commit 3c5b46c2ed)
 2017-11-12 09:25:12 -08:00
Arun Suresh 45aabb3c8d YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh) 
(cherry picked from commit 5cd92ed555)
 2017-11-11 09:11:43 -08:00
Subru Krishnan b35c5ba472 HADOOP-15030. [branch-2] Include hadoop-cloud-storage-project in the main hadoop pom modules. 
(cherry picked from commit 132c2e7a2a)
 2017-11-10 13:52:39 -08:00
Arun Suresh dc65df2a1a YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh) 
(cherry picked from commit 0411c710d2)
 2017-11-10 13:45:14 -08:00
Arun Suresh d754b24738 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 
(cherry picked from commit 7af9b8ad1e)
 2017-11-09 15:17:59 -08:00
Haibo Chen 288d9506f0 YARN-7388. TestAMRestart should be scheduler agnostic. 
(cherry picked from commit a1382a18df)
(cherry picked from commit 91a7f8d246)
(cherry picked from commit 3fbe67d3e1)
 2017-11-09 11:02:05 -08:00
John Zhuge 120d868963 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend. 
(cherry picked from commit 3123895db0)
 2017-11-09 09:18:53 -08:00
Subru Krishnan 26110ec335 HADOOP-15026. Rebase ResourceEstimator start/stop scripts for branch-2. (Rui Li via Subru). 
(cherry picked from commit 5991c218a0)
 2017-11-09 00:33:23 -08:00
Subru Krishnan d45672a144 HADOOP-15025. Ensure singleton for ResourceEstimatorService. (Rui Li via Subru). 
(cherry picked from commit f2df6b8983)
(cherry picked from commit 46a740a82e)
 2017-11-08 18:11:32 -08:00
Arun Suresh 1ddd0a7958 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh) 
(cherry picked from commit a9c70b0e84)
(cherry picked from commit 5486542074)
 2017-11-08 08:08:26 -08:00
Brahma Reddy Battula ce027c6f48 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 
(cherry picked from commit 410d0319cf)
 2017-11-08 14:46:27 +05:30
Brahma Reddy Battula 53891b7f8f HDFS-12783. [branch-2] dfsrouter should use hdfsScript. Contributed by Brahma Reddy Battula 
(cherry picked from commit 135abcac4b)
 2017-11-08 10:19:58 +05:30
Subru Krishnan 8746a65e78 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure. 
(cherry picked from commit 0542e6f86e)
 2017-11-03 11:15:48 -07:00
Arun Suresh bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Inigo Goiri 6f5a95ff98 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri. 
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
 2017-11-02 21:35:45 -07:00
Subru Krishnan a60bb3b36f YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru). 
(cherry picked from commit ad0fff2b41)
 2017-11-02 17:42:38 -07:00
Arun Suresh e44ff3f60a HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh) 
(cherry picked from commit 53c0fb7efe)
 2017-11-02 17:21:57 -07:00
Eric Payne 9a61d12c03 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák. 
(cherry picked from commit e6ec02001f)
 2017-11-02 13:09:27 -05:00
Wangda Tan 7a658363d9 YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda) 
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
(cherry picked from commit 752f000e0f)
 2017-11-02 09:53:20 -07:00
Jason Lowe cfef479b73 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger 
(cherry picked from commit b7dee1f060)
(cherry picked from commit 6ad6882343)
 2017-11-02 11:02:37 -05:00
Arun Suresh da6ea5c144 Add missing 2.8.2 jdiff for YARN API 2017-11-02 07:09:54 -07:00
Akira Ajisaka 05b7b3d126
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi. 
(cherry picked from commit cc3f3eca40)
(cherry picked from commit 82fc80a987)
 2017-11-02 18:34:46 +09:00
Rohith Sharma K S 6005f0a3ee addendum patch for YARN-7289. 
(cherry picked from commit 940ffe3f9c)
 2017-11-02 14:11:33 +05:30
Weiwei Yang 3555397179 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b0670)
(cherry picked from commit 0f20434e18)
 2017-11-01 18:13:28 -07:00
Junping Du d1accde1cd YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong. 
(cherry picked from commit d57dba9942)
(cherry picked from commit d1f8854a1b)
 2017-11-01 15:01:55 -07:00
Haibo Chen 955f3c30e4 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen) 
(cherry picked from commit d7f3737f3b)
(cherry picked from commit 32a712a740)
 2017-11-01 14:22:53 -07:00