Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,119 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17119 Commits

Author SHA1 Message Date
Zhankun Tang df2ae271cc YARN-9584. Should put initializeProcessTrees method call before get pid. Contributed by Wanqiang Ji. 
(cherry picked from commit 67414a1a80)
 2019-06-18 13:26:48 +08:00
Yufei Gu c25427ceca YARN-7290. Method canContainerBePreempted can return true when it shouldn't. (Contributed by Steven Rand) 
(cherry picked from commit 2bde3aedf1)
(cherry picked from commit f335d509d3)
 2017-12-08 11:00:22 -08:00
Sunil G 0510ceede6 YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne. 
(cherry picked from commit 61ace174cd)
(cherry picked from commit c3fb49667a)
 2017-12-08 10:59:09 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) b1712f9c1f HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades. 
(cherry picked from commit f19638333b)
 2017-12-08 08:03:58 -08:00
Kai Zheng c27951e98d HADOOP-15104. AliyunOSS: change the default value of max error retry. Contributed by Jinhu Wu 2017-12-08 23:02:17 +08:00
Sammi Chen 6e24fe2998 HADOOP-15024. AliyunOSS: Support user agent configuration and include that & Hadoop version information to oss server. 
(cherry picked from commit abaabb5dec)
 2017-12-08 21:43:05 +08:00
Sammi Chen 1e0f7a1631 HADOOP-14993. AliyunOSS: Override listFiles and listLocatedStatus. Contributed Genmao Yu. 
(cherry picked from commit fb809e05dc)
 2017-12-08 20:44:40 +08:00
Lei Xu e309d25d2b HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 67662e2ac9)
(cherry picked from commit f3143d225a)
 2017-12-07 11:24:24 -08:00
Sammi Chen cb307d5b8e HADOOP-15080. Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x json-lib 2017-12-07 23:11:40 +08:00
Weiwei Yang 7f354097aa YARN-7607. Remove the trailing duplicated timestamp in container diagnostics message. Contributed by Weiwei Yang. 2017-12-07 17:40:16 +08:00
Akira Ajisaka 99bc03f56b
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb)
(cherry picked from commit a8be4b559a)
 2017-12-07 13:24:10 +09:00
Xiao Chen 859f57e32c HDFS-12872. EC Checksum broken when BlockAccessToken is enabled. 
(cherry picked from commit 56b1ff80dd)
 2017-12-05 20:48:53 -08:00
Akira Ajisaka c49b4f7977
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a5)
(cherry picked from commit c81057d936)
 2017-12-06 11:42:12 +09:00
Wangda Tan 243a0812b7 YARN-7381. Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml. (Xuan Gong via wangda) 
Change-Id: I1ed58dafad5cc276eea5c0b0813cf04f57d73a87
(cherry picked from commit 0311cf0535)
 2017-12-05 13:10:36 -08:00
Sean Mackrory c938a54e87 HADOOP-15058. create-release site build outputs dummy shaded jars due to skipShade. Contributed by Andrew Wang. 
(cherry picked from commit 5533648241)
(cherry picked from commit 486311cdc4)
 2017-12-04 15:45:37 -07:00
Chris Douglas 0d41249bec HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 42307e3c3a)
(cherry picked from commit 2399c96ee7)
 2017-12-02 23:32:59 -08:00
Jason Lowe 419a83e133 YARN-7589. TestPBImplRecords fails with NullPointerException. Contributed by Daniel Templeton 
(cherry picked from commit 25df505421)
(cherry picked from commit f222b9d362)
 2017-12-01 14:27:54 -08:00
Chris Douglas 60adf0b8bd Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak" 
This reverts commit be664bd64d.
 2017-12-01 11:19:25 -08:00
Chris Douglas be664bd64d HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 5304698dc8)
(cherry picked from commit 482fd5a880)
 2017-12-01 10:35:31 -08:00
Robert Kanter 7dd435cd81 HADOOP-13493. Compatibility Docs should clarify the policy for what takes precedence when a conflict is found (templedf via rkanter) 
(cherry picked from commit 75a3ab88f5)
(cherry picked from commit 2c2ff7da05)
 2017-11-30 09:27:12 -08:00
Daniel Templeton 9de795f12a YARN-7541. Node updates don't update the maximum cluster capability for resources other than CPU and memory 
(cherry picked from commit 8498d287cd)
(cherry picked from commit 0e73efb1ad68398ce5f7cde51466cea8c2153659)
 2017-11-30 09:26:46 -08:00
Wangda Tan 60b35eccfd YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda) 
Change-Id: I8a6d821abb2fe32a93cc88658ed95094e79e3e8b
 2017-11-29 16:08:37 -08:00
Kihwal Lee 2e1532a712 HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b)
 2017-11-29 15:13:49 -06:00
Jason Lowe e03725c262 YARN-6647. RM can crash during transitionToStandby due to InterruptedException. Contributed by Bibin A Chundatt 
(cherry picked from commit a2c7a73e33)
 2017-11-28 11:26:47 -06:00
Xiao Chen b9239e0b79 HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev. 
(cherry picked from commit d162252d7a)
 2017-11-23 09:02:15 -08:00
Daniel Templeton d7c9b58ec7 HADOOP-14876. Create downstream developer docs from the compatibility guidelines 
(cherry picked from commit bfd588789a879b8583ea4abd59f4f5843c5ac285)
(cherry picked from commit 4a70e75386)
 2017-11-22 12:27:37 -08:00
Kihwal Lee 6c633e64a0 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 
(cherry picked from commit 738d1a206a)
 2017-11-22 14:20:44 -06:00
Lei Xu 781c01aa2c HDFS-12847. Regenerate editsStored and editsStored.xml in HDFS tests. Contributed by Lei (Eddy) Xu. 2017-11-22 10:23:25 -08:00
Varun Vasudev 098eb777cf YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang. 
(cherry picked from commit 5f0b238a11)
(cherry picked from commit 6681e7238b)
 2017-11-22 20:50:35 +05:30
Andrew Wang 3853c33466 Update maven versions in preparation for 3.0.0 release. 2017-11-14 11:12:22 -08:00
Andrew Wang 3f96ecf5c3 HADOOP-15037. Add site release notes for OrgQueue and resource types. 
(cherry picked from commit 8b12574165)
 2017-11-13 18:49:50 -08:00
Junping Du ef212b8550 YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi. 
(cherry picked from commit e14f03dfbf)
 2017-11-13 15:28:21 -08:00
Wangda Tan 7b3cd10131 YARN-6909. Use LightWeightedResource when number of resource types more than two. (Sunil G via wangda) 
Change-Id: I90e021c5dea7abd9ec6bd73b2287c8adebe14595
 2017-11-13 14:45:40 -08:00
Arun Suresh cb48eea922 HADOOP-15036. Update LICENSE.txt for HADOOP-14840. (asuresh) 
(cherry picked from commit f871b7541a)
 2017-11-13 14:38:05 -08:00
Arun Suresh f6de2b741e Addendum patch for Configuration fix. (Jason Lowe via asuresh) 
(cherry picked from commit b07e68b02a)
 2017-11-13 14:05:41 -08:00
Daniel Templeton c2f479c248 YARN-7369. Improve the resource types docs 2017-11-13 11:08:58 -08:00
Daniel Templeton 5b55a74bad YARN-7442. [YARN-7069] Limit format of resource type name (Contributed by Wangda Tan via Daniel Templeton) 
(cherry picked from commit 2c6213a44280f5b3950167131293ff83f48ff56f)
 2017-11-13 11:03:56 -08:00
Xiaoyu Yao f90f772384 HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen. 
(cherry picked from commit 59d78a5088)
 2017-11-12 19:44:18 -08:00
Anu Engineer ba4355a62f HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru. 
(cherry picked from commit e1b32e0959)
 2017-11-12 19:44:18 -08:00
Subru Krishnan 37ae818660 YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). 
(cherry picked from commit 3c5b46c2ed)
(cherry picked from commit 3e26077848)
 2017-11-12 09:54:55 -08:00
bibinchundatt bfbf94197f YARN-7406. Moving logging APIs over to slf4j in hadoop-yarn-api. Contributed by Yeliang Cang. 
(cherry picked from commit 2c2b7a3672)
 2017-11-11 10:38:47 +05:30
Chris Douglas 7f80c2f293 HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when finish() and resetState() are used. Contributed by Mike Percy 
(cherry picked from commit 796a0d3a5c)
 2017-11-10 17:45:15 -08:00
Xiao Chen 65d7968afd HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev. 
(cherry picked from commit 3c6adda291)
 2017-11-09 21:06:43 -08:00
Arun Suresh 72d7bedac9 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 
(cherry picked from commit 5eb7dbe9b3)
 2017-11-09 15:16:55 -08:00
Sean Mackrory abaf90792e YARN-7465. start-yarn.sh fails to start ResourceManagers unless running as root. 
(cherry picked from commit 1883a00249)
 2017-11-09 14:49:54 -07:00
Daniel Templeton 38f5d4cbba YARN-7413. Support resource type in SLS (Contributed by Yufei Gu via Daniel Templeton) 
Change-Id: Ic0a897c123c5d2f57aae757ca6bcf1dad7b90d2b
(cherry picked from commit ba8136615a)
 2017-11-09 13:39:08 -08:00
Yufei Gu ddef7d05a4 YARN-6505. Define the strings used in SLS JSON input file format. (Contributed by Gergely Novak) 
(cherry picked from commit 99880d0a16)
 2017-11-09 13:38:57 -08:00
Konstantinos Karanasos e55dc1700d YARN-7437. Rename PlacementSet and SchedulingPlacementSet. (Wangda Tan via kkaranasos) 
(cherry picked from commit ac4d2b1081)
 2017-11-09 13:07:10 -08:00
Robert Kanter 82abc7224f YARN-7386. Duplicate Strings in various places in Yarn memory (misha@cloudera.com via rkanter) 
(cherry picked from commit a2c150a736)
 2017-11-09 12:13:09 -08:00
Daniel Templeton 933a09e886 YARN-7143. FileNotFound handling in ResourceUtils is inconsistent 
Change-Id: Ib1bb487e14a15edd2b5a42cf5078c5a2b295f069
(cherry picked from commit db82a41d94872cea4d0c1bb1336916cebc2faeec)
 2017-11-09 11:59:16 -08:00