Commit Graph

4200 Commits

Author SHA1 Message Date
Robert Kanter 101d9005dd HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
(cherry picked from commit 7ab08a9c37)
2018-04-23 15:53:53 -07:00
Jason Lowe 4bff2df137 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie
(cherry picked from commit 766544c0b0)
2018-04-20 13:26:29 -05:00
Sunil G 070bee57a3 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S.
(cherry picked from commit 7d06806dfd)
2018-04-20 00:07:12 +05:30
Shashikant Banerjee 2c4b1c2b15
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247)
2018-04-19 08:36:59 +09:00
Jason Lowe 391ac5cdd2 YARN-7189. Container-executor doesn't remove Docker containers that error out early. Contributed by Eric Badger 2018-04-17 09:45:55 -05:00
Inigo Goiri 688933e6c7 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
(cherry picked from commit dd5e18c4ae)
2018-04-17 15:29:39 +05:30
Rohith Sharma K S 7e37979472 YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
(cherry picked from commit 669eb7bdea)
2018-04-14 11:10:16 +05:30
Jason Lowe d416a0c9b7 YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan 2018-04-12 16:04:20 -05:00
Lei Xu 3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Eric E Payne 43d2ee9de6 YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
(cherry picked from commit 18844599ae)
2018-04-12 18:10:42 +00:00
Eric E Payne 081ea1ec39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
(cherry picked from commit 6bb128dfb8)
2018-04-12 16:22:48 +00:00
Eric Yang f2cf11416c YARN-7810. Update TestDockerContainerRuntime to test with current user credential.
(contributed by Shane Kumpf)

            Cherry-picked from: 59828be197
2018-04-11 20:04:24 -04:00
Vrushali C ec258b8ed1 YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d5)
2018-04-11 09:49:25 +05:30
bibinchundatt 952bb0f371 YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T.
(cherry picked from commit eb47c3de74)
2018-04-08 14:57:11 +05:30
Haibo Chen ca105d1c8e YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 024d7c0870)
(cherry picked from commit b232dcab33)
2018-04-06 09:43:06 -07:00
Haibo Chen 9cb378f5c7 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit f8b8bd53c4)
(cherry picked from commit 6658018410)
2018-04-05 11:38:44 -07:00
Zhe Zhang f3b41bb1ad YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung.
(cherry picked from commit 0b1c2b5fe1)
(cherry picked from commit 0db6b8c93c)
2018-03-28 11:43:34 -07:00
Weiwei Yang bedf30e594 YARN-7734. Fix UT failure TestContainerLogsPage#testContainerLogPageAccess. Contributed by Tao Yang. 2018-03-28 17:44:45 +08:00
Wangda Tan 48778eee52 YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda)
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad)
2018-03-26 11:33:33 -07:00
Wangda Tan a465026207 YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda)
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f8)
2018-03-26 11:33:24 -07:00
Rohith Sharma K S dc02823d2c YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri.
(cherry picked from commit 75fc05f369)
2018-03-23 12:24:38 +05:30
Sunil G 2f6d6cc0d6 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S.
(cherry picked from commit 22c5ddb7c4)
2018-03-23 10:55:46 +05:30
Jason Lowe 8f60b50f28 YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles
(cherry picked from commit 5aa7052e31)
2018-03-21 17:23:01 -05:00
Weiwei Yang 7c286fe804 YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 19:11:54 +08:00
Rohith Sharma K S 117984a2cb YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi.
(cherry picked from commit e6de10d0a6)
2018-03-14 22:14:43 +05:30
Wangda Tan 8034faa888 Updated timeline reader to use AuthenticationFilter
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
2018-03-10 13:36:09 -08:00
Owen O'Malley 0f106df4d6 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
This reverts commit 172b23af33.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
2018-03-10 13:33:52 -08:00
Sen Zhao 4df200bc6d
YARN-7736. Fix itemization in YARN federation document
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc)
2018-03-05 11:55:01 -08:00
Jason Lowe 7c224656ce YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang
(cherry picked from commit 83798f15f8)
2018-03-02 10:03:51 -06:00
Sunil G 09bb378c10 YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne.
(cherry picked from commit bdd2a184d7)
2018-02-21 15:06:28 +05:30
Jason Lowe 85c611ad7d YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne 2018-02-19 14:38:49 -06:00
Rohith Sharma K S 313c38b502 YARN-7937. Fix http method name in Cluster Application Timeout Update API example request. Contributed by Charan Hebri.
(cherry picked from commit 87bdde6943)
2018-02-18 14:06:29 +05:30
Eric Payne 55ded70716 Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit 36c9dda07f.
2018-02-14 14:38:31 -06:00
Eric Payne 36c9dda07f YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue 2018-02-14 08:58:28 -06:00
Anu Engineer 2d6ab20007 HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
(cherry picked from commit 4304fcd5bd)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestGetConf.java

(cherry picked from commit 9264f10bb3)
2018-02-07 11:16:53 -08:00
Billie Rinaldi 0ec45f73a1 Revert "YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi."
This reverts commit ef212b8550.
2018-02-07 07:51:56 -08:00
Billie Rinaldi 615bd15072 YARN-7890. NPE during container relaunch. Contributed by Jason Lowe
(cherry picked from commit a196ee9362)
2018-02-06 11:34:49 -08:00
Lei Xu 7b377f43d0 Preparing for 3.0.2 development 2018-02-06 10:50:37 -08:00
Jason Lowe 07f779483c YARN-7849. TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error. Contributed by Botong Huang
(cherry picked from commit 60656bceca)
2018-02-05 17:17:15 -06:00
Jason Lowe 84297f69d8 Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan"
This reverts commit 874bdbc401.
2018-02-01 12:17:23 -06:00
Jason Lowe 874bdbc401 YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
(cherry picked from commit 12eaae383a)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/DockerLinuxContainerRuntime.java
2018-01-31 11:45:57 -06:00
Sunil G 0463ede09d YARN-7790. Improve Capacity Scheduler Async Scheduling to better handle node failures. Contributed by Wangda Tan.
(cherry picked from commit e9c72d04be)
2018-01-29 20:46:32 +05:30
Jinjiang Ling 1d7e9b9ad8
YARN-7698. A misleading variable's name in ApplicationAttemptEventDispatcher
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3400d0c535)
2018-01-30 00:12:40 +09:00
Jian He 3316779364 YARN-7765. Fixed an issue that kerberos tgt not found when NM posting timeline events. Contributed by Rohith Sharma K S 2018-01-27 22:20:49 -08:00
Jason Lowe 217f408aaa YARN-7102. NM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang
(cherry picked from commit ff8378eb1b)
2018-01-25 17:51:51 -06:00
Sunil G 88bacad50f YARN-7728. Expose container preemptions related information in Capacity Scheduler queue metrics. Contributed by Eric Payne.
(cherry picked from commit 82cc6f6968)
2018-01-25 14:33:42 +05:30
Zhe Zhang 83a4f92a3f YARN-7737. prelaunch.err file not found exception on container failure. Contributed by Keqiu Hu.
(cherry picked from commit fa8cf4d1b4)
2018-01-24 12:57:27 -08:00
Jian He 7598f73320 YARN-7801. AmFilterInitializer should addFilter after fill all parameters. Contributed by Wangda Tan 2018-01-24 11:20:23 -08:00
Sunil G ecfdd01be7 YARN-7806. Distributed Shell should use timeline async api's. Contributed by Rohith Sharma K S
(cherry picked from commit 97607617ce)
2018-01-24 16:56:51 +05:30
Miklos Szegedi bf795560fb YARN-7796. Container-executor fails with segfault on certain OS configurations. Contributed by Gergo Repas.
(cherry picked from commit e7642a3e6f)
2018-01-23 22:21:12 -08:00