Robert Kanter
|
ea7ad50499
|
HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
(cherry picked from commit 7ab08a9c37 )
|
2018-04-23 16:25:41 -07:00 |
Eric Yang
|
5556cf397c
|
YARN-8064. Bugfix for clean up container-executor cmd helper file.
Contributed by Eric Badger
|
2018-04-20 19:12:06 -04:00 |
Konstantinos Karanasos
|
18c86a3fb6
|
YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang.
(cherry picked from commit 28e2244390 )
|
2018-04-20 12:25:08 -07:00 |
Jason Lowe
|
71b0d52987
|
YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie
(cherry picked from commit 766544c0b0 )
|
2018-04-20 13:23:46 -05:00 |
Sunil G
|
162db6e826
|
YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S.
(cherry picked from commit 7d06806dfd )
|
2018-04-20 00:06:44 +05:30 |
Weiwei Yang
|
c3ca10c22a
|
YARN-7734. Fix UT failure TestContainerLogsPage#testContainerLogPageAccess. Contributed by Tao Yang.
(cherry picked from commit 411993f6e5 )
|
2018-04-18 19:40:34 -07:00 |
Shashikant Banerjee
|
a13b3edfd8
|
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247 )
|
2018-04-19 08:36:32 +09:00 |
Rohith Sharma K S
|
fa007d986b
|
YARN-8145. yarn rmadmin -getGroups doesn't return updated groups for user. Contributed by Sunil G.
(cherry picked from commit 241d985467 )
|
2018-04-18 13:40:32 +05:30 |
Inigo Goiri
|
8f300c9ce1
|
YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
(cherry picked from commit dd5e18c4ae )
|
2018-04-17 15:28:13 +05:30 |
Wangda Tan
|
6ee62e6b1c
|
YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda)
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
|
2018-04-14 11:04:49 -07:00 |
Rohith Sharma K S
|
eb1026dffa
|
YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
(cherry picked from commit 669eb7bdea )
|
2018-04-14 10:57:02 +05:30 |
Wangda Tan
|
994c7d66e0
|
YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda)
Change-Id: I5fab3fe229c34e967487b7327c7b3c8ddf7cb795
|
2018-04-13 10:19:10 -07:00 |
Wangda Tan
|
7031a853f4
|
YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
|
2018-04-13 10:18:48 -07:00 |
Sunil G
|
21717db6a0
|
YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. Contributed by Wangda Tan.
|
2018-04-13 10:18:12 -07:00 |
Wangda Tan
|
c962371430
|
YARN-1151. Ability to configure auxiliary services from HDFS-based JAR files. (Xuan Gong via wangda)
Change-Id: Ied37ff11e507fc86847753ba79486652c8fadfe9
|
2018-04-13 10:17:47 -07:00 |
Weiwei Yang
|
84531ad9b6
|
YARN-8153. Guaranteed containers always stay in SCHEDULED on NM after restart. Contributed by Yang Wang.
|
2018-04-13 13:29:43 +08:00 |
Eric E Payne
|
9693d8b99d
|
YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
(cherry picked from commit 18844599ae )
|
2018-04-12 17:58:41 +00:00 |
Eric E Payne
|
f955d52f39
|
YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
(cherry picked from commit 6bb128dfb8 )
|
2018-04-12 16:11:57 +00:00 |
Billie Rinaldi
|
11f1d49823
|
YARN-7221. Add security check for privileged docker container. Contributed by Eric Yang
(cherry picked from commit 933477e9e0 )
|
2018-04-11 12:15:00 -07:00 |
Weiwei Yang
|
c2036af196
|
YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang.
(cherry picked from commit 7eb783e263 )
|
2018-04-11 17:21:47 +08:00 |
Vrushali C
|
67cd7acf99
|
YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d5 )
|
2018-04-11 09:41:04 +05:30 |
Wangda Tan
|
f5dc7d1edf
|
YARN-8116. Nodemanager fails with NumberFormatException: For input string: . (Chandni Singh via wangda)
Change-Id: Idd30cfca59982d3fc6e47aa1b88f844a78fae94d
(cherry picked from commit 2bf9cc2c73 )
|
2018-04-10 17:38:31 -07:00 |
Wangda Tan
|
25bf1d3ac6
|
Updated branch-3.1 to track 3.1.1
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
|
2018-04-09 10:58:50 -07:00 |
Sunil G
|
8311fcc75b
|
YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad.
(cherry picked from commit 821b0de4c5 )
|
2018-04-09 21:17:56 +05:30 |
bibinchundatt
|
091db4d0eb
|
YARN-7905. Parent directory permission incorrect during public localization. Contributed by Bilwa S T.
(cherry picked from commit eb47c3de74 )
|
2018-04-08 14:49:36 +05:30 |
Subru Krishnan
|
b9bad94596
|
YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru).
(cherry picked from commit 00905efab2 )
|
2018-04-06 16:35:29 -07:00 |
Haibo Chen
|
b232dcab33
|
YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 024d7c0870 )
|
2018-04-06 09:39:45 -07:00 |
Haibo Chen
|
6658018410
|
YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit f8b8bd53c4 )
|
2018-04-05 11:31:17 -07:00 |
Konstantinos Karanasos
|
fa464c12ad
|
YARN-8013. Support application tags when defining application namespaces for placement constraints. Contributed by Weiwei Yang.
(cherry picked from commit 7853ec8d2f )
|
2018-04-04 10:53:33 -07:00 |
Wangda Tan
|
78832eca8a
|
YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. (Weiwei Yang via wangda)
Change-Id: I63b4e4192a95bf7ded98c54e46a2871c72869700
|
2018-04-04 09:42:49 +08:00 |
Sunil G
|
73cd67d7e3
|
YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang.
(cherry picked from commit 7a59d60e0c )
|
2018-03-29 21:41:52 +05:30 |
Subru Krishnan
|
a0091ec4b3
|
YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 09999d7e01 )
|
2018-03-28 11:35:45 -07:00 |
Subru Krishnan
|
ed49f59e18
|
Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)."
This reverts commit 85eebf1beb .
|
2018-03-28 11:35:30 -07:00 |
Wangda Tan
|
a2b4daab55
|
YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda)
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
(cherry picked from commit 47f711eebc )
|
2018-03-28 11:22:26 -07:00 |
Subru Krishnan
|
85eebf1beb
|
YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru).
(cherry picked from commit 2a2ef15caf )
|
2018-03-27 17:44:00 -07:00 |
Wangda Tan
|
dc99611878
|
YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda)
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
(cherry picked from commit 24bc5e0e4d )
|
2018-03-26 11:27:40 -07:00 |
Wangda Tan
|
62b9537332
|
YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda)
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad )
|
2018-03-26 11:27:32 -07:00 |
Wangda Tan
|
54da6a0d78
|
YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda)
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f8 )
|
2018-03-26 11:27:21 -07:00 |
Jason Lowe
|
5d4b2c31a1
|
YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles
(cherry picked from commit 5aa7052e31 )
|
2018-03-21 17:20:36 -05:00 |
Rohith Sharma K S
|
bbfe36d686
|
YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen.
(cherry picked from commit 29acea5000 )
|
2018-03-21 08:26:56 +05:30 |
Haibo Chen
|
d8764f1c90
|
YARN-8053. Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 3ff6977d3e )
|
2018-03-21 08:26:56 +05:30 |
Jason Lowe
|
a4f0dbcb44
|
YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan
(cherry picked from commit f480367af6 )
|
2018-03-19 17:44:06 -05:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
0bd99621c5
|
Preparing for 3.1.0 development
|
2018-03-19 15:16:54 -07:00 |
Yufei Gu
|
49c747ab18
|
YARN-8039. Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer. Contributed by Miklos Szegedi.
|
2018-03-16 16:25:33 -07:00 |
Weiwei Yang
|
154cfb2b62
|
YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang.
|
2018-03-16 18:57:31 +08:00 |
Wangda Tan
|
4bf622043f
|
YARN-7952. RM should be able to recover log aggregation status after restart/fail-over. (Xuan Gong via wangda)
Change-Id: I725c9afe64831eda0aa6b0bebdbc79d2dd165707
|
2018-03-15 13:26:45 -07:00 |
fang zhenyi
|
5e013d50d1
|
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-03-15 16:12:07 +09:00 |
Eric Yang
|
a82be7754d
|
YARN-7999. Added file cache initializer for Linux container-executor.
Contributed by Jason Lowe
|
2018-03-14 12:21:57 -04:00 |
Rohith Sharma K S
|
e6de10d0a6
|
YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi.
|
2018-03-14 09:42:20 +05:30 |
Wangda Tan
|
b167d60763
|
YARN-7657. Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue. (Suma Shivaprasad via wangda)
Change-Id: I32d566e8727840e43c0d66e39a77edef017e3a83
|
2018-03-13 17:55:51 -07:00 |
Wangda Tan
|
a5b27b3c67
|
YARN-5015. Support sliding window retry capability for container restart. (Chandni Singh via wangda)
Change-Id: I07addd3e4ba8d98456ee2ff1d5c540a38fe61dea
|
2018-03-13 17:55:17 -07:00 |
Miklos Szegedi
|
a82d4a2e3a
|
YARN-5764. NUMA awareness support for launching containers. Contributed by Devaraj K.
|
2018-03-13 12:36:57 -07:00 |
Yufei Gu
|
ff31d8aefa
|
YARN-8024. LOG in class MaxRunningAppsEnforcer is initialized with a faulty class. Contributed by Sen Zhao.
|
2018-03-12 16:35:26 -07:00 |
Wangda Tan
|
ea18e70a74
|
Updated timeline reader to use AuthenticationFilter
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
|
2018-03-09 22:51:08 -08:00 |
Owen O'Malley
|
3a8dade9b1
|
Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
This reverts commit 172b23af33 .
(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
|
2018-03-09 22:46:30 -08:00 |
Weiwei Yang
|
b451889e8e
|
YARN-8011. TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails intermittently. Contributed by Tao Yang.
|
2018-03-08 18:13:36 +08:00 |
Wangda Tan
|
e718ac597f
|
Revert "YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)"
This reverts commit 4d53ef7eef .
|
2018-03-07 15:46:47 -08:00 |
Wangda Tan
|
037d783483
|
YARN-7626. Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount. (Zian Chen via wangda)
Change-Id: If461277d4557922ab7e4dce9dd8dc5d0d5f22710
(cherry picked from commit 88f9138e12d2d5a1bd13f0915acef93037c1d086)
|
2018-03-07 11:30:15 -08:00 |
Wangda Tan
|
4d53ef7eef
|
YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)
Change-Id: Ie16e34039d57df50128c73b37516ad0bc7c9590e
|
2018-03-07 11:30:06 -08:00 |
Jason Lowe
|
d69b31f7f7
|
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
|
2018-03-07 09:20:34 -06:00 |
Rohith Sharma K S
|
55ba49dd07
|
YARN-7346. Add a profile to allow optional compilation for ATSv2 with HBase-2.0. Contributed by Haibo Chen and Rohith.
|
2018-03-06 11:55:21 +05:30 |
Arun Suresh
|
1054b48c27
|
YARN-7972. Support inter-app placement constraints for allocation tags by application ID. (Weiwei Yang via asuresh)
|
2018-03-05 11:24:17 -08:00 |
Billie Rinaldi
|
628be58a4c
|
YARN-7915. Trusted image log message repeated multiple times. Contributed by Shane Kumpf
|
2018-03-05 09:08:44 -08:00 |
Jason Lowe
|
83798f15f8
|
YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang
|
2018-03-02 09:59:46 -06:00 |
Ray Chiang
|
923e1773e1
|
HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang)
|
2018-03-01 15:36:10 -08:00 |
Sunil G
|
22928c0c60
|
YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen.
|
2018-03-01 22:39:32 +05:30 |
Yufei Gu
|
6ca4e3017b
|
YARN-5028. RMStateStore should trim down app state for completed applications(addendum). Contributed by Rohith Sharma K S.
|
2018-03-01 08:38:53 -08:00 |
Haibo Chen
|
10663b78c8
|
Revert "yarn-7346.07.patch"
This reverts commit 5e37ca5bb4 .
|
2018-02-28 21:11:36 -08:00 |
Haibo Chen
|
d1274c3b71
|
YARN-7835. Race condition in NM while publishing events if second attempt is launched on the same node. (Rohith Sharma K S via Haibo Chen)
|
2018-02-28 21:10:42 -08:00 |
Haibo Chen
|
5e37ca5bb4
|
yarn-7346.07.patch
|
2018-02-28 21:04:54 -08:00 |
Billie Rinaldi
|
727c033997
|
YARN-7446. Remove --user flag when running privileged mode docker container. Contributed by Eric Yang
|
2018-02-27 14:33:57 -08:00 |
Arpit Agarwal
|
2fa7963c3d
|
HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.
|
2018-02-24 14:41:55 -08:00 |
Jason Lowe
|
8e728f39c9
|
YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan
|
2018-02-23 15:46:35 -06:00 |
Carlo Curino
|
514794e1a5
|
YARN-7934. [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos. (Contributed by curino)
|
2018-02-22 18:12:12 -08:00 |
Jason Lowe
|
3132709b46
|
YARN-7916. Remove call to docker logs on failure in container-executor. Contributed by Shane Kumpf
|
2018-02-21 16:54:02 -06:00 |
Yufei Gu
|
92cbbfe79e
|
YARN-5028. RMStateStore should trim down app state for completed applications. Contributed by Gergo Repas.
|
2018-02-21 11:42:51 -08:00 |
Sunil G
|
bdd2a184d7
|
YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne.
|
2018-02-21 14:35:57 +05:30 |
Jason Lowe
|
9497215084
|
YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne
|
2018-02-19 14:06:28 -06:00 |
Jason Lowe
|
b9a429bb28
|
Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan"
This reverts commit 8013475d44 .
|
2018-02-19 08:16:25 -06:00 |
fang zhenyi
|
4d4dde5112
|
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-18 22:19:39 +09:00 |
Rohith Sharma K S
|
9af30d46c6
|
YARN-7919. Refactor timelineservice-hbase module into submodules. Contributed by Haibo Chen.
|
2018-02-17 20:30:28 +05:30 |
Arun Suresh
|
a1e56a6286
|
YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via asuresh)
|
2018-02-17 03:24:55 -08:00 |
Sunil G
|
aae629913c
|
YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan.
|
2018-02-16 12:37:40 +05:30 |
Jason Lowe
|
8013475d44
|
YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
|
2018-02-15 17:09:00 -06:00 |
Konstantinos Karanasos
|
0b489e564c
|
YARN-7920. Simplify configuration for PlacementConstraints. Contributed by Wangda Tan.
|
2018-02-15 14:23:38 -08:00 |
Eric Payne
|
bddfe42e2c
|
Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit c5e6e3de1c .
|
2018-02-14 14:29:20 -06:00 |
Wangda Tan
|
042ef2fa7b
|
YARN-7789. Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator. (Zian Chen via wangda)
Change-Id: I1f6a451fe16758def6f47c046a9b8a67ad7255af
|
2018-02-14 23:11:10 +08:00 |
Eric Payne
|
c5e6e3de1c
|
YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue
|
2018-02-13 10:11:02 -06:00 |
Jason Lowe
|
5a1db60ab1
|
YARN-7914. Fix exit code handling for short lived Docker containers. Contributed by Shane Kumpf
|
2018-02-12 15:50:10 -06:00 |
Jason Lowe
|
3414fd1243
|
YARN-7917. Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens. Contributed by Shane Kumpf
|
2018-02-12 09:27:43 -06:00 |
Wangda Tan
|
d02e42cee4
|
YARN-7739. DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation. (wangda)
Change-Id: I10cc9341237d9a2fc0f8c855efb98a36b91389e2
|
2018-02-12 10:29:37 +08:00 |
Wangda Tan
|
60f9e60b3b
|
Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
|
2018-02-11 11:17:38 +08:00 |
Yufei Gu
|
1bc03ddf97
|
YARN-7655. Avoid AM preemption caused by RRs for specific nodes or racks. Contributed by Steven Rand.
|
2018-02-08 12:32:43 -08:00 |
Jian He
|
eb2449d539
|
YARN-5428. Allow for specifying the docker client configuration directory. Contributed by Shane Kumpf
|
2018-02-08 11:35:30 -08:00 |
Jason Lowe
|
456705a07c
|
YARN-7815. Make the YARN mounts added to Docker containers more restrictive. Contributed by Shane Kumpf
|
2018-02-07 13:09:08 -06:00 |
Billie Rinaldi
|
266da25c04
|
Revert "YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi."
This reverts commit e14f03dfbf .
|
2018-02-07 07:17:00 -08:00 |
Billie Rinaldi
|
aa461f9091
|
YARN-7516. Add security check for trusted docker images. Contributed by Eric Yang
|
2018-02-07 07:09:45 -08:00 |
Robert Kanter
|
814d701d46
|
YARN-7841. Cleanup AllocationFileLoaderService's reloadAllocations method (snemeth via rkanter)
|
2018-02-06 14:36:49 -08:00 |
Anu Engineer
|
4304fcd5bd
|
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
|
2018-02-06 13:43:45 -08:00 |
Weiwei Yang
|
bff858e910
|
YARN-7860. Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning. Contributed by Sunil G.
|
2018-02-06 19:33:04 +08:00 |