Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,984 Commits 326 Branches 371 Tags
Commit Graph

2853 Commits

Author SHA1 Message Date
Wangda Tan
6856a7183a YARN-4865. Track Reserved resources in ResourceUsage and QueueCapacities. (Sunil G via wangda) 
(cherry picked from commit fc055a3cbe9545cf1c59421641c7b296aa33f953)
 2016-03-29 17:10:17 -07:00
Xuan
ffe01e05cd YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du 
(cherry picked from commit 80182809aed76fb9522d25db9bf5e445395dd573)
 2016-03-28 22:18:56 -07:00
Jason Lowe
edf17fe8e5 YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong 
(cherry picked from commit 948b75807068c304ffe789e32f2b850c0d653e0a)
 2016-03-28 23:02:15 +00:00
Jian He
c7d843af3b YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du 2016-03-28 11:13:02 -07:00
Jian He
d2f9adca88 Missing file for YARN-4117. 2016-03-28 09:23:06 -07:00
Jian He
bdc648ebe7 YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola 2016-03-27 20:22:49 -07:00
Karthik Kambatla
4212f2e2bf YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha) 
(cherry picked from commit 49ff54c8609431f5d1a6bee84df3b52fec445379)
 2016-03-26 21:45:29 -07:00
Jason Lowe
3cea00a294 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong 
(cherry picked from commit e8fc81f9c812b0c167411de7f1789a9a433a0d57)
 2016-03-25 20:19:15 +00:00
Junping Du
c722262c75 YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit 19b645c93801a53d4486f9a7639186525e51f723)
 2016-03-23 19:35:14 -07:00
Junping Du
76602161c0 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong. 
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
 2016-03-23 08:58:05 -07:00
Karthik Kambatla
95b59c17a7 YARN-4732. *ProcessTree classes have too many whitespace issues 
(cherry picked from commit 7fae4c68e6d599d0c01bb2cb2c8d5e52925b3e1e)
 2016-03-20 10:47:56 -07:00
Eric Payne
dd1e4107e5 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
 2016-03-18 17:05:53 +00:00
Junping Du
66257613b4 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. 
(cherry picked from commit ca8106d2dd03458944303d93679daa03b1d82ad5)
 2016-03-17 09:25:36 -07:00
Karthik Kambatla
bbe9bb078c YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha) 
(cherry picked from commit f84af8bd588763c4e99305742d8c86ed596e8359)
 2016-03-17 05:54:40 -07:00
Wangda Tan
484976fa2b YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan) 
(cherry picked from commit 7e8c9beb4156dcaeb3a11e60aaa06d2370626913)
(cherry picked from commit ae14e5d07f1b6702a5160637438028bb03d9387e)
 2016-03-16 17:03:35 -07:00
Karthik Kambatla
ab03266831 YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha) 
(cherry picked from commit 3ef5500783f043ff206458d8c10ed3d5405a8b0c)
 2016-03-15 23:47:19 -07:00
Xuan
398dbde538 Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
 2016-03-15 22:11:16 -07:00
Li Lu
94649b9cc0 YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9) 
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
 2016-03-15 11:48:37 -07:00
Li Lu
14a4110b75 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
 2016-03-15 11:42:30 -07:00
Robert Kanter
da24fde333 TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter) 
(cherry picked from commit 22ca176dfe125a4f7bf38cc63ab8106c40a7a7ba)
 2016-03-15 10:05:28 -07:00
Siddharth Seth
edd9abf302 YARN-4816. Fix incompatible change in SystemClock. 
(cherry picked from commit eba66a64d28b50a660d6f537c767677f5fa0f7ea)
 2016-03-14 20:15:41 -07:00
Karthik Kambatla
b4c8693096 YARN-4719. Add a helper library to maintain node state and allows common queries. (kasha) 
(cherry picked from commit 20d389ce61eaacb5ddfb329015f50e96ad894f8d)
 2016-03-14 14:22:21 -07:00
Junping Du
3d5ac829da YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du 
(cherry picked from commit f291d82cd49c04a81380bc45c97c279d791b571c)
 2016-03-14 08:30:07 -07:00
Li Lu
2b16a54fbe YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. 
This commit amends commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec with a missed test file.

(cherry picked from commit 017d2c127b9cbd75d3e31467172ed832f27ef826)
 2016-03-10 13:04:57 -08:00
Li Lu
76ef097fd1 YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9) 
(cherry-picked from commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec)
 2016-03-10 10:56:51 -08:00
Allen Wittenauer
9f4b3eaac0 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 45bb467918ce986760ba5f7a948cf016656f0e57.
 2016-03-09 09:59:19 -08:00
Chris Nauroth
38a031ce68 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml
 2016-03-08 21:22:57 -08:00
Wangda Tan
f7b38a7fb8 YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda) 
(cherry picked from commit 0233d4e0ee9947a95c018b1539310fc0bff6c44e)
 2016-03-08 14:28:26 -08:00
Jian He
fb139b0c40 YARN-4764. Application submission fails when submitted queue is not available in scheduler xml. Contributed by Bibin A Chundatt 
(cherry picked from commit 3c33158d1cb38ee4ab3baa21752a3cdf0bdc8ccc)
 2016-03-08 13:12:33 -08:00
Akira Ajisaka
0586386472 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f86850b544dcb34ee3c9336fad584309e886dbed)
 2016-03-08 14:29:46 +09:00
Vinod Kumar Vavilapalli
da9f39b107 YARN-4762. Fixed CgroupHandler's creation and usage to avoid NodeManagers crashing when LinuxContainerExecutor is enabled. (Sidharta Seethana via vinodkv) 
(cherry picked from commit b2661765a5a48392a5691cee15904ed2de147b00)
 2016-03-07 11:11:29 -08:00
Jason Lowe
adcdcfd5c1 YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger 
(cherry picked from commit 4163e36c2be2f562545aba93c1d47643a9ff4741)
 2016-03-07 15:57:44 +00:00
Jason Lowe
4eace7ab43 YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana 
(cherry picked from commit 059caf99891943d9587cac19b48e82efbed06b2d)
 2016-03-07 15:45:47 +00:00
Varun Vasudev
78919f8c34 YARN-4245. Generalize config file handling in container-executor. Contributed by Sidharta Seethana. 
(cherry picked from commit 8ed2e060e80c0def3fcb7604e0bd27c1c24d291e)
 2016-03-07 16:19:27 +05:30
Varun Vasudev
e9a0ffc7f1 YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron. 
(cherry picked from commit 43416187c07afb35e3267f94d0a41d8d3cfb5735)
 2016-03-07 15:23:36 +05:30
Zhihai Xu
7ac7ca48b7 YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee 
(cherry picked from commit e1ccc9622b2f1fbefea1862fa74d1fb56d8eb264)
 2016-03-06 19:49:47 -08:00
Rohith Sharma K S
1415e6190a YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 77e2c3e8c7365b2aca00b6169829f87c63e4b460)
 2016-03-05 13:07:20 +05:30
Masatake Iwasaki
722182fdfb HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a61252f253aa2bcdb9cad70f7876d231)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
 2016-03-04 14:12:44 +09:00
Andrew Wang
670944810c HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:58 -08:00
Jian He
023c2d2e56 YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding 2016-03-01 13:14:51 -08:00
Jian He
589b537631 YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu 
(cherry picked from commit d93c22ec274b1a0f29609217039b80732886fed7)
 2016-02-29 18:19:34 -08:00
Karthik Kambatla
84172b047b YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha) 
(cherry picked from commit 9dafaaaf0de68ce7f5e495ea4b8e0ce036dc35a2)
 2016-02-29 16:10:26 -08:00
Haohui Mai
c5db4ab0b4 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:10:18 -08:00
Jason Lowe
bd0f5085e3 YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe 
(cherry picked from commit c58a6d53c58209a8f78ff64e04e9112933489fb5)
 2016-02-29 15:26:26 +00:00
Rohith Sharma K S
2a1bb6cb67 YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit e0b14f26f5201a149218276469434df511697acc)
 2016-02-29 10:50:23 +08:00
Karthik Kambatla
f3b37d8020 YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha) 
(cherry picked from commit f9692770a58af0ab082eb7f15da9cbdcd177605b)
 2016-02-28 10:01:48 -08:00
Jason Lowe
0bd7ba4ea8 YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla 
(cherry picked from commit 6b0f813e898cbd14b2ae52ecfed6d30bce8cb6b7)
 2016-02-26 20:25:56 +00:00
Ming Ma
1656bcec5f YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma) 
(cherry picked from commit 7f3139e54da2c496327446a5eac43f8421fc8839)
 2016-02-26 08:43:14 -08:00
Robert Kanter
872b8d90a6 YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter) 
(cherry picked from commit d7fdec1e6b465395d2faca6e404e329d20f6c3d8)
 2016-02-25 16:40:05 -08:00
Robert Kanter
ec48848711 YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter) 
(cherry picked from commit c4d4df8de09ee0c89ea8176bd8149900becd3c0c)
 2016-02-25 12:48:29 -08:00