Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,048 Commits 326 Branches 371 Tags
Commit Graph

1942 Commits

Author SHA1 Message Date
Jian He
42a2bddcb7 YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding 
(cherry picked from commit 6b9a5beb2b2f9589ef86670f2d763e8488ee5e90)
 2015-12-02 11:09:08 -08:00
Tsuyoshi Ozawa
f50f889c17 YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena. 
(cherry picked from commit 0656d2dc83af6a48a8d8d0e37cdf1f813124f366)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
 2015-11-26 01:22:11 +09:00
Jason Lowe
b68f527b9f YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla 
(cherry picked from commit f5acf94ecafb301a0cc8e8f91f19c8bcbc8da701)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/nodelabels/TestFileSystemNodeLabelsStore.java
 2015-11-24 23:52:46 +00:00
Jason Lowe
9bd9544bda Update CHANGES.txt for recent commits to branch-2.6. 
(cherry picked from commit aa2009c37bc3c47035a5aea4a7449d3fe48569d4)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-23 22:00:27 +00:00
Jason Lowe
5bd40d7099 YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev 
(cherry picked from commit d36b6e045f317c94e97cb41a163aa974d161a404)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java
 2015-11-23 20:47:12 +00:00
Wangda Tan
c7e23255ae YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda) 2015-11-20 16:36:11 -08:00
Wangda Tan
2ad1386b2b YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda) 2015-11-20 16:17:23 -08:00
Jason Lowe
9074714a18 YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li 
(cherry picked from commit 060cdcbe5db56383e74e282ac61eedff8248c11b)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
 2015-11-20 23:25:27 +00:00
Xuan
eb9296d316 YARN-2859 addendum: move the entry from 2.6.2 to 2.6.3 in hadoop-yarn/CHANGES.txt. 
(cherry picked from commit 866dce4e8e105d0e2c7e041b5d30213536a61702)
(cherry picked from commit 8347b1048d063adaf40fc4f537aaa9bfd1157c37)
 2015-11-19 10:18:47 -08:00
Xuan
fe67c6f43f YARN-2859.addendum: fix the remaining issue from the previous patch 
(cherry picked from commit f114e728da6e19f3d35ff0cfef9fceea26aa5d46)
(cherry picked from commit be65d319fae8f8644c46ee7c44108ce72dafc9c7)
 2015-11-19 10:10:22 -08:00
Wangda Tan
82de3e1c11 YARN-4287. Capacity Scheduler: Rack Locality improvement. (Nathan Roberts via wangda) 2015-11-18 13:58:47 -08:00
Jian He
27b786660e Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan" 
This reverts commit cb4d4d5918c4d488056e5521e343aaa9ffbd24d1.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-11-16 20:20:46 -08:00
Jason Lowe
e1716c7cf9 YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe. 
(cherry picked from commit 855d52927b6115e2cfbd97a94d6c1a3ddf0e94bb)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestLocalResourcesTrackerImpl.java
 2015-11-16 15:02:56 +00:00
Jason Lowe
38f37ca2eb Revert "YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe." 
This reverts commit 8ea88ab0b87482b779ec9f629b46e9ac7ad53cb5.
 2015-11-16 14:30:22 +00:00
Junping Du
8ea88ab0b8 YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe. 
(cherry picked from commit 855d52927b6115e2cfbd97a94d6c1a3ddf0e94bb)
(cherry picked from commit 1d107d805841e9b39db01aa236068a0ff1ca46d1)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestLocalResourcesTrackerImpl.java
 2015-11-15 04:50:28 -08:00
Wangda Tan
ddce4c8245 YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda) 2015-11-12 11:20:38 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
2bd64879f4 YARN-4183. Reverting the patch to fix behaviour change. 
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"

This reverts commit 3287a50cfe4b978d3776e3cce2218e0b10e3e519.
 2015-11-11 10:46:32 -08:00
Akira Ajisaka
0bdb51d801 YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas. 
(cherry picked from commit 23d0db551cc63def9acbab2473e58fb1c52f85e0)
(cherry picked from commit f6f128c8676981a33ccc55c92321244391f9a3ac)
 2015-11-11 16:15:57 +09:00
Vinod Kumar Vavilapalli
373b29491f HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in 
the first patch committed. (Karthik Kambatla via vinodkv)

(cherry picked from commit b742ea7fe677def932e94abfa7d3fcec80ccfd93)
 2015-11-10 12:22:40 -08:00
Jian He
a0570ebb15 Fix CHANGES.txt for YARN-3840 2015-11-09 14:33:07 -08:00
Jian He
cb4d4d5918 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan 
(cherry picked from commit 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
(cherry picked from commit a4ff03b200cf02a49ab81fa3c71cb707f6d2fee1)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
 2015-11-09 14:30:47 -08:00
Wangda Tan
f7deb6b472 YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda) 
(cherry picked from commit 0783184f4b3f669f7211e42b395b62d63144100d)
 2015-11-06 09:07:27 -08:00
Jason Lowe
7499f71e77 Add 2.7.3 release to CHANGES.txt 
(cherry picked from commit 0383a3973b3b734fb23c331a2256dc92cff05365)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2015-11-04 16:29:56 +00:00
Jian He
7029fc356f YARN-4127. RM fail with noAuth error if switched from failover mode to non-failover mode. Contributed by Varun Saxena 2015-11-03 15:33:13 -08:00
Vinod Kumar Vavilapalli
09348c4bce Preparing for 2.7.3 development 2015-11-03 15:18:10 -08:00
Wangda Tan
04abe7e9e0 YARN-3136. getTransferredContainers can be a bottleneck during AM registration. (Sunil G via jianhe) 2015-11-03 12:59:06 -08:00
Jian He
ece1b1645b YARN-4321. Incessant retries if NoAuthException is thrown by Zookeeper in non HA mode. Contributed by Varun Saxena 2015-11-02 11:22:30 -08:00
Sangjin Lee
c8767fb68c Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
 2015-10-30 18:53:10 -07:00
Jason Lowe
e894be93f6 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096cb010eb7f0afd9afd4ae0d67b2645f)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2015-10-30 14:55:33 +00:00
Tsuyoshi Ozawa
c84ec0657f YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena. 
(cherry picked from commit ce31b22739512804da38cf87e0ce1059e3128da3)
 2015-10-30 18:00:45 +09:00
Tsuyoshi Ozawa
6636441911 YARN-4312. TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out. Contributed by Varun Saxena. 2015-10-30 16:25:52 +09:00
Junping Du
da564ef9a7 YARN-3580. [JDK8] TestClientRMService.testGetLabelsToNodes fails. Contributed by Robert Kanter. 
(cherry picked from commit 31b627b2a8755dec0820d01f6f7ac96e4c6194e2)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-10-30 15:59:40 +09:00
Xuan
ceefabc44a YARN-4313. Race condition in MiniMRYarnCluster when getting history 
server address. Contributed by Jian He

(cherry picked from commit 7412ff48eeb967c972c19c1370c77a41c5b3b81f)
(cherry picked from commit b505bf9e582f5bca59be28296a4b4a640b3389eb)
 2015-10-29 17:38:09 -07:00
Jonathan Eagles
3287a50cfe YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles) 
(cherry picked from commit c293c58954cdab25c8c69418b0e839883b563fa4)
 2015-10-29 16:45:31 -05:00
Jason Lowe
c43cc8fd67 YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena 
(cherry picked from commit e2267de2076245bd9857f6a30e3c731df017fef8)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DockerContainerExecutor.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
 2015-10-29 16:48:57 +00:00
Xuan
336be63dad YARN-2859. ApplicationHistoryServer binds to default port 8188 in 
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 27414dac66f278b61fc23762204b01a1c508178a)
(cherry picked from commit 9ce5069d16edefb0b2a24d6b7988347039624942)
 2015-10-28 10:34:28 -07:00
Jason Lowe
2b6ce20e1c YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G 
(cherry picked from commit d3a34a4f388155f6a7ef040e244ce7be788cd28b)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-23 20:59:28 +00:00
Jonathan Eagles
49a7d70f53 YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles) 
(cherry picked from commit f8adeb712dc834c27cec15c04a986f2f635aba83)
 2015-10-23 11:18:32 -05:00
Jian He
7021e015d7 YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena 2015-10-21 16:37:21 -07:00
Jonathan Eagles
7d3d0d6052 YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles) 
(cherry picked from commit 25f8f801d15e3d9f27f4a2a198262407203e14a5)
 2015-10-21 15:40:24 -05:00
Tsuyoshi Ozawa
c74a32ea42 Moved CHANGES.txt entries to 2.6.2 
YARN-2019, YARN-4092, YARN-4101, YARN-4087, YARN-3727, YARN-4005,
YARN-3780, YARN-3802, YARN-3896, YARN-3554, YARN-3194, YARN-3798

(cherry picked from commit 14f0e2787c7c590d8ec1fc52f437866f34b098bd)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-10-21 23:28:25 +09:00
Jason Lowe
29838ff5b1 YARN-4281. 2.7 RM app page is broken. Contributed by Chang Li 2015-10-21 13:43:25 +00:00
Tsuyoshi Ozawa
08c02199ff YARN-3798. ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED. (ozawa and Varun Saxena) 2015-10-19 10:30:28 +09:00
Jason Lowe
fe874e9f69 YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks) 
(cherry picked from commit feaf0349949e831ce3f25814c1bbff52f17bfe8f)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 16:08:55 +00:00
Jason Lowe
784d00e0e2 YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes 
after NM is reconnected. Contributed by zhihai xu
(cherry picked from commit 5b5bb8dcdc888ba1ebc7e4eba0fa0e7e79edda9a)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 15:56:44 +00:00
Jason Lowe
aaff9dc39b YARN-3780. Should use equals when compare Resource in 
RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.
(cherry picked from commit c7ee6c151c5771043a6de3b8a951cea13f59dd7b)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 15:30:25 +00:00
Jason Lowe
84f1d99d02 YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong 
(cherry picked from commit 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 15:06:58 +00:00
Rohith Sharma K S
a231075964 YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks) 2015-10-07 09:35:10 +05:30
Jason Lowe
9f6ed41b95 YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu 2015-10-02 20:19:14 +00:00
Jason Lowe
493f072008 YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu 
(cherry picked from commit 854d25b0c30fd40f640c052e79a8747741492042)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestLocalResourcesTrackerImpl.java
 2015-09-30 15:08:10 +00:00