Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,090 Commits 326 Branches 371 Tags
Commit Graph

2544 Commits

Author SHA1 Message Date
rohithsharmaks
7e66b2f22c YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit 10dc2c049304671f0ed9fd737a30cd843427b53e)
 2016-01-24 23:37:11 +05:30
rohithsharmaks
280c9b8401 YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks) 
(cherry picked from commit 99829eb221482928d8a1b148ae3c802cc7c9253e)
 2016-01-23 07:58:16 +05:30
Xuan
1d19557dda YARN-4496. Improve HA ResourceManager Failover detection on the client. 
Contributed by Jian He

(cherry picked from commit 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28)
 2016-01-22 18:21:50 -08:00
Jason Lowe
635849fa45 YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen 
(cherry picked from commit 46e5ea81e0e41646ba02391aea31481ead28aaf8)
 2016-01-22 21:55:59 +00:00
Jason Lowe
ad84f90e88 YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G 
(cherry picked from commit e91e8b711c68273460b36557fc37fdfc86be097b)
 2016-01-22 21:37:08 +00:00
rohithsharmaks
1cec12d95a YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit 34a3900773df6d9075dcf5476e8fe5208cd8f806)
 2016-01-22 21:18:42 +05:30
rohithsharmaks
493275b27b YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks) 
(cherry picked from commit d6258b33a7428a0725ead96bc43f4dd444c7c8f1)
 2016-01-22 20:29:10 +05:30
Akira Ajisaka
ddc22bbcb1 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang. 
(cherry picked from commit 8f58f742aea87b2b46b9741ffeaebfa36af3573f)
 2016-01-22 19:43:37 +09:00
Varun Vasudev
85561207f9 YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana. 
(cherry picked from commit b41a7e89d1eb8650975ac7092532ed9563ac60f2)
 2016-01-22 14:44:22 +05:30
Rohith Sharma K S
844a8e3771 YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit e30668106dc246f68db36fbd1f2db6ec08cd96f2)
 2016-01-22 10:20:09 +05:30
Jason Lowe
d051200a62 YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe 
(cherry picked from commit 468a53b22f4ac5bb079dff986ba849a687d709fe)
 2016-01-21 18:32:47 +00:00
Akira Ajisaka
bf4901c609 YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki. 
(cherry picked from commit d3224e2d6274daf73a103c0dbe21ba69add7ca26)
 2016-01-22 02:14:53 +09:00
Karthik Kambatla
5c2f495fcc YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha) 
(cherry picked from commit 4992398aeeb213ce59e068b0226e22e49ce559eb)
 2016-01-21 17:43:49 +01:00
Jason Lowe
4e6fc3ca18 YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R 
(cherry picked from commit f858ac24269c101bdee1f7b7b2566bdbda2b4ecd)
 2016-01-21 15:39:51 +00:00
Wangda Tan
9512866740 YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda) 
(cherry picked from commit c9fe0371a8ab40c0d3437fadd32788b320788a7a)
 2016-01-21 11:16:58 +08:00
Xuan
66b030f608 YARN-4611. Fix scheduler load simulator to support multi-layer network 
location. Contributed by Ming Ma.

(cherry picked from commit 1708a4cd2377c56e2cb5738720b7eaf10baf13c8)
 2016-01-20 15:43:02 -08:00
Xuan
be3322792f YARN-4559. Make leader elector and zk store share the same curator 
client. Contributed by Jian He

(cherry picked from commit 890a2ebd1af51d24ccbbc5d1d65d17b24ad8ab9b)
 2016-01-20 14:49:04 -08:00
Wangda Tan
23deeb4230 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)
 2016-01-19 21:28:51 +08:00
Jian He
bb2a9a78c0 YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan 2016-01-18 21:05:03 -08:00
Wangda Tan
704b37d0e1 YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 
(cherry picked from commit a44ce3f14fd940601f984fbf7980aa6fdc8f23b7)
 2016-01-19 09:31:13 +08:00
Wangda Tan
1625281ccb Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" 
This reverts commit 3fe57285635e8058c34aa40a103845b49ca7d6ff.

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 150f5ae0343e872ee8bef39c57008c1389f0ba9e)
 2016-01-19 09:31:07 +08:00
Jian He
6db022fc48 YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu 2016-01-18 16:59:04 -08:00
rohithsharmaks
da887e4252 YARN-4265 Addendum patch to fix compilation issue caused by project version number 2016-01-18 16:38:41 +05:30
Karthik Kambatla
ef59521094 YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha) 
(cherry picked from commit d40859fab1ad977636457a6cc96b6a4f9b903afc)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapred/TestTaskAttemptListenerImpl.java
 2016-01-18 10:59:34 +01:00
Wangda Tan
c56d46307a Move YARN-4524 from 2.9 to 2.8 2016-01-18 17:04:41 +08:00
Wangda Tan
552f15739c YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda) 
(cherry picked from commit b08ecf5c7589b055e93b2907413213f36097724d)
 2016-01-18 11:16:04 +08:00
Wangda Tan
6dab78c71a YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 
(cherry picked from commit 805a9ed85eb34c8125cfb7d26d07cdfac12b3579)
 2016-01-18 11:15:59 +08:00
Wangda Tan
c1193b46d4 YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda) 
(cherry picked from commit 9523648d57ebc71cf5c57f3f8c52c4a63265b61c)
 2016-01-18 11:15:53 +08:00
Junping Du
4a30a44b11 YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe 
(cherry picked from commit 02f597c5db36ded385413958bdee793ad7eda40e)
 2016-01-17 17:38:42 -08:00
Colin Patrick Mccabe
48b8c99479 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) 
(cherry picked from commit b2c155f810888480d058512a326a5083e1bb4eaa)
 2016-01-15 13:22:14 -08:00
rohithsharmaks
d3c08cde68 YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks) 2016-01-15 22:46:21 +05:30
Junping Du
e09222306f YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee. 
(cherry picked from commit fc6d3a3b234efff2b0b646c31a4e6ff0a5118ef9)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-15 08:43:30 -08:00
Colin Patrick Mccabe
cea1c71087 HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe) 
(cherry picked from commit b1ed28fa77cb2fab80c54f9dfeb5d8b7139eca34)

Conflicts:
	hadoop-common-project/hadoop-common/pom.xml
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/pom.xml
 2016-01-14 11:13:13 -08:00
Karthik Kambatla
f0923819c3 YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha) 
(cherry picked from commit 9d04f26d4c42170ee3dab2f6fb09a94bbf72fc65)
 2016-01-14 08:33:52 -08:00
Varun Vasudev
6220a024b1 YARN-4553. Add cgroups support for docker containers. Contributed by Sidharta Seethana. 
(cherry picked from commit 3ddb92bd30d4a267c5c35b410b21c6ea42a7238b)
 2016-01-14 14:30:19 +05:30
Akira Ajisaka
ffca0ebfff YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun. 
(cherry picked from commit 62b0d6151362a9860d4d750e6e0d032882af68aa)
 2016-01-14 13:59:58 +09:00
Karthik Kambatla
a1ff0b4145 YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha) 
(cherry picked from commit 321072ba8114ed5ad2e9c5c2cfd7e1a54def6ebe)
 2016-01-13 12:09:58 -08:00
Wangda Tan
c0b97865e8 YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda) 
(cherry picked from commit c0537bcd2c2dcdb4812fcab7badf42e4f55a54d9)
 2016-01-13 13:19:01 +08:00
Jason Lowe
d164cdcda1 YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li 
(cherry picked from commit 13de8359a1c6d9fc78cd5013c860c1086d86176f)
 2016-01-12 15:57:07 +00:00
Jason Lowe
8d34d899e4 Update CHANGES.txt for recent commits to 2.7 and 2.6 
(cherry picked from commit c77c35f83ce953005fe0d3334acf0f0013a82139)
 2016-01-12 15:45:21 +00:00
Akira Ajisaka
93b7ef8aec YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67. 
(cherry picked from commit da1e3e3c571e7cc76adff198bf433e3f23e8b683)
 2016-01-12 15:13:38 +09:00
Wangda Tan
15e174fe79 YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda) 
(cherry picked from commit 9e792da01419998c2ebfafd7161070150d85d3ac)
 2016-01-12 12:54:09 +08:00
Akira Ajisaka
df95343047 HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
 2016-01-12 13:34:44 +09:00
Jian He
c4aed35200 Missing file for YARN-4580 2016-01-11 17:05:11 -08:00
Jian He
591e7fb221 YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S 
(cherry picked from commit b8942be888e1f6f7049398f3d0322602a58ee312)
 2016-01-11 16:45:14 -08:00
Rohith Sharma K S
da42b01645 Add YARN-3849 to Release 2.6.4 entry in CHANGES.txt 
(cherry picked from commit 76e72708511100dbfaba910e120892b87b87edee)
 2016-01-11 12:18:12 +05:30
Jian He
d4ff8fd5d8 YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S 
(cherry picked from commit 109e528ef5d8df07443373751266b4417acc981a)
 2016-01-08 15:51:33 -08:00
Xuan
2cbbf76c3d YARN-4438. Implement RM leader election with curator. Contributed by Jian He 
(cherry picked from commit 89022f8d4bac0e9d0b848fd91e9c4d700fe1cdbe)
 2016-01-07 14:34:14 -08:00
Akira Ajisaka
3905435d3d YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi. 
(cherry picked from commit 52b77577c44538c26fb9d0144f0b280be3593a38)
 2016-01-08 01:13:30 +09:00
Steve Loughran
d9459ffa00 YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel) 2016-01-07 14:30:07 +00:00