Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,694 Commits 326 Branches 371 Tags
Commit Graph

1318 Commits

Author SHA1 Message Date
Jian He
d61cdd66db YARN-2559. Fixed NPE in SystemMetricsPublisher when retrieving FinalApplicationStatus. Contributed by Zhijie Shen 
(cherry picked from commit ee21b13cbd4654d7181306404174329f12193613)
 2014-09-17 21:44:49 -07:00
Jian He
3746b1e905 YARN-2558. Updated ContainerTokenIdentifier#read/write to use ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA. 
(cherry picked from commit f4886111aa573ec928de69e8ca9328d480bf673e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-09-17 15:22:02 -07:00
junping_du
c6b9768b36 YARN-1250. Addendum 
(cherry picked from commit 0e7d1dbf9ab732dd04dccaacbf273e9ac437eba5)
 2014-09-16 18:30:31 -07:00
XuanGong
03fdbd7899 YARN-2557. Add a parameter "attempt_Failures_Validity_Interval" into 
DistributedShell. Contributed by Xuan Gong
 2014-09-16 11:01:26 -07:00
Vinod Kumar Vavilapalli
9d34dc87e1 YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev. 
(cherry picked from commit 9f6891d9ef7064d121305ca783eb62586c8aa018)
 2014-09-16 10:15:37 -07:00
Jian He
1c3f837835 YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen 
(cherry picked from commit 88e329fdfb27c11f1964c0345188bcf328c95fd6)
 2014-09-15 13:15:07 -07:00
cnauroth
aaef460e7a YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest classes. Contributed by Chris Nauroth. 
(cherry picked from commit 9d4ec97c95b51c6f99112030da91950551b22b9c)
 2014-09-15 11:54:41 -07:00
Vinod Kumar Vavilapalli
5cdb24d4b1 YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong. 
(cherry picked from commit 14e2639fd0d53f7e0b58f2f4744af44983d4e867)
 2014-09-13 18:05:02 -07:00
Zhijie Shen
99ccd842d8 YARN-2528. Relaxed http response split vulnerability protection for the origins header and made it accept multiple origins in CrossOriginFilter. Contributed by Jonathan Eagles. 
(cherry picked from commit 98588cf044d9908ecf767257c09a52cf17aa2ec2)
 2014-09-12 21:35:49 -07:00
Jian He
09ad86d70c YARN-2542. Fixed NPE when retrieving ApplicationReport from TimeLineServer. Contributed by Zhijie Shen 
(cherry picked from commit a0ad975ea1e70f9532cf6cb6c1d9d92736ca0ebc)
 2014-09-12 15:28:10 -07:00
XuanGong
add5ac6a73 YARN-2456. Possible livelock in CapacityScheduler when RM is recovering 
apps. Contributed by Jian He
 2014-09-12 15:24:02 -07:00
Jonathan Eagles
546a708acc YARN-2547. Cross Origin Filter throws UnsupportedOperationException upon destroy (Mit Desai via jeagles) 
(cherry picked from commit 54e5794806bd856da0277510efe63656eed23146)
 2014-09-12 15:41:31 -05:00
Jian He
f21a5236e5 YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 3122daa80261b466e309e88d88d1e2c030525e3f)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/preemption/CheckpointAMPreemptionPolicy.java
 2014-09-12 10:45:42 -07:00
Jason Lowe
7e69dc8771 YARN-2484. FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 78b048393a80a9bd1399d08525590bb211a32d8c)
 2014-09-12 14:10:51 +00:00
Zhijie Shen
466bdf79c5 YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. Contributed by Xuan Gong. 
(cherry picked from commit 469ea3dcef6e427d02fd08b859b2789cc25189f9)
 2014-09-11 22:21:59 -07:00
Jian He
f580586ab7 YARN-2541. Fixed ResourceManagerRest.apt.vm table syntax error. Contributed by Jian He 
(cherry picked from commit 5633da2a018efcfac03cc1dd65af79bce2f1a11b)
 2014-09-11 21:31:56 -07:00
junping_du
efa9ab3638 YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen) 
(cherry picked from commit 6b8b1608e64e300e4e1d23c60476febaca29ca38)
 2014-09-12 10:08:06 +08:00
Karthik Kambatla
d22cd065ed Update CHANGES.txt to set the release date for 2.5.1 
(cherry picked from commit 17ffbe08642c622f099dd1cd9cb9e008ba98ea52)
 2014-09-11 17:36:06 -07:00
Karthik Kambatla
6f8b2a8e2e YARN-2534. FairScheduler: Potential integer overflow calculating totalMaxShare. (Zhihai Xu via kasha) 
(cherry picked from commit c11ada5ea6d17321626e5a9a4152ff857d03aee2)
 2014-09-11 12:06:28 -07:00
Vinod Kumar Vavilapalli
a2a61eec6d YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all containers to a preconfigured limit. Contributed by Varun Vasudev. 
(cherry picked from commit 4be95175cdb58ff12a27ab443d609d3b46da7bfa)
 2014-09-10 19:24:14 -07:00
Jian He
ceae7be6b2 YARN-415. Capture aggregate memory allocation at the app-level for chargeback. Contributed by Eric Payne & Andrey Klochkov 
(cherry picked from commit 83be3ad44484bf8a24cb90de4b9c26ab59d226a8)
 2014-09-10 18:22:07 -07:00
XuanGong
5ca99b5297 Fix CHANGES.txt. Credit Mayank Bansal for his contributions on YARN-2459 2014-09-10 15:21:41 -07:00
Jian He
f58a076dbc YARN-2158. Fixed TestRMWebServicesAppsModification#testSingleAppKill test failure. Contributed by Varun Vasudev 
(cherry picked from commit cbfe26370b85161c79fdd48bf69c95d5725d8f6a)
 2014-09-10 12:48:40 -07:00
XUAN
b91ef0c502 YARN-2459. RM crashes if App gets rejected for any reason and HA is enabled. Contributed by Jian He 2014-09-10 11:51:57 -07:00
Vinod Kumar Vavilapalli
b4b59ef749 YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource types to the AMs. Contributed by Varun Vasudev. 
(cherry picked from commit b67d5ba7842cc10695d987f217027848a5a8c3d8)
 2014-09-10 10:17:30 -07:00
Karthik Kambatla
a19694f19d YARN-1458. FairScheduler: Zero weight can lead to livelock. (Zhihai Xu via kasha) 
(cherry picked from commit 3072c83b38fd87318d502a7d1bc518963b5ccdf7)
 2014-09-10 08:33:31 -07:00
Karthik Kambatla
fe9d1ee96f YARN-2526. SLS can deadlock when all the threads are taken by AMSimulators. (Wei Yan via kasha) 
(cherry picked from commit 28d99db99236ff2a6e4a605802820e2b512225f9)
 2014-09-09 15:15:42 -07:00
Jian He
c17810a84c YARN-2515. Updated ConverterUtils#toContainerId to parse epoch. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 0974f434c47ffbf4b77a8478937fd99106c8ddbd)
 2014-09-07 18:31:07 -07:00
Zhijie Shen
0974400b74 YARN-2507. Documented CrossOriginFilter configurations for the timeline server. Contributed by Jonathan Eagles. 
(cherry picked from commit 56dc496a1031621d2b701801de4ec29179d75f2e)
 2014-09-07 18:25:13 -07:00
Zhijie Shen
f2a5a5d4aa YARN-2512. Allowed pattern matching for origins in CrossOriginFilter. Contributed by Jonathan Eagles. 
(cherry picked from commit a092cdf32de4d752456286a9f4dda533d8a62bca)
 2014-09-07 17:52:38 -07:00
cnauroth
af1d389157 YARN-2519. Credential Provider related unit tests failed on Windows. Contributed by Xiaoyu Yao. 
(cherry picked from commit cbea1b10efd871d04c648af18449dc724685db74)
 2014-09-06 20:06:44 -07:00
Jonathan Eagles
c47d72d8d2 YARN-2508. Cross Origin configuration parameters prefix are not honored (Mit Desai via jeagles) 
(cherry picked from commit e6420fec0af9b8d4f424098688ae4926ff527fcf)
 2014-09-05 19:45:02 -05:00
Zhijie Shen
1e40cbba7f YARN-2511. Allowed all origins by default when CrossOriginFilter is enabled. Contributed by Jonathan Eagles. 
(cherry picked from commit 51a4faf52199b181471d591a9fde900fc166fc48)
 2014-09-04 15:03:50 -07:00
Jason Lowe
04d325afff YARN-2431. NM restart: cgroup is not removed for reacquired containers. Contributed by Jason Lowe 
(cherry picked from commit 3fa5f728c4d6944302621965d6a0376827af5b51)
 2014-09-04 21:14:20 +00:00
Jonathan Eagles
7e76039278 YARN-2509. Enable Cross Origin Filter for timeline server only and not all Yarn servers (Mit Desai via jeagles) 
(cherry picked from commit 91d45f0f017281c8ab7ac858aa5d618accb9ea44)
 2014-09-04 11:54:43 -05:00
Karthik Kambatla
96a13c6d0c YARN-2394. FairScheduler: Configure fairSharePreemptionThreshold per queue. (Wei Yan via kasha) 
(cherry picked from commit 1dcaba9a7aa27f7ca4ba693e3abb56ab3c59c8a7)
 2014-09-03 10:27:47 -07:00
Karthik Kambatla
7b9e763138 YARN-2395. FairScheduler: Preemption timeout should be configurable per queue. (Wei Yan via kasha) 
(cherry picked from commit 0f34e6f3873aee0f4932740ca790c6dd2a13b5d9)
 2014-08-30 01:22:44 -07:00
Jian He
38853c97c2 YARN-1506. Changed RMNode/SchedulerNode to update resource with event notification. Contributed by Junping Du 
(cherry picked from commit 5c14bc426b4be381383018ebc2236be83eef15cd)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-08-29 23:39:58 -07:00
Jason Lowe
b61b78e5c6 YARN-2462. TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync should have a test timeout. Contributed by Eric Payne 
(cherry picked from commit 9ecda8f4c7e10d825b884e35c994d241b9fc8907)
 2014-08-29 20:18:49 +00:00
Jian He
73a0e46657 YARN-2447. RM web service app submission doesn't pass secrets correctly. Contributed by Varun Vasudev 
(cherry picked from commit c686aa3533b42e1baf62a78bc1bfb0ac05be53bb)
 2014-08-29 11:44:27 -07:00
Hitesh Shah
aeb8667a06 YARN-2450. Fix typos in log messages. Contributed by Ray Chiang. 
(cherry picked from commit 3de66011c2e80d7c458a67f80042af986fcc677d)
 2014-08-29 11:18:54 -07:00
Zhijie Shen
77a4b014e6 YARN-2449. Fixed the bug that TimelineAuthenticationFilterInitializer is not automatically added when hadoop.http.filter.initializers is not configured. Contributed by Varun Vasudev. 
(cherry picked from commit 4bd0194e6be68421eb1dc87f9f031626112e4c50)
 2014-08-29 09:46:04 -07:00
Karthik Kambatla
f237dee156 YARN-2405. NPE in FairSchedulerAppsBlock. (Tsuyoshi Ozawa via kasha) 
(cherry picked from commit fa80ca49bdd741823ff012ddbd7a0f1aecf26195)
 2014-08-28 23:22:04 -07:00
Jian He
2545ee6244 Add CHANGES.txt for YARN-2406. 
(cherry picked from commit 9d68445710feff9fda9ee69847beeaf3e99b85ef)
 2014-08-28 21:59:59 -07:00
Jian He
5c63482aaa YARN-2182. Updated ContainerId#toString() to append RM Epoch number. Contributed by Tsuyoshi OZAWA 
(cherry-picked from commit e2d0ff364a84a4de10e7b11fe83cd3dab155a571)
 2014-08-27 10:11:24 -07:00
Zhijie Shen
0c785f0824 YARN-2035. FileSystemApplicationHistoryStore should not make working dir when it already exists. Contributed by Jonathan Eagles. 
(cherry picked from commit d778abf022b415c64223153814d4188c2b3dd797)
 2014-08-27 02:10:06 -07:00
Karthik Kambatla
9c43760e59 YARN-1326. RM should log using RMStore at startup time. (Tsuyoshi Ozawa via kasha) 
(cherry picked from commit d16bfd1d0f7cd958e7041be40763cc9983a7b80a)
 2014-08-27 01:44:28 -07:00
Karthik Kambatla
2a3c8331fe Add a section for 2.5.1 in CHANGES.txt 
(cherry picked from commit dc154ab86d694e68f54c635043eb55d501d0e242)
 2014-08-27 00:56:17 -07:00
Karthik Kambatla
21843592db YARN-2393. FairScheduler: Add the notion of steady fair share. (Wei Yan via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619852 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-22 16:00:57 +00:00
Jason Darrell Lowe
fab20109ae svn merge -c 1619614 FIXES: YARN-2434. RM should not recover containers from previously failed attempt when AM restart is not enabled. Contributed by Jian He 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619616 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-21 22:45:35 +00:00