Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,368 Commits 326 Branches 371 Tags
Commit Graph

1832 Commits

Author SHA1 Message Date
Junping Du
b91e1b0feb YARN-3296. Mark ResourceCalculatorProcessTree class as Public for configurable resource monitoring. Contributed by Hitesh Shah 
(cherry picked from commit 7ce3c7635392c32f0504191ddd8417fb20509caa)
 2015-03-08 14:48:42 -07:00
Jason Lowe
ef3d9bdf6b YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne 
(cherry picked from commit 27e8ea820fab8dce59f4db9814e73bd60c1d4ef1)
 2015-03-06 22:45:09 +00:00
Jian He
6cef2c16de YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu 
(cherry picked from commit 21101c01f242439ec8ec40fb3a9ab1991ae0adc7)
 2015-03-06 14:18:56 -08:00
Xuan
56c2050ab7 YARN-3227. Timeline renew delegation token fails when RM user's TGT is 
expired. Contributed by Zhijie Shen

(cherry picked from commit d1abc5d4fc00bb1b226066684556ba16ace71744)
 2015-03-06 13:33:18 -08:00
Jian He
a5f3fb4dc1 YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong 
(cherry picked from commit 95bfd087dc89e57a93340604cc8b96042fa1a05a)
 2015-03-05 21:27:03 -08:00
Vinod Kumar Vavilapalli
9c8882546a YARN-2786. Created a yarn cluster CLI and seeded with one command for listing node-labels collection. Contributed by Wangda Tan. 2015-03-05 10:56:28 -08:00
Tsuyoshi Ozawa
5680b41597 Update CHANGES.txt for YARN-2616 to fix indentation. 
(cherry picked from commit 28b85a2116c3061fcb739aaca0dff89ff2a925e4)
 2015-03-06 00:53:20 +09:00
Tsuyoshi Ozawa
6660c2f83b YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi. 
(cherry picked from commit 1b672096121fef775572b517d4f5721997abbac6)
 2015-03-05 19:56:59 +09:00
Karthik Kambatla
0d62e94887 YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha) 
(cherry picked from commit 8d88691d162f87f95c9ed7e0a569ef08e8385d4f)
 2015-03-04 19:49:21 -08:00
Karthik Kambatla
721d7b5741 YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha) 
(cherry picked from commit 22426a1c9f4bd616558089b6862fd34ab42d19a7)
 2015-03-04 18:07:33 -08:00
Karthik Kambatla
1749094fab YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha) 
(cherry picked from commit 53947f37c7a84a84ef4ab1a3cab63ff27c078385)
 2015-03-04 17:39:39 -08:00
Jason Lowe
ab397194c3 YARN-3131. YarnClientImpl should check FAILED and KILLED state in submitApplication. Contributed by Chang Li 
(cherry picked from commit 03cc22945e5d4e953c06a313b8158389554a6aa7)
 2015-03-04 18:05:20 +00:00
Jian He
aafe571398 YARN-3285. (Backport YARN-3168) Convert branch-2 .apt.vm files of YARN to markdown. Contributed by Masatake Iwasaki 2015-03-03 16:44:59 -08:00
Wangda Tan
0a502c665b YARN-3272. Surface container locality info in RM web UI (Jian He via wangda) 
(cherry picked from commit e17e5ba9d7e2bd45ba6884f59f8045817594b284)
 2015-03-03 11:49:45 -08:00
Vinod Kumar Vavilapalli
253c78548b YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan. 
(cherry picked from commit 14dd647c556016d351f425ee956ccf800ccb9ce2)
 2015-03-02 17:54:01 -08:00
Wangda Tan
19a8e48230 YARN-3270. Fix node label expression not getting set in ApplicationSubmissionContext (Rohit Agarwal via wangda) 
(cherry picked from commit abac6eb9d530bb1e6ff58ec3c75b17d840a0ee3f)
 2015-03-02 17:24:55 -08:00
Jian He
76b7283fa1 YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu 
(cherry picked from commit 5d0bae550f5b9a6005aa1d373cfe1ec80513dbd9)
 2015-03-02 14:43:12 -08:00
Wangda Tan
0b0be0056b YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda) 
(cherry picked from commit edcecedc1c39d54db0f86a1325b4db26c38d2d4d)
 2015-02-27 16:14:35 -08:00
Tsuyoshi Ozawa
79f73f4613 YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu. 
(cherry picked from commit 01a1621930df17a745dd37892996c68fca3447d1)
 2015-02-28 00:57:01 +09:00
Konstantin V Shvachko
9e67f2cb0d YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko. 2015-02-26 17:26:08 -08:00
Tsuyoshi Ozawa
dc348f4894 YARN-3217. Remove httpclient dependency from hadoop-yarn-server-web-proxy. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 773b6515ac51af3484824bd6f57685a9726a1e70)
 2015-02-27 00:25:12 +09:00
Devaraj K
f83d2e4410 YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against 
all Schedulers even when using ParameterizedSchedulerTestBase. Contributed
by Anubhav Dhoot.

(cherry picked from commit 0d4296f0e0f545267f2e39a868d4ffefc9844db8)
 2015-02-26 15:47:32 +05:30
Jason Lowe
257087417e YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params. Contributed by Jian He 
(cherry picked from commit 1a68fc43464d3948418f453bb2f80df7ce773097)
 2015-02-25 16:15:35 +00:00
Tsuyoshi Ozawa
13e213c41a YARN-3247. TestQueueMappings should use CapacityScheduler explicitly. Contributed by Zhihai Xu. 
(cherry picked from commit 6cbd9f1113fca9ff86fd6ffa783ecd54b147e0db)
 2015-02-25 11:23:34 +09:00
Devaraj K
b9e82e27f5 YARN-2797. Add -help to yarn logs and nodes CLI command. Contributed by 
Jagadesh Kiran N.

(cherry picked from commit b610c68d4423a5a1ab342dc490cd0064f8983c07)
 2015-02-24 12:08:50 +05:30
Xuan
0ca974d0b0 YARN-2797. TestWorkPreservingRMRestart should use 
ParametrizedSchedulerTestBase. Contributed by Karthik Kambatla

(cherry picked from commit fe7a302473251b7310105a936edf220e401c613f)
 2015-02-21 19:19:08 -08:00
Xuan
f8435c5d3d YARN-3236. Cleanup RMAuthenticationFilter#AUTH_HANDLER_PROPERTY. 
Contributed by zhihai xu

(cherry picked from commit e3d290244c8a39edc37146d992cf34e6963b6851)
 2015-02-21 16:20:33 -08:00
Xuan
fefeba4ac8 YARN-3238. Connection timeouts to nodemanagers are retried at multiple 
levels. Contributed by Jason Lowe

(cherry picked from commit 92d67ace3248930c0c0335070cc71a480c566a36)
 2015-02-21 16:07:28 -08:00
Xuan
9cbe9bcbaa YARN-3237. AppLogAggregatorImpl fails to log error cause. Contributed by 
Rushabh S Shah

(cherry picked from commit f56c65bb3eb9436b67de2df63098e26589e70e56)
 2015-02-20 14:03:46 -08:00
Wangda Tan
a1963968d2 YARN-3230. Clarify application states on the web UI. (Jian He via wangda) 
(cherry picked from commit ce5bf927c3d9f212798de1bf8706e5e9def235a1)
 2015-02-20 10:40:04 -08:00
Junping Du
4a87a61fe9 YARN-2799. Cleanup TestLogAggregationService based on the change in YARN-90. Contributed by Zhihai Xu 
(cherry picked from commit c33ae271c24f0770c9735ccd2086cafda4f4e0b2)
 2015-02-20 09:44:31 -08:00
Jason Lowe
3e8dfd1299 YARN-3194. RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node. Contributed by Rohith 
(cherry picked from commit a64dd3d24bfcb9af21eb63869924f6482b147fd3)
 2015-02-20 15:12:08 +00:00
Jian He
eaeaf80d39 YARN-933. Fixed InvalidStateTransitonException at FINAL_SAVING state in RMApp. Contributed by Rohith Sharmaks 
(cherry picked from commit c0d9b93953767608dfe429ddb9bd4c1c3bd3debf)
 2015-02-19 15:43:14 -08:00
Wangda Tan
cd5eb9c1de YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda) 
(cherry picked from commit d49ae725d5fa3eecf879ac42c42a368dd811f854)
 2015-02-19 11:01:47 -08:00
Tsuyoshi Ozawa
fef5efa0cb YARN-1615. Fix typos in delay scheduler's description. Contributed by Akira Ajisaka. 
(cherry picked from commit b8a14efdf535d42bcafa58d380bd2c7f4d36f8cb)
 2015-02-19 10:24:40 +09:00
Jian He
b8fe1a747e YARN-1514. Utility to benchmark ZKRMStateStore#loadState for RM HA. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 1c03376300a46722d4147f5b8f37242f68dba0a2)
 2015-02-18 16:34:42 -08:00
Jian He
8f06eaa251 YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan 
(cherry picked from commit f5da5566d9c392a5df71a2dce4c2d0d50eea51ee)
 2015-02-18 11:52:28 -08:00
Xuan
ba18adbb27 YARN-3207. Secondary filter matches entites which do not have the key 
being filtered for. Contributed by Zhijie Shen

(cherry picked from commit 57db50cbe3ce42618ad6d6869ae337d15b261f4e)
 2015-02-17 18:18:56 -08:00
Tsuyoshi Ozawa
fabac2ff30 YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and Devaraj K. 
(cherry picked from commit 556386a07084b70a5d2ae0c2bd4445a348306db8)
 2015-02-17 01:54:09 +09:00
Tsuyoshi Ozawa
42368b91c4 Revert "YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj." 
This reverts commit 67e3a77720cfcb0fc540e8e0c80a5d42b8140fcc.
 2015-02-17 01:53:58 +09:00
Tsuyoshi Ozawa
67e3a77720 YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj. 
(cherry picked from commit 9aae81c93421874b726c7b6ff970895c429e502d)
 2015-02-17 01:48:53 +09:00
Tsuyoshi Ozawa
fd8f7e2c7d YARN-3203. Correct a log message in AuxServices. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 447bd7b5a61a5788dc2a5d29cedfc19f0e99c0f5)
 2015-02-16 23:56:32 +09:00
Junping Du
eee89bd18c YARN-2749. Fix some testcases from TestLogAggregationService fails in trunk. (Contributed by Xuan Gong) 
(cherry picked from commit ab0b958a522d502426b91b6e4ab6dd29caccc372)
 2015-02-15 06:48:29 -08:00
cnauroth
48302e687a YARN-2899. Run TestDockerContainerExecutorWithMocks on Linux only. Contributed by Ming Ma. 
(cherry picked from commit 6804d689019e4d2dfb2b35fd82f775a13e85960c)
 2015-02-13 21:59:14 -08:00
Jason Lowe
c9cd58d711 YARN-2847. Linux native container executor segfaults if default banned user detected. Contributed by Olaf Flebbe 
(cherry picked from commit 1a0f508b6386b1c26ec606f6d73afddaa191b7d8)
 2015-02-13 20:22:12 +00:00
Xuan
3c4b5606dc YARN-3164. RMAdmin command usage prints incorrect command name. 
Contributed by Bibin A Chundatt

(cherry picked from commit 253035491ce208a8c9b50a20da91f5b8e679eebf)
 2015-02-12 21:40:42 -08:00
Tsuyoshi Ozawa
613065d75a YARN-3182. Cleanup switch statement in ApplicationMasterLauncher#handle(). Contributed by Ray Chiang. 
(cherry picked from commit 110cf6b9a3b64cc2159e708967b854f5a419d438)
 2015-02-13 14:21:43 +09:00
Tsuyoshi Ozawa
43429cd33a YARN-2994. Document work-preserving RM restart. Contributed by Jian He. 
(cherry picked from commit b0d81e05abd730a923aed4727a8191650aebd2f9)
 2015-02-13 13:08:37 +09:00
Akira Ajisaka
9d8dbf8ea4 YARN-3191. Log object should be initialized with its own class. Contributed by Rohith. 
(cherry picked from commit 99c7f2b8fa417303e8f42ea3641c302135879280)
 2015-02-12 17:59:04 -08:00
Xuan
df6bee5a75 YARN-3179. Update use of Iterator to Iterable in RMAdminCLI and 
CommonNodeLabelsManager. Contributed by Ray Chiang

(cherry picked from commit 2586915bb3178d26ad692f93d53aaffbb55d9ed9)
 2015-02-12 17:32:58 -08:00