Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,369 Commits 326 Branches 371 Tags
Commit Graph

5132 Commits

Author SHA1 Message Date
Wangda Tan
5f7ed043c8 YARN-8456. Fix a configuration handling bug when user leave FPGA discover executable path configuration default but set OpenCL SDK path environment variable. (Zhankun Tang via wangda) 
Change-Id: Iff150ea98ba0c60d448474fd940eb121afce6965
(cherry picked from commit a457a8951a1b35f06811c40443ca44bb9c698c30)
 2018-10-18 12:12:14 -07:00
Wangda Tan
a7785d2764 YARN-6098. Add documentation for Delete Queue. (Suma Shivaprasad via wangda) 
Change-Id: I23bf7ca0acbe1168a7f805ceccdd62fe41bfeb35
(cherry picked from commit bfb88b10f46a265aa38ab3e1d87b6a0a99d94be8)
 2018-10-18 12:12:09 -07:00
Eric Yang
4681e17a36 YARN-8687. Update YARN service file type in documentation. 
Contributed by Suma Shivaprasad
 2018-10-18 12:04:04 -04:00
Sunil G
bde4fd5ed9 Preparing for 3.2.0 release 2018-10-18 17:07:45 +05:30
Sunil G
6380ee5512 YARN-8759. Copy of resource-types.xml is not deleted if test fails, causes other test failures. Contributed by Antal Bálint Steinbach. 
(cherry picked from commit 5085e5fa9e8c7e489a8518e8541c12b14f3651df)
 2018-10-17 16:06:07 +05:30
Eric Yang
fc25def7d7 YARN-8810. Fixed a YARN service bug in comparing ConfigFile object. 
Contributed by Chandni Singh
 2018-10-16 18:57:50 -04:00
Wangda Tan
80ee60c88c YARN-8892. YARN UI2 doc changes to update security status (verified under security environment). (Sunil G via wangda) 
Change-Id: I8bc8622936861b8d6de3e42a0b75af86ad8a3961
(cherry picked from commit 538250db26ce0b261bb74053348cddfc2d65cf52)
 2018-10-16 13:53:08 -07:00
Wangda Tan
aa23c8d739 YARN-8798. [Submarine] Job should not be submitted if --input_path option is missing. (Zhankun Tang via wangda) 
Change-Id: I7ae0e44eb5179b04a6ac861ec1c65f3b18c38f0f
(cherry picked from commit 143d74775b2b62884090fdd88874134b9eab2888)
 2018-10-16 13:53:03 -07:00
Wangda Tan
920401b296 YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda) 
Change-Id: I46e8d9fd32c7745c313030da62da41486a77b3ea
(cherry picked from commit 46d6e0016610ced51a76189daeb3ad0e3dbbf94c)
 2018-10-16 13:52:58 -07:00
Wangda Tan
8610c20724 YARN-8875. [Submarine] Add documentation for submarine installation script details. (Xun Liu via wangda) 
Change-Id: I1c8d39c394e5a30f967ea514919835b951f2c124
(cherry picked from commit ed08dd3b0c9cec20373e8ca4e34d6526bd759943)
 2018-10-16 13:52:53 -07:00
Sunil G
a439aa79dc YARN-8879. Kerberos principal is needed when submitting a submarine job. Contributed by Zac Zhou. 
(cherry picked from commit 753f149fd3f5acf9a98cfc780d7899e307c19002)
 2018-10-16 22:18:30 +05:30
Sunil G
1ca5f974f1 YARN-8869. YARN Service Client might not work correctly with RM REST API for Kerberos authentication. Contributed by Eric Yang. 
(cherry picked from commit fa94d370b6e3cba9c7560c09b517583e6652f103)
 2018-10-15 21:22:45 +05:30
Vrushali C
62d329cac0 YARN-5742 Serve aggregated logs of historical apps from timeline service. Contributed by Rohith Sharma KS 
(cherry picked from commit 8d1981806feb8278966c02a9eff42d72541bb35e)
 2018-10-12 07:18:13 +05:30
Jason Lowe
cdbca8b133 YARN-8861. executorLock is misleading in ContainerLaunch. Contributed by Chandni Singh 
(cherry picked from commit e787d65a08f5d5245d2313fc34f2dde518bfaa5b)
 2018-10-11 10:58:48 -05:00
Sunil G
f29a7fdb14 YARN-8753. [UI2] Lost nodes representation missing from Nodemanagers Chart. Contributed by Yesha Vora. 
(cherry picked from commit 8a379839909197690af170afc13c49ef7aa54286)
 2018-10-11 16:16:05 +05:30
Sunil G
0bf0fb5499 YARN-8666. [UI2] Remove application tab from YARN Queue Page. Contributed by Yesha Vora. 
(cherry picked from commit d3da741fa27c14f3d1391a76d6ade5d1a8365aa5)
 2018-10-11 16:07:08 +05:30
Jason Lowe
145c7aa663 YARN-7644. NM gets backed up deleting docker containers. Contributed by Chandni Singh 
(cherry picked from commit 5ce70e1211e624d58e8bb1181aec00729ebdc085)
 2018-10-10 10:01:52 -05:00
Weiwei Yang
eb0147a4c7 YARN-8858. CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. Contributed by Wangda Tan. 
(cherry picked from commit edce866489d83744f3f47a3b884b0c6136885e4a)
 2018-10-10 09:42:45 +08:00
Eric Yang
614d6cf99c YARN-8845. Removed unused hadoop.registry.rm reference. 
Contributed by Íñigo Goiri

(cherry picked from commit bf04f194568f9e81f5481b25a84ad903e3c307cf)
 2018-10-09 15:56:04 -04:00
Wangda Tan
8e8b748724 YARN-8852. Add documentation for submarine installation details. (Zac Zhou via wangda) 
Change-Id: If5681d1ef37ff5dc916735eeef15a6120173d653
(cherry picked from commit a23ea68b9747eae9b176f908bb04b76d30fe3795)
 2018-10-09 10:19:16 -07:00
Sunil G
f6a73d181f YARN-8853. [UI2] Application Attempts tab is not shown correctly when there are no attempts. Contributed by Akhil PB. 
(cherry picked from commit 6f11919beb71f3bab7a49f2866c03bca5a4afc3b)
 2018-10-09 22:05:53 +05:30
Inigo Goiri
21553e22b6 YARN-8843. updateNodeResource does not support units for memory. Contributed by Manikandan R. 
(cherry picked from commit 745f64012a2a912d5f0a36bbda89dc638e1715cb)
 2018-10-08 10:40:59 -07:00
Sunil G
50acba2e39 YARN-7825. [UI2] Maintain constant horizontal application info bar for Application Attempt page. Contributed by Akhil PB. 
(cherry picked from commit 228dc192f1108438e2a221ec2ed7b6fd44080295)
 2018-10-08 11:55:50 +05:30
Vidura Mudalige
843e7f81fe
YARN-8819. Fix findbugs warnings in YarnServiceUtils 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit b85ee0d75d450f1c695cec1bebac627f66a97c98)
 2018-10-07 00:55:08 +09:00
Sunil G
a7711073ac YARN-8797. [UI2] Improve error pages in new YARN UI. Contributed by Akhil PB. 
(cherry picked from commit 94d82f416258b65c8ab7849a459af78abebdf7d0)
 2018-10-05 14:33:47 +05:30
Sunil G
8957a61ed9 YARN-7957. [UI2] YARN service delete option disappears after stopping application. Contributed by Akhil PB. 
(cherry picked from commit 751f626e506b6cf8cc87ca65b65550871dca74fb)
 2018-10-05 12:29:08 +05:30
Wangda Tan
b3ac886933 YARN-8844. TestNMProxy unit test is failing. (Eric Yang via wangda) 
Change-Id: I241fa8701b6f1dbcad87fd2e9a429e32e7aa40f5
 2018-10-04 10:48:47 -07:00
Wangda Tan
abe4a8e5d8 YARN-8758. Support getting PreemptionMessage when using AMRMClientAsyn. (Zian Chen via wangda) 
Change-Id: Ibf5d165f49957b582eeadeb41dc285c84d2f05e7
(cherry picked from commit 6926fd0ec634df2576bbc9f45e9636b99260db72)
 2018-10-04 10:43:16 -07:00
Akira Ajisaka
4de3cf1968
YARN-8840. Add missing cleanupSSLConfig() call for TestTimelineClient test. Contributed by Aki Tanaka. 
(cherry picked from commit 39b35036ba47064149003046a7b59feb01575d1e)
 2018-10-04 09:52:50 +09:00
Shane Kumpf
5edb9d3b97 YARN-8785. Improve the error message when a bind mount is not whitelisted. Contributed by Simon Prewo 2018-10-02 07:16:29 -06:00
Haibo Chen
d0ee6fbe28 YARN-8621. Add test coverage of custom Resource Types for the apps/<appId> REST API endpoint. (Contributed by Szilard Nemeth) 2018-10-01 14:46:42 -07:00
Giovanni Matteo Fumarola
59d5af21b7 YARN-8760. [AMRMProxy] Fix concurrent re-register due to YarnRM failover in AMRMClientRelayer. Contributed by Botong Huang. 2018-10-01 13:12:38 -07:00
Weiwei Yang
fd6be5898a YARN-8468. Enable the use of queue based maximum container allocation limit and implement it in FairScheduler. Contributed by Antal Bálint Steinbach. 2018-09-29 17:47:12 +08:00
Sunil G
19ad5be651 YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. 2018-09-29 00:01:04 +05:30
Billie Rinaldi
d1c1dde309 YARN-8734. Readiness check for remote service belonging to the same user. Contributed by Eric Yang 2018-09-28 09:40:48 -07:00
Eric E Payne
8598b498bc YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang. 2018-09-28 15:32:07 +00:00
bibinchundatt
7093afd874 YARN-8829. Cluster metrics can fail with IndexOutOfBoundsException. Contributed by Akshay Agarwal. 2018-09-28 12:35:33 +05:30
Vrushali C
90e2e493b3 YARN-8270 Adding JMX Metrics for Timeline Collector and Reader. Contributed by Sushil Ks. 2018-09-27 15:53:39 -07:00
Eric Yang
b237a0dd44 YARN-6456. Added config to set default container runtimes. 
Contributed by Craig Condit
 2018-09-27 15:31:18 -04:00
Jason Lowe
6b988d821e YARN-8804. resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues. Contributed by Tao Yang 2018-09-26 14:43:00 -07:00
Eric Yang
913f87dada YARN-8665. Added Yarn service cancel upgrade option. 
Contributed by Chandni Singh
 2018-09-26 14:51:35 -04:00
Rohith Sharma K S
e5287a4fe0 YARN-8824. App Nodelabel missed after RM restart for finished apps. Contributed by Bibin A Chundatt. 2018-09-26 12:30:26 +05:30
Akira Ajisaka
44edcdfd6a
YARN-8745. Misplaced the TestRMWebServicesFairScheduler.java file. Contributed by Y. SREENIVASULU REDDY. 2018-09-26 10:09:11 +09:00
Akira Ajisaka
94b5c54e8a
YARN-8752. yarn-registry.md has wrong word ong-lived, it should be long-lived. Contributed by leiqiang. 2018-09-26 09:42:53 +09:00
Shane Kumpf
26c94a0fd0 YARN-8623. Update Docker examples to use image which exists. Contributed by Craig Condit 2018-09-25 06:38:25 -06:00
Rohith Sharma K S
50bc7746d7 YARN-8815. RM fails to recover finished unmanaged AM. Contributed by Bibin A Chundatt. 2018-09-25 11:31:14 +05:30
Sunil G
d0bc6a27fd YARN-8817. [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework requires user to set HDFS related environments. Contributed by Wangda Tan. 2018-09-25 11:23:34 +05:30
Haibo Chen
29dad7d258 YARN-8616. systemClock should be used in RMAppImpl instead of System.currentTimeMills(), to be consistent. (Contributed by Szilard Nemeth) 2018-09-24 16:04:28 -07:00
Haibo Chen
cf62ff9a6a YARN-6338. Typos in Docker docs: contains => containers. (Contributed by Zoltan Siegl) 2018-09-24 15:54:02 -07:00
Giovanni Matteo Fumarola
3090922805 YARN-8696. [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async. Contributed by Botong Huang. 2018-09-24 11:37:05 -07:00