Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,402 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

1926 Commits

Author SHA1 Message Date
Karthik Kambatla 527c40e4d6 YARN-1012. Report NM aggregated container resource utilization in heartbeat. (Inigo Goiri via kasha) 2015-07-09 09:35:14 -07:00
Akira Ajisaka d6325745e2 YARN-3690. [JDK8] 'mvn site' fails. Contributed by Brahma Reddy Battula. 2015-07-08 15:42:31 +09:00
Jian He c9dd2cada0 YARN-3892. Fixed NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails. Contributed by Bibin A Chundatt 2015-07-07 14:16:21 -07:00
Varun Vasudev c40bdb56a7 YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan. 2015-07-07 16:59:29 +05:30
Devaraj K af63427c6d YARN-3837. javadocs of TimelineAuthenticationFilterInitializer give wrong 
prefix for auth options. Contributed by Bibin A Chundatt.
 2015-07-07 12:06:30 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.) bf89ddb9b8 Release process for 2.7.1: Set the release date for 2.7.1. 2015-07-06 16:39:59 -07:00
Xuan 688617d6d7 YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner 
after create them. Contributed by zhihai xu
 2015-07-04 21:51:58 -07:00
Devaraj K 37d7395773 YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id 
properly in log. Contributed by Bibin A Chundatt.
 2015-07-02 10:20:31 +05:30
Wangda Tan 0e4b06690f YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) 2015-07-01 17:32:22 -07:00
Jason Lowe b5cdf78e8e YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena 2015-07-01 21:13:32 +00:00
Devaraj K 80a68d6056 YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a 
null attempt. Contributed by nijel.
 2015-07-01 19:03:44 +05:30
Devaraj K 7405c59799 YARN-3823. Fix mismatch in default values for 
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.
 2015-07-01 11:11:26 +05:30
Colin Patrick Mccabe d0cc0380b5 YARN-3827. Migrate YARN native build to new CMake framework (Alan Burlison via Colin P. McCabe) 2015-06-30 16:24:19 -07:00
Gera Shegalov 6f2a41e37d YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera) 2015-06-30 14:59:33 -07:00
Jian He 4672315e2d YARN-3770. SerializedException should also handle java.lang.Error on de-serialization. Contributed by Lavkesh Lahngir 2015-06-29 14:31:49 -07:00
Jian He 62e583c7dc YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti 2015-06-29 13:37:32 -07:00
Junping Du a95d39f9d0 YARN-3860. rmadmin -transitionToActive should check the state of non-target node. (Contributed by Masatake Iwasaki) 2015-06-28 22:26:47 -07:00
Vinod Kumar Vavilapalli aad6a7d5db Adding release 2.7.2 to CHANGES.txt. 2015-06-28 16:29:12 -07:00
Devaraj K b543d1a390 YARN-3859. LeafQueue doesn't print user properly for application add. 
Contributed by Varun Saxena.
 2015-06-28 10:04:50 +05:30
Xuan fe6c1bd73a YARN-2871. TestRMRestart#testRMRestartGetApplicationList sometime fails 
in trunk. Contributed by zhihai xu
 2015-06-26 19:43:59 -07:00
Jason Lowe 40b256949a YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena 2015-06-26 15:47:07 +00:00
Devaraj K b381f88c71 YARN-3745. SerializedException should also try to instantiate internal 
exception with the default constructor. Contributed by Lavkesh Lahngir.
 2015-06-25 17:38:11 +05:30
Devaraj K 57f1a01eda YARN-3826. Race condition in ResourceTrackerService leads to wrong 
diagnostics messages. Contributed by Chengbing Liu.
 2015-06-25 16:13:59 +05:30
Jonathan Eagles 4c659ddbf7 YARN-3360. Add JMX metrics to TimelineDataManager (Jason Lowe via jeagles) 2015-06-24 16:16:52 -05:00
rohithsharmaks 2df00d53d1 Move YARN-3790 from 2.7.1 to 2.8 in CHANGES.txt 2015-06-24 23:31:03 +05:30
rohithsharmaks dd4b387d96 YARN-3790. usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container (Zhihai Xu via rohithsharmaks) 2015-06-24 23:00:14 +05:30
Jason Lowe 8d58512d6e YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula 2015-06-24 16:37:39 +00:00
Jason Lowe 2a20dd9b61 YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong 2015-06-24 16:23:48 +00:00
Robert Kanter 99271b7621 YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter) 2015-06-22 18:02:27 -07:00
Karthik Kambatla 5ebf2817e5 YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha) 2015-06-22 17:47:47 -07:00
Xuan 6c7a9d502a YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth 2015-06-21 17:13:44 -07:00
Xuan 5b5bb8dcdc YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes 
after NM is reconnected. Contributed by zhihai xu
 2015-06-18 14:37:49 -07:00
Devaraj K 2ad668748e YARN-3824. Fix two minor nits in member variable properties of 
YarnConfiguration. Contributed by Ray Chiang.
 2015-06-18 16:44:08 +05:30
Xuan a826d432f9 YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena 2015-06-17 16:23:27 -07:00
Devaraj K ebb9a82519 YARN-3148. Allow CORS related headers to passthrough in 
WebAppProxyServlet. Contributed by Varun Saxena.
 2015-06-17 15:56:18 +05:30
Devaraj K 318d2cde7c YARN-3617. Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning 
always -1. Contributed by J.Andreina.
 2015-06-17 13:54:09 +05:30
Xuan e27d5a13b0 YARN-3714. AM proxy filter can not get RM webapp address from 
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki
 2015-06-16 14:06:16 -07:00
Devaraj K b039e69bb0 YARN-3789. Improve logs for LeafQueue#activateApplications(). Contributed 
by Bibin A Chundatt.
 2015-06-16 14:03:22 +05:30
Tsuyoshi Ozawa e8c514373f YARN-3711. Documentation of ResourceManager HA should explain configurations about listen addresses. Contributed by Masatake Iwasaki. 2015-06-16 10:12:38 +09:00
Devaraj K d8dcfa98e3 YARN-3794. TestRMEmbeddedElector fails because of ambiguous LOG reference. 
Contributed by Chengbing Liu.
 2015-06-12 13:42:49 +05:30
Xuan 5583f88bf7 YARN-3785. Support for Resource as an argument during submitApp call in 
MockRM test class. Contributed by Sunil G
 2015-06-10 21:40:48 -07:00
Zhijie Shen 8d0ef31632 YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong. 2015-06-08 23:14:58 -07:00
cnauroth a531b058ae YARN-3786. Document yarn class path options. Contributed by Brahma Reddy Battula. 2015-06-08 16:18:36 -07:00
Xuan 2b2465dfac YARN-3778. Fix Yarn resourcemanger CLI usage. Contributed by Brahma Reddy Battula 2015-06-08 15:43:03 -07:00
Jian He 960b8f19ca YARN-2716. Refactor ZKRMStateStore retry code with Apache Curator. Contributed by Karthik Kambatla 2015-06-08 14:50:58 -07:00
Devaraj K 126321eded YARN-3747. TestLocalDirsHandlerService should delete the created test 
directory logDir2. Contributed by David Moore.
 2015-06-08 15:32:13 +05:30
Devaraj K c7ee6c151c YARN-3780. Should use equals when compare Resource in 
RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.
 2015-06-08 11:54:55 +05:30
Karthik Kambatla bd69ea408f YARN-3655. FairScheduler: potential livelock due to maxAMShare limitation and container reservation. (Zhihai Xu via kasha) 2015-06-07 11:37:52 -07:00
Xuan 3e000a919f YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong 2015-06-05 12:48:52 -07:00
Karthik Kambatla 75885852cc YARN-3259. FairScheduler: Trigger fairShare updates on node events. (Anubhav Dhoot via kasha) 2015-06-05 09:39:41 -07:00
Zhijie Shen 18dd01d6bf YARN-3766. Fixed the apps table column error of generic history web UI. Contributed by Xuan Gong. 2015-06-04 14:47:08 -07:00
Jian He 1970ca7cbc YARN-2392. Add more diags about app retry limits on AM failures. Contributed by Steve Loughran 2015-06-04 11:14:09 -07:00
Jian He 6ad4e59cfc YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan 2015-06-04 10:52:59 -07:00
Wangda Tan ebd797c48f YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda) 2015-06-04 10:22:57 -07:00
Junping Du d7e7f6aa03 YARN-41. The RM should handle the graceful shutdown of the NM. Contributed by Devaraj K. 2015-06-04 04:59:27 -07:00
Xuan 5766a04428 YARN-3749. We should make a copy of configuration when init 
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
 2015-06-03 17:20:15 -07:00
Zhijie Shen bc85959edd Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong." 
This reverts commit 4a9ec1a824.
 2015-06-03 14:15:56 -07:00
Zhijie Shen 4eec2fd132 Revert "YARN-1462. Correct fix version from branch-2.7.1 to branch-2.8 in" 
This reverts commit 0b5cfacde6.
 2015-06-03 14:15:56 -07:00
Karthik Kambatla edb9cd0f7a YARN-3762. FairScheduler: CME on FSParentQueue#getQueueUserAclInfo. (kasha) 2015-06-03 13:47:24 -07:00
Jason Lowe e13b671aa5 YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled. Contributed by Rohith Sharmaks 2015-06-03 19:44:07 +00:00
Zhijie Shen dbc4f64937 YARN-3751. Fixed AppInfo to check if used resources are null. Contributed by Sunil G. 2015-06-03 11:51:41 -07:00
Xuan 0b5cfacde6 YARN-1462. Correct fix version from branch-2.7.1 to branch-2.8 in 
CHANGES.txt
 2015-06-01 11:39:00 -07:00
Wangda Tan 5cc3fced95 YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda) 2015-05-31 16:31:09 -07:00
Xuan 9686261ecb YARN-2900. Application (Attempt and Container) Not Found in AHS results 
in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai
 2015-05-31 15:37:05 -07:00
Xuan da05361c3b Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" 
This reverts commit 06f8e9caba.
 2015-05-31 00:26:04 -07:00
Xuan 06f8e9caba YARN-2900. Application (Attempt and Container) Not Found in AHS results 
in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai
 2015-05-30 21:56:19 -07:00
Zhijie Shen 4a9ec1a824 YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong. 2015-05-30 21:05:36 -07:00
Karthik Kambatla a8acdd65b3 YARN-3467. Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI. (Anubhav Dhoot via kasha) 2015-05-30 13:36:24 -07:00
Zhijie Shen eb6bf91eea YARN-3740. Fixed the typo in the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS. Contributed by Xuan Gong. 2015-05-29 18:17:48 -07:00
Robert Kanter 6aec13cb33 YARN-3713. Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition (zxu via rkanter) 2015-05-29 15:34:37 -07:00
Karthik Kambatla 3ae2a62501 YARN-3547. FairScheduler: Apps that have no resource demand should not participate scheduling. (Xianyin Xin via kasha) 2015-05-29 15:17:22 -07:00
Wangda Tan 788bfa0359 YARN-3716. Node-label-expression should be included by ResourceRequestPBImpl.toString. (Xianyin Xin via wangda) 2015-05-28 16:34:18 -07:00
Xuan 3077c299da YARN-3723. Need to clearly document primaryFilter and otherInfo value 
type. Contributed by Zhijie Shen
 2015-05-28 10:19:36 -07:00
Devaraj K 7e509f5843 YARN-3722. Merge multiple TestWebAppUtils into 
o.a.h.yarn.webapp.util.TestWebAppUtils. Contributed by Masatake Iwasaki.
 2015-05-28 15:35:06 +05:30
Zhijie Shen 54504133f4 YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong. 2015-05-27 16:52:22 -07:00
Allen Wittenauer d6e3164d4a YARN-2355. MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container (Darrell Taylor via aw) 2015-05-27 16:40:56 -07:00
Wangda Tan cab7674e54 YARN-3581. Deprecate -directlyAccessNodeLabelStore in RMAdminCLI. (Naganarasimha G R via wangda) 2015-05-27 15:34:38 -07:00
Wangda Tan ec0a852a37 YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda) 2015-05-27 12:51:20 -07:00
Wangda Tan cdbd66be11 YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda) 2015-05-26 15:58:47 -07:00
Jian He 10732d515f YARN-3632. Ordering policy should be allowed to reorder an application when demand changes. Contributed by Craig Welch 2015-05-26 12:00:51 -07:00
Vinod Kumar Vavilapalli 500a1d9c76 YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev. 2015-05-26 11:38:35 -07:00
Tsuyoshi Ozawa 9a3d617b63 YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka. 2015-05-26 19:07:40 +09:00
Xuan 39077dba2e YARN-2238. Filtering on UI sticks even if I move away from the page. 
Contributed by Jian He
 2015-05-25 22:39:16 -07:00
Jian He 446d51591e YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan 2015-05-22 15:58:22 -07:00
Xuan 455b3acf0e YARN-3701. Isolating the error of generating a single app report when 
getting all apps from generic history service. Contributed by Zhijie
Shen
 2015-05-22 14:34:39 -07:00
Junping Du 132d909d4a YARN-3594. WintuilsProcessStubExecutor.startStreamReader leaks streams. Contributed by Lars Francke. 2015-05-22 04:23:25 -07:00
Vinod Kumar Vavilapalli 53fafcf061 YARN-3684. Changed ContainerExecutor's primary lifecycle methods to use a more extensible mechanism of context objects. Contributed by Sidharta Seethana. 2015-05-21 15:50:23 -07:00
Karthik Kambatla 4513761869 YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha) 2015-05-21 13:44:42 -07:00
Devaraj K 0305316d69 YARN-3646. Applications are getting stuck some times in case of retry 
policy forever. Contributed by Raju Bairishetti.
 2015-05-21 20:14:44 +05:30
Akira Ajisaka a5def58087 YARN-3694. Fix dead link for TimelineServer REST API. Contributed by Jagadesh Kiran N. 2015-05-21 23:14:44 +09:00
Jian He 6329bd00fa YARN-3654. ContainerLogsPage web UI should not have meta-refresh. Contributed by Xuan Gong 2015-05-20 17:20:21 -07:00
Jian He 8966d42179 YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan 2015-05-20 16:30:07 -07:00
Xuan 5774f6b1e5 YARN-3681. yarn cmd says "could not find main class 'queue'" in windows. 
Contributed by Craig Welch and Varun Saxena
 2015-05-20 14:21:12 -07:00
Wangda Tan 03f897fd1a Move YARN-2918 from 2.8.0 to 2.7.1 2015-05-20 13:49:10 -07:00
Tsuyoshi Ozawa 7401e5b5e8 YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager. Contributed by Vinod Kumar Vavilapalli. 2015-05-20 08:59:26 +09:00
Wangda Tan 563eb1ad2a YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda) 2015-05-19 16:54:38 -07:00
Wangda Tan b37da52a1c YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda) 2015-05-19 16:34:17 -07:00
Jian He 7438966586 YARN-2821. Fixed a problem that DistributedShell AM may hang if restarted. Contributed by Varun Vasudev 2015-05-19 14:20:31 -07:00
Ravi Prakash c97f32e7b9 YARN-3302. TestDockerContainerExecutor should run automatically if it can detect docker in the usual place (Ravindra Kumar Naik via raviprak) 2015-05-19 10:28:11 -07:00
Xuan 5009ad4a7f YARN-3601. Fix UT TestRMFailover.testRMWebAppRedirect. Contributed by Weiwei Yang 2015-05-19 09:56:01 -07:00