2351 Commits

Author	SHA1	Message	Date
Xuan	83be450acc	YARN-3147. Clean up RM web proxy code. Contributed by Steve Loughran	2015-02-12 10:57:55 -08:00
Tsuyoshi Ozawa	7bc492adab	YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt.	2015-02-12 23:48:43 +09:00
Junping Du	46c7577b98	YARN-1580. Documentation error regarding container-allocation.expiry-interval-ms (Brahma Reddy Battula via junping_du)	2015-02-12 03:38:54 -08:00
Tsuyoshi Ozawa	4cbaa74f62	Revert "YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt." ... This reverts commit 95a41bf35d.	2015-02-12 18:48:17 +09:00
Tsuyoshi Ozawa	95a41bf35d	YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt.	2015-02-12 18:41:17 +09:00
Tsuyoshi Ozawa	b3bcbaf277	YARN-1237. Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading. Contributed by Brahma Reddy Battula.	2015-02-12 15:17:51 +09:00
Xuan	65c69e296e	YARN-3151. On Failover tracking url wrong in application cli for KILLED ... application. Contributed by Rohith	2015-02-11 21:19:48 -08:00
Jason Lowe	b379972ab3	YARN-3074. Nodemanager dies when localizer runner tries to write to a full disk. Contributed by Varun Saxena	2015-02-11 16:33:43 +00:00
Steve Loughran	c3da2db48f	YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel)	2015-02-11 14:26:37 +00:00
Steve Loughran	362565cf5a	YARN-2616 [YARN-913] Add CLI client to the registry to list, view and manipulate entries. (Akshay Radia via stevel)	2015-02-11 14:19:01 +00:00
Junping Du	c541a374d8	YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu)	2015-02-11 03:44:31 -08:00
Zhijie Shen	d5855c0e46	YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K.	2015-02-10 15:24:01 -08:00
Jason Lowe	3f5431a22f	YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts	2015-02-10 17:27:21 +00:00
Jason Lowe	4eb5f7fa32	YARN-3090. DeletionService can silently ignore deletion task failures. Contributed by Varun Saxena	2015-02-10 16:54:21 +00:00
Zhijie Shen	23bf6c7207	YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.	2015-02-09 20:34:56 -08:00
Wangda Tan	00a748d24a	YARN-3155. Refactor the exception handling code for TimelineClientImpl's retryOn method (Li Lu via wangda)	2015-02-09 17:20:34 -08:00
Jonathan Eagles	af08425893	YARN-2971. RM uses conf instead of token service address to renew timeline delegation tokens (jeagles)	2015-02-09 17:56:05 -06:00
Jian He	0af6a99a3f	YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong	2015-02-09 13:47:08 -08:00
Karthik Kambatla	7e42088abf	YARN-2990. FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests. (kasha)	2015-02-08 22:48:10 -08:00
Jason Lowe	da2fb2bc46	YARN-3143. RM Apps REST API can return NPE or entries missing id and other fields. Contributed by Jason Lowe	2015-02-06 21:47:32 +00:00
Allen Wittenauer	5c79439568	HADOOP-11485. Pluggable shell integration (aw)	2015-02-06 13:09:01 -08:00
Jason Lowe	6f10434a5a	YARN-3144. Configuration for making delegation token failures to timeline server not-fatal. Contributed by Jonathan Eagles	2015-02-06 20:55:00 +00:00
Jason Lowe	4c484320b4	YARN-3089. LinuxContainerExecutor does not handle file arguments to deleteAsUser. Contributed by Eric Payne	2015-02-06 20:39:01 +00:00
Jian He	c1957fef29	YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan	2015-02-06 11:34:20 -08:00
Arun C. Murthy	02f154a001	YARN-1537. Fix race condition in TestLocalResourcesTrackerImpl.testLocalResourceCache. Contributed by Xuan Gong.	2015-02-05 23:58:52 -08:00
Arun C. Murthy	18b2507eda	YARN-1904. Ensure exceptions thrown in ClientRMService & ApplicationHistoryClientService are uniform when application-attempt is not found. Contributed by Zhijie Shen.	2015-02-05 23:48:55 -08:00
Jian He	4641196fe0	YARN-3145. Fixed ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo. Contributed by Tsuyoshi OZAWA	2015-02-05 16:12:53 -08:00
Xuan	b77ff37686	YARN-3149. Fix typo in message for invalid application id. Contributed ... by Bibin A Chundatt.	2015-02-05 15:13:57 -08:00
Jason Lowe	69c8a7f45b	YARN-1582. Capacity Scheduler: add a maximum-allocation-mb setting per queue. Contributed by Thomas Graves	2015-02-05 19:28:49 +00:00
Sandy Ryza	b6466deac6	YARN-3101. In Fair Scheduler, fix canceling of reservations for exceeding max share (Anubhav Dhoot via Sandy Ryza)	2015-02-05 09:39:28 -08:00
Tsuyoshi Ozawa	ec950be173	HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula.	2015-02-05 15:49:36 +09:00
Allen Wittenauer	43d5caef5e	HADOOP-11460. Deprecate shell vars (John Smith via aw)	2015-02-04 16:35:50 -08:00
Zhijie Shen	30510cff75	YARN-3123. Made YARN CLI show a single completed container even if the app is running. Contributed by Naganarasimha G R.	2015-02-04 16:02:52 -08:00
Siddharth Seth	e04e8fa810	YARN-1723. AMRMClientAsync missing blacklist addition and removal ... functionality. Contributed by Bartosz Ługowski.	2015-02-04 12:52:02 -08:00
Tsuyoshi Ozawa	26dee1486b	YARN-3058. Fix error message of tokens' activation delay configuration. Contributed by Yi Liu.	2015-02-04 11:41:14 +09:00
Zhijie Shen	e5b56e2af6	YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R.	2015-02-03 17:34:22 -08:00
Xuan	b73e776abc	YARN-3056. Add verification for containerLaunchDuration in ... TestNodeManagerMetrics. Contributed by zhihai Xu	2015-02-03 15:12:54 -08:00
Karthik Kambatla	c559df2219	YARN-1393. SLS: Add how-to-use instructions. (Wei Yan via kasha)	2015-02-03 13:20:41 -08:00
Wangda Tan	5bd984691b	YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda)	2015-02-03 12:52:42 -08:00
Jian He	21d80b3dd9	YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues. Contributed by Wangda Tan	2015-02-03 11:43:12 -08:00
Robert Kanter	f7a77819a1	YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter)	2015-02-03 10:39:41 -08:00
Jason Lowe	a761bf8726	YARN-3085. Application summary should include the application type. Contributed by Rohith	2015-02-03 14:56:34 +00:00
Zhijie Shen	5f9a0dd8d9	YARN-2216. Fixed the change log.	2015-02-02 12:11:36 -08:00
Zhijie Shen	52575ff224	YARN-2808. Made YARN CLI list attempt’s finished containers of a running application. Contributed by Naganarasimha G R.	2015-02-02 12:03:52 -08:00
Kihwal Lee	f33c99ba39	YARN-3113. Release audit warning for Sorting icons.psd. Contributed by Steve Loughran.	2015-02-02 12:58:35 -06:00
Jian He	054a947989	YARN-3077. Fixed RM to create zk root path recursively. Contributed by Chun Chen	2015-01-30 17:34:49 -08:00
Jian He	86358221fc	YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan	2015-01-30 15:15:20 -08:00
Jonathan Eagles	30a8778c63	YARN-3108. ApplicationHistoryServer doesn't process -D arguments (Chang Li via jeagles)	2015-01-29 16:51:38 -06:00
Tsuyoshi Ozawa	7acce7d364	YARN-3029. FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere. Contributed by Varun Saxena.	2015-01-30 04:42:05 +09:00
Akira Ajisaka	342efa110a	HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)	2015-01-30 02:49:10 +09:00
Allen Wittenauer	9dd0b7a2ab	YARN-2428. LCE default banned user list should have yarn (Varun Saxena via aw)	2015-01-29 09:30:26 -08:00
Wangda Tan	7882bc0f14	YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource. (Zhihai Xu via wangda)	2015-01-28 21:54:38 -08:00
Jian He	6d2bdbd7da	YARN-3103. AMRMClientImpl does not update AMRM token properly. Contributed by Jason Lowe	2015-01-28 15:23:13 -08:00
Wangda Tan	18741adf97	YARN-2932. Add entry for preemptable status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging. (Eric Payne via wangda)	2015-01-27 15:36:09 -08:00
Wangda Tan	fd93e5387b	YARN-3028. Better syntax for replaceLabelsOnNode in RMAdmin CLI. Contributed by Rohith Sharmaks	2015-01-27 15:23:45 -08:00
Jonathan Eagles	a8ad1e8089	YARN-2897. CrossOriginFilter needs more log statements (Mit Desai via jeagles)	2015-01-27 16:06:39 -06:00
Jian He	4e15fc0841	YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena	2015-01-27 13:31:22 -08:00
Tsuyoshi Ozawa	f56da3ce04	YARN-3086. Make NodeManager memory configurable in MiniYARNCluster. Contributed by Robert Metzger.	2015-01-28 00:15:34 +09:00
Jian He	6f9fe76918	YARN-3092. Created a common ResourceUsage class to track labeled resource usages in Capacity Scheduler. Contributed by Wangda Tan	2015-01-26 15:38:00 -08:00
Jason Lowe	902c6ea7e4	YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error. Contributed by Eric Payne	2015-01-26 15:40:21 +00:00
Xuan	0d6bd62102	YARN-3024. LocalizerRunner should give DIE action when all resources are ... localized. Contributed by Chengbing Liu	2015-01-25 19:37:57 -08:00
Tsuyoshi Ozawa	24aa462673	YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan.	2015-01-23 20:37:05 +09:00
Tsuyoshi Ozawa	3aab354e66	YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse processing. Contributed by Anubhav Dhoot.	2015-01-23 16:04:18 +09:00
Tsuyoshi Ozawa	5712c9f96a	YARN-3078. LogCLIHelpers lacks of a blank space before string 'does not exist'. Contributed by Sam Liu.	2015-01-22 12:25:05 +09:00
Wangda Tan	f250ad1773	YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder. (Contributed by Carlo Curino)	2015-01-20 14:46:22 -08:00
Wangda Tan	0a2d3e717d	YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal	2015-01-19 16:48:50 -08:00
cnauroth	cb0a15d201	YARN-3015. yarn classpath command should support same options as hadoop classpath. Contributed by Varun Saxena.	2015-01-19 15:52:32 -08:00
Akira Ajisaka	4a5c3a4cfe	YARN-3071. Remove invalid char from sample conf in doc of FairScheduler. (Contributed by Masatake Iwasaki)	2015-01-19 21:21:34 +09:00
Junping Du	19cbce3898	YARN-3070. TestRMAdminCLI#testHelp fails for transitionToActive command. (Contributed by Junping Du)	2015-01-18 23:08:06 -08:00
Zhijie Shen	43302f6f44	YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common. Contributed by Ferdinand Xu.	2015-01-16 16:37:42 -08:00
Karthik Kambatla	84198564ba	YARN-2984. Metrics for container's actual memory usage. (kasha)	2015-01-17 05:44:04 +05:30
Junping Du	5d1cca34fa	YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He)	2015-01-16 00:08:36 -08:00
Jian He	9e33116d1d	YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen	2015-01-15 11:07:43 -08:00
Akira Ajisaka	533e551eb4	YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki)	2015-01-15 21:27:39 +09:00
Karthik Kambatla	ba5116ec8e	YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha)	2015-01-15 14:28:44 +05:30
Xuan	d15cbae73c	YARN-2807. Option "--forceactive" not works as described in usage of ... "yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki	2015-01-14 11:04:03 -08:00
Junping Du	f92e503800	YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He)	2015-01-13 18:20:57 -08:00
Jian He	c53420f583	YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch	2015-01-13 17:32:07 -08:00
Robert Kanter	51881535e6	YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter)	2015-01-12 17:51:00 -08:00
Robert Kanter	f451631915	YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter)	2015-01-12 12:00:30 -08:00
Robert Kanter	ae7bf31fe1	YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter)	2015-01-12 10:47:52 -08:00
Jian He	a260406268	YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan	2015-01-09 17:49:53 -08:00
Jian He	27a489cba6	YARN-2956. Added missing links in YARN documentation. Contributed by Masatake Iwasaki	2015-01-09 17:46:36 -08:00
cnauroth	8c3e888dcd	HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth.	2015-01-09 15:01:50 -08:00
Allen Wittenauer	ab5cd99177	YARN-3002. YARN documentation needs updating post-shell rewrite (aw)	2015-01-09 15:01:29 -08:00
Jian He	cc2a745f7e	YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu	2015-01-08 11:12:54 -08:00
Zhijie Shen	dc2eaa26b2	YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu.	2015-01-08 09:47:02 -08:00
Jian He	ef237bd52f	Moved YARN-2880 to improvement section in CHANGES.txt	2015-01-07 16:20:26 -08:00
Jian He	2638f4d0f0	YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on getProto method. Contributed by Varun Saxena	2015-01-07 16:14:22 -08:00
Jian He	e13a484a2b	YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. Contributed by Yi Liu	2015-01-07 14:12:20 -08:00
Jian He	fe8d2bd741	YARN-2230. Fixed few configs description in yarn-default.xml. Contributed by Vijay Bhat	2015-01-07 10:57:06 -08:00
Zhijie Shen	60103fca04	YARN-2427. Added the API of moving apps between queues in RM web services. Contributed by Varun Vasudev.	2015-01-06 14:37:44 -08:00
Jian He	dd57c2047b	YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun Saxena	2015-01-06 14:15:57 -08:00
Karthik Kambatla	0c4b112677	YARN-2881. [YARN-2574] Implement PlanFollower for FairScheduler. (Anubhav Dhoot via kasha)	2015-01-06 04:42:10 +05:30
Karthik Kambatla	41d72cbd48	Move YARN-2360 from 2.6 to 2.7 in CHANGES.txt	2015-01-06 03:31:11 +05:30
Zhijie Shen	562a701945	YARN-2958. Made RMStateStore not update the last sequence number when updating the delegation token. Contributed by Varun Saxena.	2015-01-05 13:33:07 -08:00
Tsuyoshi Ozawa	ddc5be48fc	YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue. Contributed by Rohith Sharmaks.	2015-01-05 00:08:31 +09:00
Zhijie Shen	947578c1c1	YARN-2991. Fixed DrainDispatcher to reuse the draining code path in AsyncDispatcher. Contributed by Rohith Sharmaks.	2015-01-02 11:08:47 -08:00
Karthik Kambatla	e7257acd8a	YARN-2998. Abstract out scheduler independent PlanFollower components. (Anubhav Dhoot via kasha)	2014-12-30 19:55:24 -08:00
Jian He	e2351c7ae2	YARN-2987. Fixed ClientRMService#getQueueInfo to check against queue and app ACLs. Contributed by Varun Saxena	2014-12-30 17:15:37 -08:00
Jian He	b7442bf92e	YARN-2493. Added node-labels page on RM web UI. Contributed by Wangda Tan	2014-12-30 16:49:01 -08:00
Jian He	746ad6e989	Revert "YARN-2492(wrong jira number). Added node-labels page on RM web UI. Contributed by Wangda Tan" ... This reverts commit 5f57b904f5.	2014-12-30 16:48:49 -08:00
Jian He	5f57b904f5	YARN-2492. Added node-labels page on RM web UI. Contributed by Wangda Tan	2014-12-30 15:38:28 -08:00
Zhijie Shen	241d3b3a50	YARN-2938. Fixed new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice. Contributed by Varun Saxena.	2014-12-29 09:59:35 -08:00
Jian He	1454efe5d4	YARN-2992. ZKRMStateStore crashes due to session expiry. Contributed by Karthik Kambatla	2014-12-26 17:59:58 -08:00
Junping Du	40ee4bff65	YARN-2993. Several fixes (missing acl check, error log msg ...) and some refinement in AdminService. (Contributed by Yi Liu)	2014-12-26 06:59:25 -08:00
Tsuyoshi Ozawa	b256dd7600	YARN-2988. Graph#save() may leak file descriptors. (Ted Yu via ozawa)	2014-12-25 12:48:24 +09:00
Jian He	4f18018b7a	YARN-2946. Fixed potential deadlock in RMStateStore. Contributed by Rohith Sharmaks	2014-12-23 22:14:29 -08:00
Zhijie Shen	41a548a916	YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. Contributed by Varun Saxena.	2014-12-23 20:32:36 -08:00
Junping Du	d468c9aaf1	YARN-2940. Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu)	2014-12-23 20:04:33 -08:00
Junping Du	856b46cf47	Revert ca3381de61 and 20674255ad as missing JIRA number in commit message	2014-12-23 20:02:33 -08:00
Junping Du	20674255ad	CHANGES.txt: add YARN-2940	2014-12-23 18:59:52 -08:00
Junping Du	ca3381de61	Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu)	2014-12-23 18:57:16 -08:00
Jian He	149512a837	YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen	2014-12-23 18:25:37 -08:00
Junping Du	e1ee0d45ea	YARN-2970. NodeLabel operations in RMAdmin CLI get missing in help command. (Contributed by Varun Saxena)	2014-12-23 18:23:45 -08:00
Jian He	0d89859b51	YARN-2340. Fixed NPE when queue is stopped during RM restart. Contributed by Rohith Sharmaks	2014-12-22 21:53:22 -08:00
Jian He	fdf042dfff	YARN-2920. Changed CapacityScheduler to kill containers on nodes where node labels are changed. Contributed by Wangda Tan	2014-12-22 16:51:15 -08:00
Junping Du	a696fbb001	YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du)	2014-12-22 03:06:37 -08:00
Tsuyoshi Ozawa	8f5522ed99	CHANGES.txt: move YARN-2977 from 2.6.1 to 2.7.0	2014-12-21 12:51:46 +09:00
Karthik Kambatla	24ee9e3431	YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha)	2014-12-20 12:17:50 -08:00
Tsuyoshi Ozawa	76b0370a27	CHANGES.txt: add YARN-2977	2014-12-20 22:54:48 +09:00
Tsuyoshi Ozawa	cf7fe583d1	YARN-2977. Fixed intermittent TestNMClient failure. (Contributed by Junping Du)	2014-12-20 22:35:28 +09:00
Jian He	808cba3821	YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks	2014-12-19 16:56:30 -08:00
Karthik Kambatla	954fb8581e	YARN-2675. containersKilled metrics is not updated when the container is killed during localization. (Zhihai Xu via kasha)	2014-12-19 16:02:20 -08:00
Karthik Kambatla	a22ffc3188	YARN-2738. [YARN-2574] Add FairReservationSystem for FairScheduler. (Anubhav Dhoot via kasha)	2014-12-19 15:37:12 -08:00
Jason Lowe	0402bada19	YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie). Contributed by Jian He	2014-12-18 23:28:18 +00:00
Junping Du	389f881d42	YARN-2949. Add documentation for CGroups. (Contributed by Varun Vasudev)	2014-12-18 06:25:59 -08:00
Junping Du	2b4b0e8847	YARN-2972. DelegationTokenRenewer thread pool never expands. Contributed by Jason Lowe	2014-12-17 17:40:00 -08:00
Karthik Kambatla	b7f64823e1	YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha)	2014-12-17 16:32:21 -08:00
Karthik Kambatla	a1bd140964	YARN-2944. InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance. (Chris Trezzo via kasha)	2014-12-17 16:23:52 -08:00
Karthik Kambatla	f2d150ea12	YARN-2964. FSLeafQueue#assignContainer - document the reason for using both write and read locks. (Tsuyoshi Ozawa via kasha)	2014-12-17 12:03:16 -08:00
Karthik Kambatla	9b4ba409c6	YARN-2189. Admin service for cache manager. Addendum to sort entries	2014-12-17 11:22:12 -08:00
cnauroth	e996a1bfd4	HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth.	2014-12-16 15:29:22 -08:00
Jian He	c65f1b382e	YARN-2762. Fixed RMAdminCLI to trim and check node-label related arguments before sending to RM. Contributed by Rohith Sharmaks	2014-12-16 11:00:25 -08:00
Karthik Kambatla	e597249d36	YARN-2914. [YARN-1492] Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics. (Varun Saxena via kasha)	2014-12-15 12:00:12 -08:00
Jian He	a4f2995b9e	Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai." ... This reverts commit 51af8d367d. Conflicts: hadoop-yarn-project/CHANGES.txt	2014-12-15 11:04:09 -08:00
Devaraj K	fae3e8614f	YARN-2356. yarn status command for non-existent application/application ... attempt/container is too verbose. Contributed by Sunil G.	2014-12-15 14:43:21 +05:30
Harsh J	0e37bbc8e3	YARN-2950. Change message to mandate, not suggest JS requirement on UI. Contributed by Dustin Cote.	2014-12-13 07:10:40 +05:30
Steve Loughran	3681de2039	YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel)	2014-12-12 17:11:07 +00:00
Devaraj K	bda748ac3a	YARN-2243. Order of arguments for Preconditions.checkNotNull() is wrong in ... SchedulerApplicationAttempt ctor. Contributed by Devaraj K.	2014-12-12 12:34:43 +05:30
Jian He	614b6afea4	YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher. Contributed by Rohith Sharmaks	2014-12-11 11:17:54 -08:00
Allen Wittenauer	59cb8b9123	YARN-2437. start-yarn.sh/stop-yarn should give info (Varun Saxena via aw)	2014-12-10 13:48:07 -08:00
Allen Wittenauer	c536142699	HADOOP-6590. Add a username check for hadoop sub-commands (John Smith via aw)	2014-12-10 13:41:28 -08:00
Allen Wittenauer	a7c6c710b2	HADOOP-10950. rework heap management vars (John Smith via aw)	2014-12-10 13:37:32 -08:00
Jian He	437322afca	YARN-2924. Fixed RMAdminCLI to not convert node labels to lower case. Contributed by Wangda Tan	2014-12-09 17:56:04 -08:00
Jian He	2ed90a57fd	YARN-2930. Fixed TestRMRestart#testRMRestartRecoveringNodeLabelManager intermittent failure. Contributed by Wangda Tan	2014-12-09 16:48:04 -08:00
Karthik Kambatla	a2e07a5456	YARN-2910. FSLeafQueue can throw ConcurrentModificationException. (Wilfred Spiegelenburg via kasha)	2014-12-09 14:00:31 -08:00
Karthik Kambatla	db73cc9124	YARN-2931. PublicLocalizer may fail until directory is initialized by LocalizeRunner. (Anubhav Dhoot via kasha)	2014-12-08 22:26:18 -08:00
Karthik Kambatla	120e1decd7	YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent. (Ray Chiang via kasha)	2014-12-07 22:28:26 -08:00
Jian He	e69af836f3	YARN-2869. CapacityScheduler should trim sub queue names when parse configuration. Contributed by Wangda Tan	2014-12-05 17:33:39 -08:00
Jason Lowe	4b13082199	YARN-2056. Disable preemption at Queue level. Contributed by Eric Payne	2014-12-05 21:06:48 +00:00
Robert Kanter	3c72f54ef5	YARN-2461. Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration. (rchiang via rkanter)	2014-12-05 12:07:41 -08:00
Karthik Kambatla	78968155d7	YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)	2014-12-04 17:36:32 -08:00
Jian He	258623ff8b	YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R	2014-12-04 12:53:18 -08:00
Jian He	73fbb3c66b	YARN-2880. Added a test to make sure node labels will be recovered if RM restart is enabled. Contributed by Rohith Sharmaks	2014-12-03 17:14:52 -08:00
Harsh J	a31e016491	YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh)	2014-12-04 03:17:15 +05:30
Karthik Kambatla	799353e2c7	YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha)	2014-12-03 13:44:41 -08:00
Jason Lowe	03ab24aa01	MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov	2014-12-03 17:02:14 +00:00
Junping Du	e65b7c5ff6	YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA)	2014-12-03 04:11:18 -08:00
Jian He	392c3aaea8	YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks	2014-12-02 17:16:35 -08:00
Jian He	52bcefca8b	YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena	2014-12-02 10:54:48 -08:00
Allen Wittenauer	26319ba0db	YARN-2472. yarn-daemons.sh should jsut call yarn directly (Masatake Iwasaki via aw)	2014-12-02 09:14:20 -08:00
Zhijie Shen	51af8d367d	YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.	2014-12-01 19:04:04 -08:00
Jian He	a7fba0bc28	YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe	2014-12-01 16:38:25 -08:00
Allen Wittenauer	031f980e7e	HADOOP-11081. Document hadoop properties expected to be set by the shell code in *-env.sh (aw)	2014-12-01 16:21:20 -08:00
Jason Lowe	0f9528b99a	YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena	2014-12-01 22:29:05 +00:00
Junping Du	c732ed760e	YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith)	2014-12-01 05:38:22 -08:00
Zhijie Shen	8f1454cc6d	YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ.	2014-11-26 12:09:34 -08:00
Karthik Kambatla	fe1f2db5ee	YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)	2014-11-25 16:21:46 -08:00
Jian He	8a7ca13b13	YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe	2014-11-25 16:16:56 -08:00
Jian He	5805a81efb	YARN-2404. Removed ApplicationAttemptState and ApplicationState class in RMStateStore. Contributed by Tsuyoshi OZAWA	2014-11-25 12:48:22 -08:00
Zhijie Shen	e37a4ff0c1	YARN-2697. Remove useless RMAuthenticationHandler. Contributed by Haosong Huang.	2014-11-24 14:58:59 -08:00
Jason Lowe	1ce4d33c2d	YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena	2014-11-24 22:36:59 +00:00
Sandy Ryza	a128cca305	YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza)	2014-11-21 16:06:41 -08:00
Karthik Kambatla	1e9a3f42ff	Update release date for 2.5.2	2014-11-21 14:34:23 -08:00
Karthik Kambatla	233b61e495	YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha)	2014-11-21 14:22:21 -08:00
Karthik Kambatla	3114d4731d	YARN-2604. Scheduler should consider max-allocation-* in conjunction with the largest node. (Robert Kanter via kasha)	2014-11-21 10:32:28 -08:00
Jonathan Eagles	c298a9a845	YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles)	2014-11-20 23:34:35 -06:00
Karthik Kambatla	a9a0cc3679	YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha)	2014-11-19 20:15:40 -08:00
Karthik Kambatla	c90fb84aaa	YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha)	2014-11-19 19:50:12 -08:00
Jian He	9cb8b75ba5	YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks	2014-11-19 19:48:52 -08:00
Allen Wittenauer	72c141ba96	HADOOP-11208. Replace "daemon" with better name in script subcommands (aw)	2014-11-19 14:49:29 -08:00
Jian He	bc4ee5e06f	YARN-2878. Fix DockerContainerExecutor.apt.vm formatting. Contributed by Abin Shahab	2014-11-19 14:44:25 -08:00
Jian He	90a968d675	YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA	2014-11-18 16:12:39 -08:00
Zhijie Shen	ef38fb9758	YARN-2870. Updated the command to run the timeline server it the document. Contributed by Masatake Iwasaki.	2014-11-18 16:04:31 -08:00
Karthik Kambatla	2fce6d6141	YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes independent of Scheduler type. (Anubhav Dhoot via kasha)	2014-11-17 16:45:57 -08:00
Jason Lowe	81c9d17af8	YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan	2014-11-17 21:15:48 +00:00
Vinod Kumar Vavilapalli	198fb58776	YARN-1703. Fixed ResourceManager web-proxy to close connections correctly. Contributed by Rohith Sharma.	2014-11-15 12:05:25 -08:00
Jian He	9b860661a5	YARN-2432. RMStateStore should process the pending events before close. Contributed by Varun Saxena	2014-11-14 17:24:09 -08:00
Sandy Ryza	1a47f890ba	YARN-2811. In Fair Scheduler, reservation fulfillments shouldn't ignore max share (Siqi Li via Sandy Ryza)	2014-11-14 15:18:56 -08:00
Jason Lowe	49c38898b0	YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu	2014-11-14 21:25:59 +00:00
Jason Lowe	f2fe8a800e	YARN-2857. ConcurrentModificationException in ContainerLogAppender. Contributed by Mohammad Kamrul Islam	2014-11-14 20:47:26 +00:00
Jian He	d005404ef7	YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks	2014-11-13 15:34:26 -08:00
Zhijie Shen	3648cb57c9	YARN-2766. Made ApplicationHistoryManager return a sorted list of apps, attempts and containers. Contributed by Robert Kanter.	2014-11-13 13:47:42 -08:00
Vinod Kumar Vavilapalli	4ae9780e6a	Revert "YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw)" ... This reverts commit b0a9cd37ab. Conflicts: hadoop-yarn-project/CHANGES.txt	2014-11-13 13:17:11 -08:00
Arun C. Murthy	9ff7315cbe	Preparing to release hadoop-2.6.0-rc1.	2014-11-13 13:02:55 -08:00
Arun C. Murthy	81dc0ac6dc	YARN-2635. Merging to branch-2.6 for hadoop-2.6.0-rc1.	2014-11-13 10:27:47 -08:00
Arun C. Murthy	d648e60eba	YARN-2853. Merging to branch-2.6 for hadoop-2.6.0-rc1.	2014-11-13 10:04:45 -08:00
Vinod Kumar Vavilapalli	3651fe1b08	YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user kill request races with ApplicationMaster finish. Contributed by Jian He.	2014-11-13 08:13:03 -08:00
Jason Lowe	33ea5ae92b	YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du	2014-11-13 16:11:04 +00:00
cnauroth	0abb973f09	HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA.	2014-11-12 21:41:19 -08:00
Allen Wittenauer	b0a9cd37ab	YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw)	2014-11-12 17:02:53 -08:00
Zhijie Shen	be7bf956e9	YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He.	2014-11-12 11:07:57 -08:00
Arun C. Murthy	51957ca818	YARN-2843. Merging to branch-2.6 for hadoop-2.6.0-rc1.	2014-11-12 10:41:24 -08:00
Arun C. Murthy	3e7a5157f0	YARN-2841. Merging to branch-2.6 for hadoop-2.6.0-rc1.	2014-11-12 10:36:54 -08:00
Karthik Kambatla	a04143039e	YARN-2236. [YARN-1492] Shared Cache uploader service on the Node Manager. (Chris Trezzo and Sanjin Lee via kasha)	2014-11-12 09:31:05 -08:00
Jason Lowe	f8aefa5e9c	YARN-2780. Log aggregated resource allocation in rm-appsummary.log. Contributed by Eric Payne	2014-11-12 17:01:15 +00:00
Ravi Prakash	53f64ee516	YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN	2014-11-11 21:28:11 -08:00
Karthik Kambatla	456b973819	YARN-570. Time strings are formated in different timezone. (Akira Ajisaka and Peng Zhang via kasha)	2014-11-11 13:22:59 -08:00
Vinod Kumar Vavilapalli	0fd97f9c19	YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and labels so as to make them work correctly. Contributed by Wangda Tan.	2014-11-11 12:33:10 -08:00
Karthik Kambatla	061bc293c8	YARN-2735. diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection. (Zhihai Xu via kasha)	2014-11-11 10:31:39 -08:00
Xuan	58e9bf4b90	YARN-2841: Correct fix version from branch-2.6 to branch-2.7 in the ... change log.	2014-11-10 18:31:25 -08:00
Xuan	5c9a51f140	YARN-2841. RMProxy should retry EOFException. Contributed by Jian He	2014-11-10 18:25:01 -08:00
Karthik Kambatla	68a0508728	Set the release date for 2.5.2	2014-11-10 15:22:53 -08:00
Karthik Kambatla	b31b4bf029	Fix broken download of directories ... (cherry picked from commit 745c9a0124)	2014-11-09 19:03:49 -08:00
Vinod Kumar Vavilapalli	e76faebc95	YARN-2834. Fixed ResourceManager to ignore token-renewal failures on recovery consistent with the (somewhat incorrect) behaviour in the non-recovery case. Contributed by Jian He.	2014-11-09 18:56:58 -08:00
Arun C. Murthy	770cc14442	Updated CHANGES.txt to reflect hadoop-2.6.0 release dates.	2014-11-09 18:47:21 -08:00
Arun C. Murthy	43cd07b408	YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles.	2014-11-09 14:57:37 -08:00
Vinod Kumar Vavilapalli	737d9284c1	YARN-2607. Fixed issues in TestDistributedShell. Contributed by Wangda Tan.	2014-11-08 11:00:57 -08:00
Zhijie Shen	9a4e0d343e	YARN-2505. Supported get/add/remove/change labels in RM REST API. Contributed by Craig Welch.	2014-11-07 20:35:46 -08:00
Vinod Kumar Vavilapalli	df36edf751	YARN-2826. Fixed user-groups mappings' refresh bug caused by YARN-2826. Contributed by Wangda Tan.	2014-11-07 19:43:55 -08:00
Xuan	4a114dd67a	YARN-2819. NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6. Contributed by Zhijie Shen	2014-11-07 16:11:30 -08:00
Jason Lowe	1e215e8ba2	YARN-2632. Document NM Restart feature. Contributed by Junping Du and Vinod Kumar Vavilapalli	2014-11-07 23:40:22 +00:00
Jason Lowe	c3d475070a	YARN-2825. Container leak on NM. Contributed by Jian He	2014-11-07 23:16:37 +00:00
Vinod Kumar Vavilapalli	4cfd5bc7c1	YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. Contributed by Zhihai xu.	2014-11-07 14:15:53 -08:00
cnauroth	06b797947c	YARN-2803. MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Contributed by Craig Welch.	2014-11-07 12:29:39 -08:00
Vinod Kumar Vavilapalli	a71e9302a9	YARN-2827. Fixed bugs in "yarn queue" CLI. Contributed by Wangda Tan.	2014-11-07 11:56:11 -08:00
Vinod Kumar Vavilapalli	2ac1be7dec	YARN-2824. Fixed Capacity Scheduler to not crash when some node-labels are not mapped to queues by making default capacities per label to be zero. Contributed by Wangda Tan.	2014-11-07 10:39:37 -08:00
Xuan	1e97f2f094	YARN-2810. TestRMProxyUsersConf fails on Windows VMs. Contributed by Varun Vasudev	2014-11-07 09:44:43 -08:00
Vinod Kumar Vavilapalli	a5657182a7	YARN-2823. Fixed ResourceManager app-attempt state machine to inform schedulers about previous finished attempts of a running appliation to avoid expectation mismatch w.r.t transferred containers. Contributed by Jian He.	2014-11-07 09:28:36 -08:00
Vinod Kumar Vavilapalli	61effcbebc	YARN-2647. Added a queue CLI for getting queue information. Contributed by Sunil Govind.	2014-11-06 20:48:31 -08:00
Vinod Kumar Vavilapalli	a3839a9fbf	YARN-2744. Fixed CapacityScheduler to validate node-labels correctly against queues. Contributed by Wangda Tan.	2014-11-06 17:28:12 -08:00
Steve Loughran	1670578018	YARN-2768 Improved Yarn Registry service record structure (stevel)	2014-11-06 20:22:22 +00:00
Vinod Kumar Vavilapalli	f5b19bed7d	YARN-2818. Removed the now unnecessary user entity injection from Timeline service given we now have domains. Contributed by Zhijie Shen.	2014-11-06 11:48:40 -08:00
Xuan	b0b52c4e11	YARN-2812. TestApplicationHistoryServer is likely to fail on less powerful machine. Contributed by Zhijie Shen	2014-11-05 20:42:38 -08:00
Xuan	e4b4901d36	YARN-2813. Fixed NPE from MemoryTimelineStore.getDomains. Contributed by Zhijie Shen	2014-11-05 18:24:41 -08:00
Jian He	395275af86	YARN-2579. Fixed a deadlock issue when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time. Contributed by Rohith Sharmaks	2014-11-05 16:59:54 -08:00
Vinod Kumar Vavilapalli	834e931d8e	YARN-2805. Fixed ResourceManager to load HA configs correctly before kerberos login. Contributed by Wangda Tan.	2014-11-05 15:30:33 -08:00
Zhijie Shen	b4c951ab83	YARN-2767. Added a test case to verify that http static user cannot kill or submit apps in the secure mode. Contributed by Varun Vasudev.	2014-11-05 10:57:38 -08:00
Vinod Kumar Vavilapalli	b76179895d	YARN-2804. Fixed Timeline service to not fill the logs with JAXB bindings exceptions. Contributed by Zhijie Shen.	2014-11-04 18:00:06 -08:00
Haohui Mai	d794f785de	HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN. Contributed by Robert Kanter.	2014-11-04 17:52:03 -08:00
Karthik Kambatla	b2cd269802	YARN-2010. Handle app-recovery failures gracefully. (Jian He and Karthik Kambatla via kasha)	2014-11-04 17:45:24 -08:00
Karthik Kambatla	4de56d27fb	Adding release 2.5.2 to CHANGES.txt	2014-11-04 16:50:40 -08:00
Vinod Kumar Vavilapalli	c5a46d4c8c	YARN-1922. Fixed NodeManager to kill process-trees correctly in the presence of races between the launch and the stop-container call and when root processes crash. Contributed by Billie Rinaldi.	2014-11-03 16:38:55 -08:00
Vinod Kumar Vavilapalli	ec6cbece8e	YARN-2795. Fixed ResourceManager to not crash loading node-label data from HDFS in secure mode. Contributed by Wangda Tan.	2014-11-03 13:44:06 -08:00
Vinod Kumar Vavilapalli	58e9f24e0f	YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused when adding log-upload-time via YARN-2703. Contributed by Xuan Gong.	2014-11-03 13:16:29 -08:00
Vinod Kumar Vavilapalli	71fbb474f5	YARN-2798. Fixed YarnClient to populate the renewer correctly for Timeline delegation tokens. Contributed by Zhijie Shen.	2014-11-03 12:49:42 -08:00
Jason Lowe	6157ace547	YARN-2730. DefaultContainerExecutor runs only one localizer at a time. Contributed by Siqi Li	2014-11-03 20:37:47 +00:00
Zhijie Shen	27715ec63b	YARN-2785. Fixed intermittent TestContainerResourceUsage failure. Contributed by Varun Vasudev.	2014-11-02 15:20:40 -08:00
Vinod Kumar Vavilapalli	5c0381c96a	YARN-2790. Fixed a NodeManager bug that was causing log-aggregation to fail beyond HFDS delegation-token expiry even when RM is a proxy-user (YARN-2704). Contributed by Jian He.	2014-11-01 16:32:35 -07:00
Zhijie Shen	1cd088fd9d	YARN-2711. Fixed TestDefaultContainerExecutor#testContainerLaunchError failure on Windows. Contributed by Varun Vasudev.	2014-10-31 17:43:30 -07:00
Jason Lowe	7bc179f9f5	YARN-2707. Potential null dereference in FSDownload. Contributed by Gera Shegalov	2014-10-31 22:53:04 +00:00
Vinod Kumar Vavilapalli	6ce32f593b	YARN-2789. Re-instated the NodeReport.newInstance private unstable API modified in YARN-2698 so that tests in YARN frameworks don't break. Contributed by Wangda Tan.	2014-10-31 15:32:21 -07:00
Xuan	86ff28dea0	YARN-2701. Addendum patch. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong	2014-10-31 14:36:25 -07:00
Jian He	1b4be91866	YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen	2014-10-31 13:16:45 -07:00
Karthik Kambatla	256697acd5	YARN-2186. [YARN-1492] Node Manager uploader service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)	2014-10-31 13:00:42 -07:00
Vinod Kumar Vavilapalli	b6c1188b85	YARN-2778. Moved node-lables' reports to the yarn nodes CLI from the admin CLI. Contributed by Wangda Tan.	2014-10-31 10:11:59 -07:00
Vinod Kumar Vavilapalli	d1828d9443	YARN-2779. Fixed ResourceManager to not require delegation tokens for communicating with Timeline Service. Contributed by Zhijie Shen.	2014-10-30 23:16:19 -07:00
Vinod Kumar Vavilapalli	e0233c16eb	YARN-2698. Moved some node label APIs to be correctly placed in client protocol. Contributed by Wangda Tan.	2014-10-30 22:59:31 -07:00
Steve Loughran	81fe8e4147	YARN-2677 registry punycoding of usernames doesn't fix all usernames to be DNS-valid (stevel)	2014-10-30 22:32:32 +00:00
Jason Lowe	73e626ad91	YARN-2755. NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661. Contributed by Siqi Li	2014-10-30 15:10:27 +00:00
Karthik Kambatla	179cab81e0	YARN-2712. TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks. (Tsuyoshi Ozawa via kasha)	2014-10-30 00:29:07 -07:00
Zhijie Shen	a8c1202220	YARN-2769. Fixed the problem that timeline domain is not set in distributed shell AM when using shell_command on Windows. Contributed by Varun Vasudev.	2014-10-29 12:12:30 -07:00
Karthik Kambatla	782971ae7a	YARN-2742. FairSchedulerConfiguration should allow extra spaces between value and unit. (Wei Yan via kasha)	2014-10-29 10:24:57 -07:00
Zhijie Shen	ec63a3ffbd	YARN-2747. Fixed the test failure of TestAggregatedLogFormat when native I/O is enabled. Contributed by Xuan Gong.	2014-10-28 22:43:40 -07:00
Jian He	0782f60288	Missing CHANGES.txt for YARN-2503.	2014-10-28 17:59:52 -07:00
Jian He	d5e0a09721	YARN-2503. Added node lablels in web UI. Contributed by Wangda Tan	2014-10-28 17:57:54 -07:00
Zhijie Shen	8984e9b177	YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. Contributed by Craig Welch.	2014-10-28 14:11:19 -07:00
Xuan	69f79bee8b	YARN-2758. Update TestApplicationHistoryClientService to use the new generic history store. Contributed by Zhijie Shen	2014-10-28 13:28:42 -07:00
Xuan	0d3e7e2bd6	RN-2279. Add UTs to cover timeline server authentication. Contributed by Zhijie Shen	2014-10-28 11:16:49 -07:00
Karthik Kambatla	ade3727ecb	YARN-2760. Remove 'experimental' from FairScheduler docs. (Harsh J via kasha)	2014-10-28 08:49:14 -07:00
Jian He	f6b963fdfc	YARN-2502. Changed DistributedShell to support node labels. Contributed by Wangda Tan	2014-10-27 20:13:00 -07:00
Vinod Kumar Vavilapalli	a16d022ca4	YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.	2014-10-27 15:49:47 -07:00
Jian He	c05b581a55	YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen	2014-10-27 10:45:53 -07:00
Xuan	ce1a4419a6	YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan	2014-10-27 10:26:21 -07:00
Zhijie Shen	caecd9fffe	YARN-2734. Skipped sub-folders in the local log dir when aggregating logs. Contributed by Xuan Gong.	2014-10-26 12:57:31 -07:00
Vinod Kumar Vavilapalli	0186645505	YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He.	2014-10-26 11:14:34 -07:00
Xuan	65d95b1a52	YARN-2723. Fix rmadmin -replaceLabelsOnNode does not correctly parse ... port. Contributed by Naganarasimha G R	2014-10-25 12:45:14 -07:00
Karthik Kambatla	c51e53d7aa	YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)	2014-10-25 10:31:06 -07:00
Jian He	f44cf99599	YARN-2314. Disable ContainerManagementProtocolProxy cache by default to prevent creating thousands of threads in a large cluster. Contributed by Jason Lowe	2014-10-24 23:05:16 -07:00
Jian He	5864dd99a4	YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe	2014-10-24 22:47:56 -07:00
Karthik Kambatla	683897fd02	YARN-2713. "RM Home" link in NM should point to one of the RMs in an HA setup. (kasha)	2014-10-24 15:00:12 -07:00
Zhijie Shen	f81dc3f995	YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong.	2014-10-24 14:10:46 -07:00
Zhijie Shen	e31f0a6558	YARN-2724. Skipped uploading a local log file to HDFS if exception is raised when opening it. Contributed by Xuan Gong.	2014-10-24 11:13:44 -07:00
Jian He	071c925c7d	Updated CHANGES.txt to move YARN-2682 to branch-2.6	2014-10-23 22:27:25 -07:00
Zhijie Shen	0f3b6900be	YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.	2014-10-23 21:56:03 -07:00
Zhijie Shen	b94b8b30f2	YARN-2732. Fixed syntax error in SecureContainer.apt.vm. Contributed by Jian He.	2014-10-22 18:39:29 -07:00
Jian He	3b12fd6cfb	YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu	2014-10-22 15:57:46 -07:00
Steve Loughran	90e5ca24fb	YARN-2700 TestSecureRMRegistryOperations failing on windows: auth problems	2014-10-22 21:13:52 +01:00
Steve Loughran	85a88649c3	YARN-2692 ktutil test hanging on some machines/ktutil versions (stevel)	2014-10-22 14:35:31 +01:00
Zhijie Shen	7e3b5e6f5c	YARN-2721. Suppress NodeExist exception thrown by ZKRMStateStore when it retries creating znode. Contributed by Jian He.	2014-10-21 21:49:17 -07:00
Vinod Kumar Vavilapalli	c0e034336c	YARN-2715. Fixed ResourceManager to respect common configurations for proxy users/groups beyond just the YARN level config. Contributed by Zhijie Shen.	2014-10-21 20:09:40 -07:00
Zhijie Shen	b2942762d7	YARN-2709. Made timeline client getDelegationToken API retry if ConnectException happens. Contributed by Li Lu.	2014-10-21 16:06:39 -07:00
cnauroth	6637e3cf95	YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch.	2014-10-21 12:33:21 -07:00
Jason Lowe	6f2028bd15	YARN-90. NodeManager should identify failed disks becoming good again. Contributed by Varun Vasudev	2014-10-21 17:31:13 +00:00
Zhijie Shen	171f2376d2	YARN-2717. Avoided duplicate logging when container logs are not found. Contributed by Xuan Gong.	2014-10-20 22:21:37 -07:00
Jian He	4a78a75228	Missing file for YARN-1879	2014-10-20 21:14:19 -07:00
Jian He	4fa1fb3193	Missing file for YARN-2701	2014-10-20 19:57:45 -07:00
Jian He	2839365f23	YARN-2701. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong	2014-10-20 18:45:47 -07:00
Zhijie Shen	e90718fa5a	YARN-2582. Fixed Log CLI and Web UI for showing aggregated logs of LRS. Contributed Xuan Gong.	2014-10-20 13:38:59 -07:00
Zhijie Shen	89427419a3	YARN-2673. Made timeline client put APIs retry if ConnectException happens. Contributed by Li Lu.	2014-10-20 12:22:17 -07:00
Vinod Kumar Vavilapalli	8256766498	YARN-2504. Enhanced RM Admin CLI to support management of node-labels. Contribyted by Wangda Tan.	2014-10-18 12:07:40 -07:00
Vinod Kumar Vavilapalli	39063cd36f	YARN-2676. Enhanced Timeline auth-filter to support proxy users. Contributed by Zhijie Shen.	2014-10-17 22:02:50 -07:00
Vinod Kumar Vavilapalli	e9c66e8fd2	YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing test-failures: added a dummy in-memory labels-manager. Contributed by Wangda Tan.	2014-10-17 18:26:12 -07:00
Jian He	c3de2412eb	YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over. Contributed by Tsuyoshi OZAWA	2014-10-17 16:35:27 -07:00
Jian He	a6aa6e42ca	YARN-2588. Standby RM fails to transitionToActive if previous transitionToActive failed with ZK exception. Contributed by Rohith Sharmaks	2014-10-17 10:54:24 -07:00
Vinod Kumar Vavilapalli	abae63caf9	YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.	2014-10-17 08:58:08 -07:00
Jian He	72093fd8cb	Moved YARN-2682 from 2.6 to 2.7 in CHANGES.txt	2014-10-16 19:02:44 -07:00
Jian He	0fd0ebae64	YARN-2682. Updated WindowsSecureContainerExecutor to not use DefaultContainerExecutor#getFirstApplicationDir and use getWorkingDir() instead. Contributed by Zhihai Xu	2014-10-16 18:14:34 -07:00
Jian He	233d446be1	YARN-2621. Simplify the output when the user doesn't have the access for getDomain(s). Contributed by Zhijie Shen	2014-10-16 16:37:21 -07:00
Steve Loughran	6f43491c03	YARN-2689 TestSecureRMRegistryOperations failing on windows: secure ZK won't start	2014-10-16 14:22:02 -07:00
Vinod Kumar Vavilapalli	b3056c266a	YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.	2014-10-15 18:47:26 -07:00
Vinod Kumar Vavilapalli	f2ea555ac6	YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan. ... YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.	2014-10-15 18:33:06 -07:00
Jian He	0af1a2b5bc	YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA	2014-10-15 15:22:07 -07:00
Zhijie Shen	1220bb72d4	YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen.	2014-10-14 21:50:46 -07:00
Zhijie Shen	cdce88376a	HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen.	2014-10-14 11:35:38 -07:00
Karthik Kambatla	cc93e7e683	YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha)	2014-10-13 16:32:01 -07:00
Karthik Kambatla	da709a2eac	YARN-2641. Decommission nodes on -refreshNodes instead of next NM-RM heartbeat. (Zhihai Xu via kasha)	2014-10-13 16:23:04 -07:00
Jian He	178bc505da	Missing Changes.txt for YARN-2308	2014-10-13 14:19:28 -07:00
Jian He	f9680d9a16	YARN-2308. Changed CapacityScheduler to explicitly throw exception if the queue ... to which the apps were submitted is changed across RM restart. Contributed by Craig Welch & Chang Li	2014-10-13 14:09:04 -07:00
Jason Lowe	a56ea01002	YARN-2377. Localization exception stack traces are not passed as diagnostic info. Contributed by Gera Shegalov	2014-10-13 18:31:16 +00:00
Zhijie Shen	4aed2d8e91	YARN-2651. Spun off LogRollingInterval from LogAggregationContext. Contributed by Xuan Gong.	2014-10-13 10:54:09 -07:00
Jason Lowe	344a10ad5e	YARN-2667. Fix the release audit warning caused by hadoop-yarn-registry. Contributed by Yi Liu	2014-10-13 15:37:50 +00:00
Steve Loughran	ac64ff77cf	YARN-2668 yarn-registry JAR won't link against ZK 3.4.5. (stevel)	2014-10-11 18:34:26 -07:00
Vinod Kumar Vavilapalli	a5ec3d0809	YARN-2501. Enhanced AMRMClient library to support requests against node labels. Contributed by Wangda Tan.	2014-10-10 19:57:39 -07:00
Vinod Kumar Vavilapalli	db7f165319	YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.	2014-10-10 11:44:21 -07:00
Zhijie Shen	cb81bac002	YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong.	2014-10-10 00:11:30 -07:00
cnauroth	d3afd730ac	YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. Contributed by Chris Nauroth.	2014-10-09 22:44:44 -07:00
Zhijie Shen	5b12df6587	YARN-2671. Fix the Jira number in the change log.	2014-10-09 20:57:29 -07:00
Zhijie Shen	e532ed8faa	YARN-2617. Fixed ApplicationSubmissionContext to still set resource for backward compatibility. Contributed by Wangda Tan.	2014-10-09 17:57:50 -07:00
Karthik Kambatla	4f426fe223	YARN-2180. [YARN-1492] In-memory backing store for cache manager. (Chris Trezzo via kasha)	2014-10-09 17:16:06 -07:00
Vinod Kumar Vavilapalli	596702a025	YARN-2544. Added admin-API objects for using node-labels. Contributed by Wangda Tan.	2014-10-09 15:46:24 -07:00
Zhijie Shen	1d4612f5ad	YARN-2629. Made the distributed shell use the domain-based timeline ACLs. Contributed by Zhijie Shen.	2014-10-09 12:59:47 -07:00
Vinod Kumar Vavilapalli	180afa2f86	YARN-2493. Added user-APIs for using node-labels. Contributed by Wangda Tan.	2014-10-09 11:26:26 -07:00
Mayank Bansal	df3becf080	YARN-2598 GHS should show N/A instead of null for the inaccessible information (Zhijie Shen via mayank)	2014-10-08 17:27:53 -07:00
Steve Loughran	6a326711aa	YARN-913 service registry: YARN-2652 add hadoop-yarn-registry package under hadoop-yarn	2014-10-08 13:02:25 -07:00
Jian He	e16e25ab1b	YARN-2649. Fixed TestAMRMRPCNodeUpdates test failure. Contributed by Ming Ma	2014-10-08 10:58:51 -07:00
Jian He	30d56fdbb4	YARN-1857. CapacityScheduler headroom doesn't account for other AM's running. Contributed by Chen He and Craig Welch	2014-10-07 13:45:04 -07:00
Jian He	519e5a7dd2	YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch	2014-10-06 15:48:46 -07:00
Jian He	ea26cc0b4a	YARN-2615. Changed ClientToAMTokenIdentifier/RM(Timeline)DelegationTokenIdentifier to use protobuf as payload. Contributed by Junping Du	2014-10-06 10:47:43 -07:00
Chris Douglas	8380ca3723	Move YARN-1051 to 2.6	2014-10-06 10:38:18 -07:00
Chris Douglas	c8212bacb1	YARN-1051. Add a system for creating reservations of cluster capacity. ... Contributed by Subru Krishnan and Carlo Curino.	2014-10-03 17:09:02 -07:00
subru	a2986234be	YARN-2611. Fixing jenkins findbugs warning and TestRMWebServicesCapacitySched for branch YARN-1051. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit c47464aba4)	2014-10-03 15:43:23 -07:00
subru	5e10a13bb4	YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 90ac0be86b)	2014-10-03 15:43:13 -07:00
subru	6261f7cc69	YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 8baeaead85) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java	2014-10-03 15:42:43 -07:00
subru	3418c56bcf	YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 169085319b)	2014-10-03 15:42:10 -07:00
carlo curino	b6df0dddcd	YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit c4918cb4cb)	2014-10-03 15:42:03 -07:00
carlo curino	f66ffcf832	YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit aef7928899)	2014-10-03 15:41:57 -07:00
subru	cf4b34282a	YARN-1709. In-memory data structures used to track resources over time to enable reservations. ... (cherry picked from commit 0d8b2cd88b)	2014-10-03 15:41:51 -07:00
subru	c9266df404	YARN-1708. Public YARN APIs for creating/updating/deleting reservations. ... (cherry picked from commit 3f2e3b275b)	2014-10-03 15:41:39 -07:00
carlo curino	1c6950354f	YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit f83a07f266)	2014-10-03 15:41:21 -07:00
carlo curino	eb3e40b833	YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan ... (cherry picked from commit aac47fda7f) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java	2014-10-03 15:41:02 -07:00
Vinod Kumar Vavilapalli	34cdcaad71	YARN-2468. Enhanced NodeManager to support log handling APIs (YARN-2569) for use by long running services. Contributed by Xuan Gong.	2014-10-03 12:15:40 -07:00
Karthik Kambatla	80d11eb68e	YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha)	2014-10-03 11:49:49 -07:00
Jian He	eb6ce5e97c	YARN-2562. Changed ContainerId#toString() to be more readable. Contributed by Tsuyoshi OZAWA	2014-10-03 11:04:02 -07:00
Jian He	054f285526	YARN-2628. Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free. Contributed by Varun Vasudev	2014-10-02 15:13:33 -07:00
Zhijie Shen	1c93025a1b	YARN-2527. Fixed the potential NPE in ApplicationACLsManager and added test cases for it. Contributed by Benoy Antony.	2014-10-02 14:56:13 -07:00
Jason Lowe	29f520052e	YARN-2624. Resource Localization fails on a cluster due to existing cache directories. Contributed by Anubhav Dhoot	2014-10-02 17:39:34 +00:00
Karthik Kambatla	5e0b49da9c	YARN-2254. TestRMWebServicesAppsModification should run against both CS and FS. (Zhihai Xu via kasha)	2014-10-02 10:15:04 -07:00
Jian He	3ef1cf187f	YARN-2617. Fixed NM to not send duplicate container status whose app is not running. Contributed by Jun Gong	2014-10-02 10:04:09 -07:00
junping_du	c7cee9b455	YARN-1979. TestDirectoryCollection fails when the umask is unusual. (Contributed by Vinod Kumar Vavilapalli and Tsuyoshi OZAWA)	2014-10-02 08:02:59 -07:00
Vinod Kumar Vavilapalli	9e40de6af7	YARN-2446. Augmented Timeline service APIs to start taking in domains as a parameter while posting entities and events. Contributed by Zhijie Shen.	2014-10-01 17:52:03 -07:00
junping_du	0708827a93	YARN-2613. Support retry in NMClient for rolling-upgrades. (Contributed by Jian He)	2014-10-01 16:50:30 -07:00
Zhijie Shen	52bbe0f11b	YARN-2630. Prevented previous AM container status from being acquired by the current restarted AM. Contributed by Jian He.	2014-10-01 15:38:11 -07:00
Vinod Kumar Vavilapalli	ba7f31c2ee	YARN-1972. Added a secure container-executor for Windows. Contributed by Remus Rusanu.	2014-10-01 10:14:41 -07:00
Vinod Kumar Vavilapalli	5ca97f1e60	YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu. ... Committed as a YARN patch even though all the code changes are in common.	2014-10-01 09:54:17 -07:00
Karthik Kambatla	17d1202c35	YARN-2179. [YARN-1492] Initial cache manager structure and context. (Chris Trezzo via kasha)	2014-09-30 19:01:47 -07:00
Jian He	bbff96be48	YARN-2602. Fixed possible NPE in ApplicationHistoryManagerOnTimelineStore. Contributed by Zhijie Shen	2014-09-30 16:44:17 -07:00
Karthik Kambatla	14d60dadc2	YARN-2594. Potential deadlock in RM when querying ApplicationResourceUsageReport. (Wangda Tan via kasha)	2014-09-30 16:12:27 -07:00
Jason Lowe	feaf139b4f	YARN-2387. Resource Manager crashes with NPE due to lack of synchronization. Contributed by Mit Desai	2014-09-30 22:37:28 +00:00
Zhijie Shen	9582a50176	YARN-2627. Added the info logs of attemptFailuresValidityInterval and number of previous failed attempts. Contributed by Xuan Gong.	2014-09-30 12:57:45 -07:00
Karthik Kambatla	f7743dd07d	YARN-2610. Hamlet should close table tags. (Ray Chiang via kasha)	2014-09-30 11:46:07 -07:00
Arun C. Murthy	ea32a66f7d	Preparing to branch hadoop-2.6	2014-09-30 10:26:42 -07:00
Jonathan Eagles	e10eeaabce	YARN-2606. Application History Server tries to access hdfs before doing secure login (Mit Desai via jeagles)	2014-09-29 16:37:23 -05:00
Jason Lowe	9c22065109	YARN-1769. CapacityScheduler: Improve reservations. Contributed by Thomas Graves	2014-09-29 14:12:18 +00:00
Jian He	5391919b09	YARN-668. Changed NMTokenIdentifier/AMRMTokenIdentifier/ContainerTokenIdentifier to use protobuf object as the payload. Contributed by Junping Du.	2014-09-26 17:48:41 -07:00
Allen Wittenauer	32870db0fb	YARN-2372. There are Chinese Characters in the FairScheduler's document (Fengdong Yu via aw)	2014-09-26 12:46:45 -07:00
Allen Wittenauer	ac70c27473	YARN-2577. Clarify ACL delimiter and how to configure ACL groups only (Mikos Christine via aw)	2014-09-26 11:05:13 -07:00
Karthik Kambatla	f4357240a6	YARN-2608. FairScheduler: Potential deadlocks in loading alloc files and clock access. (Wei Yan via kasha)	2014-09-25 17:42:51 -07:00
Jason Lowe	8269bfa613	YARN-2523. ResourceManager UI showing negative value for "Decommissioned Nodes" field. Contributed by Rohith	2014-09-25 22:37:05 +00:00
Zhijie Shen	72b0881ca6	YARN-2546. Made REST API for application creation/submission use numeric and boolean types instead of the string of them. Contributed by Varun Vasudev.	2014-09-24 17:57:32 -07:00
Zhijie Shen	c86674a3a4	YARN-2581. Passed LogAggregationContext to NM via ContainerTokenIdentifier. Contributed by Xuan Gong.	2014-09-24 17:50:26 -07:00
Karthik Kambatla	39c87344e1	YARN-2596. TestWorkPreservingRMRestart fails with FairScheduler. (kasha)	2014-09-24 15:23:31 -07:00
Vinod Kumar Vavilapalli	d78b452a4f	YARN-2102. Added the concept of a Timeline Domain to handle read/write ACLs on Timeline service event data. Contributed by Zhijie Shen.	2014-09-24 11:27:53 -07:00
Allen Wittenauer	034df0e2eb	YARN-2161. Fix build on macosx: YARN parts (Binglin Chang via aw)	2014-09-24 08:47:55 -07:00
Allen Wittenauer	3dc28e2052	HADOOP-11092. hadoop shell commands should print usage if not given a class (aw)	2014-09-23 12:24:23 -07:00
Zhijie Shen	5338ac416a	YARN-2569. Added the log handling APIs for the long running services. Contributed by Xuan Gong.	2014-09-23 10:36:57 -07:00
Karthik Kambatla	f5578207d2	YARN-2252. Intermittent failure of TestFairScheduler.testContinuousScheduling. (Ratandeep Ratti and kasha via kasha)	2014-09-23 00:03:16 -07:00
Karthik Kambatla	568d3dc2bb	YARN-1959. Fix headroom calculation in FairScheduler. (Anubhav Dhoot via kasha)	2014-09-22 23:49:39 -07:00
junping_du	a9a55db065	YARN-2584. TestContainerManagerSecurity fails on trunk. (Contributed by Jian He)	2014-09-22 22:45:06 -07:00
Karthik Kambatla	43efdd30b5	YARN-2539. FairScheduler: Set the default value for maxAMShare to 0.5. (Wei Yan via kasha)	2014-09-22 16:09:52 -07:00
Karthik Kambatla	23e17ce0ff	YARN-2540. FairScheduler: Queue filters not working on scheduler page in RM UI. (Ashwin Shankar via kasha)	2014-09-22 15:40:47 -07:00
Jian He	0a641496c7	YARN-1372. Ensure all completed containers are reported to the AMs across RM restart. Contributed by Anubhav Dhoot	2014-09-22 10:30:53 -07:00
Zhijie Shen	376233cdd4	MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev.	2014-09-22 09:28:47 -07:00
Karthik Kambatla	9721e2c1fe	YARN-2453. TestProportionalCapacityPreemptionPolicy fails with FairScheduler. (Zhihai Xu via kasha)	2014-09-21 23:13:45 -07:00
Karthik Kambatla	c50fc92502	YARN-2452. TestRMApplicationHistoryWriter fails with FairScheduler. (Zhihai Xu via kasha)	2014-09-21 13:15:04 -07:00
Allen Wittenauer	aa1052c34b	YARN-2460. Remove obsolete entries from yarn-default.xml (Ray Chiang via aw)	2014-09-19 14:07:38 -07:00
Jian He	444acf8ea7	YARN-2565. Fixed RM to not use FileSystemApplicationHistoryStore unless explicitly set. Contributed by Zhijie Shen	2014-09-19 11:26:29 -07:00
Zhijie Shen	6fe5c6b746	YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He.	2014-09-18 21:56:56 -07:00
Jian He	eb92cc67df	YARN-2563. Fixed YarnClient to call getTimeLineDelegationToken only if the Token is not present. Contributed by Zhijie Shen	2014-09-18 14:40:24 -07:00
Jason Lowe	a337f0e354	YARN-2561. MR job client cannot reconnect to AM after NM restart. Contributed by Junping Du	2014-09-18 21:34:40 +00:00
Jason Lowe	9ea7b6c063	YARN-2363. Submitted applications occasionally lack a tracking URL. Contributed by Jason Lowe	2014-09-18 20:13:16 +00:00
Vinod Kumar Vavilapalli	485c96e3cb	YARN-2001. Added a time threshold for RM to wait before starting container allocations after restart/failover. Contributed by Jian He.	2014-09-18 11:03:12 -07:00
Vinod Kumar Vavilapalli	a3d9934f91	YARN-1779. Fixed AMRMClient to handle AMRMTokens correctly across ResourceManager work-preserving-restart or failover. Contributed by Jian He.	2014-09-18 10:16:18 -07:00
Jian He	ee21b13cbd	YARN-2559. Fixed NPE in SystemMetricsPublisher when retrieving FinalApplicationStatus. Contributed by Zhijie Shen	2014-09-17 21:44:15 -07:00
Jian He	f4886111aa	YARN-2558. Updated ContainerTokenIdentifier#read/write to use ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA.	2014-09-17 15:13:59 -07:00
junping_du	0e7d1dbf9a	YARN-1250. Addendum	2014-09-16 18:25:45 -07:00
junping_du	90a0c03f0a	YARN-1250. Generic history service should support application-acls. (Contributed by Zhijie Shen)	2014-09-16 18:20:49 -07:00
Allen Wittenauer	7971c97ec1	HADOOP-11022. User replaced functions get lost 2-3 levels deep (e.g., sbin) (aw)	2014-09-16 16:06:23 -07:00
XuanGong	8e5d6713cf	YARN-2557. Add a parameter "attempt_Failures_Validity_Interval" into ... DistributedShell. Contributed by Xuan Gong	2014-09-16 10:58:18 -07:00
Vinod Kumar Vavilapalli	9f6891d9ef	YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev.	2014-09-16 10:14:46 -07:00
Allen Wittenauer	0c8aec43f0	YARN-2438. yarn-env.sh cleanup (aw)	2014-09-15 14:09:50 -07:00
Jian He	88e329fdfb	YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen	2014-09-15 13:13:54 -07:00
cnauroth	9d4ec97c95	YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest classes. Contributed by Chris Nauroth.	2014-09-15 11:53:57 -07:00
Vinod Kumar Vavilapalli	14e2639fd0	YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong.	2014-09-13 18:04:05 -07:00
Zhijie Shen	98588cf044	YARN-2528. Relaxed http response split vulnerability protection for the origins header and made it accept multiple origins in CrossOriginFilter. Contributed by Jonathan Eagles.	2014-09-12 21:33:01 -07:00
Jian He	a0ad975ea1	YARN-2542. Fixed NPE when retrieving ApplicationReport from TimeLineServer. Contributed by Zhijie Shen	2014-09-12 15:27:13 -07:00
XuanGong	e65ae575a0	YARN-2456. Possible livelock in CapacityScheduler when RM is recovering ... apps. Contributed by Jian He	2014-09-12 15:21:46 -07:00
Allen Wittenauer	40364dc47c	YARN-2525. yarn logs command gives error on trunk (Akira AJISAKA via aw)	2014-09-12 14:56:41 -07:00
Jonathan Eagles	54e5794806	YARN-2547. Cross Origin Filter throws UnsupportedOperationException upon destroy (Mit Desai via jeagles)	2014-09-12 15:35:17 -05:00
Jian He	3122daa802	YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA	2014-09-12 10:33:33 -07:00
Jason Lowe	78b048393a	YARN-2484. FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block. Contributed by Tsuyoshi OZAWA	2014-09-12 14:09:14 +00:00
Zhijie Shen	469ea3dcef	YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. Contributed by Xuan Gong.	2014-09-11 22:19:00 -07:00
Jian He	5633da2a01	YARN-2541. Fixed ResourceManagerRest.apt.vm table syntax error. Contributed by Jian He	2014-09-11 21:31:09 -07:00
junping_du	6b8b1608e6	YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen)	2014-09-12 10:04:51 +08:00
Karthik Kambatla	17ffbe0864	Update CHANGES.txt to set the release date for 2.5.1	2014-09-11 17:35:35 -07:00
Karthik Kambatla	c11ada5ea6	YARN-2534. FairScheduler: Potential integer overflow calculating totalMaxShare. (Zhihai Xu via kasha)	2014-09-11 12:06:06 -07:00
Vinod Kumar Vavilapalli	4be95175cd	YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all containers to a preconfigured limit. Contributed by Varun Vasudev.	2014-09-10 19:22:52 -07:00
Jian He	83be3ad444	YARN-415. Capture aggregate memory allocation at the app-level for chargeback. Contributed by Eric Payne & Andrey Klochkov	2014-09-10 18:20:54 -07:00
XuanGong	7d38ffc8d3	Fix CHANGES.txt. Credit Mayank Bansal for his contributions on YARN-2459	2014-09-10 15:14:47 -07:00
Jian He	cbfe26370b	YARN-2158. Fixed TestRMWebServicesAppsModification#testSingleAppKill test failure. Contributed by Varun Vasudev	2014-09-10 12:47:34 -07:00
XUAN	47bdfa044a	YARN-2459. RM crashes if App gets rejected for any reason and HA is enabled. Contributed by Jian He	2014-09-10 11:44:41 -07:00
Vinod Kumar Vavilapalli	b67d5ba784	YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource types to the AMs. Contributed by Varun Vasudev.	2014-09-10 10:15:47 -07:00
Karthik Kambatla	3072c83b38	YARN-1458. FairScheduler: Zero weight can lead to livelock. (Zhihai Xu via kasha)	2014-09-10 08:26:14 -07:00
Karthik Kambatla	28d99db992	YARN-2526. SLS can deadlock when all the threads are taken by AMSimulators. (Wei Yan via kasha)	2014-09-09 15:13:16 -07:00
Allen Wittenauer	9b81045754	Add missing YARN-1471 to the CHANGES.txt	2014-09-09 14:06:27 -07:00
Jian He	0974f434c4	YARN-2515. Updated ConverterUtils#toContainerId to parse epoch. Contributed by Tsuyoshi OZAWA	2014-09-07 18:29:22 -07:00
Zhijie Shen	56dc496a10	YARN-2507. Documented CrossOriginFilter configurations for the timeline server. Contributed by Jonathan Eagles.	2014-09-07 18:22:40 -07:00
Zhijie Shen	a092cdf32d	YARN-2512. Allowed pattern matching for origins in CrossOriginFilter. Contributed by Jonathan Eagles.	2014-09-07 17:49:06 -07:00
cnauroth	cbea1b10ef	YARN-2519. Credential Provider related unit tests failed on Windows. Contributed by Xiaoyu Yao.	2014-09-06 20:05:07 -07:00
Jonathan Eagles	e6420fec0a	YARN-2508. Cross Origin configuration parameters prefix are not honored (Mit Desai via jeagles)	2014-09-05 19:42:40 -05:00
Zhijie Shen	51a4faf521	YARN-2511. Allowed all origins by default when CrossOriginFilter is enabled. Contributed by Jonathan Eagles.	2014-09-04 15:01:01 -07:00
Jason Lowe	3fa5f728c4	YARN-2431. NM restart: cgroup is not removed for reacquired containers. Contributed by Jason Lowe	2014-09-04 21:11:27 +00:00
Jonathan Eagles	91d45f0f01	YARN-2509. Enable Cross Origin Filter for timeline server only and not all Yarn servers (Mit Desai via jeagles)	2014-09-04 11:53:52 -05:00
Karthik Kambatla	1dcaba9a7a	YARN-2394. FairScheduler: Configure fairSharePreemptionThreshold per queue. (Wei Yan via kasha)	2014-09-03 10:27:36 -07:00
Karthik Kambatla	ce0462129f	HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha)	2014-09-03 09:39:02 -07:00
Karthik Kambatla	0f34e6f387	YARN-2395. FairScheduler: Preemption timeout should be configurable per queue. (Wei Yan via kasha)	2014-08-30 01:17:13 -07:00
Jian He	5c14bc426b	YARN-1506. Changed RMNode/SchedulerNode to update resource with event notification. Contributed by Junping Du	2014-08-29 23:05:51 -07:00
Karthik Kambatla	270a271f53	YARN-2360. Fair Scheduler: Display dynamic fair share for queues on the scheduler page. (Ashwin Shankar and Wei Yan via kasha)	2014-08-29 17:15:38 -07:00
Jason Lowe	b03653f9a5	YARN-2462. TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync should have a test timeout. Contributed by Eric Payne	2014-08-29 20:15:40 +00:00
Jian He	c686aa3533	YARN-2447. RM web service app submission doesn't pass secrets correctly. Contributed by Varun Vasudev	2014-08-29 11:40:47 -07:00
Hitesh Shah	3de66011c2	YARN-2450. Fix typos in log messages. Contributed by Ray Chiang.	2014-08-29 11:16:36 -07:00
Zhijie Shen	4bd0194e6b	YARN-2449. Fixed the bug that TimelineAuthenticationFilterInitializer is not automatically added when hadoop.http.filter.initializers is not configured. Contributed by Varun Vasudev.	2014-08-29 09:40:39 -07:00
Karthik Kambatla	fa80ca49bd	YARN-2405. NPE in FairSchedulerAppsBlock. (Tsuyoshi Ozawa via kasha)	2014-08-28 23:21:37 -07:00
Jian He	9d68445710	Add CHANGES.txt for YARN-2406.	2014-08-28 21:58:48 -07:00
Jian	7b3e27ab73	YARN-2406. Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto. Contributed by Tsuyoshi OZAWA	2014-08-28 21:47:26 -07:00
Allen Wittenauer	d8774cc577	HADOOP-11013. CLASSPATH handling should be consolidated, debuggable (aw)	2014-08-28 18:09:25 -07:00
Jian He	e2d0ff364a	YARN-2182. Updated ContainerId#toString() to append RM Epoch number. Contributed by Tsuyoshi OZAWA	2014-08-27 10:02:45 -07:00
Allen Wittenauer	9ec4a930f5	HADOOP-10996. Stop violence in the *_HOME (aw)	2014-08-27 07:00:31 -07:00
Zhijie Shen	d778abf022	YARN-2035. FileSystemApplicationHistoryStore should not make working dir when it already exists. Contributed by Jonathan Eagles.	2014-08-27 02:01:00 -07:00
Karthik Kambatla	d16bfd1d0f	YARN-1326. RM should log using RMStore at startup time. (Tsuyoshi Ozawa via kasha)	2014-08-27 01:43:58 -07:00
Karthik Kambatla	dc154ab86d	Add a section for 2.5.1 in CHANGES.txt	2014-08-27 00:55:19 -07:00
Karthik Kambatla	0097b15e21	YARN-2393. FairScheduler: Add the notion of steady fair share. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619845 13f79535-47bb-0310-9956-ffa450edef68	2014-08-22 15:44:47 +00:00
Jason Darrell Lowe	4236c6600e	YARN-2434. RM should not recover containers from previously failed attempt when AM restart is not enabled. Contributed by Jian He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619614 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 22:41:34 +00:00
Jason Darrell Lowe	da4ba50269	HADOOP-10893. isolated classloader on the client side. Contributed by Sangjin Lee ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619604 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 21:38:16 +00:00
Allen Wittenauer	cbbb899aed	YARN-2436. [post-HADOOP-9902] yarn application help doesn't work ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619603 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 21:33:35 +00:00
Allen Wittenauer	7e75226e68	YARN-2424. LCE should support non-cgroups, non-secure mode (Chris Douglas via aw) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619421 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 14:57:11 +00:00
Karthik Kambatla	e1dd210fa5	YARN-1919. Potential NPE in EmbeddedElectorService#stop. (Tsuyoshi Ozawa via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619251 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 22:10:52 +00:00
Karthik Kambatla	9b8250c742	Set the release date for 2.5.0 in CHANGES.txt ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619237 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 21:33:19 +00:00
Jason Darrell Lowe	55a2b550b5	YARN-2034. Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect. Contributed by Chen He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619176 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 17:38:51 +00:00
Jian He	e4539e88e3	YARN-2174. Enable HTTPs for the writer REST API of TimelineServer. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619160 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 17:05:07 +00:00
Zhijie Shen	f6a778c372	YARN-2249. Avoided AM release requests being lost on work preserving RM restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618972 13f79535-47bb-0310-9956-ffa450edef68	2014-08-19 20:33:49 +00:00
Jian He	375c221960	YARN-2409. RM ActiveToStandBy transition missing stoping previous rmDispatcher. Contributed by Rohith ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618915 13f79535-47bb-0310-9956-ffa450edef68	2014-08-19 17:49:39 +00:00
Allen Wittenauer	31467453ec	HADOOP-9902. Shell script rewrite (aw) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618847 13f79535-47bb-0310-9956-ffa450edef68	2014-08-19 12:11:17 +00:00
Jian He	519c4be95a	YARN-2411. Support simple user and group mappings to queues. Contributed by Ram Venkatesh ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618542 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 06:08:45 +00:00
Jian He	c3084d6c16	YARN-2389. Added functionality for schedulers to kill all applications in a queue. Contributed by Subramaniam Venkatraman Krishnan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618294 13f79535-47bb-0310-9956-ffa450edef68	2014-08-15 23:53:57 +00:00
Allen Wittenauer	31e478905a	Wrong categorization for a variety of commits in the CHANGES.txt files ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618233 13f79535-47bb-0310-9956-ffa450edef68	2014-08-15 16:47:34 +00:00
Jian He	7360cec692	YARN-2378. Added support for moving applications across queues in CapacityScheduler. Contributed by Subramaniam Venkatraman Krishnan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618106 13f79535-47bb-0310-9956-ffa450edef68	2014-08-15 06:00:31 +00:00
Allen Wittenauer	0350ea3c72	YARN-1918. Typo in description and error message for yarn.resourcemanager.cluster-id (Anandha L Ranganathan via aw) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618070 13f79535-47bb-0310-9956-ffa450edef68	2014-08-14 21:53:12 +00:00
Allen Wittenauer	b8ea45c2e3	YARN-2197. Add a link to YARN CHANGES.txt in the left side of doc (Akira AJISAKA via aw) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618066 13f79535-47bb-0310-9956-ffa450edef68	2014-08-14 21:45:58 +00:00
Zhijie Shen	a9023c2736	YARN-2397. Avoided loading two authentication filters for RM and TS web interfaces. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618054 13f79535-47bb-0310-9956-ffa450edef68	2014-08-14 21:17:20 +00:00
Zhijie Shen	1a535f8dcd	YARN-2070. Made DistributedShell publish the short user name to the timeline server. Contributed by Robert Kanter. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617837 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 21:07:18 +00:00
Zhijie Shen	41aa4badf8	YARN-2277. Added cross-origin support for the timeline server web services. Contributed by Jonathan Eagles. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617832 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 20:29:23 +00:00
Karthik Kambatla	5197f8c3c5	YARN-1370. Fair scheduler to re-populate container allocation state. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617645 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 01:38:59 +00:00
Karthik Kambatla	4239695588	YARN-2399. Delete old versions of files. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617619 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 22:51:57 +00:00
Karthik Kambatla	486e718fc1	YARN-2399. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617600 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 21:43:27 +00:00
Zhijie Shen	7ad7ab1723	YARN-2317. Updated the document about how to write YARN applications. Contributed by Li Lu. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617594 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 21:37:34 +00:00
Jian He	0c9b8f2d7f	YARN-2373. Changed WebAppUtils to use Configuration#getPassword for accessing SSL passwords. Contributed by Larry McCay ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617555 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 18:29:42 +00:00
Junping Du	c2febdcbaa	YARN-1337. Recover containers upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617448 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 10:56:13 +00:00
Jian He	c4dc685343	YARN-2138. Cleaned up notifyDone* APIs in RMStateStore. Contributed by Varun Saxena ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617341 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 18:24:24 +00:00
Xuan Gong	946be75704	YARN-2400: Addendum fix for TestAMRestart failure. Contributed by Jian He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617333 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 17:42:53 +00:00
Karthik Kambatla	da7b508ffc	YARN-2361. RMAppAttempt state machine entries for KILLED state has duplicate event entries. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617190 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 01:42:26 +00:00
Karthik Kambatla	bdd3e2ce49	YARN-2337. ResourceManager sets ClientRMService in RMContext multiple times. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617183 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 00:13:27 +00:00
Junping Du	e91d099c4a	YARN-2302. Refactor TimelineWebServices. (Contributed by Zhijie Shen) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617055 13f79535-47bb-0310-9956-ffa450edef68	2014-08-10 07:21:15 +00:00
Xuan Gong	743f7f30da	YARN-2400. Fixed TestAMRestart fails intermittently. Contributed by Jian He: ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617028 13f79535-47bb-0310-9956-ffa450edef68	2014-08-09 23:31:11 +00:00
Zhijie Shen	ee3825e278	YARN-1954. Added waitFor to AMRMClient(Async). Contributed by Tsuyoshi Ozawa. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617002 13f79535-47bb-0310-9956-ffa450edef68	2014-08-09 18:44:51 +00:00
Karthik Kambatla	a7643f4de7	YARN-2026. Fair scheduler: Consider only active queues for computing fairshare. (Ashwin Shankar via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616915 13f79535-47bb-0310-9956-ffa450edef68	2014-08-09 02:10:00 +00:00
Xuan Gong	eeb4acd955	YARN-2212: ApplicationMaster needs to find a way to update the AMRMToken periodically. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616892 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:38:24 +00:00
Karthik Kambatla	6d39525f6b	YARN-2352. Add missing file. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616784 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 14:38:18 +00:00
Karthik Kambatla	14864e9c7c	YARN-2352. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616769 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 14:17:54 +00:00
Jian He	8437df8ba9	YARN-2008. Fixed CapacityScheduler to calculate headroom based on max available capacity instead of configured max capacity. Contributed by Craig Welch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616580 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 20:00:04 +00:00
Zhijie Shen	3bfdb0091d	YARN-2288. Made persisted data in LevelDB timeline store be versioned. Contributed by Junping Du. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616540 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 17:02:26 +00:00
Zhijie Shen	be6360593b	YARN-2388. Fixed TestTimelineWebServices failure due to HADOOP-10791. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616405 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 05:36:50 +00:00
Karthik Kambatla	8feddc4c84	YARN-2359. Application hangs when it fails to launch AM container. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616375 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 00:06:17 +00:00
Jian He	9ebeac16eb	YARN-2374. Fixed TestDistributedShell#testDSShell failure due to hostname dismatch. Contributed by Varun Vasudev ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616302 13f79535-47bb-0310-9956-ffa450edef68	2014-08-06 18:58:50 +00:00
Junping Du	b47f65214c	YARN-2298. Move TimelineClient to yarn-common project (Contributed by Zhijie Shen) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616100 13f79535-47bb-0310-9956-ffa450edef68	2014-08-06 05:48:32 +00:00
Junping Du	b8f151231b	YARN-1354. Recover applications upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615550 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 13:25:37 +00:00
Junping Du	04ae560370	YARN-2370. Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo (Contributed by Wenwu Peng) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615469 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 01:15:46 +00:00
Jian He	a41c314373	YARN-2343. Improve NMToken expire exception message. Contributed by Li Lu ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615270 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 23:44:48 +00:00
Junping Du	1141edc424	YARN-2051. Fix bug in PBimpls and add more unit tests with reflection. (Contributed by Binglin Chang) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615025 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 04:16:08 +00:00
Xuan Gong	e52f67e389	YARN-1994. Expose YARN/MR endpoints on multiple interfaces. Contributed by Craig Welch, Milan Potocnik,and Arpit Agarwal ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614981 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 20:06:02 +00:00
Zhijie Shen	1d6e178144	YARN-2347. Consolidated RMStateVersion and NMDBSchemaVersion into Version in yarn-server-common. Contributed by Junping Du. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614838 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 09:27:43 +00:00
Jian He	7e54b1c6d9	YARN-2354. DistributedShell may allocate more containers than client specified after AM restarts. Contributed by Li Lu ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614538 13f79535-47bb-0310-9956-ffa450edef68	2014-07-30 03:58:59 +00:00
Karthik Kambatla	c0b49ff107	YARN-2328. FairScheduler: Verify update and continuous scheduling threads are stopped when the scheduler is stopped. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614432 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 17:41:52 +00:00
Zhijie Shen	d6532d3a77	YARN-2247. Made RM web services authenticate users via kerberos and delegation token. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613821 13f79535-47bb-0310-9956-ffa450edef68	2014-07-27 17:55:06 +00:00
Aaron Myers	5d4677b57b	YARN-1796. container-executor shouldn't require o-r permissions. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613548 13f79535-47bb-0310-9956-ffa450edef68	2014-07-26 01:51:35 +00:00
Karthik Kambatla	b0c2c85619	YARN-1726. ResourceSchedulerWrapper broken due to AbstractYarnScheduler. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613547 13f79535-47bb-0310-9956-ffa450edef68	2014-07-26 01:29:25 +00:00
Jian He	d4fec34933	YARN-2211. Persist AMRMToken master key in RMStateStore for RM recovery. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613515 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 20:42:37 +00:00
Karthik Kambatla	77363b9d83	YARN-2335. Annotate all hadoop-sls APIs as @Private. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613478 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 17:12:22 +00:00
Karthik Kambatla	1e553858f9	YARN-2214. FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness. (Ashwin Shankar via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613459 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 16:13:07 +00:00
Devarajulu K	2050e0dad6	YARN-1342. Recover container tokens upon nodemanager restart. Contributed by Jason Lowe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612995 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 05:02:00 +00:00
Zhijie Shen	06e5c5cb2d	YARN-2300. Improved the documentation of the sample requests for RM REST API - submitting an app. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612981 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 03:12:45 +00:00
Jason Darrell Lowe	28fca92521	YARN-2147. client lacks delegation token exception details when application submit fails. Contributed by Chen He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612950 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 21:40:57 +00:00
Sanford Ryza	c88402f36d	YARN-2313. Livelock can occur in FairScheduler when there are lots of running apps (Tsuyoshi Ozawa via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612769 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 05:00:52 +00:00
Karthik Kambatla	ff77582991	YARN-2273. NPE in ContinuousScheduling thread when we lose a node. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612720 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 22:44:38 +00:00
Karthik Kambatla	df2abcb372	YARN-2131. Addendum2: Document -format-state-store. Add a way to format the RMStateStore. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612634 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 18:11:11 +00:00
Jian He	f6c723ff0c	YARN-2295. Refactored DistributedShell to use public APIs of protocol records. Contributed by Li Lu ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612626 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 17:49:14 +00:00
Zhijie Shen	eac0701c96	YARN-2319. Made the MiniKdc instance start/close before/after the class of TestRMWebServicesDelegationTokens. Contributed by Wenwu Peng. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612588 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 15:15:29 +00:00
Junping Du	afb9394c91	YARN-2242. Addendum patch. Improve exception information on AM launch crashes. (Contributed by Li Lu) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612565 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 13:07:23 +00:00
Zhijie Shen	70dededdc9	YARN-2270. Made TestFSDownload#testDownloadPublicWithStatCache be skipped when there’s no ancestor permissions. Contributed by Akira Ajisaka. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612460 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 04:58:00 +00:00
Junping Du	537c361f5b	YARN-2013. The diagnostics is always the ExitCodeException stack when the container crashes. (Contributed by Tsuyoshi OZAWA) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612449 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 03:01:58 +00:00
Karthik Kambatla	266a4ff6a5	YARN-2131. Addendum. Add a way to format the RMStateStore. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612443 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 01:30:36 +00:00
Jason Darrell Lowe	1ad2d7b405	YARN-2321. NodeManager web UI can incorrectly report Pmem enforcement. Contributed by Leitao Guo ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612411 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 21:55:06 +00:00
Jason Darrell Lowe	8a87085820	YARN-2045. Data persisted in NM should be versioned. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612285 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 14:43:59 +00:00
Sanford Ryza	7c71a3b876	YARN-2323. FairShareComparator creates too many Resource objects (Hong Zhiguo via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612187 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 05:00:27 +00:00
Karthik Kambatla	8871d8ed9f	YARN-2244. FairScheduler missing handling of containers for unknown application attempts. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611840 13f79535-47bb-0310-9956-ffa450edef68	2014-07-19 00:12:05 +00:00
Xuan Gong	f1b831ccfb	YARN-2208. AMRMTokenManager need to have a way to roll over AMRMToken. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611820 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 21:46:29 +00:00
Junping Du	403ec8ea80	YARN-1341. Recover NMTokens upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611512 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 23:33:22 +00:00
Jian He	3c193811ca	YARN-2219. Addendum patch for YARN-2219 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611240 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 03:28:39 +00:00
Vinod Kumar Vavilapalli	bda23181bf	YARN-2219. Changed ResourceManager to avoid AMs and NMs getting exceptions after RM recovery but before scheduler learns about apps and app-attempts. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611222 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 00:14:56 +00:00
Jian He	40e1bb9d31	YARN-2264. Fixed a race condition in DrainDispatcher which may cause random test failures. Contributed by Li Lu ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611126 13f79535-47bb-0310-9956-ffa450edef68	2014-07-16 18:25:05 +00:00
Vinayakumar B	dc31d66f8a	HADOOP-9921. daemon scripts should remove pid file on stop call after stop or process is found not running ( Contributed by Vinayakumar B) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610964 13f79535-47bb-0310-9956-ffa450edef68	2014-07-16 10:48:15 +00:00
Vinod Kumar Vavilapalli	030580387a	YARN-2233. Implemented ResourceManager web-services to create, renew and cancel delegation tokens. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610876 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 23:00:17 +00:00
Mayank Bansal	43589a8df7	YARN-1408 Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins. (Sunil G via mayank) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610860 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 21:48:58 +00:00
Vinod Kumar Vavilapalli	a6cd712ca7	YARN-2228. Augmented TimelineServer to load pseudo authentication filter when authentication = simple. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610575 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 04:33:48 +00:00
Vinod Kumar Vavilapalli	c6cc6a6a8e	YARN-2260. Fixed ResourceManager's RMNode to correctly remember containers when nodes resync during work-preserving RM restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610557 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 23:32:03 +00:00
Karthik Kambatla	4d211d5fde	YARN-2274. FairScheduler: Add debug information about cluster capacity, availability and reservations. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609942 13f79535-47bb-0310-9956-ffa450edef68	2014-07-12 15:10:19 +00:00
Jian He	3bdea22947	Moved few YARN entries in CHANGES.txt from 2.5 to 2.6 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609594 13f79535-47bb-0310-9956-ffa450edef68	2014-07-11 00:06:55 +00:00
Xuan Gong	c0439b732c	YARN-2269. Remove external links from YARN UI. Contributed by Craig Welch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609590 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 23:31:55 +00:00
Jian He	50be8561a7	YARN-2088. Fixed a bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder. Contributed by Binglin Chang ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609584 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 22:36:13 +00:00
Karthik Kambatla	9f1768fba2	YARN-2224. Fix CHANGES.txt. This was committed as YARN-2204 before. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609582 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 22:18:24 +00:00
Jian He	c9fb040c87	YARN-2181. Added preemption info to logs and RM web UI. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609561 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 20:03:35 +00:00
Karthik Kambatla	8fbca62a90	YARN-2131. Add a way to format the RMStateStore. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609278 13f79535-47bb-0310-9956-ffa450edef68	2014-07-09 19:58:43 +00:00
Jian He	d751a61e5a	YARN-1366. Changed AMRMClient to re-register with RM and send outstanding requests back to RM on work-preserving RM restart. Contributed by Rohith ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609254 13f79535-47bb-0310-9956-ffa450edef68	2014-07-09 18:25:45 +00:00
Zhijie Shen	12c4197b35	YARN-2158. Improved assertion messages of TestRMWebServicesAppsModification. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608667 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 05:50:04 +00:00
Jian He	6d7dbd4fed	YARN-1367. Changed NM to not kill containers on NM resync if RM work-preserving restart is enabled. Contributed by Anubhav Dhoot ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608334 13f79535-47bb-0310-9956-ffa450edef68	2014-07-07 04:37:59 +00:00
Sanford Ryza	5644f529f3	YARN-2250. FairScheduler.findLowestCommonAncestorQueue returns null when queues not identical (Krisztian Horvath via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607872 13f79535-47bb-0310-9956-ffa450edef68	2014-07-04 15:16:43 +00:00
Junping Du	4074843fea	YARN-2251. Avoid negative elapsed time in JHS/MRAM web UI and services (Contributed by Zhijie Shen) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607833 13f79535-47bb-0310-9956-ffa450edef68	2014-07-04 11:18:05 +00:00
Junping Du	5cb489f9d3	YARN-2242. Improve exception information on AM launch crashes. (Contributed by Li Lu) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607655 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 14:15:19 +00:00
Karthik Kambatla	54dc17ce2f	Preparing for release 2.6.0 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607538 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 05:55:05 +00:00
Vinod Kumar Vavilapalli	3047336791	YARN-2022. Fixing CHANGES.txt to be correctly placed. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607486 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 21:51:43 +00:00
Vinod Kumar Vavilapalli	45b191e38c	YARN-2232. Fixed ResourceManager to allow DelegationToken owners to be able to cancel their own tokens in secure mode. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607484 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 21:36:42 +00:00
Karthik Kambatla	447c1c233b	YARN-2241. ZKRMStateStore: On startup, show nicer messages if znodes already exist. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607473 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 20:33:26 +00:00
Steve Loughran	d1f54f4f4b	YARN-2065 AM cannot create new containers after restart ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607441 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 18:35:10 +00:00
Karthik Kambatla	58e398f31d	YARN-2204. Explicitly enable vmem check in TestContainersMonitor#testContainerKillOnMemoryOverflow. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607231 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 02:05:37 +00:00
Mayank Bansal	03a25d2cc1	YARN-2022 Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy (Sunil G via mayank) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607227 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 01:54:47 +00:00
Vinod Kumar Vavilapalli	075ff276ca	YARN-1713. Added get-new-app and submit-app functionality to RM web services. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607216 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 00:23:07 +00:00
Xuan Gong	e5ae7c55d1	TestRMApplicationHistoryWriter sometimes fails in trunk. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606835 13f79535-47bb-0310-9956-ffa450edef68	2014-06-30 16:51:22 +00:00
Jian He	b0c51504c4	YARN-2052. Embedded an epoch number in container id to ensure the uniqueness of container id after RM restarts. Contributed by Tsuyoshi OZAWA ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606557 13f79535-47bb-0310-9956-ffa450edef68	2014-06-29 18:24:03 +00:00
Jian He	b717d44b52	YARN-614. Changed ResourceManager to not count disk failure, node loss and RM restart towards app failures. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606407 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 23:37:46 +00:00
Zhijie Shen	55a0aa0bad	YARN-2201. Made TestRMWebServicesAppsModification be independent of the changes on yarn-default.xml. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606285 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 03:30:44 +00:00
Jason Darrell Lowe	73927ba695	YARN-2104. Scheduler queue filter failed to work because index of queue column changed. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606265 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 23:11:12 +00:00
Karthik Kambatla	f911f5495b	YARN-2204. Addendum patch. TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606168 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 18:09:41 +00:00
Ravi Prakash	f084170a0a	YARN 2163. WebUI: Order of AppId in apps table should be consistent with ApplicationId.compareTo() ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605964 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 06:43:46 +00:00
Vinod Kumar Vavilapalli	9571db19eb	YARN-2171. Improved CapacityScheduling to not lock on nodemanager-count when AMs heartbeat in. Contributed by Jason Lowe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605616 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 21:56:42 +00:00
Karthik Kambatla	1a3a7e0c1a	YARN-2204. TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605548 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 18:50:53 +00:00
Jian He	c3f1c30e65	YARN-1365. Changed ApplicationMasterService to allow an app to re-register after RM restart. Contributed by Anubhav Dhoot ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605263 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 04:42:39 +00:00
Vinod Kumar Vavilapalli	e285b98f0f	YARN-2152. Added missing information into ContainerTokenIdentifier so that NodeManagers can report the same to RM when RM restarts. Contributed Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605205 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 21:43:22 +00:00
Thomas Graves	1f9a0fd927	YARN-2072. RM/NM UIs and webservices are missing vcore information. (Nathan Roberts via tgraves) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605162 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 19:34:34 +00:00
Karthik Kambatla	c0991d11eb	YARN-2109. Fix TestRM to work with both schedulers. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605142 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 17:30:53 +00:00
Karthik Kambatla	db4d277117	YARN-2192. TestRMHA fails when run with a mix of Schedulers. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605138 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 17:05:35 +00:00
Sanford Ryza	29c102cad0	YARN-2111. In FairScheduler.attemptScheduling, we don't count containers as assigned if they have 0 memory but non-zero cores (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605113 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 15:40:39 +00:00
Vinod Kumar Vavilapalli	d16470025a	YARN-2074. Changed ResourceManager to not count AM preemptions towards app failures. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605106 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 15:15:12 +00:00
Devarajulu K	cb2b34b01c	YARN-2195. Clean a piece of code in ResourceRequest. Contributed by Wei Yan. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605083 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 13:57:31 +00:00
Jian He	59b5e9fa15	YARN-2191. Added a new test to ensure NM will clean up completed applications in the case of RM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604949 13f79535-47bb-0310-9956-ffa450edef68	2014-06-23 22:52:38 +00:00
Karthik Kambatla	6fcbf9b848	YARN-2187. FairScheduler: Disable max-AM-share check by default. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604321 13f79535-47bb-0310-9956-ffa450edef68	2014-06-21 07:30:07 +00:00
Haohui Mai	22cbcd16cb	HADOOP-10717. Revert r1603571. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603620 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 20:37:25 +00:00
Steve Loughran	bae5837d3b	HADOOP-10717. Missing JSP support in Jetty ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603534 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 17:08:45 +00:00
Jason Darrell Lowe	98238a8d4a	YARN-2167. LeveldbIterator should get closed in NMLeveldbStateStoreService#loadLocalizationState() within finally block. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603039 13f79535-47bb-0310-9956-ffa450edef68	2014-06-17 02:12:03 +00:00
Junping Du	072360d128	YARN-1339. Recover DeletionService state upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603036 13f79535-47bb-0310-9956-ffa450edef68	2014-06-17 01:02:16 +00:00
Jian He	95897ca14b	YARN-1885. Fixed a bug that RM may not send application-clean-up signal to NMs where the completed applications previously ran in case of RM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603028 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 23:56:12 +00:00
Karthik Kambatla	082c2ab8b8	YARN-2159. Better logging in SchedulerNode#allocateContainer. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603003 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 20:45:38 +00:00
Arun Murthy	26936978be	Preparing to release hadoop-2.4.1. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602886 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 15:07:00 +00:00
Vinod Kumar Vavilapalli	dc7dd1fa19	YARN-1702. Added kill app functionality to RM web services. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602298 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 21:31:52 +00:00
Karthik Kambatla	4bc91b44c9	YARN-2155. FairScheduler: Incorrect threshold check for preemption. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602295 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 21:23:32 +00:00
Zhijie Shen	deb858a835	YARN-2075. Fixed the test failure of TestRMAdminCLI. Contributed by Kenji Kikushima. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602071 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 06:40:32 +00:00
Bikas Saha	2584d531e1	YARN-2148. TestNMClient failed due more exit code values added and passed to AM (Wangda Tan via bikas) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602043 13f79535-47bb-0310-9956-ffa450edef68	2014-06-11 22:45:09 +00:00
Jian He	c6e29a9f06	YARN-2125. Changed ProportionalCapacityPreemptionPolicy to log CSV in debug level. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601980 13f79535-47bb-0310-9956-ffa450edef68	2014-06-11 18:31:28 +00:00
Jian He	710a8693e5	YARN-2124. Fixed NPE in ProportionalCapacityPreemptionPolicy. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601964 13f79535-47bb-0310-9956-ffa450edef68	2014-06-11 17:30:18 +00:00
Bikas Saha	ecfd43a2f1	YARN-2091. Add more values to ContainerExitStatus and pass it from NM to RM and then to app masters (Tsuyoshi OZAWA via bikas) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601762 13f79535-47bb-0310-9956-ffa450edef68	2014-06-10 20:08:33 +00:00
Karthik Kambatla	5de6f72054	YARN-1424. RMAppAttemptImpl should return the DummyApplicationResourceUsageReport for all invalid accesses. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601742 13f79535-47bb-0310-9956-ffa450edef68	2014-06-10 19:03:06 +00:00
Jian He	d3b8971798	YARN-2030. Augmented RMStateStore with state machine. Contributed by Binglin Chang ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601537 13f79535-47bb-0310-9956-ffa450edef68	2014-06-10 01:00:15 +00:00
Jian He	c94f2cec3a	Augmented RMStateStore with state machine. Contributed by Binglin Chang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601491 13f79535-47bb-0310-9956-ffa450edef68	2014-06-09 19:44:31 +00:00
Vinod Kumar Vavilapalli	424fd9494f	YARN-1368. Added core functionality of recovering container state into schedulers after ResourceManager Restart so as to preserve running work in the cluster. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601303 13f79535-47bb-0310-9956-ffa450edef68	2014-06-09 03:09:21 +00:00
Karthik Kambatla	9958072d53	YARN-2132. ZKRMStateStore.ZKAction#runWithRetries doesn't log the exception it encounters. (Vamsee Yarlagadda via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601065 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 06:12:59 +00:00
Karthik Kambatla	85d4c787e0	YARN-2128. FairScheduler: Incorrect calculation of amResource usage. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601050 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 01:21:33 +00:00
Karthik Kambatla	969bef3c77	YARN-2122. In AllocationFileLoaderService, the reloadThread should be created in init() and started in start(). (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601045 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 00:49:20 +00:00
Vinod Kumar Vavilapalli	825365d1d0	YARN-2121. Fixed NPE handling in Timeline Server's TimelineAuthenticator. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601000 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 20:32:43 +00:00
Zhijie Shen	08b4aa699a	YARN-2117. Fixed the issue that secret file reader is potentially not closed in TimelineAuthenticationFilterInitializer. Contributed by Chen He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600994 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 20:07:58 +00:00
Zhijie Shen	d7f5d76869	YARN-2118. Fixed the type mismatch in Map#containsKey check of TimelineWebServices#injectOwnerInfo. Contributed by Ted Yu. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600967 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 17:47:03 +00:00
Junping Du	0ceb742549	YARN-1977. Add tests on getApplicationRequest with filtering start time range. (Contributed by Junping Du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600644 13f79535-47bb-0310-9956-ffa450edef68	2014-06-05 13:15:44 +00:00
Karthik Kambatla	d1d6bb70f4	YARN-2061. Revisit logging levels in ZKRMStateStore. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600498 13f79535-47bb-0310-9956-ffa450edef68	2014-06-04 21:11:09 +00:00
Karthik Kambatla	731f417f67	YARN-2119. DEFAULT_PROXY_ADDRESS should use DEFAULT_PROXY_PORT. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600484 13f79535-47bb-0310-9956-ffa450edef68	2014-06-04 20:12:47 +00:00
Sanford Ryza	16caa3fd18	YARN-1913. With Fair Scheduler, cluster can logjam when all resources are consumed by AMs (Wei Yan via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599400 13f79535-47bb-0310-9956-ffa450edef68	2014-06-03 00:56:48 +00:00
Karthik Kambatla	5bbc484393	YARN-1877. Updated CHANGES.txt to fix the JIRA number. It was previously committed as YARN-2010. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599348 13f79535-47bb-0310-9956-ffa450edef68	2014-06-02 20:28:13 +00:00
Karthik Kambatla	0aad2d56df	YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599345 13f79535-47bb-0310-9956-ffa450edef68	2014-06-02 20:22:52 +00:00
Junping Du	790cbbf3e2	YARN-2103. Inconsistency between viaProto flag and initial value of SerializedExceptionProto.Builder (Contributed by Binglin Chang) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599115 13f79535-47bb-0310-9956-ffa450edef68	2014-06-02 08:15:30 +00:00
Karthik Kambatla	a4ba451802	YARN-1474. Make schedulers services. (Tsuyoshi Ozawa via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598908 13f79535-47bb-0310-9956-ffa450edef68	2014-05-31 19:33:09 +00:00
Vinod Kumar Vavilapalli	23c325ad47	YARN-2115. Replaced RegisterNodeManagerRequest's ContainerStatus with a new NMContainerStatus which has more information that is needed for work-preserving RM-restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598790 13f79535-47bb-0310-9956-ffa450edef68	2014-05-31 00:20:50 +00:00
Chris Nauroth	d599adcc6a	YARN-1868. YARN status web ui does not show correctly in IE 11. Contributed by Chuan Liu. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598686 13f79535-47bb-0310-9956-ffa450edef68	2014-05-30 18:07:23 +00:00
Junping Du	66598697a6	YARN-1338. Recover localized resource cache state upon nodemanager restart (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598640 13f79535-47bb-0310-9956-ffa450edef68	2014-05-30 15:37:27 +00:00
Karthik Kambatla	75112e97b4	YARN-2010. Document yarn.resourcemanager.zk-auth and its scope. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598636 13f79535-47bb-0310-9956-ffa450edef68	2014-05-30 15:32:23 +00:00
Karthik Kambatla	49a3a0cd0c	YARN-2054. Better defaults for YARN ZK configs for retries and retry-inteval when HA is enabled. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598630 13f79535-47bb-0310-9956-ffa450edef68	2014-05-30 15:24:49 +00:00
Arpit Agarwal	4a4868e523	HADOOP-10448. Support pluggable mechanism to specify proxy user settings (Contributed by Benoy Antony) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598396 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 20:52:01 +00:00
Vinod Kumar Vavilapalli	cd24e955cf	YARN-2112. Fixed yarn-common's pom.xml to include jackson dependencies so that both Timeline Server and client can access them. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598373 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 19:06:36 +00:00
Chris Nauroth	806f4d11f2	HADOOP-10602. Documentation has broken "Go Back" hyperlinks. Contributed by Akira AJISAKA. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598337 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 17:26:50 +00:00
Sanford Ryza	342da5b4d3	YARN-596. Use scheduling policies throughout the queue hierarchy to decide which containers to preempt (Wei Yan via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598197 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 04:01:24 +00:00
Zhijie Shen	001078e067	YARN-2107. Refactored timeline classes into o.a.h.y.s.timeline package. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598094 13f79535-47bb-0310-9956-ffa450edef68	2014-05-28 18:09:04 +00:00
Sanford Ryza	edfbc8ad4a	YARN-2105. Fix TestFairScheduler after YARN-2012. (Ashwin Shankar via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597902 13f79535-47bb-0310-9956-ffa450edef68	2014-05-27 23:46:22 +00:00
Vinod Kumar Vavilapalli	4dd2003373	YARN-2071. Modified levelDB store permissions to be readable only by the server user. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597231 13f79535-47bb-0310-9956-ffa450edef68	2014-05-24 01:24:26 +00:00
Karthik Kambatla	7dd378c274	YARN-2096. Race in TestRMRestart#testQueueMetricsOnRMRestart. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597223 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 23:51:00 +00:00
Sanford Ryza	a00b2d4f37	YARN-2073. Fair Scheduler: Add a utilization threshold to prevent preempting resources when cluster is free (Karthik Kambatla via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597209 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:52:46 +00:00
Vinod Kumar Vavilapalli	7f0724dddb	YARN-2059. Added admin ACLs support to Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597207 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:40:52 +00:00
Sanford Ryza	6c56612af5	YARN-2012. Fair Scheduler: allow default queue placement rule to take an arbitrary queue (Ashwin Shankar via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597204 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:38:52 +00:00
Vinod Kumar Vavilapalli	892ada8fb3	YARN-1937. Added owner-only ACLs support for Timeline Client and server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597186 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 21:19:15 +00:00
Vinod Kumar Vavilapalli	af8b09af75	YARN-1936. Added security support for the Timeline Client. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597153 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 18:47:57 +00:00
Vinod Kumar Vavilapalli	b867b69556	YARN-2049. Added delegation-token support for the Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597130 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 17:09:47 +00:00
Karthik Kambatla	619ec833fc	YARN-2089. FairScheduler: QueuePlacementPolicy and QueuePlacementRule are missing audience annotations. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596765 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 06:13:24 +00:00
Vinod Kumar Vavilapalli	82f3454f5a	YARN-2017. Merged some of the common scheduler code. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596753 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 05:32:26 +00:00
Zhijie Shen	28058894dd	YARN-2081. Fixed TestDistributedShell failure after YARN-1962. Contributed by Zhiguo Hong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596724 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 01:16:14 +00:00
Vinod Kumar Vavilapalli	fdb5870d49	YARN-1938. Added kerberos login for the Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596710 13f79535-47bb-0310-9956-ffa450edef68	2014-05-21 23:20:08 +00:00
Jason Darrell Lowe	64ec743e6c	YARN-2050. Fix LogCLIHelpers to create the correct FileContext. Contributed by Ming Ma ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596310 13f79535-47bb-0310-9956-ffa450edef68	2014-05-20 16:19:55 +00:00
Junping Du	461ded8bd4	YARN-2066. Wrong field is referenced in GetApplicationsRequestPBImpl#mergeLocalToBuilder (Contributed by Hong Zhiguo) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595413 13f79535-47bb-0310-9956-ffa450edef68	2014-05-17 01:43:15 +00:00
Ravi Prakash	c9377189a0	MAPREDUCE 5874. Creating MapReduce REST API section. Contributed by Tsuyoshi Ozawa ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595265 13f79535-47bb-0310-9956-ffa450edef68	2014-05-16 16:50:58 +00:00
Jian He	0c5e2f6c73	Relocate entry in CHANGES.txt ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595126 13f79535-47bb-0310-9956-ffa450edef68	2014-05-16 07:09:42 +00:00
Jian He	0f9147c857	YARN-2053. Fixed a bug in AMS to not add null NMToken into NMTokens list from previous attempts for work-preserving AM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595116 13f79535-47bb-0310-9956-ffa450edef68	2014-05-16 06:22:22 +00:00
Sanford Ryza	561c014e77	YARN-2042. String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp (Chen He via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594482 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 06:55:04 +00:00
Sanford Ryza	84dfae2f8a	YARN-1986. In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE (Hong Zhiguo via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594476 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 06:41:20 +00:00
Junping Du	b29434a5c8	YARN-1362. Distinguish between nodemanager shutdown for decommission vs shutdown for restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594421 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 00:20:53 +00:00
Christopher Douglas	45b42676f9	YARN-1957. Consider the max capacity of the queue when computing the ideal ... capacity for preemption. Contributed by Carlo Curino git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594414 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 23:15:27 +00:00
Jonathan Turner Eagles	1c48142807	YARN-1981. Nodemanager version is not updated when a node reconnects (Jason Lowe via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594358 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 20:03:58 +00:00
Vinod Kumar Vavilapalli	2f87e77cb7	YARN-1861. Fixed a bug in RM to reset leader-election on fencing that was causing both RMs to be stuck in standby mode when automatic failover is enabled. Contributed by Karthik Kambatla and Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594356 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 20:00:44 +00:00
Jason Darrell Lowe	b0e80d1a47	MAPREDUCE-5814. fat jar with *-default.xml may fail when mapreduce.job.classloader=true. Contributed by Gera Shegalov ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594326 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 18:55:05 +00:00
Jason Darrell Lowe	95ba9f47fc	YARN-1751. Improve MiniYarnCluster for log aggregation testing. Contributed by Ming Ma ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594275 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 16:43:59 +00:00
Jian He	089adaa999	YARN-1976. Fix CHANGES.txt for YARN-1976. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594123 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 04:49:30 +00:00
Jian He	4f6493bcf9	YARN-2016. Fix a bug in GetApplicationsRequestPBImpl to add the missed fields to proto. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594085 13f79535-47bb-0310-9956-ffa450edef68	2014-05-12 20:45:21 +00:00
Jian He	41344a4a69	YARN-1975. Fix yarn application CLI to print the scheme of the tracking url of failed/killed applications. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593874 13f79535-47bb-0310-9956-ffa450edef68	2014-05-12 00:43:35 +00:00
Junping Du	ca95af7d23	YARN-2011. Fix typo and warning in TestLeafQueue (Contributed by Chen He) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593804 13f79535-47bb-0310-9956-ffa450edef68	2014-05-11 15:13:29 +00:00
Karthik Kambatla	4a19196a34	YARN-1987. Wrapper for leveldb DBIterator to aid in handling database exceptions. (Jason Lowe via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593757 13f79535-47bb-0310-9956-ffa450edef68	2014-05-11 06:11:04 +00:00
Vinod Kumar Vavilapalli	58c81d56e9	YARN-1962. Changed Timeline Service client configuration to be off by default given the non-readiness of the feature yet. Contributed by Mohammad Kamrul Islam. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593750 13f79535-47bb-0310-9956-ffa450edef68	2014-05-11 00:15:12 +00:00
Vinod Kumar Vavilapalli	fa6fd973cf	YARN-1982. Renamed the daemon name to be TimelineServer instead of History Server and deprecated the old usage. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593748 13f79535-47bb-0310-9956-ffa450edef68	2014-05-11 00:04:49 +00:00
Junping Du	72ba2b35d8	YARN-766. TestNodeManagerShutdown in branch-2 should use Shell to form the output path and a format issue in trunk. (Contributed by Siddharth Seth) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593660 13f79535-47bb-0310-9956-ffa450edef68	2014-05-10 03:45:01 +00:00
Sanford Ryza	1a2f75c903	YARN-2036. Document yarn.resourcemanager.hostname in ClusterSetup (Ray Chiang via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593631 13f79535-47bb-0310-9956-ffa450edef68	2014-05-09 22:18:43 +00:00
Zhijie Shen	0c437e90b8	YARN-1701. Improved default paths of the timeline store and the generic history store. Contributed by Tsuyoshi Ozawa. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593481 13f79535-47bb-0310-9956-ffa450edef68	2014-05-09 04:23:27 +00:00
Sanford Ryza	1c5902fba2	YARN-1864. Add missing file FSQueueType.java ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593191 13f79535-47bb-0310-9956-ffa450edef68	2014-05-08 07:22:42 +00:00
Sanford Ryza	cfc97a4e88	YARN-1864. Fair Scheduler Dynamic Hierarchical User Queues (Ashwin Shankar via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593190 13f79535-47bb-0310-9956-ffa450edef68	2014-05-08 07:21:11 +00:00
Arpit Agarwal	f4b687b873	YARN-2018. TestClientRMService.testTokenRenewalWrongUser fails after HADOOP-10562. (Contributed by Ming Ma) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592783 13f79535-47bb-0310-9956-ffa450edef68	2014-05-06 15:45:49 +00:00
Junping Du	2ad1cee5da	YARN-1201. TestAMAuthorization fails with local hostname cannot be resolved. (Wangda Tan via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592197 13f79535-47bb-0310-9956-ffa450edef68	2014-05-03 13:03:27 +00:00
Haohui Mai	d777cb8996	HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592069 13f79535-47bb-0310-9956-ffa450edef68	2014-05-02 22:26:02 +00:00
Vinod Kumar Vavilapalli	ef498235ad	YARN-1696. Added documentation for ResourceManager fail-over. Contributed by Karthik Kambatla, Masatake Iwasaki, Tsuyoshi OZAWA. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591416 13f79535-47bb-0310-9956-ffa450edef68	2014-04-30 18:00:32 +00:00
Vinod Kumar Vavilapalli	7a241aee90	YARN-1929. Fixed a deadlock in ResourceManager that occurs when failover happens right at the time of shutdown. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591071 13f79535-47bb-0310-9956-ffa450edef68	2014-04-29 19:49:44 +00:00
Jason Darrell Lowe	a9775b4e49	YARN-738. TestClientRMTokens is failing irregularly while running all yarn tests. Contributed by Ming Ma ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591030 13f79535-47bb-0310-9956-ffa450edef68	2014-04-29 17:47:11 +00:00
Sanford Ryza	faffedeb24	YARN-483. Improve documentation on log aggregation in yarn-default.xml (Akira Ajisaka via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590150 13f79535-47bb-0310-9956-ffa450edef68	2014-04-25 21:14:03 +00:00
Jing Zhao	6d4c7df434	HADOOP-10535. Make the retry numbers in ActiveStandbyElector configurable. Contributed by Jing Zhao. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589905 13f79535-47bb-0310-9956-ffa450edef68	2014-04-24 23:03:30 +00:00
Jason Darrell Lowe	c02ea74551	YARN-1975. Used resources shows escaped html in CapacityScheduler and FairScheduler page. Contributed by Mit Desai ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589859 13f79535-47bb-0310-9956-ffa450edef68	2014-04-24 20:02:44 +00:00
Chris Nauroth	84388525a3	YARN-1970. Prepare YARN codebase for JUnit 4.11. Contributed by Chris Nauroth. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589001 13f79535-47bb-0310-9956-ffa450edef68	2014-04-21 23:31:18 +00:00
Ivan Mitic	4810e2b849	YARN-1865. ShellScriptBuilder does not check for some error conditions. Contributed by Remus Rusanu. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588693 13f79535-47bb-0310-9956-ffa450edef68	2014-04-19 18:55:07 +00:00
Jason Darrell Lowe	d667df4ed0	YARN-1932. Javascript injection on the job status page. Contributed by Mit Desai ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588572 13f79535-47bb-0310-9956-ffa450edef68	2014-04-18 21:41:37 +00:00
Jason Darrell Lowe	cda8646cfa	YARN-1940. deleteAsUser() terminates early without deleting more files on error. Contributed by Rushabh S Shah ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588546 13f79535-47bb-0310-9956-ffa450edef68	2014-04-18 19:24:13 +00:00
Vinod Kumar Vavilapalli	bad021534c	YARN-1281. Fixed TestZKRMStateStoreZKClientConnections to not fail intermittently due to ZK-client timeouts. Contributed by Tsuyoshi Ozawa. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588369 13f79535-47bb-0310-9956-ffa450edef68	2014-04-17 20:57:15 +00:00
Junping Du	bd43d2481e	YARN-1947. TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently. (Jian He via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588365 13f79535-47bb-0310-9956-ffa450edef68	2014-04-17 20:27:37 +00:00
Junping Du	0d087f7941	YARN-1750. TestNodeStatusUpdater#testNMRegistration is incorrect in test case. (Wangda Tan via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588343 13f79535-47bb-0310-9956-ffa450edef68	2014-04-17 19:06:48 +00:00
Junping Du	36ed8c74ea	YARN-1870. FileInputStream is not closed in ProcfsBasedProcessTree#constructProcessSMAPInfo. (Fengdong Yu via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588324 13f79535-47bb-0310-9956-ffa450edef68	2014-04-17 18:05:43 +00:00
Thomas Graves	ad9edb02b9	YARN-1931. Private API change in YARN-1824 in 2.4 broke compatibility with previous releases (Sandy Ryza via tgraves) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588281 13f79535-47bb-0310-9956-ffa450edef68	2014-04-17 15:23:22 +00:00
Jian He	38d5ca2e47	YARN-1934. Fixed a potential NPE in ZKRMStateStore caused by handling Disconnected event from ZK. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587776 13f79535-47bb-0310-9956-ffa450edef68	2014-04-16 02:02:18 +00:00
Zhijie Shen	44b6261bfa	YARN-1892. Improved some logs in the scheduler. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587717 13f79535-47bb-0310-9956-ffa450edef68	2014-04-15 20:37:44 +00:00
Vinod Kumar Vavilapalli	eb7b33c298	YARN-1928. Fixed a race condition in TestAMRMRPCNodeUpdates which caused it to fail occassionally. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587114 13f79535-47bb-0310-9956-ffa450edef68	2014-04-13 22:40:16 +00:00
Vinod Kumar Vavilapalli	c6b70f4760	YARN-1933. Fixed test issues with TestAMRestart and TestNodeHealthService. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587104 13f79535-47bb-0310-9956-ffa450edef68	2014-04-13 21:51:38 +00:00
Sanford Ryza	9274626a11	YARN-1923. Make Fair Scheduler resource ratio calculations terminate faster (Anubhav Dhoot via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586796 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 23:24:40 +00:00
Vinod Kumar Vavilapalli	4636f816fa	YARN-1833. Relocating CHANGES.txt entry in trunk and branch-2 to the right location. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586769 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 20:28:27 +00:00
Vinod Kumar Vavilapalli	ba4474b63f	YARN-1907. Merged into branch-2.4 also. ... svn merge --ignore-ancestry -c 1585992 ../../trunk/ onto branch-2.4. Fixed CHANGES.txt entries too. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586767 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 20:23:09 +00:00
Vinod Kumar Vavilapalli	922f97c89e	YARN-1883. Merged into branch-2.4 also. ... svn merge --ignore-ancestry -c 1582862 ../../trunk/ onto branch-2.4. Fixed CHANGES.txt entries too. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586766 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 20:16:10 +00:00
Jonathan Turner Eagles	0a0ca4f062	HADOOP-8826. Docs still refer to 0.20.205 as stable line (Mit Desai via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586685 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 15:34:12 +00:00
Vinod Kumar Vavilapalli	d6a6e982a8	YARN-1926. Changed DistributedShell to use appIDs as unique identifiers for HDFS paths and thus avoid test failures on Windows. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586562 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 04:06:40 +00:00
Zhijie Shen	dc84800184	YARN-1924. Made ZKRMStateStore updateApplication(Attempt)StateInternal work when Application(Attempt) state hasn't been stored before. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586547 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 03:36:36 +00:00
Jian He	ed78328d50	YARN-1903. Set exit code and diagnostics when container is killed at NEW/LOCALIZING state. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586522 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 01:26:36 +00:00
Vinod Kumar Vavilapalli	cde7b17566	YARN-1914. Fixed resource-download on NodeManagers to skip permission verification of public cache files in Windows+local file-system environment. Contribued by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586434 13f79535-47bb-0310-9956-ffa450edef68	2014-04-10 19:28:31 +00:00
Zhijie Shen	3993d646d7	YARN-1920. Fixed TestFileSystemApplicationHistoryStore failure on windows. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586414 13f79535-47bb-0310-9956-ffa450edef68	2014-04-10 18:57:02 +00:00
Vinod Kumar Vavilapalli	791f2f6f1b	YARN-1910. Fixed a race condition in TestAMRMTokens that causes the test to fail more often on Windows. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586192 13f79535-47bb-0310-9956-ffa450edef68	2014-04-10 01:36:50 +00:00
Kihwal Lee	c3f6d71726	YARN-1907. TestRMApplicationHistoryWriter#testRMWritingMassiveHistory intermittently fails. Contributed by Mit Desai. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585992 13f79535-47bb-0310-9956-ffa450edef68	2014-04-09 15:33:25 +00:00