1783 Commits

Author	SHA1	Message	Date
Jian He	21101c01f2	YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu	2015-03-06 14:18:11 -08:00
Xuan	d1abc5d4fc	YARN-3227. Timeline renew delegation token fails when RM user's TGT is ... expired. Contributed by Zhijie Shen	2015-03-06 13:32:05 -08:00
Jian He	95bfd087dc	YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong	2015-03-05 21:20:09 -08:00
Vinod Kumar Vavilapalli	138c9cadee	YARN-2786. Created a yarn cluster CLI and seeded with one command for listing node-labels collection. Contributed by Wangda Tan.	2015-03-05 10:54:34 -08:00
Tsuyoshi Ozawa	28b85a2116	Update CHANGES.txt for YARN-2616 to fix indentation.	2015-03-06 00:53:03 +09:00
Tsuyoshi Ozawa	1b67209612	YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi.	2015-03-05 19:55:56 +09:00
Karthik Kambatla	8d88691d16	YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)	2015-03-04 19:49:05 -08:00
Karthik Kambatla	22426a1c9f	YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha)	2015-03-04 18:06:58 -08:00
Karthik Kambatla	53947f37c7	YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha)	2015-03-04 17:33:30 -08:00
Jason Lowe	03cc22945e	YARN-3131. YarnClientImpl should check FAILED and KILLED state in submitApplication. Contributed by Chang Li	2015-03-04 18:04:22 +00:00
Wangda Tan	e17e5ba9d7	YARN-3272. Surface container locality info in RM web UI (Jian He via wangda)	2015-03-03 11:49:01 -08:00
Vinod Kumar Vavilapalli	14dd647c55	YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan.	2015-03-02 17:52:47 -08:00
Wangda Tan	abac6eb9d5	YARN-3270. Fix node label expression not getting set in ApplicationSubmissionContext (Rohit Agarwal via wangda)	2015-03-02 17:21:19 -08:00
Jian He	5d0bae550f	YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu	2015-03-02 14:39:49 -08:00
Allen Wittenauer	8472d72997	YARN-3199. Fair Scheduler documentation improvements (Rohit Agarwal via aw)	2015-02-28 11:36:15 -08:00
Allen Wittenauer	2e44b75f72	YARN-3168. Convert site documentation from apt to markdown (Gururaj Shetty via aw)	2015-02-27 20:39:44 -08:00
Wangda Tan	edcecedc1c	YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda)	2015-02-27 16:13:32 -08:00
Tsuyoshi Ozawa	01a1621930	YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu.	2015-02-28 00:56:44 +09:00
Konstantin V Shvachko	8ca0d957c4	YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko.	2015-02-26 17:12:19 -08:00
Tsuyoshi Ozawa	773b6515ac	YARN-3217. Remove httpclient dependency from hadoop-yarn-server-web-proxy. Contributed by Brahma Reddy Battula.	2015-02-27 00:24:29 +09:00
Devaraj K	0d4296f0e0	YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against ... all Schedulers even when using ParameterizedSchedulerTestBase. Contributed by Anubhav Dhoot.	2015-02-26 15:45:41 +05:30
Jason Lowe	1a68fc4346	YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params. Contributed by Jian He	2015-02-25 16:14:34 +00:00
Tsuyoshi Ozawa	6cbd9f1113	YARN-3247. TestQueueMappings should use CapacityScheduler explicitly. Contributed by Zhihai Xu.	2015-02-25 10:38:11 +09:00
Allen Wittenauer	d4ac6822e1	YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw)	2015-02-24 11:25:26 -08:00
Devaraj K	b610c68d44	YARN-2797. Add -help to yarn logs and nodes CLI command. Contributed by ... Jagadesh Kiran N.	2015-02-24 12:04:06 +05:30
Xuan	fe7a302473	YARN-2797. TestWorkPreservingRMRestart should use ... ParametrizedSchedulerTestBase. Contributed by Karthik Kambatla	2015-02-21 19:17:29 -08:00
Xuan	e3d290244c	YARN-3236. Cleanup RMAuthenticationFilter#AUTH_HANDLER_PROPERTY. ... Contributed by zhihai xu	2015-02-21 16:18:40 -08:00
Xuan	92d67ace32	YARN-3238. Connection timeouts to nodemanagers are retried at multiple ... levels. Contributed by Jason Lowe	2015-02-21 16:06:12 -08:00
Xuan	f56c65bb3e	YARN-3237. AppLogAggregatorImpl fails to log error cause. Contributed by ... Rushabh S Shah	2015-02-20 14:02:40 -08:00
Wangda Tan	ce5bf927c3	YARN-3230. Clarify application states on the web UI. (Jian He via wangda)	2015-02-20 10:39:28 -08:00
Junping Du	c33ae271c2	YARN-2799. Cleanup TestLogAggregationService based on the change in YARN-90. Contributed by Zhihai Xu	2015-02-20 09:43:39 -08:00
Jason Lowe	a64dd3d24b	YARN-3194. RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node. Contributed by Rohith	2015-02-20 15:10:10 +00:00
Jian He	c0d9b93953	YARN-933. Fixed InvalidStateTransitonException at FINAL_SAVING state in RMApp. Contributed by Rohith Sharmaks	2015-02-19 15:42:39 -08:00
Wangda Tan	d49ae725d5	YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda)	2015-02-19 11:00:57 -08:00
Tsuyoshi Ozawa	b8a14efdf5	YARN-1615. Fix typos in delay scheduler's description. Contributed by Akira Ajisaka.	2015-02-19 10:24:07 +09:00
Jian He	1c03376300	YARN-1514. Utility to benchmark ZKRMStateStore#loadState for RM HA. Contributed by Tsuyoshi OZAWA	2015-02-18 16:06:55 -08:00
Jian He	f5da5566d9	YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan	2015-02-18 11:51:51 -08:00
Xuan	57db50cbe3	YARN-3207. Secondary filter matches entites which do not have the key ... being filtered for. Contributed by Zhijie Shen	2015-02-17 18:17:29 -08:00
Tsuyoshi Ozawa	556386a070	YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and Devaraj K.	2015-02-17 01:53:31 +09:00
Tsuyoshi Ozawa	3f32357c36	Revert "YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj." ... This reverts commit 9aae81c934.	2015-02-17 01:52:22 +09:00
Tsuyoshi Ozawa	9aae81c934	YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj.	2015-02-17 01:48:22 +09:00
Tsuyoshi Ozawa	447bd7b5a6	YARN-3203. Correct a log message in AuxServices. Contributed by Brahma Reddy Battula.	2015-02-16 23:55:58 +09:00
Junping Du	ab0b958a52	YARN-2749. Fix some testcases from TestLogAggregationService fails in trunk. (Contributed by Xuan Gong)	2015-02-15 06:46:32 -08:00
cnauroth	6804d68901	YARN-2899. Run TestDockerContainerExecutorWithMocks on Linux only. Contributed by Ming Ma.	2015-02-13 21:58:54 -08:00
Jason Lowe	1a0f508b63	YARN-2847. Linux native container executor segfaults if default banned user detected. Contributed by Olaf Flebbe	2015-02-13 20:20:55 +00:00
Xuan	253035491c	YARN-3164. RMAdmin command usage prints incorrect command name. ... Contributed by Bibin A Chundatt	2015-02-12 21:39:16 -08:00
Tsuyoshi Ozawa	110cf6b9a3	YARN-3182. Cleanup switch statement in ApplicationMasterLauncher#handle(). Contributed by Ray Chiang.	2015-02-13 14:21:21 +09:00
Tsuyoshi Ozawa	b0d81e05ab	YARN-2994. Document work-preserving RM restart. Contributed by Jian He.	2015-02-13 13:08:13 +09:00
Akira Ajisaka	6a49e58cb8	YARN-3191. Log object should be initialized with its own class. Contributed by Rohith.	2015-02-12 17:58:54 -08:00
Xuan	2586915bb3	YARN-3179. Update use of Iterator to Iterable in RMAdminCLI and ... CommonNodeLabelsManager. Contributed by Ray Chiang	2015-02-12 17:31:45 -08:00
Xuan	99f6bd4f7a	YARN-3158. Correct log messages in ResourceTrackerService. Contributed ... by Varun Saxena	2015-02-12 16:42:15 -08:00
Jian He	18297e0972	YARN-3104. Fixed RM to not generate new AMRM tokens on every heartbeat between rolling and activation. Contributed by Jason Lowe	2015-02-12 16:02:45 -08:00
Jian He	18a594257e	YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track capacities-by-label. Contributed by Wangda Tan	2015-02-12 14:58:09 -08:00
Allen Wittenauer	f1070230d1	YARN-2796. deprecate sbin/yarn-daemon.sh (aw)	2015-02-12 13:45:04 -08:00
Karthik Kambatla	c2b185def8	YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)	2015-02-12 13:44:47 -08:00
Junping Du	04f5ef18f7	YARN-2079. Recover NonAggregatingLogHandler state upon nodemanager restart. (Contributed by Jason Lowe)	2015-02-12 11:46:47 -08:00
Xuan	83be450acc	YARN-3147. Clean up RM web proxy code. Contributed by Steve Loughran	2015-02-12 10:57:55 -08:00
Tsuyoshi Ozawa	7bc492adab	YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt.	2015-02-12 23:48:43 +09:00
Junping Du	46c7577b98	YARN-1580. Documentation error regarding container-allocation.expiry-interval-ms (Brahma Reddy Battula via junping_du)	2015-02-12 03:38:54 -08:00
Tsuyoshi Ozawa	4cbaa74f62	Revert "YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt." ... This reverts commit 95a41bf35d.	2015-02-12 18:48:17 +09:00
Tsuyoshi Ozawa	95a41bf35d	YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt.	2015-02-12 18:41:17 +09:00
Tsuyoshi Ozawa	b3bcbaf277	YARN-1237. Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading. Contributed by Brahma Reddy Battula.	2015-02-12 15:17:51 +09:00
Xuan	65c69e296e	YARN-3151. On Failover tracking url wrong in application cli for KILLED ... application. Contributed by Rohith	2015-02-11 21:19:48 -08:00
Jason Lowe	b379972ab3	YARN-3074. Nodemanager dies when localizer runner tries to write to a full disk. Contributed by Varun Saxena	2015-02-11 16:33:43 +00:00
Steve Loughran	c3da2db48f	YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel)	2015-02-11 14:26:37 +00:00
Steve Loughran	362565cf5a	YARN-2616 [YARN-913] Add CLI client to the registry to list, view and manipulate entries. (Akshay Radia via stevel)	2015-02-11 14:19:01 +00:00
Junping Du	c541a374d8	YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu)	2015-02-11 03:44:31 -08:00
Zhijie Shen	d5855c0e46	YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K.	2015-02-10 15:24:01 -08:00
Jason Lowe	3f5431a22f	YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts	2015-02-10 17:27:21 +00:00
Jason Lowe	4eb5f7fa32	YARN-3090. DeletionService can silently ignore deletion task failures. Contributed by Varun Saxena	2015-02-10 16:54:21 +00:00
Zhijie Shen	23bf6c7207	YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.	2015-02-09 20:34:56 -08:00
Wangda Tan	00a748d24a	YARN-3155. Refactor the exception handling code for TimelineClientImpl's retryOn method (Li Lu via wangda)	2015-02-09 17:20:34 -08:00
Jonathan Eagles	af08425893	YARN-2971. RM uses conf instead of token service address to renew timeline delegation tokens (jeagles)	2015-02-09 17:56:05 -06:00
Jian He	0af6a99a3f	YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong	2015-02-09 13:47:08 -08:00
Karthik Kambatla	7e42088abf	YARN-2990. FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests. (kasha)	2015-02-08 22:48:10 -08:00
Jason Lowe	da2fb2bc46	YARN-3143. RM Apps REST API can return NPE or entries missing id and other fields. Contributed by Jason Lowe	2015-02-06 21:47:32 +00:00
Jason Lowe	6f10434a5a	YARN-3144. Configuration for making delegation token failures to timeline server not-fatal. Contributed by Jonathan Eagles	2015-02-06 20:55:00 +00:00
Jason Lowe	4c484320b4	YARN-3089. LinuxContainerExecutor does not handle file arguments to deleteAsUser. Contributed by Eric Payne	2015-02-06 20:39:01 +00:00
Jian He	c1957fef29	YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan	2015-02-06 11:34:20 -08:00
Arun C. Murthy	02f154a001	YARN-1537. Fix race condition in TestLocalResourcesTrackerImpl.testLocalResourceCache. Contributed by Xuan Gong.	2015-02-05 23:58:52 -08:00
Arun C. Murthy	18b2507eda	YARN-1904. Ensure exceptions thrown in ClientRMService & ApplicationHistoryClientService are uniform when application-attempt is not found. Contributed by Zhijie Shen.	2015-02-05 23:48:55 -08:00
Jian He	4641196fe0	YARN-3145. Fixed ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo. Contributed by Tsuyoshi OZAWA	2015-02-05 16:12:53 -08:00
Xuan	b77ff37686	YARN-3149. Fix typo in message for invalid application id. Contributed ... by Bibin A Chundatt.	2015-02-05 15:13:57 -08:00
Jason Lowe	69c8a7f45b	YARN-1582. Capacity Scheduler: add a maximum-allocation-mb setting per queue. Contributed by Thomas Graves	2015-02-05 19:28:49 +00:00
Sandy Ryza	b6466deac6	YARN-3101. In Fair Scheduler, fix canceling of reservations for exceeding max share (Anubhav Dhoot via Sandy Ryza)	2015-02-05 09:39:28 -08:00
Zhijie Shen	30510cff75	YARN-3123. Made YARN CLI show a single completed container even if the app is running. Contributed by Naganarasimha G R.	2015-02-04 16:02:52 -08:00
Siddharth Seth	e04e8fa810	YARN-1723. AMRMClientAsync missing blacklist addition and removal ... functionality. Contributed by Bartosz Ługowski.	2015-02-04 12:52:02 -08:00
Tsuyoshi Ozawa	26dee1486b	YARN-3058. Fix error message of tokens' activation delay configuration. Contributed by Yi Liu.	2015-02-04 11:41:14 +09:00
Zhijie Shen	e5b56e2af6	YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R.	2015-02-03 17:34:22 -08:00
Xuan	b73e776abc	YARN-3056. Add verification for containerLaunchDuration in ... TestNodeManagerMetrics. Contributed by zhihai Xu	2015-02-03 15:12:54 -08:00
Karthik Kambatla	c559df2219	YARN-1393. SLS: Add how-to-use instructions. (Wei Yan via kasha)	2015-02-03 13:20:41 -08:00
Wangda Tan	5bd984691b	YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda)	2015-02-03 12:52:42 -08:00
Jian He	21d80b3dd9	YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues. Contributed by Wangda Tan	2015-02-03 11:43:12 -08:00
Robert Kanter	f7a77819a1	YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter)	2015-02-03 10:39:41 -08:00
Jason Lowe	a761bf8726	YARN-3085. Application summary should include the application type. Contributed by Rohith	2015-02-03 14:56:34 +00:00
Zhijie Shen	5f9a0dd8d9	YARN-2216. Fixed the change log.	2015-02-02 12:11:36 -08:00
Zhijie Shen	52575ff224	YARN-2808. Made YARN CLI list attempt’s finished containers of a running application. Contributed by Naganarasimha G R.	2015-02-02 12:03:52 -08:00
Kihwal Lee	f33c99ba39	YARN-3113. Release audit warning for Sorting icons.psd. Contributed by Steve Loughran.	2015-02-02 12:58:35 -06:00
Jian He	054a947989	YARN-3077. Fixed RM to create zk root path recursively. Contributed by Chun Chen	2015-01-30 17:34:49 -08:00
Jian He	86358221fc	YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan	2015-01-30 15:15:20 -08:00
Jonathan Eagles	30a8778c63	YARN-3108. ApplicationHistoryServer doesn't process -D arguments (Chang Li via jeagles)	2015-01-29 16:51:38 -06:00
Tsuyoshi Ozawa	7acce7d364	YARN-3029. FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere. Contributed by Varun Saxena.	2015-01-30 04:42:05 +09:00
Allen Wittenauer	9dd0b7a2ab	YARN-2428. LCE default banned user list should have yarn (Varun Saxena via aw)	2015-01-29 09:30:26 -08:00
Wangda Tan	7882bc0f14	YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource. (Zhihai Xu via wangda)	2015-01-28 21:54:38 -08:00
Jian He	6d2bdbd7da	YARN-3103. AMRMClientImpl does not update AMRM token properly. Contributed by Jason Lowe	2015-01-28 15:23:13 -08:00
Wangda Tan	18741adf97	YARN-2932. Add entry for preemptable status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging. (Eric Payne via wangda)	2015-01-27 15:36:09 -08:00
Wangda Tan	fd93e5387b	YARN-3028. Better syntax for replaceLabelsOnNode in RMAdmin CLI. Contributed by Rohith Sharmaks	2015-01-27 15:23:45 -08:00
Jonathan Eagles	a8ad1e8089	YARN-2897. CrossOriginFilter needs more log statements (Mit Desai via jeagles)	2015-01-27 16:06:39 -06:00
Jian He	4e15fc0841	YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena	2015-01-27 13:31:22 -08:00
Tsuyoshi Ozawa	f56da3ce04	YARN-3086. Make NodeManager memory configurable in MiniYARNCluster. Contributed by Robert Metzger.	2015-01-28 00:15:34 +09:00
Jian He	6f9fe76918	YARN-3092. Created a common ResourceUsage class to track labeled resource usages in Capacity Scheduler. Contributed by Wangda Tan	2015-01-26 15:38:00 -08:00
Jason Lowe	902c6ea7e4	YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error. Contributed by Eric Payne	2015-01-26 15:40:21 +00:00
Xuan	0d6bd62102	YARN-3024. LocalizerRunner should give DIE action when all resources are ... localized. Contributed by Chengbing Liu	2015-01-25 19:37:57 -08:00
Tsuyoshi Ozawa	24aa462673	YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan.	2015-01-23 20:37:05 +09:00
Tsuyoshi Ozawa	3aab354e66	YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse processing. Contributed by Anubhav Dhoot.	2015-01-23 16:04:18 +09:00
Tsuyoshi Ozawa	5712c9f96a	YARN-3078. LogCLIHelpers lacks of a blank space before string 'does not exist'. Contributed by Sam Liu.	2015-01-22 12:25:05 +09:00
Wangda Tan	f250ad1773	YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder. (Contributed by Carlo Curino)	2015-01-20 14:46:22 -08:00
Wangda Tan	0a2d3e717d	YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal	2015-01-19 16:48:50 -08:00
cnauroth	cb0a15d201	YARN-3015. yarn classpath command should support same options as hadoop classpath. Contributed by Varun Saxena.	2015-01-19 15:52:32 -08:00
Akira Ajisaka	4a5c3a4cfe	YARN-3071. Remove invalid char from sample conf in doc of FairScheduler. (Contributed by Masatake Iwasaki)	2015-01-19 21:21:34 +09:00
Junping Du	19cbce3898	YARN-3070. TestRMAdminCLI#testHelp fails for transitionToActive command. (Contributed by Junping Du)	2015-01-18 23:08:06 -08:00
Zhijie Shen	43302f6f44	YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common. Contributed by Ferdinand Xu.	2015-01-16 16:37:42 -08:00
Karthik Kambatla	84198564ba	YARN-2984. Metrics for container's actual memory usage. (kasha)	2015-01-17 05:44:04 +05:30
Junping Du	5d1cca34fa	YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He)	2015-01-16 00:08:36 -08:00
Jian He	9e33116d1d	YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen	2015-01-15 11:07:43 -08:00
Akira Ajisaka	533e551eb4	YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki)	2015-01-15 21:27:39 +09:00
Karthik Kambatla	ba5116ec8e	YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha)	2015-01-15 14:28:44 +05:30
Xuan	d15cbae73c	YARN-2807. Option "--forceactive" not works as described in usage of ... "yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki	2015-01-14 11:04:03 -08:00
Junping Du	f92e503800	YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He)	2015-01-13 18:20:57 -08:00
Jian He	c53420f583	YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch	2015-01-13 17:32:07 -08:00
Robert Kanter	51881535e6	YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter)	2015-01-12 17:51:00 -08:00
Robert Kanter	f451631915	YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter)	2015-01-12 12:00:30 -08:00
Robert Kanter	ae7bf31fe1	YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter)	2015-01-12 10:47:52 -08:00
Jian He	a260406268	YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan	2015-01-09 17:49:53 -08:00
Jian He	27a489cba6	YARN-2956. Added missing links in YARN documentation. Contributed by Masatake Iwasaki	2015-01-09 17:46:36 -08:00
Allen Wittenauer	ab5cd99177	YARN-3002. YARN documentation needs updating post-shell rewrite (aw)	2015-01-09 15:01:29 -08:00
Jian He	cc2a745f7e	YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu	2015-01-08 11:12:54 -08:00
Zhijie Shen	dc2eaa26b2	YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu.	2015-01-08 09:47:02 -08:00
Jian He	ef237bd52f	Moved YARN-2880 to improvement section in CHANGES.txt	2015-01-07 16:20:26 -08:00
Jian He	2638f4d0f0	YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on getProto method. Contributed by Varun Saxena	2015-01-07 16:14:22 -08:00
Jian He	e13a484a2b	YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. Contributed by Yi Liu	2015-01-07 14:12:20 -08:00
Jian He	fe8d2bd741	YARN-2230. Fixed few configs description in yarn-default.xml. Contributed by Vijay Bhat	2015-01-07 10:57:06 -08:00
Zhijie Shen	60103fca04	YARN-2427. Added the API of moving apps between queues in RM web services. Contributed by Varun Vasudev.	2015-01-06 14:37:44 -08:00
Jian He	dd57c2047b	YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun Saxena	2015-01-06 14:15:57 -08:00
Karthik Kambatla	0c4b112677	YARN-2881. [YARN-2574] Implement PlanFollower for FairScheduler. (Anubhav Dhoot via kasha)	2015-01-06 04:42:10 +05:30
Karthik Kambatla	41d72cbd48	Move YARN-2360 from 2.6 to 2.7 in CHANGES.txt	2015-01-06 03:31:11 +05:30
Zhijie Shen	562a701945	YARN-2958. Made RMStateStore not update the last sequence number when updating the delegation token. Contributed by Varun Saxena.	2015-01-05 13:33:07 -08:00
Tsuyoshi Ozawa	ddc5be48fc	YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue. Contributed by Rohith Sharmaks.	2015-01-05 00:08:31 +09:00
Zhijie Shen	947578c1c1	YARN-2991. Fixed DrainDispatcher to reuse the draining code path in AsyncDispatcher. Contributed by Rohith Sharmaks.	2015-01-02 11:08:47 -08:00
Karthik Kambatla	e7257acd8a	YARN-2998. Abstract out scheduler independent PlanFollower components. (Anubhav Dhoot via kasha)	2014-12-30 19:55:24 -08:00
Jian He	e2351c7ae2	YARN-2987. Fixed ClientRMService#getQueueInfo to check against queue and app ACLs. Contributed by Varun Saxena	2014-12-30 17:15:37 -08:00
Jian He	b7442bf92e	YARN-2493. Added node-labels page on RM web UI. Contributed by Wangda Tan	2014-12-30 16:49:01 -08:00
Jian He	746ad6e989	Revert "YARN-2492(wrong jira number). Added node-labels page on RM web UI. Contributed by Wangda Tan" ... This reverts commit 5f57b904f5.	2014-12-30 16:48:49 -08:00
Jian He	5f57b904f5	YARN-2492. Added node-labels page on RM web UI. Contributed by Wangda Tan	2014-12-30 15:38:28 -08:00
Zhijie Shen	241d3b3a50	YARN-2938. Fixed new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice. Contributed by Varun Saxena.	2014-12-29 09:59:35 -08:00
Jian He	1454efe5d4	YARN-2992. ZKRMStateStore crashes due to session expiry. Contributed by Karthik Kambatla	2014-12-26 17:59:58 -08:00
Junping Du	40ee4bff65	YARN-2993. Several fixes (missing acl check, error log msg ...) and some refinement in AdminService. (Contributed by Yi Liu)	2014-12-26 06:59:25 -08:00
Tsuyoshi Ozawa	b256dd7600	YARN-2988. Graph#save() may leak file descriptors. (Ted Yu via ozawa)	2014-12-25 12:48:24 +09:00
Jian He	4f18018b7a	YARN-2946. Fixed potential deadlock in RMStateStore. Contributed by Rohith Sharmaks	2014-12-23 22:14:29 -08:00
Zhijie Shen	41a548a916	YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. Contributed by Varun Saxena.	2014-12-23 20:32:36 -08:00
Junping Du	d468c9aaf1	YARN-2940. Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu)	2014-12-23 20:04:33 -08:00
Junping Du	856b46cf47	Revert ca3381de61 and 20674255ad as missing JIRA number in commit message	2014-12-23 20:02:33 -08:00
Junping Du	20674255ad	CHANGES.txt: add YARN-2940	2014-12-23 18:59:52 -08:00
Jian He	149512a837	YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen	2014-12-23 18:25:37 -08:00
Junping Du	e1ee0d45ea	YARN-2970. NodeLabel operations in RMAdmin CLI get missing in help command. (Contributed by Varun Saxena)	2014-12-23 18:23:45 -08:00
Jian He	0d89859b51	YARN-2340. Fixed NPE when queue is stopped during RM restart. Contributed by Rohith Sharmaks	2014-12-22 21:53:22 -08:00
Jian He	fdf042dfff	YARN-2920. Changed CapacityScheduler to kill containers on nodes where node labels are changed. Contributed by Wangda Tan	2014-12-22 16:51:15 -08:00
Junping Du	a696fbb001	YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du)	2014-12-22 03:06:37 -08:00
Tsuyoshi Ozawa	8f5522ed99	CHANGES.txt: move YARN-2977 from 2.6.1 to 2.7.0	2014-12-21 12:51:46 +09:00
Karthik Kambatla	24ee9e3431	YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha)	2014-12-20 12:17:50 -08:00
Tsuyoshi Ozawa	76b0370a27	CHANGES.txt: add YARN-2977	2014-12-20 22:54:48 +09:00
Jian He	808cba3821	YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks	2014-12-19 16:56:30 -08:00
Karthik Kambatla	954fb8581e	YARN-2675. containersKilled metrics is not updated when the container is killed during localization. (Zhihai Xu via kasha)	2014-12-19 16:02:20 -08:00
Karthik Kambatla	a22ffc3188	YARN-2738. [YARN-2574] Add FairReservationSystem for FairScheduler. (Anubhav Dhoot via kasha)	2014-12-19 15:37:12 -08:00
Jason Lowe	0402bada19	YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie). Contributed by Jian He	2014-12-18 23:28:18 +00:00
Junping Du	389f881d42	YARN-2949. Add documentation for CGroups. (Contributed by Varun Vasudev)	2014-12-18 06:25:59 -08:00
Junping Du	2b4b0e8847	YARN-2972. DelegationTokenRenewer thread pool never expands. Contributed by Jason Lowe	2014-12-17 17:40:00 -08:00
Karthik Kambatla	b7f64823e1	YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha)	2014-12-17 16:32:21 -08:00
Karthik Kambatla	a1bd140964	YARN-2944. InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance. (Chris Trezzo via kasha)	2014-12-17 16:23:52 -08:00
Karthik Kambatla	f2d150ea12	YARN-2964. FSLeafQueue#assignContainer - document the reason for using both write and read locks. (Tsuyoshi Ozawa via kasha)	2014-12-17 12:03:16 -08:00
Jian He	c65f1b382e	YARN-2762. Fixed RMAdminCLI to trim and check node-label related arguments before sending to RM. Contributed by Rohith Sharmaks	2014-12-16 11:00:25 -08:00
Karthik Kambatla	e597249d36	YARN-2914. [YARN-1492] Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics. (Varun Saxena via kasha)	2014-12-15 12:00:12 -08:00
Jian He	a4f2995b9e	Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai." ... This reverts commit 51af8d367d. Conflicts: hadoop-yarn-project/CHANGES.txt	2014-12-15 11:04:09 -08:00
Devaraj K	fae3e8614f	YARN-2356. yarn status command for non-existent application/application ... attempt/container is too verbose. Contributed by Sunil G.	2014-12-15 14:43:21 +05:30
Harsh J	0e37bbc8e3	YARN-2950. Change message to mandate, not suggest JS requirement on UI. Contributed by Dustin Cote.	2014-12-13 07:10:40 +05:30
Steve Loughran	3681de2039	YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel)	2014-12-12 17:11:07 +00:00
Devaraj K	bda748ac3a	YARN-2243. Order of arguments for Preconditions.checkNotNull() is wrong in ... SchedulerApplicationAttempt ctor. Contributed by Devaraj K.	2014-12-12 12:34:43 +05:30
Jian He	614b6afea4	YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher. Contributed by Rohith Sharmaks	2014-12-11 11:17:54 -08:00
Allen Wittenauer	59cb8b9123	YARN-2437. start-yarn.sh/stop-yarn should give info (Varun Saxena via aw)	2014-12-10 13:48:07 -08:00
Jian He	437322afca	YARN-2924. Fixed RMAdminCLI to not convert node labels to lower case. Contributed by Wangda Tan	2014-12-09 17:56:04 -08:00
Jian He	2ed90a57fd	YARN-2930. Fixed TestRMRestart#testRMRestartRecoveringNodeLabelManager intermittent failure. Contributed by Wangda Tan	2014-12-09 16:48:04 -08:00
Karthik Kambatla	a2e07a5456	YARN-2910. FSLeafQueue can throw ConcurrentModificationException. (Wilfred Spiegelenburg via kasha)	2014-12-09 14:00:31 -08:00
Karthik Kambatla	db73cc9124	YARN-2931. PublicLocalizer may fail until directory is initialized by LocalizeRunner. (Anubhav Dhoot via kasha)	2014-12-08 22:26:18 -08:00
Karthik Kambatla	120e1decd7	YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent. (Ray Chiang via kasha)	2014-12-07 22:28:26 -08:00
Jian He	e69af836f3	YARN-2869. CapacityScheduler should trim sub queue names when parse configuration. Contributed by Wangda Tan	2014-12-05 17:33:39 -08:00
Jason Lowe	4b13082199	YARN-2056. Disable preemption at Queue level. Contributed by Eric Payne	2014-12-05 21:06:48 +00:00
Robert Kanter	3c72f54ef5	YARN-2461. Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration. (rchiang via rkanter)	2014-12-05 12:07:41 -08:00
Karthik Kambatla	78968155d7	YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)	2014-12-04 17:36:32 -08:00
Jian He	258623ff8b	YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R	2014-12-04 12:53:18 -08:00
Jian He	73fbb3c66b	YARN-2880. Added a test to make sure node labels will be recovered if RM restart is enabled. Contributed by Rohith Sharmaks	2014-12-03 17:14:52 -08:00
Harsh J	a31e016491	YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh)	2014-12-04 03:17:15 +05:30
Karthik Kambatla	799353e2c7	YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha)	2014-12-03 13:44:41 -08:00
Junping Du	e65b7c5ff6	YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA)	2014-12-03 04:11:18 -08:00
Jian He	392c3aaea8	YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks	2014-12-02 17:16:35 -08:00
Jian He	52bcefca8b	YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena	2014-12-02 10:54:48 -08:00
Allen Wittenauer	26319ba0db	YARN-2472. yarn-daemons.sh should jsut call yarn directly (Masatake Iwasaki via aw)	2014-12-02 09:14:20 -08:00
Zhijie Shen	51af8d367d	YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.	2014-12-01 19:04:04 -08:00
Jian He	a7fba0bc28	YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe	2014-12-01 16:38:25 -08:00
Jason Lowe	0f9528b99a	YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena	2014-12-01 22:29:05 +00:00
Junping Du	c732ed760e	YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith)	2014-12-01 05:38:22 -08:00
Zhijie Shen	8f1454cc6d	YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ.	2014-11-26 12:09:34 -08:00
Karthik Kambatla	fe1f2db5ee	YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)	2014-11-25 16:21:46 -08:00
Jian He	8a7ca13b13	YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe	2014-11-25 16:16:56 -08:00
Jian He	5805a81efb	YARN-2404. Removed ApplicationAttemptState and ApplicationState class in RMStateStore. Contributed by Tsuyoshi OZAWA	2014-11-25 12:48:22 -08:00
Zhijie Shen	e37a4ff0c1	YARN-2697. Remove useless RMAuthenticationHandler. Contributed by Haosong Huang.	2014-11-24 14:58:59 -08:00
Jason Lowe	1ce4d33c2d	YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena	2014-11-24 22:36:59 +00:00
Sandy Ryza	a128cca305	YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza)	2014-11-21 16:06:41 -08:00
Karthik Kambatla	1e9a3f42ff	Update release date for 2.5.2	2014-11-21 14:34:23 -08:00
Karthik Kambatla	233b61e495	YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha)	2014-11-21 14:22:21 -08:00
Karthik Kambatla	3114d4731d	YARN-2604. Scheduler should consider max-allocation-* in conjunction with the largest node. (Robert Kanter via kasha)	2014-11-21 10:32:28 -08:00
Jonathan Eagles	c298a9a845	YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles)	2014-11-20 23:34:35 -06:00
Karthik Kambatla	a9a0cc3679	YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha)	2014-11-19 20:15:40 -08:00
Karthik Kambatla	c90fb84aaa	YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha)	2014-11-19 19:50:12 -08:00
Jian He	9cb8b75ba5	YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks	2014-11-19 19:48:52 -08:00
Jian He	bc4ee5e06f	YARN-2878. Fix DockerContainerExecutor.apt.vm formatting. Contributed by Abin Shahab	2014-11-19 14:44:25 -08:00
Jian He	90a968d675	YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA	2014-11-18 16:12:39 -08:00
Zhijie Shen	ef38fb9758	YARN-2870. Updated the command to run the timeline server it the document. Contributed by Masatake Iwasaki.	2014-11-18 16:04:31 -08:00
Karthik Kambatla	2fce6d6141	YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes independent of Scheduler type. (Anubhav Dhoot via kasha)	2014-11-17 16:45:57 -08:00
Jason Lowe	81c9d17af8	YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan	2014-11-17 21:15:48 +00:00
Vinod Kumar Vavilapalli	198fb58776	YARN-1703. Fixed ResourceManager web-proxy to close connections correctly. Contributed by Rohith Sharma.	2014-11-15 12:05:25 -08:00
Jian He	9b860661a5	YARN-2432. RMStateStore should process the pending events before close. Contributed by Varun Saxena	2014-11-14 17:24:09 -08:00
Sandy Ryza	1a47f890ba	YARN-2811. In Fair Scheduler, reservation fulfillments shouldn't ignore max share (Siqi Li via Sandy Ryza)	2014-11-14 15:18:56 -08:00
Jason Lowe	49c38898b0	YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu	2014-11-14 21:25:59 +00:00
Jason Lowe	f2fe8a800e	YARN-2857. ConcurrentModificationException in ContainerLogAppender. Contributed by Mohammad Kamrul Islam	2014-11-14 20:47:26 +00:00
Jian He	d005404ef7	YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks	2014-11-13 15:34:26 -08:00
Zhijie Shen	3648cb57c9	YARN-2766. Made ApplicationHistoryManager return a sorted list of apps, attempts and containers. Contributed by Robert Kanter.	2014-11-13 13:47:42 -08:00
Vinod Kumar Vavilapalli	4ae9780e6a	Revert "YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw)" ... This reverts commit b0a9cd37ab. Conflicts: hadoop-yarn-project/CHANGES.txt	2014-11-13 13:17:11 -08:00
Arun C. Murthy	9ff7315cbe	Preparing to release hadoop-2.6.0-rc1.	2014-11-13 13:02:55 -08:00
Arun C. Murthy	81dc0ac6dc	YARN-2635. Merging to branch-2.6 for hadoop-2.6.0-rc1.	2014-11-13 10:27:47 -08:00
Arun C. Murthy	d648e60eba	YARN-2853. Merging to branch-2.6 for hadoop-2.6.0-rc1.	2014-11-13 10:04:45 -08:00
Vinod Kumar Vavilapalli	3651fe1b08	YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user kill request races with ApplicationMaster finish. Contributed by Jian He.	2014-11-13 08:13:03 -08:00
Jason Lowe	33ea5ae92b	YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du	2014-11-13 16:11:04 +00:00
Allen Wittenauer	b0a9cd37ab	YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw)	2014-11-12 17:02:53 -08:00
Zhijie Shen	be7bf956e9	YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He.	2014-11-12 11:07:57 -08:00
Arun C. Murthy	51957ca818	YARN-2843. Merging to branch-2.6 for hadoop-2.6.0-rc1.	2014-11-12 10:41:24 -08:00
Arun C. Murthy	3e7a5157f0	YARN-2841. Merging to branch-2.6 for hadoop-2.6.0-rc1.	2014-11-12 10:36:54 -08:00
Karthik Kambatla	a04143039e	YARN-2236. [YARN-1492] Shared Cache uploader service on the Node Manager. (Chris Trezzo and Sanjin Lee via kasha)	2014-11-12 09:31:05 -08:00
Jason Lowe	f8aefa5e9c	YARN-2780. Log aggregated resource allocation in rm-appsummary.log. Contributed by Eric Payne	2014-11-12 17:01:15 +00:00
Ravi Prakash	53f64ee516	YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN	2014-11-11 21:28:11 -08:00
Karthik Kambatla	456b973819	YARN-570. Time strings are formated in different timezone. (Akira Ajisaka and Peng Zhang via kasha)	2014-11-11 13:22:59 -08:00