Varun Saxena
|
5ef27b65b9
|
YARN-5037. Fix random failure of TestRMRestart#testQueueMetricsOnRMRestart (sandflee via Varun Saxena).
|
2016-07-10 22:13:53 +05:30 |
Junping Du
|
7db796562c
|
Fix OOM issue in DistributedShell. Contributed by Jian He.
(cherry picked from commit 9bdb5bebea )
|
2016-07-09 05:11:29 -07:00 |
Varun Saxena
|
f515678b67
|
YARN-5318. Fix intermittent test failure of TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider. (Jun Gong via Varun Saxena).
|
2016-07-09 01:43:09 +05:30 |
Varun Saxena
|
550abb53e5
|
YARN-5297. Avoid printing a stack trace when recovering an app after the RM restarts. (Junping Du via Varun Saxena).
|
2016-07-09 00:14:51 +05:30 |
Junping Du
|
5c0386d535
|
YARN-4939. The decommissioning Node should keep alive during NM restart. Contributed by sandflee.
(cherry picked from commit 30ee57ceb1 )
|
2016-07-08 04:15:47 -07:00 |
Vinod Kumar Vavilapalli
|
687185feb2
|
YARN-5314. Fixed a ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore. Contributed by Li Lu.
(cherry picked from commit 673e5e02fe )
|
2016-07-07 22:38:41 -07:00 |
Jian He
|
b7604a22e6
|
YARN-5233. Support for specifying a path for ATS plugin jars. Contributed by Li Lu
(cherry picked from commit 8a9d293dd6 )
|
2016-07-06 16:45:32 -07:00 |
Wangda Tan
|
e246cf74c9
|
YARN-5294. Pass remote ip address down to YarnAuthorizationProvider. (Jian He via wangda)
|
2016-07-06 16:42:35 -07:00 |
Vinod Kumar Vavilapalli
|
c3d9ac82af
|
YARN-5224. Added new web-services /containers/{containerid}/logs & /containers/{containerid}/logs/{filename} and using them in "yarn logs" CLI to get logs of finished containers of a running application. Contributed by Xuan Gong.
|
2016-07-06 14:19:16 -07:00 |
Jian He
|
ccb0791904
|
YARN-5227. Yarn logs command: no need to specify applicationId when
specifying containerId. Contributed by Gergely Novák
(cherry picked from commit d169f5052f )
|
2016-07-06 13:29:12 -07:00 |
Jian He
|
46f8204992
|
YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du
(cherry picked from commit d792a90206 )
|
2016-07-05 18:06:03 -07:00 |
Vinod Kumar Vavilapalli
|
56a08983e2
|
YARN-5214. Fixed locking in DirectoryCollection to avoid hanging NMs when various code-paths hit slow disks. Contributed by Junping Du.
(cherry picked from commit ce9c006430 )
|
2016-07-05 16:08:57 -07:00 |
Varun Saxena
|
516aa58c1b
|
YARN-5286. Add RPC port info in RM web service's response when getting app status. (Jun Gong via Varun Saxena).
|
2016-07-05 23:10:08 +05:30 |
Ray Chiang
|
fb9327edae
|
YARN-4568. Fix message when NodeManager runs into errors initializing the recovery directory. (rchiang)
(cherry picked from commit 0a5def155e )
|
2016-07-01 15:55:56 -07:00 |
Jian He
|
d2559ca307
|
YARN-5023. TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails. Contributed by sandflee
(cherry picked from commit c35a5a7a8d )
|
2016-07-01 14:29:28 -07:00 |
Varun Saxena
|
4837aebca4
|
YARN-5282. Fix typos in CapacityScheduler documentation. (Ray Chiang via Varun Saxena).
|
2016-07-01 11:39:26 +05:30 |
Varun Saxena
|
527cd9852a
|
YARN-5182. MockNodes.newNodes creates one more node per rack than requested. (Karthik Kambatla via Varun Saxena).
|
2016-06-30 00:06:17 +05:30 |
Rohith Sharma K S
|
d3fc1bddea
|
YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat.
(cherry picked from commit 26b5e6116f )
|
2016-06-29 10:13:17 +05:30 |
Xuan
|
b7f18f2815
|
YARN-5266. Wrong exit code while trying to get app logs using regex via CLI. Contributed by Xuan Gong
(cherry picked from commit 6ab5aa1c1f )
|
2016-06-22 21:50:09 -07:00 |
Arun Suresh
|
e64d21b297
|
YARN-5171. Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node. (Inigo Goiri via asuresh)
(cherry picked from commit 99e5dd68d0 )
|
2016-06-22 19:05:28 -07:00 |
Sangjin Lee
|
2a79910c22
|
YARN-4958. The file localization process should allow for wildcards to reduce the application footprint in the state store (Daniel Templeton via sjlee)
(cherry picked from commit 5107a967fa )
|
2016-06-20 10:00:41 -07:00 |
Junping Du
|
ea4cab2330
|
YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev.
(cherry picked from commit d0162f2040 )
|
2016-06-19 17:45:57 -07:00 |
Karthik Kambatla
|
25be8105cd
|
YARN-5077. Fix FSLeafQueue#getFairShare() for queues with zero fairshare. (Yufei Gu via kasha)
(cherry picked from commit 20f2799938 )
|
2016-06-17 22:25:04 -07:00 |
Karthik Kambatla
|
e9c1155233
|
YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit. Addendum to fix javac warning. (Arun Suresh via kasha)
(cherry picked from commit fbbe0bb627 )
|
2016-06-17 22:13:18 -07:00 |
Junping Du
|
6afa044dda
|
YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong.
(cherry picked from commit c35fa4a0e5 )
|
2016-06-17 08:25:33 -07:00 |
Wangda Tan
|
7eb524ddee
|
YARN-4844. Addendum patch, revert few changes to public and evolving to avoid breaking downstream projects as much as possible.
|
2016-06-16 11:09:56 -07:00 |
Junping Du
|
eec703f36f
|
YARN-5083. YARN CLI for AM logs does not give any error message if entered invalid am value. Contributed by Jian He.
(cherry picked from commit e14ee0d3b5 )
|
2016-06-16 08:56:46 -07:00 |
Junping Du
|
6dd34baf3c
|
YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong.
(cherry picked from commit 5dfc38ff57 )
|
2016-06-15 16:20:07 -07:00 |
Varun Vasudev
|
75235149af
|
YARN-5223. Container line in yarn logs output for a live application should include the hostname for the container. Contributed by Xuan Gong.
(cherry picked from commit 25064fb2fb )
|
2016-06-15 12:43:26 +05:30 |
Varun Vasudev
|
5bd39d2f3c
|
YARN-5122. "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete. Contributed by Jian He.
(cherry picked from commit d6284428e8 )
|
2016-06-15 12:37:51 +05:30 |
Wangda Tan
|
863bfa4d6a
|
YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)
|
2016-06-14 15:12:00 -07:00 |
Wangda Tan
|
cd3bdbc70a
|
YARN-4887. Add allocation request ID to AM-RM protocol for identifying resource-requests explicitly. (Subru Krishnan via wangda)
(cherry picked from commit eec835ec17 )
|
2016-06-13 21:57:55 -07:00 |
Rohith Sharma K S
|
c540b9bd7b
|
YARN-4989. TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently. Contributed by Ajith S.
(cherry picked from commit 28b66ae919 )
|
2016-06-13 11:23:10 +05:30 |
Karthik Kambatla
|
a92be02c2e
|
YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. Addendum to fix compilation. (Arun Suresh via kasha)
|
2016-06-12 14:28:14 -07:00 |
Arun Suresh
|
f3c7a99e33
|
YARN-5212. Run existing ContainerManager tests using QueuingContainerManagerImpl. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 7dae2b3bc4 )
|
2016-06-12 10:06:18 -07:00 |
Arun Suresh
|
fccb641942
|
YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. (asuresh)
(cherry picked from commit 5143277958 )
|
2016-06-12 09:43:19 -07:00 |
Arun Suresh
|
5985221b46
|
YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit (sandflee via asuresh)
(cherry picked from commit 5279af7cd4 )
|
2016-06-10 22:34:33 -07:00 |
Rohith Sharma K S
|
efdfa68911
|
YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe.
(cherry picked from commit e0f4620cc7 )
|
2016-06-11 10:31:00 +05:30 |
Wangda Tan
|
e91e9e596d
|
YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
(cherry picked from commit 03fc6b1bb0 )
|
2016-06-10 09:53:40 -07:00 |
Wangda Tan
|
a4094ddb5a
|
YARN-5208. Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled. (Rohith Sharma K S via wangda)
(cherry picked from commit 244506f9c8 )
|
2016-06-10 09:37:35 -07:00 |
Vinod Kumar Vavilapalli
|
f6cd1bcf89
|
YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv)
(cherry picked from commit 9378d9428f )
|
2016-06-09 12:32:53 -07:00 |
Wangda Tan
|
aef6e455b1
|
YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda)
|
2016-06-09 10:08:31 -07:00 |
Naganarasimha
|
27fc225558
|
YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G
(cherry picked from commit 1500a0a300 )
|
2016-06-09 05:44:41 +05:30 |
Vinod Kumar Vavilapalli
|
67dbd4c466
|
YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong
(cherry picked from commit 5a43583c0b )
|
2016-06-08 09:51:36 -07:00 |
Arun Suresh
|
c29fbdd8ac
|
YARN-5204. Properly report status of killed/stopped queued containers. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 3344ba70e0 )
|
2016-06-08 08:32:17 -07:00 |
Jason Lowe
|
c6f33e096e
|
YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran
(cherry picked from commit 8c8a377cac )
|
2016-06-08 14:13:19 +00:00 |
Arun Suresh
|
154c7c343b
|
YARN-5176. More test cases for queuing of containers at the NM. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 76f0800c21 )
|
2016-06-07 17:17:22 -07:00 |
Xuan
|
10f0c0475e
|
YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and
FileInputStream in NMWebServices#getLogs. Contributed by Xuan Gong
(cherry picked from commit 58be55b6e0 )
|
2016-06-07 16:08:54 -07:00 |
Arun Suresh
|
6a9f38ebaf
|
Addendum patch for YARN-5180 updating findbugs-exclude.xml
(cherry picked from commit 8554aee1be )
|
2016-06-07 16:00:59 -07:00 |
Rohith Sharma K S
|
a29f8bdc3d
|
YARN-5118. Tests fails with localizer port bind exception. Contributed by Brahma Reddy Battula.
(cherry picked from commit bddea5fe5f )
|
2016-06-07 11:23:02 +05:30 |
Arun Suresh
|
d3655f4123
|
YARN-4525. Fix bug in RLESparseResourceAllocation.getRangeOverlapping(). (Ishai Menache and Carlo Curino via asuresh)
(cherry picked from commit 3a154f75ed )
|
2016-06-06 21:18:53 -07:00 |
Arun Suresh
|
f0a869b52a
|
YARN-5185. StageAllocaterGreedyRLE: Fix NPE in corner case. (Carlo Curino via asuresh)
(cherry picked from commit 7a9b7372a1 )
|
2016-06-06 21:07:24 -07:00 |
Ming Ma
|
74e2b5efa2
|
MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)
(cherry picked from commit 4a1cedc010 )
|
2016-06-06 14:34:47 -07:00 |
Arun Suresh
|
8ebd89dcfb
|
YARN-5165. Fix NoOvercommitPolicy to take advantage of RLE representation of plan. (Carlo Curino via asuresh)
(cherry picked from commit db54670e83 )
|
2016-06-03 14:50:51 -07:00 |
Vinod Kumar Vavilapalli
|
029888871f
|
YARN-5098. Fixed ResourceManager's DelegationTokenRenewer to replace expiring system-tokens if RM stops and only restarts after a long time. Contributed by Jian He.
Made one minor edit for branch-2 patch.
(cherry picked from commit f10ebc67f5 )
|
2016-06-03 13:11:17 -07:00 |
Jian He
|
7f865bf438
|
YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du
(cherry picked from commit 99cc439e29 )
|
2016-06-03 11:11:20 -07:00 |
Jian He
|
a022776c2e
|
YARN-1815. Work preserving recovery of Unmanged AMs. Contributed by Subru Krishnan
(cherry picked from commit 097baaaeba )
|
2016-06-03 10:49:54 -07:00 |
Arun Suresh
|
384a84828f
|
YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)
(cherry picked from commit dc26601d8f )
|
2016-06-02 09:14:30 -07:00 |
Wangda Tan
|
b63ebca9dd
|
Addendum patch for YARN-4844, to supress few more deprecation warnings.
|
2016-06-01 14:37:20 -07:00 |
Xuan
|
04062593b4
|
YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong
(cherry picked from commit 0bc05e40fa )
|
2016-06-01 13:45:24 -07:00 |
Varun Vasudev
|
bd01153ddf
|
YARN-5141. Get Container logs for the Running application from Yarn Logs CommandLine. Contributed by Xuan Gong.
(cherry picked from commit 4e1f56e111 )
|
2016-05-29 21:54:29 +05:30 |
Varun Vasudev
|
d7bb28f15b
|
YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana.
(cherry picked from commit 86fb58b7dc )
|
2016-05-29 21:33:43 +05:30 |
Varun Vasudev
|
4f36c3d214
|
YARN-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.
|
2016-05-29 20:55:39 +05:30 |
Karthik Kambatla
|
b3f5337bb3
|
YARN-5132. Exclude generated protobuf sources from YARN Javadoc build. (Subru Krishnan via kasha)
(cherry picked from commit f5ff05cc8a )
|
2016-05-28 08:10:16 -07:00 |
Arun Suresh
|
de28ca1e92
|
YARN-5117. QueuingContainerManager does not start GUARANTEED Container even if Resources are available. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 4fc09a897b )
|
2016-05-27 17:50:34 -07:00 |
Arun Suresh
|
0b1472fbc0
|
YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh)
(cherry picked from commit aa975bc781 )
|
2016-05-27 14:07:15 -07:00 |
Akira Ajisaka
|
ec811909e4
|
YARN-5166. javadoc:javadoc goal fails on hadoop-yarn-client. Contributed by Andras Bokor.
(cherry picked from commit e4022debf7 )
|
2016-05-27 23:15:48 +09:00 |
Junping Du
|
dea79a7dd6
|
YARN-4987. Read cache concurrency issue between read and evict in EntityGroupFS timeline store. Contributed by Li Lu.
(cherry picked from commit 705286ccae )
|
2016-05-27 06:59:15 -07:00 |
Xuan
|
38ae5954df
|
YARN-5089. Improve "yarn log" command-line "logFiles" option to support
regex. Contributed by Xuan Gong
(cherry picked from commit bde819abbb )
|
2016-05-26 23:50:14 -07:00 |
Rohith Sharma K S
|
ef3e0c6fd6
|
YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt.
(cherry picked from commit 0a544f8a3e )
|
2016-05-27 10:48:47 +05:30 |
Karthik Kambatla
|
59335b4d7a
|
YARN-5035. FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on. (kasha)
(cherry picked from commit 04ded558b0 )
|
2016-05-26 15:09:47 -07:00 |
Arun Suresh
|
44cbf5b7f5
|
YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh)
(cherry picked from commit 5b41b288d0 )
|
2016-05-26 14:58:15 -07:00 |
Karthik Kambatla
|
999cdd91b7
|
YARN-4866. FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy. (Yufei Gu via kasha)
(cherry picked from commit 4f513a4a8e )
|
2016-05-25 22:13:42 -07:00 |
Carlo Curino
|
c656977961
|
YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
(cherry picked from commit 013532a95e )
|
2016-05-25 16:58:19 -07:00 |
Jason Lowe
|
da77040793
|
YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong
(cherry picked from commit 1ba31fe9e9 )
|
2016-05-25 21:29:27 +00:00 |
Karthik Kambatla
|
0ac8c098e8
|
YARN-3344. Fix warning - procfs stat file is not in the expected format. (Ravindra Kumar Naik and Akira Ajisaka via kasha)
(cherry picked from commit 77d5ce9069 )
|
2016-05-25 10:51:09 -07:00 |
Robert Kanter
|
71e5b36763
|
YARN-4766. NM should not aggregate logs older than the retention policy (haibochen via rkanter)
(cherry picked from commit e07519b8db )
|
2016-05-25 10:25:59 -07:00 |
Varun Vasudev
|
5361a91909
|
YARN-5115. Avoid setting CONTENT-DISPOSITION header in the container-logs web-service. Contributed by Xuan Gong.
(cherry picked from commit c52c15dd2df5050c6c3ddbe5ee708404f1920721)
|
2016-05-25 19:01:22 +05:30 |
Varun Vasudev
|
36f2ae0692
|
YARN-857. Localization failures should be available in container diagnostics. Contributed by Vinod Kumar Vavilapalli.
(cherry picked from commit f440a9d8c4a177bc5062d21d4b4bc4d9b2944344)
|
2016-05-25 19:01:22 +05:30 |
Junping Du
|
2e42bafdc8
|
YARN-5131. Distributed shell AM fails when extra container arrives during finishing. Contributed by Wangda Tan.
(cherry picked from commit 48c931331c )
|
2016-05-25 06:19:29 -07:00 |
Rohith Sharma K S
|
b9567b89b9
|
YARN-5024. TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure. Contributed by Bibin A Chundatt
(cherry picked from commit 28bd63e92b )
|
2016-05-25 10:24:59 +05:30 |
Naganarasimha
|
02323603e2
|
YARN-5114. Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8. Contributed by Bibin A Chundatt
(cherry picked from commit edd716e99c )
|
2016-05-25 06:15:50 +08:00 |
Karthik Kambatla
|
108db38788
|
YARN-4878. Expose scheduling policy and max running apps over JMX for Yarn queues. (Yufei Gu via kasha)
(cherry picked from commit f979d779e1 )
|
2016-05-24 10:54:33 -07:00 |
Arun Suresh
|
ce886ff2b1
|
YARN-4991. Fix ContainerRequest Constructor to set nodelabelExpression correctly. (Bibin A Chundatt via asuresh)
(cherry picked from commit a5fed8bbfe )
|
2016-05-24 05:12:03 -07:00 |
Naganarasimha
|
155f25061e
|
YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (addendum patch). Contributed by Bibin A chundatt
(cherry picked from commit b4078bd17b )
|
2016-05-24 08:14:53 +08:00 |
Karthik Kambatla
|
f33f0b697b
|
YARN-4979. FSAppAttempt demand calculation considers demands at multiple locality levels different. (Zhihai Xu via kasha)
(cherry picked from commit 6d043aa4cf )
|
2016-05-23 14:30:05 -07:00 |
Jason Lowe
|
7602070457
|
YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger
(cherry picked from commit ac954486c5 )
|
2016-05-23 15:56:00 +00:00 |
Jason Lowe
|
e8bd2a5be6
|
YARN-5103. With NM recovery enabled, restarting NM multiple times results in AM restart. Contributed by Junping Du
(cherry picked from commit d1df0266cf )
|
2016-05-23 15:16:52 +00:00 |
Junping Du
|
867cd2f5a2
|
YARN-5112. Excessive log warnings for directory permission issue on NM recovery. Contributed by Jian He.
|
2016-05-22 16:02:57 -07:00 |
Jian He
|
6e0522ee1b
|
YARN-5020. Fix Documentation for Yarn Capacity Scheduler on Resource Calculator. Contributed by Takashi Ohnishi
(cherry picked from commit d364ceac85 )
|
2016-05-20 11:36:08 -07:00 |
Varun Vasudev
|
e7f396fd47
|
YARN-5016. Add support for a minimum retry interval for container retries. Contributed by Jun Gong.
(cherry picked from commit 0287c49107 )
|
2016-05-20 12:32:29 +05:30 |
Junping Du
|
2703ec6871
|
YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron.
|
2016-05-19 14:10:15 -07:00 |
Jian He
|
2d846fdcbd
|
YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong
(cherry picked from commit feb90ffcca )
|
2016-05-19 13:02:05 -07:00 |
Junping Du
|
416274b53e
|
YARN-5100. The YarnApplicationState is always running in ATS even application is finished. Contributed by Xuan Gong.
(cherry picked from commit 141873ca7d )
|
2016-05-19 09:14:42 -07:00 |
Steve Loughran
|
151ecdf26d
|
HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.
|
2016-05-19 14:44:44 +01:00 |
Arun Suresh
|
15808717f3
|
YARN-5110. Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds. (Konstantinos Karanasos via asuresh)
(cherry picked from commit 1597630681 )
|
2016-05-18 23:20:54 -07:00 |
Arun Suresh
|
a555a320e8
|
YARN-5090. Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster. (asuresh)
(cherry picked from commit 8a9ecb7584 )
|
2016-05-18 23:20:36 -07:00 |
Arun Suresh
|
f31602893e
|
YARN-5075. Fix findbugs warnings in hadoop-yarn-common module. (asuresh)
(cherry picked from commit ccc93e7812 )
|
2016-05-18 23:20:08 -07:00 |
Arun Suresh
|
bbcea3abf3
|
YARN-4738. Notify the RM about the status of OPPORTUNISTIC containers (Konstantinos Karanasos via asuresh)
(cherry picked from commit f45bc5a83e )
|
2016-05-18 23:12:19 -07:00 |
Arun Suresh
|
69a9ce3494
|
YARN-2888. Corrective mechanisms for rebalancing NM container queues. (asuresh)
(cherry picked from commit f0ac18d001 )
|
2016-05-18 23:09:11 -07:00 |
Arun Suresh
|
005dae521c
|
YARN-5073. Refactor startContainerInternal() in ContainerManager to remove unused parameter. (Konstantinos Karanasos via asuresh)
(cherry picked from commit d971bf252f )
|
2016-05-18 22:36:28 -07:00 |
Arun Suresh
|
1b4600abcf
|
YARN-4412. Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers. (asuresh)
(cherry picked from commit 341888a0aa )
|
2016-05-18 22:35:55 -07:00 |
Arun Suresh
|
307cda70db
|
YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)
(cherry picked from commit d464f4d1c4 )
|
2016-05-18 22:09:30 -07:00 |
Arun Suresh
|
d80d24aabf
|
YARN-2885. Create AMRMProxy request interceptor and ContainerAllocator to distribute OPPORTUNISTIC containers to appropriate Nodes (asuresh)
(cherry picked from commit 2bf025278a318b0452fdc9ece4427b4c42124e39)
(cherry picked from commit c282a08f38 )
|
2016-05-18 22:08:55 -07:00 |
Karthik Kambatla
|
b56fc51b70
|
YARN-2883. Queuing of container requests in the NM. (Konstantinos Karanasos and Arun Suresh via kasha)
(cherry picked from commit c8172f5f14 )
|
2016-05-18 22:08:20 -07:00 |
Arun Suresh
|
68964bbaa2
|
YARN-4335. Allow ResourceRequests to specify ExecutionType of a request ask (kkaranasos via asuresh)
(cherry picked from commit 8ffabfdf4f )
(cherry picked from commit b2a654c5ee )
|
2016-05-18 22:02:43 -07:00 |
Karthik Kambatla
|
2c6c701aff
|
YARN-2882. Add an OPPORTUNISTIC ExecutionType. (Konstantinos Karanasos and Inigo Goiri via kasha)
(cherry picked from commit fb00794368 )
|
2016-05-18 22:02:28 -07:00 |
Naganarasimha
|
a166286b9e
|
YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt
(cherry picked from commit f04c81c9ce )
|
2016-05-19 01:35:47 +08:00 |
Varun Vasudev
|
3c9392a31d
|
YARN-4913. Yarn logs should take a -out option to write to a directory. Contributed by Xuan Gong.
(cherry picked from commit ef1757790d )
|
2016-05-18 22:45:06 +05:30 |
Jian He
|
264c06a438
|
YARN-4832. NM side resource value should get updated if change applied in RM side. Contributed by Junping Du
|
2016-05-17 15:02:14 -07:00 |
Eric Payne
|
42b2a34ed8
|
YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger.
(cherry picked from commit 1217c8f6b4 )
|
2016-05-16 20:38:10 +00:00 |
Jason Lowe
|
575c056357
|
YARN-4325. Nodemanager log handlers fail to send finished/failed events in some cases. Contributed by Junping Du
(cherry picked from commit 81effb7dcd )
|
2016-05-16 15:43:20 +00:00 |
Rohith Sharma K S
|
a37b3694ea
|
YARN-5068. Expose scheduler queue to application master. (Harish Jaiprakash via rohithsharmaks)
|
2016-05-16 15:25:15 +05:30 |
Xuan
|
3fe4107909
|
YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or
RUNNING AM. Contributed by Xuan Gong
(cherry picked from commit 7be53b65f9 )
|
2016-05-14 12:22:06 -07:00 |
Jason Lowe
|
bb95a5e18f
|
YARN-5053. More informative diagnostics when applications killed by a user. Contributed by Eric Badger
(cherry picked from commit 013000fbc2 )
|
2016-05-12 20:30:10 +00:00 |
Sangjin Lee
|
d6d13ec670
|
YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)
(cherry picked from commit 0bbe01f8d5 )
|
2016-05-12 10:14:24 -07:00 |
Karthik Kambatla
|
f96b2b6fac
|
YARN-4995. FairScheduler: Display per-queue demand on the scheduler page. (xupeng via kasha)
(cherry picked from commit 4b4e4c6ba8 )
|
2016-05-11 17:36:42 -07:00 |
Junping Du
|
9dc3683d87
|
YARN-5029. RM needs to send update event with YarnApplicationState as Running to ATS/AHS. Contributed by Xuan Gong.
(cherry picked from commit 39f2bac38b )
|
2016-05-11 09:33:16 -07:00 |
Vinod Kumar Vavilapalli
|
e0d6a9632d
|
YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the appOwner argument when viewing another user's logs. Contributed by Ram Venkatesh and Xuan Gong.
(cherry picked from commit 87f5e35133 )
|
2016-05-09 22:47:58 -07:00 |
Naganarasimha
|
3732a1e985
|
YARN-4926. Change nodelabel rest API invalid reponse status to 400. Contributed by Bibin A Chundatt
(cherry picked from commit 2750fb900f )
|
2016-05-08 23:02:07 +05:30 |
Yongjun Zhang
|
5172d0e7b1
|
YARN-5048. DelegationTokenRenewer#skipTokenRenewal may throw NPE (Jian He via Yongjun Zhang)
(cherry picked from commit 47c41e7ac7 )
|
2016-05-06 22:38:56 -07:00 |
Jason Lowe
|
3895058a67
|
YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena
(cherry picked from commit b2ed6ae731 )
|
2016-05-06 23:00:25 +00:00 |
Wangda Tan
|
b68e6b1d6d
|
getApplicationReport call may raise NPE for removed queues. (Jian He via wangda)
(cherry picked from commit 23248f63aa )
|
2016-05-06 15:32:15 -07:00 |
Jian He
|
a6b24c62ab
|
YARN-4390. Do surgical preemption based on reserved container in CapacityScheduler. Contributed by Wangda Tan
(cherry picked from commit bb62e05925 )
|
2016-05-05 12:56:55 -07:00 |
Jason Lowe
|
ee86cef2fe
|
YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla
(cherry picked from commit d0da13229c )
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockNodes.java
|
2016-05-05 14:33:01 +00:00 |
Varun Vasudev
|
38a3b86141
|
YARN-4595. Add support for configurable read-only mounts when launching Docker containers. Contributed by Billie Rinaldi.
(cherry picked from commit 72b047715c )
|
2016-05-05 13:02:38 +05:30 |
Vinod Kumar Vavilapalli
|
8262ef8318
|
YARN-4905. Improved "yarn logs" command-line to optionally show log metadata also. Contributed by Xuan Gong.
(cherry picked from commit 9e37fe3b7a )
|
2016-05-04 14:17:09 -07:00 |
Wangda Tan
|
585299146a
|
YARN-4984. LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak. (Junping Du via wangda)
(cherry picked from commit 7bd418e48c )
|
2016-05-04 11:39:25 -07:00 |
Junping Du
|
1ffb0c43d6
|
YARN-4920. ATS/NM should support a link to dowload/get the logs in text format. Contributed by Xuan Gong.
(cherry picked from commit 3cf223166d452a0f58f92676837a9edb8ddc1139)
|
2016-05-04 10:36:31 -07:00 |
Rohith Sharma K S
|
5aad4070b2
|
YARN-4947. Test timeout is happening for TestRMWebServicesNodes. Contributed by Bibin A Chundatt
(cherry picked from commit 75e0450593 )
|
2016-05-04 10:26:25 +05:30 |
Jason Lowe
|
baac4e7db1
|
YARN-5003. Add container resource to RM audit log. Contributed by Nathan Roberts
(cherry picked from commit ed54f5f1ff )
|
2016-05-03 22:16:17 +00:00 |
Jason Lowe
|
d8fcf02069
|
YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts
(cherry picked from commit c6b4839168 )
|
2016-05-03 22:14:50 +00:00 |
Junping Du
|
47f67ae447
|
YARN-4851. Metric improvements for ATS v1.5 storage components. Li Lu via junping_du.
(cherry picked from commit 06413da72e )
|
2016-05-03 04:18:01 -07:00 |
Robert Kanter
|
ac8fb579c6
|
Remove parent's env vars from child processes
|
2016-04-29 09:26:09 -07:00 |
Varun Vasudev
|
6561e3b500
|
YARN-3998. Add support in the NodeManager to re-launch containers. Contributed by Jun Gong.
(cherry picked from commit 0f25a1bb52 )
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/ProtoUtils.java
|
2016-04-29 16:22:06 +05:30 |
Jian He
|
6ba39a1597
|
YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe
(cherry picked from commit 4a8508501b )
|
2016-04-28 21:54:30 -07:00 |
Jian He
|
a9707dceaf
|
YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe
|
2016-04-28 21:28:03 -07:00 |
Li Lu
|
50b7a35d56
|
YARN-4956. findbug issue on LevelDBCacheTimelineStore. (Zhiyuan Yang via gtcarrera9)
(cherry picked from commit f16722d2ef )
|
2016-04-27 10:58:12 -07:00 |
Karthik Kambatla
|
864ecb4434
|
YARN-4807. MockAM#waitForState sleep duration is too long. (Yufei Gu via kasha)
(cherry picked from commit 185c3d4de1 )
|
2016-04-27 09:43:42 -07:00 |
Varun Vasudev
|
cf3e93ee73
|
YARN-4966. Improve yarn logs to fetch container logs without specifying nodeId. Contributed by Xuan Gong.
(cherry picked from commit 66b07d8374 )
|
2016-04-27 15:57:17 +05:30 |
Jian He
|
9d3ddb0b4d
|
YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode
(cherry picked from commit 4beff01354 )
|
2016-04-26 21:02:04 -07:00 |
Karthik Kambatla
|
52bfa90fed
|
YARN-4795. ContainerMetrics drops records. (Daniel Templeton via kasha)
(cherry picked from commit 1a3f1482e2 )
|
2016-04-26 06:18:27 -07:00 |
Karthik Kambatla
|
a5edb45b18
|
YARN-1297. FairScheduler: Move some logs to debug and check if debug logging is enabled
(cherry picked from commit 4b1dcbbe0c )
|
2016-04-26 05:10:29 -07:00 |
Wangda Tan
|
45ff579bfa
|
YARN-4846. Fix random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers. (Bibin A Chundatt via wangda)
(cherry picked from commit 7cb3a3da96 )
|
2016-04-22 11:41:08 -07:00 |
Eric Payne
|
a7f903b2ba
|
YARN-4556. TestFifoScheduler.testResourceOverCommit fails. Contributed by Akihiro Suda
(cherry picked from commit 3dce486d88 )
|
2016-04-21 21:27:10 +00:00 |
Li Lu
|
054fa104c5
|
YARN-4968. A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped. (Wangda Tan via gtcarrera9)
(cherry picked from commit 7c6339f66a )
|
2016-04-21 13:27:47 -07:00 |
Chris Douglas
|
878924189d
|
YARN-4976. Missing NullPointer check in ContainerLaunchContextPBImpl. Contributed by Giovanni Matteo Fumarola
(cherry picked from commit 95a5046607 )
|
2016-04-21 10:46:35 -07:00 |
Karthik Kambatla
|
75cf238354
|
YARN-4784. Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO. (Yufei Gu via kasha)
(cherry picked from commit 170c4fd4cd )
|
2016-04-20 23:58:30 -07:00 |
Karthik Kambatla
|
cd74cf9525
|
YARN-4935. TestYarnClient#testSubmitIncorrectQueue fails when FairScheduler is the default. (Yufei Gu via kasha)
(cherry picked from commit 6e297836d6 )
|
2016-04-20 23:41:03 -07:00 |
Wangda Tan
|
83a5cdc400
|
YARN-4890. Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate. (Sunil G via wangda)
(cherry picked from commit 33fd95a99c )
|
2016-04-20 17:38:22 -07:00 |
Vinod Kumar Vavilapalli
|
342bb438f2
|
Fixed TimelineClient to retry SocketTimeoutException too. Contributed by Xuan Gong.
(cherry picked from commit 477003730e )
|
2016-04-18 11:49:00 -07:00 |
Wangda Tan
|
41cafeb5a1
|
YARN-4934. Reserved Resource for QueueMetrics needs to be handled correctly in few cases. (Sunil G via wangda)
(cherry picked from commit fdc46bfb37 )
|
2016-04-16 22:50:00 -07:00 |
Xuan
|
94e4d349b0
|
YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du
(cherry picked from commit e6c0742012 )
|
2016-04-16 19:40:11 -07:00 |
Arun Suresh
|
8460a323ce
|
YARN-4468. Document the general ReservationSystem functionality, and the REST API. (subru and carlo via asuresh)
|
2016-04-15 17:20:05 -07:00 |
Jason Lowe
|
cd148cb347
|
YARN-4940. yarn node -list -all failed if RM start with decommissioned node. Contributed by sandflee
(cherry picked from commit 69f3d428d5 )
|
2016-04-15 20:38:04 +00:00 |
Naganarasimha
|
2213a40f30
|
YARN-4909. Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter. Contributed by Bibin A Chundatt
(cherry picked from commit fdbafbc9e5 )
|
2016-04-15 23:40:07 +05:30 |
Jason Lowe
|
ece01478c5
|
YARN-4924. NM recovery race can lead to container not cleaned up. Contributed by sandflee
(cherry picked from commit 3150ae8108 )
|
2016-04-14 19:19:46 +00:00 |
Robert Kanter
|
e79a47670b
|
YARN-4541. Change log message in LocalizedResource#handle() to DEBUG (rchiang via rkanter)
(cherry picked from commit 0d9194df00 )
|
2016-04-13 17:45:36 -07:00 |
Xuan
|
5bc64dafc3
|
YARN-4886. Add HDFS caller context for EntityGroupFSTimelineStore. Contributed by Li Lu
(cherry picked from commit e0cb426758 )
|
2016-04-13 10:39:31 -07:00 |
Naganarasimha
|
53c24e00e8
|
YARN-4810. NM applicationpage cause internal error 500. Contributed by Bibin A Chundatt.
(cherry picked from commit 437e9d6475 )
|
2016-04-12 18:25:11 +05:30 |
Rohith Sharma K S
|
d93cfefea5
|
YARN-4897. dataTables_wrapper change min height. Contributed by Bibin A Chundatt.
(cherry picked from commit 4ee7f0a3e7 )
|
2016-04-12 10:28:18 +05:30 |
Rohith Sharma K S
|
e9d1d8afd7
|
YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He.
(cherry picked from commit ff722bbbdf )
|
2016-04-12 10:03:29 +05:30 |
Vinod Kumar Vavilapalli
|
f1dcd40294
|
YARN-4168. Fixed a failing test TestLogAggregationService.testLocalFileDeletionOnDiskFull. Contributed by Takashi Ohnishi.
(cherry picked from commit 44bbc50d91 )
|
2016-04-11 12:12:30 -07:00 |
Jason Lowe
|
f1a370ce8b
|
Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla"
This reverts commit 814ceeb489 .
|
2016-04-11 15:56:29 +00:00 |
Junping Du
|
a3f8491410
|
YARN-4928. Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon. Contributed by Gergely Novák.
(cherry picked from commit 08ddb3ac6d )
|
2016-04-11 08:51:22 -07:00 |
Akira Ajisaka
|
8cf6630fc6
|
YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 1ff27f9d12 )
|
2016-04-11 14:55:37 +09:00 |
Varun Vasudev
|
4baee3eb67
|
YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.
(cherry picked from commit 07920acc16 )
|
2016-04-11 09:40:28 +05:30 |
Akira Ajisaka
|
88556294e2
|
YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger.
(cherry picked from commit 1b78b2ba17 )
|
2016-04-11 01:32:49 +09:00 |
Karthik Kambatla
|
94a88ae87b
|
YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha)
(cherry picked from commit ff95fd547b )
|
2016-04-09 10:31:29 -07:00 |
Wangda Tan
|
dac2021f87
|
YARN-4826. Document configuration of ReservationSystem for CapacityScheduler. (Subru Krishnan via wangda)
(cherry picked from commit fcb3fcd4c6 )
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
|
2016-04-08 16:28:14 -07:00 |
Wangda Tan
|
12ccdd6540
|
YARN-3215. Respect labels in CapacityScheduler when computing headroom. (Naganarasimha G R via wangda)
(cherry picked from commit ec06957941 )
|
2016-04-08 15:34:24 -07:00 |
Jian He
|
77a75de319
|
YARN-4740. AM may not receive the container complete msg when it restarts. Contributed by Jun Gong
|
2016-04-08 11:21:07 -07:00 |
Karthik Kambatla
|
2b97a50eec
|
YARN-4756. Unnecessary wait in Node Status Updater during reboot. (Eric Badger via kasha)
(cherry picked from commit e82f961a39 )
|
2016-04-07 17:30:54 -07:00 |
Jian He
|
42bc565630
|
YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev
|
2016-04-06 16:14:13 -07:00 |
Varun Vasudev
|
8f9b97ccce
|
YARN-4906. Capture container start/finish time in container metrics. Contributed by Jian He.
(cherry picked from commit b41e65e5bc )
|
2016-04-06 13:42:06 +05:30 |
Wangda Tan
|
11e796b5cd
|
YARN-4699. Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node. (Sunil G via wangda)
(cherry picked from commit 21eb428448 )
|
2016-04-05 16:25:55 -07:00 |
Masatake Iwasaki
|
e98bb0279b
|
YARN-4917. Fix typos in documentation of Capacity Scheduler. (Takashi Ohnishi via iwasakims)
(cherry picked from commit 500e5a5952 )
|
2016-04-06 04:01:34 +09:00 |
Masatake Iwasaki
|
36a3fe0334
|
YARN-4915. Fix typo in YARN Secure Containers documentation (Takashi Ohnishi via iwasakims)
(cherry picked from commit 30206346cf )
|
2016-04-06 03:47:42 +09:00 |
Junping Du
|
0907ce8c93
|
YARN-4916. TestNMProxy.tesNMProxyRPCRetry fails. Contributed by Tibor Kiss.
(cherry picked from commit 0005816743 )
|
2016-04-05 09:02:50 -07:00 |
Junping Du
|
eeff2e35f8
|
YARN-4893. Fix some intermittent test failures in TestRMAdminService. Contributed by Brahma Reddy Battula.
(cherry picked from commit 6be28bcc46 )
|
2016-04-05 07:05:06 -07:00 |
Jason Lowe
|
814ceeb489
|
YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla
(cherry picked from commit 1cbcd4a491 )
|
2016-04-05 13:41:18 +00:00 |
Rohith Sharma K S
|
13a4e25f26
|
YARN-4609. RM Nodes list page takes too much time to load. Contributed by Bibin A Chundatt
(cherry picked from commit 776b549e2a )
|
2016-04-05 14:53:24 +05:30 |
Rohith Sharma K S
|
eec23580b4
|
YARN-4880. Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE. Contributed by Sunil G
(cherry picked from commit 552237d4a3 )
|
2016-04-05 14:37:31 +05:30 |
Li Lu
|
236d1a5093
|
YARN-4706. UI Hosting Configuration in TimelineServer doc is broken. (Akira AJISAKA via gtcarrera9)
(cherry picked from commit f61de41736 )
|
2016-04-04 14:41:40 -07:00 |
naganarasimha
|
3772602848
|
YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt
(cherry picked from commit 5092c94195 )
|
2016-04-04 18:08:18 +05:30 |
Rohith Sharma K S
|
c8271cd117
|
YARN-4607. Pagination support for AppAttempt page TotalOutstandingResource Requests table. Contributed by Bibin A Chundatt
(cherry picked from commit 1e6f92977d )
|
2016-04-04 08:13:03 +05:30 |
Allen Wittenauer
|
92a3dbe44f
|
YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw)
(cherry picked from commit b1394d6307 )
|
2016-04-01 16:57:31 -07:00 |
Karthik Kambatla
|
ecfd25dc65
|
YARN-4657. Javadoc comment is broken for Resources.multiplyByAndAddTo(). (Daniel Templeton via kasha)
(cherry picked from commit 81d04cae41 )
|
2016-04-01 16:20:18 -07:00 |
Arun Suresh
|
f56266fccc
|
Missing file for YARN-4895.
(cherry picked from commit 5686caa9fc )
|
2016-04-01 15:58:38 -07:00 |
Arun Suresh
|
24ce9ea456
|
YARN-4895. Add subtractFrom method to ResourceUtilization class. Contributed by Konstantinos Karanasos.
(cherry picked from commit 82621e38a0 )
|
2016-04-01 15:00:02 -07:00 |
Varun Vasudev
|
10d8f8a39c
|
Revert "YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki."
This reverts commit 0064cba169 .
(cherry picked from commit 3488c4f2c9 )
|
2016-04-01 12:21:49 +05:30 |
Robert Kanter
|
633f612d67
|
YARN-4639. Remove dead code in TestDelegationTokenRenewer added in YARN-3055 (templedf via rkanter)
(cherry picked from commit 7a021471c3 )
|
2016-03-31 15:47:44 -07:00 |
Wangda Tan
|
d36d9d676d
|
YARN-4634. Scheduler UI/Metrics need to consider cases like non-queue label mappings. (Sunil G via wangda)
(cherry picked from commit 12b11e2e68 )
|
2016-03-31 14:35:59 -07:00 |
Jian He
|
3afc2caec8
|
YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage
|
2016-03-31 14:31:38 -07:00 |
Sangjin Lee
|
b91928cd26
|
YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee)
(cherry picked from commit 6d67420dbc )
|
2016-03-31 10:49:45 -07:00 |
Varun Vasudev
|
dcad99892d
|
YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki.
(cherry picked from commit 0064cba169 )
|
2016-03-31 14:06:45 +05:30 |
Varun Vasudev
|
cda9e1d09b
|
YARN-4884. Fix missing documentation about rmadmin command regarding node labels. Contributed by Kai Sasaki.
(cherry picked from commit f1b8f6b2c1 )
|
2016-03-31 14:03:08 +05:30 |
Jian He
|
f1f441b80f
|
YARN-4822. Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates. Contributed by Wangda Tan
|
2016-03-30 12:46:36 -07:00 |
Robert Kanter
|
b7e6d5cbfe
|
YARN-4436. DistShell ApplicationMaster.ExecBatScripStringtPath is misspelled (mattlamantia via rkanter)
(cherry picked from commit 8286270466 )
|
2016-03-29 17:21:50 -07:00 |
Wangda Tan
|
6856a7183a
|
YARN-4865. Track Reserved resources in ResourceUsage and QueueCapacities. (Sunil G via wangda)
(cherry picked from commit fc055a3cbe )
|
2016-03-29 17:10:17 -07:00 |
Xuan
|
ffe01e05cd
|
YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du
(cherry picked from commit 80182809ae )
|
2016-03-28 22:18:56 -07:00 |
Jason Lowe
|
edf17fe8e5
|
YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong
(cherry picked from commit 948b758070 )
|
2016-03-28 23:02:15 +00:00 |
Jian He
|
c7d843af3b
|
YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du
|
2016-03-28 11:13:02 -07:00 |
Jian He
|
d2f9adca88
|
Missing file for YARN-4117.
|
2016-03-28 09:23:06 -07:00 |
Jian He
|
bdc648ebe7
|
YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola
|
2016-03-27 20:22:49 -07:00 |
Karthik Kambatla
|
4212f2e2bf
|
YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha)
(cherry picked from commit 49ff54c860 )
|
2016-03-26 21:45:29 -07:00 |
Jason Lowe
|
3cea00a294
|
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong
(cherry picked from commit e8fc81f9c8 )
|
2016-03-25 20:19:15 +00:00 |
Junping Du
|
c722262c75
|
YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.
(cherry picked from commit 19b645c938 )
|
2016-03-23 19:35:14 -07:00 |
Junping Du
|
76602161c0
|
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong.
(cherry picked from commit af1d125f9c )
|
2016-03-23 08:58:05 -07:00 |
Karthik Kambatla
|
95b59c17a7
|
YARN-4732. *ProcessTree classes have too many whitespace issues
(cherry picked from commit 7fae4c68e6 )
|
2016-03-20 10:47:56 -07:00 |
Eric Payne
|
dd1e4107e5
|
YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger.
(cherry picked from commit 92b7e0d413 )
|
2016-03-18 17:05:53 +00:00 |
Junping Du
|
66257613b4
|
YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API.
(cherry picked from commit ca8106d2dd )
|
2016-03-17 09:25:36 -07:00 |
Karthik Kambatla
|
bbe9bb078c
|
YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha)
(cherry picked from commit f84af8bd58 )
|
2016-03-17 05:54:40 -07:00 |
Wangda Tan
|
484976fa2b
|
YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)
(cherry picked from commit 7e8c9beb41 )
(cherry picked from commit ae14e5d07f )
|
2016-03-16 17:03:35 -07:00 |
Karthik Kambatla
|
ab03266831
|
YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha)
(cherry picked from commit 3ef5500783 )
|
2016-03-15 23:47:19 -07:00 |
Xuan
|
398dbde538
|
Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)"
This reverts commit 3a0b695441 .
(cherry picked from commit a888b5bc53 )
|
2016-03-15 22:11:16 -07:00 |
Li Lu
|
94649b9cc0
|
YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9)
(cherry-picked from commit 5176a69868 )
|
2016-03-15 11:48:37 -07:00 |
Li Lu
|
14a4110b75
|
YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)
(cherry picked from commit 3a0b695441 )
|
2016-03-15 11:42:30 -07:00 |
Robert Kanter
|
da24fde333
|
TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)
(cherry picked from commit 22ca176dfe )
|
2016-03-15 10:05:28 -07:00 |
Siddharth Seth
|
edd9abf302
|
YARN-4816. Fix incompatible change in SystemClock.
(cherry picked from commit eba66a64d2 )
|
2016-03-14 20:15:41 -07:00 |
Karthik Kambatla
|
b4c8693096
|
YARN-4719. Add a helper library to maintain node state and allows common queries. (kasha)
(cherry picked from commit 20d389ce61 )
|
2016-03-14 14:22:21 -07:00 |
Junping Du
|
3d5ac829da
|
YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du
(cherry picked from commit f291d82cd4 )
|
2016-03-14 08:30:07 -07:00 |
Li Lu
|
2b16a54fbe
|
YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency.
This commit amends commit d49cfb3504 with a missed test file.
(cherry picked from commit 017d2c127b )
|
2016-03-10 13:04:57 -08:00 |
Li Lu
|
76ef097fd1
|
YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)
(cherry-picked from commit d49cfb3504 )
|
2016-03-10 10:56:51 -08:00 |
Allen Wittenauer
|
9f4b3eaac0
|
Revert "HADOOP-12366. expose calculated paths (aw)"
This reverts commit 45bb467918 .
|
2016-03-09 09:59:19 -08:00 |
Wangda Tan
|
f7b38a7fb8
|
YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda)
(cherry picked from commit 0233d4e0ee )
|
2016-03-08 14:28:26 -08:00 |
Jian He
|
fb139b0c40
|
YARN-4764. Application submission fails when submitted queue is not available in scheduler xml. Contributed by Bibin A Chundatt
(cherry picked from commit 3c33158d1c )
|
2016-03-08 13:12:33 -08:00 |
Akira Ajisaka
|
0586386472
|
HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
(cherry picked from commit f86850b544 )
|
2016-03-08 14:29:46 +09:00 |
Vinod Kumar Vavilapalli
|
da9f39b107
|
YARN-4762. Fixed CgroupHandler's creation and usage to avoid NodeManagers crashing when LinuxContainerExecutor is enabled. (Sidharta Seethana via vinodkv)
(cherry picked from commit b2661765a5 )
|
2016-03-07 11:11:29 -08:00 |
Jason Lowe
|
adcdcfd5c1
|
YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger
(cherry picked from commit 4163e36c2b )
|
2016-03-07 15:57:44 +00:00 |
Jason Lowe
|
4eace7ab43
|
YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana
(cherry picked from commit 059caf9989 )
|
2016-03-07 15:45:47 +00:00 |
Varun Vasudev
|
78919f8c34
|
YARN-4245. Generalize config file handling in container-executor. Contributed by Sidharta Seethana.
(cherry picked from commit 8ed2e060e8 )
|
2016-03-07 16:19:27 +05:30 |
Varun Vasudev
|
e9a0ffc7f1
|
YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.
(cherry picked from commit 43416187c07afb35e3267f94d0a41d8d3cfb5735)
|
2016-03-07 15:23:36 +05:30 |
Zhihai Xu
|
7ac7ca48b7
|
YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee
(cherry picked from commit e1ccc9622b )
|
2016-03-06 19:49:47 -08:00 |
Rohith Sharma K S
|
1415e6190a
|
YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks)
(cherry picked from commit 77e2c3e8c7365b2aca00b6169829f87c63e4b460)
|
2016-03-05 13:07:20 +05:30 |
Masatake Iwasaki
|
722182fdfb
|
HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
(cherry picked from commit cbd31328a6 )
Conflicts:
hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
|
2016-03-04 14:12:44 +09:00 |
Jian He
|
023c2d2e56
|
YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding
|
2016-03-01 13:14:51 -08:00 |
Jian He
|
589b537631
|
YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu
(cherry picked from commit d93c22ec27 )
|
2016-02-29 18:19:34 -08:00 |
Karthik Kambatla
|
84172b047b
|
YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha)
(cherry picked from commit 9dafaaaf0d )
|
2016-02-29 16:10:26 -08:00 |
Haohui Mai
|
c5db4ab0b4
|
HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.
|
2016-02-29 14:10:18 -08:00 |
Jason Lowe
|
bd0f5085e3
|
YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe
(cherry picked from commit c58a6d53c5 )
|
2016-02-29 15:26:26 +00:00 |
Rohith Sharma K S
|
2a1bb6cb67
|
YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit e0b14f26f5 )
|
2016-02-29 10:50:23 +08:00 |
Karthik Kambatla
|
f3b37d8020
|
YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha)
(cherry picked from commit f9692770a5 )
|
2016-02-28 10:01:48 -08:00 |
Jason Lowe
|
0bd7ba4ea8
|
YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla
(cherry picked from commit 6b0f813e89 )
|
2016-02-26 20:25:56 +00:00 |
Ming Ma
|
1656bcec5f
|
YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma)
(cherry picked from commit 7f3139e54d )
|
2016-02-26 08:43:14 -08:00 |
Robert Kanter
|
872b8d90a6
|
YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)
(cherry picked from commit d7fdec1e6b )
|
2016-02-25 16:40:05 -08:00 |
Robert Kanter
|
ec48848711
|
YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter)
(cherry picked from commit c4d4df8de0 )
|
2016-02-25 12:48:29 -08:00 |
Karthik Kambatla
|
6a75c5af09
|
YARN-4729. SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE. (kasha)
(cherry picked from commit c684f2b007 )
|
2016-02-24 18:34:21 -08:00 |
Robert Kanter
|
c2098d2470
|
YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)
(cherry picked from commit 954dd57043 )
|
2016-02-24 15:00:48 -08:00 |
Li Lu
|
51162f9629
|
YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
gtcarrera9)
|
2016-02-24 13:52:11 -08:00 |