af14458de7
HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]
2015-12-06 17:42:56 +00:00
78a07e99dd
YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh)
...
(cherry picked from commit 742632e346
2015-12-05 21:30:48 -08:00
8a97ca4b00
Add missing file for YARN-4419
2015-12-03 19:11:07 -08:00
be404e1680
YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
...
(cherry picked from commit 755dda8dd8
2015-12-03 17:46:09 -08:00
51e448d295
YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda)
...
(cherry picked from commit a2c3bfc8c1
2015-12-03 14:30:25 -08:00
23fe1abc02
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
...
(cherry picked from commit 9f77ccad73
2015-12-03 12:49:22 -08:00
e76ba91fa5
YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter.
...
(cherry picked from commit 62e9348bc1
2015-12-03 06:37:31 -08:00
48cbde9083
YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding
2015-12-02 11:08:00 -08:00
45bb467918
HADOOP-12366. expose calculated paths (aw)
2015-12-01 08:16:20 -08:00
092c469059
Creating 2.6.4 entries in CHANGES.txt files.
...
(cherry picked from commit 028894281b
2015-12-01 08:18:57 -08:00
b20e77eba3
Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0
2015-11-25 17:47:22 -08:00
767815f317
Adding release 2.8.0 to CHANGES.txt
...
(cherry picked from commit d57fd181c7
2015-11-25 17:37:47 -08:00
d76b523b02
YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena.
...
(cherry picked from commit 0656d2dc83
2015-11-26 01:10:41 +09:00
7b9f7eaf5c
YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda)
...
(cherry picked from commit 23c625ec57
2015-11-24 16:36:30 -08:00
3a2f5d6329
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla
...
(cherry picked from commit f5acf94eca
2015-11-24 23:47:54 +00:00
9e54433c6c
YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li
...
(cherry picked from commit 4ac6799d4a
2015-11-24 22:36:19 +00:00
9e458c3e9e
YARN-4387. Fix typo in FairScheduler log message. Contributed by Xin Wang.
...
(cherry picked from commit 28dfe721b8
2015-11-24 22:10:31 +09:00
ac0ddc4fec
YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.
...
(cherry picked from commit 8c0133f3d4
2015-11-24 18:40:56 +09:00
49ed955c91
YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)
...
(cherry picked from commit 52948bb20b
2015-11-24 13:52:29 +05:30
b339a4b8d6
YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
...
(cherry picked from commit 8676a118a1
2015-11-23 17:20:24 -08:00
d13b646c61
Update CHANGES.txt for recent commits to branch-2.6.
...
(cherry picked from commit aa2009c37b
2015-11-23 21:58:57 +00:00
9d303edbfb
YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev
...
(cherry picked from commit d36b6e045f
2015-11-23 20:31:50 +00:00
cbbdbe3cdd
YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)
...
(cherry picked from commit da1016365a
2015-11-21 10:01:10 -08:00
08727287de
move YARN-4326/YARN-3849 from 2.8.0 to 2.7.3
2015-11-20 16:42:11 -08:00
cdca460ad4
YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)
...
(cherry picked from commit 2346fa3141
2015-11-20 15:56:17 -08:00
f3bca8bc1a
YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li
...
(cherry picked from commit 060cdcbe5d
2015-11-20 23:13:27 +00:00
8347b1048d
YARN-2859 addendum: move the entry from 2.6.2 to 2.6.3 in hadoop-yarn/CHANGES.txt.
...
(cherry picked from commit 866dce4e8e
2015-11-19 10:17:20 -08:00
be65d319fa
YARN-2859.addendum: fix the remaining issue from the previous patch
...
(cherry picked from commit f114e728da
2015-11-19 10:09:48 -08:00
3504d0e795
move fix version of YARN-4287 from 2.8.0 to 2.7.3
2015-11-18 14:01:02 -08:00
d3f9508096
YARN-4367. SLS webapp doesn't load. (kasha)
2015-11-18 13:45:00 -08:00
a0b3e43a6d
YARN-4279. Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable. (stevel)
2015-11-18 21:41:24 +00:00
d8e60080e9
YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)
...
(cherry picked from commit 6a61928fb7
2015-11-17 15:51:59 -08:00
2cf084ac76
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
...
This reverts commit a4ff03b200
2015-11-16 20:19:31 -08:00
1d107d8058
YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.
...
(cherry picked from commit 855d52927b
2015-11-15 04:44:59 -08:00
875aec3177
YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)
...
(cherry picked from commit 7ff280fca9
2015-11-12 11:50:41 -08:00
13f8c7093b
YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)
...
(cherry picked from commit 7f55a18071
2015-11-12 11:24:04 -08:00
0c1fb15b29
YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)
...
(cherry picked from commit 796638d9bc
2015-11-12 11:12:11 -08:00
9050078005
YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du
...
(cherry picked from commit 06a70311b9
2015-11-12 14:49:55 +00:00
bb5dd7f772
YARN-4183. Reverting the patch to fix behaviour change.
...
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"
This reverts commit 42bc525acb
2015-11-11 10:42:52 -08:00
f6f128c867
YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.
...
(cherry picked from commit 23d0db551c
2015-11-11 16:13:50 +09:00
8a8ac50a5b
YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda)
...
(cherry picked from commit c99925d6dd
2015-11-10 13:17:23 -08:00
b742ea7fe6
HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in
...
the first patch committed. (Karthik Kambatla via vinodkv)
2015-11-10 12:16:52 -08:00
a4ff03b200
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
...
(cherry picked from commit 8fbea531d7
2015-11-09 11:05:12 -08:00
8334d86472
Add 2.7.3 release to CHANGES.txt
...
(cherry picked from commit 0383a3973b
2015-11-04 16:27:28 +00:00
3190446df9
YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda)
...
(cherry picked from commit 0783184f4b
2015-11-03 11:36:11 -08:00
b2d6ea5e18
Updated the 2.6.2 final release date.
...
(cherry picked from commit a4a6b5b4b4
2015-10-30 18:49:21 -07:00
8dce482f61
Creating 2.6.3 entries in CHANGES.txt files.
...
(cherry picked from commit eadf7b3096
2015-10-30 14:52:06 +00:00
1c80473a41
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
...
(cherry picked from commit ce31b22739
2015-10-30 18:00:35 +09:00
dd144035a0
Add an entry of YARN-4312 to CHANGES.txt
...
(cherry picked from commit d21214ce33
2015-10-30 17:57:29 +09:00
c522a9ffc2
Move YARN-3580 in CHANGES.txt from 2.8 to 2.7.2.
...
(cherry picked from commit d2e01f4ed8
2015-10-30 15:51:04 +09:00
b505bf9e58
YARN-4313. Race condition in MiniMRYarnCluster when getting history
...
server address. Contributed by Jian He
(cherry picked from commit 7412ff48ee
2015-10-29 17:37:24 -07:00
2b197bbffd
YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena
...
(cherry picked from commit e5b1733e04
2015-10-29 15:43:26 -07:00
42bc525acb
YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)
...
(cherry picked from commit c293c58954
2015-10-29 16:42:49 -05:00
8943abfb08
YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh)
...
(cherry picked from commit 58d1df585c
2015-10-29 13:43:43 -07:00
c75d8b164f
YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena
...
(cherry picked from commit e2267de207
2015-10-29 16:39:55 +00:00
7d109ef5b5
YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
...
(cherry picked from commit c41699965e
2015-10-29 00:01:20 -07:00
e3fcb711d6
YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks)
...
(cherry picked from commit 656c8f9527
2015-10-29 12:25:08 +05:30
16db203a83
Set the release date for 2.6.2
2015-10-28 20:48:49 -07:00
9ce5069d16
YARN-2859. ApplicationHistoryServer binds to default port 8188 in
...
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli
(cherry picked from commit 27414dac66
2015-10-28 10:33:56 -07:00
d29bff86c4
YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 9f4dfdf4eb
2015-10-28 17:39:26 +09:00
c5bf1cb7af
YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt.
...
(cherry picked from commit c28e16b40c
2015-10-27 20:56:45 +05:30
3138b43f16
YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 96677bef00
2015-10-27 12:35:20 +09:00
d9156c1245
YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka)
...
(cherry picked from commit 8a68630dd1
2015-10-27 10:28:30 +09:00
1499af38eb
YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda)
...
(cherry picked from commit 56e4f6237a
2015-10-26 16:45:20 -07:00
9bf1e74171
YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)
...
(cherry picked from commit 6f606214e7
2015-10-26 16:38:39 -07:00
baa2998e93
YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
...
(cherry picked from commit 3cc73773eb
2015-10-26 13:12:56 -07:00
7d66e2e666
YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee
...
(cherry picked from commit 33a03af3c3
2015-10-26 19:54:16 +00:00
33455fa415
YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)
...
(cherry picked from commit 5acdde4744
2015-10-26 15:45:22 +05:30
06ecc37e82
YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager project. (varun saxena via rohithsharmaks)
...
(cherry picked from commit 092883b34a
2015-10-26 15:26:08 +05:30
e85ebf0825
YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula.
...
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerShutdown.java
2015-10-26 17:06:46 +09:00
e75799d5fd
YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks)
...
(cherry picked from commit b57f08c0d2
2015-10-26 12:07:48 +05:30
599653ad92
YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw)
2015-10-25 21:43:51 -07:00
f0580dcac0
YARN-3738. Add support for recovery of reserved apps running under dynamic queues (subru via asuresh)
...
(cherry picked from commit ab8eb8770c
2015-10-24 22:54:45 -07:00
fc5a433adb
YARN-4296. DistributedShell Log.info is not friendly. (Xiaowei Wang via stevel)
2015-10-24 12:54:48 +01:00
65b928d8c7
YARN-4289. TestDistributedShell failing with bind exception. (Brahma Reddy Battula via stevel)
2015-10-24 12:48:03 +01:00
356e922632
YARN-4294. [JDK8] Fix javadoc errors caused by wrong reference and illegal tag. (aajisaka)
...
(cherry picked from commit 7781fe1b9e
2015-10-24 11:56:37 +09:00
235e84bf3d
YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G
...
(cherry picked from commit d3a34a4f38
2015-10-23 20:57:53 +00:00
6db7bfbcfd
YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
...
(cherry picked from commit f8adeb712d
2015-10-23 10:43:59 -05:00
4bb7e68eb6
YARN-2913. Fair scheduler should have ability to set MaxResourceDefault for each queue. (Siqi Li via mingma)
...
(cherry picked from commit 934d96a334
2015-10-23 08:37:46 -07:00
d5145b58f6
YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.
...
(cherry picked from commit 0fce5f9a49
2015-10-22 13:42:12 -07:00
9fe7ccc61c
YARN-4256. YARN fair scheduler vcores with decimal values. Contributed by Jun Gong
...
(cherry picked from commit 960201b79b
2015-10-22 12:31:28 -07:00
c44401f362
YARN-3739. Add reservation system recovery to RM recovery process. Contributed by Subru Krishnan.
...
(cherry picked from commit 2798723a54
2015-10-22 06:52:41 -07:00
cc8093e5ac
YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)
...
(cherry picked from commit 25f8f801d1
2015-10-21 15:38:48 -05:00
e2f027dddc
Moved CHANGES.txt entries to 2.6.2
...
YARN-2019, YARN-4092, YARN-4101, YARN-4087, YARN-3727, YARN-4005,
YARN-3780, YARN-3802, YARN-3896, YARN-3554, YARN-3194, YARN-3798
(cherry picked from commit 14f0e2787c
2015-10-21 23:25:43 +09:00
f2009dc89c
YARN-3985. Make ReservationSystem persist state using RMStateStore reservation APIs. (adhoot via asuresh)
...
(cherry picked from commit 506d1b1dbc
2015-10-20 16:48:58 -07:00
acc0e718d6
YARN-4270. Limit application resource reservation on nodes for non-node/rack specific requests (asuresh)
...
(cherry picked from commit 7e2837f830
2015-10-19 20:02:10 -07:00
e4429de86f
YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana.
...
(cherry picked from commit 151eab2a12
2015-10-19 20:56:43 +05:30
196d549e2b
YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.
...
(cherry picked from commit e39ae0e676
2015-10-19 20:21:48 +05:30
390f29ab99
YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel)
2015-10-18 12:03:46 +01:00
180efe6677
YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee)
...
(cherry picked from commit 58590fef49
2015-10-16 16:57:32 -07:00
1ba73169c7
YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G
...
(cherry picked from commit f9da5cdb2b
2015-10-16 15:26:46 -07:00
204ee6a40f
YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda)
...
(cherry picked from commit 4337b263aa
2015-10-16 15:10:08 -07:00
2862057f11
YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena
...
(cherry picked from commit cf23f2c2b5
2015-10-15 17:13:09 -07:00
342870b70f
YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana.
...
(cherry picked from commit 63020c54c1
2015-10-15 13:41:58 +05:30
0e4fb329ed
HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)
2015-10-14 20:25:33 +01:00
526be695c0
YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks)
...
(cherry picked from commit d6c8bad869
2015-10-14 16:13:26 +05:30
2dd9c475c4
YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana.
...
(cherry picked from commit da1ee078f9
2015-10-14 15:27:18 +05:30
0aeedfd572
YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana.
...
(cherry picked from commit fb9c1519b3
2015-10-14 15:19:19 +05:30
a9b03b5afb
YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana.
...
(cherry picked from commit 8d59293089
2015-10-14 15:04:22 +05:30
5eab51a24f
HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)
2015-10-13 21:47:54 +01:00
Steve Loughran
Arun Suresh
Jian He
Wangda Tan
Junping Du
Allen Wittenauer
Vinod Kumar Vavilapalli
Tsuyoshi Ozawa
Jason Lowe
Akira Ajisaka
Karthik Kambatla
Xuan
Sangjin Lee
Jonathan Eagles
Rohith Sharma K S
Varun Vasudev
Ming Ma
Zhihai Xu
Anubhav Dhoot