Wangda Tan
fd18377255
YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)
...
(cherry picked from commit 7e4715186d
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
(cherry picked from commit 7013f9d6cd
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-12-08 14:31:31 -08:00
Vinod Kumar Vavilapalli
067d14f503
HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport.
2015-12-08 11:36:15 -08:00
cnauroth
e23ab9d02b
HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen.
...
(cherry picked from commit 1b525a9c32
)
(cherry picked from commit faf1c60899
)
2015-12-08 11:22:19 -08:00
Tsuyoshi Ozawa
0460b8a8a3
YARN-4348. ZKRMStateStore.syncInternal shouldn't wait for sync completion for avoiding blocking ZK's event thread. (ozawa)
2015-12-08 13:33:10 +09:00
Xuan
ba02e8f6d1
MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
...
(cherry picked from commit fc470840a0
)
(cherry picked from commit 3b10ff6a6f
)
2015-12-07 14:18:26 -08:00
Jonathan Eagles
22be47d747
YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)
...
(cherry picked from commit 4ff973f96a
)
2015-12-07 15:09:54 -06:00
Zhe Zhang
670617f325
HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. Contributed by Xiao Chen.
...
Change-Id: Idf99293085531165239369155c039b55db0eed83
2015-12-04 09:49:43 -08:00
Zhe Zhang
b39de3b0bd
HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. Contributed by Ming Ma. Branch-2.7 patch contributed by Xiao Chen.
...
Change-Id: Iadaee6be2b44f7b0322d7b0e58f8fc983ef463f6
2015-12-03 23:19:17 -08:00
Jian He
6a30d93aa4
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
...
(cherry picked from commit 9f77ccad73
)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/TaskPage.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/WebPageUtils.java
2015-12-03 14:11:48 -08:00
Zhe Zhang
1ae8a8342e
HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. Contributed by Brahma Reddy Battula. Branch-2.7 patch contributed by Xiao Chen.
...
Change-Id: I1b32627bc2a2f30f5debeaba7663fb2777958079
2015-12-03 10:30:48 -08:00
Akira Ajisaka
7404506111
HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu.
...
(cherry picked from commit 3857fed2c8
)
(cherry picked from commit 15c2f709c6
)
2015-12-03 11:52:28 +08:00
Tsz-Wo Nicholas Sze
4123650e92
HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula
2015-12-02 17:55:10 -08:00
Jian He
42a2bddcb7
YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding
...
(cherry picked from commit 6b9a5beb2b
)
2015-12-02 11:09:08 -08:00
Andrew Wang
10e8a67d23
HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang.
...
(cherry picked from commit 9b8e50b424
)
(cherry picked from commit ce1111ceea
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
2015-11-30 14:53:04 -08:00
Jason Lowe
e1b6a5413f
MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
...
(cherry picked from commit 7fd00b3db4
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2015-11-30 17:45:27 +00:00
Vinayakumar B
0c48c17ae9
HDFS-9426. Rollingupgrade finalization is not backward compatible (Contributed by Kihwal Lee)
...
(cherry picked from commit c62d42cd8b
)
2015-11-26 09:42:26 +05:30
Tsuyoshi Ozawa
f50f889c17
YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena.
...
(cherry picked from commit 0656d2dc83
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
2015-11-26 01:22:11 +09:00
Jason Lowe
b68f527b9f
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla
...
(cherry picked from commit f5acf94eca
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/nodelabels/TestFileSystemNodeLabelsStore.java
2015-11-24 23:52:46 +00:00
Jason Lowe
4ba5667aed
MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts
...
(cherry picked from commit cab3c7c889
)
2015-11-24 22:02:21 +00:00
Tsz-Wo Nicholas Sze
af811030e5
Move HDFS-9434 to 2.6.3 in CHANGES.txt.
2015-11-24 12:49:34 -08:00
Tsz-Wo Nicholas Sze
09f4a4eefd
HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags.
2015-11-24 12:47:50 -08:00
Jason Lowe
2946621a53
Revert "HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula."
...
This reverts commit 4356e8a5ef
.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSourceAdapter.java
(cherry picked from commit 17b1a5482b
)
2015-11-24 19:18:37 +00:00
Jason Lowe
9bd9544bda
Update CHANGES.txt for recent commits to branch-2.6.
...
(cherry picked from commit aa2009c37b
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2015-11-23 22:00:27 +00:00
Jason Lowe
5bd40d7099
YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev
...
(cherry picked from commit d36b6e045f
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java
2015-11-23 20:47:12 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f62cdc38f3
HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit 70c26703f4
)
2015-11-23 10:01:38 -08:00
Wangda Tan
c7e23255ae
YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)
2015-11-20 16:36:11 -08:00
Wangda Tan
2ad1386b2b
YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda)
2015-11-20 16:17:23 -08:00
Jason Lowe
9074714a18
YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li
...
(cherry picked from commit 060cdcbe5d
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
2015-11-20 23:25:27 +00:00
Xuan
eb9296d316
YARN-2859 addendum: move the entry from 2.6.2 to 2.6.3 in hadoop-yarn/CHANGES.txt.
...
(cherry picked from commit 866dce4e8e
)
(cherry picked from commit 8347b1048d
)
2015-11-19 10:18:47 -08:00
Xuan
fe67c6f43f
YARN-2859.addendum: fix the remaining issue from the previous patch
...
(cherry picked from commit f114e728da
)
(cherry picked from commit be65d319fa
)
2015-11-19 10:10:22 -08:00
Akira Ajisaka
bb6983e153
HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii.
...
(cherry picked from commit ac1aa6c819
)
(cherry picked from commit c74e42b4a2
)
2015-11-19 20:55:52 +09:00
Wangda Tan
82de3e1c11
YARN-4287. Capacity Scheduler: Rack Locality improvement. (Nathan Roberts via wangda)
2015-11-18 13:58:47 -08:00
Jason Lowe
b96377334c
MAPREDUCE-6377. JHS sorting on state column not working in webUi.
...
Contributed by zhihai xu.
(cherry picked from commit 790a861766
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2015-11-18 17:12:50 +00:00
Ming Ma
1b0f277eae
HDFS-9413. getContentSummary() on standby should throw StandbyException. (Brahma Reddy Battula via mingma)
...
(cherry picked from commit 02653add98
)
(cherry picked from commit 42b55ff23e
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit 83200450f6
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-11-17 16:12:58 +05:30
Akira Ajisaka
ab04c9ab5f
HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 1a169a26bc
)
(cherry picked from commit 9f9315008e
)
2015-11-17 16:32:07 +09:00
Jian He
27b786660e
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
...
This reverts commit cb4d4d5918
.
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-11-16 20:20:46 -08:00
Jian He
f95f416fad
MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du
2015-11-16 17:13:49 -08:00
Jason Lowe
e1716c7cf9
YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.
...
(cherry picked from commit 855d52927b
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestLocalResourcesTrackerImpl.java
2015-11-16 15:02:56 +00:00
Jason Lowe
38f37ca2eb
Revert "YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe."
...
This reverts commit 8ea88ab0b8
.
2015-11-16 14:30:22 +00:00
Junping Du
8ea88ab0b8
YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.
...
(cherry picked from commit 855d52927b
)
(cherry picked from commit 1d107d8058
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestLocalResourcesTrackerImpl.java
2015-11-15 04:50:28 -08:00
Akira Ajisaka
854a0fa6c9
Fix conflict in CHANGES.txt when backporting HADOOP-12482 to branch-2.7.
2015-11-15 19:04:30 +09:00
Lei Xu
929699f7eb
HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei)
...
(cherry picked from commit 0eb9c60c5b
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2015-11-14 14:58:50 +09:00
Robert Kanter
d833950317
HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter)
...
(cherry picked from commit 764f8baa99
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2015-11-14 14:50:01 +09:00
Tsuyoshi Ozawa
2b7e6f7dfd
HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 4356e8a5ef
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2015-11-14 14:48:33 +09:00
Eric Yang
47dfb69a26
HADOOP-12374. Updated expunge command description.
...
(WeiWei Yang via eyang)
(cherry picked from commit b4bb8e1731
)
2015-11-14 13:13:38 +09:00
Akira Ajisaka
5c35f6c460
HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad.
...
(cherry picked from commit f94d892704
)
(cherry picked from commit c5c663c05d
)
Conflicts:
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/package-info.java
2015-11-13 21:59:18 +09:00
Wangda Tan
ddce4c8245
YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)
2015-11-12 11:20:38 -08:00
Sangjin Lee
adede3e53d
MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee)
...
(cherry picked from commit 9ad708a0df
)
2015-11-11 16:35:46 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
2bd64879f4
YARN-4183. Reverting the patch to fix behaviour change.
...
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"
This reverts commit 3287a50cfe
.
2015-11-11 10:46:32 -08:00
Tsuyoshi Ozawa
ba7b5f3a5d
Updated CHANGES.txt to move HADOOP-12526 to 2.6.3.
...
(cherry picked from commit f6cecbfce5
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2015-11-11 23:23:14 +09:00