Commit Graph

9100 Commits

Author SHA1 Message Date
Jason Lowe dbed88237c HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe
(cherry picked from commit cdf8895259)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-14 23:52:10 +00:00
Jason Lowe 4976aac46e HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma)
(cherry picked from commit 8e1bdc17d9)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-14 23:34:29 +00:00
Arpit Agarwal 6cd5fcb634 HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:19:51 -08:00
Yongjun Zhang 7a550db931 HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit 817cc1f02a)
2016-01-14 12:45:42 -08:00
Kihwal Lee a90dcb0865 Fix up CHANGES.txt 2016-01-14 09:58:35 -06:00
Junping Du c2d1d69525 Fix yarn CHANGES.txt entry for 2.7.2 2016-01-14 06:17:42 -08:00
Junping Du 0e0272f120 Add missing CHANGES.txt entry for HDFS-8767.
(cherry picked from commit e50dd19a9c)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit 62eabec549)
2016-01-14 06:14:56 -08:00
Akira Ajisaka b1ee278428 MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt.
(cherry picked from commit 7b0964f354)
(cherry picked from commit 6efee8907a)
2016-01-14 10:42:02 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) f93f912969 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
Putting CHANGES.txt entry under 2.6.3 after the backport.

(cherry picked from commit e3e09aa1e7)
2016-01-13 15:08:13 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) faebc20e26 HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753da)
2016-01-13 14:56:58 -08:00
Kihwal Lee 83a4791243 HDFS-9047. Retire libwebhdfs. 2016-01-13 11:01:35 -06:00
Yongjun Zhang 4c09a75f3e HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang)
(cherry picked from commit 25051c3bd0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
2016-01-12 09:40:56 -08:00
Jason Lowe 4b829c41ce YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
(cherry picked from commit 13de8359a1)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-01-12 15:59:14 +00:00
Jason Lowe a30b8ef59e YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti
(cherry picked from commit 62e583c7dc)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-01-12 15:04:43 +00:00
Jason Lowe fec437ac31 Add MR-5982 and MR-6492 to 2.6.4
(cherry picked from commit e5df366707)
2016-01-11 18:33:47 +00:00
Kihwal Lee b06e39de4f HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 2016-01-08 11:31:49 -06:00
Vinayakumar B 5dc5bb2812 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang)
(cherry picked from commit 34cd7cd765)
(cherry picked from commit aa710bd461)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DecommissionManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java
2016-01-07 11:50:12 +05:30
Junping Du 258ef9f9c3 YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe.
(cherry picked from commit c1462a67ff)
(cherry picked from commit 1cc001db4c)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestSchedulerApplicationAttempt.java
2016-01-06 06:18:19 -08:00
Sangjin Lee 28fd4c70ca MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee)
(cherry picked from commit f6f16118d3)
2016-01-05 16:01:09 -08:00
Akira Ajisaka 68c68e187f Set release date for 2.6.3
(cherry picked from commit db99e30f67)
(cherry picked from commit 247ab92464)
2016-01-04 16:14:30 +09:00
Akira Ajisaka 3a1c98bba3 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki.
(cherry picked from commit 64ae85fd2e)
(cherry picked from commit d98cfe611f)
2016-01-04 14:35:54 +09:00
Kihwal Lee cdf9f1c662 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 2015-12-28 10:57:31 -06:00
Haohui Mai e0e5a0fa82 HDFS-8914. Document HA support in the HDFS HdfsDesign.md. Contributed by Lars Francke.
(cherry picked from commit 049ccf71ce)
2015-12-21 21:44:46 +09:00
Akira Ajisaka 5ffad1551b HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki.
(cherry picked from commit fa544020f6)
(cherry picked from commit 7526a2a005)
2015-12-21 21:27:28 +09:00
Akira Ajisaka e94a8aea57 MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki.
(cherry picked from commit 7995a6ea4d)
(cherry picked from commit 8607cb6074)
2015-12-21 00:19:11 +09:00
Junping Du 803fdc9f5e Creating 2.6.4 entries in CHANGES.txt files.
(cherry picked from commit 028894281b)

(cherry picked from commit 092c469059)
2015-12-18 14:24:51 +09:00
Akira Ajisaka eed00804a7 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki.
(cherry picked from commit bd5e207432)
(cherry picked from commit e06c291245)
2015-12-18 13:13:30 +09:00
Kihwal Lee 03292b234e HDFS-9533. seen_txid in the shared edits directory is modified during bootstrapping. Contributed by Kihwal Lee.
(cherry picked from commit 5cb1e0118b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java
(cherry picked from commit 3c0ae5914c)
2015-12-17 17:28:24 -06:00
cnauroth 56882e7b1c Revert "HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang."
This reverts commit 4d2ee51c52.
2015-12-17 13:49:47 -08:00
Kihwal Lee 4d2ee51c52 HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang.
(cherry picked from commit eb6939cea0)
2015-12-17 10:33:15 -06:00
Junping Du face83775b YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.
(cherry picked from commit 50bd067e1d)
(cherry picked from commit 1a2ef845b5)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java
(cherry picked from commit 0f9dd48842)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2015-12-17 06:07:50 -08:00
Plamen Jeliazkov d97696e4c4 HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov. 2015-12-17 00:09:48 -08:00
Vinod Kumar Vavilapalli cab5d86738 Revert "MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev"
This reverts commit ba02e8f6d1.
2015-12-16 15:17:01 -08:00
Vinod Kumar Vavilapalli 7b3f027ed4 HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos)
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62)
2015-12-16 14:43:20 -08:00
Tom Zeng 6c62d422d6 HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
(cherry picked from commit b4c6b511e7)
2015-12-16 14:27:30 -08:00
Zhihai Xu e1a2f9e6e0 Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE
(cherry picked from commit 7092d47fc0)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
2015-12-15 22:27:32 -08:00
Jason Lowe 8ab642989c YARN-4439. Clarify NMContainerStatus#toString method. Contributed by Jian He 2015-12-15 18:06:13 +00:00
Jason Lowe 97a20ff2c6 Revert "YARN-4439. Clarify NMContainerStatus#toString method. Contributed by"
This reverts commit 1507d30bc1.

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2015-12-15 17:59:45 +00:00
Zhihai Xu 35a5b8929e MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki
(cherry picked from commit 5b7078d069)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-12-15 01:24:03 -08:00
Xuan 1507d30bc1 YARN-4439. Clarify NMContainerStatus#toString method. Contributed by
Jian He

(cherry picked from commit d8a45425eb)
(cherry picked from commit 992f65dd8b)
2015-12-14 15:42:38 -08:00
Kihwal Lee a02312546a HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su.
(cherry picked from commit a48301791e)
2015-12-11 08:47:22 -06:00
Akira Ajisaka 02f666b324 HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki.
(cherry picked from commit eee0cf4611)
(cherry picked from commit 5047ee56af)
2015-12-11 16:19:28 +09:00
Akira Ajisaka c9be259f26 YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang.
(cherry picked from commit 16dc65811d4e0e7ab61c61295149848fe53ddd89)
(cherry picked from commit 925bb94d87db7e916ed380d4512225e796f9e03d)
2015-12-09 16:26:58 +09:00
Wangda Tan fd18377255 YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)
(cherry picked from commit 7e4715186d)

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 7013f9d6cd)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-12-08 14:31:31 -08:00
Vinod Kumar Vavilapalli 067d14f503 HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:36:15 -08:00
cnauroth e23ab9d02b HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen.
(cherry picked from commit 1b525a9c32)
(cherry picked from commit faf1c60899)
2015-12-08 11:22:19 -08:00
Tsuyoshi Ozawa 0460b8a8a3 YARN-4348. ZKRMStateStore.syncInternal shouldn't wait for sync completion for avoiding blocking ZK's event thread. (ozawa) 2015-12-08 13:33:10 +09:00
Xuan ba02e8f6d1 MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
(cherry picked from commit fc470840a0)
(cherry picked from commit 3b10ff6a6f)
2015-12-07 14:18:26 -08:00
Jonathan Eagles 22be47d747 YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)
(cherry picked from commit 4ff973f96a)
2015-12-07 15:09:54 -06:00
Zhe Zhang 670617f325 HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. Contributed by Xiao Chen.
Change-Id: Idf99293085531165239369155c039b55db0eed83
2015-12-04 09:49:43 -08:00