Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,631 Commits 326 Branches 371 Tags
Commit Graph

10631 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ravi Prakash
5468c40fe7 HADOOP-12689. S3 filesystem operations stopped working correctly 
(cherry picked from commit 2d16f40dab291a29b3fc005221b12fd587615d4e)
(cherry picked from commit 6330683778d684d539ae756226f62728776cc1d7)
 2016-01-15 15:19:15 -08:00
Yongjun Zhang
4c8131b1bf HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit a9c69ebeb707801071db3cc22bfcd14f87be443a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-01-15 10:12:15 -08:00
rohithsharmaks
9baeae9368 YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks) 
(cherry picked from commit d3c08cde68cbf31c7fc7b479be1da10072363ac0)
 2016-01-15 22:48:43 +05:30
Jason Lowe
de31bff67d MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt 
(cherry picked from commit 9fbd579ab50f051c8ad63d316ca5a3e24822dcdd)
 2016-01-15 16:54:03 +00:00
Junping Du
a03532e04e YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee. 
(cherry picked from commit fc6d3a3b234efff2b0b646c31a4e6ff0a5118ef9)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
(cherry picked from commit e09222306f65227d14fe1e656102d225b232409c)
 2016-01-15 08:53:48 -08:00
Akira Ajisaka
8a23379283 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge. 
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit f0b1b531734bf0699f48ba0bd00ddc9a0a821493)
 2016-01-15 10:58:20 +09:00
Akira Ajisaka
91c1736b7a Correct the section of HADOOP-12590 in CHANGES.txt. 2016-01-15 10:53:16 +09:00
Steve Loughran
1fc36b824c HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel) 
(cherry picked from commit 80734bc346e8d339a2427b4f691365298acf062c)
 2016-01-15 10:41:56 +09:00
Jason Lowe
4ab508ead4 HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe 
(cherry picked from commit cdf88952599a43b1ef5adda792bfb195c7529fad)
 2016-01-14 23:48:12 +00:00
Jason Lowe
fe77cb1df0 Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6 
(cherry picked from commit 651c23e8ef8aeafd999249ce57b31e689bd2ece6)
 2016-01-14 23:43:09 +00:00
Benoy Antony
6cfeb84a36 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 2016-01-14 14:42:04 -08:00
Benoy Antony
6ceee07357 HDFS-9597. BaseReplicationPolicyTest should update data node stats after adding a data node. Contributed by Wei-Chiu Chuang. 2016-01-14 14:42:04 -08:00
Benoy Antony
5a50651e5b HDFS-9034. StorageTypeStats Metric should not count failed storage. Contributed by Surendra Singh Lilhore. 2016-01-14 14:42:04 -08:00
Arpit Agarwal
3266709b5d HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:18:21 -08:00
Yongjun Zhang
f2eea3a1b4 HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 817cc1f02a60ef4e372171415058fdc76c0d2e39)
 2016-01-14 13:06:23 -08:00
Yongjun Zhang
a7d33b934a Revert "HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge." 
This reverts commit b3fa190297cf81d909adb2aeca2868b4fc77c9e9.
 2016-01-14 13:06:03 -08:00
Akira Ajisaka
6816481c72 MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. Contributed by Kai Sasaki. 
(cherry picked from commit 5cc44d18aa946ce2a7a9ffbd7bcce57b07e9e1cb)
(cherry picked from commit 7c4be1599152b29d329b4e61c21a935aa234d5a9)
 2016-01-15 00:44:52 +09:00
Akira Ajisaka
b3fa190297 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge. 
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit 722d9e569ee6891e71274e758474063f25f5babf)
 2016-01-15 00:32:07 +09:00
Akira Ajisaka
4417c3b6d2 YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun. 
(cherry picked from commit 62b0d6151362a9860d4d750e6e0d032882af68aa)
(cherry picked from commit ffca0ebfff7fa6d0e6878801da01dfdbe1ed770a)
 2016-01-14 14:00:18 +09:00
Akira Ajisaka
d4d368d4e8 MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt. 
(cherry picked from commit 7b0964f354e90968c2dac2f7acc17214732aed64)
(cherry picked from commit 6efee8907af3f21d8526927cf5e676d9922b686b)
 2016-01-14 10:41:45 +09:00
Lei Xu
894345e2f0 HDFS-9493. Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk. (Tony Wu via lei) 
(cherry picked from commit fd8065a763ff68db265ef23a7d4f97558e213ef9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestMetaSave.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManagerTestUtil.java
 2016-01-13 16:34:13 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
e3e09aa1e7 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
Putting CHANGES.txt entry under 2.6.3 after the backport.
 2016-01-13 15:05:43 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
7eb63d4e7c HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa) 
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753dab836105247945392ad4e43695a50bc)
 2016-01-13 14:56:35 -08:00
Kihwal Lee
8df0db3d18 Supplement to HDFS-9047. 
(cherry picked from commit c722b62908984f8fb6ab2e0bfd40c090e8c830c7)
 2016-01-13 11:09:50 -06:00
Jason Lowe
a22a7f61e4 MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla 
(cherry picked from commit f657b54281d517c69df0a23b97b47befa77d1dc2)
 2016-01-12 23:59:06 +00:00
cnauroth
c3f4cb927a HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
(cherry picked from commit 2605e78e44493a99a466a9264bf47f44176811ba)
 2016-01-12 15:42:00 -08:00
Lei Xu
39f07295fb HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) 
(cherry picked from commit 126705f67eaa6d866f7572fbddf133c5d7552353)
 2016-01-12 12:21:00 -08:00
Yongjun Zhang
6650387bfb HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang) 
(cherry picked from commit 25051c3bd08efc12333a6acb51782cc7800403a4)
 2016-01-12 09:23:40 -08:00
Jason Lowe
a8292161fc YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li 
(cherry picked from commit 13de8359a1c6d9fc78cd5013c860c1086d86176f)
 2016-01-12 15:57:44 +00:00
Jason Lowe
7c419bc9e5 Update CHANGES.txt for recent commits to 2.7 and 2.6 
(cherry picked from commit c77c35f83ce953005fe0d3334acf0f0013a82139)
 2016-01-12 15:45:37 +00:00
Wangda Tan
00fca06b43 YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda) 
(cherry picked from commit 9e792da01419998c2ebfafd7161070150d85d3ac)
 2016-01-12 12:56:12 +08:00
Akira Ajisaka
3fced13eae HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
(cherry picked from commit 6f80be98758ff5d53a192f86ada6cc4062fcdef8)
 2016-01-12 13:35:03 +09:00
Xiaoyu Yao
74c05e5359 Correct commit message for HDFS-9584 
(cherry picked from commit 103d3cfc4ee1ac21970fd6bbca54bb085ab771ba)
 2016-01-11 19:01:11 -08:00
Xiaoyu Yao
a9cbfd717c HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit c2e2e134555010ec28da296bcfef4ba2613a5c6c)
 2016-01-11 17:16:43 -08:00
Jian He
8172921f6d Missing file for YARN-4580 2016-01-11 17:00:17 -08:00
Jian He
e73bf71e10 YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S 
(cherry picked from commit b8942be888e1f6f7049398f3d0322602a58ee312)
 2016-01-11 16:45:48 -08:00
Arpit Agarwal
319c71b89b HDFS-9639. Fix up CHANGES.txt 2016-01-11 15:11:30 -08:00
Arpit Agarwal
476f7d0be3 HDFS-9639. Inconsistent Logging in BootstrapStandby. (Contributed by Xiaobing Zhou) 2016-01-11 15:10:21 -08:00
Jason Lowe
bf6d50cda3 Add MR-5982 and MR-6492 to 2.6.4 
(cherry picked from commit e5df366707e326d869f72db03b08228b33ff6e46)
 2016-01-11 18:33:25 +00:00
Zhe Zhang
87d614c70b HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng. 
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
 2016-01-11 09:57:01 -08:00
Junping Du
d7e10f8174 MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang. 
(cherry picked from commit 8c1adeaa26a7eaaca891dccdb71ff085e598a7de)
(cherry picked from commit 51073c910ccdfaa07f7b8dab290617b56e4d86b7)
 2016-01-11 06:14:58 -08:00
cnauroth
e26f702866 HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth. 
(cherry picked from commit 0e76f1fceaaaeb66bdb4818f43b9a55fc092bf79)
(cherry picked from commit 813841e10bf9ac30481852bb5aeacc98921bb41c)
 2016-01-09 22:18:30 -08:00
cnauroth
f0f8e3ee7c HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f0fa6d869b9abb5a900ea1c9eb4eb19ec9831dc4)
(cherry picked from commit debd13387daad868de466586370846c32040b7ad)
 2016-01-08 20:19:18 -08:00
Jian He
17d29b515f YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S 
(cherry picked from commit 109e528ef5d8df07443373751266b4417acc981a)
 2016-01-08 15:52:03 -08:00
Zhe Zhang
eef26388ca HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen. 
Change-Id: I5cee398dfc361121d8b666ffd1203cc14a4ace24
 2016-01-08 13:20:02 -08:00
Kihwal Lee
d1cbc8442c HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 
(cherry picked from commit 38c4c14472996562eb3d610649246770c2888c6b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-01-08 11:16:40 -06:00
Akira Ajisaka
852033ca62 YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi. 
(cherry picked from commit 52b77577c44538c26fb9d0144f0b280be3593a38)
(cherry picked from commit 3905435d3d592b980425169bf1355d3d2b5c616f)
 2016-01-08 01:13:44 +09:00
Steve Loughran
092901345e HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:36 +00:00
Vinayakumar B
3303326dd9 HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang) 
(cherry picked from commit 6702e7d66a4949a40bcdbd9f51ca1e746c8991e1)
(cherry picked from commit 08f39bd5d1b86db9a0efa84901408a615309bf48)
 2016-01-07 14:21:18 +05:30
Vinayakumar B
a14baa05b0 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 
(cherry picked from commit 34cd7cd76505d01ec251e30837c94ab03319a0c1)
(cherry picked from commit aa710bd461b593b0f3d7d7ac41ca68e1aa3fa9d6)
 2016-01-07 12:11:55 +05:30