Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,793 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

10793 Commits

Author SHA1 Message Date
Jason Lowe bf6d50cda3 Add MR-5982 and MR-6492 to 2.6.4 
(cherry picked from commit e5df366707)
 2016-01-11 18:33:25 +00:00
Zhe Zhang 87d614c70b HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng. 
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
 2016-01-11 09:57:01 -08:00
Junping Du d7e10f8174 MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang. 
(cherry picked from commit 8c1adeaa26)
(cherry picked from commit 51073c910c)
 2016-01-11 06:14:58 -08:00
cnauroth e26f702866 HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth. 
(cherry picked from commit 0e76f1fcea)
(cherry picked from commit 813841e10b)
 2016-01-09 22:18:30 -08:00
cnauroth f0f8e3ee7c HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f0fa6d869b)
(cherry picked from commit debd13387d)
 2016-01-08 20:19:18 -08:00
Jian He 17d29b515f YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S 
(cherry picked from commit 109e528ef5)
 2016-01-08 15:52:03 -08:00
Zhe Zhang eef26388ca HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen. 
Change-Id: I5cee398dfc361121d8b666ffd1203cc14a4ace24
 2016-01-08 13:20:02 -08:00
Kihwal Lee d1cbc8442c HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 
(cherry picked from commit 38c4c14472)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-01-08 11:16:40 -06:00
Akira Ajisaka 852033ca62 YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi. 
(cherry picked from commit 52b77577c4)
(cherry picked from commit 3905435d3d)
 2016-01-08 01:13:44 +09:00
Steve Loughran 092901345e HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:36 +00:00
Vinayakumar B 3303326dd9 HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang) 
(cherry picked from commit 6702e7d66a)
(cherry picked from commit 08f39bd5d1)
 2016-01-07 14:21:18 +05:30
Vinayakumar B a14baa05b0 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 
(cherry picked from commit 34cd7cd765)
(cherry picked from commit aa710bd461)
 2016-01-07 12:11:55 +05:30
Haohui Mai bb6f03d597 HDFS-9047. Retire libwebhdfs. Contributed by Haohui Mai. 2016-01-06 16:39:51 -08:00
cnauroth 506a517f9f HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade. 
(cherry picked from commit 978bbdfeb2)
(cherry picked from commit 4753676a34)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-06 11:17:01 -08:00
Sangjin Lee ae535ec93e MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee) 
(cherry picked from commit f6f16118d3)
(cherry picked from commit 28fd4c70ca)
 2016-01-06 08:44:37 -08:00
Junping Du 49ba43e05b YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe. 
(cherry picked from commit c1462a67ff)
(cherry picked from commit 1cc001db4c)
 2016-01-06 05:52:21 -08:00
Haohui Mai 6dcf3cb6a1 HDFS-9605. Add links to failed volumes to explorer.html in HDFS Web UI. Contributed by Archana T. 2016-01-05 13:56:18 -08:00
Haohui Mai 2aa99e6df0 HDFS-7779. Support changing ownership, group and replication in HDFS Web UI. Contributed by Ravi Prakash. 2016-01-05 13:45:10 -08:00
Yongjun Zhang f372d3faae HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang) 
(cherry picked from commit 28bd138018)
 2016-01-05 11:19:39 -08:00
Uma Mahesh 68ee13e4f5 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 
(cherry picked from commit 778146eaae)
 2016-01-04 15:14:14 -08:00
Akira Ajisaka a319df412f HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi. 
(cherry picked from commit 1af2917856)
(cherry picked from commit 40b41ac8fc)
 2016-01-04 20:33:57 +09:00
Akira Ajisaka 5daa07481e MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE. Contributed by Naganarasimha G R. 
(cherry picked from commit 7dafee11d8)
(cherry picked from commit 6d235f0b91)
 2016-01-04 16:31:42 +09:00
Akira Ajisaka 22ac1a1ac0 Set release date for 2.6.3 
(cherry picked from commit db99e30f67)
(cherry picked from commit 247ab92464)
 2016-01-04 16:13:06 +09:00
Akira Ajisaka 13a48f6256 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2e)
(cherry picked from commit d98cfe611f)
 2016-01-04 14:32:21 +09:00
Wangda Tan 8c3ad2b734 YARN-4510. Fix SLS startup failure caused by NPE. (Bibin A Chundatt via wangda) 
(cherry picked from commit 6eefae1b33)
 2015-12-30 15:42:27 -08:00
Xiaoyu Yao c16e126d16 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth. 
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
 2015-12-30 11:16:06 -08:00
Xiaoyu Yao a48fdc1907 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit ab725cff66)
 2015-12-30 10:44:13 -08:00
Junping Du a5eb8bb8f5 YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S. 
(cherry picked from commit 223ce323bb)
(cherry picked from commit 401d1e6e8a)
 2015-12-30 07:53:55 -08:00
Jian He 9b11e7bd6d YARN-4098. Document ApplicationPriority feature. Contributed by Rohith Sharma K S 2015-12-29 16:52:30 -08:00
Wangda Tan c7fe0bac77 YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda) 
(cherry picked from commit 561abb9fee)
(cherry picked from commit 3efbde5378)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-29 13:31:43 -08:00
cnauroth 6d9f210c4d HDFS-7553. fix the TestDFSUpgradeWithHA due to BindException. Contributed by Xiao Chen. 
(cherry picked from commit 1f8162b74e)
 2015-12-29 10:57:30 -08:00
Akira Ajisaka 2139458a98 MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka) 
(cherry picked from commit 2a59d01503)
(cherry picked from commit a8314505d0)
 2015-12-30 01:34:26 +09:00
Akira Ajisaka 7063d8d013 MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka) 
(cherry picked from commit 1a06949126)
 2015-12-30 01:04:40 +09:00
Wangda Tan aa85ce73de MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda) 
(cherry picked from commit 32b3dc11eb)
(cherry picked from commit ca575e6add)
 2015-12-28 11:08:31 -08:00
Xiaoyu Yao beec7a2efb HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang. 
(cherry picked from commit 993311e547)
 2015-12-28 10:47:20 -08:00
Akira Ajisaka c60792e6e5 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki. 
(cherry picked from commit babe025fb0)
 2015-12-28 14:39:51 +09:00
Tsuyoshi Ozawa 4db6808f38 YARN-4234. addendum patch to remove unnecessary file. Contributed by Masatake Iwasaki. 
(cherry picked from commit 65537845a9)
(cherry picked from commit c6e0f64582)
 2015-12-24 19:54:22 +09:00
Rohith Sharma K S 550840f402 MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit a308e86621)
 2015-12-24 12:02:53 +05:30
Junping Du ce74b17028 YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton. 
(cherry picked from commit bb5df272b9)
(cherry picked from commit dbc4c79b44)
 2015-12-23 08:56:37 -08:00
Junping Du 630b637ff3 YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong. 
(cherry picked from commit 882f2f0464)
(cherry picked from commit 6e97a3c968)
 2015-12-23 05:31:16 -08:00
Kihwal Lee 263c544021 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 
(cherry picked from commit 867048c3e4)
(cherry picked from commit 131260f0a7)
 2015-12-22 14:20:10 -06:00
cnauroth 8fad4c780a HDFS-9458. TestBackupNode always binds to port 50070, which can cause bind failures. Contributed by Xiao Chen. 
(cherry picked from commit 5c0ff69618)
(cherry picked from commit 9b039a5004)
 2015-12-22 10:29:47 -08:00
Colin Patrick Mccabe 9218890c7f HDFS-9589. Block files which have been hardlinked should be duplicated before the DataNode appends to the them (cmccabe) 
(cherry picked from commit bb540ba85a)
(cherry picked from commit a56c5ef636)
 2015-12-22 09:39:04 -08:00
Arun Suresh 546178a5de YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh) 
(cherry picked from commit e88422df45)
 2015-12-21 22:42:42 -08:00
cnauroth eb5f46e34f YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri. 
(cherry picked from commit 114b590955)
(cherry picked from commit fdfcffb3d1)
 2015-12-21 16:59:24 -08:00
Wangda Tan e507ed1f90 YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda) 
(cherry picked from commit a0de702851)
 2015-12-21 11:38:15 -08:00
Wangda Tan 01c813d210 YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda) 
(cherry picked from commit bc038b382c)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-21 11:31:54 -08:00
Akira Ajisaka 4254ca9898 Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt. 
(cherry picked from commit 2cb5afffc4)
(cherry picked from commit 12caea3274)
 2015-12-21 21:53:53 +09:00
Akira Ajisaka 1cd85efd71 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 
(cherry picked from commit fa544020f6)
(cherry picked from commit 7526a2a005)
 2015-12-21 21:23:40 +09:00
Akira Ajisaka 5f34cbff5c MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki. 
(cherry picked from commit 7995a6ea4d)
(cherry picked from commit 8607cb6074)
 2015-12-21 00:18:40 +09:00