Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,592 Commits 326 Branches 371 Tags
Commit Graph

10592 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Zhe Zhang
87d614c70b HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng. 
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
 2016-01-11 09:57:01 -08:00
Junping Du
d7e10f8174 MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang. 
(cherry picked from commit 8c1adeaa26a7eaaca891dccdb71ff085e598a7de)
(cherry picked from commit 51073c910ccdfaa07f7b8dab290617b56e4d86b7)
 2016-01-11 06:14:58 -08:00
cnauroth
e26f702866 HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth. 
(cherry picked from commit 0e76f1fceaaaeb66bdb4818f43b9a55fc092bf79)
(cherry picked from commit 813841e10bf9ac30481852bb5aeacc98921bb41c)
 2016-01-09 22:18:30 -08:00
cnauroth
f0f8e3ee7c HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f0fa6d869b9abb5a900ea1c9eb4eb19ec9831dc4)
(cherry picked from commit debd13387daad868de466586370846c32040b7ad)
 2016-01-08 20:19:18 -08:00
Jian He
17d29b515f YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S 
(cherry picked from commit 109e528ef5d8df07443373751266b4417acc981a)
 2016-01-08 15:52:03 -08:00
Zhe Zhang
eef26388ca HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen. 
Change-Id: I5cee398dfc361121d8b666ffd1203cc14a4ace24
 2016-01-08 13:20:02 -08:00
Kihwal Lee
d1cbc8442c HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee. 
(cherry picked from commit 38c4c14472996562eb3d610649246770c2888c6b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-01-08 11:16:40 -06:00
Akira Ajisaka
852033ca62 YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi. 
(cherry picked from commit 52b77577c44538c26fb9d0144f0b280be3593a38)
(cherry picked from commit 3905435d3d592b980425169bf1355d3d2b5c616f)
 2016-01-08 01:13:44 +09:00
Steve Loughran
092901345e HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:36 +00:00
Vinayakumar B
3303326dd9 HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang) 
(cherry picked from commit 6702e7d66a4949a40bcdbd9f51ca1e746c8991e1)
(cherry picked from commit 08f39bd5d1b86db9a0efa84901408a615309bf48)
 2016-01-07 14:21:18 +05:30
Vinayakumar B
a14baa05b0 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang) 
(cherry picked from commit 34cd7cd76505d01ec251e30837c94ab03319a0c1)
(cherry picked from commit aa710bd461b593b0f3d7d7ac41ca68e1aa3fa9d6)
 2016-01-07 12:11:55 +05:30
Haohui Mai
bb6f03d597 HDFS-9047. Retire libwebhdfs. Contributed by Haohui Mai. 2016-01-06 16:39:51 -08:00
cnauroth
506a517f9f HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade. 
(cherry picked from commit 978bbdfeb2d12efd6e750da6a14849e072fb814b)
(cherry picked from commit 4753676a34c4a3de29f9d20281de09533b73ce53)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-06 11:17:01 -08:00
Sangjin Lee
ae535ec93e MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee) 
(cherry picked from commit f6f16118d38fcfe3b724f05fad752cb223f441ec)
(cherry picked from commit 28fd4c70cab27c2872dc6a63ddee223ccf53f21d)
 2016-01-06 08:44:37 -08:00
Junping Du
49ba43e05b YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe. 
(cherry picked from commit c1462a67ff7bb632df50e1c52de971cced56c6a3)
(cherry picked from commit 1cc001db4c3767072b5d065d161bc5c6d1c480d4)
 2016-01-06 05:52:21 -08:00
Haohui Mai
6dcf3cb6a1 HDFS-9605. Add links to failed volumes to explorer.html in HDFS Web UI. Contributed by Archana T. 2016-01-05 13:56:18 -08:00
Haohui Mai
2aa99e6df0 HDFS-7779. Support changing ownership, group and replication in HDFS Web UI. Contributed by Ravi Prakash. 2016-01-05 13:45:10 -08:00
Yongjun Zhang
f372d3faae HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang) 
(cherry picked from commit 28bd138018bea6fc9c3bfb94c7a4143420f02ced)
 2016-01-05 11:19:39 -08:00
Uma Mahesh
68ee13e4f5 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 
(cherry picked from commit 778146eaae5b1e17928a1f26fb1e46536a6ee510)
 2016-01-04 15:14:14 -08:00
Akira Ajisaka
a319df412f HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi. 
(cherry picked from commit 1af2917856f8da3ad76bb6cbbc511627a647e091)
(cherry picked from commit 40b41ac8fc1aed679d2cd45794c4fb47bdafa9b2)
 2016-01-04 20:33:57 +09:00
Akira Ajisaka
5daa07481e MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE. Contributed by Naganarasimha G R. 
(cherry picked from commit 7dafee11d865c7c121c7886ac66aa9d088ea13f7)
(cherry picked from commit 6d235f0b91b9ba3041f5465f480278c33f01bd36)
 2016-01-04 16:31:42 +09:00
Akira Ajisaka
22ac1a1ac0 Set release date for 2.6.3 
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
 2016-01-04 16:13:06 +09:00
Akira Ajisaka
13a48f6256 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2ea91f46ab3b21f007befbeef8c3c947)
(cherry picked from commit d98cfe611f7cedc58cdecfb5a83829adb2521138)
 2016-01-04 14:32:21 +09:00
Wangda Tan
8c3ad2b734 YARN-4510. Fix SLS startup failure caused by NPE. (Bibin A Chundatt via wangda) 
(cherry picked from commit 6eefae1b33928486e7a8572e14eaf00b83f2acfc)
 2015-12-30 15:42:27 -08:00
Xiaoyu Yao
c16e126d16 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth. 
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
 2015-12-30 11:16:06 -08:00
Xiaoyu Yao
a48fdc1907 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit ab725cff66e8a047e9437e42ac49ac8685ee7a94)
 2015-12-30 10:44:13 -08:00
Junping Du
a5eb8bb8f5 YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S. 
(cherry picked from commit 223ce323bb81463ec5c5ac7316738370d4a47366)
(cherry picked from commit 401d1e6e8af93557723e4afbb58f14ea0b3a30a8)
 2015-12-30 07:53:55 -08:00
Jian He
9b11e7bd6d YARN-4098. Document ApplicationPriority feature. Contributed by Rohith Sharma K S 2015-12-29 16:52:30 -08:00
Wangda Tan
c7fe0bac77 YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda) 
(cherry picked from commit 561abb9fee5f57f74c2b5868a065b818678622fa)
(cherry picked from commit 3efbde5378d73667b3fb53be656ccf108f6dd2fb)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-29 13:31:43 -08:00
cnauroth
6d9f210c4d HDFS-7553. fix the TestDFSUpgradeWithHA due to BindException. Contributed by Xiao Chen. 
(cherry picked from commit 1f8162b74eddd849c7949ac64acf729c208b8af9)
 2015-12-29 10:57:30 -08:00
Akira Ajisaka
2139458a98 MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka) 
(cherry picked from commit 2a59d01503ed547bac15443fc273b5e04a2839d9)
(cherry picked from commit a8314505d0c7fa4a3748bef4c156095bdfdd3fc0)
 2015-12-30 01:34:26 +09:00
Akira Ajisaka
7063d8d013 MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka) 
(cherry picked from commit 1a06949126df84ffed703547a88beee5ff0bec83)
 2015-12-30 01:04:40 +09:00
Wangda Tan
aa85ce73de MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda) 
(cherry picked from commit 32b3dc11eba8f2d8f22ca502bf30d6aa8839460e)
(cherry picked from commit ca575e6addb801accafa7e3a6dad08d75cf79bdc)
 2015-12-28 11:08:31 -08:00
Xiaoyu Yao
beec7a2efb HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang. 
(cherry picked from commit 993311e547e6dd7757025d5ffc285019bd4fc1f6)
 2015-12-28 10:47:20 -08:00
Akira Ajisaka
c60792e6e5 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki. 
(cherry picked from commit babe025fb0a5c0e2822bdb6766fa8b3f71f5f7e6)
 2015-12-28 14:39:51 +09:00
Tsuyoshi Ozawa
4db6808f38 YARN-4234. addendum patch to remove unnecessary file. Contributed by Masatake Iwasaki. 
(cherry picked from commit 65537845a9799c6a73eecccb4cd437def58459d8)
(cherry picked from commit c6e0f645827b1ff1ea3c305f13112dfc9a24fbd8)
 2015-12-24 19:54:22 +09:00
Rohith Sharma K S
550840f402 MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit a308e86621b1a7692fe1004ed14c919fdaba03cd)
 2015-12-24 12:02:53 +05:30
Junping Du
ce74b17028 YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton. 
(cherry picked from commit bb5df272b9c0be9830ee8480cd33e75d26deb9d1)
(cherry picked from commit dbc4c79b446564502c62c51ce65096bd1b605e89)
 2015-12-23 08:56:37 -08:00
Junping Du
630b637ff3 YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong. 
(cherry picked from commit 882f2f04644a13cadb93070d5545f7a4f8691fde)
(cherry picked from commit 6e97a3c9686b847e6047e12b7e53a8316e2bebfa)
 2015-12-23 05:31:16 -08:00
Kihwal Lee
263c544021 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 
(cherry picked from commit 867048c3e4b20ece0039a876def129fa5eb9234f)
(cherry picked from commit 131260f0a7e8480e03b20d6e6327d8b468a9313d)
 2015-12-22 14:20:10 -06:00
cnauroth
8fad4c780a HDFS-9458. TestBackupNode always binds to port 50070, which can cause bind failures. Contributed by Xiao Chen. 
(cherry picked from commit 5c0ff69618fa303078c0f9afef4c93a864ab6cb7)
(cherry picked from commit 9b039a5004685d61375a7c0d40de95e4c15ae1d6)
 2015-12-22 10:29:47 -08:00
Colin Patrick Mccabe
9218890c7f HDFS-9589. Block files which have been hardlinked should be duplicated before the DataNode appends to the them (cmccabe) 
(cherry picked from commit bb540ba85aa37d9fe31e640665158afe8a936230)
(cherry picked from commit a56c5ef636413052fec62cee1a38b7e1455e389d)
 2015-12-22 09:39:04 -08:00
Arun Suresh
546178a5de YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh) 
(cherry picked from commit e88422df45550f788ae8dd73aec84bde28012aeb)
 2015-12-21 22:42:42 -08:00
cnauroth
eb5f46e34f YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri. 
(cherry picked from commit 114b59095540bb80db5153c816f9d285e4029031)
(cherry picked from commit fdfcffb3d1054ae9587a66e4919a0bb10720df55)
 2015-12-21 16:59:24 -08:00
Wangda Tan
e507ed1f90 YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda) 
(cherry picked from commit a0de7028515eebe1c526cc42808cdbc8ed6b4e2a)
 2015-12-21 11:38:15 -08:00
Wangda Tan
01c813d210 YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda) 
(cherry picked from commit bc038b382cb2ce561ce718405fbcee4382f3b204)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-21 11:31:54 -08:00
Akira Ajisaka
4254ca9898 Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt. 
(cherry picked from commit 2cb5afffc4c546e3d0d0f68a921905967047b0e0)
(cherry picked from commit 12caea3274f42d6218149d17cd68c687905cc669)
 2015-12-21 21:53:53 +09:00
Akira Ajisaka
1cd85efd71 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 
(cherry picked from commit fa544020f6f71ee993f047c9b986c047a25ed84c)
(cherry picked from commit 7526a2a005621e2d1d5eed6561fcd1b05ad20037)
 2015-12-21 21:23:40 +09:00
Akira Ajisaka
5f34cbff5c MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki. 
(cherry picked from commit 7995a6ea4dc524e5b17606359d09df72d771224a)
(cherry picked from commit 8607cb6074b40733d8990618a44c490f9f303ae3)
 2015-12-21 00:18:40 +09:00
Uma Mahesh
6f30919336 YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh) 
(cherry picked from commit 0f82b5d878a76b1626c9e07b2fbb55ce2a79232a)
 2015-12-19 23:28:51 -08:00