Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,619 Commits 326 Branches 371 Tags
Commit Graph

11619 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jian He
e0f4397232 MAPREDUCE-6197. Cache MapOutputLocations in ShuffleHandler. Contributed by Junping Du 
(cherry picked from commit d8107fcd1c93c202925f2946d0cd4072fe0aef1e)
 2016-06-21 14:26:23 -07:00
Chris Nauroth
e6ebe9ab4e HADOOP-13287. TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains +. Contributed by Chris Nauroth. 
(cherry picked from commit b2c596cdda7c129951074bc53b4b9ecfedbf080a)
 2016-06-21 11:32:11 -07:00
Sangjin Lee
910742ad12 MAPREDUCE-6719. The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state store (Daniel Templeton via sjlee) 
(cherry picked from commit 605b4b61364781fc99ed27035c793153a20d8f71)
 2016-06-21 11:26:55 -07:00
Akira Ajisaka
65b4f2682e HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton. 
(cherry picked from commit e15cd43369eb6d478844f25897e4a86065c62168)
 2016-06-21 20:17:00 +09:00
Brahma Reddy Battula
ee0f389ecd HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 
(cherry picked from commit f2ac132d6a21c215093b7f87acf2843ac8123716)
 2016-06-21 15:44:45 +05:30
Colin Patrick Mccabe
4e11f33ccc HDFS-10448. CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 (Yiqun Lin via cmccabe) 
(cherry picked from commit 46f1602e896273b308fbd5df6c75f6c142828227)
 2016-06-20 18:31:40 -07:00
Colin Patrick Mccabe
0914658eb8 HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe) 
(cherry picked from commit 5f6b4157a40e974ccc6a56c39dbd35c54f393fbd)
 2016-06-20 18:12:41 -07:00
Jitendra Pandey
f2ef1145c5 HDFS-10538. Remove AsyncDistributedFileSystem. Contributed by Xiaobing Zhou and Jitendra Pandey. 2016-06-20 18:04:05 -07:00
Jitendra Pandey
8f93bbcb11 HADOOP-13291. Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented. Contributed by Mingliang Liu. 2016-06-20 16:28:55 -07:00
Colin Patrick Mccabe
14df17383c HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit 8c1f81d4bf424bdc421cf4952b230344e39a7b68)
 2016-06-20 14:30:21 -07:00
Colin Patrick Mccabe
7db1e57cc1 HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe) 
(cherry picked from commit 5370a6ffaec5227c0978f10c86a5811155271933)
 2016-06-20 10:50:30 -07:00
Sangjin Lee
2a79910c22 YARN-4958. The file localization process should allow for wildcards to reduce the application footprint in the state store (Daniel Templeton via sjlee) 
(cherry picked from commit 5107a967fa2558deba11c33a326d4d2e5748f452)
 2016-06-20 10:00:41 -07:00
Akira Ajisaka
39ea0891d2 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde. 
(cherry picked from commit fc6b50cc574e144fd314dea6c11987c6a384bfa6)
 2016-06-20 17:08:02 +09:00
Brahma Reddy Battula
3f27f40503 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:38:18 +05:30
Junping Du
ea4cab2330 YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit d0162f2040a4d98fbac51527dfc9447888cb32ab)
 2016-06-19 17:45:57 -07:00
Arpit Agarwal
bd33cc0179 HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:17:10 -07:00
Chris Nauroth
b726b5c52c Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)" 
This reverts commit a1f913fb6e917f90d9492c78a30b380096ddb3db.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-06-17 23:50:55 -07:00
Karthik Kambatla
25be8105cd YARN-5077. Fix FSLeafQueue#getFairShare() for queues with zero fairshare. (Yufei Gu via kasha) 
(cherry picked from commit 20f2799938c5cad59f59617cdb0f86e137c3c2c0)
 2016-06-17 22:25:04 -07:00
Karthik Kambatla
e9c1155233 YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit. Addendum to fix javac warning. (Arun Suresh via kasha) 
(cherry picked from commit fbbe0bb627c1b5f333eb5d5390e709cc43517420)
 2016-06-17 22:13:18 -07:00
Andrew Wang
94759470b8 Fix hadoop-hdfs-native-client compilation on Windows. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 3ff0510ffdc20e44f06aec591782f8875b686327)
 2016-06-17 15:54:57 -07:00
Chris Nauroth
b9dbef9417 HADOOP-13149. Windows distro build fails on dist-copynativelibs. Contributed by Chris Nauroth. 2016-06-17 15:54:21 -07:00
Xiaoyu Yao
ed5d3a62ce HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao. 
(cherry picked from commit 0761379fe45898c44c8f161834c298ef932e4d8c)
 2016-06-17 15:30:51 -07:00
Kihwal Lee
35c6b725db HDFS-10493. Add links to datanode web UI in namenode datanodes page. Contributed by Weiwei Yang. 
(cherry picked from commit 280069510b71d81a150b2b28d9fa987891d82774)
 2016-06-17 11:12:16 -05:00
Junping Du
6afa044dda YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong. 
(cherry picked from commit c35fa4a0e57b99415e284c7c2f3b1a0bebc610c2)
 2016-06-17 08:25:33 -07:00
Akira Ajisaka
a36aa920f4 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 
(cherry picked from commit 09e82acaf9a6d7663bc51bbca0cdeca4b582b535)
 2016-06-17 16:21:05 +09:00
Xiaoyu Yao
ddf66427ff HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 2016-06-16 20:12:17 -07:00
Akira Ajisaka
1ef89a767d MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 
(cherry picked from commit 51d497fa93d35dec7503eb30b8e3a1e8f2d39b45)
 2016-06-17 11:05:13 +09:00
Konstantin V Shvachko
77ed9bafdd HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 18:26:46 -07:00
Colin Patrick Mccabe
56c997a1a6 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe) 
(cherry picked from commit bf780406f2b30e627bdf36ac07973f6931f81106)
 2016-06-16 16:59:46 -07:00
Colin Patrick Mccabe
49c0d9b325 HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit c7921c9bddb79c9db5059b6c3f7a3a586a3cd95b)
 2016-06-16 13:52:38 -07:00
Chris Nauroth
e4b63ed7b4 HADOOP-13241. document s3a better. Contributed by Steve Loughran. 
(cherry picked from commit 127d2c7281917f23bce17afa6098a2d678a16441)
 2016-06-16 11:18:40 -07:00
Ravi Prakash
b216dbfb55 HADOOP-3733. "s3x:" URLs break when Secret Key contains a slash, even if encoded. Contributed by Steve Loughran. 
(cherry picked from commit 4aefe119a0203c03cdc893dcb3330fd37f26f0ee)
 2016-06-16 11:14:38 -07:00
Wangda Tan
7eb524ddee YARN-4844. Addendum patch, revert few changes to public and evolving to avoid breaking downstream projects as much as possible. 2016-06-16 11:09:56 -07:00
Arpit Agarwal
159b249a3d HDFS-10532. Typo in RollingUpgrade docs. (Contributed by Yiqun Lin) 2016-06-16 10:10:49 -07:00
Junping Du
eec703f36f YARN-5083. YARN CLI for AM logs does not give any error message if entered invalid am value. Contributed by Jian He. 
(cherry picked from commit e14ee0d3b55816bed1d27a8caf78001985119e3c)
 2016-06-16 08:56:46 -07:00
Vinayakumar B
6ab1f545fb HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B) 
(cherry picked from commit cc6c265171aace1e57653e777a4a73a747221086)
 2016-06-16 16:56:27 +05:30
Colin Patrick Mccabe
8280e3bcc2 HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe) 
(cherry picked from commit 2ca73445f5c2929d9c2ff4232dca58a63a0570a0)
 2016-06-15 22:50:36 -07:00
Colin Patrick Mccabe
17301ab395 HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe) 
(cherry picked from commit 2449db507d84b1c4fac70a800fb2ad8905cf3db7)
 2016-06-15 22:42:19 -07:00
Akira Ajisaka
d1c475ddd4 HADOOP-12892. fix/rewrite create-release. Contributed by Allen Wittenauer. 2016-06-16 14:03:57 +09:00
Ming Ma
32b115da1d HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma) 
(cherry picked from commit b48f27e794e42ba90836314834e872616437d7c9)
 2016-06-15 22:03:20 -07:00
Junping Du
6dd34baf3c YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong. 
(cherry picked from commit 5dfc38ff57669cba9078146e91ed990a1d25a3f0)
 2016-06-15 16:20:07 -07:00
Jitendra Pandey
14b849489a HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin. 2016-06-15 13:29:29 -07:00
Varun Vasudev
75235149af YARN-5223. Container line in yarn logs output for a live application should include the hostname for the container. Contributed by Xuan Gong. 
(cherry picked from commit 25064fb2fb79751cedbb8019900d811e07549ecf)
 2016-06-15 12:43:26 +05:30
Varun Vasudev
5bd39d2f3c YARN-5122. "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete. Contributed by Jian He. 
(cherry picked from commit d6284428e8bd09a06cf18ff81a7064d744ef47d0)
 2016-06-15 12:37:51 +05:30
Akira Ajisaka
6ffb557521 HADOOP-12893. Verify LICENSE.txt and NOTICE.txt. Contributed by Xiao Chen, Andrew Wang, and Akira Ajisaka. 2016-06-15 13:32:13 +09:00
Ming Ma
b7436f4468 HDFS-9016. Display upgrade domain information in fsck. (mingma) 2016-06-14 20:07:37 -07:00
Wangda Tan
863bfa4d6a YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda) 2016-06-14 15:12:00 -07:00
Masatake Iwasaki
9c66fffe4a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki. 
(cherry picked from commit 20b13d109a1f66d8911936d26bdde38d81a1c4c6)
 2016-06-14 19:46:33 +09:00
Vinayakumar B
06b76f1586 HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma) 
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
 2016-06-14 15:59:07 +05:30
Wangda Tan
cd3bdbc70a YARN-4887. Add allocation request ID to AM-RM protocol for identifying resource-requests explicitly. (Subru Krishnan via wangda) 
(cherry picked from commit eec835ec17f77bf713d90dbc2f77dea45f3ee660)
 2016-06-13 21:57:55 -07:00