Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,838 Commits 326 Branches 371 Tags
Commit Graph

11838 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
d8a69c8737 HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen. 
(cherry picked from commit 771f798edf97b27ae003395118c0317b484df6ee)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2016-06-27 18:29:39 -07:00
Arpit Agarwal
f73e748754 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:49:04 -07:00
Tsz-Wo Nicholas Sze
20ee619e32 HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:46:33 +08:00
Akira Ajisaka
b59b8b7351 HADOOP-13067. cleanup the dockerfile. Contributed by Allen Wittenauer. 2016-06-25 10:41:29 +09:00
Sangjin Lee
ae90d4dd90 HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 2016-06-24 14:48:36 -07:00
Colin Patrick Mccabe
e751bb4497 Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 975786492c42b8aebc6dc247bdcdb4768d99d641)
 2016-06-24 09:47:25 -07:00
Akira Ajisaka
2830ee5f0f MAPREDUCE-6725. Javadoc for CLI#listEvents() contains no-existent param. Contributed by shenyinjie. 
(cherry picked from commit 0f23cd497b0baa0899c7565cd94e2f27dbc7c0ff)
 2016-06-25 00:27:18 +09:00
Andrew Wang
8a1ee4d2b5 Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen." 
This reverts commit 55eda958ccbf3941986d6da63ad7ee16646d7067.
 2016-06-23 11:08:52 -07:00
Kihwal Lee
742f9083f6 HDFS-10555: Unable to loadFSEdits due to a failure in readCachePoolInfo. Contributed by Uma Maheswara Rao G 
(cherry picked from commit 01643020d24b606c26cb2dcaefdb6e47a5f06c8f)
 2016-06-23 09:19:49 -05:00
Akira Ajisaka
96dca785fa HDFS-10561. test_native_mini_dfs fails by NoClassDefFoundError. (aajisaka) 
(cherry picked from commit ff07b108039ecc4e680352f756930673ced42256)
 2016-06-23 15:49:55 +09:00
Akira Ajisaka
fb13ab0727 HADOOP-13307. add rsync to Dockerfile so that precommit archive works. Contributed by Allen Wittenauer. 
(cherry picked from commit 85209cc59152bcd7070b0a654af7d64105d36a6b)
 2016-06-23 15:24:10 +09:00
Allen Wittenauer
2a956baaab HADOOP-13245. Fix up some misc create-release issues (aw) 
(cherry picked from commit e2f640942b722e35490cf146c0268517da5a28b1)
 2016-06-23 15:15:23 +09:00
Xuan
b7f18f2815 YARN-5266. Wrong exit code while trying to get app logs using regex via CLI. Contributed by Xuan Gong 
(cherry picked from commit 6ab5aa1c1f82f81726c6daa38b3db90d8c3ad856)
 2016-06-22 21:50:09 -07:00
Arun Suresh
e64d21b297 YARN-5171. Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node. (Inigo Goiri via asuresh) 
(cherry picked from commit 99e5dd68d0f44109c169d74824fa45a7396a5990)
 2016-06-22 19:05:28 -07:00
Tsuyoshi Ozawa
3ecbfdfdc2 MAPREDUCE-6721. mapreduce.reduce.shuffle.memory.limit.percent=0.0 should be legal to enforce shuffle to disk. (Gera Shegalov via ozawa) 
This closes #102

(cherry picked from commit 79a7289165510072c46779251ebb010248cb0ce8)
 2016-06-22 17:20:49 -07:00
Jing Zhao
856bc4e28b HDFS-10556. DistCpOptions should be validated automatically. Contributed by Mingliang Liu. 2016-06-22 15:15:47 -07:00
Masatake Iwasaki
81497a4451 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims) 
(cherry picked from commit 67089875f0ea2a47cca0c237fccf239bf6fe2d53)
 2016-06-22 23:48:06 +09:00
Steve Loughran
fb9167fdef HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:42:30 +01:00
Akira Ajisaka
ad50a64ded HDFS-7597. DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping. Contributed by Daryn Sharp, Bob Hansen, and Xiao Chen. 
(cherry picked from commit d433b16ce6d74f1a44bc29446c74b1cb5f8a10fa)
 2016-06-22 11:02:31 +09:00
Jian He
e0f4397232 MAPREDUCE-6197. Cache MapOutputLocations in ShuffleHandler. Contributed by Junping Du 
(cherry picked from commit d8107fcd1c93c202925f2946d0cd4072fe0aef1e)
 2016-06-21 14:26:23 -07:00
Chris Nauroth
e6ebe9ab4e HADOOP-13287. TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains +. Contributed by Chris Nauroth. 
(cherry picked from commit b2c596cdda7c129951074bc53b4b9ecfedbf080a)
 2016-06-21 11:32:11 -07:00
Sangjin Lee
910742ad12 MAPREDUCE-6719. The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state store (Daniel Templeton via sjlee) 
(cherry picked from commit 605b4b61364781fc99ed27035c793153a20d8f71)
 2016-06-21 11:26:55 -07:00
Akira Ajisaka
65b4f2682e HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton. 
(cherry picked from commit e15cd43369eb6d478844f25897e4a86065c62168)
 2016-06-21 20:17:00 +09:00
Brahma Reddy Battula
ee0f389ecd HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 
(cherry picked from commit f2ac132d6a21c215093b7f87acf2843ac8123716)
 2016-06-21 15:44:45 +05:30
Colin Patrick Mccabe
4e11f33ccc HDFS-10448. CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 (Yiqun Lin via cmccabe) 
(cherry picked from commit 46f1602e896273b308fbd5df6c75f6c142828227)
 2016-06-20 18:31:40 -07:00
Colin Patrick Mccabe
0914658eb8 HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe) 
(cherry picked from commit 5f6b4157a40e974ccc6a56c39dbd35c54f393fbd)
 2016-06-20 18:12:41 -07:00
Jitendra Pandey
f2ef1145c5 HDFS-10538. Remove AsyncDistributedFileSystem. Contributed by Xiaobing Zhou and Jitendra Pandey. 2016-06-20 18:04:05 -07:00
Jitendra Pandey
8f93bbcb11 HADOOP-13291. Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented. Contributed by Mingliang Liu. 2016-06-20 16:28:55 -07:00
Colin Patrick Mccabe
14df17383c HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit 8c1f81d4bf424bdc421cf4952b230344e39a7b68)
 2016-06-20 14:30:21 -07:00
Colin Patrick Mccabe
7db1e57cc1 HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe) 
(cherry picked from commit 5370a6ffaec5227c0978f10c86a5811155271933)
 2016-06-20 10:50:30 -07:00
Sangjin Lee
2a79910c22 YARN-4958. The file localization process should allow for wildcards to reduce the application footprint in the state store (Daniel Templeton via sjlee) 
(cherry picked from commit 5107a967fa2558deba11c33a326d4d2e5748f452)
 2016-06-20 10:00:41 -07:00
Akira Ajisaka
39ea0891d2 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde. 
(cherry picked from commit fc6b50cc574e144fd314dea6c11987c6a384bfa6)
 2016-06-20 17:08:02 +09:00
Brahma Reddy Battula
3f27f40503 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:38:18 +05:30
Junping Du
ea4cab2330 YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev. 
(cherry picked from commit d0162f2040a4d98fbac51527dfc9447888cb32ab)
 2016-06-19 17:45:57 -07:00
Arpit Agarwal
bd33cc0179 HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:17:10 -07:00
Chris Nauroth
b726b5c52c Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)" 
This reverts commit a1f913fb6e917f90d9492c78a30b380096ddb3db.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-06-17 23:50:55 -07:00
Karthik Kambatla
25be8105cd YARN-5077. Fix FSLeafQueue#getFairShare() for queues with zero fairshare. (Yufei Gu via kasha) 
(cherry picked from commit 20f2799938c5cad59f59617cdb0f86e137c3c2c0)
 2016-06-17 22:25:04 -07:00
Karthik Kambatla
e9c1155233 YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit. Addendum to fix javac warning. (Arun Suresh via kasha) 
(cherry picked from commit fbbe0bb627c1b5f333eb5d5390e709cc43517420)
 2016-06-17 22:13:18 -07:00
Andrew Wang
94759470b8 Fix hadoop-hdfs-native-client compilation on Windows. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 3ff0510ffdc20e44f06aec591782f8875b686327)
 2016-06-17 15:54:57 -07:00
Chris Nauroth
b9dbef9417 HADOOP-13149. Windows distro build fails on dist-copynativelibs. Contributed by Chris Nauroth. 2016-06-17 15:54:21 -07:00
Xiaoyu Yao
ed5d3a62ce HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao. 
(cherry picked from commit 0761379fe45898c44c8f161834c298ef932e4d8c)
 2016-06-17 15:30:51 -07:00
Kihwal Lee
35c6b725db HDFS-10493. Add links to datanode web UI in namenode datanodes page. Contributed by Weiwei Yang. 
(cherry picked from commit 280069510b71d81a150b2b28d9fa987891d82774)
 2016-06-17 11:12:16 -05:00
Junping Du
6afa044dda YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong. 
(cherry picked from commit c35fa4a0e57b99415e284c7c2f3b1a0bebc610c2)
 2016-06-17 08:25:33 -07:00
Akira Ajisaka
a36aa920f4 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 
(cherry picked from commit 09e82acaf9a6d7663bc51bbca0cdeca4b582b535)
 2016-06-17 16:21:05 +09:00
Xiaoyu Yao
ddf66427ff HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 2016-06-16 20:12:17 -07:00
Akira Ajisaka
1ef89a767d MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 
(cherry picked from commit 51d497fa93d35dec7503eb30b8e3a1e8f2d39b45)
 2016-06-17 11:05:13 +09:00
Konstantin V Shvachko
77ed9bafdd HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 18:26:46 -07:00
Colin Patrick Mccabe
56c997a1a6 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe) 
(cherry picked from commit bf780406f2b30e627bdf36ac07973f6931f81106)
 2016-06-16 16:59:46 -07:00
Colin Patrick Mccabe
49c0d9b325 HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit c7921c9bddb79c9db5059b6c3f7a3a586a3cd95b)
 2016-06-16 13:52:38 -07:00
Chris Nauroth
e4b63ed7b4 HADOOP-13241. document s3a better. Contributed by Steve Loughran. 
(cherry picked from commit 127d2c7281917f23bce17afa6098a2d678a16441)
 2016-06-16 11:18:40 -07:00