Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,279 Commits 326 Branches 371 Tags
Commit Graph

3614 Commits

Author SHA1 Message Date
Arpit Agarwal
f73e748754 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:49:04 -07:00
Tsz-Wo Nicholas Sze
20ee619e32 HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:46:33 +08:00
Sangjin Lee
ae90d4dd90 HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 2016-06-24 14:48:36 -07:00
Colin Patrick Mccabe
e751bb4497 Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 975786492c42b8aebc6dc247bdcdb4768d99d641)
 2016-06-24 09:47:25 -07:00
Andrew Wang
8a1ee4d2b5 Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen." 
This reverts commit 55eda958ccbf3941986d6da63ad7ee16646d7067.
 2016-06-23 11:08:52 -07:00
Allen Wittenauer
2a956baaab HADOOP-13245. Fix up some misc create-release issues (aw) 
(cherry picked from commit e2f640942b722e35490cf146c0268517da5a28b1)
 2016-06-23 15:15:23 +09:00
Masatake Iwasaki
81497a4451 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims) 
(cherry picked from commit 67089875f0ea2a47cca0c237fccf239bf6fe2d53)
 2016-06-22 23:48:06 +09:00
Steve Loughran
fb9167fdef HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:42:30 +01:00
Akira Ajisaka
65b4f2682e HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton. 
(cherry picked from commit e15cd43369eb6d478844f25897e4a86065c62168)
 2016-06-21 20:17:00 +09:00
Colin Patrick Mccabe
14df17383c HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit 8c1f81d4bf424bdc421cf4952b230344e39a7b68)
 2016-06-20 14:30:21 -07:00
Colin Patrick Mccabe
7db1e57cc1 HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe) 
(cherry picked from commit 5370a6ffaec5227c0978f10c86a5811155271933)
 2016-06-20 10:50:30 -07:00
Akira Ajisaka
39ea0891d2 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde. 
(cherry picked from commit fc6b50cc574e144fd314dea6c11987c6a384bfa6)
 2016-06-20 17:08:02 +09:00
Brahma Reddy Battula
3f27f40503 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:38:18 +05:30
Arpit Agarwal
bd33cc0179 HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:17:10 -07:00
Chris Nauroth
b726b5c52c Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)" 
This reverts commit a1f913fb6e917f90d9492c78a30b380096ddb3db.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-06-17 23:50:55 -07:00
Xiaoyu Yao
ed5d3a62ce HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao. 
(cherry picked from commit 0761379fe45898c44c8f161834c298ef932e4d8c)
 2016-06-17 15:30:51 -07:00
Akira Ajisaka
a36aa920f4 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 
(cherry picked from commit 09e82acaf9a6d7663bc51bbca0cdeca4b582b535)
 2016-06-17 16:21:05 +09:00
Xiaoyu Yao
ddf66427ff HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 2016-06-16 20:12:17 -07:00
Akira Ajisaka
1ef89a767d MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 
(cherry picked from commit 51d497fa93d35dec7503eb30b8e3a1e8f2d39b45)
 2016-06-17 11:05:13 +09:00
Konstantin V Shvachko
77ed9bafdd HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 18:26:46 -07:00
Colin Patrick Mccabe
56c997a1a6 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe) 
(cherry picked from commit bf780406f2b30e627bdf36ac07973f6931f81106)
 2016-06-16 16:59:46 -07:00
Chris Nauroth
e4b63ed7b4 HADOOP-13241. document s3a better. Contributed by Steve Loughran. 
(cherry picked from commit 127d2c7281917f23bce17afa6098a2d678a16441)
 2016-06-16 11:18:40 -07:00
Vinayakumar B
6ab1f545fb HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B) 
(cherry picked from commit cc6c265171aace1e57653e777a4a73a747221086)
 2016-06-16 16:56:27 +05:30
Jitendra Pandey
14b849489a HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin. 2016-06-15 13:29:29 -07:00
Masatake Iwasaki
9c66fffe4a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki. 
(cherry picked from commit 20b13d109a1f66d8911936d26bdde38d81a1c4c6)
 2016-06-14 19:46:33 +09:00
Vinayakumar B
06b76f1586 HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma) 
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
 2016-06-14 15:59:07 +05:30
Akira Ajisaka
d219550e8b HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki. 
(cherry picked from commit e3ba9ad3f116306910f74645ded91506345b9f6e)
 2016-06-14 10:20:43 +09:00
Andrew Wang
6a8d3233fc HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 
(cherry picked from commit 0accc3306d830c3f2b16c4b8abf68729c7aba6cb)
 2016-06-13 11:43:56 -07:00
Karthik Kambatla
63da641910 HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha) 
(cherry picked from commit 49b4064644b242921af4ddf1de9932bc7bcf5f0e)
 2016-06-12 14:28:19 -07:00
Akira Ajisaka
035eea4d12 HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis. 
This closes #97.

(cherry picked from commit 8a1dcceccea5cfe9fb0c94daa2517cd64a16b3c0)
 2016-06-11 03:33:19 +09:00
Jing Zhao
9c7002b122 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. 
(cherry picked from commit 0bbb4ddd793063c87927035969884a34f60f2076)
 2016-06-10 10:40:53 -07:00
Wangda Tan
e91e9e596d YARN-3426. Add jdiff support to YARN. (vinodkv via wangda) 
(cherry picked from commit 03fc6b1bb0f5c0844cd5477ffba43de8a14d4d60)
 2016-06-10 09:53:40 -07:00
Chris Nauroth
1925942294 Revert "HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane." 
This reverts commit a8f03ef7ea8163c00ce5d72a4e1c77284befe5aa.
 2016-06-09 15:17:18 -07:00
Chris Nauroth
a8f03ef7ea HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane. 
(cherry picked from commit 9581fb715cbc8a6ad28566e83c6d0242a7306688)

Conflicts:
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
 2016-06-09 14:49:05 -07:00
Steve Loughran
6350e4b1fb HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:59:54 +01:00
Steve Loughran
df29f77846 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:27 +01:00
Junping Du
19eb997f67 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe. 
(cherry picked from commit c14c1b298e29e799f7c8f15ff24d7eba6e0cd39b)
 2016-06-07 09:20:51 -07:00
Tsz-Wo Nicholas Sze
074588d78b Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 5bfadb8e6bd9af791890da84707f4ebee0f664d8.
 2016-06-06 16:52:24 +08:00
Tsz-Wo Nicholas Sze
09a543fc86 Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit 071aeab5853087314efd6252b9b7e4b64979a0fd.
 2016-06-06 16:52:02 +08:00
Tsz-Wo Nicholas Sze
7b9062f405 Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 7d4c16bae9b69a722807b3ca200f97bb8cc95f61.
 2016-06-06 16:51:48 +08:00
Tsz-Wo Nicholas Sze
c1947a71ff Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit c11c2ee649a186d211cea0b85cb33dab0b3f96db.
 2016-06-06 16:51:41 +08:00
Andrew Wang
c11c2ee649 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit d316f44059c4417ed30064470a590991dd160857.
 2016-06-03 18:11:12 -07:00
Andrew Wang
7d4c16bae9 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit 7e0824faa9970de608fabd8101bdb2652db4362b.
 2016-06-03 18:10:49 -07:00
Andrew Wang
071aeab585 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit 658072d62e856c65632f1a66b10808de625649f1.
 2016-06-03 18:10:49 -07:00
Andrew Wang
5bfadb8e6b Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit f7189d6a1c08075920bb6f8efd41a8730a4eb7c7.
 2016-06-03 18:10:47 -07:00
Andrew Wang
03c4724c88 HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 713cb71820ad94a5436f35824d07aa12fcba5cc6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
 2016-06-03 17:01:11 -07:00
Chris Nauroth
5e6ee5aafb HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu. 
(cherry picked from commit d82bc8501869be78780fc09752dbf7af918c14af)
 2016-06-03 16:38:38 -07:00
Jian He
7f865bf438 YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du 
(cherry picked from commit 99cc439e29794f8e61bebe03b2a7ca4b6743ec92)
 2016-06-03 11:11:20 -07:00
Chris Nauroth
043a0c2e6c HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran. 2016-06-03 08:56:07 -07:00
Akira Ajisaka
b6d5546e24 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka) 2016-06-03 16:04:11 +09:00