Commit Graph

3028 Commits

Author SHA1 Message Date
Arpit Agarwal ad653de2d7 HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor) 2016-08-02 15:18:24 -07:00
Arpit Agarwal 745ba1160b HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-02 13:43:50 -07:00
Chris Nauroth 06df0cd87f HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin.
(cherry picked from commit 0458a2af6e)
(cherry picked from commit ec522a1907)
2016-08-02 12:43:58 -07:00
Akira Ajisaka f39ed9ea8e HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon.
(cherry picked from commit 5469e128d3)
2016-08-02 10:18:52 +09:00
Chris Nauroth 244285488d HADOOP-13422. ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process. Contributed by Sergey Shelukhin.
(cherry picked from commit 255ea45e50)
(cherry picked from commit df2ed6b2c4)
2016-07-26 15:33:42 -07:00
Jing Zhao 54be36a6d6 HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
2016-07-25 09:51:59 -07:00
Arpit Agarwal bbf711c030 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-07-25 09:51:59 -07:00
Chris Nauroth 0456069aca HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran.
(cherry picked from commit 5fda66e4a3)
(cherry picked from commit e6ba69b4db)
2016-07-22 15:39:12 -07:00
Chris Nauroth af3c860bb1 HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge.
(cherry picked from commit 43cf6b101d)
(cherry picked from commit 382bcf21e7)
2016-07-21 14:12:47 -07:00
Jakob Homan 9442e1d48e HADOOP-12009. Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. backport to 2.8 2016-07-21 21:50:25 +01:00
Allen Wittenauer 35885e9540 HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw)
(cherry picked from commit b3649adf6a)
(cherry picked from commit 84c785036f)
2016-07-20 11:30:52 -07:00
Steve Loughran 0f1e02a298 HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan) 2016-07-20 13:42:19 +01:00
Akira Ajisaka f2508d78b2 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki.
(cherry picked from commit dc065dd64c)
(cherry picked from commit 8fe2c450b3)
2016-07-19 16:06:35 -07:00
Akira Ajisaka cf79ac5fa9 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki.
(cherry picked from commit c2bcffb34e)
(cherry picked from commit 09375baad1)
2016-07-18 11:50:53 -07:00
Akira Ajisaka bc21763da4 HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou.
(cherry picked from commit 1381483233)
(cherry picked from commit 2231ef22f5)
2016-07-14 23:15:53 -07:00
Zhe Zhang cbd885b6fa HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung.
(cherry picked from commit 728bf7f698)
(cherry picked from commit b95f1af8a9)
2016-07-13 16:47:01 -07:00
Akira Ajisaka 213b7f40de HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R.
(cherry picked from commit 505ce88437)
(cherry picked from commit ee1e45e4b2)
2016-07-13 13:10:27 -07:00
Tsuyoshi Ozawa fa9ff4997e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa)
(cherry picked from commit 77ffe76212)
2016-07-13 21:41:11 +09:00
Lei Xu d1d280fcfa HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei)
(cherry picked from commit a290a98b6a)
2016-07-12 16:51:55 -07:00
Jitendra Pandey 324923e1bc HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer. 2016-07-12 14:38:20 -07:00
Robert Kanter 2e2caeb50e HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
(cherry picked from commit 042a3ae960)
2016-07-12 14:37:57 -07:00
Steve Loughran 310c08454f HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse. 2016-07-11 17:21:14 +01:00
Akira Ajisaka a8cfcce542 Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux."
This reverts commit 1d175f0f3f.
2016-07-09 21:01:07 -07:00
Jitendra Pandey 9c7ce389c7 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 15:04:47 -07:00
Jitendra Pandey bc7fd76a1f HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:37:32 -07:00
Vinayakumar B 2c6e7f221e HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B)
(cherry picked from commit c25021fb71)
(cherry picked from commit 1458e66593)
2016-07-01 12:23:23 +05:30
Andrew Wang ae2ab601c0 HADOOP-12345. Pad hostname correctly in CredentialsSys.java. Contributed by Pradeep Nayak Udupi Kadbet.
(cherry picked from commit 846ada2de3)
(cherry picked from commit af581c0e23)
2016-06-29 17:32:52 -07:00
Masatake Iwasaki b5dbd3b5ed HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims)
(cherry picked from commit 5c07c573db)
2016-06-30 07:30:37 +09:00
Steve Loughran 52dbafecc5 HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki 2016-06-29 14:31:13 +01:00
Andrew Wang 47c13c4f7d HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen.
(cherry picked from commit 7d2070493e)
(cherry picked from commit 22eb53eb71)
2016-06-27 18:46:59 -07:00
Andrew Wang 59a70977c3 HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen.
(cherry picked from commit 771f798edf)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit d8a69c8737)
2016-06-27 18:29:58 -07:00
Akira Ajisaka a0f6109907 MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 2016-06-27 15:19:21 -07:00
Arpit Agarwal f7bd302550 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:51:16 -07:00
Tsz-Wo Nicholas Sze ce788c207f HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:51:45 +08:00
Jing Zhao e251654ee4 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu.
(cherry picked from commit 0bbb4ddd79)
2016-06-25 15:51:35 +08:00
Colin Patrick Mccabe 2d681a9246 Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
(cherry picked from commit 975786492c)
(cherry picked from commit e751bb4497)
2016-06-24 09:47:41 -07:00
Andrew Wang f28c270c96 Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen."
This reverts commit 4ad9ca85fb.
2016-06-23 11:09:06 -07:00
Allen Wittenauer d4474d7d09 HADOOP-13245. Fix up some misc create-release issues (aw)
(cherry picked from commit e2f640942b)
(cherry picked from commit 2a956baaab)
2016-06-23 15:16:33 +09:00
Masatake Iwasaki 9c46f99cc6 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims)
(cherry picked from commit 67089875f0)
2016-06-22 23:49:04 +09:00
Steve Loughran 1eb45180a6 HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:41:52 +01:00
Akira Ajisaka 6fefb8f4a4 HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton.
(cherry picked from commit e15cd43369)
(cherry picked from commit 65b4f2682e)
2016-06-21 20:17:42 +09:00
Colin Patrick Mccabe c5dafb4ad7 HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe)
(cherry picked from commit 8c1f81d4bf)
(cherry picked from commit 14df17383c)
2016-06-20 14:30:51 -07:00
Colin Patrick Mccabe c610b60331 HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe)
(cherry picked from commit 5370a6ffae)
(cherry picked from commit 7db1e57cc1)

Conflicts:
    hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileSystemStorageStatistics.java
2016-06-20 10:53:14 -07:00
Akira Ajisaka 615a023be3 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde.
(cherry picked from commit fc6b50cc57)
(cherry picked from commit 39ea0891d2)
2016-06-20 17:08:19 +09:00
Brahma Reddy Battula 9d27530c36 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula)
(cherry picked from commit 3f27f40503)
2016-06-20 12:40:11 +05:30
Chris Nauroth 55658dcaa3 Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)"
This reverts commit 62206dd2ed.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-06-17 23:51:27 -07:00
Akira Ajisaka 242263c56d HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang.
(cherry picked from commit 09e82acaf9)
(cherry picked from commit a36aa920f4)
2016-06-17 16:21:31 +09:00
Xiaoyu Yao e84a9c976a HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen.
(cherry picked from commit ddf66427ff)
2016-06-16 20:12:55 -07:00
Konstantin V Shvachko 408848d1e9 HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 18:33:05 -07:00
Colin Patrick Mccabe 04682cc6b0 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe)
(cherry picked from commit bf780406f2)
(cherry picked from commit 56c997a1a6)
2016-06-16 17:03:52 -07:00