Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,023 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2061 Commits

Author SHA1 Message Date
Haohui Mai e2c1ef4deb HADOOP-11287. Simplify UGI#reloginFromKeytab for Java 7+. Contributed by Li Lu. 2014-12-08 21:10:49 -08:00
Andrew Wang 46a7365164 HADOOP-11329. Add JAVA_LIBRARY_PATH to KMS startup options. Contributed by Arun Suresh. 
(cherry picked from commit ddffcd8fac)
 2014-12-08 13:45:34 -08:00
Jing Zhao 582f96e41d HADOOP-11354. ThrottledInputStream doesn't perform effective throttling. Contributed by Ted Yu. 2014-12-08 11:09:34 -08:00
cnauroth 143a5b67d8 HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B. 
(cherry picked from commit ffe942b82c)
 2014-12-08 10:28:25 -08:00
Steve Loughran 275561d848 HADOOP-10530 Make hadoop build on Java7+ only (stevel) 2014-12-08 15:30:34 +00:00
cnauroth 308b75571b HADOOP-11313. Adding a document about NativeLibraryChecker. Contributed by Tsuyoshi OZAWA. 
(cherry picked from commit 1b3bb9e7a3)
 2014-12-06 20:12:56 -08:00
Andrew Wang dabdd2d746 HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen. 
(cherry picked from commit 0707e4eca9)
 2014-12-05 18:20:23 -08:00
Andrew Wang b8e4fffa49 HADOOP-11355. When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown. Contributed by Arun Suresh. 
(cherry picked from commit 9cdaec6a6f)
 2014-12-05 12:01:32 -08:00
Haohui Mai 4f612f148b HADOOP-11356. Removed deprecated o.a.h.fs.permission.AccessControlException. Contributed by Li Lu. 2014-12-05 10:50:03 -08:00
Colin Patrick Mccabe a0976152e6 HADOOP-11348. Remove unused variable from CMake error message for finding openssl (Dian Fu via Colin P. McCabe) 
(cherry picked from commit 565b0e60a8)
 2014-12-04 12:54:59 -08:00
Aaron T. Myers 534a021e70 HADOOP-11332. KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject. Contributed by Dian Fu. 
(cherry picked from commit 9d1a8f5897)
 2014-12-03 18:54:26 -08:00
Andrew Wang 696e15f0d1 HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL. Contributed by Dian Fu. 
(cherry picked from commit 1812241ee1)
 2014-12-03 12:00:29 -08:00
Andrew Wang c962eef533 HADOOP-11344. KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup. Contributed by Arun Suresh. 
(cherry picked from commit 3d48ad7eb4)
 2014-12-02 19:04:33 -08:00
stack 6d904985e8 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 
(cherry picked from commit b36f292982)
 2014-12-01 23:08:16 -08:00
stack 76245dfccd Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)" 
This reverts commit fd6a801ddb.

Refers to an HBASE rather than HADOOP issue.
 2014-12-01 23:02:32 -08:00
stack fd6a801ddb HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack) 
(cherry picked from commit 74f4d8590d)
 2014-12-01 22:55:12 -08:00
Andrew Wang 881c77107e HADOOP-11341. KMS support for whitelist key ACLs. Contributed by Arun Suresh. 
(cherry picked from commit 31b4d2daa1)
 2014-12-01 21:58:21 -08:00
Colin Patrick Mccabe f9c5dec152 CHANGES.txt: add HADOOP-11257 
(cherry picked from commit c1f2bb2d31)
 2014-12-01 21:58:15 -08:00
Andrew Wang 084667aad9 HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done atomically. Contributed by Dian Fu. 
(cherry picked from commit 9fa2990257)
 2014-12-01 21:22:03 -08:00
Colin Patrick Mccabe f6d1bf5ed1 HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
(cherry picked from commit 86e3993def)
 2014-12-01 11:48:53 -08:00
Colin Patrick Mccabe 8f98225418 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 13:42:07 -08:00
Steve Loughran 6a01497d7c HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:43:46 +00:00
Andrew Wang 8018d1af58 HADOOP-11173. Improve error messages for some KeyShell commands. 
(cherry picked from commit fae266bbf1)
 2014-11-25 16:13:37 -08:00
Andrew Wang aad16f8f5c HADOOP-11300. KMS startup scripts must not display the keystore / truststore passwords. Contributed by Arun Suresh. 
(cherry picked from commit 56f3eecc12)
 2014-11-25 15:12:09 -08:00
yliu 4b62d6d2fd HADOOP-11322. key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT. (Dian Fu via yliu) 2014-11-25 01:12:31 +08:00
Colin Patrick Mccabe 4435ac9af5 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe) 
(cherry picked from commit f636f9d943)
 2014-11-24 10:58:05 -08:00
Karthik Kambatla e0df934ed1 Update release date for 2.5.2 
(cherry picked from commit 1e9a3f42ff)
 2014-11-21 14:34:47 -08:00
Andrew Wang 85bdc3a013 HADOOP-11323. WritableComparator#compare keeps reference to byte array. Contributed by Wilfred Spiegelenburg. 
(cherry picked from commit eb4045e765)
 2014-11-20 11:05:50 -08:00
cnauroth 00a06e28d4 HADOOP-11201. Hadoop Archives should support globs resolving to files. Contributed by Gera Shegalov. 
(cherry picked from commit 79301e80d7)
 2014-11-18 17:10:24 -08:00
Jian He 1412e712b4 YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA 
(cherry picked from commit 90a968d675)
 2014-11-18 16:13:08 -08:00
Andrew Wang 1e14792be6 HADOOP-11312. Fix unit tests to not use uppercase key names. 
(cherry picked from commit bcd402ae38)
 2014-11-18 10:48:10 -08:00
Jason Lowe 5125a8e59e HADOOP-11309. System class pattern package.Foo should match package.Foo$Bar, too. Contributed by Gera Shegalov 
(cherry picked from commit b4ca727690)
 2014-11-18 17:23:37 +00:00
Andrew Wang 541172f2ee HDFS-6982. nntop: top­-like tool for name node users. (Maysam Yabandeh via wang) 
(cherry picked from commit dcb8e24427)
 2014-11-17 17:34:02 -08:00
Andrew Wang 1deefa6cf1 HADOOP-11311. Restrict uppercase key names from being created with JCEKS. 
(cherry picked from commit 48d62fad80)
 2014-11-17 13:59:55 -08:00
Brandon Li 7b2a884077 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 
(cherry picked from commit 351c5561c2)
 2014-11-17 13:25:43 -08:00
Aaron T. Myers d35eba7b1f HADOOP-11157. ZKDelegationTokenSecretManager never shuts down listenerThreadPool. Contributed by Arun Suresh. 
(cherry picked from commit 07d489e6230682e0553840bb1a0e446acb9f8d19)
 2014-11-17 13:02:59 -08:00
Haohui Mai 6eb88c278c HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. 2014-11-17 12:56:03 -08:00
cnauroth 72207f65aa HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang. 
(cherry picked from commit 1925e2a4ae)
 2014-11-14 16:46:24 -08:00
Karthik Kambatla 8e524e8d60 HADOOP-11307. create-release script should run git clean first (kasha) 
(cherry picked from commit 4fb96dbe3b)
 2014-11-14 15:37:46 -08:00
Colin Patrick Mccabe 5b90e428a5 Revert HADOOP-11257 because it didn't get a jenkins run yet 2014-11-14 13:06:41 -08:00
Colin Patrick Mccabe 490df57fa2 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 
(cherry picked from commit 10c98aed38)
 2014-11-14 12:56:31 -08:00
Ravi Prakash 45692effe4 MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times (Sergey Murylev via raviprak) 2014-11-14 03:48:28 -08:00
Arun C. Murthy fc324d7062 Preparing to release hadoop-2.6.0-rc1. 
(cherry picked from commit 9ff7315cbe)
 2014-11-13 13:03:13 -08:00
cnauroth 9c94945fe9 HADOOP-11291. Log the cause of SASL connection failures. Contributed by Stephen Chu. 
(cherry picked from commit 7dae5b5a88)
 2014-11-12 21:54:40 -08:00
cnauroth 69a7780ee5 HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA. 2014-11-12 21:44:05 -08:00
Karthik Kambatla 6e64390627 HADOOP-11217. (Addendum to allow SSLv2Hello) Disable SSLv3 in KMS. (Robert Kanter via kasha) 
(cherry picked from commit 87818ef4e7)
 2014-11-12 18:39:21 -08:00
Arun C. Murthy 3ee522abb1 HADOOP-9576. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 09:56:17 -08:00
Jian He 2b125b3a39 HADOOP-9576. Changed NetUtils#wrapException to throw EOFException instead of wrapping it as IOException. Contributed by Steve Loughran 
(cherry picked from commit 86bf8c7193)
 2014-11-10 17:26:12 -08:00
Haohui Mai d47a34fc66 HADOOP-11296. Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor. Contributed by Brandon Li. 2014-11-10 15:43:16 -08:00
Karthik Kambatla 92de44c2c5 Set the release date for 2.5.2 
(cherry picked from commit 68a0508728)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-11-10 15:23:43 -08:00
Haohui Mai ebb0636c9d HADOOP-11289. Fix typo in RpcUtil log message. Contributed by Charles Lamb. 2014-11-10 11:05:37 -08:00
Arun C. Murthy adfb830a2b Preparing to release hadoop-2.6.0: Set version in branch-2 to 2.7.0-SNAPSHOT. 2014-11-09 19:19:02 -08:00
Arun C. Murthy d827b7a013 Release Notes for hadoop-2.6.0. 2014-11-09 19:15:37 -08:00
Arun C. Murthy cff08dab5e Updated CHANGES.txt to reflect hadoop-2.6.0 release dates. 
(cherry picked from commit 770cc14442)
 2014-11-09 18:48:01 -08:00
Arun C. Murthy e3877e8051 HADOOP-10786. Moved to hadoop-2.7.X. 
(cherry picked from commit 14b87b70a8)
 2014-11-09 18:19:47 -08:00
Haohui Mai 9e63cb4492 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 2014-11-09 17:48:40 -08:00
Arun C. Murthy 1f5bad04ce HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs. 
(cherry picked from commit 6caa8100d5)
 2014-11-09 05:23:10 -08:00
Arun C. Murthy 242404b025 HADOOP-10563. Fix bad merge which messed up hadoop-common/CHANGES.txt. 2014-11-09 05:23:05 -08:00
cnauroth 3ef876712c HADOOP-11282. Skip NFS TestShellBasedIdMapping tests that are irrelevant on Windows. Contributed by Chris Nauroth. 
(cherry picked from commit 68db5b3736)
 2014-11-07 14:32:04 -08:00
cnauroth a3496b7e01 HADOOP-11280. TestWinUtils#testChmod fails after removal of NO_PROPAGATE_INHERIT_ACE. Contributed by Chris Nauroth. 
(cherry picked from commit 42bbe3794e)
 2014-11-07 00:04:13 -08:00
Jing Zhao 7a91ea32e1 Revert "HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du." 
This reverts commit 16b3482467.
 2014-11-06 18:30:35 -08:00
Jing Zhao 22ecbd4ab3 HADOOP-11274. ConcurrentModificationException in Configuration Copy Constructor. Contributed by Junping Du. 2014-11-06 17:00:11 -08:00
Jason Lowe c0bbb72912 MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov 
(cherry picked from commit 10f9f5101c)
 2014-11-06 15:12:06 +00:00
Aaron T. Myers d698ed1d6f HADOOP-11187 NameNode - KMS communication fails after a long period of inactivity. Contributed by Arun Suresh. 
(cherry picked from commit d593035d50e9997f31ddd67275b6e68504f9ca3c)
 2014-11-05 18:17:43 -08:00
Aaron T. Myers e96f0c6aae HADOOP-11272. Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator client. Contributed by Arun Suresh. 
(cherry picked from commit 8a261e68e4)
 2014-11-05 17:47:49 -08:00
Aaron T. Myers 9082fe4e20 HADOOP-10714. AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call. Contributed by Juan Yu. 
(cherry picked from commit 6ba52d88ec)
 2014-11-05 17:24:55 -08:00
Haohui Mai 1857623634 HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu. 2014-11-05 15:25:46 -08:00
Haohui Mai 44f9790247 HADOOP-11266. Remove no longer supported activation properties for packaging from pom. Contributed by Masatake Iwasaki. 2014-11-05 11:15:47 -08:00
cnauroth a339fd3646 HADOOP-11265. Credential and Key Shell Commands not available on Windows. Contributed by Larry McCay. 
(cherry picked from commit a7fbd4e633)
 2014-11-05 08:44:16 -08:00
Vinayakumar B 2d0c56e898 HADOOP-11271. Use Time.monotonicNow() in Shell.java instead of Time.now() (Contributed by Vinayakumar B) 
(cherry picked from commit 8e9502e05d)
 2014-11-05 14:49:19 +05:30
Haohui Mai ab07fef5b7 HADOOP-11269. Add java 8 profile for hadoop-annotations. Contributed by Li Lu. 2014-11-04 18:01:02 -08:00
Haohui Mai fa92b40f09 HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN. Contributed by Robert Kanter. 2014-11-04 17:53:00 -08:00
Haohui Mai bfcf0c83a2 HADOOP-11268. Update BUILDING.txt to remove the workaround for tools.jar. Contributed by Li Lu. 2014-11-04 17:47:17 -08:00
Karthik Kambatla 6f9484221e Adding release 2.5.2 to CHANGES.txt 
(cherry picked from commit 4de56d27fb)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-04 16:51:54 -08:00
Karthik Kambatla 395d4ba766 HADOOP-11260. Patch up Jetty to disable SSLv3. (Mike Yoder via kasha) 
(cherry picked from commit dbf30e3c0e)
 2014-11-04 16:22:09 -08:00
Haohui Mai 7e2bdd5255 HADOOP-10717. HttpServer2 should load jsp DTD from local jars instead of going remote. Contributed by Dapeng Sun. 2014-11-04 15:02:25 -08:00
Haohui Mai 06bc026c21 Addendum patch for HADOOP-10563 in branch-2. 2014-11-04 14:54:59 -08:00
Haohui Mai aa09c4c342 HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai. 2014-11-04 14:52:51 -08:00
Haohui Mai 3bdfd6e58e HADOOP-10847. Remove the usage of sun.security.x509.* in testing code. Contributed by Pascal Oliva. 2014-11-04 10:52:22 -08:00
cnauroth f4ed787669 HADOOP-11165. TestUTF8 fails when run against java 8. Contributed by Stephen Chu. 
(cherry picked from commit 85da71c2d3)
 2014-11-04 10:29:29 -08:00
Kihwal Lee c8648bd27e HADOOP-10987. Provide an iterator-based listing API for FileSystem. Contributed by Kihwal Lee. 2014-11-03 08:23:34 -06:00
Vinod Kumar Vavilapalli 0cbc115704 HADOOP-11254. Changed visibility of AccessControlList to be public for consumption by ecosystem. Contributed by Zhijie Shen. 
(cherry picked from commit b18e8a272e)
 2014-11-01 11:11:04 -07:00
Zhijie Shen e286ae90b7 HADOOP-11241. Fixed intermittent TestNMSimulator failure due to timing issue. Contributed by Varun Vasudev. 
(cherry picked from commit 260ab6d5f4)
 2014-10-31 18:04:05 -07:00
Jian He a87f827ae4 YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen 
(cherry picked from commit 1b4be91866)
 2014-10-31 13:17:19 -07:00
Haohui Mai 5e5585a7e0 HADOOP-11253. Hadoop streaming test TestStreamXmlMultipleRecords fails on Windows. Contributed by Varun Vasudev. 2014-10-31 11:54:18 -07:00
cnauroth 57fa43ab0a HDFS-7313. Support optional configuration of AES cipher suite on DataTransferProtocol. Contributed by Chris Nauroth. 
(cherry picked from commit 5573b3476a)
 2014-10-30 22:52:33 -07:00
Brandon Li cc900b213c update CHANGES.txt to move HADOOP-11247 to 2.6 2014-10-30 13:31:40 -07:00
Tsz-Wo Nicholas Sze 2b5baa6714 HADOOP-11221. IdentityHashStore assumes System.identityHashCode() is non-negative. Contributed by Jinghui Wang 2014-10-30 11:00:24 -07:00
Colin Patrick Mccabe e107ea5177 HADOOP-11250. fix endmacro of set_find_shared_library_without_version in CMakeLists (Yi Liu via Colin P. McCabe) 
(cherry picked from commit e488f0d93b)
 2014-10-30 10:38:17 -07:00
yliu 51f621c01c HADOOP-11216. Improve Openssl library finding. (cmccabe via yliu) 2014-10-30 10:38:52 +08:00
Haohui Mai c7d1db7495 HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li. 2014-10-29 17:54:37 -07:00
Jason Lowe 0c15130db2 HADOOP-9740. Fix FsShell '-text' command to be able to read Avro files stored in HDFS and other filesystems. Contributed by Allan Yan 2014-10-29 20:23:17 +00:00
Colin Patrick Mccabe f6102831bc HADOOP-11186: documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes (cmccabe) 
(cherry picked from commit c2575fb046)
 2014-10-29 12:14:30 -07:00
cnauroth b4446cb370 HADOOP-11068. Match hadoop.auth cookie format to jetty output. Contributed by Gregory Chanan. 
(cherry picked from commit 5c900b522e)
 2014-10-29 11:21:37 -07:00
Brandon Li 6caf36f9eb HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang 
(cherry picked from commit 72a556d3b0)
 2014-10-29 11:06:44 -07:00
Kihwal Lee 45b6dea95f MAPREDUCE-6022. map_input_file is missing from streaming job 
environment. Contributed by Jason Lowe.
(cherry picked from commit b056048114)
 2014-10-29 12:30:08 -05:00
Karthik Kambatla 160aebcae2 HADOOP-11243. SSLFactory shouldn't allow SSLv3. (Wei Yan via kasha) 
(cherry picked from commit 3c5f5af118)
 2014-10-28 18:08:00 -07:00
Karthik Kambatla 0aec884704 HADOOP-11217. Disable SSLv3 in KMS. (Robert Kanter via kasha) 
(cherry picked from commit 1a78082338)
 2014-10-28 17:31:55 -07:00
cnauroth c2790932bd HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao. 
(cherry picked from commit c6f04f391b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-28 14:17:35 -07:00
yliu 8b812a35b8 HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu) 2014-10-28 21:16:34 +08:00