Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,648 Commits 326 Branches 371 Tags
Commit Graph

1461 Commits

Author SHA1 Message Date
arp
5f86ce7ea9 HDFS-7064. Fix unit test failures in HDFS-6581 branch. (Contributed by Xiaoyu Yao) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
 2014-10-17 13:42:02 -07:00
arp
08cc08adb3 HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
 2014-10-17 13:42:01 -07:00
Ravi Prakash
08eeb3e5b6 HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) 
(cherry picked from commit 466f08792f11c2f95bf293ac9b6facd7018a5bb8)
 2014-10-15 15:52:46 -07:00
Zhijie Shen
bec165e163 YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen. 
(cherry picked from commit 1220bb72d452521c6f09cebe1dd77341054ee9dd)
 2014-10-14 21:56:44 -07:00
Zhijie Shen
8aeda20b25 HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen. 
(cherry picked from commit cdce88376a60918dfe2f3bcd82a7666d74992a19)
 2014-10-14 11:37:28 -07:00
Haohui Mai
262fef119e HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu. 2014-10-13 20:43:17 -07:00
Aaron T. Myers
f3132eee10 HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh. 
(cherry picked from commit 0e57aa3bf689374736939300d8f3525ec38bead7)
 2014-10-13 18:10:23 -07:00
Karthik Kambatla
88455173e8 YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha) 
(cherry picked from commit cc93e7e683fa74eb1a7aa2b357a36667bd21086a)
 2014-10-13 16:32:42 -07:00
Haohui Mai
16710758f1 HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao. 2014-10-10 23:02:41 -07:00
Andrew Wang
217c0405d9 HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang) 
(cherry picked from commit d3d3d47202a18749eeebec22db759c19dd3e232c)
 2014-10-10 13:40:53 -07:00
Colin Patrick Mccabe
4c0bc45978 HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe) 
(cherry picked from commit 1ceb3269337e321e352b7cd9f946c5c52dcfddfa)
 2014-10-10 13:04:16 -07:00
Aaron T. Myers
8cbacb37e9 HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang. 
(cherry picked from commit cbd21fd13b321d042faeff00fa71c9becc0d6087)
 2014-10-09 18:53:03 -07:00
Colin Patrick Mccabe
8addbe2b8e HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe) 
(cherry picked from commit d8d628d1e0c42a32e2079ed430e8817996bbe4c4)
 2014-10-09 17:12:24 -07:00
Andrew Wang
6cc8ec980c HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang) 
(cherry picked from commit 8d941144952a77a714cd4368cba21b01904926e9)
 2014-10-09 13:21:32 -07:00
cnauroth
4e544c84e9 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth. 2014-10-09 11:55:59 -07:00
Uma Maheswara Rao G
7d63b4f273 HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh) 
(cherry picked from commit 8d7c54967d5a08cdff75a782998ee89e7537b5c4)
 2014-10-09 20:20:27 +05:30
Aaron T. Myers
afaadd6535 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh. 
(cherry picked from commit d9556e873ef4d3e68c4f0c991f856d1faa747f07)
 2014-10-08 18:02:00 -07:00
Colin Patrick Mccabe
f1feaae1dd HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe) 
(cherry picked from commit d996235285e5047f731e3d3fc4c6e6214caa10aa)
 2014-10-08 18:01:22 -07:00
Zhijie Shen
f27a88562e HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch. 
(cherry picked from commit a1690519317068d9855174752d22ff45f0e4c962)
 2014-10-08 15:37:57 -07:00
Andrew Wang
52c8ac90ea HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang) 
(cherry picked from commit 4b2834898cbcc66ffbf01b2fb10375e79a50d538)
 2014-10-07 14:57:09 -07:00
Andrew Wang
3e897da5fc HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang) 
(cherry picked from commit b2f619752355d4ef6733935c020f57c8a26d82e1)
 2014-10-07 14:47:14 -07:00
Colin Patrick Mccabe
b5158c8d24 HADOOP-10404. Commit correct version of patch (cmccabe) 
(cherry picked from commit 687d83c9e10a4432c8d54c2cd406c7ccb4392187)
 2014-10-06 14:45:04 -07:00
Colin Patrick Mccabe
c97134d054 HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe) 
(cherry picked from commit 8099de259fb91a29674bf17cb1382c038b707a90)
 2014-10-06 14:41:14 -07:00
Arun C. Murthy
7dd508b880 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan. 
(cherry picked from commit 8f9ab998e273259c1e7a3ed53ba37d767e02b6bb)
 2014-10-05 07:42:10 -07:00
cnauroth
a828ef15b0 HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu. 
(cherry picked from commit 69c9af91031f345d9511618877646b8756b17863)
 2014-10-03 21:05:05 -07:00
Colin Patrick Mccabe
b335df9a9b HDFS-7055. Add tracing to DFSInputStream (cmccabe) 
(cherry picked from commit 7f6ed7fe365166e8075359f1d0ad035fa876c70f)
 2014-10-03 13:38:15 -07:00
Andrew Wang
9ebff016c2 HADOOP-11151. Automatically refresh auth token and retry on auth failure. Contributed by Arun Suresh. 
(cherry picked from commit 2d8e6e2c4a52a4ba815b23d6d1ac21be4df23d9e)
 2014-10-02 19:59:56 -07:00
Andrew Wang
6dbba19469 HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang) 
(cherry picked from commit 6ac10516e7fa28384b6d3c2670f6621e2666ffdb)
 2014-10-02 13:54:56 -07:00
Vinod Kumar Vavilapalli
64bed0460e YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu. 
Committed as a YARN patch even though all the code changes are in common.

(cherry picked from commit 5ca97f1e60b8a7848f6eadd15f6c08ed390a8cda)
 2014-10-01 09:55:57 -07:00
Steve Loughran
49be85005e HADOOP-11117 UGI HadoopLoginModule doesn't catch & wrap all kerberos-related exceptions (stevel) 2014-09-30 17:28:56 -07:00
Andrew Wang
489b4008df HADOOP-11113. Namenode not able to reconnect to KMS after KMS restart. (Arun Suresh via wang) 
(cherry picked from commit e25a25c5343c889d8c9e45b65082ddb55cf36d52)
 2014-09-30 16:48:17 -07:00
Andrew Wang
d4c5a39270 HADOOP-11156. DelegateToFileSystem should implement getFsStatus(final Path f). Contributed by Zhihai Xu. 
(cherry picked from commit d7075ada5d3019a8c520d34bfddb0cd73a449343)
 2014-09-30 16:40:00 -07:00
Andrew Wang
47ddaee1db HDFS-7122. Use of ThreadLocal<Random> results in poor block placement. (wang) 
(cherry picked from commit d7086c563ff2847c415913ac625b2a557eeccbdd)
 2014-09-29 15:00:28 -07:00
Andrew Wang
2028414ebe HADOOP-11110. JavaKeystoreProvider should not report a key as created if it was not flushed to the backing file. (Arun Suresh via wang) 
(cherry picked from commit a78953c974e52abe73905b1901a2354696f4a5a0)
 2014-09-29 13:10:35 -07:00
Colin Patrick Mccabe
c412652820 HDFS-7157. Using Time.now() for recording start/end time of reconfiguration tasks (Lei Xu via Colin Patrick McCabe) 
(cherry picked from commit b3d5d269a73a1826ebf6f637a0dbd69f6261dbcb)
 2014-09-29 11:30:32 -07:00
Jason Lowe
0cfff28f57 HADOOP-11049. javax package system class default is too broad. Contributed by Sangjin Lee 
(cherry picked from commit cf4631d7c9448205f4952341c071e1650e7922dc)
 2014-09-29 14:37:28 +00:00
Steve Loughran
7fabec3258 HADOOP-11143 NetUtils.wrapException loses inner stack trace on BindException 2014-09-27 21:06:31 +01:00
Allen Wittenauer
f894d187ed HADOOP-10731. Remove @date JavaDoc comment in ProgramDriver class (Henry Saputra via aw) 2014-09-26 14:41:53 -07:00
Allen Wittenauer
67d6fc3f01 MAPREDUCE-5945. Update the description of GenericOptionsParser -jt option (Akira AJISAKA via aw) 2014-09-26 14:26:36 -07:00
Jason Lowe
50a5227dad HADOOP-11048. user/custom LogManager fails to load if the client classloader is enabled. Contributed by Sangjin Lee 
(cherry picked from commit f154ebe8c44e41edc443198a14e0491604cc613f)
 2014-09-26 19:51:18 +00:00
Colin Patrick Mccabe
b5b4cb4d64 HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe) 
(cherry picked from commit 55302ccfba199ddf070119be30df06afd2511e05)
 2014-09-26 10:34:42 -07:00
Andrew Wang
3f71a15813 HDFS-7077. Separate CipherSuite from crypto protocol version. (wang) 
(cherry picked from commit e96ce6f3e3e549202ce3c48d4733ba34098870ad)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2014-09-25 18:42:17 -07:00
Tsz-Wo Nicholas Sze
022474c807 Merge branch 'HDFS-6584' into trunk 
Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicyConsiderLoad.java
 2014-09-26 04:47:25 +08:00
Colin Patrick Mccabe
cb9283549f HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe) 
(cherry picked from commit 1861b32eb551a07d748afc6205ea9573f9503eda)
 2014-09-25 13:22:35 -07:00
Vinayakumar B
1e097ba429 HADOOP-11101. How about inputstream close statement from catch block to finally block in FileContext#copy() ( Contributed by skrho ) 
(cherry picked from commit dff95f7af899a4f2add791afbd20c8a1e33c7a36)
 2014-09-25 12:47:41 +05:30
cnauroth
6e5194099c HADOOP-11064. UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes. Contributed by Chris Nauroth. 
(cherry picked from commit cbf0ae742ae3db964550df11c4044d3e16013959)
 2014-09-24 15:33:18 -07:00
Andrew Wang
3cf28210ec HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. (Zhe Zhang via wang) 2014-09-24 12:11:45 -07:00
Karthik Kambatla
b34858c1f8 HADOOP-11017. Addendum to fix RM HA. KMS delegation token secret manager should be able to use zookeeper as store. (Arun Suresh via kasha) 
(cherry picked from commit ef784a2e08c2452026a85ae382a956ff7deecbd0)
 2014-09-23 17:08:23 -07:00
Vinayakumar B
1fe3086bdb HADOOP-10131. NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree (Contributed by Vinayakumar B) 
(cherry picked from commit eab15af12c114eef4e9abd9af2ba03b0ab2cc441)
 2014-09-22 11:29:04 +05:30
Alejandro Abdelnur
897ced1a20 HADOOP-11017. KMS delegation token secret manager should be able to use zookeeper as store. (asuresh via tucu) 
(cherry picked from commit db890eef3208cc557476fa510f7a253ba22bc68a)

Conflicts:
	hadoop-project/pom.xml
 2014-09-20 08:24:34 -07:00