2266 Commits

Author SHA1 Message Date
Colin Patrick Mccabe
f1feaae1dd HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe)
(cherry picked from commit d996235285e5047f731e3d3fc4c6e6214caa10aa)
2014-10-08 18:01:22 -07:00
Zhijie Shen
f27a88562e HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch.
(cherry picked from commit a1690519317068d9855174752d22ff45f0e4c962)
2014-10-08 15:37:57 -07:00
Colin Patrick Mccabe
19c307f36a CHANGES.txt: move HADOOP-10404 underneath branch 2.6 2014-10-08 14:01:50 -07:00
Andrew Wang
d9aa0f8333 HADOOP-11166. Remove ulimit from test-patch.sh.
(cherry picked from commit 60f0f6fcde406ed15e9079e0ff34df744b09a844)
2014-10-07 17:30:16 -07:00
Andrew Wang
6546c59745 Fixup for CHANGES.txt
(cherry picked from commit 0263656247f31a67347bea4b702869ddce21e7c4)
2014-10-07 14:59:17 -07:00
Andrew Wang
52c8ac90ea HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang)
(cherry picked from commit 4b2834898cbcc66ffbf01b2fb10375e79a50d538)
2014-10-07 14:57:09 -07:00
Andrew Wang
3e897da5fc HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang)
(cherry picked from commit b2f619752355d4ef6733935c020f57c8a26d82e1)
2014-10-07 14:47:14 -07:00
Kihwal Lee
7910c6d035 HADOOP-11007. Reinstate building of ant tasks support. Contributed by
Jason Lowe.
(cherry picked from commit 99d7a452be91b3aefe9bcde9b51893ff6719742e)
2014-10-07 16:23:52 -05:00
Colin Patrick Mccabe
2a8f824fb7 HDFS-7186. Document the "hadoop trace" command. (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 9196db9a080b96b9022c424d70f59811e67570a6)
2014-10-07 11:57:09 -07:00
Haohui Mai
70c8cb5614 HADOOP-11168. Remove duplicated entry dfs.webhdfs.enabled in the user doc. Contributed by Yi Liu. 2014-10-06 22:07:29 -06:00
Colin Patrick Mccabe
b5158c8d24 HADOOP-10404. Commit correct version of patch (cmccabe)
(cherry picked from commit 687d83c9e10a4432c8d54c2cd406c7ccb4392187)
2014-10-06 14:45:04 -07:00
Colin Patrick Mccabe
c97134d054 HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe)
(cherry picked from commit 8099de259fb91a29674bf17cb1382c038b707a90)
2014-10-06 14:41:14 -07:00
Arun C. Murthy
c5828c624f HADOOP-10731. Sync-ing CHANGES.txt across branches. 2014-10-05 07:51:27 -07:00
Arun C. Murthy
7dd508b880 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan.
(cherry picked from commit 8f9ab998e273259c1e7a3ed53ba37d767e02b6bb)
2014-10-05 07:42:10 -07:00
cnauroth
1329d1e701 HADOOP-11163. Correct CHANGES.txt.
(cherry picked from commit bbb3b1acc0e8ce10b8689ded2be73b0965f09e52)
2014-10-03 21:07:40 -07:00
cnauroth
a828ef15b0 HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu.
(cherry picked from commit 69c9af91031f345d9511618877646b8756b17863)
2014-10-03 21:05:05 -07:00
Colin Patrick Mccabe
b335df9a9b HDFS-7055. Add tracing to DFSInputStream (cmccabe)
(cherry picked from commit 7f6ed7fe365166e8075359f1d0ad035fa876c70f)
2014-10-03 13:38:15 -07:00
Andrew Wang
9ebff016c2 HADOOP-11151. Automatically refresh auth token and retry on auth failure. Contributed by Arun Suresh.
(cherry picked from commit 2d8e6e2c4a52a4ba815b23d6d1ac21be4df23d9e)
2014-10-02 19:59:56 -07:00
Haohui Mai
ebeb9da80c HADOOP-11160. Fix typo in nfs3 server duplicate entry reporting. Contributed by Charles Lamb. 2014-10-02 14:08:01 -07:00
Andrew Wang
6dbba19469 HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang)
(cherry picked from commit 6ac10516e7fa28384b6d3c2670f6621e2666ffdb)
2014-10-02 13:54:56 -07:00
Haohui Mai
63ad22be48 HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li. 2014-10-01 13:19:05 -07:00
Vinod Kumar Vavilapalli
64bed0460e YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu.
Committed as a YARN patch even though all the code changes are in common.

(cherry picked from commit 5ca97f1e60b8a7848f6eadd15f6c08ed390a8cda)
2014-10-01 09:55:57 -07:00
Steve Loughran
49be85005e HADOOP-11117 UGI HadoopLoginModule doesn't catch & wrap all kerberos-related exceptions (stevel) 2014-09-30 17:28:56 -07:00
Andrew Wang
489b4008df HADOOP-11113. Namenode not able to reconnect to KMS after KMS restart. (Arun Suresh via wang)
(cherry picked from commit e25a25c5343c889d8c9e45b65082ddb55cf36d52)
2014-09-30 16:48:17 -07:00
Andrew Wang
d4c5a39270 HADOOP-11156. DelegateToFileSystem should implement getFsStatus(final Path f). Contributed by Zhihai Xu.
(cherry picked from commit d7075ada5d3019a8c520d34bfddb0cd73a449343)
2014-09-30 16:40:00 -07:00
Arun C. Murthy
6a60fa279a Preparing to branch hadoop-2.6 2014-09-30 10:37:03 -07:00
cnauroth
57b145c3ab HADOOP-11145. TestFairCallQueue fails. Contributed by Akira AJISAKA.
(cherry picked from commit b9158697a4f2d345b681a9b6ed982dae558338bc)
2014-09-30 08:58:39 -07:00
cnauroth
781833f553 HADOOP-11154. Update BUILDING.txt to state that CMake 3.0 or newer is required on Mac. Contributed by Chris Nauroth.
(cherry picked from commit 8dc4e9408f4cd9a50cd58aee574f3b03c3a33b31)
2014-09-30 08:35:35 -07:00
Brandon Li
aa3d6d374d HADOOP-11130. NFS updateMaps OS check is reversed. Contributed by Brandon Li
(cherry picked from commit c88c6c57aa79e8a1f33d2e075491656f472c858b)
2014-09-29 15:08:19 -07:00
Andrew Wang
758fb8465a HADOOP-11153. Make number of KMS threads configurable. (wang)
(cherry picked from commit 64aef189656919327b11fe5e90ea680ca7ba83df)
2014-09-29 15:04:26 -07:00
Andrew Wang
47ddaee1db HDFS-7122. Use of ThreadLocal<Random> results in poor block placement. (wang)
(cherry picked from commit d7086c563ff2847c415913ac625b2a557eeccbdd)
2014-09-29 15:00:28 -07:00
Andrew Wang
d551a95fc4 Move HDFS-7157 to HDFS CHANGES.txt
(cherry picked from commit a45b331cc9b9c772504474c224aa23bcbac403db)
2014-09-29 13:17:28 -07:00
Andrew Wang
2028414ebe HADOOP-11110. JavaKeystoreProvider should not report a key as created if it was not flushed to the backing file. (Arun Suresh via wang)
(cherry picked from commit a78953c974e52abe73905b1901a2354696f4a5a0)
2014-09-29 13:10:35 -07:00
Colin Patrick Mccabe
c412652820 HDFS-7157. Using Time.now() for recording start/end time of reconfiguration tasks (Lei Xu via Colin Patrick McCabe)
(cherry picked from commit b3d5d269a73a1826ebf6f637a0dbd69f6261dbcb)
2014-09-29 11:30:32 -07:00
Jason Lowe
0cfff28f57 HADOOP-11049. javax package system class default is too broad. Contributed by Sangjin Lee
(cherry picked from commit cf4631d7c9448205f4952341c071e1650e7922dc)
2014-09-29 14:37:28 +00:00
Steve Loughran
7fabec3258 HADOOP-11143 NetUtils.wrapException loses inner stack trace on BindException 2014-09-27 21:06:31 +01:00
Jian He
a6879b606e MAPREDUCE-6087. Fixed wrong config name of MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by Akira AJISAKA
(cherry picked from commit 5f16c98ad66b562760d5d947151a38f14875d21a)
2014-09-26 18:06:19 -07:00
Allen Wittenauer
0341c65519 HADOOP-10552. Fix usage and example at FileSystemShell.apt.vm (Kenji Kikushima via aw) 2014-09-26 14:57:20 -07:00
Allen Wittenauer
f894d187ed HADOOP-10731. Remove @date JavaDoc comment in ProgramDriver class (Henry Saputra via aw) 2014-09-26 14:41:53 -07:00
Allen Wittenauer
67d6fc3f01 MAPREDUCE-5945. Update the description of GenericOptionsParser -jt option (Akira AJISAKA via aw) 2014-09-26 14:26:36 -07:00
Jason Lowe
50a5227dad HADOOP-11048. user/custom LogManager fails to load if the client classloader is enabled. Contributed by Sangjin Lee
(cherry picked from commit f154ebe8c44e41edc443198a14e0491604cc613f)
2014-09-26 19:51:18 +00:00
Allen Wittenauer
27f9edceed HADOOP-10954. Adding site documents of hadoop-tools (Masatake Iwasaki via aw) 2014-09-26 12:01:41 -07:00
Allen Wittenauer
424b1f6955 HADOOP-8808. Update FsShell documentation to mention deprecation of some of the commands, and mention alternatives (Akira AJISAKA via aw) 2014-09-26 11:11:30 -07:00
Colin Patrick Mccabe
b5b4cb4d64 HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe)
(cherry picked from commit 55302ccfba199ddf070119be30df06afd2511e05)
2014-09-26 10:34:42 -07:00
Andrew Wang
0eaa4ba026 HADOOP-11140. hadoop-aws only need test-scoped dependency on hadoop-common's tests jar. Contributed by Juan Yu.
(cherry picked from commit 4ea77efa3ab4160498fec54d4824321921c15124)
2014-09-25 21:56:35 -07:00
Andrew Wang
3f71a15813 HDFS-7077. Separate CipherSuite from crypto protocol version. (wang)
(cherry picked from commit e96ce6f3e3e549202ce3c48d4733ba34098870ad)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
2014-09-25 18:42:17 -07:00
Tsz-Wo Nicholas Sze
022474c807 Merge branch 'HDFS-6584' into trunk
Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicyConsiderLoad.java
2014-09-26 04:47:25 +08:00
Colin Patrick Mccabe
cb9283549f HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe)
(cherry picked from commit 1861b32eb551a07d748afc6205ea9573f9503eda)
2014-09-25 13:22:35 -07:00
Vinayakumar B
1e097ba429 HADOOP-11101. How about inputstream close statement from catch block to finally block in FileContext#copy() ( Contributed by skrho )
(cherry picked from commit dff95f7af899a4f2add791afbd20c8a1e33c7a36)
2014-09-25 12:47:41 +05:30
Allen Wittenauer
ea1fb1461a HADOOP-11009. Add Timestamp Preservation to DistCp (Gary Steelman via aw) 2014-09-24 15:39:55 -07:00