Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,505 Commits 326 Branches 371 Tags
Commit Graph

1974 Commits

Author SHA1 Message Date
Robert Kanter
3f79ee7494 HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter) 
(cherry picked from commit aaafa0b2ee64f6cfb7fdc717500e1c483b9df8cc)
 2015-06-30 16:50:42 -07:00
Colin Patrick Mccabe
016c794e75 HADOOP-12124. Add HTrace support for FsShell (cmccabe) 
(cherry picked from commit ad60807238c4f7779cb0685e7d39ca0c50e01b2f)
 2015-06-30 16:47:14 -07:00
Colin Patrick Mccabe
7c698bc350 HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe) 
(cherry picked from commit 68e588cbee660d55dba518892d064bee3795a002)
 2015-06-30 16:42:36 -07:00
Andrew Wang
1204140baa HADOOP-12158. Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed. 
(cherry picked from commit b088bc6c8c36ce3fe8b69bc0280fd4ea80ca6328)
 2015-06-30 15:04:23 -07:00
Steve Loughran
6719fc94e1 Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)" 
This reverts commit f02c06965c7caecb64c56c65b03648e998643c67.
 2015-06-30 11:53:03 +01:00
Vinayakumar B
bc06d5b041 HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina) 
(cherry picked from commit 6d99017f38f5a158b5cb65c74688b4c833e4e35f)
 2015-06-30 15:25:58 +05:30
cnauroth
399df10c58 HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit 460e98f7b3ec84f3c5afcb2aad4f4e7031d16e3a)
 2015-06-29 13:49:12 -07:00
Colin Patrick Mccabe
5ff14f2342 HADOOP-12112. Make hadoop-common-project Native code -Wall-clean (alanburlison via cmccabe) 2015-06-29 12:34:47 -07:00
Colin Patrick Mccabe
df58fdaf21 HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 5a27c3fd7616215937264c2b1f015205e60f2d73)
 2015-06-29 12:31:43 -07:00
Vinayakumar B
e4adb191aa HADOOP-12119. hadoop fs -expunge does not work for federated namespace (Contributed by J.Andreina) 
(cherry picked from commit c815344e2e68d78f6587b65bc2db25e151aa4364)
 2015-06-29 15:59:21 +05:30
Vinod Kumar Vavilapalli
4155bb565e Adding release 2.7.2 to CHANGES.txt. 
(cherry picked from commit aad6a7d5dba5858d6e9845f18c4baec16c91911d)
 2015-06-28 16:30:27 -07:00
Steve Loughran
f02c06965c HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel) 2015-06-28 19:13:48 +01:00
Colin Patrick Mccabe
9cf5bd2fad HADOOP-12036. Consolidate all of the cmake extensions in one directory (alanburlison via cmccabe) 
(cherry picked from commit aa07dea3577158b92a17651d10da20df73f54561)
 2015-06-26 12:38:15 -07:00
Harsh J
55427fb66c HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. Contributed by Matt Foley. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389006 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit ac31d6a4485d7ff9074fb5dade7a6cf5292bb347)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-06-26 02:19:08 -07:00
Jonathan Eagles
bb6e28592e HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error occurs (Jason Lowe via jeagles) 
(cherry picked from commit 2236b577a34b069c0d1f91da99f63a199f260ac2)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSystemImpl.java
 2015-06-24 14:54:11 -05:00
Yongjun Zhang
430ba669cc HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang. 
(cherry picked from commit 49f5d20efe7af7cd7c45d93edad33997a695a746)
 2015-06-19 14:46:31 -07:00
Colin Patrick Mccabe
2946e92f79 HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe) 
(cherry picked from commit 6e0a9f92fe0052d39b95a605174b3f6423c6aae7)
 2015-06-18 11:39:28 -07:00
Vinayakumar B
80697e4f32 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 
(cherry picked from commit 295d678be8853a52c3ec3da43d9265478d6632b3)
 2015-06-18 14:45:07 +05:30
Yongjun Zhang
8cac3888c1 HADOOP-11965. determine-flaky-tests needs a summary mode. Contributed by Yufei Gu. 
(cherry picked from commit 74351af3b7521b194116258c96270ddaeccd8126)
 2015-06-17 21:08:55 -07:00
cnauroth
63f3c24bb0 HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay. 
(cherry picked from commit fbf55dcaf45285e1795cb107e7846799e4042b0b)
 2015-06-16 14:44:14 -07:00
Akira Ajisaka
4c6a1509cd HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b578807b9903f3f2056c7064bfe5af8619eb4835)
 2015-06-16 13:38:32 -07:00
Vinod Kumar Vavilapalli
069acdac8a HADOOP-12001. Moving CHANGES.txt up into 2.8. 
(cherry picked from commit 04c9a077c8f88e3d8ed3e7966966e13f68c5c2ec)
 2015-06-15 14:30:07 -07:00
Vinod Kumar Vavilapalli
58d3a9aaf6 HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and GID attributes during the search. Contributed by Patrick White. 
(cherry picked from commit 722aa1db1f2ac3db0e70063022436a90f90643f3)
 2015-06-15 14:25:40 -07:00
Akira Ajisaka
e397cca456 HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to hadoop-common. Contributed by Masatake Iwasaki. 
(cherry picked from commit e4489d97e5f0cec601b93e1b883fa194a7353229)
 2015-06-12 07:26:05 -07:00
Vinayakumar B
7454ed2b59 HADOOP-12074. in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException (Contributed by Lavkesh Lahngir) 
(cherry picked from commit 95c73d49b1bb459b626a9ac52acadb8f5fa724de)
 2015-06-11 12:00:17 +05:30
Vinayakumar B
d21bc811d8 HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() (Contributed by kanaka kumar avvaru) 
(cherry picked from commit 48ca23def1d1c28448a65238814070e79c8f4c4e)
 2015-06-10 11:07:04 +05:30
Arpit Agarwal
2d67dff15f HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal) 2015-06-09 20:58:46 -07:00
cnauroth
f5b0cce7fa HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic. 
(cherry picked from commit c45784bc9031353b938f4756473937cca759b3dc)
 2015-06-08 22:42:24 -07:00
Arpit Agarwal
82e772bdbb HADOOP-12054. RPC client should not retry for InvalidToken exceptions. (Contributed by Varun Saxena) 2015-06-08 15:45:25 -07:00
Steve Loughran
c3c2b4d318 HADOOP-12052 IPC client downgrades all exception types to IOE, breaks callers trying to use them. (Brahma Reddy Battula via stevel) 2015-06-08 13:02:26 +01:00
cnauroth
1d1841d40f HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. 
(cherry picked from commit e46cb800028c95f9bce575d05268cd10d0913222)
 2015-06-06 09:17:11 -07:00
Andrew Wang
1137fd4c5b HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory. Contributed by Zhihai Xu. 
(cherry picked from commit bc11e158b1726174fae2c7d2e8aa1f5005bf42eb)
 2015-06-05 13:52:43 -07:00
Andrew Wang
83a97907cc HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey. 
(cherry picked from commit 2dbc40e6086026ef02747223982aa68f2d328ade)
 2015-06-05 13:11:12 -07:00
Gera Shegalov
2cc2488164 HADOOP-11924. Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) 
(cherry picked from commit 9f6d67844da3c6ca1de66d426790e741e77f8038)
 2015-06-04 11:47:22 -07:00
Arpit Agarwal
75e962f367 HADOOP-11994. smart-apply-patch wrongly assumes that git is infallible. (Contributed by Kengo Seki) 2015-06-04 10:54:12 -07:00
Akira Ajisaka
1cccd1eeb3 HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii. 
(cherry picked from commit dbed757cbaf3ddff0c9ae2d905d42828aadedf2a)
 2015-06-05 01:46:33 +09:00
Vinayakumar B
2ce7659bf0 HADOOP-12019. update BUILDING.txt to include python for 'mvn site' in windows (Contributed by Vinayakumar B) 
(cherry picked from commit 1bb79c9d019ef12585eb1761f477cafcf859b1f0)
 2015-06-04 10:44:04 +05:30
Akira Ajisaka
e02df98f7d HADOOP-12018. smart-apply-patch.sh fails if the patch edits CR+LF files and is created by 'git diff --no-prefix'. Contributed by Kengo Seki. 
(cherry picked from commit b5f0d294f828240ea9a2395db94492e87af0260b)
 2015-06-04 11:16:24 +09:00
Akira Ajisaka
84cae6c101 HADOOP-11991. test-patch.sh isn't re-executed even if smart-apply-patch.sh is modified. Contributed by Kengo Seki. 
(cherry picked from commit a6a8ee3c24e2457ce3ccc9a4a4e2535b223f547e)
 2015-06-03 15:01:52 +09:00
Andrew Wang
52ff1610cd HADOOP-12037. Fix wrong classname in example configuration of hadoop-auth documentation. Contributed by Masatake Iwasaki. 
(cherry picked from commit 990078b927fb1189a99055f3758a4f4f639f2a9d)
 2015-06-01 18:05:06 -07:00
Andrew Wang
600f5f5232 HADOOP-12043. Display warning if defaultFs is not set when running fs commands. Contributed by Eddy Xu. 
(cherry picked from commit 374ddd9f9ea43b0e730a7baab3e51e6893d40420)
 2015-05-29 17:16:19 -07:00
Andrew Wang
bdaa0fed13 HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang) 
(cherry picked from commit 7673d4f205b26a6a26cfc47d999ece96f3c42782)

 Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/pom.xml
	hadoop-mapreduce-project/pom.xml
 2015-05-29 14:55:52 -07:00
Vinayakumar B
09d68d645a HADOOP-12042. Users may see TrashPolicy if hdfs dfs -rm is run (Contributed by Andreina J) 
(cherry picked from commit 7366e4256395ed7550702275d0d9f2674bd43d6c)
 2015-05-29 16:52:23 +05:30
cnauroth
33648268ce HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay. 
(cherry picked from commit 860b8373c3a851386b8cd2d4265dd35e5aabc941)
 2015-05-28 15:01:57 -07:00
cnauroth
39f451e721 HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic. 
(cherry picked from commit 94e7d49a6dab7e7f4e873dcca67e7fcc98e7e1f8)

Conflicts:
	hadoop-project/pom.xml
 2015-05-28 12:32:55 -07:00
Allen Wittenauer
6c71ac7b6b HADOOP-11930. test-patch in offline mode should tell maven to be in offline mode (Sean Busbey via aw) 2015-05-28 12:12:19 -07:00
Colin Patrick Mccabe
4b108a441d HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit a1140959dab3f35accbd6c66abfa14f94ff7dcec)
 2015-05-28 12:03:07 -07:00
Colin Patrick Mccabe
2a56adc550 HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread. (zhouyingchao via cmccabe) 
(cherry picked from commit 246cefa089156a50bf086b8b1e4d4324d66dc58c)
 2015-05-28 11:54:24 -07:00
Allen Wittenauer
1a3ccf4724 HADOOP-12030. test-patch should only report on newly introduced findbugs warnings. (Sean Busbey via aw) 2015-05-28 09:54:17 -07:00
Allen Wittenauer
e6a171e7a2 HADOOP-12035. shellcheck plugin displays a wrong version potentially (Kengo Seki via aw) 2015-05-28 09:11:52 -07:00