Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,305 Commits 326 Branches 371 Tags
Commit Graph

2964 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze
7e0824faa9 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:20:10 -07:00
Colin Patrick Mccabe
b16c376c3b HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 2beedead72ee9efb69218aaf587de585158d6a1c)
 2016-05-02 09:43:42 -07:00
Robert Kanter
ac8fb579c6 Remove parent's env vars from child processes 2016-04-29 09:26:09 -07:00
Andrew Wang
7271e91b79 HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen. 2016-04-27 17:13:50 -07:00
Lei Xu
4289cb8b36 HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 0a152103f19a3e8e1b7f33aeb9dd115ba231d7b7)
 2016-04-27 15:06:35 -07:00
Arpit Agarwal
14b8701a63 HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor) 2016-04-27 10:07:08 -07:00
Jian He
9d3ddb0b4d YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode 
(cherry picked from commit 4beff013546dbc29c004a1bad1b019dc9d2b751f)
 2016-04-26 21:02:04 -07:00
Arpit Agarwal
dba737f1e5 HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:46:47 -07:00
Masatake Iwasaki
c12fcbde44 HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang. 
(cherry picked from commit 68b4564e78380a2fac1a9000fb862104d4bc86e5)
 2016-04-27 10:48:26 +09:00
Tsz-Wo Nicholas Sze
d316f44059 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-04-26 17:21:20 -07:00
Masatake Iwasaki
5bceaa9683 HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims) 
(cherry picked from commit bec5b4cd8c1fb27a5b707d601b508224a9c107ed)
 2016-04-25 22:46:50 +09:00
Ravi Prakash
88e1427a03 HDFS-9525. hadoop utilities need to support provided delegation tokens. Contributed by HeeSoo Kim 2016-04-23 20:50:56 -07:00
Akira Ajisaka
5949436010 HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor. 
(cherry picked from commit c610031cabceebe9fe63106471476be862d6013c)
 2016-04-23 06:20:44 +09:00
Kihwal Lee
d0718ed466 HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 
(cherry picked from commit 9dbdc8e12d009e76635b2d20ce940851725cb069)
 2016-04-22 15:03:56 -05:00
Steve Loughran
edcb2a8410 HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel) 2016-04-22 11:24:50 +01:00
Larry McCay
a0605ff002 HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers 2016-04-21 20:16:08 -07:00
Jing Zhao
5353289c8c HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou. 
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
 2016-04-21 20:16:02 -07:00
Xiaoyu Yao
432531dcf7 HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou. 
(cherry picked from commit b4be288c5d6801988f555a566c2eb793c88a15a4)
 2016-04-21 10:19:35 -07:00
Xiaoyu Yao
a2a65922dd HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 
(cherry picked from commit 5bd7b592e5fbe4d448fd127c15d29f3121b8a833)
 2016-04-20 23:11:42 -07:00
Steve Loughran
8d11a771b3 HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2016-04-15 17:43:52 +01:00
Akira Ajisaka
5ae74507c0 HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi. 
(cherry picked from commit 6e6b6dd5aaf93cfb373833cd175ee722d2cb708f)
 2016-04-15 14:15:33 +09:00
Steve Loughran
e124c3a2ae HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:45:10 +01:00
Steve Loughran
a59e05ad0a HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:20 +01:00
Akira Ajisaka
03bf09865f HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor. 
(cherry picked from commit 27b131e79c5fa99de3ed4fb529d854dd5da55bde)
 2016-04-14 10:57:50 +09:00
Robert Kanter
d9d12b9e72 HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter) 
(cherry picked from commit 042a3ae960883c263adc76f16d0ea3438d8b12be)
 2016-04-13 17:42:28 -07:00
Xiaoyu Yao
42040f706a HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8ced42daff5cd0cb11d26042ae8c8255ef629a40)
 2016-04-13 16:42:55 -07:00
Colin Patrick Mccabe
2b0b332e2f HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe) 
(cherry picked from commit 35f07705552ef5636f8b8d2599a6af5ec1426203)
 2016-04-12 16:29:15 -07:00
Akira Ajisaka
bb1ed426d1 HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang. 2016-04-12 15:28:05 +09:00
Akira Ajisaka
8f968171bd HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran. 
(cherry picked from commit a409508b3f4c46b419c41b9cdff83429d9d025ce)
 2016-04-12 14:55:25 +09:00
Vinod Kumar Vavilapalli
4041d2b49e HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba. 
(cherry picked from commit 069c6c62def4a0f94382e9f149581d8e22f6d31c)
 2016-04-11 12:03:39 -07:00
Chris Nauroth
26a23eff82 HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran. 
(cherry picked from commit 843ee8d59d8bacbca0d87ccf0790772e39d16138)
 2016-04-08 13:37:46 -07:00
Steve Loughran
c8797e0e39 HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel) 2016-04-08 12:59:01 +01:00
Andrew Wang
2f983b161f HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen. 
(cherry picked from commit 594c70f779b277bd0b9d0a5dc98c3e9cc49b7e91)
 2016-04-07 23:50:36 -07:00
Tsz-Wo Nicholas Sze
46352de1a2 HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou 2016-04-07 14:49:48 +08:00
Suresh Srinivas
d72db7d3aa HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
 2016-04-07 14:39:22 +08:00
Vinayakumar B
aea518ef30 Addendum : HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B) 2016-04-07 14:33:48 +08:00
Vinayakumar B
c2b271fe05 HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B 
This closes #91

(cherry picked from commit 8d29e2451f5ca60f864c7ece16722c0abdd1c657)
 2016-04-07 10:17:43 +05:30
Jian He
42bc565630 YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev 2016-04-06 16:14:13 -07:00
Akira Ajisaka
1371f993a9 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer. 2016-04-06 17:43:31 +09:00
Masatake Iwasaki
2542e9bccf HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 85ec5573eb9fd746a9295ecc6fe1ae683073aaf5)
 2016-04-06 03:26:33 +09:00
Kihwal Lee
ef3da82357 HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
 2016-04-05 09:16:05 -05:00
Arpit Agarwal
30e12edb67 HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:28 -07:00
Steve Loughran
20e808d83e HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:39:51 +01:00
Akira Ajisaka
80d122d7fe HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula. 
(cherry picked from commit a8d8b80a205c78bf0aa65d32a6a83c16d3ea3f0b)
 2016-04-01 13:59:45 +09:00
Xiaoyu Yao
ab9dc84d4a HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao. 
(cherry picked from commit aac4d65bf9c6d68f53610e5fe9997a391e3fa053)
(cherry picked from commit dc78250aa4ba17e3ddaf0c5c0b0457ba7023c4cb)
 2016-03-31 15:50:17 -07:00
Jian He
3afc2caec8 YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage 2016-03-31 14:31:38 -07:00
Xiaoyu Yao
6db3c9d394 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao. 
(cherry picked from commit d95c6eb32cec7768ac418fb467b1198ccf3cf0dc)
(cherry picked from commit a0c001c0b95f9c98b747f0534c33e3725940adab)
 2016-03-31 09:05:37 -07:00
Akira Ajisaka
b4fbc22688 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak. 
(cherry picked from commit acca149ec96f2932bebc492452a63a159de9ce47)
 2016-03-31 16:05:51 +09:00
Zhe ZHang
9216993b02 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang. 2016-03-30 14:14:05 -07:00
Colin Patrick Mccabe
9df2e54160 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe) 
(cherry picked from commit e3d15a2e236f93325c67f9e52fb16f645c44238a)
 2016-03-29 17:14:36 -07:00