Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,368 Commits 326 Branches 371 Tags
Commit Graph

2986 Commits

Author SHA1 Message Date
Andrew Wang
d6f6b99c83 HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu. 
(cherry picked from commit 3bfd29949fef6d8fb5df4c6398e77cde320d8c2d)
 2016-05-12 23:48:58 -07:00
Steve Loughran
1370dfc775 HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel 
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
 2016-05-12 19:23:31 +01:00
Sangjin Lee
d6d13ec670 YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale) 
(cherry picked from commit 0bbe01f8d56191edfba3b50fb9f8859a0b3f826f)
 2016-05-12 10:14:24 -07:00
Steve Loughran
257b2f5beb HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel. 2016-05-12 13:57:05 +01:00
Colin Patrick Mccabe
15bfcde238 HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe) 
(cherry picked from commit 687233f20d24c29041929dd0a99d963cec54b6df)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
 2016-05-11 14:02:03 -07:00
Larry McCay
788f80b617 HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay) 2016-05-11 14:38:21 -04:00
Chris Nauroth
31279ae45e HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay. 
(cherry picked from commit dee279b532e7286362518b531c9daea9ae8606f4)
 2016-05-11 10:58:42 -07:00
Steve Loughran
0ff3ec1f67 HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel) 2016-05-11 14:19:41 +01:00
Tsuyoshi Ozawa
eb4182f8f5 HADOOP-10694. Remove synchronized input streams from Writable deserialization. Contributed by Gopal V and Rajesh Balamohan. 
(cherry picked from commit 6e565780315469584c47515be6bd189f07840f1b)
 2016-05-10 17:27:43 -07:00
Eric Payne
de4daf9d22 YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts. 
(cherry picked from commit 6b1c1cb01cbf979f46cd3ea9308b7745c5595b4f)
 2016-05-10 21:37:24 +00:00
Steve Loughran
f47ea0cc3f HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel) 2016-05-10 21:40:13 +01:00
Steve Loughran
092b199741 HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel). 2016-05-10 21:33:11 +01:00
Akira Ajisaka
7cbf306e4c HADOOP-13118. Fix IOUtils#cleanup and IOUtils#closeStream javadoc. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 0f0c6415af409d213e7a132390a850c1251b92ef)
 2016-05-10 10:03:41 -07:00
Harsh J
e2216a96d7 HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388893 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 28023b77595991fe3be590a929b7d162556f1d4a)
 2016-05-10 09:49:00 -07:00
Andrew Wang
1d563f4d7e HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge. 
(cherry picked from commit 8ef75a702e3b4b8ca7794421c44da7f8d44daa4c)
 2016-05-06 17:23:31 -07:00
Xiaoyu Yao
35859872b7 HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit dacd1f50feb24ccdf6155b2b7a6126fe21a47ad0)
 2016-05-05 18:15:32 -07:00
Xiaoyu Yao
d18a991817 HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao) 
(cherry picked from commit 4e5e87ddd4a47dbea2b23387782e7cd47dec560e)
 2016-05-05 17:58:41 -07:00
Tsz-Wo Nicholas Sze
b66b85094a HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 15:50:50 -07:00
Ming Ma
5b53833171 HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma) 
(cherry picked from commit 1268cf5fbe4458fa75ad0662512d352f9e8d3470)
 2016-05-04 17:04:44 -07:00
Arpit Agarwal
cb0a035bd1 HADOOP-13068. Clean up RunJar and related test class. (Contributed by Andras Bokor) 2016-05-04 09:49:51 -07:00
Masatake Iwasaki
2d01ffaf24 HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang. 
(cherry picked from commit 355325bcc7111fa4aac801fd23a26422ffabaf7c)
 2016-05-04 15:18:41 +09:00
Chris Douglas
a50dc05a60 HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri 
(cherry picked from commit c1cc6ac667e9e1b2ed58f16cb9fa1584ea54f0ac)
 2016-05-02 22:37:36 -07:00
Tsz-Wo Nicholas Sze
7e0824faa9 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:20:10 -07:00
Colin Patrick Mccabe
b16c376c3b HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 2beedead72ee9efb69218aaf587de585158d6a1c)
 2016-05-02 09:43:42 -07:00
Robert Kanter
ac8fb579c6 Remove parent's env vars from child processes 2016-04-29 09:26:09 -07:00
Andrew Wang
7271e91b79 HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen. 2016-04-27 17:13:50 -07:00
Lei Xu
4289cb8b36 HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 0a152103f19a3e8e1b7f33aeb9dd115ba231d7b7)
 2016-04-27 15:06:35 -07:00
Arpit Agarwal
14b8701a63 HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor) 2016-04-27 10:07:08 -07:00
Jian He
9d3ddb0b4d YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode 
(cherry picked from commit 4beff013546dbc29c004a1bad1b019dc9d2b751f)
 2016-04-26 21:02:04 -07:00
Arpit Agarwal
dba737f1e5 HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:46:47 -07:00
Masatake Iwasaki
c12fcbde44 HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang. 
(cherry picked from commit 68b4564e78380a2fac1a9000fb862104d4bc86e5)
 2016-04-27 10:48:26 +09:00
Tsz-Wo Nicholas Sze
d316f44059 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-04-26 17:21:20 -07:00
Masatake Iwasaki
5bceaa9683 HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims) 
(cherry picked from commit bec5b4cd8c1fb27a5b707d601b508224a9c107ed)
 2016-04-25 22:46:50 +09:00
Ravi Prakash
88e1427a03 HDFS-9525. hadoop utilities need to support provided delegation tokens. Contributed by HeeSoo Kim 2016-04-23 20:50:56 -07:00
Akira Ajisaka
5949436010 HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor. 
(cherry picked from commit c610031cabceebe9fe63106471476be862d6013c)
 2016-04-23 06:20:44 +09:00
Kihwal Lee
d0718ed466 HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 
(cherry picked from commit 9dbdc8e12d009e76635b2d20ce940851725cb069)
 2016-04-22 15:03:56 -05:00
Steve Loughran
edcb2a8410 HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel) 2016-04-22 11:24:50 +01:00
Larry McCay
a0605ff002 HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers 2016-04-21 20:16:08 -07:00
Jing Zhao
5353289c8c HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou. 
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
 2016-04-21 20:16:02 -07:00
Xiaoyu Yao
432531dcf7 HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou. 
(cherry picked from commit b4be288c5d6801988f555a566c2eb793c88a15a4)
 2016-04-21 10:19:35 -07:00
Xiaoyu Yao
a2a65922dd HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 
(cherry picked from commit 5bd7b592e5fbe4d448fd127c15d29f3121b8a833)
 2016-04-20 23:11:42 -07:00
Steve Loughran
8d11a771b3 HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2016-04-15 17:43:52 +01:00
Akira Ajisaka
5ae74507c0 HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi. 
(cherry picked from commit 6e6b6dd5aaf93cfb373833cd175ee722d2cb708f)
 2016-04-15 14:15:33 +09:00
Steve Loughran
e124c3a2ae HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:45:10 +01:00
Steve Loughran
a59e05ad0a HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:20 +01:00
Akira Ajisaka
03bf09865f HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor. 
(cherry picked from commit 27b131e79c5fa99de3ed4fb529d854dd5da55bde)
 2016-04-14 10:57:50 +09:00
Robert Kanter
d9d12b9e72 HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter) 
(cherry picked from commit 042a3ae960883c263adc76f16d0ea3438d8b12be)
 2016-04-13 17:42:28 -07:00
Xiaoyu Yao
42040f706a HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8ced42daff5cd0cb11d26042ae8c8255ef629a40)
 2016-04-13 16:42:55 -07:00
Colin Patrick Mccabe
2b0b332e2f HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe) 
(cherry picked from commit 35f07705552ef5636f8b8d2599a6af5ec1426203)
 2016-04-12 16:29:15 -07:00
Akira Ajisaka
bb1ed426d1 HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang. 2016-04-12 15:28:05 +09:00