Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,617 Commits 326 Branches 371 Tags
Commit Graph

3016 Commits

Author SHA1 Message Date
Wangda Tan
69f91d8c48 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 
(cherry picked from commit 875062b5bc789158290bf93dadc71b5328ca4fee)
(cherry picked from commit 269401dc83699e4de7b99e794eeb7646a7f3fc93)
 2016-09-27 11:46:49 -07:00
Wei-Chiu Chuang
6ca5ffe4b5 HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2. Contributed by Min Shen. 
(cherry picked from commit 23984e17870bcff6fffd8e1ca185fd37e2352b29)
 2016-09-23 14:28:00 -07:00
Brahma Reddy Battula
aa967869a5 HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document. 
(cherry picked from commit bbdf350ff9fb624fe736c1eb9271c5dcb4e14b06)
 2016-09-23 19:35:34 +05:30
Mingliang Liu
c7bd564b79 HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani. 
(cherry picked from commit e80386d69d5fb6a08aa3366e42d2518747af569f)
 2016-09-20 13:24:02 -07:00
Xiao Chen
900dc70a01 HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 
(cherry picked from commit ea839bd48e4478fc7b6d0a69e0eaeae2de5e0f0d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml

(cherry picked from commit 20585ade1d9d7fbd8b9df8b1e3db5a74fd4441a6)
 2016-09-19 16:38:00 -07:00
Xiao Chen
a7f1dc8aa8 HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen. 
(cherry picked from commit 680be58aac03a9ffab6b07c8fde9602ddb9dc858)
(cherry picked from commit d157733082697e67be56f516606a0127f5830c58)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java
 2016-09-19 12:52:58 -07:00
Akira Ajisaka
06d82ffb76 HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki. 
(cherry picked from commit 7cad7b704644f260688eb0d4d92413f3a8630f25)
(cherry picked from commit e485ace0dd30c684d3432c49ccc20496270f7aea)
 2016-09-15 23:43:57 +09:00
Steve Loughran
6a7ce4ee52 HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran 2016-09-14 15:44:20 +01:00
Jing Zhao
26597aa59b HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou. 
(cherry picked from commit 08d8e0ba259f01465a83d8db09466dfd46b7ec81)
(cherry picked from commit 55600b38a81b822f2bdc5d71dbfb1b7336c2c024)
 2016-09-13 11:15:51 -07:00
Yongjun Zhang
b96e2cbd20 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit d2466ec3e01b5ef2a0bde738232c5ad6d2d956eb)
 2016-09-12 22:13:17 -07:00
Arpit Agarwal
ed35f99045 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:34:28 -07:00
Arpit Agarwal
04f620c4d0 HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang. 2016-09-10 18:01:37 -07:00
Kihwal Lee
4b9845bc53 HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp. 
(cherry picked from commit d4d076876a8d0002bd3a73491d8459d11cb4896c)
(cherry picked from commit d2349902081c32010e10ce67bdc33d8cb9423fa6)
 2016-09-09 10:48:05 -05:00
Kihwal Lee
56340ac029 HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp. 
(cherry picked from commit 39d1b1d747b1e325792b897b3264272f32b756a9)
 2016-09-06 10:19:34 -05:00
Kihwal Lee
20eb5386d9 HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp. 
(cherry picked from commit 28ea4122f087581f5a7b1bea753f253af5ea0cc7)
 2016-09-02 11:14:39 -05:00
Ray Chiang
2dd809eada Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)" 
This reverts commit 9ad3a7a43b35dd4bb9d10bd322fbb956d3b01ff2.
 2016-09-01 15:10:37 -07:00
Kihwal Lee
af26fba62e HADOOP-13473. Tracing in IPC Server is broken. Contributed by Daryn Sharp. 
(cherry picked from commit caf800d5290d8618003b764afb0b3ef8d9a5a0a8)
 2016-09-01 16:19:10 -05:00
Kihwal Lee
2ff6b13e69 HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp. 
(cherry picked from commit 76cd81f4b656f0d40a4b2122e15f04ea53d8020b)
 2016-09-01 16:11:45 -05:00
Kihwal Lee
a4292fe618 HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp. 
(cherry picked from commit 580a8334963709e728ed677c815fb7fef9bca70e)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/ProtobufRpcEngine.java
 2016-09-01 16:00:55 -05:00
Kihwal Lee
983d47ecb3 HADOOP-13429. Dispose of unnecessary SASL servers. Contributed by Daryn Sharp. 
(cherry picked from commit b3018e73ccae43484d9cb85eabae814eb7f050a6)
 2016-09-01 15:59:53 -05:00
Kihwal Lee
afc8da0d86 HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp. 
(cherry picked from commit 2d8227605fe22c1c05f31729edc8939013763c05)
 2016-09-01 15:59:40 -05:00
Mingliang Liu
22e182f295 HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang) 
(cherry picked from commit dcd21d083ab2a66fc3ca3bfda03887461698b7b1)
(cherry picked from commit 4d709be8c9db236bc7f473e7f31ecd8385211c01)
 2016-09-01 11:14:57 -07:00
Ray Chiang
9ad3a7a43b YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang) 
(cherry picked from commit 05ede003868871addc30162e9707c3dc14ed6b7a)
(cherry picked from commit 3b19bcb8f0f70606a8080bc46fa64cd34f6280d7)
 2016-08-29 16:15:39 -07:00
Mingliang Liu
250ddf155f HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri) 
(cherry picked from commit 6fcb04c1780ac3dca5b986f1bcd558fffccb3eb9)
 2016-08-29 13:05:34 -07:00
Jason Lowe
b1979bec51 HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe 
(cherry picked from commit 92d8f371553b88e5b3a9d3354e93f75d60d81368)
 2016-08-29 15:58:34 +00:00
Wei-Chiu Chuang
bd729af8a8 HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-24 08:53:43 -07:00
Akira Ajisaka
f871aed87e HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin. 
(cherry picked from commit 092b4d5bfd02131d62723fc5673892305eb9fcef)
(cherry picked from commit 2321b73037fcf7ea9ee60c1a94838233c3df8908)
 2016-08-24 16:50:28 +09:00
Zhe Zhang
8bc33bf343 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 
(cherry picked from commit dfcbc12026b591745a7d7279f2b840152cb53a91)
 2016-08-23 14:46:47 -07:00
Masatake Iwasaki
80d8e79e26 HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu. 
(cherry picked from commit 8aae8d6bf03ade0607547ed461dc99a336a7e9d4)
 2016-08-24 00:10:37 +09:00
Xiao Chen
0f9bed050d HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen. 
(cherry picked from commit 2f21d53e3aaf97f425f954f52b50f36dddb6b886)
 2016-08-22 14:42:20 -07:00
Mingliang Liu
9d304822f6 HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang) 
(cherry picked from commit 115ecb52a86b49aad3d058a6b4c1c7926b8b0a40)
 2016-08-21 09:42:06 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
b2efb2040c HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan. 
(cherry picked from commit 99603e902244f17b04cfd55122f47355d070b588)
 2016-08-19 19:11:04 -07:00
Kihwal Lee
4f3df8e22a HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 
(cherry picked from commit ae90d4dd908cf3f9e9ff26fa8e92f028057a9ca1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/webhdfs/WebHdfsHandler.java
 2016-08-19 15:32:11 -05:00
Chris Nauroth
dd6c149c4a HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran. 
(cherry picked from commit 763f0497bb996e331e40caed9ca0af966f5b3fac)
(cherry picked from commit 6dba38f08ba84109b01c8ce8d30c71354d089dbe)
 2016-08-19 12:55:57 -07:00
Jing Zhao
5d91f9fe35 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou. 
(cherry picked from commit 9fdd1ea72497f7a8aadbfedeba36688e0c16c52e)
 2016-08-18 15:00:17 -07:00
Mingliang Liu
ef38aa64c6 HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu) 
(cherry picked from commit 0f51eae0c085ded38216824377acf8122638c3a5)
 2016-08-18 14:22:58 -07:00
Steve Loughran
c09797ce9f HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie 2016-08-18 14:35:26 +01:00
Mingliang Liu
00eb790622 HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-16 17:41:51 -07:00
Mingliang Liu
b6d92c61fe Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)" 
This reverts commit 657064e59397feb92cec95094ac34c85e3040c50.
 2016-08-16 16:27:36 -07:00
Andrew Wang
8b6eeb2595 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 
(cherry picked from commit 4b689e7a758a55cec2ca8398727feefc8ac21bfd)
(cherry picked from commit c91e6f28283d1f8ad4504a2338a01e284ced6b24)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java
 2016-08-16 15:14:06 -07:00
Mingliang Liu
657064e593 HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-15 20:46:40 -07:00
Mingliang Liu
0b934c375e HDFS-10678. Documenting NNThroughputBenchmark tool. (Contributed by Mingliang Liu) 2016-08-15 20:46:28 -07:00
Mingliang Liu
6471ec31bc HDFS-10724. Document caller context config keys. (Contributed by Mingliang Liu) 
(cherry picked from commit 4bcbef39f7ca07601092919a7f2bea531a2dfa07)
 2016-08-15 20:46:03 -07:00
Varun Saxena
6fed7b9c45 HADOOP-13333. testConf.xml ls comparators in wrong order (Vrushali C via Varun Saxena) 2016-08-16 03:14:24 +05:30
Zhe Zhang
b8b4ea67d8 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen. 
(cherry picked from commit ccff6035f50769eb69701128ae61efc69e82609d)
(cherry picked from commit 7d402692b4b06af0459ea81129e93a5182291a27)
 2016-08-11 12:42:17 -07:00
Xiaoyu Yao
cc49133281 HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao. 
(cherry picked from commit 0761379fe45898c44c8f161834c298ef932e4d8c)
 2016-08-10 15:19:04 -07:00
Wei-Chiu Chuang
753edc4931 HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah. 
(cherry picked from commit 8efd4959f3fd48fe281aa26a46668071461dee8b)
 2016-08-10 11:39:12 -07:00
Karthik Kambatla
5ea35b2af2 HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha) 
(cherry picked from commit 85422bb7c5d3e70a49f620ba1c8800e0ba4b64f2)
(cherry picked from commit 2df34ab6e261613526bc7b8e4ef303617f89c758)
 2016-08-09 13:47:42 -07:00
Masatake Iwasaki
a9d957d77d HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang. 
(cherry picked from commit 8f9b61852bf6600b65e49875fec172bac9e0a85d)
 2016-08-09 10:06:14 +09:00
Arpit Agarwal
5006083806 HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang) 2016-08-08 12:31:19 -07:00