Commit Graph

3118 Commits

Author SHA1 Message Date
Arpit Agarwal 3a9808e96c HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru. 2016-10-13 11:37:25 -07:00
Xiaoyu Yao 5abc788825 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
(cherry picked from commit 9097e2efe4)
2016-10-13 10:58:20 -07:00
Andrew Wang 9bde45d2fe HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures.
(cherry picked from commit 12d739a34b)
(cherry picked from commit f131d61ff8)
2016-10-12 15:20:10 -07:00
Kihwal Lee 136c6f6f7d HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah.
(cherry picked from commit 5305a392c3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
2016-10-12 15:38:34 -05:00
Xiao Chen bc5a9931d7 HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key.
(cherry picked from commit b84c4891f9)
2016-10-11 17:05:20 -07:00
Wei-Chiu Chuang 773e2e6b6c HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4b32b1420d)
(cherry picked from commit 56184de510)
2016-10-11 13:22:41 -07:00
Mingliang Liu def48f5228 HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu
(cherry picked from commit de30f13a0a)
2016-10-10 13:40:39 -07:00
Xiao Chen 97105d8733 HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya.
(cherry picked from commit fc18c32540ed6a410adb123e1105729e0343b7f5)
2016-10-10 12:50:59 -07:00
Kai Zheng 583283db25 HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang 2016-10-10 11:45:07 +06:00
Robert Kanter dfc0e3f543 HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter)
(cherry picked from commit c183b9de8d)
2016-10-07 10:51:28 -07:00
Steve Loughran 96cc056cb7 HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran. 2016-10-07 13:22:20 +01:00
Steve Loughran d24933ad3a HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan. 2016-10-07 13:12:04 +01:00
Chris Nauroth e36b665f90 HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth.
(cherry picked from commit 1d330fbaf6)
(cherry picked from commit a28ffd0fde)
2016-10-06 13:24:54 -07:00
Chris Nauroth b9ce40e12c HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran.
(cherry picked from commit 2d46c3f6b7)
(cherry picked from commit ecccb114ae)
2016-10-06 10:57:15 -07:00
Brahma Reddy Battula a4ee4f9e51 HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen
(cherry picked from commit b90fc70d67)
2016-10-06 17:49:48 +05:30
Akira Ajisaka c0699a1f55 HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao.
(cherry picked from commit 9a61b52fbe)
(cherry picked from commit bdbb75e083)
2016-10-05 20:41:51 +09:00
Xiao Chen bf043e63f9 HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen.
(cherry picked from commit 853d65a157)
2016-10-03 16:02:11 -07:00
Xiao Chen b1eb21e940 HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya.
(cherry picked from commit 89bd6d29a6)
2016-09-30 17:52:17 -07:00
Wei-Chiu Chuang 9a79c54867 HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark.
(cherry picked from commit 57aec2b46b)
(cherry picked from commit a6863e5334)
2016-09-30 13:29:59 -07:00
Chris Nauroth 1085b3ee45 Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin."
This reverts commit 06df0cd87f.
2016-09-29 13:58:35 -07:00
Kihwal Lee d60b4648dc HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp.
(cherry picked from commit 236ac773c9)
(cherry picked from commit 92336ea37e)
2016-09-29 13:58:17 -05:00
Steve Loughran 1c8e388181 HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri 2016-09-29 11:35:54 +01:00
Kihwal Lee 7091753bd2 HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp.
(cherry picked from commit e19b37ead2)
2016-09-28 10:03:24 -05:00
Brahma Reddy Battula 5f754e8638 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki
(cherry picked from commit e9a34ae29c)
2016-09-28 11:16:40 +05:30
Mingliang Liu ecb5f282ea HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang
(cherry picked from commit 9a44a832a9)
2016-09-27 17:42:01 -07:00
Wangda Tan 69f91d8c48 HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
(cherry picked from commit 875062b5bc)
(cherry picked from commit 269401dc83)
2016-09-27 11:46:49 -07:00
Xiao Chen 09964a1629 HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang.
(cherry picked from commit fa397e74fe)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit 06187e4f98)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2016-09-26 13:04:29 -07:00
Brahma Reddy Battula fa042ff9af HADOOP-12597. In kms-site.xml configuration hadoop.security.keystore.JavaKeyStoreProvider.password should be updated with new name. ( Contributed by Surendra Singh Lilhore via Brahma Reddy Battula) 2016-09-26 23:19:36 +05:30
Wei-Chiu Chuang 6ca5ffe4b5 HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2. Contributed by Min Shen.
(cherry picked from commit 23984e1787)
2016-09-23 14:28:00 -07:00
Brahma Reddy Battula aa967869a5 HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document.
(cherry picked from commit bbdf350ff9)
2016-09-23 19:35:34 +05:30
Mingliang Liu c7bd564b79 HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani.
(cherry picked from commit e80386d69d)
2016-09-20 13:24:02 -07:00
Xiao Chen 900dc70a01 HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
(cherry picked from commit ea839bd48e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml

(cherry picked from commit 20585ade1d9d7fbd8b9df8b1e3db5a74fd4441a6)
2016-09-19 16:38:00 -07:00
Xiao Chen a7f1dc8aa8 HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen.
(cherry picked from commit 680be58aac)
(cherry picked from commit d157733082)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java
2016-09-19 12:52:58 -07:00
Wei-Chiu Chuang c7b79e8d91 HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang.
(cherry picked from commit f6f3a447bf)
(cherry picked from commit 031d5f6c5b)
2016-09-16 14:56:55 -07:00
Akira Ajisaka 06d82ffb76 HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
(cherry picked from commit 7cad7b7046)
(cherry picked from commit e485ace0dd)
2016-09-15 23:43:57 +09:00
Steve Loughran 6a7ce4ee52 HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran 2016-09-14 15:44:20 +01:00
Jing Zhao 26597aa59b HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.
(cherry picked from commit 08d8e0ba25)
(cherry picked from commit 55600b38a8)
2016-09-13 11:15:51 -07:00
Yongjun Zhang b96e2cbd20 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang)
(cherry picked from commit d2466ec3e0)
2016-09-12 22:13:17 -07:00
Arpit Agarwal ed35f99045 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:34:28 -07:00
Arpit Agarwal 04f620c4d0 HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang. 2016-09-10 18:01:37 -07:00
Kihwal Lee 4b9845bc53 HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp.
(cherry picked from commit d4d076876a)
(cherry picked from commit d234990208)
2016-09-09 10:48:05 -05:00
Kihwal Lee 56340ac029 HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp.
(cherry picked from commit 39d1b1d747)
2016-09-06 10:19:34 -05:00
Kihwal Lee 20eb5386d9 HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp.
(cherry picked from commit 28ea4122f0)
2016-09-02 11:14:39 -05:00
Ray Chiang 2dd809eada Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)"
This reverts commit 9ad3a7a43b.
2016-09-01 15:10:37 -07:00
Kihwal Lee af26fba62e HADOOP-13473. Tracing in IPC Server is broken. Contributed by Daryn Sharp.
(cherry picked from commit caf800d529)
2016-09-01 16:19:10 -05:00
Kihwal Lee 2ff6b13e69 HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
(cherry picked from commit 76cd81f4b6)
2016-09-01 16:11:45 -05:00
Kihwal Lee a4292fe618 HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp.
(cherry picked from commit 580a833496)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/ProtobufRpcEngine.java
2016-09-01 16:00:55 -05:00
Kihwal Lee 983d47ecb3 HADOOP-13429. Dispose of unnecessary SASL servers. Contributed by Daryn Sharp.
(cherry picked from commit b3018e73cc)
2016-09-01 15:59:53 -05:00
Kihwal Lee afc8da0d86 HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp.
(cherry picked from commit 2d8227605f)
2016-09-01 15:59:40 -05:00
Mingliang Liu 22e182f295 HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang)
(cherry picked from commit dcd21d083a)
(cherry picked from commit 4d709be8c9)
2016-09-01 11:14:57 -07:00