2480 Commits

Author SHA1 Message Date
Xiao Chen
67e87c9aff HADOOP-14474. Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures. Contributed by Akira Ajisaka.
(cherry picked from commit 5e40efe0ec38f1e1228846a5448d93bf040868ff)
(cherry picked from commit d946387850ae2fe383df90dd2722560986236e31)

Conflicts:
	dev-support/docker/Dockerfile
2017-06-02 09:36:08 -07:00
Kihwal Lee
01cdea732f HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B. 2017-06-01 12:41:00 -05:00
Steve Loughran
f225b5514f HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2017-05-24 19:00:18 -07:00
Amar Kamat
61ba70c978 HADOOP-7851. Configuration.getClasses() never returns the default value. (amarrk)
(cherry picked from commit 82d57ee7fee82919b42066af38063a27d0998806)
2017-05-24 17:19:54 -07:00
Brahma Reddy Battula
7ae1bc3c20 HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
(cherry picked from commit 52661e0912a79d1e851afc2b46c941ce952ca63f)
2017-05-24 00:04:25 +08:00
Chris Douglas
2b58fb8b03 HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak
(cherry picked from commit ef9e536a7137d209985d25a4769712c2db2c52bf)
(cherry picked from commit 4bb056544341726dd051353f1cc8430b801bf391)
(cherry picked from commit 475b50b44cebf5e5b4622e4092f4a447569b1b2b)
2017-05-17 17:30:20 -07:00
Brahma Reddy Battula
3004358639 HDFS-8312. Trash does not descent into child directories to check for permissions. Contributed By Weiwei Yang via Eric Yang. 2017-05-16 23:27:57 +05:30
Jason Lowe
3252064eac HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan
(cherry picked from commit 7bc217224891b7f7f0a2e35e37e46b36d8c5309d)
2017-05-12 17:04:31 -05:00
Chris Douglas
db72660f30 HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri
(cherry picked from commit e59f6fad6a8849cfab6acbf012f338d9cc7dd63c)

# Conflicts:
#	hadoop-common-project/hadoop-common/CHANGES.txt
2017-05-10 20:48:38 -07:00
Konstantin V Shvachko
f30484e042 Update CHANGES.txt for HADOOP-11703. 2017-05-10 20:01:43 -07:00
Konstantin V Shvachko
834d4217b7 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe).
HADOOP-14408. Backport contributed by Erik Krogen.

(cherry picked from commit bf780406f2b30e627bdf36ac07973f6931f81106)
(cherry picked from commit 56c997a1a61188693ed306b3ceddb13a2f2e6456)
(cherry picked from commit 04682cc6b00e2ba9c0a0a3d1f71a06f36cd4c1a9)
2017-05-10 19:16:01 -07:00
Akira Ajisaka
2875462c2b
HADOOP-14100. Upgrade Jsch jar to latest version to fix vulnerability in old versions. Contributed by Vinayakumar B and Brahma Reddy Battula. 2017-05-09 11:47:28 -05:00
Akira Ajisaka
0187892151
HADOOP-14374. License error in GridmixTestUtils.java. Contributed by lixinglong.
(cherry picked from commit c60164fb60d3d8afb0fb8410936ccc231c4593f9)
(cherry picked from commit 753954f7beb3a1ca4a60cc3f59c809aed3839dd2)
2017-05-09 05:43:12 -05:00
Akira Ajisaka
60e74edd05
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong.
(cherry picked from commit 20cde552748cc6be1c5ca590755d4e5a67baf187)
(cherry picked from commit 036624900be0bcc2af7f60a28a72cea0295f7300)
2017-05-02 23:41:17 +09:00
John Zhuge
fac5bdc023 HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar.
(cherry picked from commit 128015584d69492806fd1700c8f840d78aa9c729)
(cherry picked from commit a92f654aa2859dd962b6d75f4b25a7f8344cc7aa)
2017-04-12 20:05:15 -07:00
Steve Loughran
7a3f9e8fac HADOOP-14066 VersionInfo should be marked as public API
(cherry picked from commit 2ed65540a3fe73db5d2dd0d25e658ccf13c9188a)
2017-04-11 15:06:48 -07:00
Andrew Wang
60a3a63990 HADOOP-14293. Initialize FakeTimer with a less trivial value.
(cherry picked from commit be144117a885cb39bc192279c96cbe3790dc77b1)
(cherry picked from commit dab1deb9a0c96471b6da4ef95be86cbc81d55305)
2017-04-10 11:37:38 -07:00
Zhe Zhang
e5d5d0ddb5 HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen.
(cherry picked from commit 95b7f1d29a5e2dadd70a56fca5faa006c5bd74fc)
(cherry picked from commit c85026038a6ef8d38b7a8563fbb64ac6edd1d4ce)
(cherry picked from commit ef8b30dd4beb8baf59f70e81ee938d7852922a42)
2017-04-07 10:59:44 -07:00
Andrew Wang
295aab8e3a HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen.
(cherry picked from commit 0e556a5ba645570d381beca60114a1239b27d49f)
(cherry picked from commit 96fe940e59127dc7c3e4182c3ed450c3cd8d858e)
(cherry picked from commit 5130128a31a75587f6ccca08c487e44f73685227)
2017-03-24 11:38:39 -07:00
Zhe Zhang
4cc53b51f6 HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen.
(cherry picked from commit 59d69257a888347f0fb9c51bb000afc986b64f98)
(cherry picked from commit f98f4bb6ca45e6f807ca747d673690232e39da52)
(cherry picked from commit 8ca9915d0f833bff6dae75fdcd071b6ae79b6320)
2017-03-22 22:48:04 -07:00
Erik Krogen
1d035c8149 HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen.
(cherry picked from commit e1a99802fc5c2f2ad3ceb000378db1c0133069b3)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFs.java
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/viewfs/ViewFsBaseTest.java
2017-03-17 17:38:03 -07:00
Jason Lowe
39b483e065 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
(cherry picked from commit 05237636d3a359dc502e8fa2d66bfdcea274f86c)
2017-03-03 08:03:05 -06:00
Steve Loughran
c67d2f96da HADOOP-14138. Remove S3A ref from META-INF service discovery, rely on existing core-default entry.
Contributed by Steve Loughran

(cherry picked from commit 51fefbe38bf40373d2855163fa6444821b0f994c)
2017-03-02 16:01:29 -06:00
Xiao Chen
18dfff8a3c HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-02-08 23:48:24 -08:00
Eric Yang
b13492a0ab HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
(cherry picked from commit a847903b6e64c6edb11d852b91f2c816b1253eb3)
2017-01-21 15:50:42 -08:00
Akira Ajisaka
1cf20b37ed HADOOP-14001. Improve delegation token validity checking.
(cherry picked from commit 176346721006a03f41d028560e9e29b5931d5be2)
(cherry picked from commit c6c29d0080964e55ff84246af1e4149d1ef3162a)
2017-01-19 18:07:54 +09:00
Masatake Iwasaki
04ccb1bec5 HADOOP-13839. Fix outdated tracing documentation. Contributed by Elek, Marton. 2017-01-05 09:24:15 +09:00
Kihwal Lee
deae1f8323 HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. Contributed by Eugene Koifman.
(cherry picked from commit db4419df6bc72e9a1ddd90bac4dd7dcf0fb05479)
2016-12-09 11:05:04 -06:00
Akira Ajisaka
45bc79d135 HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge.
(cherry picked from commit 00096dcc0c23af38e697cd7c6c29e3f00d744e54)
(cherry picked from commit 0c895e8a62b4b69a020a5f004e97323520a1b1d0)
2016-11-29 19:59:33 +09:00
Kihwal Lee
ba10a055e4 HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula.
(cherry picked from commit bd3735554fa5c3bc064c57ec78f4308430b14b48)
(cherry picked from commit 0fb1306f9329be7bc793a342daaaa08b2fe16f4a)
2016-11-28 15:37:45 -08:00
Mingliang Liu
48a2dacc68 HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
(cherry picked from commit ed9dcdae57cf3f97e563b149ecfc9ee65368094b)
2016-11-22 13:30:26 -08:00
Zhe Zhang
cc1979b2a0 HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 23:09:12 -08:00
Zhe Zhang
d762730367 HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen.
(cherry picked from commit 77c13c385774c51766fe505397fa916754ac08d4)
(cherry picked from commit 758638d08d3337159dd3e9fa651093d0430b399a)
(cherry picked from commit d93dc01e3dc0b9d5ce8c8105120cf01d0c66b473)
2016-11-08 16:15:44 -08:00
Zhe Zhang
64657cd675 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen.
(cherry picked from commit 3dbad5d823b8bf61b643dd1057165044138b99e0)
(cherry picked from commit b245e9ce2f20bb84690bffe902a60d5e96130cdb)
(cherry picked from commit 384b7b71a3d22bcc27bbdb9002ad700015b86eab)
2016-11-07 16:22:16 -08:00
yliu
49f983633a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu)
(cherry picked from commit 2c0dbf728a9ade29eb5c86e798bd6d75de956e5a)
2016-11-01 22:56:25 -07:00
Zhe Zhang
e6ee3e2597 HADOOP-10300. Allowed deferred sending of call responses. Contributed by Daryn Sharp. 2016-11-01 22:24:40 -07:00
Zhe Zhang
c10428bb7e HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer. 2016-10-31 11:43:46 -07:00
Arpit Agarwal
c60cbb3396 HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma)
(cherry picked from commit edbeefdb052bffd0a3ba2f00c8a5a376017fbf33)
2016-10-31 11:25:08 -07:00
Brahma Reddy Battula
616d634525 HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu
(cherry picked from commit 0c837db8a874079dd5db83a7eef9c4d2b9d0e9ff)
2016-10-27 19:57:00 +05:30
Brahma Reddy Battula
d05e737b84 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
(cherry picked from commit f872c6bc0390415f13e95b99749b0b1a690991b7)
2016-10-21 06:21:46 +05:30
Steve Loughran
897cf09b40 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula"
This reverts commit f6d8746f2e809a1889a0bcccc8c6f1ecdad13481.
2016-10-20 19:48:56 +01:00
Brahma Reddy Battula
f6d8746f2e HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
(cherry picked from commit f872c6bc0390415f13e95b99749b0b1a690991b7)
2016-10-20 21:54:09 +05:30
Brahma Reddy Battula
1e5c40b5b4 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki
(cherry picked from commit e9a34ae29c7390f3ffcbeee02dc5faa26fca482a)
(cherry picked from commit 5f754e8638d5a35ab12765edec6561228312f71c)
2016-10-18 10:50:19 -07:00
Robert Kanter
bd16763591 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter)
(cherry picked from commit ee233ec95ce8cfc8309d3adc072d926cd85eba08)
(cherry picked from commit 731ed9cad81f91e9da18148f0c4757a38ca406f6)
2016-10-18 10:25:52 -07:00
Wei-Chiu Chuang
f27cf17f7e HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2. Contributed by Min Shen.
(cherry picked from commit 23984e17870bcff6fffd8e1ca185fd37e2352b29)
(cherry picked from commit 6ca5ffe4b52c13e71027c465c9a757724f6b091d)
2016-10-18 10:03:46 -07:00
Brahma Reddy Battula
23d4351174 adding entry for HADOOP-13670 in changes.txt 2016-10-06 20:01:31 +05:30
Brahma Reddy Battula
7e241cfcba HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula 2016-10-06 17:56:45 +05:30
Kihwal Lee
031125b8ff HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp.
(cherry picked from commit e19b37ead23805c7ed45bdcbfa7fdc8898cde7b2)
2016-09-28 10:49:29 -05:00
Brahma Reddy Battula
aaff2033b9 HADOOP-12597. In kms-site.xml configuration hadoop.security.keystore.JavaKeyStoreProvider.password should be updated with new name. ( Contributed by Surendra Singh Lilhore via Brahma Reddy Battula) 2016-09-26 22:31:31 +05:30
Konstantin V Shvachko
66ee9f554e HDFS-10843. Add missing file to commit 4b5806217e6846bcecc6480af46c0e70102daac0. 2016-09-23 11:13:25 -07:00