Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,150 Commits 326 Branches 371 Tags
Commit Graph

3594 Commits

Author SHA1 Message Date
Xiao Chen
a4674c3e40 HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev. 
(cherry picked from commit d162252d7a7223631ff66ba0210953296407e55f)
 2017-11-23 09:02:23 -08:00
Robert Kanter
8db49df4a2 HADOOP-14982. Clients using FailoverOnNetworkExceptionRetry can go into a loop if they're used without authenticating with kerberos in HA env (pbacsko via rkanter) 
(cherry picked from commit f2efaf013f7577948061abbb49c6d17c375e92cc)
 2017-11-16 11:12:01 -08:00
Xiao Chen
ba2eab9122 HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * numValues) > 0 on construction. 
(cherry picked from commit b1941b200d6b4fa6a7891421c0a1e212cad3d6eb)
 2017-11-15 16:45:06 -08:00
Arun Suresh
4e847d63a3 Addendum patch for Configuration fix. (Jason Lowe via asuresh) 2017-11-13 13:49:08 -08:00
Xiao Chen
39fb402da4 HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev. 
(cherry picked from commit 3c6adda291745c592741b87cd613214ae11887e4)
 2017-11-09 21:06:55 -08:00
Arun Suresh
7af9b8ad1e Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 2017-11-09 15:10:21 -08:00
Brahma Reddy Battula
135abcac4b HDFS-12783. [branch-2] dfsrouter should use hdfsScript. Contributed by Brahma Reddy Battula 2017-11-08 01:45:53 +05:30
Arun Suresh
71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Jason Lowe
347997c959 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60c43b62bd908a9499562fe528603185)
 2017-10-31 09:32:45 -05:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
 2017-10-27 21:42:42 -07:00
Steve Loughran
3fbcf76324 HADOOP-14553. Add (parallelized) integration tests to hadoop-azure. 
Contributed by Steve Loughran.

(backport JIRA HADOOP-14870)
 2017-10-27 12:55:12 +01:00
Junping Du
3793d2b9cf Add CHANGES.md and RELEASENOTES for 2.8.2 release. 2017-10-26 23:23:39 -07:00
Junping Du
1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:20:24 -07:00
Varun Saxena
0c8a2c2609 HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750e731f5ecfa84e82b84b7fc7ee0b233)
 2017-10-25 03:09:07 +05:30
Naganarasimha
2b04ae918c HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458ede9ececb138bed99d368580e5439a1)
 2017-10-23 23:47:33 +05:30
Arpit Agarwal
a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Xiao Chen
a6370dde90 HADOOP-14944. Add JvmMetrics to KMS. 2017-10-19 22:37:35 -07:00
Wei-Chiu Chuang
9eb33d0e87 HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6881f87eee1575bcbdd28b31ecac231)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2017-10-19 06:06:01 -07:00
Junping Du
e7e2b8158d HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du. 
(cherry picked from commit b016f08f67830ed3ca741bc6a10c3f5164781be5)
(cherry picked from commit 9433f9eb09af0ca61f01a2eb42ff3ffe31a94d5f)
 2017-10-18 15:07:59 -07:00
Wangda Tan
d894f910d0 YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda) 2017-10-17 19:45:09 -07:00
Rohith Sharma K S
4e1af68ae1 YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena. 
(cherry picked from commit 387dd3da87759860dd18bd8aa95c60d962b1e6a9)
 2017-10-17 23:36:39 +05:30
Sangjin Lee
e212e562ec YARN-5355. Backported YARN-2928 into our branch-2 feature branch. 2017-10-17 23:36:33 +05:30
Xiao Chen
a103b323e6 Revert "HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar." 
This reverts commit 1452ba139ea845ad9e82a5902d239b59a789bff3.
 2017-10-17 10:11:38 -07:00
Robert Kanter
8a1ed84c77 HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter) 2017-10-16 16:51:28 -07:00
Wei-Chiu Chuang
1452ba139e HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar. 
(cherry picked from commit e906108fc98a011630d12a43e557b81d7ef7ea5d)
 2017-10-16 16:44:35 -07:00
Xiao Chen
0bddcf10ef HADOOP-14949. TestKMS#testACLs fails intermittently. 
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2017-10-16 14:20:05 -07:00
Anu Engineer
5933068e70 HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin. 
(cherry picked from commit 075358eb6fff5ae4a40ac4dfde292e2a9a4ceddf)
 2017-10-11 16:15:59 -07:00
Arun Suresh
fb8bd4d2d7 HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh) 
(cherry picked from commit b6c2c9058e83116dcca46cd6934db3428f931347)
 2017-10-11 15:22:51 -07:00
Steve Loughran
ccfd1a4a56 HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB. 
Contributed by Varada Hemeswari.

Cherry-picked from commit ref 3de574413c4d5554213d02bd0ad343ba82cf82aa
 2017-10-11 18:09:13 +01:00
Jason Lowe
63d86ee3a5 HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp 
(cherry picked from commit 1123f8f0b62292197f5433cd40e66d8620044608)
 2017-10-10 14:50:15 -05:00
Xiaoyu Yao
65b5e81752 HADOOP-14920. KMSClientProvider won't work with KMS delegation token retrieved from non-Java client. Contributed by Xiaoyu Yao. 
(cherry picked from commit 2b08a1fc644904a37545107666efc25b3552542d)
 2017-10-06 10:39:37 -07:00
Xiao Chen
dd0113d777 HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah. 
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
 2017-10-05 19:47:04 -07:00
Wangda Tan
73d1b02d5a HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. (Varun Vasudev via wangda) 
Change-Id: I1031a4fa4e0c5c76928d03c5e61971978ec7e6ab
 2017-10-05 17:02:00 -07:00
Xiao Chen
78d6dd414a HADOOP-14095. Document caveats about the default JavaKeyStoreProvider in KMS. 
(cherry picked from commit d7ecac379a02876919d3e6081d42f0937f54e664)

Conflicts:
	hadoop-common-project/hadoop-kms/src/site/markdown/index.md.vm
 2017-09-29 19:34:50 -07:00
Steve Loughran
a1afc6aa59
HADOOP-13345 S3Guard: Improved Consistency for S3A. 
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.

(cherry-picked from/based on commit 621b43e254afaff708cd6fc4698b29628f6abc33)
 2017-09-29 11:29:22 +01:00
Jason Lowe
11ac10fe1d HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru 
(cherry picked from commit 6f789fe05766a61b12ca10df3f26ee354eac84aa)
 2017-09-28 16:40:18 -05:00
Jason Lowe
0aac5af6e1 HADOOP-14891. Remove references to Guava Objects.toStringHelper. Contributed by Jonathan Eagles 2017-09-26 10:08:06 -05:00
Akira Ajisaka
b017af2391
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari. 
(cherry picked from commit d08b8c801a908b4242e7b21a54f3b1e4072f1eae)
 2017-09-26 16:47:50 +09:00
Anu Engineer
17b17aed0f HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru. 2017-09-25 13:44:51 -07:00
Jason Lowe
09be0acae0 HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham 
(cherry picked from commit ac05a51bbb2a3fad4e85f9334a3408571967900a)
 2017-09-25 15:38:52 -05:00
Akira Ajisaka
6004fb4676
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari. 
(cherry picked from commit 3a10367a17b99e2c3035ec54048f94f334d93227)
 2017-09-26 01:48:24 +09:00
Akira Ajisaka
6581f2dea3
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina. 
(cherry picked from commit 7e58b2478ce10f54b9b9a647f22a69dd528a81e6)
 2017-09-20 21:08:54 +09:00
Robert Kanter
4e36452d02 YARN-7162. Remove XML excludes file format (rkanter) 2017-09-15 09:53:55 -07:00
John Zhuge
eaef8446f6 HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham. 
(cherry picked from commit 7ee02d1065268511ec10a8b8852d0d6327419b9c)
 2017-09-14 11:29:34 -07:00
Xiao Chen
0a8ed025e4 Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah." 
This reverts commit 5337c2511df5f75d950b713740c4d61bffc6034d.
 2017-09-12 19:53:14 -07:00
Jason Lowe
c314a66353 HADOOP-14843. Improve FsPermission symbolic parsing unit test coverage. Contributed by Bharat Viswanadham 
(cherry picked from commit 86f4d1c66c8b541465ff769e5d951305c41c715c)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/permission/TestFsPermission.java
 2017-09-12 17:00:22 -05:00
Steve Loughran
a46204437b
HADOOP-14851 LambdaTestUtils.eventually() doesn't spin on Assertion failures. 
Contributed by Steve Loughran

(cherry picked from commit 180e814b081d3707c95641171d649b547db41a04)
 2017-09-11 21:33:44 +01:00
Xuan
02ae3f8202 YARN-7072. Add a new log aggregation file format controller (xgong) 2017-09-10 23:18:31 -07:00
John Zhuge
1421196d20 HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria. 
(cherry picked from commit a4661850c1e0794baf493a468191e12681d68ab4)
 2017-09-08 14:15:51 -07:00
Jason Lowe
f39a444120 HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen 
(cherry picked from commit dd814946f68d52a9b1627ac4dd61f9ab093423ae)
 2017-09-06 16:05:58 -05:00