3491 Commits

Author SHA1 Message Date
Jason Lowe
09be0acae0 HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham
(cherry picked from commit ac05a51bbb2a3fad4e85f9334a3408571967900a)
2017-09-25 15:38:52 -05:00
Akira Ajisaka
6004fb4676
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
(cherry picked from commit 3a10367a17b99e2c3035ec54048f94f334d93227)
2017-09-26 01:48:24 +09:00
Akira Ajisaka
6581f2dea3
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina.
(cherry picked from commit 7e58b2478ce10f54b9b9a647f22a69dd528a81e6)
2017-09-20 21:08:54 +09:00
Robert Kanter
4e36452d02 YARN-7162. Remove XML excludes file format (rkanter) 2017-09-15 09:53:55 -07:00
John Zhuge
eaef8446f6 HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.
(cherry picked from commit 7ee02d1065268511ec10a8b8852d0d6327419b9c)
2017-09-14 11:29:34 -07:00
Xiao Chen
0a8ed025e4 Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
This reverts commit 5337c2511df5f75d950b713740c4d61bffc6034d.
2017-09-12 19:53:14 -07:00
Jason Lowe
c314a66353 HADOOP-14843. Improve FsPermission symbolic parsing unit test coverage. Contributed by Bharat Viswanadham
(cherry picked from commit 86f4d1c66c8b541465ff769e5d951305c41c715c)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/permission/TestFsPermission.java
2017-09-12 17:00:22 -05:00
Steve Loughran
a46204437b
HADOOP-14851 LambdaTestUtils.eventually() doesn't spin on Assertion failures.
Contributed by Steve Loughran

(cherry picked from commit 180e814b081d3707c95641171d649b547db41a04)
2017-09-11 21:33:44 +01:00
Xuan
02ae3f8202 YARN-7072. Add a new log aggregation file format controller (xgong) 2017-09-10 23:18:31 -07:00
John Zhuge
1421196d20 HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
(cherry picked from commit a4661850c1e0794baf493a468191e12681d68ab4)
2017-09-08 14:15:51 -07:00
Jason Lowe
f39a444120 HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen
(cherry picked from commit dd814946f68d52a9b1627ac4dd61f9ab093423ae)
2017-09-06 16:05:58 -05:00
Wei-Chiu Chuang
aada99a376 HADOOP-14688. Intern strings in KeyVersion and EncryptedKeyVersion. Contributed by Xiao Chen.
(cherry picked from commit ad32759fd9f33e7bd18758ad1a5a464dab3bcbd9)
(cherry picked from commit c16ecf0fe8c112437c463c8aabe3a4c0bce6d1da)
2017-09-05 15:14:13 -07:00
Yiqun Lin
41d8e4e9b3 HDFS-12317. HDFS metrics render error in the page of Github. Contributed by Yiqun Lin. 2017-09-01 10:13:01 +08:00
Steve Loughran
25e9c29608
HADOOP-14802. Add support for using container saskeys for all accesses.
Contributed by Sivaguru Sankaridurg

(cherry picked from commit 021974f4cb1eb8cf530dabc95039fed46e66a43d)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
2017-08-30 22:40:50 +01:00
Junping Du
7dd5bb9492 HADOOP-14814. Fix incompatible API change on FsServerDefaults to HADOOP-14104. Contributed by Junping Du.
(cherry picked from commit 41480233a9cfb0bcfb69cc0f1594120e7656f031)
2017-08-30 13:30:48 -07:00
Arpit Agarwal
ae69c99068 HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang. 2017-08-24 11:17:36 -07:00
John Zhuge
6e8c696651 HADOOP-14251. Credential provider should handle property key deprecation. Contributed by John Zhuge.
(cherry picked from commit 7e6463d2fb5f9383d88baec290461868cf476e4c)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java
2017-08-23 11:59:47 -07:00
Subru Krishnan
a45ffdcddc YARN-7053. Move curator transaction support to ZKCuratorManager. (Jonathan Hung via Subru).
(cherry picked from commit 4249172e1419acdb2b69ae3db43dc59da2aa2e03)
2017-08-22 19:21:35 -07:00
Jason Lowe
45c1f8ac8e HADOOP-14687. AuthenticatedURL will reuse bad/expired session cookies. Contributed by Daryn Sharp
(cherry picked from commit c3793102121767c46091805eae65ef3919a5f368)
2017-08-22 16:53:51 -05:00
Arpit Agarwal
b3ea11dfdb HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang. 2017-08-21 14:07:59 -07:00
Arpit Agarwal
d5379cc564 HDFS-12325. SFTPFileSystem operations should restore cwd. Contributed by Chen Liang. 2017-08-20 23:41:16 -07:00
Arpit Agarwal
d8d2a221f8 HDFS-11450. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang. 2017-08-18 11:43:17 -07:00
Arpit Agarwal
850593133b Revert "HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru."
This reverts commit bdc425057ebedb8f0988ce4dae18fdcd67c8523f.
2017-08-18 10:16:13 -07:00
Mingliang Liu
03d15fa58e HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze 2017-08-16 16:06:13 -07:00
Steve Loughran
d5680c08ed
HADOOP-14660. wasb: improve throughput by 34% when account limit exceeded.
Contributed by Thomas Marquardt.
2017-08-16 13:49:47 +01:00
Subru Krishnan
ad46a90872 HADOOP-14773. Extend ZKCuratorManager API for more reusability. (Íñigo Goiri via Subru).
(cherry picked from commit 75dd866bfb8b63cb9f13179d4365b05c48e0907d)
2017-08-15 16:54:48 -07:00
Arpit Agarwal
bdc425057e HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru. 2017-08-14 15:53:43 -07:00
Subru Krishnan
a70efb6138 HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru). 2017-08-14 11:03:50 -07:00
John Zhuge
0efc590e6d HADOOP-14627. Support MSI and DeviceCode token provider in ADLS. Contributed by Atul Sikaria.
(cherry picked from commit 7769e9614956283a86eda9e4e69aaa592c0ca960)
2017-08-13 00:27:33 -07:00
John Zhuge
e208a4e7ee HADOOP-14260. Configuration.dumpConfiguration should redact sensitive information. Contributed by John Zhuge.
(cherry picked from commit 582648befaf9908159f937d2cc8f549583a3483e)
2017-08-11 10:54:41 -07:00
John Zhuge
76c4aee2e3 HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang
(cherry picked from commit 00160f71b6d98244fcb1cb58b2db9fc24f1cd672)
2017-08-11 10:54:30 -07:00
John Zhuge
9ba3268fa3 HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang
(cherry picked from commit 59d59667a8b1d3fb4a744a41774b2397fd91cbb3)
2017-08-11 10:54:25 -07:00
Steve Loughran
9c6e8ece98
HADOOP-14754. TestCommonConfigurationFields failed: core-default.xml has 2 wasb properties missing in classes.
Contributed by John Zhuge.

(cherry picked from commit d964062f66c0772f4b1a029bfcdff921fbaaf91c)
2017-08-11 10:58:26 +01:00
Wei-Chiu Chuang
304cc1a856 HADOOP-14743. CompositeGroupsMapping should not swallow exceptions. Contributed by Wei-Chiu Chuang.
(cherry picked from commit a8b75466b21edfe8b12beb4420492817f0e03147)
2017-08-10 09:36:21 -07:00
Steve Loughran
96befde480
HADOOP-14183. Remove service loader config file for wasb fs.
Contributed by Esfandiar Manii.

(cherry picked from commit 54356b1e8366a23fff1bb45601efffc743306efc)
2017-08-10 16:49:51 +01:00
Haohui Mai
3e2753daa1 HADOOP-14598. Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory. Contributed by Steve Loughran. 2017-08-08 16:33:54 -07:00
Jian He
ad1567c487 YARN-6890. Not display killApp button on UI if UI is unsecured but cluster is secured. Contributed by Junping Du 2017-08-08 11:10:29 -07:00
Yiqun Lin
817c0f4564 HDFS-12198. Document missing namenode metrics that were added recently. Contributed by Yiqun Lin. 2017-08-08 19:30:03 +08:00
Arpit Agarwal
2906c494c5 HDFS-12264. DataNode uses a deprecated method IoUtils#cleanup. Contributed by Ajay Yadav. 2017-08-07 15:33:36 -07:00
Xiao Chen
050c50e3c5 HADOOP-14727. Socket not closed properly when reading Configurations with BlockReaderRemote. Contributed by Jonathan Eagles.
(cherry picked from commit 9a755e6da7158783789f55796644578330653efb)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
2017-08-07 10:26:10 -07:00
Lei Xu
d87a92bf55 HDFS-12251. Add document for StreamCapabilities. (Lei (Eddy) Xu)
(cherry picked from commit fe3341786a0d61f404127bf21d1afc85b2f21d38)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSErasureCoding.md
2017-08-04 11:25:21 -07:00
wenxinhe
11e1e0c275
HADOOP-14706. Adding a helper method to determine whether a log is Log4j implement.
This closes #258

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-08-04 14:42:35 +09:00
Andrew Wang
2da20df1dd HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen. 2017-08-03 15:45:21 -07:00
Steve Loughran
cb46792610
HADOOP-14709. Fix checkstyle warnings in ContractTestUtils.
Contributed by Thomas Marquardt.
2017-08-02 12:46:30 +01:00
Masatake Iwasaki
d9a07b3904 HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu. 2017-08-02 06:21:37 +00:00
Andrew Wang
5467d1a4d1 HADOOP-14701. Configuration can log misleading warnings about an attempt to override final parameter. Contributed by Andrew Sherman.
(cherry picked from commit a11c230236036317a6c12deeca401e3ae8dce698)

 Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java
2017-08-01 15:18:18 -07:00
Arpit Agarwal
d19504866c HDFS-14676. Wrong default value for fs.df.interval. Contributed by xiangguang zheng. 2017-08-01 13:31:55 -07:00
Lei Xu
f09d20cffb HADOOP-14397. Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it. (Lei (Eddy) Xu)
(cherry picked from commit 667ee003bf47e44beb3fdff8d06a7264a13dd22c)
2017-07-31 20:07:13 -07:00
Akira Ajisaka
9c8a296169
HADOOP-14690. RetryInvocationHandler should override toString(). Contributed by Yeliang Cang.
(cherry picked from commit f14be0d24126747887ddc7580f4a9a70768de23d)
2017-07-31 14:10:18 +09:00
Brahma Reddy Battula
8bfb9971ca HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula. 2017-07-30 14:01:41 +08:00