a373094bf9
HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham.
2017-10-23 10:47:35 -07:00
a6370dde90
HADOOP-14944. Add JvmMetrics to KMS.
2017-10-19 22:37:35 -07:00
9eb33d0e87
HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
...
(cherry picked from commit 97c70c7ac6
2017-10-19 06:06:01 -07:00
e7e2b8158d
HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du.
...
(cherry picked from commit b016f08f679433f9eb09
2017-10-18 15:07:59 -07:00
d894f910d0
YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda)
2017-10-17 19:45:09 -07:00
4e1af68ae1
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
...
(cherry picked from commit 387dd3da87759860dd18bd8aa95c60d962b1e6a9)
2017-10-17 23:36:39 +05:30
e212e562ec
YARN-5355. Backported YARN-2928 into our branch-2 feature branch.
2017-10-17 23:36:33 +05:30
a103b323e6
Revert "HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar."
...
This reverts commit 1452ba139e
2017-10-17 10:11:38 -07:00
8a1ed84c77
HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter)
2017-10-16 16:51:28 -07:00
1452ba139e
HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.
...
(cherry picked from commit e906108fc9
2017-10-16 16:44:35 -07:00
5933068e70
HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin.
...
(cherry picked from commit 075358eb6f
2017-10-11 16:15:59 -07:00
fb8bd4d2d7
HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh)
...
(cherry picked from commit b6c2c9058e
2017-10-11 15:22:51 -07:00
ccfd1a4a56
HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB.
...
Contributed by Varada Hemeswari.
Cherry-picked from commit ref 3de574413c
2017-10-11 18:09:13 +01:00
63d86ee3a5
HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp
...
(cherry picked from commit 1123f8f0b6
2017-10-10 14:50:15 -05:00
65b5e81752
HADOOP-14920. KMSClientProvider won't work with KMS delegation token retrieved from non-Java client. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 2b08a1fc64
2017-10-06 10:39:37 -07:00
dd0113d777
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
...
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
2017-10-05 19:47:04 -07:00
73d1b02d5a
HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. (Varun Vasudev via wangda)
...
Change-Id: I1031a4fa4e0c5c76928d03c5e61971978ec7e6ab
2017-10-05 17:02:00 -07:00
a1afc6aa59
HADOOP-13345 S3Guard: Improved Consistency for S3A.
...
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.
(cherry-picked from/based on commit 621b43e254
2017-09-29 11:29:22 +01:00
11ac10fe1d
HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru
...
(cherry picked from commit 6f789fe057
2017-09-28 16:40:18 -05:00
0aac5af6e1
HADOOP-14891. Remove references to Guava Objects.toStringHelper. Contributed by Jonathan Eagles
2017-09-26 10:08:06 -05:00
b017af2391
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari.
...
(cherry picked from commit d08b8c801a
2017-09-26 16:47:50 +09:00
17b17aed0f
HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru.
2017-09-25 13:44:51 -07:00
09be0acae0
HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham
...
(cherry picked from commit ac05a51bbb
2017-09-25 15:38:52 -05:00
6004fb4676
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
...
(cherry picked from commit 3a10367a17
2017-09-26 01:48:24 +09:00
6581f2dea3
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina.
...
(cherry picked from commit 7e58b2478c
2017-09-20 21:08:54 +09:00
4e36452d02
YARN-7162. Remove XML excludes file format (rkanter)
2017-09-15 09:53:55 -07:00
eaef8446f6
HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.
...
(cherry picked from commit 7ee02d1065
2017-09-14 11:29:34 -07:00
0a8ed025e4
Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
...
This reverts commit 5337c2511d
2017-09-12 19:53:14 -07:00
c314a66353
HADOOP-14843. Improve FsPermission symbolic parsing unit test coverage. Contributed by Bharat Viswanadham
...
(cherry picked from commit 86f4d1c66c
2017-09-12 17:00:22 -05:00
a46204437b
HADOOP-14851 LambdaTestUtils.eventually() doesn't spin on Assertion failures.
...
Contributed by Steve Loughran
(cherry picked from commit 180e814b08
2017-09-11 21:33:44 +01:00
02ae3f8202
YARN-7072. Add a new log aggregation file format controller (xgong)
2017-09-10 23:18:31 -07:00
1421196d20
HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
...
(cherry picked from commit a4661850c1
2017-09-08 14:15:51 -07:00
f39a444120
HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen
...
(cherry picked from commit dd814946f6
2017-09-06 16:05:58 -05:00
aada99a376
HADOOP-14688. Intern strings in KeyVersion and EncryptedKeyVersion. Contributed by Xiao Chen.
...
(cherry picked from commit ad32759fd9c16ecf0fe8
2017-09-05 15:14:13 -07:00
41d8e4e9b3
HDFS-12317. HDFS metrics render error in the page of Github. Contributed by Yiqun Lin.
2017-09-01 10:13:01 +08:00
25e9c29608
HADOOP-14802. Add support for using container saskeys for all accesses.
...
Contributed by Sivaguru Sankaridurg
(cherry picked from commit 021974f4cb
2017-08-30 22:40:50 +01:00
7dd5bb9492
HADOOP-14814. Fix incompatible API change on FsServerDefaults to HADOOP-14104. Contributed by Junping Du.
...
(cherry picked from commit 41480233a9
2017-08-30 13:30:48 -07:00
ae69c99068
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
2017-08-24 11:17:36 -07:00
6e8c696651
HADOOP-14251. Credential provider should handle property key deprecation. Contributed by John Zhuge.
...
(cherry picked from commit 7e6463d2fb
2017-08-23 11:59:47 -07:00
a45ffdcddc
YARN-7053. Move curator transaction support to ZKCuratorManager. (Jonathan Hung via Subru).
...
(cherry picked from commit 4249172e14
2017-08-22 19:21:35 -07:00
45c1f8ac8e
HADOOP-14687. AuthenticatedURL will reuse bad/expired session cookies. Contributed by Daryn Sharp
...
(cherry picked from commit c379310212
2017-08-22 16:53:51 -05:00
b3ea11dfdb
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
2017-08-21 14:07:59 -07:00
d5379cc564
HDFS-12325. SFTPFileSystem operations should restore cwd. Contributed by Chen Liang.
2017-08-20 23:41:16 -07:00
d8d2a221f8
HDFS-11450. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
2017-08-18 11:43:17 -07:00
850593133b
Revert "HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru."
...
This reverts commit bdc425057e
2017-08-18 10:16:13 -07:00
03d15fa58e
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
2017-08-16 16:06:13 -07:00
d5680c08ed
HADOOP-14660. wasb: improve throughput by 34% when account limit exceeded.
...
Contributed by Thomas Marquardt.
2017-08-16 13:49:47 +01:00
ad46a90872
HADOOP-14773. Extend ZKCuratorManager API for more reusability. (Íñigo Goiri via Subru).
...
(cherry picked from commit 75dd866bfb
2017-08-15 16:54:48 -07:00
bdc425057e
HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru.
2017-08-14 15:53:43 -07:00
a70efb6138
HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru).
2017-08-14 11:03:50 -07:00
0efc590e6d
HADOOP-14627. Support MSI and DeviceCode token provider in ADLS. Contributed by Atul Sikaria.
...
(cherry picked from commit 7769e96149
2017-08-13 00:27:33 -07:00
e208a4e7ee
HADOOP-14260. Configuration.dumpConfiguration should redact sensitive information. Contributed by John Zhuge.
...
(cherry picked from commit 582648befa
2017-08-11 10:54:41 -07:00
76c4aee2e3
HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang
...
(cherry picked from commit 00160f71b6
2017-08-11 10:54:30 -07:00
9ba3268fa3
HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang
...
(cherry picked from commit 59d59667a8
2017-08-11 10:54:25 -07:00
9c6e8ece98
HADOOP-14754. TestCommonConfigurationFields failed: core-default.xml has 2 wasb properties missing in classes.
...
Contributed by John Zhuge.
(cherry picked from commit d964062f66
2017-08-11 10:58:26 +01:00
304cc1a856
HADOOP-14743. CompositeGroupsMapping should not swallow exceptions. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit a8b75466b2
2017-08-10 09:36:21 -07:00
96befde480
HADOOP-14183. Remove service loader config file for wasb fs.
...
Contributed by Esfandiar Manii.
(cherry picked from commit 54356b1e83
2017-08-10 16:49:51 +01:00
3e2753daa1
HADOOP-14598. Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory. Contributed by Steve Loughran.
2017-08-08 16:33:54 -07:00
ad1567c487
YARN-6890. Not display killApp button on UI if UI is unsecured but cluster is secured. Contributed by Junping Du
2017-08-08 11:10:29 -07:00
817c0f4564
HDFS-12198. Document missing namenode metrics that were added recently. Contributed by Yiqun Lin.
2017-08-08 19:30:03 +08:00
2906c494c5
HDFS-12264. DataNode uses a deprecated method IoUtils#cleanup. Contributed by Ajay Yadav.
2017-08-07 15:33:36 -07:00
050c50e3c5
HADOOP-14727. Socket not closed properly when reading Configurations with BlockReaderRemote. Contributed by Jonathan Eagles.
...
(cherry picked from commit 9a755e6da7158783789f55796644578330653efb)
Conflicts:
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
2017-08-07 10:26:10 -07:00
d87a92bf55
HDFS-12251. Add document for StreamCapabilities. (Lei (Eddy) Xu)
...
(cherry picked from commit fe3341786a
2017-08-04 11:25:21 -07:00
11e1e0c275
HADOOP-14706. Adding a helper method to determine whether a log is Log4j implement.
...
This closes #258
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-08-04 14:42:35 +09:00
2da20df1dd
HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen.
2017-08-03 15:45:21 -07:00
cb46792610
HADOOP-14709. Fix checkstyle warnings in ContractTestUtils.
...
Contributed by Thomas Marquardt.
2017-08-02 12:46:30 +01:00
d9a07b3904
HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu.
2017-08-02 06:21:37 +00:00
5467d1a4d1
HADOOP-14701. Configuration can log misleading warnings about an attempt to override final parameter. Contributed by Andrew Sherman.
...
(cherry picked from commit a11c230236
2017-08-01 15:18:18 -07:00
d19504866c
HDFS-14676. Wrong default value for fs.df.interval. Contributed by xiangguang zheng.
2017-08-01 13:31:55 -07:00
f09d20cffb
HADOOP-14397. Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it. (Lei (Eddy) Xu)
...
(cherry picked from commit 667ee003bf47e44beb3fdff8d06a7264a13dd22c)
2017-07-31 20:07:13 -07:00
9c8a296169
HADOOP-14690. RetryInvocationHandler should override toString(). Contributed by Yeliang Cang.
...
(cherry picked from commit f14be0d241
2017-07-31 14:10:18 +09:00
8bfb9971ca
HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula.
2017-07-30 14:01:41 +08:00
c3e8c7d56e
HDFS-12190. Enable 'hdfs dfs -stat' to display access time. Contributed by Yongjun Zhang.
...
(cherry picked from commit c6330f22a5
2017-07-27 17:05:30 -07:00
4edb849611
HADOOP-14578. Bind IPC connections to kerberos UPN host for proxy users. Contributed by Daryn Sharp.
...
(cherry picked from commit 27a1a5fde9
2017-07-26 13:16:34 -05:00
ab95086ed1
HADOOP-14518. Customize User-Agent header sent in HTTP/HTTPS requests by WASB. Contributed by Georgi Chalakov.
2017-07-25 08:31:35 -07:00
22f237c5d9
HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.
...
(cherry picked from commit cca51e916b
2017-07-25 15:25:36 +09:00
db7c5636b6
YARN-6768. Improve performance of yarn api record toString and fromString. Contributed by Jonathan Eagles
...
(cherry picked from commit 24853bf32a
2017-07-24 10:22:31 -05:00
daa7685344
HADOOP-13178. TestShellBasedIdMapping.testStaticMapUpdate doesn't work on OS X (Kai Sasaki via aw)
...
(cherry picked from commit d8c1fd1944
2017-07-24 11:57:10 +09:00
7e583a3824
HADOOP-14539. Move commons logging APIs over to slf4j in hadoop-common.
...
This closes #251
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-07-24 11:14:08 +09:00
a735916b2c
HADOOP-14659. UGI getShortUserName does not need to search the Subject. Contributed by Daryn Sharp.
...
(cherry picked from commit b3269f7cc1
2017-07-20 16:15:06 -05:00
1d629c95af
HADOOP-14666. Tests use assertTrue(....equals(...)) instead of assertEquals()
...
(cherry picked from commit c21c260392
2017-07-19 14:01:10 -07:00
23b920cd7a
HADOOP-14642. wasb: add support for caching Authorization and SASKeys. Contributed by Sivaguru Sankaridurg.
2017-07-19 11:37:36 -07:00
057631c031
HADOOP-14669. GenericTestUtils.waitFor should use monotonic time. Contributed by Daniel Templeton
...
(cherry picked from commit df180259b0
2017-07-19 09:42:38 -05:00
9b961db569
HADOOP-14637. GenericTestUtils.waitFor needs to check condition again after max wait time. Contributed by Daniel Templeton
...
(cherry picked from commit 5aa2bf231f
2017-07-18 16:27:34 -05:00
5337c2511d
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
...
(cherry picked from commit aa395c1ec9a170f2da732c6e6114c60412161d40)
2017-07-14 22:23:07 -07:00
956e83c100
HADOOP-14646. FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runs. Contributed by Andras Bokor.
...
(cherry picked from commit b61ab8573e
2017-07-13 21:43:10 +09:00
2653cf4466
HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor.
...
(cherry picked from commit 9144fd9e9b
2017-07-12 11:40:48 +09:00
41e83b2ca2
HADOOP-14535 wasb: implement high-performance random access and seek of block blobs.
...
Contributed by Thomas Marquardt
(cherry picked from commit d670c3a4da
2017-07-11 21:45:24 +01:00
e494a169ed
HADOOP-14638. Replace commons-logging APIs with slf4j in StreamPumper.
...
This closes #247
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit fce7951014
2017-07-11 13:36:56 +09:00
b82485d6fe
HADOOP-10829. Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe. Contributed by Benoy Antony and Rakesh R.
2017-07-10 17:55:02 -07:00
1c40df5bcd
HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He.
2017-07-08 03:01:18 +09:00
730b21e9f9
HADOOP-14563. LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException. Contributed by Rushabh S Shah.
...
(cherry picked from commit 8153fe2bd3
2017-07-07 06:14:07 -07:00
1e8301b215
HADOOP-13414. Hide Jetty Server version header in HTTP responses. Contributed by Surendra Singth Lilhore.
2017-07-05 16:06:19 +05:30
3404824854
HADOOP-14617. Add ReflectionUtils.logThreadInfo that accept slf4j logger API.
...
Contributed by Wenxin He.
(cherry picked from commit 128d8bc3e9d792fde9cacd9e1d786db8ef682b0b)
2017-07-04 11:40:46 +01:00
ca8102962f
HADOOP-14571. Deprecate public APIs relate to log4j1
...
This closes #244
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit f2aba1da30
2017-07-04 18:56:41 +09:00
4ceb3bd4b3
HADOOP-14615. Add ServiceOperations.stopQuietly that accept slf4j logger API.
...
Contributed by Wenxin He.
(cherry picked from commit 1aaa7f1eac
2017-07-04 10:49:20 +01:00
367f525e81
HADOOP-14611. NetworkTopology.DEFAULT_HOST_LEVEL is unused
...
(Contributed by Chen Liang via Daniel Templeton)
(cherry picked from commit 5a75f73893
2017-06-29 16:56:55 -07:00
b59b96deee
HDFS-11992. Replace commons-logging APIs with slf4j in FsDatasetImpl. Contributed by hu xiaodong.
2017-06-27 03:28:09 +09:00
239b382153
HADOOP-14549. Use GenericTestUtils.setLogLevel when available in hadoop-tools. Contributed by wenxin he.
...
(cherry picked from commit a594f96fb1
2017-06-26 16:41:44 +09:00
4b420e0678
HADOOP-14543. ZKFC should use getAversion() while setting the zkacl. Contributed by Brahma Reddy Battula.
2017-06-23 16:50:56 -07:00
Arpit Agarwal
Xiao Chen
Wei-Chiu Chuang
Junping Du
Wangda Tan
Rohith Sharma K S
Sangjin Lee
Robert Kanter
Anu Engineer
Arun Suresh
Steve Loughran
Jason Lowe
Xiaoyu Yao
Akira Ajisaka
John Zhuge
Xuan
Yiqun Lin
Subru Krishnan
Mingliang Liu
Subru Krishnan
Haohui Mai
Jian He
Lei Xu
wenxinhe
Andrew Wang
Masatake Iwasaki
Lei Xu
Brahma Reddy Battula
Yongjun Zhang
Kihwal Lee
Jitendra Pandey
Jason Lowe
Allen Wittenauer
Daniel Templeton
Vinayakumar B