bcacb57114
YARN-9335 [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls. Contributed by Abhishesk Modi.
2019-09-05 16:27:39 +05:30
6acc1a2bd0
YARN-9382 Publish container killed, paused and resumed events to ATSv2. Contributed by Abhishesk Modi.
2019-09-05 15:39:38 +05:30
f52a88fdc8
YARN-9303 Username splits won't help timelineservice.app_flow table. Contributed by Prabhu Joseph.
2019-09-05 15:39:38 +05:30
998aa3de2c
YARN-9418. ATSV2 /apps//entities/YARN_CONTAINER rest api does not show metrics. Contributed by Prabhu Joseph.
2019-09-05 15:39:38 +05:30
8de93fca3c
YARN-9389. FlowActivity and FlowRun table prefix is wrong. Contributed by Prabhu Joseph.
2019-09-05 15:39:38 +05:30
0ccc5a2695
YARN-9387. Update document for ATS HBase Custom tablenames (-entityTableName). Contributed by Prabhu Joseph.
2019-09-05 15:39:38 +05:30
d451ff7534
YARN-3841 [atsv2 Storage implementation] Adding retry semantics to HDFS backing storage. Contributed by Abhishek Modi.
2019-09-05 15:39:38 +05:30
66e1599761
YARN-3879 [Storage implementation] Create HDFS backing storage implementation for ATS reads. Contributed by Abhishek Modi.
2019-09-05 15:39:38 +05:30
6f9764076a
YARN-8995. Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time. Contributed by zhuqi.
2019-09-05 16:53:16 +08:00
84a9c3f999
YARN-5336 Limit the flow name size & consider cleanup for hex chars. Contributed by Sushil Ks
2019-09-05 12:43:02 +05:30
108c569e3b
YARN-6735. Have a way to turn off container metrics from NMs. Contributed by Abhishek Modi.
2019-09-05 12:42:06 +05:30
5345508fa3
YARN-6149. Allow port range to be specified while starting NM Timeline collector manager. Contributed by Abhishek Modi.
2019-09-05 12:38:37 +05:30
0a6f90d4fc
YARN-9034. ApplicationCLI should have option to take clusterId. Contributed by Rohith Sharma K S.
2019-09-05 12:38:07 +05:30
4a4a892d32
YARN-7754. [Atsv2] Update document for running v1 and v2 TS. Contributed by Suma Shivaprasad.
2019-09-05 12:31:37 +05:30
a3496a368b
YARN-8871. Document ATSv2 integrated LogWebService. Contributed by Suma Shivaprasad.
2019-09-05 12:30:50 +05:30
252afdc8e6
YARN-9804. Update ATSv2 document for latest feature supports.
2019-09-05 09:00:22 +05:30
259c6bb0c7
HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.
...
(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)
2019-09-03 09:12:19 -07:00
269aa7ebfe
YARN-9785. Fix DominantResourceCalculator when one resource is zero. Contributed by Bibin A Chundatt, Sunil Govindan, Bilwa S T.
...
(cherry picked from commit bb26514ba9
2019-09-03 15:02:15 +08:00
1e6095f16b
YARN-9797. LeafQueue#activateApplications should use resourceCalculator#fitsIn. Contributed by Bilwa S T.
...
(cherry picked from commit 03489124ea
2019-09-03 11:55:13 +05:30
61fd1a74a1
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 915cbc91c0
2019-09-02 10:06:39 -07:00
84b2fe4b10
Revert "HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell."
...
This reverts commit 9c0d6e1657
2019-09-02 10:06:39 -07:00
a453f38015
YARN-9162. Fix TestRMAdminCLI#testHelp. Contributed by Ayush Saxena.
...
(cherry picked from commit 5db7c49062
2019-08-30 17:52:07 -07:00
2fc4123fe0
YARN-9714. ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby. Contributed by Tao Yang.
2019-08-30 10:36:23 +05:30
1c685a3aba
HADOOP-15998. Ensure jar validation works on Windows.
...
* use a different path separator for artifacts to test
* fail if and commands fail (including the jar listing)
* handle different line endings from jar listing
* make sure we have bash 3.1+
Co-authored-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Abhishek Modi <abmodi@apache.org>
Signed-off-by: Rohith Sharma K S <rohithsharmaks@apache.org>
(cherry picked from commit b86582ce2b8b00c128add054bcb80951c38cb3d3)
2019-08-29 23:08:49 -05:00
3edffd90c9
HDFS-12212. Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified. Contributed by Vinayakumar B.
2019-08-30 08:58:12 +05:30
b516d2ea7b
Make DataNodePeerMetrics#minOutlierDetectionSamples configurable ( #1314 ). Contributed by Lisheng Sun.
...
Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>
(cherry picked from commit 915271245b
2019-08-29 18:46:15 -07:00
9c0d6e1657
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7bebad61d9
2019-08-29 17:38:55 -07:00
7c6fc964fd
HDFS-8178. QJM doesn't move aside stale inprogress edits files. Contributed by Istvan Fajth.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 03049290fe8ef1459a3c8bd05cf198320e6e4973)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNNStorageRetentionManager.java
2019-08-29 16:55:18 -07:00
7616495fb7
YARN-9796. Fix ASF license issue in branch-3.2. Contributed by Prabhu Joseph.
2019-08-29 12:01:38 +05:30
81c0809463
YARN-9640. Slow event processing could cause too many attempt unregister events. Contributed by Bibin A Chundatt.
2019-08-29 09:30:20 +05:30
d562050cec
YARN-9756: Create metric that sums total memory/vcores preempted per round. Contributed by Manikandan R (manirajv06).
2019-08-28 20:53:43 +00:00
f36ccf0ac1
YARN-9438. launchTime not written to state store for running applications
...
(cherry picked from commit 9568656cd21d9c02168e18ce35c6726077bbf3a1)
2019-08-27 15:54:22 -07:00
2d8799f4bc
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter.
2019-08-27 19:08:39 +00:00
9d722c637e
HADOOP-16460: ABFS: fix for Sever Name Indication (SNI)
...
Contributed by Sneha Vijayarajan <snvijaya@microsoft.com>
2019-08-27 19:08:39 +00:00
3b3c0c4b87
HADOOP-16479. ABFS FileStatus.getModificationTime returns localized time instead of UTC.
...
Contributed by Bilahari T H
Change-Id: I532055baaadfd7c324710e4b25f60cdf0378bdc0
2019-08-27 19:08:38 +00:00
ce23e971b4
HADOOP-16340. ABFS driver continues to retry on IOException responses from REST operations.
...
Contributed by Robert Levas.
This makes the HttpException constructor protected rather than public, so it is possible
to implement custom subclasses of this exception -exceptions which will not be retried.
Change-Id: Ie8aaa23a707233c2db35948784908b6778ff3a8f
2019-08-27 19:08:29 +00:00
a6d50a9054
HADOOP-16376. ABFS: Override access() to no-op.
...
Contributed by Da Zhou.
Change-Id: Ia0024bba32250189a87eb6247808b2473c331ed0
2019-08-27 19:04:16 +00:00
dd636127e9
HADOOP-16269. ABFS: add listFileStatus with StartFrom.
...
Author: Da Zhou
2019-08-27 19:01:21 +00:00
006ae258b3
HADOOP-16163. NPE in setup/teardown of ITestAbfsDelegationTokens.
...
Contributed by Da Zhou.
Signed-off-by: Steve Loughran <stevel@apache.org>
2019-08-27 19:01:21 +00:00
d255efa5f8
HDFS-14779. Fix logging error in TestEditLog#testMultiStreamsLoadEditWithConfMaxTxns
...
(cherry picked from commit 8ab7020e64
2019-08-27 10:30:55 -07:00
8b12381717
HDFS-2470. NN should automatically set permissions on dfs.namenode.*.dir. Contributed by Siddharth Wagle.
...
(cherry picked from commit a64a43b77fb1032dcb66730a6b6257a24726c256)
2019-08-26 15:57:41 -07:00
e4249c3202
YARN-9775. RMWebServices /scheduler-conf GET returns all hadoop configurations for ZKConfigurationStore. Contributed by Prabhu Joseph
...
(cherry picked from commit 8660e48ca1
2019-08-26 15:51:38 -07:00
7f20c31e31
YARN-9642. Fix Memory Leak in AbstractYarnScheduler caused by timer. Contributed by Bibin A Chundatt.
...
(cherry picked from commit d3ce53e507
2019-08-26 23:23:49 +05:30
ab98f91638
YARN-8917. Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource. Contributed by Tao Yang.
2019-08-26 21:13:02 +05:30
c824653955
HDFS-14674. [SBN read] Got an unexpected txid when tail editlog. Contributed by wangzhaohui.
2019-08-23 12:28:13 -07:00
2408c2491f
HDFS-13977. Override shouldForceSync in QuorumOutputStream to allow for proper auto-sync behavior. Contributed by Erik Krogen.
...
(cherry picked from d699022fce
2019-08-23 11:48:11 -07:00
e8b93d04c4
HDFS-14396. Failed to load image from FSImageFile when downgrade from 3.x to 2.x. Contributed by Fei Hui.
...
(cherry picked from commit bd7baea5a5
2019-08-23 15:28:54 +09:00
d3e5898712
HDFS-13596. NN restart fails after RollingUpgrade from 2.x to 3.x. Contributed by Fei Hui.
...
(cherry picked from commit abc8fde4ca
2019-08-23 14:45:57 +09:00
afb3f329fd
YARN-9774. Fix order of arguments for assertEquals in TestSLSUtils. Contributed by Nikhil Navadiya.
...
(cherry picked from commit 84b1982060
2019-08-23 14:40:15 +09:00
b7a66471ca
HDFS-14276. [SBN read] Reduce tailing overhead. Contributed by Wei-Chiu Chuang.
2019-08-22 22:35:48 +05:30
Vrushali C
Giovanni Matteo Fumarola
Rohith Sharma K S
Tao Yang
Suma Shivaprasad
Rohith Sharma K S
Xiaoyu Yao
Zhankun Tang
bibinchundatt
Stephen O'Donnell
Wei-Chiu Chuang
Akira Ajisaka
Brian Grunkemeyer
Ayush Saxena
leosunli
Stephen O'Donnell
Istvan Fajth
Eric E Payne
Jonathan Hung
Sneha Vijayarajan
bilaharith
Robert Levas
Da Zhou
Arpit Agarwal
Chen Liang
Erik Krogen