34f7562abe
HDFS-15875. Check whether file is being truncated before truncate ( #2746 )
...
(cherry picked from commit 6a55baeee4
2021-03-11 10:07:48 +08:00
cdaa64458d
HADOOP-17191. ABFS: Run the tests with various combinations of configurations and publish a consolidated results ( #2597 )
...
Contributed by Bilahari T H and Sumangala Patki
2021-03-10 18:25:41 +00:00
0e82d42d2c
[HADOOP-17567] typo in MagicCommitTracker ( #2749 )
...
Contributed by Pierrick Hymbert
2021-03-10 15:41:21 +00:00
5ffcee8979
HADOOP-17528. SFTP File System: close the connection pool when closing a FileSystem ( #2701 )
...
Contributed by Mike Pryakhin.
Change-Id: I59ef67c38c313f30c5e000b2fe41fcf715cf3a4b
2021-03-09 19:58:11 +00:00
f12293fba2
YARN-10671.Fix Typo in TestSchedulingRequestContainerAllocation. Contributed by D M Murali Krishna Reddy.
...
(cherry picked from commit b2a565629d
2021-03-09 20:27:07 +05:30
2da6a96821
HADOOP-17557. skip-dir option is not processed by Yetus. Contributed by Ahmed Hussein.
...
(cherry picked from commit 63aa142b77
2021-03-09 11:10:53 +09:00
eb05d49349
YARN-10642. Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995. Contributed by zhengchenyu.
2021-03-08 12:36:08 +01:00
066f89af01
YARN-10672. All testcases in TestReservations are flaky. Contributed by Szilard Nemeth.
2021-03-08 11:42:59 +01:00
c498ef4b6d
HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time. ( #2668 ) Contributed by tomscut.
...
(cherry picked from commit 9cb51bf106
2021-03-06 14:00:25 -08:00
1a33878279
YARN-10664. Allow parameter expansion in NM_ADMIN_USER_ENV. Contributed by Jim
...
Brennan.
(cherry picked from commit 9d088639bf
2021-03-05 19:49:49 +00:00
e607d03995
HADOOP-17563. Update Bouncy Castle to 1.68. ( #2740 )
...
(cherry picked from commit 0774116756
2021-03-05 22:59:09 +09:00
0396a721e3
YARN-10649. Fix RMNodeImpl.updateExistContainers leak ( #2719 ). Contributed by Max Xie
...
(cherry picked from commit d615e2d3bd
2021-03-04 14:54:28 +05:30
4462da0a84
HADOOP-17546. Update Description of hadoop-http-auth-signature-secret in HttpAuthentication.md. Contributed by Ravuri Sushma sree.
...
(cherry picked from commit 9fd2198daa
2021-03-04 14:56:54 +09:00
852adff194
HDFS-15870. Remove unused configuration dfs.namenode.stripe.min ( #2739 )
...
Co-authored-by: tomscut <litao@bigo.sg>
(cherry picked from commit cdba06e380
2021-03-03 22:35:45 +09:00
138021ce23
[MAPREDUCE-7234] ClientHSSecurityInfo class is in wrong META-INF file.
...
Contributed by Eric Badger.
(cherry picked from commit a17dc4e821
2021-03-02 21:49:09 +00:00
56679e83bf
HDFS-15849. ExpiredHeartbeats metric should be of Type.COUNTER. Contributed by Qi Zhu.
...
(cherry picked from commit 9501c698f4
2021-03-01 17:20:40 -08:00
24a0304159
HDFS-14013. Skip any credentials stored in HDFS when starting ZKFC. Contributed by Stephen O'Donnell
...
(cherry picked from commit c3b3b36dee
2021-03-01 11:50:23 +00:00
792329fde9
MAPREDUCE-7320. organize test directories for ClusterMapReduceTestCase ( #2722 ). Contributed by Ahmed Hussein
...
(cherry picked from commit e04bcb3a06
2021-02-26 19:56:07 +00:00
e4dcc31114
YARN-10653. Fixed the findbugs issues introduced by YARN-10647. Contributed by
...
Qi Zhu
(cherry picked from commit fcdb1e7fec
2021-02-26 19:07:59 +00:00
a6f86af39f
HDFS-15210. EC : File write hanged when DN is shutdown by admin command. Contributed by Surendra Singh Lilhore.
...
(cherry picked from commit db6252b6c3
2021-02-26 10:49:16 +08:00
be6e99963d
YARN-10651. CapacityScheduler crashed with NPE in AbstractYarnScheduler.updateNodeResource(). Contributed by Haibo Chen
...
(cherry picked from commit f348ab3f2f468751af329a1ffce4917cb000fcbf)
2021-02-25 15:09:33 -08:00
db457b056a
[YARN-10613] Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF. Contributed by Eric Payne
...
(cherry picked from commit c373da9f88
2021-02-25 16:48:46 +00:00
e3ef326663
HDFS-15422. Reported IBR is partially replaced with stored info when queuing. Contributed by Stephen O'Donnell and Kihwal Lee
...
(cherry picked from commit 9c583f36d5
2021-02-24 11:04:52 +00:00
ced08fba7c
HADOOP-17510. Hadoop prints sensitive Cookie information. ( #2673 )
...
(cherry picked from commit 924fa87010
2021-02-24 17:34:07 +08:00
cc42f5dafd
HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index. ( #2716 )
...
(cherry picked from commit e9a3c2950e
2021-02-23 22:55:10 +00:00
6ff5da931f
HDFS-15847. create client protocol: add ecPolicyName & storagePolicy param to debug statement string. Contributed by Bhavik Patel.
2021-02-23 19:12:42 +05:30
305c4e72c2
YARN-10647. Fix TestRMNodeLabelsManager failed after YARN-10501. Contributed by
...
Qi Zhu.
(cherry picked from commit 47420ae3ed
2021-02-22 18:59:45 +00:00
3339ff5966
MAPREDUCE-7323. Remove job_history_summary.py. ( #2712 )
...
Reviewed-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 8bca105655
2021-02-22 23:16:05 +09:00
7642ddcd6f
HADOOP-17537. ABFS: Correct assertion reversed in HADOOP-13327
...
Contributed Sumangala Patki.
2021-02-22 11:49:25 +00:00
5857b781a3
HADOOP-17038 Support disabling buffered reads in ABFS positional reads. ( #2646 )
...
- Contributed by @anoopsjohn
Change-Id: Ibd11cc9d7aed0c2cc831a01e07d0a1595f7026fb
2021-02-22 11:46:35 +00:00
52a46f064a
HDFS-15734. [READ] DirectoryScanner#scan need not check StorageType.PROVIDED ( #2559 )
...
Co-authored-by: wangyuxuan <wangyuxuan@xiaomi.com>
(cherry picked from commit 1e32ab7d2f
2021-02-22 18:14:18 +08:00
852db790d3
HADOOP-17534. Update Jackson to 2.10.5 and Jackson databind to 2.10.5.1 ( #2708 )
...
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit e119063a07
2021-02-22 17:34:43 +09:00
ee0e32abdc
HDFS-15826. Solve the problem of incorrect progress of delegation tokens when loading FsImage. ( #2686 )
...
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
(cherry picked from commit 98ffd65d8b
2021-02-22 15:24:37 +08:00
ff8b79f890
HADOOP-16748. Migrate to Python 3 and upgrade Yetus to 0.13.0 (branch-3.3) ( #2709 )
...
- Upgrade Yetus to 0.13.0 to support Python 3 for the release scripts.
- Removed determine-flaky-tests-hadoop.py.
- Temporarily disabled shelldocs check due to YETUS-1099.
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
(cherry picked from commit b9b49ed956
2021-02-22 15:19:05 +09:00
c7bab342ee
HADOOP-17084 Update Dockerfile_aarch64 to use Bionic ( #2103 ). Contributed by zhaorenhai.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 6c57be4897
2021-02-22 13:49:51 +09:00
118a5747f8
HADOOP-16054. Update Dockerfile to use Bionic ( #1966 )
...
(cherry picked from commit 81d8b71534
2021-02-22 13:49:29 +09:00
27f00c7cd4
YARN-10501. Can't remove all node labels after add node label without
...
nodemanager port. Contributed by caozhiqiang.
(cherry picked from commit 4891e68c2b
2021-02-19 23:25:25 +00:00
1125e3f0c0
HDFS-15835. Erasure coding: Add/remove logs for the better readability/debugging. Contributed by Bhavik Patel.
...
(cherry picked from commit 25af8901a9
2021-02-19 14:47:16 +09:00
a9d3500894
HDFS-15830. Support to make dfs.image.parallel.load reconfigurable ( #2694 )
2021-02-19 09:14:14 +08:00
8c8ef2f444
YARN-9017. PlacementRule order is not maintained in CS. Contributed by Bilwa S T.
...
(cherry picked from commit 35010120fb
2021-02-18 20:42:26 +05:30
97171b9b18
YARN-8942. PriorityBasedRouterPolicy throws exception if all sub-cluster weights have negative value. Contributed by Bilwa S T.
...
(cherry picked from commit 108ecf992f
2021-02-18 20:32:32 +05:30
5cb9657320
YARN-9301. Too many InvalidStateTransitionException with SLS. Contributed by Bilwa S T.
...
(cherry picked from commit 96bbc3bc97
2021-02-18 20:29:57 +05:30
5be3a1dc7b
YARN-9301. Too many InvalidStateTransitionException with SLS. Contributed by Bilwa S T.
...
(cherry picked from commit 9cbd0cd2a9
2021-02-18 20:29:42 +05:30
a1bebfd85e
YARN-10359. Log container report only if list is not empty. Contributed by Bilwa S T.
...
(cherry picked from commit 5323e83edf
2021-02-18 20:23:56 +05:30
72904c014d
YARN-10361. Make custom DAO classes configurable into RMWebApp#JAXBContextResolver.
...
Contributed by Bilwa ST.
(cherry picked from commit c7e71a6c0b
2021-02-18 14:25:16 +05:30
0c46ab51b5
YARN-8047. RMWebApp make external class pluggable.
...
Contributed by Bilwa S T.
(cherry picked from commit 3a4d05b850
2021-02-18 13:59:50 +05:30
4423a7e736
HADOOP-16906. Abortable ( #2684 )
...
Adds an Abortable.abort() interface for streams to enable output streams to be terminated; this
is implemented by the S3A connector's output stream. It allows for commit protocols
to be implemented which commit/abort work by writing to the final destination and
using the abort() call to cancel any write which is not intended to be committed.
Consult the specification document for information about the interface and its use.
Contributed by Jungtaek Lim and Steve Loughran.
Change-Id: I7fcc25e9dd8c10ce6c29f383529f3a2642a201ae
2021-02-17 11:29:19 +00:00
73f9083f2a
YARN-10407. Add phantomjsdriver.log to gitignore. ( #2244 )
...
(cherry picked from commit 658b1a6cde
2021-02-17 10:28:17 +09:00
457c8404b9
[YARN-10626] Log resource allocation in NM log at container start time. Contributed by Eric Badger
...
(cherry picked from commit 3fcc7a55b6
2021-02-16 16:47:46 +00:00
e45149bf70
HDFS-15836. RBF: Fix contract tests after HADOOP-13327 ( #2702 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 2b3c5b1733
2021-02-16 14:52:31 +09:00
Hui Fei
sumangala-patki
Pierrick Hymbert
Mike
Brahma Reddy Battula
Akira Ajisaka
Peter Bacsko
tomscut
Eric Badger
Takanobu Asanuma
Neil
litao
Konstantin V Shvachko
S O'Donnell
Ahmed Hussein
Surendra Singh Lilhore
Jonathan Hung
Jim Brennan
Renukaprasad C
Masatake Iwasaki
Ayush Saxena
Anoop Sam John
Wang Yuxuan
jianghuazhu
zhaorenhai
Inigo Goiri
bibinchundatt
Prabhu Joseph
Steve Loughran