Commit Graph

24096 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze 592127bdc2
HDFS-15520 Use visitor pattern to visit namespace tree (#2203) 2020-08-11 12:30:30 +05:30
Akira Ajisaka 32895f4f7e
HDFS-15507. [JDK 11] Fix javadoc errors in hadoop-hdfs-client module. Contributed by Xieming Li. 2020-08-11 13:49:56 +09:00
Akira Ajisaka 7938ebfb9d
HDFS-15506. [JDK 11] Fix javadoc errors in hadoop-hdfs module. Contributed by Xieming Li. 2020-08-11 11:14:58 +09:00
Akira Ajisaka 9062814bab
HDFS-15508. [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module 2020-08-11 10:58:56 +09:00
Prabhu Joseph 5e0f879779 YARN-10364. Fix logic of queue capacity is absolute resource or percentage.
Contributed by Bilwa ST. Reviewed by Sunil G.
2020-08-08 22:33:58 +05:30
Ayush Saxena c2a17659d1 HDFS-15443. Setting dfs.datanode.max.transfer.threads to a very small value can cause strange failure. Contributed by AMC-team. 2020-08-08 14:33:53 +05:30
Akira Ajisaka 40542024df
HADOOP-17182. Remove breadcrumbs from web site (#2190)
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2020-08-07 23:29:52 -07:00
Jonathan Hung 64753addba YARN-10251. Show extended resources on legacy RM UI. Contributed by Eric Payne 2020-08-07 17:43:01 -07:00
Ayush Saxena 975b6024dd HDFS-15514. Remove useless dfs.webhdfs.enabled. Contributed by Fei Hui. 2020-08-07 22:19:17 +05:30
bibinchundatt 81da221c75 YARN-10388. RMNode updatedCapability flag not set while RecommissionNodeTransition. Contributed by Pranjal Protim Borah 2020-08-07 08:36:52 +05:30
bilaharith a2610e21ed
HADOOP-17183. ABFS: Enabling checkaccess on ABFS
- Contributed by Bilahari T H
2020-08-06 14:52:02 -07:00
Takanobu Asanuma 1d5ccc790b
HDFS-15512. Remove smallBufferSize in DFSClient. (#2191) 2020-08-06 22:47:12 +05:30
Prabhu Joseph c7e71a6c0b YARN-10361. Make custom DAO classes configurable into RMWebApp#JAXBContextResolver.
Contributed by Bilwa ST.
2020-08-06 13:19:52 +05:30
Wanqiang Ji dc5470ae86
MAPREDUCE-7288. Fix TestLongLong#testRightShift (#2183) 2020-08-06 09:35:15 +09:00
Eric Badger 5edd8b925e YARN-4575. ApplicationResourceUsageReport should return ALL reserved resource.
Contributed by Bibin Chundatt and Eric Payne.
2020-08-05 18:47:49 +00:00
bilaharith 3f73facd7b
HADOOP-17149. ABFS: Fixing the testcase ITestGetNameSpaceEnabled
- Contributed by Bilahari T H
2020-08-05 10:01:04 -07:00
bilaharith c566cabd62
HADOOP-17163. ABFS: Adding debug log for rename failures
- Contributed by Bilahari T H
2020-08-05 09:38:13 -07:00
Mukund Thakur ac697571a1
HADOOP-17186. Fixing javadoc in ListingOperationCallbacks (#2196) 2020-08-05 20:40:49 +09:00
Mingliang Liu 58def7cecb
HDFS-15499. Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion (#2188)
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2020-08-04 20:48:45 -07:00
Mingliang Liu 49996f67f7
HADOOP-17184. Add --mvn-custom-repos parameter to yetus calls (#2193) 2020-08-05 10:39:56 +09:00
Akira Ajisaka ed3ab4b87d
HADOOP-17179. [JDK 11] Fix javadoc error while detecting Java API link (#2186)
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-08-04 12:09:14 -07:00
Prabhu Joseph 0277856738 YARN-10377. Fix filter index to show apps while clicking on queue in RM UI
Contributed by Tarun Parimi.
2020-08-04 23:10:45 +05:30
Prabhu Joseph aa5afa72c5 YARN-10381. Add application attempt state in AppAttempts RM REST API
Contributed by Siddharth Ahuja. Reviewed by Bilwa ST.
2020-08-04 23:07:28 +05:30
sguggilam 2986058e7f
HADOOP-17164. UGI loginUserFromKeytab doesn't set the last login time (#2178)
Contributed by Sandeep Guggilam.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Steve Loughran <stevel@apache.org>
2020-08-04 10:30:06 -07:00
Mukund Thakur 8fd4f5490f
HADOOP-17131. Refactor S3A Listing code for better isolation. (#2148)
Contributed by Mukund Thakur.
2020-08-04 16:00:02 +01:00
bshashikant e072d33327
HDFS-15497. Make snapshot limit on global as well per snapshot root directory configurable (#2175) 2020-08-04 14:10:29 +05:30
kevinzhao1661 ab2b3df2de
YARN-10383. YarnCommands.md is inconsistent with the source code (#2177) 2020-08-04 12:02:16 +09:00
hemanthboyina 82f3ffcd64 HDFS-15503. File and directory permissions are not able to be modified from WebUI. 2020-08-03 23:21:01 +05:30
Brahma Reddy Battula eac558380f YARN-10229. [Federation] Client should be able to submit application to RM directly using normal client conf. Contributed by Bilwa S T. 2020-08-03 12:54:36 +05:30
Akira Ajisaka c40cbc57fa
HADOOP-17091. [JDK11] Fix Javadoc errors (#2098) 2020-08-03 10:46:51 +09:00
bshashikant d8a2df25ad
HDFS-15498. Show snapshots deletion status in snapList cmd. (#2181) 2020-08-02 21:59:56 +05:30
hemanthboyina 528a799a78 HDFS-15229. Truncate info should be logged at INFO level. Contributed by Ravuri Sushma sree. 2020-08-02 12:02:37 +05:30
bibinchundatt 5323e83edf YARN-10359. Log container report only if list is not empty. Contributed by Bilwa S T. 2020-08-01 13:03:46 +05:30
bilaharith a7fda2e38f
HADOOP-17137. ABFS: Makes the test cases in ITestAbfsNetworkStatistics agnostic
- Contributed by Bilahari T H
2020-07-31 12:27:57 -07:00
Yuan e756fe3590
HDFS-14950. fix missing libhdfspp lib in dist-package (#1947)
libhdfspp.{a,so} are missed in dist-package.
This patch fixed this by copying these libs to the right directory

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2020-07-31 16:49:49 +09:00
Tsz-Wo Nicholas Sze 05b3337a46
HDFS-15481. Ordered snapshot deletion: garbage collect deleted snapshots (#2165) 2020-07-30 23:06:51 +05:30
Eric E Payne e0c9653166 YARN-1529: Add Localization overhead metrics to NM. Contributed by Jim_Brennan. 2020-07-30 15:30:22 +00:00
ywheel cf4eb75608
MAPREDUCE-7051. Fix typo in MultipleOutputFormat (#338) 2020-07-30 13:01:22 +09:00
bibinchundatt 5d8600e80a YARN-10369. Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG. Contributed by Jim Brennan. 2020-07-29 23:26:08 +05:30
bshashikant 68287371cc
HDFS-15488. Add a command to list all snapshots for a snaphottable root with snapshot Ids. (#2166) 2020-07-29 21:33:25 +05:30
Jonathan Hung 3eaf62726f YARN-10343. Legacy RM UI should include labeled metrics for allocated, total, and reserved resources. Contributed by Eric Payne 2020-07-28 13:43:19 -07:00
bibinchundatt 5dadf963d3 YARN-10208. Add capacityScheduler metric for NODE_UPDATE interval. Contributed by Pranjal Protim Borah. 2020-07-28 11:55:47 +05:30
touchida 026dce5334
HDFS-15465. Support WebHDFS accesses to the data stored in secure Datanode through insecure Namenode. (#2135) 2020-07-27 09:55:11 -07:00
Prabhu Joseph 60a254621a YARN-10366. Fix Yarn rmadmin help message shows two labels for one node for --replaceLabelsOnNode.
Contributed by Tanu Ajmera.
2020-07-27 12:23:21 +05:30
Akira Ajisaka d02be17a26
YARN-10362. Javadoc for TimelineReaderAuthenticationFilterInitializer is broken. Contributed by Xieming Li. 2020-07-27 01:55:04 +09:00
Akira Ajisaka e277d338da
YARN-10367. Failed to get nodejs 10.21.0 when building docker image (#2171) 2020-07-27 00:51:44 +09:00
Masatake Iwasaki 4b1816c7d0
HADOOP-17153. Add boost installation steps to build instruction on CentOS 8. (#2169) 2020-07-26 06:38:54 +09:00
Eric Badger ac5f21dbef YARN-4771. Some containers can be skipped during log aggregation after NM
restart. Contributed by Jason Lowe and Jim Brennan.
2020-07-24 22:35:16 +00:00
belugabehr e60096c377
HADOOP-17141. Add Capability To Get Text Length (#2157)
Contributed by David Mollitor
2020-07-24 10:37:28 +01:00
Prabhu Joseph 247eb0979b YARN-10319. Record Last N Scheduler Activities from ActivitiesManager
Reviewed by Tao Yang and Adam Antal.
2020-07-24 11:43:31 +05:30