31b2f687ef
HDFS-15265. HttpFS: validate content-type in HttpFSUtils. Contributed by hemanthboyina.
2020-04-29 13:41:36 -07:00
d125d39108
YARN-6973. Adding RM Cluster Id in ApplicationReport. Contributed by Bilwa S T.
2020-04-29 11:23:58 -07:00
9ca6298a9a
HDFS-15285. The same distance and load nodes don't shuffle when consider DataNode load. Contributed by Lisheng Sun.
2020-04-29 15:56:06 +01:00
410c605aec
YARN-10247. Application priority queue ACLs are not respected. Contributed by Sunil G
2020-04-29 15:53:30 +02:00
db6252b6c3
HDFS-15210. EC : File write hanged when DN is shutdown by admin command. Contributed by Surendra Singh Lilhore.
2020-04-29 10:58:35 +05:30
816042e62b
HDFS-15301. statfs function in hdfs-fuse not working. Contributed by Aryan Gupta.( #1980 )
2020-04-29 09:19:59 +05:30
4202750040
HADOOP-17010. Add queue capacity support for FairCallQueue ( #1977 )
2020-04-28 16:14:55 -07:00
ab36429559
YARN-10215. Endpoint for obtaining direct URL for the logs. Contributed by Andras Gyori
2020-04-28 18:53:28 +02:00
5e0eda5d5f
HDFS-15286. Concat on a same file deleting the file. Contributed by hemanthboyina.
2020-04-28 06:17:14 +09:00
6ef01646ba
YARN-9848. Revert YARN-4946. Contributed by Steven Rand.
2020-04-28 05:35:36 +09:00
e2322e1117
MAPREDUCE-7277. IndexCache totalMemoryUsed differs from cache contents. Contributed by Jon Eagles (jeagles).
2020-04-27 19:10:00 +00:00
18d7dfbf35
HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised. ( #1952 )
...
Contributed by Mikhail Pryakhin.
2020-04-27 14:43:51 +01:00
9224568b0e
YARN-10156. Destroy Jersey Client in TimelineConnector.
...
Contributed by Tanu Ajmera.
2020-04-27 18:49:15 +05:30
62c26b91fd
HDFS-15298 Fix the findbugs warnings introduced in HDFS-15217 ( #1979 )
2020-04-27 17:20:47 +09:00
f91e21ac10
YARN-10194. YARN RMWebServices /scheduler-conf/validate leaks ZK Connections. Contributed by Prabhu Joseph
2020-04-27 08:26:11 +02:00
85516a8af7
HADOOP-17007. hadoop-cos fails to build. Contributed by Yang Yu.
2020-04-26 12:46:53 +05:30
74d4a18735
HDFS-15297. TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently. Contributed by Ayush Saxena
2020-04-25 15:43:02 -07:00
453c9c9a67
HDFS-15281. Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address ( #1964 )
...
Contributed by Dhiraj Hegde.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Inigo Goiri <inigoiri@apache.org>
2020-04-25 13:04:32 -07:00
81d8b71534
HADOOP-16054. Update Dockerfile to use Bionic ( #1966 )
2020-04-26 02:54:45 +09:00
ef9a6e775c
HADOOP-16886. Add hadoop.http.idle_timeout.ms to core-default.xml. Contributed by Lisheng Sun.
2020-04-25 13:07:32 +05:30
453771f170
HDFS-15295. AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. Contributed by Jinglun.
2020-04-24 11:53:24 -07:00
d4874585f4
YARN-10237. Add isAbsoluteResource config for queue in scheduler response. Contributed by Prabhu Joseph
2020-04-24 17:04:47 +02:00
30ef8d0f1a
HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not
...
Contributed by Bilahari T H.
2020-04-23 17:46:18 -07:00
9827ff2961
YARN-10223. Remove jersey-test-framework-core dependency from yarn-server-common. ( #1939 )
2020-04-24 09:32:25 +09:00
459eb2ad6d
HADOOP-16914 Adding Output Stream Counters in ABFS ( #1899 )
...
Contributed by Mehakmeet Singh.There
2020-04-23 13:35:39 +01:00
5958af4dbc
HDFS-15276. Concat on INodeRefernce fails with illegal state exception. Contributed by hemanthboyina
2020-04-22 13:31:02 -07:00
af85971a58
HADOOP-17001. The suffix name of the unified compression class. Contributed by bianqi
2020-04-22 12:36:33 -07:00
3d69383c26
Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy
...
Contributed by Sneha Vijayarajan
2020-04-21 21:39:48 -07:00
264e49c8f2
HADOOP-16922. ABFS: Change User-Agent header ( #1938 )
...
Contributed by Bilahari T H.
2020-04-21 17:37:40 +01:00
8031c66295
HADOOP-16965. Refactor abfs stream configuration. ( #1956 )
...
Contributed by Mukund Thakur.
2020-04-21 17:27:29 +01:00
60fa15366e
YARN-10240. Prevent Fatal CancelledException in TimelineV2Client when stopping
...
Contributed by Tarun Parimi.
2020-04-21 12:01:33 +05:30
e069a06137
HDFS-14742. RBF: TestRouterFaultTolerant tests are flaky
2020-04-20 08:41:18 -07:00
1fdfaebd98
HDFS-15275. HttpFS: Response of Create was not correct with noredirect and data are true. Contributed by hemanthboyina.
2020-04-20 23:09:33 +09:00
93b662db47
HADOOP-16953. tuning s3guard disabled warnings ( #1962 )
...
Contributed by Steve Loughran.
The S3Guard absence warning of HADOOP-16484 has been changed
so that by default the S3A connector only logs at debug
when the connection to the S3 Store does not have S3Guard
enabled.
The option to control this log level is now
fs.s3a.s3guard.disabled.warn.level
and can be one of: silent, inform, warn, fail.
On a failure, an ExitException is raised with exit code 49.
For details on this safety feature, consult the s3guard documentation.
2020-04-20 15:05:55 +01:00
42711081e3
HADOOP-16986. S3A to not need wildfly on the classpath. ( #1948 )
...
HADOOP-16986. S3A to not need wildfly JAR on its classpath.
Contributed by Steve Loughran
This is a successor to HADOOP-16346, which enabled the S3A connector
to load the native openssl SSL libraries for better HTTPS performance.
That patch required wildfly.jar to be on the classpath. This
update:
* Makes wildfly.jar optional except in the special case that
"fs.s3a.ssl.channel.mode" is set to "openssl"
* Retains the declaration of wildfly.jar as a compile-time
dependency in the hadoop-aws POM. This means that unless
explicitly excluded, applications importing that published
maven artifact will, transitively, add the specified
wildfly JAR into their classpath for compilation/testing/
distribution.
This is done for packaging and to offer that optional
speedup. It is not mandatory: applications importing
the hadoop-aws POM can exclude it if they choose.
2020-04-20 14:32:13 +01:00
82ff7bc9ab
HADOOP-16959. Resolve hadoop-cos dependency conflict. Contributed by Yang Yu.
2020-04-20 18:14:11 +08:00
79e03fb622
HADOOP-16971. TestFileContextResolveAfs#testFileContextResolveAfs creates dangling link and fails for subsequent runs. Contributed by Ctest.
2020-04-20 01:59:18 +05:30
1824aee9da
HDFS-15217 Add more information to longest write/read lock held log
2020-04-18 13:52:07 -07:00
5576915236
HADOOP-16944. Use Yetus 0.12.0 in GitHub PR ( #1917 )
2020-04-19 02:43:44 +09:00
8e6227441a
HDFS-15218. RBF: MountTableRefresherService failed to refresh other router MountTableEntries in secure mode. Contributed by Surendra Singh Lilhore.
2020-04-18 20:07:21 +05:30
a1b0697d37
MAPREDUCE-7199. HsJobsBlock reuse JobACLsManager for checkAccess. Contributed by Bilwa S T
2020-04-18 19:42:20 +05:30
92b28e38b7
YARN-9996. Code cleanup in QueueAdminConfigurationMutationACLPolicy. Contributed by Siddharth Ahuja
2020-04-18 10:13:37 +02:00
76900b4f5b
YARN-10189. Code cleanup in LeveldbRMStateStore. Contributed by Benjamin Teke
2020-04-18 09:57:27 +02:00
ac40daece1
HADOOP-16972. Ignore AuthenticationFilterInitializer for KMSWebServer. ( #1961 )
2020-04-18 06:38:25 +09:00
3601054822
YARN-9954. Configurable max application tags and max tag length. Contributed by Bilwa S T
2020-04-17 10:34:44 -07:00
eca05917d6
HADOOP-16951: Tidy Up Text and ByteWritables Classes.
...
1. Remove superfluous code
2. Remove superfluous comments
3. Checkstyle fixes
4. Remove methods that simply call super.method()
5. Use Java 8 facilities to streamline code where applicable
6. Simplify and unify some of the constructs between the two classes
7. Expanding of the arrays be 1.5x instead of 2x per expansion.
2020-04-17 08:16:12 -07:00
2fe122e322
YARN-10154. CS Dynamic Queues cannot be configured with absolute resources. Contributed by Manikandan R.
2020-04-17 18:51:19 +05:30
56350664a7
HADOOP-13873. log DNS addresses on s3a initialization.
...
Contributed by Mukund Thakur.
If you set the log org.apache.hadoop.fs.s3a.impl.NetworkBinding
to DEBUG, then when the S3A bucket probe is made -the DNS address
of the S3 endpoint is calculated and printed.
This is useful to see if a large set of processes are all using
the same IP address from the pool of load balancers to which AWS
directs clients when an AWS S3 endpoint is resolved.
This can have implications for performance: if all clients
access the same load balancer performance may be suboptimal.
Note: if bucket probes are disabled, fs.s3a.bucket.probe = 0,
the DNS logging does not take place.
Change-Id: I21b3ac429dc0b543f03e357fdeb94c2d2a328dd8
2020-04-17 14:15:38 +01:00
37d6582223
HDFS-15266. Add missing DFSOps Statistics in WebHDFS. Contributed by Ayush Saxena.
2020-04-17 13:32:02 +05:30
3481895f8a
HDFS-15283. Cache pool MAXTTL is not persisted and restored on cluster restart. Contributed by Stephen O'Donnell.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-04-16 20:18:25 -07:00
Inigo Goiri
S O'Donnell
Szilard Nemeth
Surendra Singh Lilhore
Aryan Gupta
lfengnan
Akira Ajisaka
Eric E Payne
Mike
Prabhu Joseph
Toshihiro Suzuki
Ayush Saxena
Mingliang Liu
Dhiraj
Wei-Chiu Chuang
bilaharith
Mehakmeet Singh
Sneha Vijayarajan
Mukund Thakur
Prabhu Joseph
Takanobu Asanuma
Steve Loughran
Sammi Chen
Masatake Iwasaki
Jonathan Hung
belugabehr
Sunil G
Mukund Thakur
Stephen O'Donnell