9224568b0e
YARN-10156. Destroy Jersey Client in TimelineConnector.
...
Contributed by Tanu Ajmera.
2020-04-27 18:49:15 +05:30
62c26b91fd
HDFS-15298 Fix the findbugs warnings introduced in HDFS-15217 ( #1979 )
2020-04-27 17:20:47 +09:00
f91e21ac10
YARN-10194. YARN RMWebServices /scheduler-conf/validate leaks ZK Connections. Contributed by Prabhu Joseph
2020-04-27 08:26:11 +02:00
85516a8af7
HADOOP-17007. hadoop-cos fails to build. Contributed by Yang Yu.
2020-04-26 12:46:53 +05:30
74d4a18735
HDFS-15297. TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently. Contributed by Ayush Saxena
2020-04-25 15:43:02 -07:00
453c9c9a67
HDFS-15281. Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address ( #1964 )
...
Contributed by Dhiraj Hegde.
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Inigo Goiri <inigoiri@apache.org>
2020-04-25 13:04:32 -07:00
81d8b71534
HADOOP-16054. Update Dockerfile to use Bionic ( #1966 )
2020-04-26 02:54:45 +09:00
ef9a6e775c
HADOOP-16886. Add hadoop.http.idle_timeout.ms to core-default.xml. Contributed by Lisheng Sun.
2020-04-25 13:07:32 +05:30
453771f170
HDFS-15295. AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. Contributed by Jinglun.
2020-04-24 11:53:24 -07:00
d4874585f4
YARN-10237. Add isAbsoluteResource config for queue in scheduler response. Contributed by Prabhu Joseph
2020-04-24 17:04:47 +02:00
30ef8d0f1a
HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not
...
Contributed by Bilahari T H.
2020-04-23 17:46:18 -07:00
9827ff2961
YARN-10223. Remove jersey-test-framework-core dependency from yarn-server-common. ( #1939 )
2020-04-24 09:32:25 +09:00
459eb2ad6d
HADOOP-16914 Adding Output Stream Counters in ABFS ( #1899 )
...
Contributed by Mehakmeet Singh.There
2020-04-23 13:35:39 +01:00
5958af4dbc
HDFS-15276. Concat on INodeRefernce fails with illegal state exception. Contributed by hemanthboyina
2020-04-22 13:31:02 -07:00
af85971a58
HADOOP-17001. The suffix name of the unified compression class. Contributed by bianqi
2020-04-22 12:36:33 -07:00
3d69383c26
Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy
...
Contributed by Sneha Vijayarajan
2020-04-21 21:39:48 -07:00
264e49c8f2
HADOOP-16922. ABFS: Change User-Agent header ( #1938 )
...
Contributed by Bilahari T H.
2020-04-21 17:37:40 +01:00
8031c66295
HADOOP-16965. Refactor abfs stream configuration. ( #1956 )
...
Contributed by Mukund Thakur.
2020-04-21 17:27:29 +01:00
60fa15366e
YARN-10240. Prevent Fatal CancelledException in TimelineV2Client when stopping
...
Contributed by Tarun Parimi.
2020-04-21 12:01:33 +05:30
e069a06137
HDFS-14742. RBF: TestRouterFaultTolerant tests are flaky
2020-04-20 08:41:18 -07:00
1fdfaebd98
HDFS-15275. HttpFS: Response of Create was not correct with noredirect and data are true. Contributed by hemanthboyina.
2020-04-20 23:09:33 +09:00
93b662db47
HADOOP-16953. tuning s3guard disabled warnings ( #1962 )
...
Contributed by Steve Loughran.
The S3Guard absence warning of HADOOP-16484 has been changed
so that by default the S3A connector only logs at debug
when the connection to the S3 Store does not have S3Guard
enabled.
The option to control this log level is now
fs.s3a.s3guard.disabled.warn.level
and can be one of: silent, inform, warn, fail.
On a failure, an ExitException is raised with exit code 49.
For details on this safety feature, consult the s3guard documentation.
2020-04-20 15:05:55 +01:00
42711081e3
HADOOP-16986. S3A to not need wildfly on the classpath. ( #1948 )
...
HADOOP-16986. S3A to not need wildfly JAR on its classpath.
Contributed by Steve Loughran
This is a successor to HADOOP-16346, which enabled the S3A connector
to load the native openssl SSL libraries for better HTTPS performance.
That patch required wildfly.jar to be on the classpath. This
update:
* Makes wildfly.jar optional except in the special case that
"fs.s3a.ssl.channel.mode" is set to "openssl"
* Retains the declaration of wildfly.jar as a compile-time
dependency in the hadoop-aws POM. This means that unless
explicitly excluded, applications importing that published
maven artifact will, transitively, add the specified
wildfly JAR into their classpath for compilation/testing/
distribution.
This is done for packaging and to offer that optional
speedup. It is not mandatory: applications importing
the hadoop-aws POM can exclude it if they choose.
2020-04-20 14:32:13 +01:00
82ff7bc9ab
HADOOP-16959. Resolve hadoop-cos dependency conflict. Contributed by Yang Yu.
2020-04-20 18:14:11 +08:00
79e03fb622
HADOOP-16971. TestFileContextResolveAfs#testFileContextResolveAfs creates dangling link and fails for subsequent runs. Contributed by Ctest.
2020-04-20 01:59:18 +05:30
1824aee9da
HDFS-15217 Add more information to longest write/read lock held log
2020-04-18 13:52:07 -07:00
5576915236
HADOOP-16944. Use Yetus 0.12.0 in GitHub PR ( #1917 )
2020-04-19 02:43:44 +09:00
8e6227441a
HDFS-15218. RBF: MountTableRefresherService failed to refresh other router MountTableEntries in secure mode. Contributed by Surendra Singh Lilhore.
2020-04-18 20:07:21 +05:30
a1b0697d37
MAPREDUCE-7199. HsJobsBlock reuse JobACLsManager for checkAccess. Contributed by Bilwa S T
2020-04-18 19:42:20 +05:30
92b28e38b7
YARN-9996. Code cleanup in QueueAdminConfigurationMutationACLPolicy. Contributed by Siddharth Ahuja
2020-04-18 10:13:37 +02:00
76900b4f5b
YARN-10189. Code cleanup in LeveldbRMStateStore. Contributed by Benjamin Teke
2020-04-18 09:57:27 +02:00
ac40daece1
HADOOP-16972. Ignore AuthenticationFilterInitializer for KMSWebServer. ( #1961 )
2020-04-18 06:38:25 +09:00
3601054822
YARN-9954. Configurable max application tags and max tag length. Contributed by Bilwa S T
2020-04-17 10:34:44 -07:00
eca05917d6
HADOOP-16951: Tidy Up Text and ByteWritables Classes.
...
1. Remove superfluous code
2. Remove superfluous comments
3. Checkstyle fixes
4. Remove methods that simply call super.method()
5. Use Java 8 facilities to streamline code where applicable
6. Simplify and unify some of the constructs between the two classes
7. Expanding of the arrays be 1.5x instead of 2x per expansion.
2020-04-17 08:16:12 -07:00
2fe122e322
YARN-10154. CS Dynamic Queues cannot be configured with absolute resources. Contributed by Manikandan R.
2020-04-17 18:51:19 +05:30
56350664a7
HADOOP-13873. log DNS addresses on s3a initialization.
...
Contributed by Mukund Thakur.
If you set the log org.apache.hadoop.fs.s3a.impl.NetworkBinding
to DEBUG, then when the S3A bucket probe is made -the DNS address
of the S3 endpoint is calculated and printed.
This is useful to see if a large set of processes are all using
the same IP address from the pool of load balancers to which AWS
directs clients when an AWS S3 endpoint is resolved.
This can have implications for performance: if all clients
access the same load balancer performance may be suboptimal.
Note: if bucket probes are disabled, fs.s3a.bucket.probe = 0,
the DNS logging does not take place.
Change-Id: I21b3ac429dc0b543f03e357fdeb94c2d2a328dd8
2020-04-17 14:15:38 +01:00
37d6582223
HDFS-15266. Add missing DFSOps Statistics in WebHDFS. Contributed by Ayush Saxena.
2020-04-17 13:32:02 +05:30
3481895f8a
HDFS-15283. Cache pool MAXTTL is not persisted and restored on cluster restart. Contributed by Stephen O'Donnell.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-04-16 20:18:25 -07:00
053e39e1e4
MAPREDUCE-7273. Fixed Job History server token renewal.
...
Contributed by Peter Bacsko via eyang
2020-04-16 20:17:21 -04:00
8505840c26
HADOOP-16979. S3Guard auth mode should be set to false by default in integration tests. ( #1958 ) Contributed by Mukund Thakur.
2020-04-16 13:02:30 +02:00
cc5c1da7c1
HDFS-15277. Parent directory in the explorer does not support all path formats. Contributed by Jianfei Jiang.
2020-04-15 23:01:58 +05:30
4d24d99e85
HADOOP-16985. Handle release package related issues ( #1957 )
2020-04-15 20:38:19 +05:30
4db598e0e6
YARN-9999. TestFSSchedulerConfigurationStore: Extend from ConfigurationStoreBaseTest, general code cleanup. Contributed by Benjamin Teke
2020-04-15 13:18:44 +02:00
94f7470c71
YARN-10233. Fix YARN UI2 Daemon Logs
...
Contributed by Akhil PB.
2020-04-15 13:39:37 +05:30
55fcbcb5c2
YARN-10234. FS-CS converter: don't enable auto-create queue property for root. Contributed by Peter Bacsko
2020-04-15 07:24:04 +02:00
ae474e1ae5
HADOOP-16982. Update Netty to 4.1.48.Final. Contributed by Lisheng Sun.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2020-04-15 06:41:32 +09:00
0ad0102678
HADOOP-16855. Changing wildfly dependency scope in hadoop-azure to compile
...
Contributed by Biliharith
2020-04-14 19:17:12 +01:00
7b2d84d19c
HADOOP-16465 listLocatedStatus() optimisation ( #1943 )
...
Contributed by Mukund Thakur
Optimize S3AFileSystem.listLocatedStatus() to perform list
operations directly and then fallback to head checks for files
2020-04-14 17:19:51 +01:00
aeeebc5e79
HADOOP-16941. ITestS3GuardOutOfBandOperations.testListingDelete failing on versioned bucket ( #1919 )
...
Contributed by Steve Loughran.
Removed the failing probe and replacing with two probes which will fail
on both versioned and unversioned buckets.
2020-04-14 10:56:00 +01:00
c791b0e90e
YARN-10219. Fix YARN Native Service Placement Constraints with Node Attributes.
...
Contributed by Eric Yang.
2020-04-14 12:34:53 +05:30
Prabhu Joseph
Toshihiro Suzuki
Szilard Nemeth
Ayush Saxena
Mingliang Liu
Dhiraj
Akira Ajisaka
Wei-Chiu Chuang
bilaharith
Mehakmeet Singh
Sneha Vijayarajan
Mukund Thakur
Prabhu Joseph
Takanobu Asanuma
Steve Loughran
Sammi Chen
Surendra Singh Lilhore
Masatake Iwasaki
Jonathan Hung
belugabehr
Sunil G
Mukund Thakur
Stephen O'Donnell
Eric Yang
Vinayakumar B
Prabhu Joseph
sunlisheng