d887e49dd4
Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()
...
Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>
2020-01-21 18:22:44 +09:00
f6d20daf40
HADOOP-16808. Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin. Contributed by Xieming Li.
2020-01-21 18:03:24 +09:00
1defe3a65a
HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li.
2020-01-21 10:58:32 +09:00
6a859d33aa
HADOOP-16785. followup to abfs close() fix.
...
Adds one extra test to the ABFS close logic, to explicitly
verify that the close sequence of FilterOutputStream is
not going to fail.
This is just a due-diligence patch, but it helps ensure
that no regressions creep in in future.
Contributed by Steve Loughran.
Change-Id: Ifd33a8c322d32513411405b15f50a1aebcfa6e48
2020-01-20 16:23:41 +00:00
581072a8f0
YARN-7913. Improve error handling when application recovery fails with exception. Contributed by Wilfred Spiegelenburg
2020-01-20 13:10:32 +01:00
6d52bbbfcf
YARN-9525. IFile format is not working against s3a remote folder. Contributed by Adam Antal
2020-01-20 12:36:55 +01:00
8b3ee2f7e9
YARN-9462. TestResourceTrackerService.testNodeRemovalGracefully fails sporadically. Contributed by Prabhu Joseph
2020-01-20 09:54:22 +01:00
57aad0f43a
YARN-10081. Exception message from ClientRMProxy#getRMAddress is misleading. Contributed by Ravuri Sushma Sree
2020-01-20 09:41:06 +01:00
14d0f9a775
YARN-8148. Update decimal values for queue capacities shown on queue status CLI. Contributed by Prabhu Joseph
2020-01-20 09:28:23 +01:00
263413e838
HDFS-15112. RBF: Do not return FileNotFoundException when a subcluster is unavailable.
2020-01-16 10:39:14 -08:00
edbbc03ce7
HADOOP-16621. [pb-upgrade] Remove Protobuf classes from signatures of Public APIs. Contributed by Vinayakumar B. ( #1803 )
2020-01-16 23:27:50 +05:30
a0ff42d761
YARN-10070. Fix NPE if no queue mapping defined for proxy user when using application tag based placement.
...
Contributed by Kinga Marton. Reviewed by Adam Antal.
2020-01-16 12:55:27 +05:30
b8518e6dab
MAPREDUCE-7247. Modify HistoryServerRest.html content,change The job attempt id‘s datatype from string to int ( #1684 )
2020-01-16 12:53:56 +09:00
14c2c3d69d
YARN-9512. [JDK11] TestAuxServices#testCustomizedAuxServiceClassPath fails because of ClassCastException. ( #1806 )
2020-01-16 12:21:50 +09:00
d7c4f8ab21
HDFS-13616. Batch listing of multiple directories ( #1725 )
2020-01-15 17:22:47 -08:00
5d180463dc
HADOOP-16790. Add Write Convenience Methods.
...
Contributed by David Mollitor.
This adds operations in FileUtil to write text to a file via
either a FileSystem or FileContext instance.
Change-Id: I5fe8fcf1bdbdbc734e137f922a75a822f2b88410
2020-01-15 18:38:34 +00:00
2aa065d98f
YARN-10082. FS-CS converter: disable terminal placement rule checking. Contributed by Peter Bacsko
2020-01-15 12:42:13 +01:00
7f3510048d
HADOOP-16803. Upgrade jackson-databind to 2.9.10.2. ( #1805 )
2020-01-15 19:50:25 +09:00
7c5cecc3b3
YARN-9970. Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping. Contributed by Manikandan R
2020-01-15 09:55:41 +01:00
a2fdd7c2b5
MAPREDUCE-7256. Fix javadoc error in SimpleExponentialSmoothing. ( #1804 )
2020-01-15 12:09:09 +09:00
c36f09deb9
HADOOP-16005. NativeAzureFileSystem does not support setXAttr.
...
Contributed by Clemens Wolff.
2020-01-14 17:28:37 -08:00
1c51f36be7
YARN-9788. Queue Management API does not support parallel updates. Contributed by Prabhu Joseph
2020-01-14 12:26:03 +01:00
13cea0412c
YARN-10028. Integrate the new abstract log servlet to the JobHistory server. Contributed by Adam Antal
2020-01-14 11:00:08 +01:00
6b86a5110e
HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu.
2020-01-13 10:48:53 -08:00
621c5eac38
YARN-9912. Capacity scheduler: support u:user2:%secondary_group queue mapping. Contributed by Manikandan R
2020-01-13 17:23:00 +01:00
b7ef8a333f
YARN-9868. Validate %primary_group queue in CS queue manager. Contributed by Manikandan R
2020-01-13 17:15:09 +01:00
2576c31644
YARN-9989. Typo in CapacityScheduler documentation: Runtime Configuration. Contributed by Kevin Su
2020-01-13 16:50:07 +01:00
52b360a928
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. ( #1801 )
2020-01-13 10:40:29 +05:30
d842dfffa5
YARN-9866. u:user2:%primary_group is not working as expected. Contributed by Manikandan R
2020-01-12 14:04:15 +01:00
24e6a9e43a
YARN-10067. Add dry-run feature to FS-CS converter tool. Contributed by Peter Bacsko
2020-01-12 13:48:39 +01:00
cebce0a348
HDFS-14578. AvailableSpaceBlockPlacementPolicy always prefers local node. Contributed by Ayush Saxena.
2020-01-11 10:29:11 +05:30
7b62409ace
HDFS-15108. RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update. Contributed by Ayush Saxena.
2020-01-11 10:21:31 +05:30
26a969ec73
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.
2020-01-10 17:06:59 -08:00
2301b25899
YARN-10019. Improved container-executor exec() calls.
...
Contributed by Peter Bacsko
2020-01-10 19:04:04 -05:00
e589f6199c
HADOOP-16590. Update OS login modules for IBM JDK.
...
Contributed by Nicholas Marion
Close #1484
2020-01-10 14:33:12 -05:00
5fb901ac40
HDFS-15095. Fix TestDecommissioningStatus. Contributed by Ahmed Hussein.
2020-01-10 12:43:21 -06:00
c4fb43c942
HADOOP-16749. Configuration parsing of CDATA values are blank
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-01-10 10:31:39 -06:00
49df838995
HADOOP-16697. Tune/audit S3A authoritative mode.
...
Contains:
HADOOP-16474. S3Guard ProgressiveRenameTracker to mark destination
dirirectory as authoritative on success.
HADOOP-16684. S3guard bucket info to list a bit more about
authoritative paths.
HADOOP-16722. S3GuardTool to support FilterFileSystem.
This patch improves the marking of newly created/import directory
trees in S3Guard DynamoDB tables as authoritative.
Specific changes:
* Renamed directories are marked as authoritative if the entire
operation succeeded (HADOOP-16474).
* When updating parent table entries as part of any table write,
there's no overwriting of their authoritative flag.
s3guard import changes:
* new -verbose flag to print out what is going on.
* The "s3guard import" command lets you declare that a directory tree
is to be marked as authoritative
hadoop s3guard import -authoritative -verbose s3a://bucket/path
When importing a listing and a file is found, the import tool queries
the metastore and only updates the entry if the file is different from
before, where different == new timestamp, etag, or length. S3Guard can get
timestamp differences due to clock skew in PUT operations.
As the recursive list performed by the import command doesn't retrieve the
versionID, the existing entry may in fact be more complete.
When updating an existing due to clock skew the existing version ID
is propagated to the new entry (note: the etags must match; this is needed
to deal with inconsistent listings).
There is a new s3guard command to audit a s3guard bucket/path's
authoritative state:
hadoop s3guard authoritative -check-config s3a://bucket/path
This is primarily for testing/auditing.
The s3guard bucket-info command also provides some more details on the
authoritative state of a store (HADOOP-16684).
Change-Id: I58001341c04f6f3597fcb4fcb1581ccefeb77d91
2020-01-10 11:11:56 +00:00
9da294a140
HDFS-15110. HttpFS: post requests are not supported for path "/". Contributed by hemanthboyina.
2020-01-10 17:53:19 +09:00
20a90c0b5b
YARN-10071. Sync Mockito version with other modules
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2020-01-10 17:41:04 +09:00
0315ef8448
HDFS-15100. RBF: Print stacktrace when DFSRouter fails to fetch/parse JMX output from NameNode. ( #1800 )
2020-01-10 13:16:57 +09:00
b32757c616
HDFS-15107. dfs.client.server-defaults.validity.period.ms to support time units. Contributed by Ayush Saxena.
2020-01-10 08:14:56 +05:30
782c0556fb
HDFS-15102. HttpFS: put requests are not supported for path "/". Contributed by hemanthboyina.
2020-01-10 09:52:13 +09:00
93233a7d6e
YARN-9018. Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path. Contributed by Kuhu Shukla (kshukla)
2020-01-09 17:18:44 +00:00
a40dc9ee31
HADOOP-15993. Upgrade Kafka to 2.4.0 in hadoop-kafka module. ( #1796 )
2020-01-09 16:24:58 +09:00
bf45f3b80a
HDFS-14957. INodeReference Space Consumed was not same in QuotaUsage and ContentSummary. Contributed by hemanthboyina.
2020-01-09 12:04:05 +05:30
8fe01db34a
HDFS-15094. RBF: Reuse ugi string in ConnectionPoolID. Contributed by Ayush Saxena.
2020-01-09 09:02:38 +05:30
fd30f4c52b
HDFS-15096. RBF: GetServerDefaults Should be Cached At Router. Contributed by Ayush Saxena.
2020-01-09 08:26:51 +05:30
b1e07d27cc
YARN-7387: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently. Contributed by Jim Brennan (Jim_Brennan)
2020-01-08 19:26:01 +00:00
6899be5a17
YARN-10072: TestCSAllocateCustomResource failures. Contributed by Jim Brennan (Jim_Brennan)
2020-01-08 17:29:56 +00:00
sunlisheng
Akira Ajisaka
Steve Loughran
Szilard Nemeth
Inigo Goiri
Vinayakumar B
Prabhu Joseph
kevinzhao1661
Chao Sun
David Mollitor
Masatake Iwasaki
Clemens Wolff
Wei-Chiu Chuang
Ayush Saxena
Chen Liang
Eric Yang
Kihwal Lee
Daryn Sharp
Takanobu Asanuma
Adam Antal
Eric E Payne
Surendra Singh Lilhore