8b3c6791b1
YARN-9135. NM State store ResourceMappings serialization are tested with Strings instead of real Device objects. Contributed by Peter Bacsko
2019-07-12 17:20:42 +02:00
c416284bb7
YARN-9235. If linux container executor is not set for a GPU cluster GpuResourceHandlerImpl is not initialized and NPE is thrown. Contributed by Antal Balint Steinbach, Adam Antal
2019-07-12 16:51:58 +02:00
190e4349d7
HDDS-1790. Fix checkstyle issues in TestDataScrubber
...
Closes #1082
2019-07-12 14:42:29 +02:00
7b8177ba0f
HDDS-1791. Update network-tests/src/test/blockade/README.md file
...
Closes #1083
2019-07-12 14:38:22 +02:00
b15ef7dc3d
HADOOP-16384: S3A: Avoid inconsistencies between DDB and S3.
...
Contributed by Steve Loughran
Contains
- HADOOP-16397. Hadoop S3Guard Prune command to support a -tombstone option.
- HADOOP-16406. ITestDynamoDBMetadataStore.testProvisionTable times out intermittently
This patch doesn't fix the underlying problem but it
* changes some tests to clean up better
* does a lot more in logging operations in against DDB, if enabled
* adds an entry point to dump the state of the metastore and s3 tables (precursor to fsck)
* adds a purge entry point to help clean up after a test run has got a store into a mess
* s3guard prune command adds -tombstone option to only clear tombstones
The outcome is that tests should pass consistently and if problems occur we have better diagnostics.
Change-Id: I3eca3f5529d7f6fec398c0ff0472919f08f054eb
2019-07-12 13:02:25 +01:00
f9fab9f22a
HDFS-14499. Misleading REM_QUOTA value with snapshot and trash feature enabled for a directory. Contributed by Shashikant Banerjee.
2019-07-12 15:42:06 +05:30
51e7dc3221
make author check yetus safe
2019-07-12 11:59:24 +02:00
ca7b3e8310
reenable unit test execution
2019-07-12 11:59:20 +02:00
317f2c896f
fix rat problem
2019-07-12 11:30:56 +02:00
987bf3f696
fix print0 consequences
2019-07-12 11:30:56 +02:00
6f25420f57
fixing ALL the checkstule issues under hadoop-ozone/dev-support/checks
2019-07-12 11:30:56 +02:00
0bae9e8ec8
HDDS-1735. Create separate unit and integration test executor dev-support script
2019-07-12 11:30:55 +02:00
9119ed07ff
HDDS-1384. TestBlockOutputStreamWithFailures is failing
...
Closes #1029
2019-07-12 11:00:03 +02:00
14c43f85de
HDDS-1752. ConcurrentModificationException while handling DeadNodeHandler event. ( #1080 )
2019-07-12 14:15:48 +05:30
738fab3bff
HDDS-1754. getContainerWithPipeline fails with PipelineNotFoundException. Contributed by Supratim Deka ( #1081 )
2019-07-12 10:31:48 +05:30
00dd843a1a
HDFS-14466. Add a regression test for HDFS-14323.
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-12 10:04:55 +09:00
cdcc205490
HDDS-1784. Missing HostName and IpAddress in the response of register command. ( #1078 )
2019-07-11 17:17:05 -07:00
9b54dd7186
YARN-9668. UGI conf doesn't read user overridden configurations on RM and NM startup. (Contributed by Jonathan Hung)
2019-07-11 13:57:08 -07:00
8fb5ca3f40
HDFS-14611. Move handshake secret field from Token to BlockAccessToken. Contributed by Chen Liang.
2019-07-11 13:23:25 -07:00
6a3433bffd
HADOOP-16357. TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists.
...
Contributed by Steve Loughran.
This patch
* changes the default for the staging committer to append, as we get for the classic FileOutputFormat committer
* adds a check for the dest path being a file not a dir
* adds tests for this
* Changes AbstractCommitTerasortIT. to not use the simple parser, so fails if the file is present.
Change-Id: Id53742958ed1cf321ff96c9063505d64f3254f53
2019-07-11 18:15:34 +01:00
5747f6cff5
HDFS-14624. When decommissioning a node, log remaining blocks to replicate periodically. Contributed by Stephen O'Donnell.
2019-07-11 08:55:44 -07:00
5043840b1d
HDFS-14410. Make Dynamometer documentation properly compile onto the Hadoop site. Contributed by Erik Krogen.
2019-07-11 23:47:27 +08:00
32925d04d9
HDFS-14640. [Dynamometer] Fix TestDynamometerInfra failure. Contributed by Erik Krogen.
2019-07-11 08:34:39 -07:00
fc0656dd30
HADOOP-16418. [Dynamometer] Fix checkstyle and findbugs warnings. Contributed by Erik Krogen.
2019-07-11 08:29:57 -07:00
9cec023186
YARN-9625. UI2 - No link to a queue on the Queues page for Fair Scheduler. Contributed by Zoltan Siegl
2019-07-11 16:11:21 +02:00
0f399b0d57
HDDS-1784. Missing HostName and IpAddress in the response of register command.
2019-07-11 19:01:06 +05:30
acef5e0cec
HDDS-1201. Reporting corrupted containers info to SCM ( #1032 )
2019-07-11 14:49:58 +05:30
ccaa99c923
HADOOP-16381. The JSON License is included in binary tarball via azure-documentdb:1.16.2. Contributed by Sushil Ks.
2019-07-11 13:49:42 +09:00
555dabf4f8
YARN-9660. Update support documentation for Docker on YARN.
...
Contributed by Peter Bacsko
2019-07-10 17:15:33 -04:00
c7b5f858a0
HADOOP-16393. S3Guard init command uses global settings, not those of target bucket.
...
Contributed by Steve Loughran.
Change-Id: I226a91ab8d7758340f8d221aa80a7abf9a0d3e8f
2019-07-10 20:57:02 +01:00
6872efcabf
HDDS-1611.[Addendum] Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. ( #973 )
...
Fixes a build break in ozone.
2019-07-10 11:28:18 -07:00
eccc9a40de
HDFS-12703. Exceptions are fatal to decommissioning monitor. Contributed by He Xiaoqiao.
2019-07-10 11:11:52 -07:00
cdb20adfcc
HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. ( #973 )
2019-07-10 11:03:58 -07:00
90b10a0d54
HDFS-14622. [Dynamometer] Update XML FsImage parsing logic to ignore non-INodeSection entries to fix an issue caused by the presence of Centralized Cache Management functionality. Contributed by Erik Krogen.
2019-07-10 09:59:11 -07:00
efb916457f
HDDS-1778. Fix existing blockade tests. ( #1068 )
2019-07-10 09:43:58 -07:00
bbf5844968
HDDS-1525. Mapreduce failure when using Hadoop 2.7.5
...
Closes #1065
2019-07-10 15:31:28 +02:00
93824886e9
HDDS-1764. Fix hidden errors in acceptance tests
...
Closes #1059
2019-07-10 13:22:51 +02:00
e0fa1040af
HDDS-1748. Error message for 3 way commit failure is not verbose. Contributed by Supratim Deka ( #1051 )
2019-07-10 16:45:55 +05:30
993dc8726b
HDFS-14632. Reduce useless #getNumLiveDataNodes call in SafeModeMonitor. Contributed by He Xiaoqiao.
2019-07-10 10:53:34 +08:00
ac7a8accdf
HDDS-1603. Handle Ratis Append Failure in Container State Machine. Contributed by Supratim Deka ( #1019 )
2019-07-10 07:49:36 +05:30
030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen.
2019-07-09 14:43:55 -07:00
96d0555913
HDDS-1718. Increase Ratis Leader election timeout default. Contributed by Aravindan Vijayan & Siddharth Wagle. ( #1062 )
2019-07-09 23:17:50 +05:30
1dc58c5b04
HDDS-1742. Merge ozone-perf and ozonetrace example clusters
...
Closes #1057
2019-07-09 17:21:16 +02:00
8861573e8c
HDDS-1717. MR Job fails as OMFailoverProxyProvider has dependency hadoop-3.2
...
Closes #1056
2019-07-09 13:22:00 +02:00
82d88a8d30
HDDS-1705. Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints. Contributed by Vivek Ratnavel Subramanian.
2019-07-08 21:06:50 -07:00
e5ffb88257
HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. ( #1050 )
...
* HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.
2019-07-08 20:24:12 -07:00
b5d30e4914
HDDS-1750. Add block allocation metrics for pipelines in SCM. Contributed by Lokesh Jain. ( #1047 )
2019-07-09 08:42:55 +05:30
738c09349e
HADOOP-16411. Fix javadoc warnings in hadoop-dynamometer.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-07-09 09:44:49 +09:00
4632708148
HDFS-14547. Improve memory efficiency of quotas when storage type quotas are not set. Contributed by Jinglun.
2019-07-08 14:46:25 -07:00
de6b7bc67a
HADOOP-16409. Allow authoritative mode on non-qualified paths. Contributed by Sean Mackrory
2019-07-08 19:27:07 +02:00
Szilard Nemeth
Nanda kumar
Steve Loughran
Shashikant Banerjee
Márton Elek
Hrishikesh Gadre
supratimdeka
Masatake Iwasaki
Anu Engineer
Haibo Chen
Chen Liang
Inigo Goiri
Yiqun Lin
Erik Krogen
Akira Ajisaka
Eric Yang
Ajay Yadav
Xiaoyu Yao
Mukul Kumar Singh
pifta
Hanisha Koneru
Vivek Ratnavel Subramanian
Lokesh Jain
Sean Mackrory