Rakesh Radhakrishnan
|
f982f96623
|
HDFS-14402. Use FileChannel.transferTo() method for transferring block to SCM cache. Contributed by Feilong He.
(cherry picked from commit 37900c5639 )
|
2019-10-27 22:23:33 +05:30 |
Rakesh Radhakrishnan
|
3b2a7aabf7
|
HDFS-14401. Refine the implementation for HDFS cache on SCM. Contributed by Feilong He.
|
2019-10-27 22:23:16 +05:30 |
Uma Maheswara Rao G
|
b00f9d89e4
|
HDFS-14355 : Implement HDFS cache on SCM by using pure java mapped byte buffer. Contributed by Feilong He.
|
2019-10-27 22:20:00 +05:30 |
Rakesh Radhakrishnan
|
712749c1a0
|
HDFS-14393. Refactor FsDatasetCache for SCM cache implementation. Contributed by Rakesh R
(cherry picked from commit f3f51284d5 )
|
2019-10-27 22:14:56 +05:30 |
Uma Maheswara Rao G
|
aab9fefddc
|
HDFS-14354: Refactor MappableBlock to align with the implementation of SCM cache. Contributed by Feilong He.
(cherry picked from commit ba50a36a3e )
|
2019-10-27 22:14:39 +05:30 |
Fei Hui
|
287fab6346
|
HDFS-14923. Remove dead code from HealthMonitor. Contributed by Fei Hui.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 7be5508d9b )
(cherry picked from commit 54d3e212bf )
|
2019-10-25 15:06:56 -07:00 |
zhaoyim
|
44ca2fe4db
|
HDFS-14308. DFSStripedInputStream curStripeBuf is not freed by unbuffer() (#1667)
Reviewed-by: Aravindan Vijayan <avijayan@cloudera.com>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 30db895b59 )
(cherry picked from commit 9316ca149f )
|
2019-10-25 13:11:07 -07:00 |
Eric Badger
|
f5a3a9e138
|
YARN-9914. Use separate configs for free disk space checking for full and not-full disks. Contributed by Jim Brennan
(cherry picked from commit eef34f2d87 )
|
2019-10-25 17:17:14 +00:00 |
Wei-Chiu Chuang
|
c6e6d1c6cc
|
HDFS-14910. Rename Snapshot with Pre Descendants Fail With IllegalArgumentException. Contributed by Wei-Chiu Chuang. (#1672)
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit a1b4eebcc9 )
(cherry picked from commit 8cf4bc4bda )
|
2019-10-24 13:14:18 -07:00 |
Wei-Chiu Chuang
|
a3493fe328
|
HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang. (#1370)
* HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang.
Change-Id: I9e5e450c07ad70aa1905973896c4f627042dbd37
* Fix checkstyle
Change-Id: I16d4bd4f03a971e1ed36cf57d89dc42357ef8fbf
(cherry picked from commit 6ef6594c7e )
(cherry picked from commit 570ffa1cd6 )
|
2019-10-24 13:14:00 -07:00 |
Vinayakumar B
|
e640e809a9
|
HDFS-14921. Remove SuperUser Check in Setting Storage Policy in FileStatus During Listing. Contributed by Ayush Saxena.
|
2019-10-24 12:26:29 +05:30 |
Zhankun Tang
|
7175fc91d0
|
YARN-9921. Issue in PlacementConstraint when YARN Service AM retries allocation on component failure. Contributed by Tarun Parimi
|
2019-10-24 10:07:40 +08:00 |
Mukul Kumar Singh
|
51114e12ee
|
HDFS-14884. Add sanity check that zone key equals feinfo key while setting Xattrs. Contributed by Mukul Kumar Singh.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit a901405ad8 )
(cherry picked from commit c9d07a42dc )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirXAttrOp.java
|
2019-10-22 16:14:26 -07:00 |
Wei-Chiu Chuang
|
8ef6c0aab2
|
HDFS-13901. INode access time is ignored because of race between open and rename. Contributed by Jinglun.
(cherry picked from commit 31243f0d29 )
|
2019-10-22 09:34:41 -07:00 |
Ayush Saxena
|
4d4f5325bd
|
HDFS-14915. Move Superuser Check Before Taking Lock For Encryption API. Contributed by Ayush Saxena.
|
2019-10-22 18:47:08 +05:30 |
Kihwal Lee
|
362657c1a3
|
HDFS-12749. DN may not send block report to NN after NN restart. Contributed by Xiaoqiao He.
(cherry picked from commit c4e27ef773 )
|
2019-10-21 16:35:50 -05:00 |
Eric E Payne
|
d8b4348036
|
YARN-9915: Fix FindBug issue in QueueMetrics. Contributed by Prabhu Joseph.
(cherry picked from commit 83d148074f )
|
2019-10-21 21:14:23 +00:00 |
Ayush Saxena
|
9067a11b0d
|
HDFS-14913. Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType(). Contributed by Ayush Saxena.
|
2019-10-21 18:43:03 +05:30 |
Ayush Saxena
|
9434f36b43
|
HADOOP-16662. Remove unnecessary InnerNode check in NetworkTopology#add(). Contributed by Lisheng Sun.
|
2019-10-20 11:55:58 +05:30 |
Ayush Saxena
|
c5b4a2d115
|
HDFS-14847. Erasure Coding: Blocks are over-replicated while EC decommissioning. Contributed by Fei Hui.
|
2019-10-20 06:36:27 +05:30 |
Szilard Nemeth
|
19755b9b36
|
MAPREDUCE-6441. Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes (wattsinabox, rchiang, haibochen via snemeth)
|
2019-10-18 15:25:50 +02:00 |
Duo Zhang
|
6097e909ec
|
HADOOP-16600. StagingTestBase uses methods not available in Mockito 1.8.5 in branch-3.1
Signed-off-by: Steve Loughran <stevel@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: stack <stack@apache.org>
|
2019-10-17 16:52:09 -07:00 |
Surendra Singh Lilhore
|
14beaae65e
|
HDFS-14909. DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 54dc6b7d72 )
|
2019-10-17 22:49:03 +05:30 |
Eric E Payne
|
889255576b
|
YARN-9773: Add QueueMetrics for Custom Resources. Contributed by Manikandan R.
(cherry picked from commit a5034c7988 )
|
2019-10-16 21:23:38 +00:00 |
Szilard Nemeth
|
f8c06f5a87
|
HADOOP-16580. Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException. Contributed by Adam Antal
(cherry picked from commit c79a5f2d99 )
(cherry picked from commit 0bbd48c7a8 )
|
2019-10-16 14:24:17 +02:00 |
Haibo Chen
|
a70c6e9665
|
YARN-8842. Expose metrics for custom resource types in QueueMetrics. (Contributed by Szilard Nemeth)
(cherry picked from commit 84e22a6af4 )
|
2019-10-15 22:20:56 +00:00 |
Haibo Chen
|
4ec409fe09
|
YARN-8750. Refactor TestQueueMetrics. (Contributed by Szilard Nemeth)
(cherry picked from commit e60b797c88 )
|
2019-10-15 15:41:20 +00:00 |
Szilard Nemeth
|
c44902212a
|
YARN-8453. Additional Unit tests to verify queue limit and max-limit with multiple resource types. Contributed by Adam Antal
|
2019-10-15 13:25:57 +02:00 |
Surendra Singh Lilhore
|
a47680a3f9
|
HDFS-14886. In NameNode Web UI's Startup Progress page, Loading edits always shows 0 sec. Contributed by hemanthboyina.
(cherry picked from commit 336abbd873 )
|
2019-10-15 00:11:37 +05:30 |
Surendra Singh Lilhore
|
626a48d472
|
HDFS-14373. EC : Decoding is failing when block group last incomplete cell fall in to AlignedStripe. Contributed by Surendra Singh Lilhore.
|
2019-10-11 00:09:20 +05:30 |
Surendra Singh Lilhore
|
b396ebd0d5
|
HDFS-14754. Erasure Coding : The number of Under-Replicated Blocks never reduced(addendum). Contributed by Surendra Singh Lilhore.
(cherry picked from commit d76e2655ac )
|
2019-10-09 23:47:21 +05:30 |
Szilard Nemeth
|
aabc18a777
|
Revert "YARN-9128. Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings. Contributed by Zoltan Siegl"
This reverts commit 73bc8ef9b8 .
|
2019-10-09 19:59:02 +02:00 |
Szilard Nemeth
|
57e88a63cf
|
YARN-9552. FairScheduler: NODE_UPDATE can cause NoSuchElementException. Contributed by Peter Bacsko.
|
2019-10-09 14:19:56 +02:00 |
Szilard Nemeth
|
73bc8ef9b8
|
YARN-9128. Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings. Contributed by Zoltan Siegl
(cherry picked from commit 6f1ab95168 )
(cherry picked from commit 42177e8b78 )
|
2019-10-09 13:28:44 +02:00 |
Szilard Nemeth
|
d1415b66b7
|
YARN-9356. Add more tests to ratio method in TestResourceCalculator. Contributed by Zoltan Siegl
(cherry picked from commit 35f093f5b3 )
(cherry picked from commit 0ddb48a303 )
|
2019-10-09 13:13:51 +02:00 |
Chen Liang
|
01d9952f63
|
HDFS-14509. DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x. Contributed by Yuxuan Wang and Konstantin Shvachko.
(cherry picked from commit 72ae371e7a )
|
2019-10-08 12:08:17 -07:00 |
Hrishikesh Gadre
|
b74754a448
|
HADOOP-16491. Upgrade jetty version to 9.3.27. Contributed by Hrishikesh Gadre.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3cc0ace203 )
(cherry picked from commit aec58731a8 )
|
2019-10-08 11:29:59 -07:00 |
Jonathan Hung
|
0dc85bc182
|
YARN-9760. Support configuring application priorities on a workflow level. Contributed by Varun Saxena
|
2019-10-08 11:18:52 -07:00 |
Szilard Nemeth
|
2c8cfb4f64
|
YARN-6715. Fix documentation about NodeHealthScriptRunner. Contributed by Peter Bacsko
|
2019-10-08 17:34:44 +02:00 |
Ayush Saxena
|
a3599c7e70
|
HDFS-14859. Prevent unnecessary evaluation of costly operation getNumLiveDataNodes when dfs.namenode.safemode.min.datanodes is not zero. Contributed by Srinivasu Majeti.
|
2019-10-08 14:24:56 +05:30 |
Vinayakumar B
|
7ab02a67bc
|
HDFS-13806. EC: No error message for unsetting EC policy of the directory inherits the erasure coding policy from an ancestor directory. Contributed by Ayush Saxena.
(cherry picked from commit 30eceec342 )
|
2019-10-04 13:53:50 -07:00 |
Eric Yang
|
166d38ceaa
|
HDFS-14890. Fixed namenode and journalnode startup on Windows.
Contributed by Siddharth Wagle
(cherry picked from commit aa24add8f0 )
(cherry picked from commit 8bb2b00d38 )
|
2019-10-04 12:08:21 -07:00 |
He Xiaoqiao
|
c61c114a3d
|
HDFS-14497. Addendum: Write lock held by metasave impact following RPC processing.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit dde9399b37 )
(cherry picked from commit e29ae7db12 )
|
2019-10-04 12:07:44 -07:00 |
He Xiaoqiao
|
d91c68729c
|
HDFS-14497. Write lock held by metasave impact following RPC processing. Contributed by He Xiaoqiao.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 33c62f8f4e )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
(cherry picked from commit 80392e94b6 )
|
2019-10-04 12:07:42 -07:00 |
Erik Krogen
|
9fdb849e03
|
HDFS-14245. [SBN read] Enable ObserverReadProxyProvider to work with non-ClientProtocol proxy types. Contributed by Erik Krogen.
(cherry picked from 5847e00143 )
(cherry picked from 6630c9b75d )
|
2019-10-04 11:34:37 -07:00 |
Arpit Agarwal
|
8bb98076be
|
HDFS-2470. NN should automatically set permissions on dfs.namenode.*.dir. Contributed by Siddharth Wagle.
(cherry picked from commit a64a43b77fb1032dcb66730a6b6257a24726c256)
(cherry picked from commit 8b12381717 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLog.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestStartup.java
|
2019-10-04 11:23:03 -07:00 |
Erik Krogen
|
56caacac1f
|
HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen.
(cherry picked from 64f28f9efa )
(cherry picked from 69b0c513a9 )
|
2019-10-04 10:48:17 -07:00 |
Siyao Meng
|
61dc877b00
|
HDFS-14686. HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null (#1192) Contributed by Siyao Meng.
(cherry picked from commit 17e8cf501b )
|
2019-10-04 09:19:30 -07:00 |
Ayush Saxena
|
8ce5015e94
|
HDFS-13693. Remove unnecessary search in INodeDirectory.addChild during image loading. Contributed by Lisheng Sun.
(cherry picked from commit 377f95bbe8 )
(cherry picked from commit e3f54a7babf942efbe879aabef65a5b6df57fb65)
|
2019-10-04 08:52:03 -07:00 |
Takanobu Asanuma
|
c48f2730b4
|
HDFS-14879. Header was wrong in Snapshot web UI. Contributed by hemanthboyina
(cherry picked from commit b23bdaf085 )
|
2019-10-04 16:49:58 +09:00 |