e0c8c6eed4
HDFS-16678. RBF should supports disable getNodeUsage() in RBFMetrics ( #4606 )
2022-08-12 12:01:58 -07:00
521e65acfe
HDFS-16723. Replace incorrect SafeModeException with StandbyException in RouterRpcServer.class ( #4716 ). Contributed by ZanderXu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-13 00:21:11 +05:30
59619ad247
HDFS-16689. NameNode may crash when transitioning to Active with in-progress tailer if there are some abnormal JNs. ( #4628 )
2022-08-12 12:19:28 +08:00
2005582a28
HDFS-16702. MiniDFSCluster should report cause of exception in assert error ( #4680 )
...
When the MiniDFSClsuter detects that an exception caused an exit, it should include that exception as the cause for the AssertionError that it throws. The current AssertError simply reports the message "Test resulted in an unexpected exit" and provides a stack trace to the location of the check for an exit exception. This patch adds the original exception as the cause of the AssertError.
2022-08-11 13:52:39 -07:00
09cabaad68
HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets ( #4531 )
2022-08-11 13:23:32 -07:00
895f7c51fd
HDFS-16709. Remove redundant cast in FSEditLogOp.class ( #4667 ). Contributed by ZanderXu.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-09 00:54:01 +05:30
25ccdc77af
HDFS-16648. Add isDebugEnabled check for debug blockLogs in some classes ( #4529 )
2022-08-06 21:34:01 +08:00
62dbefd8f2
HADOOP-18305. Release Hadoop 3.3.4: upstream changelog and jdiff files
...
Add the r3.3.4 changelog, release notes and jdiff xml files.
2022-08-05 14:06:22 +01:00
dbf73e16b1
HADOOP-18364. All method metrics related to the RPC protocol should be initialized. ( #4624 ). Contributed by Shuyan Zhang.
...
Reviewed-by: Erik Krogen <xkrogen@apache.org>
Reviewed-by: Chao Sun <sunchao@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-08-04 13:00:37 +08:00
8eebf40b1a
HDFS-16642. Moving the selecting inputstream from journalnode in EditLogTailer outof FSNLock ( #4497 )
2022-08-04 11:04:28 +08:00
0fc7dd8228
HDFS-16687. RouterFsckServlet replicates code from DfsServlet base class ( #4681 )
2022-08-03 09:14:11 -07:00
0f36539d60
HDFS-16712. Fix incorrect placeholder in DataNode.java ( #4672 ). Contributed by ZanderXu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-03 13:01:41 +05:30
69f6fdb757
HADOOP-18301. Upgrade commons-io to 2.11.0 ( #4455 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-08-03 10:44:39 +09:00
f80fab2b90
HDFS-16671. RBF: RouterRpcFairnessPolicyController supports configurable permit acquire timeout ( #4597 )
2022-07-28 15:42:53 +08:00
a5adc27c99
HDFS-16658. Change logLevel from DEBUG to INFO if logEveryBlock is true ( #4559 ). Contributed by ZanderXu.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-07-28 15:30:22 +08:00
06ac327e88
HDFS-16619. Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import ( #4406 )
...
Co-authored-by: slfan1989 <louj1988@@>
2022-07-28 11:07:24 +08:00
24560f2eb5
HDFS-16660. Improve Code With Lambda in IPCLoggerChannel class ( #4561 )
2022-07-27 18:53:05 -07:00
01a2e0f6bd
HDFS-16533. COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length. ( #4155 )
...
Co-authored-by: zengqiang.xu <zengqiang.xu@shopee.com>
2022-07-26 04:30:00 +08:00
6ba2c53720
HDFS-16681. Do not pass GCC flags for MSVC in libhdfspp ( #4615 )
...
* This PR ensures that the GCC flag
-Wno-missing-field-initializers isn't passed
for MSVC.
2022-07-25 22:55:38 +05:30
2f49eec5dd
HDFS-16655. OIV: print out erasure coding policy name in oiv Delimited output ( #4541 ). Contributed by Max Xie.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-07-25 17:39:25 +08:00
8f83d9f56d
HDFS-16680. Skip libhdfspp Valgrind tests on Windows ( #4611 )
...
* The CMake test libhdfs_mini_stress_valgrind
requires Valgrind.
* This PR skips this test on Windows since
Valgrind isn't available.
2022-07-23 23:22:13 +05:30
7de9b5ee27
HDFS-16467. Ensure Protobuf generated headers are included first ( #4601 )
...
* This PR ensures that the Protobuf generated headers
are always included first, even when these headers
are included transitively.
* This problem is specific to Windows only.
2022-07-23 23:20:15 +05:30
2c96357051
HDFS-15079. RBF: Namenode needs to use the actual client Id and callId when going through RBF proxy. ( #4530 )
2022-07-23 22:19:37 +08:00
3cce41a1f6
Make upstream aware of 3.2.4 release.
...
(cherry picked from commit e1637a57df
2022-07-22 02:27:19 +00:00
2f6916a313
HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle. ( #4375 )
2022-07-21 18:42:55 -07:00
08a940d5dd
HDFS-16640. RBF: Show datanode IP list when click DN histogram in Router ( #4488 )
2022-07-21 16:21:31 -07:00
d07256a96d
HDFS-16667. Use malloc for buffer allocation in uriparser2 ( #4576 )
...
* Windows doesn't support variables for specifying
the array size.
* This PR uses malloc to fix this issue.
2022-07-20 21:57:28 +05:30
6415eb04e8
HDFS-16665. Fix duplicate sources for HDFS test ( #4573 )
...
* The library target hdfspp_test_shim_static is
built using the following sources, which
causes duplicate symbols to be defined -
- hdfs_shim.c
- ${LIBHDFSPP_BINDING_C}/hdfs.cc
* ${LIBHDFSPP_BINDING_C}/hdfs.cc is redundant
and removing this fixes the issue.
2022-07-19 21:39:06 +05:30
4fb799e6c5
HDFS-16464. Create only libhdfspp static libraries for Windows ( #4571 )
...
* Added the appropriate CMake flags and
commands to enable only statically
linked libraries and executables to
be built on Windows.
2022-07-19 21:37:22 +05:30
21b8952125
HDFS-16666. Pass CMake args for Windows in pom.xml ( #4574 )
...
* This PR passes the necessary CMake args in the
pom.xml needed for building HDFS native client
on Windows.
* These arguments are exposed as maven options
and can be passed from the command-line.
2022-07-19 10:45:59 +05:30
440f4c2b28
HDFS-16654. Link OpenSSL lib for CMake deps check ( #4538 )
...
* The check_c_source_compiles fails on Windows
while linking with an "unable to resolve
external symbol" error.
* This PR links OpenSSL lib for this check to
fix this issue.
2022-07-17 20:47:30 +05:30
9376b65989
HDFS-16566 Erasure Coding: Recovery may causes excess replicas when busy DN exsits ( #4252 )
2022-07-16 04:52:12 +08:00
2835174a4c
HDFS-16652. Upgrade jquery datatable version references to v1.10.19 ( #4562 )
2022-07-14 18:27:07 +05:30
6f9c4359ec
HDFS-16283. RBF: reducing the load of renewLease() RPC ( #4524 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-07-14 07:26:40 +05:30
8e39e35bea
HDFS-16466. Implement Linux permission flags on Windows ( #4526 )
...
* HDFS-16466. Implement Linux permission flags on Windows
* statinfo.cc uses POSIX permission flags.
These flags aren't available for Windows.
* This PR implements the equivalent flags
on Windows to make this cross platform
compatible.
2022-07-08 09:29:13 +05:30
ea46f49b04
HDFS-16638. Add isDebugEnabled check for debug blockLogs in BlockManager. ( #4480 ). Contributed by dzcxzl.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-07-04 02:36:29 +05:30
a333674785
HDFS-16647. Delete unused NameNode#FS_HDFS_IMPL_KEY. ( #4525 ). Contributed by JiangHua Zhu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-07-03 01:47:02 +05:30
073b8ea1d5
HADOOP-18284. Remove Unnecessary semicolon ';' ( #4422 ). Contributed by fanshilun.
2022-06-29 15:20:41 +05:30
321a4844ad
HADOOP-18314. Add some description for PowerShellFencer. ( #4505 )
2022-06-28 19:06:39 -07:00
b7edc6c60c
HDFS-16633. Fixing when Reserved Space For Replicas is not released on some cases ( #4452 )
...
* HDFS-16633.Reserved Space For Replicas is not released on some cases
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-06-24 18:35:00 +05:30
e8fd914c58
HDFS-16616. remove use of org.apache.hadoop.util.Sets ( #4400 )
...
Co-Authored by: Samrat Deb
2022-06-22 10:17:36 +05:30
7a1d811197
HDFS-16637. TestHDFSCLI#testAll consistently failing ( #4466 ). Contributed by Viraj Jasani.
...
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-06-21 13:42:43 +05:30
efc2761d32
HDFS-16635.Fixed javadoc error in Java 11 ( #4451 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-06-20 11:14:31 +05:30
cfceaebde6
HDFS-16064. Determine when to invalidate corrupt replicas based on number of usable replicas ( #4410 )
...
Co-authored-by: Kevin Wikant <wikak@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-06-20 11:20:24 +09:00
cb0421095b
HDFS-16634. Dynamically adjust slow peer report size on JMX metrics ( #4448 )
...
Signed-off-by: Tao Li <tomscut@apache.org>
2022-06-20 09:21:00 +08:00
e38e13be03
HADOOP-18288. Total requests and total requests per sec served by RPC servers ( #4431 )
...
Reviewed-by: Steve Loughran <stevel@apache.org>
Signed-off-by: Tao Li <tomscut@apache.org>
2022-06-18 12:17:20 +08:00
4893f00395
HDFS-16600. Fix deadlock of fine-grain lock for FsDatastImpl of DataNode. ( #4367 ). Contributed by ZanderXu.
...
Reviewed-by: Mingxiang Li <liaiphag0@gmail.com>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-06-17 22:05:33 +08:00
9e3fc40ecb
HDFS-16613. EC: Improve performance of decommissioning dn with many ec blocks ( #4398 )
2022-06-17 02:11:25 +08:00
6cbeae2e52
HDFS-16581.Print node status when executing printTopology. ( #4321 )
...
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Tao Li <tomscut@apache.org>
2022-06-16 19:18:58 +08:00
f8c7e67fdc
HDFS-16628 RBF: Correct target directory when move to trash for kerberos login user. ( #4424 ). Contributed by Xiping Zhang.
2022-06-15 21:16:24 +08:00
xuzq
Steve Vaughan
Steve Loughran
zhangshuyan0
Ashutosh Gupta
slfan1989
Gautham B A
Neil
Masatake Iwasaki
wangzhaohui
RuinanGu
Murali Krishna
cxzl25
jianghuazhu
Samrat
Viraj Jasani
KevinWikant
caozhiqiang
章锡平