5567154f71
HDFS-16734. RBF: fix some bugs when handling getContentSummary RPC ( #4763 )
2022-08-26 16:04:33 -07:00
5736b34b2a
HDFS-16736. Link to Boost library in libhdfspp ( #4782 )
2022-08-26 09:11:44 -07:00
231a4468cd
HDFS-16732. [SBN READ] Avoid get location from observer when the block report is delayed ( #4756 )
...
Signed-off-by: Erik Krogen <xkrogen@apache.org>
2022-08-25 10:37:25 -07:00
1691cccc89
HDFS-16738. Invalid CallerContext caused NullPointerException ( #4791 )
2022-08-25 17:12:27 +08:00
8d4f51c432
HDFS-16728. RBF throw IndexOutOfBoundsException with disableNameServices ( #4734 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-24 20:27:15 +05:30
c37f01d95b
HDFS-16724. RBF should support get the information about ancestor mount points ( #4719 )
2022-08-23 13:25:42 -07:00
a3b1bafa34
HDFS-16669: Enhance client protocol to propagate last seen state IDs for multiple nameservices.
...
Fixes #4584
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-08-23 11:12:50 -07:00
6fbc38db95
HDFS-16686. GetJournalEditServlet fails to authorize valid Kerberos request ( #4724 )
2022-08-23 08:03:57 -07:00
183f09b1da
HDFS-16717. Replace NPE with IOException in DataNode.class ( #4699 ). Contributed by ZanderXu.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-08-23 18:17:32 +08:00
a9e5fb3313
HDFS-16684. Exclude the current JournalNode ( #4723 )
...
Exclude bound local addresses, including the use of a wildcard address in the bound host configurations.
* Allow sync attempts with unresolved addresses
* Update the comments.
* Remove unused import
Signed-off-by: stack <stack@apache.org>
2022-08-22 09:52:45 -07:00
7f176d080c
HDFS-16729. RBF: fix some unreasonably annotated docs. ( #4745 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-08-21 07:29:31 +09:00
5cc8c574d1
HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously ( #4626 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-08-18 02:25:09 +08:00
86abeb401e
HDFS-16730. Update the doc that append to EC files is supported ( #4749 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-08-17 05:41:41 +08:00
622ca0d51f
HDFS-16705. RBF supports healthMonitor timeout configurable and caching NN and client proxy in NamenodeHeartbeatService ( #4662 )
2022-08-15 13:55:16 -07:00
b1d4af2492
HDFS-16704. Datanode return empty response instead of NPE for GetVolumeInfo during restarting ( #4661 ). Contributed by ZanderXu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-08-15 20:57:27 +08:00
86cc96c493
Revert "HDFS-16689. NameNode may crash when transitioning to Active with in-progress tailer if there are some abnormal JNs. ( #4628 )" ( #4743 )
2022-08-15 19:48:05 +08:00
e0c8c6eed4
HDFS-16678. RBF should supports disable getNodeUsage() in RBFMetrics ( #4606 )
2022-08-12 12:01:58 -07:00
521e65acfe
HDFS-16723. Replace incorrect SafeModeException with StandbyException in RouterRpcServer.class ( #4716 ). Contributed by ZanderXu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-13 00:21:11 +05:30
59619ad247
HDFS-16689. NameNode may crash when transitioning to Active with in-progress tailer if there are some abnormal JNs. ( #4628 )
2022-08-12 12:19:28 +08:00
2005582a28
HDFS-16702. MiniDFSCluster should report cause of exception in assert error ( #4680 )
...
When the MiniDFSClsuter detects that an exception caused an exit, it should include that exception as the cause for the AssertionError that it throws. The current AssertError simply reports the message "Test resulted in an unexpected exit" and provides a stack trace to the location of the check for an exit exception. This patch adds the original exception as the cause of the AssertError.
2022-08-11 13:52:39 -07:00
09cabaad68
HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets ( #4531 )
2022-08-11 13:23:32 -07:00
895f7c51fd
HDFS-16709. Remove redundant cast in FSEditLogOp.class ( #4667 ). Contributed by ZanderXu.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-09 00:54:01 +05:30
25ccdc77af
HDFS-16648. Add isDebugEnabled check for debug blockLogs in some classes ( #4529 )
2022-08-06 21:34:01 +08:00
62dbefd8f2
HADOOP-18305. Release Hadoop 3.3.4: upstream changelog and jdiff files
...
Add the r3.3.4 changelog, release notes and jdiff xml files.
2022-08-05 14:06:22 +01:00
dbf73e16b1
HADOOP-18364. All method metrics related to the RPC protocol should be initialized. ( #4624 ). Contributed by Shuyan Zhang.
...
Reviewed-by: Erik Krogen <xkrogen@apache.org>
Reviewed-by: Chao Sun <sunchao@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-08-04 13:00:37 +08:00
8eebf40b1a
HDFS-16642. Moving the selecting inputstream from journalnode in EditLogTailer outof FSNLock ( #4497 )
2022-08-04 11:04:28 +08:00
0fc7dd8228
HDFS-16687. RouterFsckServlet replicates code from DfsServlet base class ( #4681 )
2022-08-03 09:14:11 -07:00
0f36539d60
HDFS-16712. Fix incorrect placeholder in DataNode.java ( #4672 ). Contributed by ZanderXu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-03 13:01:41 +05:30
69f6fdb757
HADOOP-18301. Upgrade commons-io to 2.11.0 ( #4455 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-08-03 10:44:39 +09:00
f80fab2b90
HDFS-16671. RBF: RouterRpcFairnessPolicyController supports configurable permit acquire timeout ( #4597 )
2022-07-28 15:42:53 +08:00
a5adc27c99
HDFS-16658. Change logLevel from DEBUG to INFO if logEveryBlock is true ( #4559 ). Contributed by ZanderXu.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-07-28 15:30:22 +08:00
06ac327e88
HDFS-16619. Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import ( #4406 )
...
Co-authored-by: slfan1989 <louj1988@@>
2022-07-28 11:07:24 +08:00
24560f2eb5
HDFS-16660. Improve Code With Lambda in IPCLoggerChannel class ( #4561 )
2022-07-27 18:53:05 -07:00
01a2e0f6bd
HDFS-16533. COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length. ( #4155 )
...
Co-authored-by: zengqiang.xu <zengqiang.xu@shopee.com>
2022-07-26 04:30:00 +08:00
6ba2c53720
HDFS-16681. Do not pass GCC flags for MSVC in libhdfspp ( #4615 )
...
* This PR ensures that the GCC flag
-Wno-missing-field-initializers isn't passed
for MSVC.
2022-07-25 22:55:38 +05:30
2f49eec5dd
HDFS-16655. OIV: print out erasure coding policy name in oiv Delimited output ( #4541 ). Contributed by Max Xie.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-07-25 17:39:25 +08:00
8f83d9f56d
HDFS-16680. Skip libhdfspp Valgrind tests on Windows ( #4611 )
...
* The CMake test libhdfs_mini_stress_valgrind
requires Valgrind.
* This PR skips this test on Windows since
Valgrind isn't available.
2022-07-23 23:22:13 +05:30
7de9b5ee27
HDFS-16467. Ensure Protobuf generated headers are included first ( #4601 )
...
* This PR ensures that the Protobuf generated headers
are always included first, even when these headers
are included transitively.
* This problem is specific to Windows only.
2022-07-23 23:20:15 +05:30
2c96357051
HDFS-15079. RBF: Namenode needs to use the actual client Id and callId when going through RBF proxy. ( #4530 )
2022-07-23 22:19:37 +08:00
3cce41a1f6
Make upstream aware of 3.2.4 release.
...
(cherry picked from commit e1637a57df
2022-07-22 02:27:19 +00:00
2f6916a313
HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle. ( #4375 )
2022-07-21 18:42:55 -07:00
08a940d5dd
HDFS-16640. RBF: Show datanode IP list when click DN histogram in Router ( #4488 )
2022-07-21 16:21:31 -07:00
d07256a96d
HDFS-16667. Use malloc for buffer allocation in uriparser2 ( #4576 )
...
* Windows doesn't support variables for specifying
the array size.
* This PR uses malloc to fix this issue.
2022-07-20 21:57:28 +05:30
6415eb04e8
HDFS-16665. Fix duplicate sources for HDFS test ( #4573 )
...
* The library target hdfspp_test_shim_static is
built using the following sources, which
causes duplicate symbols to be defined -
- hdfs_shim.c
- ${LIBHDFSPP_BINDING_C}/hdfs.cc
* ${LIBHDFSPP_BINDING_C}/hdfs.cc is redundant
and removing this fixes the issue.
2022-07-19 21:39:06 +05:30
4fb799e6c5
HDFS-16464. Create only libhdfspp static libraries for Windows ( #4571 )
...
* Added the appropriate CMake flags and
commands to enable only statically
linked libraries and executables to
be built on Windows.
2022-07-19 21:37:22 +05:30
21b8952125
HDFS-16666. Pass CMake args for Windows in pom.xml ( #4574 )
...
* This PR passes the necessary CMake args in the
pom.xml needed for building HDFS native client
on Windows.
* These arguments are exposed as maven options
and can be passed from the command-line.
2022-07-19 10:45:59 +05:30
440f4c2b28
HDFS-16654. Link OpenSSL lib for CMake deps check ( #4538 )
...
* The check_c_source_compiles fails on Windows
while linking with an "unable to resolve
external symbol" error.
* This PR links OpenSSL lib for this check to
fix this issue.
2022-07-17 20:47:30 +05:30
9376b65989
HDFS-16566 Erasure Coding: Recovery may causes excess replicas when busy DN exsits ( #4252 )
2022-07-16 04:52:12 +08:00
2835174a4c
HDFS-16652. Upgrade jquery datatable version references to v1.10.19 ( #4562 )
2022-07-14 18:27:07 +05:30
6f9c4359ec
HDFS-16283. RBF: reducing the load of renewLease() RPC ( #4524 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-07-14 07:26:40 +05:30
ZanderXu
Gautham B A
zhengchenyu
Simba Dzinamarira
Steve Vaughan
jianghuazhu
Ashutosh Gupta
Hui Fei
Steve Loughran
zhangshuyan0
slfan1989
Neil
Masatake Iwasaki
wangzhaohui
RuinanGu
Murali Krishna