xuzq
895f7c51fd
HDFS-16709. Remove redundant cast in FSEditLogOp.class ( #4667 ). Contributed by ZanderXu.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-09 00:54:01 +05:30
xuzq
25ccdc77af
HDFS-16648. Add isDebugEnabled check for debug blockLogs in some classes ( #4529 )
2022-08-06 21:34:01 +08:00
Steve Loughran
62dbefd8f2
HADOOP-18305. Release Hadoop 3.3.4: upstream changelog and jdiff files
...
Add the r3.3.4 changelog, release notes and jdiff xml files.
2022-08-05 14:06:22 +01:00
zhangshuyan0
dbf73e16b1
HADOOP-18364. All method metrics related to the RPC protocol should be initialized. ( #4624 ). Contributed by Shuyan Zhang.
...
Reviewed-by: Erik Krogen <xkrogen@apache.org>
Reviewed-by: Chao Sun <sunchao@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-08-04 13:00:37 +08:00
xuzq
8eebf40b1a
HDFS-16642. Moving the selecting inputstream from journalnode in EditLogTailer outof FSNLock ( #4497 )
2022-08-04 11:04:28 +08:00
Steve Vaughan
0fc7dd8228
HDFS-16687. RouterFsckServlet replicates code from DfsServlet base class ( #4681 )
2022-08-03 09:14:11 -07:00
xuzq
0f36539d60
HDFS-16712. Fix incorrect placeholder in DataNode.java ( #4672 ). Contributed by ZanderXu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-03 13:01:41 +05:30
Ashutosh Gupta
69f6fdb757
HADOOP-18301. Upgrade commons-io to 2.11.0 ( #4455 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-08-03 10:44:39 +09:00
xuzq
f80fab2b90
HDFS-16671. RBF: RouterRpcFairnessPolicyController supports configurable permit acquire timeout ( #4597 )
2022-07-28 15:42:53 +08:00
xuzq
a5adc27c99
HDFS-16658. Change logLevel from DEBUG to INFO if logEveryBlock is true ( #4559 ). Contributed by ZanderXu.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-07-28 15:30:22 +08:00
slfan1989
06ac327e88
HDFS-16619. Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import ( #4406 )
...
Co-authored-by: slfan1989 <louj1988@@>
2022-07-28 11:07:24 +08:00
xuzq
24560f2eb5
HDFS-16660. Improve Code With Lambda in IPCLoggerChannel class ( #4561 )
2022-07-27 18:53:05 -07:00
xuzq
01a2e0f6bd
HDFS-16533. COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length. ( #4155 )
...
Co-authored-by: zengqiang.xu <zengqiang.xu@shopee.com>
2022-07-26 04:30:00 +08:00
Gautham B A
6ba2c53720
HDFS-16681. Do not pass GCC flags for MSVC in libhdfspp ( #4615 )
...
* This PR ensures that the GCC flag
-Wno-missing-field-initializers isn't passed
for MSVC.
2022-07-25 22:55:38 +05:30
Neil
2f49eec5dd
HDFS-16655. OIV: print out erasure coding policy name in oiv Delimited output ( #4541 ). Contributed by Max Xie.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-07-25 17:39:25 +08:00
Gautham B A
8f83d9f56d
HDFS-16680. Skip libhdfspp Valgrind tests on Windows ( #4611 )
...
* The CMake test libhdfs_mini_stress_valgrind
requires Valgrind.
* This PR skips this test on Windows since
Valgrind isn't available.
2022-07-23 23:22:13 +05:30
Gautham B A
7de9b5ee27
HDFS-16467. Ensure Protobuf generated headers are included first ( #4601 )
...
* This PR ensures that the Protobuf generated headers
are always included first, even when these headers
are included transitively.
* This problem is specific to Windows only.
2022-07-23 23:20:15 +05:30
xuzq
2c96357051
HDFS-15079. RBF: Namenode needs to use the actual client Id and callId when going through RBF proxy. ( #4530 )
2022-07-23 22:19:37 +08:00
Masatake Iwasaki
3cce41a1f6
Make upstream aware of 3.2.4 release.
...
(cherry picked from commit e1637a57df
)
2022-07-22 02:27:19 +00:00
slfan1989
2f6916a313
HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle. ( #4375 )
2022-07-21 18:42:55 -07:00
wangzhaohui
08a940d5dd
HDFS-16640. RBF: Show datanode IP list when click DN histogram in Router ( #4488 )
2022-07-21 16:21:31 -07:00
Gautham B A
d07256a96d
HDFS-16667. Use malloc for buffer allocation in uriparser2 ( #4576 )
...
* Windows doesn't support variables for specifying
the array size.
* This PR uses malloc to fix this issue.
2022-07-20 21:57:28 +05:30
Gautham B A
6415eb04e8
HDFS-16665. Fix duplicate sources for HDFS test ( #4573 )
...
* The library target hdfspp_test_shim_static is
built using the following sources, which
causes duplicate symbols to be defined -
- hdfs_shim.c
- ${LIBHDFSPP_BINDING_C}/hdfs.cc
* ${LIBHDFSPP_BINDING_C}/hdfs.cc is redundant
and removing this fixes the issue.
2022-07-19 21:39:06 +05:30
Gautham B A
4fb799e6c5
HDFS-16464. Create only libhdfspp static libraries for Windows ( #4571 )
...
* Added the appropriate CMake flags and
commands to enable only statically
linked libraries and executables to
be built on Windows.
2022-07-19 21:37:22 +05:30
Gautham B A
21b8952125
HDFS-16666. Pass CMake args for Windows in pom.xml ( #4574 )
...
* This PR passes the necessary CMake args in the
pom.xml needed for building HDFS native client
on Windows.
* These arguments are exposed as maven options
and can be passed from the command-line.
2022-07-19 10:45:59 +05:30
Gautham B A
440f4c2b28
HDFS-16654. Link OpenSSL lib for CMake deps check ( #4538 )
...
* The check_c_source_compiles fails on Windows
while linking with an "unable to resolve
external symbol" error.
* This PR links OpenSSL lib for this check to
fix this issue.
2022-07-17 20:47:30 +05:30
RuinanGu
9376b65989
HDFS-16566 Erasure Coding: Recovery may causes excess replicas when busy DN exsits ( #4252 )
2022-07-16 04:52:12 +08:00
Murali Krishna
2835174a4c
HDFS-16652. Upgrade jquery datatable version references to v1.10.19 ( #4562 )
2022-07-14 18:27:07 +05:30
xuzq
6f9c4359ec
HDFS-16283. RBF: reducing the load of renewLease() RPC ( #4524 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-07-14 07:26:40 +05:30
Gautham B A
8e39e35bea
HDFS-16466. Implement Linux permission flags on Windows ( #4526 )
...
* HDFS-16466. Implement Linux permission flags on Windows
* statinfo.cc uses POSIX permission flags.
These flags aren't available for Windows.
* This PR implements the equivalent flags
on Windows to make this cross platform
compatible.
2022-07-08 09:29:13 +05:30
cxzl25
ea46f49b04
HDFS-16638. Add isDebugEnabled check for debug blockLogs in BlockManager. ( #4480 ). Contributed by dzcxzl.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-07-04 02:36:29 +05:30
jianghuazhu
a333674785
HDFS-16647. Delete unused NameNode#FS_HDFS_IMPL_KEY. ( #4525 ). Contributed by JiangHua Zhu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-07-03 01:47:02 +05:30
slfan1989
073b8ea1d5
HADOOP-18284. Remove Unnecessary semicolon ';' ( #4422 ). Contributed by fanshilun.
2022-06-29 15:20:41 +05:30
jianghuazhu
321a4844ad
HADOOP-18314. Add some description for PowerShellFencer. ( #4505 )
2022-06-28 19:06:39 -07:00
Ashutosh Gupta
b7edc6c60c
HDFS-16633. Fixing when Reserved Space For Replicas is not released on some cases ( #4452 )
...
* HDFS-16633.Reserved Space For Replicas is not released on some cases
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-06-24 18:35:00 +05:30
Samrat
e8fd914c58
HDFS-16616. remove use of org.apache.hadoop.util.Sets ( #4400 )
...
Co-Authored by: Samrat Deb
2022-06-22 10:17:36 +05:30
Viraj Jasani
7a1d811197
HDFS-16637. TestHDFSCLI#testAll consistently failing ( #4466 ). Contributed by Viraj Jasani.
...
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-06-21 13:42:43 +05:30
Ashutosh Gupta
efc2761d32
HDFS-16635.Fixed javadoc error in Java 11 ( #4451 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-06-20 11:14:31 +05:30
KevinWikant
cfceaebde6
HDFS-16064. Determine when to invalidate corrupt replicas based on number of usable replicas ( #4410 )
...
Co-authored-by: Kevin Wikant <wikak@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-06-20 11:20:24 +09:00
Viraj Jasani
cb0421095b
HDFS-16634. Dynamically adjust slow peer report size on JMX metrics ( #4448 )
...
Signed-off-by: Tao Li <tomscut@apache.org>
2022-06-20 09:21:00 +08:00
Viraj Jasani
e38e13be03
HADOOP-18288. Total requests and total requests per sec served by RPC servers ( #4431 )
...
Reviewed-by: Steve Loughran <stevel@apache.org>
Signed-off-by: Tao Li <tomscut@apache.org>
2022-06-18 12:17:20 +08:00
xuzq
4893f00395
HDFS-16600. Fix deadlock of fine-grain lock for FsDatastImpl of DataNode. ( #4367 ). Contributed by ZanderXu.
...
Reviewed-by: Mingxiang Li <liaiphag0@gmail.com>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-06-17 22:05:33 +08:00
caozhiqiang
9e3fc40ecb
HDFS-16613. EC: Improve performance of decommissioning dn with many ec blocks ( #4398 )
2022-06-17 02:11:25 +08:00
jianghuazhu
6cbeae2e52
HDFS-16581.Print node status when executing printTopology. ( #4321 )
...
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Tao Li <tomscut@apache.org>
2022-06-16 19:18:58 +08:00
章锡平
f8c7e67fdc
HDFS-16628 RBF: Correct target directory when move to trash for kerberos login user. ( #4424 ). Contributed by Xiping Zhang.
2022-06-15 21:16:24 +08:00
Gautham B A
5a40224b53
HDFS-16469. Locate protoc-gen-hrpc across platforms ( #4434 )
...
* We use the TARGET_FILE CMake
generator expression to get
the location of the
protoc-gen-hrpc CMake target.
2022-06-15 15:28:10 +05:30
xuzq
d0715b1024
HDFS-16598. Fix DataNode FsDatasetImpl lock issue without GS checks. ( #4366 ). Contributed by ZanderXu.
...
Reviewed-by: Mingxiang Li <liaiphag0@gmail.com>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-06-14 21:48:03 +08:00
Steve Vaughan
bebf03a66e
HDFS-16625. Check assumption about PMDK availability ( #4414 )
...
Signed-off-by: Ashutosh Gupta <ashutosh.gupta@st.niituniversity.in>
Signed-off-by: stack <stack@apache.org>
2022-06-13 23:42:18 -07:00
slfan1989
170668b994
HDFS-16609. Fix Flakes Junit Tests that often report timeouts. ( #4382 ). Contributed by fanshilun.
2022-06-11 20:11:21 +08:00
slfan1989
02c21ef8c3
HDFS-16627. Improve BPServiceActor#register log to add NameNode address. ( #4419 ). Contributed by fanshilun.
2022-06-11 20:04:39 +08:00