Commit Graph

22477 Commits

Author SHA1 Message Date
Wei-Chiu Chuang 99f88c30cb HDFS-14419. Avoid repeated calls to the listOpenFiles function. Contributed by HuangTao. 2019-07-30 16:50:06 -07:00
Chao Sun 3ae775d740 HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-07-30 16:01:17 -07:00
Erik Krogen 1f26cc8705 HDFS-13783. Add an option to the Balancer to make it run as a long-running service. Contributed by Chen Zhang. 2019-07-30 15:42:55 -07:00
Inigo Goiri 7849bdcf70 HDFS-14449. Expose total number of DT in JMX for Namenode. Contributed by Fengnan Li. 2019-07-30 13:45:27 -07:00
Doroszlai, Attila e68d8446c4 HDDS-1834. parent directories not found in secure setup due to ACL check. Contributed by Doroszlai, Attila.
This closes #1171.
2019-07-30 13:41:16 -07:00
Eric E Payne 42683aef1a YARN-9596: QueueMetrics has incorrect metrics when labelled partitions are involved. Contributed by Muhammad Samir Khan. 2019-07-30 18:58:36 +00:00
Siyao Meng c75f16db79 HADOOP-16452. Increase ipc.maximum.data.length default from 64MB to 128MB. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-07-30 11:22:45 -07:00
Sneha Vijayarajan 12a526c080 HADOOP-16460: ABFS: fix for Sever Name Indication (SNI)
Contributed by Sneha Vijayarajan <snvijaya@microsoft.com>
2019-07-30 17:23:23 +00:00
Ayush Saxena 8deced0073 HDFS-14677. TestDataNodeHotSwapVolumes#testAddVolumesConcurrently fails intermittently in trunk. Contributed by Chen Zhang. 2019-07-30 22:17:39 +05:30
Bharat Viswanadham 88daa730a3
HDDS-1872. Fix entry clean up from openKeyTable during complete MPU. (#1182) 2019-07-30 09:28:26 -07:00
Felipe Lopes bca86bd289
HADOOP-16469. Update committers.md
Contributed by Felipe Lopes.

Change-Id: I5c05b878bde073aeb45bf22340183893f85269e1
2019-07-30 12:47:55 +01:00
Don Jeba 204a977f55
HADOOP-15910. Fix Javadoc for LdapAuthenticationHandler#ENABLE_START_TLS
Contributed by Don Jeba.

Change-Id: I2755bfb1263fc659078a1af8f0bdfd739fd1ae40
2019-07-30 12:39:48 +01:00
Akira Ajisaka cbfa3f3e98
HADOOP-16435. RpcMetrics should not retained forever. Contributed by Zoltan Haindrich. 2019-07-29 17:37:26 -07:00
Bharat Viswanadham 68f9f2d833
Revert HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. (#1183) 2019-07-29 16:44:48 -07:00
Siyao Meng 4d07134b13 HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated (#1164) 2019-07-29 16:42:00 -07:00
Wei-Chiu Chuang 8053085388 HDFS-14429. Block remain in COMMITTED but not COMPLETE caused by Decommission. Contributed by Yicong Cai. 2019-07-29 14:31:34 -07:00
Erik Krogen 72900de5f4 HDFS-14639. [Dynamometer] Remove unnecessary duplicate directory from the distribution. Contributed by Erik Krogen. 2019-07-29 13:50:14 -07:00
CR Hota 611718f59f HDFS-14670: RBF: Create secret manager instance using FederationUtil#newInstance. 2019-07-29 11:00:22 -07:00
avijayanhwx 60325c9611 HDDS-1391 : Add ability in OM to serve delta updates through an API. (#1033) 2019-07-29 09:39:40 -07:00
Eric Yang d023663e3e HDDS-1833. Moved RefCountedDB stacktrace to log level trace.
Contributed by Siddharth Wagle
2019-07-29 12:05:24 -04:00
Chen Zhang 8a59cd1b8a HDFS-12967. NNBench should support multi-cluster access. Contributed by Chen Zhang.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-07-29 05:55:12 -07:00
Márton Elek 90afb7bf8c
HDDS-1725. pv-test example to test csi is not working 2019-07-29 11:54:36 +02:00
Márton Elek b039f7591f
HDDS-1682. TestEventWatcher.testMetrics is flaky
Closes #962.
2019-07-29 11:04:45 +02:00
Doroszlai, Attila 61ec03c966
HDDS-1852. Fix typo in TestOmAcls
Closes #1173
2019-07-29 10:46:11 +02:00
Doroszlai, Attila 902ff4a2f6
HDDS-1867. Invalid Prometheus metric name from JvmMetrics
Closes #1172
2019-07-29 10:27:55 +02:00
Ayush Saxena 02bd02b5af HDFS-14660. [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider. Contributed by Chao Sun. 2019-07-28 08:41:42 +05:30
hunshenshi 2fe450cb5e HDFS-14425. Native build fails on macos due to jlong in hdfs.c (#741) 2019-07-26 15:33:12 -07:00
Erik Krogen 62efb63006 HADOOP-16245. Restrict the effect of LdapGroupsMapping SSL configurations to avoid interfering with other SSL connections. Contributed by Erik Krogen. 2019-07-26 11:16:58 -07:00
HUAN-PING SU ecc8acfd24 HDFS-14673. The console log is noisy when using DNSDomainNameResolver to resolve NameNode. 2019-07-26 11:08:46 -07:00
Sammi Chen c01e137273 HDDS-1864. Turn on topology aware read in TestFailureHandlingByClient. (#1168) 2019-07-26 23:11:34 +05:30
Chen, Junjie c7c7a889a8 HDDS-1839: Change topology sorting related logs in Pipeline from INFO to DEBUG. Contributed by Junjie Chen.
This closes #1158.
2019-07-26 08:14:24 -07:00
Mehul Garnara c0a0c353e8
MAPREDUCE-6973. Fix comments on creating _SUCCESS file.
This closes #280

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-26 21:21:26 +09:00
Gopal V aebac6d2d2
HADOOP-16461. Regression: FileSystem cache lock parses XML within the lock.
Contributed by Gopal V.

Change-Id: If6654f850e9c24ee0d9519a46fd6269b18e1a7a4
2019-07-26 11:32:13 +01:00
Steve Loughran 07530314c2
HADOOP-9844. NPE when trying to create an error message response of SASL RPC
This closes #55

Change-Id: I10a20380565fa89762f4aa564b2f1c83b9aeecdc
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-26 17:53:18 +09:00
pingsutw 98653ecccb
HADOOP-16447 Upgrade JUnit5 from 5.3.1 to 5.5.1 to support global timeout
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-26 17:05:34 +09:00
Bharat Viswanadham 3426777140
HDDS-1861. Fix TableCacheImpl cleanup logic. (#1165) 2019-07-25 22:30:06 -07:00
Ayush Saxena ce99cc31e9 HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu. 2019-07-26 08:31:00 +05:30
Nanda kumar a2cc961086 HDDS-1855. TestStorageContainerManager#testScmProcessDatanodeHeartbeat is failing. (#1153) 2019-07-26 10:54:23 +08:00
Masatake Iwasaki 6b8107ad97 HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-07-26 09:35:23 +09:00
Siyao Meng b7fba78fb6 HDDS-1830 OzoneManagerDoubleBuffer#stop should wait for daemon thread to die (#1156) 2019-07-25 16:14:50 -07:00
Nanda kumar 2b1d8aedbb HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-25 14:25:39 -07:00
Xiaoyu Yao b41ef61ebc HDDS-1858. mTLS support for Ozone is not correct. Contributed by Siddharth Wagle. 2019-07-25 09:52:02 -07:00
Bharat Viswanadham 3c4159ff3d
HDDS-1842. Implement S3 Abort MPU request to use Cache and DoubleBuffer. (#1155) 2019-07-25 08:51:11 -07:00
avijayanhwx ba43233451 HDDS-1749 : Ozone Client should randomize the list of nodes in pipeline for reads. (#1124) 2019-07-25 20:24:46 +05:30
Ayush Saxena 62deab17a3 HDFS-14647. NPE during secure namenode startup. Contributed by Fengnan Li. 2019-07-25 06:51:07 +05:30
Siyao Meng 9b8b3acb0a HADOOP-16451. Update jackson-databind to 2.9.9.1. Contributed by Siyao Meng.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-07-24 17:25:25 -07:00
Nanda kumar 2546e6ece2 HDDS-1817. GetKey fails with IllegalArgumentException.
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-24 15:59:30 -07:00
Bharat Viswanadham 1d98a212cb
HDDS-1819. Implement S3 Commit MPU request to use Cache and DoubleBuffer. (#1140) 2019-07-24 14:03:40 -07:00
Nanda kumar cb69700ac6
HDDS-1853. Fix failing blockade test-cases. (#1151) 2019-07-25 00:02:28 +05:30
Gabor Bota 7b219778e0
HADOOP-16433. S3Guard: Filter expired entries and tombstones when listing with MetadataStore.listChildren().
Contributed by Gabor Bota.

This pulls the tracking of the lastUpdated timestamp of metadata entries up from the DDB metastore into all s3guard stores, and then uses this to filter out expired tombstones from listings.

Change-Id: I80f121236b49c75a024116f65a3ef29d3580b462
2019-07-24 18:11:43 +01:00