Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
22,412 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

22412 Commits

Author SHA1 Message Date
Wei-Chiu Chuang 8053085388 HDFS-14429. Block remain in COMMITTED but not COMPLETE caused by Decommission. Contributed by Yicong Cai. 2019-07-29 14:31:34 -07:00
Erik Krogen 72900de5f4 HDFS-14639. [Dynamometer] Remove unnecessary duplicate directory from the distribution. Contributed by Erik Krogen. 2019-07-29 13:50:14 -07:00
CR Hota 611718f59f HDFS-14670: RBF: Create secret manager instance using FederationUtil#newInstance. 2019-07-29 11:00:22 -07:00
avijayanhwx 60325c9611 HDDS-1391 : Add ability in OM to serve delta updates through an API. (#1033) 2019-07-29 09:39:40 -07:00
Eric Yang d023663e3e HDDS-1833. Moved RefCountedDB stacktrace to log level trace. 
Contributed by Siddharth Wagle
 2019-07-29 12:05:24 -04:00
Chen Zhang 8a59cd1b8a HDFS-12967. NNBench should support multi-cluster access. Contributed by Chen Zhang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-07-29 05:55:12 -07:00
Márton Elek 90afb7bf8c
HDDS-1725. pv-test example to test csi is not working 2019-07-29 11:54:36 +02:00
Márton Elek b039f7591f
HDDS-1682. TestEventWatcher.testMetrics is flaky 
Closes #962.
 2019-07-29 11:04:45 +02:00
Doroszlai, Attila 61ec03c966
HDDS-1852. Fix typo in TestOmAcls 
Closes #1173
 2019-07-29 10:46:11 +02:00
Doroszlai, Attila 902ff4a2f6
HDDS-1867. Invalid Prometheus metric name from JvmMetrics 
Closes #1172
 2019-07-29 10:27:55 +02:00
Ayush Saxena 02bd02b5af HDFS-14660. [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider. Contributed by Chao Sun. 2019-07-28 08:41:42 +05:30
hunshenshi 2fe450cb5e HDFS-14425. Native build fails on macos due to jlong in hdfs.c (#741) 2019-07-26 15:33:12 -07:00
Erik Krogen 62efb63006 HADOOP-16245. Restrict the effect of LdapGroupsMapping SSL configurations to avoid interfering with other SSL connections. Contributed by Erik Krogen. 2019-07-26 11:16:58 -07:00
HUAN-PING SU ecc8acfd24 HDFS-14673. The console log is noisy when using DNSDomainNameResolver to resolve NameNode. 2019-07-26 11:08:46 -07:00
Sammi Chen c01e137273 HDDS-1864. Turn on topology aware read in TestFailureHandlingByClient. (#1168) 2019-07-26 23:11:34 +05:30
Chen, Junjie c7c7a889a8 HDDS-1839: Change topology sorting related logs in Pipeline from INFO to DEBUG. Contributed by Junjie Chen. 
This closes #1158.
 2019-07-26 08:14:24 -07:00
Mehul Garnara c0a0c353e8
MAPREDUCE-6973. Fix comments on creating _SUCCESS file. 
This closes #280

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-26 21:21:26 +09:00
Gopal V aebac6d2d2
HADOOP-16461. Regression: FileSystem cache lock parses XML within the lock. 
Contributed by Gopal V.

Change-Id: If6654f850e9c24ee0d9519a46fd6269b18e1a7a4
 2019-07-26 11:32:13 +01:00
Steve Loughran 07530314c2
HADOOP-9844. NPE when trying to create an error message response of SASL RPC 
This closes #55

Change-Id: I10a20380565fa89762f4aa564b2f1c83b9aeecdc
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-26 17:53:18 +09:00
pingsutw 98653ecccb
HADOOP-16447 Upgrade JUnit5 from 5.3.1 to 5.5.1 to support global timeout 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-26 17:05:34 +09:00
Bharat Viswanadham 3426777140
HDDS-1861. Fix TableCacheImpl cleanup logic. (#1165) 2019-07-25 22:30:06 -07:00
Ayush Saxena ce99cc31e9 HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu. 2019-07-26 08:31:00 +05:30
Nanda kumar a2cc961086 HDDS-1855. TestStorageContainerManager#testScmProcessDatanodeHeartbeat is failing. (#1153) 2019-07-26 10:54:23 +08:00
Masatake Iwasaki 6b8107ad97 HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena. 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-07-26 09:35:23 +09:00
Siyao Meng b7fba78fb6 HDDS-1830 OzoneManagerDoubleBuffer#stop should wait for daemon thread to die (#1156) 2019-07-25 16:14:50 -07:00
Nanda kumar 2b1d8aedbb HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-25 14:25:39 -07:00
Xiaoyu Yao b41ef61ebc HDDS-1858. mTLS support for Ozone is not correct. Contributed by Siddharth Wagle. 2019-07-25 09:52:02 -07:00
Bharat Viswanadham 3c4159ff3d
HDDS-1842. Implement S3 Abort MPU request to use Cache and DoubleBuffer. (#1155) 2019-07-25 08:51:11 -07:00
avijayanhwx ba43233451 HDDS-1749 : Ozone Client should randomize the list of nodes in pipeline for reads. (#1124) 2019-07-25 20:24:46 +05:30
Ayush Saxena 62deab17a3 HDFS-14647. NPE during secure namenode startup. Contributed by Fengnan Li. 2019-07-25 06:51:07 +05:30
Siyao Meng 9b8b3acb0a HADOOP-16451. Update jackson-databind to 2.9.9.1. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-07-24 17:25:25 -07:00
Nanda kumar 2546e6ece2 HDDS-1817. GetKey fails with IllegalArgumentException. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-24 15:59:30 -07:00
Bharat Viswanadham 1d98a212cb
HDDS-1819. Implement S3 Commit MPU request to use Cache and DoubleBuffer. (#1140) 2019-07-24 14:03:40 -07:00
Nanda kumar cb69700ac6
HDDS-1853. Fix failing blockade test-cases. (#1151) 2019-07-25 00:02:28 +05:30
Gabor Bota 7b219778e0
HADOOP-16433. S3Guard: Filter expired entries and tombstones when listing with MetadataStore.listChildren(). 
Contributed by Gabor Bota.

This pulls the tracking of the lastUpdated timestamp of metadata entries up from the DDB metastore into all s3guard stores, and then uses this to filter out expired tombstones from listings.

Change-Id: I80f121236b49c75a024116f65a3ef29d3580b462
 2019-07-24 18:11:43 +01:00
Bharat Viswanadham cf9ff08f4b
HDDS-1848. Fix TestOzoneManagerHA and TestOzoneManagerSnapShotProvider. (#1148) 2019-07-23 20:23:06 -07:00
sunlisheng a1251addff
HADOOP-16431. Remove useless log in IOUtils.java and ExceptionDiags.java. 
This closes #1091

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-24 10:04:39 +09:00
Bharat Viswanadham ecb9f817ac
HDDS-1845. Fix OMVolumeSetQuota|OwnerRequest#validateAndUpdateCache return response. (#1141) 2019-07-23 14:45:47 -07:00
Bharat Viswanadham fbe2fc6580 HDDS-1846. Default value for checksum bytes is different in ozone-site.xml and code. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-23 10:42:16 -07:00
Doroszlai, Attila 278390f5bf HDDS-1710. Fix checkstyle errors 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-23 07:56:30 -07:00
Steve Loughran 4317d33232
HADOOP-16380. S3Guard to determine empty directory status for all non-root directories. 
Contributed by Steve Loughran and Gabor Bota.

This
* Asks S3Guard to determine the empty directory status.
* Has S3A's root directory rm("/") command to always return false (as abfs does)
* Documents that object stores MAY do this
* Overloads ContractTestUtils.assertDeleted to let assertions declare that the source directory does not need to exist. This stops inconsistencies in directory listings failing a root test.

It avoids a recent regression (HADOOP-16279) where if there was a tombstone above the first element found in a directory listing, the directory would be considered empty, when in fact there were child entries. That could downgrade an rm(path, recursive) to a no-op, while also confusing rename(src, dest), as dest could be mistaken for an empty directory and so permit the copy above it, rather than reject it "destination path exists and is not empty".

Change-Id: I136a3d1a5a48a67e6155d790a40ff558d0d2c108
 2019-07-23 14:52:03 +01:00
S O'Donnell eb36b09cb7
HADOOP-16443. Improve help text for setfacl --set option. 
Contributed by S O'Donnell.

Change-Id: I1da46c4c414a5d2b07ee15867508f0799440a413
 2019-07-23 10:24:07 +01:00
Ayush Saxena 377f95bbe8 HDFS-13693. Remove unnecessary search in INodeDirectory.addChild during image loading. Contributed by Lisheng Sun. 2019-07-23 08:37:55 +05:30
pingsutw ee87e9a42e
MAPREDUCE-7076. TestNNBench#testNNBenchCreateReadAndDelete failing in our internal build 
This closes #1089

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-23 10:34:10 +09:00
Márton Elek c533b79c32 HDDS-1710. Publish JVM metrics via Hadoop metrics 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 16:27:50 -07:00
Doroszlai, Attila d59f2711e0 HDDS-1803. shellcheck.sh does not work on Mac 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 16:21:42 -07:00
Márton Elek d70ec4b5fa HDDS-1799. Add goofyfs to the ozone-runner docker image 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 15:53:18 -07:00
Vivek Ratnavel Subramanian f3f2f3419d HDDS-1585. Add LICENSE.txt and NOTICE.txt to Ozone Recon Web 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 15:26:23 -07:00
Bharat Viswanadham 2ea71d953b HDDS-1686. Remove check to get from openKeyTable in acl implementatio… (#966) 2019-07-22 15:11:10 -07:00
Doroszlai, Attila c958eddcf4 HDDS-1811. Prometheus metrics are broken. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 14:12:06 -07:00