Steve Loughran
07530314c2
HADOOP-9844. NPE when trying to create an error message response of SASL RPC
...
This closes #55
Change-Id: I10a20380565fa89762f4aa564b2f1c83b9aeecdc
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-26 17:53:18 +09:00
pingsutw
98653ecccb
HADOOP-16447 Upgrade JUnit5 from 5.3.1 to 5.5.1 to support global timeout
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-26 17:05:34 +09:00
Bharat Viswanadham
3426777140
HDDS-1861. Fix TableCacheImpl cleanup logic. ( #1165 )
2019-07-25 22:30:06 -07:00
Ayush Saxena
ce99cc31e9
HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.
2019-07-26 08:31:00 +05:30
Nanda kumar
a2cc961086
HDDS-1855. TestStorageContainerManager#testScmProcessDatanodeHeartbeat is failing. ( #1153 )
2019-07-26 10:54:23 +08:00
Masatake Iwasaki
6b8107ad97
HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-07-26 09:35:23 +09:00
Siyao Meng
b7fba78fb6
HDDS-1830 OzoneManagerDoubleBuffer#stop should wait for daemon thread to die ( #1156 )
2019-07-25 16:14:50 -07:00
Nanda kumar
2b1d8aedbb
HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-25 14:25:39 -07:00
Xiaoyu Yao
b41ef61ebc
HDDS-1858. mTLS support for Ozone is not correct. Contributed by Siddharth Wagle.
2019-07-25 09:52:02 -07:00
Bharat Viswanadham
3c4159ff3d
HDDS-1842. Implement S3 Abort MPU request to use Cache and DoubleBuffer. ( #1155 )
2019-07-25 08:51:11 -07:00
avijayanhwx
ba43233451
HDDS-1749 : Ozone Client should randomize the list of nodes in pipeline for reads. ( #1124 )
2019-07-25 20:24:46 +05:30
Ayush Saxena
62deab17a3
HDFS-14647. NPE during secure namenode startup. Contributed by Fengnan Li.
2019-07-25 06:51:07 +05:30
Siyao Meng
9b8b3acb0a
HADOOP-16451. Update jackson-databind to 2.9.9.1. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-07-24 17:25:25 -07:00
Nanda kumar
2546e6ece2
HDDS-1817. GetKey fails with IllegalArgumentException.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-24 15:59:30 -07:00
Bharat Viswanadham
1d98a212cb
HDDS-1819. Implement S3 Commit MPU request to use Cache and DoubleBuffer. ( #1140 )
2019-07-24 14:03:40 -07:00
Nanda kumar
cb69700ac6
HDDS-1853. Fix failing blockade test-cases. ( #1151 )
2019-07-25 00:02:28 +05:30
Gabor Bota
7b219778e0
HADOOP-16433. S3Guard: Filter expired entries and tombstones when listing with MetadataStore.listChildren().
...
Contributed by Gabor Bota.
This pulls the tracking of the lastUpdated timestamp of metadata entries up from the DDB metastore into all s3guard stores, and then uses this to filter out expired tombstones from listings.
Change-Id: I80f121236b49c75a024116f65a3ef29d3580b462
2019-07-24 18:11:43 +01:00
Bharat Viswanadham
cf9ff08f4b
HDDS-1848. Fix TestOzoneManagerHA and TestOzoneManagerSnapShotProvider. ( #1148 )
2019-07-23 20:23:06 -07:00
sunlisheng
a1251addff
HADOOP-16431. Remove useless log in IOUtils.java and ExceptionDiags.java.
...
This closes #1091
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-24 10:04:39 +09:00
Bharat Viswanadham
ecb9f817ac
HDDS-1845. Fix OMVolumeSetQuota|OwnerRequest#validateAndUpdateCache return response. ( #1141 )
2019-07-23 14:45:47 -07:00
Bharat Viswanadham
fbe2fc6580
HDDS-1846. Default value for checksum bytes is different in ozone-site.xml and code.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-23 10:42:16 -07:00
Doroszlai, Attila
278390f5bf
HDDS-1710. Fix checkstyle errors
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-23 07:56:30 -07:00
Steve Loughran
4317d33232
HADOOP-16380. S3Guard to determine empty directory status for all non-root directories.
...
Contributed by Steve Loughran and Gabor Bota.
This
* Asks S3Guard to determine the empty directory status.
* Has S3A's root directory rm("/") command to always return false (as abfs does)
* Documents that object stores MAY do this
* Overloads ContractTestUtils.assertDeleted to let assertions declare that the source directory does not need to exist. This stops inconsistencies in directory listings failing a root test.
It avoids a recent regression (HADOOP-16279) where if there was a tombstone above the first element found in a directory listing, the directory would be considered empty, when in fact there were child entries. That could downgrade an rm(path, recursive) to a no-op, while also confusing rename(src, dest), as dest could be mistaken for an empty directory and so permit the copy above it, rather than reject it "destination path exists and is not empty".
Change-Id: I136a3d1a5a48a67e6155d790a40ff558d0d2c108
2019-07-23 14:52:03 +01:00
S O'Donnell
eb36b09cb7
HADOOP-16443. Improve help text for setfacl --set option.
...
Contributed by S O'Donnell.
Change-Id: I1da46c4c414a5d2b07ee15867508f0799440a413
2019-07-23 10:24:07 +01:00
Ayush Saxena
377f95bbe8
HDFS-13693. Remove unnecessary search in INodeDirectory.addChild during image loading. Contributed by Lisheng Sun.
2019-07-23 08:37:55 +05:30
pingsutw
ee87e9a42e
MAPREDUCE-7076. TestNNBench#testNNBenchCreateReadAndDelete failing in our internal build
...
This closes #1089
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-23 10:34:10 +09:00
Márton Elek
c533b79c32
HDDS-1710. Publish JVM metrics via Hadoop metrics
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 16:27:50 -07:00
Doroszlai, Attila
d59f2711e0
HDDS-1803. shellcheck.sh does not work on Mac
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 16:21:42 -07:00
Márton Elek
d70ec4b5fa
HDDS-1799. Add goofyfs to the ozone-runner docker image
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 15:53:18 -07:00
Vivek Ratnavel Subramanian
f3f2f3419d
HDDS-1585. Add LICENSE.txt and NOTICE.txt to Ozone Recon Web
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 15:26:23 -07:00
Bharat Viswanadham
2ea71d953b
HDDS-1686. Remove check to get from openKeyTable in acl implementatio… ( #966 )
2019-07-22 15:11:10 -07:00
Doroszlai, Attila
c958eddcf4
HDDS-1811. Prometheus metrics are broken.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-22 14:12:06 -07:00
Hanisha Koneru
cdc36fe286
HDDS-1649. On installSnapshot notification from OM leader, download checkpoint and reload OM state ( #948 )
2019-07-22 12:06:55 -07:00
Bharat Viswanadham
340bbaf8bf
HDDS-1840. Fix TestSecureOzoneContainer. ( #1135 )
2019-07-22 10:23:48 -07:00
Bharat Viswanadham
acdb0a1276
HDDS-1841. Fix TestSecureContainerServer. ( #1136 )
2019-07-20 08:14:23 -07:00
Bharat Viswanadham
4aa76e327d
HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. ( #1108 )
2019-07-20 08:11:36 -07:00
Ayush Saxena
e60f5e2572
HADOOP-16440. Distcp can not preserve timestamp with -delete option. Contributed by ludun.
2019-07-20 13:11:14 +05:30
Arun Singh
0b45293abb
HADOOP-16404. ABFS default blocksize change(256MB from 512MB)
...
Contributed by: Arun Singh
2019-07-19 20:21:28 -07:00
Bharat Viswanadham
f5b2f7538c
HDDS-1795. Implement S3 Delete Bucket request to use Cache and DoubleBuffer. ( #1097 )
2019-07-19 17:43:23 -07:00
Sammi Chen
69a46a95bb
HDDS-1713. ReplicationManager fail to find proper node topology based… ( #1112 )
2019-07-19 15:45:26 -07:00
Sean Mackrory
7f1b76ca35
HADOOP-13868. [s3a] New default for S3A multi-part configuration ( #1125 )
2019-07-19 09:49:59 -06:00
lqjaclee
cd967c75a7
HADOOP-15847. S3Guard testConcurrentTableCreations to set R/W capacity == 0
...
Contributed by lqjaclee
Change-Id: I4a4d5b29f2677c188799479e4db38f07fa0591d1
2019-07-19 14:46:55 +01:00
Ayush Saxena
6282c02d7d
HDFS-14577. RBF: FederationUtil#newInstance should allow constructor without context. Contributed by CR Hota.
2019-07-19 17:44:13 +05:30
Xiaoyu Yao
4e66cb9333
HDDS-1653. Add option to "ozone scmcli printTopology" to order the output acccording to topology layer. Contributed by Xiaoyu Yao. ( #1067 )
...
* HDDS-1653. Add option to "ozone scmcli printTopology" to order the output acccording to topology layer. Contributed by Xiaoyu Yao.
* use ip/hostname instead of network name for -o output and add smoke test
2019-07-19 11:00:49 +08:00
Josh Rosen
d545f9c290
HADOOP-16437 documentation typo fix: fs.s3a.experimental.input.fadvise
...
Fix fs.s3a.experimental.fadvise to fs.s3a.experimental.input.fadvise
Contributed by: Josh Rosen
2019-07-18 23:19:38 +01:00
Doroszlai, Attila
d5ef38b093
HDDS-1822. NPE in SCMCommonPolicy.chooseDatanodes ( #1120 )
2019-07-18 13:28:03 -07:00
Eric Yang
9838a47d44
YARN-6046. Fixed documentation error in YarnApplicationSecurity.
...
Contributed by Yousef Abu-Salah
2019-07-18 12:39:18 -04:00
Bharat Viswanadham
f22818d0d6
HDDS-1820. Fix numKeys metrics in OM HA. ( #1116 )
2019-07-18 09:36:15 -07:00
Eric Yang
c34ceb5fde
YARN-9568. Fixed NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover.
...
Contributed by Steve Loughran
2019-07-18 12:30:53 -04:00
Shashikant Banerjee
8ef2365ffd
HDDS-1779. TestWatchForCommit tests are flaky.Contributed by Shashikant Banerjee. ( #1071 )
2019-07-18 19:57:12 +05:30