587a8eeec8
HDFS-14874. Fix TestHDFSCLI and TestDFSShell test break because of logging change in mkdir ( #1522 ). Contributed by Gabor Bota.
2019-09-26 10:15:13 +05:30
606e341c1a
Addendum to YARN-9730. Support forcing configured partitions to be exclusive based on app node label
2019-09-25 17:54:53 -07:00
f647185905
HDDS-2067. Create generic service facade with tracing/metrics/logging support
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
Co-Authored-By: Doroszlai, Attila <6454655+adoroszlai@users.noreply.github.com>
2019-09-25 17:19:22 -07:00
bdaaa3bbf2
HDFS-14832. RBF: Add Icon for ReadOnly False. Contributed by hemanthboyina
2019-09-25 23:48:49 +09:00
c89d22d13a
HADOOP-16602. mvn package fails in hadoop-aws.
...
Contributed by Xieming Li.
Follow-up to HADOOP-16445
Change-Id: I72c62d55b734a0f67556844f398ef4a50d9ea585
2019-09-25 14:15:35 +01:00
16f626f7f0
HDDS-2165. Freon fails if bucket does not exists
...
Closes #1503
2019-09-25 13:31:35 +02:00
e346e3638c
HADOOP-15691 Add PathCapabilities to FileSystem and FileContext.
...
Contributed by Steve Loughran.
This complements the StreamCapabilities Interface by allowing applications to probe for a specific path on a specific instance of a FileSystem client
to offer a specific capability.
This is intended to allow applications to determine
* Whether a method is implemented before calling it and dealing with UnsupportedOperationException.
* Whether a specific feature is believed to be available in the remote store.
As well as a common set of capabilities defined in CommonPathCapabilities,
file systems are free to add their own capabilities, prefixed with
fs. + schema + .
The plan is to identify and document more capabilities -and for file systems which add new features, for a declaration of the availability of the feature to always be available.
Note
* The remote store is not expected to be checked for the feature;
It is more a check of client API and the client's configuration/knowledge
of the state of the remote system.
* Permissions are not checked.
Change-Id: I80bfebe94f4a8bdad8f3ac055495735b824968f5
2019-09-25 12:16:41 +01:00
e6fb6ee94d
HDDS-1738. Add nullable annotation for OMResponse classes
...
Closes #1499
2019-09-25 12:14:07 +02:00
8baebb54e1
HDDS-2171. Dangling links in test report due to incompatible realpath
...
Closes #1515
2019-09-25 12:02:42 +02:00
c72457787d
YARN-6715. Fix documentation about NodeHealthScriptRunner. Contributed by Peter Bacsko
2019-09-25 10:36:22 +02:00
bec0864394
YARN-9808. Zero length files in container log output haven't got a header. Contributed by Adam Antal
2019-09-25 10:28:34 +02:00
3f89084ac7
HDFS-14845. Ignore AuthenticationFilterInitializer for HttpFSServerWebServer and honor hadoop.http.authentication configs.
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-09-25 10:19:30 +09:00
a3463812ef
HDDS-2168. TestOzoneManagerDoubleBufferWithOMResponse sometimes fails with out of memory error ( #1509 )
2019-09-24 16:28:25 -07:00
6917754ba7
HDDS-2172.Ozone shell should remove description about REST protocol support. Contributed by Siddharth Wagle.
2019-09-24 16:06:10 -07:00
c2731d4b63
YARN-9730. Support forcing configured partitions to be exclusive based on app node label
2019-09-24 13:51:32 -07:00
66400c1cbb
HDFS-14808. EC: Improper size values for corrupt ec block in LOG. Contributed by Ayush Saxena.
2019-09-25 01:31:15 +05:30
eb96a3093e
HDFS-14655. [SBN Read] Namenode crashes if one of The JN is down. Contributed by Ayush Saxena.
2019-09-25 01:16:30 +05:30
f16cf877e5
HDDS-2170. Add Object IDs and Update ID to Volume Object ( #1510 )
2019-09-24 11:01:05 -07:00
afa1006a53
HDFS-14843. Double Synchronization in BlockReportLeaseManager. Contributed by David Mollitor.
2019-09-24 09:58:42 -07:00
816d3cb908
HDFS-14837. Review of Block.java. Contributed by David Mollitor.
2019-09-24 09:54:09 -07:00
43203b466d
HDFS-14868. RBF: Fix typo in TestRouterQuota. Contributed by Jinglun.
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-09-24 09:38:58 -07:00
91f50b98ca
HDDS-2167. Hadoop31-mr acceptance test is failing due to the shading
...
Closes #1507
2019-09-24 17:52:36 +02:00
51c64b357d
HDFS-13660. DistCp job fails when new data is appended in the file while the DistCp copy job is running
...
This uses the length of the file known at the start of the copy to determine the amount of data to copy.
* If a file is appended to during the copy, the original bytes are copied.
* If a file is truncated during a copy, or the attempt to read the data fails with a truncated stream,
distcp will now fail. Until now these failures were not detected.
Contributed by Mukund Thakur.
Change-Id: I576a49d951fa48d37a45a7e4c82c47488aa8e884
2019-09-24 11:23:24 +01:00
8f1a135118
HDDS-2081. Fix TestRatisPipelineProvider#testCreatePipelinesDnExclude. Contributed by Aravindan Vijayan. ( #1506 )
2019-09-24 12:59:51 +05:30
e8e7d7b4cd
HADOOP-16561. [MAPREDUCE] use protobuf-maven-plugin to generate protobuf classes ( #1500 )
...
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
2019-09-24 08:52:12 +08:00
bfe1dac29d
HADOOP-16560. [YARN] use protobuf-maven-plugin to generate protobuf classes ( #1496 )
...
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
2019-09-24 08:50:36 +08:00
0a716bd3a5
HDDS-2159. Fix Race condition in ProfileServlet#pid.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-23 17:21:19 -07:00
6cbe5d3809
HDDS-2160. Add acceptance test for ozonesecure-mr compose. Contributed by Xiaoyu Yao. ( #1490 )
2019-09-23 13:28:38 -07:00
3fd3d746fc
HDDS-2161. Create RepeatedKeyInfo structure to be saved in deletedTable
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-23 13:15:47 -07:00
3d78b1223d
YARN-9762. Add submission context label to audit logs. Contributed by Manoj Kumar
2019-09-23 13:12:16 -07:00
c30e495557
HDFS-14853. NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar.
2019-09-23 21:22:50 +05:30
2b5fc95851
HADOOP-16591 Fix S3A ITest*MRjob failures.
...
Contributed by Siddharth Seth.
Change-Id: I7f08201c9f7c0551514049389b5b398a84855191
2019-09-23 14:58:03 +01:00
aa664d7259
HADOOP-16138. hadoop fs mkdir / of nonexistent abfs container raises NPE ( #1302 ). Contributed by Gabor Bota.
...
Change-Id: I2f637865c871e400b95fe7ddaa24bf99fa192023
2019-09-23 13:29:01 +02:00
07c81e9bfc
HADOOP-16558. [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes ( #1494 ). Contributed by Vinayakumar B.
2019-09-23 12:37:47 +05:30
4c0a7a9e13
Make upstream aware of 3.2.1 release.
2019-09-23 06:20:54 +00:00
659c88801d
HDFS-14818. Check native pmdk lib by 'hadoop checknative' command. Contributed by Feilong He.
2019-09-22 22:02:54 +05:30
a94aa1ff46
HDDS-2150. Update dependency versions to avoid security vulnerabilities. ( #1472 )
2019-09-20 23:21:53 -07:00
e02b1023c2
HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB ( #1332 )
2019-09-21 11:50:45 +05:30
dbdc612b3b
HDDS-2163. Add 'Replication factor' to the output of list keys ( #1493 )
2019-09-20 22:59:45 -07:00
efed4450bf
HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default ( #1482 ). Contributed by Vinayakumar B.
2019-09-21 10:07:26 +05:30
aa938662f9
HDFS-14833. RBF: Router Update Doesn't Sync Quota. Contributed by Ayush Saxena.
2019-09-21 09:53:13 +05:30
d7d6ec8fae
HDDS-2128. Make ozone sh command work with OM HA service ids ( #1445 )
2019-09-20 14:22:55 -07:00
53637301d1
HDDS-2157. checkstyle: print filenames relative to project root ( #1485 )
2019-09-20 14:05:35 -07:00
3f223bebfa
HDFS-14844. Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable. Contributed by Lisheng Sun.
2019-09-20 11:45:01 -07:00
b3173e1f58
HDDS-2001. Update Ratis version to 0.4.0.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-20 10:03:46 -07:00
5553887d95
HDDS-1949. Missing or error-prone test cleanup.
...
Contributed by Doroszlai, Attila.
2019-09-20 09:57:08 -07:00
dd0834696a
HADOOP-16581. Revise ValueQueue to correctly replenish queues that go below the watermark ( #1463 )
...
In the existing implementation, the ValueQueue::getAtMost() method will only trigger a refill on a key queue if it has gone empty, instead of triggering a refill when it has gone below the watermark. Revise the test suite to correctly verify this behavior.
2019-09-20 09:55:48 -07:00
1654497f98
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 ( #1432 )
...
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1. Contributed by Vinayakumar B.
2019-09-20 16:08:30 +05:30
d072d3304c
HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 22:43:00 -07:00
9be448b336
HDDS-2156. Fix alignment issues in HDDS doc pages
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-09-19 22:32:19 -07:00
Gabor Bota
Jonathan Hung
Márton Elek
Takanobu Asanuma
Xieming Li
Doroszlai, Attila
Steve Loughran
Yi Sheng
Szilard Nemeth
Prabhu Joseph
Vivek Ratnavel Subramanian
Bharat Viswanadham
Ayush Saxena
Anu Engineer
Inigo Goiri
Wei-Chiu Chuang
Mukund Thakur
avijayanhwx
Duo Zhang
Hanisha Koneru
Xiaoyu Yao
dchitlangia
Siddharth Seth
Vinayakumar B
Rohith Sharma K S
Rakesh Radhakrishnan
Siyao Meng
Doroszlai, Attila
Nanda kumar
Yuval Degani