Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
22,125 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

22125 Commits

Author SHA1 Message Date
Yiqun Lin cd73cb8d00 HDFS-13443. RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries. Contributed by Mohammad Arshad. 2019-06-23 09:27:02 +05:30
Takanobu Asanuma 7d8cc5d12c HDFS-14151. RBF: Make the read-only column of Mount Table clearly understandable. 2019-06-23 09:27:02 +05:30
Yiqun Lin a505876bda HDFS-13869. RBF: Handle NPE for NamenodeBeanMetrics#getFederationMetrics. Contributed by Ranith Sardar. 2019-06-23 09:27:02 +05:30
Takanobu Asanuma 71cec6aa47 HDFS-14152. RBF: Fix a typo in RouterAdmin usage. Contributed by Ayush Saxena. 2019-06-23 09:27:02 +05:30
Yiqun Lin dbe01391f2 HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui. 2019-06-23 09:27:02 +05:30
Yiqun Lin 88fd500c50 Revert "HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui." 
This reverts commit 7c0d6f65fde12ead91ed7c706521ad1d3dc995f8.
 2019-06-23 09:27:02 +05:30
Yiqun Lin acafc7aee0 HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui. 2019-06-23 09:27:02 +05:30
Surendra Singh Lilhore d49ebf36d4 HDFS-14085. RBF: LS command for root shows wrong owner and permission information. Contributed by Ayush Saxena. 2019-06-23 09:27:02 +05:30
Brahma Reddy Battula 5b24f0f44c HDFS-14089. RBF: Failed to specify server's Kerberos pricipal name in NamenodeHeartbeatService. Contributed by Ranith Sardar. 2019-06-23 09:27:02 +05:30
Brahma Reddy Battula 5df703fff6 HDFS-13776. RBF: Add Storage policies related ClientProtocol APIs. Contributed by Dibyendu Karmakar. 2019-06-23 09:27:02 +05:30
Yiqun Lin 650b0f5dfc HDFS-14082. RBF: Add option to fail operations when a subcluster is unavailable. Contributed by Inigo Goiri. 2019-06-23 09:27:02 +05:30
Inigo Goiri 0635de615e HDFS-13834. RBF: Connection creator thread should catch Throwable. Contributed by CR Hota. 2019-06-23 09:27:02 +05:30
Inigo Goiri 7d2a1f890c HDFS-13852. RBF: The DN_REPORT_TIME_OUT and DN_REPORT_CACHE_EXPIRE should be configured in RBFConfigKeys. Contributed by yanghuafeng. 2019-06-23 09:27:02 +05:30
Brahma Reddy Battula 84b33ee328 HDFS-12284. addendum to HDFS-12284. Contributed by Inigo Goiri. 2019-06-23 09:27:02 +05:30
Brahma Reddy Battula da154a687e HDFS-12284. RBF: Support for Kerberos authentication. Contributed by Sherwood Zheng and Inigo Goiri. 2019-06-23 09:27:02 +05:30
Inigo Goiri d2d214817d HDFS-14024. RBF: ProvidedCapacityTotal json exception in NamenodeHeartbeatService. Contributed by CR Hota. 2019-06-23 09:27:02 +05:30
Brahma Reddy Battula ab38e37523 HDFS-13845. RBF: The default MountTableResolver should fail resolving multi-destination paths. Contributed by yanghuafeng. 2019-06-23 09:27:02 +05:30
Yiqun Lin 7ac5e769fb HDFS-14011. RBF: Add more information to HdfsFileStatus for a mount point. Contributed by Akira Ajisaka. 2019-06-23 09:27:02 +05:30
Vinayakumar B 8dfd2e5644 HDFS-13906. RBF: Add multiple paths for dfsrouteradmin 'rm' and 'clrquota' commands. Contributed by Ayush Saxena. 2019-06-23 09:27:01 +05:30
Nanda kumar b28ddb22a5 HDDS-1706. Replication Manager thread running too frequently. Contributed by Nilotpal Nandi. 2019-06-22 16:15:45 +05:30
Wei-Chiu Chuang 645d67bc4f HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu. 2019-06-21 18:27:03 -07:00
Wei-Chiu Chuang 1524e2e6c5 HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi. 2019-06-21 18:17:36 -07:00
Prabhu Joseph 371452e260 HADOOP-15989. Synchronized at CompositeService#removeService is not required. Contributed by Prabhu Joseph. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-21 17:05:13 -07:00
Hrishikesh Gadre 8194a1196e HDDS-1690. ContainerController should provide a way to retrieve containers per volume (#986) 2019-06-21 10:23:11 -07:00
S O'Donnell cba13c7f83
HDDS-1715. Update the Intellij runner definitition of SCM to use the new class name 
Closes #1000
 2019-06-21 16:25:10 +02:00
Márton Elek 256bdd6982
HDDS-1678. Default image name for kubernetes examples should be ozone and not hadoop 
Closes #959
 2019-06-21 14:14:06 +02:00
Weiwei Yang 83dcb9d87e YARN-9209. When nodePartition is not set in Placement Constraints, containers are allocated only in default partition. Contributed by Tarun Parimi. 2019-06-21 17:41:05 +08:00
S O'Donnell b95a58e231
HDDS-1674. Make ScmBlockLocationProtocol message type based. 
Closes #984
 2019-06-21 11:35:43 +02:00
Lokesh Jain 272b96d243 HDFS-13893. DiskBalancer: no validations for Disk balancer commands. Contributed by Lokesh Jain. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-20 20:23:05 -07:00
Takanobu Asanuma 98d2065643 HDFS-12564. Add the documents of swebhdfs configurations on the client side. Contributed by Takanobu Asanuma. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-20 20:17:24 -07:00
Wei-Chiu Chuang 840d02ca5b HADOOP-14385. HttpExceptionUtils#validateResponse swallows exceptions. Contributed by Wei-Chiu Chuang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-20 19:57:48 -07:00
Bharat Viswanadham d9a9e9913e
HDDS-1579. Create OMDoubleBuffer metrics. (#871) 2019-06-20 09:42:45 -07:00
Surendra Singh Lilhore 5962a518bd HDFS-14581. Appending to EC files crashes NameNode. Contributed by Surendra Singh Lilhore. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-20 09:40:29 -07:00
Márton Elek 9c4b15d2f4
HDDS-1508. Provide example k8s deployment files for the new CSI server 
Closes #905
 2019-06-20 16:36:42 +02:00
Steve Loughran e02eb24e0a
HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename. 
Contributed by Steve Loughran.

Change-Id: I825b0bc36be960475d2d259b1cdab45ae1bb78eb
 2019-06-20 09:56:40 +01:00
Sahil Takiar 28291a9e8a
HADOOP-16379: S3AInputStream.unbuffer should merge input stream stats into fs-wide stats 
Contributed by Sahil Takiar

Change-Id: I2bcfaaea00d12c633757069402dcd0b91a5f5c05
 2019-06-20 09:42:27 +01:00
Eric Yang 5bfdf62614 YARN-9631. Added ability to select JavaScript test or skip JavaScript tests for YARN application catalog. 
Contributed by Eric Yang

(cherry picked from commit 6002b0c5c6994965d3f7231330248c093869dba2)
 2019-06-19 18:48:16 -04:00
Wei-Chiu Chuang 71ecd2e411 HDFS-14303. check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu. 2019-06-19 10:27:53 -07:00
David Mollitor f5ecc0bc08 HDFS-14103. Review Logging of BlockPlacementPolicyDefault. Contributed by David Mollitor. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-19 10:06:40 -07:00
Robert Levas 450c070a8f
HADOOP-16340. ABFS driver continues to retry on IOException responses from REST operations. 
Contributed by Robert Levas.

This makes the HttpException constructor protected rather than public, so it is possible
to implement custom subclasses of this exception -exceptions which will not be retried.

Change-Id: Ie8aaa23a707233c2db35948784908b6778ff3a8f
 2019-06-19 17:43:14 +01:00
supratimdeka 9d6842501c HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka (#852) 2019-06-19 20:11:16 +05:30
Wei-Chiu Chuang d3ac516665 Revert "HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti." 
This reverts commit a1c3868c4f.
 2019-06-19 06:27:02 -07:00
Wei-Chiu Chuang 48e564f7e2 HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar. 2019-06-18 22:28:21 -07:00
Virajith Jalaparti a1c3868c4f HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-18 22:17:49 -07:00
Bharat Viswanadham f9ee97de98
HDFS-14398. Update HAState.java to fix typos. Contributed by Nikhil Navadiya. 2019-06-18 21:58:37 -07:00
Hanisha Koneru 2dfa932818
HDDS-1684. OM should create Ratis related dirs only if ratis is enabled (#965) 2019-06-18 16:08:48 -07:00
Vivek Ratnavel Subramanian 37bd5bb342 HDDS-1702. Optimize Ozone Recon build time (#982) 2019-06-18 14:44:23 -07:00
Elek, Marton 81ec909411 HDFS-14078. Admin helper fails to prettify NullPointerExceptions. Contributed by Elek, Marton. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-18 12:01:26 -07:00
avijayanhwx 71edfce187 HDDS-1699. Update RocksDB version to 6.0.1 (#980) 2019-06-18 11:13:13 -07:00
Eric Yang b14f0569bb YARN-9574. Update hadoop-yarn-applications-mawo artifactId to match directory name. 
Contributed by Wanqiang Ji

(cherry picked from commit 5f758a69ede8fafd214857a74f5d3b46198094c4)
 2019-06-18 13:51:12 -04:00