Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
22,282 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

22282 Commits

Author SHA1 Message Date
Yiqun Lin 4244653e43 HDFS-14150. RBF: Quotas of the sub-cluster should be removed when removing the mount point. Contributed by Takanobu Asanuma. 2019-06-24 22:03:02 +05:30
Inigo Goiri f3cbf0eb9a HDFS-14161. RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection. Contributed by Fei Hui. 2019-06-24 22:03:02 +05:30
Inigo Goiri 1dc01e59af HDFS-14167. RBF: Add stale nodes to federation metrics. Contributed by Inigo Goiri. 2019-06-24 22:03:02 +05:30
Yiqun Lin 8f6f9d9c83 HDFS-13443. RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries. Contributed by Mohammad Arshad. 2019-06-24 22:03:02 +05:30
Takanobu Asanuma 3d97142dff HDFS-14151. RBF: Make the read-only column of Mount Table clearly understandable. 2019-06-24 22:03:02 +05:30
Yiqun Lin bbe859177d HDFS-13869. RBF: Handle NPE for NamenodeBeanMetrics#getFederationMetrics. Contributed by Ranith Sardar. 2019-06-24 22:03:02 +05:30
Takanobu Asanuma 01b4126b4e HDFS-14152. RBF: Fix a typo in RouterAdmin usage. Contributed by Ayush Saxena. 2019-06-24 22:03:02 +05:30
Yiqun Lin 94a8dec168 HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui. 2019-06-24 22:03:02 +05:30
Yiqun Lin 0ca7142c11 Revert "HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui." 
This reverts commit 7c0d6f65fde12ead91ed7c706521ad1d3dc995f8.
 2019-06-24 22:03:02 +05:30
Yiqun Lin 6aa7aabff8 HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui. 2019-06-24 22:03:02 +05:30
Surendra Singh Lilhore b320caecb3 HDFS-14085. RBF: LS command for root shows wrong owner and permission information. Contributed by Ayush Saxena. 2019-06-24 22:03:02 +05:30
Brahma Reddy Battula 19088e1b49 HDFS-14089. RBF: Failed to specify server's Kerberos pricipal name in NamenodeHeartbeatService. Contributed by Ranith Sardar. 2019-06-24 22:03:02 +05:30
Brahma Reddy Battula f2355c7063 HDFS-13776. RBF: Add Storage policies related ClientProtocol APIs. Contributed by Dibyendu Karmakar. 2019-06-24 22:03:02 +05:30
Yiqun Lin f4bd1114ff HDFS-14082. RBF: Add option to fail operations when a subcluster is unavailable. Contributed by Inigo Goiri. 2019-06-24 22:03:02 +05:30
Inigo Goiri fa55eacd35 HDFS-13834. RBF: Connection creator thread should catch Throwable. Contributed by CR Hota. 2019-06-24 22:03:02 +05:30
Inigo Goiri 04caaba488 HDFS-13852. RBF: The DN_REPORT_TIME_OUT and DN_REPORT_CACHE_EXPIRE should be configured in RBFConfigKeys. Contributed by yanghuafeng. 2019-06-24 22:03:02 +05:30
Brahma Reddy Battula ebfd2d8a4e HDFS-12284. addendum to HDFS-12284. Contributed by Inigo Goiri. 2019-06-24 22:03:02 +05:30
Brahma Reddy Battula 6f2c871b05 HDFS-12284. RBF: Support for Kerberos authentication. Contributed by Sherwood Zheng and Inigo Goiri. 2019-06-24 22:03:02 +05:30
Inigo Goiri 7b0bc492ed HDFS-14024. RBF: ProvidedCapacityTotal json exception in NamenodeHeartbeatService. Contributed by CR Hota. 2019-06-24 22:03:02 +05:30
Brahma Reddy Battula c5065bf20b HDFS-13845. RBF: The default MountTableResolver should fail resolving multi-destination paths. Contributed by yanghuafeng. 2019-06-24 22:03:02 +05:30
Yiqun Lin b3fee1d2bf HDFS-14011. RBF: Add more information to HdfsFileStatus for a mount point. Contributed by Akira Ajisaka. 2019-06-24 22:03:02 +05:30
Vinayakumar B 41c94a636b HDFS-13906. RBF: Add multiple paths for dfsrouteradmin 'rm' and 'clrquota' commands. Contributed by Ayush Saxena. 2019-06-24 22:03:02 +05:30
Eric Yang b220ec6f61 YARN-9374. Improve Timeline service resilience when HBase is unavailable. 
Contributed by Prabhu Joseph and Szilard Nemeth
 2019-06-24 12:19:14 -04:00
avijayanhwx 81d2f1b724 HDDS-1719 : Increase ratis log segment size to 1MB. (#1005) 
* HDDS-1719 : Increase ratis log segment size to 1MB.

* HDDS-1719 : Increase ratis log segment size to 1MB.
 2019-06-24 08:57:08 -07:00
Wei-Chiu Chuang 05145404d5 HDFS-14339. Inconsistent log level practices in RpcProgramNfs3.java. Contributed by Anuhan Torgonshar. 2019-06-24 08:30:48 -07:00
sunlisheng daa1e14745 when evictableMmapped or evictable size is zero, do not throw NoSuchElementException 
Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>
 2019-06-24 20:17:22 +08:00
Nanda kumar b28ddb22a5 HDDS-1706. Replication Manager thread running too frequently. Contributed by Nilotpal Nandi. 2019-06-22 16:15:45 +05:30
Wei-Chiu Chuang 645d67bc4f HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu. 2019-06-21 18:27:03 -07:00
Wei-Chiu Chuang 1524e2e6c5 HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi. 2019-06-21 18:17:36 -07:00
Prabhu Joseph 371452e260 HADOOP-15989. Synchronized at CompositeService#removeService is not required. Contributed by Prabhu Joseph. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-21 17:05:13 -07:00
Hrishikesh Gadre 8194a1196e HDDS-1690. ContainerController should provide a way to retrieve containers per volume (#986) 2019-06-21 10:23:11 -07:00
S O'Donnell cba13c7f83
HDDS-1715. Update the Intellij runner definitition of SCM to use the new class name 
Closes #1000
 2019-06-21 16:25:10 +02:00
Márton Elek 256bdd6982
HDDS-1678. Default image name for kubernetes examples should be ozone and not hadoop 
Closes #959
 2019-06-21 14:14:06 +02:00
Weiwei Yang 83dcb9d87e YARN-9209. When nodePartition is not set in Placement Constraints, containers are allocated only in default partition. Contributed by Tarun Parimi. 2019-06-21 17:41:05 +08:00
S O'Donnell b95a58e231
HDDS-1674. Make ScmBlockLocationProtocol message type based. 
Closes #984
 2019-06-21 11:35:43 +02:00
Lokesh Jain 272b96d243 HDFS-13893. DiskBalancer: no validations for Disk balancer commands. Contributed by Lokesh Jain. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-20 20:23:05 -07:00
Takanobu Asanuma 98d2065643 HDFS-12564. Add the documents of swebhdfs configurations on the client side. Contributed by Takanobu Asanuma. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-20 20:17:24 -07:00
Wei-Chiu Chuang 840d02ca5b HADOOP-14385. HttpExceptionUtils#validateResponse swallows exceptions. Contributed by Wei-Chiu Chuang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-20 19:57:48 -07:00
Bharat Viswanadham d9a9e9913e
HDDS-1579. Create OMDoubleBuffer metrics. (#871) 2019-06-20 09:42:45 -07:00
Surendra Singh Lilhore 5962a518bd HDFS-14581. Appending to EC files crashes NameNode. Contributed by Surendra Singh Lilhore. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-20 09:40:29 -07:00
Márton Elek 9c4b15d2f4
HDDS-1508. Provide example k8s deployment files for the new CSI server 
Closes #905
 2019-06-20 16:36:42 +02:00
Steve Loughran e02eb24e0a
HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename. 
Contributed by Steve Loughran.

Change-Id: I825b0bc36be960475d2d259b1cdab45ae1bb78eb
 2019-06-20 09:56:40 +01:00
Sahil Takiar 28291a9e8a
HADOOP-16379: S3AInputStream.unbuffer should merge input stream stats into fs-wide stats 
Contributed by Sahil Takiar

Change-Id: I2bcfaaea00d12c633757069402dcd0b91a5f5c05
 2019-06-20 09:42:27 +01:00
Eric Yang 5bfdf62614 YARN-9631. Added ability to select JavaScript test or skip JavaScript tests for YARN application catalog. 
Contributed by Eric Yang

(cherry picked from commit 6002b0c5c6994965d3f7231330248c093869dba2)
 2019-06-19 18:48:16 -04:00
Wei-Chiu Chuang 71ecd2e411 HDFS-14303. check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu. 2019-06-19 10:27:53 -07:00
David Mollitor f5ecc0bc08 HDFS-14103. Review Logging of BlockPlacementPolicyDefault. Contributed by David Mollitor. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-06-19 10:06:40 -07:00
Robert Levas 450c070a8f
HADOOP-16340. ABFS driver continues to retry on IOException responses from REST operations. 
Contributed by Robert Levas.

This makes the HttpException constructor protected rather than public, so it is possible
to implement custom subclasses of this exception -exceptions which will not be retried.

Change-Id: Ie8aaa23a707233c2db35948784908b6778ff3a8f
 2019-06-19 17:43:14 +01:00
supratimdeka 9d6842501c HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka (#852) 2019-06-19 20:11:16 +05:30
Wei-Chiu Chuang d3ac516665 Revert "HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti." 
This reverts commit a1c3868c4f.
 2019-06-19 06:27:02 -07:00
Wei-Chiu Chuang 48e564f7e2 HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar. 2019-06-18 22:28:21 -07:00