281 Commits

Author SHA1 Message Date
Reid Chan
16304aa260 Update POMs and CHANGES.txt for 1.7.0RC0 2021-04-13 00:13:15 +08:00
Viraj Jasani
fb25a7d530
HBASE-23935 : Backport HBASE-22978, HBASE-24528, HBASE-24718 to branch-1 (#2312)
* HBASE-22978: Online slow response log (with sub-tasks: Large logs, Replicate logs to HDFS, Filter support in query)
* HBASE-24718: Generic NamedQueue framework for recent in-memory history
* HBASE-24528: Improve balancer decision observability

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-10-16 12:21:17 +05:30
Bharath Vissapragada
3e1450d8b3
HBASE-24765: Dynamic master discovery (#2314)
This patch adds the ability to discover newly added masters
dynamically on the master registry side. The trigger for the
re-fetch is either periodic (5 mins) or any registry RPC failure.
Master server information is cached in masters to avoid repeated
ZK lookups.

Updates the client side connection metrics to maintain a counter
per RPC type so that clients have visibility into counts grouped
by RPC method name.

I didn't add the method to ZK registry interface since there
is a design discussion going on in splittable meta doc. We can
add it later if needed.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 275a38e1533eafa1d4bd1d50c13bcecd9a397ea8)
(cherry picked from commit bb9121da77c7b881a3cc4c389029a610fc2b0925)
2020-09-19 15:01:06 -07:00
Bharath Vissapragada
ebe9e68274
HBASE-23305: Implement master based registry for client connections
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-09-19 15:01:06 -07:00
stack
cb756629b0
HBASE-7767 Get rid of ZKTable, and table enable/disable state in ZK (Andrey Stepachev)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

(cherry picked from commit 3cc5d19039904361f60c413f10f3cbca27a7ba96)
2020-09-19 15:01:06 -07:00
Bharath Vissapragada
18200b09e2
HBASE-23304: RPCs needed for client meta information lookup (#904)
* HBASE-23304: RPCs needed for client meta information lookup

This patch implements the RPCs needed for the meta information
lookup during connection init. New tests added to cover the RPC
code paths. HBASE-23305 builds on this to implement the client
side logic.

Fixed a bunch of checkstyle nits around the places the patch
touches.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 4f8fbba0c01742f17fa2d85a4b944d7f42b7c2b1)
(cherry picked from commit 488460e84015647840afca8d02ab279653b11dee)
2020-09-19 15:01:05 -07:00
Abhishek Singh Chouhan
54c38c840c HBASE-24618 Backport HBASE-21204 to branch-1 2020-06-24 10:21:41 -07:00
Bharath Vissapragada
4e4d11cb19
HBASE-24260 Add a ClusterManager that issues commands via coprocessor (#1853)
Implements `ClusterManager` that relies on the new
`ShellExecEndpointCoprocessor` for remote shell command execution.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
2020-06-04 22:08:16 -07:00
Reid Chan
0d8683507b
HBASE-24112 [RSGroup] Support renaming rsgroup (#1467)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-15 19:20:14 +08:00
Andrew Purtell
b9c676cdc0
Set version on branch-1 to 1.7.0-SNAPSHOT 2020-02-14 11:31:32 -08:00
Andrew Purtell
5ec5a5b115
Update POMs and CHANGES.txt for 1.6.0RC0 2020-02-14 11:30:22 -08:00
Abhishek Singh Chouhan
b25071c679 HBASE-23825 Increment proto conversion is broken 2020-02-11 17:07:43 -08:00
Peter Somogyi
907184dfa0
HBASE-23675 Move to Apache parent POM version 22 (#1023)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-01-15 10:10:23 +01:00
Viraj Jasani
1451063115
HBASE-23590 : Update maxStoreFileRefCount to maxCompactedStoreFileRefCount for auto region recovery based on old reader references
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-01-01 23:50:24 +05:30
Sean Busbey
4bcc397f3e
HBASE-23229 Update branch-1 to 1.6.0-SNAPSHOT (#772)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-10-30 09:22:39 -05:00
Viraj Jasani
5e414f2d46 HBASE-23213 Backport HBASE-22460 to branch-1 (#761)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-10-29 13:15:39 -07:00
Andrew Purtell
214d33e0f4
Renumber branch to 1.5.1-SNAPSHOT 2019-10-12 13:21:18 -07:00
Andrew Purtell
3966d0fee6
Update POMs and CHANGES.txt for 1.5.0 RC4 2019-10-07 11:46:53 -07:00
Wellington Chevreuil
0ffbf9c759
HBASE-23101 Backport HBASE-22380 to branch-1
Fixes #680

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-10-02 11:25:26 -07:00
Viraj Jasani
72ea3666c0 HBASE-22760 : Pause/Resume/Query Snapshot Auto Cleanup Activity (#619) 2019-09-13 10:38:10 +05:30
Viraj Jasani
f7bdf76295
HBASE-22648 Snapshot TTL (#371)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Co-authored-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/SnapshotDescription.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ProtobufUtil.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
	hbase-common/src/main/resources/hbase-default.xml
	hbase-protocol-shaded/src/main/protobuf/Snapshot.proto
	hbase-protocol/src/main/protobuf/HBase.proto
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotInfo.java
	hbase-server/src/main/resources/hbase-webapps/master/snapshot.jsp
	hbase-server/src/main/resources/hbase-webapps/master/snapshotsStats.jsp
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestSnapshotTemporaryDirectory.java
	hbase-shell/src/main/ruby/hbase/admin.rb
	src/main/asciidoc/_chapters/hbase-default.adoc
2019-07-23 09:56:31 -07:00
Geoffrey Jacoby
0a5fe609e7
HBASE-22622 WALKey Extended Attributes (#352)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Co-authored-by: Andrew Purtell <apurtell@apache.org>
2019-07-19 15:31:29 -07:00
Andrew Purtell
e233cfbe75
HBASE-22459 Expose store reader reference count (#248) 2019-05-30 15:09:15 -07:00
Andrew Purtell
98dc440462
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:44:02 -07:00
Andrew Purtell
e2d48f41c5
Set version on branch back to 1.5.0-SNAPSHOT 2019-05-20 13:02:40 -07:00
Andrew Purtell
1ad5a08ebb
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions (#225)
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-14 13:34:15 -07:00
Abhishek Singh Chouhan
f4881dcf1b
HBASE-22330 Backport HBASE-20724 (Sometimes some compacted storefiles are still opened after region failover) to branch-1 2019-05-08 16:27:53 -07:00
Andrew Purtell
ce6a6014da
Update POMs and CHANGES.txt for 1.5.0 RC0 2019-02-01 12:36:10 -08:00
Andrew Purtell
2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1
HBASE-21034 Add new throttle type: read/write capacity unit

HBASE-21578 Fix wrong throttling exception for capacity unit
2019-01-16 15:59:46 -08:00
Andrew Purtell
d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
HBASE-6028 Start/Stop compactions at region server level

Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
2019-01-11 18:08:27 -08:00
Sean Busbey
ba7a936f74 Revert "HBASE-9465 Push entries to peer clusters serially"
This reverts commit 441bc050b991c14c048617bc443b97f46e21b76f.

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:15 +08:00
Guangxu Cheng
6938720c12 HBASE-19326 Remove decommissioned servers from rsgroup
Signed-off-by: Michael Stack <stack@apache.org>

Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminClient.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminEndpoint.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminServer.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManagerImpl.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroups.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
	hbase-shell/src/main/ruby/hbase/rsgroup_admin.rb
2017-12-01 12:15:43 -08:00
Andrew Purtell
6961526573 HBASE-12350 Backport error-prone build support to branch-1 and branch-2 2017-11-09 15:34:09 -08:00
Chia-Ping Tsai
56fd75e8e2 HBASE-19131 Add the ClusterStatus hook and cleanup other hooks which can be replaced by ClusterStatus hook 2017-11-05 09:55:10 +08:00
Andrew Purtell
64328caef0 HBASE-15631 Backport Regionserver Groups (HBASE-6721) to branch-1 (Francis Liu and Andrew Purtell) 2017-10-23 17:10:33 -07:00
andrewcheng
815673f7e4 HBASE-18131 Add an hbase shell command to clear deadserver list in ServerManager
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-09-16 09:33:08 -07:00
Pankaj Kumar
deeda60c69 HBASE-17617 Backport HBASE-16731 (Inconsistent results from the Get/Scan if we use the empty FilterList) to branch-1
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-08-17 18:31:57 +08:00
Andrew Purtell
3feb87b005 HBASE-18431 Mitigate compatibility concerns between branch-1.3 and branch-1.4
- Refactor TableName into its own proto module and fix up users

- Move SnapshotDescription from Snapshot.proto back to HBase.proto

- Restore FastLongHistogram and TestFastLongHistogram;
  deprecate FastLongHistogram

- Move DeleteQueryTracker back to o.a.h.h.regionserver
2017-08-16 11:34:18 -07:00
Andrew Purtell
3dd55fa0c0 Set versions on branch-1 to 1.5.0-SNAPSHOT 2017-07-03 18:01:15 -07:00
Phil Yang
381c89b5cc HBASE-15576 Scanning cursor to prevent blocking long time on ResultScanner.next() 2017-06-07 11:37:22 +08:00
huzheng
f9dc4cad63 HBASE-11013 Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-05-18 17:54:53 +08:00
Vincent
d8ef495063 Amend HBASE-18026 ProtobufUtil seems to do extra array copying
If the ByteString is not a LiteralByteString, just do toByteArray().

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-15 18:07:53 -07:00
huzheng
45357c078d HBASE-17472: Correct the semantic of permission grant
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-20 20:24:09 +08:00
Ajay Jadhav
67fe516ec9 HBASE-17280 Add mechanism to control hbase cleaner behavior
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-09 12:18:42 -08:00
zhangduo
e9abe07629 HBASE-17599 Use mayHaveMoreCellsInRow instead of isPartial 2017-02-09 15:38:23 +08:00
zhangduo
4456d22859 HBASE-17508 Unify the implementation of small scan and regular scan for sync client 2017-02-05 08:49:51 +08:00
Guanghao Zhang
4b3df0f926 HBASE-17296 Provide per peer throttling for replication
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-12-15 16:13:04 +08:00
zhangduo
af69783128 HBASE-17167 Pass mvcc to client when scan 2016-11-30 10:02:17 +08:00
Guanghao Zhang
66941910bd HBASE-16653 Backport HBASE-11393 to branches which support namespace
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-18 09:12:47 +08:00
Phil Yang
441bc050b9 HBASE-9465 Push entries to peer clusters serially
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:26:15 +08:00