Commit Graph

2079 Commits

Author SHA1 Message Date
Josh Elser cb2ef7a606 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-04-11 12:17:55 -04:00
Reid Chan 61396aecd2 HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2019-04-11 12:17:45 -04:00
liubangchen 694983dc96 HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2019-04-11 12:17:28 -04:00
zhangduo 08060b32b1 HBASE-22179 Fix RawAsyncHBaseAdmin.getCompactionState 2019-04-07 08:46:53 +08:00
zhangduo 2f05376687 HBASE-22177 Do not recreate IOException in RawAsyncHBaseAdmin.adminCall 2019-04-07 08:34:04 +08:00
zhangduo dd19173fbd HBASE-22135 AsyncAdmin will not refresh master address
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-01 13:48:03 +08:00
pingsutw 0c882100d4 HBASE-22101 AsyncAdmin.isTableAvailable should not throw TableNotFoundException
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-30 20:43:25 +08:00
Nihal Jain 7094987311 HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement
Signed-off-by: Josh Elser <elserj@apache.org>
2019-03-27 15:37:50 -04:00
Sakthi 0d2c5197de HBASE-22094: Throw TableNotFoundException if table not exists in AsyncAdmin.compact
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-27 20:15:43 +08:00
stack c6dc2541e9 Preparing development version 2.1.5-SNAPSHOT 2019-03-24 16:02:56 +00:00
stack 57b29f2bcf Preparing HBase release 2.1.4RC1.5; tagging and updates to CHANGES.md and RELEASENOTES.md 2019-03-24 16:02:41 +00:00
stack 59c1e2b07c Preparing development version 2.1.5-SNAPSHOT 2019-03-19 18:44:34 +00:00
stack 5b7722f855 Preparing HBase release 2.1.4RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 2019-03-19 18:44:20 +00:00
Rishabh Jain 63a9a359bf HBASE-22042 Missing @Override annotation for RawAsyncTableImpl.scan
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-19 14:03:21 +08:00
stack e30755bf15 Preparing development version 2.1.5-SNAPSHOT 2019-03-18 23:02:12 +00:00
stack 18a6ad74b9 Preparing HBase release 2.1.4RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 2019-03-18 23:01:58 +00:00
stack 74837d3fc5 Preparing development version 2.1.5-SNAPSHOT 2019-03-18 19:01:27 +00:00
stack ec50f16c33 Preparing HBase release 2.1.4RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 2019-03-18 19:01:12 +00:00
stack 11badde248 HBASE-21998 Move branch-2.1 version from 2.1.4 to 2.1.5-SNAPSHOT 2019-03-05 20:29:22 -08:00
zhangduo 1128cad3dd HBASE-21985 Set version as 2.1.4 in branch-2.1 in prep for first RC 2019-03-05 08:26:54 +08:00
zhangduo 2872b156b3 HBASE-21983 Should track the scan metrics in AsyncScanSingleRegionRpcRetryingCaller if scan metrics is enabled 2019-03-03 19:09:02 +08:00
zhangduo 6d03807e4c HBASE-21978 Should close AsyncRegistry if we fail to get cluster id when creating AsyncConnection
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-03 08:19:49 +08:00
Duo Zhang 73c62bc5d0 HBASE-21976 Deal with RetryImmediatelyException for batching request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 12:14:43 +08:00
Duo Zhang 1a0a41bc2b HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 17:55:20 +08:00
Duo Zhang dcc22d3e41 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-26 11:22:29 +08:00
zhangduo ceb900fbf3 Revert "HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client"
This reverts commit 6881753e59.
2019-02-24 20:14:50 +08:00
Duo Zhang 6881753e59 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 17:34:42 +08:00
zhangduo ba02226302 HBASE-21927 Always fail the locate request when error occur
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 19:48:51 +08:00
zhangduo 851262d15d HBASE-21930 Deal with ScannerResetException when opening region scanner
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 11:17:59 +08:00
Duo Zhang 2386f0a897 HBASE-21910 The nonce implementation is wrong for AsyncTable
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-15 20:24:56 +08:00
Duo Zhang aafbfa4c9d HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-14 19:50:35 +08:00
Duo Zhang 8611bef4fd HBASE-21897 Set version to 2.1.4-SNAPSHOT for branch-2.1 2019-02-14 16:39:12 +08:00
zhangduo 54f9afba04 HBASE-21862 IPCUtil.wrapException should keep the original exception types for all the connection exceptions
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-10 09:38:03 +08:00
zhangduo 16f27d7699 HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-08 19:48:49 +08:00
zhangduo 454805ec5d HBASE-21834 Set version as 2.1.3 in branch-2.1 in prep for first RC 2019-02-04 08:05:51 +08:00
zhangduo c0c051a44a HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:42:35 +08:00
zhangduo 3b9f1fc492 HBASE-21828 Make sure we do not return CompletionException when locating region 2019-02-02 21:14:37 +08:00
zhangduo edbb816abe HBASE-21684 Throw DNRIOE when connection or rpc client is closed 2019-01-31 20:22:14 +08:00
Sakthi 762ed54fb7 HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'
Signed-off-by: Josh Elser <elserj@apache.org>
2019-01-30 18:52:28 -05:00
Tommy Li 94d52d24f5 HBASE-21775 ADDENDUM - fix TestAsyncProcess 2019-01-30 15:44:01 -08:00
wanghuan ae3068d657 HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 16:01:39 +08:00
Tommy Li ab60d397f6 HBASE-21775 The BufferedMutator doesn't ever refresh region location cache
Fix server location metadata refresh in multi-actions

Signed-off-by: stack <stack@apache.org>
2019-01-26 13:11:35 -08:00
xujunhong d5d7732fb7 HBASE-21715 set timeout instead of throwing Exception when calling ProcedureFuture.get in client side.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-01-24 14:55:37 +08:00
huzheng da92b3e006 HBASE-21734 Some optimization in FilterListWithOR 2019-01-22 11:42:23 +08:00
Guanghao Zhang 450124fe56 Revert "HBASE-21034 Add new throttle type: read/write capacity unit"
This reverts commit 483b7d008e.
2019-01-19 09:49:04 +08:00
zhangduo b06387b2b0 HBASE-19695 Handle disabled table for async client
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
2019-01-18 09:48:27 +08:00
meiyi 483b7d008e HBASE-21034 Add new throttle type: read/write capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-17 17:59:27 +08:00
Duo Zhang c49cdc3e61 HBASE-21732 Should call toUpperCase before using Enum.valueOf in some methods for ColumnFamilyDescriptor
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-01-16 20:46:35 +08:00
Peter Somogyi 400cab10b2 HBASE-21727 Simplify documentation around client timeout
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 11:44:19 +01:00
zhangduo b26bcb852c HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin 2019-01-13 13:41:10 +08:00
Duo Zhang d04282627f HBASE-21663 Add replica scan support 2019-01-11 14:19:22 +08:00
Duo Zhang 3f750955b5 HBASE-21580 Support getting Hbck instance from AsyncConnection 2019-01-11 11:55:35 +08:00
meiyi 117d12e9c6 HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-10 09:38:08 +08:00
stack 5364601dea HBASE-21698 Move version in branch-2.1 from 2.1.2 to 2.1.3-SNAPSHOT 2019-01-08 16:01:07 -08:00
zhangduo 3de116af46 HBASE-21682 Support getting from specific replica 2019-01-08 09:49:22 +08:00
zhangduo 0c3da777e3 HBASE-17356 Add replica get support 2019-01-03 09:24:55 +08:00
Sakthi 7e911d9e21 HBASE-21631: list_quotas should print human readable values for LIMIT
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-22 22:10:26 +08:00
openinx c5810f19a6 HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-21 15:21:12 -08:00
Guanghao Zhang 512a6322d9 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:54:58 +08:00
zhangduo 492ca34025 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 15:29:56 +08:00
Sakthi 7cac6eb548 HBASE-21453 Convert ReadOnlyZKClient to DEBUG instead of INFO 2018-12-11 08:19:21 +01:00
stack 7c1f15bd2a HBASE-21558 Set version to 2.1.2 on branch-2.1 so can cut an RC 2018-12-05 21:24:04 -08:00
Josh Elser acb58284a5 HBASE-21524 Fix logging in ConnectionImplementation.isTableAvailable()
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-29 11:34:15 -05:00
Ben Lau 0875fa0634
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2018-11-08 14:09:55 -08:00
Sean Busbey 6f9084380b HBASE-21442 Update branch-2.1 for next development cycle
* update pom versions to 2.1.2-SNAPSHOT
* update CHANGES.md to mark release date (as of arriving in dist/release svn repo)
2018-11-06 14:19:47 -06:00
tianjingyun 422e98957b
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:56:44 -07:00
Michael Stack 066082dff4
HBASE-21397 Set version to 2.1.1 on branch-2.1 in prep for first RC 2018-10-26 12:56:24 -07:00
Guanghao Zhang 7c3033d704 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:21:58 -07:00
Sahil Aggarwal b972b9a2d9
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup. 2018-10-17 21:03:39 -07:00
Michael Stack 4d50f6db5a
HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay 2018-10-12 16:22:10 -07:00
Michael Stack 266544370d
Revert "HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay"
This reverts commit 7f3ca4643d.

Bad commit.
2018-10-12 16:15:57 -07:00
Michael Stack 7f3ca4643d
HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements; ADDENDUM Fix TestHRegionInfo AND TestRegionInfoDisplay 2018-10-12 16:09:54 -07:00
Michael Stack fecaf4737c HBASE-21303 [shell] clear_deadservers with no args fails 2018-10-12 11:19:24 -07:00
Michael Stack 9d34b4581c
HBASE-21242 [amv2] Miscellaneous minor log and assign procedure create improvements
For RIT Duration, do better than print ms/seconds. Remove redundant UI
column dedicated to duration when we log it in the status field too.

Make bypass log at INFO level.

Make it so on complete of subprocedure, we note count of outstanding
siblings so we have a clue how much further the parent has to go before
it is done (Helpful when hundreds of servers doing SCP).

Have the SCP run the AP preflight check before creating an AP; saves
creation of thousands of APs during fixup.

Don't log tablename three times when reporting remote call failed.

If lock is held already, note who has it. Also log after we get lock
or if we have to wait rather than log on entrance though we may
later have to wait (or we may have just picked up the lock).

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-10-04 17:18:13 -07:00
Michael Stack 8fc90a23ae
HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign
Adds override to assigns and unassigns. Changes bypass 'force'
to align calling the param 'override' instead.

Adds recursive to 'bypass', a means of calling bypass on
parent and its subprocedures (usually bypass works on
leaf nodes rippling the bypass up to parent -- recursive
has us work in the opposite direction): EXPERIMENTAL.

bypass on an assign/unassign leaves region in RIT and the
RegionStateNode loaded with the bypassed procedure. First
implementation had assign/unassign cleanup leftover state.
Second implementation, on feedback, keeps the state in place
as a fence against other Procedures assuming the region entity,
and instead adds an 'override' function that hbck2 can set on
assigns/unassigns to override the fencing.

Note that the below also converts ProcedureExceptions that
come out of the Pv2 system into DoNotRetryIOEs. It is a
little awkward because DNRIOE is in client-module, not
in procedure module. Previous, we'd just keep retrying
the bypass, etc.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
 Have bypass take an environment like all other methods so subclasses.
 Fix javadoc issues.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 Javadoc issues. Pass environment when we invoke bypass.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Rename waitUntilNamespace... etc. to align with how these method types
 are named elsehwere .. i.e. waitFor rather than waitUntil..

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 Cleanup message we emit when we find an exisitng procedure working
 against this entity.
 Add support for a force function which allows Assigns/Unassigns force
 ownership of the Region entity.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestRegionBypass.java
 Test bypass and force.

M hbase-shell/src/main/ruby/shell/commands/list_procedures.rb
 Minor cleanup of the json output... do iso8601 timestamps.
2018-10-04 16:37:37 -07:00
Michael Stack 259d12f739 Revert "Revert "Revert "HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign"""
This reverts commit 2174461cf7.

Revert because not ready to port to other branches.
2018-09-29 04:06:46 -07:00
Michael Stack 2174461cf7 Revert "Revert "HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign""
This reverts commit b96905d1df.

i.e. a revert of a revert so a reapplication!

Revert so I can add signed-off-by....

Signed-off-by: Allan Yang <allan163@apache.org>
2018-09-29 03:34:36 -07:00
Michael Stack b96905d1df Revert "HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign"
This reverts commit b42d7978cb.
2018-09-29 03:34:10 -07:00
Michael Stack b42d7978cb HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign
bypass on an assign/unassign leaves region in RIT and the
RegionStateNode loaded with the bypassed procedure. First
implementation had assign/unassign cleanup leftover state.
Second implementation, on feedback, keeps the state in place
as a fence against other Procedures assuming the region entity,
and instead adds an 'override' function that hbck2 can set on
assigns/unassigns to override the fencing.

Note that the below also converts ProcedureExceptions that
come out of the Pv2 system into DoNotRetryIOEs. It is a
little awkward because DNRIOE is in client-module, not
in procedure module. Previous, we'd just keep retrying
the bypass, etc.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
 Have bypass take an environment like all other methods so subclasses.
 Fix javadoc issues.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 Javadoc issues. Pass environment when we invoke bypass.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Rename waitUntilNamespace... etc. to align with how these method types
 are named elsehwere .. i.e. waitFor rather than waitUntil..

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 Cleanup message we emit when we find an exisitng procedure working
 against this entity.
 Add support for a force function which allows Assigns/Unassigns force
 ownership of the Region entity.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestRegionBypass.java
 Test bypass and force.

M hbase-shell/src/main/ruby/shell/commands/list_procedures.rb
 Minor cleanup of the json output... do iso8601 timestamps.
2018-09-29 03:33:07 -07:00
Nihal Jain c41003f5e6
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:35:57 -07:00
Michael Stack 0d008b4792
HBASE-21223 [amv2] Remove abort_procedure from shell
Signed-off-by: Balazs Meszaros <balazs.meszaros@cloudera.com>
2018-09-25 10:07:32 -07:00
Umesh Agashe e6c7ed34e0
HBASE-21023 Added bypassProcedure() API to HbckService 2018-09-19 15:01:29 -07:00
Michael Stack 37cc07a772
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
Adds 'raw' assigns and unassigns methods to Hbck Service.

Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 09:02:43 -07:00
Umesh Agashe 589c1e4078
HBASE-20941 Created and implemented HbckService in master
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-09-12 21:31:13 -07:00
Guangxu Cheng ea4194039e HBASE-21179 Fix the number of actions in responseTooSlow log 2018-09-12 10:44:05 +08:00
Guangxu Cheng 1c8c7e10f8 HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter 2018-09-10 21:40:57 +08:00
subrat.mishra e10d48df54 HBASE-21030: Changed javadoc for append operation.
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2018-08-26 23:46:10 +09:00
jingyuntian 95e3dec510 HBASE-20985 add two attributes when we do normalization
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 16:55:19 +08:00
Sakthi 7e9f8c60e2 HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-03 11:07:01 -04:00
Michael Stack 88f3148810 HBASE-20989 Minor, miscellaneous logging fixes
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-08-01 11:20:01 -07:00
zhangduo 1777ea3aae HBASE-20938 Set version to 2.1.1-SNAPSHOT for branch-2.1 2018-07-25 21:45:09 +08:00
Allan Yang 3251554737 HBASE-20867 RS may get killed while master restarts 2018-07-25 18:11:28 +08:00
huzheng 1dbfe92dbf HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result 2018-07-24 10:39:36 +08:00
Balazs Meszaros 36c4f62daf HBASE-20853 Polish "Add defaults to Table Interface so Implementors don't have to"
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 20:48:32 +08:00
Mike Drob 624a5c6644
HBASE-20884 Replace Base64 with j.u.Base64
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-13 13:00:40 -05:00
zhaoyuan 8de69db143 HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 11:17:41 +08:00
zhangduo 5e25bc92cf HBASE-20784 Will lose the SNAPSHOT suffix if we get the version of RS from ServerManager 2018-07-10 10:00:15 +08:00
Allan Yang 77c6276a7e HBASE-20854 Wrong retries number in RpcRetryingCaller's log message 2018-07-09 15:24:38 +08:00
zhangduo 5a40606422 HBASE-20822 TestAsyncNonMetaRegionLocator is flakey 2018-07-09 14:56:45 +08:00
zhangduo a2db3d27ff HBASE-20849 Set version as 2.1.0 in branch-2.1 in prep for first RC 2018-07-06 15:32:23 +08:00