Commit Graph

1279 Commits

Author SHA1 Message Date
Josh Elser 25defc9293 HBASE-21796 Recover a ZK client from the AUTH_FAILED state
Introduces "hbase.zookeeper.authfailed.retries.number" and
"hbase.zookeeper.authfailed.pause" to control number of retries
from the AUTH_FAILED state (and the pause in millis between
attempts) before giving up and throwing an uncaught exception.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-03-12 22:12:34 -04:00
Andrew Purtell 1acdec96cb
Revert "HBASE-21775 The BufferedMutator doesn't ever refresh region location cache Fix server location metadata refresh in multi-actions"
This reverts commit 4e89d98d4a.

Several unit tests are failing after this commit.
2019-02-05 14:01:37 -08:00
Andrew Purtell ce6a6014da
Update POMs and CHANGES.txt for 1.5.0 RC0 2019-02-01 12:36:10 -08:00
Tommy Li 4e89d98d4a HBASE-21775 The BufferedMutator doesn't ever refresh region location cache Fix server location metadata refresh in multi-actions
This is a backport from branch-2 but we do not backport the test because
it uses branch-2-isms.

Signed-off-by: stack <stack@apache.org>
2019-01-26 13:46:26 -08:00
huzheng 3015e23c09 HBASE-21734 Some optimization in FilterListWithOR 2019-01-22 12:01:52 +08:00
xcang 3a11028cdf
Throw DNRIOE when connection or rpc client is closed
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-17 18:02:29 -08:00
Peter Somogyi cad3630c70
HBASE-21727 Simplify documentation around client timeout
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientScanner.java
	src/main/asciidoc/_chapters/configuration.adoc
	src/main/asciidoc/_chapters/troubleshooting.adoc

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-17 16:59:12 -08:00
Andrew Purtell 2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1
HBASE-21034 Add new throttle type: read/write capacity unit

HBASE-21578 Fix wrong throttling exception for capacity unit
2019-01-16 15:59:46 -08:00
Nihal Jain a3e274cf57
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 11:24:08 -08:00
Andrew Purtell d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
HBASE-6028 Start/Stop compactions at region server level

Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
2019-01-11 18:08:27 -08:00
Sahil Aggarwal 21cfff857d
HBASE-20716 Unsafe access cleanup
Changes the bytes[] conversion done in Bytes and ByteBufferUtils.
Instead of doing check unsafe_aligned available everytime, choose
the best converter at startup.

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/FuzzyRowFilter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:45 -08:00
openinx 55a775b8d4 HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-25 09:49:38 +08:00
Guanghao Zhang 98640e4b2c HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 14:03:12 +08:00
Andrew Purtell e80cc3286c
HBASE-21464 Splitting blocked with meta NSRE during split transaction
Signed-off-by: Lars Hofhansl <larsh@apache.org>
2018-12-05 10:54:35 -08:00
Andrew Purtell 547f3fc2dc
Revert "HBASE-21464 Splitting blocked with meta NSRE during split transaction"
This reverts commit bd87f4ebcd

Committed change is insufficient. Was able to reproduce the problem again.
2018-11-30 14:41:57 -08:00
Andrew Purtell bd87f4ebcd
HBASE-21464 Splitting blocked with meta NSRE during split transaction
When looking up the locations of hbase:meta with useCache false, clear all previous
cache entries for it first

Fix Table reference leaks in MetaTableAccessor with try-with-resources

Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-30 09:57:54 -08:00
Ben Lau 68c9396685
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Amend HBASE-21439 Update RSGroup Test too

Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-11-08 14:21:51 -08:00
Xu Cang 6e0ee4efa7
HBASE-18549 Add metrics for failed replication queue recovery
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:24 -07:00
Reid Chan c6a1334528 Revert "HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work"
Revert reason: It breaks phoenix client.

This reverts commit 8dbb0b0487.
2018-09-22 10:13:14 +08:00
jackbearden 8dbb0b0487 HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work
Amending-Author: Reid Chan <reidchan@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-19 10:53:24 +08:00
Guangxu Cheng c458757f10 HBASE-21179 Fix the number of actions in responseTooSlow log
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
2018-09-13 15:10:19 +08:00
Guangxu Cheng d4d0a21b55 HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:12:24 +08:00
Lars Hofhansl d236a5fab8 HBASE-21166 Creating a CoprocessorHConnection re-retrieves the cluster id from ZK. 2018-09-07 15:16:54 -07:00
subrat.mishra 3258b83f37 HBASE-21030: Changed javadoc for append operation.
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2018-08-26 23:40:46 +09:00
Vikas Vishwakarma 3bc4bc48f6 HBASE-20896 Port HBASE-20866 to branch-1 and branch-1.4
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-04 10:24:18 +08:00
Josh Elser ab3ec9477a HBASE-20930 MetaScanner.metaScan should respect meta table name (Vishal Khandelwal) 2018-07-30 17:12:03 -04:00
huzheng 0b7081e67a HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result 2018-07-24 10:25:43 +08:00
jingyuntian 15ed2e86e1 HBASE-20855 PeerConfigTracker only supporting one listener will cause problem when there is a recovered replication queue
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 08:43:23 -07:00
Guanghao Zhang 3835f715f2 HBASE-20697 (addendum) Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations() 2018-07-12 13:47:55 +08:00
zhaoyuan 6edb27e1e6 HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 11:33:32 +08:00
Pankaj 0953eb7ed9 HBASE-20771 PUT operation fail with "No server address listed in hbase:meta for region xxxxx"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-09 15:54:54 -07:00
Michael Stack ccead1264c HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
General log cleanup; setting stuff that can flood the log to TRACE.

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-26 15:54:47 -07:00
Wei-Chiu Chuang f1eda99451 HBASE-20669 [findbugs] autoboxing to parse primitive
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-06-01 13:26:13 -05:00
Andrew Purtell e793e7c30c HBASE-20493 Port HBASE-19994 (Create a new class for RPC throttling exception, make it retryable) to branch-1 2018-04-26 15:38:40 -07:00
Toshihiro Suzuki f11cf007a2 HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on 2018-04-25 13:36:12 -07:00
maoling 2a8e62f8ee HBASE-20047 AuthenticationTokenIdentifier should provide a toString
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-22 09:56:43 -05:00
Sakthi 8da331c4d7
HBASE-18864 Fixed NullPointerException thrown while adding rows to a table from peer cluster, with replication factor other than 0 or 1 2018-03-13 13:19:15 -07:00
dbist13 4bdfa342a5 HBASE-19985 Redundant instanceof check in ProtobufUtil#getServiceException 2018-03-03 02:45:40 -08:00
Andrew Purtell aae12e8470 HBASE-20109 Add Admin#getMaster API to branch-1
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-02 11:39:43 -08:00
Andrew Purtell c590ebba07 HBASE-19769 IllegalAccessError on package-private Hadoop metrics2 classes in MapReduce jobs
Client-side ZooKeeper metrics cause issues when launching MapReduce
jobs via 'yarn jar' on the command line. This stems from ClassLoader
separation issues that YARN implements. It was chosen that the
easiest solution was to remove these ZooKeeper metrics entirely.

Revert "HBASE-17448 Export metrics from RecoverableZooKeeper"

This reverts commit defc25c6d1.
2018-03-01 15:28:39 -08:00
Pankaj Kumar 343cdda9ae HBASE-19364, Truncate_preserve fails with table when replica region > 1 2018-02-23 14:13:02 -08:00
Sean Busbey ba7a936f74 Revert "HBASE-9465 Push entries to peer clusters serially"
This reverts commit 441bc050b9.

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:15 +08:00
Sean Busbey 0a284d2b76 Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)"
This reverts commit 97276da9a7.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:04 +08:00
Chia-Ping Tsai 21f6830fe1 HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-20 16:59:44 -08:00
Ben Lau 28ebd29f0f HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-14 17:23:23 -08:00
Chia-Ping Tsai f77b42b2af HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner 2018-02-13 21:29:01 +08:00
Janos Gub fe5848038d HBASE-19981 Boolean#getBoolean is used to parse value
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-12 13:08:04 -08:00
Chia-Ping Tsai 0cbb19201c HBASE-19900 Region-level exception destroy the result of batch 2018-02-07 08:30:55 +08:00
Andrew Purtell f35bcd2fe3 HBASE-19858 Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1
HBASE-14061 Support CF-level Storage Policy
HBASE-14061 Support CF-level Storage Policy (addendum)
HBASE-14061 Support CF-level Storage Policy (addendum2)
HBASE-15172 Support setting storage policy in bulkload
HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs
HBASE-18015 Storage class aware block placement for procedure v2 WALs
HBASE-18017 Reduce frequency of setStoragePolicy failure warnings
Default storage policy if not configured cannot be "NONE"
HBASE-19016 Coordinate storage policy property name for table schema and bulkload
Fix checkstyle warnings
Addressed additional review feedback on backport
2018-02-01 17:10:39 -08:00
Niels Basjes 42c8b5bec5 HBASE-19673 Backport "HBASE-19486 Periodically ensure records are not buffered too long by BufferedMutator" to branch-1
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-06 16:15:13 +08:00