Commit Graph

1209 Commits

Author SHA1 Message Date
Phil Yang d5838c78fc HBASE-18113 Handle old client without include_stop_row flag when startRow equals endRow 2017-05-26 13:51:17 +08:00
tedyu c03f003f4f HBASE-18035 Meta replica does not give any primaryOperationTimeout to primary meta region (huaxiang sun) 2017-05-21 06:39:33 -07:00
tedyu 300c5388f2 HBASE-18058 Zookeeper retry sleep time should have an upper limit (Allan Yang) 2017-05-19 10:58:38 -07:00
huzheng f9dc4cad63 HBASE-11013 Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-05-18 17:54:53 +08:00
Michael Stack 51cb53776d HBASE-18021 Add more info in timed out RetriesExhaustedException for read replica client get processing (Huaxiang Sun) 2017-05-11 17:24:26 -07:00
Vincent ffa3785d0e HBASE-18026 ProtobufUtil seems to do extra array copying
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-11 13:23:19 -07:00
Josh Elser 737b489edd HBASE-17534 Avoid re-wrapping IOExceptions as IOExceptions
This ensures that when a DoNotRetryIOException is returned
from the RPC, it is propagated as a DoNotRetryIOException.
When this does not happen, requests which should not be
retried are repeated per the client configuration.
2017-05-04 12:45:02 -04:00
jc@lifove.net 3a3cb48e2b HBASE-17862 Fix a condition that always returns true
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-05-03 00:30:47 +08:00
QilinCao 9a71bacdf0 HBASE-17835 Spelling mistakes in the Java source
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:40:47 -05:00
huaxiang sun cdda1d0302 HBASE-17904 Get runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to be org.apache.hadoop.hbase.ipc.RpcClientImpl
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-28 06:53:37 +08:00
ckulkarni defc25c6d1 HBASE-17448 Export metrics from RecoverableZooKeeper
Added metrics for RecoverableZooKeeper related to specific exceptions,
total failed ZooKeeper API calls and latency histograms for read,
write and sync operations. Also added unit tests for the same. Added
service provider for the ZooKeeper metrics implementation inside the
hadoop compatibility module.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/RecoverableZooKeeper.java
	hbase-metrics-api/src/main/java/org/apache/hadoop/hbase/metrics/PackageMarker.java
2017-04-26 18:14:53 -07:00
Nemo Chen 4030facc99 HBASE-16469 Several log refactoring/improvement suggestions
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-11 14:28:47 -05:00
Yu Li 96890d64d4 HBASE-17886 Fix compatibility of ServerSideScanMetrics 2017-04-06 18:19:34 +08:00
zhangduo 849ab5ff29 HBASE-17595 addendum fix the problem for mayHaveMoreCellsInRow 2017-03-23 20:35:12 +08:00
zhangduo b973d3fd46 HBASE-17584 Expose ScanMetrics with ResultScanner rather than Scan 2017-03-20 16:32:20 +08:00
zhangduo 6be8d2041b HBASE-17793 Backport ScanResultCache related code to branch-1 2017-03-17 09:32:44 +08:00
CHIA-PING TSAI d542b446b8 HBASE-17778 Remove the testing code in the AsyncRequestFutureImpl 2017-03-17 07:52:45 +08:00
zhangduo 094e9a311b HBASE-16584 Backport the new ipc implementation in HBASE-16432 to branch-1 2017-03-16 23:00:30 +08:00
tedyu 318298047b HBASE-17779 disable_table_replication returns misleading message and does not turn off replication (Janos Gub) 2017-03-14 12:34:04 -07:00
tedyu f34709e1b7 HBASE-17460 enable_table_replication can not perform cyclic replication of a table (Janos Gub) 2017-03-08 01:27:35 -08:00
Karan Mehta 5f630935bb HBASE-17716 Formalize Scan Metric names
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 07:42:40 -08:00
Phil Yang f45d261902 HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs. 2017-03-07 22:42:58 +08:00
Phil Yang 6afe696e53 HBASE-15484 Correct the semantic of batch and partial 2017-03-07 12:04:09 +08:00
Andrew Purtell ccf1f17d78 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
Conflicts:
	hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
Josh Elser 85b5d49315 HBASE-17717 Explicitly use "sasl" ACL scheme for hbase superuser
The special "auth" ZK ACL scheme will always set the ACL's id (the
user who is allowed) to be the authenticated user of the ZK connection.
This results in the HBase superuser not actually receiving the
permissions as the ZKUtil intends to do. Since we know we have security
enabled, we can instead explicitly list "sasl" as the ACL scheme
instead.
2017-03-02 15:50:38 -05:00
Jingcheng Du 2131c79552 HBASE-17688 MultiRowRangeFilter not working correctly if given same start and stop RowKey 2017-02-28 12:15:38 +08:00
Jan Hentschel ec84118c97 HBASE-17634 Cleaned up the usage of Result.isPartial
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-27 20:45:58 +08:00
Abhishek Singh Chouhan 2b6e9b3a3a Amend HBASE-17069 RegionServer writes invalid META entries in some circumstances
Fix Hregioninfo being null during merge

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-23 13:46:02 -08:00
zhangduo 3e2a6784c7 HBASE-17595 Add partial result support for small/limited scan 2017-02-23 16:10:10 +08:00
huzheng 45357c078d HBASE-17472: Correct the semantic of permission grant
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-20 20:24:09 +08:00
zhangduo f835d1efc2 HBASE-17583 Add inclusive/exclusive support for startRow and endRow of scan for sync client 2017-02-15 10:18:58 +08:00
tedyu 2ac0c3b6da HBASE-17460 enable_table_replication can not perform cyclic replication of a table - revert due to failure in testEnableReplicationWhenSlaveClusterDoesntHaveTable 2017-02-13 16:01:25 -08:00
tedyu 810427b950 HBASE-17460 enable_table_replication can not perform cyclic replication of a table (NITIN VERMA) 2017-02-10 16:45:27 -08:00
Andrew Purtell e4ee7ee891 HBASE-17572 HMaster: Caught throwable while processing event C_M_MERGE_REGION 2017-02-09 13:37:40 -08:00
Ajay Jadhav 67fe516ec9 HBASE-17280 Add mechanism to control hbase cleaner behavior
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-09 12:18:42 -08:00
zhangduo e9abe07629 HBASE-17599 Use mayHaveMoreCellsInRow instead of isPartial 2017-02-09 15:38:23 +08:00
Andrew Purtell fd062011f0 Revert "HBASE-17572 HMaster: Caught throwable while processing event C_M_MERGE_REGION (UndeclaredThrowableException)"
This reverts commit fb1239766d.
2017-02-08 15:59:44 -08:00
Enis Soztutar 7cac85b667 HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application 2017-02-06 13:39:09 -08:00
zhangduo 4456d22859 HBASE-17508 Unify the implementation of small scan and regular scan for sync client 2017-02-05 08:49:51 +08:00
Andrew Purtell fb1239766d HBASE-17572 HMaster: Caught throwable while processing event C_M_MERGE_REGION (UndeclaredThrowableException) 2017-02-03 14:15:56 -08:00
gjacoby 3aac1b6884 HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-01-31 16:16:20 -08:00
zhangduo 57409371a0 HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted 2017-01-22 16:39:14 +08:00
tedyu 0e06ade694 HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand) 2017-01-17 09:38:50 -08:00
Allan Yang 2b5292c5f9 HBASE-17475 Stack overflow in AsyncProcess if retry too much
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-01-17 15:47:25 +08:00
tedyu ee66ab8e29 HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng) 2017-01-13 09:39:06 -08:00
tedyu e371b1e723 HBASE-17431 Incorrect precheck condition in RoundRobinPool#get() - revert due to test failure 2017-01-06 12:13:18 -08:00
tedyu d0393bdf28 HBASE-17431 Incorrect precheck condition in RoundRobinPool#get() (Jan Hentschel) 2017-01-06 09:08:55 -08:00
Ashish Singhi e8e40d8625 HBASE-17290 Potential loss of data for replication of bulk loaded hfiles 2017-01-06 16:57:52 +05:30
Jan Hentschel a9bac6a496 HBASE-17390 Added master and backup masters to online update of configuration
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-01-04 22:25:22 -08:00
Guanghao Zhang 97d1ba4015 HBASE-17317 [branch-1] The updatePeerConfig method in ReplicationPeersZKImpl didn't update the table-cfs map 2016-12-20 18:51:26 +08:00
Guanghao Zhang 4b3df0f926 HBASE-17296 Provide per peer throttling for replication
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-12-15 16:13:04 +08:00
tedyu 1f9214bee7 HBASE-17297 Single Filter in parenthesis cannot be parsed correctly (Xuesen Liang) 2016-12-12 12:09:22 -08:00
tedyu 30576991bc HBASE-17289 Avoid adding a replication peer named "lock" 2016-12-12 09:38:55 -08:00
tedyu d87b05f040 HBASE-16336 Removing peers seems to be leaving spare queues (Guanghao Zhang) 2016-12-11 07:43:10 -08:00
tedyu 600fa8de77 HBASE-17170 HBase is also retrying DoNotRetryIOException because of class loader differences (Ankit Singhal) 2016-12-05 10:16:01 -08:00
Guanghao Zhang 682dd57cd6 HBASE-17205 Add a metric for the duration of region in transition 2016-12-01 10:32:24 -08:00
Jonathan M Hsieh 9da0d5d00e HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn) 2016-12-01 09:10:03 -08:00
Yu Li 4068a8b4d4 HBASE-17114 Add an option to set special retry pause when encountering CallQueueTooBigException 2016-12-01 16:48:46 +08:00
Yu Li b3627ef51e HBASE-17212 Should add null checker on table name in HTable and RegionServerCallable constructor (addendum) 2016-12-01 13:32:33 +08:00
Yu Li edcac04ac1 HBASE-17212 Should add null checker on table name in HTable and RegionServerCallable constructor 2016-12-01 02:26:14 +08:00
Yu Li 547d97f5ca HBASE-17211 Add more details in log when UnknownScannerException thrown in ScannerCallable 2016-12-01 01:14:45 +08:00
zhangduo af69783128 HBASE-17167 Pass mvcc to client when scan 2016-11-30 10:02:17 +08:00
Yu Li e30329e372 HBASE-17127 Locate region should fail fast if underlying Connection already closed 2016-11-19 23:51:25 +08:00
Jerry He 26e3164481 HBASE-16708 Expose endpoint Coprocessor name in responseTooSlow log messages (Yi Liang) 2016-11-18 11:09:55 -08:00
tedyu b77bfe9d3b HBASE-17077 Don't copy the replication queue belonging to the peer which has been deleted (Guanghao Zhang) 2016-11-13 07:00:25 -08:00
tedyu 97276da9a7 HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang) 2016-11-08 06:35:12 -08:00
Mikhail Antonov 3063943c78 HBASE-17032 CallQueueTooBigException and CallDroppedException should not be triggering PFFE 2016-11-06 21:34:11 -08:00
Jim Kleckner 5fdddae55e HBASE-16970 Clarify misleading Scan.java comment about caching
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-01 17:48:56 +08:00
Guanghao Zhang 722be3a3d8 HBASE-16947 Some improvements for DumpReplicationQueues tool
Signed-off-by: Michael Stack <stack@apache.org>
2016-10-31 21:00:45 -07:00
Michael Stack a969f8d790 HBASE-16969 RegionCoprocessorServiceExec should override the toString() for debugging (ChiaPing Tsai) 2016-10-31 14:37:51 -07:00
Esteban Gutierrez 0a41493ac4 HBASE-16450 Shell tool to dump replication queues
New tool to dump existing replication peers, configurations and
queues when using HBase Replication. The tool provides two flags:

 --distributed  This flag will poll each RS for information about
                the replication queues being processed on this RS.
                By default this is not enabled and the information
                about the replication queues and configuration will
                be obtained from ZooKeeper.
 --hdfs         When --distributed is used, this flag will attempt
                to calculate the total size of the WAL files used
                by the replication queues. Since its possible that
                multiple peers can be configured this value can be
                overestimated.

Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-27 21:38:42 -07:00
tedyu d4826e1665 HBASE-16886 hbase-client: scanner with reversed=true and small=true gets no result (huzheng) 2016-10-27 07:47:49 -07:00
Ashu Pachauri 0117ed9d78 HBASE-16752 addendum. Do not retry large request for client versions less than 1.3
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-20 10:34:46 -07:00
Ashu Pachauri 33e89fa9cf HBASE-16752 Return error back to rpc client on exceeding rpc request size limit.
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-19 15:50:42 -07:00
Huaxiang Sun a97aef5163 HBASE-16345 RpcRetryingCallerWithReadReplicas#call() should catch some RegionServer Exceptions
Fix logic for
1). how to handle exception while waiting for reply from the primary replica.
2). handle exception from replicas while waiting for a correct response.

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2016-10-19 14:22:42 -07:00
Guanghao Zhang 66941910bd HBASE-16653 Backport HBASE-11393 to branches which support namespace
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-18 09:12:47 +08:00
tedyu 6df7554d29 HBASE-16855 Avoid NPE in MetricsConnection’s construction (ChiaPing Tsai) 2016-10-17 09:35:02 -07:00
Phil Yang 8f9fadf021 HBASE-16664 Timeout logic in AsyncProcess is broken
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 17:14:52 +08:00
Jerry He 5ac2776d23 HBASE-16732 Avoid possible NPE in MetaTableLocator 2016-09-29 14:14:01 -07:00
anoopsamjohn a3485cc5ab HBASE-16705 Eliminate long to Long auto boxing in LongComparator. (binlijin)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/LongComparator.java
2016-09-26 15:41:45 -07:00
Enis Soztutar 8a797e81b8 HBASE-16604 Scanner retries on IOException can cause the scans to miss data 2016-09-22 18:48:06 -07:00
Jonathan M Hsieh ecc1c294f5 HBASE-12088 Addendum - fix spacing 2016-09-21 20:58:34 -07:00
Jonathan M Hsieh 13d6acbc7f HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:52:19 -07:00
Phil Yang 069d1f73fa HBASE-16388 Prevent client threads being blocked by only one slow region server
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:28:20 -07:00
tedyu 8e25ea536a HBASE-16613 Return the unused ByteBuffer to BoundedByteBufferPool when no cell is retrieved from the CellScanner (ChiaPing Tsai) 2016-09-13 09:49:13 -07:00
Umesh Agashe 059a169d3a HBASE-15297 Correct handling of namespace existence checks in shell.
Changes namespace_exists? method in SecurityAdmin ruby code to catch NamespaceNotFoundException
and modified Admin.java file to document the exception.

Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
2016-09-12 23:58:21 -07:00
Dustin Pho 7028a0d889 HBASE-16540 Adding checks in Scanner's setStartRow and setStopRow for invalid row key sizes.
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-09-12 17:38:15 -07:00
tedyu 354706a7d8 HBASE-16572 Sync method in RecoverableZooKeeper failed to pass callback function in (Allan Yang) 2016-09-07 11:36:18 -07:00
tedyu e1aab356b3 HBASE-16556 The read/write timeout are not used in HTable.delete(List), HTable.get(List), and HTable.existsAll(List) (ChiaPing Tsai) 2016-09-04 21:15:10 -07:00
tedyu a0e52a2dab HBASE-16541 Avoid unnecessary cell copy in Result#compareResults (ChiaPing Tsai) 2016-09-04 07:08:38 -07:00
tedyu 64135da824 HBASE-16515 AsyncProcess has incorrent count of tasks if the backoff policy is enabled - addendum fixes timeout of TestAsyncProcess#testSubmitRandomSizeRequest (Chiaping Tsai) 2016-08-31 02:05:45 -07:00
tedyu 1d365f580c HBASE-16515 AsyncProcess has incorrent count of tasks if the backoff policy is enabled (ChiaPing Tsai) 2016-08-30 19:40:50 -07:00
chenheng ce9b6c0abf HBASE-16224 Reduce the number of RPCs for the large PUTs (ChiaPing Tsai) 2016-08-30 13:30:23 +08:00
Josh Elser c64c0e85c0 HBASE-16376 Scan#setBatch(int) javadoc update WRT partial results
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-08-24 05:13:00 -07:00
Phil Yang 441bc050b9 HBASE-9465 Push entries to peer clusters serially
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:26:15 +08:00
stack 25c4ff5404 HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang) 2016-08-08 21:44:37 -07:00
Phil Yang 0354dbf1ec HBASE-12770 Don't transfer all the queued hlogs of a dead server to the same alive server
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-08 16:32:43 +08:00
Vivek ec99838b9c HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Table.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/client/HTableWrapper.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2016-08-06 10:38:41 -07:00
Sean Busbey a5f98c3f9e HBASE-16321 ensure no findbugs-jsr305
Signed-off-by: Esteban Gutierrez <esteban@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-rsgroup/pom.xml
	hbase-server/pom.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/ObserverContext.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-spark/pom.xml
	src/main/asciidoc/_chapters/developer.adoc
2016-08-05 14:08:50 -05:00
Ramkrishna 7a62076ae4 HBASE-16303 Addendum as the wrong patch was committed 2016-08-05 13:09:32 +05:30