Commit Graph

1328 Commits

Author SHA1 Message Date
huaxiang sun 9427d6c73c HBASE-18247 Hbck to fix the case that replica region shows as key in the meta table
Change-Id: I2169290ec5a97a63747bc93ee37f36729c3ac916
2017-07-25 17:08:53 -07:00
张世彬10204932 8ea7a364bf HBASE-18323 Remove multiple ACLs for the same user in kerberos
Signed-off-by: Josh Elser <elserj@apache.org>
2017-07-25 18:22:45 -04:00
rgidwani 26247996d2 HBASE-15816 Provide client with ability to set priority on Operations
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-07-21 17:12:25 -07:00
Andrew Purtell cfd5b6b59f HBASE-18330 NPE in ReplicationZKLockCleanerChore 2017-07-19 15:46:45 -07:00
Phil Yang 980209579b HBASE-18390 Sleep too long when finding region location failed 2017-07-19 12:05:21 +08:00
Chia-Ping Tsai 8eaad67866 HBASE-18268 Eliminate the findbugs warnings for hbase-client 2017-07-12 03:15:08 +08:00
Andrew Purtell 3dd55fa0c0 Set versions on branch-1 to 1.5.0-SNAPSHOT 2017-07-03 18:01:15 -07:00
Michael Stack 3b28f66bf3 HBASE-18266 Create static empty byte array to save memory (Ben Epstein) 2017-06-30 15:31:38 -07:00
Michael Stack 262e6bb3fa HBASE-18004 getRegionLocations needs to be called once in ScannerCallableWithReplicas#call() (Huaxiang Sun)
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-30 15:31:30 -07:00
Pankaj Kumar d5bba50794 HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-22 02:11:07 -07:00
tedyu 3d9c544428 HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always - revert wrong version of patch 2017-06-22 02:10:25 -07:00
Pankaj Kumar 01027f805b HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-21 08:22:30 -07:00
Andrew Purtell 316e02e3d8 HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT 2017-06-14 16:03:54 -07:00
huzheng 256fc63007 HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-06-13 20:28:04 +08:00
zhangduo d6e85b0511 Revert "FilterList with MUST_PASS_ONE may lead to redundant cells returned" miss issue number
This reverts commit c71da858ad.
2017-06-13 20:27:28 +08:00
huzheng c71da858ad FilterList with MUST_PASS_ONE may lead to redundant cells returned
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-12 23:55:25 -07:00
zhangduo 6860ddca9f HBASE-18199 Race in NettyRpcConnection may cause call stuck in BufferCallBeforeInitHandler forever 2017-06-10 19:07:23 +08:00
Phil Yang 381c89b5cc HBASE-15576 Scanning cursor to prevent blocking long time on ResultScanner.next() 2017-06-07 11:37:22 +08:00
tedyu 39e8e2fb58 HBASE-18005 read replica: handle the case that region server hosting both primary replica and meta region is down (huaxiang sun) 2017-06-06 09:07:17 -07:00
Phil Yang d5838c78fc HBASE-18113 Handle old client without include_stop_row flag when startRow equals endRow 2017-05-26 13:51:17 +08:00
tedyu c03f003f4f HBASE-18035 Meta replica does not give any primaryOperationTimeout to primary meta region (huaxiang sun) 2017-05-21 06:39:33 -07:00
tedyu 300c5388f2 HBASE-18058 Zookeeper retry sleep time should have an upper limit (Allan Yang) 2017-05-19 10:58:38 -07:00
huzheng f9dc4cad63 HBASE-11013 Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-05-18 17:54:53 +08:00
Michael Stack 51cb53776d HBASE-18021 Add more info in timed out RetriesExhaustedException for read replica client get processing (Huaxiang Sun) 2017-05-11 17:24:26 -07:00
Vincent ffa3785d0e HBASE-18026 ProtobufUtil seems to do extra array copying
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-11 13:23:19 -07:00
Josh Elser 737b489edd HBASE-17534 Avoid re-wrapping IOExceptions as IOExceptions
This ensures that when a DoNotRetryIOException is returned
from the RPC, it is propagated as a DoNotRetryIOException.
When this does not happen, requests which should not be
retried are repeated per the client configuration.
2017-05-04 12:45:02 -04:00
jc@lifove.net 3a3cb48e2b HBASE-17862 Fix a condition that always returns true
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-05-03 00:30:47 +08:00
QilinCao 9a71bacdf0 HBASE-17835 Spelling mistakes in the Java source
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:40:47 -05:00
huaxiang sun cdda1d0302 HBASE-17904 Get runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to be org.apache.hadoop.hbase.ipc.RpcClientImpl
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-28 06:53:37 +08:00
ckulkarni defc25c6d1 HBASE-17448 Export metrics from RecoverableZooKeeper
Added metrics for RecoverableZooKeeper related to specific exceptions,
total failed ZooKeeper API calls and latency histograms for read,
write and sync operations. Also added unit tests for the same. Added
service provider for the ZooKeeper metrics implementation inside the
hadoop compatibility module.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/RecoverableZooKeeper.java
	hbase-metrics-api/src/main/java/org/apache/hadoop/hbase/metrics/PackageMarker.java
2017-04-26 18:14:53 -07:00
Nemo Chen 4030facc99 HBASE-16469 Several log refactoring/improvement suggestions
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-11 14:28:47 -05:00
Yu Li 96890d64d4 HBASE-17886 Fix compatibility of ServerSideScanMetrics 2017-04-06 18:19:34 +08:00
zhangduo 849ab5ff29 HBASE-17595 addendum fix the problem for mayHaveMoreCellsInRow 2017-03-23 20:35:12 +08:00
zhangduo b973d3fd46 HBASE-17584 Expose ScanMetrics with ResultScanner rather than Scan 2017-03-20 16:32:20 +08:00
zhangduo 6be8d2041b HBASE-17793 Backport ScanResultCache related code to branch-1 2017-03-17 09:32:44 +08:00
CHIA-PING TSAI d542b446b8 HBASE-17778 Remove the testing code in the AsyncRequestFutureImpl 2017-03-17 07:52:45 +08:00
zhangduo 094e9a311b HBASE-16584 Backport the new ipc implementation in HBASE-16432 to branch-1 2017-03-16 23:00:30 +08:00
tedyu 318298047b HBASE-17779 disable_table_replication returns misleading message and does not turn off replication (Janos Gub) 2017-03-14 12:34:04 -07:00
tedyu f34709e1b7 HBASE-17460 enable_table_replication can not perform cyclic replication of a table (Janos Gub) 2017-03-08 01:27:35 -08:00
Karan Mehta 5f630935bb HBASE-17716 Formalize Scan Metric names
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 07:42:40 -08:00
Phil Yang f45d261902 HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs. 2017-03-07 22:42:58 +08:00
Phil Yang 6afe696e53 HBASE-15484 Correct the semantic of batch and partial 2017-03-07 12:04:09 +08:00
Andrew Purtell ccf1f17d78 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
Conflicts:
	hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
Josh Elser 85b5d49315 HBASE-17717 Explicitly use "sasl" ACL scheme for hbase superuser
The special "auth" ZK ACL scheme will always set the ACL's id (the
user who is allowed) to be the authenticated user of the ZK connection.
This results in the HBase superuser not actually receiving the
permissions as the ZKUtil intends to do. Since we know we have security
enabled, we can instead explicitly list "sasl" as the ACL scheme
instead.
2017-03-02 15:50:38 -05:00
Jingcheng Du 2131c79552 HBASE-17688 MultiRowRangeFilter not working correctly if given same start and stop RowKey 2017-02-28 12:15:38 +08:00
Jan Hentschel ec84118c97 HBASE-17634 Cleaned up the usage of Result.isPartial
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-27 20:45:58 +08:00
Abhishek Singh Chouhan 2b6e9b3a3a Amend HBASE-17069 RegionServer writes invalid META entries in some circumstances
Fix Hregioninfo being null during merge

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-23 13:46:02 -08:00
zhangduo 3e2a6784c7 HBASE-17595 Add partial result support for small/limited scan 2017-02-23 16:10:10 +08:00
huzheng 45357c078d HBASE-17472: Correct the semantic of permission grant
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-20 20:24:09 +08:00
zhangduo f835d1efc2 HBASE-17583 Add inclusive/exclusive support for startRow and endRow of scan for sync client 2017-02-15 10:18:58 +08:00
tedyu 2ac0c3b6da HBASE-17460 enable_table_replication can not perform cyclic replication of a table - revert due to failure in testEnableReplicationWhenSlaveClusterDoesntHaveTable 2017-02-13 16:01:25 -08:00
tedyu 810427b950 HBASE-17460 enable_table_replication can not perform cyclic replication of a table (NITIN VERMA) 2017-02-10 16:45:27 -08:00
Andrew Purtell e4ee7ee891 HBASE-17572 HMaster: Caught throwable while processing event C_M_MERGE_REGION 2017-02-09 13:37:40 -08:00
Ajay Jadhav 67fe516ec9 HBASE-17280 Add mechanism to control hbase cleaner behavior
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-09 12:18:42 -08:00
zhangduo e9abe07629 HBASE-17599 Use mayHaveMoreCellsInRow instead of isPartial 2017-02-09 15:38:23 +08:00
Andrew Purtell fd062011f0 Revert "HBASE-17572 HMaster: Caught throwable while processing event C_M_MERGE_REGION (UndeclaredThrowableException)"
This reverts commit fb1239766d.
2017-02-08 15:59:44 -08:00
Enis Soztutar 7cac85b667 HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application 2017-02-06 13:39:09 -08:00
zhangduo 4456d22859 HBASE-17508 Unify the implementation of small scan and regular scan for sync client 2017-02-05 08:49:51 +08:00
Andrew Purtell fb1239766d HBASE-17572 HMaster: Caught throwable while processing event C_M_MERGE_REGION (UndeclaredThrowableException) 2017-02-03 14:15:56 -08:00
gjacoby 3aac1b6884 HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-01-31 16:16:20 -08:00
zhangduo 57409371a0 HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted 2017-01-22 16:39:14 +08:00
tedyu 0e06ade694 HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand) 2017-01-17 09:38:50 -08:00
Allan Yang 2b5292c5f9 HBASE-17475 Stack overflow in AsyncProcess if retry too much
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-01-17 15:47:25 +08:00
tedyu ee66ab8e29 HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng) 2017-01-13 09:39:06 -08:00
tedyu e371b1e723 HBASE-17431 Incorrect precheck condition in RoundRobinPool#get() - revert due to test failure 2017-01-06 12:13:18 -08:00
tedyu d0393bdf28 HBASE-17431 Incorrect precheck condition in RoundRobinPool#get() (Jan Hentschel) 2017-01-06 09:08:55 -08:00
Ashish Singhi e8e40d8625 HBASE-17290 Potential loss of data for replication of bulk loaded hfiles 2017-01-06 16:57:52 +05:30
Jan Hentschel a9bac6a496 HBASE-17390 Added master and backup masters to online update of configuration
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-01-04 22:25:22 -08:00
Guanghao Zhang 97d1ba4015 HBASE-17317 [branch-1] The updatePeerConfig method in ReplicationPeersZKImpl didn't update the table-cfs map 2016-12-20 18:51:26 +08:00
Guanghao Zhang 4b3df0f926 HBASE-17296 Provide per peer throttling for replication
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-12-15 16:13:04 +08:00
tedyu 1f9214bee7 HBASE-17297 Single Filter in parenthesis cannot be parsed correctly (Xuesen Liang) 2016-12-12 12:09:22 -08:00
tedyu 30576991bc HBASE-17289 Avoid adding a replication peer named "lock" 2016-12-12 09:38:55 -08:00
tedyu d87b05f040 HBASE-16336 Removing peers seems to be leaving spare queues (Guanghao Zhang) 2016-12-11 07:43:10 -08:00
tedyu 600fa8de77 HBASE-17170 HBase is also retrying DoNotRetryIOException because of class loader differences (Ankit Singhal) 2016-12-05 10:16:01 -08:00
Guanghao Zhang 682dd57cd6 HBASE-17205 Add a metric for the duration of region in transition 2016-12-01 10:32:24 -08:00
Jonathan M Hsieh 9da0d5d00e HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn) 2016-12-01 09:10:03 -08:00
Yu Li 4068a8b4d4 HBASE-17114 Add an option to set special retry pause when encountering CallQueueTooBigException 2016-12-01 16:48:46 +08:00
Yu Li b3627ef51e HBASE-17212 Should add null checker on table name in HTable and RegionServerCallable constructor (addendum) 2016-12-01 13:32:33 +08:00
Yu Li edcac04ac1 HBASE-17212 Should add null checker on table name in HTable and RegionServerCallable constructor 2016-12-01 02:26:14 +08:00
Yu Li 547d97f5ca HBASE-17211 Add more details in log when UnknownScannerException thrown in ScannerCallable 2016-12-01 01:14:45 +08:00
zhangduo af69783128 HBASE-17167 Pass mvcc to client when scan 2016-11-30 10:02:17 +08:00
Yu Li e30329e372 HBASE-17127 Locate region should fail fast if underlying Connection already closed 2016-11-19 23:51:25 +08:00
Jerry He 26e3164481 HBASE-16708 Expose endpoint Coprocessor name in responseTooSlow log messages (Yi Liang) 2016-11-18 11:09:55 -08:00
tedyu b77bfe9d3b HBASE-17077 Don't copy the replication queue belonging to the peer which has been deleted (Guanghao Zhang) 2016-11-13 07:00:25 -08:00
tedyu 97276da9a7 HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang) 2016-11-08 06:35:12 -08:00
Mikhail Antonov 3063943c78 HBASE-17032 CallQueueTooBigException and CallDroppedException should not be triggering PFFE 2016-11-06 21:34:11 -08:00
Jim Kleckner 5fdddae55e HBASE-16970 Clarify misleading Scan.java comment about caching
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-01 17:48:56 +08:00
Guanghao Zhang 722be3a3d8 HBASE-16947 Some improvements for DumpReplicationQueues tool
Signed-off-by: Michael Stack <stack@apache.org>
2016-10-31 21:00:45 -07:00
Michael Stack a969f8d790 HBASE-16969 RegionCoprocessorServiceExec should override the toString() for debugging (ChiaPing Tsai) 2016-10-31 14:37:51 -07:00
Esteban Gutierrez 0a41493ac4 HBASE-16450 Shell tool to dump replication queues
New tool to dump existing replication peers, configurations and
queues when using HBase Replication. The tool provides two flags:

 --distributed  This flag will poll each RS for information about
                the replication queues being processed on this RS.
                By default this is not enabled and the information
                about the replication queues and configuration will
                be obtained from ZooKeeper.
 --hdfs         When --distributed is used, this flag will attempt
                to calculate the total size of the WAL files used
                by the replication queues. Since its possible that
                multiple peers can be configured this value can be
                overestimated.

Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-27 21:38:42 -07:00
tedyu d4826e1665 HBASE-16886 hbase-client: scanner with reversed=true and small=true gets no result (huzheng) 2016-10-27 07:47:49 -07:00
Ashu Pachauri 0117ed9d78 HBASE-16752 addendum. Do not retry large request for client versions less than 1.3
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-20 10:34:46 -07:00
Ashu Pachauri 33e89fa9cf HBASE-16752 Return error back to rpc client on exceeding rpc request size limit.
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-19 15:50:42 -07:00
Huaxiang Sun a97aef5163 HBASE-16345 RpcRetryingCallerWithReadReplicas#call() should catch some RegionServer Exceptions
Fix logic for
1). how to handle exception while waiting for reply from the primary replica.
2). handle exception from replicas while waiting for a correct response.

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2016-10-19 14:22:42 -07:00
Guanghao Zhang 66941910bd HBASE-16653 Backport HBASE-11393 to branches which support namespace
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-18 09:12:47 +08:00
tedyu 6df7554d29 HBASE-16855 Avoid NPE in MetricsConnection’s construction (ChiaPing Tsai) 2016-10-17 09:35:02 -07:00
Phil Yang 8f9fadf021 HBASE-16664 Timeout logic in AsyncProcess is broken
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 17:14:52 +08:00
Jerry He 5ac2776d23 HBASE-16732 Avoid possible NPE in MetaTableLocator 2016-09-29 14:14:01 -07:00
anoopsamjohn a3485cc5ab HBASE-16705 Eliminate long to Long auto boxing in LongComparator. (binlijin)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/LongComparator.java
2016-09-26 15:41:45 -07:00
Enis Soztutar 8a797e81b8 HBASE-16604 Scanner retries on IOException can cause the scans to miss data 2016-09-22 18:48:06 -07:00
Jonathan M Hsieh ecc1c294f5 HBASE-12088 Addendum - fix spacing 2016-09-21 20:58:34 -07:00
Jonathan M Hsieh 13d6acbc7f HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:52:19 -07:00
Phil Yang 069d1f73fa HBASE-16388 Prevent client threads being blocked by only one slow region server
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:28:20 -07:00
tedyu 8e25ea536a HBASE-16613 Return the unused ByteBuffer to BoundedByteBufferPool when no cell is retrieved from the CellScanner (ChiaPing Tsai) 2016-09-13 09:49:13 -07:00
Umesh Agashe 059a169d3a HBASE-15297 Correct handling of namespace existence checks in shell.
Changes namespace_exists? method in SecurityAdmin ruby code to catch NamespaceNotFoundException
and modified Admin.java file to document the exception.

Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
2016-09-12 23:58:21 -07:00
Dustin Pho 7028a0d889 HBASE-16540 Adding checks in Scanner's setStartRow and setStopRow for invalid row key sizes.
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-09-12 17:38:15 -07:00
tedyu 354706a7d8 HBASE-16572 Sync method in RecoverableZooKeeper failed to pass callback function in (Allan Yang) 2016-09-07 11:36:18 -07:00
tedyu e1aab356b3 HBASE-16556 The read/write timeout are not used in HTable.delete(List), HTable.get(List), and HTable.existsAll(List) (ChiaPing Tsai) 2016-09-04 21:15:10 -07:00
tedyu a0e52a2dab HBASE-16541 Avoid unnecessary cell copy in Result#compareResults (ChiaPing Tsai) 2016-09-04 07:08:38 -07:00
tedyu 64135da824 HBASE-16515 AsyncProcess has incorrent count of tasks if the backoff policy is enabled - addendum fixes timeout of TestAsyncProcess#testSubmitRandomSizeRequest (Chiaping Tsai) 2016-08-31 02:05:45 -07:00
tedyu 1d365f580c HBASE-16515 AsyncProcess has incorrent count of tasks if the backoff policy is enabled (ChiaPing Tsai) 2016-08-30 19:40:50 -07:00
chenheng ce9b6c0abf HBASE-16224 Reduce the number of RPCs for the large PUTs (ChiaPing Tsai) 2016-08-30 13:30:23 +08:00
Josh Elser c64c0e85c0 HBASE-16376 Scan#setBatch(int) javadoc update WRT partial results
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-08-24 05:13:00 -07:00
Phil Yang 441bc050b9 HBASE-9465 Push entries to peer clusters serially
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:26:15 +08:00
stack 25c4ff5404 HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang) 2016-08-08 21:44:37 -07:00
Phil Yang 0354dbf1ec HBASE-12770 Don't transfer all the queued hlogs of a dead server to the same alive server
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-08 16:32:43 +08:00
Vivek ec99838b9c HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Table.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/client/HTableWrapper.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2016-08-06 10:38:41 -07:00
Sean Busbey a5f98c3f9e HBASE-16321 ensure no findbugs-jsr305
Signed-off-by: Esteban Gutierrez <esteban@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-rsgroup/pom.xml
	hbase-server/pom.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/ObserverContext.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-spark/pom.xml
	src/main/asciidoc/_chapters/developer.adoc
2016-08-05 14:08:50 -05:00
Ramkrishna 7a62076ae4 HBASE-16303 Addendum as the wrong patch was committed 2016-08-05 13:09:32 +05:30
Stevo Slavić 737e063240 HBASE-16355 Invalid hbase-common test-jar dependency scope
hbase-client has hbase-common test-jar as dependency in compile scope, while it should be test scope instead.
This patch fixes the bug.

closes #12

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-04 01:29:25 -05:00
Enis Soztutar 64136151b1 HBASE-16315 RegionSizeCalculator prints region names as binary without escapes 2016-08-02 16:35:31 -07:00
Yu Li 96d8dcb6f1 HBASE-16289 AsyncProcess stuck messages need to print region/server 2016-07-29 11:24:48 +08:00
Phil Yang f35b2c45d4 HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException
Signed-off-by: zhangduo <zhangduo@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannerTimeout.java
2016-07-25 22:37:59 +08:00
Stephen Yuan Jiang a8dd359d7e HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang) 2016-07-23 20:21:32 -07:00
Matteo Bertozzi 24a3d6952c HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun) 2016-07-22 15:29:19 -07:00
Mikhail Antonov ce651f5c6d HBASE-16024 Revert HBASE-15406 from branch-1.3 2016-07-22 14:50:32 -07:00
stack c3fba60842 HBASE-16236 Typo in javadoc of InstancePending (Hiroshi Ikeda) 2016-07-18 22:26:59 -07:00
stack f83c2345bb HBASE-16238 It's useless to catch SESSIONEXPIRED exception and retry in RecoverableZooKeeper (Allan Yang) 2016-07-18 14:36:39 -07:00
tedyu fd8460a4cf HBASE-16237 Blocks for hbase:meta table are not cached in L1 cache (Lars George and Ted Yu) 2016-07-18 10:12:52 -07:00
tedyu 630a1a41df HBASE-16172 Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas 2016-07-18 06:54:09 -07:00
Phil Yang 1e3bce943b HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely 2016-07-18 09:34:45 +08:00
Enis Soztutar 09c7b1e962 HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-07-13 18:23:05 -07:00
stack 9563ab4ca1 HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken scanning because of a side effect of a clean up in HBASE-15650 to make TimeRange construction consistent exposed a latent issue in TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
 Call through to next constructor (if minStamp was 0, we'd skip setting
 allTime=true). Add asserts that timestamps are not < 0 cos it messes
 us up if they are (we already were checking for < 0 on construction but
 assert passed in timestamps are not < 0).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 Add constructor override that takes a TimeRangeTracker (set when flushing
 but not when compacting)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
 Add override creating an HFile in tmp that takes a TimeRangeTracker

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
 Add override for HFile Writer that takes a TimeRangeTracker Take it on
 construction instead of having it passed by a setter later (flags and
 reference set by the setter were not volatile... could have been prob
 in concurrent case)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
 Log WARN if bad initial TimeRange value (and then 'fix' it)

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
 A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
 Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
 Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 14:23:23 -07:00
Yu Li 84dd9cbcb6 HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin) 2016-07-04 21:46:19 +08:00
zhangduo 721c5b7128 HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted 2016-07-04 19:52:28 +08:00
Jerry He 24fd547292 HBASE-16149 Log the underlying RPC exception in RpcRetryingCallerImpl 2016-07-01 22:49:51 -07:00
Jerry He 4d7e5992cf Revert "Log the underlying RPC exception in RpcRetryingCallerImpl": missing HBASE-16149 2016-07-01 22:47:51 -07:00
tedyu 7121bc41e7 HBASE-16159 OutOfMemory exception when using AsyncRpcClient with encryption to read rpc response (Colin Ma) 2016-07-01 14:33:06 -07:00
Jerry He e40fcee6b5 Log the underlying RPC exception in RpcRetryingCallerImpl 2016-07-01 14:21:08 -07:00
Ramkrishna f06945ae6c HBASE-15783 AccessControlConstants#OP_ATTRIBUTE_ACL_STRATEGY_CELL_FIRST
not used any more. (Ram)
2016-06-21 11:56:38 +05:30
tedyu 4377e16619 HBASE-16054 OutOfMemory exception when using AsyncRpcClient with encryption (Colin Ma) 2016-06-20 07:31:07 -07:00
Ashish Singhi a40ec70da9 HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node 2016-06-09 18:46:07 +05:30
Matteo Bertozzi 13d06a2cc8 HBASE-15975 logic in TestHTableDescriptor#testAddCoprocessorWithSpecStr is wrong (Huaxiang Sun) 2016-06-08 22:44:16 -07:00
Sergey Soldatov 7fed7a8f4e HBASE-15957 RpcClientImpl.close never ends in some circumstances
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-06-07 11:38:11 -07:00
stack 3ff082cb87 HBASE-15913 Sasl encryption doesn't work with AsyncRpcChannel 2016-06-07 09:22:09 -07:00
tedyu fad99a3f68 HBASE-15803 ZooKeeperWatcher's constructor can leak a ZooKeeper instance with throwing ZooKeeperConnectionException when canCreateBaseZNode is true 2016-06-07 09:14:01 -07:00
Andrew Purtell 76404238a8 HBASE-15698 Increment TimeRange not serialized to server (Ted Yu) 2016-06-06 22:17:37 -07:00
Sean Mackrory 878b1ea721 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
Ashish Singhi 950a09b03c HBASE-15888 Extend HBASE-12769 for bulk load data replication 2016-06-03 18:47:31 +05:30
Yu Li 36bb496e48 HBASE-15931 Add log for long-running tasks in AsyncProcess 2016-06-02 12:02:19 +08:00
Andrew Purtell 22aa501436 HBASE-15854 Log the cause of SASL connection failures (Robert Yokota) 2016-05-26 14:27:36 -07:00
Mikhail Antonov 51dfe44174 HBASE-15880 RpcClientImpl#tracedWriteRequest incorrectly closes HTrace span 2016-05-23 12:47:46 -07:00
tedyu 6738dbadac HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig) 2016-05-22 06:47:59 -07:00
Jerry He b7de663580 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:32:20 -07:00
Gary Helmling aacc816ac7 HBASE-15856 Addendum Fix UnknownHostException import in MetaTableLocator 2016-05-20 19:31:07 -07:00
Gary Helmling df40739ae7 HBASE-15856 Don't cache unresolved addresses for connections 2016-05-20 10:02:05 -07:00
Matteo Bertozzi e5eea96ca6 HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:51:17 -07:00
tedyu ce43e33876 HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 13:26:45 -07:00
stack c0fcce2bde HBASE-15593 Time limit of scanning should be offered by client (Phil Yang) 2016-05-17 12:51:03 -07:00
Elliott Clark 89146d85ac HBASE-15840 WAL.proto compilation broken for cpp 2016-05-17 12:04:31 -07:00
Sean Busbey e365191896 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:53:45 -05:00
Mikhail Antonov 0042d6d4c8 HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang) 2016-05-15 20:49:00 -07:00
stack 77f511fceb HBASE-15811 Batch Get after batch Put does not fetch all Cells We were not waiting on all executors in a batch to complete. The test for no-more-executors was damaged by the 0.99/0.98.4 fix "HBASE-11403 Fix race conditions around Object#notify"
It added this in AsyncProcess#waitForMaximumCurrentTasks:

synchronized (this.tasksInProgress) {
+          if (tasksInProgress.get() != oldInProgress) break;
           this.tasksInProgress.wait(100);

which added a break out of our waiting loop if any change in
count of tasks; it seems that what was wanted was instead to
avoid the wait if there was movement in the count of completed
task.

Reformats waitForMaximumCurrentTasks so it is testable. Adds
test that we indeed wait on the specified parameter.
2016-05-13 17:53:37 -07:00
Ramkrishna 94c4d568b5 HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
any such public facing class for 2.0 (Ram)
2016-05-09 14:57:39 +05:30
Ashish Singhi 0964884b92 HBASE-15669 HFile size is not considered correctly in a replication request 2016-05-06 17:28:06 +05:30
Ramkrishna b9df7978fc HBASE-15608 Remove PB references from SnapShot related Exceptions (Ram) 2016-05-06 17:07:44 +05:30
tedyu 09d451b1db HBASE-15292 Refined ZooKeeperWatcher to prevent ZooKeeper's callback while construction (Hiroshi Ikeda) 2016-05-05 16:07:39 -07:00
Gary Helmling b36222831d HBASE-15741 Provide backward compatibility for HBase coprocessor service names 2016-05-04 12:37:39 -07:00
Ramkrishna 902b673167 HBASE-15607 Remove PB references from Admin for 2.0 (Ram) 2016-05-03 10:52:59 +05:30
Mikhail Antonov 7e0e86072a HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them 2016-05-02 15:27:13 -07:00
Yu Li 44fdfb3ba0 HBASE-15711 Add client side property to allow logging details for batch errors 2016-04-29 10:16:01 +08:00
tedyu 4f2d8dc328 HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig) 2016-04-27 21:03:34 -07:00
Gary Helmling 4272178b1f HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable 2016-04-26 23:02:24 -07:00
Phil Yang d5acbdd1e4 HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:52:12 -07:00
stack 9f222d59e1 HBASE-15710 Include issue servers information in RetriesExhaustedWithDetailsException message (Yu Li) 2016-04-26 09:15:24 -07:00
chenheng 5d497d5ba8 HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HRegionLocator.java
2016-04-21 14:28:07 +08:00
chenheng 96e9c466d2 HBASE-15406 Split / merge switch left disabled after early termination of hbck
Conflicts:
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
        hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
        hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
        hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
        hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
        hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestSplitOrMergeStatus.java
        hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckOneRS.java
2016-04-15 15:34:43 +08:00
tedyu 85f2caf184 HBASE-15633 Backport HBASE-15507 to branch-1 (Geoffrey Jacoby) 2016-04-13 02:25:32 -07:00
Vasudevan e407e1e81d HBASE-15605 Remove PB references from HCD and HTD for 2.0 (Ram_ 2016-04-11 14:15:09 +05:30
Enis Soztutar 5202d3c25b HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/DistributedHBaseCluster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide3.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannersFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestClockSkewDetection.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestNamespaceCommands.java
2016-03-28 17:00:21 -07:00
Mikhail Antonov ca819e1ef6 HBASE-15524 Fix NPE in client-side metrics 2016-03-23 21:59:15 -07:00
Jesse Yates ee33bf0c7d HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerFactory.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerImpl.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/StatsTrackingRpcRetryingCaller.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ClientProtos.java
2016-03-24 11:27:54 +08:00
zhangduo 9fa44a8126 HBASE-15520 Fix broken TestAsyncIPC
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/AsyncRpcChannel.java
2016-03-24 10:57:42 +08:00
Elliott Clark 604415e827 HBASE-15475 Allow TimestampsFilter to provide a seek hint 2016-03-23 18:57:02 -07:00
tedyu 1c5002660b HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang) 2016-03-21 13:20:23 -07:00
tedyu 050c13e83f HBASE-15479 No more garbage or beware of autoboxing (Vladimir Rodionov) 2016-03-19 17:23:29 -07:00
Jerry He 8151503fa0 HBASE-14963 Remove use of Guava Stopwatch from HBase client code (Devaraj Das) 2016-03-19 13:23:05 -07:00
Mikhail Antonov a317a0f89c HBASE-15390 Unnecessary MetaCache evictions cause elevated number of requests to meta (ADDENDUM) 2016-03-17 01:09:10 -07:00
Elliott Clark aaaae83423 HBASE-15441 Fix WAL splitting when region has moved multiple times
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.

Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.

We need to:

It appears that the close event with a sequence id of one is coming from region warm up.

This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.

Test Plan: Unit tests pass

Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:35:18 -07:00
Mikhail Antonov 94d576025f HBASE-15390 Unnecessary MetaCache evictions cause elevated number of requests to meta 2016-03-16 16:32:11 -07:00
anoopsjohn 75547a42b9 HBASE-15322 Operations using Unsafe path broken for platforms not having sun.misc.Unsafe. 2016-03-11 09:38:24 +05:30
tedyu e103f75ae7 HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang) 2016-03-09 10:05:06 -08:00
Mikhail Antonov 3339bac563 HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE 2016-03-08 02:59:20 -08:00
tedyu 4ec6ad12c9 HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 19:28:21 -08:00
Mikhail Antonov 43698b3fcb HBASE-15354 Use same criteria for clearing meta cache for all operations (Ashu Pachauri) 2016-03-07 17:34:11 -08:00
tedyu c1524485c5 HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi) 2016-03-07 04:57:55 -08:00
tedyu 42c3fcabc0 HBASE-15397 Create bulk load replication znode(hfile-refs) in ZK replication queue by default (Ashish Singhi) 2016-03-04 13:49:00 -08:00
chenheng 18194f8a56 HBASE-15128 Disable region splits and merges switch in master 2016-02-29 20:41:27 +08:00
Mikhail Antonov 998e339d6e HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
Josh Elser d747188f2c HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)

For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.

As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.

Signed-off-by: stack <stack@apache.org>
2016-02-23 10:28:33 -08:00