Commit Graph

1332 Commits

Author SHA1 Message Date
Phil Yang 8f9fadf021 HBASE-16664 Timeout logic in AsyncProcess is broken
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 17:14:52 +08:00
Jerry He 5ac2776d23 HBASE-16732 Avoid possible NPE in MetaTableLocator 2016-09-29 14:14:01 -07:00
anoopsamjohn a3485cc5ab HBASE-16705 Eliminate long to Long auto boxing in LongComparator. (binlijin)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/LongComparator.java
2016-09-26 15:41:45 -07:00
Enis Soztutar 8a797e81b8 HBASE-16604 Scanner retries on IOException can cause the scans to miss data 2016-09-22 18:48:06 -07:00
Jonathan M Hsieh ecc1c294f5 HBASE-12088 Addendum - fix spacing 2016-09-21 20:58:34 -07:00
Jonathan M Hsieh 13d6acbc7f HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:52:19 -07:00
Phil Yang 069d1f73fa HBASE-16388 Prevent client threads being blocked by only one slow region server
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:28:20 -07:00
tedyu 8e25ea536a HBASE-16613 Return the unused ByteBuffer to BoundedByteBufferPool when no cell is retrieved from the CellScanner (ChiaPing Tsai) 2016-09-13 09:49:13 -07:00
Umesh Agashe 059a169d3a HBASE-15297 Correct handling of namespace existence checks in shell.
Changes namespace_exists? method in SecurityAdmin ruby code to catch NamespaceNotFoundException
and modified Admin.java file to document the exception.

Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
2016-09-12 23:58:21 -07:00
Dustin Pho 7028a0d889 HBASE-16540 Adding checks in Scanner's setStartRow and setStopRow for invalid row key sizes.
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-09-12 17:38:15 -07:00
tedyu 354706a7d8 HBASE-16572 Sync method in RecoverableZooKeeper failed to pass callback function in (Allan Yang) 2016-09-07 11:36:18 -07:00
tedyu e1aab356b3 HBASE-16556 The read/write timeout are not used in HTable.delete(List), HTable.get(List), and HTable.existsAll(List) (ChiaPing Tsai) 2016-09-04 21:15:10 -07:00
tedyu a0e52a2dab HBASE-16541 Avoid unnecessary cell copy in Result#compareResults (ChiaPing Tsai) 2016-09-04 07:08:38 -07:00
tedyu 64135da824 HBASE-16515 AsyncProcess has incorrent count of tasks if the backoff policy is enabled - addendum fixes timeout of TestAsyncProcess#testSubmitRandomSizeRequest (Chiaping Tsai) 2016-08-31 02:05:45 -07:00
tedyu 1d365f580c HBASE-16515 AsyncProcess has incorrent count of tasks if the backoff policy is enabled (ChiaPing Tsai) 2016-08-30 19:40:50 -07:00
chenheng ce9b6c0abf HBASE-16224 Reduce the number of RPCs for the large PUTs (ChiaPing Tsai) 2016-08-30 13:30:23 +08:00
Josh Elser c64c0e85c0 HBASE-16376 Scan#setBatch(int) javadoc update WRT partial results
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-08-24 05:13:00 -07:00
Phil Yang 441bc050b9 HBASE-9465 Push entries to peer clusters serially
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:26:15 +08:00
stack 25c4ff5404 HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang) 2016-08-08 21:44:37 -07:00
Phil Yang 0354dbf1ec HBASE-12770 Don't transfer all the queued hlogs of a dead server to the same alive server
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-08 16:32:43 +08:00
Vivek ec99838b9c HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Table.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/client/HTableWrapper.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2016-08-06 10:38:41 -07:00
Sean Busbey a5f98c3f9e HBASE-16321 ensure no findbugs-jsr305
Signed-off-by: Esteban Gutierrez <esteban@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-rsgroup/pom.xml
	hbase-server/pom.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/ObserverContext.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-spark/pom.xml
	src/main/asciidoc/_chapters/developer.adoc
2016-08-05 14:08:50 -05:00
Ramkrishna 7a62076ae4 HBASE-16303 Addendum as the wrong patch was committed 2016-08-05 13:09:32 +05:30
Stevo Slavić 737e063240 HBASE-16355 Invalid hbase-common test-jar dependency scope
hbase-client has hbase-common test-jar as dependency in compile scope, while it should be test scope instead.
This patch fixes the bug.

closes #12

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-04 01:29:25 -05:00
Enis Soztutar 64136151b1 HBASE-16315 RegionSizeCalculator prints region names as binary without escapes 2016-08-02 16:35:31 -07:00
Yu Li 96d8dcb6f1 HBASE-16289 AsyncProcess stuck messages need to print region/server 2016-07-29 11:24:48 +08:00
Phil Yang f35b2c45d4 HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException
Signed-off-by: zhangduo <zhangduo@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannerTimeout.java
2016-07-25 22:37:59 +08:00
Stephen Yuan Jiang a8dd359d7e HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang) 2016-07-23 20:21:32 -07:00
Matteo Bertozzi 24a3d6952c HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun) 2016-07-22 15:29:19 -07:00
Mikhail Antonov ce651f5c6d HBASE-16024 Revert HBASE-15406 from branch-1.3 2016-07-22 14:50:32 -07:00
stack c3fba60842 HBASE-16236 Typo in javadoc of InstancePending (Hiroshi Ikeda) 2016-07-18 22:26:59 -07:00
stack f83c2345bb HBASE-16238 It's useless to catch SESSIONEXPIRED exception and retry in RecoverableZooKeeper (Allan Yang) 2016-07-18 14:36:39 -07:00
tedyu fd8460a4cf HBASE-16237 Blocks for hbase:meta table are not cached in L1 cache (Lars George and Ted Yu) 2016-07-18 10:12:52 -07:00
tedyu 630a1a41df HBASE-16172 Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas 2016-07-18 06:54:09 -07:00
Phil Yang 1e3bce943b HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely 2016-07-18 09:34:45 +08:00
Enis Soztutar 09c7b1e962 HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-07-13 18:23:05 -07:00
stack 9563ab4ca1 HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken scanning because of a side effect of a clean up in HBASE-15650 to make TimeRange construction consistent exposed a latent issue in TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
 Call through to next constructor (if minStamp was 0, we'd skip setting
 allTime=true). Add asserts that timestamps are not < 0 cos it messes
 us up if they are (we already were checking for < 0 on construction but
 assert passed in timestamps are not < 0).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 Add constructor override that takes a TimeRangeTracker (set when flushing
 but not when compacting)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
 Add override creating an HFile in tmp that takes a TimeRangeTracker

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
 Add override for HFile Writer that takes a TimeRangeTracker Take it on
 construction instead of having it passed by a setter later (flags and
 reference set by the setter were not volatile... could have been prob
 in concurrent case)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
 Log WARN if bad initial TimeRange value (and then 'fix' it)

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
 A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
 Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
 Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 14:23:23 -07:00
Yu Li 84dd9cbcb6 HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin) 2016-07-04 21:46:19 +08:00
zhangduo 721c5b7128 HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted 2016-07-04 19:52:28 +08:00
Jerry He 24fd547292 HBASE-16149 Log the underlying RPC exception in RpcRetryingCallerImpl 2016-07-01 22:49:51 -07:00
Jerry He 4d7e5992cf Revert "Log the underlying RPC exception in RpcRetryingCallerImpl": missing HBASE-16149 2016-07-01 22:47:51 -07:00
tedyu 7121bc41e7 HBASE-16159 OutOfMemory exception when using AsyncRpcClient with encryption to read rpc response (Colin Ma) 2016-07-01 14:33:06 -07:00
Jerry He e40fcee6b5 Log the underlying RPC exception in RpcRetryingCallerImpl 2016-07-01 14:21:08 -07:00
Ramkrishna f06945ae6c HBASE-15783 AccessControlConstants#OP_ATTRIBUTE_ACL_STRATEGY_CELL_FIRST
not used any more. (Ram)
2016-06-21 11:56:38 +05:30
tedyu 4377e16619 HBASE-16054 OutOfMemory exception when using AsyncRpcClient with encryption (Colin Ma) 2016-06-20 07:31:07 -07:00
Ashish Singhi a40ec70da9 HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node 2016-06-09 18:46:07 +05:30
Matteo Bertozzi 13d06a2cc8 HBASE-15975 logic in TestHTableDescriptor#testAddCoprocessorWithSpecStr is wrong (Huaxiang Sun) 2016-06-08 22:44:16 -07:00
Sergey Soldatov 7fed7a8f4e HBASE-15957 RpcClientImpl.close never ends in some circumstances
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-06-07 11:38:11 -07:00
stack 3ff082cb87 HBASE-15913 Sasl encryption doesn't work with AsyncRpcChannel 2016-06-07 09:22:09 -07:00
tedyu fad99a3f68 HBASE-15803 ZooKeeperWatcher's constructor can leak a ZooKeeper instance with throwing ZooKeeperConnectionException when canCreateBaseZNode is true 2016-06-07 09:14:01 -07:00
Andrew Purtell 76404238a8 HBASE-15698 Increment TimeRange not serialized to server (Ted Yu) 2016-06-06 22:17:37 -07:00
Sean Mackrory 878b1ea721 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
Ashish Singhi 950a09b03c HBASE-15888 Extend HBASE-12769 for bulk load data replication 2016-06-03 18:47:31 +05:30
Yu Li 36bb496e48 HBASE-15931 Add log for long-running tasks in AsyncProcess 2016-06-02 12:02:19 +08:00
Andrew Purtell 22aa501436 HBASE-15854 Log the cause of SASL connection failures (Robert Yokota) 2016-05-26 14:27:36 -07:00
Mikhail Antonov 51dfe44174 HBASE-15880 RpcClientImpl#tracedWriteRequest incorrectly closes HTrace span 2016-05-23 12:47:46 -07:00
tedyu 6738dbadac HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig) 2016-05-22 06:47:59 -07:00
Jerry He b7de663580 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:32:20 -07:00
Gary Helmling aacc816ac7 HBASE-15856 Addendum Fix UnknownHostException import in MetaTableLocator 2016-05-20 19:31:07 -07:00
Gary Helmling df40739ae7 HBASE-15856 Don't cache unresolved addresses for connections 2016-05-20 10:02:05 -07:00
Matteo Bertozzi e5eea96ca6 HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:51:17 -07:00
tedyu ce43e33876 HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 13:26:45 -07:00
stack c0fcce2bde HBASE-15593 Time limit of scanning should be offered by client (Phil Yang) 2016-05-17 12:51:03 -07:00
Elliott Clark 89146d85ac HBASE-15840 WAL.proto compilation broken for cpp 2016-05-17 12:04:31 -07:00
Sean Busbey e365191896 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:53:45 -05:00
Mikhail Antonov 0042d6d4c8 HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang) 2016-05-15 20:49:00 -07:00
stack 77f511fceb HBASE-15811 Batch Get after batch Put does not fetch all Cells We were not waiting on all executors in a batch to complete. The test for no-more-executors was damaged by the 0.99/0.98.4 fix "HBASE-11403 Fix race conditions around Object#notify"
It added this in AsyncProcess#waitForMaximumCurrentTasks:

synchronized (this.tasksInProgress) {
+          if (tasksInProgress.get() != oldInProgress) break;
           this.tasksInProgress.wait(100);

which added a break out of our waiting loop if any change in
count of tasks; it seems that what was wanted was instead to
avoid the wait if there was movement in the count of completed
task.

Reformats waitForMaximumCurrentTasks so it is testable. Adds
test that we indeed wait on the specified parameter.
2016-05-13 17:53:37 -07:00
Ramkrishna 94c4d568b5 HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
any such public facing class for 2.0 (Ram)
2016-05-09 14:57:39 +05:30
Ashish Singhi 0964884b92 HBASE-15669 HFile size is not considered correctly in a replication request 2016-05-06 17:28:06 +05:30
Ramkrishna b9df7978fc HBASE-15608 Remove PB references from SnapShot related Exceptions (Ram) 2016-05-06 17:07:44 +05:30
tedyu 09d451b1db HBASE-15292 Refined ZooKeeperWatcher to prevent ZooKeeper's callback while construction (Hiroshi Ikeda) 2016-05-05 16:07:39 -07:00
Gary Helmling b36222831d HBASE-15741 Provide backward compatibility for HBase coprocessor service names 2016-05-04 12:37:39 -07:00
Ramkrishna 902b673167 HBASE-15607 Remove PB references from Admin for 2.0 (Ram) 2016-05-03 10:52:59 +05:30
Mikhail Antonov 7e0e86072a HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them 2016-05-02 15:27:13 -07:00
Yu Li 44fdfb3ba0 HBASE-15711 Add client side property to allow logging details for batch errors 2016-04-29 10:16:01 +08:00
tedyu 4f2d8dc328 HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig) 2016-04-27 21:03:34 -07:00
Gary Helmling 4272178b1f HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable 2016-04-26 23:02:24 -07:00
Phil Yang d5acbdd1e4 HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:52:12 -07:00
stack 9f222d59e1 HBASE-15710 Include issue servers information in RetriesExhaustedWithDetailsException message (Yu Li) 2016-04-26 09:15:24 -07:00
chenheng 5d497d5ba8 HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HRegionLocator.java
2016-04-21 14:28:07 +08:00
chenheng 96e9c466d2 HBASE-15406 Split / merge switch left disabled after early termination of hbck
Conflicts:
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
        hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
        hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
        hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
        hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
        hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestSplitOrMergeStatus.java
        hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckOneRS.java
2016-04-15 15:34:43 +08:00
tedyu 85f2caf184 HBASE-15633 Backport HBASE-15507 to branch-1 (Geoffrey Jacoby) 2016-04-13 02:25:32 -07:00
Vasudevan e407e1e81d HBASE-15605 Remove PB references from HCD and HTD for 2.0 (Ram_ 2016-04-11 14:15:09 +05:30
Enis Soztutar 5202d3c25b HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/DistributedHBaseCluster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide3.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannersFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestClockSkewDetection.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestNamespaceCommands.java
2016-03-28 17:00:21 -07:00
Mikhail Antonov ca819e1ef6 HBASE-15524 Fix NPE in client-side metrics 2016-03-23 21:59:15 -07:00
Jesse Yates ee33bf0c7d HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerFactory.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerImpl.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/StatsTrackingRpcRetryingCaller.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ClientProtos.java
2016-03-24 11:27:54 +08:00
zhangduo 9fa44a8126 HBASE-15520 Fix broken TestAsyncIPC
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/AsyncRpcChannel.java
2016-03-24 10:57:42 +08:00
Elliott Clark 604415e827 HBASE-15475 Allow TimestampsFilter to provide a seek hint 2016-03-23 18:57:02 -07:00
tedyu 1c5002660b HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang) 2016-03-21 13:20:23 -07:00
tedyu 050c13e83f HBASE-15479 No more garbage or beware of autoboxing (Vladimir Rodionov) 2016-03-19 17:23:29 -07:00
Jerry He 8151503fa0 HBASE-14963 Remove use of Guava Stopwatch from HBase client code (Devaraj Das) 2016-03-19 13:23:05 -07:00
Mikhail Antonov a317a0f89c HBASE-15390 Unnecessary MetaCache evictions cause elevated number of requests to meta (ADDENDUM) 2016-03-17 01:09:10 -07:00
Elliott Clark aaaae83423 HBASE-15441 Fix WAL splitting when region has moved multiple times
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.

Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.

We need to:

It appears that the close event with a sequence id of one is coming from region warm up.

This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.

Test Plan: Unit tests pass

Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:35:18 -07:00
Mikhail Antonov 94d576025f HBASE-15390 Unnecessary MetaCache evictions cause elevated number of requests to meta 2016-03-16 16:32:11 -07:00
anoopsjohn 75547a42b9 HBASE-15322 Operations using Unsafe path broken for platforms not having sun.misc.Unsafe. 2016-03-11 09:38:24 +05:30
tedyu e103f75ae7 HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang) 2016-03-09 10:05:06 -08:00
Mikhail Antonov 3339bac563 HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE 2016-03-08 02:59:20 -08:00
tedyu 4ec6ad12c9 HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 19:28:21 -08:00
Mikhail Antonov 43698b3fcb HBASE-15354 Use same criteria for clearing meta cache for all operations (Ashu Pachauri) 2016-03-07 17:34:11 -08:00
tedyu c1524485c5 HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi) 2016-03-07 04:57:55 -08:00
tedyu 42c3fcabc0 HBASE-15397 Create bulk load replication znode(hfile-refs) in ZK replication queue by default (Ashish Singhi) 2016-03-04 13:49:00 -08:00
chenheng 18194f8a56 HBASE-15128 Disable region splits and merges switch in master 2016-02-29 20:41:27 +08:00
Mikhail Antonov 998e339d6e HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
Josh Elser d747188f2c HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)

For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.

As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.

Signed-off-by: stack <stack@apache.org>
2016-02-23 10:28:33 -08:00
anoopsjohn cc45b4ab38 HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy) 2016-02-23 09:59:35 +05:30
Jonathan M Hsieh 7b4646fe3d HBASE-15285 ADDENDUM make RETURN_RESULTS attribute name protected to match branch-1.1 and deprecated to warn of 2.0 (Sean Busbey) 2016-02-18 07:17:10 -08:00
stack 23917519e8 HBASE-15285 Forward-port respect for isReturnResult from HBASE-15095 2016-02-17 23:34:42 -06:00
Jonathan M Hsieh 2e1a3ef644 HBASE-15283 Revert to IOException in TimeRange constructor to maintain API compat in 1.x line
[branch-1 and branch-1.2 only] HBASE-14355 changed the type of exception thrown if an invalid TimeRange is specified.  This reverts to 1.1.x semantics.
2016-02-17 15:57:54 -08:00
anoopsjohn 7e5ce6b0a3 HBASE-15198 RPC client not using Codec and CellBlock for puts by default-addendum. 2016-02-12 07:35:42 +05:30
anoopsjohn 19f8faeb88 HBASE-15198 RPC client not using Codec and CellBlock for puts by default. 2016-02-11 16:37:20 +05:30
Josh Elser 01b73e9877 HBASE-15221 Reload the cache on re-tried puts in HTableMultiplexer and adds a close() method to HTableMultiplexer
When a Put fails due to a NotServingRegionException, the cached location
of that Region is never cleared. Thus, subsequent calls to resubmit
the Put will fail in the same way as the original, never determining
the new location of the Region.

If the Connection is not closed by the user before the Multiplexer
is discarded, it will leak resources and could cause resource
issues.

Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-02-08 00:07:08 -06:00
anoopsjohn 64c87f2476 HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across. 2016-02-06 02:41:29 +05:30
Andrew Purtell 1b420be56a Amend HBASE-15200 ZooKeeper znode ACL checks should only compare the shortname
Fixes for newly introduced FindBugs warnings
2016-02-04 17:33:29 -08:00
Enis Soztutar 73d6778820 HBASE-15177 Reduce garbage created under high load
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2016-02-04 13:26:22 -08:00
Andrew Purtell 360bb62469 HBASE-15200 ZooKeeper znode ACL checks should only compare the shortname 2016-02-03 10:43:29 -08:00
Enis Soztutar f1e7c06539 HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/SecureBulkLoadUtil.java
2016-02-02 17:06:20 -08:00
tedyu 486f7612be HBASE-15173 Execute mergeRegions RPC call as the request user 2016-01-28 10:02:49 -08:00
Elliott Clark 421fe24e9b HBASE-15146 Don't block on Reader threads queueing to a scheduler queue 2016-01-28 08:11:11 -05:00
ramkrishna bc0e5fc048 HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 - recommit
(Ram)
2016-01-25 08:04:22 +05:30
stack a5228a0b4d Revert "HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 (Ram)"
Causes TestHFileOutputFormat to fail every time. Messes up our 1.3 CI.

This reverts commit 58521869b0.
2016-01-22 10:45:51 -08:00
stack a9c008344f HBASE-15091 Forward-port to 1.2 HBASE-15031 "Fix merge of MVCC and SequenceID performance regression in branch-1.0" 2016-01-21 10:26:46 -08:00
stack d965d14a63 Revert "HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Apply)"
Needs newer Hadoop with n HADOOP-10786/HADOOP-11287 (courtesy of Matteo)

This reverts commit e76a2e4e6d.
2016-01-21 08:27:06 -08:00
ramkrishna 58521869b0 HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 (Ram) 2016-01-21 21:22:40 +05:30
Mikhail Antonov cea43788fe HBASE-15139 Connection manager doesn't pass client metrics to RpcClient 2016-01-20 14:20:26 -08:00
tedyu e76a2e4e6d HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Apply) 2016-01-19 13:08:24 -08:00
tedyu 7a096ac6cb HBASE-15073 Revert due to different opinion on usefulness 2016-01-18 17:35:18 -08:00
stack d9fd87d5a8 HBASE-15115 Fix findbugs complaints in hbase-client 2016-01-16 16:14:13 -08:00
tedyu 53983f5b2e HBASE-15073 Finer grained control over normalization actions for RegionNormalizer 2016-01-06 15:38:46 -08:00
tedyu 2797adf45f HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled 2016-01-04 07:19:13 -08:00
Ashish Singhi 64553236a9 HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-30 09:18:48 -06:00
tedyu afaa7f843a HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish) 2015-12-24 11:18:32 -08:00
anoopsjohn 4a7565af9c HBASE-14940 Make our unsafe based ops more safe. 2015-12-24 07:56:27 +05:30
stack fdeca854ec Revert "HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implemenations (Ashish Singhi)"
This reverts commit 59cca6297f.
2015-12-23 15:31:35 -08:00
stack 59cca6297f HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implemenations (Ashish Singhi) 2015-12-23 07:29:44 -08:00
anoopsjohn b7100c934b HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also - Addendum 2015-12-22 09:58:12 +05:30
Lars Hofhansl c27d2c9c3e HBASE-14822 Renewing leases of scanners doesn't work. 2015-12-19 10:15:26 -08:00
anoopsjohn 574774d8b1 HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also. 2015-12-19 14:58:52 +05:30
Enis Soztutar f3ebeeb3fc HBASE-14989 Implementation of Mutation.getWriteToWAL() is backwards 2015-12-17 11:48:14 -08:00
anoopsjohn a93c0e822e HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 23:33:39 +05:30
stack 2f7d5e6354 HBASE-14946 Don't allow multi's to over run the max result size. 2015-12-10 21:25:46 -08:00
Enis Soztutar aeb6ae97d3 HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRpcControllerFactory.java
2015-12-10 19:13:14 -08:00
Elliott Clark 8508dd07ff HBASE-14946 Don't allow multi's to over run the max result size.
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens

Test Plan: Added a unit test

Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:31:05 -08:00
ramkrishna 65117d3d04 HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:10:41 +05:30
Gary Helmling 5dec5ad250 HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 16:47:25 -08:00
tedyu 66adeb3048 HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:10:27 -08:00
tedyu 447a0e7b7e HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar) 2015-11-23 20:26:18 -08:00
chenheng 40e01512cf HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov) 2015-11-19 11:41:05 +08:00
tedyu a6e0ad636a HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo) 2015-11-18 14:26:31 -08:00
Elliott Clark e40ed0e836 HBASE-14812 Fix ResultBoundedCompletionService deadlock 2015-11-17 13:48:50 -08:00
Elliott Clark 4d5ac316b6 HBASE-14708 Use copy on write Map for region location cache
Summary:
Create and use a copy on write map for region location.

  - Create a copy on write map backed by a sorted array.
  - Create a test for both comparing each with a jdk provided map.
  - Change MetaCache to use the new map.

Test Plan:
  - org.apache.hadoop.hbase.client.TestFromClientSide
  - TestHCM

Differential Revision: https://reviews.facebook.net/D49545
2015-11-17 11:01:52 -08:00
stack 336eb92016 HBASE-14355 Scan different TimeRange for each column family 2015-11-13 22:44:05 -08:00
tedyu 3e551ea538 HBASE-14498 Revert for on-going review 2015-11-12 12:55:44 -08:00
tedyu c36b9489aa HBASE-14498 Master stuck in infinite loop when all Zookeeper servers are unreachable (Pankaj Kumar) 2015-11-12 07:22:42 -08:00
chenheng 7330e11aa4 HBASE-14693 Add client-side metrics for received pushback signals
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestClientPushback.java
2015-11-09 15:32:28 -08:00
tedyu f3af7b642c HBASE-14758 Add UT case for unchecked error/exception thrown in AsyncProcess#sendMultiAction (Yu Li) 2015-11-04 07:29:01 -08:00
chenheng fa2d0859f7 HBASE-12986 Compaction pressure based client pushback
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ClientProtos.java
2015-11-03 18:40:59 -08:00
stack 759252027d HBASE-14754 TestFastFailWithoutTestUtil failing on trunk now in #testPreemptiveFastFailException50Times 2015-11-03 16:21:23 -08:00
Jesse Yates ed3b6bda4b HBASE-14715 Add javadocs to DelegatingRetryingCallable 2015-11-03 13:45:05 -08:00
stack 51f5412a92 Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets"
Reverting. It seems to have destabilized the build.

This reverts commit aaaa813225.
2015-11-02 08:16:59 -08:00
stack aaaa813225 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-01 22:55:59 -08:00
Elliott Clark 3bdfa782f3 HBASE-14687 Un-synchronize BufferedMutator
Summary:
Use concurrent collections and atomic longs to keep track of edits in buffered mutator.
This keeps buffered mutator as thread safe but it means that shared buffered mutators are not contending on thread locking.

Test Plan: Unit Tests.

Differential Revision: https://reviews.facebook.net/D49467
2015-10-30 13:39:38 -07:00
Matteo Bertozzi 569fe82acf HBASE-14714 some cleanup to snapshot code 2015-10-29 14:04:48 -07:00
tedyu 3c8e92019c HBASE-12769 Replication fails to delete all corresponding zk nodes when peer is removed (Jianwei Cui) 2015-10-28 15:43:26 -07:00
Enis Soztutar c174a54d87 HBASE-14425 In Secure Zookeeper cluster superuser will not have sufficient permission if multiple values are configured in hbase.superuser (Pankaj Kumar)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZooKeeperWatcher.java
2015-10-27 17:00:46 -07:00
tedyu 8fc9c2803f HBASE-14696 Support setting allowPartialResults in mapreduce Mappers 2015-10-27 11:13:58 -07:00
tedyu 842593c439 HBASE-14694 Scan copy constructor doesn't handle allowPartialResults 2015-10-27 07:55:16 -07:00
Elliott Clark a268d151e2 HBASE-14683 Fix Batching in buffered mutator is awful when adding lists of mutations.
Summary: Send the list of mutations to AsyncProcess only after done adding the list otherwise there's a lot of contention

Test Plan: UnitTests.

Differential Revision: https://reviews.facebook.net/D49251
2015-10-24 10:03:03 -07:00
Enis Soztutar 6dc33cad75 HBASE-14474 Addendum closes connection in writeRequest() outside synchronized block 2015-10-16 12:00:03 -07:00
tedyu be04ede5b9 HBASE-14594 Use new DNS API introduced in HADOOP-12437 (Josh Elser) 2015-10-14 14:24:24 -07:00
stack 11066d0459 HBASE-14598 ByteBufferOutputStream grows its HeapByteBuffer beyond JVM limitations (Ian Friedman) 2015-10-14 13:13:35 -07:00
stack cab158173d Revert "HBASE-14583 Enabled client-side metrics by default"
Caused TestShell to hang. Reverting for now.

This reverts commit dced02ad9f.
2015-10-10 13:19:52 -07:00
anoopsjohn 90f0644d9a HBASE-14366 NPE in case visibility expression is not present in labels table during importtsv run. (Bhupendra) 2015-10-10 12:08:23 +05:30
stack cd298eae4f HBASE-14517 Show regionserver's version in master status page (Liu Shaohui) 2015-10-09 15:11:14 -07:00
Nick Dimiduk dced02ad9f HBASE-14583 Enabled client-side metrics by default 2015-10-09 10:30:50 -07:00
Nick Dimiduk a048c32a99 HBASE-12911 Client-side metrics 2015-10-07 17:05:51 -07:00
Elliott Clark ef8cc7a575 HBASE-14544 Allow HConnectionImpl to not refresh the dns on errors 2015-10-05 09:44:52 -07:00
Mikhail Antonov b9bfd6f7e3 HBASE-14367 Add normalization support to shell 2015-10-04 01:24:15 -07:00
smaddineni 373c75dde6 HBASE-13770 Programmatic JAAS configuration option for secure zookeeper may be broken
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/HQuorumPeer.java
2015-10-02 18:00:47 -07:00
Matteo Bertozzi afb3b19a15 HBASE-14485 ConnectionImplementation leaks on construction failure 2015-10-01 12:50:26 -07:00
stack 16ad5e61c8 HBASE-14510 Fix coprocessor handling of duplicate classes (Yerui Sun) 2015-09-29 15:35:44 -07:00
Enis Soztutar bc1a03d9b4 HBASE-14474 DeadLock in RpcClientImpl.Connection.close() 2015-09-25 11:05:26 -07:00
Andrew Purtell 12e2341f3d HBASE-13324 o.a.h.h.Coprocessor should be LimitedPrivate("Coprocessor") 2015-09-24 10:57:39 -07:00
Stephen Yuan Jiang e38fd84d3f HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-24 07:17:23 -07:00
tedyu 992856c11d HBASE-14397 Revert pending review comments 2015-09-22 10:00:11 -07:00
tedyu ca6c7f0a68 HBASE-14431 Addendum checks for null connectionInPool (Yu Li) 2015-09-21 07:23:47 -07:00
tedyu 88adccd553 HBASE-14431 AsyncRpcClient#removeConnection() never removes connection from connections pool if server fails (Samir Ahmic) 2015-09-19 07:33:26 -07:00
tedyu 00f467b225 HBASE-14449 Rewrite deadlock prevention for concurrent connection close 2015-09-18 14:47:58 -07:00
stack 82554e2750 HBASE-14433 Set down the client executor core thread count from 256 in tests: REAPPLY AGAIN (WAS MISSING JIRA) 2015-09-16 10:15:00 -07:00
stack b6549007b3 Revert "Set down the client executor core thread count from 256 in tests: REAPPLY"
Missing JIRA. Will reapply in a sec with commit log fixed.

This reverts commit c100fb835a.
2015-09-16 10:14:32 -07:00
stack c100fb835a Set down the client executor core thread count from 256 in tests: REAPPLY 2015-09-16 08:57:39 -07:00
Apekshit(Appy) Sharma 1517deee67 HBASE-14400 Fix HBase RPC protection documentation
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/SaslUtil.java
2015-09-15 18:30:24 -07:00
stack 8354ed69ec HBASE-14421 TestFastFail* are flakey; ADDENDUM 2 DISABLE testInterceptorIntercept50Times 2015-09-13 10:33:26 -07:00
stack 37badc04ae HBASE-14421 TestFastFail* are flakey 2015-09-12 22:36:10 -07:00
tedyu 6c90507314 HBASE-14397 PrefixFilter doesn't filter all remaining rows if the prefix is longer than rowkey being compared (Jianwei Cui) 2015-09-11 16:07:49 -07:00
Srikanth Srungarapu e2250e71f8 HBASE-14385 Close the sockets that is missing in connection closure. 2015-09-09 23:39:05 -07:00
Nick Dimiduk 364b977269 HBASE-14382 TestInterfaceAudienceAnnotations should hadoop-compt module resources 2015-09-09 11:11:08 -07:00
stack 30752d5815 HBASE-14308 HTableDescriptor WARN is not actionable (Lars Francke) 2015-09-04 22:44:53 -07:00
Andrew Purtell 513b37603d HBASE-14359 HTable#close will hang forever if unchecked error/exception thrown in AsyncProcess#sendMultiAction (Victor Xu) 2015-09-03 17:49:06 -07:00
Stephen Yuan Jiang 90b8a3c894 HBASE-14108 Procedure V2 - Administrative Task: provide an API to abort a procedure (Stephen Yuan Jiang) 2015-09-03 07:01:30 -07:00
tedyu d3a7222bfc HBASE-14309 Allow load balancer to operate when there is region in transition by adding force flag 2015-08-29 17:08:40 -07:00
Elliott Clark ab47cb9569 HBASE-14313 After a Connection sees ConnectionClosingException it never recovers -- ADDENDUM 2015-08-27 15:24:15 -07:00
Elliott Clark 886542bd1b HBASE-14313 After a Connection sees ConnectionClosingException on a connection it never recovers 2015-08-27 15:24:10 -07:00
tedyu b8c7a08a9e HBASE-14269 FuzzyRowFilter omits certain rows when multiple fuzzy keys exist (hongbin ma) 2015-08-26 20:49:43 -07:00
stack c127577862 HBASE-14290 Spin up less threads in tests
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
2015-08-25 16:32:06 -07:00
stack 64f9d43d01 HBASE-13480 ShortCircuitConnection doesn't short-circuit all calls as expected (Jingcheng Du) 2015-08-25 08:01:00 -07:00
stack 5dcb3d85a1 HBASE-14224 Fix coprocessor handling of duplicate classes 2015-08-24 14:12:57 -07:00
tedyu 558aec84e8 HBASE-14241 Fix deadlock during cluster shutdown due to concurrent connection close 2015-08-19 08:56:44 -07:00
Enis Soztutar c9b3d837a0 HBASE-14203 remove duplicate code getTableDescriptor in HTable (Heng Chen)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
2015-08-17 16:12:18 -07:00
Enis Soztutar c619e0c76f HBASE-14122 Client API for determining if server side supports cell level security - ADDENDUM for javadoc fix 2015-08-17 14:34:25 -07:00
Andrew Purtell ba4cc6321b HBASE-14122 Client API for determining if server side supports cell level security 2015-08-12 13:27:51 -07:00
tedyu 90b8cc89bd HBASE-14206 MultiRowRangeFilter returns records whose rowKeys are out of allowed ranges (Anton Nazaruk) 2015-08-11 10:01:55 -07:00
Andrew Purtell 68cb53d151 HBASE-12865 WALs may be deleted before they are replicated to peers (He Liangliang) 2015-08-07 15:08:29 -07:00
Andrew Purtell b194052ec0 HBASE-13825 Use ProtobufUtil#mergeFrom and ProtobufUtil#mergeDelimitedFrom in place of builder methods of same name
Incorporates HBASE-14076
2015-08-06 21:48:04 -07:00
Sean Busbey a45651c2cf HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)

Conflicts:
	NOTICE.txt
	hbase-checkstyle/pom.xml
	hbase-resource-bundle/pom.xml
	hbase-server/pom.xml
	hbase-thrift/pom.xml
	pom.xml
2015-08-05 14:52:33 -07:00
Ashish Singhi f274796941 HBASE-14154 DFS Replication should be configurable at column family level
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileWriterImpl.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin1.java
2015-07-31 18:19:07 -07:00
Sean Busbey 9091409800 HBASE-14087 Ensure correct ASF headers for docs/code
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint

Conflicts:
	bin/considerAsDead.sh
	dev-support/rebase_all_git_branches.sh
2015-07-31 11:22:50 -07:00
Srikanth Srungarapu d1ff4cb2c1 HBASE-14097 Log link to client scan troubleshooting section when scanner exceptions happen. 2015-07-28 15:15:45 -07:00
Srikanth Srungarapu da811332cf HBASE-14057 HBase shell user_permission should list super users defined on hbase-site.xml 2015-07-28 11:43:24 -07:00
tedyu 48b968e323 HBASE-13881 Bug in HTable#incrementColumnValue implementation (Gabor Liptak) 2015-07-21 02:37:02 -07:00
Andrew Purtell c42fc1dd56 HBASE-14089 Remove unnecessary draw of system entropy from RecoverableZooKeeper 2015-07-15 18:41:45 -07:00
Ashish Singhi 789d2a94b7 HBASE-8642 [Snapshot] List and delete snapshot by table
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-15 15:56:08 -07:00
terence.yoo 173f343aea HBASE-14041 Do not clear MetaCache if a ThrottlingException is thrown
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
2015-07-15 03:27:05 -05:00
Enis Soztutar 426bd09777 HBASE-13997 ScannerCallableWithReplicas cause Infinitely blocking (Zephyr Guo and Enis)
Conflicts:
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestClientScanner.java
2015-07-13 12:24:54 -07:00
Matteo Bertozzi b62f134545 HBASE-13415 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-13 11:19:02 -05:00
Sean Busbey 88ff206c57 Revert "Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)"
This reverts commit 4eb84651a2.
2015-07-13 11:16:21 -05:00
stack a81b3c5afe HBASE-14052 Mark a few methods in CellUtil audience private since only make sense internally to hbase 2015-07-10 10:44:08 -07:00
Matteo Bertozzi 4eb84651a2 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang) 2015-07-09 08:13:32 -07:00
stack 24cf287df4 HBASE-13337 Table regions are not assigning back, after restarting all regionservers at once (Samir Ahmic) 2015-07-08 17:20:23 -07:00
Andrey Stepachev 8d71d283b9 HBASE-13646 HRegion#execService should not try to build incomplete messages
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-06 10:36:13 -05:00
Ashish Singhi ab9a0b80af HBASE-13925 Use zookeeper multi to clear znodes in ZKProcedureUtil
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
2015-07-03 12:29:55 -07:00
stack 09846ff81a HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- ADDENDUM 2015-07-02 10:05:58 -07:00
stack 0f17b76796 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) 2015-07-01 17:30:16 -07:00
stack 93b0b41603 HBASE-13983 Doc how the oddball HTable methods getStartKey, getEndKey, etc. will be removed in 2.0.0 2015-07-01 13:05:25 -07:00
Matteo Bertozzi 7ece46a607 HBASE-13995 ServerName is not fully case insensitive 2015-07-01 09:40:11 -07:00
Sean Busbey a58848507a HBASE-13990 make maven site generation work with jdk8
* includes additiona branch-1 specific fixes to javadocs
* includes rollback of 2 changes from HBASE-13898 that didn't apply to branch-1

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
2015-07-01 08:00:15 -05:00
Gábor Lipták 8e6fb569c5 HBASE-13963 Do not leak jdk.tools dependency from hbase-annotations
Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-common/pom.xml
2015-06-26 08:56:14 -05:00
Nick Dimiduk 5a24d16f4c HBASE-13938 Deletes done during the region merge transaction may get eclipsed (ddas, enis, ndimiduk) 2015-06-23 11:08:48 -07:00
Mikhail Antonov 7d778e892c HBASE-13906 Improve handling of NeedUnmanagedConnectionException 2015-06-22 23:36:04 -07:00
Misty Stanley-Jones 9ac6539f6a HBASE-13898 correct additional javadoc failures under java 8 <Gabor Liptak>
Ammending-Author: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellComparator.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufMagic.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/RegionObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/http/jmx/JMXJsonServlet.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlockIndex.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/BloomFilterChunk.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
2015-06-23 01:14:15 -05:00
Mikhail Antonov 84675ef615 HBASE-13103 [ergonomics] add region size balancing as a feature of master 2015-06-22 22:48:19 -07:00
Sean Busbey f2f19ddb5c HBASE-13909 update branch-1 poms to 1.3.0-SNAPSHOT 2015-06-15 22:30:56 -05:00
Ashish Singhi e949f0c6b0 HBASE-13901 Error while calling watcher on creating and deleting an HBase table
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-15 11:28:16 -07:00
Gábor Lipták 0a0ff3354a HBASE-13569 Correct Javadoc (for Java8)
Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Result.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/FilterBase.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValue.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/constraint/ConstraintException.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/RegionObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderV2.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileScanner.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MiniBatchOperationInProgress.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/BloomFilterWriter.java
2015-06-13 22:23:53 -05:00
tedyu 4468f3ce95 HBASE-13829 Add more ThrottleType (Guanghao Zhang) 2015-06-13 06:30:26 -07:00
Josh Elser e78572a985 HBASE-13892 NPE in ClientScanner on null results array
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-11 19:27:06 -07:00
tedyu 254de0c451 HBASE-13875 Clock skew between master and region server may render restored region without server address 2015-06-09 18:26:56 -07:00
ramkrishna d34e9c5c5c HBASE-13686 - Fail to limit rate in RateLimiter (Ashish Singhi) 2015-06-07 22:25:32 +05:30
Enis Soztutar deca3930b9 HBASE-13851 RpcClientImpl.close() can hang with cancelled replica RPCs 2015-06-06 14:02:00 -07:00
Changgeng Li 93148719ba HBASE-13638 Put copy constructor is shallow
Deep copy the cell list

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-06-01 13:57:19 -07:00
Matteo Bertozzi adbc3dd097 HBASE-13779 Calling table.exists() before table.get() end up with an empty Result (addendum) 2015-05-29 17:42:11 -07:00
stack 32f4a6ad8f HBASE-13799 javadoc how Scan gets polluted when used; if you set attributes or ask for scan metrics 2015-05-29 11:32:17 -07:00
Matteo Bertozzi 5b67c7a0da HBASE-13779 Calling table.exists() before table.get() end up with an empty Result 2015-05-29 16:44:39 +01:00
Geoffrey ffcd4d424f HBASE 13796 - Fixed ZKUtil's cleaning of the zookeeper quorum setting
Signed-off-by: stack <stack@apache.org>
2015-05-28 20:07:46 -07:00
stack 94f0ee7ee3 HBASE-13616 Move ServerShutdownHandler to Pv2 2015-05-28 15:04:27 -07:00
Nick Dimiduk 2f9851af26 HBASE-13761 Optimize FuzzyRowFilter (Vladimir Rodionov) 2015-05-28 10:17:46 -07:00
Andrew Purtell a035baab46 HBASE-13768 ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration (Enis Soztutar) 2015-05-27 12:32:45 -07:00
Matteo Bertozzi cb7675c57f HBASE-13767 Allow ZKAclReset to set and not just clear ZK ACLs 2015-05-27 18:34:17 +01:00
stack a9e2f4cf31 HBASE-5980 Scanner responses from RS should include metrics on rows/KVs filtered; ADDENDUM -- ADD MISSING FILES 2015-05-21 11:11:06 -07:00
stack 078a9a97c3 HBASE-5980 Scanner responses from RS should include metrics on rows/KVs filtered 2015-05-21 11:09:14 -07:00
Enis Soztutar 420baa42ce HBASE-13709 Updates to meta table server columns may be eclipsed
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/handler/OpenMetaHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/handler/OpenRegionHandler.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestMetaTableAccessor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
2015-05-20 19:19:52 -07:00
Nick Dimiduk 49fc6c817d HBASE-13711 Provide an API to set min and max versions in HColumnDescriptor (Stephen Yuan Jiang) 2015-05-20 11:41:23 -07:00
tedyu 181ec60510 HBASE-13704 Hbase throws OutOfOrderScannerNextException when MultiRowRangeFilter is used (Aleksandr Maksymenko) 2015-05-19 20:21:08 -07:00
ted malaska 00636cc998 HBASE-13677 changed RecoverableZooKeeper logs about retries from info and warn to debug
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-05-18 10:31:40 -05:00
Enis Soztutar 77b155858f HBASE-13661 Correct binary compatibility issues discovered in 1.1.0RC0 2015-05-11 18:33:44 -07:00
Sean Busbey 6213fa2fce HBASE-13611 update clover profile to work with clover 4.x and maven 3.
* change pom to use a maven 3 compat version of clover
* add clover to javadoc plugin deps so that instrumented doclet works
* modify IA annotation test to filter out clover instrumentation
* make splitlog counters check for atomiclong before casting
2015-05-11 01:23:35 -05:00
tedyu ec3d7189ad HBASE-13625 Use HDFS for HFileOutputFormat2 partitioner's path (Stephen Yuan Jiang) 2015-05-06 07:29:57 -07:00
Lars Hofhansl 0e76cf5be4 HBASE-13333 Renew Scanner Lease without advancing the RegionScanner. 2015-05-02 17:52:27 -07:00
Andrew Purtell 60b356a853 HBASE-13312 SmallScannerCallable does not increment scan metrics 2015-05-01 16:33:11 -07:00
Elliott Clark d16c8ab71b HBASE-13325 Protocol Buffers 2.5 no longer available for download on code.google.com 2015-05-01 13:31:40 -07:00
Matt Warhaftig 5a87c3910e HBASE-13358 - Update VisibilityClient to accept Connection objects.
Signed-off-by: Srikanth Srungarapu <ssrungarapu@cloudera.com>
2015-04-30 21:21:41 -07:00
tedyu 20b6c31880 HBASE-13594 MultiRowRangeFilter shouldn't call HBaseZeroCopyByteString.wrap() directly 2015-04-29 10:35:45 -07:00
Nick Dimiduk cc5a0f361a HBASE-13417 batchCoprocessorService() does not handle NULL keys (Abhishek Singh Chouhan) 2015-04-28 16:39:56 -07:00
Usha Kuchibhotla 0dbbc8b8de HBASE-11677 Making Logger instance modifiers consistent.
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final

Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientIdGenerator.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerImpl.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestIngestWithEncryption.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/TestStatusResource.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestTableDescriptor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestRowCounter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildHole.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildOverlap.java
2015-04-28 10:10:21 -05:00
Nick Dimiduk c678a28fca HBASE-13518 Typo in hbase.hconnection.meta.lookup.threads.core parameter (Devaraj Das) 2015-04-27 23:06:51 -07:00
Nick Dimiduk 566dfda5b7 HBASE-13466 Document deprecations in 1.x - Part 1 (Lars Francke) 2015-04-26 13:11:35 -07:00
Sean Busbey 1a0c61c974 HBASE-13546 handle nulls in MasterAddressTracker when there is no master active. 2015-04-24 13:54:36 -05:00
Jonathan Lawlor c8d8499da8 HBASE-13527 The default value for hbase.client.scanner.max.result.size is never actually set on Scans
Signed-off-by: stack <stack@apache.org>
2015-04-22 13:29:48 -07:00
ramkrishna 385b5fa1f6 HBASE-13502 - Deprecate/remove getRowComparator() in TableName (Ram) 2015-04-22 09:34:10 +05:30
zhangduo ca7efc183a HBASE-13499 AsyncRpcClient test cases failure in powerpc 2015-04-14 23:00:17 +08:00
Enis Soztutar 60c30c707c HBASE-13491 Issue in FuzzyRowFilter#getNextForFuzzyRule (Anoop Sam John) 2015-04-17 21:56:04 -07:00
Jonathan Lawlor a4f77d49a5 HBASE-13090 Progress heartbeats for long running scanners
Signed-off-by: stack <stack@apache.org>
2015-04-17 15:43:13 -07:00
Nick Dimiduk cf45c8d30a Bump pom version to 1.2.0-SNAPSHOT 2015-04-16 17:30:48 -07:00
Devaraj Das fe8658ce35 HBASE-13460. Revise the MetaLookupPool executor-related defaults (introduced in HBASE-13036). 2015-04-15 07:56:58 -07:00
Matteo Bertozzi 7c5ae63850 HBASE-13290 Procedure v2 - client enable/disable table sync (Stephen Yuan Jiang) 2015-04-15 11:05:49 +01:00
Matteo Bertozzi 67149d253b HBASE-13204 Procedure v2 - client create/delete table sync 2015-04-15 11:02:26 +01:00
Matteo Bertozzi 58b1598b44 HBASE-13203 Procedure v2 - master create/delete table 2015-04-15 11:01:36 +01:00
Matteo Bertozzi 4fc39fd7c9 HBASE-13457 SnapshotExistsException doesn't honor the DoNotRetry 2015-04-13 23:22:28 +01:00
Mikhail Antonov c73f1a5183 HBASE-13270 Setter for Result#getStats is #addResults; confusing!
Signed-off-by: stack <stack@apache.org>
2015-04-09 10:44:58 -07:00
Jonathan Lawlor 408b916175 HBASE-13421 Reduce the number of object creations introduced by HBASE-11544 in scan RPC hot code paths
Signed-off-by: stack <stack@apache.org>
2015-04-08 14:03:38 -07:00
tedyu c031d8de23 HBASE-13205 [branch-1] Backport HBASE-11598 Add simple rpc throttling (Ashish Singhi) 2015-04-07 18:29:03 -07:00
Ashish Singhi 15cdd898e3 HBASE-13299 Add setReturnResults() to Increment, like Append has
Signed-off-by: stack <stack@apache.org>
2015-04-07 11:47:48 -07:00
Andrew Purtell 2982768153 Amend HBASE-13409 Add categories to uncategorized tests; fix compliation error 2015-04-06 12:03:42 -07:00
Andrew Purtell 935352c4d8 HBASE-13409 Add categories to uncategorized tests 2015-04-06 11:08:10 -07:00
Jonathan Lawlor 30f6d54cc8 HBASE-13374 Small scanners (with particular configurations) do not return all rows
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-04-05 14:29:43 -07:00
stack 7e1e5a60fb HBASE-13216 Add version info in RPC connection header (Liu Shaohui) 2015-04-02 15:50:49 -07:00
Josh Elser 79d80b187e HBASE-13335 Use serverHasMoreResults context in SmallScanner and SmallReversedScanner.
Use the context passed back via ScanResponse that a RegionServer
fills in to denote whether or not more results existing in the
current Region. Add a simple factory to remove a static method
used across both SmallScanner and SmallReverseScanner. Add new
unit tests for both scanner classes to test scans with and
without the new context (as a quick backward-compatibility test).
2015-03-31 21:35:34 -07:00
Josh Elser b0116398ff HBASE-13262 Observe ScanResponse.moreResults in ClientScanner.
The RS already returns to the client whether or not it has additional
results to be returned in a subsequent call to scan(), but the ClientScanner
did not use or adhere to this value. Subsequently, this can lead to
bugs around moving to the next region too early. A new method was added
to ClientScanner in the name of testability.

Encapsulate server-state into RegionServerCallable to avoid
modifying parameterization of callable impls.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-28 18:56:50 -07:00
Josh Elser b9a615e739 HBASE-13222 Add isBalancerEnabled method to Master and Admin.
Include some basic tests for the method on a testing cluster.
Also update master page to show an alert when balancer is disabled.

Signed-off-by: Enis Soztutar <enis@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/RequestConverter.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
2015-03-27 14:47:24 -07:00
Sameet Agarwal 2fd6f2a829 HBASE-13316 Reduce the downtime on planned moves of regions
Summary:
The current behavior of a region move shuts down a region and then starts is up in another regionserver. This causes increased latency and possibly timeouts till the new region's cache is fully warmed up. We can make a region move less disruptive by warming the cache in the destination region server before shutting dow the old region.

See https://issues.apache.org/jira/browse/HBASE-13316

Test Plan:
1. Unit Tests
2. Added test for concurrent moves and warmups
3. Manually tested reads/writes happening with concurrent moves

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D35967

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-27 11:56:21 -07:00
stack 46e782927d HBASE-13298 Clarify if Table.{set|get}WriteBufferSize() is deprecated or not 2015-03-25 13:10:29 -07:00