Commit Graph

1731 Commits

Author SHA1 Message Date
Stephen Yuan Jiang bdd7782f05 HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang) 2016-07-23 14:47:11 -07:00
Stephen Yuan Jiang cd0b85e0a8 Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue) 2016-07-22 20:09:03 -07:00
Gary Helmling 65834a1ced HBASE-16217 Pass through the calling user in ObserverContext 2016-07-21 16:45:09 -07:00
Jerry He 70f330dc84 Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load 2016-07-19 19:53:10 -07:00
Stephen Yuan Jiang 638ca24f01 HBASE-14552 (addendum) Procedure V2: Reimplement DispatchMergingRegionHandler (add nonce support) (Stephen Yuan Jiang) 2016-07-19 08:49:23 -07:00
stack 1a62eaa89c HBASE-16236 Typo in javadoc of InstancePending (Hiroshi Ikeda) 2016-07-18 22:26:27 -07:00
stack c9925bcec1 HBASE-16238 It's useless to catch SESSIONEXPIRED exception and retry in RecoverableZooKeeper (Allan Yang) 2016-07-18 14:36:11 -07:00
Phil Yang a1cc2c4bfe HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely
(cherry picked from commit a8dfd8c436)
2016-07-18 06:48:17 -05:00
Sean Busbey a0aa017ae9 Revert "Replication queue's lock will live forever if RS acquiring the lock has died prematurely"
This reverts commit a8dfd8c436.
2016-07-18 06:47:56 -05:00
tedyu eb43f0a5d0 HBASE-16172 Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas 2016-07-18 03:35:10 -07:00
Phil Yang a8dfd8c436 Replication queue's lock will live forever if RS acquiring the lock has died prematurely 2016-07-18 09:32:36 +08:00
Stephen Yuan Jiang f04eeecffc HBASE-14552 Procedure V2: Reimplement DispatchMergingRegionHandler (Stephen Yuan Jiang) 2016-07-15 07:06:53 -07:00
Enis Soztutar a07892558b HBASE-16095 Add priority to TableDescriptor and priority region open thread pool 2016-07-13 18:19:59 -07:00
Joseph Hwang f292048ffd HBASE-16208 Check that the row exists before attempting to remove a queue from TableBasedReplicationQueuesImpl
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-12 14:50:07 -07:00
stack 496fd9837a HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove
TimeRangeTracker as point of contention when many threads reading a StoreFile
 Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken
 scanning because of a side effect of a clean up in  HBASE-15650 to make
 TimeRange construction consistent exposed a latent issue in
 TimeRange#compare. See HBASE-16074 for more detail.

Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
 Call through to next constructor (if minStamp was 0, we'd skip setting
 allTime=true). Add asserts that timestamps are not < 0 cos it messes
 us up if they are (we already were checking for < 0 on construction but
 assert passed in timestamps are not < 0).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 Add constructor override that takes a TimeRangeTracker (set when flushing
 but not when compacting)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
 Add override creating an HFile in tmp that takes a TimeRangeTracker

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
 Add override for HFile Writer that takes a TimeRangeTracker Take it on
 construction instead of having it passed by a setter later (flags and
 reference set by the setter were not volatile... could have been prob
 in concurrent case)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
 Log WARN if bad initial TimeRange value (and then 'fix' it)

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
 A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
 Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
 Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 18:20:31 -07:00
tedyu 20a99b4c06 HBASE-16144 Revert - test failure in TestMultiSlaveReplication#testMultiSlaveReplication seems to be related 2016-07-05 13:19:33 -07:00
tedyu b5cdb38dc7 HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely (Phil Yang) 2016-07-05 07:16:12 -07:00
Yu Li 7f44dfd85f HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin) 2016-07-04 21:45:04 +08:00
zhangduo 6944a17ad4 HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted 2016-07-04 19:26:27 +08:00
tedyu af9422c04a HBASE-16159 OutOfMemory exception when using AsyncRpcClient with encryption to read rpc response (Colin Ma) 2016-07-01 14:26:09 -07:00
stack 2d93444cb0 HBASE-16149 Log the underlying RPC exception in RpcRetryingCallerImpl (Jerry He) 2016-06-30 05:57:50 -07:00
Jonathan M Hsieh e1d130946b HBASE-16117 Fix Connection leak in mapred.TableOutputFormat 2016-06-29 17:18:43 -07:00
chenheng 68c1b34dbc HBASE-16040 Remove configuration "hbase.replication" 2016-06-24 10:41:35 +08:00
Joseph Hwang 2766e4a42e HBASE-16083 Fix RepliationFactory config property names to match HBase naming conventions
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-22 12:49:45 -07:00
Joseph Hwang 152594560e HBASE-16036 Made Replication Table creation non-blocking.
All ReplicationTableBase method's that need to access the Replication Table will block until it is created though.
Also refactored ReplicationSourceManager so that abandoned queue adoption is run in the background too so that it does not block HRegionServer initialization.

Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-21 13:05:50 -07:00
Ramkrishna a9950e0001 HBASE-15783 AccessControlConstants#OP_ATTRIBUTE_ACL_STRATEGY_CELL_FIRST
not used any more. (Ram)
2016-06-21 10:51:42 +05:30
tedyu 76419df21d HBASE-16054 OutOfMemory exception when using AsyncRpcClient with encryption (Colin Ma) 2016-06-20 07:29:40 -07:00
Enis Soztutar bdb0cc8808 HBASE-15467 Remove 1.x/2.0 TableDescriptor incompatibility 2016-06-17 17:25:04 -07:00
Joseph Hwang 61ff6ced5b HBASE-16018 Refactored the ReplicationPeers interface to clear up what some methods do and move away from a ZooKeeper-specific implementation.
Also added some documentation for undocumented methods.

Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-17 13:04:21 -07:00
Joseph Hwang 2093aadec1 HBASE-15974 Create a ReplicationQueuesClientHBaseImpl
Building on HBase-15958.
Provided a ReplicationQueuesClientHBaseImpl that relies on the HBase Replication Table to track WAL queues.
Refactored out a large section of ReplicationQueuesHBaseImpl into a ReplicationTableClient class that handles Replication Table operations.

Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-15 10:43:14 -07:00
anoopsjohn 17bcf14fea HBASE-15525 OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts. 2016-06-14 19:03:54 +05:30
Jurriaan Mous bd45cf3476 HBASE-16004 Update to Netty 4.1.1
Signed-off-by: stack <stack@apache.org>
2016-06-10 12:14:05 -07:00
Joseph Hwang babdedc1b0 HBASE-15958 Implement ClaimQueues on top of HBase
Building on HBase-15883.
Now implementing the claim queues procedure within an HBase table.
Also added UnitTests to test claimQueue.
Peer tracking will still be performed by ZooKeeper though.
Also modified the queueId tracking procedure so we no longer have to perform scans over the Replication Table.
This does make our queue naming schema slightly different from ReplicationQueuesZKImpl though.

Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-09 15:05:54 -07:00
Ashish Singhi 9012a0b123 HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node 2016-06-09 18:44:29 +05:30
Matteo Bertozzi 41cc215544 HBASE-15975 logic in TestHTableDescriptor#testAddCoprocessorWithSpecStr is wrong (Huaxiang Sun) 2016-06-08 22:42:50 -07:00
Matteo Bertozzi d9463bcce0 HBASE-15989 Remove hbase.online.schema.update.enable 2016-06-08 13:09:31 -07:00
Sergey Soldatov da88b48240 HBASE-15957 RpcClientImpl.close never ends in some circumstances
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-06-07 11:33:03 -07:00
Andrew Purtell 376ad0d986 HBASE-15698 Increment TimeRange not serialized to server (Ted Yu) 2016-06-06 22:17:00 -07:00
tedyu 7fd3532de6 HBASE-15803 ZooKeeperWatcher's constructor can leak a ZooKeeper instance with throwing ZooKeeperConnectionException when canCreateBaseZNode is true 2016-06-06 18:35:15 -07:00
Apekshit Sharma 15c03fd1c9 HBASE-15965
- Testing by executing a command will cover the exact path users will trigger, so its better then directly calling library functions in tests. Changing the tests to use @shell.command(:<command>, args) to execute them like it's a command coming from shell.

Norm change:
Commands should print the output user would like to see, but in the end, should also return the relevant value. This way:
- Tests can use returned value to check that functionality works
- Tests can capture stdout to assert particular kind of output user should see.
- We do not print the return value in interactive mode and keep the output clean. See Shell.command() function.

Bugs found due to this change:
- Uncovered bug in major_compact.rb with this approach. It was calling admin.majorCompact() which doesn't exist but our tests didn't catch it since they directly tested admin.major_compact()
- Enabled TestReplicationShell. If it's bad, flaky infra will take care of it.

Change-Id: I5d8af16bf477a79a2f526a5bf11c245b02b7d276
2016-06-06 17:50:22 -07:00
Ramkrishna b21c56e795 HBASE-15174 Client Public API should not have PB objects in 2.0 (Ram) 2016-06-06 10:11:38 +05:30
Joseph Hwang 21e98271c3 HBASE-15883 Adding WAL files and tracking offsets in HBase.
Implemented ReplicationQueuesHBaseImpl that tracks WAL offsets and replication queues in an HBase table.
Only wrote the basic tracking methods, have not implemented claimQueue() or HFileRef methods yet.
Wrote a basic unit test for ReplicationQueueHBaseImpl that tests the implemented functions on a single Region Server

Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-03 15:23:10 -07:00
Ashish Singhi 0cbce07626 HBASE-15888 Extend HBASE-12769 for bulk load data replication 2016-06-03 18:42:00 +05:30
Yu Li 53eb27bb60 HBASE-15931 Add log for long-running tasks in AsyncProcess 2016-06-02 12:00:42 +08:00
tedyu cbb95cd3a9 HBASE-15932 Shell test fails due to uninitialized constant 2016-06-01 10:35:00 -07:00
Jurriaan Mous a1f0c1cbb3 HBASE-15875 Remove HTable references and HTableInterface
Signed-off-by: stack <stack@apache.org>
2016-05-30 19:56:54 -07:00
Jurriaan Mous cdd532da8a HBASE-15610 Remove deprecated HConnection for 2.0 thus removing all PB references for 2.0
Signed-off-by: stack <stack@apache.org>
2016-05-29 07:50:55 -07:00
Sean Mackrory f4470af95d HBASE-15891. Closeable resources potentially not getting closed if exception is thrown.
Signed-off-by: stack <stack@apache.org>
2016-05-28 21:32:22 -07:00
Sean Mackrory 3b6e6e6c25 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-28 10:41:31 -07:00
Gary Helmling da0d74cd27 HBASE-15830 SASL encryption doesn't work with AsyncRpcChannelImpl (Colin Ma) 2016-05-26 21:58:27 -07:00
Andrew Purtell fdaf3be84f HBASE-15854 Log the cause of SASL connection failures (Robert Yokota) 2016-05-26 14:16:20 -07:00
Mikhail Antonov 1c30ae68ec HBASE-15880 RpcClientImpl#tracedWriteRequest incorrectly closes HTrace span 2016-05-23 12:44:48 -07:00
tedyu ae42c65cfd HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig) 2016-05-21 21:15:10 -07:00
Jerry He 56e4b85d06 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:06:05 -07:00
Gary Helmling b1bf622e69 HBASE-15856 Addendum Fix UnknownHostException import in MetaTableLocator 2016-05-20 20:44:56 -07:00
stack 8dc0ae6fb3 HBASE-15863 Typo in Put.java class documentation (Tamer Soliman) 2016-05-20 11:51:36 -07:00
Gary Helmling 4793988aef HBASE-15856 Don't cache unresolved addresses for connections 2016-05-20 09:36:11 -07:00
eshcar a27504c701 HBASE-14920: Compacting memstore
Signed-off-by: stack <stack@apache.org>
2016-05-20 03:41:43 -07:00
Matteo Bertozzi 5ac54e6abb HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:48:26 -07:00
Phil Yang 3bd9220f0c HBASE-15593 Time limit of scanning should be offered by client
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-05-18 19:13:15 +08:00
Ramkrishna 7b5d5394c0 HBASE-15784 Misuse core/maxPoolSize of LinkedBlockingQueue in
ThreadPoolExecutor (Jingcheng Du)
2016-05-18 12:40:43 +05:30
Elliott Clark 9269b8199e HBASE-15840 WAL.proto compilation broken for cpp 2016-05-17 12:04:14 -07:00
tedyu 838c306c0a HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 11:01:26 -07:00
Sean Busbey e0aff10901 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:50:14 -05:00
stack c47511baa7 HBASE-15828 fix extant findbug NM_SAME_SIMPLE_NAME_AS_INTERFACE in Future 2016-05-15 21:11:29 -07:00
Mikhail Antonov 2482062d34 HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang) 2016-05-15 20:37:26 -07:00
stack 6904430a3d HBASE-15811 Batch Get after batch Put does not fetch all Cells We were not waiting on all executors in a batch to complete. The test for no-more-executors was damaged by the 0.99/0.98.4 fix "HBASE-11403 Fix race conditions around Object#notify"
It added this in AsyncProcess#waitForMaximumCurrentTasks:

synchronized (this.tasksInProgress) {
+          if (tasksInProgress.get() != oldInProgress) break;
           this.tasksInProgress.wait(100);

which added a break out of our waiting loop if any change in
count of tasks; it seems that what was wanted was instead to
avoid the wait if there was movement in the count of completed
task.

Reformats waitForMaximumCurrentTasks so it is testable. Adds
test that we indeed wait on the specified parameter.
2016-05-13 17:51:27 -07:00
Jurriaan Mous a11091c49c HBASE-15798 Add Async RpcChannels to all RpcClients
Signed-off-by: stack <stack@apache.org>
2016-05-10 07:44:51 -07:00
Jurriaan Mous 9d17e3d22a HBASE-15797 TestIPCUtil fails after HBASE-15795
Signed-off-by: stack <stack@apache.org>
2016-05-09 17:04:58 -07:00
Ramkrishna 97ad33c691 HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
any such public facing class for 2.0 (Ram)
2016-05-09 14:56:00 +05:30
Jurriaan Mous 9ee0cbb995 HBASE-15796 TestMetaCache fails after HBASE-15745
Signed-off-by: stack <stack@apache.org>
2016-05-07 15:29:07 -07:00
Jurriaan Mous fa033b6a08 HBASE-15793 Port over AsyncCall improvements
Signed-off-by: stack <stack@apache.org>
2016-05-07 10:38:38 -07:00
Jurriaan Mous ac31ceb835 HBASE-15794 Fix Findbugs instanceof always true issue in
MultiServerCallable

Signed-off-by: stack <stack@apache.org>
2016-05-07 10:10:23 -07:00
Jurriaan Mous e71ae601f7 HBASE-15795 Cleanup all classes in package org.apache.hadoop.hbase.ipc
for code style

Signed-off-by: stack <stack@apache.org>
2016-05-07 09:55:07 -07:00
Jurriaan Mous 56358a0fd3 HBASE-15745 Refactor RPC classes to better accept async changes
Signed-off-by: stack <stack@apache.org>
2016-05-06 13:43:45 -07:00
Ashish Singhi 34e9a6ff30 HBASE-15669 HFile size is not considered correctly in a replication request 2016-05-06 17:26:17 +05:30
Ramkrishna bec81b1977 HBASE-15608 Remove PB references from SnapShot related Exceptions (ram) 2016-05-06 17:06:25 +05:30
Alex Moundalexis 0bf065a5d5 HBASE-15768 fix capitalization of ZooKeeper usage
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:35:44 -05:00
tedyu 8b0ce77942 HBASE-15292 Refined ZooKeeperWatcher to prevent ZooKeeper's callback while construction (Hiroshi Ikeda) 2016-05-05 11:14:32 -07:00
Gary Helmling d23d600d76 HBASE-15741 Provide backward compatibility for HBase coprocessor service names 2016-05-04 12:09:57 -07:00
Ramkrishna c06a976a98 HBASE-15607 Remove PB references from Admin for 2.0 (Ram) 2016-05-03 10:51:46 +05:30
Mikhail Antonov 58c4c3d174 HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them 2016-05-02 15:23:07 -07:00
Jurriaan Mous 15631a76f5 HBASE-15744 Port over small format/text improvements from HBASE-13784
(Jurriaan Mous)

Signed-off-by: stack <stack@apache.org>
2016-05-01 19:48:43 -07:00
chenheng ccd8888b4b Revert "HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response"
This reverts commit 01c0448ccd.
2016-04-30 11:37:05 +08:00
chenheng 01c0448ccd HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response 2016-04-30 09:27:32 +08:00
Yu Li d8e032279f HBASE-15711 Add client side property to allow logging details for batch errors 2016-04-29 10:14:27 +08:00
tedyu 9343ef438f HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig) 2016-04-27 21:00:11 -07:00
Gary Helmling ce318a2906 HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable 2016-04-26 22:54:13 -07:00
Phil Yang 53d7316075 HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:51:29 -07:00
stack 4bdd47c52c HBASE-15710 Include issue servers information in RetriesExhaustedWithDetailsException message (Yu Li) 2016-04-26 09:15:02 -07:00
chenheng 03f3c392a3 HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache 2016-04-21 14:19:39 +08:00
chenheng a9f1c4a871 HBASE-15406 Split / merge switch left disabled after early termination of hbck 2016-04-15 14:09:52 +08:00
Vasudevan a395922ad5 HBASE-15605 Remove PB references from HCD and HTD for 2.0 (Ram) 2016-04-11 14:12:07 +05:30
tedyu e0f31ba6e6 HBASE-15507 Online modification of enabled ReplicationPeerConfig (Geoffrey Jacoby) 2016-04-08 21:26:31 -07:00
Samir Ahmic d393603dea HBASE-15606 Limit creating zk connection in HBaseAdmin#getCompactionState() only to case when 'hbase:meta' is checked.
Signed-off-by: stack <stack@apache.org>
2016-04-07 14:25:49 -07:00
Enis Soztutar 7e399883f6 HBASE-15505 ReplicationPeerConfig should be builder-style (Gabor Liptak) 2016-04-05 11:44:05 -07:00
Stephen Yuan Jiang e1d5c3d269 HBASE-15521 Procedure V2 - RestoreSnapshot and CloneSnapshot (Stephen Yuan Jiang) 2016-03-31 21:49:13 -07:00
chenheng 7f39baf0f4 HBASE-11393 Replication TableCfs should be a PB object rather than a string 2016-03-29 10:25:29 +08:00
Enis Soztutar 0520097611 HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock 2016-03-28 17:56:32 -07:00
Mikhail Antonov db3ba652f8 HBASE-15524 Fix NPE in client-side metrics 2016-03-23 21:23:54 -07:00
zhangduo fd5c0934b6 HBASE-15520 Fix broken TestAsyncIPC 2016-03-24 10:46:44 +08:00
Elliott Clark 925c185969 HBASE-15475 Allow TimestampsFilter to provide a seek hint
Summary:
Allow TestTimestampFilterSeekHint to provide a seek next hint.
This can be incorrect as it might skip deletes. However it can
make things much much faster.

Test Plan: Added a unit test.

Differential Revision: https://reviews.facebook.net/D55617
2016-03-23 18:56:52 -07:00
Misty Stanley-Jones b6e1f63074 HBASE-15447 Improve javadocs description for Delete methods <Wellington Chevreuil> 2016-03-22 12:56:30 -07:00
tedyu dc6cd0bb74 HBASE-15479 No more garbage or beware of autoboxing (Vladimir Rodionov) 2016-03-19 17:22:53 -07:00
tedyu fbf58f330b HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang) 2016-03-17 11:03:29 -07:00
Mikhail Antonov a2c99b133f HBASE-15390 Unnecessary MetaCache evictions cause elevated number of requests to meta (ADDENDUM) 2016-03-17 01:08:36 -07:00
Elliott Clark ecec35ae4e HBASE-15441 Fix WAL splitting when region has moved multiple times
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.

Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.

We need to:

It appears that the close event with a sequence id of one is coming from region warm up.

This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.

Test Plan: Unit tests pass

Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:26:09 -07:00
Mikhail Antonov 3adcc750e3 HBASE-15390 Unnecessary MetaCache evictions cause elevated number of requests to meta 2016-03-16 16:22:36 -07:00
Enis Soztutar ca816f0780 HBASE-6721 RegionServer Group based Assignment (Francis Liu) 2016-03-14 18:28:50 -07:00
anoopsjohn eea8b38dfa HBASE-15180 Reduce garbage created while reading Cells from Codec Decoder. 2016-03-11 13:58:41 +05:30
anoopsjohn 6628d2df11 HBASE-15322 Operations using Unsafe path broken for platforms not having sun.misc.Unsafe. 2016-03-11 09:37:00 +05:30
tedyu ad9b91a904 HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang) 2016-03-09 09:28:54 -08:00
Mikhail Antonov 46cc3d4972 HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE 2016-03-07 20:54:54 -08:00
tedyu ed977fd125 HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 16:15:59 -08:00
tedyu dfc650a953 HBASE-15243 Revert due to compilation error - master branch change makes the patch stale 2016-03-07 15:59:29 -08:00
tedyu 05c1309b3c HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 15:41:06 -08:00
Jesse Yates ef712df944 HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen) 2016-03-05 11:01:45 -08:00
tedyu d083e4f29f HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi) 2016-03-05 06:28:09 -08:00
Ashu Pachauri 27cf0c8c36 HBASE-15354 Same criteria to clear metacache across operations (Ashu Pachauri)
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-03-04 17:55:35 -08:00
tedyu 664575598e HBASE-15397 Create bulk load replication znode(hfile-refs) in ZK replication queue by default (Ashish Singhi) 2016-03-04 13:43:25 -08:00
Jonathan M Hsieh f658f3ef83 HBASE-15356 Remove unused imports (Youngjoon Kim) 2016-03-03 11:42:38 -08:00
chenheng 99955a3240 HBASE-15128 Disable region splits and merges switch in master 2016-02-27 08:36:59 +08:00
chenheng bf4fcc30c6 Revert "HBASE-15128 Disable region splits and merges switch in master"
This reverts commit 24d481c580.
2016-02-26 08:52:12 +08:00
chenheng 24d481c580 HBASE-15128 Disable region splits and merges switch in master 2016-02-26 08:11:16 +08:00
Josh Elser a8073c4a98 HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)

For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.

As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.

Signed-off-by: stack <stack@apache.org>
2016-02-22 22:03:14 -08:00
anoopsjohn 2d66cd86d0 HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy) 2016-02-23 09:21:37 +05:30
stack 4b1acead42 HBASE-15285 Forward-port respect for isReturnResult from HBASE-15095 2016-02-17 19:26:17 -08:00
anoopsjohn 12982d1957 HBASE-15198 RPC client not using Codec and CellBlock for puts by default-addendum. 2016-02-12 07:37:45 +05:30
anoopsjohn 29a192ef3c HBASE-15198 RPC client not using Codec and CellBlock for puts by default. 2016-02-11 09:51:11 +05:30
tedyu 7bb68b9031 HBASE-15231 Make TableState.State private (Misty Stanley-Jones) 2016-02-08 15:21:18 -08:00
Josh Elser dfd8a31a13 HBASE-15221 Reload the cache on re-tried puts in HTableMultiplexer and adds a close() method to HTableMultiplexer
When a Put fails due to a NotServingRegionException, the cached location
of that Region is never cleared. Thus, subsequent calls to resubmit
the Put will fail in the same way as the original, never determining
the new location of the Region.

If the Connection is not closed by the user before the Multiplexer
is discarded, it will leak resources and could cause resource
issues.

Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-02-08 00:04:28 -06:00
anoopsjohn 7239056c78 HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across. 2016-02-06 02:40:49 +05:30
chenheng 8f20bc748d HBASE-15197 Expose filtered read requests metric to metrics framework and Web UI (Eungsop Yoo) 2016-02-05 10:57:14 +08:00
Andrew Purtell b80325fb1b Amend HBASE-15200 ZooKeeper znode ACL checks should only compare the shortname
Fixes for newly introduced FindBugs warnings
2016-02-04 17:33:32 -08:00
Enis Soztutar a69272efe1 HBASE-15177 Reduce garbage created under high load 2016-02-04 13:27:00 -08:00
stack d5d26f0804 Fixup on the hbasecon banner image.. add date and location 2016-02-04 11:44:16 -08:00
Andrew Purtell 6256ce4e63 HBASE-15200 ZooKeeper znode ACL checks should only compare the shortname 2016-02-03 10:43:20 -08:00
Enis Soztutar 2f5767376f HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li) 2016-02-02 17:10:19 -08:00
stack ed46591f30 HBASE-15196 HBASE-15158 Preamble 2 of 2:Add Increment tests 2016-02-02 11:27:03 -08:00
stack 2cc48e039d HBASE-15158 HBASE-15158 Preamble 1 of 2: fix findbugs, add javadoc, change Region#getReadpoint to #getReadPoint, and some util 2016-01-31 20:21:48 -08:00
tedyu 1ee07688c8 HBASE-15173 Execute mergeRegions RPC call as the request user 2016-01-28 09:53:24 -08:00
Elliott Clark 138b754671 HBASE-15146 Don't block on Reader threads queueing to a scheduler queue 2016-01-28 07:58:43 -05:00
Devaraj Das 4681827d63 HBASE-14963. Remove Guava dependency from HBase client code 2016-01-22 13:26:54 -08:00
Mikhail Antonov 4bf6f8379d HBASE-15139 Connection manager doesn't pass client metrics to RpcClient 2016-01-20 14:17:01 -08:00
tedyu eb17f74b9e HBASE-15073 Revert due to different opinion on usefulness 2016-01-18 17:51:21 -08:00
stack 76bce77326 HBASE-15115 Fix findbugs complaints in hbase-client 2016-01-15 10:25:49 -08:00
stack 300fe5e6bf Revert "v1"
Bad commit message; revert

This reverts commit c516968b8c.
2016-01-15 10:24:58 -08:00
stack c516968b8c v1 2016-01-15 10:15:05 -08:00
tedyu 4ac8d4ce61 HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Appy) 2016-01-14 16:39:52 -08:00
ramkrishna 28c2b18d30 HBASE-15027 Refactor the way the CompactedHFileDischarger threads are
created (Ram)
2016-01-08 11:18:39 +05:30
tedyu d65978fceb HBASE-15073 Finer grained control over normalization actions for RegionNormalizer 2016-01-06 17:25:41 -08:00
anoopsjohn a9b671b31f HBASE-12593 Tags to work with ByteBuffer. 2016-01-06 21:28:06 +05:30
stack 46303dfd75 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-05 14:35:27 -08:00
tedyu 00656688f7 HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled 2016-01-04 07:10:10 -08:00
stack a82f7fc94a Revert "HBASE-14888 ClusterSchema: Add Namespace Operations"
This reverts commit c5f3d17ae3.
2016-01-03 07:15:18 -08:00
stack c5f3d17ae3 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-02 16:16:56 -08:00
Ashish Singhi 413d663f92 HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-29 20:25:47 -06:00
tedyu a1a19d9405 HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish) 2015-12-24 11:07:49 -08:00
anoopsjohn 6fc2596ab3 HBASE-14940 Make our unsafe based ops more safe. 2015-12-24 07:54:13 +05:30
stack 04de427e57 Revert "HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implemenations (Ashish Singhi)"
This reverts commit e00a04df10.
2015-12-23 15:31:10 -08:00
stack e00a04df10 HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implemenations (Ashish Singhi) 2015-12-23 07:29:18 -08:00
chenheng f018c371b5 HBASE-14654 Reenable TestMultiParallel#testActiveThreadsCount 2015-12-22 11:33:25 +08:00
Lars Hofhansl 86a417eead HBASE-14822 Renewing leases of scanners doesn't work. 2015-12-19 09:55:03 -08:00
anoopsjohn 408666a06d HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also. 2015-12-18 09:50:53 +05:30
anoopsjohn cf458d3023 HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 18:01:16 +05:30
Mikhail Antonov abe30b52a8 HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version 2015-12-15 12:11:27 -08:00
stack 22b95aebcd HBASE-14946 Don't allow multi's to over run the max result size. 2015-12-10 21:25:21 -08:00
Enis Soztutar cff664c5e2 HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded 2015-12-10 19:11:57 -08:00
Elliott Clark 48e217a7db HBASE-14946 Don't allow multi's to over run the max result size.
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens

Test Plan: Added a unit test

Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:10:32 -08:00
stack bebcc09fb3 HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin 2015-12-10 15:02:21 -08:00
Nate Edel 9511150bd6 HBASE-14901 Remove duplicate code to create/manage encryption keys
Signed-off-by: Gary Helmling <garyh@apache.org>
2015-12-10 14:38:43 -08:00
ramkrishna 26ac60b03f HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:07:46 +05:30
Gary Helmling c1e0fcc26d HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 15:52:27 -08:00
stack 92e178df28 Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).

This reverts commit 6adce67572.
2015-12-01 11:30:39 -08:00
Apekshit(Appy) Sharma 6adce67572 HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
Apekshit 3bac31b2a4 HBASE-14890 Fix broken checkstyle tool. Some javadocs had parsing errors because of wrongly formatted HTML tags. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-28 21:57:52 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
anoopsjohn daba867734 HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek) 2015-11-24 09:50:56 +05:30
tedyu 9a91f5ac81 HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar) 2015-11-23 20:13:00 -08:00
chenheng ebe5801e00 HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov) 2015-11-19 11:28:18 +08:00
tedyu d738aade2e HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo) 2015-11-18 14:24:47 -08:00
Elliott Clark d6fdf92f9e HBASE-14812 Fix ResultBoundedCompletionService deadlock 2015-11-17 14:41:35 -08:00
Elliott Clark a591df1073 HBASE-14708 Use copy on write Map for region location cache
Summary:
Create and use a copy on write map for region location.

  - Create a copy on write map backed by a sorted array.
  - Create a test for both comparing each with a jdk provided map.
  - Change MetaCache to use the new map.

Test Plan:
  - org.apache.hadoop.hbase.client.TestFromClientSide
  - TestHCM

Differential Revision: https://reviews.facebook.net/D49545
2015-11-17 10:52:43 -08:00
tedyu 789f8a5a70 HBASE-14498 Revert for on-going review 2015-11-12 12:57:23 -08:00
stack 290ecbe829 HBASE-14355 Scan different TimeRange for each column family (Churro Morales) 2015-11-12 10:54:16 -10:00
tedyu b677f2e65d HBASE-14498 Master stuck in infinite loop when all Zookeeper servers are unreachable (Pankaj Kumar) 2015-11-12 07:21:19 -08:00
stack 32de06f663 HBASE-14787 Remove obsolete ConnectionImplementation.refCount (Appy) 2015-11-09 17:08:17 -10:00
chenheng 086bacd12d HBASE-14693 Add client-side metrics for received pushback signals
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-09 18:03:30 -08:00
Apekshit(Appy) Sharma 08963189a2 HBASE-14767 - Remove deprecated functions from HBaseAdmin Deprecated in HBASE-12083 (1.0.0, 2.0.0, 0.99.2) - HBaseAdmin(Configuration)
Deprecated in HBASE-10479 (0.99.0, hbase-10070)
  - HBaseAdmin(Connection)

  Deprecated in HBASE-11826 (0.99.0, 1.0.0, 2.0.0)
  - flush()
  - compact()
  - majorCompact()
  - split()
  - getCompactionState()

- Changes many declarations from HBaseAdmin to Admin
(Apekshit)

Signed-off-by: stack <stack@apache.org>
2015-11-06 16:23:55 -10:00
tedyu cfc5348b5e HBASE-14758 Add UT case for unchecked error/exception thrown in AsyncProcess#sendMultiAction (Yu Li) 2015-11-04 07:20:59 -08:00
stack ceddec9141 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-03 20:47:20 -08:00
chenheng 6871724104 HBASE-12986 Compaction pressure based client pushback
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-03 18:32:08 -08:00
stack e4bf77e2de HBASE-14754 TestFastFailWithoutTestUtil failing on trunk now in #testPreemptiveFastFailException50Times 2015-11-03 16:20:55 -08:00
Jesse Yates 1b8b612b8b HBASE-14715 Add javadocs to DelegatingRetryingCallable 2015-11-02 16:20:55 -08:00
stack 9630fec2d5 Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets"
Revert. Seems to have destabilized the build

This reverts commit 6dbb5a8052.
2015-11-02 08:17:41 -08:00
stack 6dbb5a8052 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-01 22:26:43 -08:00
Jonathan M Hsieh 4c25549e9f HBASE-14711 Remove or annotate deprecated methods in HRegionInfo 2015-11-01 04:29:51 -08:00
Elliott Clark ec651bfc7b HBASE-14687 Un-synchronize BufferedMutator
Summary:
Use concurrent collections and atomic longs to keep track of edits in buffered mutator.
This keeps buffered mutator as thread safe but it means that shared buffered mutators are not contending on thread locking.

Test Plan: Unit Tests.

Differential Revision: https://reviews.facebook.net/D49467
2015-10-30 13:27:25 -07:00
Matteo Bertozzi 4b91a6425e HBASE-14714 some cleanup to snapshot code 2015-10-29 13:48:59 -07:00
Jonathan M Hsieh 094d65e6f5 HBASE-14673 Exorcise deprecated Delete#delete* api 2015-10-29 11:15:34 -07:00
Jonathan M Hsieh de9555cec4 HBASE-14675 Exorcise deprecated Put#add(...) and replace with Put#addColumn(...) 2015-10-29 11:15:31 -07:00
tedyu 210c3dd937 HBASE-12769 Replication fails to delete all corresponding zk nodes when peer is removed (Jianwei Cui) 2015-10-27 19:40:40 -07:00
Misty Stanley-Jones e24d03b10c HBASE-14695 Fix some easy HTML warnings and bad links 2015-10-28 12:12:40 +10:00
Enis Soztutar 0e6dd3257b HBASE-14425 In Secure Zookeeper cluster superuser will not have sufficient permission if multiple values are configured in hbase.superuser (Pankaj Kumar) 2015-10-27 16:56:20 -07:00
tedyu f91546f2e6 HBASE-14696 Support setting allowPartialResults in mapreduce Mappers 2015-10-27 07:57:32 -07:00
tedyu a321da2039 HBASE-14694 Scan copy constructor doesn't handle allowPartialResults 2015-10-27 07:51:04 -07:00
Elliott Clark caae3b2e5f HBASE-14683 Fix Batching in buffered mutator is awful when adding lists of mutations.
Summary: Send the list of mutations to AsyncProcess only after done adding the list otherwise there's a lot of contention

Test Plan: UnitTests.

Differential Revision: https://reviews.facebook.net/D49251
2015-10-24 10:05:39 -07:00
Ashish Singhi 467bc098a9 HBASE-13538 Procedure v2 - client add/delete/modify column family sync (incompatible with branch-1.x)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-10-22 13:12:35 -07:00
Matteo Bertozzi 36a196722c HBASE-14669 remove unused import and fix javadoc 2015-10-22 09:25:26 -07:00
Misty Stanley-Jones 2996355e94 HBASE-14603 Lots of work on the POM to enhance Javadocs, Xrefs
* We now have apidocs, devapidocs, testapidocs, and testdevapidocs
* When using reportSets, the Javadoc plugin ignores the plugin configuration,
  so I propagated it to the individual reportSet configuration blocks.
* I was able to remove some of the logic that moved / copied things around
  in post-site.
* We now have xref and xref-test (these are superfluous but something needs them
  so I left them)
* Added source to Javadocs -- you can click a method or property to browse its source.
  More user-friendly than xref maybe.
* You can now get the whole site to build by doing 'mvn clean site site:stage' and
  it takes about 10 minutes.
2015-10-22 19:12:42 +10:00
Misty Stanley-Jones 74d5232065 Revert "Lots of work on the POM to enhance Javadocs, Xrefs"
This reverts commit aa78ebbd5a.
2015-10-22 19:11:40 +10:00
Misty Stanley-Jones aa78ebbd5a Lots of work on the POM to enhance Javadocs, Xrefs
* We now have apidocs, devapidocs, testapidocs, and testdevapidocs
* When using reportSets, the Javadoc plugin ignores the plugin configuration,
  so I propagated it to the individual reportSet configuration blocks.
* I was able to remove some of the logic that moved / copied things around
  in post-site.
* We now have xref and xref-test (these are superfluous but something needs them
  so I left them)
* Added source to Javadocs -- you can click a method or property to browse its source.
  More user-friendly than xref maybe.
* You can now get the whole site to build by doing 'mvn clean site site:stage' and
  it takes about 10 minutes.
2015-10-22 18:29:08 +10:00
tedyu 8e6316a80c HBASE-14458 AsyncRpcClient#createRpcChannel() should check and remove dead channel before creating new one to same server (Samir Ahmic) 2015-10-18 20:49:31 -07:00
Enis Soztutar 6076ed2a12 HBASE-14474 Addendum closes connection in writeRequest() outside synchronized block
This reverts commit 414a7b18b1.
2015-10-16 11:54:22 -07:00
Nicolas Liochon e7defd7d9a HBASE-14521 Unify the semantic of hbase.client.retries.number (Yu Li) 2015-10-15 10:42:40 +02:00
tedyu 8c69b0f751 HBASE-14594 Use new DNS API introduced in HADOOP-12437 (Josh Elser) 2015-10-14 14:17:36 -07:00
stack 940e5404df HBASE-14598 ByteBufferOutputStream grows its HeapByteBuffer beyond JVM limitations (Ian Friedman) 2015-10-14 13:13:01 -07:00
stack b9639d1e82 HBASE-14590 Shorten ByteBufferedCell#getXXXPositionInByteBuffer method name (Anoop Sam John) 2015-10-12 12:33:28 -07:00
stack e37e72c160 Revert "HBASE-14583 Enabled client-side metrics by default"
Causes TestShell to hang. Reverting for now till we figure why.

This reverts commit c7efd14726.
2015-10-10 13:18:48 -07:00
anoopsjohn 4969879df5 HBASE-14366 NPE in case visibility expression is not present in labels table during importtsv run. (Bhupendra) 2015-10-10 12:04:47 +05:30
stack 445dbd8a0e HBASE-14517 Show regionserver's version in master status page (Liu Shaohui) 2015-10-09 15:06:39 -07:00
Nick Dimiduk c7efd14726 HBASE-14583 Enabled client-side metrics by default 2015-10-09 10:17:56 -07:00
Nick Dimiduk 7e30436e3f HBASE-12911 Client-side metrics 2015-10-07 17:01:56 -07:00
Elliott Clark ceafa09d3c HBASE-14544 Allow HConnectionImpl to not refresh the dns on errors 2015-10-05 09:35:40 -07:00
Mikhail Antonov 19045a5ea7 HBASE-14367 Add normalization support to shell 2015-10-04 00:29:39 -07:00
smaddineni 44b8809726 HBASE-13770 Programmatic JAAS configuration option for secure zookeeper may be broken
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-02 17:50:54 -07:00
Matteo Bertozzi 2e8575bb0f HBASE-14485 ConnectionImplementation leaks on construction failure 2015-10-01 12:56:37 -07:00
stack e0929bbc5a HBASE-14510 Fix coprocessor handling of duplicate classes (Yerui Sun) 2015-09-29 15:01:10 -07:00
chenheng 02699fe967 HBASE-14227 Fold special cased MOB APIs into existing APIs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-25 18:28:13 -07:00
tedyu 414a7b18b1 HBASE-14474 Revert addendum 2015-09-25 15:48:08 -07:00
tedyu dc2aa7e513 HBASE-14474 Addendum closes connection in writeRequest() outside synchronized block 2015-09-25 15:18:21 -07:00
Enis Soztutar 32f49fa7fc HBASE-14474 DeadLock in RpcClientImpl.Connection.close() 2015-09-25 11:04:53 -07:00
Andrew Purtell 2239d55871 HBASE-13324 o.a.h.h.Coprocessor should be LimitedPrivate("Coprocessor") 2015-09-24 10:57:32 -07:00
Stephen Yuan Jiang 5b7894f92b HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-23 21:48:32 -07:00
tedyu b6bd811c76 HBASE-14397 Revert pending review comments 2015-09-22 10:00:50 -07:00
tedyu 86cf148894 HBASE-14431 Addendum checks for null connectionInPool (Yu Li) 2015-09-21 07:23:14 -07:00
tedyu 1545e1ed8d HBASE-14431 AsyncRpcClient#removeConnection() never removes connection from connections pool if server fails (Samir Ahmic) 2015-09-19 07:32:04 -07:00
tedyu b0f5233265 HBASE-14449 Rewrite deadlock prevention for concurrent connection close 2015-09-18 14:40:39 -07:00
stack bd26386dc7 HBASE-14433 Set down the client executor core thread count from 256 in tests: REAPPLY AGAIN (WAS MISSING JIRA) 2015-09-16 10:13:55 -07:00
stack b0aa86a694 Revert "Set down the client executor core thread count from 256 in tests: REAPPLY"
Missing JIRA number.

This reverts commit b00f3d3703.
2015-09-16 10:12:39 -07:00
stack b00f3d3703 Set down the client executor core thread count from 256 in tests: REAPPLY 2015-09-16 08:57:06 -07:00
stack 8633b26ee5 Revert "HBASE-14433 Set down the client executor core thread count from 256 to number of processors"
This reverts commit d2e3381818.
2015-09-16 08:53:34 -07:00
stack d2e3381818 HBASE-14433 Set down the client executor core thread count from 256 to number of processors 2015-09-15 22:36:05 -07:00
Apekshit(Appy) Sharma fe2c4f630d HBASE-14400 Fix HBase RPC protection documentation
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-15 17:43:48 -07:00
Samir Ahmic f51c79076d HBASE-13337 Table regions are not assigning back, after restarting all regionservers at once.
Signed-off-by: stack <stack@apache.org>
2015-09-15 06:36:57 -07:00
stack ceff3e242b HBASE-14421 TestFastFail* are flakey; ADDENDUM 2 DISABLE testInterceptorIntercept50Times 2015-09-13 10:33:44 -07:00
stack a9157379a3 HBASE-14421 TestFastFail* are flakey 2015-09-12 22:34:04 -07:00
tedyu 36675c81fb HBASE-14397 PrefixFilter doesn't filter all remaining rows if the prefix is longer than rowkey being compared (Jianwei Cui) 2015-09-11 16:04:31 -07:00
Srikanth Srungarapu 1a19b0ee17 HBASE-14385 Close the sockets that is missing in connection closure. 2015-09-09 23:31:37 -07:00
Nick Dimiduk a11bb2a933 HBASE-14382 TestInterfaceAudienceAnnotations should hadoop-compt module resources 2015-09-09 11:08:28 -07:00
stack a11f5c55b4 HBASE-14308 HTableDescriptor WARN is not actionable (Lars Francke) 2015-09-04 22:44:21 -07:00
Andrew Purtell 2481b7f76f HBASE-14359 HTable#close will hang forever if unchecked error/exception thrown in AsyncProcess#sendMultiAction (Victor Xu) 2015-09-03 17:48:45 -07:00
Stephen Yuan Jiang 3341f13e71 HBASE-14108 Procedure V2 Administrative Task: provide an API to abort a procedure (Stephen Yuan Jiang) 2015-09-02 19:18:46 -07:00
tedyu df341c4299 HBASE-14309 Allow load balancer to operate when there is region in transition by adding force flag 2015-08-29 13:15:53 -07:00
Elliott Clark cc1542828d HBASE-14313 After a Connection sees ConnectionClosingException it never recovers -- ADDENDUM 2015-08-27 15:23:43 -07:00
Elliott Clark 56890d9fe1 HBASE-14313 After a Connection sees ConnectionClosingException on a connection it never recovers 2015-08-26 13:44:12 -07:00
tedyu 6661f2d025 HBASE-14269 FuzzyRowFilter omits certain rows when multiple fuzzy keys exist (hongbin ma) 2015-08-26 07:23:43 -07:00
stack 3dacee674c HBASE-14290 Spin up less threads in tests 2015-08-25 16:16:03 -07:00
stack d0873f5a8c HBASE-14224 Fix coprocessor handling of duplicate classes 2015-08-24 13:47:19 -07:00
stack b85857cf3c HBASE-13480 ShortCircuitConnection doesn't short-circuit all calls as expected (Jingcheng Du and Josh Elser) 2015-08-24 12:29:46 -07:00
tedyu 16f8d27708 HBASE-14241 Fix deadlock during cluster shutdown due to concurrent connection close 2015-08-19 08:49:38 -07:00
Enis Soztutar 395ec5a9bb HBASE-14203 remove duplicate code getTableDescriptor in HTable (Heng Chen) 2015-08-17 16:05:26 -07:00
Enis Soztutar 2ed7f9bb1d HBASE-14122 Client API for determining if server side supports cell level security - ADDENDUM for javadoc fix 2015-08-17 14:04:28 -07:00
Andrew Purtell 5e5bcceb53 HBASE-14122 Client API for determining if server side supports cell level security 2015-08-12 13:26:55 -07:00
Elliott Clark 38b94709ee HBASE-14208 Remove yarn dependencies on -common and -client 2015-08-11 13:00:13 -07:00
tedyu a2dbe31b26 HBASE-14206 MultiRowRangeFilter returns records whose rowKeys are out of allowed ranges (Anton Nazaruk) 2015-08-11 09:40:13 -07:00
Nick Dimiduk e4106b4c4a Revert "HBASE-12911 Client-side metrics"
This reverts commit 06989fd1f9.
2015-08-10 17:13:09 -07:00
Nick Dimiduk 06989fd1f9 HBASE-12911 Client-side metrics
First pass. Plumbs up metrics for each connection instance. Exposes
static information about those connections (zk quorum and root node,
cluster id, user). Exposes basic thread pool utilization gauges for
"meta lookup" and "batch" pools.
2015-08-10 16:48:48 -07:00
Andrew Purtell ea8833fd63 HBASE-12865 WALs may be deleted before they are replicated to peers (He Liangliang) 2015-08-07 15:08:30 -07:00
Andrew Purtell f06daaf010 HBASE-13825 Use ProtobufUtil#mergeFrom and ProtobufUtil#mergeDelimitedFrom in place of builder methods of same name 2015-08-06 21:48:09 -07:00
Sean Busbey 1b0b67fb7c HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)
2015-08-04 17:16:56 -05:00
tedyu 598cfeb775 HBASE-13965 Stochastic Load Balancer JMX Metrics (Lei Chen) 2015-08-03 12:46:01 -07:00
tedyu 4b6598e394 HBASE-13864 HColumnDescriptor should parse the output from master and from describe for TTL (Ashu Pachauri) 2015-08-01 02:15:02 -07:00
Ashish Singhi f504e4b4ed HBASE-14154 DFS Replication should be configurable at column family level
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-31 19:15:48 -07:00
Sean Busbey 4ce6f486d0 HBASE-14087 Ensure correct ASF headers for docs/code
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint
2015-07-29 14:25:43 -05:00
Srikanth Srungarapu 05de2ec580 HBASE-14097 Log link to client scan troubleshooting section when scanner exceptions happen. 2015-07-28 15:14:27 -07:00
Srikanth Srungarapu 1d4c2452e7 HBASE-14057 HBase shell user_permission should list super users defined on hbase-site.xml 2015-07-28 11:33:52 -07:00
ramkrishna 6b9b7cb8c7 HBASE-14152 Fix the warnings in Checkstyle and FindBugs brought in by merging hbase-11339 (Jingcheng Du)
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-07-28 10:14:29 -05:00
Sean Busbey e36af70835 Revert "Fix the warnings in Checkstyle and FindBugs brought in by merging"
This reverts commit 89d0409462.
2015-07-28 10:13:57 -05:00
ramkrishna 89d0409462 Fix the warnings in Checkstyle and FindBugs brought in by merging
hbase-11339 (Jingcheng Du)
2015-07-28 11:41:41 +05:30
anoopsjohn 4f60d9c28d HBASE-14151 Remove the unnecessary file ProtobufUtil.java.rej which is brought in by merging hbase-11339. (Jingcheng) 2015-07-23 11:43:23 +05:30
Jonathan M Hsieh 493f36c899 HBASE-11339 Merge remote-tracking branch 'apache/hbase-11339' (Jingcheng Du) 2015-07-22 12:51:11 -07:00
anoopsjohn 3b6db26863 HBASE-13954 Remove HTableInterface#getRowOrBefore related server side code. (Ashish) 2015-07-21 09:08:26 +05:30
anoopsjohn ebdac4b52e HBASE-12296 Filters should work with ByteBufferedCell. 2015-07-16 09:36:05 +05:30
Andrew Purtell 6c6c7c51f6 HBASE-14089 Remove unnecessary draw of system entropy from RecoverableZooKeeper 2015-07-15 18:41:34 -07:00
Ashish Singhi e6bd0c8c15 HBASE-8642 [Snapshot] List and delete snapshot by table
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-15 15:56:07 -07:00
terence.yoo a63e3ac83f HBASE-14041 Do not clear MetaCache if a ThrottlingException is thrown
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-15 02:53:21 -05:00
ramkrishna a3d30892b4 HBASE-14047 - Cleanup deprecated APIs from Cell class (Ashish Singhi) 2015-07-13 22:06:16 +05:30
Matteo Bertozzi 951ec7a0b7 HBASE-13415 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-13 11:02:30 -05:00
Sean Busbey 60d6435ad8 Revert "Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)"
This reverts commit 87ee37ceb8.
2015-07-13 11:01:45 -05:00
Enis Soztutar 5e708746b8 HBASE-13997 ScannerCallableWithReplicas cause Infinitely blocking (Zephyr Guo and Enis) 2015-07-10 16:06:29 -07:00
stack 66082c7224 HBASE-14052 Mark a few methods in CellUtil audience private since only make sense internally to hbase 2015-07-10 10:44:38 -07:00
Matteo Bertozzi 87ee37ceb8 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang) 2015-07-09 07:44:36 -07:00
anoopsjohn d07ff5ec5a HBASE-13387 Add ByteBufferedCell an extension to Cell. 2015-07-09 15:35:24 +05:30
Ashish Singhi 5b75faefcc HBASE-13925 Use zookeeper multi to clear znodes in ZKProcedureUtil
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-03 12:24:47 -07:00
anoopsjohn 62f5694491 HBASE-13998 Remove CellComparator#compareRows(byte[] left, int loffset, int llength, byte[] right, int roffset, int rlength). 2015-07-02 11:58:25 +05:30
stack 20e855f282 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- REAPPLY 2015-07-01 23:16:30 -07:00
stack f0e29c49a1 Revert "HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis"
This reverts commit fca725a899.
2015-07-01 20:20:08 -07:00
stack fca725a899 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis
Soztutar)
2015-07-01 20:07:26 -07:00
stack 460d76f623 HBASE-13983 Doc how the oddball HTable methods getStartKey, getEndKey, etc. will be removed in 2.0.0 2015-07-01 13:04:19 -07:00
anoopsjohn 7b92d8c06a HBASE-13968 Remove deprecated methods from BufferedMutator class.(Ashish Singhi) 2015-06-29 11:00:54 +05:30
Ashish Singhi 3efde85614 HBASE-13214 Remove deprecated and unused methods from HTable class 2015-06-26 15:39:53 -07:00
Gábor Lipták 5826bf2a7c HBASE-13963 Do not leak jdk.tools dependency from hbase-annotations
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-06-26 08:48:02 -05:00
stack b5b5853043 HBASE-13893 Replace HTable with Table in client tests (Jurriaan Mous) 2015-06-25 14:42:33 -07:00
Nick Dimiduk 3e72dc9f08 HBASE-13938 Deletes done during the region merge transaction may get eclipsed (ddas, enis, ndimiduk) 2015-06-23 10:23:38 -07:00
Gábor Lipták 6a537eb854 HBASE-13900 Use ProtobufMagic methods in ProtobufUtil
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-23 00:32:23 -05:00
Sean Busbey abc2e61eb1 Revert "Use ProtobufMagic methods in ProtobufUtil"
This reverts commit 6b37f26280.
2015-06-23 00:30:25 -05:00
Sean Busbey 93640bb798 Revert "HBASE-13898 Move 'converter' functions from ProtobufUtil into a helper class"
This reverts commit 1d7c68c086.
2015-06-23 00:04:27 -05:00
Mikhail Antonov fd37ccb63c HBASE-13103 [ergonomics] add region size balancing as a feature of master 2015-06-22 15:52:07 -07:00
Gábor Lipták d51a184051 HBASE-13843 Correct typo in ReplicationAdmin
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-06-22 08:54:01 -05:00
Gábor Lipták 1d7c68c086 HBASE-13898 Move 'converter' functions from ProtobufUtil into a helper class
Signed-off-by: Misty Stanley-Jones <mstanleyjones@cloudera.com>
2015-06-22 12:11:51 +10:00
Misty Stanley-Jones 43c0647c62 Revert "Move 'converter' functions from ProtobufUtil into a helper class"
Bad commit message

This reverts commit 2b9afcad3eca725ff322cd9e70cde1d9522d8e21.
2015-06-22 12:10:12 +10:00
Gábor Lipták 80b2b85ab2 Move 'converter' functions from ProtobufUtil into a helper class
Signed-off-by: Misty Stanley-Jones <mstanleyjones@cloudera.com>
2015-06-22 12:05:11 +10:00
anoopsjohn 04c25e0f35 HBASE-13931 Move Unsafe based operations to UnsafeAccess. 2015-06-20 20:52:06 +05:30
Gábor Lipták 6b37f26280 Use ProtobufMagic methods in ProtobufUtil
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-19 13:50:09 -07:00
Misty Stanley-Jones b16293b5e2 HBASE-13898 correct additional javadoc failures under java 8 <Gabor Liptak> 2015-06-16 14:18:09 +10:00
Misty Stanley-Jones 5e6373e8ec Revert "Correct Javadoc generation errors"
This reverts commit 0a227b79d6.
2015-06-16 14:18:09 +10:00
Gábor Lipták 0a227b79d6 Correct Javadoc generation errors 2015-06-16 13:27:45 +10:00
Ashish Singhi d28f299807 HBASE-13901 Error while calling watcher on creating and deleting an HBase table
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-15 11:27:59 -07:00
Gábor Lipták 682b8ab8a5 HBASE-13569 Correct Javadoc (for Java8)
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-06-13 01:10:37 -05:00
Josh Elser 8cef99e506 HBASE-13892 NPE in ClientScanner on null results array
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2015-06-11 19:03:59 -07:00
tedyu 4713fc6407 HBASE-13875 Clock skew between master and region server may render restored region without server address 2015-06-09 18:52:49 -07:00
tedyu 6cc42c8cd1 HBASE-13829 Add more ThrottleType (Guanghao Zhang) 2015-06-09 06:42:55 -07:00
Enis Soztutar 587b0b4f20 HBASE-13851 RpcClientImpl.close() can hang with cancelled replica RPCs 2015-06-06 14:01:33 -07:00
Changgeng Li dcc711fff2 HBASE-13638 Put copy constructor is shallow
Deep copy the cell list

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-06-01 13:55:29 -07:00
anoopsjohn b5641d8edf HBASE-13805 Use LimitInputStream in hbase-common instead of ProtobufUtil.LimitedInputStream. (Jingcheng) 2015-06-01 09:58:56 +05:30
Matteo Bertozzi 749dda6aca HBASE-13779 Calling table.exists() before table.get() end up with an empty Result (addendum) 2015-05-29 17:41:33 -07:00
stack 62b5e578a8 HBASE-13799 javadoc how Scan gets polluted when used; if you set attributes or ask for scan metrics 2015-05-29 11:31:49 -07:00
Matteo Bertozzi 18fef46901 HBASE-13779 Calling table.exists() before table.get() end up with an empty Result 2015-05-29 16:39:03 +01:00
stack 325614220f HBASE-13616 Move ServerShutdownHandler to Pv2 2015-05-28 20:45:38 -07:00
Geoffrey e61bf1bf25 HBASE 13796 - Fixed ZKUtil's cleaning of the zookeeper quorum setting
Signed-off-by: stack <stack@apache.org>
2015-05-28 20:06:58 -07:00
Nick Dimiduk f0a1ca4a6f HBASE-13761 Optimize FuzzyRowFilter (Vladimir Rodionov) 2015-05-28 10:12:21 -07:00
anoopsjohn b31a6acf4c HBASE-13763 Handle the rename, annotation and typo stuff in MOB. (Jingcheng) 2015-05-28 13:43:12 +05:30
Andrew Purtell 942e09b71e HBASE-13768 ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration (Enis Soztutar) 2015-05-27 12:23:14 -07:00
Matteo Bertozzi 19a57f1e7e HBASE-13767 Allow ZKAclReset to set and not just clear ZK ACLs 2015-05-27 18:30:55 +01:00
anoopsjohn 9ee184b673 HBASE-13760 Cleanup Findbugs keySet iterator warnings. (Gabor Liptak) 2015-05-25 22:11:49 +05:30
stack e1e8434340 HBASE-5980 Scanner responses from RS should include metrics on rows/KVs filtered 2015-05-21 11:06:27 -07:00
anoopsjohn 6c3fd34475 HBASE-13641 Deperecate Filter#filterRowKey(byte[] buffer, int offset, int length) in favor of filterRowKey(Cell firstRowCell). 2015-05-21 16:50:42 +05:30
Enis Soztutar eddabdd353 HBASE-13709 Updates to meta table server columns may be eclipsed 2015-05-20 17:42:32 -07:00
Lars Francke 315f596798 HBASE-13656 Rename getDeadServers to getDeadServersSize in Admin
Replace JIRA

Signed-off-by: stack <stack@apache.org>
2015-05-20 13:32:06 -07:00
stack e2e9ea5bd5 Revert "HBASE-5980 Scanner responses from RS should include metrics on rows/KVs filtered"
Committed by mistake. Backing out till sure it good.

This reverts commit dc72dad7cd.
2015-05-20 13:25:49 -07:00
eshcar 7f2b33dbbf HBASE-13071 synchronous scanner -- cache size-in-bytes bug fix
Signed-off-by: stack <stack@apache.org>
2015-05-20 12:35:26 -07:00
stack dc72dad7cd HBASE-5980 Scanner responses from RS should include metrics on rows/KVs filtered 2015-05-20 11:55:06 -07:00
Nick Dimiduk 77d9719e2b HBASE-13711 Provide an API to set min and max versions in HColumnDescriptor (Stephen Yuan Jiang) 2015-05-20 11:40:25 -07:00
tedyu 132573792d HBASE-13704 Hbase throws OutOfOrderScannerNextException when MultiRowRangeFilter is used (Aleksandr Maksymenko) 2015-05-19 20:22:53 -07:00
Lars Francke 1fcee86978 HBASE-13636 Remove deprecation for HBASE-4072 (Reading of zoo.cfg)
Signed-off-by: stack <stack@apache.org>
2015-05-19 16:32:32 -07:00
Jonathan M Hsieh 09a00efc0b Merge remote-tracking branch 'apache/master' (5/19/15) into hbase-11339
Patches that caused deltas:
HBASE-10810 - around HColumnDescriptor 'should' vs 'is' api.
HBASE-11677 - LOG was made private
HBASE-11927 - Checksum constant changed
HBASE-10800 - CellComparator instead of KVComparator

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java
2015-05-19 16:30:21 -07:00
ted malaska a1c94c0bdf HBASE-13677 changed RecoverableZooKeeper logs about retries from info and warn to debug
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-05-18 10:24:42 -05:00
Andrey Stepachev 9ba7337ac8 HBASE-13646 HRegion#execService should not try to build incomplete messages 2015-05-14 13:21:48 +01:00
eshcar 86b91997d0 HBASE-13071 Hbase Streaming Scan Feature
Signed-off-by: stack <stack@apache.org>
2015-05-13 08:23:39 -07:00
Srikanth Srungarapu 9e131dfa8e HBASE-13571 Procedure v2 - client modify table sync 2015-05-11 23:07:15 -07:00
Enis Soztutar 59a6e031fb HBASE-13661 Correct binary compatibility issues discovered in 1.1.0RC0 2015-05-11 18:28:29 -07:00
Lars Francke ec51d7b2e6 HBASE-1989 Admin (et al.) not accurate with Column vs. Column-Family
usage

Fix check style issues & rename parameter

Incorporate comments

Signed-off-by: stack <stack@apache.org>
2015-05-11 09:46:28 -07:00
stack b03ff8ccca Revert "Rename & deprecate everything in Admin"
Revert because does not cite associated JIRA in commit message (my
fault)

This reverts commit 2ad4114149.
2015-05-11 09:45:33 -07:00
Sean Busbey 9aeafe30b7 HBASE-13611 update clover profile to work with clover 4.x and maven 3.
* change pom to use a maven 3 compat version of clover
* add clover to javadoc plugin deps so that instrumented doclet works
* modify IA annotation test to filter out clover instrumentation
* make splitlog counters check for atomiclong before casting
2015-05-11 01:01:57 -05:00
Lars Francke 8e5a183256 HBASE-13655 Deprecate duplicate getCompression methods in HColumnDescriptor (Lars Francke <lars.francke@gmail.com>)
Recommit after commit missing JIRA
Signed-off-by: stack <stack@apache.org>
2015-05-10 22:52:10 -07:00
stack 17b6f59a98 Revert "Deprecate old methods"
Revert commit of HBASE-13655 Deprecate duplicate getCompression methods in HColumnDescriptor
I committed with bad commit message.

This reverts commit 5732bdb483.
2015-05-10 22:48:09 -07:00
Lars Francke 2ad4114149 Rename & deprecate everything in Admin
Fix check style issues & rename parameter

Incorporate comments

Signed-off-by: stack <stack@apache.org>
2015-05-10 20:47:12 -07:00
Lars Francke 5732bdb483 Deprecate old methods
Add proper JIRA

Signed-off-by: stack <stack@apache.org>
2015-05-10 20:11:12 -07:00
Srikanth Srungarapu 70b5c97903 HBASE-13620 Bring back the removed VisibilityClient methods and mark them as deprecated. 2015-05-08 20:27:36 -07:00
tedyu a93ba89b5b HBASE-13625 Use HDFS for HFileOutputFormat2 partitioner's path (Stephen Yuan Jiang) 2015-05-06 07:31:15 -07:00
ramkrishna 977f867439 HBASE-10800 - Use CellComparator instead of KVComparator (Ram) 2015-05-05 11:38:10 +05:30
stack 2ee5f8f5fd HBASE-13464 Remove deprecations for 2.0.0 - Part 1 (Lars Francke) 2015-05-04 14:42:58 -07:00
Lars Hofhansl a4799acd6b HBASE-13333 Renew Scanner Lease without advancing the RegionScanner. 2015-05-02 17:48:32 -07:00
Andrew Purtell a6027aedb3 HBASE-13312 SmallScannerCallable does not increment scan metrics 2015-05-01 16:33:14 -07:00
Jonathan M Hsieh 0e20bbf6a3 Merge branch 'apache/master' (4/16/15) into hbase-11339
API conflicts and test fixes
Update LoadTestTool.COLUMN_FAMILY -> DEFAULT_COLUMN_FAMILY due HBASE-11842
Use new 1.0+ api in some tests
Use updated Scanners internal api
Fix to take into account  HBASE-13203 - procedure v2 table delete

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
2015-05-01 08:18:51 -07:00
Srikanth Srungarapu 6399cd2c45 HBASE-13358 - Update VisibilityClient to accept Connection objects; ADDENDUM -- remove unused imports 2015-04-30 22:39:26 -07:00
Matt Warhaftig d50d6d967d HBASE-13358 - Update VisibilityClient to accept Connection objects.
Signed-off-by: Srikanth Srungarapu <ssrungarapu@cloudera.com>
2015-04-30 21:28:01 -07:00
tedyu 2e6cd5a47a HBASE-13594 MultiRowRangeFilter shouldn't call HBaseZeroCopyByteString.wrap() directly 2015-04-29 10:38:09 -07:00
Nick Dimiduk 5e3127304d HBASE-13417 batchCoprocessorService() does not handle NULL keys (Abhishek Singh Chouhan) 2015-04-28 16:37:58 -07:00
Usha Kuchibhotla 94a00bea07 HBASE-11677 Making Logger instance modifiers consistent.
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-04-28 09:20:34 -05:00
Ashish Singhi 84dd84fc58 HBASE-13572 Procedure v2 - client truncate table sync
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-28 12:46:06 +01:00
Nick Dimiduk 75bb815d99 HBASE-13518 Typo in hbase.hconnection.meta.lookup.threads.core parameter (Devaraj Das) 2015-04-27 23:01:05 -07:00
Srikanth Srungarapu 807142024f HBASE-13537 Change the admin interface for async operations to return Future. 2015-04-26 16:36:13 -07:00
Nick Dimiduk ba6ba16bc0 HBASE-13466 Document deprecations in 1.x - Part 1 (Lars Francke) 2015-04-26 13:13:02 -07:00
Sean Busbey 9eecd43013 HBASE-13546 handle nulls in MasterAddressTracker when there is no master active. 2015-04-24 13:49:15 -05:00
stack 4c97d4b244 HBASE-13523 API Doumentation formatting is broken (Dylan Jones) 2015-04-24 08:06:20 -07:00
ramkrishna bcb2a279c4 HBASE-13501 - Deprecate/Remove getComparator() in HRegionInfo. (Ram) 2015-04-23 12:12:36 +05:30
Jonathan Lawlor afd7a8f474 HBASE-13527 The default value for hbase.client.scanner.max.result.size is never actually set on Scans
Signed-off-by: stack <stack@apache.org>
2015-04-22 13:29:18 -07:00
ramkrishna 2396020752 HBASE-13502 - Deprecate/remove getRowComparator() in TableName (Ram) 2015-04-22 09:24:00 +05:30
Devaraj Das d314f7d9e0 HBASE-13460. Revise the MetaLookupPool executor-related defaults (introduced in HBASE-13036). 2015-04-15 07:56:25 -07:00
zhangduo fe9180d79e HBASE-13499 AsyncRpcClient test cases failure in powerpc 2015-04-14 23:00:07 +08:00
Enis Soztutar 92e922e11d HBASE-13491 Issue in FuzzyRowFilter#getNextForFuzzyRule (Anoop Sam John) 2015-04-17 21:54:41 -07:00
Jonathan Lawlor abe3796a99 HBASE-13090 Progress heartbeats for long running scanners
Signed-off-by: stack <stack@apache.org>
2015-04-17 15:42:46 -07:00
stack 0dfeba3d78 HBASE-13487 Doc KEEP_DELETED_CELLS 2015-04-17 08:27:45 -07:00
Matteo Bertozzi e9da064ccd HBASE-13457 SnapshotExistsException doesn't honor the DoNotRetry 2015-04-13 23:21:50 +01:00
Matteo Bertozzi f6512065c2 HBASE-13290 Procedure v2 - client enable/disable table sync (Stephen Yuan Jiang) 2015-04-10 18:53:43 +01:00
Matteo Bertozzi 6a6e3f46fd HBASE-13204 Procedure v2 - client create/delete table sync 2015-04-10 18:53:42 +01:00
Matteo Bertozzi b5f1f98a25 HBASE-13203 Procedure v2 - master create/delete table 2015-04-10 18:53:42 +01:00
Mikhail Antonov 1deadb60d1 HBASE-13270 Setter for Result#getStats is #addResults; confusing!
Signed-off-by: stack <stack@apache.org>
2015-04-09 10:44:30 -07:00
Jonathan Lawlor 62d47e175c HBASE-13421 Reduce the number of object creations introduced by HBASE-11544 in scan RPC hot code paths
Signed-off-by: stack <stack@apache.org>
2015-04-08 14:02:49 -07:00
stack 8cd3001f81 Revert "HBASE-11544 [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME"
References the wrong JIRA above so revert; also an addendum is on the
way.

This reverts commit 26ba621e47.
2015-04-08 09:32:09 -07:00
Jonathan Lawlor 26ba621e47 HBASE-11544 [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Added in some check-style fixes to bring us back under the limit

Signed-off-by: stack <stack@apache.org>
2015-04-08 08:16:54 -07:00
Ashish Singhi 4d5a11e082 HBASE-13299 Add setReturnResults() to Increment, like Append has
Signed-off-by: stack <stack@apache.org>
2015-04-07 11:46:56 -07:00
Ashish Singhi 8c740f4309 HBASE-13411 Misleading error message when request size quota limit exceeds
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-06 22:31:07 +01:00
Andrew Purtell 8c707499ba HBASE-13409 Add categories to uncategorized tests 2015-04-06 11:02:18 -07:00
Jonathan Lawlor 057499474c HBASE-13374 Small scanners (with particular configurations) do not return all rows
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-04-05 14:27:23 -07:00
Mikhail Antonov 578df6dfc0 HBASE-13252 Get rid of managed connections and connection caching
Signed-off-by: stack <stack@apache.org>
2015-04-02 12:00:42 -07:00
Josh Elser ffdcc00952 HBASE-13335 Use serverHasMoreResults context in SmallScanner and SmallReversedScanner.
Use the context passed back via ScanResponse that a RegionServer
fills in to denote whether or not more results existing in the
current Region. Add a simple factory to remove a static method
used across both SmallScanner and SmallReverseScanner. Add new
unit tests for both scanner classes to test scans with and
without the new context (as a quick backward-compatibility test).
2015-03-31 21:32:49 -07:00
Elliott Clark 55a5a3be33 HBASE-13364 Make error prone off by default 2015-03-30 16:03:53 -07:00
stack 3815a33e34 HBASE-13361 Remove or undeprecate {get|set}ScannerCaching in HTable (Lars Francke) 2015-03-30 08:16:23 -07:00
Josh Elser ced0e324a1 HBASE-13262 Observe ScanResponse.moreResults in ClientScanner.
The RS already returns to the client whether or not it has additional
results to be returned in a subsequent call to scan(), but the ClientScanner
did not use or adhere to this value. Subsequently, this can lead to
bugs around moving to the next region too early. A new method was added
to ClientScanner in the name of testability.

Encapsulate server-state into RegionServerCallable to avoid
modifying parameterization of callable impls.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-28 18:56:52 -07:00
Josh Elser 98b1e72d1c HBASE-13222 Add isBalancerEnabled method to Master and Admin.
Include some basic tests for the method on a testing cluster.
Also update master page to show an alert when balancer is disabled.

Signed-off-by: Enis Soztutar <enis@apache.org>
2015-03-27 14:28:03 -07:00
Sameet Agarwal ba6345f7d1 HBASE-13316 Reduce the downtime on planned moves of regions
Summary:
The current behavior of a region move shuts down a region and then starts is up in another regionserver. This causes increased latency and possibly timeouts till the new region's cache is fully warmed up. We can make a region move less disruptive by warming the cache in the destination region server before shutting dow the old region.

See https://issues.apache.org/jira/browse/HBASE-13316

Test Plan:
1. Unit Tests
2. Added test for concurrent moves and warmups
3. Manually tested reads/writes happening with concurrent moves

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D35967

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-27 11:48:01 -07:00
Andrey Stepachev e26c4e4e67 HBASE-5238 Add a log4j category for all edits to META/ROOT 2015-03-25 23:03:18 +00:00
Elliott Clark 134b95579c HBASE-13325 Protocol Buffers 2.5 no longer available for download on code.google.com 2015-03-25 14:05:34 -07:00
stack 50daed268e HBASE-13298 Clarify if Table.{set|get}WriteBufferSize() is deprecated or not 2015-03-25 13:10:04 -07:00
stack 04740703e9 HBASE-13248 Make HConnectionImplementation top-level class; ADDENDUM -- missing file 2015-03-25 11:11:38 -07:00
Ashish Singhi b5c4d9a04f HBASE-13305 Get(Get get) is not copying the row key
Signed-off-by: stack <stack@apache.org>
2015-03-25 07:39:05 -07:00
stack 8579c6dd49 HBASE-13248 Make HConnectionImplementation top-level class 2015-03-25 07:25:44 -07:00
Mikhail Antonov 8cb4f89c01 HBASE-13273 Make Result.EMPTY_RESULT read-only; currently it can be modified
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-03-24 12:33:02 -07:00
Matteo Bertozzi 80d230e1fb HBASE-13314 Fix NPE in HMaster.getClusterStatus() 2015-03-24 09:28:06 +00:00
Nick Dimiduk 5459008ccd HBASE-13315 BufferedMutator should be @InterfaceAudience.Public (addendum) 2015-03-23 16:38:32 -07:00
zhangduo 6e9ded51fb HBASE-13310 Fix high priority findbugs warnings 2015-03-24 06:50:04 +08:00
Nick Dimiduk 1428a59caf HBASE-13315 BufferedMutator should be @InterfaceAudience.Public (Solomon Duskis) 2015-03-23 12:16:29 -07:00
Nicolas Liochon 6d4460341e HBASE-13286 Minimum timeout for a rpc call could be 1 ms instead of 2 seconds 2015-03-20 19:09:43 +01:00
stack 34347a3639 HBASE-13274 Fix misplaced deprecation in Delete#addXYZ (Mikhail Antonov) 2015-03-20 09:43:56 -07:00
stack f57dca5e1b HBASE-13198 Remove HConnectionManager (Mikhail Antonov) 2015-03-20 09:41:48 -07:00
Liu Shaohui 602e11cc74 HBASE-13216 Add version info in RPC connection header (Shaohui Liu) 2015-03-19 10:30:55 +08:00
Andrey Stepachev 7a08ad9df8 HBASE-13093 Local mode HBase instance doesn't shut down. 2015-03-17 14:46:30 +00:00
stack a75a2ace4f HBASE-13193 RegionScannerImpl filters should not be reset if a partial Result is returned (Jonathan Lawlor) 2015-03-16 13:26:34 -07:00
stack c5aca1919d HBASE-12586 Task 6 & 7 from HBASE-9117, delete all public HTable constructors and delete ConnectionManager#{delete,get}Connection (Mikhail Antonov) 2015-03-16 11:20:14 -07:00
Josh Elser 72855c584e HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-13 22:35:52 -05:00
Jonathan M Hsieh aedd0ebe9b HBASE-13230 [mob] reads hang when trying to read rows with large mobs (>10MB) 2015-03-13 10:45:46 -07:00
anoopsjohn 0f69ea409f HBASE-13232 ConnectionManger : Batch pool threads and metaLookup pool threads should use different name pattern. 2015-03-13 22:51:29 +05:30
tedyu 1cc1142379 HBASE-13162 Addendum adds InterfaceAudience annotation to ZkAclReset 2015-03-12 19:10:03 -07:00
Jonathan M Hsieh 3509cc2134 HBASE-13162 Add capability for cleaning hbase acls to hbase cleanup script (Srikanth Srungarapu) 2015-03-12 17:06:27 -07:00
tedyu 7a3ea23704 HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 18:24:12 -07:00
Enis Soztutar c938267db3 HBASE-13063 Allow to turn off memstore replication for region replicas - ADDENDUM for turning of primary flush tigger when this is enabled 2015-03-11 14:56:54 -07:00
stack b436db7d70 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer; ADDENDUM 2015-03-10 22:17:08 -07:00
Matteo Bertozzi cbf03787ea HBASE-13063 Allow to turn off memstore replication for region replicas 2015-03-10 10:02:04 +00:00
zhangduo 9b53a1c214 HBASE-12405 WAL accounting by Store 2015-03-10 13:00:02 +08:00
Enis Soztutar 5025d3aa91 HBASE-13121 Async wal replication for region replicas and dist log replay does not work together 2015-03-09 15:49:09 -07:00
Andrey Stepachev 948746ce4e HBASE-12990 MetaScanner should be replaced by MetaTableAccessor 2015-03-09 10:39:59 +00:00
Enis Soztutar 95fc53f105 HBASE-12706 Support multiple port numbers in ZK quorum string (Stephen Yuan Jiang) 2015-03-06 16:46:17 -08:00
stack 9159c82fbf HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer 2015-03-06 14:35:08 -08:00
tedyu 8449251fb6 HBASE-13122 Improve efficiency for return codes of some filters (Shuaifeng) 2015-03-05 18:42:22 -08:00
Jonathan M Hsieh 47ed5cd7ed HBASE-13012 Add shell commands to trigger the mob file compactor (Jingcheng Du and Jiajia Li) 2015-03-04 23:47:05 -08:00
stack 74837d9b1f Revert " HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer"
OVERCOMMIT. REVERT.

This reverts commit 55f8f56ad2.
2015-03-04 22:58:02 -08:00
stack 55f8f56ad2 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer
Rename ByteBufferReservoir as BoundedByteBufferPool
2015-03-04 22:44:20 -08:00
Jonathan Lawlor de9791e91e HBASE-11544: [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Signed-off-by: stack <stack@apache.org>
2015-03-04 17:34:48 -08:00
Misty Stanley-Jones 39425a8558 HBASE-11670 Generate PDF of Reference Guide 2015-03-05 09:31:11 +10:00
Lars Hofhansl 464e7ce685 HBASE-13109 Make better SEEK vs SKIP decisions during scanning. 2015-03-04 14:03:47 -08:00
Enis Soztutar 9899aab12b HBASE-11580 Failover handling for secondary region replicas 2015-03-03 11:48:12 -08:00
tedyu e0019d99de HBASE-13122 Revert pending answer to Ram's question 2015-03-02 21:00:26 -08:00
Andrew Purtell 0c63eeb511 HBASE-12995 Document that HConnection#getTable methods do not check table existence since 0.98.1 2015-03-02 16:58:45 -08:00
tedyu 7b5c9eabac HBASE-13122 Improve efficiency for return codes of some filters (Shuaifeng Zhou) 2015-03-02 07:47:33 -08:00
tedyu 4980bfe642 HBASE-13134 mutateRow and checkAndMutate apis don't throw region level exceptions (Francis Liu) 2015-03-01 20:22:07 -08:00
Sean Busbey dad2474f08 HBASE-13131 ReplicationAdmin must clean up connections if constructor fails. 2015-03-01 00:20:44 -06:00
zhangduo 21f12ce8e5 HBASE-13097 addendum use default ByteBufAllocator
Signed-off-by: stack <stack@apache.org>
2015-02-27 17:18:59 -08:00
zhangduo d1619bceb3 HBASE-13097 Use same EventLoopGroup for different AsyncRpcClients if possible
Signed-off-by: stack <stack@apache.org>
2015-02-27 08:34:46 -08:00
Nick Dimiduk c651271f57 HBASE-13086 Show ZK root node on Master WebUI 2015-02-24 19:04:12 -08:00
Ashish Singhi 913ea2c222 HBASE-13048 Use hbase.crypto.wal.algorithm in SecureProtobufLogReader while decrypting the data
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-24 18:18:07 -08:00
Devaraj Das 70412d886c HBASE-13067. Fix caching of stubs to allow IP address changes of restarted remote servers. 2015-02-23 22:15:03 -08:00
zhangduo b20675f5af HBASE-12953 RegionServer is not functionally working with AysncRpcClient in secure mode
Signed-off-by: stack <stack@apache.org>
2015-02-23 20:38:19 -08:00
Enis Soztutar e405017a31 HBASE-12561 Replicas of regions can be cached from different instances of the table in MetaCache 2015-02-23 11:06:17 -08:00
Jonathan M Hsieh fe335b683c Merge branch 'master' (2/11/15) into hbase-11339
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/TagType.java
	hbase-common/src/main/resources/hbase-default.xml
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java
	hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestAcidGuarantees.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/HFileLink.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/DisabledTableSnapshotHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/StripeCompactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/RestoreSnapshotHelper.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotReferenceUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.java
	pom.xml
	src/main/docbkx/book.xml
	src/main/docbkx/ops_mgt.xml
	src/main/docbkx/schema_design.xml
2015-02-22 12:54:45 -08:00
tedyu 9a311303a8 HBASE-13057 Provide client utility to easily enable and disable table replication (Ashish Singhi) 2015-02-20 10:18:47 -08:00
Ashish Singhi 31f17b17f0 HBASE-13002 Make encryption cipher configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-18 11:42:20 -08:00
Devaraj Das 14bb352b02 HBASE-13036. Meta scanner should use its own threadpool 2015-02-18 10:23:02 -08:00
zhangduo 20bc74dff0 HBASE-13066 Fix typo in AsyncRpcChannel
Signed-off-by: stack <stack@apache.org>
2015-02-18 09:43:27 -08:00
zhangduo e99091e97c HBASE-13011 TestLoadIncrementalHFiles is flakey when using AsyncRpcClient as client implementation
Added comment to AsyncRpcChannel data members

Signed-off-by: stack <stack@apache.org>
2015-02-16 09:03:31 -08:00
Sean Busbey c96df5e240 HBASE-13027 Ensure extension of TableInputFormatBase works.
* move mapreduce version of TableInputFormat tests out of mapred
* add ability to get runnable job via MR test shims
* correct the javadoc example for current APIs.
* add tests the run a job based on the extending TableInputFormatBase (as given in the javadocs)
* add tests that run jobs based on the javadocs from 0.98
* fall back to our own Connection if ussers of the deprecated table configuration have a managed connection.
2015-02-13 18:41:04 -06:00
stack 3babad30e6 HBASE-13030 [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn 2015-02-13 15:24:38 -08:00
Enis Soztutar 3e10e6e1a6 HBASE-11569 Flush / Compaction handling from secondary region replicas 2015-02-13 11:08:24 -08:00
Ashish Singhi 16ed345191 HBASE-9531 a command line (hbase shell) interface to retreive the replication metrics and show replication lag
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-12 14:50:01 -08:00
Andrew Purtell dc522d010c HBASE-12996 Reversed field on Filter should be transient (Ian Friedman) 2015-02-11 12:17:51 -08:00
stack dec0ec2290 HBASE-13016 Clean up remnants of table states stored in table descriptors (Andrey Stepachev) 2015-02-11 11:09:03 -08:00
stack fa852c4ce6 HBASE-12035 Keep table state in META (Andrey Stepachev) 2015-02-10 14:20:47 -08:00
Jeffrey Zhong 3f4427739d HBASE-11567 Write bulk load COMMIT events to WAL (Alex Newman, Jeffrey Zhong) 2015-02-06 18:07:30 -08:00
stack 96cdc7987e HBASE-12958 SSH doing hbase:meta get but hbase:meta not assigned 2015-02-04 22:56:40 -08:00
Victoria Dudin 4f472062a4 HBASE-12961 Fix negative values in read and write region server metrics. 2015-02-04 10:32:09 -08:00
Devaraj Das cf5ad96fcc HBASE-10942. support parallel request cancellation for multi-get (Nicolas Liochon & Devaraj Das) 2015-02-02 23:01:31 -08:00
zhangduo fef78acf65 HBASE-12951 TestHCM.testConnectionClose is flakey when using AsyncRpcClient as client implementation
Signed-off-by: stack <stack@apache.org>
2015-02-02 08:27:57 -08:00
stack 538388c2b5 HBASE-6778 Deprecate Chore; its a thread per task when we should have one thread to do all tasks (Jonathan Lawlor) 2015-01-29 19:26:26 -08:00
Lars Hofhansl 1270e590d1 HBASE-12859 New master API to track major compaction completion. 2015-01-29 13:58:27 -08:00
Devaraj Das 6b20a0f831 HBASE-11574. hbase:meta's regions can be replicated 2015-01-27 16:40:29 -08:00
tedyu aaeafca920 HBASE-7847 Use zookeeper multi to clear znodes (Rakesh R) 2015-01-26 21:40:39 -08:00
Enis Soztutar 2fb19fb951 HBASE-11908 Region replicas should be added to the meta table at the time of table creation 2015-01-26 19:55:47 -08:00
tedyu 26b8b48b42 HBASE-12915 Disallow small scan with batching 2015-01-26 10:58:53 -08:00
stack a4be1b84e4 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous) -- SMALL AMENDMENT 2015-01-24 18:24:32 -08:00
Jurriaan Mous 854f13afa1 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>
2015-01-24 18:05:39 -08:00
Nick Dimiduk 588b43b06b HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum) 2015-01-23 14:45:21 -08:00
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Andrew Purtell 71ab4ddb19 HBASE-12731 Heap occupancy based client pushback 2015-01-22 17:33:21 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
Nick Dimiduk 9bdb81f0a1 HBASE-12887 Cleanup many checkstyle errors in o.a.h.h.client 2015-01-20 12:44:36 -08:00
Andrew Purtell 03e17168c3 HBASE-12840 Improve unit test coverage of the client pushback mechanism 2015-01-17 11:50:26 -08:00
Enis Soztutar 092c91eb0f HBASE-12837 ReplicationAdmin leaks zk connections (stack) 2015-01-16 13:16:12 -08:00
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
tedyu e5f3dd682f HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:02:06 -08:00
Andrew Purtell c32a2c0b16 HBASE-12839 Remove synchronization in ServerStatisticsTracker 2015-01-12 16:06:51 -08:00
Enis Soztutar 8816fa05c2 HBASE-12832 Describe table from shell no longer shows Table's attributes, only CF attributes (Srikanth Srungarapu) 2015-01-12 14:00:22 -08:00
Nick Dimiduk dde713ee4e HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:17:00 -08:00
tedyu 9246af8dac HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous) 2015-01-08 07:49:28 -08:00
Enis Soztutar c348cd327b HBASE-12788 Promote Abortable to LimitedPrivate 2015-01-05 16:29:27 -08:00
tedyu ac95cc1fbb HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 19:48:06 -08:00
Jurriaan Mous e5ec14af04 HBASE-12761 On region jump ClientScanners should get next row start key instead of a skip.
Signed-off-by: stack <stack@apache.org>
2014-12-30 14:47:01 -08:00
Esteban Gutierrez b2eea8cac6 HBASE-12695 JDK 1.8 compilation broken
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
stack a8766fd623 HBASE-12641 Grant all permissions of hbase zookeeper node to hbase superuser in a secure cluster (Liu Shaohui) 2014-12-27 21:11:57 -08:00
stack 2b090d6832 HBASE-12739 Avoid too large identifier of ZooKeeperWatcher (Liu Shaohui) 2014-12-23 12:20:30 -08:00
Jurriaan Mous 4880e5d83b HBASE-12736
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:30:25 -08:00
tedyu 700de7d92c HBASE-12750 getRequestsCount() in ClusterStatus returns total number of request (Weichen Ye) 2014-12-23 10:26:16 -08:00
Devaraj Das 1c45d1cd9d HBASE-12012. Improve cancellation for the scan RPCs 2014-12-22 16:22:04 -08:00
stack b004e4ff5b HBASE-11412 Minimize a number of hbase-client transitive dependencies (Sergey Beryozkin) 2014-12-19 07:55:53 -08:00
Enis Soztutar 83e4bfaf73 HBASE-11412 Minimize a number of hbase-client transitive dependencies (Sergey Beryozkin) 2014-12-17 21:53:18 -08:00
Andrew Purtell 99a11390b4 Amend HBASE-5162 Basic client pushback mechanism (Jesse Yates)
Applied hbase-5162-trunk-addendum.patch
2014-12-16 22:15:49 -08:00
Andrew Purtell 6a042c381a Revert "HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM"
This reverts commit f7154e1ac9.
2014-12-16 22:14:50 -08:00
stack f7154e1ac9 HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM 2014-12-16 21:09:52 -08:00
zhangduo c7fad665f3 HBASE-10201 Port 'Make flush decisions per column family' to trunk
Signed-off-by: stack <stack@apache.org>
2014-12-16 11:49:17 -08:00
Jesse Yates a411227b0e HBASE-5162 Basic client pushback mechanism
Instead of just blocking the client for 90 seconds when the region gets too
busy, it now sends along region load stats to the client so the client can
know how busy the server is. Currently, its just the load on the memstore, but
it can be extended for other stats (e.g. cpu, general memory, etc.).

It is then up to the client to decide if it wants to listen to these stats.
By default, the client ignores the stats, but it can easily be toggled to the
built-in exponential back-off or users can plug in their own back-off
implementations
2014-12-16 11:14:30 -08:00
stack 029768287a HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test 2014-12-14 19:42:15 -08:00
Enis Soztutar 743d16138e HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate 2014-12-14 17:46:30 -08:00
tedyu 65830b096b HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu) 2014-12-13 10:17:43 -08:00
Jurriaan Mous 3275b964c1 HBASE-12668 Adapt PayloadCarryingRpcController so it can also be used in an async way
Signed-off-by: stack <stack@apache.org>
2014-12-12 07:44:04 -08:00
Misty Stanley-Jones 7d10af1254 HBASE-9763 Scan javadoc doesn't fully capture semantics of start and stop row (Gabriel Reid) 2014-12-12 13:39:16 +10:00
stack da2b5a9627 HBASE-12373 Provide a command to list visibility labels (Jerry He) 2014-12-11 15:18:03 -08:00
stack df22270756 HBASE-12665 When aborting, dump metrics
Add some fixup of checkstyle fails
2014-12-09 21:01:15 -08:00
Nick Dimiduk e720c83557 HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis) 2014-12-09 11:27:34 -08:00
Matteo Bertozzi 8a2c84156a HBASE-12564 consolidate the getTableDescriptors() semantic 2014-12-09 12:06:00 +00:00
Jurriaan Mous a8e6461855 HBASE-12597
Signed-off-by: stack <stack@apache.org>
2014-12-08 15:40:09 -08:00
stack 1a27cb7b0f Revert "HBASE-12597 Add RpcClient interface and enable changing of RpcClient implementation (Jurriaan Mous)"
Revert partial commit of HBASE-12597

This reverts commit 4be2034a26.
2014-12-08 15:35:50 -08:00
stack b8ab1b176c Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
Accidental commit. Reverting.

This reverts commit 2458be08ed.
2014-12-08 15:34:53 -08:00
stack 4be2034a26 HBASE-12597 Add RpcClient interface and enable changing of RpcClient implementation (Jurriaan Mous) 2014-12-08 15:13:50 -08:00
stack 2458be08ed HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-12-08 15:04:59 -08:00
stack 4b1983c89d HBASE-12611 Create autoCommit() method and remove clearBufferOnFail (Solomon Duskis) 2014-12-08 11:01:28 -08:00
tedyu 9e9be97af7 HBASE-12650 Move ServerName to hbase-common module - check in changed files 2014-12-08 07:08:44 -08:00
tedyu e930510c65 HBASE-12650 Move ServerName to hbase-common module - remove files 2014-12-08 07:01:47 -08:00
Devaraj Das 9fd6db3703 HBASE-11903. Directly invoking split & merge of replica regions should be disallowed 2014-12-07 11:56:53 -08:00
Gary Helmling b7d1790411 HBASE-12493 Addendum - Fix javadoc warnings 2014-12-06 00:33:12 -08:00
Gary Helmling 1ec6609b97 HBASE-12493 Make User and TokenUtil public 2014-12-05 13:04:54 -08:00
Andrew Purtell 09cd3d7bfb HBASE-10560 Per cell TTLs 2014-12-05 11:10:26 -08:00
stack c45772e76a HBASE-12431 Use of getColumnLatestCell(byte[], int, int, byte[], int, int) is Not Thread Safe (Jingcheng Du) 2014-12-03 22:34:27 -08:00
stack 7a3396f0e1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 10:06:21 -08:00
stack 1a9b556474 Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
This reverts commit 8b8f2026bd.

Overcommit. Added "HBASE-12490 Replace uses of setAutoFlush(boolean,
boolean)" by mistake

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterStatusListener.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
2014-12-02 09:51:19 -08:00
tedyu 2fbbdfd9a1 HBASE-12559 Revert for addressing review comments 2014-12-01 10:38:05 -08:00
stack 56a03d736a HBASE-12603 Remove javadoc warnings introduced due to removal of unused imports (Varun Saxena) 2014-12-01 10:13:16 -08:00
Ramkrishna b6b88edf93 HBASE-11639 [Visibility controller] Replicate the visibility of Cells as
strings (Ram)
2014-12-01 23:03:52 +05:30
tedyu 41041e8d6a HBASE-12559 Provide LoadBalancer with online configuration capability 2014-12-01 07:30:17 -08:00
stack 555e78005d HBASE-12526 Remove unused imports (Varun Saxena) 2014-11-29 09:20:46 -08:00
stack 58b6b24c29 HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-28 20:50:02 -08:00
Jeffrey Zhong f0d95e7f11 HBASE-12533: staging directories are not deleted after secure bulk load 2014-11-26 16:23:11 -08:00
Enis Soztutar 02963b202a HBASE-12072 Standardize retry handling for master operations 2014-11-26 12:09:44 -08:00
Enis Soztutar 54627ea6dc HBASE-12128 Cache configuration and RpcController selection for Table in Connection 2014-11-26 12:07:49 -08:00
stack 8df780db88 HBASE-12400 Fix refguide so it does connection#getTable rather than new HTable everywhere 2014-11-26 09:12:16 -08:00
stack 8b8f2026bd HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-11-25 21:21:50 -08:00
stack e6b4300756 HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
HConnection#getTable (0.98, 0.99)

Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
till end of time to do all and some cases are cryptic. Also skipped
some mapreduce where HTable comes through in API. Can do both of
these stragglers in another issue.
Generally, if a utility class or standalone class, tried to pass in a
Connection rather than have the utility or standalone create its own
connection on each invocation; e.g. the Quota stuff. Where not possible,
noted where invocation comes from... if test or hbck, didn't worry about
it.
Some classes are just standalone and nothing to be done to avoid
a Connection setup per invocation (this is probably how it worked
in the new HTable...days anyways). Some classes are not used:
AggregationClient, FavoredNodes... we should just purge this stuff.
Doc on what short circuit connection does (I can just use it...
I thought it was just for short circuit but no, it switches dependent
on where you are connecting).
Changed HConnection to super Interface ClusterConnection where safe (
internal usage by private classes only).
Doc cleanup in example usage so we do new mode rather than the old
fashion.
Used java7 idiom that allows you avoid writing out finally to call close
on implementations of Closeable.
Added a RegistryFactory.. moved it out from being inner class.
Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
to create a Scan that can ...
Renamed getShortCircuitConnection as getConnection – users don't need
to know what implementation does (that it can short-circuit RPC).
The old name gave pause. I was frightened to use it thinking it only
for short-circuit reading – that it would not do remote too.
Squashed commit of the following:
2014-11-25 08:15:20 -08:00
stack 336c22d581 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
2014-11-24 09:46:28 -08:00
Enis Soztutar 882324dbcc HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 11:44:46 -08:00