Commit Graph

1113 Commits

Author SHA1 Message Date
Elliott Clark 48e217a7db HBASE-14946 Don't allow multi's to over run the max result size.
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens

Test Plan: Added a unit test

Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:10:32 -08:00
stack bebcc09fb3 HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin 2015-12-10 15:02:21 -08:00
Nate Edel 9511150bd6 HBASE-14901 Remove duplicate code to create/manage encryption keys
Signed-off-by: Gary Helmling <garyh@apache.org>
2015-12-10 14:38:43 -08:00
ramkrishna 26ac60b03f HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:07:46 +05:30
Gary Helmling c1e0fcc26d HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 15:52:27 -08:00
stack 92e178df28 Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).

This reverts commit 6adce67572.
2015-12-01 11:30:39 -08:00
Apekshit(Appy) Sharma 6adce67572 HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
Apekshit 3bac31b2a4 HBASE-14890 Fix broken checkstyle tool. Some javadocs had parsing errors because of wrongly formatted HTML tags. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-28 21:57:52 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
anoopsjohn daba867734 HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek) 2015-11-24 09:50:56 +05:30
tedyu 9a91f5ac81 HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar) 2015-11-23 20:13:00 -08:00
chenheng ebe5801e00 HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov) 2015-11-19 11:28:18 +08:00
tedyu d738aade2e HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo) 2015-11-18 14:24:47 -08:00
Elliott Clark d6fdf92f9e HBASE-14812 Fix ResultBoundedCompletionService deadlock 2015-11-17 14:41:35 -08:00
Elliott Clark a591df1073 HBASE-14708 Use copy on write Map for region location cache
Summary:
Create and use a copy on write map for region location.

  - Create a copy on write map backed by a sorted array.
  - Create a test for both comparing each with a jdk provided map.
  - Change MetaCache to use the new map.

Test Plan:
  - org.apache.hadoop.hbase.client.TestFromClientSide
  - TestHCM

Differential Revision: https://reviews.facebook.net/D49545
2015-11-17 10:52:43 -08:00
tedyu 789f8a5a70 HBASE-14498 Revert for on-going review 2015-11-12 12:57:23 -08:00
stack 290ecbe829 HBASE-14355 Scan different TimeRange for each column family (Churro Morales) 2015-11-12 10:54:16 -10:00
tedyu b677f2e65d HBASE-14498 Master stuck in infinite loop when all Zookeeper servers are unreachable (Pankaj Kumar) 2015-11-12 07:21:19 -08:00
stack 32de06f663 HBASE-14787 Remove obsolete ConnectionImplementation.refCount (Appy) 2015-11-09 17:08:17 -10:00
chenheng 086bacd12d HBASE-14693 Add client-side metrics for received pushback signals
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-09 18:03:30 -08:00
Apekshit(Appy) Sharma 08963189a2 HBASE-14767 - Remove deprecated functions from HBaseAdmin Deprecated in HBASE-12083 (1.0.0, 2.0.0, 0.99.2) - HBaseAdmin(Configuration)
Deprecated in HBASE-10479 (0.99.0, hbase-10070)
  - HBaseAdmin(Connection)

  Deprecated in HBASE-11826 (0.99.0, 1.0.0, 2.0.0)
  - flush()
  - compact()
  - majorCompact()
  - split()
  - getCompactionState()

- Changes many declarations from HBaseAdmin to Admin
(Apekshit)

Signed-off-by: stack <stack@apache.org>
2015-11-06 16:23:55 -10:00
tedyu cfc5348b5e HBASE-14758 Add UT case for unchecked error/exception thrown in AsyncProcess#sendMultiAction (Yu Li) 2015-11-04 07:20:59 -08:00
stack ceddec9141 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-03 20:47:20 -08:00
chenheng 6871724104 HBASE-12986 Compaction pressure based client pushback
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-03 18:32:08 -08:00
stack e4bf77e2de HBASE-14754 TestFastFailWithoutTestUtil failing on trunk now in #testPreemptiveFastFailException50Times 2015-11-03 16:20:55 -08:00
Jesse Yates 1b8b612b8b HBASE-14715 Add javadocs to DelegatingRetryingCallable 2015-11-02 16:20:55 -08:00
stack 9630fec2d5 Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets"
Revert. Seems to have destabilized the build

This reverts commit 6dbb5a8052.
2015-11-02 08:17:41 -08:00
stack 6dbb5a8052 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-01 22:26:43 -08:00
Jonathan M Hsieh 4c25549e9f HBASE-14711 Remove or annotate deprecated methods in HRegionInfo 2015-11-01 04:29:51 -08:00
Elliott Clark ec651bfc7b HBASE-14687 Un-synchronize BufferedMutator
Summary:
Use concurrent collections and atomic longs to keep track of edits in buffered mutator.
This keeps buffered mutator as thread safe but it means that shared buffered mutators are not contending on thread locking.

Test Plan: Unit Tests.

Differential Revision: https://reviews.facebook.net/D49467
2015-10-30 13:27:25 -07:00
Matteo Bertozzi 4b91a6425e HBASE-14714 some cleanup to snapshot code 2015-10-29 13:48:59 -07:00
Jonathan M Hsieh 094d65e6f5 HBASE-14673 Exorcise deprecated Delete#delete* api 2015-10-29 11:15:34 -07:00
Jonathan M Hsieh de9555cec4 HBASE-14675 Exorcise deprecated Put#add(...) and replace with Put#addColumn(...) 2015-10-29 11:15:31 -07:00
tedyu 210c3dd937 HBASE-12769 Replication fails to delete all corresponding zk nodes when peer is removed (Jianwei Cui) 2015-10-27 19:40:40 -07:00
Misty Stanley-Jones e24d03b10c HBASE-14695 Fix some easy HTML warnings and bad links 2015-10-28 12:12:40 +10:00
Enis Soztutar 0e6dd3257b HBASE-14425 In Secure Zookeeper cluster superuser will not have sufficient permission if multiple values are configured in hbase.superuser (Pankaj Kumar) 2015-10-27 16:56:20 -07:00
tedyu f91546f2e6 HBASE-14696 Support setting allowPartialResults in mapreduce Mappers 2015-10-27 07:57:32 -07:00
tedyu a321da2039 HBASE-14694 Scan copy constructor doesn't handle allowPartialResults 2015-10-27 07:51:04 -07:00
Elliott Clark caae3b2e5f HBASE-14683 Fix Batching in buffered mutator is awful when adding lists of mutations.
Summary: Send the list of mutations to AsyncProcess only after done adding the list otherwise there's a lot of contention

Test Plan: UnitTests.

Differential Revision: https://reviews.facebook.net/D49251
2015-10-24 10:05:39 -07:00
Ashish Singhi 467bc098a9 HBASE-13538 Procedure v2 - client add/delete/modify column family sync (incompatible with branch-1.x)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-10-22 13:12:35 -07:00
Matteo Bertozzi 36a196722c HBASE-14669 remove unused import and fix javadoc 2015-10-22 09:25:26 -07:00
Misty Stanley-Jones 2996355e94 HBASE-14603 Lots of work on the POM to enhance Javadocs, Xrefs
* We now have apidocs, devapidocs, testapidocs, and testdevapidocs
* When using reportSets, the Javadoc plugin ignores the plugin configuration,
  so I propagated it to the individual reportSet configuration blocks.
* I was able to remove some of the logic that moved / copied things around
  in post-site.
* We now have xref and xref-test (these are superfluous but something needs them
  so I left them)
* Added source to Javadocs -- you can click a method or property to browse its source.
  More user-friendly than xref maybe.
* You can now get the whole site to build by doing 'mvn clean site site:stage' and
  it takes about 10 minutes.
2015-10-22 19:12:42 +10:00
Misty Stanley-Jones 74d5232065 Revert "Lots of work on the POM to enhance Javadocs, Xrefs"
This reverts commit aa78ebbd5a.
2015-10-22 19:11:40 +10:00
Misty Stanley-Jones aa78ebbd5a Lots of work on the POM to enhance Javadocs, Xrefs
* We now have apidocs, devapidocs, testapidocs, and testdevapidocs
* When using reportSets, the Javadoc plugin ignores the plugin configuration,
  so I propagated it to the individual reportSet configuration blocks.
* I was able to remove some of the logic that moved / copied things around
  in post-site.
* We now have xref and xref-test (these are superfluous but something needs them
  so I left them)
* Added source to Javadocs -- you can click a method or property to browse its source.
  More user-friendly than xref maybe.
* You can now get the whole site to build by doing 'mvn clean site site:stage' and
  it takes about 10 minutes.
2015-10-22 18:29:08 +10:00
tedyu 8e6316a80c HBASE-14458 AsyncRpcClient#createRpcChannel() should check and remove dead channel before creating new one to same server (Samir Ahmic) 2015-10-18 20:49:31 -07:00
Enis Soztutar 6076ed2a12 HBASE-14474 Addendum closes connection in writeRequest() outside synchronized block
This reverts commit 414a7b18b1.
2015-10-16 11:54:22 -07:00
Nicolas Liochon e7defd7d9a HBASE-14521 Unify the semantic of hbase.client.retries.number (Yu Li) 2015-10-15 10:42:40 +02:00
tedyu 8c69b0f751 HBASE-14594 Use new DNS API introduced in HADOOP-12437 (Josh Elser) 2015-10-14 14:17:36 -07:00
stack 940e5404df HBASE-14598 ByteBufferOutputStream grows its HeapByteBuffer beyond JVM limitations (Ian Friedman) 2015-10-14 13:13:01 -07:00
stack b9639d1e82 HBASE-14590 Shorten ByteBufferedCell#getXXXPositionInByteBuffer method name (Anoop Sam John) 2015-10-12 12:33:28 -07:00
stack e37e72c160 Revert "HBASE-14583 Enabled client-side metrics by default"
Causes TestShell to hang. Reverting for now till we figure why.

This reverts commit c7efd14726.
2015-10-10 13:18:48 -07:00
anoopsjohn 4969879df5 HBASE-14366 NPE in case visibility expression is not present in labels table during importtsv run. (Bhupendra) 2015-10-10 12:04:47 +05:30
stack 445dbd8a0e HBASE-14517 Show regionserver's version in master status page (Liu Shaohui) 2015-10-09 15:06:39 -07:00
Nick Dimiduk c7efd14726 HBASE-14583 Enabled client-side metrics by default 2015-10-09 10:17:56 -07:00
Nick Dimiduk 7e30436e3f HBASE-12911 Client-side metrics 2015-10-07 17:01:56 -07:00
Elliott Clark ceafa09d3c HBASE-14544 Allow HConnectionImpl to not refresh the dns on errors 2015-10-05 09:35:40 -07:00
Mikhail Antonov 19045a5ea7 HBASE-14367 Add normalization support to shell 2015-10-04 00:29:39 -07:00
smaddineni 44b8809726 HBASE-13770 Programmatic JAAS configuration option for secure zookeeper may be broken
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-02 17:50:54 -07:00
Matteo Bertozzi 2e8575bb0f HBASE-14485 ConnectionImplementation leaks on construction failure 2015-10-01 12:56:37 -07:00
stack e0929bbc5a HBASE-14510 Fix coprocessor handling of duplicate classes (Yerui Sun) 2015-09-29 15:01:10 -07:00
chenheng 02699fe967 HBASE-14227 Fold special cased MOB APIs into existing APIs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-25 18:28:13 -07:00
tedyu 414a7b18b1 HBASE-14474 Revert addendum 2015-09-25 15:48:08 -07:00
tedyu dc2aa7e513 HBASE-14474 Addendum closes connection in writeRequest() outside synchronized block 2015-09-25 15:18:21 -07:00
Enis Soztutar 32f49fa7fc HBASE-14474 DeadLock in RpcClientImpl.Connection.close() 2015-09-25 11:04:53 -07:00
Andrew Purtell 2239d55871 HBASE-13324 o.a.h.h.Coprocessor should be LimitedPrivate("Coprocessor") 2015-09-24 10:57:32 -07:00
Stephen Yuan Jiang 5b7894f92b HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-23 21:48:32 -07:00
tedyu b6bd811c76 HBASE-14397 Revert pending review comments 2015-09-22 10:00:50 -07:00
tedyu 86cf148894 HBASE-14431 Addendum checks for null connectionInPool (Yu Li) 2015-09-21 07:23:14 -07:00
tedyu 1545e1ed8d HBASE-14431 AsyncRpcClient#removeConnection() never removes connection from connections pool if server fails (Samir Ahmic) 2015-09-19 07:32:04 -07:00
tedyu b0f5233265 HBASE-14449 Rewrite deadlock prevention for concurrent connection close 2015-09-18 14:40:39 -07:00
stack bd26386dc7 HBASE-14433 Set down the client executor core thread count from 256 in tests: REAPPLY AGAIN (WAS MISSING JIRA) 2015-09-16 10:13:55 -07:00
stack b0aa86a694 Revert "Set down the client executor core thread count from 256 in tests: REAPPLY"
Missing JIRA number.

This reverts commit b00f3d3703.
2015-09-16 10:12:39 -07:00
stack b00f3d3703 Set down the client executor core thread count from 256 in tests: REAPPLY 2015-09-16 08:57:06 -07:00
stack 8633b26ee5 Revert "HBASE-14433 Set down the client executor core thread count from 256 to number of processors"
This reverts commit d2e3381818.
2015-09-16 08:53:34 -07:00
stack d2e3381818 HBASE-14433 Set down the client executor core thread count from 256 to number of processors 2015-09-15 22:36:05 -07:00
Apekshit(Appy) Sharma fe2c4f630d HBASE-14400 Fix HBase RPC protection documentation
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-15 17:43:48 -07:00
Samir Ahmic f51c79076d HBASE-13337 Table regions are not assigning back, after restarting all regionservers at once.
Signed-off-by: stack <stack@apache.org>
2015-09-15 06:36:57 -07:00
stack ceff3e242b HBASE-14421 TestFastFail* are flakey; ADDENDUM 2 DISABLE testInterceptorIntercept50Times 2015-09-13 10:33:44 -07:00
stack a9157379a3 HBASE-14421 TestFastFail* are flakey 2015-09-12 22:34:04 -07:00
tedyu 36675c81fb HBASE-14397 PrefixFilter doesn't filter all remaining rows if the prefix is longer than rowkey being compared (Jianwei Cui) 2015-09-11 16:04:31 -07:00
Srikanth Srungarapu 1a19b0ee17 HBASE-14385 Close the sockets that is missing in connection closure. 2015-09-09 23:31:37 -07:00
Nick Dimiduk a11bb2a933 HBASE-14382 TestInterfaceAudienceAnnotations should hadoop-compt module resources 2015-09-09 11:08:28 -07:00
stack a11f5c55b4 HBASE-14308 HTableDescriptor WARN is not actionable (Lars Francke) 2015-09-04 22:44:21 -07:00
Andrew Purtell 2481b7f76f HBASE-14359 HTable#close will hang forever if unchecked error/exception thrown in AsyncProcess#sendMultiAction (Victor Xu) 2015-09-03 17:48:45 -07:00
Stephen Yuan Jiang 3341f13e71 HBASE-14108 Procedure V2 Administrative Task: provide an API to abort a procedure (Stephen Yuan Jiang) 2015-09-02 19:18:46 -07:00
tedyu df341c4299 HBASE-14309 Allow load balancer to operate when there is region in transition by adding force flag 2015-08-29 13:15:53 -07:00
Elliott Clark cc1542828d HBASE-14313 After a Connection sees ConnectionClosingException it never recovers -- ADDENDUM 2015-08-27 15:23:43 -07:00
Elliott Clark 56890d9fe1 HBASE-14313 After a Connection sees ConnectionClosingException on a connection it never recovers 2015-08-26 13:44:12 -07:00
tedyu 6661f2d025 HBASE-14269 FuzzyRowFilter omits certain rows when multiple fuzzy keys exist (hongbin ma) 2015-08-26 07:23:43 -07:00
stack 3dacee674c HBASE-14290 Spin up less threads in tests 2015-08-25 16:16:03 -07:00
stack d0873f5a8c HBASE-14224 Fix coprocessor handling of duplicate classes 2015-08-24 13:47:19 -07:00
stack b85857cf3c HBASE-13480 ShortCircuitConnection doesn't short-circuit all calls as expected (Jingcheng Du and Josh Elser) 2015-08-24 12:29:46 -07:00
tedyu 16f8d27708 HBASE-14241 Fix deadlock during cluster shutdown due to concurrent connection close 2015-08-19 08:49:38 -07:00
Enis Soztutar 395ec5a9bb HBASE-14203 remove duplicate code getTableDescriptor in HTable (Heng Chen) 2015-08-17 16:05:26 -07:00
Enis Soztutar 2ed7f9bb1d HBASE-14122 Client API for determining if server side supports cell level security - ADDENDUM for javadoc fix 2015-08-17 14:04:28 -07:00
Andrew Purtell 5e5bcceb53 HBASE-14122 Client API for determining if server side supports cell level security 2015-08-12 13:26:55 -07:00
Elliott Clark 38b94709ee HBASE-14208 Remove yarn dependencies on -common and -client 2015-08-11 13:00:13 -07:00
tedyu a2dbe31b26 HBASE-14206 MultiRowRangeFilter returns records whose rowKeys are out of allowed ranges (Anton Nazaruk) 2015-08-11 09:40:13 -07:00
Nick Dimiduk e4106b4c4a Revert "HBASE-12911 Client-side metrics"
This reverts commit 06989fd1f9.
2015-08-10 17:13:09 -07:00
Nick Dimiduk 06989fd1f9 HBASE-12911 Client-side metrics
First pass. Plumbs up metrics for each connection instance. Exposes
static information about those connections (zk quorum and root node,
cluster id, user). Exposes basic thread pool utilization gauges for
"meta lookup" and "batch" pools.
2015-08-10 16:48:48 -07:00