Commit Graph

902 Commits

Author SHA1 Message Date
Andrew Purtell 8e4516536c HBASE-25292 Improve InetSocketAddress usage discipline (#2669)
Network identities should be bound late. Remote addresses should be
resolved at the last possible moment, just before connect(). Network
identity mappings can change, so our code should not inappropriately
cache them. Otherwise we might miss a change and fail to operate normally.

Revert "HBASE-14544 Allow HConnectionImpl to not refresh the dns on errors"
Removes hbase.resolve.hostnames.on.failure and related code. We always
resolve hostnames, as late as possible.

Preserve InetSocketAddress caching per RPC connection. Avoids potential
lookups per Call.

Replace InetSocketAddress with Address where used as a map key. If we want
to key by hostname and/or resolved address we should be explicit about it.
Using Address chooses mapping by hostname and port only.

Add metrics for potential nameservice resolution attempts, whenever an
InetSocketAddress is instantiated for connect; and metrics for failed
resolution, whenever InetSocketAddress#isUnresolved on the new instance
is true.

* Use ServerName directly to build a stub key

* Resolve and cache ISA on a RpcChannel as late as possible, at first call

* Remove now invalid unit test TestCIBadHostname

We resolve DNS at the latest possible time, at first call, and do not
resolve hostnames for creating stubs at all, so this unit test cannot
work now.

Reviewed-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-12-04 10:19:53 -08:00
Andrew Purtell 30d988f6e2
HBASE-24640 [branch-1] Purge use of VisibleForTesting (#2697)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-11-25 14:25:24 -08:00
WenFeiYi 18e9660962
HBASE-25240 gson format of RpcServer.logResponse is abnormal
Closes #2623

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-11-05 20:25:43 +05:30
Andrew Purtell 8813b3bfc1 HBASE-25227 [branch-1] Fix Java 11 runtime issue in UnsafeAccess #2594
Reapply with corrected commit message.

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-10-29 14:40:21 -07:00
Andrew Purtell 60105e1b22 Revert "HBASE-25227 [branch-1] Fix Java 11 runtime issue in UnsafeAccess (#2594)"
This reverts commit 2e3f842dc7.
2020-10-29 14:40:01 -07:00
Andrew Purtell 2e3f842dc7
HBASE-25227 [branch-1] Fix Java 11 runtime issue in UnsafeAccess (#2594) 2020-10-29 14:33:38 -07:00
sguggilam 0b48208bd5
HBASE-24768 Clear cached service kerberos ticket in case of SASL failures (#2578)
Signed-off-by: Aman Poonia <aman.poonia.29@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-10-29 14:23:52 -07:00
Viraj Jasani fb25a7d530
HBASE-23935 : Backport HBASE-22978, HBASE-24528, HBASE-24718 to branch-1 (#2312)
* HBASE-22978: Online slow response log (with sub-tasks: Large logs, Replicate logs to HDFS, Filter support in query)
* HBASE-24718: Generic NamedQueue framework for recent in-memory history
* HBASE-24528: Improve balancer decision observability

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-10-16 12:21:17 +05:30
Bharath Vissapragada ebe9e68274
HBASE-23305: Implement master based registry for client connections
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-09-19 15:01:06 -07:00
Sean Busbey af18670665
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe
* refactor how we use connection to rely on the access method
* refactor initialization and cleanup of the shared connection
* incompatibly change HCTU's Configuration member variable to be final so it can be safely accessed from multiple threads.

Closes #2188

adapted for jdk7

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 86ebbdd8a2)
(cherry picked from commit 0806349ada)
2020-08-04 11:15:02 -05:00
Viraj Jasani dd4417a9e2
HBASE-24757 : ReplicationSink should limit row count in batch mutation based on hbase.rpc.rows.warning.threshold (#2146)
Closes #2127

Signed-off-by: stack <stack@apache.org>
2020-07-28 01:10:02 +05:30
Bo Cui 0841f12e4e
HBASE-24693 regioninfo#isLast() should point to EMPTY_END_ROW (readability improvement)
Closes #2051

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-14 15:48:16 +05:30
Bharath Vissapragada 32690e1e89
HBASE-24603: Make Zookeeper sync() call synchronous (#1945) (#1976)
Writing a test for this is tricky. There is enough coverage for
functional tests. Only concern is performance, but there is enough
logging for it to detect timed out/badly performing sync calls.

Additionally, this patch decouples the ZK event processing into it's
own thread rather than doing it in the EventThread's context. That
avoids deadlocks and stalls of the event thread.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 84e246f9b1)
(cherry picked from commit 2379a25f0c)
2020-06-25 18:36:14 -07:00
Anoop Sam John 81ee344439
HBASE-24189 WALSplit recreates region dirs for deleted table with recovered edits data. 2020-06-13 22:21:49 +05:30
thangTang d3d527637f
HBASE-24485 Backport to branch-1 HBASE-17738 BucketCache startup is slow (#1823)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-05 11:48:23 +08:00
thangTang 4118383fb1
HBASE-24501 Backport to branch-1 HBASE-15785 Unnecessary lock in ByteBufferArray (#1842)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-04 09:06:22 +08:00
Bharath Vissapragada cd0aaed929
HBASE-24477 (addendum): Fix missing IA annotations in ConfigurationManager
Found this via failure in the nightly tests on branch-1
2020-06-01 09:03:32 -07:00
Bharath Vissapragada ee869b9aea
HBASE-24477: Move ConfigurationObserver and related classes to hbase-common
This utility is useful for any module that wants to detect
dynamic config changes. Having it to hbase-common makes it
accessible to all the other modules.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-31 14:26:26 -07:00
Nick Dimiduk a53356729f HBASE-24271 Set values in `conf/hbase-site.xml` that enable running on `LocalFileSystem` out of the box
Simplify the new user experience shipping a configuration that enables
a fresh checkout or tarball distribution to run in standalone mode
without direct user configuration. This change restores the behavior
we had when running on Hadoop 2.8 and earlier.

Patch for master includes an update to the book. This change will be
omitted when backporting to earlier branches.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-14 14:35:50 -07:00
Nick Dimiduk 67abffa105 Revert "HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem"
This reverts commit 03d73f151b.
2020-05-14 14:35:50 -07:00
shahrs87 be59ddc263
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive (#1687)
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 12:10:03 +05:30
Andrew Purtell 5cd2aa8913
HBASE-24322 UnsafeAvailChecker should also check that required methods are available (#1650)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-05-05 12:12:23 -07:00
Viraj Jasani a7a4f61040
HBASE-24024 : Reject multi() requests with rows higher than threshold (#1560)
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-22 14:13:05 +05:30
Viraj Jasani d4b64c2545
HBASE-24194 : Refactor anonymous inner classes of BufferedEncodedSeeker to named inner classes (#1522)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-04-16 19:36:43 +05:30
Nick Dimiduk 03d73f151b
HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Backport to branch-1

Co-authored-by: Andrew Purtell <apurtell@apache.org>
2020-04-14 19:13:44 -07:00
Andrew Purtell b9c676cdc0
Set version on branch-1 to 1.7.0-SNAPSHOT 2020-02-14 11:31:32 -08:00
Andrew Purtell 5ec5a5b115
Update POMs and CHANGES.txt for 1.6.0RC0 2020-02-14 11:30:22 -08:00
Jan Hentschel 2267ab9399
HBASE-23621 Reduced the number of Checkstyle violations in tests of hbase-common
Signed-off-by: stack <stack@apache.org>
2020-01-27 13:05:25 +01:00
Jan Hentschel 9d4ea24db5
HBASE-23645 Fixed remaining Checkstyle violations in hbase-common tests
Signed-off-by: stack <stack@apache.org>
2020-01-22 14:46:01 +01:00
Jan Hentschel ee50d4829e
HBASE-23625 Reduced number of Checkstyle violations in hbase-common
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-21 12:13:32 +01:00
Jan Hentschel 99a59cf9e7
HBASE-23622 Reduced the number of Checkstyle violations in hbase-common
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-01-19 18:02:08 +01:00
Jan Hentschel dc602d7d5d
HBASE-23626 Reduced number of Checkstyle violations in tests in hbase-common
Signed-off-by: stack <stack@apache.org>
2020-01-18 20:32:51 +01:00
Bharath Vissapragada 71bfac3353 HBASE-23665: Split unit tests from TestTableName into a separate test-only class. (#1032) (#1051)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-01-17 09:52:31 -08:00
Peter Somogyi 907184dfa0
HBASE-23675 Move to Apache parent POM version 22 (#1023)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-01-15 10:10:23 +01:00
Viraj Jasani 1451063115
HBASE-23590 : Update maxStoreFileRefCount to maxCompactedStoreFileRefCount for auto region recovery based on old reader references
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-01-01 23:50:24 +05:30
Bharath Vissapragada eb5e94aced HBASE-23259: Populate master address end points in cluster/rs configs (#807) (#858)
All the clients need to know the master RPC end points while using master
based registry for creating cluster connections. This patch amends the
test cluster utility to populate these configs in the base configuration
object used to spin up the cluster.

The config key added here ("hbase.master.addrs") is used in the subsequent
patches for HBASE-18095.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 834ccb4bf6)
2019-11-21 09:47:05 -08:00
Geoffrey Jacoby 5f36343949 HBASE-23288 - Backport HBASE-23251 (Add Column Family and Table Names to HFileContext) to branch-1 (#822)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-11-18 16:56:10 -08:00
Josh Elser b566a4f9bc HBASE-22701 Disable the DynamicClassLoader when it fails to initialize
Signed-off-by: Ankit Singhal <ankitsinghal59@gmail.com>
2019-11-15 13:56:10 -06:00
Mingliang Liu a154bd8a73 HBASE-23283 Provide clear and consistent logging about the period of enabled chores
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-11-14 21:10:17 -06:00
Viraj Jasani a5f09cd756
HBASE-23212 Dynamically reload configs for Region Recovery chore (#803)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-11-06 15:43:08 -08:00
Sean Busbey 4bcc397f3e
HBASE-23229 Update branch-1 to 1.6.0-SNAPSHOT (#772)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-10-30 09:22:39 -05:00
Viraj Jasani 5e414f2d46 HBASE-23213 Backport HBASE-22460 to branch-1 (#761)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-10-29 13:15:39 -07:00
chenxu14 425d84dc14
HBASE-23151 Backport HBASE-23083 (Collect Executor status info periodically and report to metrics system) to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-10-15 10:13:04 -07:00
Andrew Purtell 214d33e0f4
Renumber branch to 1.5.1-SNAPSHOT 2019-10-12 13:21:18 -07:00
Andrew Purtell 3966d0fee6
Update POMs and CHANGES.txt for 1.5.0 RC4 2019-10-07 11:46:53 -07:00
Sanjeet Nishad b96aefd07f HBASE-23038 Provide consistent and clear logging about disabling chores
Differs from master/branch-2 version due to commons-logging

Co-authored-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit b45c0d0efa)
2019-09-27 20:17:46 -05:00
Viraj Jasani f77c14d181 HBASE-23015 : Moving from Jackson2 to shaded Gson (#616)
* Backport HBASE-20587
* moving to shaded gson with jdk7 compatibility
* Include jackson-mapper-asl for testing-util because of Hadoop
* Update shaded jar check to allow hbase-thirdparty libs

Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
2019-09-25 21:49:48 -05:00
Viraj Jasani 5c4d8e036f HBASE-23024 Replace initcause with Constructor arg (#627)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-09-17 14:00:12 +02:00
Viraj Jasani 72ea3666c0 HBASE-22760 : Pause/Resume/Query Snapshot Auto Cleanup Activity (#619) 2019-09-13 10:38:10 +05:30
openinx 4c2bf71a3a
HBASE-22937 The RawBytesComparator in branch-1 have wrong comparison order (#582) 2019-09-05 17:48:41 +08:00