Commit Graph

12989 Commits

Author SHA1 Message Date
thangTang d3d527637f
HBASE-24485 Backport to branch-1 HBASE-17738 BucketCache startup is slow (#1823)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-05 11:48:23 +08:00
thangTang 4118383fb1
HBASE-24501 Backport to branch-1 HBASE-15785 Unnecessary lock in ByteBufferArray (#1842)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-06-04 09:06:22 +08:00
Bharath Vissapragada 26828ac615
HBASE-21905: [FIFOCompaction] Don't compact already inflight store files (#1829)
This one surfaced as a flake test but turns out to be a legit bug
in FIFOCompaction code. FifoCompaction does not check if an empty
store file is already being compacted by an in-flight compaction
request and still enqueues. It can potentially race with a running
compaction (as in this test case, see jira for the exact exception).

Fixes the edge case and cleans up the test code a bit.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-06-03 16:22:28 -07:00
Viraj Jasani bbfb4d432f
HBASE-24492 : Remove infinite loop from ProtobufLogReader#readNext (#1831)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-03 22:22:05 +05:30
Bharath Vissapragada d889c7b442
HBASE-24480: Deflake TestRSGroupsBasics#testClearDeadServers (#1821)
More details about the flakiness in the jira comments.

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-01 09:11:27 -07:00
Bharath Vissapragada cd0aaed929
HBASE-24477 (addendum): Fix missing IA annotations in ConfigurationManager
Found this via failure in the nightly tests on branch-1
2020-06-01 09:03:32 -07:00
bsglz 4096925b98
HBASE-24455 Correct the doc of "On the number of column families" (#1799)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-06-01 14:11:57 +05:30
Bharath Vissapragada 6bca1dd1c1
HBASE-24479: Deflake TestCompaction#testStopStartCompaction (#1820)
HBASE-24479: Deflake TestCompaction#testStopStartCompaction

Polling of active compaction count is racy. Tightened the asserts
to be more reliable.

Reid Chan <reidchan@apache.org>
2020-05-31 22:45:31 -07:00
sguggilam 3c138845d9
HBASE-24069 Provide an ExponentialBackOffPolicy sleep between failed … (#1755)
HBASE-24069: Provide an ExponentialBackOffPolicy sleep between failed region close requests

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-31 14:41:18 -07:00
Bharath Vissapragada ee869b9aea
HBASE-24477: Move ConfigurationObserver and related classes to hbase-common
This utility is useful for any module that wants to detect
dynamic config changes. Having it to hbase-common makes it
accessible to all the other modules.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-31 14:26:26 -07:00
jacob-leblanc 90b66544f0 HBASE-24454 - Read ioErrorStartTime to local temporary variable to avoid issue when it is set to -1 between greater than zero check and calculation of error duration (#1816)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2020-05-30 21:10:56 -07:00
xincunSong 61fa21e657
HBASE-24470 : Add store file info when log meessages in HStore. (#1804)
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-29 19:20:37 +05:30
wenbang 136414dd72
HBASE-24453 [BackPort-HBASE-20220] Check if table exists in the cluster before moving it to the specified regionserver group
Co-authored-by: wenbang <wenbang@didiglobal.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-05-29 11:39:42 +08:00
Viraj Jasani 7df034a824
HBASE-24428 : Update compaction priority (ADDENDUM) 2020-05-28 14:39:49 +05:30
Javier Akira Luca de Tena 6aa2286733
HBASE-24435 Add hedgedReads and hedgedReadWins count metrics (#1781)
Co-authored-by: stack <stack@apache.org>
Co-authored-by: Javier <javier.lucadetena@linecorp.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-05-28 10:11:10 +08:00
Alexander Myasnikov 1870876bd3 HBASE-24434 Fix building cpp-example DemoClient
Changed boost::shared_ptr to std::shared_ptr for compatibility with apache thrift v0.13.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-27 14:16:44 -07:00
Viraj Jasani 1e386e3d83
HBASE-24428 : Update compaction priority for recently split daughter regions (#1784)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-05-27 22:52:56 +05:30
Zheng Wang 9f12ef0772 HBASE-24423 No need to get lock in canSplit because hasReferences will get lock too
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-26 13:38:06 -07:00
niuyulin 3235b568da
HBASE-24386 TableSnapshotScanner support scan limit (#1724)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-19 21:30:59 +05:30
Sandeep Pal fbe5e68251
HBASE-24350: Extending and Fixing HBaseTable level replication metrics (#1704)
branch-1 backport

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Co-Authored-by: Andrew Purtell <apurtell@apache.org>
2020-05-14 15:00:37 -07:00
Nick Dimiduk a53356729f HBASE-24271 Set values in `conf/hbase-site.xml` that enable running on `LocalFileSystem` out of the box
Simplify the new user experience shipping a configuration that enables
a fresh checkout or tarball distribution to run in standalone mode
without direct user configuration. This change restores the behavior
we had when running on Hadoop 2.8 and earlier.

Patch for master includes an update to the book. This change will be
omitted when backporting to earlier branches.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-14 14:35:50 -07:00
Nick Dimiduk 67abffa105 Revert "HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem"
This reverts commit 03d73f151b.
2020-05-14 14:35:50 -07:00
Gkkkk302 59a48fc470
HBASE-24355 Fix typos in the HStore#compact annotation (#1699)
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-12 21:06:47 +05:30
Wellington Ramos Chevreuil f57b3d68c7
HBASE-24351 Backport HBASE-24302 to branch-1 (#1693)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-12 16:27:05 +01:00
Reid Chan 29c24e7257
HBASE-24345 [ACL] renameRSGroup should require Admin level permission (#1689) 2020-05-11 14:50:21 +08:00
shahrs87 be59ddc263
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive (#1687)
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 12:10:03 +05:30
Mohammad Arshad d1aff27e06
HBASE-24211: [Addendum] Create table is slow in large cluster when AccessController is enabled. (#1658)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-07 00:32:33 +05:30
Reid Chan febf15f1ea HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong (#1667)
Signed-off-by: binlijin <binlijin@gmail.com>
2020-05-06 19:47:22 +08:00
Anoop Sam John e4dbfe9bed
HBASE-24311 Add more details in MultiVersionConcurrencyControl STUCK log message (#1654) 2020-05-05 12:46:06 -07:00
Andrew Purtell 5cd2aa8913
HBASE-24322 UnsafeAvailChecker should also check that required methods are available (#1650)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-05-05 12:12:23 -07:00
Jan Hentschel 9da034e24f
HBASE-24301 Updated Apache POM to version 23
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-02 15:07:55 +02:00
xincunSong 92654691d7
HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call (#1604)
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-30 16:02:44 -07:00
bsglz 178005efb9
HBASE-23264 Resolve a TODO of BucketAllocator: "Why we add the extra … (#801)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-26 16:23:22 +05:30
Mohammad Arshad 9fc8263ca4
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. (#1577)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2020-04-25 17:48:47 +05:30
Viraj Jasani a7a4f61040
HBASE-24024 : Reject multi() requests with rows higher than threshold (#1560)
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-22 14:13:05 +05:30
Reid Chan 5213d20ae8
HBASE-24196 [Shell] Add rename rsgroup command in hbase shell (#1555)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-22 14:21:49 +08:00
Beata Sudi aaa6450d40
HBASE-24139 : Balancer should avoid leaving idle region servers (#1511)
Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-04-22 11:36:48 +05:30
Reid Chan 7cf97016b9 HBASE-24229 [Build] Pin rubocop version <= 0.81
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-22 13:00:33 +08:00
Reid Chan af1fa22e4d
Revert "[Build] Pin rubocop version <= 0.81 (#1561)" (#1562)
This reverts commit c40b4781e4.
2020-04-22 12:57:58 +08:00
Reid Chan c40b4781e4
[Build] Pin rubocop version <= 0.81 (#1561) 2020-04-22 12:57:18 +08:00
Duo Zhang 74faa263bd HBASE-24218 Add hadoop 3.2.x in hadoop check (#1559)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-22 10:53:14 +08:00
Duo Zhang 53d5f3cc70 HBASE-24213 Backport the pre commit changes for HBASE-24169 to all branches (#1548)
Signed-off-by: stack <stack@apache.org>
2020-04-22 10:37:56 +08:00
Andrew Purtell ee8da704c9
HBASE-24148 Upgrade Thrift to 0.13.0: 0.12.0 has outstanding CVEs. (#1533)
Backport for branch-1

Signed-off-by: Michael Stack <stack@apache.org>
2020-04-17 12:10:31 -07:00
Reid Chan 1eeff370c4
HBASE-24174 Fix findbugs warning on ServiceAuthorizationManager (#1494)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-17 13:55:47 +08:00
Viraj Jasani d4b64c2545
HBASE-24194 : Refactor anonymous inner classes of BufferedEncodedSeeker to named inner classes (#1522)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-04-16 19:36:43 +05:30
binlijin 589d075de8
HBASE-24191 HRegion#processRowsWithLocks count memstore size wrong when sync failed (#1518)
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-04-16 16:31:38 +08:00
Lokesh Khurana f80c4c24b6
HBASE-24193 : BackPort HBASE-18651 to branch-1 (#1521)
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-16 10:13:20 +08:00
Reid Chan 0d8683507b
HBASE-24112 [RSGroup] Support renaming rsgroup (#1467)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-15 19:20:14 +08:00
Nick Dimiduk 03d73f151b
HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Backport to branch-1

Co-authored-by: Andrew Purtell <apurtell@apache.org>
2020-04-14 19:13:44 -07:00
Wei-Chiu Chuang b644e3ccd8
HBASE-8868 add metric to report client shortcircuit reads.
branch-1 backport of #1334

Signed-off-by: stack <stack@apache.net>
Signed-off-by: Sean Busbey <busbey@apache.org>

Co-authored-by: Andrew Purtell <apurtell@apache.org>
2020-04-14 19:05:37 -07:00