Commit Graph

13119 Commits

Author SHA1 Message Date
Nick Dimiduk a53356729f HBASE-24271 Set values in `conf/hbase-site.xml` that enable running on `LocalFileSystem` out of the box
Simplify the new user experience shipping a configuration that enables
a fresh checkout or tarball distribution to run in standalone mode
without direct user configuration. This change restores the behavior
we had when running on Hadoop 2.8 and earlier.

Patch for master includes an update to the book. This change will be
omitted when backporting to earlier branches.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-14 14:35:50 -07:00
Nick Dimiduk 67abffa105 Revert "HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem"
This reverts commit 03d73f151b.
2020-05-14 14:35:50 -07:00
Gkkkk302 59a48fc470
HBASE-24355 Fix typos in the HStore#compact annotation (#1699)
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-12 21:06:47 +05:30
Wellington Ramos Chevreuil f57b3d68c7
HBASE-24351 Backport HBASE-24302 to branch-1 (#1693)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-12 16:27:05 +01:00
Reid Chan 29c24e7257
HBASE-24345 [ACL] renameRSGroup should require Admin level permission (#1689) 2020-05-11 14:50:21 +08:00
shahrs87 be59ddc263
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive (#1687)
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 12:10:03 +05:30
Mohammad Arshad d1aff27e06
HBASE-24211: [Addendum] Create table is slow in large cluster when AccessController is enabled. (#1658)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-07 00:32:33 +05:30
Reid Chan febf15f1ea HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong (#1667)
Signed-off-by: binlijin <binlijin@gmail.com>
2020-05-06 19:47:22 +08:00
Anoop Sam John e4dbfe9bed
HBASE-24311 Add more details in MultiVersionConcurrencyControl STUCK log message (#1654) 2020-05-05 12:46:06 -07:00
Andrew Purtell 5cd2aa8913
HBASE-24322 UnsafeAvailChecker should also check that required methods are available (#1650)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-05-05 12:12:23 -07:00
Jan Hentschel 9da034e24f
HBASE-24301 Updated Apache POM to version 23
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-02 15:07:55 +02:00
xincunSong 92654691d7
HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call (#1604)
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-30 16:02:44 -07:00
bsglz 178005efb9
HBASE-23264 Resolve a TODO of BucketAllocator: "Why we add the extra … (#801)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-26 16:23:22 +05:30
Mohammad Arshad 9fc8263ca4
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. (#1577)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2020-04-25 17:48:47 +05:30
Viraj Jasani a7a4f61040
HBASE-24024 : Reject multi() requests with rows higher than threshold (#1560)
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-22 14:13:05 +05:30
Reid Chan 5213d20ae8
HBASE-24196 [Shell] Add rename rsgroup command in hbase shell (#1555)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-22 14:21:49 +08:00
Beata Sudi aaa6450d40
HBASE-24139 : Balancer should avoid leaving idle region servers (#1511)
Co-authored-by: Viraj Jasani <vjasani@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-04-22 11:36:48 +05:30
Reid Chan 7cf97016b9 HBASE-24229 [Build] Pin rubocop version <= 0.81
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-22 13:00:33 +08:00
Reid Chan af1fa22e4d
Revert "[Build] Pin rubocop version <= 0.81 (#1561)" (#1562)
This reverts commit c40b4781e4.
2020-04-22 12:57:58 +08:00
Reid Chan c40b4781e4
[Build] Pin rubocop version <= 0.81 (#1561) 2020-04-22 12:57:18 +08:00
Duo Zhang 74faa263bd HBASE-24218 Add hadoop 3.2.x in hadoop check (#1559)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-22 10:53:14 +08:00
Duo Zhang 53d5f3cc70 HBASE-24213 Backport the pre commit changes for HBASE-24169 to all branches (#1548)
Signed-off-by: stack <stack@apache.org>
2020-04-22 10:37:56 +08:00
Andrew Purtell ee8da704c9
HBASE-24148 Upgrade Thrift to 0.13.0: 0.12.0 has outstanding CVEs. (#1533)
Backport for branch-1

Signed-off-by: Michael Stack <stack@apache.org>
2020-04-17 12:10:31 -07:00
Reid Chan 1eeff370c4
HBASE-24174 Fix findbugs warning on ServiceAuthorizationManager (#1494)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-17 13:55:47 +08:00
Viraj Jasani d4b64c2545
HBASE-24194 : Refactor anonymous inner classes of BufferedEncodedSeeker to named inner classes (#1522)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-04-16 19:36:43 +05:30
binlijin 589d075de8
HBASE-24191 HRegion#processRowsWithLocks count memstore size wrong when sync failed (#1518)
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-04-16 16:31:38 +08:00
Lokesh Khurana f80c4c24b6
HBASE-24193 : BackPort HBASE-18651 to branch-1 (#1521)
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-16 10:13:20 +08:00
Reid Chan 0d8683507b
HBASE-24112 [RSGroup] Support renaming rsgroup (#1467)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-15 19:20:14 +08:00
Nick Dimiduk 03d73f151b
HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Backport to branch-1

Co-authored-by: Andrew Purtell <apurtell@apache.org>
2020-04-14 19:13:44 -07:00
Wei-Chiu Chuang b644e3ccd8
HBASE-8868 add metric to report client shortcircuit reads.
branch-1 backport of #1334

Signed-off-by: stack <stack@apache.net>
Signed-off-by: Sean Busbey <busbey@apache.org>

Co-authored-by: Andrew Purtell <apurtell@apache.org>
2020-04-14 19:05:37 -07:00
binlijin 73d1c2a10f
HBASE-24077 When encounter RowTooBigException, log the row info. (#1379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-14 18:43:24 -07:00
Reid Chan 7b1270956a HBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable. And it should be (#1439)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2020-04-09 17:00:57 +08:00
Sean Busbey 4b94f2ed41 HBASE-24138 log more details about balancer decisions for StochasticLoadBalancer (#1455)
- at DEBUG log messages about RegionCountSkewCostFunction region/server totals
- at DEBUG log messages about the decision to balance or not with total costs
- at TRACE log messages about region count on each server RegionCountSkewCostFunction sees
- at TRACE log message with the individual cost functions used in the decision to balance or not

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 2d78a286b6)
2020-04-09 00:30:09 -05:00
Andrew Purtell 27f512d334
HBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock (#1407)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2020-04-08 11:41:24 -07:00
Minwoo Kang 776d75b9c0 HBASE-24130 rat plugin complains about having an unlicensed file (#1445)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-07 09:19:53 -07:00
Andrew Purtell c79fb39d1a
HBASE-24115 Relocate test-only REST "client" from src/ to test/ and mark Private (#1434)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-04-06 17:05:57 -07:00
Nick Dimiduk dd7208c9d5 HBASE-24081 Provide documentation for running Yetus with HBase
Signed-off-by: stack <stack@apache.org>
2020-04-06 16:42:24 -07:00
Viraj Jasani 96ae39b01b
HBASE-23678 : Builder API for version management - setVersionsWithTimeToLive
Signed-off-by: Xu Cang <xucang@apache.org>
2020-04-01 16:58:44 +05:30
WenFeiYi f94c19494b HBASE-24040 WALFactory.Providers.multiwal causes StackOverflowError (#1338)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-03-27 10:25:55 +08:00
Nick Dimiduk b1617df69c HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM
* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist
2020-03-26 08:50:54 -07:00
Nick Dimiduk 759ad3a8cb HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh
Signed-off-by: stack <stack@apache.org>
2020-03-26 08:50:54 -07:00
Huaxiang Sun 61f9048b01
HBASE-23957 [flakey test] client.TestMultiParallel fails to read hbase-site.xml (#1310) (#1344)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-03-25 09:58:04 -07:00
Nick Dimiduk 61e17d78d1 HBASE-23980 Use enforcer plugin to print JVM info in maven output
Does what it says on the tin. Bound to `initialize` phase so that it
runs early in lifecycle. Uses `<inherited>false</inherited>` so that
the plugin will run only for the base pom's reactor stage and not for
any children.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-24 09:22:36 -07:00
Reid Chan 1f88e0d9a2 HBASE-24032 [Addendum] use equals instead of == 2020-03-24 14:57:58 +08:00
Reid Chan 3b8576e6d2
HBASE-24032 [RSGroup] Assign created tables to respective rsgroup automatically instead of manual operations (#1318)
Signed-off-by: binlijin <binlijin@gmail.com>
2020-03-24 13:37:37 +08:00
Duo Zhang 789c7aefca HBASE-24009 Backport the personality changes in HBASE-23989 to all active branches (#1304)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-20 14:23:05 +08:00
stack 6aa4a1cecc HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY 2020-03-18 14:46:03 -07:00
Jan Hentschel bc2c768a52
HBASE-23943 Updated Rubocop configuration to current version
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-03-18 12:26:09 +01:00
xuqinya1 200bf3de86
HBASE-23967 Improve the accuracy of the method sizeToString (#1273)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-13 19:45:53 +05:30
Viraj Jasani 957bfcb065
HBASE-23631 : Backport HBASE-23350 (Make compaction files cacheonWrite configurable based on threshold) to branch-1 (#1256)
Signed-off-by: ramkrish86 <ramkrishna@apache.org>

Backport of commit: 77229c79e3
2020-03-10 20:35:55 +05:30