Commit Graph

12898 Commits

Author SHA1 Message Date
Duo Zhang 53d5f3cc70 HBASE-24213 Backport the pre commit changes for HBASE-24169 to all branches (#1548)
Signed-off-by: stack <stack@apache.org>
2020-04-22 10:37:56 +08:00
Andrew Purtell ee8da704c9
HBASE-24148 Upgrade Thrift to 0.13.0: 0.12.0 has outstanding CVEs. (#1533)
Backport for branch-1

Signed-off-by: Michael Stack <stack@apache.org>
2020-04-17 12:10:31 -07:00
Reid Chan 1eeff370c4
HBASE-24174 Fix findbugs warning on ServiceAuthorizationManager (#1494)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-17 13:55:47 +08:00
Viraj Jasani d4b64c2545
HBASE-24194 : Refactor anonymous inner classes of BufferedEncodedSeeker to named inner classes (#1522)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-04-16 19:36:43 +05:30
binlijin 589d075de8
HBASE-24191 HRegion#processRowsWithLocks count memstore size wrong when sync failed (#1518)
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-04-16 16:31:38 +08:00
Lokesh Khurana f80c4c24b6
HBASE-24193 : BackPort HBASE-18651 to branch-1 (#1521)
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-16 10:13:20 +08:00
Reid Chan 0d8683507b
HBASE-24112 [RSGroup] Support renaming rsgroup (#1467)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-15 19:20:14 +08:00
Nick Dimiduk 03d73f151b
HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Backport to branch-1

Co-authored-by: Andrew Purtell <apurtell@apache.org>
2020-04-14 19:13:44 -07:00
Wei-Chiu Chuang b644e3ccd8
HBASE-8868 add metric to report client shortcircuit reads.
branch-1 backport of #1334

Signed-off-by: stack <stack@apache.net>
Signed-off-by: Sean Busbey <busbey@apache.org>

Co-authored-by: Andrew Purtell <apurtell@apache.org>
2020-04-14 19:05:37 -07:00
binlijin 73d1c2a10f
HBASE-24077 When encounter RowTooBigException, log the row info. (#1379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-14 18:43:24 -07:00
Reid Chan 7b1270956a HBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable. And it should be (#1439)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2020-04-09 17:00:57 +08:00
Sean Busbey 4b94f2ed41 HBASE-24138 log more details about balancer decisions for StochasticLoadBalancer (#1455)
- at DEBUG log messages about RegionCountSkewCostFunction region/server totals
- at DEBUG log messages about the decision to balance or not with total costs
- at TRACE log messages about region count on each server RegionCountSkewCostFunction sees
- at TRACE log message with the individual cost functions used in the decision to balance or not

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 2d78a286b6)
2020-04-09 00:30:09 -05:00
Andrew Purtell 27f512d334
HBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock (#1407)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2020-04-08 11:41:24 -07:00
Minwoo Kang 776d75b9c0 HBASE-24130 rat plugin complains about having an unlicensed file (#1445)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-07 09:19:53 -07:00
Andrew Purtell c79fb39d1a
HBASE-24115 Relocate test-only REST "client" from src/ to test/ and mark Private (#1434)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-04-06 17:05:57 -07:00
Nick Dimiduk dd7208c9d5 HBASE-24081 Provide documentation for running Yetus with HBase
Signed-off-by: stack <stack@apache.org>
2020-04-06 16:42:24 -07:00
Viraj Jasani 96ae39b01b
HBASE-23678 : Builder API for version management - setVersionsWithTimeToLive
Signed-off-by: Xu Cang <xucang@apache.org>
2020-04-01 16:58:44 +05:30
WenFeiYi f94c19494b HBASE-24040 WALFactory.Providers.multiwal causes StackOverflowError (#1338)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-03-27 10:25:55 +08:00
Nick Dimiduk b1617df69c HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM
* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist
2020-03-26 08:50:54 -07:00
Nick Dimiduk 759ad3a8cb HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh
Signed-off-by: stack <stack@apache.org>
2020-03-26 08:50:54 -07:00
Huaxiang Sun 61f9048b01
HBASE-23957 [flakey test] client.TestMultiParallel fails to read hbase-site.xml (#1310) (#1344)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-03-25 09:58:04 -07:00
Nick Dimiduk 61e17d78d1 HBASE-23980 Use enforcer plugin to print JVM info in maven output
Does what it says on the tin. Bound to `initialize` phase so that it
runs early in lifecycle. Uses `<inherited>false</inherited>` so that
the plugin will run only for the base pom's reactor stage and not for
any children.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-24 09:22:36 -07:00
Reid Chan 1f88e0d9a2 HBASE-24032 [Addendum] use equals instead of == 2020-03-24 14:57:58 +08:00
Reid Chan 3b8576e6d2
HBASE-24032 [RSGroup] Assign created tables to respective rsgroup automatically instead of manual operations (#1318)
Signed-off-by: binlijin <binlijin@gmail.com>
2020-03-24 13:37:37 +08:00
Duo Zhang 789c7aefca HBASE-24009 Backport the personality changes in HBASE-23989 to all active branches (#1304)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-20 14:23:05 +08:00
stack 6aa4a1cecc HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY 2020-03-18 14:46:03 -07:00
Jan Hentschel bc2c768a52
HBASE-23943 Updated Rubocop configuration to current version
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-03-18 12:26:09 +01:00
xuqinya1 200bf3de86
HBASE-23967 Improve the accuracy of the method sizeToString (#1273)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-13 19:45:53 +05:30
Viraj Jasani 957bfcb065
HBASE-23631 : Backport HBASE-23350 (Make compaction files cacheonWrite configurable based on threshold) to branch-1 (#1256)
Signed-off-by: ramkrish86 <ramkrishna@apache.org>

Backport of commit: 77229c79e3
2020-03-10 20:35:55 +05:30
Viraj Jasani 1931714583
HBASE-23909 : list_regions raise correct error if it is being splitted/merged/transitioning (#1238)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-06 13:09:51 +05:30
Viraj Jasani a50d5c4a8d
HBASE-23631 : Backport HBASE-23588 Cache index & bloom blocks on write if CacheCompactedBlocksOnWrite is enabled
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: chenxu14 <47170471+chenxu14@users.noreply.github.com>
2020-02-28 20:42:51 +05:30
Viraj Jasani bd99a55de8
HBASE-23066 : Allow cache on write during compactions when prefetching is enabled
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-02-28 20:06:48 +05:30
Nick Dimiduk c45d03c021 HBASE-23874 Move Jira-attached file precommit definition from script in Jenkins config to dev-support (#1191)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-02-26 17:01:09 -08:00
Sakthi 25654df98b
HBASE-23862 Fix flaky TestSnapshotFromMaster in 1.x versions (#1181)
Backport HBASE-23658 - Fix flaky TestSnapshotFromMaster

(cherry picked from commit e750d2c7af)

Signed-off-by: Guanghao Zhang <zghaobac@gmail.com>
2020-02-19 19:51:07 -08:00
Andrew Purtell b9c676cdc0
Set version on branch-1 to 1.7.0-SNAPSHOT 2020-02-14 11:31:32 -08:00
Andrew Purtell 5ec5a5b115
Update POMs and CHANGES.txt for 1.6.0RC0 2020-02-14 11:30:22 -08:00
Sandeep Pal 901dffd241
HBASE-21776: Avoid duplicate calls to setStoragePolicy which shows up in debug Logging (#856)
Signed-off-by: Xu Cang <xucang@apache.org>
2020-02-13 11:56:17 -08:00
Abhishek Singh Chouhan b25071c679 HBASE-23825 Increment proto conversion is broken 2020-02-11 17:07:43 -08:00
thangTang 942bb77d84 HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-02-10 17:03:42 +00:00
Wellington Chevreuil bb49aa205c Revert "HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071)"
This reverts commit f99e899ca3.
2020-02-10 17:03:09 +00:00
thangTang f99e899ca3
HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071) 2020-02-10 16:57:30 +00:00
Nick Dimiduk 9e4aec56c3
HBASE-23802 Remove unnecessary Configuration instantiation in LossyAccounting (#1127) (#1140)
Signed-off-by: stack <stack@apache.org>
2020-02-07 08:56:11 -08:00
Nick Dimiduk 68912c6bac HBASE-23793 Increase maven heap allocation to 4G in Yetus personality (#1122)
I saw this over on
https://builds.apache.org/view/H-L/view/HBase/job/HBase%20Nightly/job/branch-2/2447/console. Looks
like we need to bump the memory allocation for maven. I wonder if this
is the underlying cause of HBASE-22470.

```
6:38:47  ============================================================================
16:38:47  ============================================================================
16:38:47                                Finished build.
16:38:47  ============================================================================
16:38:47  ============================================================================
16:38:47
16:38:47
Post stage
[Pipeline] stash
16:38:48  Warning: overwriting stash 'hadoop2-result'
16:38:48  Stashed 1 file(s)
[Pipeline] junit
16:38:48  Recording test results
16:38:54  Remote call on H2 failed
Error when executing always post condition:
java.io.IOException: Remote call on H2 failed
	at hudson.remoting.Channel.call(Channel.java:963)
	at hudson.FilePath.act(FilePath.java:1072)
	at hudson.FilePath.act(FilePath.java:1061)
	at hudson.tasks.junit.JUnitParser.parseResult(JUnitParser.java:114)
	at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:137)
	at hudson.tasks.junit.JUnitResultArchiver.parseAndAttach(JUnitResultArchiver.java:167)
	at hudson.tasks.junit.pipeline.JUnitResultsStepExecution.run(JUnitResultsStepExecution.java:52)
	at hudson.tasks.junit.pipeline.JUnitResultsStepExecution.run(JUnitResultsStepExecution.java:25)
	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
	at com.sun.org.apache.xerces.internal.util.XMLStringBuffer.append(XMLStringBuffer.java:208)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.scanData(XMLEntityScanner.java:1515)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanCDATASection(XMLDocumentFragmentScannerImpl.java:1654)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:3014)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602)
	at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:842)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:771)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643)
	at org.dom4j.io.SAXReader.read(SAXReader.java:465)
	at org.dom4j.io.SAXReader.read(SAXReader.java:343)
	at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:178)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:348)
	at hudson.tasks.junit.TestResult.parsePossiblyEmpty(TestResult.java:281)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:206)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:178)
	at hudson.tasks.junit.TestResult.<init>(TestResult.java:143)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:146)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:118)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3052)
	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
	at hudson.remoting.Request$2.run(Request.java:369)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	... 4 more

[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
16:38:54  Failed in branch yetus jdk8 hadoop2 checks
```

Signed-off-by: stack <stack@apache.org>
2020-02-05 14:30:18 -08:00
Josh Elser 0f440b4402 HBASE-23774 Add the user-zh mailing list 2020-01-31 19:34:44 -05:00
Gkkkk302 66f1658167
HBASE-23045 currentPath may be stitched in a loop in replication source code. (#1006)
Co-authored-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-30 01:07:40 +05:30
Viraj Jasani dfe636017d
HBASE-23749 : TestHFileWriterV3 for all DataBlock Encoders
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-01-30 00:51:45 +05:30
Nick Dimiduk 33f69f116a
HBASE-23707 Add IntelliJ check style plugin configuration (#1064) (#1093)
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-01-27 10:53:55 -08:00
Jan Hentschel 2267ab9399
HBASE-23621 Reduced the number of Checkstyle violations in tests of hbase-common
Signed-off-by: stack <stack@apache.org>
2020-01-27 13:05:25 +01:00
Jan Hentschel 4a39f0a2c5
HBASE-23661 Reduced number of Checkstyle violations in hbase-rest
Signed-off-by: stack <stack@apache.org>
2020-01-26 13:38:42 +01:00
Jan Hentschel 21f2eddd20
HBASE-23627 Resolved remaining Checkstyle violations in hbase-thrift
Signed-off-by: stack <stack@apache.org>
2020-01-24 13:24:58 +01:00