Commit Graph

12989 Commits

Author SHA1 Message Date
binlijin 73d1c2a10f
HBASE-24077 When encounter RowTooBigException, log the row info. (#1379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-14 18:43:24 -07:00
Reid Chan 7b1270956a HBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable. And it should be (#1439)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2020-04-09 17:00:57 +08:00
Sean Busbey 4b94f2ed41 HBASE-24138 log more details about balancer decisions for StochasticLoadBalancer (#1455)
- at DEBUG log messages about RegionCountSkewCostFunction region/server totals
- at DEBUG log messages about the decision to balance or not with total costs
- at TRACE log messages about region count on each server RegionCountSkewCostFunction sees
- at TRACE log message with the individual cost functions used in the decision to balance or not

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 2d78a286b6)
2020-04-09 00:30:09 -05:00
Andrew Purtell 27f512d334
HBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock (#1407)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2020-04-08 11:41:24 -07:00
Minwoo Kang 776d75b9c0 HBASE-24130 rat plugin complains about having an unlicensed file (#1445)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-07 09:19:53 -07:00
Andrew Purtell c79fb39d1a
HBASE-24115 Relocate test-only REST "client" from src/ to test/ and mark Private (#1434)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-04-06 17:05:57 -07:00
Nick Dimiduk dd7208c9d5 HBASE-24081 Provide documentation for running Yetus with HBase
Signed-off-by: stack <stack@apache.org>
2020-04-06 16:42:24 -07:00
Viraj Jasani 96ae39b01b
HBASE-23678 : Builder API for version management - setVersionsWithTimeToLive
Signed-off-by: Xu Cang <xucang@apache.org>
2020-04-01 16:58:44 +05:30
WenFeiYi f94c19494b HBASE-24040 WALFactory.Providers.multiwal causes StackOverflowError (#1338)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-03-27 10:25:55 +08:00
Nick Dimiduk b1617df69c HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM
* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist
2020-03-26 08:50:54 -07:00
Nick Dimiduk 759ad3a8cb HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh
Signed-off-by: stack <stack@apache.org>
2020-03-26 08:50:54 -07:00
Huaxiang Sun 61f9048b01
HBASE-23957 [flakey test] client.TestMultiParallel fails to read hbase-site.xml (#1310) (#1344)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-03-25 09:58:04 -07:00
Nick Dimiduk 61e17d78d1 HBASE-23980 Use enforcer plugin to print JVM info in maven output
Does what it says on the tin. Bound to `initialize` phase so that it
runs early in lifecycle. Uses `<inherited>false</inherited>` so that
the plugin will run only for the base pom's reactor stage and not for
any children.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-24 09:22:36 -07:00
Reid Chan 1f88e0d9a2 HBASE-24032 [Addendum] use equals instead of == 2020-03-24 14:57:58 +08:00
Reid Chan 3b8576e6d2
HBASE-24032 [RSGroup] Assign created tables to respective rsgroup automatically instead of manual operations (#1318)
Signed-off-by: binlijin <binlijin@gmail.com>
2020-03-24 13:37:37 +08:00
Duo Zhang 789c7aefca HBASE-24009 Backport the personality changes in HBASE-23989 to all active branches (#1304)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-20 14:23:05 +08:00
stack 6aa4a1cecc HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY 2020-03-18 14:46:03 -07:00
Jan Hentschel bc2c768a52
HBASE-23943 Updated Rubocop configuration to current version
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-03-18 12:26:09 +01:00
xuqinya1 200bf3de86
HBASE-23967 Improve the accuracy of the method sizeToString (#1273)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-13 19:45:53 +05:30
Viraj Jasani 957bfcb065
HBASE-23631 : Backport HBASE-23350 (Make compaction files cacheonWrite configurable based on threshold) to branch-1 (#1256)
Signed-off-by: ramkrish86 <ramkrishna@apache.org>

Backport of commit: 77229c79e3
2020-03-10 20:35:55 +05:30
Viraj Jasani 1931714583
HBASE-23909 : list_regions raise correct error if it is being splitted/merged/transitioning (#1238)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-06 13:09:51 +05:30
Viraj Jasani a50d5c4a8d
HBASE-23631 : Backport HBASE-23588 Cache index & bloom blocks on write if CacheCompactedBlocksOnWrite is enabled
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: chenxu14 <47170471+chenxu14@users.noreply.github.com>
2020-02-28 20:42:51 +05:30
Viraj Jasani bd99a55de8
HBASE-23066 : Allow cache on write during compactions when prefetching is enabled
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-02-28 20:06:48 +05:30
Nick Dimiduk c45d03c021 HBASE-23874 Move Jira-attached file precommit definition from script in Jenkins config to dev-support (#1191)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-02-26 17:01:09 -08:00
Sakthi 25654df98b
HBASE-23862 Fix flaky TestSnapshotFromMaster in 1.x versions (#1181)
Backport HBASE-23658 - Fix flaky TestSnapshotFromMaster

(cherry picked from commit e750d2c7af)

Signed-off-by: Guanghao Zhang <zghaobac@gmail.com>
2020-02-19 19:51:07 -08:00
Andrew Purtell b9c676cdc0
Set version on branch-1 to 1.7.0-SNAPSHOT 2020-02-14 11:31:32 -08:00
Andrew Purtell 5ec5a5b115
Update POMs and CHANGES.txt for 1.6.0RC0 2020-02-14 11:30:22 -08:00
Sandeep Pal 901dffd241
HBASE-21776: Avoid duplicate calls to setStoragePolicy which shows up in debug Logging (#856)
Signed-off-by: Xu Cang <xucang@apache.org>
2020-02-13 11:56:17 -08:00
Abhishek Singh Chouhan b25071c679 HBASE-23825 Increment proto conversion is broken 2020-02-11 17:07:43 -08:00
thangTang 942bb77d84 HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-02-10 17:03:42 +00:00
Wellington Chevreuil bb49aa205c Revert "HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071)"
This reverts commit f99e899ca3.
2020-02-10 17:03:09 +00:00
thangTang f99e899ca3
HBASE-23693 Split failure may cause region hole and data loss when use zk assign (#1071) 2020-02-10 16:57:30 +00:00
Nick Dimiduk 9e4aec56c3
HBASE-23802 Remove unnecessary Configuration instantiation in LossyAccounting (#1127) (#1140)
Signed-off-by: stack <stack@apache.org>
2020-02-07 08:56:11 -08:00
Nick Dimiduk 68912c6bac HBASE-23793 Increase maven heap allocation to 4G in Yetus personality (#1122)
I saw this over on
https://builds.apache.org/view/H-L/view/HBase/job/HBase%20Nightly/job/branch-2/2447/console. Looks
like we need to bump the memory allocation for maven. I wonder if this
is the underlying cause of HBASE-22470.

```
6:38:47  ============================================================================
16:38:47  ============================================================================
16:38:47                                Finished build.
16:38:47  ============================================================================
16:38:47  ============================================================================
16:38:47
16:38:47
Post stage
[Pipeline] stash
16:38:48  Warning: overwriting stash 'hadoop2-result'
16:38:48  Stashed 1 file(s)
[Pipeline] junit
16:38:48  Recording test results
16:38:54  Remote call on H2 failed
Error when executing always post condition:
java.io.IOException: Remote call on H2 failed
	at hudson.remoting.Channel.call(Channel.java:963)
	at hudson.FilePath.act(FilePath.java:1072)
	at hudson.FilePath.act(FilePath.java:1061)
	at hudson.tasks.junit.JUnitParser.parseResult(JUnitParser.java:114)
	at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:137)
	at hudson.tasks.junit.JUnitResultArchiver.parseAndAttach(JUnitResultArchiver.java:167)
	at hudson.tasks.junit.pipeline.JUnitResultsStepExecution.run(JUnitResultsStepExecution.java:52)
	at hudson.tasks.junit.pipeline.JUnitResultsStepExecution.run(JUnitResultsStepExecution.java:25)
	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
	at com.sun.org.apache.xerces.internal.util.XMLStringBuffer.append(XMLStringBuffer.java:208)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.scanData(XMLEntityScanner.java:1515)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanCDATASection(XMLDocumentFragmentScannerImpl.java:1654)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:3014)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602)
	at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:842)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:771)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643)
	at org.dom4j.io.SAXReader.read(SAXReader.java:465)
	at org.dom4j.io.SAXReader.read(SAXReader.java:343)
	at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:178)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:348)
	at hudson.tasks.junit.TestResult.parsePossiblyEmpty(TestResult.java:281)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:206)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:178)
	at hudson.tasks.junit.TestResult.<init>(TestResult.java:143)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:146)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:118)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3052)
	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
	at hudson.remoting.Request$2.run(Request.java:369)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	... 4 more

[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
16:38:54  Failed in branch yetus jdk8 hadoop2 checks
```

Signed-off-by: stack <stack@apache.org>
2020-02-05 14:30:18 -08:00
Josh Elser 0f440b4402 HBASE-23774 Add the user-zh mailing list 2020-01-31 19:34:44 -05:00
Gkkkk302 66f1658167
HBASE-23045 currentPath may be stitched in a loop in replication source code. (#1006)
Co-authored-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-30 01:07:40 +05:30
Viraj Jasani dfe636017d
HBASE-23749 : TestHFileWriterV3 for all DataBlock Encoders
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-01-30 00:51:45 +05:30
Nick Dimiduk 33f69f116a
HBASE-23707 Add IntelliJ check style plugin configuration (#1064) (#1093)
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-01-27 10:53:55 -08:00
Jan Hentschel 2267ab9399
HBASE-23621 Reduced the number of Checkstyle violations in tests of hbase-common
Signed-off-by: stack <stack@apache.org>
2020-01-27 13:05:25 +01:00
Jan Hentschel 4a39f0a2c5
HBASE-23661 Reduced number of Checkstyle violations in hbase-rest
Signed-off-by: stack <stack@apache.org>
2020-01-26 13:38:42 +01:00
Jan Hentschel 21f2eddd20
HBASE-23627 Resolved remaining Checkstyle violations in hbase-thrift
Signed-off-by: stack <stack@apache.org>
2020-01-24 13:24:58 +01:00
Geoffrey Jacoby c080923d77
HBASE-23710 - Priority configuration for system coprocessor
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-23 16:54:26 -08:00
Jan Hentschel 02d80b240b
HBASE-23623 Reduced the number of Checkstyle violations in hbase-rest
Signed-off-by: stack <stack@apache.org>
2020-01-23 13:03:28 +01:00
Jan Hentschel 9d4ea24db5
HBASE-23645 Fixed remaining Checkstyle violations in hbase-common tests
Signed-off-by: stack <stack@apache.org>
2020-01-22 14:46:01 +01:00
Geoffrey Jacoby 99d26e884b
HBASE-23711 - Add test for MinVersions and KeepDeletedCells TTL
Co-authored-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-22 01:05:08 -08:00
Jan Hentschel ee50d4829e
HBASE-23625 Reduced number of Checkstyle violations in hbase-common
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-21 12:13:32 +01:00
Jeongdae Kim 8bf4985d69 HBASE-23254 Release replication buffer quota correctly, when batch includes bulk loaded hfiles (#792)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-01-21 09:23:55 +00:00
Jan Hentschel 2e3273f6ea
HBASE-23646 Resolved remaining Checkstyle violations in tests of hbase-rest
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-20 22:21:32 +01:00
Jan Hentschel 99a59cf9e7
HBASE-23622 Reduced the number of Checkstyle violations in hbase-common
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-01-19 18:02:08 +01:00
Viraj Jasani 64b9d2f5ab
HBASE-23335 : Improving cost functions array copy in StochasticLoadBalancer
Signed-off-by: stack <stack@apache.org>
2020-01-18 17:45:03 -08:00