Commit Graph

53 Commits

Author SHA1 Message Date
Vladimir Rodionov b8194b4902 HBASE-22749 Distributed MOB compactions
- MOB compaction is now handled in-line with per-region compaction on region
  servers
- regions with mob data store per-hfile metadata about which mob hfiles are
  referenced
- admin requested major compaction will also rewrite MOB files; periodic RS
  initiated major compaction will not
- periodically a chore in the master will initiate a major compaction that
  will rewrite MOB values to ensure it happens. controlled by
  'hbase.mob.compaction.chore.period'. default is weekly
- control how many RS the chore requests major compaction on in parallel
  with 'hbase.mob.major.compaction.region.batch.size'. default is as
  parallel as possible.
- periodic chore in master will scan backing hfiles from regions to get the
  set of referenced mob hfiles and archive those that are no longer
  referenced. control period with 'hbase.master.mob.cleaner.period'
- Optionally, RS that are compacting mob files can limit write
  amplification by not rewriting values from mob hfiles over a certain size
  limit. opt-in by setting 'hbase.mob.compaction.type' to 'optimized'.
  control threshold by 'hbase.mob.compactions.max.file.size'.
  default is 1GiB
- Should smoothly integrate with existing MOB users via rolling upgrade.
  will delay old MOB file cleanup until per-region compaction has managed
  to compact each region at least once so that used mob hfile metadata can
  be gathered.
2020-02-19 16:06:38 -06:00
Jan Hentschel 50e264485d
HBASE-23686 Revert binary incompatible change in ByteRangeUtils and removed reflections in CommonFSUtils
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-01-19 18:06:31 +01:00
Nick Dimiduk 70c8a5d939
HBASE-23700 Upgrade checkstyle and plugin versions (#1056)
Bump checkstyle version to 8.28, maven-checkstyle-plugin to 3.1.0.

As per HBASE-23242 and the updated checkstyle docs[1], the LineLength
check should be placed under an instance of Checker.

[1] https://checkstyle.sourceforge.io/config_sizes.html#LineLength

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-17 16:58:49 -08:00
Jan Hentschel 0a9e1f807d
HBASE-23646 Resolved remaining Checkstyle violations in tests of hbase-rest
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-11 21:09:14 +01:00
Jan Hentschel 1eafba5603
HBASE-23645 Fixed remaining Checkstyle violations in hbase-common tests
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-01-07 08:54:04 +01:00
Jan Hentschel e28afec9ec HBASE-22594 Clean up for backup examples (#315)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-25 13:35:44 +08:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2019-07-01 21:15:00 -07:00
Jan Hentschel b20044c612
HBASE-22595 Changed suppressions to full qualified class name
Signed-off-by: stack <stack@apache.org>
2019-06-28 09:43:56 +02:00
syedmurtazahassan b32e716bee HBASE-22481 Javadoc Warnings reference not found 2019-06-08 20:25:31 +02:00
Andrew Purtell a30b186568
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:34:25 -07:00
Jan Hentschel f227eb7aac HBASE-22203 Reformatted DemoClient.java 2019-04-12 09:15:49 +02:00
Jan Hentschel fc6e3fc9d7 HBASE-19762 Fixed Checkstyle errors in hbase-http 2019-04-11 12:55:44 +02:00
stack 1dca6ac5da HBASE-21990 puppycrawl checkstyle dtds 404... moved to sourceforge
ADDENDUM -- dtds moved location. See
https://github.com/checkstyle/checkstyle/issues/6478
2019-03-08 09:22:35 -08:00
stack 5739a64536 HBASE-21990 puppycrawl checkstyle dtds 404... moved to sourceforge 2019-03-04 20:41:33 -08:00
Mike Drob 613d831429
HBASE-20749 Update to checkstyle 8.11 2018-08-02 14:27:07 -05:00
Sean Busbey f1b536bad4 HBASE-20332 shaded mapreduce module shouldn't include hadoop
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
2018-06-18 11:31:04 -07:00
Balazs Meszaros c323e7bfaa
HBASE-20656 Validate pre-2.0 coprocessors against HBase 2.0+
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-11 10:26:58 -05:00
Mike Drob eb13cdd7ed HBASE-20707 Move MissingSwitchDefault case check
Perform this check using error-prone instead of checkstyle because the
former can handle enum switches somewhat more intelligently.
2018-06-11 09:57:50 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
Mike Drob e6220c8b60 Revert "HBASE-20478 move hbaseanti import checks to checkstyle"
Need to update version of checkstyle used for new features.

This reverts commit 90d103d6d5.
2018-04-26 13:36:13 -05:00
Mike Drob 90d103d6d5 HBASE-20478 move hbaseanti import checks to checkstyle
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 09:28:59 -05:00
Balazs Meszaros afb6d3ecce HBASE-20441 Use checkstyle to ban imports from commons-lang 2
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 13:38:24 -05:00
Balazs Meszaros 90fe98ae99 HBASE-20443 Use checkstyle to ban imports from commons-collections 3
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 12:06:58 -05:00
Josh Elser 15c398f7d2 HBASE-20223 Update to hbase-thirdparty 2.1.0
Remove commons-cli and commons-collections4 use. Account
for the newer internal protobuf version of 3.5.1.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-26 22:05:19 -04:00
Jan Hentschel 830179600d HBASE-19471 Fixed remaining Checkstyle errors in hbase-thrift 2018-01-07 13:14:00 +01:00
Jan Hentschel 741466a882 HBASE-19606 Fixed Checkstyle errors in hbase-hadoop-compat and enabled Checkstyle to fail on violations 2018-01-03 01:50:08 +03:00
Mike Drob ea7d5fc884 HBASE-19552 Update hbase-thirdparty version
Some manual cleanup of changing package names in pom files and getting
rid of the no-longer-needed netty system property.

This commit will break compilation, package renames in source code are
done in follow-on commits using straightforward find and replace.

's/org.apache.hadoop.hbase.shaded.com.google/org.apache.hbase.thirdparty.com.google/'
's/org.apache.hadoop.hbase.shaded.io.netty/org.apache.hbase.thirdparty.io.netty/'
2017-12-28 11:41:42 -06:00
Chia-Ping Tsai 01b1f48ccd HBASE-19644 add the checkstyle rule to reject the illegal imports 2017-12-28 04:10:42 +08:00
Jan Hentschel c24cf2d55e HBASE-19601 Fixed Checkstyle errors in hbase-rsgroup and enabled Checkstyle to fail on violations 2017-12-24 12:58:50 +01:00
zhangduo d4babbf060 HBASE-19262 Revisit checkstyle rules 2017-11-16 09:43:08 +08:00
Jan Hentschel d4e3f902e6 HBASE-19183 Removed redundant groupId from hbase-checkstyle and hbase-error-prone 2017-11-07 08:20:51 +01:00
Michael Stack 929c9dab14 HBASE-18181 Move master branch to version 3.0.0-SNAPSHOT post creation of branch-2 2017-06-06 22:04:39 -07:00
Michael Stack fb2c89b1b3 HBASE-16785 We are not running all tests
M TestStressWALProcedureStore.java
Disable test that now runs that fails because of difference in pb3.1.0.

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-26 21:49:18 -08:00
Michael Stack 1ee8776273 HBASE-16785 We are not running all tests Do nothing patch just to get baseline of how many tests we run 2017-01-26 12:21:00 -08:00
zhangduo e0b8098869 HBASE-15693 Reconsider the ImportOrder rule of checkstyle 2016-04-24 11:05:46 +08:00
stack 5e08e2ceb6 Revert "HBASE-14902 Revert some of the stringency recently introduced by checkstyle tightening"
This seems to cause a NPE when generating report.... reverting.

This reverts commit 2c0394f078.
2016-01-20 08:40:02 -08:00
stack 2c0394f078 HBASE-14902 Revert some of the stringency recently introduced by checkstyle tightening 2016-01-19 14:36:44 -08:00
stack 72d32cc96b HBASE-14902 Revert some of the stringency recently introduced by checkstyle tightening; RETRY changing javadoc indent from 4 to 2 2016-01-05 14:45:05 -08:00
stack 1c4edd2ab7 Revert "HBASE-14902 Revert some of the stringency recently introduced by checkstyle tightening"
This reverts commit 998b9371c9.
2016-01-04 20:03:56 -08:00
stack 998b9371c9 HBASE-14902 Revert some of the stringency recently introduced by checkstyle tightening 2016-01-04 14:22:12 -08:00
Mikhail Antonov b68542e35a HBASE-15015 Checktyle plugin shouldn't check Jamon-generated Java classes 2015-12-19 11:58:15 -08:00
Apekshit(Appy) Sharma efb5917f22 HBASE-14859 Better checkstyle reporting. Reports file names, error names and old/new error counts. Fix some checks. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-25 12:18:40 -08:00
stack 62aba61bea HBASE-14829 Add more checkstyles (appy) 2015-11-19 21:33:14 -08:00
Sean Busbey 1b0b67fb7c HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)
2015-08-04 17:16:56 -05:00
Misty Stanley-Jones 39425a8558 HBASE-11670 Generate PDF of Reference Guide 2015-03-05 09:31:11 +10:00
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
Sean Busbey 20524080b2 HBASE-12523 update checkstyle warnings to match our normal usage. 2014-12-03 12:40:09 -06:00
stack fba164a1d1 HBASE-12355 Update maven plugins 2014-10-29 13:11:44 -07:00
Ted Yu deaba78141 HBASE-12318 Add license header to checkstyle xml files 2014-10-22 14:33:35 +00:00
Elliott Clark 43dda4f18a HBASE-12315 Fix 0.98 Tests after checkstyle got parented 2014-10-21 22:42:21 -07:00