Commit Graph

80 Commits

Author SHA1 Message Date
Sean Busbey 2a65066b35 HBASE-20070 refactor website generation
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2018-03-02 09:25:10 -06:00
Apekshit Sharma 330b0d05b9 HBASE-19114 Split out o.a.h.h.zookeeper from hbase-server and hbase-client
- Moved DrainingServerTracker and RegionServerTracker to hbase-server:o.a.h.h.master.
- Moved SplitOrMergeTracker to oahh.master (because it depends on a PB)
- Moving hbase-client:oahh.zookeeper.*  to hbase-zookeeper module.  After HBASE-19200, hbase-client doesn't need them anymore (except 3 classes).
- Renamed some classes to use a consistent naming for classes - ZK instead of mix of ZK, Zk , ZooKeeper. Couldn't rename following public classes: MiniZooKeeperCluster, ZooKeeperConnectionException. Left RecoverableZooKeeper for lack of better name. (suggestions?)
- Sadly, can't move tests out because they depend on HBaseTestingUtility (which defeats part of the purpose - trimming down hbase-server tests. We need to promote more use of mocks in our tests)
2017-11-17 13:20:18 -08:00
Guanghao Zhang 249bc09d8d HBASE-19255 PerformanceEvaluation class not found when run PE test 2017-11-15 15:04:33 +08:00
Apekshit Sharma 8a179ead50 HBASE-19089 Fix the list of included moduleSets in src and binary tars.
Change-Id: I2c4c3fab111fdc311c730c857bb09739dae5585b
2017-11-09 14:22:49 -08:00
Michael Stack 4edfa06564
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-03 09:52:28 -07:00
Sean Busbey bafbade248 HBASE-18940 include project pylint configs in source artifact.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-05 10:38:28 -05:00
Michael Stack a4277f37e2 HBASE-18820 assembly is missing hbase-permission 2017-09-14 13:27:47 -07:00
Yi Liang d83af698eb HBASE-18791: HBASE_HOME/lib does not contain hbase-mapreduce-test.jar 2017-09-12 07:51:57 -07:00
Apekshit Sharma 664b6be0ef HBASE-18640 Move mapreduce out of hbase-server into separate module.
- Moves out o.a.h.h.{mapred, mapreduce} to new hbase-mapreduce module which depends
  on hbase-server because of classes like *Snapshot{Input,Output}Format.java, WALs, replication, etc
- hbase-backup depends on it for WALPlayer and MR job stuff
- A bunch of tools needed to be pulled into hbase-mapreduce becuase of their dependencies on MR.
  These are: CompactionTool, LoadTestTool, PerformanceEvaluation, ExportSnapshot
  This is better place of them than hbase-server. But ideal place would be in separate hbase-tools module.
- There were some tests in hbase-server which were digging into these tools for static util funtions or
  confs. Moved these to better/easily shared place. For eg. security related stuff to HBaseKerberosUtils.
- Note that hbase-mapreduce has secondPartExecution tests. On my machine they took like 20 min, so maybe
  more on apache jenkins. That's basically equal reduction of runtime of hbase-server tests, which is a
  big win!

Change-Id: Ieeb7235014717ca83ee5cb13b2a27fddfa6838e8
2017-08-25 18:38:48 -07:00
Vladimir Rodionov 2dda371209 HBASE-17614: Move Backup/Restore into separate module (Vladimir Rodionov)
Signed-off-by: Josh Elser <elserj@apache.org>
2017-08-23 12:40:57 -04:00
Mike Drob 51d458872d HBASE-12349 Add custom error-prone module 2017-08-22 16:38:17 -05:00
Samir Ahmic 7fee03ed65 HBASE-18518 Remove jersey1* dependencies form project and jersey1* jars from lib dir.
This patch removes jersey1 dependencies form hbase REST project also
removes dead code in hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/ResourceConfig.java and prevents jersey1 jars in lib dir. RESTApiClusterManager.java is modified to use jersey2.

Signed-off-by: Michael Stack <stack@apache.org>
2017-08-17 22:06:34 -07:00
Michael Stack 890d92a90c HBASE-17908 Upgrade guava
Pull in guava 22.0 by using the shaded version up in new hbase-thirdparty project.

In poms, exclude guava everywhere except on hadoop-common. Do this so
we minimize transitive includes. hadoop-common is needed because hadoop
Configuration uses guava doing preconditions.

Everywhere we used guava, instead use shaded so fix a load of imports.

Stopwatch API changed as did hashing and toStringHelper which is now
in MoreObjects class. Otherwise, minimal changes to come up on 22.0
2017-07-21 15:28:08 +01:00
Yi Liang 79a702d112 HBASE-18175 Add hbase-spark integration test into hbase-spark-it
* adds module hbase-spark-it
* adds test IntegrationTestSparkBulkLoad
* adds resultant jar to bin assembly

Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-07-14 10:53:40 -05:00
Peter Somogyi f2731fc241 HBASE-18264 Update pom plugins
Update plugins in main and subprojects
Unified versions to use variable instead of direct values

Affected plugins:
- apache-rat-plugin 0.11 -> 0.12
- asciidoctor-maven-plugin 1.5.2.1 -> 1.5.5
- asciidoctorj-pdf 1.5.0-alpha.6 -> 1.5.0-alpha.15
- build-helper-maven-plugin 1.9.1 -> 3.0.0
- buildnumber-maven-plugin 1.3 -> 1.4
- exec-maven-plugin 1.2.1/1.4.0 -> 1.6.0
- extra-enforcer-rules 1.0-beta-3 -> 1.0-beta-6
- findbugs-maven-plugin 3.0.0 -> 3.0.4
- jamon-maven-plugin 2.4.1 -> 2.4.2
- maven-bundle-plugin 2.5.3 -> 3.3.0
- maven-compiler-plugin 3.2/3.5.1 -> 3.6.1
- maven-eclipse-plugin 2.9 -> 2.10
- maven-shade-plugin 2.4.1 -> 3.0.0
- maven-surefire-plugin 2.18.1 -> 2.20
- maven-surefire-report-plugin 2.7.2 -> 2.20
- scala-maven-plugin 3.2.0 -> 3.2.2
- spotbugs 3.1.0-RC1 -> 3.1.0-RC3
- wagon-ssh 2.2 -> 2.12
- xml-maven-plugin 1.0 -> 1.0.1

- maven-assembly-plugin 2.4 -> 2.6(inherited)
- maven-dependency-plugin 2.4 -> 2.10 (inherited)
- maven-enforcer-plugin 1.3.1 -> 1.4.1 (inherited)
- maven-javadoc-plugin 2.10.3 -> 2.10.4 (inherited)
- maven-resources-plugin 2.7 (inherited)
- maven-site-plugin 3.4 -> 3.5.1 (inherited)

Change-Id: I84539f555be498dff18caed1e3eea1e1aeb2143a

Signed-off-by: Michael Stack <stack@apache.org>
2017-07-03 19:42:46 -07:00
Mike Drob 270f317727 HBASE-18176 Enforce no scala outside hbase-spark
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-19 16:36:42 -05:00
tedyu 8b36da1108 HBASE-18209 Include httpclient / httpcore jars in build artifacts 2017-06-14 20:09:42 -07:00
Michael Stack 2846a7c90e HBASE-18191 Include hbase-metrics-* in assembly 2017-06-07 21:57:35 -07:00
Michael Stack 929c9dab14 HBASE-18181 Move master branch to version 3.0.0-SNAPSHOT post creation of branch-2 2017-06-06 22:04:39 -07:00
Xiang Li 4ab94744e2 HBASE-17997: In dev environment, add jruby-complete jar to classpath only when jruby is needed
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-05-25 08:07:50 -07:00
Mike Drob 5c728b0f0c HBASE-17286 Add goal to remote-resources plugin
With Apache parent pom v12 our remote-resources-plugin execution id was
shadowing the parent declaration, and our configuration would get run to
aggregate LICENSE files correctly. When upgrading to v18, apache changed
the execution id, so our configuration no longer gets used.

Add an explicit goal to our usage of the remote-resources-plugin and
change the name to something more descriptive and less likely to
conflict (either intentionally or not).

Signed-off-by: Josh Elser <elserj@apache.org>
2017-05-19 11:37:49 -04:00
Xiang Li 083796d2e6 HBASE-15199 Move jruby jar so only on runtime classpath for hbase-shell and support scripts.
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-05-02 16:05:54 -05:00
Enis Soztutar c64a1d1994 HBASE-9774 HBase native metrics and metric collection for coprocessors 2017-01-25 11:47:35 -08:00
tedyu acd0218d91 HBASE-17352 Fix hbase-assembly build with bash 4 (Junegunn Choi) 2016-12-21 08:41:34 -08:00
Michael Stack 4533bb63cf Revert "Revert "HBASE-15789 PB related changes to work with offheap""
Restore this change but with a clean of the generated dirs first so
that we avoid trying to apply a patch on top of an already patched src.

This reverts commit 0f384158fc.
2016-10-24 16:51:50 -07:00
Michael Stack 0f384158fc Revert "HBASE-15789 PB related changes to work with offheap"
This reverts commit fb15e3d4f5.
Breaks the build
2016-10-15 18:44:00 -07:00
Michael Stack fb15e3d4f5 HBASE-15789 PB related changes to work with offheap
Adds means of patching our shaded protobuf. Does it using
the Anoop patch attached to HBASE-15789 that adds ByteInput
to protobuf. This patch gets applied after protobuf has been
downloaded, relocated, and then unpacked over src/main/java.

Also fixes a few small build WARNINGs because of duplicate
mentions of dependencies.
2016-10-15 10:02:23 -07:00
Michael Stack c6289f1976 HBASE-16808 Included the generated, shaded java files from HBASE-15638 Shade protobuf in our src assembly 2016-10-12 14:56:33 -07:00
Apekshit Sharma c66bb48ce8 HBASE-16101 Tool to microbenchmark procedure WAL performance.
Change-Id: I8ec158319395d2ec8e36641a3beab2694f7b6aef
2016-08-30 13:31:58 -07:00
Elliott Clark 2eef33930c HBASE-16177 In dev mode thrift server can't be run 2016-07-05 12:15:21 -07:00
Enis Soztutar 91291e3780 HBASE-15732 hbase-rsgroups should be in the assembly 2016-04-28 17:14:54 -07:00
Jerry He 3aff98c75b HBASE-15201 Add hbase-spark to hbase assembly 2016-02-08 14:13:46 -08:00
Sean Busbey d238c17f31 HBASE-14952 ensure correct components in source assembly.
* hbase-external-blockcache
* hbase-spark
* remove duplicate inclusion of hbase-shaded-{client,server}

Signed-off-by: stack <stack@apache.org>
2015-12-16 12:00:17 -06:00
Elliott Clark 7b08f4c8be HBASE-14334 Move Memcached block cache in to it's own optional module. 2015-09-16 15:26:38 -07:00
Nick Dimiduk 4dd30ab019 HBASE-14219 src tgz no longer builds after HBASE-14085 2015-08-13 11:13:50 -07:00
Sean Busbey 1b0b67fb7c HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)
2015-08-04 17:16:56 -05:00
Jerry He 1d26d26407 HBASE-13598 Make hbase assembly attach to the project 2015-04-30 23:01:11 -07:00
Nick Dimiduk c65e4d5540 HBASE-13596 src assembly does not build 2015-04-29 12:32:45 -07:00
Elliott Clark d2c19416a2 HBASE-13517 Publish a client artifact with shaded dependencies
Summary: Add in shaded versions of server and shaded versions of client

Test Plan: HBase downstreamer

Differential Revision: https://reviews.facebook.net/D37467
2015-04-28 09:41:52 -07:00
Misty Stanley-Jones 39425a8558 HBASE-11670 Generate PDF of Reference Guide 2015-03-05 09:31:11 +10:00
Aditya Kishore 8a6e9827a2 HBASE-13009: HBase REST UI inaccessible
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-10 19:09:08 -08:00
Sean Busbey 296383c934 HBASE-11533 ADDENDUM asciidoc POC 2015-01-14 19:02:00 -08:00
stack 7587d99b62 HBASE-12352 Add hbase-annotation-tests to runtime classpath so can run hbase it tests; ADDENDUM 2014-10-27 15:41:04 -07:00
Elliott Clark 6ddb2f1965 HBASE-12197 Move rest to it's on module
Summary:
Move hbase-rest to it's own module.
copy test resources from hbase-server into hbase-rest's test resources.

Test Plan: Unit tests pass of hbase-rest module.

Differential Revision: https://reviews.facebook.net/D24657
2014-10-10 09:51:09 -07:00
Enis Soztutar 92c52a727a Updated version in master to 2.0.0-SNAPSHOT after 'branch-1' is created for 1.x line of releases 2014-06-30 20:26:47 -07:00
Michael Stack 37654f77a6 HBASE-10781 Remove hadoop-one-compat module and all references to hadoop1
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1579449 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 23:08:55 +00:00
Andrew Kyle Purtell f8139d1bf5 Update version in POMs to 0.99.0-SNAPSHOT after branching for release 0.98.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1547743 13f79535-47bb-0310-9956-ffa450edef68
2013-12-04 09:31:02 +00:00
Enis Soztutar 25c871b71c HBASE-9755 Cannot run classes in hbase-server tests jar from command line
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1533267 13f79535-47bb-0310-9956-ffa450edef68
2013-10-17 21:25:27 +00:00
eclark ce7c5b8e03 HBASE-9699 For Downstreamers using HBaseTestingUtility is hard.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1528645 13f79535-47bb-0310-9956-ffa450edef68
2013-10-02 21:59:19 +00:00
Jonathan Hsieh f4f3bc3129 HBASE-9660 Release source tarball should contain ./dev-support contents
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1526358 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 02:38:21 +00:00