Apekshit Sharma
59d034106f
HBASE-18640 Move mapreduce out of hbase-server into separate module.
...
- Moves out o.a.h.h.{mapred, mapreduce} to new hbase-mapreduce module which depends
on hbase-server because of classes like *Snapshot{Input,Output}Format.java, WALs, replication, etc
- hbase-backup depends on it for WALPlayer and MR job stuff
- A bunch of tools needed to be pulled into hbase-mapreduce becuase of their dependencies on MR.
These are: CompactionTool, LoadTestTool, PerformanceEvaluation, ExportSnapshot
This is better place of them than hbase-server. But ideal place would be in separate hbase-tools module.
- There were some tests in hbase-server which were digging into these tools for static util funtions or
confs. Moved these to better/easily shared place. For eg. security related stuff to HBaseKerberosUtils.
- Note that hbase-mapreduce has secondPartExecution tests. On my machine they took like 20 min, so maybe
more on apache jenkins. That's basically equal reduction of runtime of hbase-server tests, which is a
big win!
Change-Id: Ieeb7235014717ca83ee5cb13b2a27fddfa6838e8
2017-08-26 01:55:33 -07:00
Michael Stack
b24e33312a
HBASE-18594 Release hbase-2.0.0-alpha2; ADDENDUM update version from 2.0.0-alpha2 to 2.0.0-alpha3-SNAPSHOT
2017-08-23 11:07:41 -07:00
Michael Stack
add9974515
HBASE-18595 Set version in branch-2 from 2.0.0-alpha2-SNAPSHOT to 2.0.0-alpha2
2017-08-14 10:28:44 -07:00
Michael Stack
6440509d7d
HBASE-17056 Remove checked in PB generated files; ADDENDUM
2017-08-02 09:54:03 -07:00
Michael Stack
ee70b1d2e0
HBASE-17056 Remove checked in PB generated files
...
Selective add of dependency on hbase-thirdparty jars.
Update to READMEs on how protobuf is done (and update to refguide).
Removed all checked in generated protobuf files. They are generated
on the fly now as part of mainline build.
2017-08-02 09:42:38 -07:00
Michael Stack
d5c6e11016
HBASE-17908 Upgrade guava
...
Pull in guava 22.0 by using the shaded version up in new hbase-thirdparty project.
In poms, exclude guava everywhere except on hadoop-common. Do this so
we minimize transitive includes. hadoop-common is needed because hadoop
Configuration uses guava doing preconditions.
Everywhere we used guava, instead use shaded so fix a load of imports.
Stopwatch API changed as did hashing and toStringHelper which is now
in MoreObjects class. Otherwise, minimal changes to come up on 22.0
2017-07-21 15:41:52 +01:00
Sean Busbey
9cc9404261
HBASE-18187 update version to 2.0.0-alpha-2-SNAPSHOT
2017-07-14 11:20:32 -05:00
Michael Stack
b2b5cd6de6
Revert "HBASE-17056 Remove checked in PB generated files Selective add of dependency on"
...
Build is unstable and has interesting issues around CLASSPATH. Revert
for now.
This reverts commit 1049025e1d
.
2017-07-06 21:48:41 -07:00
Michael Stack
1049025e1d
HBASE-17056 Remove checked in PB generated files Selective add of dependency on
...
hbase-thirdparty jars. Update to READMEs on how protobuf is done (and update to
refguide) Removed all checked in generated protobuf files. They are generatedon
the fly now as part of mainline build.
2017-07-05 21:38:23 -07:00
Jan Hentschel
43adfa9b02
HBASE-16730 Excluded junit as a transitive dependency from hadoop-common
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-07-05 12:49:12 -07:00
Peter Somogyi
eacbdb061e
HBASE-18264 Update pom plugins
...
Update plugins in main and subprojects
Unified versions to use variable instead of direct values
Affected plugins:
- apache-rat-plugin 0.11 -> 0.12
- asciidoctor-maven-plugin 1.5.2.1 -> 1.5.5
- asciidoctorj-pdf 1.5.0-alpha.6 -> 1.5.0-alpha.15
- build-helper-maven-plugin 1.9.1 -> 3.0.0
- buildnumber-maven-plugin 1.3 -> 1.4
- exec-maven-plugin 1.2.1/1.4.0 -> 1.6.0
- extra-enforcer-rules 1.0-beta-3 -> 1.0-beta-6
- findbugs-maven-plugin 3.0.0 -> 3.0.4
- jamon-maven-plugin 2.4.1 -> 2.4.2
- maven-bundle-plugin 2.5.3 -> 3.3.0
- maven-compiler-plugin 3.2/3.5.1 -> 3.6.1
- maven-eclipse-plugin 2.9 -> 2.10
- maven-shade-plugin 2.4.1 -> 3.0.0
- maven-surefire-plugin 2.18.1 -> 2.20
- maven-surefire-report-plugin 2.7.2 -> 2.20
- scala-maven-plugin 3.2.0 -> 3.2.2
- spotbugs 3.1.0-RC1 -> 3.1.0-RC3
- wagon-ssh 2.2 -> 2.12
- xml-maven-plugin 1.0 -> 1.0.1
- maven-assembly-plugin 2.4 -> 2.6(inherited)
- maven-dependency-plugin 2.4 -> 2.10 (inherited)
- maven-enforcer-plugin 1.3.1 -> 1.4.1 (inherited)
- maven-javadoc-plugin 2.10.3 -> 2.10.4 (inherited)
- maven-resources-plugin 2.7 (inherited)
- maven-site-plugin 3.4 -> 3.5.1 (inherited)
Change-Id: I84539f555be498dff18caed1e3eea1e1aeb2143a
Signed-off-by: Michael Stack <stack@apache.org>
2017-07-03 19:43:42 -07:00
Mike Drob
4aa7ce399e
HBASE-18176 Enforce no scala outside hbase-spark
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:10:53 -05:00
dskskv
79607fda85
HBASE-17546 Correct scala syntax to match Apache Spark examples
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-19 16:27:00 -05:00
Sean Busbey
d3ba357c7c
HBASE-16242 Manually resolve transitive Apache Avro dependency to consistently be ver 1.7.7.
...
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-06-19 16:07:33 -05:00
Michael Stack
adfb48eeb8
HBASE-18190 Set version in branch-2 to 2.0.0-alpha-1
2017-06-07 21:10:01 -07:00
Jan Hentschel
17007685c1
HBASE-13074 Cleaned up usage of hbase.master.lease.thread.wakefrequency
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-05-02 23:12:02 +08:00
Yi Liang
49f707fba7
HBASE-17933: [hbase-spark] Support Java api for bulkload
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-24 11:48:29 -05:00
zhangduo
66b616d7a3
HBASE-17914 Create a new reader instead of cloning a new StoreFile when compaction
2017-04-19 09:26:33 +08:00
Xiang Li
e2a746152c
HBASE-17090 Redundant exclusion of jruby-complete in pom of hbase-spark
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-04-14 08:08:42 -07:00
Yi Liang
d7ddc79198
HBASE-17905 [hbase-spark] bulkload does not work when table not exist
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-11 17:18:49 -07:00
tedyu
02da5a6104
HBASE-17905: [hbase-spark] bulkload does not work when table not exist - revert due to misspelling
2017-04-11 17:18:37 -07:00
Yi Liang
22f602cab5
HBASE-17905: [hbase-spark] bulkload does not work when table not exist
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-11 17:01:07 -07:00
zhangduo
a66d491892
HBASE-17857 Remove IS annotations from IA.Public classes
2017-04-05 15:34:06 +08:00
Jerry He
35d7a0cd07
HBASE-15597 Clean up configuration keys used in hbase-spark module (Yi Liang)
2017-03-13 12:02:07 -07:00
Jerry He
6bb5938226
HBASE-14375 Define public API for spark integration module
2017-03-04 14:10:34 -08:00
Jerry He
a95570cfa0
Revert "Define public API for spark integration module" for missing JIRA number.
...
This reverts commit 58b6d9759e
.
2017-03-04 14:08:38 -08:00
Jerry He
58b6d9759e
Define public API for spark integration module
2017-03-04 12:53:21 -08:00
Andrew Purtell
404a2883f2
HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
2017-03-03 12:40:06 -08:00
Jerry He
8088aa3733
HBASE-17574 Clean up how to run tests under hbase-spark module (Yi Liang)
2017-02-07 12:36:19 -08:00
Michael Stack
ffe7dac53d
Revert "Revert "HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server""
...
This reverts commit 0ac5d4a717
.
This is a revert of a revert; i.e. a reapplication!
Fixes for breakage that comes in with this patch is in a follow-on.
2017-01-30 11:54:54 -08:00
chetkhatri
92fc4c0cc8
HBase-17549 HBase-Spark Module: Corrected - Incorrect log at println and unwanted comment code
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-26 21:58:25 -08:00
dskskv
59cd8e510c
HBASE-17547 Bug Resolved - TableCatelog doesn't supports multiple columns from Single Column family
2017-01-26 11:58:01 -08:00
tedyu
81d3e25a75
HBASE-17547 HBase-Spark Module : TableCatelog doesn't support multiple columns from Single Column family - revert due to not using git am
2017-01-26 11:57:04 -08:00
tedyu
0cdea03460
HBASE-17547 HBase-Spark Module : TableCatelog doesn't support multiple columns from Single Column family (Chetan Khatri)
2017-01-26 10:51:43 -08:00
Michael Stack
0ac5d4a717
Revert "HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server"
...
This reverts commit 59fd6eb7f6
.
2017-01-25 22:55:18 -08:00
Yang Guang
59fd6eb7f6
HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server
2017-01-24 23:37:12 -08:00
Yu Li
07e0a30efa
HBASE-17491 Remove all setters from HTable interface and introduce a TableBuilder to build Table instance
2017-01-23 13:57:01 +08:00
Jan Hentschel
55a1aa1e73
HBASE-10699 Set capacity on ArrayList where possible and use isEmpty instead of size() == 0
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:58:20 -08:00
tedyu
ccb8d671d5
HBASE-17371 Enhance 'HBaseContextSuite @ distributedScan to test HBase client' with filter
2016-12-27 15:44:18 -08:00
Michael Stack
b2b79ac7d6
HBASE-17160 Undo unnecessary inter-module dependency; spark to hbase-it and hbase-it to shell
2016-11-22 10:29:27 -08:00
tedyu
81623a353c
HBASE-17047 Add an API to get HBase connection cache statistics (Weiqing Yang)
2016-11-11 06:50:01 -08:00
Michael Stack
ad0e862f78
"HBASE-16952 Replace hadoop-maven-plugins with protobuf-maven-plugin for building protos""
...
Rely on the new plugin to do all proto generation. No need of an
external protoc setup anymore. Mvn will do it all for you.
Updated all READMEs appropriately.
Signed-off-by: Michael Stack <stack@apache.org>
2016-10-28 16:49:35 -07:00
Michael Stack
738ff821dd
Revert "HBASE-16952 Replace hadoop-maven-plugins with protobuf-maven-plugin for building protos"
...
Revert premature commit
This reverts commit d0e61b0e9a
.
2016-10-27 13:17:07 -07:00
Michael Stack
d0e61b0e9a
HBASE-16952 Replace hadoop-maven-plugins with protobuf-maven-plugin for building protos
...
This patch changes poms to use protobuf-maven-plugin instaed of
hadoop-maven-plugins generating protos. Adds a few missing READMEs too
as well as purge of unused protos turned up by the new plugin.
2016-10-27 10:11:58 -07:00
tedyu
444dc866c0
HBASE-16823 Add examples in HBase Spark module (Weiqing Yang)
2016-10-14 10:19:54 -07:00
tedyu
a68c0e2a34
HBASE-16818 Avoid multiple copies of binary data during the conversion from Result to Row (Weiqing Yang)
2016-10-14 10:16:43 -07:00
tedyu
07086036a5
HBASE-16638 Reduce the number of Connection's created in classes of hbase-spark module - addendum 2 (Weiqing Yang)
2016-10-14 09:00:38 -07:00
tedyu
ee6f0ddef6
HBASE-16638 Reduce the number of Connection's created in classes of hbase-spark module - Addendum (Weiqing Yang)
2016-10-11 10:22:50 -07:00
tedyu
9d304d3b2d
HBASE-16638 Reduce the number of Connection's created in classes of hbase-spark module (Weiqing Yang)
2016-10-11 09:04:26 -07:00
tedyu
83fc59d5c9
HBASE-16804 JavaHBaseContext.streamBulkGet is void but should be JavaDStream (Igor Yurinok)
2016-10-10 19:34:21 -07:00