939a29b41e
HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications
...
This is a reapply of a reverted commit. This commit includes
HBASE-22059 amendment and subsequent ammendments to HBASE-22052.
See HBASE-22052 for full story.
jersey-core is problematic. It was transitively included from hadoop
and polluting our CLASSPATH with an implementation of a 1.x version
of the javax.ws.rs.core.Response Interface from jsr311-api when we
want the javax.ws.rs-api 2.x version.
M hbase-endpoint/pom.xml
M hbase-http/pom.xml
M hbase-mapreduce/pom.xml
M hbase-rest/pom.xml
M hbase-server/pom.xml
M hbase-zookeeper/pom.xml
Remove redundant version specification (and the odd property define
done already up in parent pom).
M hbase-it/pom.xml
M hbase-rest/pom.xml
Exclude jersey-core explicitly.
M hbase-procedure/pom.xml
Remove redundant version and classifier.
M pom.xml
Add jersey-core exclusions to all dependencies that pull it in
except hadoop-minicluster. mr tests fail w/o the jersey-core
so let it in for minicluster and then in modules, exclude it
where it causes damage as in hbase-it.
2019-03-25 09:28:39 -04:00
b6afc5fbc1
HBASE-21810 bulkload support set hfile compression on client
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-12 17:54:24 +08:00
bfe7751814
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-08 14:06:15 -08:00
2f9ab7d95a
HBASE-21871 Added support to specify a peer table name in VerifyReplication tool
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-06 23:29:08 +09:00
607ac735c4
HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter
2019-02-23 23:29:53 +08:00
761aef6d9d
HBASE-20587 Replace Jackson with shaded thirdparty gson
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:40:45 +08:00
df8fa5ef23
HBASE-18484 VerifyRep by snapshot does not work when Yarn/SourceHBase/PeerHBase located in three different HDFS clusters
2019-02-12 11:06:11 +08:00
3902693f61
HBASE-21201 Support to run VerifyReplication MR tool without peerid
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-02-10 16:16:37 +09:00
16665b6e93
HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT
2019-01-29 21:53:21 +08:00
2d4819dbed
HBASE-21782 LoadIncrementalHFiles should not be IA.Public
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:26:00 +08:00
1ac090b3f0
HBASE-21762 Move some methods in ClusterConnection to Connection
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-01-25 21:14:07 +08:00
fdfbd9a21c
HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case
2019-01-16 09:47:27 +08:00
8add7915de
HBASE-21646 Flakey TestTableSnapshotInputFormat; DisableTable not completing... Amendment to fix checkstyle complaint
...
Includes fix for checkstyle complaint.
2018-12-28 14:47:50 -08:00
f60e8b0b95
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time
2018-12-27 18:50:10 +08:00
fc7ca8a2ef
HBASE-21492 CellCodec Written To WAL Before It's Verified
2018-12-18 17:45:37 -08:00
b8405bfea4
HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running
...
This includes removing the "old way" of disabling blockcache in favor of the
new API.
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-11 11:37:35 -05:00
66c2a7487c
HBASE-21452 Illegal character in hbase counters group name
2018-11-13 22:12:40 -08:00
ee19f2b36f
HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS
2018-11-10 10:19:45 +08:00
12ea0cf373
HBASE-20766 Typo in VerifyReplication error.
...
closes #80 .
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 8f8d571779
2018-09-26 14:55:21 -07:00
fd68e7593e
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:34 -07:00
d40348e8cd
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 16:31:56 -07:00
7d9e5538ba
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia)
2018-09-07 15:09:36 -07:00
f61f3c7f65
HBASE-21157 Split TableInputFormatScan to individual tests
2018-09-06 13:56:36 +08:00
d39be48f04
HBASE-21127 TableRecordReader need to handle cursor result too
2018-09-05 10:41:02 +08:00
a0cbfb8ea6
HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:22:04 -07:00
9c19692c37
HBASE-20890 PE filterScan seems to be stuck forever
2018-08-27 13:01:52 +05:30
2a9162a503
HBASE-20884 Replace Base64 with j.u.Base64
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-13 13:00:23 -05:00
e3d87cc1ec
HBASE-20785 NPE getting metrics in PE testing scans
2018-06-27 12:07:50 -07:00
e61507b9a0
HBASE-19164: Remove UUID.randomUUID in tests.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-27 10:36:48 -05:00
a02581e72f
HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-06-27 14:31:41 +08:00
2c02fb66a0
Revert "HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl"
...
This reverts commit 48cd82e134
2018-06-27 14:30:46 +08:00
48cd82e134
HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
2018-06-26 15:35:05 +08:00
dde042cc93
HBASE-20776 Update branch-2 version to 2.2.0-SNAPSHOT
2018-06-22 22:15:18 +08:00
ee84a8f243
HBASE-20332 shaded mapreduce module shouldn't include hadoop
...
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
Conflicts:
hbase-backup/pom.xml
hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-18 14:02:48 -07:00
b04c976fe6
HBASE-20478 Update checkstyle to v8.2
...
Cannot go to latest (8.9) yet due to
https://github.com/checkstyle/checkstyle/issues/5279
* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-06-18 14:02:40 -07:00
81937df3bb
HBASE-20579 Include original exception in wrapped exception
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-02 22:16:29 -04:00
5a200b5902
HBASE-20668 Avoid permission change if ExportSnapshot's copy fails
2018-06-01 14:39:01 -07:00
f27a6dc1d2
HBASE-20601 Add multiPut support and other miscellaneous to PE
2018-05-23 20:06:23 +08:00
c3c9a4a595
HBASE-20579 Improve snapshot manifest copy in ExportSnapshot
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-18 06:43:53 -07:00
56bb1fa065
HBASE-20488 Fix PE command help message
...
checkstyle fix
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-05-17 11:58:23 +02:00
61f96b6ffa
HBASE-20544 Make HBTU default to random ports.
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
Conflicts:
hbase-backup/src/test/resources/hbase-site.xml
hbase-spark-it/src/test/resources/hbase-site.xml
hbase-spark/src/test/resources/hbase-site.xml
2018-05-09 23:45:39 -07:00
de25f8b209
HBASE-20539 Disable IMC; part 2
...
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
2018-05-09 06:29:56 -07:00
421ed6ca51
HBASE-20521 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests
2018-05-08 22:18:48 -05:00
d91908b0d4
Revert "change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests"
...
This reverts commit 9e68719014
2018-05-08 22:18:42 -05:00
9e68719014
change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests
2018-05-08 10:25:56 -05:00
6f2ec4639b
HBASE-20505 PE should support multi column family read and write cases
2018-05-07 18:39:10 -07:00
db67906cd0
HBASE-20523 PE tool should support configuring client side buffering sizes
...
(Ram)
2018-05-07 12:50:24 +05:30
991d78ca2b
HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation
2018-05-04 17:59:20 -07:00
7df8e5e4a7
HBASE-20517 Fix PerformanceEvaluation 'column' parameter
2018-05-04 17:24:21 -07:00
944ecc729c
HBASE-20439 Clean up incorrect use of commons-logging in hbase-server
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/FileArchiverNotifierImpl.java
hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/RegionSizeReportingChore.java
hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/RegionSizeStoreImpl.java
Additions:
hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestCellBasedHFileOutputFormat2.java
hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestCellBasedImportExport2.java
2018-04-20 08:04:17 -05:00
e51ced4f17
HBASE-20376 RowCounter and CellCounter documentations are incorrect
2018-04-12 10:05:45 +02:00
d0060394bf
HBASE-20386 [DOC] Align WALPlayer help text and refguide
2018-04-11 09:36:26 -07:00
1ec708bf6c
HBASE-20361 Non-successive TableInputSplits may wrongly be merged by auto balancing feature
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-08 10:58:56 -07:00
10ed3f41f5
HBASE-20295 fix NullPointException in TableOutputFormat.checkOutputSpecs
2018-04-07 09:30:52 -07:00
468d4fcd73
HBASE-20282 Clean up tooling docs/help
2018-03-30 09:00:46 -07:00
c3d82a283d
HBASE-20223 Update to hbase-thirdparty 2.1.0
...
Remove commons-cli and commons-collections4 use. Account
for the newer internal protobuf version of 3.5.1.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-26 16:07:39 -04:00
52014b9423
HBASE-13300 Fixed casing in set/getTimeStamp for Mutations
2018-03-23 17:23:55 -07:00
96d63fee11
HBASE-20224 Web UI is broken in standalone mode
...
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
2018-03-22 20:28:08 -07:00
79e4c9d925
Revert "HBASE-20224 Web UI is broken in standalone mode"
...
Broke shell tests.
This reverts commit dd9fe813ec
2018-03-22 10:47:47 -07:00
dd9fe813ec
HBASE-20224 Web UI is broken in standalone mode
...
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
2018-03-22 06:52:51 -07:00
dd9e46bbf5
HBASE-20212 Make all Public classes have InterfaceAudience category
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-22 18:09:54 +08:00
95596e8ba7
HBASE-20119 Introduce a pojo class to carry coprocessor information in order to make TableDescriptorBuilder accept multiple cp at once
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-16 01:26:08 +08:00
5e2f8e4023
HBASE-20180 Avoid Class::newInstance
2018-03-14 12:23:38 -05:00
b84fbde175
HBASE-19687 Move the logic in ReplicationZKNodeCleaner to ReplicationChecker and remove ReplicationZKNodeCleanerChore
2018-03-09 20:55:48 +08:00
525fef572e
HBASE-19633 Clean up the replication queues in the postPeerModification stage when removing a peer
2018-03-09 20:55:48 +08:00
1e36a84afc
HBASE-19622 Reimplement ReplicationPeers with the new replication storage interface
2018-03-09 20:55:48 +08:00
eae251d203
HBASE-19573 Rewrite ReplicationPeer with the new replication storage interface
2018-03-09 20:55:48 +08:00
71cc7869db
HBASE-20155 update branch-2 version to 2.1.0-SNAPSHOT
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-03-08 08:44:30 -08:00
9927c2e14a
HBASE-20070 refactor website generation
...
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
Conflicts:
hbase-backup/pom.xml
hbase-spark-it/pom.xml
2018-03-02 09:51:43 -06:00
a2de29560f
HBASE-20113 Move branch-2 version from 2.0.0-beta-2-SNAPSHOT to 2.0.0-beta-2
2018-03-01 15:46:38 -08:00
03f9cb89a6
HBASE-20110 Findbugs in zk and mr caused nightly #409 branch-2 to fail
2018-02-28 23:38:35 -08:00
b3ae580216
HBASE-20086 PE randomSeekScan fails with ClassNotFoundException
2018-02-26 18:30:09 -08:00
d8ec10e20f
HBASE-20039 MR tests out to hbase-mapreduce mobile
2018-02-21 14:53:30 -06:00
a5443c18d2
HBASE-20023 CompactionTool command line examples are incorrect
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-20 08:13:59 -08:00
a458d7c400
HBASE-18294 Reduce global heap pressure: flush based on heap occupancy
2018-02-18 12:58:52 +02:00
f5b365e2c9
HBASE-19968 MapReduce test fails with NoClassDefFoundError against hadoop3
2018-02-12 09:54:48 -08:00
8f1e01b6e5
HBASE-19951 Cleanup the explicit timeout value for test method
2018-02-07 16:39:54 -08:00
66a11f2ac0
HBASE-19904 Break dependency of WAL constructor on Replication
2018-02-03 17:11:30 +08:00
b0bf6f504e
HBASE-19720 Rename WALKey#getTabnename to WALKey#getTableName
2018-02-02 20:02:04 +08:00
28d13c54a9
HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules
2018-01-31 20:49:25 +08:00
90a75fb052
HBASE-19888 Move branch-2 version from 2.0.0-beta-1 to 2.0.0-beta-2-SNAPSHOT
2018-01-29 14:17:54 -08:00
bbf3bae72a
HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs
2018-01-29 12:41:14 -08:00
80c7b7d0de
HBASE-19853 Remove duplicate slf4j-api dep
2018-01-24 11:40:00 -06:00
8f713fcc19
HBASE-19829 hadoop-minicluster pulls zookeeper:test-jar:tests 3.4.6
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-19 15:22:15 -08:00
48bb19012c
HBASE-19792 TestReplicationSmallTests.testDisableEnable fails
2018-01-17 14:23:17 +08:00
814d08a2d6
HBASE-19751 Use RegionInfo directly instead of an identifier and a namespace when getting WAL
2018-01-11 15:48:33 +08:00
3fa3dcd9f9
HBASE-19483 Add proper privilege check for rsgroup commands
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-09 08:11:07 -08:00
0b62528dbf
HBASE-18452 VerifyReplication by Snapshot should cache HDFS token before submit job for kerberos env
2018-01-04 14:01:41 +08:00
654edc5fa5
HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes
2018-01-04 13:05:21 +08:00
4c0fba6a85
HBASE-19588 Additional jar dependencies needed for mapreduce
...
PerformanceEvaluation
Signed-off-by: Albert Chu <chu11@llnl.gov>
2018-01-03 21:36:05 -06:00
16e8422855
HBASE-18806 VerifyRep by snapshot need not to restore snapshot for each mapper
2018-01-04 10:12:53 +08:00
9e141d12a4
HBASE-8518 Get rid of hbase.hstore.compaction.complete setting
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-30 04:32:12 +08:00
64cb777a8a
HBASE-19552 find-and-replace thirdparty offset
2017-12-28 12:01:25 -06:00
968b938fde
HBASE-19552 Update hbase-thirdparty version
...
Some manual cleanup of changing package names in pom files and getting
rid of the no-longer-needed netty system property.
This commit will break compilation, package renames in source code are
done in follow-on commits using straightforward find and replace.
's/org.apache.hadoop.hbase.shaded.com.google/org.apache.hbase.thirdparty.com.google/'
's/org.apache.hadoop.hbase.shaded.io.netty/org.apache.hbase.thirdparty.io.netty/'
2017-12-28 11:58:49 -06:00
d6d8369655
HBASE-19648 Move branch-2 version from 2.0.0-beta-1-SNAPSHOT to 2.0.0-beta-1
2017-12-27 14:41:19 -08:00
2468f30029
HBASE-19628 ByteBufferCell should extend ExtendedCell
2017-12-27 23:02:18 +08:00
0454a389a3
HBASE-19629 RawCell#getTags should return the Iterator<Tag> in order to avoid iterating through whole tag array at once
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 21:30:08 +08:00
15ed748286
HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 20:10:50 +08:00
992b5d8630
HBASE-10092 Move up on to log4j2
...
Changes:
- replaced commons-logging to slf4j everywhere
- log.XXX(Throwable) calls were replaced with log.XXX(t.toString(), t)
- log.XXX(Object) calls were replaced with log.XXX(Objects.toString(obj))
- log.fatal() calls were replaced with log.error(HBaseMarkers.FATAL, ...)
- programmatic log4j configuration was removed from the unit test
This commit does not affect the current logging configurations, because log4j
is still on the classpath. slf4j-log4j12 binds log4j to slf4j.
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-20 22:58:12 -08:00
c739e3ecec
HBASE-15482 Provide an option to skip calculating block locations for SnapshotInputFormat
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-19 15:52:42 -08:00
stack
chenyechao
Wellington Chevreuil
subrat.mishra
Guanghao Zhang
Duo Zhang
huzheng
Toshihiro Suzuki
BELUGA BEHR
Josh Elser
ffernandez92
Guangxu Cheng
Tyler Mi
Andrew Purtell
Mingliang Liu
Vikas Vishwakarma
Mike Drob
Sahil Aggarwal
jingyuntian
Sean Busbey
tedyu
Allan Yang
Xu Cang
michael.jin
Vasudevan
Peter Somogyi
Balazs Meszaros
Yuki Tawara
Jan Hentschel
Umesh Agashe
Chia-Ping Tsai
Artem Ervits
eshcar
Duo Zhang
brandboat
Peter Somogyi
Xiang Li