Commit Graph

263 Commits

Author SHA1 Message Date
Viraj Jasani 2ad62b0162 HBASE-22679 : Revamping CellUtil (#735)
* HBASE-22679 : Revamping CellUtil

* checkstyle fix

* incorporating review

* minor indentation
2019-10-21 23:04:21 -07:00
Andrew Purtell 6e3a455887
HBASE-23139 MapReduce jobs lauched from convenience distribution are nonfunctional (#705)
Add hbase-shaded-gson to base job dependencies.

Conflicts:
	hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
2019-10-08 19:14:09 -07:00
langdamao 128b4803f2 HBASE-22887 Fix HFileOutputFormat2 writer roll (#554)
Signed-off-by: langdamao <lang--lang--lang@163.com>
2019-10-08 16:42:54 -07:00
Pankaj 13b2edc1be HBASE-22928 ScanMetrics counter update may not happen in case of exception in TableRecordReaderImpl
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-09-02 10:47:44 +08:00
Viraj Jasani b8857ec010 HBASE-22863 Cleanup transitive Jackson1 vulnerable dependencies(forward-port HBASE-22728) (#505)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-21 22:06:05 +08:00
syedmurtazahassan 15c903b3f8 HBASE-22725 Remove all remaining Javadoc warnings
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-11 21:48:08 +02:00
Jan Hentschel ef887e5292
HBASE-22832 Removed deprecated method from HFileOutputFormat2
Signed-off-by: stack <stack@apache.org>
2019-08-11 21:42:53 +02:00
Jan Hentschel 0553aa4451
HBASE-22831 Removed deprecated constructor from TableRecordWriter
Signed-off-by: stack <stack@apache.org>
2019-08-11 21:40:54 +02:00
dingwei-2017 ff96485396 HBASE-22773 when set blockSize option in Performance Evaluation tool, error occurs:ERROR: Unrecognized option/command: --blockSize=131072
Signed-off-by: huzheng <openinx@gmail.com>
2019-08-05 11:34:52 +08:00
Wellington Chevreuil 3708198817 HBASE-21773 rowcounter utility should respond to pleas for help
Signed-off-by: stack <stack@apache.org>
2019-07-26 21:19:17 +01:00
syedmurtazahassan d9493c539f HBASE-22603 Javadoc Warnings related to @link tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 14:14:12 +02:00
syedmurtazahassan 8defea9561 HBASE-22586 Javadoc Warnings related to @param tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 16:46:18 +02:00
syedmurtazahassan 9f343c2efa HBASE-22571 Javadoc Warnings related to @return tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 13:34:48 +02:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2019-07-01 21:15:00 -07:00
Duo Zhang a116e0bab1 HBASE-21723 Remove ConnectionImplementation and related classes 2019-06-18 08:43:35 +08:00
Duo Zhang d64d015f51 HBASE-21718 Implement Admin based on AsyncAdmin 2019-06-18 08:43:32 +08:00
Duo Zhang 6b87a4ce98 HBASE-21717 Implement Connection based on AsyncConnection 2019-06-18 08:37:51 +08:00
zhangduo b7793d7d1d HBASE-21585 Remove ClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 2182bfb942 HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection 2019-06-18 08:37:50 +08:00
Jan Hentschel 5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs (#208)
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:02:23 +02:00
Apache9 9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface (#309)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
2019-06-17 10:18:18 +08:00
Jan Hentschel 47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:13:46 +02:00
syedmurtazahassan b32e716bee HBASE-22481 Javadoc Warnings reference not found 2019-06-08 20:25:31 +02:00
zhangduo 26037854ad HBASE-22524 Refactor TestReplicationSyncUpTool 2019-06-04 07:46:15 +08:00
Guanghao 97090560a5
HBASE-22003 Fix flaky test TestVerifyReplication.testHBase14905 2019-05-28 17:22:53 +08:00
Andrew Purtell a30b186568
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:34:25 -07:00
Jan Hentschel 2c7fdb39ce HBASE-22277 Removed deprecated methods from Get 2019-05-01 01:25:53 +02:00
Sean Busbey bf140acd20 HBASE-22083 move eclipse settings into a profile.
Signed-off-by: stack <stack@apache.org>
2019-04-25 14:17:18 -05:00
Jan Hentschel f30d6c958a HBASE-22231 Removed unused and '*' imports 2019-04-20 22:03:32 +02:00
Jan Hentschel 12bcb879da HBASE-22199 Replaced UTF-8 String with StandardCharsets.UTF_8 2019-04-17 10:13:25 +02:00
wellington cd61bcc01e
HBASE-20586: add support for clusters on different realms (with cross-realm authentication)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-15 11:23:21 -07:00
meiyi 94d9dc1e84 HBASE-22084 Rename AccessControlLists to PermissionStorage
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-12 14:18:09 +08:00
Bahram Chechrazy 2c8b813810 HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-04-11 11:33:52 -07:00
Guanghao 89ce5d17e4
HBASE-22163 Should not archive the compacted store files when region warmup (#122)
* HBASE-22163 Should not archive the compacted store files when region warmup
2019-04-08 22:11:07 +08:00
stack 089a639724 HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications
This is a reapply of a reverted commit. This commit includes
HBASE-22059 amendment and subsequent ammendments to HBASE-22052.
See HBASE-22052 for full story.

jersey-core is problematic. It was transitively included from hadoop
and polluting our CLASSPATH with an implementation of a 1.x version
of the javax.ws.rs.core.Response Interface from jsr311-api when we
want the javax.ws.rs-api 2.x version.

    M hbase-endpoint/pom.xml
    M hbase-http/pom.xml
    M hbase-mapreduce/pom.xml
    M hbase-rest/pom.xml
    M hbase-server/pom.xml
    M hbase-zookeeper/pom.xml
     Remove redundant version specification (and the odd property define
     done already up in parent pom).
    M hbase-it/pom.xml
    M hbase-rest/pom.xml
     Exclude jersey-core explicitly.

    M hbase-procedure/pom.xml
     Remove redundant version and classifier.

    M pom.xml
     Add jersey-core exclusions to all dependencies that pull it in
     except hadoop-minicluster. mr tests fail w/o the jersey-core
     so let it in for minicluster and then in modules, exclude it
     where it causes damage as in hbase-it.
2019-03-25 09:30:09 -04:00
Kevin Risden c144c814b0 HBASE-21895 - Error prone upgrade
* Upgrades to error prone 2.3.3
* Moves to error prone plugin to support 9+ JDKs
* Removes custom error prone plugin due to no usage

Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-24 13:13:07 +08:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-14 21:42:23 +08:00
chenyechao a54f0bfb8f HBASE-21810 bulkload support set hfile compression on client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-12 16:02:15 +08:00
Wellington Chevreuil 92e0d2c246
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-08 14:04:54 -08:00
subrat.mishra 177d43d8db HBASE-21871 Added support to specify a peer table name in VerifyReplication tool
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-06 23:27:44 +09:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
zhangduo 0b2b474b4c HBASE-21908 Remove Scan.getScanMetrics
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 17:39:31 +08:00
Josh Elser ae0198084c HBASE-21872 Use a call that defaults to UTF-8 charset for string to byte encoding
Fixed commit message

Signed-off-by: Sean Busbey <busbey@apache.org>
2019-02-15 12:11:40 -05:00
Josh Elser d0e4912f67 Revert "HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding"
This reverts commit 3d4e1d57e5. Fixing incorrect Jira id.
2019-02-15 12:11:29 -05:00
Josh Elser 3d4e1d57e5 HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-02-14 12:02:49 -05:00
huzheng 1df571cb36 HBASE-18484 VerifyRep by snapshot does not work when Yarn/SourceHBase/PeerHBase located in three different HDFS clusters 2019-02-12 10:42:52 +08:00
Toshihiro Suzuki b322d0a3e5 HBASE-21201 Support to run VerifyReplication MR tool without peerid
Signed-off-by: Josh Elser <elserj@apache.org>
2019-02-10 16:15:45 +09:00
zhangduo 1995f61d7f HBASE-21782 LoadIncrementalHFiles should not be IA.Public
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:24:55 +08:00
Duo Zhang 4f3b95b318 HBASE-21762 Move some methods in ClusterConnection to Connection
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-01-25 21:13:44 +08:00
huzheng 15031c5bd5 HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:41:02 +08:00
stack 7755d4beed HBASE-21646 Flakey TestTableSnapshotInputFormat; DisableTable not completing... Amendment to fix checkstyle complaint
Includes fix for checkstyle complaint.
2018-12-28 14:48:23 -08:00
huzheng c2d5991b82 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:22:54 +08:00
Josh Elser 67d6d5084c HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-11 10:02:18 -05:00
BELUGA BEHR 7877e09b60 HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-11-27 08:57:06 -08:00
Michael Stack d486bba630 HBASE-21452 Illegal character in hbase counters group name 2018-11-13 22:11:43 -08:00
huzheng 8135285506 HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:18:01 +08:00
Artem Ervits b723ce1051 HBASE-21194 Add tests in TestCopyTable which exercises MOB feature
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-20 08:10:27 -07:00
ffernandez92 8f8d571779 HBASE-20766 Typo in VerifyReplication error.
closes #80.

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-09-26 14:52:28 -07:00
Guangxu Cheng 3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:39 -07:00
Tyler Mi 5c1b325b51 HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
Andrew Purtell 9af7bc6204
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia) 2018-09-07 15:09:09 -07:00
Duo Zhang 855f4bbb28 HBASE-21157 Split TableInputFormatScan to individual tests 2018-09-06 13:56:32 +08:00
Guanghao Zhang bb657c2d2e HBASE-21127 TableRecordReader need to handle cursor result too 2018-09-05 10:34:07 +08:00
Mingliang Liu 6dd5383033 HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:20:31 -07:00
Vikas Vishwakarma dd9880e0de HBASE-20890 PE filterScan seems to be stuck forever 2018-08-27 13:05:29 +05:30
subrat.mishra 49ae8549cf HBASE-21040 Replace call to printStackTrace() with proper logger call
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-15 08:29:54 -07:00
Mike Drob dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-13 12:59:36 -05:00
Wei-Chiu Chuang 6ee0fedb3d HBASE-20859 Backup and incremental load could fail in secure clusters.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-11 16:56:39 -07:00
Michael Stack ffe430237a HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:10:15 -07:00
Sahil Aggarwal 952bb96c8a
HBASE-19164: Remove UUID.randomUUID in tests.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-27 10:34:16 -05:00
jingyuntian a68dbde941 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
Signed-off-by: huzheng <openinx@gmail.com>
2018-06-27 14:39:20 +08:00
huzheng 063c3aca56 Revert "HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl"
This reverts commit b41b05cd6b.
2018-06-27 14:39:12 +08:00
jingyuntian b41b05cd6b HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl 2018-06-26 15:24:49 +08:00
Sean Busbey f1b536bad4 HBASE-20332 shaded mapreduce module shouldn't include hadoop
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
2018-06-18 11:31:04 -07:00
Josh Elser a5ed463d48 HBASE-20579 Include original exception in wrapped exception
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-02 22:27:13 -04:00
tedyu 74ef118e9e HBASE-20668 Avoid permission change if ExportSnapshot's copy fails 2018-06-01 14:34:51 -07:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
Allan Yang f3d1c021de HBASE-20601 Add multiPut support and other miscellaneous to PE 2018-05-24 19:52:40 +08:00
Allan Yang 4005a0c4d3 Revert "HBASE-20601 Add multiPut support and other miscellaneous to PE" 2018-05-24 19:37:21 +08:00
Allan Yang 85901754f8 HBASE-20601 Add multiPut support and other miscellaneous to PE 2018-05-24 09:11:45 +08:00
jingyuntian c9f8c3436f HBASE-20579 Improve snapshot manifest copy in ExportSnapshot
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-18 06:42:12 -07:00
Xu Cang cf529f18a9 HBASE-20488 Fix PE command help message
checkstyle fix

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-05-17 11:56:04 +02:00
Vladimir Rodionov acbc3a2253 HBASE-20530 Composition of backup directory containing namespace when restoring is different from the actual hfile location
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-16 14:21:20 -07:00
Sean Busbey 8ba2a7eeb9 HBASE-20544 Make HBTU default to random ports.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2018-05-09 23:35:20 -07:00
Michael Stack 4f2dfd3877 HBASE-20539 Disable IMC; part 2
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
2018-05-09 06:30:28 -07:00
Mike Drob c51e9adc78 HBASE-20521 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 22:20:12 -05:00
Mike Drob 82e6fae1de Revert "change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests"
This reverts commit b748ea3b0d.
2018-05-08 22:20:06 -05:00
michael.jin b748ea3b0d change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 10:24:03 -05:00
Andrew Purtell 1825af45b3 HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:02 -07:00
Vasudevan 8e6ff689e8 HBASE-20523 PE tool should support configuring client side buffering sizes
(Ram)
2018-05-07 12:57:20 +05:30
Andrew Purtell 291dedbf81 HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:12 -07:00
Andrew Purtell 78ffd7ace6 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:17 -07:00
Peter Somogyi c4ebf666b7 HBASE-20376 RowCounter and CellCounter documentations are incorrect 2018-04-12 10:00:38 +02:00
Balazs Meszaros eb40e6dfaa HBASE-20386 [DOC] Align WALPlayer help text and refguide 2018-04-11 09:32:55 -07:00
Yuki Tawara c7593d14a9 HBASE-20361 Non-successive TableInputSplits may wrongly be merged by auto balancing feature
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-08 10:58:23 -07:00
wellington f574fd4782 HBASE-20305 adding options to skip deletes/puts on target when running SyncTable
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-04 12:38:18 -07:00
Mike Drob d57001ee2d HBASE-20282 Clean up tooling docs/help 2018-03-30 08:59:47 -07:00
michael.jin 53b4507c79 HBASE-20295 fix NullPointException in TableOutputFormat.checkOutputSpecs
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-03-30 07:07:45 -07:00
Josh Elser 15c398f7d2 HBASE-20223 Update to hbase-thirdparty 2.1.0
Remove commons-cli and commons-collections4 use. Account
for the newer internal protobuf version of 3.5.1.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-26 22:05:19 -04:00