Commit Graph

176 Commits

Author SHA1 Message Date
chenyechao a54f0bfb8f HBASE-21810 bulkload support set hfile compression on client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-12 16:02:15 +08:00
Wellington Chevreuil 92e0d2c246
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files.
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-08 14:04:54 -08:00
subrat.mishra 177d43d8db HBASE-21871 Added support to specify a peer table name in VerifyReplication tool
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-06 23:27:44 +09:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
zhangduo 0b2b474b4c HBASE-21908 Remove Scan.getScanMetrics
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 17:39:31 +08:00
Josh Elser ae0198084c HBASE-21872 Use a call that defaults to UTF-8 charset for string to byte encoding
Fixed commit message

Signed-off-by: Sean Busbey <busbey@apache.org>
2019-02-15 12:11:40 -05:00
Josh Elser d0e4912f67 Revert "HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding"
This reverts commit 3d4e1d57e5. Fixing incorrect Jira id.
2019-02-15 12:11:29 -05:00
Josh Elser 3d4e1d57e5 HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-02-14 12:02:49 -05:00
huzheng 1df571cb36 HBASE-18484 VerifyRep by snapshot does not work when Yarn/SourceHBase/PeerHBase located in three different HDFS clusters 2019-02-12 10:42:52 +08:00
Toshihiro Suzuki b322d0a3e5 HBASE-21201 Support to run VerifyReplication MR tool without peerid
Signed-off-by: Josh Elser <elserj@apache.org>
2019-02-10 16:15:45 +09:00
zhangduo 1995f61d7f HBASE-21782 LoadIncrementalHFiles should not be IA.Public
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:24:55 +08:00
Duo Zhang 4f3b95b318 HBASE-21762 Move some methods in ClusterConnection to Connection
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-01-25 21:13:44 +08:00
huzheng 15031c5bd5 HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:41:02 +08:00
stack 7755d4beed HBASE-21646 Flakey TestTableSnapshotInputFormat; DisableTable not completing... Amendment to fix checkstyle complaint
Includes fix for checkstyle complaint.
2018-12-28 14:48:23 -08:00
huzheng c2d5991b82 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:22:54 +08:00
Josh Elser 67d6d5084c HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-11 10:02:18 -05:00
BELUGA BEHR 7877e09b60 HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-11-27 08:57:06 -08:00
Michael Stack d486bba630 HBASE-21452 Illegal character in hbase counters group name 2018-11-13 22:11:43 -08:00
huzheng 8135285506 HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:18:01 +08:00
Artem Ervits b723ce1051 HBASE-21194 Add tests in TestCopyTable which exercises MOB feature
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-20 08:10:27 -07:00
ffernandez92 8f8d571779 HBASE-20766 Typo in VerifyReplication error.
closes #80.

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-09-26 14:52:28 -07:00
Guangxu Cheng 3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:39 -07:00
Tyler Mi 5c1b325b51 HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
Andrew Purtell 9af7bc6204
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia) 2018-09-07 15:09:09 -07:00
Duo Zhang 855f4bbb28 HBASE-21157 Split TableInputFormatScan to individual tests 2018-09-06 13:56:32 +08:00
Guanghao Zhang bb657c2d2e HBASE-21127 TableRecordReader need to handle cursor result too 2018-09-05 10:34:07 +08:00
Mingliang Liu 6dd5383033 HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:20:31 -07:00
Vikas Vishwakarma dd9880e0de HBASE-20890 PE filterScan seems to be stuck forever 2018-08-27 13:05:29 +05:30
subrat.mishra 49ae8549cf HBASE-21040 Replace call to printStackTrace() with proper logger call
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-15 08:29:54 -07:00
Mike Drob dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-13 12:59:36 -05:00
Wei-Chiu Chuang 6ee0fedb3d HBASE-20859 Backup and incremental load could fail in secure clusters.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-11 16:56:39 -07:00
Michael Stack ffe430237a HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:10:15 -07:00
Sahil Aggarwal 952bb96c8a
HBASE-19164: Remove UUID.randomUUID in tests.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-27 10:34:16 -05:00
jingyuntian a68dbde941 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
Signed-off-by: huzheng <openinx@gmail.com>
2018-06-27 14:39:20 +08:00
huzheng 063c3aca56 Revert "HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl"
This reverts commit b41b05cd6b.
2018-06-27 14:39:12 +08:00
jingyuntian b41b05cd6b HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl 2018-06-26 15:24:49 +08:00
Sean Busbey f1b536bad4 HBASE-20332 shaded mapreduce module shouldn't include hadoop
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
2018-06-18 11:31:04 -07:00
Josh Elser a5ed463d48 HBASE-20579 Include original exception in wrapped exception
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-02 22:27:13 -04:00
tedyu 74ef118e9e HBASE-20668 Avoid permission change if ExportSnapshot's copy fails 2018-06-01 14:34:51 -07:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
Allan Yang f3d1c021de HBASE-20601 Add multiPut support and other miscellaneous to PE 2018-05-24 19:52:40 +08:00
Allan Yang 4005a0c4d3 Revert "HBASE-20601 Add multiPut support and other miscellaneous to PE" 2018-05-24 19:37:21 +08:00
Allan Yang 85901754f8 HBASE-20601 Add multiPut support and other miscellaneous to PE 2018-05-24 09:11:45 +08:00
jingyuntian c9f8c3436f HBASE-20579 Improve snapshot manifest copy in ExportSnapshot
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-18 06:42:12 -07:00
Xu Cang cf529f18a9 HBASE-20488 Fix PE command help message
checkstyle fix

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-05-17 11:56:04 +02:00
Vladimir Rodionov acbc3a2253 HBASE-20530 Composition of backup directory containing namespace when restoring is different from the actual hfile location
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-16 14:21:20 -07:00
Sean Busbey 8ba2a7eeb9 HBASE-20544 Make HBTU default to random ports.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2018-05-09 23:35:20 -07:00
Michael Stack 4f2dfd3877 HBASE-20539 Disable IMC; part 2
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
2018-05-09 06:30:28 -07:00
Mike Drob c51e9adc78 HBASE-20521 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 22:20:12 -05:00