Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,903 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

272 Commits

Author SHA1 Message Date
Jan Hentschel ab9766599d
HBASE-23635 Reduced number of Checkstyle violations in hbase-mapreduce 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-01-04 00:48:24 +01:00
Sean Busbey bc2f162749 HBASE-23239 Reporting on status of backing MOB files from client-facing cells (#785) 
* Adds a new MapReduce job that builds a report of health of mob files
* Also builds background information on mob system use
* add a basic mob architecture in the ref guide to explain how mob takes the reference hfile value and finds the actual cell contents
* add a troubleshooting mob section to the ref guide to explain how to do a mob reference scan.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-12-16 12:48:17 -06:00
Mingliang Liu 96fd75bd0e HBASE-22607. TestExportSnapshotNoCluster fails intermittently 2019-11-20 07:47:46 -08:00
Mingliang Liu 8bfdfe1b85 HBASE-23289 Update links to Hadoop wiki in book and code 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2019-11-18 08:58:07 -08:00
Geoffrey Jacoby 77490f815a HBASE-23251 - Add Column Family and Table Names to HFileContext and use in HFileWriterImpl logging (#796) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-11-11 16:18:43 +08:00
chenxu14 34661050c8 HBASE-22888 Share some stuffs with the initial reader when new stream reader created (#581) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-11-08 13:54:53 +08:00
Shardul Singh f58bd4a7ac HBASE-22980 HRegionPartioner getPartition() method incorrectly partitions the regions of the table. (#590) 
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
 2019-11-06 22:07:44 +08:00
Michael Stack e1b4a2a895 HBASE-23221 Polish the WAL interface after HBASE-23181 (#774) 
Removes the closeRegion flag added by HBASE-23181 and instead
relies on reading meta WALEdit content. Modified how qualifier is
written when the meta WALEdit is for a RegionEventDescriptor
so the 'type' is added to the qualifer so can figure type
w/o having to deserialize protobuf value content: e.g.
HBASE::REGION_EVENT::REGION_CLOSE

Added doc on WALEdit and tried to formalize the 'meta' WALEdit
type and how it works. Needs complete redo in part as suggested
by HBASE-8457. Meantime, some doc and cleanup.

Also changed the LogRoller constructor to remove redundant param.
Because of constructor change, need to change also
TestFailedAppendAndSync, TestWALLockup, TestAsyncFSWAL &
WALPerformanceEvaluation.java

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-10-31 18:52:04 +08:00
Duo Zhang 7b5cd0152f
HBASE-23181 Blocked WAL archive: "LogRoller: Failed to schedule flush of XXXX, because it is not online on us" (#753) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-10-26 20:37:37 +08:00
Viraj Jasani 2ad62b0162 HBASE-22679 : Revamping CellUtil (#735) 
* HBASE-22679 : Revamping CellUtil

* checkstyle fix

* incorporating review

* minor indentation
 2019-10-21 23:04:21 -07:00
Andrew Purtell 6e3a455887
HBASE-23139 MapReduce jobs lauched from convenience distribution are nonfunctional (#705) 
Add hbase-shaded-gson to base job dependencies.

Conflicts:
	hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
 2019-10-08 19:14:09 -07:00
langdamao 128b4803f2 HBASE-22887 Fix HFileOutputFormat2 writer roll (#554) 
Signed-off-by: langdamao <lang--lang--lang@163.com>
 2019-10-08 16:42:54 -07:00
Pankaj 13b2edc1be HBASE-22928 ScanMetrics counter update may not happen in case of exception in TableRecordReaderImpl 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-09-02 10:47:44 +08:00
Viraj Jasani b8857ec010 HBASE-22863 Cleanup transitive Jackson1 vulnerable dependencies(forward-port HBASE-22728) (#505) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-08-21 22:06:05 +08:00
syedmurtazahassan 15c903b3f8 HBASE-22725 Remove all remaining Javadoc warnings 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-08-11 21:48:08 +02:00
Jan Hentschel ef887e5292
HBASE-22832 Removed deprecated method from HFileOutputFormat2 
Signed-off-by: stack <stack@apache.org>
 2019-08-11 21:42:53 +02:00
Jan Hentschel 0553aa4451
HBASE-22831 Removed deprecated constructor from TableRecordWriter 
Signed-off-by: stack <stack@apache.org>
 2019-08-11 21:40:54 +02:00
dingwei-2017 ff96485396 HBASE-22773 when set blockSize option in Performance Evaluation tool, error occurs:ERROR: Unrecognized option/command: --blockSize=131072 
Signed-off-by: huzheng <openinx@gmail.com>
 2019-08-05 11:34:52 +08:00
Wellington Chevreuil 3708198817 HBASE-21773 rowcounter utility should respond to pleas for help 
Signed-off-by: stack <stack@apache.org>
 2019-07-26 21:19:17 +01:00
syedmurtazahassan d9493c539f HBASE-22603 Javadoc Warnings related to @link tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-23 14:14:12 +02:00
syedmurtazahassan 8defea9561 HBASE-22586 Javadoc Warnings related to @param tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-13 16:46:18 +02:00
syedmurtazahassan 9f343c2efa HBASE-22571 Javadoc Warnings related to @return tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-13 13:34:48 +02:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
 2019-07-01 21:15:00 -07:00
Duo Zhang a116e0bab1 HBASE-21723 Remove ConnectionImplementation and related classes 2019-06-18 08:43:35 +08:00
Duo Zhang d64d015f51 HBASE-21718 Implement Admin based on AsyncAdmin 2019-06-18 08:43:32 +08:00
Duo Zhang 6b87a4ce98 HBASE-21717 Implement Connection based on AsyncConnection 2019-06-18 08:37:51 +08:00
zhangduo b7793d7d1d HBASE-21585 Remove ClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 2182bfb942 HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection 2019-06-18 08:37:50 +08:00
Jan Hentschel 5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs (#208) 
Signed-off-by: stack <stack@apache.org>
 2019-06-17 22:02:23 +02:00
Apache9 9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface (#309) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
 2019-06-17 10:18:18 +08:00
Jan Hentschel 47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation 
Signed-off-by: stack <stack@apache.org>
 2019-06-16 16:13:46 +02:00
syedmurtazahassan b32e716bee HBASE-22481 Javadoc Warnings reference not found 2019-06-08 20:25:31 +02:00
zhangduo 26037854ad HBASE-22524 Refactor TestReplicationSyncUpTool 2019-06-04 07:46:15 +08:00
Guanghao 97090560a5
HBASE-22003 Fix flaky test TestVerifyReplication.testHBase14905 2019-05-28 17:22:53 +08:00
Andrew Purtell a30b186568
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:34:25 -07:00
Jan Hentschel 2c7fdb39ce HBASE-22277 Removed deprecated methods from Get 2019-05-01 01:25:53 +02:00
Sean Busbey bf140acd20 HBASE-22083 move eclipse settings into a profile. 
Signed-off-by: stack <stack@apache.org>
 2019-04-25 14:17:18 -05:00
Jan Hentschel f30d6c958a HBASE-22231 Removed unused and '*' imports 2019-04-20 22:03:32 +02:00
Jan Hentschel 12bcb879da HBASE-22199 Replaced UTF-8 String with StandardCharsets.UTF_8 2019-04-17 10:13:25 +02:00
wellington cd61bcc01e
HBASE-20586: add support for clusters on different realms (with cross-realm authentication) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-15 11:23:21 -07:00
meiyi 94d9dc1e84 HBASE-22084 Rename AccessControlLists to PermissionStorage 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-12 14:18:09 +08:00
Bahram Chechrazy 2c8b813810 HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-04-11 11:33:52 -07:00
Guanghao 89ce5d17e4
HBASE-22163 Should not archive the compacted store files when region warmup (#122) 
* HBASE-22163 Should not archive the compacted store files when region warmup
 2019-04-08 22:11:07 +08:00
stack 089a639724 HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications 
This is a reapply of a reverted commit. This commit includes
HBASE-22059 amendment and subsequent ammendments to HBASE-22052.
See HBASE-22052 for full story.

jersey-core is problematic. It was transitively included from hadoop
and polluting our CLASSPATH with an implementation of a 1.x version
of the javax.ws.rs.core.Response Interface from jsr311-api when we
want the javax.ws.rs-api 2.x version.

    M hbase-endpoint/pom.xml
    M hbase-http/pom.xml
    M hbase-mapreduce/pom.xml
    M hbase-rest/pom.xml
    M hbase-server/pom.xml
    M hbase-zookeeper/pom.xml
     Remove redundant version specification (and the odd property define
     done already up in parent pom).
    M hbase-it/pom.xml
    M hbase-rest/pom.xml
     Exclude jersey-core explicitly.

    M hbase-procedure/pom.xml
     Remove redundant version and classifier.

    M pom.xml
     Add jersey-core exclusions to all dependencies that pull it in
     except hadoop-minicluster. mr tests fail w/o the jersey-core
     so let it in for minicluster and then in modules, exclude it
     where it causes damage as in hbase-it.
 2019-03-25 09:30:09 -04:00
Kevin Risden c144c814b0 HBASE-21895 - Error prone upgrade 
* Upgrades to error prone 2.3.3
* Moves to error prone plugin to support 9+ JDKs
* Removes custom error prone plugin due to no usage

Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-24 13:13:07 +08:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-14 21:42:23 +08:00
chenyechao a54f0bfb8f HBASE-21810 bulkload support set hfile compression on client 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-12 16:02:15 +08:00
Wellington Chevreuil 92e0d2c246
HBASE-21959 - CompactionTool should close the store it uses for compacting files, in order to properly archive compacted files. 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-03-08 14:04:54 -08:00
subrat.mishra 177d43d8db HBASE-21871 Added support to specify a peer table name in VerifyReplication tool 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-03-06 23:27:44 +09:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-22 16:24:51 +08:00
zhangduo 0b2b474b4c HBASE-21908 Remove Scan.getScanMetrics 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-16 17:39:31 +08:00
Josh Elser ae0198084c HBASE-21872 Use a call that defaults to UTF-8 charset for string to byte encoding 
Fixed commit message

Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-02-15 12:11:40 -05:00
Josh Elser d0e4912f67 Revert "HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding" 
This reverts commit 3d4e1d57e5. Fixing incorrect Jira id.
 2019-02-15 12:11:29 -05:00
Josh Elser 3d4e1d57e5 HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-02-14 12:02:49 -05:00
huzheng 1df571cb36 HBASE-18484 VerifyRep by snapshot does not work when Yarn/SourceHBase/PeerHBase located in three different HDFS clusters 2019-02-12 10:42:52 +08:00
Toshihiro Suzuki b322d0a3e5 HBASE-21201 Support to run VerifyReplication MR tool without peerid 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-02-10 16:15:45 +09:00
zhangduo 1995f61d7f HBASE-21782 LoadIncrementalHFiles should not be IA.Public 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-27 11:24:55 +08:00
Duo Zhang 4f3b95b318 HBASE-21762 Move some methods in ClusterConnection to Connection 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-01-25 21:13:44 +08:00
huzheng 15031c5bd5 HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:41:02 +08:00
stack 7755d4beed HBASE-21646 Flakey TestTableSnapshotInputFormat; DisableTable not completing... Amendment to fix checkstyle complaint 
Includes fix for checkstyle complaint.
 2018-12-28 14:48:23 -08:00
huzheng c2d5991b82 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:22:54 +08:00
Josh Elser 67d6d5084c HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running 
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-11 10:02:18 -05:00
BELUGA BEHR 7877e09b60 HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-11-27 08:57:06 -08:00
Michael Stack d486bba630 HBASE-21452 Illegal character in hbase counters group name 2018-11-13 22:11:43 -08:00
huzheng 8135285506 HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:18:01 +08:00
Artem Ervits b723ce1051 HBASE-21194 Add tests in TestCopyTable which exercises MOB feature 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-10-20 08:10:27 -07:00
ffernandez92 8f8d571779 HBASE-20766 Typo in VerifyReplication error. 
closes #80.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-09-26 14:52:28 -07:00
Guangxu Cheng 3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-09-21 16:06:39 -07:00
Tyler Mi 5c1b325b51 HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3 
Signed-off-by: Zach York <zyork@apache.org>
 2018-09-11 16:23:16 -07:00
Andrew Purtell 9af7bc6204
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia) 2018-09-07 15:09:09 -07:00
Duo Zhang 855f4bbb28 HBASE-21157 Split TableInputFormatScan to individual tests 2018-09-06 13:56:32 +08:00
Guanghao Zhang bb657c2d2e HBASE-21127 TableRecordReader need to handle cursor result too 2018-09-05 10:34:07 +08:00
Mingliang Liu 6dd5383033 HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-27 10:20:31 -07:00
Vikas Vishwakarma dd9880e0de HBASE-20890 PE filterScan seems to be stuck forever 2018-08-27 13:05:29 +05:30
subrat.mishra 49ae8549cf HBASE-21040 Replace call to printStackTrace() with proper logger call 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-08-15 08:29:54 -07:00
Mike Drob dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-13 12:59:36 -05:00
Wei-Chiu Chuang 6ee0fedb3d HBASE-20859 Backup and incremental load could fail in secure clusters. 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-11 16:56:39 -07:00
Michael Stack ffe430237a HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:10:15 -07:00
Sahil Aggarwal 952bb96c8a
HBASE-19164: Remove UUID.randomUUID in tests. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-27 10:34:16 -05:00
jingyuntian a68dbde941 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl 
Signed-off-by: huzheng <openinx@gmail.com>
 2018-06-27 14:39:20 +08:00
huzheng 063c3aca56 Revert "HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl" 
This reverts commit b41b05cd6b.
 2018-06-27 14:39:12 +08:00
jingyuntian b41b05cd6b HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl 2018-06-26 15:24:49 +08:00
Sean Busbey f1b536bad4 HBASE-20332 shaded mapreduce module shouldn't include hadoop 
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
 2018-06-18 11:31:04 -07:00
Josh Elser a5ed463d48 HBASE-20579 Include original exception in wrapped exception 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-06-02 22:27:13 -04:00
tedyu 74ef118e9e HBASE-20668 Avoid permission change if ExportSnapshot's copy fails 2018-06-01 14:34:51 -07:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-05-29 10:12:31 -05:00
Allan Yang f3d1c021de HBASE-20601 Add multiPut support and other miscellaneous to PE 2018-05-24 19:52:40 +08:00
Allan Yang 4005a0c4d3 Revert "HBASE-20601 Add multiPut support and other miscellaneous to PE" 2018-05-24 19:37:21 +08:00
Allan Yang 85901754f8 HBASE-20601 Add multiPut support and other miscellaneous to PE 2018-05-24 09:11:45 +08:00
jingyuntian c9f8c3436f HBASE-20579 Improve snapshot manifest copy in ExportSnapshot 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-18 06:42:12 -07:00
Xu Cang cf529f18a9 HBASE-20488 Fix PE command help message 
checkstyle fix

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2018-05-17 11:56:04 +02:00
Vladimir Rodionov acbc3a2253 HBASE-20530 Composition of backup directory containing namespace when restoring is different from the actual hfile location 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-16 14:21:20 -07:00
Sean Busbey 8ba2a7eeb9 HBASE-20544 Make HBTU default to random ports. 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-05-09 23:35:20 -07:00
Michael Stack 4f2dfd3877 HBASE-20539 Disable IMC; part 2 
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
 2018-05-09 06:30:28 -07:00
Mike Drob c51e9adc78 HBASE-20521 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 22:20:12 -05:00
Mike Drob 82e6fae1de Revert "change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests" 
This reverts commit b748ea3b0d.
 2018-05-08 22:20:06 -05:00
michael.jin b748ea3b0d change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 10:24:03 -05:00
Andrew Purtell 1825af45b3 HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:02 -07:00
Vasudevan 8e6ff689e8 HBASE-20523 PE tool should support configuring client side buffering sizes 
(Ram)
 2018-05-07 12:57:20 +05:30