Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,727 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

215 Commits

Author SHA1 Message Date
Toshihiro Suzuki 3902693f61 HBASE-21201 Support to run VerifyReplication MR tool without peerid 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-02-10 16:16:37 +09:00
Guanghao Zhang 16665b6e93 HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT 2019-01-29 21:53:21 +08:00
zhangduo 2d4819dbed HBASE-21782 LoadIncrementalHFiles should not be IA.Public 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-27 11:26:00 +08:00
Duo Zhang 1ac090b3f0 HBASE-21762 Move some methods in ClusterConnection to Connection 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-01-25 21:14:07 +08:00
huzheng fdfbd9a21c HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:47:27 +08:00
stack 8add7915de HBASE-21646 Flakey TestTableSnapshotInputFormat; DisableTable not completing... Amendment to fix checkstyle complaint 
Includes fix for checkstyle complaint.
 2018-12-28 14:47:50 -08:00
huzheng f60e8b0b95 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:50:10 +08:00
BELUGA BEHR fc7ca8a2ef
HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-12-18 17:45:37 -08:00
Josh Elser b8405bfea4 HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running 
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-11 11:37:35 -05:00
Michael Stack 66c2a7487c HBASE-21452 Illegal character in hbase counters group name 2018-11-13 22:12:40 -08:00
huzheng ee19f2b36f HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:19:45 +08:00
ffernandez92 12ea0cf373 HBASE-20766 Typo in VerifyReplication error. 
closes #80.

Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 8f8d571779)
 2018-09-26 14:55:21 -07:00
Guangxu Cheng fd68e7593e
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-09-21 16:06:34 -07:00
Tyler Mi d40348e8cd HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3 
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
 2018-09-11 16:31:56 -07:00
Andrew Purtell 7d9e5538ba
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia) 2018-09-07 15:09:36 -07:00
Duo Zhang f61f3c7f65 HBASE-21157 Split TableInputFormatScan to individual tests 2018-09-06 13:56:36 +08:00
Guanghao Zhang d39be48f04 HBASE-21127 TableRecordReader need to handle cursor result too 2018-09-05 10:41:02 +08:00
Mingliang Liu a0cbfb8ea6 HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-27 10:22:04 -07:00
Vikas Vishwakarma 9c19692c37 HBASE-20890 PE filterScan seems to be stuck forever 2018-08-27 13:01:52 +05:30
Mike Drob 2a9162a503
HBASE-20884 Replace Base64 with j.u.Base64 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-13 13:00:23 -05:00
Michael Stack e3d87cc1ec HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:07:50 -07:00
Sahil Aggarwal e61507b9a0
HBASE-19164: Remove UUID.randomUUID in tests. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-27 10:36:48 -05:00
jingyuntian a02581e72f HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl 
Signed-off-by: huzheng <openinx@gmail.com>
 2018-06-27 14:31:41 +08:00
huzheng 2c02fb66a0 Revert "HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl" 
This reverts commit 48cd82e134.
 2018-06-27 14:30:46 +08:00
jingyuntian 48cd82e134 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl 2018-06-26 15:35:05 +08:00
zhangduo dde042cc93 HBASE-20776 Update branch-2 version to 2.2.0-SNAPSHOT 2018-06-22 22:15:18 +08:00
Sean Busbey ee84a8f243 HBASE-20332 shaded mapreduce module shouldn't include hadoop 
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports

 Conflicts:
	hbase-backup/pom.xml
	hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-18 14:02:48 -07:00
Mike Drob b04c976fe6 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-06-18 14:02:40 -07:00
Josh Elser 81937df3bb HBASE-20579 Include original exception in wrapped exception 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-06-02 22:16:29 -04:00
tedyu 5a200b5902 HBASE-20668 Avoid permission change if ExportSnapshot's copy fails 2018-06-01 14:39:01 -07:00
Allan Yang f27a6dc1d2 HBASE-20601 Add multiPut support and other miscellaneous to PE 2018-05-23 20:06:23 +08:00
jingyuntian c3c9a4a595 HBASE-20579 Improve snapshot manifest copy in ExportSnapshot 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-18 06:43:53 -07:00
Xu Cang 56bb1fa065 HBASE-20488 Fix PE command help message 
checkstyle fix

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2018-05-17 11:58:23 +02:00
Sean Busbey 61f96b6ffa HBASE-20544 Make HBTU default to random ports. 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>

 Conflicts:
	hbase-backup/src/test/resources/hbase-site.xml
	hbase-spark-it/src/test/resources/hbase-site.xml
	hbase-spark/src/test/resources/hbase-site.xml
 2018-05-09 23:45:39 -07:00
Michael Stack de25f8b209 HBASE-20539 Disable IMC; part 2 
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
 2018-05-09 06:29:56 -07:00
Mike Drob 421ed6ca51 HBASE-20521 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 22:18:48 -05:00
Mike Drob d91908b0d4 Revert "change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests" 
This reverts commit 9e68719014.
 2018-05-08 22:18:42 -05:00
michael.jin 9e68719014 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 10:25:56 -05:00
Andrew Purtell 6f2ec4639b HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:10 -07:00
Vasudevan db67906cd0 HBASE-20523 PE tool should support configuring client side buffering sizes 
(Ram)
 2018-05-07 12:50:24 +05:30
Andrew Purtell 991d78ca2b HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:20 -07:00
Andrew Purtell 7df8e5e4a7 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:21 -07:00
Sean Busbey 944ecc729c HBASE-20439 Clean up incorrect use of commons-logging in hbase-server 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/FileArchiverNotifierImpl.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/RegionSizeReportingChore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/RegionSizeStoreImpl.java
 Additions:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestCellBasedHFileOutputFormat2.java
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestCellBasedImportExport2.java
 2018-04-20 08:04:17 -05:00
Peter Somogyi e51ced4f17 HBASE-20376 RowCounter and CellCounter documentations are incorrect 2018-04-12 10:05:45 +02:00
Balazs Meszaros d0060394bf HBASE-20386 [DOC] Align WALPlayer help text and refguide 2018-04-11 09:36:26 -07:00
Yuki Tawara 1ec708bf6c HBASE-20361 Non-successive TableInputSplits may wrongly be merged by auto balancing feature 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-08 10:58:56 -07:00
michael.jin 10ed3f41f5 HBASE-20295 fix NullPointException in TableOutputFormat.checkOutputSpecs 2018-04-07 09:30:52 -07:00
Mike Drob 468d4fcd73 HBASE-20282 Clean up tooling docs/help 2018-03-30 09:00:46 -07:00
Josh Elser c3d82a283d HBASE-20223 Update to hbase-thirdparty 2.1.0 
Remove commons-cli and commons-collections4 use. Account
for the newer internal protobuf version of 3.5.1.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-26 16:07:39 -04:00
Jan Hentschel 52014b9423 HBASE-13300 Fixed casing in set/getTimeStamp for Mutations 2018-03-23 17:23:55 -07:00
Umesh Agashe 96d63fee11 HBASE-20224 Web UI is broken in standalone mode 
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
 2018-03-22 20:28:08 -07:00
Michael Stack 79e4c9d925
Revert "HBASE-20224 Web UI is broken in standalone mode" 
Broke shell tests.

This reverts commit dd9fe813ec.
 2018-03-22 10:47:47 -07:00
Umesh Agashe dd9fe813ec HBASE-20224 Web UI is broken in standalone mode 
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
 2018-03-22 06:52:51 -07:00
Chia-Ping Tsai dd9e46bbf5 HBASE-20212 Make all Public classes have InterfaceAudience category 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-22 18:09:54 +08:00
Chia-Ping Tsai 95596e8ba7 HBASE-20119 Introduce a pojo class to carry coprocessor information in order to make TableDescriptorBuilder accept multiple cp at once 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-16 01:26:08 +08:00
Mike Drob 5e2f8e4023 HBASE-20180 Avoid Class::newInstance 2018-03-14 12:23:38 -05:00
zhangduo b84fbde175 HBASE-19687 Move the logic in ReplicationZKNodeCleaner to ReplicationChecker and remove ReplicationZKNodeCleanerChore 2018-03-09 20:55:48 +08:00
zhangduo 525fef572e HBASE-19633 Clean up the replication queues in the postPeerModification stage when removing a peer 2018-03-09 20:55:48 +08:00
huzheng 1e36a84afc HBASE-19622 Reimplement ReplicationPeers with the new replication storage interface 2018-03-09 20:55:48 +08:00
Guanghao Zhang eae251d203 HBASE-19573 Rewrite ReplicationPeer with the new replication storage interface 2018-03-09 20:55:48 +08:00
Sean Busbey 71cc7869db HBASE-20155 update branch-2 version to 2.1.0-SNAPSHOT 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2018-03-08 08:44:30 -08:00
Sean Busbey 9927c2e14a HBASE-20070 refactor website generation 
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>

 Conflicts:
	hbase-backup/pom.xml
	hbase-spark-it/pom.xml
 2018-03-02 09:51:43 -06:00
Michael Stack a2de29560f HBASE-20113 Move branch-2 version from 2.0.0-beta-2-SNAPSHOT to 2.0.0-beta-2 2018-03-01 15:46:38 -08:00
Michael Stack 03f9cb89a6 HBASE-20110 Findbugs in zk and mr caused nightly #409 branch-2 to fail 2018-02-28 23:38:35 -08:00
tedyu b3ae580216 HBASE-20086 PE randomSeekScan fails with ClassNotFoundException 2018-02-26 18:30:09 -08:00
Mike Drob d8ec10e20f HBASE-20039 MR tests out to hbase-mapreduce mobile 2018-02-21 14:53:30 -06:00
Artem Ervits a5443c18d2 HBASE-20023 CompactionTool command line examples are incorrect 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-20 08:13:59 -08:00
eshcar a458d7c400 HBASE-18294 Reduce global heap pressure: flush based on heap occupancy 2018-02-18 12:58:52 +02:00
tedyu f5b365e2c9 HBASE-19968 MapReduce test fails with NoClassDefFoundError against hadoop3 2018-02-12 09:54:48 -08:00
Michael Stack 8f1e01b6e5 HBASE-19951 Cleanup the explicit timeout value for test method 2018-02-07 16:39:54 -08:00
zhangduo 66a11f2ac0 HBASE-19904 Break dependency of WAL constructor on Replication 2018-02-03 17:11:30 +08:00
Chia-Ping Tsai b0bf6f504e HBASE-19720 Rename WALKey#getTabnename to WALKey#getTableName 2018-02-02 20:02:04 +08:00
zhangduo 28d13c54a9 HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules 2018-01-31 20:49:25 +08:00
Michael Stack 90a75fb052 HBASE-19888 Move branch-2 version from 2.0.0-beta-1 to 2.0.0-beta-2-SNAPSHOT 2018-01-29 14:17:54 -08:00
Duo Zhang bbf3bae72a
HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs 2018-01-29 12:41:14 -08:00
Mike Drob 80c7b7d0de HBASE-19853 Remove duplicate slf4j-api dep 2018-01-24 11:40:00 -06:00
Artem Ervits 8f713fcc19 HBASE-19829 hadoop-minicluster pulls zookeeper:test-jar:tests 3.4.6 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-19 15:22:15 -08:00
zhangduo 48bb19012c HBASE-19792 TestReplicationSmallTests.testDisableEnable fails 2018-01-17 14:23:17 +08:00
zhangduo 814d08a2d6 HBASE-19751 Use RegionInfo directly instead of an identifier and a namespace when getting WAL 2018-01-11 15:48:33 +08:00
Guangxu Cheng 3fa3dcd9f9 HBASE-19483 Add proper privilege check for rsgroup commands 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-09 08:11:07 -08:00
huzheng 0b62528dbf HBASE-18452 VerifyReplication by Snapshot should cache HDFS token before submit job for kerberos env 2018-01-04 14:01:41 +08:00
Chia-Ping Tsai 654edc5fa5 HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes 2018-01-04 13:05:21 +08:00
Michael Stack 4c0fba6a85
HBASE-19588 Additional jar dependencies needed for mapreduce 
PerformanceEvaluation

Signed-off-by: Albert Chu <chu11@llnl.gov>
 2018-01-03 21:36:05 -06:00
huzheng 16e8422855 HBASE-18806 VerifyRep by snapshot need not to restore snapshot for each mapper 2018-01-04 10:12:53 +08:00
brandboat 9e141d12a4 HBASE-8518 Get rid of hbase.hstore.compaction.complete setting 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-30 04:32:12 +08:00
Mike Drob 64cb777a8a HBASE-19552 find-and-replace thirdparty offset 2017-12-28 12:01:25 -06:00
Mike Drob 968b938fde HBASE-19552 Update hbase-thirdparty version 
Some manual cleanup of changing package names in pom files and getting
rid of the no-longer-needed netty system property.

This commit will break compilation, package renames in source code are
done in follow-on commits using straightforward find and replace.

's/org.apache.hadoop.hbase.shaded.com.google/org.apache.hbase.thirdparty.com.google/'
's/org.apache.hadoop.hbase.shaded.io.netty/org.apache.hbase.thirdparty.io.netty/'
 2017-12-28 11:58:49 -06:00
Michael Stack d6d8369655
HBASE-19648 Move branch-2 version from 2.0.0-beta-1-SNAPSHOT to 2.0.0-beta-1 2017-12-27 14:41:19 -08:00
Chia-Ping Tsai 2468f30029 HBASE-19628 ByteBufferCell should extend ExtendedCell 2017-12-27 23:02:18 +08:00
Vasudevan 0454a389a3 HBASE-19629 RawCell#getTags should return the Iterator<Tag> in order to avoid iterating through whole tag array at once 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-27 21:30:08 +08:00
Peter Somogyi 15ed748286 HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-27 20:10:50 +08:00
Balazs Meszaros 992b5d8630 HBASE-10092 Move up on to log4j2 
Changes:
- replaced commons-logging to slf4j everywhere
- log.XXX(Throwable) calls were replaced with log.XXX(t.toString(), t)
- log.XXX(Object) calls were replaced with log.XXX(Objects.toString(obj))
- log.fatal() calls were replaced with log.error(HBaseMarkers.FATAL, ...)
- programmatic log4j configuration was removed from the unit test

This commit does not affect the current logging configurations, because log4j
is still on the classpath. slf4j-log4j12 binds log4j to slf4j.

Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-20 22:58:12 -08:00
Xiang Li c739e3ecec HBASE-15482 Provide an option to skip calculating block locations for SnapshotInputFormat 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-12-19 15:52:42 -08:00
Peter Somogyi dbf0d427e2
HBASE-19549 Change path comparison in CommonFSUtils 
Also change makeQualified(FileSystem fs)
to makeQualified(URI defaultUri, Path workingDir)

Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-18 15:28:29 -08:00
Michael Stack 495bedea35
HBASE-19122 Suspect methods on Cell to be deprecated 2017-12-18 15:23:03 -08:00
Mike Drob 23a9059cb2 HBASE-18838 Fix hadoop3 check-shaded-invariants 2017-12-15 13:20:54 -06:00
BELUGA BEHR 7c871849de HBASE-19472 Remove ArrayUtil Class 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-13 19:08:54 +08:00
Peter Somogyi 941acc5c05 HBASE-19213 Align check and mutate operations in Table and AsyncTable 
- Deprecates old checkAnd*() operations in Table
- Adds Table#CheckAndMutateBuilder and implements it in HTable

Commiter note: When committing the patch, noticed redundant {@inheritDoc} being added in HTable.
Removed new and olds ones.

Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-12-12 20:46:39 -08:00
Michael Stack a33a9de643
HBASE-19134 Make WALKey an Interface; expose Read-Only version to CPs 
Created a new WALKey Interface and a WALKeyImpl. The WALKey Interface
is surfaced to Coprocessors and throughout most of the code base.
WALKeyImpl is used internally by WAL and by Replication which need
access to WALKey setters.

Methods that were deprecated in WALObserver because they were exposing
Private audience Classes have been undeprecated now we have WALKey.

Moved over to use SequenceId#getSequenceId throughout. Changed
SequenceId#getSequenceId removing the IOE.
 2017-12-08 15:12:51 -08:00
Michael Stack b0d68d6814
HBASE-19349 Introduce wrong version depencency of servlet-api jar 
Move the hadoop-hdfs guava exclude in modules up to the top pom.
Looks like an exclude in a module is not additive but rather exclusive
blanking out the top level set of exclusions.

Tested by looking in lib dir of the built tarball.
 2017-12-07 18:06:33 -08:00