Go to file
Elliott Clark aaaae83423 HBASE-15441 Fix WAL splitting when region has moved multiple times
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.

Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.

We need to:

It appears that the close event with a sequence id of one is coming from region warm up.

This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.

Test Plan: Unit tests pass

Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:35:18 -07:00
bin HBASE-15145 HBCK and Replication should authenticate to zookepeer using server principal 2016-01-26 14:43:30 -08:00
conf HBASE-14087 Ensure correct ASF headers for docs/code 2015-07-31 11:22:50 -07:00
dev-support HBASE-15021 hadoopqa doing false positives 2015-12-22 19:49:14 -08:00
hbase-annotations HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-assembly HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-checkstyle HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-client HBASE-15441 Fix WAL splitting when region has moved multiple times 2016-03-16 16:35:18 -07:00
hbase-common HBASE-15439 getMaximumAllowedTimeBetweenRuns in ScheduledChore ignores the TimeUnit (Jingcheng Du) 2016-03-14 07:10:34 -07:00
hbase-examples HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-external-blockcache HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-hadoop-compat HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen) 2016-03-15 13:35:13 -07:00
hbase-hadoop2-compat HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen) 2016-03-15 13:35:13 -07:00
hbase-it HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-native-client HBASE-14087 Ensure correct ASF headers for docs/code 2015-07-31 11:22:50 -07:00
hbase-prefix-tree HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-procedure HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 11:08:05 -08:00
hbase-protocol HBASE-15128 Disable region splits and merges switch in master 2016-02-29 20:41:27 +08:00
hbase-resource-bundle HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-rest HBASE-15323 Hbase Rest CheckAndDeleteAPi should be able to delete more cells (Ajith) 2016-02-29 12:31:53 -08:00
hbase-server HBASE-15441 Fix WAL splitting when region has moved multiple times 2016-03-16 16:35:18 -07:00
hbase-shaded HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-shell HBASE-15128 Disable region splits and merges switch in master 2016-02-29 20:41:27 +08:00
hbase-testing-util HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
hbase-thrift HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
src/main HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-20 20:25:41 -08:00
.arcconfig HBASE-12139 StochasticLoadBalancer doesn't work on large lightly loaded clusters 2014-10-01 13:01:29 -07:00
.gitattributes HBASE-6816. [WINDOWS] line endings on checkout for .sh files 2013-01-23 19:30:14 +00:00
.gitignore HBASE-13517 Publish a client artifact with shaded dependencies 2015-04-28 09:44:12 -07:00
CHANGES.txt Update CHANGES.txt for 0.99.2 2014-12-02 20:39:44 -08:00
LICENSE.txt HBASE-14338 License notification misspells 'Asciidoctor' (Lars Francke) 2015-09-22 09:53:36 -07:00
NOTICE.txt HBASE-14085 Update LICENSE and NOTICE files. 2015-08-05 14:52:33 -07:00
README.txt Updated links in README 2014-09-18 12:06:02 -07:00
pom.xml HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00

README.txt

Apache HBase [1] is an open-source, distributed, versioned, column-oriented
store modeled after Google' Bigtable: A Distributed Storage System for
Structured Data by Chang et al.[2]  Just as Bigtable leverages the distributed
data storage provided by the Google File System, HBase provides Bigtable-like
capabilities on top of Apache Hadoop [3].

To get started using HBase, the full documentation for this release can be
found under the doc/ directory that accompanies this README.  Using a browser,
open the docs/index.html to view the project home page (or browse to [1]).
The hbase 'book' at http://hbase.apache.org/book.html has a 'quick start'
section and is where you should being your exploration of the hbase project.

The latest HBase can be downloaded from an Apache Mirror [4].

The source code can be found at [5]

The HBase issue tracker is at [6]

Apache HBase is made available under the Apache License, version 2.0 [7]

The HBase mailing lists and archives are listed here [8].

The HBase distribution includes cryptographic software. See the export control
notice here [9].

1. http://hbase.apache.org
2. http://research.google.com/archive/bigtable.html
3. http://hadoop.apache.org
4. http://www.apache.org/dyn/closer.cgi/hbase/
5. https://hbase.apache.org/source-repository.html
6. https://hbase.apache.org/issue-tracking.html
7. http://hbase.apache.org/license.html
8. http://hbase.apache.org/mail-lists.html
9. https://hbase.apache.org/export_control.html