Commit Graph

15789 Commits

Author SHA1 Message Date
Michael Stack 323907f84f HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing ADDENDUM: Rather than rollback, just do region reopens.
In split, reopen the parent if recovered.edits and in merge, reopen the
parent region or regions that happened to have recovered.edits on close.
2018-08-01 00:33:55 -07:00
Andrew Purtell 5a1e02b6dc HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal) 2018-07-31 15:58:05 -07:00
Wei-Chiu Chuang 7be97980f5 HBASE-20950 Helper method to configure secure DFS cluster for tests
Create a helper method HBaseKerberosUtils#setSecuredConfiguration().
TestSecureExport, TestSaslFanOutOneBlockAsyncDFSOutput,
SecureTestCluster and TestThriftSpnegoHttpServer uses this new helper
method.

Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-31 13:36:17 -07:00
Reid Chan a8e184dc77 HBASE-20886 [Auth] Support keytab login in hbase client
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-31 11:04:40 +08:00
Josh Elser 803b62f0b2 HBASE-20977 Avoid using the word "snapshot" when defining HBase Snapshots
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-07-30 18:12:39 -04:00
Sahil Aggarwal c075f33fc7 HBASE-20731: fix incorrect snapshot folders path in documentation
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-07-30 11:04:46 +02:00
zhangduo df256223d6 HBASE-20538 Upgrade our hadoop versions to 2.7.7 and 3.0.3 2018-07-29 20:18:40 +08:00
zhangduo e8cd3c4b95 Revert "HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3"
This reverts commit 336fd14e26.
2018-07-29 20:18:23 +08:00
zhangduo 336fd14e26 HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3 2018-07-29 20:04:57 +08:00
Alex Leblang e963694259
HBASE-19369 Switch to Builder Pattern In WAL
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).

Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-27 23:42:33 -05:00
tedyu cf481d3b51 HBASE-20966 RestoreTool#getTableInfoPath should look for completed snapshot only 2018-07-27 11:12:26 -07:00
zhangduo 7178a98258 HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException 2018-07-27 17:27:12 +08:00
Allan Yang 80b40a3b58 HBASE-20921 Possible NPE in ReopenTableRegionsProcedure 2018-07-27 09:36:50 +08:00
zhangduo d43e28dc82 Revert "HBASE-20949 Add logs for debugging"
This reverts commit 8b8de1f8a7.
2018-07-27 08:40:46 +08:00
Sergey Soldatov 973b4ddcfa HBASE-20927 RSGroupAdminEndpoint doesn't handle clearing dead servers if they are not processed yet.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-26 09:58:49 -07:00
zhangduo 8b8de1f8a7 HBASE-20949 Add logs for debugging 2018-07-26 22:43:14 +08:00
Mingliang Liu a392c017ed HBASE-20932 Effective MemStoreSize::hashCode()
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-25 14:40:45 -07:00
Xu Cang 1913164970 HBASE-20928 Rewrite calculation of midpoint - addemdum
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-25 10:00:58 -07:00
Peter Somogyi ba5d1c1f28 HBASE-20649 Validate HFiles do not have PREFIX_TREE DataBlockEncoding
Amending-Author: Balazs Meszaros <balazs.meszaros@cloudera.com>

Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-25 09:00:00 -05:00
Allan Yang 44f6ef1c90 HBASE-20867 RS may get killed while master restarts 2018-07-25 18:16:28 +08:00
zhangduo f3f17fa111 HBASE-20846 Restore procedure locks when master restarts 2018-07-25 14:37:26 +08:00
Wei-Chiu Chuang e44f506694 HBASE-20873 Update doc for Endpoint-based Export
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-07-25 10:38:12 +08:00
Saurabh Singh 3a3855aade HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-24 08:16:30 -07:00
huzheng a888af3dc9 HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result 2018-07-24 10:29:24 +08:00
Allan Yang b631727bdf HBASE-20878 Data loss if merging regions while ServerCrashProcedure executing 2018-07-24 10:00:28 +08:00
Allan Yang 4804483f7e HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing 2018-07-23 14:48:43 +08:00
tedyu 37de961f20 HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region 2018-07-22 20:50:51 -07:00
Reid Chan 4613f3e8c7 HBASE-20401 Make MAX_WAIT and waitIfNotFinished in CleanerContext configurable (Contributed by Stephen Wu) 2018-07-23 10:30:01 +08:00
zhangduo b4759ce6e7 HBASE-20915 Remove the commit column on our download page 2018-07-22 17:08:27 +08:00
Toshihiro Suzuki 682aa69677 HBASE-19893 restore_snapshot is broken in master branch when region splits
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-21 07:37:10 -07:00
Ankit Singhal 2eee7a3f8b HBASE-20910 Fix dev-support/submit-patch.py by opening file with 'b' mode
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-07-20 15:31:11 -07:00
Ankit Singhal eb906e20ee HBASE-20908 Infinite loop on regionserver if region replica are reduced
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-20 13:05:11 -07:00
Michael Stack 067388bfd9 HBASE-20914 Trim Master memory usage
Add (weak reference) interning of ServerNames.

Correct Balancer regions x racks matrix.

Make smaller defaults when creating ArrayDeques.
2018-07-20 10:08:55 -07:00
Allan Yang 03e596c669 HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool 2018-07-20 12:17:21 +08:00
Ankit e66a6603e3 HBASE-20672 New metrics ReadRequestRate and WriteRequestRate
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-19 15:33:09 -07:00
Ankit Singhal b4eacdabd6 HBASE-20901 Reducing region replica has no effect
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 13:38:32 -07:00
zhangduo c92cda8420 HBASE-20909 Add 2.1.0 to the download page 2018-07-19 22:51:55 +08:00
Mohit Goel 950d6e6fb0 HBASE-6028 Start/Stop compactions at region server level
Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.

Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 06:20:44 -07:00
Wei-Chiu Chuang 1ed58e41cc HBASE-20869 Endpoint-based Export use incorrect user to write to destination
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 20:29:55 +08:00
Balazs Meszaros 724e323494 HBASE-20853 Polish "Add defaults to Table Interface so Implementors don't have to"
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 19:38:43 +08:00
jack-altiscale 7e599428d3 HBASE-20823. Fix wrong param name in javadoc
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-19 18:26:18 +08:00
Yu Li 619e0fdab8 HBASE-20907 Fix Intermittent failure on TestProcedurePriority 2018-07-19 12:00:55 +08:00
Michael Stack 2bf5e46a33 HBASE-20875 MemStoreLABImp::copyIntoCell uses 7% CPU when writing
Make the #copyCellInto method smaller so it inlines; we do it by
checking for the common type early and then taking a code path
that presumes ByteBufferExtendedCell -- avoids checks.
2018-07-18 20:41:19 -07:00
Reid Chan 8c85763327 HBASE-20876 Improve docs style in HConstants (Contributed by Wei-Chiu Chuang) 2018-07-18 11:42:26 +08:00
tedyu 2997b6d071 HBASE-20879 Compacting memstore config should handle lower case 2018-07-13 11:19:45 -07:00
Mike Drob dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-13 12:59:36 -05:00
Toshihiro Suzuki ce82fd0f47 HBASE-19572 RegionMover should use the configured default port number and not the one from HConstants
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-13 10:44:35 +08:00
Artem Ervits e9fdcff691 HBASE-20880 Fix for warning It would fail on the following input in hbase-spark
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-12 12:57:49 -07:00
Toshihiro Suzuki 3fc23fe930 HBASE-20865 CreateTableProcedure is stuck in retry loop in CREATE_TABLE_WRITE_FS_LAYOUT state
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-12 00:15:26 -07:00
Yu Li c55acb0b03 HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed 2018-07-12 10:16:11 +08:00