5451 Commits

Author SHA1 Message Date
tedyu
d0498d979c HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum - addendum resets min cost 2017-02-07 12:24:20 -08:00
Ramkrishna
6c5eec249c HBASE-17484 Add non cached version of OffheapKV for write path (Ram) 2017-02-07 21:27:33 +05:30
tedyu
9d8de85fa5 HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum 2017-02-07 06:22:47 -08:00
Guanghao Zhang
9a78d00884 HBASE-17389 Convert all internal usages from ReplicationAdmin to Admin 2017-02-07 10:18:59 +08:00
zhangduo
af9d359b8e HBASE-17402 TestAsyncTableScan sometimes hangs 2017-02-07 09:42:42 +08:00
Michael Stack
9ec0ec4922 HBASE-17350 Fixup of regionserver group-based assignment
Renamed move_rsgroup_servers as move_servers_rsgroup
Renamed move_rsgroup_tables as move_tables_rsgroup

Minor changes to help text in rsgroup commands making them all same.
Made LOG from RSGroupAdminServer all talk of 'rsgroup' rather than
'group' to be consistent.

Fix for table.jsp where it would fail to display regions because no
type for the protobuf record specified.

Fix it so that move of an offline server to 'default' rsgroup is like
moving the reference to the server to trash (keeps the 'default' group
consistently 'dynamic' regards its server-list).

Fixed another issue where we were stuck in a loop because regions
were in FAILED_OPEN state because no server to assign too so we'd
never recover (a vagary of the current state of Master assignement
but no less a possibility in real world deploys).

Make it so servers are sorted when we list them; its what operator
would expect.
2017-02-06 13:09:57 -08:00
Enis Soztutar
4d730244a9 HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application 2017-02-06 12:00:42 -08:00
tedyu
19e1450b0f HBASE-17601 close() in TableRecordReaderImpl assumes the split has started (Michael Axiak) 2017-02-06 10:32:20 -08:00
Guanghao Zhang
5093a49e0b HBASE-17596 Implement add/delete/modify column family methods 2017-02-06 13:45:01 +08:00
Guanghao Zhang
26a94844f5 HBASE-17511 Implement enable/disable table methods 2017-02-05 14:18:40 +08:00
zhangduo
ffa0cea2a3 HBASE-17508 Unify the implementation of small scan and regular scan for sync client 2017-02-05 08:49:39 +08:00
Huaxiang Sun
1159296541 HBASE-16981 Expand Mob Compaction Partition policy from daily to weekly, monthly
Support weekly and monthly mob compact partition policies in addition to the existing
daily partition policy.

Signed-off-by: Jingcheng Du <jingchengdu@apache.org>
2017-02-03 15:52:43 +08:00
Zach York
63c819efbe HBASE-17588 Remove unused imports brought in by HBASE-17437
Signed-off-by: Michael Stack <stack@apache.org>
2017-02-02 22:05:50 -08:00
Zach York
537580bc51 HBASE-17587 Do not Rethrow DoNotRetryIOException as UnknownScannerException
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-02 17:12:18 -08:00
Ajay Jadhav
f8b1f57b05 HBASE-17280 Add mechanism to control hbase cleaner behavior
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-01 22:16:01 -06:00
Sean Busbey
2c799fb70a Revert "Add mechanism to control hbase cleaner behavior"
This reverts commit ef052521cd3b1ae086770aabfad14804ee8d4ac6.

Bad commit message.
2017-02-01 22:11:48 -06:00
Ajay Jadhav
ef052521cd Add mechanism to control hbase cleaner behavior
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-01 19:33:06 -08:00
Thiruvel Thirumoolan
c6250ecc83 HBASE-17281 FN should use datanode port from hdfs configuration
Signed-off-by: Francis Liu <toffer@apache.org>
2017-02-01 10:43:58 -08:00
Balazs Meszaros
81956aa446 HBASE-17197 hfile does not work in 2.0
Files can be specified with -f option or without it.

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-31 22:37:31 -08:00
Balazs Meszaros
ccd5b9f873 HBASE-3462 Fix table.jsp in regards to splitting a region/table with an optional splitkey
Now compact/split requires row keys instead of region names (as UI suggests).

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-31 16:34:41 -08:00
tedyu
34ffca1357 HBASE-16621 HBCK should have -fixHFileLinks (Janos Gub) 2017-01-31 14:32:45 -08:00
Geoffrey
5ebaadf1a6 HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-01-31 12:58:37 -08:00
Zach York
ae21797305 HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
Signed-off-by: Enis Soztutar <enis@apache.org>
2017-01-31 11:43:33 -08:00
Thiruvel Thirumoolan
bd7c9581f2 HBASE-17198 Remove redundant FN updates to merged region
Signed-off-by: Francis Liu <toffer@apache.org>
2017-01-31 11:17:58 -08:00
Thiruvel Thirumoolan
680289d67d HBASE-17101: FavoredNodes should not apply to system tables
Signed-off-by: Francis Liu <toffer@apache.org>
2017-01-31 10:58:50 -08:00
Sean Busbey
6791828698 HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'.
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-31 09:56:45 -06:00
Jingcheng Du
47ce72d78c HBASE-16812 Clean up the locks in MOB 2017-01-31 12:15:09 +08:00
Balazs Meszaros
e68ab09d5e HBASE-17566 Jetty upgrade fixes
Fix issues caused by HBASE-12894 Upgrade Jetty to 9.2.6 commit.

- removed Jetty 6.x dependencies (org.mortbay.jetty.*)
- corrected @Ignore-d unit tests

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-30 11:56:21 -08:00
Michael Stack
ffe7dac53d Revert "Revert "HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server""
This reverts commit 0ac5d4a7171833d33b35c09a3f5f3ca3ee5cd4d1.
This is a revert of a revert; i.e. a reapplication!
Fixes for breakage that comes in with this patch is in a follow-on.
2017-01-30 11:54:54 -08:00
Michael Stack
52ad310c80 HBASE-17471 Region Seqid will be out of order in WAL if using mvccPreAssign (Allan Yang) 2017-01-30 09:19:38 -08:00
Jan Hentschel
aff8de8397 HBASE-17555 Changed calls to deprecated getHBaseAdmin to getAdmin
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-28 21:41:25 -08:00
Yu Li
3693d1306d HBASE-17526 Procedure v2 - cleanup isSuspended from MasterProcedureScheduler#Queue (addendum) 2017-01-29 00:14:29 +08:00
Michael Stack
c725d4d334 HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs Policy is set in a number of places each with its own 'implementation'.
A setStoragePolicy was added by:

    commit 629b04f44f19b9589c9bcfb84da0cf5e0d4d1f18
    Author: Yu Li <liyu@apache.org>
    Date:   Fri Jan 6 18:35:38 2017 +0800

      HBASE-15172 Support setting storage policy in bulkload

..for hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java

And in *FileSystem files and StoreFileWriter by

    commit f92a14ade635e4b081f3938620979b5864ac261f
    Author: Yu Li <liyu@apache.org>
    Date:   Mon Jan 9 09:52:58 2017 +0800

      HBASE-14061 Support CF-level Storage Policy

This patch has all instances call the FSUtils#setStoragePolicy added here:

    commit eafc07a06d03c00e17bd476fa2b84ba7c8924b1e
    Author: tedyu <yuzhihong@gmail.com>
    Date:   Thu Jan 15 08:52:30 2015 -0800

      HBASE-12848 Utilize Flash storage for WAL

It does right thing when local vs distributed calling setStoragePolicy.

Fixed bug in the above FSUtils#setStoragePolicy where the check for a
distributed filesystem was failing when passed an HFileSystem -- though
it was backed by a DistributedFileSystem.

Cleanups.
2017-01-27 23:01:42 -08:00
Sukumar Maddineni
bd8a4d5fad HBASE-17540 Change SASL server GSSAPI callback log line from DEBUG to TRACE in RegionServer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-27 15:14:00 -08:00
tedyu
07c175b10a HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown) 2017-01-26 11:04:49 -08:00
tedyu
e8979c67aa HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer - revert due to pending discussion 2017-01-26 10:44:54 -08:00
Michael Stack
0ac5d4a717 Revert "HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server"
This reverts commit 59fd6eb7f68c6d616a645db078939c6d32da7aaf.
2017-01-25 22:55:18 -08:00
tedyu
a8bb27b2e0 HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown) 2017-01-25 17:59:55 -08:00
Apekshit Sharma
4254d7edf3 HBASE-17526 Queue#setSuspended() is not used anywhere, probably because when queue wait/wakes on an event, it gets removed or added back to the fairq.
Removing state, functions, and uses of isSuspended().

Change-Id: Id56eba81eaa66518bb0cba98070f0b78f8941c4f
2017-01-25 12:00:54 -08:00
Enis Soztutar
c64a1d1994 HBASE-9774 HBase native metrics and metric collection for coprocessors 2017-01-25 11:47:35 -08:00
Yang Guang
59fd6eb7f6 HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server 2017-01-24 23:37:12 -08:00
Guanghao Zhang
8aea84d723 HBASE-17500 Implement getTable/creatTable/deleteTable/truncateTable methods 2017-01-25 11:30:11 +08:00
zhangduo
85d701892e HBASE-17045 Unify the implementation of small scan and regular scan 2017-01-25 09:53:06 +08:00
Guanghao Zhang
843ba9e545 HBASE-17443 Move listReplicated/enableTableRep/disableTableRep methods from ReplicationAdmin to Admin 2017-01-24 13:40:29 +08:00
anastas
aa5d9a9ad3 HBASE-17492 Fix the compacting memstore part in hbase shell ruby script
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-23 21:27:44 -08:00
Michael Stack
980c8c2047 HBASE-17067 Procedure v2 - remove zklock/tryLock and use wait/wake (Matteo Bertozzi)
This is an amalgam of https://reviews.apache.org/r/54435/ and
9c14863594

Removes notion of suspend/resume from procedure. Instead have the below lock states
and just unschedule if lock is not yet available

 LOCK_ACQUIRED should be returned when the proc has the lock and the proc is ready to execute.
 LOCK_YIELD_WAIT should be returned when the proc has not the lock and the framework
   should take care of readding the procedure back to the runnable set for retry
 LOCK_EVENT_WAIT should be returned when the proc has not the lock and someone will take care of
  readding the procedure back to the runnable set when the lock is available.

Side benefit is being able to undo a bunch of synchronization around
procedure management.

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-23 09:29:16 -08:00
Yu Li
ba4a926b62 HBASE-17367 Make HTable#getBufferedMutator thread safe 2017-01-23 18:23:24 +08:00
tedyu
7754a9620e HBASE-17462 Use sliding window for read/write request costs in StochasticLoadBalancer (Tim Brown) 2017-01-22 18:35:38 -08:00
eshcar
f254e278ec HBASE-17407: Correct update of maxFlushedSeqId in HRegion
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-01-23 09:22:51 +08:00
zhangduo
3abd13dacb HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted 2017-01-22 16:39:00 +08:00