Commit Graph

13557 Commits

Author SHA1 Message Date
Jan Hentschel 8b0ae5d1ae HBASE-17954 Switched findbugs implementation to spotbugs
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:11:11 -05:00
Kahlil Oppenheimer 3a79590bb4 HBASE-18164 Fast locality computation in balancer
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.

-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer

-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-06-20 01:11:08 -05:00
Mike Drob deb47d677d HBASE-18230 Remove Velocity vars from LICENSE
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:11:03 -05:00
Mike Drob 4aa7ce399e HBASE-18176 Enforce no scala outside hbase-spark
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:10:53 -05:00
dskskv 79607fda85 HBASE-17546 Correct scala syntax to match Apache Spark examples
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-19 16:27:00 -05:00
Sean Busbey d3ba357c7c HBASE-16242 Manually resolve transitive Apache Avro dependency to consistently be ver 1.7.7.
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-06-19 16:07:33 -05:00
Pankaj Kumar cfa1bd3265 HBASE-18180 Possible connection leak while closing BufferedMutator in TableOutputFormat
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-19 02:02:54 -07:00
Guanghao Zhang 74c6f44877 HBASE-18170 Refactor ReplicationSourceWALReaderThread 2017-06-19 09:34:23 +08:00
Umesh Agashe fa93c0f59a HBASE-18104 AMv2: Enabled aggregation of RPCs
Unit test (TestAssignmentManager) uses mock which always aggregates. So added trace level log message and verified manually on a single node cluster.

Signed-off-by: Michael Stack <stack@apache.org>
2017-06-16 23:54:11 -07:00
Umesh Agashe 5db63014b0 HBASE-18227 Fixed unit test hbase.coprocessor.TestCoprocessorMetrics#testRegionObserverAfterRegionClosed
Calling closeRegion() directly on remote server is not supported post-AMv2. Calling unassign() on master

Signed-off-by: Michael Stack <stack@apache.org>
2017-06-16 20:19:59 -07:00
Josh Elser 2ef80ab39a HBASE-18225 Avoid toString() on an array 2017-06-16 08:55:14 -07:00
Ramkrishna 7c15e57005 HBASE-18220 - Addendum as per Duo suggestion for readability (Ram) 2017-06-16 12:35:38 +05:30
Ramkrishna ac2018e276 HBASE-18220 Compaction scanners need not reopen storefile scanners while
trying to switch over from pread to stream (Ram)
2017-06-16 11:04:44 +05:30
Michael Stack 4184ae7563 HBASE-18004 getRegionLocations needs to be called once in
ScannerCallableWithReplicas#call() (Huaxiang Sun)
2017-06-15 13:41:49 -07:00
Balazs Meszaros d023508b5b HBASE-17898 Update dependencies
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-15 13:33:22 -07:00
Michael Stack 8c7bf7b0a9 HBASE-18166 [AMv2] We are splitting already-split files v2 Address Stephen Jiang reivew comments; ADDENDUM TO FIX COMPILE 2017-06-15 11:40:38 -07:00
Michael Stack c02a142143 HBASE-18166 [AMv2] We are splitting already-split files v2 Address Stephen Jiang reivew comments 2017-06-15 10:27:49 -07:00
tedyu 299850ea70 HBASE-18209 Include httpclient / httpcore jars in build artifacts 2017-06-14 21:00:12 -07:00
Andrew Purtell 6af3ee44c0 HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT 2017-06-14 16:03:50 -07:00
Michael Stack 16a5a9db3e HBASE-18216 [AMv2] Workaround for HBASE-18152, corrupt procedure WAL;
ADDENDUM

Forgot this change found testing.
2017-06-13 21:59:32 -07:00
Michael Stack 1eb2f2593d HBASE-18216 [AMv2] Workaround for HBASE-18152, corrupt procedure WAL 2017-06-13 21:49:30 -07:00
zhangduo f50fe22196 HBASE-17008 Examples to make AsyncClient go down easy 2017-06-14 10:51:51 +08:00
Vincent 385b792446 HBASE-18137 Replication gets stuck for empty WALs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-10 12:45:40 -07:00
zhangduo eca1ec3356 HBASE-18199 Race in NettyRpcConnection may cause call stuck in BufferCallBeforeInitHandler forever 2017-06-10 19:12:29 +08:00
Ashu Pachauri 1aedc07b52 HBASE-18192: Replication drops recovered queues on region server shutdown
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 19:53:31 -07:00
Mike Drob eb5c5a9bc8 HBASE-18033 Fix license check for hadoop-3.x
Hadoop 3.x added some new dependencies that refer to the apache license
by it's older title (from apache parent pom 14 and earlier). Instead of
listing them all individually, we can group them under ASL for our
LICENSE file.

Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-09 15:20:32 -05:00
Ashu Pachauri 1e4f8491f7 HBASE-18092: Removing a peer does not properly clean up the ReplicationSourceManager state and metrics
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 08:23:41 -07:00
Chia-Ping Tsai 922894c96e HBASE-18193 Master web UI presents the incorrect number of regions 2017-06-09 14:45:20 +08:00
Umesh Agashe a81577d827 HBASE-18195 Removed redundant single quote from start message for HMaster and HRegionServer
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-08 22:21:25 -07:00
Gary Helmling 17966525e9 HBASE-18141 Regionserver fails to shutdown when abort triggered during RPC call 2017-06-08 17:30:20 -07:00
Yi Liang ea7d51e129 HBASE-18109: Assign system tables first
This issue adds comments and a sort so system tables are queued first
(which will ensure they go out first). This should be good enough
along w/ existing scheduling mechanisms to ensure system/meta get
assigned first.

Signed-off-by: Michael Stack <stack@apache.org>
2017-06-08 13:26:42 -07:00
Chia-Ping Tsai 1e7804634c HBASE-18008 Any HColumnDescriptor we give out should be immutable 2017-06-08 23:28:33 +08:00
Alex Araujo c830a0f47f HBASE-18184 Add hbase-hadoop2-compat jar as MapReduce dependency
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-07 21:58:17 -07:00
Michael Stack 84915bc681 HBASE-18191 Include hbase-metrics-* in assembly 2017-06-07 21:56:47 -07:00
Michael Stack adfb48eeb8 HBASE-18190 Set version in branch-2 to 2.0.0-alpha-1 2017-06-07 21:10:01 -07:00
Guangxu Cheng 3d721798c4 HBASE-18149 The setting rules for table-scope attributes and family-scope attributes should keep consistent
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-07 08:30:03 -07:00
huzheng 347bef8d33 HBASE-17678 FilterList with MUST_PASS_ONE lead to redundancy cells returned - addendum
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-07 07:35:03 -07:00
Chia-Ping Tsai 9c8c749cd3 HBASE-18158 Two running in-memory compaction threads may lose data for flushing 2017-06-07 18:04:30 +08:00
Ramkrishna 9329a18c2d HBASE-17849 PE tool random read is not totally random (Ram) 2017-06-07 11:31:30 +05:30
huzheng 0d0c330401 HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-06 21:08:12 -07:00
Phil Yang 2f1923a823 HBASE-15576 Scanning cursor to prevent blocking long time on ResultScanner.next() 2017-06-07 11:32:04 +08:00
tedyu 80e15aac21 HBASE-16392 Backup delete fault tolerance (Vladimir Rodionov) 2017-06-06 20:29:13 -07:00
Chia-Ping Tsai da3c023635 HBASE-18145 The flush may cause the corrupt data for reading
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 18:02:43 -07:00
Andrew Purtell 858bccfcb8 HBASE-18132 Low replication should be checked in period in case of datanode rolling upgrade (Allan Yang) 2017-06-06 17:21:21 -07:00
Ashish Singhi 1950acc67a HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 12:52:46 -07:00
zhangduo ee0f148c73 HBASE-18038 Rename StoreFile to HStoreFile and add a StoreFile interface for CP 2017-06-06 20:36:38 +08:00
anoopsamjohn 8bfa8aaaca HBASE-18030 Per Cell TTL tags may get duplicated with increments/Append causing tags length overflow. 2017-06-06 12:25:15 +05:30
Michael Stack 59448cddd3 Add specification of the HBase 'color' -- International Orange (Engineering), same as GG -- and the our font (Bitsumishi) 2017-06-05 21:19:12 -07:00
Umesh Agashe 07c38e7165 HBASE-16549 Added new metrics for AMv2 procedures
Following AMv2 procedures are modified to override onSubmit(), onFinish() hooks provided by HBASE-17888 to do
metrics calculations when procedures are submitted and finshed:
* AssignProcedure
* UnassignProcedure
* MergeTableRegionProcedure
* SplitTableRegionProcedure
* ServerCrashProcedure

Following metrics is collected for each of the above procedure during lifetime of a process:
* Total number of requests submitted for a type of procedure
* Histogram of runtime in milliseconds for successfully completed procedures
* Total number of failed procedures

As we are moving away from Hadoop's metric2, hbase-metrics-api module is used for newly added metrics.

Modified existing tests to verify count of procedures.

Signed-off-by: Michael Stack <stack@apache.org>
2017-06-05 17:14:14 -07:00
Michael Stack e65d8653e5 HBASE-18155 TestMasterProcedureWalLease is flakey 2017-06-03 12:55:18 -07:00