3a79590bb4
HBASE-18164 Fast locality computation in balancer
...
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.
-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer
-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-06-20 01:11:08 -05:00
deb47d677d
HBASE-18230 Remove Velocity vars from LICENSE
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:11:03 -05:00
4aa7ce399e
HBASE-18176 Enforce no scala outside hbase-spark
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:10:53 -05:00
79607fda85
HBASE-17546 Correct scala syntax to match Apache Spark examples
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-19 16:27:00 -05:00
d3ba357c7c
HBASE-16242 Manually resolve transitive Apache Avro dependency to consistently be ver 1.7.7.
...
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-06-19 16:07:33 -05:00
cfa1bd3265
HBASE-18180 Possible connection leak while closing BufferedMutator in TableOutputFormat
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-19 02:02:54 -07:00
74c6f44877
HBASE-18170 Refactor ReplicationSourceWALReaderThread
2017-06-19 09:34:23 +08:00
fa93c0f59a
HBASE-18104 AMv2: Enabled aggregation of RPCs
...
Unit test (TestAssignmentManager) uses mock which always aggregates. So added trace level log message and verified manually on a single node cluster.
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-16 23:54:11 -07:00
5db63014b0
HBASE-18227 Fixed unit test hbase.coprocessor.TestCoprocessorMetrics#testRegionObserverAfterRegionClosed
...
Calling closeRegion() directly on remote server is not supported post-AMv2. Calling unassign() on master
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-16 20:19:59 -07:00
2ef80ab39a
HBASE-18225 Avoid toString() on an array
2017-06-16 08:55:14 -07:00
7c15e57005
HBASE-18220 - Addendum as per Duo suggestion for readability (Ram)
2017-06-16 12:35:38 +05:30
ac2018e276
HBASE-18220 Compaction scanners need not reopen storefile scanners while
...
trying to switch over from pread to stream (Ram)
2017-06-16 11:04:44 +05:30
4184ae7563
HBASE-18004 getRegionLocations needs to be called once in
...
ScannerCallableWithReplicas#call() (Huaxiang Sun)
2017-06-15 13:41:49 -07:00
d023508b5b
HBASE-17898 Update dependencies
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-15 13:33:22 -07:00
8c7bf7b0a9
HBASE-18166 [AMv2] We are splitting already-split files v2 Address Stephen Jiang reivew comments; ADDENDUM TO FIX COMPILE
2017-06-15 11:40:38 -07:00
c02a142143
HBASE-18166 [AMv2] We are splitting already-split files v2 Address Stephen Jiang reivew comments
2017-06-15 10:27:49 -07:00
299850ea70
HBASE-18209 Include httpclient / httpcore jars in build artifacts
2017-06-14 21:00:12 -07:00
6af3ee44c0
HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT
2017-06-14 16:03:50 -07:00
16a5a9db3e
HBASE-18216 [AMv2] Workaround for HBASE-18152, corrupt procedure WAL;
...
ADDENDUM
Forgot this change found testing.
2017-06-13 21:59:32 -07:00
1eb2f2593d
HBASE-18216 [AMv2] Workaround for HBASE-18152, corrupt procedure WAL
2017-06-13 21:49:30 -07:00
f50fe22196
HBASE-17008 Examples to make AsyncClient go down easy
2017-06-14 10:51:51 +08:00
385b792446
HBASE-18137 Replication gets stuck for empty WALs
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-10 12:45:40 -07:00
eca1ec3356
HBASE-18199 Race in NettyRpcConnection may cause call stuck in BufferCallBeforeInitHandler forever
2017-06-10 19:12:29 +08:00
1aedc07b52
HBASE-18192: Replication drops recovered queues on region server shutdown
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 19:53:31 -07:00
eb5c5a9bc8
HBASE-18033 Fix license check for hadoop-3.x
...
Hadoop 3.x added some new dependencies that refer to the apache license
by it's older title (from apache parent pom 14 and earlier). Instead of
listing them all individually, we can group them under ASL for our
LICENSE file.
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-09 15:20:32 -05:00
1e4f8491f7
HBASE-18092: Removing a peer does not properly clean up the ReplicationSourceManager state and metrics
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 08:23:41 -07:00
922894c96e
HBASE-18193 Master web UI presents the incorrect number of regions
2017-06-09 14:45:20 +08:00
a81577d827
HBASE-18195 Removed redundant single quote from start message for HMaster and HRegionServer
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-08 22:21:25 -07:00
17966525e9
HBASE-18141 Regionserver fails to shutdown when abort triggered during RPC call
2017-06-08 17:30:20 -07:00
ea7d51e129
HBASE-18109: Assign system tables first
...
This issue adds comments and a sort so system tables are queued first
(which will ensure they go out first). This should be good enough
along w/ existing scheduling mechanisms to ensure system/meta get
assigned first.
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-08 13:26:42 -07:00
1e7804634c
HBASE-18008 Any HColumnDescriptor we give out should be immutable
2017-06-08 23:28:33 +08:00
c830a0f47f
HBASE-18184 Add hbase-hadoop2-compat jar as MapReduce dependency
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-07 21:58:17 -07:00
84915bc681
HBASE-18191 Include hbase-metrics-* in assembly
2017-06-07 21:56:47 -07:00
adfb48eeb8
HBASE-18190 Set version in branch-2 to 2.0.0-alpha-1
2017-06-07 21:10:01 -07:00
3d721798c4
HBASE-18149 The setting rules for table-scope attributes and family-scope attributes should keep consistent
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-07 08:30:03 -07:00
347bef8d33
HBASE-17678 FilterList with MUST_PASS_ONE lead to redundancy cells returned - addendum
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-07 07:35:03 -07:00
9c8c749cd3
HBASE-18158 Two running in-memory compaction threads may lose data for flushing
2017-06-07 18:04:30 +08:00
9329a18c2d
HBASE-17849 PE tool random read is not totally random (Ram)
2017-06-07 11:31:30 +05:30
0d0c330401
HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-06 21:08:12 -07:00
2f1923a823
HBASE-15576 Scanning cursor to prevent blocking long time on ResultScanner.next()
2017-06-07 11:32:04 +08:00
80e15aac21
HBASE-16392 Backup delete fault tolerance (Vladimir Rodionov)
2017-06-06 20:29:13 -07:00
da3c023635
HBASE-18145 The flush may cause the corrupt data for reading
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 18:02:43 -07:00
858bccfcb8
HBASE-18132 Low replication should be checked in period in case of datanode rolling upgrade (Allan Yang)
2017-06-06 17:21:21 -07:00
1950acc67a
HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 12:52:46 -07:00
ee0f148c73
HBASE-18038 Rename StoreFile to HStoreFile and add a StoreFile interface for CP
2017-06-06 20:36:38 +08:00
8bfa8aaaca
HBASE-18030 Per Cell TTL tags may get duplicated with increments/Append causing tags length overflow.
2017-06-06 12:25:15 +05:30
59448cddd3
Add specification of the HBase 'color' -- International Orange (Engineering), same as GG -- and the our font (Bitsumishi)
2017-06-05 21:19:12 -07:00
07c38e7165
HBASE-16549 Added new metrics for AMv2 procedures
...
Following AMv2 procedures are modified to override onSubmit(), onFinish() hooks provided by HBASE-17888 to do
metrics calculations when procedures are submitted and finshed:
* AssignProcedure
* UnassignProcedure
* MergeTableRegionProcedure
* SplitTableRegionProcedure
* ServerCrashProcedure
Following metrics is collected for each of the above procedure during lifetime of a process:
* Total number of requests submitted for a type of procedure
* Histogram of runtime in milliseconds for successfully completed procedures
* Total number of failed procedures
As we are moving away from Hadoop's metric2, hbase-metrics-api module is used for newly added metrics.
Modified existing tests to verify count of procedures.
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-05 17:14:14 -07:00
e65d8653e5
HBASE-18155 TestMasterProcedureWalLease is flakey
2017-06-03 12:55:18 -07:00
118429cbac
HBASE-15160 Put back HFile's HDFS op latency sampling code and add metrics for monitoring (Yu Li and Enis Soztutar)
2017-06-02 17:41:53 -07:00
Kahlil Oppenheimer
Mike Drob
dskskv
Sean Busbey
Pankaj Kumar
Guanghao Zhang
Umesh Agashe
Josh Elser
Ramkrishna
Michael Stack
Balazs Meszaros
tedyu
Andrew Purtell
zhangduo
Vincent
Ashu Pachauri
Chia-Ping Tsai
Gary Helmling
Yi Liang
Alex Araujo
Guangxu Cheng
huzheng
Phil Yang
Ashish Singhi
anoopsamjohn
Enis Soztutar