b5a24b6696
Revert "HBASE-18520 Add jmx value to determine true Master Start time"
...
This reverts commit 1ba949e030
2017-08-08 15:43:58 +08:00
3b49e60e17
HBASE-18520 Add jmx value to determine true Master Start time
...
This is to determine how long it took in total for the master to start and finish initializing.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-08 15:27:19 +08:00
ce91ab4871
Revert "HBASE-18520 Add jmx value to determine true Master Start time"
...
This reverts commit 1ba949e030
2017-08-08 15:25:07 +08:00
1ba949e030
HBASE-18520 Add jmx value to determine true Master Start time
...
This is to determine how long it took in total for the master to start and finish initializing.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-08 15:02:58 +08:00
cad3d55892
HBASE-18520 Add jmx value to determine true Master Start time
...
This is to determine how long it took in total for the master to start and finish initializing.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-05 22:34:26 -07:00
a35dc0dddf
HBASE-18480 The cost of BaseLoadBalancer.cluster is changed even if the rollback is done
2017-08-02 08:41:53 +08:00
80b85a857c
HBASE-18487 Minor fixes in row lock implementation
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-08-01 11:28:28 -07:00
abb9d88dce
HBASE-18374 RegionServer Metrics improvements
2017-07-31 12:47:11 +05:30
59cad7d3e3
HBASE-18481 The autoFlush flag was not used in PE tool
2017-07-31 11:12:33 +08:00
9278037108
HBASE-15134 Add visibility into Flush and Compaction queues
2017-07-28 13:21:04 +05:30
e662d04321
HBASE-18362 hbck should not report split replica parent region from meta as errors (Huaxiang Sun)
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-07-27 15:59:07 -05:00
aca8a124c0
HBASE-17922 Clean TestRegionServerHostname for hadoop3.
...
Change-Id: I6f1514b1bc301be553912539e6a4192c2ccc782b
Signed-off-by: Apekshit Sharma <appy@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerHostname.java
2017-07-26 15:27:58 -07:00
a4e1af1fcc
HBASE-18054 log when we add/remove failed servers in client (Ali)
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/FailedServers.java
2017-07-25 18:53:01 -07:00
9427d6c73c
HBASE-18247 Hbck to fix the case that replica region shows as key in the meta table
...
Change-Id: I2169290ec5a97a63747bc93ee37f36729c3ac916
2017-07-25 17:08:53 -07:00
c7e1d67df7
HBASE-18023 Update row threshold warning from 1k to 5k (addendum)
2017-07-25 18:39:44 -04:00
26247996d2
HBASE-15816 Provide client with ability to set priority on Operations
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-07-21 17:12:25 -07:00
9036556a33
HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when configuring hbase.bucketcache.bucket.sizes.
2017-07-20 23:00:48 +05:30
cfd5b6b59f
HBASE-18330 NPE in ReplicationZKLockCleanerChore
2017-07-19 15:46:45 -07:00
2da5b432a1
HBASE-18308 Eliminate the findbugs warnings for hbase-server
2017-07-20 00:36:16 +08:00
980209579b
HBASE-18390 Sleep too long when finding region location failed
2017-07-19 12:05:21 +08:00
af359d03b5
HBASE-16488 Starting namespace and quota services in master startup asynchronizely (Stephen Yuan Jiang)
2017-07-18 06:58:29 -07:00
5a28437a74
HBASE-18377 Error handling for FileNotFoundException should consider RemoteException in openReader()
2017-07-18 06:50:02 -07:00
e1bf966f93
HBASE-18358 Backport HBASE-18099 'FlushSnapshotSubprocedure should wait for concurrent Region#flush() to finish'
2017-07-11 18:12:15 -07:00
bec34ae432
HBASE-18295 The result contains the cells across different rows
2017-07-12 02:46:13 +08:00
44651e52d8
HBASE-18267 The result from the postAppend is ignored
2017-07-11 10:31:21 +08:00
5d710bbe7f
HBASE-18312 Ineffective handling of FileNotFoundException in FileLink.tryOpen()
2017-07-05 21:02:28 -07:00
3dd55fa0c0
Set versions on branch-1 to 1.5.0-SNAPSHOT
2017-07-03 18:01:15 -07:00
3381c6c453
HBASE-17931 Assign system tables to servers with highest version
2017-07-03 11:35:31 +08:00
743f454d25
HBASE-18023 Log multi-* requests for more than threshold number of rows
...
Signed-off-by: Josh Elser <elserj@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2017-06-30 18:45:36 -07:00
9264e8fb17
HBASE-17995 improve log messages during snapshot tests.
...
Signed-off-by: Michael Stack <stack@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TableSnapshotInputFormatTestBase.java
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/SnapshotTestingUtils.java
2017-06-30 10:16:05 -05:00
67b61e6d5a
HBASE-16585 Rewrite the delegation token tests with Parameterized pattern
2017-06-30 16:26:34 +08:00
bb181ff50b
HBASE-18164 Fast locality computation in balancer - addendum handles NaN
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-27 13:33:48 -05:00
386a6e87fe
Revert "HBASE-18164 Fast locality computation in balancer - addendum handles NaN"
...
This reverts commit 74e9d31474
2017-06-27 13:33:23 -05:00
74e9d31474
HBASE-18164 Fast locality computation in balancer - addendum handles NaN
...
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.
-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer
-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-26 12:40:30 -07:00
d5bba50794
HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-22 02:11:07 -07:00
3d9c544428
HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always - revert wrong version of patch
2017-06-22 02:10:25 -07:00
940f4107b0
HBASE-18226 Disable reverse DNS lookup at HMaster and use the hostname provided by RegionServer (Duo Xu)
2017-06-21 18:23:30 -07:00
105c5c36e6
HBASE-15691 ConcurrentModificationException in BucketAllocator
2017-06-21 15:23:59 -07:00
7b977695aa
HBASE-18252 Resolve BaseLoadBalancer bad practice warnings
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-21 10:13:18 -07:00
01027f805b
HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-21 08:22:30 -07:00
532e0dda16
HBASE-18036 Data locality is not maintained after cluster restart or SSH (Stephen Yuan Jiang)
2017-06-20 13:07:19 -07:00
dead08d668
HBASE-18212 reduce log level for unbuffer warning.
...
In Standalone mode with local filesystem HBase logs Warning message:Failed to invoke 'unbuffer' method in class org.apache.hadoop.fs.FSDataInputStream
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 02:18:44 -05:00
4a2f475ed3
HBASE-18164 Fast locality computation in balancer
...
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.
-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer
-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
2017-06-20 02:18:43 -05:00
d5749bf8ed
HBASE-18180 Possible connection leak while closing BufferedMutator in TableOutputFormat
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-19 06:39:27 -07:00
316e02e3d8
HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT
2017-06-14 16:03:54 -07:00
256fc63007
HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-06-13 20:28:04 +08:00
d6e85b0511
Revert "FilterList with MUST_PASS_ONE may lead to redundant cells returned" miss issue number
...
This reverts commit c71da858ad
2017-06-13 20:27:28 +08:00
c71da858ad
FilterList with MUST_PASS_ONE may lead to redundant cells returned
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-12 23:55:25 -07:00
650ef5cf59
HBASE-18137 Replication gets stuck for empty WALs
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-10 11:29:51 -07:00
6e3da5a39a
HBASE-18192: Replication drops recovered queues on region server shutdown
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 19:54:17 -07:00
961337aadc
HBASE-18092: Removing a peer does not properly clean up the ReplicationSourceManager state and metrics
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 11:14:40 -07:00
6c4980161b
HBASE-18141 Regionserver fails to shutdown when abort triggered during RPC call
2017-06-08 18:33:19 -07:00
ba3a816663
HBASE-18184 Add hbase-hadoop2-compat jar as MapReduce dependency
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-07 14:26:08 -07:00
381c89b5cc
HBASE-15576 Scanning cursor to prevent blocking long time on ResultScanner.next()
2017-06-07 11:37:22 +08:00
9cb57ae35e
HBASE-18145 The flush may cause the corrupt data for reading
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 18:03:02 -07:00
e0dbafd7cc
HBASE-18132 Low replication should be checked in period in case of datanode rolling upgrade (Allan Yang)
2017-06-06 17:21:11 -07:00
9c1efc9f9d
HBASE-18066: Get with closest_row_before on hbase:meta can return empty Cell during region merge/split
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 17:13:16 -07:00
ea3075e7fd
HBASE-15160 Put back HFile's HDFS op latency sampling code and add metrics for monitoring (Yu Li and Enis Soztutar)
2017-06-06 14:41:02 -07:00
356d4e9187
HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 12:59:19 -07:00
39e8e2fb58
HBASE-18005 read replica: handle the case that region server hosting both primary replica and meta region is down (huaxiang sun)
2017-06-06 09:07:17 -07:00
69d3e332f1
HBASE-18150: Do not call FSUtils.setVersion() and FSUtils.checkVersion() when using checkRootDir() to check hbase.wal.dir
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-06 05:44:29 -07:00
8252fe4fbb
HBASE-18030 Per Cell TTL tags may get duplicated with increments/Append causing tags length overflow.
2017-06-06 12:26:21 +05:30
3cf4433260
HBASE-15995 Separate replication WAL reading from shipping
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-03 09:48:57 -07:00
b66a478e73
HBASE-18111 Replication stuck when cluster connection is closed
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/HBaseInterClusterReplicationEndpoint.java
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-01 15:18:04 -07:00
46ee6e0fcc
HBASE 17959 Canary timeout should be configurable on a per-table basis
...
For branch-1: Added support for configuring read/write timeouts on a per-table basis
when in region mode.
Added unit test for per-table timeout checks.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-31 17:58:09 -07:00
e670be690f
HBASE-18122 Scanner id should include ServerName of region server
2017-05-31 14:01:58 +08:00
140c559a3a
HBASE-18027 HBaseInterClusterReplicationEndpoint should respect RPC limits when batching edits
2017-05-30 14:25:36 -07:00
1a37f3be82
HBASE-18042 Client Compatibility breaks between versions 1.2 and 1.3
2017-05-27 17:56:05 +08:00
d8c1e0e004
HBASE-16011 TableSnapshotScanner and TableSnapshotInputFormat can produce duplicate rows if split table.
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-05-26 07:31:05 -07:00
109e0d5485
HBASE-18099 FlushSnapshotSubprocedure should wait for concurrent Region#flush() to finish
2017-05-25 07:56:13 -07:00
a3c3f1012d
HBASE-18060 Backport to branch-1 HBASE-9774 HBase native metrics and metric collection for coprocessors
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-24 13:20:44 -07:00
f2ba52ac45
HBASE-18096 Limit HFileUtil visibility and add missing annotations
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-05-24 16:34:27 +08:00
50708d9524
HBASE-18093 Overloading the meaning of 'enabled' in Quota Manager to indicate either quota disabled or quota manager not ready is not good (Stephen Yuan Jiang)
2017-05-23 13:10:07 -07:00
4249a1f3d9
HBASE-18069 Fix flaky test TestReplicationAdminWithClusters#testDisableAndEnableReplication
2017-05-22 17:31:01 +08:00
affd6ddf32
HBASE-18081 The way we process connection preamble in SimpleRpcServer is broken
2017-05-21 22:00:27 +08:00
c03f003f4f
HBASE-18035 Meta replica does not give any primaryOperationTimeout to primary meta region (huaxiang sun)
2017-05-21 06:39:33 -07:00
f9dc4cad63
HBASE-11013 Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-05-18 17:54:53 +08:00
292226690a
HBASE-18043 Institute a hard limit for individual cell size that cannot be overridden by clients
2017-05-15 18:03:24 -07:00
0a4528225c
HBASE-18014 A case of Region remain unassigned when table enabled (Allan Yang)
2017-05-12 16:59:38 -07:00
f81486445c
HBASE-17887 Row-level consistency is broken for read
2017-05-12 19:44:16 +08:00
9bf5bc1986
Amend HBASE-18000 Make sure we always return the scanner id with ScanResponse (Karan Mehta and Duo Zhang)
...
Move getRegionScanner() call below builder.setScannerId() to handle a
corner case.
2017-05-11 14:38:28 -07:00
ea89047abf
HBASE-8758 Error in RegionCoprocessorHost class preScanner method documentation
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-05-10 11:34:18 +08:00
0f6a2c4113
HBASE-17924 Consider sorting the row order when processing multi() ops before taking rowlocks
...
(Allan Yang)
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2017-05-08 17:04:50 -07:00
9a97e28bdf
HBASE-17471 Region Seqid will be out of order in WAL if using mvccPreAssign
...
Signed-off-by: Yu Li <liyu@apache.org>
2017-05-06 23:29:49 +08:00
408645c4ef
HBASE-18000 Make sure we always return the scanner id with ScanResponse
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-05 11:49:07 -07:00
dd321c4a35
HBASE-17991 Add more details about compaction queue on /dump (Guangxu Cheng)
2017-05-04 08:28:02 -07:00
a5f52360f6
HBASE-17993 Delete useless info log in RpcServer.processResponse
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-05-04 20:59:10 +08:00
e08277ac8f
Addendum patch for HBASE-12870. Added check for null pointer.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-03 14:03:27 -07:00
9f25836d99
HBASE-17958 Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP
2017-05-03 21:39:30 +08:00
d2fcfd74d9
HBASE-12870 "Major compaction triggered" and "Skipping major compaction" messages lack the region information
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-02 10:54:37 -07:00
262c66f614
HBASE-17757 Unify blocksize after encoding to decrease memory fragment
...
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2017-05-02 10:06:33 +05:30
9a71bacdf0
HBASE-17835 Spelling mistakes in the Java source
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:40:47 -05:00
0f5932b059
HBASE-17817 add table name to output (if available) when removing coprocessors
...
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:39:54 -05:00
cdda1d0302
HBASE-17904 Get runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to be org.apache.hadoop.hbase.ipc.RpcClientImpl
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-28 06:53:37 +08:00
aca4eb8d5c
HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (addendum for branch-1)
2017-04-27 17:08:21 +08:00
78c64c360f
HBASE-17965 Canary tool should print the regionserver name on failure
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestCanaryTool.java
2017-04-26 18:25:31 -07:00
cbae657632
HBASE-17956 Raw scan should ignore TTL
2017-04-26 15:34:14 +08:00
5f1691d06e
HBASE-17302 The region flush request disappeared from flushQueue - addendum (Guangxu Cheng)
2017-04-22 15:09:29 -07:00
d69a6366f6
HBASE-17937 Memstore size becomes negative in case of expensive postPut/Delete Coprocessor call
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-21 08:50:53 +08:00
c8c2e07aa1
HBASE-17930 Avoid using Canary.sniff in HBaseTestingUtility
2017-04-18 18:17:38 +08:00
a26de9b51e
HBASE-17912 - Avoid major compactions on region server startup
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-17 19:43:03 -07:00
cb2f2a7d1b
HBASE-17916 Error message not clear when the permission of staging dir
...
is not as expected
Signed-off-by: Michael Stack <stack@apache.org>
2017-04-14 08:12:09 -07:00
1afb86a1c1
HBASE-17816 HRegion#mutateRowWithLocks should update writeRequestCount metric
...
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-04-11 18:08:06 -07:00
4030facc99
HBASE-16469 Several log refactoring/improvement suggestions
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-11 14:28:47 -05:00
a6e9de3a0e
HBASE-17871 scan#setBatch(int) call leads wrong result of VerifyReplication
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-06 07:00:36 -07:00
4057a6c89c
HBASE-17861: Regionserver down when checking the permission of staging dir if hbase.rootdir is on S3
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-04 07:22:31 -07:00
19e4e4d49a
HBASE-17698 ReplicationEndpoint choosing sinks
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-03-31 16:31:29 -07:00
589a0e2efb
HBASE-17837 Backport HBASE-15314 to branch-1.3 (Chunhui shen & Ram))
2017-03-30 17:03:36 +05:30
d0139a8777
HBASE-17287 Master becomes a zombie if filesystem object closes
2017-03-29 04:50:49 -07:00
babb857940
HBASE-16755 Honor flush policy under global memstore pressure
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-27 11:48:17 -07:00
006bfc7054
HBASE-17623 Reuse the bytes array when building the hfile block
2017-03-25 23:51:14 +08:00
849ab5ff29
HBASE-17595 addendum fix the problem for mayHaveMoreCellsInRow
2017-03-23 20:35:12 +08:00
9726c71681
HBASE-17798 RpcServer.Listener.Reader can abort due to CancelledKeyException (Guangxu Cheng)
2017-03-21 08:06:56 -07:00
b973d3fd46
HBASE-17584 Expose ScanMetrics with ResultScanner rather than Scan
2017-03-20 16:32:20 +08:00
02d9bf0c57
HBASE-17803 PE always re-creates table when we specify the split policy
2017-03-19 19:10:24 +08:00
d1ea718e43
HBASE-17501 Revert "Revert "guard against NPE while reading FileTrailer and HFileBlock""
...
This reverts commit e92a147e19
2017-03-16 14:56:04 -07:00
e92a147e19
Revert "guard against NPE while reading FileTrailer and HFileBlock"
...
This reverts commit c97905a962
2017-03-16 14:55:41 -07:00
094e9a311b
HBASE-16584 Backport the new ipc implementation in HBASE-16432 to branch-1
2017-03-16 23:00:30 +08:00
318298047b
HBASE-17779 disable_table_replication returns misleading message and does not turn off replication (Janos Gub)
2017-03-14 12:34:04 -07:00
c97905a962
guard against NPE while reading FileTrailer and HFileBlock
...
guard against NPE from FSInputStream#seek
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-13 14:53:57 -07:00
759d63b15c
HBASE-17773 VerifyReplication tool wrongly emits Invalid arguments error (Tom Tsuruhara)
2017-03-13 17:53:43 +08:00
531598d67f
HBASE-17746 TestSimpleRpcScheduler.testCoDelScheduling is broken
2017-03-13 11:10:33 +08:00
dc84c7b9a7
HBASE-17712 Addendum modify log message
2017-03-10 16:01:45 +08:00
7dfb3b3194
HBASE-17764 Solve TestMultiSlaveReplication flakiness (Stephen Yuan Jiang)
2017-03-09 18:38:57 -08:00
20cb390529
HBASE-15429 Add split policy for busy regions
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 17:33:53 -08:00
0bc9ad0628
HBASE-17731 Fractional latency reporting in MultiThreadedAction
2017-03-09 16:54:38 -08:00
598dd9bb0e
HBASE-16977 VerifyReplication should log a printable representation of the row keys
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 16:36:10 -08:00
3d9520b140
HBASE-17761: Test TestRemoveRegionMetrics.testMoveRegion fails intermittently because of race condition
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-03-09 14:26:10 -08:00
c70769ea89
HBASE-15941 HBCK repair should not unsplit healthy splitted region
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-08 22:03:47 -08:00
ca5b8a44a4
HBASE-17718 Difference between RS's servername and its ephemeral node cause SSH stop working
...
This patch reverts HBASE-9593 -- i.e. registering in zk before we
register with master putting it back to how it was where we register
in zk AFTER we report for duty with the master (because then we'll
register in zk with the name the master gave us). It then fixes the
problem reported in HBASE-9593 in an alternate fashion by checking
for a RS znode if we failed a connect on assign; if none found, we
remove a server from online servers list.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Make move method available to tests.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
Correct method name changing moveFromOnelineToDeadServers to
moveFromOnlineToDeadServers
Add actual fix which is call to checkForRSznode if exception trying to
open a region; if none found, call expire on the server so it gets
removed from the list of online servers.
This patch exposes sloppyness in the waitForRegionServers around our
current case where Master is hosting regions but ONLY hbase:meta;
in this case we need to wait on at least another server to report
in beyond Master (we weren't but stuff was 'working' because of the
early registration of RS nodes in zk).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Make 'killed' available to tests.
Put registry of ephemeral node back to where it was originally,
so it is AFTER we get response from Master on registering for duty
so we can put our znode up in zk with the name the Master gave us
rather than local name (which could be unknown to the Master).
private boolean stopping = false;
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRSKilledWhenInitializing.java
Cleanup and test of new cleanup.
2017-03-08 10:47:53 -08:00
f34709e1b7
HBASE-17460 enable_table_replication can not perform cyclic replication of a table (Janos Gub)
2017-03-08 01:27:35 -08:00
dcaa9bd715
HBASE-17712 Remove/Simplify the logic of RegionScannerImpl.handleFileNotFound
2017-03-08 14:51:11 +08:00
5f630935bb
HBASE-17716 Formalize Scan Metric names
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 07:42:40 -08:00
f45d261902
HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs.
2017-03-07 22:42:58 +08:00
6afe696e53
HBASE-15484 Correct the semantic of batch and partial
2017-03-07 12:04:09 +08:00
ccf1f17d78
HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
...
Conflicts:
hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
88f909cf1f
HBASE-17710 HBase in standalone mode creates directories with 777 permission
2017-03-02 11:33:36 -08:00
f64a52a0c2
HBASE-16630 Fragmentation in long running Bucket Cache
...
Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra
Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket
Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-03-01 18:10:54 +05:30
bef27396e5
Revert "HBASE-16630 Handle Fragmentation in bucket cache"
...
This reverts commit 779f9cb07f
2017-03-01 11:41:02 +05:30
779f9cb07f
HBASE-16630 Handle Fragmentation in bucket cache
...
Currently whenever a compaction/bulkload happen and the
blocks are evicted from theirs buckets the buckets become
fragmented and are not available to be used by other
BucketSizes
Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra
Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket
Change-Id: I9e3b4deb8d893953003ddf5f1e66312ed97ea9cb
Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-03-01 10:37:22 +05:30
7d38e6126a
HBASE-17673 Monitored RPC Handler not shown in the WebUI (Allan Yang)
2017-02-28 07:44:35 -08:00
2131c79552
HBASE-17688 MultiRowRangeFilter not working correctly if given same start and stop RowKey
2017-02-28 12:15:38 +08:00
ec84118c97
HBASE-17634 Cleaned up the usage of Result.isPartial
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-27 20:45:58 +08:00
8528e82875
HBASE-17674 Major compaction may be cancelled in CompactionChecker (Guangxu Cheng)
2017-02-25 16:33:34 -08:00
4b8195f22c
HBASE-17057 Minor compactions should also drop page cache (Ashu Pachauri)
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-24 15:31:36 -08:00
b0780bdc63
HBASE-17682 Region stuck in merging_new state indefinitely
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-23 15:19:13 -08:00
3e2a6784c7
HBASE-17595 Add partial result support for small/limited scan
2017-02-23 16:10:10 +08:00
7917314477
HBASE-17677 Just the new tests from 'ServerName parsing from directory name should be more robust to errors.'
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-02-22 21:23:11 -06:00
a373445730
HBASE-17590 Drop cache hint should work on store file write path (Ashu Pachauri)
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-22 13:37:12 -08:00
a404bfa0c2
HBASE-17561 table status page should escape values that may contain arbitrary characters.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-02-21 23:22:55 -06:00
e7efa23d07
HBASE-13718 added columns schema to table description in web view
...
Summary:
* added a new table "Table Schema" on the table description page
* per column, list all the key/values on the column description
Test Plan:
* mvn test # and wait..
* create a new table using hbase shell:
* create 'mytesttable', {NAME=>'CF1'}, {NAME=>'CF2'}
* open http://localhost:16010/table.jsp?name=mytesttable
* check the "Table Schema" appears and lists the columns correctly
Reviewers: eclark, vicka.dudin
Differential Revision: https://reviews.facebook.net/D38649
Signed-off-by: Elliott Clark <eclark@apache.org>
2017-02-21 23:22:55 -06:00
f5ae21ea32
HBASE-17210 Set timeout on trying rowlock according to client's RPC timeout
2017-02-22 11:43:47 +08:00
27a8aa99d9
HBASE-17675 ReplicationEndpoint should choose new sinks if a SaslException occurs
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-21 18:45:15 -08:00
cdb38830d7
HBASE-15328 sanity check the redirect used to send master info requests to the embedded regionserver.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-02-21 09:05:31 -06:00
45357c078d
HBASE-17472: Correct the semantic of permission grant
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-20 20:24:09 +08:00
964e17f7b0
HBASE-17661 fix the queue length passed to FastPathBalancedQueueRpcExecutor
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-19 13:26:24 -08:00
6b96b0ce85
HBASE-17658 Fix bookkeeping error with max regions for a table
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-17 07:42:21 -08:00
b141603e2e
HBASE-17648: HBase Table-level synchronization fails between two secured(kerberized) cluster
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-17 07:04:35 -08:00
4038917239
HBASE-17069 RegionServer writes invalid META entries for split daughters in some circumstances
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-16 15:36:33 +08:00
f835d1efc2
HBASE-17583 Add inclusive/exclusive support for startRow and endRow of scan for sync client
2017-02-15 10:18:58 +08:00
0a25bf5b3f
HBASE-17639 Do not stop server if ReplicationSourceManager's waitUntilCanBePushed throws InterruptedException
2017-02-14 17:48:49 +08:00
d7c304573f
HBASE-17558 ZK dumping jsp should escape HTML.
...
Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-13 23:49:12 -05:00
4588bdee9f
HBASE-17609 Allow for region merging in the UI
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-09 14:06:48 -08:00
52c51fc271
HBASE-17265 Region left unassigned in master failover when region failed to open (Allan Yang)
2017-02-09 12:43:37 -08:00
67fe516ec9
HBASE-17280 Add mechanism to control hbase cleaner behavior
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-09 12:18:42 -08:00
e9abe07629
HBASE-17599 Use mayHaveMoreCellsInRow instead of isPartial
2017-02-09 15:38:23 +08:00
f61b840a31
HBASE-15437 Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload
2017-02-08 17:21:56 -08:00
8f6388503b
HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
...
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)
Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-08 15:01:59 -08:00
753169a3af
HBASE-17105 Annotate RegionServerObserver
2017-02-08 13:35:29 -08:00
8574934f59
HBASE-17381 ReplicationSourceWorkerThread can die due to unhandled exceptions (huzheng)
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-07 17:33:42 -08:00
a75e5a5435
HBASE-17275 Assign timeout may cause region to be unassigned forever (Allan yang)
2017-02-07 12:57:07 -08:00
0553290c6a
HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum - addendum resets min cost
2017-02-07 12:24:54 -08:00
5a0020e867
HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum
2017-02-07 06:26:12 -08:00
0a0aef345a
HBASE-17264 Processing RIT with offline state will always fail to open the first time (Allan Yang)
2017-02-06 19:48:14 -08:00
f708d986a0
HBASE-17597 TestMetaWithReplicas.testMetaTableReplicaAssignment is flaky
2017-02-07 09:51:46 +08:00
7cac85b667
HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application
2017-02-06 13:39:09 -08:00
35e4eb7a7a
HBASE-17601 close() in TableRecordReaderImpl assumes the split has started (Michael Axiak)
2017-02-06 10:33:05 -08:00
4456d22859
HBASE-17508 Unify the implementation of small scan and regular scan for sync client
2017-02-05 08:49:51 +08:00
cd847e599c
HBASE-17587 Do not Rethrow DoNotRetryIOException as UnknownScannerException
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-02 17:09:34 -08:00
f59cf6f02e
HBASE-16621 HBCK should have -fixHFileLinks (Janos Gub)
2017-02-02 07:31:35 -08:00
fab0b2e603
Addendum HBASE-17522 missed some branch-1 specific direct uses of MemoryMXBean
2017-02-01 11:32:13 -06:00
3d4639f34d
HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'.
...
Signed-off-by: Michael Stack <stack@apache.org>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
2017-02-01 10:38:29 -06:00
3aac1b6884
HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-01-31 16:16:20 -08:00
c937e97864
HBASE-17540 Change SASL server GSSAPI callback log line from DEBUG to TRACE in RegionServer
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-27 15:13:56 -08:00
3dc03ccfb7
HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer - revert due to pending discussion
2017-01-26 10:46:03 -08:00
a0fac0894b
HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown)
2017-01-25 20:36:48 -08:00
ed023058d2
HBASE-17519 Rollback the removed cells (ChiaPing Tsai)
2017-01-25 06:29:56 -08:00
19f9a1a643
HBASE-17462 Use sliding window for read/write request costs in StochasticLoadBalancer (Tim Brown)
2017-01-23 14:55:40 -08:00
50ecbf1c8a
HBASE-17510 DefaultMemStore gets the wrong heap size after rollback (ChiaPing Tsai)
2017-01-23 09:30:39 -08:00
6e0f3f5bbc
HBASE-17504 The passed durability of Increment is ignored when syncing WAL (ChiaPing Tsai)
2017-01-22 08:44:11 -08:00
57409371a0
HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted
2017-01-22 16:39:14 +08:00
c64236584b
HBASE-17357 FIX PerformanceEvaluation parameters parsing triggers NPE.
...
check command name is not null, if null print usage and exit
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:53:23 -08:00
f7d1d25fd7
HBASE-17488 WALEdit should be lazily instantiated (ChiaPing Tsai)
2017-01-20 09:38:55 -08:00
abc8c5edd3
HBASE-17494 Guard against cloning family of all cells if no data need be replicated (ChiaPing Tsai)
2017-01-19 16:21:17 -08:00
0e06ade694
HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand)
2017-01-17 09:38:50 -08:00
354e213852
HBASE-17464 Fix HBaseTestingUtility.getNewDataTestDirOnTestFS to always return a unique path
2017-01-13 17:53:48 -08:00
ee66ab8e29
HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng)
2017-01-13 09:39:06 -08:00
49b5a6e803
HBASE-17452 Failed taking snapshot - region Manifest proto-message too large (huaxiang sun)
2017-01-13 09:00:15 -08:00
56f963f4a6
HBASE-17445 Count size of serialized exceptions in checking max result size quota
2017-01-11 10:06:40 -08:00
2f7ce65b81
HBASE-17429 HBase bulkload cannot support HDFS viewFs (shenxianqiang)
2017-01-09 18:53:39 -08:00
Michael Stack
Zach York
Chia-Ping Tsai
James Taylor
Abhishek Singh Chouhan
Guanghao Zhang
Esteban Gutierrez
Mike Drob
Andrew Purtell
huaxiang sun
Josh Elser
rgidwani
anoopsamjohn
Phil Yang
Stephen Yuan Jiang
tedyu
David Harju
Sean Busbey
zhangduo
Kahlil Oppenheimer
Pankaj Kumar
QilinCao
Ashish Singhi
huzheng
Vincent
Ashu Pachauri
Gary Helmling
Alex Araujo
Enis Soztutar
Xiang Li
Chinmay Kulkarni
Balazs Meszaros
Roman Nikitchenko
Allan Yang
Jingyun Tian
Chinmay Kulkarni
Steen Manniche
Karan Mehta
Abhishek Singh Chouhan
gjacoby
qgxiaozhan
Nemo Chen
Tomu Tsuruhara
Yi Liang
Karan Mehta
Ramkrishna
James Moore
Umesh Agashe
dvdreddy
Jingcheng Du
Jan Hentschel
Joao Girao
Tim Brown
Sean Busbey
Ajay Jadhav
Jerry He
Sukumar Maddineni
Dave Navarro