92f415976e
HBASE-13532 Make UnknownScannerException less scary by giving more information in the exception string. (Apekshit)
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-13 15:03:36 -07:00
a6f8214e9b
HBASE-15236 Inconsistent cell reads over multiple bulk-loaded HFiles. In KeyValueHeap, if two cells are same i.e. have same key and timestamp, then instead of directly using seq id to determine newer one, we should use StoreFile.Comparater.SEQ_ID because that's what is used to determine order of hfiles. In this patch, we assign each scanner an order based on it's index in storefiles list, which is then used in KeyValueHeap to disambiguate between same cells. Changes the getSequenceId() in KeyValueScanner class to getScannerOrder(). Testing: Adds unit test to TestKeyValueHeap. Manual testing: Three cases (Tables t, t2, t3 in the jira description), single region, 2 hfiles with same seq id, timestamps and duplicate KVs. Made sure that returned kv was same for get and scan. (Apekshit)
...
Change-Id: I22600c91c0a51fb63eb17db73472839d2f13957c
Signed-off-by: stack <stack@apache.org>
2016-05-12 21:31:13 -07:00
cadc4cf15b
HBASE-15808 Reduce potential bulk load intermediate space usage and waste
2016-05-12 15:22:56 -07:00
98d13c745c
HBASE-15415 Improve Master WebUI snapshot information (huaxiang sun)
2016-05-09 20:22:07 -07:00
2f282aca15
HBASE-11625 - Verifies data before building HFileBlock. - Adds HFileBlock.Header class which contains information about location of fields. Testing: Adds CorruptedFSReaderImpl to TestChecksum.
...
Change-Id: I6777f2ddf8922691c84ca86d0cffa9a37dc879ae
Signed-off-by: stack <stack@apache.org>
2016-05-09 16:29:47 -07:00
d07d316113
HBASE-15740 Replication source.shippedKBs metric is undercounting because it is in KB
2016-05-09 10:25:57 -07:00
e44c360350
HBASE-15773 Improvements to CellCounter job
2016-05-06 11:18:24 -07:00
0964884b92
HBASE-15669 HFile size is not considered correctly in a replication request
2016-05-06 17:28:06 +05:30
3a7552a9f3
HBASE-15563 'counter' may overflow in BoundedGroupingStrategy (Matt Warhaftig)
2016-05-05 10:29:10 -07:00
686a31fbde
HBASE-15755 SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked
2016-05-05 07:28:52 -07:00
b36222831d
HBASE-15741 Provide backward compatibility for HBase coprocessor service names
2016-05-04 12:37:39 -07:00
12da71b824
HBASE-15613 TestNamespaceCommand times out
2016-05-04 11:37:09 -07:00
a7b31f74db
HBASE-15752 ClassNotFoundException is encountered when custom WAL codec is not found in WALPlayer job
2016-05-03 07:01:08 -07:00
0ee3ca2a78
HBASE-15714 We are calling checkRow() twice in doMiniBatchMutation()
2016-05-03 22:34:09 +10:00
330b3b281a
HBASE-15675 Add more details about region on table.jsp
2016-05-03 20:29:49 +08:00
7e0e86072a
HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them
2016-05-02 15:27:13 -07:00
36d634d353
HBASE-15281 Allow the FileSystem inside HFileSystem to be wrapped (Rajesh Nishtala)
2016-05-02 13:26:37 -07:00
57ca428c54
HBASE-15357 TableInputFormatBase getSplitKey does not handle signed bytes correctly (Nathan Schile)
2016-04-29 20:55:47 -07:00
e6bcf95da5
HBASE-15551 Make call queue too big exception use servername
2016-04-29 10:26:18 -07:00
c512750914
HBASE-15686 Add override mechanism for the exempt classes when dynamically loading table coprocessor
2016-04-28 09:21:22 -07:00
2b0913eea4
HBASE-15697 Excessive TestHRegion running time on branch-1 (Ram)
2016-04-28 14:18:33 +05:30
4f2d8dc328
HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig)
2016-04-27 21:03:34 -07:00
5f5cdaae9a
HBASE-15720 Print row locks at the debug dump page
2016-04-28 11:46:06 +08:00
4ba57cb935
HBASE-15707 ImportTSV bulk output does not support tags with hfile.format.version=3 (huaxiang sun)
2016-04-27 13:40:54 -07:00
6b78409eb2
HBASE-15477 Purge 'next block header' from cached blocks
...
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body. We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).
This patch undoes this over-persisting.
Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.
There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.
Adds loads of documentation.
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
(write) Add writing from a ByteBuff.
M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
(toString) Add one so ByteBuff looks like ByteBuffer when you click on
it in IDE
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
Remove support for version 1 blocks.
Cleaned up handling of metadata added when we serialize a block to
caches. Metadata is smaller now.
When we serialize (used when caching), do not persist the next blocks
header if present.
Removed a bunch of methods, a few of which had overlapping
functionality and others that exposed too much of our internals.
Also removed a bunch of constructors and unified the constructors we
had left over making them share a common init method.
Shutdown access to defines that should only be used internally here.
Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
about metadata saved to caches; was unclear previously what EXTRA was
about.
Renamed static final declarations as all uppercase.
(readBlockDataInternal): Redid. Couldn't make sense of it previously.
Undid heavy-duty parse of header by constructing HFileBlock. Other
cleanups. Its 1/3rd the length it used to be. More to do in here.
Signed-off-by: stack <stack@apache.org>
2016-04-27 10:41:47 -07:00
4272178b1f
HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable
2016-04-26 23:02:24 -07:00
d5acbdd1e4
HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
...
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:52:12 -07:00
2562043e23
HBASE-15634 TestDateTieredCompactionPolicy#negativeForMajor is flaky (Duo Zhang and Ted Yu)
2016-04-26 09:24:38 -07:00
5a69bc2dcb
HBASE-14252 RegionServers fail to start when setting hbase.ipc.server.callqueue.scan.ratio to 0 (Yubao Liu and Ted Yu)
2016-04-25 14:32:53 -07:00
51be6569e6
HBASE-15670 Add missing Snapshot.proto to the maven profile for compiling protobuf
...
Conflicts:
hbase-protocol/pom.xml
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestBatchCoprocessorEndpoint.java
2016-04-22 11:44:14 -07:00
27446a5c4a
HBASE-15392 Single Cell Get reads two HFileBlocks
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
moreRowsMayExistAfterCell Exploit the fact a Scan is a Get Scan. Also save compares
if no non-default stopRow.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java
optimize Add doc on what is being optimized. Also, if a Get Scan, do not
optimize else we'll keep going after our row is DONE.
Another place to make use of the Get Scan fact is when we are DONE.. if
Get Scan, we can close out the scan.
Signed-off-by: stack <stack@apache.org>
2016-04-22 09:07:09 -07:00
550d253ead
HBASE-15671 Add per-table metrics on memstore, storefile and regionsize (Alicia Ying Shu)
2016-04-21 13:33:31 -07:00
0b65f2002b
HBASE-15366 Add doc, trace-level logging, and test around No change in operation, just adding doc., and some helpful logging
...
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
Make it emit its toString in format that matches the way we log
elsewhere
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
Capitalize statics.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
Verify and cleanup documentation of hfileblock format at head of class.
Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
Connect how we serialize and deserialize... done in different places
and one way when pulling from HDFS and another when pulling from cache
(TO BE FIXED). Shut down a load of public access.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
Add trace-level logging
Signed-off-by: stack <stack@apache.org>
2016-04-21 10:56:07 -07:00
5d497d5ba8
HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HRegionLocator.java
2016-04-21 14:28:07 +08:00
80e324cdc7
HBASE-15368 Add pluggable window support
2016-04-21 12:02:42 +08:00
780cff5886
HBASE-15614 Report metrics from JvmPauseMonitor
2016-04-20 17:36:59 -07:00
1311e25171
HBASE-15518 Add Per-Table metrics back (Alicia Ying Shu)
2016-04-20 14:35:52 -07:00
71c55d182d
HBASE-15640 L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit
2016-04-20 14:19:12 -07:00
a331a57ef8
HBASE-15385 PREFETCH_BLOCKS_ON_OPEN in HColumnDescriptor is ignored
2016-04-20 09:41:28 -07:00
1aa07404a9
HBASE-15679 Assertion on wrong variable in TestReplicationThrottler#testThrottling
2016-04-20 07:11:50 -07:00
2d99f626d1
HBASE-15672 hadoop.hbase.security.visibility.TestVisibilityLabelsWithDeletes fails (Anoop Sam John)
2016-04-19 21:54:43 -07:00
bd64db97c8
HBASE-15673 Fix latency metrics for multiGet. - Also fixes some stuff in help text. (Apekshit)
...
Change-Id: I95cfa2be74605efab0368417d59c50b94af0facb
Signed-off-by: stack <stack@apache.org>
2016-04-19 17:18:45 -07:00
22b1061044
HBASE-15665 Support using different StoreFileComparators for different CompactionPolicies
2016-04-19 19:35:36 +08:00
2b5da6f7a0
HBASE-13372 Add unit tests for SplitTransaction and RegionMergeTransaction listeners
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-04-18 16:56:59 -07:00
6d40b7a0e4
HBASE-15668 HFileReplicator fails to replicate other hfiles in the request when a hfile in not found in FS anywhere
2016-04-18 22:18:46 +05:30
ee78b6da7a
HBASE-15664 Use Long.MAX_VALUE instead of HConstants.FOREVER in CompactionPolicy
2016-04-18 20:11:35 +08:00
7dacf9f10c
HBASE-15287 mapreduce.RowCounter returns incorrect result with binary row key inputs (Matt Warhaftig)
2016-04-16 18:11:27 -07:00
fd49923350
HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile
...
Refactor so we use the immutable, unsynchronized TimeRange when doing
time-based checks at read time rather than use heavily synchronized
TimeRangeTracker; let TimeRangeTracker be for write-time only.
While in here, changed the Segment stuff so that when an immutable
segment, it uses TimeRange rather than TimeRangeTracker too.
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
Make allTime final.
Add a includesTimeRange method copied from TimeRangeTracker.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
Change name of a few methods so they match TimeRange methods that do
same thing.
(getTimeRangeTracker, getTimeRange, toTimeRange) add utility methods
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
Change Reader to use TimeRange-based checks instead of
TimeRangeTracker.
2016-04-15 16:56:05 -07:00
6cf4bfe62c
HBASE-15622 Superusers does not consider the keytab credentials
2016-04-15 08:31:46 -07:00
96e9c466d2
HBASE-15406 Split / merge switch left disabled after early termination of hbck
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestSplitOrMergeStatus.java
hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckOneRS.java
2016-04-15 15:34:43 +08:00
d378975351
HBASE-15405 Fix PE logging and wrong defaults in help message. (Apekshit)
...
Change-Id: I81f5f57e1db18df252fa92c0cc14bf950ab17034
Signed-off-by: stack <stack@apache.org>
2016-04-14 09:00:38 -07:00
07dc75f4fe
HBASE-15504 Fix Balancer in 1.3 not moving regions off overloaded regionserver
2016-04-13 18:07:21 -07:00
85f2caf184
HBASE-15633 Backport HBASE-15507 to branch-1 (Geoffrey Jacoby)
2016-04-13 02:25:32 -07:00
cd84796b39
HBASE-15481 Add pre/post roll to WALObserver
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
2016-04-13 01:06:51 -05:00
4981d4c207
HBASE-15636 hard coded wait time out value in HBaseTestingUtility#waitUntilAllRegionsAssigned might cause test failure (Stephen Yuan Jiang)
2016-04-12 16:47:21 -07:00
d896a51291
HBASE-15621 Suppress Hbase SnapshotHFile cleaner error messages when a snaphot is going on (Huaxiang Sun)
2016-04-12 12:23:28 -07:00
59bf00562c
HBASE-15632 Undo the checking of lastStoreFlushTimeMap.isEmpty() introduced in HBASE-13145 (Huaxiang Sun)
2016-04-12 11:41:00 -07:00
e31361dcb8
HBASE-14985 TimeRange constructors should set allTime when appropriate (Geoffrey Jacoby)
2016-04-11 17:58:38 -07:00
2dbbe8960a
HBASE-15627 Miss space and closing quote in AccessController#checkSystemOrSuperUser (Huaxiang Sun)
2016-04-11 08:28:02 -07:00
b7502feff3
HBASE-15093 Replication can report incorrect size of log queue for the global source when multiwal is enabled (Ashu Pachauri)
2016-04-11 08:23:34 -07:00
ff835d5ae6
HBASE-15591 ServerCrashProcedure not yielding
2016-04-10 17:07:39 -07:00
7303c7e479
HBASE-15527 Refactor Compactor related classes
2016-04-10 09:26:42 +08:00
2b75562701
HBASE-15537 Make multi WAL work with WALs other than FSHLog
2016-04-08 10:42:40 +08:00
d94c18a0e7
HBASE-15586 Unify human readable numbers in the web UI
2016-04-07 17:07:38 -07:00
b17350210b
HBASE-15400 Use DateTieredCompactor for Date Tiered Compaction (Clara Xiong)
2016-04-07 15:06:22 -07:00
ff075fd9df
HBASE-15396 Enhance mapreduce.TableSplit to add encoded region name
...
(cherry picked from commit 7d3a89ce8e
2016-04-06 08:32:32 -07:00
e6a32141b3
HBASE-15587 FSTableDescriptors.getDescriptor() logs stack trace erronously
2016-04-05 18:13:47 -07:00
8957dc1033
HBASE-15485 Filter.reset() should not be called between batches (Phil Yang)
2016-04-04 20:07:39 -07:00
e5fb045aa9
HBASE-15578 Handle HBASE-15234 for ReplicationHFileCleaner
2016-04-04 15:07:56 +05:30
4bae771b65
HBASE-15582 SnapshotManifestV1 too verbose when there are no regions
2016-04-01 20:59:08 -07:00
bcbef7b401
HBASE-15424 Add bulk load hfile-refs for replication in ZK after the event is appended in the WAL
2016-04-01 15:55:08 +05:30
d7d12aedd4
HBASE-15234 Don't abort ReplicationLogCleaner on ZooKeeper errors
2016-03-31 22:45:45 -07:00
b7df66f1a8
HBASE-15571 Make MasterProcedureManagerHost accessible through MasterServices
2016-03-31 15:49:07 -07:00
407e644607
HBASE-15324 Jitter may cause desiredMaxFileSize overflow in ConstantSizeRegionSplitPolicy and trigger unexpected split (Yu Li)
2016-03-30 13:31:34 -07:00
75d46e4697
HBASE-14983 Create metrics for per block type hit/miss ratios
...
Summary: Missing a root index block is worse than missing a data block. We should know the difference
Test Plan: Tested on a local instance. All numbers looked reasonable.
Differential Revision: https://reviews.facebook.net/D55563
2016-03-30 11:53:46 -07:00
fee0212da0
HBASE-15559 Fix BaseMasterAndRegionObserver doesn't implement all the methods
2016-03-30 11:18:15 -07:00
e339bec3f1
HBASE-15327 Canary will always invoke admin.balancer() in each sniffing period when writeSniffing is enabled (Jianwei Cui)
2016-03-30 09:00:04 -07:00
1e44dd82eb
HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock - ADDENDUM for failing test
2016-03-29 15:02:23 -07:00
c7ad42867d
HBASE-15191 CopyTable and VerifyReplication - Option to specify batch size, versions (Parth Shah)
2016-03-29 10:29:56 -07:00
13df653215
HBASE-15384 Avoid using '/tmp' directory in TestBulkLoad
2016-03-29 11:10:44 +08:00
5202d3c25b
HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcChannel.java
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
hbase-it/src/test/java/org/apache/hadoop/hbase/DistributedHBaseCluster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide3.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannersFromClientSide.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestClockSkewDetection.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestNamespaceCommands.java
2016-03-28 17:00:21 -07:00
5851ad0230
HBASE-15548 SyncTable: sourceHashDir is supposed to be optional but won't work without (Dave Latham)
2016-03-28 16:53:27 -07:00
87f1af842a
HBASE-15496 Throw RowTooBigException only for user scan/get (Guanghao Zhang)
2016-03-25 19:05:15 -07:00
d5bc56c266
HBASE-15389 Write out multiple files when compaction
2016-03-25 15:33:20 +08:00
4b5b8e01d0
HBASE-15526 Make SnapshotManager accessible through MasterServices
2016-03-24 16:02:00 -07:00
ff261efbf7
HBASE-15515 Improve LocalityBasedCandidateGenerator in Balancer (Guanghao Zhang)
2016-03-24 11:22:34 -07:00
1361a25e6d
HBASE-14256 Flush task message may be confusing when region is recovered (Gabor Liptak)
2016-03-24 10:01:53 -07:00
ee33bf0c7d
HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen)
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerFactory.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerImpl.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/StatsTrackingRpcRetryingCaller.java
hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ClientProtos.java
2016-03-24 11:27:54 +08:00
9fa44a8126
HBASE-15520 Fix broken TestAsyncIPC
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/AsyncRpcChannel.java
2016-03-24 10:57:42 +08:00
604415e827
HBASE-15475 Allow TimestampsFilter to provide a seek hint
2016-03-23 18:57:02 -07:00
a3d550fbca
HBASE-15360 Fix flaky TestSimpleRpcScheduler; ADDENDUM
2016-03-23 15:47:22 -07:00
47eb79311f
HBASE-15508 Add command for exporting snapshot in hbase command script (Yufeng Jiang)
2016-03-23 10:38:13 -07:00
b697f53be3
HBASE-15212 RRCServer should enforce max request size
2016-03-22 16:23:20 -07:00
d07230a759
HBASE-15412 Add average region size metric (Alicia Ying Shu)
...
Conflicts:
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.java
2016-03-22 14:50:14 -07:00
2331d9efe3
HBASE-15488 Add ACL for setting split merge switch
2016-03-22 10:41:08 -07:00
249e37f83c
HBASE-15464 Flush / Compaction metrics revisited
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/test/java/org/apache/hadoop/hbase/MockRegionServerServices.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
2016-03-21 17:56:22 -07:00
1c5002660b
HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang)
2016-03-21 13:20:23 -07:00
ee4bf43577
HBASE-15433 SnapshotManager#restoreSnapshot not update table and region count quota correctly when encountering exception (Jianwei Cui)
2016-03-21 03:47:43 -07:00
a3071327b5
HBASE-15478 add comments to syncRunnerIndex handling explaining constraints on possible values.
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-03-21 00:29:52 -05:00
17815ded74
HBASE-15490 Remove duplicated CompactionThroughputControllerFactory in branch-1
2016-03-20 16:16:40 +08:00
463374ecfa
HBASE-15451 Remove unnecessary wait in MVCC
2016-03-20 02:42:44 +08:00
6977c5dee5
HBASE-15302 Revert TestWALSplitCompressed which extends TestWALSplit
2016-03-18 20:56:03 -07:00
27d59d3ebb
HBASE-15302 Revert two tests which hung in build #31
2016-03-18 20:53:29 -07:00
d942d4e5a1
HBASE-15302 Reenable the other tests disabled by HBASE-14678 (Phil Yang)
2016-03-18 09:06:34 -07:00
eda2656b88
HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun)
2016-03-18 05:38:05 -07:00
a319941425
HBASE-15456 Revert due to unit test failure in thrift module
2016-03-17 17:28:13 -07:00
e4409c2f8c
HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun)
2016-03-17 13:06:42 -07:00
f1bb26c223
HBASE-15470 Add a setting for Priority queue length
...
Summary:
Move the config keys to one place
Make Two different config keys. One for default, one for priority
Test Plan: unit tests
Differential Revision: https://reviews.facebook.net/D55575
2016-03-16 16:52:17 -07:00
aaaae83423
HBASE-15441 Fix WAL splitting when region has moved multiple times
...
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.
Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.
We need to:
It appears that the close event with a sequence id of one is coming from region warm up.
This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.
Test Plan: Unit tests pass
Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:35:18 -07:00
103c313b0d
HBASE-15430 Failed taking snapshot - Manifest proto-message too large (JunHo Cho)
2016-03-16 09:06:11 -07:00
3f9ce9785a
HBASE-15360 Fix flaky TestSimpleRpcScheduler (Duo Zhang)
2016-03-16 08:04:37 -07:00
a00ed93fae
HBASE-15456 Revert due to TestCloseRegionHandler failure
2016-03-15 21:24:37 -07:00
f8bcb54479
HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun)
2016-03-15 16:21:16 -07:00
934c0274e3
HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-03-15 13:35:13 -07:00
d0bd4903c6
HBASE-15463 Region normalizer should check whether split/merge is enabled
2016-03-15 09:10:00 -07:00
95421d276e
HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu)
...
Conflicts:
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSource.java
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSourceImpl.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestMetricsWAL.java
2016-03-10 20:21:53 -08:00
e445272724
Revert "HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)"
...
Not needed afterall
This reverts commit e42065c308
2016-03-10 15:41:30 -08:00
f82147831b
HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi)
2016-03-10 07:19:59 -08:00
e103f75ae7
HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang)
2016-03-09 10:05:06 -08:00
46bf3c3275
HBASE-15113 Procedure v2 - Speedup eviction of sys operation results
2016-03-08 11:08:05 -08:00
3339bac563
HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE
2016-03-08 02:59:20 -08:00
4ec6ad12c9
HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT
2016-03-07 19:28:21 -08:00
43698b3fcb
HBASE-15354 Use same criteria for clearing meta cache for all operations (Ashu Pachauri)
2016-03-07 17:34:11 -08:00
e42065c308
HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)
2016-03-07 16:35:58 -08:00
c1524485c5
HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi)
2016-03-07 04:57:55 -08:00
bbb10c4c18
HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
2016-03-07 17:48:37 +08:00
d089ac1ec6
HBASE-15373 DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory
2016-03-03 19:43:10 -08:00
b3c62680bc
HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang)
2016-03-03 16:01:15 -08:00
77c3c61b34
HBASE-15291 Revert due to the bug Haitao discovered
2016-03-02 00:49:59 -08:00
231a5807b4
HBASE-15181 Addendum fixes findbugs warning (Clara Xiong)
2016-03-01 18:21:37 -08:00
404e9145c2
HBASE-15315 Remove always set super user call as high priority (Yong Zhang)
2016-03-01 15:34:12 -08:00
18194f8a56
HBASE-15128 Disable region splits and merges switch in master
2016-02-29 20:41:27 +08:00
03a02969c4
HBASE-15358 canEnforceTimeLimitFromScope should use timeScope instead of sizeScope
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-02-29 17:22:23 +08:00
998e339d6e
HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT
2016-02-28 16:23:29 -08:00
0cd299dfca
HBASE-15181 A simple implementation of date based tiered compaction (Clara Xiong)
2016-02-27 07:33:19 -08:00
e0d7e0eb3b
HBASE-15348 Disable metrics tests until fixed.
2016-02-26 09:05:01 -08:00
e28b01be50
HBASE-15311 Prevent NPE in BlockCacheViewTmpl.
...
Signed-off-by: stack <stack@apache.org>
2016-02-25 15:24:32 -08:00
210ed97688
HBASE-15144 Procedure v2 - Web UI displaying Store state
2016-02-25 10:50:16 -08:00
04a3b27330
HBASE-15136 Explore different queuing behaviors while busy
2016-02-24 20:42:23 -08:00
3352173ec8
HBASE-15222 Use less contended classes for metrics
...
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.
Test Plan: unit tests
Reviewers:
Subscribers:
Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:47:00 -08:00
bcbe174a27
HBASE-15306 Make RPC call queue length dynamically configurable
2016-02-23 14:22:58 -08:00
d747188f2c
HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
...
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)
For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.
As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.
Signed-off-by: stack <stack@apache.org>
2016-02-23 10:28:33 -08:00
49cb0cfccb
HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang)
2016-02-23 06:12:13 -08:00
cc45b4ab38
HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy)
2016-02-23 09:59:35 +05:30
4784717235
HBASE-15135 Add metrics for storefile age
2016-02-22 02:43:24 -08:00
215cccdffc
HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state
2016-02-20 20:25:41 -08:00
7a1c407ea6
HBASE-14949 addendum fix compilation error on branch-1
2016-02-18 21:04:14 +08:00
b8f92312b3
HBASE-14949 Resolve name conflict when splitting if there are duplicated WAL entries
2016-02-18 19:49:36 +08:00
ab1b2c6603
HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
...
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 23:59:31 -06:00
6ed63180e1
HBASE-15263 TestIPv6NIOServerSocketChannel.testServerSocketFromLocalhostResolution can hang indefinetly
...
Signed-off-by: stack <stack@apache.org>
2016-02-16 12:54:34 -08:00
Apekshit
Jerry He
Matteo Bertozzi
Enis Soztutar
Gary Helmling
Ashish Singhi
tedyu
chenheng
Yu Li
Mikhail Antonov
Vasudevan
stack
Phil Yang
zhangduo
Andrew Purtell
Gábor Lipták
Ashish Singhi
Elliott Clark
Stephen Yuan Jiang
Harsh J
Jesse Yates
Sean Busbey
Samir Ahmic
Josh Elser
anoopsjohn