b3fe4ed16c
HBASE-15412 Add average region size metric (Alicia Ying Shu)
2016-03-22 14:46:27 -07:00
2348478506
HBASE-15360 addendum fix testCoDelScheduling
...
Signed-off-by: stack <stack@apache.org>
2016-03-22 13:52:26 -07:00
000117ad9f
HBASE-15477 Purge 'next block header' from cached blocks
...
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body. We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).
This patch undoes this over-persisting.
Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.
There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.
Adds loads of documentation.
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
(write) Add writing from a ByteBuff.
M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
(toString) Add one so ByteBuff looks like ByteBuffer when you click on
it in IDE
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
Remove support for version 1 blocks.
Cleaned up handling of metadata added when we serialize a block to
caches. Metadata is smaller now.
When we serialize (used when caching), do not persist the next blocks
header if present.
Removed a bunch of methods, a few of which had overlapping
functionality and others that exposed too much of our internals.
Also removed a bunch of constructors and unified the constructors we
had left over making them share a common init method.
Shutdown access to defines that should only be used internally here.
Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
about metadata saved to caches; was unclear previously what EXTRA was
about.
Renamed static final declarations as all uppercase.
(readBlockDataInternal): Redid. Couldn't make sense of it previously.
Undid heavy-duty parse of header by constructing HFileBlock. Other
cleanups. Its 1/3rd the length it used to be. More to do in here.
2016-03-22 13:42:38 -07:00
ef94b55239
HBASE-15477 Purge 'next block header' from cached blocks
...
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body. We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).
This patch undoes this over-persisting.
Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.
There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.
Adds loads of documentation.
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
(write) Add writing from a ByteBuff.
M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
(toString) Add one so ByteBuff looks like ByteBuffer when you click on
it in IDE
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
Remove support for version 1 blocks.
Cleaned up handling of metadata added when we serialize a block to
caches. Metadata is smaller now.
When we serialize (used when caching), do not persist the next blocks
header if present.
Removed a bunch of methods, a few of which had overlapping
functionality and others that exposed too much of our internals.
Also removed a bunch of constructors and unified the constructors we
had left over making them share a common init method.
Shutdown access to defines that should only be used internally here.
Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
about metadata saved to caches; was unclear previously what EXTRA was
about.
Renamed static final declarations as all uppercase.
(readBlockDataInternal): Redid. Couldn't make sense of it previously.
Undid heavy-duty parse of header by constructing HFileBlock. Other
cleanups. Its 1/3rd the length it used to be. More to do in here.
2016-03-22 13:34:51 -07:00
891569bbd9
Add javadoc on how BBIOEngine works (by Anoop Sam John)
2016-03-22 13:01:13 -07:00
7073f69993
HBASE-15392 Single Cell Get reads two HFileBlocks M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java moreRowsMayExistAfterCell Exploit the fact a Scan is a Get Scan. Also save compares if no non-default stopRow.
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java
optimize Add doc on what is being optimized. Also, if a Get Scan, do not
optimize else we'll keep going after our row is DONE.
Another place to make use of the Get Scan fact is when we are DONE.. if
Get Scan, we can close out the scan.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreScanner.java
Add tests for Get Scans and optimize around block loading.
2016-03-22 13:00:41 -07:00
47471c35e3
HBASE-15488 Add ACL for setting split merge switch
2016-03-22 10:38:13 -07:00
797562e6c3
HBASE-15464 Flush / Compaction metrics revisited
2016-03-21 17:50:02 -07:00
f1d453599a
HBASE-15433 SnapshotManager#restoreSnapshot not update table and region count quota correctly when encountering exception (Jianwei Cui)
2016-03-21 03:46:23 -07:00
f48c92d143
HBASE-15478 add comments to syncRunnerIndex handling explaining constraints on possible values.
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-03-21 00:28:15 -05:00
d2d8058ab3
HBASE-15451 Remove unnecessary wait in MVCC
2016-03-19 21:24:07 +08:00
3a6d683d63
HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun)
2016-03-18 10:21:43 -07:00
8c031e9d6b
HBASE-15456 Revert due to unit test failure in thrift module
2016-03-17 17:36:44 -07:00
fbf58f330b
HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang)
2016-03-17 11:03:29 -07:00
ac1a7a4a78
HBASE-15470 Add a setting for Priority queue length
...
Summary:
Move the config keys to one place
Make Two different config keys. One for default, one for priority
Test Plan: unit tests
Differential Revision: https://reviews.facebook.net/D55575
2016-03-16 16:52:04 -07:00
ecec35ae4e
HBASE-15441 Fix WAL splitting when region has moved multiple times
...
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.
Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.
We need to:
It appears that the close event with a sequence id of one is coming from region warm up.
This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.
Test Plan: Unit tests pass
Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:26:09 -07:00
3bf0945a11
HBASE-15430 Failed taking snapshot - Manifest proto-message too large (JunHo Cho)
2016-03-16 08:52:02 -07:00
9eb25bd5c9
HBASE-15360 Fix flaky TestSimpleRpcScheduler (Duo Zhang)
2016-03-16 08:04:10 -07:00
f120602f1e
HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun)
2016-03-15 16:15:03 -07:00
51259fe4a5
HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen)
2016-03-15 11:22:18 -07:00
8fcc1e8e95
HBASE-15463 Region normalizer should check whether split/merge is enabled
2016-03-15 09:03:27 -07:00
ca816f0780
HBASE-6721 RegionServer Group based Assignment (Francis Liu)
2016-03-14 18:28:50 -07:00
eea8b38dfa
HBASE-15180 Reduce garbage created while reading Cells from Codec Decoder.
2016-03-11 13:58:41 +05:30
a979d85582
HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu)
2016-03-10 20:16:30 -08:00
bb5bfe82f2
Revert "HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)"
...
Not needed afterall
This reverts commit d15ae0e6ab
2016-03-10 15:41:04 -08:00
d14b6c3810
HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi)
2016-03-09 18:49:41 -08:00
ad9b91a904
HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang)
2016-03-09 09:28:54 -08:00
9e967e5c1d
HBASE-15113 Procedure v2 - Speedup eviction of sys operation results
2016-03-08 19:47:15 -08:00
7e4e8dc3e9
HBASE-15420: TestCacheConfig failed after HBASE-15338
2016-03-09 10:15:35 +08:00
14217cef24
HBASE-15364 Fix unescaped < and > characters in Javadoc
2016-03-08 16:44:04 -08:00
46cc3d4972
HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE
2016-03-07 20:54:54 -08:00
4f044cf6be
HBASE-15421 Convert TestStoreScanner to junit4 from junit3 and clean up close of scanners
2016-03-07 20:46:46 -08:00
e477c143bc
HBASE-15354 Use same criteria for clearing meta cache for all operations (addendum) (Ashu Pachauri)
2016-03-07 18:11:15 -08:00
d15ae0e6ab
HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)
2016-03-07 16:34:11 -08:00
0f14856b01
HBASE-15416 TestHFileBackedByBucketCache is flakey since it went in
2016-03-07 16:31:09 -08:00
ed977fd125
HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT
2016-03-07 16:15:59 -08:00
dfc650a953
HBASE-15243 Revert due to compilation error - master branch change makes the patch stale
2016-03-07 15:59:29 -08:00
05c1309b3c
HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT
2016-03-07 15:41:06 -08:00
05161fcbfd
HBASE-15393 Addendum adds TestReplicationAdminWithTwoDifferentZKClusters (Ashish)
2016-03-07 04:56:00 -08:00
f30afa05d9
HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based
2016-03-07 17:36:40 +08:00
4483b3cbed
HBASE-15338: Add a option to disable the data block cache for testing the performance of underlying file system
2016-03-07 16:37:07 +08:00
ef712df944
HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen)
2016-03-05 11:01:45 -08:00
d083e4f29f
HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi)
2016-03-05 06:28:09 -08:00
27cf0c8c36
HBASE-15354 Same criteria to clear metacache across operations (Ashu Pachauri)
...
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-03-04 17:55:35 -08:00
7dabcf23e8
HBASE-15373 DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory
2016-03-03 19:42:42 -08:00
4fba1c3627
HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang)
2016-03-03 15:59:37 -08:00
f658f3ef83
HBASE-15356 Remove unused imports (Youngjoon Kim)
2016-03-03 11:42:38 -08:00
8ace5bbfce
HBASE-15366 Add doc, trace-level logging, and test around hfileblock
...
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
Make it emit its toString in format that matches the way we log
elsewhere
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
Capitalize statics.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
Verify and cleanup documentation of hfileblock format at head of class.
Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
Connect how we serialize and deserialize... done in different places
and one way when pulling from HDFS and another when pulling from cache
(TO BE FIXED). Shut down a load of public access.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
Add trace-level logging
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileScanner.java
Make it Closeable
2016-03-03 09:16:30 -08:00
4b3e38705c
HBASE-15329 Cross-Site Scripting: Reflected in table.jsp (Samir Ahmic)
2016-03-03 12:20:00 +08:00
5e395c4294
HBASE-15375 Do not write to '/tmp' in TestRegionMover
2016-03-02 17:04:19 +08:00
edc5ab5af9
HBASE-15291 Revert due to the bug Haitao discovered
2016-03-02 00:49:17 -08:00
dc44943666
HBASE-15359 Simplifying segment hierarchy
...
Signed-off-by: stack <stack@apache.org>
2016-03-01 23:25:11 -08:00
bab8d1527b
HBASE-15181 Addendum fixes findbugs warning (Clara Xiong)
2016-03-01 18:17:43 -08:00
9ad13468a0
HBASE-15315 Remove always set super user call as high priority (Yong Zhang)
2016-03-01 15:34:16 -08:00
88f775996b
HBASE-15358 canEnforceTimeLimitFromScope should use timeScope instead of sizeScope
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-02-29 17:21:42 +08:00
03ffb30efe
HBASE-15181 adds TestCompactionPolicy which was missing in first commit
2016-02-26 19:58:33 -08:00
f7f96b9fb7
HBASE-15181 A simple implementation of date based tiered compaction (Clara Xiong)
2016-02-26 17:36:23 -08:00
99955a3240
HBASE-15128 Disable region splits and merges switch in master
2016-02-27 08:36:59 +08:00
e88d943183
HBASE-15348 Disable metrics tests until fixed.
2016-02-26 09:04:51 -08:00
8f2bd06019
HBASE-15205 Do not find the replication scope for every WAL#append() (Ram)
2016-02-26 22:30:55 +05:30
538815d82a
HBASE-15215 TestBlockEvictionFromClient is flaky in jdk1.7 build (setting
...
offheap)
2016-02-26 11:43:00 +05:30
bf4fcc30c6
Revert "HBASE-15128 Disable region splits and merges switch in master"
...
This reverts commit 24d481c580
2016-02-26 08:52:12 +08:00
24d481c580
HBASE-15128 Disable region splits and merges switch in master
2016-02-26 08:11:16 +08:00
75c57a04dd
HBASE-15311 Prevent NPE in BlockCacheViewTmpl.
...
Signed-off-by: stack <stack@apache.org>
2016-02-25 15:23:28 -08:00
40c55915e7
HBASE-15144 Procedure v2 - Web UI displaying Store state
2016-02-25 10:46:56 -08:00
43f99def67
HBASE-15136 Explore different queuing behaviors while busy
2016-02-24 20:41:30 -08:00
6e9d355b12
HBASE-15264 Implement a fan out HDFS OutputStream
2016-02-25 10:07:27 +08:00
630a65825e
HBASE-15222 Use less contended classes for metrics
...
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.
Test Plan: unit tests
Reviewers:
Subscribers:
Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:34:05 -08:00
30cec72f9a
HBASE-15302 Reenable the other tests disabled by HBASE-14678
...
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:14:01 -08:00
876a6ab73e
HBASE-15016 Services a Store needs from a Region
...
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:07:07 -08:00
28cd48b673
HBASE-15277 TestRegionMergeTransactionOnCluster.testWholesomeMerge fails with no connection to master; ADDING DEBUGGING
2016-02-23 22:43:01 -08:00
f47dba74d4
HBASE-15306 Make RPC call queue length dynamically configurable
2016-02-23 14:20:40 -08:00
58283fa1b1
HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang)
2016-02-23 06:11:39 -08:00
3ba1a7fd23
HBASE-13259 mmap() based BucketCache IOEngine (Zee Chen & Ram)
2016-02-23 17:03:38 +05:30
a8073c4a98
HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
...
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)
For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.
As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.
Signed-off-by: stack <stack@apache.org>
2016-02-22 22:03:14 -08:00
5e501123ca
HBASE-15301 Remove the never-thrown NamingException from TableInputFormatBase#reverseDNS method signature (Yu Li)
2016-02-22 21:58:20 -08:00
2d66cd86d0
HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy)
2016-02-23 09:21:37 +05:30
e58c0385a7
HBASE-15135 Add metrics for storefile age
2016-02-22 02:21:02 -08:00
ed290cf829
HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state
2016-02-20 20:25:01 -08:00
a878b19c4e
HBASE-15259 WALEdits under replay will also be replicated
2016-02-20 10:09:27 +08:00
8eedc96751
HBASE-15251 During a cluster restart, Hmaster thinks it is a failover by mistake (Clara Xiong)
2016-02-18 23:46:54 -08:00
d2ba87509b
HBASE-14949 Resolve name conflict when splitting if there are duplicated WAL entries
2016-02-18 19:48:52 +08:00
bba4f107c1
HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
...
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 23:55:38 -06:00
c7eb72a91c
Revert "HBASE-15120 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon."
...
This reverts commit 9f8273e717
2016-02-17 23:55:20 -06:00
4b1acead42
HBASE-15285 Forward-port respect for isReturnResult from HBASE-15095
2016-02-17 19:26:17 -08:00
9f8273e717
HBASE-15120 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
...
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 10:23:06 +08:00
a8077080ba
HBASE-15277 TestRegionMergeTransactionOnCluster.testWholesomeMerge fails with no connection to master
2016-02-16 13:13:13 -08:00
bb881eb80d
HBASE-15276 TestFlushSnapshotFromClient hung
2016-02-16 12:58:22 -08:00
e3aa71fb76
HBASE-15263 TestIPv6NIOServerSocketChannel.testServerSocketFromLocalhostResolution can hang indefinetly
...
Signed-off-by: stack <stack@apache.org>
2016-02-16 12:53:44 -08:00
7063562bf1
HBASE-13839 Fix AssgnmentManagerTmpl.jamon issues (coloring, content etc.) ; ADDENDUM
2016-02-15 17:50:10 -08:00
68b300173f
HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)
2016-02-15 13:53:47 +08:00
3897c4e102
Revert "HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT"
...
This reverts commit c8d133186b
2016-02-13 11:18:53 -06:00
1419628881
HBASE-13839 Fix AssgnmentManagerTmpl.jamon issues (coloring, content etc.)
2016-02-12 15:06:38 -08:00
c8d133186b
HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT
...
Signed-off-by: stack <stack@apache.org>
2016-02-12 13:41:09 -08:00
454e45f50d
HBASE-15219 Revert pending verification of test result
2016-02-12 12:06:48 -08:00
85e1d9a109
HBASE-15252 Data loss when replaying wal if HDFS timeout
2016-02-12 16:16:37 +08:00
25dfc112dd
HBASE-14919 Refactoring for in-memory flush and compaction
...
Signed-off-by: stack <stack@apache.org>
2016-02-11 10:39:01 -08:00
29a192ef3c
HBASE-15198 RPC client not using Codec and CellBlock for puts by default.
2016-02-11 09:51:11 +05:30
fec9733893
HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram)
2016-02-11 09:09:25 +05:30
1942a99b83
HBASE-15223 Make convertScanToString public for Spark
2016-02-10 15:02:58 -08:00
2963d59ed2
HBASE-15229 Canary Tools should not call System.Exit on error (Vishal Khandelwal)
2016-02-10 10:21:00 -08:00
d53318163b
HBASE-15239 Remove unused LoadBalancer.immediateAssignment()
2016-02-10 09:16:42 -08:00
df829ea7d1
HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state
2016-02-10 02:36:46 -08:00
bab812df28
HBASE-15216 Canary does not accept config params from command line (Vishal Khandelwal)
2016-02-09 22:45:37 -08:00
b6328eb803
HBASE-15238 HFileReaderV2 prefetch overreaches; runs off the end of the data
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/ChecksumUtil.java
Cleanup trace message and include offset; makes debug the easier.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/FixedFileTrailer.java
Fix incorrect data member javadoc.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
Pass along the offset we are checksumming at.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpljava
Add trace logging for debugging and set the end of the prefetch to be
last datablock, not size minus trailersize (there is the root indices
and file info to be skipped)
2016-02-09 20:31:44 -08:00
7cab24729d
HBASE-11792 Organize Performance Evaluation usage output
2016-02-09 11:16:22 -08:00
ec92a8a705
HBASE-15158 Change order in which we do write pipeline operations; do all under row locks
2016-02-07 22:56:40 -08:00
eacf7bcf97
HBASE-15163 Add sampling code and metrics for get/scan/multi/mutate count separately (Yu Li)
2016-02-06 06:30:56 -08:00
d82ae42126
Revert "HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)"
...
Revert mistaken commit.
This reverts commit efc7a0d347
2016-02-06 05:17:29 -08:00
4e44f4f505
HBASE-15204 Try to estimate the cell count for adding into WALEdit (Revert
...
for making it more cleaner)
2016-02-06 13:05:13 +05:30
59b03c77de
HBASE-14770 RowCounter argument input parse error
...
Signed-off-by: stack <stack@apache.org>
2016-02-05 21:41:30 -08:00
efc7a0d347
HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)
2016-02-05 21:28:46 -08:00
2ce31f8945
HBASE-15220 Change two logs in SimpleRegionNormalizer to INFO level
2016-02-05 20:52:17 -08:00
31f9f2fb67
HBASE-15209 (compatibility) Disable table in HBaseTestingUtility.truncateTable. (Apekshit)
...
Signed-off-by: stack <stack@apache.org>
2016-02-05 20:41:40 -08:00
81d81c9839
HBASE-15157 Add *PerformanceTest for Append, CheckAnd*
2016-02-05 20:33:55 -08:00
7239056c78
HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across.
2016-02-06 02:40:49 +05:30
779bdf1918
HBASE-15218 On RS crash and replay of WAL, loosing all Tags in Cells (Anoop Sam John)
2016-02-05 10:08:20 -08:00
64bac770d4
HBASE-11262 Avoid empty columns while doing bulk-load (Ashish Kumar)
2016-02-05 09:00:04 -08:00
6f6a8ed71f
HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram)
2016-02-05 14:24:38 +05:30
8f20bc748d
HBASE-15197 Expose filtered read requests metric to metrics framework and Web UI (Eungsop Yoo)
2016-02-05 10:57:14 +08:00
f4d9597e1e
HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond; ADDENDUM changing LOG.debug to LOG.trace -- noticed by matteo
2016-02-04 16:26:04 -08:00
18eff3c1c3
HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond
2016-02-04 16:09:26 -08:00
337f483077
Revert "HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond"
...
This reverts commit c177cfed41
2016-02-04 16:08:41 -08:00
c177cfed41
HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond
2016-02-04 14:24:05 -08:00
a69272efe1
HBASE-15177 Reduce garbage created under high load
2016-02-04 13:27:00 -08:00
7b33a740b1
HBASE-15202 Reduce garbage while setting response (Ram)
2016-02-04 23:23:31 +05:30
f5fba2ba0d
HBASE-15211 Don't run the CatalogJanitor if there are regions in transition
2016-02-04 08:52:09 -08:00
2cf8af5bf1
HBASE-HBASE-15203 Reduce garbage created by path.toString() during
...
Checksum verification (Ram)
2016-02-04 11:44:46 +05:30
2f5767376f
HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li)
2016-02-02 17:10:19 -08:00
ecf3efadc0
HBASE-15206 Fix flakey testSplitDaughtersNotInMeta test (Huaxiang Sun)
2016-02-02 16:41:43 -08:00
ed46591f30
HBASE-15196 HBASE-15158 Preamble 2 of 2:Add Increment tests
2016-02-02 11:27:03 -08:00
243e6cc529
HBASE-15192 TestRegionMergeTransactionOnCluster#testCleanMergeReference is flaky
2016-02-02 09:42:15 -08:00
fc5e698c0a
HBASE-14969 Add throughput controller for flush; ADDENDUM
2016-02-01 08:08:39 -08:00
2cc48e039d
HBASE-15158 HBASE-15158 Preamble 1 of 2: fix findbugs, add javadoc, change Region#getReadpoint to #getReadPoint, and some util
2016-01-31 20:21:48 -08:00
9ec408e25b
TestStochasticLoadBalancer.testRegionReplicationOnMidClusterSameHosts flaky on trunk
2016-01-30 07:51:21 -04:00
b3b1ce99c6
HBASE-14969 Add throughput controller for flush
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-01-29 09:32:01 +08:00
14dd959aa2
HBASE-15142 Procedure v2 - Basic WebUI listing the procedures
2016-01-28 10:13:42 -08:00
8a217da8fd
HBASE-15019 Replication stuck when HDFS is restarted.
...
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-01-28 10:09:02 -08:00
1ee07688c8
HBASE-15173 Execute mergeRegions RPC call as the request user
2016-01-28 09:53:24 -08:00
37ed0f6d08
HBASE-15171 Addendum removes extra loop (Yu Li)
2016-01-28 07:06:10 -08:00
138b754671
HBASE-15146 Don't block on Reader threads queueing to a scheduler queue
2016-01-28 07:58:43 -05:00
47c4147940
HBASE-15171 Avoid counting duplicate kv and generating lots of small hfiles in PutSortReducer (Yu Li)
2016-01-27 09:42:56 -08:00
de62ad150d
HBASE-14526 Remove delayed rpc
2016-01-26 12:15:01 -08:00
d6b3d838eb
HBASE-15123 Remove duplicate code in LocalHBaseCluster and minor formatting (Appy)
2016-01-25 13:00:08 -04:00
a87d9560fc
HBASE-15125 HBaseFsck's adoptHdfsOrphan function creates region with wrong end key boundary (chenrongwei)
2016-01-23 12:35:57 -08:00
6ed3c759d0
HBASE-15132 Master region merge RPC should authorize user request
2016-01-23 07:48:20 -08:00
f9e69b51e1
HBASE-15148 Resolve IS2_INCONSISTENT_SYNC findbugs warning in AuthenticationTokenSecretManager (Yu Li)
2016-01-22 02:47:49 -08:00
b1df2f8c88
HBASE-15133 Data loss after compaction when a row has more than Integer.MAX_VALUE columns (Toshihiro Suzuki)
2016-01-22 02:39:40 -08:00
b6f091e0fd
HBASE-15152 Automatically include prefix-tree module in MR jobs if present
2016-01-21 18:55:19 -08:00
1d2b0d8311
HBASE-15126 HBaseFsck's checkRegionBoundaries function sets incorrect storesFirstKey (chenrongwei)
2016-01-21 07:46:58 -08:00
bd9906736e
HBASE-15098 Normalizer switch in configuration is not used
2016-01-20 09:32:38 -08:00
93e200d52b
HBASE-15101 Leaked References to StoreFile.Reader after HBASE-13082
...
(Deepankar)
2016-01-20 11:42:13 +05:30
318814de28
HBASE-15102 Fix HeapMemoryTuner overtuning memstore
...
HeapMemoryTuner often over tunes memstore without looking at
the lower limit of the previous memstore size and causing a
situation in which memstore used size suddenly exceeds the
total memstore size.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-19 12:24:04 -08:00
713c6b5b1e
HBASE-15106 Procedure v2 - Procedure Queue pass Procedure for better debuggability
2016-01-19 11:54:24 -08:00
eb17f74b9e
HBASE-15073 Revert due to different opinion on usefulness
2016-01-18 17:51:21 -08:00
9bf26f46d1
HBASE-15118 Fix findbugs complaint in hbase-server
2016-01-18 13:02:17 -08:00
47fc696bc6
HBASE-14962 TestSplitWalDataLoss fails on all branches
2016-01-16 15:53:07 -08:00
387eaff316
Amend HBASE-14512 Cache UGI groups
...
Handle the case where tests might create a call with a null connection
2016-01-15 19:27:18 -08:00
79588240c6
Amend HBASE-14771 RpcServer#getRemoteAddress always returns null
...
This change has been reported to cause Phoenix's PhoenixIndexRpcSchedulerTest to fail
with a NPE
2016-01-15 19:27:18 -08:00
2d2fdd5a9f
HBASE-15114 NPE when IPC server ByteBuffer reservoir is turned off
2016-01-15 16:42:35 -08:00
cb17c7a97a
HBASE-15117 Resolve ICAST findbugs warnings in current codes (Yu Li)
2016-01-15 06:00:11 -08:00
4ac8d4ce61
HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Appy)
2016-01-14 16:39:52 -08:00
ae7cc0c848
HBASE-15105 Procedure V2 - Procedure Queue with Namespaces
2016-01-14 13:45:17 -08:00
18a48af242
HBASE-14837 Procedure v2 - Procedure Queue Improvement
2016-01-14 09:24:42 -08:00
c8b9754a5e
HBASE-15099 Move RegionStateListener class out of quotas package
2016-01-13 15:15:37 -08:00
840f5ea686
HBASE-15085 IllegalStateException was thrown when scanning on bulkloaded
...
HFiles (Victor Xu)
2016-01-12 14:36:48 +05:30
83c506d9d4
HBASE-15087 Fix hbase-common findbugs complaints
2016-01-12 00:30:42 -08:00
8ee9158b54
HBASE-15083 Gets from Multiactions are not counted in metrics for gets
2016-01-12 14:18:36 +08:00
da932ee38d
HBASE-15077 Support OffheapKV write in compaction with out copying data on heap.
2016-01-12 10:02:39 +05:30
ec47a811a2
HBASE-15052 Use EnvironmentEdgeManager in ReplicationSource
2016-01-11 09:37:08 -08:00
894ce84b83
HBASE-15027 - Findbug fix (addendum)
2016-01-11 16:50:59 +05:30
4a26644245
HBASE-15065 Addendum fixes checkstyle warnings
2016-01-08 14:49:30 -08:00
52280b64e6
HBASE-14975 Don't color the total RIT line yellow if it's zero (Pallavi Adusumilli)
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-08 14:29:44 -08:00
6e781a1f34
HBASE-15065 SimpleRegionNormalizer should return multiple normalization plans in one run
2016-01-08 11:47:34 -08:00
28c2b18d30
HBASE-15027 Refactor the way the CompactedHFileDischarger threads are
...
created (Ram)
2016-01-08 11:18:39 +05:30
f3ee6df0f2
HBASE-15079 TestMultiParallel.validateLoadedData AssertionError: null
2016-01-07 15:36:49 -08:00
5bde960b95
HBASE-15076 Add getScanner(Scan scan, List<KeyValueScanner> additionalScanners) API into Region interface (Anoop Sam John)
2016-01-07 13:45:01 -08:00
5266b07708
HBASE-15068 Add metrics for region normalization plans
2016-01-07 03:13:16 -08:00
d65978fceb
HBASE-15073 Finer grained control over normalization actions for RegionNormalizer
2016-01-06 17:25:41 -08:00
a9b671b31f
HBASE-12593 Tags to work with ByteBuffer.
2016-01-06 21:28:06 +05:30
893a54c3a4
HBASE-15066 Small improvements to Canary tool
2016-01-06 02:47:19 -08:00
073e00c005
HBASE-14221 Reduce the number of time row comparison is done in a Scan
...
(Ram)
2016-01-06 10:38:27 +05:30
e8fbc9b43a
HBASE-14468 addendum.
2016-01-05 15:54:34 -08:00
46303dfd75
HBASE-14888 ClusterSchema: Add Namespace Operations
2016-01-05 14:35:27 -08:00
00656688f7
HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled
2016-01-04 07:10:10 -08:00
9589a7d8be
HBASE-15038 ExportSnapshot should support separate configs for source and destination
2016-01-04 00:10:19 -08:00
a82f7fc94a
Revert "HBASE-14888 ClusterSchema: Add Namespace Operations"
...
This reverts commit c5f3d17ae3
2016-01-03 07:15:18 -08:00
c5f3d17ae3
HBASE-14888 ClusterSchema: Add Namespace Operations
2016-01-02 16:16:56 -08:00
92abf8ac57
HBASE-15060 Cull TestHFileV2 and HFileWriterFactory
2015-12-30 13:21:54 -08:00
c1b6d47e79
HBASE-15044 Region normalization should be allowed when underlying namespace has quota
2015-12-30 08:04:23 -08:00
07b6236706
HBASE-15050 Block Ref counting does not work in Region Split cases (Ram)
2015-12-30 14:39:03 +05:30
413d663f92
HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-29 20:25:47 -06:00
1e4992c6ec
HBASE-14867 SimpleRegionNormalizer needs to have better heuristics to trigger merge operation
2015-12-29 06:21:57 -08:00
2fba25b66a
HBASE-15023 Reenable TestShell and TestStochasticLoadBalancer
2015-12-28 13:27:17 -08:00
449fb81286
HBASE-14030 Revert due to pending review comments
2015-12-28 01:08:02 -08:00
de69f0df34
HBASE-14030 HBase Backup/Restore Phase 1 (Vladimir Rodionov)
2015-12-27 10:02:09 -08:00
1c7e9ec124
HBASE-15039 HMaster and RegionServers should try to refresh token keys from zk when facing InvalidToken (Yong Zhang)
2015-12-25 10:32:51 -08:00
3de0b0417c
HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags
2015-12-25 09:51:34 -08:00
dfada43e90
HBASE-14822; addendum - handle callSeq.
2015-12-24 12:55:39 -08:00
a1a19d9405
HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish)
2015-12-24 11:07:49 -08:00
8e0854c64b
HBASE-15030 Deadlock in master TableNamespaceManager while running IntegrationTestDDLMasterFailover
2015-12-23 09:46:18 -08:00
2439f7a688
HBASE-15028 Minor fix on RegionGroupingProvider (Yu Li)
2015-12-22 06:47:33 -08:00
6e2c5d216e
HBASE-15014 Fix filterCellByStore in WALsplitter is awful for performance
2015-12-21 22:50:38 -08:00
f018c371b5
HBASE-14654 Reenable TestMultiParallel#testActiveThreadsCount
2015-12-22 11:33:25 +08:00
f56abf730f
HBASE-14976 fix tests
...
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2015-12-21 11:35:59 -08:00
8c921ea94f
HBASE-14976 Add RPC call queues to the web ui (Pallavi Adusumilli)
2015-12-19 12:44:30 -08:00
86a417eead
HBASE-14822 Renewing leases of scanners doesn't work.
2015-12-19 09:55:03 -08:00
48113d7572
HBASE-15001 Fix thread-safety issues with replication
...
ReplicationSinkManager and HBaseInterClusterReplicationEndpoint
perform certain unsafe operations which might lead to undesirable
behavior with multiwal enabled.
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-18 11:48:55 -08:00
ba04e0372d
HBASE-15003 remove BoundedConcurrentLinkedQueue.
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-12-18 12:26:38 -06:00
4bfeccb87a
HBASE-15005 Use value array in computing block length for 1.2 and 1.3
2015-12-18 00:23:02 -08:00
408666a06d
HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also.
2015-12-18 09:50:53 +05:30
27160950ca
HBASE-14990 Tests in BaseTestHBaseFsck are run by its subclasses redundantly
2015-12-18 11:37:58 +08:00
217036d816
HBASE-14978 Don't allow Multi to retain too many blocks
2015-12-17 16:13:50 -08:00
80fc18d2e1
HBASE-15000 Fix javadoc warn in LoadIncrementalHFiles. (Ashish)
2015-12-17 22:47:48 +05:30
cf458d3023
HBASE-14999 Remove ref to org.mortbay.log.Log.
2015-12-17 18:01:16 +05:30
d78eddfdc8
HBASE-14995 Revert according to Ram's feedback
2015-12-16 21:54:48 -08:00
546ac1cbb3
HBASE-14995 Optimize setting tagsPresent in DefaultMemStore.java (huaxiang sun)
2015-12-16 18:16:38 -08:00
3dec8582f5
HBASE-14951 Make hbase.regionserver.maxlogs obsolete
2015-12-16 14:57:59 -08:00
e965b614b3
HBASE-14974 Total number of Regions in Transition number on UI incorrect
2015-12-16 14:10:32 -08:00
ca7a82fb57
HBASE-14838 Add clarification docs to SimpleRegionNormalizer.
...
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-12-16 08:58:48 -06:00
abe30b52a8
HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version
2015-12-15 12:11:27 -08:00
3e26063161
HBASE-14968 ConcurrentModificationException in region close resulting in the region staying in closing state
2015-12-15 11:49:34 -08:00
1822bb5d95
HBASE-14895 Seek only to the newly flushed file on scanner reset on flush
...
- Addendum (Ram)
2015-12-15 10:34:25 +05:30
10d86c7dae
HBASE-14929 There is a space missing from table "foo" is not currently available (Carlos A. Morillo)
2015-12-14 16:07:05 -08:00
04622254f7
HBASE-14936 CombinedBlockCache should overwrite CacheStats#rollMetricsPeriod() (Jianwei Cui)
2015-12-14 17:20:50 +08:00
555d9b70bd
HBASE-14895 Seek only to the newly flushed file on scanner reset on flush
...
(Ram)
2015-12-14 10:13:53 +05:30
f34d3e1d26
HBASE-14701 Fix flakey Failed tests: TestMobFlushSnapshotFromClient>TestFlushSnapshotFromClient.testSkipFlushTableSnapshot:199 null (Jingcheng Du)
2015-12-12 19:34:23 -08:00
453a66c3b9
HBASE-14953 Replication: retry on RejectedExecutionException
...
In HBaseInterClusterReplicationEndpoint, we fail the whole batch
in case of a RejectedExecutionException on an individual sub-batch.
We should let the submitted sub-batches finish and retry only for
the remaining ones.
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-11 13:15:22 -08:00
cff664c5e2
HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded
2015-12-10 19:11:57 -08:00
48e217a7db
HBASE-14946 Don't allow multi's to over run the max result size.
...
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens
Test Plan: Added a unit test
Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:10:32 -08:00
c15e0af84a
HBASE-14906 Improvements on FlushLargeStoresPolicy (Yu Li)
2015-12-10 16:49:23 -08:00
bebcc09fb3
HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin
2015-12-10 15:02:21 -08:00
9511150bd6
HBASE-14901 Remove duplicate code to create/manage encryption keys
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2015-12-10 14:38:43 -08:00
26ac60b03f
HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi)
2015-12-10 13:07:46 +05:30
c1e0fcc26d
HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection
2015-12-09 15:52:27 -08:00
ba3aa9a9b1
HBASE-14942 Allow turning off BoundedByteBufferPool
2015-12-09 15:29:25 -08:00
0e147a9d6e
HBASE-14954 IllegalArgumentException was thrown when doing online configuration change in CompactSplitThread (Victor Xu)
2015-12-09 07:18:08 -08:00
7bfbb6a3c9
HBASE-14869 Better request latency and size histograms. (Vikas Vishwakarma and Lars Hofhansl)
2015-12-08 17:02:27 -08:00
2430efc2b2
HBASE-7171 Initial web UI for region/memstore/storefiles details
2015-12-08 13:53:21 -08:00
1f999c1e2b
HBASE-14719 Add metrics for master WAL count (numMasterWALs). Metric numMasterWALs appears as follows in metrics dump
...
{
"name" : "Hadoop:service=HBase,name=Master,sub=Procedure",
"modelerType" : "Master,sub=Procedure",
"tag.Context" : "master",
"tag.Hostname" : "vrishal-mbp",
"numMasterWALs" : 1
},
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-07 11:14:29 -08:00
c9a0148628
HBASE-14923 VerifyReplication should not mask the exception during result comparison (Vishal Khandelwal)
2015-12-04 18:53:05 -08:00
cd5ddc5fec
HBASE-14922 Delayed flush doesn't work causing flush storms.
2015-12-04 16:54:01 -08:00
c6b8e6f1ac
HBASE-14907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)
...
Put back HBASE-14907 but with right JIRA number (by doing a revert of a revert)
This reverts commit 35a7b56e53
2015-12-04 16:40:27 -08:00
a4a44587b3
Revert "Revert "HBASE-14909 NPE testing for RIT""
...
Reverted the wrong patch... putting it back (revert of a revert)
This reverts commit 157a60f1b3
2015-12-04 16:38:33 -08:00
157a60f1b3
Revert "HBASE-14909 NPE testing for RIT"
...
This reverts commit da0cc598fe
2015-12-04 16:37:14 -08:00
35a7b56e53
Revert "HBASE-4907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)"
...
Revert because I pitched this against the wrong JIRA number!
This reverts commit 03e4712f0c
2015-12-04 16:36:46 -08:00
03e4712f0c
HBASE-4907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)
2015-12-04 10:53:09 -08:00
8b3d1f1444
HBASE-13082 Coarsen StoreScanner locks to RegionScanner (Ram)
2015-12-04 10:20:46 +05:30
b3260423b1
HBASE-14904 Mark Base[En|De]coder LimitedPrivate and fix binary compat issue
2015-12-03 18:18:20 -08:00
51503efcf0
HBASE-13857 Slow WAL Append count in ServerMetricsTmpl.jamon is hardcoded to zero (Vrishal Kulkarni)
2015-12-03 17:00:29 -08:00
Enis Soztutar
zhangduo
stack
tedyu
Sean Busbey
Yu Li
Elliott Clark
Matteo Bertozzi
anoopsjohn
Liu Shaohui
Gábor Lipták
Mikhail Antonov
chenheng
Jesse Yates
Ashu Pachauri
Jonathan M Hsieh
eshcar
Phil Yang
ramkrishna
Samir Ahmic
Josh Elser
Sean Busbey
Ashish Singhi
Jerry He
Andrew Purtell
Misty Stanley-Jones
Adrian Muraru
Apekshit
Yu Li
Lars Hofhansl
Gary Helmling
Pallavi Adusumilli
Nate Edel
Vrishal Kulkarni