Commit Graph

4687 Commits

Author SHA1 Message Date
Samir Ahmic 75c57a04dd HBASE-15311 Prevent NPE in BlockCacheViewTmpl.
Signed-off-by: stack <stack@apache.org>
2016-02-25 15:23:28 -08:00
Samir Ahmic 40c55915e7 HBASE-15144 Procedure v2 - Web UI displaying Store state 2016-02-25 10:46:56 -08:00
Mikhail Antonov 43f99def67 HBASE-15136 Explore different queuing behaviors while busy 2016-02-24 20:41:30 -08:00
zhangduo 6e9d355b12 HBASE-15264 Implement a fan out HDFS OutputStream 2016-02-25 10:07:27 +08:00
Elliott Clark 630a65825e HBASE-15222 Use less contended classes for metrics
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.

Test Plan: unit tests

Reviewers:

Subscribers:

Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:34:05 -08:00
Phil Yang 30cec72f9a HBASE-15302 Reenable the other tests disabled by HBASE-14678
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:14:01 -08:00
eshcar 876a6ab73e HBASE-15016 Services a Store needs from a Region
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:07:07 -08:00
stack 28cd48b673 HBASE-15277 TestRegionMergeTransactionOnCluster.testWholesomeMerge fails with no connection to master; ADDING DEBUGGING 2016-02-23 22:43:01 -08:00
Mikhail Antonov f47dba74d4 HBASE-15306 Make RPC call queue length dynamically configurable 2016-02-23 14:20:40 -08:00
tedyu 58283fa1b1 HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-02-23 06:11:39 -08:00
ramkrishna 3ba1a7fd23 HBASE-13259 mmap() based BucketCache IOEngine (Zee Chen & Ram) 2016-02-23 17:03:38 +05:30
Josh Elser a8073c4a98 HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)

For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.

As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.

Signed-off-by: stack <stack@apache.org>
2016-02-22 22:03:14 -08:00
stack 5e501123ca HBASE-15301 Remove the never-thrown NamingException from TableInputFormatBase#reverseDNS method signature (Yu Li) 2016-02-22 21:58:20 -08:00
anoopsjohn 2d66cd86d0 HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy) 2016-02-23 09:21:37 +05:30
Mikhail Antonov e58c0385a7 HBASE-15135 Add metrics for storefile age 2016-02-22 02:21:02 -08:00
tedyu ed290cf829 HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-20 20:25:01 -08:00
chenheng a878b19c4e HBASE-15259 WALEdits under replay will also be replicated 2016-02-20 10:09:27 +08:00
tedyu 8eedc96751 HBASE-15251 During a cluster restart, Hmaster thinks it is a failover by mistake (Clara Xiong) 2016-02-18 23:46:54 -08:00
zhangduo d2ba87509b HBASE-14949 Resolve name conflict when splitting if there are duplicated WAL entries 2016-02-18 19:48:52 +08:00
Samir Ahmic bba4f107c1 HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 23:55:38 -06:00
Sean Busbey c7eb72a91c Revert "HBASE-15120 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon."
This reverts commit 9f8273e717.
2016-02-17 23:55:20 -06:00
stack 4b1acead42 HBASE-15285 Forward-port respect for isReturnResult from HBASE-15095 2016-02-17 19:26:17 -08:00
Samir Ahmic 9f8273e717 HBASE-15120 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 10:23:06 +08:00
stack a8077080ba HBASE-15277 TestRegionMergeTransactionOnCluster.testWholesomeMerge fails with no connection to master 2016-02-16 13:13:13 -08:00
stack bb881eb80d HBASE-15276 TestFlushSnapshotFromClient hung 2016-02-16 12:58:22 -08:00
chenheng e3aa71fb76 HBASE-15263 TestIPv6NIOServerSocketChannel.testServerSocketFromLocalhostResolution can hang indefinetly
Signed-off-by: stack <stack@apache.org>
2016-02-16 12:53:44 -08:00
stack 7063562bf1 HBASE-13839 Fix AssgnmentManagerTmpl.jamon issues (coloring, content etc.) ; ADDENDUM 2016-02-15 17:50:10 -08:00
chenheng 68b300173f HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic) 2016-02-15 13:53:47 +08:00
Sean Busbey 3897c4e102 Revert "HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT"
This reverts commit c8d133186b.
2016-02-13 11:18:53 -06:00
stack 1419628881 HBASE-13839 Fix AssgnmentManagerTmpl.jamon issues (coloring, content etc.) 2016-02-12 15:06:38 -08:00
Ashish Singhi c8d133186b HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT
Signed-off-by: stack <stack@apache.org>
2016-02-12 13:41:09 -08:00
tedyu 454e45f50d HBASE-15219 Revert pending verification of test result 2016-02-12 12:06:48 -08:00
zhangduo 85e1d9a109 HBASE-15252 Data loss when replaying wal if HDFS timeout 2016-02-12 16:16:37 +08:00
eshcar 25dfc112dd HBASE-14919 Refactoring for in-memory flush and compaction
Signed-off-by: stack <stack@apache.org>
2016-02-11 10:39:01 -08:00
anoopsjohn 29a192ef3c HBASE-15198 RPC client not using Codec and CellBlock for puts by default. 2016-02-11 09:51:11 +05:30
ramkrishna fec9733893 HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram) 2016-02-11 09:09:25 +05:30
Jerry He 1942a99b83 HBASE-15223 Make convertScanToString public for Spark 2016-02-10 15:02:58 -08:00
Andrew Purtell 2963d59ed2 HBASE-15229 Canary Tools should not call System.Exit on error (Vishal Khandelwal) 2016-02-10 10:21:00 -08:00
Matteo Bertozzi d53318163b HBASE-15239 Remove unused LoadBalancer.immediateAssignment() 2016-02-10 09:16:42 -08:00
tedyu df829ea7d1 HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-10 02:36:46 -08:00
Andrew Purtell bab812df28 HBASE-15216 Canary does not accept config params from command line (Vishal Khandelwal) 2016-02-09 22:45:37 -08:00
stack b6328eb803 HBASE-15238 HFileReaderV2 prefetch overreaches; runs off the end of the data
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/ChecksumUtil.java
      Cleanup trace message and include offset; makes debug the easier.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/FixedFileTrailer.java
      Fix incorrect data member javadoc.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
      Pass along the offset we are checksumming at.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpljava
      Add trace logging for debugging and set the end of the prefetch to be
      last datablock, not size minus trailersize (there is the root indices
      and file info to be skipped)
2016-02-09 20:31:44 -08:00
Misty Stanley-Jones 7cab24729d HBASE-11792 Organize Performance Evaluation usage output 2016-02-09 11:16:22 -08:00
stack ec92a8a705 HBASE-15158 Change order in which we do write pipeline operations; do all under row locks 2016-02-07 22:56:40 -08:00
stack eacf7bcf97 HBASE-15163 Add sampling code and metrics for get/scan/multi/mutate count separately (Yu Li) 2016-02-06 06:30:56 -08:00
stack d82ae42126 Revert "HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)"
Revert mistaken commit.

This reverts commit efc7a0d347.
2016-02-06 05:17:29 -08:00
ramkrishna 4e44f4f505 HBASE-15204 Try to estimate the cell count for adding into WALEdit (Revert
for making it more cleaner)
2016-02-06 13:05:13 +05:30
Adrian Muraru 59b03c77de HBASE-14770 RowCounter argument input parse error
Signed-off-by: stack <stack@apache.org>
2016-02-05 21:41:30 -08:00
stack efc7a0d347 HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic) 2016-02-05 21:28:46 -08:00
tedyu 2ce31f8945 HBASE-15220 Change two logs in SimpleRegionNormalizer to INFO level 2016-02-05 20:52:17 -08:00
Apekshit 31f9f2fb67 HBASE-15209 (compatibility) Disable table in HBaseTestingUtility.truncateTable. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2016-02-05 20:41:40 -08:00
stack 81d81c9839 HBASE-15157 Add *PerformanceTest for Append, CheckAnd* 2016-02-05 20:33:55 -08:00
anoopsjohn 7239056c78 HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across. 2016-02-06 02:40:49 +05:30
stack 779bdf1918 HBASE-15218 On RS crash and replay of WAL, loosing all Tags in Cells (Anoop Sam John) 2016-02-05 10:08:20 -08:00
tedyu 64bac770d4 HBASE-11262 Avoid empty columns while doing bulk-load (Ashish Kumar) 2016-02-05 09:00:04 -08:00
ramkrishna 6f6a8ed71f HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram) 2016-02-05 14:24:38 +05:30
chenheng 8f20bc748d HBASE-15197 Expose filtered read requests metric to metrics framework and Web UI (Eungsop Yoo) 2016-02-05 10:57:14 +08:00
stack f4d9597e1e HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond; ADDENDUM changing LOG.debug to LOG.trace -- noticed by matteo 2016-02-04 16:26:04 -08:00
stack 18eff3c1c3 HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond 2016-02-04 16:09:26 -08:00
stack 337f483077 Revert "HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond"
This reverts commit c177cfed41.
2016-02-04 16:08:41 -08:00
stack c177cfed41 HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond 2016-02-04 14:24:05 -08:00
Enis Soztutar a69272efe1 HBASE-15177 Reduce garbage created under high load 2016-02-04 13:27:00 -08:00
ramkrishna 7b33a740b1 HBASE-15202 Reduce garbage while setting response (Ram) 2016-02-04 23:23:31 +05:30
Elliott Clark f5fba2ba0d HBASE-15211 Don't run the CatalogJanitor if there are regions in transition 2016-02-04 08:52:09 -08:00
ramkrishna 2cf8af5bf1 HBASE-HBASE-15203 Reduce garbage created by path.toString() during
Checksum verification (Ram)
2016-02-04 11:44:46 +05:30
Enis Soztutar 2f5767376f HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li) 2016-02-02 17:10:19 -08:00
Jonathan M Hsieh ecf3efadc0 HBASE-15206 Fix flakey testSplitDaughtersNotInMeta test (Huaxiang Sun) 2016-02-02 16:41:43 -08:00
stack ed46591f30 HBASE-15196 HBASE-15158 Preamble 2 of 2:Add Increment tests 2016-02-02 11:27:03 -08:00
tedyu 243e6cc529 HBASE-15192 TestRegionMergeTransactionOnCluster#testCleanMergeReference is flaky 2016-02-02 09:42:15 -08:00
stack fc5e698c0a HBASE-14969 Add throughput controller for flush; ADDENDUM 2016-02-01 08:08:39 -08:00
stack 2cc48e039d HBASE-15158 HBASE-15158 Preamble 1 of 2: fix findbugs, add javadoc, change Region#getReadpoint to #getReadPoint, and some util 2016-01-31 20:21:48 -08:00
stack 9ec408e25b TestStochasticLoadBalancer.testRegionReplicationOnMidClusterSameHosts flaky on trunk 2016-01-30 07:51:21 -04:00
Yu Li b3b1ce99c6 HBASE-14969 Add throughput controller for flush
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-01-29 09:32:01 +08:00
Matteo Bertozzi 14dd959aa2 HBASE-15142 Procedure v2 - Basic WebUI listing the procedures 2016-01-28 10:13:42 -08:00
Matteo Bertozzi 8a217da8fd HBASE-15019 Replication stuck when HDFS is restarted.
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-01-28 10:09:02 -08:00
tedyu 1ee07688c8 HBASE-15173 Execute mergeRegions RPC call as the request user 2016-01-28 09:53:24 -08:00
tedyu 37ed0f6d08 HBASE-15171 Addendum removes extra loop (Yu Li) 2016-01-28 07:06:10 -08:00
Elliott Clark 138b754671 HBASE-15146 Don't block on Reader threads queueing to a scheduler queue 2016-01-28 07:58:43 -05:00
tedyu 47c4147940 HBASE-15171 Avoid counting duplicate kv and generating lots of small hfiles in PutSortReducer (Yu Li) 2016-01-27 09:42:56 -08:00
Elliott Clark de62ad150d HBASE-14526 Remove delayed rpc 2016-01-26 12:15:01 -08:00
stack d6b3d838eb HBASE-15123 Remove duplicate code in LocalHBaseCluster and minor formatting (Appy) 2016-01-25 13:00:08 -04:00
tedyu a87d9560fc HBASE-15125 HBaseFsck's adoptHdfsOrphan function creates region with wrong end key boundary (chenrongwei) 2016-01-23 12:35:57 -08:00
tedyu 6ed3c759d0 HBASE-15132 Master region merge RPC should authorize user request 2016-01-23 07:48:20 -08:00
tedyu f9e69b51e1 HBASE-15148 Resolve IS2_INCONSISTENT_SYNC findbugs warning in AuthenticationTokenSecretManager (Yu Li) 2016-01-22 02:47:49 -08:00
tedyu b1df2f8c88 HBASE-15133 Data loss after compaction when a row has more than Integer.MAX_VALUE columns (Toshihiro Suzuki) 2016-01-22 02:39:40 -08:00
Jonathan M Hsieh b6f091e0fd HBASE-15152 Automatically include prefix-tree module in MR jobs if present 2016-01-21 18:55:19 -08:00
tedyu 1d2b0d8311 HBASE-15126 HBaseFsck's checkRegionBoundaries function sets incorrect storesFirstKey (chenrongwei) 2016-01-21 07:46:58 -08:00
stack bd9906736e HBASE-15098 Normalizer switch in configuration is not used 2016-01-20 09:32:38 -08:00
ramkrishna 93e200d52b HBASE-15101 Leaked References to StoreFile.Reader after HBASE-13082
(Deepankar)
2016-01-20 11:42:13 +05:30
Ashu Pachauri 318814de28 HBASE-15102 Fix HeapMemoryTuner overtuning memstore
HeapMemoryTuner often over tunes memstore without looking at
the lower limit of the previous memstore size and causing a
situation in which memstore used size suddenly exceeds the
total memstore size.

Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-19 12:24:04 -08:00
Matteo Bertozzi 713c6b5b1e HBASE-15106 Procedure v2 - Procedure Queue pass Procedure for better debuggability 2016-01-19 11:54:24 -08:00
tedyu eb17f74b9e HBASE-15073 Revert due to different opinion on usefulness 2016-01-18 17:51:21 -08:00
stack 9bf26f46d1 HBASE-15118 Fix findbugs complaint in hbase-server 2016-01-18 13:02:17 -08:00
stack 47fc696bc6 HBASE-14962 TestSplitWalDataLoss fails on all branches 2016-01-16 15:53:07 -08:00
Andrew Purtell 387eaff316 Amend HBASE-14512 Cache UGI groups
Handle the case where tests might create a call with a null connection
2016-01-15 19:27:18 -08:00
Andrew Purtell 79588240c6 Amend HBASE-14771 RpcServer#getRemoteAddress always returns null
This change has been reported to cause Phoenix's PhoenixIndexRpcSchedulerTest to fail
with a NPE
2016-01-15 19:27:18 -08:00
Enis Soztutar 2d2fdd5a9f HBASE-15114 NPE when IPC server ByteBuffer reservoir is turned off 2016-01-15 16:42:35 -08:00
stack cb17c7a97a HBASE-15117 Resolve ICAST findbugs warnings in current codes (Yu Li) 2016-01-15 06:00:11 -08:00
tedyu 4ac8d4ce61 HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Appy) 2016-01-14 16:39:52 -08:00
Matteo Bertozzi ae7cc0c848 HBASE-15105 Procedure V2 - Procedure Queue with Namespaces 2016-01-14 13:45:17 -08:00
Matteo Bertozzi 18a48af242 HBASE-14837 Procedure v2 - Procedure Queue Improvement 2016-01-14 09:24:42 -08:00
tedyu c8b9754a5e HBASE-15099 Move RegionStateListener class out of quotas package 2016-01-13 15:15:37 -08:00
ramkrishna 840f5ea686 HBASE-15085 IllegalStateException was thrown when scanning on bulkloaded
HFiles (Victor Xu)
2016-01-12 14:36:48 +05:30
stack 83c506d9d4 HBASE-15087 Fix hbase-common findbugs complaints 2016-01-12 00:30:42 -08:00
chenheng 8ee9158b54 HBASE-15083 Gets from Multiactions are not counted in metrics for gets 2016-01-12 14:18:36 +08:00
anoopsjohn da932ee38d HBASE-15077 Support OffheapKV write in compaction with out copying data on heap. 2016-01-12 10:02:39 +05:30
Matteo Bertozzi ec47a811a2 HBASE-15052 Use EnvironmentEdgeManager in ReplicationSource 2016-01-11 09:37:08 -08:00
ramkrishna 894ce84b83 HBASE-15027 - Findbug fix (addendum) 2016-01-11 16:50:59 +05:30
tedyu 4a26644245 HBASE-15065 Addendum fixes checkstyle warnings 2016-01-08 14:49:30 -08:00
Elliott Clark 52280b64e6 HBASE-14975 Don't color the total RIT line yellow if it's zero (Pallavi Adusumilli)
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-08 14:29:44 -08:00
tedyu 6e781a1f34 HBASE-15065 SimpleRegionNormalizer should return multiple normalization plans in one run 2016-01-08 11:47:34 -08:00
ramkrishna 28c2b18d30 HBASE-15027 Refactor the way the CompactedHFileDischarger threads are
created (Ram)
2016-01-08 11:18:39 +05:30
stack f3ee6df0f2 HBASE-15079 TestMultiParallel.validateLoadedData AssertionError: null 2016-01-07 15:36:49 -08:00
stack 5bde960b95 HBASE-15076 Add getScanner(Scan scan, List<KeyValueScanner> additionalScanners) API into Region interface (Anoop Sam John) 2016-01-07 13:45:01 -08:00
tedyu 5266b07708 HBASE-15068 Add metrics for region normalization plans 2016-01-07 03:13:16 -08:00
tedyu d65978fceb HBASE-15073 Finer grained control over normalization actions for RegionNormalizer 2016-01-06 17:25:41 -08:00
anoopsjohn a9b671b31f HBASE-12593 Tags to work with ByteBuffer. 2016-01-06 21:28:06 +05:30
Enis Soztutar 893a54c3a4 HBASE-15066 Small improvements to Canary tool 2016-01-06 02:47:19 -08:00
ramkrishna 073e00c005 HBASE-14221 Reduce the number of time row comparison is done in a Scan
(Ram)
2016-01-06 10:38:27 +05:30
Lars Hofhansl e8fbc9b43a HBASE-14468 addendum. 2016-01-05 15:54:34 -08:00
stack 46303dfd75 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-05 14:35:27 -08:00
tedyu 00656688f7 HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled 2016-01-04 07:10:10 -08:00
Gary Helmling 9589a7d8be HBASE-15038 ExportSnapshot should support separate configs for source and destination 2016-01-04 00:10:19 -08:00
stack a82f7fc94a Revert "HBASE-14888 ClusterSchema: Add Namespace Operations"
This reverts commit c5f3d17ae3.
2016-01-03 07:15:18 -08:00
stack c5f3d17ae3 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-02 16:16:56 -08:00
Jonathan M Hsieh 92abf8ac57 HBASE-15060 Cull TestHFileV2 and HFileWriterFactory 2015-12-30 13:21:54 -08:00
tedyu c1b6d47e79 HBASE-15044 Region normalization should be allowed when underlying namespace has quota 2015-12-30 08:04:23 -08:00
ramkrishna 07b6236706 HBASE-15050 Block Ref counting does not work in Region Split cases (Ram) 2015-12-30 14:39:03 +05:30
Ashish Singhi 413d663f92 HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-29 20:25:47 -06:00
tedyu 1e4992c6ec HBASE-14867 SimpleRegionNormalizer needs to have better heuristics to trigger merge operation 2015-12-29 06:21:57 -08:00
stack 2fba25b66a HBASE-15023 Reenable TestShell and TestStochasticLoadBalancer 2015-12-28 13:27:17 -08:00
tedyu 449fb81286 HBASE-14030 Revert due to pending review comments 2015-12-28 01:08:02 -08:00
tedyu de69f0df34 HBASE-14030 HBase Backup/Restore Phase 1 (Vladimir Rodionov) 2015-12-27 10:02:09 -08:00
tedyu 1c7e9ec124 HBASE-15039 HMaster and RegionServers should try to refresh token keys from zk when facing InvalidToken (Yong Zhang) 2015-12-25 10:32:51 -08:00
Jonathan M Hsieh 3de0b0417c HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags 2015-12-25 09:51:34 -08:00
Lars Hofhansl dfada43e90 HBASE-14822; addendum - handle callSeq. 2015-12-24 12:55:39 -08:00
tedyu a1a19d9405 HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish) 2015-12-24 11:07:49 -08:00
Matteo Bertozzi 8e0854c64b HBASE-15030 Deadlock in master TableNamespaceManager while running IntegrationTestDDLMasterFailover 2015-12-23 09:46:18 -08:00
tedyu 2439f7a688 HBASE-15028 Minor fix on RegionGroupingProvider (Yu Li) 2015-12-22 06:47:33 -08:00
Elliott Clark 6e2c5d216e HBASE-15014 Fix filterCellByStore in WALsplitter is awful for performance 2015-12-21 22:50:38 -08:00
chenheng f018c371b5 HBASE-14654 Reenable TestMultiParallel#testActiveThreadsCount 2015-12-22 11:33:25 +08:00
Pallavi Adusumilli f56abf730f HBASE-14976 fix tests
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2015-12-21 11:35:59 -08:00
Mikhail Antonov 8c921ea94f HBASE-14976 Add RPC call queues to the web ui (Pallavi Adusumilli) 2015-12-19 12:44:30 -08:00
Lars Hofhansl 86a417eead HBASE-14822 Renewing leases of scanners doesn't work. 2015-12-19 09:55:03 -08:00
Ashu Pachauri 48113d7572 HBASE-15001 Fix thread-safety issues with replication
ReplicationSinkManager and HBaseInterClusterReplicationEndpoint
perform certain unsafe operations which might lead to undesirable
behavior with multiwal enabled.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-18 11:48:55 -08:00
Sean Busbey ba04e0372d HBASE-15003 remove BoundedConcurrentLinkedQueue.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-12-18 12:26:38 -06:00
Elliott Clark 4bfeccb87a HBASE-15005 Use value array in computing block length for 1.2 and 1.3 2015-12-18 00:23:02 -08:00
anoopsjohn 408666a06d HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also. 2015-12-18 09:50:53 +05:30
chenheng 27160950ca HBASE-14990 Tests in BaseTestHBaseFsck are run by its subclasses redundantly 2015-12-18 11:37:58 +08:00
Elliott Clark 217036d816 HBASE-14978 Don't allow Multi to retain too many blocks 2015-12-17 16:13:50 -08:00
anoopsjohn 80fc18d2e1 HBASE-15000 Fix javadoc warn in LoadIncrementalHFiles. (Ashish) 2015-12-17 22:47:48 +05:30
anoopsjohn cf458d3023 HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 18:01:16 +05:30
tedyu d78eddfdc8 HBASE-14995 Revert according to Ram's feedback 2015-12-16 21:54:48 -08:00
tedyu 546ac1cbb3 HBASE-14995 Optimize setting tagsPresent in DefaultMemStore.java (huaxiang sun) 2015-12-16 18:16:38 -08:00
Enis Soztutar 3dec8582f5 HBASE-14951 Make hbase.regionserver.maxlogs obsolete 2015-12-16 14:57:59 -08:00
Mikhail Antonov e965b614b3 HBASE-14974 Total number of Regions in Transition number on UI incorrect 2015-12-16 14:10:32 -08:00
Josh Elser ca7a82fb57 HBASE-14838 Add clarification docs to SimpleRegionNormalizer.
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-12-16 08:58:48 -06:00
Mikhail Antonov abe30b52a8 HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version 2015-12-15 12:11:27 -08:00
Enis Soztutar 3e26063161 HBASE-14968 ConcurrentModificationException in region close resulting in the region staying in closing state 2015-12-15 11:49:34 -08:00
ramkrishna 1822bb5d95 HBASE-14895 Seek only to the newly flushed file on scanner reset on flush
- Addendum (Ram)
2015-12-15 10:34:25 +05:30
Jonathan M Hsieh 10d86c7dae HBASE-14929 There is a space missing from table "foo" is not currently available (Carlos A. Morillo) 2015-12-14 16:07:05 -08:00
chenheng 04622254f7 HBASE-14936 CombinedBlockCache should overwrite CacheStats#rollMetricsPeriod() (Jianwei Cui) 2015-12-14 17:20:50 +08:00
ramkrishna 555d9b70bd HBASE-14895 Seek only to the newly flushed file on scanner reset on flush
(Ram)
2015-12-14 10:13:53 +05:30
stack f34d3e1d26 HBASE-14701 Fix flakey Failed tests: TestMobFlushSnapshotFromClient>TestFlushSnapshotFromClient.testSkipFlushTableSnapshot:199 null (Jingcheng Du) 2015-12-12 19:34:23 -08:00
Ashu Pachauri 453a66c3b9 HBASE-14953 Replication: retry on RejectedExecutionException
In HBaseInterClusterReplicationEndpoint, we fail the whole batch
in case of a RejectedExecutionException on an individual sub-batch.
We should let the submitted sub-batches finish and retry only for
the remaining ones.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-11 13:15:22 -08:00
Enis Soztutar cff664c5e2 HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded 2015-12-10 19:11:57 -08:00
Elliott Clark 48e217a7db HBASE-14946 Don't allow multi's to over run the max result size.
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens

Test Plan: Added a unit test

Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:10:32 -08:00
stack c15e0af84a HBASE-14906 Improvements on FlushLargeStoresPolicy (Yu Li) 2015-12-10 16:49:23 -08:00
stack bebcc09fb3 HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin 2015-12-10 15:02:21 -08:00
Nate Edel 9511150bd6 HBASE-14901 Remove duplicate code to create/manage encryption keys
Signed-off-by: Gary Helmling <garyh@apache.org>
2015-12-10 14:38:43 -08:00
ramkrishna 26ac60b03f HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:07:46 +05:30
Gary Helmling c1e0fcc26d HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 15:52:27 -08:00
Elliott Clark ba3aa9a9b1 HBASE-14942 Allow turning off BoundedByteBufferPool 2015-12-09 15:29:25 -08:00
tedyu 0e147a9d6e HBASE-14954 IllegalArgumentException was thrown when doing online configuration change in CompactSplitThread (Victor Xu) 2015-12-09 07:18:08 -08:00
Lars Hofhansl 7bfbb6a3c9 HBASE-14869 Better request latency and size histograms. (Vikas Vishwakarma and Lars Hofhansl) 2015-12-08 17:02:27 -08:00
Mikhail Antonov 2430efc2b2 HBASE-7171 Initial web UI for region/memstore/storefiles details 2015-12-08 13:53:21 -08:00
Vrishal Kulkarni 1f999c1e2b HBASE-14719 Add metrics for master WAL count (numMasterWALs). Metric numMasterWALs appears as follows in metrics dump
{
    "name" : "Hadoop:service=HBase,name=Master,sub=Procedure",
    "modelerType" : "Master,sub=Procedure",
    "tag.Context" : "master",
    "tag.Hostname" : "vrishal-mbp",
    "numMasterWALs" : 1
},

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-07 11:14:29 -08:00
Andrew Purtell c9a0148628 HBASE-14923 VerifyReplication should not mask the exception during result comparison (Vishal Khandelwal) 2015-12-04 18:53:05 -08:00
Elliott Clark cd5ddc5fec HBASE-14922 Delayed flush doesn't work causing flush storms. 2015-12-04 16:54:01 -08:00
stack c6b8e6f1ac HBASE-14907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)
Put back HBASE-14907 but with right JIRA number (by doing a revert of a revert)

This reverts commit 35a7b56e53.
2015-12-04 16:40:27 -08:00
stack a4a44587b3 Revert "Revert "HBASE-14909 NPE testing for RIT""
Reverted the wrong patch... putting it back (revert of a revert)

This reverts commit 157a60f1b3.
2015-12-04 16:38:33 -08:00
stack 157a60f1b3 Revert "HBASE-14909 NPE testing for RIT"
This reverts commit da0cc598fe.
2015-12-04 16:37:14 -08:00
stack 35a7b56e53 Revert "HBASE-4907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)"
Revert because I pitched this against the wrong JIRA number!

This reverts commit 03e4712f0c.
2015-12-04 16:36:46 -08:00
stack 03e4712f0c HBASE-4907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du) 2015-12-04 10:53:09 -08:00
ramkrishna 8b3d1f1444 HBASE-13082 Coarsen StoreScanner locks to RegionScanner (Ram) 2015-12-04 10:20:46 +05:30
Enis Soztutar b3260423b1 HBASE-14904 Mark Base[En|De]coder LimitedPrivate and fix binary compat issue 2015-12-03 18:18:20 -08:00
stack 51503efcf0 HBASE-13857 Slow WAL Append count in ServerMetricsTmpl.jamon is hardcoded to zero (Vrishal Kulkarni) 2015-12-03 17:00:29 -08:00
tedyu 67ba6598b1 HBASE-14905 VerifyReplication does not honour versions option (Vishal Khandelwal) 2015-12-03 16:09:22 -08:00
Enis Soztutar bbd53b846e Revert "HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts"
This reverts commit 756e6de2a0.
2015-12-03 13:28:33 -08:00
stack 91945d7f49 HBASE-14749 Make changes to region_mover.rb to use RegionMover Java tool (Abhishek Singh Chouhan) 2015-12-02 18:14:10 -08:00
stack da0cc598fe HBASE-14909 NPE testing for RIT 2015-12-02 10:37:32 -08:00
stack 08f90f30b3 HBASE-14908 TestRowCounter flakey especially on branch-1 2015-12-02 10:19:13 -08:00
ramkrishna aa41232a87 HBASE-14832 Ensure write paths work with ByteBufferedCells in case of
compaction (Ram)
2015-12-02 10:28:30 +05:30
tedyu d8b30b8925 HBASE-14575 Relax region read lock for compactions (Nick and Ted) 2015-12-01 16:44:59 -08:00
stack 92e178df28 Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).

This reverts commit 6adce67572.
2015-12-01 11:30:39 -08:00
stack a7673ed755 HBASE-14896 Resolve Javadoc warnings in WALKey and RegionMover 2015-12-01 09:35:15 -08:00
Apekshit(Appy) Sharma 6adce67572 HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
chenheng 47082579a8 HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey 2015-12-01 10:31:00 +08:00
Enis Soztutar 756e6de2a0 HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts 2015-11-30 16:48:52 -08:00
chenheng 999ae69155 HBASE-14891 Add log for uncaught exception in RegionServerMetricsWrapperRunnable(Yu Li) 2015-11-30 22:30:09 +08:00
Apekshit 3bac31b2a4 HBASE-14890 Fix broken checkstyle tool. Some javadocs had parsing errors because of wrongly formatted HTML tags. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-28 21:57:52 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
tedyu 001eb0694a HBASE-14893 Race between mutation on region and region closing operation leads to NotServingRegionException 2015-11-27 15:32:05 -08:00
chenheng b280a41ba6 HBASE-14884 TestSplitTransactionOnCluster.testSSHCleanupDaugtherRegionsOfAbortedSplit is flakey 2015-11-27 11:24:15 +08:00
rahulgidwani 0d72849581 HBASE-14355 Scan different TimeRange for each column family - fixing memstore bug
Signed-off-by: stack <stack@apache.org>
2015-11-25 22:01:32 -08:00
Lars Hofhansl 6531b465a7 HBASE-14777 second addendum, better fix using CompletionService. 2015-11-25 21:17:56 -08:00
tedyu e73a9594c2 HBASE-14885 NullPointerException in HMaster#normalizeRegions() due to missing TableDescriptor 2015-11-25 16:06:27 -08:00
Enis Soztutar 90bdb0dc74 HBASE-14689 Addendum and unit test for HBASE-13471 2015-11-24 19:15:09 -08:00
tedyu 1178c4b89b HBASE-14861 HBASE_ZNODE_FILE on master server is overwritten by regionserver process in case of master-rs collocation (Samir Ahmic) 2015-11-24 15:02:47 -08:00
Daniel Vimont 6a493ddff7 Commit for HBASE-14825 -- corrections of typos, misspellings, and mangled links
Commit for HBASE-14825 -- corrections of typos, misspellings, and mangled links - addition commit for line lengths
2015-11-25 07:12:36 +10:00
Gary Helmling 8b67df6948 HBASE-14821 Allow configuration overrides in TableOutputFormat 2015-11-24 12:13:51 -08:00
ramkrishna afc5439be5 HBASE-14826 Small improvement in KVHeap seek() API (Ram) 2015-11-24 10:17:28 +05:30
anoopsjohn daba867734 HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek) 2015-11-24 09:50:56 +05:30
tedyu 9a91f5ac81 HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar) 2015-11-23 20:13:00 -08:00
stack 52edd83baf HBASE-14807 TestWALLockup is flakey Second attempt at stabilizing this test.
Patch includes loosening of the test so we continue when threads
run in not-expected order. Also includes minor clean ups in
FSHLog -- a formatting change, removal of an unused trace logging,
and a check so we don't create a new exception when not needed --
but it also includes a subtle so we check if we need to get to safe
point EVEN IF an outstanding exception. Previous we could by-pass
the safe point check. This should make us even more robust against
lockup (though this is a change that comes of code reading, not of
any issue seen in test).

Here is some detail on how I loosened the test:

The test can run in an unexpected order. Attempts at dictating the
order in which threads fire only had me deadlocking one latch
against another (the test latch vs the WAL zigzag latch) so I
gave up trying and instead, if we happen to go the unusual route of
rolling WALs and failing flush before the scheduled log roll
latch goes into place, just time out the run after a few seconds
and exit the test (but do not fail it); just log a WARN.

This is less than ideal but allows us keep some coverage of the
tricky scenario that was bringing on deadlock (a broken WAL that
is throwing exceptions getting stuck waiting on a sync to clear
out the ring buffer getting overshadowed by a subsequent append
added in by a concurrent flush).
2015-11-20 12:06:48 -08:00
ramkrishna 86be690b07 HBASE-14840 Sink cluster reports data replication request as success
though the data is not replicated (Ashish Singhi)
2015-11-20 15:57:10 +05:30
Ashu Pachauri 8dbbe96e04 HBASE-14777 ADDENDUM Fix failing TestReplicationEndpoint test
Signed-off-by: stack <stack@apache.org>
2015-11-20 00:10:03 -06:00
Sean Busbey 3a1874f5c4 Revert "Fix failing TestReplicationEndpoint test"
This reverts commit f0dc556b71.
2015-11-20 00:09:46 -06:00
Ashu Pachauri f0dc556b71 Fix failing TestReplicationEndpoint test
Signed-off-by: stack <stack@apache.org>
2015-11-19 13:26:13 -08:00
ramkrishna c92737c0e9 HBASE-14761 Deletes with and without visibility expression do not delete
the matching mutation (Ram)
2015-11-19 11:21:50 +05:30
Enis Soztutar cf81b45f37 HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov) 2015-11-18 19:33:11 -08:00
chenheng ebe5801e00 HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov) 2015-11-19 11:28:18 +08:00
Ashu Pachauri c8fbaf0c96 HBASE-14777 Fix Inter Cluster Replication Future ordering issues
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-11-18 16:38:41 -08:00
tedyu d738aade2e HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo) 2015-11-18 14:24:47 -08:00
stack b2187c31ab HBASE-14815 TestMobExportSnapshot.testExportFailure timeout occasionally (Heng Chen) 2015-11-18 09:05:50 -08:00
Enis Soztutar 5ebd7660a9 Revert "HBASE-14689 Addendum and unit test for HBASE-13471"
This reverts commit 4c04e8065f.
2015-11-17 20:36:18 -08:00
tedyu 1b13bfcd43 HBASE-14771 RpcServer#getRemoteAddress always returns null (Abhishek Kumar) 2015-11-17 18:46:08 -08:00
Elliott Clark a48d30984a HBASE-14793 Allow limiting size of block into L1 block cache. 2015-11-17 10:37:49 -08:00
tedyu f218e499ae HBASE-14809 Grant / revoke Namespace admin permission to group 2015-11-16 09:27:32 -08:00
stack dd5f454b03 HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers; Reapply of slightly different patch... see issue 2015-11-15 14:47:07 -08:00
stack bb6581345f Revert "HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers"
This reverts commit 7c3c9ac9c6.
2015-11-14 16:59:35 -08:00
stack 43506320a1 HBASE-14798 NPE reporting server load causes regionserver abort; causes TestAcidGuarantee to fail 2015-11-14 09:07:39 -08:00
stack 1fa7b71cf8 HBASE-14807 TestWALLockup is flakey 2015-11-13 22:40:27 -08:00
stack 7c3c9ac9c6 HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers 2015-11-13 22:06:23 -08:00
stack 290ecbe829 HBASE-14355 Scan different TimeRange for each column family (Churro Morales) 2015-11-12 10:54:16 -10:00
Jerry He 1f62a48728 HBASE-13982 Add info for visibility labels/cell TTLs to ImportTsv (NIDHI GAMBHIR) 2015-11-10 22:10:13 -08:00
tedyu ffb1e78c08 HBASE-14788 Splitting a region does not support the hbase.rs.evictblocksonclose config when closing source region 2015-11-10 18:35:00 -08:00
stack e82ccb900e HBASE-14794 Cleanup TestAtomicOperation
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java
  Fix a few missing table closes (This suite seems to leave loads of threads
  when test is done but have not figured the how yet).

hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
  Fix some missing table closes. We were leaving around client
  resources.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
  Close up WALs when done.
2015-11-10 15:08:18 -10:00
tedyu 867a5ea188 HBASE-14766 In WALEntryFilter, cell.getFamily() needs to be replaced with the new low-cost implementation (huaxiang sun) 2015-11-10 14:18:59 -08:00
Matteo Bertozzi 24580ace5e HBASE-14786 TestProcedureAdmin hangs 2015-11-10 13:15:25 -08:00
Elliott Clark ea795213b2 HBASE-14778 Make block cache hit percentages not integer in the metrics system 2015-11-10 12:25:59 -08:00
stack 1a6ec1bac6 HBASE-14784 Port conflict is not resolved in HBaseTestingUtility.randomFreePort() (Youngjoon Kim) 2015-11-10 09:53:30 -10:00
Enis Soztutar 23ec9e290e HBASE-14387 Compaction improvements: Maximum off-peak compaction size (Vladimir Rodionov) 2015-11-10 11:26:52 -08:00
stack 32de06f663 HBASE-14787 Remove obsolete ConnectionImplementation.refCount (Appy) 2015-11-09 17:08:17 -10:00
chenheng 086bacd12d HBASE-14693 Add client-side metrics for received pushback signals
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-09 18:03:30 -08:00
tedyu 6b9d30d913 HBASE-14784 Port conflict is not resolved in HBaseTestingUtility.randomFreePort() (Youngjoon Kim) 2015-11-08 08:50:41 -08:00
Apekshit(Appy) Sharma 08963189a2 HBASE-14767 - Remove deprecated functions from HBaseAdmin Deprecated in HBASE-12083 (1.0.0, 2.0.0, 0.99.2) - HBaseAdmin(Configuration)
Deprecated in HBASE-10479 (0.99.0, hbase-10070)
  - HBaseAdmin(Connection)

  Deprecated in HBASE-11826 (0.99.0, 1.0.0, 2.0.0)
  - flush()
  - compact()
  - majorCompact()
  - split()
  - getCompactionState()

- Changes many declarations from HBaseAdmin to Admin
(Apekshit)

Signed-off-by: stack <stack@apache.org>
2015-11-06 16:23:55 -10:00
zhangduo 9cce912de0 HBASE-14759 Avoid using Math.abs when selecting SyncRunner in FSHLog 2015-11-07 08:44:25 +08:00
tedyu 263a0adf79 HBASE-14463 Severe performance downgrade when parallel reading a single key from BucketCache (Yu Li) 2015-11-06 13:12:10 -08:00
tedyu 6ec4a96814 HBASE-14632 Region server aborts due to unguarded dereference of Reader 2015-11-06 12:06:19 -08:00