a912a56b38
HBASE-12590 A solution for data skew in HBase-Mapreduce jobs (Weichen Ye)
2014-12-24 04:50:42 -08:00
9a829dc458
HBASE-12735 Refactor TestAcidGuarantees so it can live as unit test and as an integration test
2014-12-23 17:18:58 -08:00
4880e5d83b
HBASE-12736
...
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:30:25 -08:00
e92a9bf003
HBASE-12742
...
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:14:16 -08:00
1c45d1cd9d
HBASE-12012. Improve cancellation for the scan RPCs
2014-12-22 16:22:04 -08:00
4d53fe5dcd
HBASE-12734 TestPerColumnFamilyFlush.testCompareStoreFileCount is flakey (zhangduo)
2014-12-22 08:56:33 -08:00
fbf8b30aa6
HBASE-12741 AccessController contains a javadoc issue (Jurriaan Mous)
2014-12-22 08:32:37 -08:00
51334fb951
HBASE-10201 Addendum fixes typo of putIfAbsent (Duo Zhang)
2014-12-21 07:22:41 -08:00
e267db45ac
HBASE-12703 Cleanup TestClientPushback for repeatability
2014-12-19 19:16:43 -08:00
feede7abd8
HBASE-12732 Log messages in FileLink#tryOpen are reversed (Tobi Vollebregt)
2014-12-19 17:47:11 -08:00
40fb2e9219
HBASE-12720 Make InternalScan LimitedPrivate (Vladimir Rodionov)
2014-12-19 13:57:51 -08:00
d3002c6a8e
HBASE-12511 namespace permissions - add support from table creation privilege in a namespace 'C' (Huaiyu Zhu)
2014-12-19 13:04:39 -08:00
9a7adafcdb
HBASE-12724 Upgrade the interface audience of RegionScanner from Private to LimitedPrivate
2014-12-19 09:37:03 -08:00
dceaa2589f
Revert "HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)"
...
This reverts commit b24991d7a0
2014-12-19 08:39:52 -08:00
f1c41e307e
HBASE-5699 Adds multiple WALs per Region Server based on groups of regions.
2014-12-19 10:31:41 -06:00
0c7d22439d
Fix single javadoc warning in VisibilityController -- removed a '@return'
2014-12-19 08:22:00 -08:00
cfd7584eef
HBASE-12715 getLastSequenceId always returns -1 (Duo Zhang)
2014-12-19 06:58:16 -08:00
33c27f4e03
HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test
2014-12-18 17:21:23 -08:00
b24991d7a0
HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)
2014-12-18 17:00:07 -08:00
3caae62390
Revert "HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)"
...
This reverts commit 9ae615f82b
2014-12-18 11:29:39 -08:00
9ae615f82b
HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)
2014-12-18 11:24:26 -08:00
15cf0a6e7b
HBASE-12223 MultiTableInputFormatBase.getSplits is too slow (Yuanbo Peng)
2014-12-18 05:09:01 -08:00
00f4ff420e
HBASE-12683 Compilation with hadoop-2.7.0-SNAPSHOT is broken - ADDENDUM
2014-12-17 19:41:56 -08:00
072b2d659c
HBASE-12640 Add Thrift-over-HTTPS and doAs support for Thrift Server
2014-12-17 16:12:48 -08:00
d918570c80
Revert "Thrift Http implementation"
...
This reverts commit 1cf8521191
2014-12-17 16:11:30 -08:00
1cf8521191
Thrift Http implementation
2014-12-17 16:06:19 -08:00
6aa8b3727c
HBASE-5162 Addendum to stabilize TestClientPushback
2014-12-17 12:37:40 -08:00
422df8a3f4
HBASE-12645 HBaseTestingUtility is using ${$HOME} for rootDir (Varun Saxena) -- ADDENDUM
2014-12-17 10:53:50 -08:00
99a11390b4
Amend HBASE-5162 Basic client pushback mechanism (Jesse Yates)
...
Applied hbase-5162-trunk-addendum.patch
2014-12-16 22:15:49 -08:00
6a042c381a
Revert "HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM"
...
This reverts commit f7154e1ac9
2014-12-16 22:14:50 -08:00
f7154e1ac9
HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM
2014-12-16 21:09:52 -08:00
89006f76f7
HBASE-12645 HBaseTestingUtility is using ${$HOME} for rootDir (Varun Saxena)
2014-12-16 16:41:27 -08:00
885b065683
HBASE-10201 Addendum changes TestPerColumnFamilyFlush to LargeTest
2014-12-16 16:02:44 -08:00
c7fad665f3
HBASE-10201 Port 'Make flush decisions per column family' to trunk
...
Signed-off-by: stack <stack@apache.org>
2014-12-16 11:49:17 -08:00
a411227b0e
HBASE-5162 Basic client pushback mechanism
...
Instead of just blocking the client for 90 seconds when the region gets too
busy, it now sends along region load stats to the client so the client can
know how busy the server is. Currently, its just the load on the memstore, but
it can be extended for other stats (e.g. cpu, general memory, etc.).
It is then up to the client to decide if it wants to listen to these stats.
By default, the client ignores the stats, but it can easily be toggled to the
built-in exponential back-off or users can plug in their own back-off
implementations
2014-12-16 11:14:30 -08:00
e5d813c46b
HBASE-9431 Set 'hbase.bulkload.retries.number' to 10 as HBASE-8450 claims
2014-12-16 11:11:14 -08:00
96c6b9815d
HBASE-12696 Possible NPE in HRegionFileSystem#splitStoreFile when skipStoreFileRangeCheck in splitPolicy return true(Rajeshbabu)
2014-12-16 08:38:15 +05:30
110c5f5930
HBASE-12348 preModifyColumn and preDeleteColumn in AC denies user to perform its operation though it has required rights
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-12-15 17:43:19 -08:00
065d03b784
HBASE-12685 TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition
2014-12-15 11:49:39 -08:00
3a652ba41c
HBASE-12692 NPE from SnapshotManager#stop (Ashish Singhi)
2014-12-15 11:17:59 -08:00
afb753ecc3
HBASE-12683 Compilation with hadoop-2.7.0-SNAPSHOT is broken
2014-12-15 11:09:20 -08:00
db873f0886
HBASE-12677 Update replication docs to clarify terminology
2014-12-15 15:44:26 +10:00
029768287a
HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test
2014-12-14 19:42:15 -08:00
743d16138e
HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate
2014-12-14 17:46:30 -08:00
65830b096b
HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu)
2014-12-13 10:17:43 -08:00
b24518562a
HBASE-12644 Visibility Labels: issue with storing super users in labels table (Jerry He)
2014-12-13 09:10:50 -08:00
a0e473730e
HBASE-12678 HBCK should print command line arguments
2014-12-12 13:17:06 -08:00
3275b964c1
HBASE-12668 Adapt PayloadCarryingRpcController so it can also be used in an async way
...
Signed-off-by: stack <stack@apache.org>
2014-12-12 07:44:04 -08:00
da2b5a9627
HBASE-12373 Provide a command to list visibility labels (Jerry He)
2014-12-11 15:18:03 -08:00
7030d2187d
HBASE-12674 Add permission check to getNamespaceDescriptor()
2014-12-11 17:43:51 +00:00
f67162547d
HBASE-12485 Maintain SeqId monotonically increasing
2014-12-10 17:30:00 -08:00
8ab96c40d8
HBASE-12663 unify getTableDescriptors() and listTableDescriptors
2014-12-10 15:15:53 +00:00
df22270756
HBASE-12665 When aborting, dump metrics
...
Add some fixup of checkstyle fails
2014-12-09 21:01:15 -08:00
9b808155e3
HBASE-12553 request value is not consistent for restoreSnapshot in audit logs (Ashish)
2014-12-09 20:40:18 -08:00
011442edda
HBASE-12454 Setting didPerformCompaction early in HRegion#compact
2014-12-09 17:06:04 -08:00
cc8bdcb498
HBASE-12467 Master joins cluster but never completes initialization
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-12-09 16:32:11 -08:00
1be63539f1
HBASE-12664 TestDefaultLoadBalancer.testBalanceCluster fails in CachedDNSToSwitchMapping -- ADDENDUM
2014-12-09 13:52:46 -08:00
5537fce353
HBASE-11979 Compaction progress reporting is wrong (Esteban Gutierrez)
2014-12-09 12:46:35 -08:00
e720c83557
HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis)
2014-12-09 11:27:34 -08:00
f9df6a2766
HBASE-12664 TestDefaultLoadBalancer.testBalanceCluster fails in CachedDNSToSwitchMapping
2014-12-09 11:06:23 -08:00
53493ff5db
HBASE-12583 Allow creating reference files even the split row not lies in the storefile range if required - Addendum(Rajeshbabu)
2014-12-09 23:36:28 +05:30
33d79bb5ec
HBASE-12655 WALPerformanceEvaluation should only add stat gathering listener once per WAL.
2014-12-09 09:52:12 -06:00
c42c36521d
HBASE-12653 Move TestRegionServerOnlineConfigChange & TestConfigurationManager to Junit4 tests (Ashish)
2014-12-09 07:25:44 -08:00
0354128780
HBASE-12583 Allow creating reference files even the split row not lies in the storefile range if required(Rajeshbabu)
2014-12-09 18:59:13 +05:30
8a2c84156a
HBASE-12564 consolidate the getTableDescriptors() semantic
2014-12-09 12:06:00 +00:00
b4371252fe
HBASE-12575 Sanity check table coprocessor classes are loadable
2014-12-08 18:18:22 -08:00
a8e6461855
HBASE-12597
...
Signed-off-by: stack <stack@apache.org>
2014-12-08 15:40:09 -08:00
b8ab1b176c
Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
...
Accidental commit. Reverting.
This reverts commit 2458be08ed
2014-12-08 15:34:53 -08:00
2458be08ed
HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG
2014-12-08 15:04:59 -08:00
4b1983c89d
HBASE-12611 Create autoCommit() method and remove clearBufferOnFail (Solomon Duskis)
2014-12-08 11:01:28 -08:00
da0e807dd3
HBASE-12574 Update replication metrics to not do so many map look ups.
2014-12-08 10:35:57 -08:00
9e9be97af7
HBASE-12650 Move ServerName to hbase-common module - check in changed files
2014-12-08 07:08:44 -08:00
87e4414004
HBASE-12647 Truncate table should work with C as well
2014-12-07 20:57:04 -08:00
9fd6db3703
HBASE-11903. Directly invoking split & merge of replica regions should be disallowed
2014-12-07 11:56:53 -08:00
bb15fd5fe0
HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
...
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 21:46:43 -08:00
ca0c1774c9
HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas
2014-12-06 18:18:03 -08:00
415ad6b686
HBASE-12642 LoadIncrementalHFiles does not throw exception after hitting hbase.bulkload.retries.number setting
2014-12-05 18:39:58 -08:00
1ec6609b97
HBASE-12493 Make User and TokenUtil public
2014-12-05 13:04:54 -08:00
09cd3d7bfb
HBASE-10560 Per cell TTLs
2014-12-05 11:10:26 -08:00
f83e25e180
HBASE-12565 Race condition in HRegion.batchMutate() causes partial data to be written when region closes
...
Signed-off-by: stack <stack@apache.org>
2014-12-05 10:17:34 -08:00
c8362a7bb2
HBASE-12622 user_permission should require global admin to display global and ns permissions
2014-12-05 10:45:30 +00:00
08754f2c43
HBASE-12637 Compilation with Hadoop-2.4- is broken
2014-12-04 18:14:59 -08:00
e690a83d41
HBASE-12635 Delete acl notify znode of table after the table is deleted (Liu Shaohui)
2014-12-04 16:43:33 -08:00
04444299ab
HBASE-12634 Fix the AccessController#requireGlobalPermission(ns) with NS
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-12-04 14:12:26 +00:00
52e35b4473
Add timeout on TestDefaultLoadBalancer#testBalancerCluster to see if we can stop it hanging as a zombie in precommit builds
2014-12-03 11:13:36 -08:00
c5c395b68a
HBASE-12623 removes unused code to upgrade from pre-0.96 to 0.96.
...
Removes both insertion of namespaces and migration of zookeeper data to protobufs.
2014-12-03 13:13:12 -06:00
d6b1d8cbf7
HBASE-12617 Running IntegrationTestBigLinkedList against cluster getting not an instance of org.apache.hadoop.hbase.MiniHBaseCluster
2014-12-03 10:37:32 -08:00
3db5e20834
HBASE-11639 - [Visibility controller] Replicate the visibility of Cells as
...
strings- Addendum adding break (Ram)
2014-12-03 10:18:27 +05:30
a8a134374e
HBASE-12614 Potentially unclosed StoreFile(s) in DefaultCompactor#compact()
2014-12-02 19:31:21 -08:00
54f438cee4
HBASE-12616 We lost the linked list commands in recent usage refactoring
2014-12-02 14:15:04 -08:00
7a3396f0e1
HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis)
2014-12-02 10:06:21 -08:00
1a9b556474
Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
...
This reverts commit 8b8f2026bd
2014-12-02 09:51:19 -08:00
29ee0cb0e1
HBASE-12576 Add metrics for rolling the HLog if there are too few DN's in the write pipeline
2014-12-02 09:30:52 -08:00
7b10847ec8
HBASE-12610 Close connection in TableInputFormatBase (Solomon Duskis)
2014-12-02 09:28:02 -08:00
5cc0714840
HBASE-12559 Addendum fixes findbugs warnings
2014-12-02 04:43:34 -08:00
94d57f81dc
HBASE-12537 HBase should log the remote host on replication error (Stack)
2014-12-01 20:10:20 -08:00
a30cca91e0
HBASE-12559 Provide LoadBalancer with online configuration capability
2014-12-01 14:11:01 -08:00
2c280e6253
HBASE-12600: Remove REPLAY tag dependency in Distributed Replay Mode
2014-12-01 11:19:47 -08:00
0733450473
Revert "Remove Replay Tag"
...
This reverts commit f723ffde7f
2014-12-01 11:17:24 -08:00
f723ffde7f
Remove Replay Tag
2014-12-01 10:59:47 -08:00
2fbbdfd9a1
HBASE-12559 Revert for addressing review comments
2014-12-01 10:38:05 -08:00
308db3a5c8
HBASE-12520 Add protected getters on TableInputFormatBase (Solomon Duskis)
2014-12-01 10:20:37 -08:00
69a437ac0d
HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
...
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:15:51 -08:00
56a03d736a
HBASE-12603 Remove javadoc warnings introduced due to removal of unused imports (Varun Saxena)
2014-12-01 10:13:16 -08:00
b6b88edf93
HBASE-11639 [Visibility controller] Replicate the visibility of Cells as
...
strings (Ram)
2014-12-01 23:03:52 +05:30
41041e8d6a
HBASE-12559 Provide LoadBalancer with online configuration capability
2014-12-01 07:30:17 -08:00
b94b0e9ca7
HBASE-12491 TableMapReduceUtil.findContainingJar() NPE
2014-11-29 09:34:00 -08:00
555e78005d
HBASE-12526 Remove unused imports (Varun Saxena)
2014-11-29 09:20:46 -08:00
58b6b24c29
HBASE-12519 Remove tabs used as whitespace (Varun Saxena)
2014-11-28 20:50:02 -08:00
eb4c194a87
HBASE-10536 ImportTsv should fail fast if any of the column family passed to the job is not present in the table (denny joesph)
2014-11-28 20:42:24 -08:00
0f8894cd64
HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) -- SLEEP ADDENDUM
2014-11-27 05:28:55 -08:00
aa0bd50fd4
HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- DISABLING FAILING TEST
2014-11-26 22:22:35 -08:00
f0d95e7f11
HBASE-12533: staging directories are not deleted after secure bulk load
2014-11-26 16:23:11 -08:00
b2cdeacc8c
HBASE-12053: SecurityBulkLoadEndPoint set 777 permission on input data files
2014-11-26 16:19:22 -08:00
595d2a846c
HBASE-12589 Forward-port fix for TestFromClientSideWithCoprocessor.testMaxKeyValueSize
2014-11-26 14:43:32 -08:00
1c0a06193e
HBASE-12587 TestReplicationTrackerZKImpl.testPeerRemovedEvent timedout
2014-11-26 12:53:54 -08:00
02963b202a
HBASE-12072 Standardize retry handling for master operations
2014-11-26 12:09:44 -08:00
d1f39d8246
Revert "HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)"
...
Causes TestZooKeeper to fail. Reverting.
This reverts commit 9be143691c
2014-11-26 10:23:49 -08:00
b719e7a8c6
HBASE-12518 Task 4 polish. Remove CM#{get,delete}Connection
...
Remove deleteConnection from everywhere except the two tests that ensure
it does the right thing and from HCM and CM themselves.
Undoes deleteConnection from tests and from the web ui
2014-11-26 08:11:41 -08:00
9be143691c
HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)
2014-11-26 07:59:26 -08:00
1350055fcd
HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum)
2014-11-26 07:53:35 -08:00
c57bc08082
HBASE-12474 Incorrect handling of default namespace in user_permission command (Srikanth Srungarapu)
2014-11-26 12:29:38 +00:00
8b8f2026bd
HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG
2014-11-25 21:21:50 -08:00
24f19328eb
HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum)
2014-11-25 16:29:53 -08:00
e6b4300756
HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
...
HConnection#getTable (0.98, 0.99)
Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
till end of time to do all and some cases are cryptic. Also skipped
some mapreduce where HTable comes through in API. Can do both of
these stragglers in another issue.
Generally, if a utility class or standalone class, tried to pass in a
Connection rather than have the utility or standalone create its own
connection on each invocation; e.g. the Quota stuff. Where not possible,
noted where invocation comes from... if test or hbck, didn't worry about
it.
Some classes are just standalone and nothing to be done to avoid
a Connection setup per invocation (this is probably how it worked
in the new HTable...days anyways). Some classes are not used:
AggregationClient, FavoredNodes... we should just purge this stuff.
Doc on what short circuit connection does (I can just use it...
I thought it was just for short circuit but no, it switches dependent
on where you are connecting).
Changed HConnection to super Interface ClusterConnection where safe (
internal usage by private classes only).
Doc cleanup in example usage so we do new mode rather than the old
fashion.
Used java7 idiom that allows you avoid writing out finally to call close
on implementations of Closeable.
Added a RegistryFactory.. moved it out from being inner class.
Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
to create a Scan that can ...
Renamed getShortCircuitConnection as getConnection – users don't need
to know what implementation does (that it can short-circuit RPC).
The old name gave pause. I was frightened to use it thinking it only
for short-circuit reading – that it would not do remote too.
Squashed commit of the following:
2014-11-25 08:15:20 -08:00
e83082a888
HBASE-12550 ADDENDUM Make HRegion's api not change.
2014-11-24 16:11:48 -08:00
0df5ed2ca6
HBASE-12550 Check all storefiles are referenced before splitting
...
Summary: If there are bugs in HDFS move and/or create we should protect against them by making sure that all files referenced end up in split daughters.
Test Plan: Unit tests cover splits pretty well
Subscribers: matteobertozzi
Differential Revision: https://reviews.facebook.net/D29373
2014-11-24 09:58:43 -08:00
336c22d581
HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
...
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).
In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).
In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
2014-11-24 09:46:28 -08:00
7ee4df600b
HBASE-12554 TestBaseLoadBalancer may timeout due to lengthy rack lookup
2014-11-21 16:52:11 -08:00
882324dbcc
HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules
2014-11-21 11:44:46 -08:00
890c067b66
HBASE-12552 listSnapshots should list only owned snapshots for non-super user
2014-11-21 10:54:05 -08:00
325cdc0987
HBASE-12073 Shell command user_permission fails on the table created by user if he is not global admin (Srikanth Srungarapu)
2014-11-21 10:55:48 +00:00
83f9f39e2a
HBASE-12346 Scan's default auths behavior under Visibility labels.(Jerry He)
2014-11-21 13:29:42 +05:30
c5690b1be3
HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer
2014-11-20 17:54:39 -08:00
a16b4e0fd5
HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test
2014-11-20 16:17:06 -08:00
cd08f8b2be
HBASE-12516 Clean up QA Bot warnings
...
Signed-off-by: stack <stack@apache.org>
2014-11-20 15:12:30 -08:00
d2ff1269f9
HBASE-11099 Two situations where we could open a region with smaller sequence number (Stephen Jiang)
2014-11-20 14:43:16 -08:00
7eefd0cbed
HBASE-12464 meta table region assignment stuck in the FAILED_OPEN state due to region server not fully ready to serve (Stephen Jiang)
2014-11-20 09:58:42 -08:00
b6dd9b441f
HBASE-12539 HFileLinkCleaner logs are uselessly noisy
2014-11-19 23:49:48 +01:00
db2b6421ff
HBASE-12535 NPE in WALFactory under contention for getInstance()
...
Signed-off-by: stack <stack@apache.org>
2014-11-19 14:39:46 -08:00
05ced20a34
HBASE-12529 Use ThreadLocalRandom for RandomQueueBalancer
2014-11-19 16:50:29 +00:00
3f95fe22e0
Patch up Jetty to disable SSLv3 (CVE-2014-3566)
2014-11-19 16:40:18 +00:00
640274d5e1
HBASE-12532 TestFilter failing occasionally with ExitCodeException doing chmod since HBASE-10378 ADDENDUM
2014-11-18 23:41:35 -08:00
d87c550b94
HBASE-12532 TestFilter failing occasionally with ExitCodeException doing chmod since HBASE-10378
2014-11-18 21:54:48 -08:00
1e77dd9f7a
Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)" ADDENDUM
2014-11-18 21:40:21 -08:00
5f391efda1
Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
...
This reverts commit d3e7c3cfa9
2014-11-18 16:30:52 -08:00
22f29ca8ef
HBASE-12496 A blockedRequestsCount metric (Yi Deng)
2014-11-18 14:14:31 -08:00
822bcce91e
HBASE-12411 Optionally enable p-reads and private readers for compactions.
2014-11-18 12:42:49 -08:00
b94e6738d9
HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM
2014-11-18 12:12:35 -08:00
f5e05eb836
HBASE-10378 Refactor write-ahead-log implementation
...
Incompatible changes called out in release notes on jira.
* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
- Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
- rolls actually happen asynchronously
- deprecated old api (and noted incompatible behavior change)
- modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
- only 1 sync offered
- WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
- Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
- replaced with generic suffixes
- WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
- made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
- WALUtil now acts as an integration point between the RegionServer and hte WAL code.
Incorporates contributions from v.himanshu.
Signed-off-by: stack <stack@apache.org>
2014-11-18 12:04:41 -08:00
b97c3daf90
HBASE-12449 Use the max timestamp of current or old cell's timestamp in HRegion.append()
2014-11-18 11:34:49 -08:00
d3e7c3cfa9
HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)
2014-11-18 09:48:54 -08:00
0eb07609b6
HBASE-12337 Import tool fails with NullPointerException if clusterIds is not initialized
2014-11-18 09:18:25 -08:00
1276af23d5
HBASE-12459 Use a non-managed Table in mapred.TableOutputFormat
2014-11-17 08:36:08 +01:00
0255fc2bf1
HBASE-12359 MulticastPublisher should specify IPv4/v6 protocol family when creating multicast channel (Qiang Tian)
2014-11-14 21:55:15 -08:00
9583d14747
HBASE-12478 HBASE-10141 and MIN_VERSIONS are not compatible
2014-11-14 16:36:56 -08:00
c29318c038
Revert "HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction."
...
This reverts commit 231d3ee2ad
2014-11-13 09:18:21 -08:00
9d634772fa
Revert "Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix"
...
This reverts commit f6d8cde1e4
2014-11-13 09:17:56 -08:00
f6d8cde1e4
Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix
2014-11-13 08:09:41 -08:00
231d3ee2ad
HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction.
2014-11-12 22:49:00 -08:00
f641aada36
HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra)
2014-11-12 15:50:10 -08:00
a376c8da9d
HBASE-12366 Add login code to HBase Canary tool (Srikanth Srungarapu)
2014-11-12 20:34:55 +00:00
210f5a3b01
Revert "HBASE-12454 Setting didPerformCompaction early in HRegion#compact"
...
This reverts commit b0a434a5ce
2014-11-12 12:30:57 -08:00
05c1663392
HBASE-12461 FSVisitor logging is excessive (Nick Dimiduk)
2014-11-12 10:23:54 -08:00
b0a434a5ce
HBASE-12454 Setting didPerformCompaction early in HRegion#compact
2014-11-12 09:47:46 -08:00
fb6c5c7fe8
HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui)
2014-11-12 08:56:42 -08:00
8327f145c9
HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter (addendum)
...
Signed-off-by: stack <stack@apache.org>
2014-11-11 15:44:56 -08:00
804444f892
HBASE-12455 Add 'description' to bean and attribute output when you do /jmx?description=true
2014-11-11 12:59:43 -08:00
6c2a299657
HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter
...
Signed-off-by: stack <stack@apache.org>
2014-11-11 11:17:23 -08:00
7657090ad9
HBASE-12448 Fix rate reporting in compaction progress DEBUG logging
2014-11-07 18:36:43 -08:00
440767ff55
Reduce the effective scope of CREATE and ADMIN permissions
2014-11-07 11:53:25 -08:00
7718390703
HBASE-12424 Finer grained logging and metrics for split transactions
2014-11-07 11:32:01 -08:00
cc71d35112
Generate Thrift code using a maven profile
...
Signed-off-by: stack <stack@apache.org>
2014-11-06 10:27:59 -08:00
c71244c02d
HBASE-12329 Table create with duplicate column family names quietly succeeds (Jingcheng Du)
2014-11-05 17:32:21 -08:00
b0eaa92f5b
HBASE-8707 Add LongComparator for filter (Liu Shaohui)
2014-11-05 16:56:43 -08:00
e1b82fe91f
HBASE-12389 Reduce the number of versions configured for the ACL table
2014-11-05 09:28:11 -08:00
9255d6fdc7
HBASE-12420 BucketCache logged startup message is egregiously large
2014-11-05 09:22:00 -08:00
48fd0369e5
HBASE-12344 Split up TestAdmin
2014-11-05 09:18:04 -08:00
ecd708671c
HBASE-12363 Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS.
2014-11-04 17:08:39 -08:00
3587fe8324
HBASE-12423 Use a non-managed Table in TableOutputFormat (Solomon Duskis)
2014-11-04 16:25:16 -08:00
7442e5bd62
HBASE-12414 Move HFileLink.exists() to base class
2014-11-04 12:33:29 +00:00
ab927b8e1a
HBASE-10780 HFilePrettyPrinter#processFile should return immediately if file does not exist (Ashish Singhi)
2014-11-03 20:31:40 -08:00
71f73fcd0b
HBASE-12402 ZKPermissionWatcher race condition in refreshing the cache leaving stale ACLs and causing AccessDenied
2014-11-03 20:09:55 -08:00
f7adec0548
HBASE-4625 Convert @deprecated HBaseTestCase tests JUnit4 style tests
...
Signed-off-by: stack <stack@apache.org>
2014-11-03 15:58:56 -08:00
b5764a8e74
HBASE-12399 Master startup race between metrics and RpcServer
2014-11-01 10:45:45 -07:00
a1f59d8e1b
Replication gets stuck following a transient zookeeper error to remote peer cluster
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-10-31 17:59:29 -07:00
b784f7db99
HBASE-12401 Add some timestamp signposts in IntegrationTestMTTR
2014-10-31 17:21:20 -07:00
f5d6314c87
HBASE-12335 IntegrationTestRegionReplicaPerf is flaky
2014-10-31 17:12:21 -07:00
a62f543c65
HBASE-12361 Show data locality of region in table page (Liu Shaohui)
2014-10-31 15:41:57 -07:00
997c1adc2f
HBASE-12390 Change revision style from svn to git
2014-10-31 11:10:38 -07:00
cacdb89e03
HBASE-10870 Deprecate and replace HCD methods that have a 'should' prefix with a 'is' instead
...
Signed-off-by: stack <stack@apache.org>
2014-10-31 08:34:00 -07:00
ba7344f5d1
HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors
...
Signed-off-by: stack <stack@apache.org>
2014-10-30 21:12:41 -07:00
a71dd16a70
HBASE-9003 TableMapReduceUtil should not rely on org.apache.hadoop.util.JarFinder#getJar (Esteban Gutierrez)
...
Signed-off-by: stack <stack@apache.org>
2014-10-30 21:03:01 -07:00
646f1d5f8f
HBASE-12388 Document behavior wrt coprocessors when wal gets empty waledits.
...
Signed-off-by: stack <stack@apache.org>
2014-10-30 19:32:12 -07:00
ff92346f5e
HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- REVERT. Failed in a test run here: https://builds.apache.org/job/PreCommit-HBASE-Build/11530//testReport/
2014-10-30 19:28:29 -07:00
a404db52ec
HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer)
2014-10-30 14:33:29 -07:00
7886c0b82f
TestRegionServerNoMaster#testMultipleOpen is flaky after HBASE-11760
2014-10-30 13:38:56 -07:00
9f4b6ac06c
HBASE-11835 Wrong managenement of non expected calls in the client (Nicolas Liochon)
2014-10-30 12:41:54 -07:00
f20fac41df
HBASE-12384 TestTags can hang on fast test hosts
2014-10-30 10:45:02 -07:00
87939889bb
HBASE-12375 LoadIncrementalHFiles fails to load data in table when CF name starts with '_'
...
Signed-off-by: stack <stack@apache.org>
2014-10-30 09:16:37 -07:00
8b84840d5a
HBASE-12378 Add a test to verify that the read-replica is able to read after a compaction
2014-10-30 12:06:16 +00:00
d170088d98
HBASE-12336 RegionServer failed to shutdown for NodeFailoverWorker thread (Liu Shaohui)
2014-10-29 22:03:26 -07:00
5062edebcf
HBASE-12238 A few ugly exceptions on startup
2014-10-29 21:42:29 -07:00
fba164a1d1
HBASE-12355 Update maven plugins
2014-10-29 13:11:44 -07:00
889333a6fd
HBASE-12313 Redo the hfile index length optimization so cell-based rather than serialized KV key
2014-10-29 11:33:49 -07:00
7cfafe401e
HBASE-12354 Update dependencies in time for 1.0 release
2014-10-29 11:16:18 -07:00
b240b00f4f
HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 ; ADDENDUM SETTING LOG LEVEL TO DEBUG AGAIN
2014-10-29 11:00:16 -07:00
cbb334035d
HBASE-12297 Support DBB usage in Bloom and HFileIndex area.
2014-10-29 14:39:03 +05:30
ece933fa3e
Implement Preemptive Fast Fail
...
Summary: This diff ports the Preemptive Fast Fail feature to OSS. In multi threaded clients, we use a feature developed on 0.89-fb branch called Preemptive Fast Fail. This allows the client threads which would potentially fail, fail fast. The idea behind this feature is that we allow, among the hundreds of client threads, one thread to try and establish connection with the regionserver and if that succeeds, we mark it as a live node again. Meanwhile, other threads which are trying to establish connection to the same server would ideally go into the timeouts which is effectively unfruitful. We can in those cases return appropriate exceptions to those clients instead of letting them retry.
Test Plan: Unit tests
Differential Revision: https://reviews.facebook.net/D24177
Signed-off-by: stack <stack@apache.org>
2014-10-28 22:47:50 -07:00
95282f2ea5
HBASE-12312 Another couple of createTable race conditions
...
Signed-off-by: stack <stack@apache.org>
2014-10-28 22:33:40 -07:00
64b6109ce9
HBASE-11562 CopyTable should provide an option to shuffle the mapper tasks (Jean-Marc Spaggiari)
2014-10-28 11:28:54 -07:00
f2f21000fb
HBASE-12304 CellCounter will throw AIOBE when output directory is not specified. (Ashish Singhi)
2014-10-28 17:27:47 +05:30
aea2c67016
HBASE-12353 Turn down logging on some spewing unit tests (Dima Spivak)
2014-10-27 15:12:25 -07:00
70a312e53f
HBASE-11912 Catch some bad practices at compile time with error-prone
2014-10-27 09:29:23 -07:00
0fb4c4d5f0
HBASE-11870 Optimization : Avoid copy of key and value for tags addition in AC and VC.
2014-10-25 21:12:15 +05:30
ff5bc351b2
Revert "HBASE-11912 Catch some bad practices at compile time with error-prone"
...
This reverts commit 7ed0260eff
2014-10-25 08:33:43 -07:00
7ed0260eff
HBASE-11912 Catch some bad practices at compile time with error-prone
2014-10-24 18:15:12 -07:00
97acb9ef24
HBASE-11964 Improve spreading replication load from failed regionservers
2014-10-24 14:17:46 -07:00
2916d4f356
HBASE-12277 Refactor bulkLoad methods in AccessController to its own interface (Madhan Neethiraj)
2014-10-24 08:47:06 -07:00
31c185aad5
HBASE-12328 Need to separate JvmMetrics for Master and RegionServer (Sanghyun Yun)
2014-10-23 21:49:47 -07:00
96f84594ee
HBASE-11915 Document and test 0.94 -> 1.0.0 update -- ADDENDUM
2014-10-22 22:10:52 -07:00
c623b04122
HBASE-12283 Clean up some checkstyle errors
2014-10-22 11:58:23 -07:00
19108fb850
HBASE-12306 CellCounter output's wrong value for Total Families Across all Rows in output file (Ashish Singhi)
2014-10-22 14:30:53 +00:00
2908c11371
HBASE-12301 user_permission command does not show global permissions
2014-10-22 10:08:31 +01:00
f6de7efb27
HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091
...
* Reduce the logging level to WARN
Signed-off-by: stack <stack@apache.org>
2014-10-21 22:02:00 -07:00
e545953c32
HBASE-12243 HBaseFsck should auto set ignorePreCheckPermission to true if no fix option is set (Yi Deng)
...
Signed-off-by: Jonathan M Hsieh <jmhsieh@apache.org>
2014-10-21 13:20:23 -07:00
6c70f4f7f7
HBASE-12302 VisibilityClient getAuths does not propagate remote service exception correctly (Jerry He)
2014-10-21 20:09:46 +00:00
c01d9981d8
HBASE-12202 Support DirectByteBuffer usage in HFileBlock.
2014-10-21 17:57:55 +05:30
c7f51db135
HBASE-12226 TestAccessController#testPermissionList failing on master (Srikranth Srungarapu)
2014-10-20 20:35:23 -07:00
0ee33094ed
HBASE-12278 Race condition in TestSecureLoadIncrementalHFilesSplitRecovery (Dima Spivak)
2014-10-20 11:08:45 -04:00
451798cefb
HBASE-12192 Remove EventHandlerListener
2014-10-18 14:27:04 -07:00
49056295ef
HBASE-12161 Add support for grant/revoke on namespaces in AccessControlClient (Srikanth Srungarapu)
2014-10-18 21:18:42 +01:00
5c92bded9d
Add admin endpoint for updating the configuration on the regionserver
...
Summary: This is a follow up diff for the jira to add the functionality to update configs in an online fashion.
Test Plan: Unit test. This adds an end point on the regionserver. It just tries to call the end point and make sure the call succeeds.
Differential Revision: https://reviews.facebook.net/D24861
Signed-off-by: stack <stack@apache.org>
2014-10-18 16:16:21 -04:00
7e995b6496
HBASE-12229 NullPointerException in SnapshotTestingUtils
...
* Implemented the waitUntilAllRegionsOnline in HBaseTestingUtility#createTable
* Add waitFor around #isTableAvailable call that previously didn't do anything
* Remove unused byte[] hex
Signed-off-by: stack <stack@apache.org>
2014-10-17 22:50:10 -04:00
349a56ae2c
HBASE-12263 RegionServer listens on localhost in distributed cluster when DNS is unavailable (Shaohui)
2014-10-17 20:52:55 +00:00
728fc543ea
HBASE-12264 ImportTsv should fail fast if output is not specified and table does not exist (Ashish)
2014-10-17 20:45:44 +00:00
686e77108a
HBASE-12274 Race between RegionScannerImpl#nextInternal() and RegionScannerImpl#close() may produce null pointer exception
2014-10-17 16:05:31 +00:00
ba20d4df8c
HBASE-12271 Add counters for files skipped during snapshot export
...
Add counters for skipped files
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-15 10:41:48 -07:00
f9c534bac3
HBASE-12258 TestHbaseFsck is flaky and has some multithreading issues
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-10-14 17:36:31 -07:00
3544f4e98b
HBASE-12247 Replace setHTable() with initializeTable() in TableInputFormat. (Solomon Duskis)
2014-10-14 14:11:21 -07:00
962065de72
Online config change
...
Summary: This diff is intended to forward port HBASE-8805 and HBASE-8544 implemented by Gaurav Menghani in 89-fb. This improves operational efficiency in managing clusters that are serving production traffic. The idea is to have a central configuration which can manage notifying the configuration observers. The observers in turn should update their local state from the latest config. Minor caveats where configuration variables are corelated should be taken care of with additional care.
Test Plan: Unit tests
Differential Revision: https://reviews.facebook.net/D24681
Signed-off-by: stack <stack@apache.org>
2014-10-13 21:23:12 -07:00
6dea02b260
HBASE-10200 Better error message when HttpServer fails to start due to java.net.BindException(Kiran Kumar M R)
2014-10-14 02:24:21 +00:00
9a893a9c6a
HBASE-12029 Use Table and RegionLocator in HTable.getRegionLocations() (Solomon Duskis)
2014-10-13 12:24:27 -07:00
b30d2f315d
HBASE-12242 Fix new javadoc warnings in Admin, etc.
2014-10-13 12:07:50 -07:00
8e9a8b002f
HBASE-8361 Bulk load and other utilities should not create tables for user (Ashish Singhi)
2014-10-12 21:52:01 -07:00
ab42b9ffe6
HBASE-12234 Make TestMultithreadedTableMapper a little more stable.
...
Signed-off-by: stack <stack@apache.org>
2014-10-12 18:37:47 -07:00
e3f9957830
HBASE-12176 WALCellCodec Encoders support for non-KeyValue Cells (Anoop Sam John)
2014-10-11 15:32:18 -07:00
8ee55fb339
HBASE-12126 Region server coprocessor endpoint (Virag Kothari)
2014-10-10 12:00:51 -07:00
65ae2e5126
HBASE-11394 Replication can have data loss if peer id contains hyphen "-"
2014-10-10 10:28:16 -07:00
3f2e599a99
HBASE-12210 Avoid KeyValue in Prefix Tree (Ram)
2014-10-10 22:45:26 +05:30
Jonathan M Hsieh
Jurriaan Mous
Devaraj Das
stack
tedyu
Jesse Yates
Enis Soztutar
Andrew Purtell
Virag Kothari
Sean Busbey
Srikanth Srungarapu
Jimmy Xiang
zhangduo
Jesse Yates
Rajeshbabu Chintaguntla
Ashish Singhi
Misty Stanley-Jones
Matteo Bertozzi
Jeffrey Zhong
Nick Dimiduk
Elliott Clark
Gary Helmling
Keith Winkler
Ramkrishna
Elliott Clark
anoopsjohn
Sean Busbey
Lars Hofhansl
Esteban Gutierrez
Niels Basjes
Adrian Muraru
manukranthk
Dima Spivak
Ted Yu
Yi Deng
anoopsjohn
Ryan Rawson
Patrick White