Commit Graph

3162 Commits

Author SHA1 Message Date
stack 9036c78cf1 HBASE-12587 TestReplicationTrackerZKImpl.testPeerRemovedEvent timedout 2014-11-26 12:54:27 -08:00
stack f376343a17 Revert "HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)"
Broke the build. TestZooKeeper doesn't pass.

This reverts commit 2e9597ffb7.
2014-11-26 10:35:03 -08:00
stack daff5e8d96 HBASE-12518 Task 4 polish. Remove CM#{get,delete}Connection
Remove deleteConnection from everywhere except the two tests that ensure
it does the right thing and from HCM and CM themselves.

Undoes deleteConnection from tests and from the web ui
2014-11-26 08:12:13 -08:00
stack 2e9597ffb7 HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER) 2014-11-26 08:00:00 -08:00
stack c55d57461c HBASE-12584 Fix branch-1 failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-26 01:52:41 -08:00
stack c9376e6d37 HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-25 16:30:23 -08:00
stack c0cdaf8400 HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
HConnection#getTable (0.98, 0.99)

    Backport

    Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
    till end of time to do all and some cases are cryptic. Also skipped
    some mapreduce where HTable comes through in API. Can do both of
    these stragglers in another issue.
    Generally, if a utility class or standalone class, tried to pass in a
    Connection rather than have the utility or standalone create its own
    connection on each invocation; e.g. the Quota stuff. Where not possible,
    noted where invocation comes from... if test or hbck, didn't worry about
    it.
    Some classes are just standalone and nothing to be done to avoid
    a Connection setup per invocation (this is probably how it worked
    in the new HTable...days anyways). Some classes are not used:
    AggregationClient, FavoredNodes... we should just purge this stuff.
    Doc on what short circuit connection does (I can just use it...
    I thought it was just for short circuit but no, it switches dependent
    on where you are connecting).
    Changed HConnection to super Interface ClusterConnection where safe (
    internal usage by private classes only).
    Doc cleanup in example usage so we do new mode rather than the old
    fashion.
    Used java7 idiom that allows you avoid writing out finally to call close
    on implementations of Closeable.
    Added a RegistryFactory.. moved it out from being inner class.
    Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
    to create a Scan that can ...
    Renamed getShortCircuitConnection as getConnection – users don't need
    to know what implementation does (that it can short-circuit RPC).
    The old name gave pause. I was frightened to use it thinking it only
    for short-circuit reading – that it would not do remote too.
    Squashed commit of the following:
2014-11-25 12:26:54 -08:00
Elliott Clark 524dcd1323 HBASE-12550 ADDENDUM Make HRegion's api not change. 2014-11-24 16:11:41 -08:00
stack 3cd1d7ab0c HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java 2014-11-24 10:12:27 -08:00
stack f3c5f11718 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
2014-11-24 10:12:27 -08:00
Elliott Clark 339fd6bdca HBASE-12550 Check all storefiles are referenced before splitting
Summary: If there are bugs in HDFS move and/or create we should protect against them by making sure that all files referenced end up in split daughters.

Test Plan: Unit tests cover splits pretty well

Subscribers: matteobertozzi

Differential Revision: https://reviews.facebook.net/D29373
2014-11-24 09:51:53 -08:00
Andrew Purtell 9904252615 HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) 2014-11-22 12:13:09 -08:00
stack 7a3e8b55f8 HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test (Virag Kothari) --ADDENDUM 2014-11-21 21:32:55 -08:00
tedyu d5bcf338d6 HBASE-12554 TestBaseLoadBalancer may timeout due to lengthy rack lookup 2014-11-21 16:56:31 -08:00
Enis Soztutar aa343ebcfe HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 14:09:28 -08:00
stack 42cbdea76d HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer -- ADDENDUM; add waitForNoRegionInTransition from HTU in master branch 2014-11-21 08:15:38 -08:00
anoopsjohn 3c3e9aef81 HBASE-12346 Scan's default auths behavior under Visibility labels. - Addendum 2014-11-21 18:25:41 +05:30
anoopsjohn 04ee2bc812 HBASE-12346 Scan's default auths behavior under Visibility labels.(Jerry He) 2014-11-21 13:47:22 +05:30
stack bfda57d4f2 HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer 2014-11-20 17:55:08 -08:00
Enis Soztutar 49422a9ec4 HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test 2014-11-20 16:19:20 -08:00
Sean Busbey f1ae3cc56f HBASE-12516 Clean up QA Bot warnings
Signed-off-by: stack <stack@apache.org>
2014-11-20 15:13:03 -08:00
tedyu 3b4688f9ee HBASE-11099 Two situations where we could open a region with smaller sequence number (Stephen Jiang) 2014-11-20 14:44:08 -08:00
tedyu deacb117f6 HBASE-12464 meta table region assignment stuck in the FAILED_OPEN state due to region server not fully ready to serve (Stephen Jiang) 2014-11-20 12:01:40 -08:00
Nick Dimiduk f1048a148b HBASE-12539 HFileLinkCleaner logs are uselessly noisy 2014-11-19 23:51:19 +01:00
Matteo Bertozzi 865ffebfc6 HBASE-12529 Use ThreadLocalRandom for RandomQueueBalancer 2014-11-19 16:51:26 +00:00
Matteo Bertozzi 6e376b900e Patch up Jetty to disable SSLv3 (CVE-2014-3566) 2014-11-19 16:51:19 +00:00
stack 3a3a4b7b6b Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit 4f5cde8a69.
2014-11-18 16:32:18 -08:00
Andrew Purtell eb34c956a1 HBASE-12496 A blockedRequestsCount metric (Yi Deng) 2014-11-18 14:24:18 -08:00
Lars Hofhansl 2ed5ac9ca9 HBASE-12411 Optionally enable p-reads and private readers for compactions. 2014-11-18 12:29:31 -08:00
Enis Soztutar bb0a3ce914 HBASE-12449 Use the max timestamp of current or old cell's timestamp in HRegion.append() 2014-11-18 11:35:47 -08:00
stack 4f5cde8a69 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
2014-11-18 10:19:55 -08:00
tedyu 463198dcdc HBASE-12337 Import tool fails with NullPointerException if clusterIds is not initialized 2014-11-18 09:19:00 -08:00
Nick Dimiduk f38efa79e6 HBASE-12459 Use a non-managed Table in mapred.TableOutputFormat 2014-11-17 08:39:46 +01:00
stack dcba045526 HBASE-12359 MulticastPublisher should specify IPv4/v6 protocol family when creating multicast channel (Qiang Tian) 2014-11-14 21:55:59 -08:00
tedyu 30ecf5ae78 HBASE-12478 HBASE-10141 and MIN_VERSIONS are not compatible 2014-11-14 16:37:19 -08:00
Lars Hofhansl 1861f9ce25 Revert "HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction."
This reverts commit 0e795c1cf8.
2014-11-13 09:19:43 -08:00
Lars Hofhansl 880c7c35fc Revert "Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix"
This reverts commit 9d2ad55cfa.
2014-11-13 09:19:32 -08:00
Andrew Purtell 9d2ad55cfa Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix 2014-11-13 08:09:51 -08:00
Lars Hofhansl 0e795c1cf8 HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction. 2014-11-12 22:49:46 -08:00
Enis Soztutar b25e5bb890 HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra) 2014-11-12 15:50:48 -08:00
Matteo Bertozzi 1f0d960792 HBASE-12366 Add login code to HBase Canary tool (Srikanth Srungarapu) 2014-11-12 20:33:37 +00:00
Andrew Purtell d0c34fb4a3 Revert "HBASE-12454 Setting didPerformCompaction early in HRegion#compact"
This reverts commit 16decdc19a.
2014-11-12 12:31:10 -08:00
Andrew Purtell 17a816a0f9 HBASE-12461 FSVisitor logging is excessive (Nick Dimiduk) 2014-11-12 10:24:04 -08:00
Andrew Purtell 16decdc19a HBASE-12454 Setting didPerformCompaction early in HRegion#compact 2014-11-12 09:47:33 -08:00
stack f3a38dcf16 HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MasterAddressTracker.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
2014-11-12 09:09:11 -08:00
Jeffrey Zhong 86711846d3 HBASE-12319: Inconsistencies during region recovery due to close/open of a region during recovery 2014-11-11 17:55:48 -08:00
Esteban Gutierrez 61477d06be HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter (addendum)
Signed-off-by: stack <stack@apache.org>
2014-11-11 15:50:06 -08:00
Esteban Gutierrez bebf0181c8 HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter
Signed-off-by: stack <stack@apache.org>
2014-11-11 15:06:56 -08:00
stack 8902fb0c1b HBASE-12455 Add 'description' to bean and attribute output when you do /jmx?description=true 2014-11-11 13:14:50 -08:00
Andrew Purtell b1f7d7cd32 HBASE-12448 Fix rate reporting in compaction progress DEBUG logging 2014-11-07 18:36:44 -08:00