Commit Graph

9568 Commits

Author SHA1 Message Date
stack f376343a17 Revert "HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)"
Broke the build. TestZooKeeper doesn't pass.

This reverts commit 2e9597ffb7.
2014-11-26 10:35:03 -08:00
stack daff5e8d96 HBASE-12518 Task 4 polish. Remove CM#{get,delete}Connection
Remove deleteConnection from everywhere except the two tests that ensure
it does the right thing and from HCM and CM themselves.

Undoes deleteConnection from tests and from the web ui
2014-11-26 08:12:13 -08:00
stack 2e9597ffb7 HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER) 2014-11-26 08:00:00 -08:00
stack c55d57461c HBASE-12584 Fix branch-1 failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-26 01:52:41 -08:00
stack c9376e6d37 HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-25 16:30:23 -08:00
Enis Soztutar b9dfcd01b8 HBASE-12128 Cache configuration and RpcController selection for Table in Connection 2014-11-25 13:48:09 -08:00
stack c0cdaf8400 HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
HConnection#getTable (0.98, 0.99)

    Backport

    Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
    till end of time to do all and some cases are cryptic. Also skipped
    some mapreduce where HTable comes through in API. Can do both of
    these stragglers in another issue.
    Generally, if a utility class or standalone class, tried to pass in a
    Connection rather than have the utility or standalone create its own
    connection on each invocation; e.g. the Quota stuff. Where not possible,
    noted where invocation comes from... if test or hbck, didn't worry about
    it.
    Some classes are just standalone and nothing to be done to avoid
    a Connection setup per invocation (this is probably how it worked
    in the new HTable...days anyways). Some classes are not used:
    AggregationClient, FavoredNodes... we should just purge this stuff.
    Doc on what short circuit connection does (I can just use it...
    I thought it was just for short circuit but no, it switches dependent
    on where you are connecting).
    Changed HConnection to super Interface ClusterConnection where safe (
    internal usage by private classes only).
    Doc cleanup in example usage so we do new mode rather than the old
    fashion.
    Used java7 idiom that allows you avoid writing out finally to call close
    on implementations of Closeable.
    Added a RegistryFactory.. moved it out from being inner class.
    Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
    to create a Scan that can ...
    Renamed getShortCircuitConnection as getConnection – users don't need
    to know what implementation does (that it can short-circuit RPC).
    The old name gave pause. I was frightened to use it thinking it only
    for short-circuit reading – that it would not do remote too.
    Squashed commit of the following:
2014-11-25 12:26:54 -08:00
Patrick White 39c67f6031 HBASE-12569 Update scripts to control MaxDirectMemorySize via env vars
Signed-off-by: stack <stack@apache.org>

Conflicts:
	src/main/docbkx/book.xml
2014-11-25 00:00:53 -08:00
Elliott Clark 524dcd1323 HBASE-12550 ADDENDUM Make HRegion's api not change. 2014-11-24 16:11:41 -08:00
stack a4a3ffd560 HBASE-12495 Use interfaces in the shell scripts (solomon duskis)
Conflicts:
	hbase-shell/src/main/ruby/hbase/quotas.rb
2014-11-24 12:19:32 -08:00
stack 3cd1d7ab0c HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java 2014-11-24 10:12:27 -08:00
stack f3c5f11718 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
2014-11-24 10:12:27 -08:00
Elliott Clark 339fd6bdca HBASE-12550 Check all storefiles are referenced before splitting
Summary: If there are bugs in HDFS move and/or create we should protect against them by making sure that all files referenced end up in split daughters.

Test Plan: Unit tests cover splits pretty well

Subscribers: matteobertozzi

Differential Revision: https://reviews.facebook.net/D29373
2014-11-24 09:51:53 -08:00
Andrew Purtell 9904252615 HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) 2014-11-22 12:13:09 -08:00
Enis Soztutar 9701845ea7 HBASE-12560 [WINDOWS] Append the classpath from Hadoop to HBase classpath in bin/hbase.cmd 2014-11-21 22:07:54 -08:00
stack 7a3e8b55f8 HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test (Virag Kothari) --ADDENDUM 2014-11-21 21:32:55 -08:00
tedyu d5bcf338d6 HBASE-12554 TestBaseLoadBalancer may timeout due to lengthy rack lookup 2014-11-21 16:56:31 -08:00
Enis Soztutar aa343ebcfe HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 14:09:28 -08:00
stack 42cbdea76d HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer -- ADDENDUM; add waitForNoRegionInTransition from HTU in master branch 2014-11-21 08:15:38 -08:00
anoopsjohn 3c3e9aef81 HBASE-12346 Scan's default auths behavior under Visibility labels. - Addendum 2014-11-21 18:25:41 +05:30
anoopsjohn 04ee2bc812 HBASE-12346 Scan's default auths behavior under Visibility labels.(Jerry He) 2014-11-21 13:47:22 +05:30
stack bfda57d4f2 HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer 2014-11-20 17:55:08 -08:00
Enis Soztutar 49422a9ec4 HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test 2014-11-20 16:19:20 -08:00
Sean Busbey f1ae3cc56f HBASE-12516 Clean up QA Bot warnings
Signed-off-by: stack <stack@apache.org>
2014-11-20 15:13:03 -08:00
tedyu 3b4688f9ee HBASE-11099 Two situations where we could open a region with smaller sequence number (Stephen Jiang) 2014-11-20 14:44:08 -08:00
Sean Busbey f43cb80327 HBASE-12544 restore ops_mgt section of ref guide.
* checked out file version as of d7f51e^
* redid cherry-pick of changes to ops_mgt.xml from master commit 804444
* fixup with cherry pick of 71ed3b to replace mdash entity with unicode.

Original Author: stack <stack@apache.org>

Signed-off-by: stack <stack@apache.org>
2014-11-20 12:44:19 -08:00
tedyu deacb117f6 HBASE-12464 meta table region assignment stuck in the FAILED_OPEN state due to region server not fully ready to serve (Stephen Jiang) 2014-11-20 12:01:40 -08:00
tedyu 84ed9f6ba4 HBASE-8572 Enhance delete_snapshot.rb to call snapshot deletion API with regex (Ashish Singhi) 2014-11-20 08:59:42 -08:00
Nick Dimiduk f1048a148b HBASE-12539 HFileLinkCleaner logs are uselessly noisy 2014-11-19 23:51:19 +01:00
Matteo Bertozzi 865ffebfc6 HBASE-12529 Use ThreadLocalRandom for RandomQueueBalancer 2014-11-19 16:51:26 +00:00
Matteo Bertozzi 6e376b900e Patch up Jetty to disable SSLv3 (CVE-2014-3566) 2014-11-19 16:51:19 +00:00
stack bfe5f2442c Revert "HBASE-12495 Use interfaces in the shell scripts (Solomon Duskis)"
This reverts commit 5accf48362.
2014-11-18 18:14:15 -08:00
stack 3a3a4b7b6b Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit 4f5cde8a69.
2014-11-18 16:32:18 -08:00
Andrew Purtell eb34c956a1 HBASE-12496 A blockedRequestsCount metric (Yi Deng) 2014-11-18 14:24:18 -08:00
Florin Broasca d3c9425c9b HBASE-12513 Graceful stop script does not restore the balancer state
Signed-off-by: stack <stack@apache.org>
2014-11-18 13:15:14 -08:00
Sean Busbey 7418bdb623 HBASE-12517 Ensure HConstants members are final.
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
2014-11-18 13:07:38 -08:00
stack 5accf48362 HBASE-12495 Use interfaces in the shell scripts (Solomon Duskis)
Conflicts:
	hbase-shell/src/main/ruby/hbase/quotas.rb
2014-11-18 12:57:31 -08:00
Lars Hofhansl 2ed5ac9ca9 HBASE-12411 Optionally enable p-reads and private readers for compactions. 2014-11-18 12:29:31 -08:00
Enis Soztutar bb0a3ce914 HBASE-12449 Use the max timestamp of current or old cell's timestamp in HRegion.append() 2014-11-18 11:35:47 -08:00
stack 4f5cde8a69 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
2014-11-18 10:19:55 -08:00
tedyu 463198dcdc HBASE-12337 Import tool fails with NullPointerException if clusterIds is not initialized 2014-11-18 09:19:00 -08:00
Nick Dimiduk 390d4acf0d HBASE-12472 Improve debuggability of IntegrationTestBulkLoad 2014-11-17 09:34:54 +01:00
Nick Dimiduk f38efa79e6 HBASE-12459 Use a non-managed Table in mapred.TableOutputFormat 2014-11-17 08:39:46 +01:00
stack dcba045526 HBASE-12359 MulticastPublisher should specify IPv4/v6 protocol family when creating multicast channel (Qiang Tian) 2014-11-14 21:55:59 -08:00
tedyu 30ecf5ae78 HBASE-12478 HBASE-10141 and MIN_VERSIONS are not compatible 2014-11-14 16:37:19 -08:00
Lars Hofhansl 1861f9ce25 Revert "HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction."
This reverts commit 0e795c1cf8.
2014-11-13 09:19:43 -08:00
Lars Hofhansl 880c7c35fc Revert "Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix"
This reverts commit 9d2ad55cfa.
2014-11-13 09:19:32 -08:00
Andrew Purtell 9d2ad55cfa Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix 2014-11-13 08:09:51 -08:00
Lars Hofhansl 0e795c1cf8 HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction. 2014-11-12 22:49:46 -08:00
Enis Soztutar b25e5bb890 HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra) 2014-11-12 15:50:48 -08:00