c9376e6d37
HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum)
2014-11-25 16:30:23 -08:00
c0cdaf8400
HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
...
HConnection#getTable (0.98, 0.99)
Backport
Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
till end of time to do all and some cases are cryptic. Also skipped
some mapreduce where HTable comes through in API. Can do both of
these stragglers in another issue.
Generally, if a utility class or standalone class, tried to pass in a
Connection rather than have the utility or standalone create its own
connection on each invocation; e.g. the Quota stuff. Where not possible,
noted where invocation comes from... if test or hbck, didn't worry about
it.
Some classes are just standalone and nothing to be done to avoid
a Connection setup per invocation (this is probably how it worked
in the new HTable...days anyways). Some classes are not used:
AggregationClient, FavoredNodes... we should just purge this stuff.
Doc on what short circuit connection does (I can just use it...
I thought it was just for short circuit but no, it switches dependent
on where you are connecting).
Changed HConnection to super Interface ClusterConnection where safe (
internal usage by private classes only).
Doc cleanup in example usage so we do new mode rather than the old
fashion.
Used java7 idiom that allows you avoid writing out finally to call close
on implementations of Closeable.
Added a RegistryFactory.. moved it out from being inner class.
Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
to create a Scan that can ...
Renamed getShortCircuitConnection as getConnection – users don't need
to know what implementation does (that it can short-circuit RPC).
The old name gave pause. I was frightened to use it thinking it only
for short-circuit reading – that it would not do remote too.
Squashed commit of the following:
2014-11-25 12:26:54 -08:00
524dcd1323
HBASE-12550 ADDENDUM Make HRegion's api not change.
2014-11-24 16:11:41 -08:00
3cd1d7ab0c
HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
2014-11-24 10:12:27 -08:00
f3c5f11718
HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
...
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).
In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).
In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
2014-11-24 10:12:27 -08:00
339fd6bdca
HBASE-12550 Check all storefiles are referenced before splitting
...
Summary: If there are bugs in HDFS move and/or create we should protect against them by making sure that all files referenced end up in split daughters.
Test Plan: Unit tests cover splits pretty well
Subscribers: matteobertozzi
Differential Revision: https://reviews.facebook.net/D29373
2014-11-24 09:51:53 -08:00
9904252615
HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari)
2014-11-22 12:13:09 -08:00
7a3e8b55f8
HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test (Virag Kothari) --ADDENDUM
2014-11-21 21:32:55 -08:00
d5bcf338d6
HBASE-12554 TestBaseLoadBalancer may timeout due to lengthy rack lookup
2014-11-21 16:56:31 -08:00
aa343ebcfe
HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules
2014-11-21 14:09:28 -08:00
42cbdea76d
HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer -- ADDENDUM; add waitForNoRegionInTransition from HTU in master branch
2014-11-21 08:15:38 -08:00
3c3e9aef81
HBASE-12346 Scan's default auths behavior under Visibility labels. - Addendum
2014-11-21 18:25:41 +05:30
04ee2bc812
HBASE-12346 Scan's default auths behavior under Visibility labels.(Jerry He)
2014-11-21 13:47:22 +05:30
bfda57d4f2
HBASE-12541 Add misc debug logging to hanging tests in TestHCM and TestBaseLoadBalancer
2014-11-20 17:55:08 -08:00
49422a9ec4
HBASE-12549 Fix TestAssignmentManagerOnCluster#testAssignRacingWithSSH() flaky test
2014-11-20 16:19:20 -08:00
f1ae3cc56f
HBASE-12516 Clean up QA Bot warnings
...
Signed-off-by: stack <stack@apache.org>
2014-11-20 15:13:03 -08:00
3b4688f9ee
HBASE-11099 Two situations where we could open a region with smaller sequence number (Stephen Jiang)
2014-11-20 14:44:08 -08:00
deacb117f6
HBASE-12464 meta table region assignment stuck in the FAILED_OPEN state due to region server not fully ready to serve (Stephen Jiang)
2014-11-20 12:01:40 -08:00
f1048a148b
HBASE-12539 HFileLinkCleaner logs are uselessly noisy
2014-11-19 23:51:19 +01:00
865ffebfc6
HBASE-12529 Use ThreadLocalRandom for RandomQueueBalancer
2014-11-19 16:51:26 +00:00
6e376b900e
Patch up Jetty to disable SSLv3 (CVE-2014-3566)
2014-11-19 16:51:19 +00:00
3a3a4b7b6b
Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
...
This reverts commit 4f5cde8a69
2014-11-18 16:32:18 -08:00
eb34c956a1
HBASE-12496 A blockedRequestsCount metric (Yi Deng)
2014-11-18 14:24:18 -08:00
2ed5ac9ca9
HBASE-12411 Optionally enable p-reads and private readers for compactions.
2014-11-18 12:29:31 -08:00
bb0a3ce914
HBASE-12449 Use the max timestamp of current or old cell's timestamp in HRegion.append()
2014-11-18 11:35:47 -08:00
4f5cde8a69
HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
2014-11-18 10:19:55 -08:00
463198dcdc
HBASE-12337 Import tool fails with NullPointerException if clusterIds is not initialized
2014-11-18 09:19:00 -08:00
f38efa79e6
HBASE-12459 Use a non-managed Table in mapred.TableOutputFormat
2014-11-17 08:39:46 +01:00
dcba045526
HBASE-12359 MulticastPublisher should specify IPv4/v6 protocol family when creating multicast channel (Qiang Tian)
2014-11-14 21:55:59 -08:00
30ecf5ae78
HBASE-12478 HBASE-10141 and MIN_VERSIONS are not compatible
2014-11-14 16:37:19 -08:00
1861f9ce25
Revert "HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction."
...
This reverts commit 0e795c1cf8
2014-11-13 09:19:43 -08:00
880c7c35fc
Revert "Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix"
...
This reverts commit 9d2ad55cfa
2014-11-13 09:19:32 -08:00
9d2ad55cfa
Amend HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction; Test import fix
2014-11-13 08:09:51 -08:00
0e795c1cf8
HBASE-12457 Regions in transition for a long time when CLOSE interleaves with a slow compaction.
2014-11-12 22:49:46 -08:00
b25e5bb890
HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra)
2014-11-12 15:50:48 -08:00
1f0d960792
HBASE-12366 Add login code to HBase Canary tool (Srikanth Srungarapu)
2014-11-12 20:33:37 +00:00
d0c34fb4a3
Revert "HBASE-12454 Setting didPerformCompaction early in HRegion#compact"
...
This reverts commit 16decdc19a
2014-11-12 12:31:10 -08:00
17a816a0f9
HBASE-12461 FSVisitor logging is excessive (Nick Dimiduk)
2014-11-12 10:24:04 -08:00
16decdc19a
HBASE-12454 Setting didPerformCompaction early in HRegion#compact
2014-11-12 09:47:33 -08:00
f3a38dcf16
HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui)
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MasterAddressTracker.java
hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
2014-11-12 09:09:11 -08:00
86711846d3
HBASE-12319: Inconsistencies during region recovery due to close/open of a region during recovery
2014-11-11 17:55:48 -08:00
61477d06be
HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter (addendum)
...
Signed-off-by: stack <stack@apache.org>
2014-11-11 15:50:06 -08:00
bebf0181c8
HBASE-12447 Add support for setTimeRange for RowCounter and CellCounter
...
Signed-off-by: stack <stack@apache.org>
2014-11-11 15:06:56 -08:00
8902fb0c1b
HBASE-12455 Add 'description' to bean and attribute output when you do /jmx?description=true
2014-11-11 13:14:50 -08:00
b1f7d7cd32
HBASE-12448 Fix rate reporting in compaction progress DEBUG logging
2014-11-07 18:36:44 -08:00
87fb974765
HBASE-12440 Region may remain offline on clean startup under certain race condition (Virag Kothari)
2014-11-07 14:11:56 -08:00
5a16c15d7f
Reduce the effective scope of CREATE and ADMIN permissions
2014-11-07 11:53:01 -08:00
3eed03268f
HBASE-12424 Finer grained logging and metrics for split transactions
...
Conflicts:
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitRequest.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java
2014-11-07 11:44:49 -08:00
de21812ad5
HBASE-12272 Generate Thrift code using a maven profile
...
Signed-off-by: stack <stack@apache.org>
Conflicts:
pom.xml
src/main/docbkx/developer.xml
2014-11-06 10:32:41 -08:00
c99d89fd63
HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT --REVERT
2014-11-05 19:15:24 -08:00
15f96c7a00
HBASE-12329 Table create with duplicate column family names quietly succeeds (Jingcheng Du)
2014-11-05 17:33:54 -08:00
625a1ea065
HBASE-8707 Add LongComparator for filter (Liu Shaohui)
2014-11-05 16:57:21 -08:00
41611547b3
HBASE-12389 Reduce the number of versions configured for the ACL table
2014-11-05 09:28:19 -08:00
2e826a4ad1
HBASE-12420 BucketCache logged startup message is egregiously large
2014-11-05 09:22:04 -08:00
64fd02fcbd
HBASE-12344 Split up TestAdmin
2014-11-05 09:18:51 -08:00
8427d67ff6
HBASE-12363 Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS.
2014-11-04 17:12:39 -08:00
e36c59d4f2
HBASE-12423 Use a non-managed Table in TableOutputFormat (Solomon Duskis)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
2014-11-04 16:29:18 -08:00
431b8a5383
Cache more efficiently getAll() and get() in FSTableDescriptors
...
Signed-off-by: stack <stack@apache.org>
2014-11-04 15:10:08 -08:00
c66a6b02a5
HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT
2014-11-04 12:41:38 -08:00
a347d32cc5
HBASE-12319: Inconsistencies during region recovery due to close/open of a region during recovery; REVERT -- UNSTABLE BUILD
2014-11-04 09:26:13 -08:00
b827b6d02e
HBASE-12414 Move HFileLink.exists() to base class
2014-11-04 12:31:21 +00:00
c84b13514e
HBASE-12319: Inconsistencies during region recovery due to close/open of a region during recovery
2014-11-03 21:31:12 -08:00
481c6829db
HBASE-10780 HFilePrettyPrinter#processFile should return immediately if file does not exist (Ashish Singhi)
2014-11-03 20:30:47 -08:00
65e7de39c7
HBASE-12402 ZKPermissionWatcher race condition in refreshing the cache leaving stale ACLs and causing AccessDenied
2014-11-03 20:12:12 -08:00
0aca51e89c
HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors; REVERTgit log! branch-1 patch AND addendum
2014-11-01 16:03:08 -07:00
c3a7f2f3bb
HBASE-12399 Master startup race between metrics and RpcServer
2014-11-01 10:47:00 -07:00
0505072c51
Replication gets stuck following a transient zookeeper error to remote peer cluster
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-10-31 17:59:43 -07:00
e15a803b59
HBASE-12401 Add some timestamp signposts in IntegrationTestMTTR
2014-10-31 17:22:47 -07:00
4a803e79e1
HBASE-12335 IntegrationTestRegionReplicaPerf is flaky
2014-10-31 17:17:05 -07:00
4649646fc8
HBASE-12361 Show data locality of region in table page (Liu Shaohui)
...
Conflicts:
hbase-server/src/main/resources/hbase-webapps/master/table.jsp
2014-10-31 15:43:01 -07:00
1f18d706a8
HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors (addendum)
...
Signed-off-by: stack <stack@apache.org>
2014-10-31 11:33:33 -07:00
a46425b2a9
HBASE-12390 Change revision style from svn to git
2014-10-31 11:11:12 -07:00
233fb8bf18
HBASE-12219 Cache more efficiently getAll() and get() in FSTableDescriptors
...
Signed-off-by: stack <stack@apache.org>
2014-10-31 10:40:57 -07:00
ae8462b3a2
HBASE-10870 Deprecate and replace HCD methods that have a 'should' prefix with a 'is' instead
...
Signed-off-by: stack <stack@apache.org>
2014-10-31 08:34:40 -07:00
b2d1b154bb
HBASE-9003 TableMapReduceUtil should not rely on org.apache.hadoop.util.JarFinder#getJar (Esteban Gutierrez)
...
Signed-off-by: stack <stack@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestJarFinder.java
2014-10-30 21:07:55 -07:00
a1162960c2
HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- ADDENDUM testannoations fixup -- REALLY REMOVE IT
2014-10-30 20:08:51 -07:00
f5e3b30058
HBASE-12388 Document behavior wrt coprocessors when wal gets empty waledits.
...
Signed-off-by: stack <stack@apache.org>
2014-10-30 19:32:44 -07:00
c1ec92adc9
HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- REVERT. Failed in a test run here: https://builds.apache.org/job/PreCommit-HBASE-Build/11530//testReport/
2014-10-30 19:26:23 -07:00
49fb89f151
HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer) -- ADDENDUM testannoations fixup
2014-10-30 14:51:15 -07:00
d719ea1db7
HBASE-11819 Unit test for CoprocessorHConnection (Talat Uyarer)
2014-10-30 14:34:02 -07:00
29d486ff4e
HBASE-11835 Wrong managenement of non expected calls in the client (Nicolas Liochon)
2014-10-30 12:42:26 -07:00
f0091a9031
HBASE-12384 TestTags can hang on fast test hosts
2014-10-30 10:45:08 -07:00
d8874fbc21
HBASE-12375 LoadIncrementalHFiles fails to load data in table when CF name starts with '_'
...
Signed-off-by: stack <stack@apache.org>
2014-10-30 09:17:02 -07:00
c466c61976
HBASE-12378 Add a test to verify that the read-replica is able to read after a compaction
2014-10-30 12:18:52 +00:00
9e0ca78439
HBASE-12336 RegionServer failed to shutdown for NodeFailoverWorker thread (Liu Shaohui)
2014-10-29 22:04:02 -07:00
b069c10af4
HBASE-12238 A few ugly exceptions on startup
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaTableLocator.java
2014-10-29 21:53:55 -07:00
6f4ae948ac
HBASE-12355 Update maven plugins
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaCache.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
2014-10-29 13:18:25 -07:00
6c39d36b32
HBASE-12313 Redo the hfile index length optimization so cell-based rather than serialized KV key
...
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/CellComparator.java
hbase-common/src/main/java/org/apache/hadoop/hbase/CellKey.java
hbase-common/src/test/java/org/apache/hadoop/hbase/TestCellUtil.java
2014-10-29 11:36:47 -07:00
7aed6de9c8
HBASE-12354 Update dependencies in time for 1.0 release
2014-10-29 11:16:44 -07:00
752c546099
HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 ; ADDENDUM SETTING LOG LEVEL TO DEBUG AGAIN
...
Conflicts:
hbase-server/src/test/resources/log4j.properties
2014-10-29 11:01:19 -07:00
e1d1ba564b
HBASE-12297 Support DBB usage in Bloom and HFileIndex area.
2014-10-29 14:40:08 +05:30
69c99da70a
Implement Preemptive Fast Fail
...
Summary: This diff ports the Preemptive Fast Fail feature to OSS. In multi threaded clients, we use a feature developed on 0.89-fb branch called Preemptive Fast Fail. This allows the client threads which would potentially fail, fail fast. The idea behind this feature is that we allow, among the hundreds of client threads, one thread to try and establish connection with the regionserver and if that succeeds, we mark it as a live node again. Meanwhile, other threads which are trying to establish connection to the same server would ideally go into the timeouts which is effectively unfruitful. We can in those cases return appropriate exceptions to those clients instead of letting them retry.
Test Plan: Unit tests
Differential Revision: https://reviews.facebook.net/D24177
Signed-off-by: stack <stack@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterConnection.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionManager.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCaller.java
2014-10-28 22:59:20 -07:00
a973fd514f
HBASE-12312 Another couple of createTable race conditions
...
Signed-off-by: stack <stack@apache.org>
2014-10-28 22:36:41 -07:00
a26bcdd4d9
HBASE-11562 CopyTable should provide an option to shuffle the mapper tasks (Jean-Marc Spaggiari)
2014-10-28 11:29:22 -07:00
81c4caf1f1
HBASE-12142 Truncate command does not preserve ACLs table (Vandana Ayyalasomayajula)
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
2014-10-28 09:59:45 -07:00
f9fce4caf0
HBASE-12304 CellCounter will throw AIOBE when output directory is not specified. (Ashish Singhi)
2014-10-28 17:56:09 +05:30
bf8c34734b
HBASE-12353 Turn down logging on some spewing unit tests (Dima Spivak)
2014-10-27 15:13:04 -07:00
862faca7a4
HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 -- Setting log level back to DEBUG TO WARN -- second time
2014-10-26 20:49:03 -07:00
65c60ce873
HBASE-12285 Builds are failing, possibly because of SUREFIRE-1091 -- Setting log level back to DEBUG from WARN
2014-10-26 16:19:23 -07:00
4d385d1509
HBASE-11870 Optimization : Avoid copy of key and value for tags addition in AC and VC.
2014-10-25 21:13:49 +05:30
stack
Elliott Clark
Andrew Purtell
tedyu
Enis Soztutar
anoopsjohn
Sean Busbey
Nick Dimiduk
Matteo Bertozzi
Lars Hofhansl
Jeffrey Zhong
Esteban Gutierrez
Niels Basjes
Adrian Muraru
Ashish Singhi
Sean Busbey
manukranthk
Dima Spivak