Commit Graph

4190 Commits

Author SHA1 Message Date
Enis Soztutar ec021a7b25 HBASE-14689 Addendum and unit test for HBASE-13471
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2015-10-26 12:08:58 -07:00
stack d76dbb4f84 HBASE-14648 Reenable TestWALProcedureStoreOnHDFS#testWalRollOnLowReplication (Heng Chen) 2015-10-24 20:56:06 -07:00
tedyu 40887c94b7 HBASE-14624 BucketCache.freeBlock is too expensive 2015-10-24 18:48:55 -07:00
stack 4f8387959a HBASE-14266 RegionServers have a lock contention of Configuration.getProps 2015-10-24 15:37:55 -07:00
stack 91bca7323a HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; ADD TestDistributedLogSplitting to the mix; ADDENDUM added TestSnapshotCloneIndependence to removed set of dodgy tests 2015-10-24 14:27:38 -07:00
Elliott Clark 1050908ff0 HBASE-14690 Fix css so there's no left/right scroll bar 2015-10-24 10:26:57 -07:00
Elliott Clark a268d151e2 HBASE-14683 Fix Batching in buffered mutator is awful when adding lists of mutations.
Summary: Send the list of mutations to AsyncProcess only after done adding the list otherwise there's a lot of contention

Test Plan: UnitTests.

Differential Revision: https://reviews.facebook.net/D49251
2015-10-24 10:03:03 -07:00
Lars George 6f21cfbf27 HBASE-14343 Fix debug message in SimpleRegionNormalizer for small regions (Lars Francke) 2015-10-24 11:28:02 +02:00
tedyu bc990a3328 HBASE-14655 Narrow the scope of doAs() calls to region observer notifications for compaction 2015-10-23 15:00:04 -07:00
Nicolas Liochon cdf2c01a76 HBASE-14580 Make the HBaseMiniCluster compliant with Kerberos 2015-10-23 11:42:30 -07:00
stack 9e3c381bee HBASE-14657 Remove unneeded API from EncodedSeeker (Heng Chen) 2015-10-22 21:32:51 -07:00
stack 34fe1f5fd7 Revert "more"
Remove overcommit..... made mistakenly.

This reverts commit 1b3557649c.
2015-10-22 17:08:54 -07:00
stack 3f7994b5ab HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; ADD TestDistributedLogSplitting to the mix 2015-10-22 17:02:44 -07:00
stack 81d7d7ba7e HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs 2015-10-22 12:33:36 -07:00
stack 1b3557649c more 2015-10-22 12:31:22 -07:00
Matteo Bertozzi 0f5191dd9a HBASE-14667 HBaseFsck constructors have diverged 2015-10-22 09:39:02 -07:00
stack aed33c9cca HBASE-14663 HStore::close does not honor config hbase.rs.evictblocksonclose (Vladimir Rodionov) 2015-10-21 21:58:09 -07:00
stack 35c34ba84e HBASE-14662 Fix NPE in HFileOutputFormat2 (Heng Chen) 2015-10-21 21:53:00 -07:00
ramkrishna 97fc755013 HBASE-14643 Avoid Splits from once again opening a closed reader for
fetching the first and last key (Heng Chen)
2015-10-21 14:45:21 +05:30
Elliott Clark 118d7b20b0 HBASE-14633 Try fluid width UI 2015-10-20 17:46:00 -07:00
stack ec1f8df523 HBASE-14656 Move TestAssignmentManager from medium to large category 2015-10-20 12:39:16 -07:00
stack 4950db5110 HBASE-14634 Disable flakey TestSnapshotCloneIndependence.testOnlineSnapshotDeleteIndependent; ADDENDUM 2015-10-20 12:19:30 -07:00
tedyu b076d7dbd1 HBASE-14604 Improve MoveCostFunction in StochasticLoadBalancer (Guanghao Zhang) 2015-10-20 02:37:35 -07:00
stack 74ad3947e9 HBASE-14646 Move TestCellACLs from medium to large category; ADDENDUM 2015-10-19 11:20:33 -07:00
stack 8940be0597 HBASE-14647 Disable TestWALProcedureStoreOnHDFS#testWalRollOnLowReplication 2015-10-19 10:42:05 -07:00
stack b921ed4222 HBASE-14646 Move TestCellACLs from medium to large category 2015-10-19 10:41:13 -07:00
Matteo Bertozzi d01063c9a3 HBASE-14541 TestHFileOutputFormat.testMRIncrementalLoadWithSplit failed due to too many splits and few retries 2015-10-19 09:24:47 -07:00
tedyu 61b11e0765 HBASE-14631 Region merge request should be audited with request user through proper scope of doAs() calls to region observer notifications 2015-10-19 08:41:58 -07:00
stack 39f6a4eb0b HBASE-14642 Disable flakey TestMultiParallel#testActiveThreadsCount 2015-10-18 20:18:15 -07:00
stack 836afcc901 HBASE-14637 Loosen TestChoreService assert AND have TestDataBlockEncoders do less work (and add timeouts) 2015-10-17 16:27:23 -07:00
Stephen Yuan Jiang 9bdb88a572 HBASE-14536 Balancer & SSH interfering with each other leading to unavailability 2015-10-16 22:38:40 -07:00
stack e8c69a5921 HBASE-14634 Disable flakey TestSnapshotCloneIndependence.testOnlineSnapshotDeleteIndependent 2015-10-16 21:15:13 -07:00
Ashu Pachauri bce9ceef41 HBASE-14621 ReplicationLogCleaner stuck on RS crash.
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-10-16 15:26:17 -07:00
Elliott Clark f4a4c3a489 HBASE-14597 Fix Groups cache in multi-threaded env 2015-10-16 15:19:19 -07:00
Devaraj Das 2c301d535b HBASE-13330. Region left unassigned due to AM & SSH each thinking the assignment would be done by the other 2015-10-16 13:49:18 -07:00
tedyu 7fe5fa0069 HBASE-14605 Split fails due to 'No valid credentials' error when SecureBulkLoadEndpoint#start tries to access hdfs 2015-10-16 02:55:28 -07:00
stack c8bdb91737 HBASE-14622 Purge TestZkLess* tests from branch-1 2015-10-15 13:00:39 -07:00
stack a3f588b26f HBASE-14608 testWalRollOnLowReplication has some risk to assert failed after HBASE-14600 (Heng Chen) 2015-10-14 23:02:43 -07:00
stack bd78320caa HBASE-14600 Make #testWalRollOnLowReplication looser still; ADDENDUM 2015-10-14 17:41:24 -07:00
tedyu be04ede5b9 HBASE-14594 Use new DNS API introduced in HADOOP-12437 (Josh Elser) 2015-10-14 14:24:24 -07:00
stack 0818df79d3 HBASE-14606 TestSecureLoadIncrementalHFiles tests timed out in trunk build on apache 2015-10-14 10:00:35 -07:00
stack f24fb713c8 HBASE-14569 Disable hanging test TestNamespaceAuditor 2015-10-13 23:44:52 -07:00
Liu Shaohui 1a163b7ab7 HBASE-14591 Region with reference hfile may split after a forced split in IncreasingToUpperBoundRegionSplitPolicy 2015-10-14 10:36:32 +08:00
stack 778a595a52 HBASE-14596 TestCellACLs failing... on1.2 builds; FIX 2015-10-13 17:07:58 -07:00
stack db880599bf HBASE-14600 Make #testWalRollOnLowReplication looser still 2015-10-13 15:51:14 -07:00
stack 50866daab3 HBASE-14596 TestCellACLs failing... on1.2 builds; TUNEUP -- ADD DEBUG INFO 2015-10-13 13:33:57 -07:00
stack 6f28281052 HBASE-14588 Stop accessing test resources from within src folder (Andrew Wang) 2015-10-12 23:11:08 -07:00
stack 80a51d227e HBASE-14596 TestCellACLs failing... on1.2 builds; TUNEUP 2015-10-12 22:38:29 -07:00
Enis Soztutar bbbb52cfbf HBASE-14501 NPE in replication with TDE
Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValue.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValueUtil.java
2015-10-12 20:44:35 -07:00
anoopsjohn 5dba2c71f7 HBASE-13819 Make RPC layer CellBlock buffer a DirectByteBuffer. 2015-10-13 07:59:11 +05:30
stack b1cfe94c92 HBASE-14587 Attach a test-sources.jar for hbase-server (Andrew Wang) 2015-10-12 14:00:40 -07:00
Elliott Clark 8019009563 HBASE-14211 Add more rigorous integration tests of splits
Summary:
Intgration tests don't currently have a lot of splits going on while there is IO.
This changes that by changing the split aglorithm and the max region hfile size. That should make things split more.

Additionally this allows ITBLL to start with just one region if hbase.test.pre-split-table is False.

Test Plan: Test on a cluster with ITBLL slow determinitic monkey and stress am monkey.

Differential Revision: https://reviews.facebook.net/D44181
2015-10-12 13:25:10 -07:00
stack a7bf4198b5 HBASE-14582 Regionserver status webpage bucketcache list can become huge 2015-10-12 12:46:02 -07:00
Elliott Clark 9c6f73d576 HBASE-14585 Clean up TestSnapshotCloneIndependence 2015-10-12 11:25:50 -07:00
tedyu cb3e734ff0 HBASE-14578 URISyntaxException during snapshot restore for table with user defined namespace (Pankaj Kumar) 2015-10-10 15:21:37 -07:00
anoopsjohn 90f0644d9a HBASE-14366 NPE in case visibility expression is not present in labels table during importtsv run. (Bhupendra) 2015-10-10 12:08:23 +05:30
stack 14819ce853 HBASE-13858 RS/MasterDumpServlet dumps threads before its “Stacks” header 2015-10-09 15:46:51 -07:00
stack cd298eae4f HBASE-14517 Show regionserver's version in master status page (Liu Shaohui) 2015-10-09 15:11:14 -07:00
anoopsjohn ced6794230 HBASE-14525 Append and increment operation throws NullPointerException on non-existing column families.(Abhishek) 2015-10-09 20:55:22 +05:30
Elliott Clark 226f7a019a HBASE-14529 Respond to SIGHUP to reload config
Summary: Add a signal handler to reload the config.

Test Plan: Send the command and see that configs get reloaded.

Differential Revision: https://reviews.facebook.net/D47877
2015-10-08 16:38:26 -07:00
tedyu 841f3924cd HBASE-14565 Make ZK connection timeout configurable in MiniZooKeeperCluster 2015-10-08 14:34:49 -07:00
Nick Dimiduk a048c32a99 HBASE-12911 Client-side metrics 2015-10-07 17:05:51 -07:00
stack d79be59f85 HBASE-14572 TestImportExport#testImport94Table can't find its src data file; ADDENDUM -- fix broke build 2015-10-07 09:03:38 -07:00
stack fcb335c4fd HBASE-14572 TestImportExport#testImport94Table can't find its src data file 2015-10-06 23:30:18 -07:00
stack fd002eaead HBASE-14502 Purge use of jmock and remove as dependency (Gabor Liptak) 2015-10-06 23:10:16 -07:00
stack 2d21cb296e HBASE-14571 Purge TestProcessBasedCluster; it does nothing and then fails 2015-10-06 22:52:27 -07:00
stack ab33a65a1a HBASE-14436 HTableDescriptor#addCoprocessor will always make RegionCoprocessorHost create new Configuration 2015-10-06 14:00:57 -07:00
tedyu 5e2db42d68 HBASE-14497 Reverse Scan threw StackOverflow caused by readPt checking (Yerui Sun) 2015-10-06 13:56:02 -07:00
stack aeb3a62459 HBASE-14563 Disable zombie TestHFileOutputFormat2 2015-10-06 13:37:35 -07:00
Stephen Yuan Jiang a6d90bcc97 HBASE-14432 Procedure V2 - enforce ACL on procedure admin tasks (Stephen Yuan Jiang) 2015-10-06 09:11:38 -07:00
stack 80961187aa HBASE-14559 branch-1 test tweeks; disable assert explicit region lands post-restart and up a few handlers 2015-10-05 22:34:41 -07:00
Elliott Clark 12fd46cdca HBASE-14555 Fix Deadlock in MVCC branch-1.2 toString() 2015-10-05 17:49:48 -07:00
Matteo Bertozzi 86b505c224 HBASE-14547 Add more debug/trace to zk-procedure 2015-10-04 20:56:01 -07:00
Mikhail Antonov b9bfd6f7e3 HBASE-14367 Add normalization support to shell 2015-10-04 01:24:15 -07:00
stack 5f95ec6265 HBASE-14545 TestMasterFailover often times out 2015-10-03 13:33:09 -07:00
Lars Hofhansl 5b3579c327 HBASE-14539 Slight improvement of StoreScanner.optimize. 2015-10-02 20:24:19 -07:00
smaddineni 373c75dde6 HBASE-13770 Programmatic JAAS configuration option for secure zookeeper may be broken
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/HQuorumPeer.java
2015-10-02 18:00:47 -07:00
Andrew Purtell d7c7cc8c8c HBASE-13744 TestCorruptedRegionStoreFile is flaky 2015-10-02 15:07:13 -07:00
stack 54dc20e920 HBASE-14519 Purge TestFavoredNodeAssignmentHelper, a test for an abandoned feature that can hang 2015-10-02 13:30:05 -07:00
Andrew Purtell 9b297493e2 HBASE-13143 TestCacheOnWrite is flaky and needs a diet
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheOnWrite.java
2015-10-01 18:45:48 -07:00
Andrew Purtell 7aaef0f920 HBASE-14475 Region split requests are always audited with hbase user rather than request user (Ted Yu) 2015-10-01 15:12:29 -07:00
Sanjeev Srivatsa d047c37871 HBASE-14459 Add response and request size metrics
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-30 18:23:17 -07:00
Elliott Clark cca2ba4d93 HBASE-14512 Cache UGI groups
Summary:
Don't create a user for every call. Instead create one user per connection.
Then inside of SecureHadoopUser cache the groupNames. This allows HBase to cache
empty groups.  This is needed since it's much more likely that HBase will be accessed
by a user that's not present on the posix /etc/group file.

Test Plan: Unit Tests

Differential Revision: https://reviews.facebook.net/D47751
2015-09-30 12:52:50 -07:00
stack 4812d9a178 HBASE-14465 Backport 'Allow rowlock to be reader/write' to branch-1 2015-09-30 11:48:46 -07:00
chenheng 2ff8580d72 HBASE-14230 replace reflection in FSHlog with HdfsDataOutputStream#getCurrentBlockReplication() 2015-09-30 17:05:32 +02:00
stack 19ac591876 HBASE-14518 Give TestScanEarlyTermination the same treatment as 'HBASE-14378 Get TestAccessController* passing again...' -- up priority handlers 2015-09-29 22:45:04 -07:00
Jerry He c75382860f HBASE-14394 Properly close the connection after reading records from table: addendum 2015-09-29 19:49:28 -07:00
stack 4bd8461566 HBASE-14513 TestBucketCache runs obnoxious 1k threads in a unit test 2015-09-29 16:20:00 -07:00
stack 255fd07d35 HBASE-14362 org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS is super duper flaky (Heng Chen) 2015-09-29 14:52:01 -07:00
Elliott Clark bf6a713bfc HBASE-14473 Compute region locality in parallel 2015-09-29 13:09:09 -07:00
ramkrishna d0d79f46c4 HBASE-14437 - ArithmeticException in ReplicationInterClusterEndpoint (Ram) 2015-09-29 16:46:29 +05:30
stack 642273bc2a HBASE-14430 TestHttpServerLifecycle#testStartedServerIsAlive times out 2015-09-28 21:38:36 -07:00
Lars Hofhansl 45fdcfc23c HBASE-14489 postScannerFilterRow consumes a lot of CPU. 2015-09-26 16:25:17 -07:00
Andrew Purtell 0dd57174fa HBASE-14407 NotServingRegion: hbase region closed forever (Shuaifeng Zhou) 2015-09-25 17:57:56 -07:00
Stephen Yuan Jiang 36eeb7917a HBASE-14051 Undo workarounds in IntegrationTestDDLMasterFailover for client double submit (Stephen Yuan jiang) 2015-09-25 15:09:34 -07:00
Andrew Purtell 70c3ed1c9c HBASE-12748 RegionCoprocessorHost.execOperation creates too many iterator objects 2015-09-25 13:31:01 -07:00
stack e33d8bd3e0 HBASE-14378 Get TestAccessController* passing again on branch-1; ADDENDUM... missed org.apache.hadoop.hbase.security.access.TestWithDisabledAuthorization 2015-09-25 09:34:01 -07:00
tedyu 2b84576e3d HBASE-14456 Implement a namespace-based region grouping strategy for RegionGroupingProvider (Yu Li) 2015-09-25 08:45:50 -07:00
tedyu 52188c5c4a HBASE-14370 Use separate thread for calling ZKPermissionWatcher#refreshNodes() 2015-09-25 06:56:33 -07:00
stack 68cb682c07 HBASE-14378 Get TestAccessController* passing again on branch-1 2015-09-24 17:39:09 -07:00
stack 8290139d4b HBASE-14486 Disable TestRegionPlacement, a flakey test for an unfinished feature 2015-09-24 15:56:08 -07:00
stack 565aaf1abe HBASE-14421 Follow-on from HBASE-14421, just disable TestFastFail* until someone digs in and fixes it; ADDENDUM -- missing import 2015-09-24 14:11:18 -07:00
stack 01ae4efb5a HBASE-14421 Follow-on from HBASE-14421, just disable TestFastFail* until someone digs in and fixes it 2015-09-24 13:52:34 -07:00
Andrew Purtell fc79ba338a HBASE-14205 RegionCoprocessorHost System.nanoTime() performance bottleneck 2015-09-24 11:16:47 -07:00
Stephen Yuan Jiang e38fd84d3f HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-24 07:17:23 -07:00
stack 744a40917c HBASE-14472 TestHCM and TestRegionServerNoMaster fixes
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
2015-09-23 11:45:57 -07:00
Matteo Bertozzi 0fa48ae56a HBASE-14464 Removed unused fs code 2015-09-23 09:56:24 -07:00
tedyu 8ed3729105 HBASE-14445 ExportSnapshot does not honor -chmod option 2015-09-22 12:59:17 -07:00
stack da7003ade2 HBASE-14461 Cleanup IncreasingToUpperBoundRegionSplitPolicy (Lars Francke) 2015-09-22 09:41:15 -07:00
tedyu 4b5dd8ee5a HBASE-14280 Bulk Upload from HA cluster to remote HA hbase cluster fails (Ankit Singhal) 2015-09-22 09:21:05 -07:00
Jerry He 73ec3fdd5c Revert: HBASE-14391 Empty regionserver WAL will never be deleted although the coresponding regionserver has been stale 2015-09-21 19:34:55 -07:00
Jerry He 9574c67610 HBASE-14391 Empty regionserver WAL will never be deleted although the coresponding regionserver has been stale (Qianxi Zhang) 2015-09-21 15:06:20 -07:00
tedyu ec86d174b4 HBASE-14280 Revert due to TestFSHDFSUtils failure 2015-09-21 09:51:27 -07:00
tedyu 81d04cde27 HBASE-14448 Refine RegionGroupingProvider Phase-2: remove provider nesting and formalize wal group name (Yu Li) 2015-09-21 06:45:02 -07:00
tedyu 566a20145c HBASE-14280 Bulk Upload from HA cluster to remote HA hbase cluster fails (Ankit Singhal) 2015-09-19 10:55:54 -07:00
Nick Dimiduk 7fb12e3331 Revert "HBASE-14230 replace reflection in FSHlog with HdfsDataOutputStream#getCurrentBlockReplication()"
This reverts commit 945477e2e6.

Also reintroduces the NO_ARGS instance that was removed in HBASE-14401
2015-09-18 14:27:45 -07:00
Enis Soztutar bb4a690b79 HBASE-14082 Add replica id to JMX metrics names (Lei Chen) 2015-09-16 17:43:32 -07:00
Elliott Clark d4d398d942 HBASE-14334 Move Memcached block cache in to it's own optional module. 2015-09-16 15:26:31 -07:00
tedyu 6598f18e56 HBASE-13250 chown of ExportSnapshot does not cover all path and files (He Liangliang) 2015-09-16 13:05:15 -07:00
stack 82554e2750 HBASE-14433 Set down the client executor core thread count from 256 in tests: REAPPLY AGAIN (WAS MISSING JIRA) 2015-09-16 10:15:00 -07:00
stack b6549007b3 Revert "Set down the client executor core thread count from 256 in tests: REAPPLY"
Missing JIRA. Will reapply in a sec with commit log fixed.

This reverts commit c100fb835a.
2015-09-16 10:14:32 -07:00
stack c100fb835a Set down the client executor core thread count from 256 in tests: REAPPLY 2015-09-16 08:57:39 -07:00
tedyu 0452ba09b5 HBASE-14411 Fix unit test failures when using multiwal as default WAL provider (Yu Li) 2015-09-16 07:09:20 -07:00
Apekshit(Appy) Sharma 1517deee67 HBASE-14400 Fix HBase RPC protection documentation
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/SaslUtil.java
2015-09-15 18:30:24 -07:00
Sanjeev Srivatsa 9e7f9b621a HBASE-14145 added flag to canary to try all regions in regionserver mode
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-09-15 16:32:44 -07:00
Srikanth Srungarapu 1e90df8aa8 HBASE-14394 Properly close the connection after reading records from table. 2015-09-15 11:11:42 -07:00
stack 236f005088 HBASE-14361 ReplicationSink should create Connection instances lazily 2015-09-15 05:16:17 -07:00
stack 042a63c24d HBASE-14401 Stamp failed appends with sequenceid too.... Cleans up latches 2015-09-14 22:22:24 -07:00
stack 233c1ee875 HBASE-14421 TestFastFail* are flakey; ADDENDUM 3 Exclude another should assert in TestFastFail 2015-09-14 08:34:02 -07:00
tedyu 5767927898 HBASE-14306 Refine RegionGroupingProvider: fix issues and make it more scalable (Yu Li) 2015-09-14 07:27:45 -07:00
stack 33fe3874c1 HBASE-14421 TestFastFail* are flakey; ADDENDUM 2015-09-13 10:12:56 -07:00
tedyu d98ea9bb4e HBASE-14287 Bootstrapping a cluster leaves temporary WAL directory laying around 2015-09-13 08:51:54 -07:00
stack 75d3d7d106 HBASE-14423 TestStochasticBalancerJmxMetrics.testJmxMetrics_PerTableMode:183 NullPointer
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestStochasticBalancerJmxMetrics.java
2015-09-13 07:37:02 -07:00
stack 37badc04ae HBASE-14421 TestFastFail* are flakey 2015-09-12 22:36:10 -07:00
tedyu be96bb6adf HBASE-6617 ReplicationSourceManager should be able to track multiple WAL paths (Yu Li) 2015-09-11 09:30:58 -07:00
tedyu 84dbe39f5d HBASE-14380 Correct data gets skipped along with bad data in importTsv bulk load thru TsvImporterTextMapper (Bhupendra Kumar Jain) 2015-09-11 09:10:20 -07:00
tedyu 272ca1f61a HBASE-14307 Addendum fixes compilation for TestHFileBlockPositionalRead 2015-09-11 04:43:35 -07:00
ramkrishna 954a6e0a75 HBASE-14307 - Incorrect use of positional read api in HFileBlock (Chris
Nauroth)
2015-09-11 15:59:07 +05:30
stack d9bc84b1fc HBASE-14392 [tests] TestLogRollingNoCluster fails on master from time to time 2015-09-10 20:26:01 -07:00
stack 66ed392412 Revert "HBASE-14361 Investigate unused connection objects"
This reverts commit 6c16d244bb.
2015-09-10 14:17:32 -07:00
chenheng 6c16d244bb HBASE-14361 Investigate unused connection objects
Signed-off-by: stack <stack@apache.org>
2015-09-10 09:18:50 -07:00
chenheng 945477e2e6 HBASE-14230 replace reflection in FSHlog with HdfsDataOutputStream#getCurrentBlockReplication()
Signed-off-by: stack <stack@apache.org>
2015-09-10 08:28:00 -07:00
stack 28afeebf76 HBASE-14393 Have TestHFileEncryption clean up after itself so it don't go all zombie on us 2015-09-10 08:27:41 -07:00
Srikanth Srungarapu e2250e71f8 HBASE-14385 Close the sockets that is missing in connection closure. 2015-09-09 23:39:05 -07:00
tedyu 00bdf14f96 HBASE-14314 Metrics for block cache should take region replicas into account 2015-09-09 13:32:02 -07:00
Sanjeev Srivatsa 2da41e5c9a HBASE-14384 changed Canary to use instance of ExtendedSink
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-09-09 12:17:44 -07:00
Elliott Clark 5b6a46237b HBASE-14322 Add a master priority function to let master use it's threads 2015-09-09 12:13:15 -07:00
stack bbafb47f72 HBASE-14317 Stuck FSHLog: bad disk (HDFS-8960) and can't roll WAL 2015-09-04 22:59:22 -07:00
stack 1f56b55e50 HBASE-14078 improve error message when HMaster can't bind to port 2015-09-04 22:59:21 -07:00
Srikanth Srungarapu b84908857e HBASE-14261 Enhance Chaos Monkey framework by adding zookeeper and datanode fault injections; ADDENDUM 2015-09-04 14:02:48 -07:00
Lars Hofhansl 16d4ed6337 HBASE-12988 [Replication]Parallel apply edits across regions. 2015-09-04 13:23:36 -07:00
stack 1ac42c9634 HBASE-14327 TestIOFencing#testFencingAroundCompactionAfterWALSync is flaky (Heng Chen) 2015-09-04 10:28:31 -07:00
Matteo Bertozzi 8a4aee6082 HBASE-14344 Add timeouts to TestHttpServerLifecycle 2015-09-03 12:07:43 -07:00
Srikanth Srungarapu 1717de65a4 HBASE-14261 Enhance Chaos Monkey framework by adding zookeeper and datanode fault injections. 2015-09-03 11:49:40 -07:00
Stephen Yuan Jiang 90b8a3c894 HBASE-14108 Procedure V2 - Administrative Task: provide an API to abort a procedure (Stephen Yuan Jiang) 2015-09-03 07:01:30 -07:00
tedyu 1003d5a6d5 HBASE-14229 Flushing canceled by coprocessor still leads to memstoreSize set down (Yerui Sun) 2015-09-02 07:29:52 -07:00
tedyu a31adde0bd HBASE-14342 Recursive call in RegionMergeTransactionImpl.getJournal() (Lars Francke) 2015-09-01 11:12:29 -07:00
tedyu d3a7222bfc HBASE-14309 Allow load balancer to operate when there is region in transition by adding force flag 2015-08-29 17:08:40 -07:00
Lars Hofhansl c277166fd1 HBASE-14315 Save one call to KeyValueHeap.peek per row. 2015-08-28 15:17:50 -07:00
tedyu b8c7a08a9e HBASE-14269 FuzzyRowFilter omits certain rows when multiple fuzzy keys exist (hongbin ma) 2015-08-26 20:49:43 -07:00
Stephen Yuan Jiang e4b96cf78a HBASE-13212 Procedure V2 - master Create/Modify/Delete namespace (Stephen Yuan Jiang) 2015-08-26 13:54:50 -07:00
stack c127577862 HBASE-14290 Spin up less threads in tests
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
2015-08-25 16:32:06 -07:00
stack d204e67091 HBASE-14273 Rename MVCC to MVCC: From MultiVersionConsistencyControl to MultiVersionConcurrencyControl (Lars Francke) 2015-08-25 16:08:09 -07:00
Enis Soztutar 65a96b4883 HBASE-14302 TableSnapshotInputFormat should not create back references when restoring snapshot
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/RestoreSnapshotHelper.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/ModifyRegionUtils.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TableSnapshotInputFormatTestBase.java
2015-08-25 13:16:53 -07:00
stack 64f9d43d01 HBASE-13480 ShortCircuitConnection doesn't short-circuit all calls as expected (Jingcheng Du) 2015-08-25 08:01:00 -07:00
stack 5dcb3d85a1 HBASE-14224 Fix coprocessor handling of duplicate classes 2015-08-24 14:12:57 -07:00
Elliott Clark 585f8fa8a5 HBASE-14239 Fix Branch-1.2 AM can get stuck when meta moves 2015-08-24 12:53:05 -07:00
tedyu 303ef340db HBASE-14293 TestStochasticBalancerJmxMetrics intermittently fails due to port conflict 2015-08-24 06:27:22 -07:00
tedyu 0b081303b9 HBASE-14291 NPE On StochasticLoadBalancer Balance Involving RS With No Regions 2015-08-22 14:50:57 -07:00
Andrew Purtell 234a4632a4 HBASE-13996 Add write sniffing in canary (Liu Shaohui)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2015-08-21 22:57:28 -07:00
Sean Busbey ca9fdb142e HBASE-14250 ensure hbase-server test-jar has its own LICENSE file and not the one for the non-test jar. 2015-08-21 17:09:48 -05:00
Sean Busbey 71fbd4ac63 HBASE-14251 ensure javadoc jars have LICENSE/NOTICE that match content. 2015-08-20 11:20:47 -05:00
Gábor Lipták d4c99fc633 HBASE-14148 Default HBase web pages to be non-framable.
* Sends X-Frame-Options header
* configured via hbase.http.filter.xframeoptions.mode
* defaults to DENY

Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-08-19 21:30:34 -05:00
tedyu b79326f09b HBASE-14165 The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues + numReadQueues + numScanQueues) (Cui Jianwei) 2015-08-19 14:35:50 -07:00
Ashish Singhi 22d39c0712 HBASE-14210 Create test for cell level ACLs involving user group
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-08-18 16:54:44 -07:00
Jerry He 2599ed7102 HBASE-14228 Close BufferedMutator and connection in MultiTableOutputFormat 2015-08-18 13:32:39 -07:00
Elliott Clark 81f3afa5da HBASE-14166 Per-Region metrics can be stale -- ADDENDUM 2015-08-17 12:19:42 -07:00
Elliott Clark d6c2beb4bf HBASE-14166 Per-Region metrics can be stale 2015-08-17 11:22:21 -07:00
Nick Dimiduk 0b6d9b25f5 HBASE-10844 Coprocessor failure during batchmutation leaves the memstore datastructs in an inconsistent state
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-08-14 15:55:58 -07:00
stack 4588b7ab90 HBASE-13966 Limit column width in table.jsp (Matt Warhaftig) 2015-08-14 09:03:08 -07:00
tedyu 22259e0dbd HBASE-13376 Improvements to Stochastic load balancer (Vandana Ayyalasomayajula) 2015-08-13 14:35:51 -07:00
Enis Soztutar a0086e97ad HBASE-14054 Acknowledged writes may get lost if regionserver clock is set backwards
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2015-08-13 11:23:55 +03:00
Elliott Clark 0dbaf0ea51 HBASE-14098 Allow dropping caches behind compactions 2015-08-12 19:42:11 -07:00
Andrew Purtell ca19f961a2 HBASE-13985 Add configuration to skip validating HFile format when bulk loading (Victor Xu) 2015-08-12 18:37:06 -07:00
Andrew Purtell ba4cc6321b HBASE-14122 Client API for determining if server side supports cell level security 2015-08-12 13:27:51 -07:00
Andrew Purtell ba328d26ea HBASE-14209 TestShell visibility tests failing 2015-08-12 13:25:29 -07:00
Simon Law 881d2c1d74 HBASE-14201 hbck should not take a lock unless fixing errors
By default, hbck is run in a read-only checker mode. In this case, it is
sensible to let others run. By default, the balancer is left alone,
which may cause spurious errors, but cannot leave the balancer in a bad
state. It is dangerous to leave the balancer by accident, so it is only
ever enabled after fixing, it will never be forced off because of
racing.

When hbck is run in fixer mode, it must take an exclusive lock and
disable the balancer, or all havoc will break loose.

If you want to stop hbck from running in parallel, the -exclusive flag
will create the lock file. If you want to force -disableBalancer, that
option is available too. This makes more semantic sense than -noLock and
-noSwitchBalancer, respectively.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-08-12 11:51:27 -07:00
tedyu 90b8cc89bd HBASE-14206 MultiRowRangeFilter returns records whose rowKeys are out of allowed ranges (Anton Nazaruk) 2015-08-11 10:01:55 -07:00
Ashish Singhi 0862abd659 HBASE-5878 Use getVisibleLength public api from HdfsDataInputStream from Hadoop-2.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-08-10 16:20:23 -07:00
tedyu afa6fa6baa HBASE-14200 Separate RegionReplica subtests of TestStochasticLoadBalancer into TestStochasticLoadBalancer2 2015-08-10 07:46:01 -07:00
tedyu 05a9638085 HBASE-14197 TestRegionServerHostname#testInvalidRegionServerHostnameAbortsServer fails in Jenkins 2015-08-07 18:47:38 -07:00
Andrew Purtell 68cb53d151 HBASE-12865 WALs may be deleted before they are replicated to peers (He Liangliang) 2015-08-07 15:08:29 -07:00
Andrew Purtell b194052ec0 HBASE-13825 Use ProtobufUtil#mergeFrom and ProtobufUtil#mergeDelimitedFrom in place of builder methods of same name
Incorporates HBASE-14076
2015-08-06 21:48:04 -07:00
Gábor Lipták 51061f08a3 HBASE-13865 Increase the default value for hbase.hregion.memstore.block.multipler from 2 to 4 (part 2) 2015-08-06 10:04:41 -07:00
chenheng 5c0c389b7a HBASE-14178 regionserver blocks because of waiting for offsetLock
Signed-off-by: zhangduo <zhangduo@apache.org>
2015-08-06 17:17:52 +08:00
zhangduo 4623c843c1 Revert "HBASE-14178 regionserver blocks because of waiting for offsetLock"
This reverts commit fe9de40e6c.
2015-08-06 17:10:59 +08:00
chenheng fe9de40e6c HBASE-14178 regionserver blocks because of waiting for offsetLock
Signed-off-by: zhangduo <zhangduo@apache.org>
2015-08-06 16:51:50 +08:00
tedyu 6a2b618d97 HBASE-13965 Stochastic Load Balancer JMX Metrics (Lei Chen) 2015-08-05 19:22:44 -07:00
Sean Busbey a45651c2cf HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)

Conflicts:
	NOTICE.txt
	hbase-checkstyle/pom.xml
	hbase-resource-bundle/pom.xml
	hbase-server/pom.xml
	hbase-thrift/pom.xml
	pom.xml
2015-08-05 14:52:33 -07:00
tedyu c8aa58b306 HBASE-14021 Quota table has a wrong description on the UI (Ashish Singhi) 2015-08-04 18:21:34 -07:00
tedyu 03c6c532bf HBASE-14185 Incorrect region names logged by MemStoreFlusher (Biju Nair) 2015-08-04 17:20:49 -07:00
tedyu 24dbe25e95 HBASE-13965 Revert due to test failure in TestAssignmentManager 2015-08-03 15:32:43 -07:00
tedyu c215b900f4 HBASE-13965 Stochastic Load Balancer JMX Metrics (Lei Chen) 2015-08-03 12:50:44 -07:00
Ashish Singhi f274796941 HBASE-14154 DFS Replication should be configurable at column family level
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileWriterImpl.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin1.java
2015-07-31 18:19:07 -07:00
Sean Busbey 9091409800 HBASE-14087 Ensure correct ASF headers for docs/code
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint

Conflicts:
	bin/considerAsDead.sh
	dev-support/rebase_all_git_branches.sh
2015-07-31 11:22:50 -07:00
tedyu 4fcafb4f05 HBASE-14168 Avoid useless retry for DoNotRetryIOException in TableRecordReaderImpl (zhouyingchao) 2015-07-31 09:24:39 -07:00
Andrew Purtell 67f4a077b9 HBASE-14155 StackOverflowError in reverse scan (Ramkrishna S. Vasudevan and Ted Yu) 2015-07-29 18:22:55 -07:00
Jerry He 3d40dd8394 HBASE-14153 Typo in ProcedureManagerHost.MASTER_PROCEUDRE_CONF_KEY (Konstantin Shvachko) 2015-07-29 15:44:04 -07:00
tedyu 93f53e263f HBASE-14164 Display primary region replicas distribution on table.jsp 2015-07-29 14:26:02 -07:00
Srikanth Srungarapu da811332cf HBASE-14057 HBase shell user_permission should list super users defined on hbase-site.xml 2015-07-28 11:43:24 -07:00
tedyu f772e62567 HBASE-14157 Interfaces implemented by subclasses should be checked when registering CoprocessorService 2015-07-28 11:10:44 -07:00
Esteban Gutierrez 8764b9fd80 HBASE-13089 Fix test compilation error on building against htrace-3.2.0-incubating 2015-07-28 10:07:48 -05:00
Elliott Clark 7b8311eb90 HBASE-14146 Fix Once replication sees an error it slows down forever 2015-07-23 16:12:12 -07:00
abhilak 89ecb93c95 HBASE-14058 Stabilizing default heap memory tuner
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-07-22 11:37:44 -07:00
tedyu 45d52129dd HBASE-14115 Fix resource leak in HMasterCommandLine (Yuhao Bi) 2015-07-22 05:59:13 -07:00
Elliott Clark 12e7153bac HBASE-14092 Add -noLock and -noBalanceSwitch options to hbck 2015-07-17 10:58:02 -07:00
tedyu d4eed9b2dd HBASE-14000 Region server failed to report to Master and was stuck in reportForDuty retry loop (Pankaj Kumar) 2015-07-17 10:49:12 -07:00
tedyu 440e0bc6ea HBASE-14110 Add CostFunction for balancing primary region replicas 2015-07-17 09:57:08 -07:00
stack d887e4cf1a HBASE-14109 NPE if we don't load fully before we are shutdown 2015-07-17 06:27:14 -07:00
Andrew Purtell d4a04d6216 HBASE-14050 NPE in org.apache.hadoop.hbase.ipc.RpcServer.readAndProcess 2015-07-16 18:27:40 -07:00
zhangduo 12f6470bf3 HBASE-14100 Fix high priority findbugs warnings 2015-07-17 08:56:33 +08:00
tedyu 46e5a8f3e5 HBASE-13971 Flushes stuck since 6 hours on a regionserver 2015-07-16 16:43:23 -07:00
Ashish Singhi 789d2a94b7 HBASE-8642 [Snapshot] List and delete snapshot by table
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-15 15:56:08 -07:00
Sean Busbey 93e26ce550 HBASE-14027 clean up multiple netty jars. 2015-07-15 02:38:15 -05:00
Matteo Bertozzi b62f134545 HBASE-13415 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-13 11:19:02 -05:00
Sean Busbey 88ff206c57 Revert "Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)"
This reverts commit 4eb84651a2.
2015-07-13 11:16:21 -05:00
Enis Soztutar 2c076a30e5 HBASE-13993 WALProcedureStore fencing is not effective if new WAL rolls 2015-07-10 13:44:32 -07:00
tedyu ebd338d0d1 HBASE-12596 bulkload needs to follow locality (Victor Xu) 2015-07-10 06:27:19 -07:00
Matteo Bertozzi 22f0f3026f HBASE-13832 Procedure v2: try to roll the WAL master on sync failure before aborting 2015-07-09 08:55:56 -07:00
Matteo Bertozzi 4eb84651a2 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang) 2015-07-09 08:13:32 -07:00
Andrew Purtell c66ff887e6 HBASE-14042 Fix FATAL level logging in FSHLog where logged for non fatal exceptions 2015-07-08 17:38:29 -07:00
tedyu 7ab78d9ddf HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) 2015-07-08 10:21:00 -07:00
Enis Soztutar 3da5058337 HBASE-13988 Add exception handler for lease thread (Liu Shaohui) 2015-07-06 19:18:18 -07:00
Enis Soztutar c59cd29153 HBASE-13352 Add hbase.import.version to Import usage (Lars Hofhansl)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Import.java
2015-07-06 15:58:19 -07:00
Matteo Bertozzi 80b0a3e914 HBASE-14017 Procedure v2 - MasterProcedureQueue fix concurrency issue on table queue deletion
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-06 15:31:54 -05:00
Matteo Bertozzi d347c66c90 HBASE-13849 Remove restore and clone snapshot from the WebUI
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-06 11:17:37 -05:00
Andrey Stepachev 8d71d283b9 HBASE-13646 HRegion#execService should not try to build incomplete messages
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-06 10:36:13 -05:00
stack 4e36815906 HBASE-14012 Double Assignment and Dataloss when ServerCrashProcedure runs during Master failover 2015-07-06 08:03:15 -07:00
Lars Hofhansl 29969dcf5c HBASE-13329 ArrayIndexOutOfBoundsException in CellComparator#getMinimumMidpointArray. 2015-07-05 12:18:59 -07:00
tedyu 9e54e195f6 HBASE-13702 ImportTsv: Add dry-run functionality and log bad rows (Apekshit Sharma) 2015-07-04 07:25:00 -07:00
Ashish Singhi ab9a0b80af HBASE-13925 Use zookeeper multi to clear znodes in ZKProcedureUtil
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
2015-07-03 12:29:55 -07:00
stack e0e6a5f09d HBASE-14013 Retry when RegionServerNotYetRunningException rather than go ahead with assign so for sure we don't skip WAL replay 2015-07-02 14:30:15 -07:00
stack bfaf837049 HBASE-14010 TestRegionRebalancing.testRebalanceOnRegionServerNumberChange fails; cluster not balanced 2015-07-02 10:06:05 -07:00
stack 7b4febbc2b HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- ADDENDUM 2015-07-02 10:05:58 -07:00
stack 09846ff81a HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- ADDENDUM 2015-07-02 10:05:58 -07:00
tedyu 5e9b6b8c3d HBASE-14005 Set permission to .top hfile in LoadIncrementalHFiles (Francesco MDE) 2015-07-02 08:41:48 -07:00
zhangduo 9aeda36613 HBASE-13970 NPE during compaction in trunk 2015-07-02 21:37:25 +08:00
stack 0f17b76796 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) 2015-07-01 17:30:16 -07:00
tedyu a883bb4e54 HBASE-13980 Distinguish blockedFlushCount vs unblockedFlushCount when tuning heap memory (Abhilash) 2015-07-01 13:03:57 -07:00
Bhupendra 0455e54c1d HBASE-13978: Variable never assigned in SimpleTotalOrderPartitioner.getPartition()
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-01 13:21:23 -05:00