Commit Graph

5028 Commits

Author SHA1 Message Date
Michael Stack ce71b8a1bc HBASE-5166 MultiThreaded Table Mapper analogous to MultiThreaded Mapper in hadoop
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293098 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:38:18 +00:00
mbautin a01166ec92 [jira] [HBASE-5442] Use builder pattern in StoreFile and HFile
Summary: Cleaning up the factory method explosion in HFile writer and StoreFile.
Now, adding a new parameter to HFile/StoreFile writer initialization will not
require modifying factory method invocations all over the codebase.

Test Plan:
Run unit tests
Deploy to dev cluster and run a load test

Reviewers: JIRA, stack, tedyu, Kannan, Karthik, Liyin

Reviewed By: stack

Differential Revision: https://reviews.facebook.net/D1893

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293095 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 06:06:53 +00:00
Michael Stack bbf0a0074e HBASE-5464 Log warning message when thrift calls throw exceptions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293093 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 05:48:13 +00:00
mbautin 85c90d9274 [jira] [HBASE-5470] Make DataBlockEncodingTool work correctly with no native
compression codecs loaded

Summary:
DataBlockEncodingTool was fixed as part of porting data block encoding
(HBASE-4218) to 89-fb
(https://reviews.facebook.net/rHBASEEIGHTNINEFBBRANCH1245291,
https://reviews.facebook.net/D1659). The bug being fixed here appeared when
using GZ as baseline compression codec but not loading native Hadoop libraries,
in which case the compressor instance would be null.

Test Plan:
Run DataBlockEncoding tool with GZ (no native codecs) and LZO (with native
codecs) as baseline (Hadoop-level) compression codecs

Reviewers: JIRA, Kannan, mcorgan, lhofhansl, todd, stack, tedyu

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D1917

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293057 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 02:03:37 +00:00
Zhihong Yu 398289ce6e HBASE-5317 Fix TestHFileOutputFormat to work against hadoop 0.23 (Gregory Chanan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293049 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 01:07:03 +00:00
Zhihong Yu 49904bcf1d HBASE-5466 Opening a table also opens the metatable and never closes it
(Ashley Taylor)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293047 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 00:55:58 +00:00
Jean-Daniel Cryans a4a4e97338 HBASE-5415 FSTableDescriptors should handle random folders in
hbase.root.dir better


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293042 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 00:41:31 +00:00
mbautin b77dca0c7f [jira] [HBASE-5357] Refactoring: use the builder pattern for HColumnDescriptor
Summary: Deprecate three ugly HColumnDescriptor constructors and use a "builder"
pattern instead, e.g. new
HColumnDescriptor(cfName).setMaxVersions(5).setBlockSize(8192), etc. Setters
have now become "builder" methods.

Test Plan: Run unit tests

Reviewers: JIRA, todd, stack, tedyu, Kannan, Karthik, Liyin

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D1851

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293026 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 23:18:27 +00:00
Zhihong Yu b0d4403059 HBASE-5437 HRegionThriftServer does not start because of a bug in HbaseHandlerMetricsProxy (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1293013 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 22:58:42 +00:00
Doug Meil 2b41fc22b4 hbase-5468 book.xml - updating copyright to 2012
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292998 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 22:31:57 +00:00
Doug Meil 16014f0448 hbase-5467 - change homepage to refer to 'reference guide'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292958 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 21:12:07 +00:00
Doug Meil bea5f9e592 hbase-5465 book.xml, preface.xml - changing "book" to "reference guide"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292921 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 19:43:37 +00:00
larsh 375d81ab29 HBASE-5460 Add protobuf as M/R dependency jar
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292656 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:44:56 +00:00
Michael Stack 30f21c3ef4 HBASE-5423 Regionserver may block forever on waitOnAllRegionsToClose when aborting
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292647 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:05:30 +00:00
Michael Stack 240d6bc52b HBASE-5424 HTable meet NPE when call getRegionInfo() -- REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292646 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 05:01:29 +00:00
Michael Stack 6a80cf5bf9 HBASE-5424 HTable meet NPE when call getRegionInfo()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 04:43:29 +00:00
Nicolas Spiegelberg c3575d2eb5 [jira] [HBASE-5332] Deterministic Compaction Jitter
Summary:
Changing the jitter in major compactions to be deterministic,
so reboots don't cause a time-based compaction storm.  This
implementation seeds a random number generator with HDFS data for
persistence.

Test Plan: - mvn test -Dtest=TestCompaction,TestCompactSelection,TestHeapSize

Reviewers: JIRA, Kannan, aaiyer, stack

Reviewed By: Kannan

Differential Revision: https://reviews.facebook.net/D1785

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292495 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 20:36:39 +00:00
Michael Stack 7b5ec59eda HBASE-5422 StartupBulkAssigner would cause a lot of timeout on RIT when assigning large numbers of regions (timeout = 3 mins)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292409 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:29:26 +00:00
larsh 0f708f7370 HBASE-5439 Fix some performance findbugs issues (Gregory Chanan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292141 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 07:00:44 +00:00
Michael Stack 953d89e3a9 HBASE-5189 Add metrics to keep track of region-splits in RS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1292139 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 06:51:02 +00:00
Michael Stack 6da328e0fb HBASE-5436 Right-size the map when reading attributes.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1291463 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 21:46:04 +00:00
larsh ad14643d55 HBASE-5431 Improve delete marker handling in Import M/R jobs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290955 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 05:51:56 +00:00
Michael Stack 145d25dfc2 HBASE-5209 HConnection/HMasterInterface should allow for way to get hostname of currently active master in multi-master HBase setup
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290942 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 04:10:46 +00:00
Michael Stack d69299dfdc HBASE-5003 If the master is started with a wrong root dir, it gets stuck and can't be killed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290882 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 21:32:42 +00:00
Michael Stack 588206f411 HBASE-5200 AM.ProcessRegionInTransition() and AM.handleRegion() race thus leaving the region assignment inconsistent
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1290854 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 20:13:54 +00:00
larsh 0e54a5f331 HBASE-3584 Addendum, remove RowMutation
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245876 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 07:25:41 +00:00
Michael Stack 9a7f01e293 HBASE-5294 Make sure javadoc is included in tarball bundle when we release
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245827 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:07:13 +00:00
Michael Stack f1815cf544 HBASE-5420 TestImportTsv does not shut down MR Cluster correctly (fails against 0.23 hadoop)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245795 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 23:02:37 +00:00
Michael Stack 0d17817fde HBASE-3584 Rename RowMutation to RowMutations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245792 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 22:58:01 +00:00
Michael Stack 9684065bec HBASE-5428 Allow for custom filters to be registered within the Thrift interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245774 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:39:30 +00:00
Michael Stack 0dd3c22706 HBASE-5195 [Coprocessors] preGet hook does not allow overriding or wrapping filter on incoming Get -- SECOND HALF OF THIS COMMIT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245773 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:34:46 +00:00
Michael Stack 0caad4616e HBASE-5279 NPE in Master after upgrading to 0.92.0 -- REVERT OVERCOMMIT TO HREGION
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245768 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:26:23 +00:00
Michael Stack 5994c50143 HBASE-5279 NPE in Master after upgrading to 0.92.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245767 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:24:21 +00:00
Michael Stack 7160ecd133 HBASE-5427 Upgrade our zk to 3.4.3
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245759 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 20:58:56 +00:00
Michael Stack d4c8317232 HBASE-5421 use hadoop-client/hadoop-minicluster artifacts for Hadoop 0.23 build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245743 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 20:21:52 +00:00
Michael Stack aa7a5b2926 HBASE-5120 Timeout monitor races with table disable handler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245731 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 20:03:57 +00:00
Jean-Daniel Cryans 6fa8f6a042 HBASE-4640 Catch ClosedChannelException and document it
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245730 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 19:56:54 +00:00
Jean-Daniel Cryans 5b542b7921 HBASE-5393 Consider splitting after flushing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245727 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 19:45:45 +00:00
Michael Stack f45b59aa4d HBASE-5425 Punt on the timeout doesn't work in BulkEnabler#waitUntilDone (master's EnableTableHandler)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245674 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 17:28:46 +00:00
Michael Stack 0a9ab79730 HBASE-5346 Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245280 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 01:07:01 +00:00
Doug Meil b45071a8d0 hbase-5397. performance.xml, configuration.xml - correction to ZK config.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1245199 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 21:56:57 +00:00
Zhihong Yu 628e5cd9f2 HBASE-5411 Add more metrics for ThriftMetrics (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244977 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 13:56:40 +00:00
Zhihong Yu fe2a3d022b HBASE-5400 Some tests does not have annotations for (Small|Medium|Large)Tests (Enis)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244726 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 21:06:15 +00:00
Doug Meil 49ea0d8484 hbase-5409 book.xml - adding section on sort-order in Data Model chapter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244706 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 20:47:30 +00:00
Doug Meil b4b62e6d97 hbase-5408. book.xml, moved "column metadata" section to top-level in Data Model chapter.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244681 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:59:28 +00:00
Doug Meil db6992f96c hbase-5406 book.xml - adding section to Data Model chapter about column metadata.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244676 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:46:06 +00:00
Doug Meil 87d4ad6980 hbase-5405. index.xml - correcting bigtable link description
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244659 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:20:21 +00:00
Doug Meil 421c120f4a hbase-5404. book.xml, performance.xml - more info on compression and schema design
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244649 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:08:05 +00:00
Michael Stack 71682997f3 HBASE-5394 Add ability to include Protobufs in HbaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244641 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:45:06 +00:00
Zhihong Yu ca6c71acd3 HBASE-5371 Introduce AccessControllerProtocol.checkPermissions(Permission[] permissons) API (Enis Soztutar)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1244623 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:13:28 +00:00