Commit Graph

800 Commits

Author SHA1 Message Date
Jim Kellerman fbd80780bf HBASE-747 Add a simple way to do batch updates of many rows
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@677431 13f79535-47bb-0310-9956-ffa450edef68
2008-07-16 21:11:19 +00:00
Jim Kellerman 90c9f71aa1 HBASE-737 Scanner: every cell in a row has the same timestamp
Changed InternalScanner API:

from
{code}
boolean next(HStoreKey, SortedMap<byte[], byte>)
{code}
to
{code}
boolean next(HStoreKey, SortedMap<byte[], Cell>)
{code}

Files changed as a result of API change:

HMerge.java, ColumnValueFilter, PageRowFilter, RegExpRowFilter, RowFilterInterface, RowFilterSet, StopRowFilter, WhileMatchRowFilter, HAbstractScanner, HRegion$HScanner, HRegionServer, HStoreScanner, InternalScanner, Memcache, StoreFileScanner, MetaUtils, HBaseTestCase, TestScannerAPI, TimestampTestBase, TestRegExpRowFilter, TestRowFilterAfterWrite, TestRowFilterOnMultipleFamilies, TestRowFilterSet, TestGet2, TestHMemcache, TestHRegion, TestScanner, TestSplit

Update comments in Flusher

HRegion.internalFlushCache, HStore.flushCache, HStore.internalFlushCache now returns true only if a flush was completed and a compaction is needed.

HRegion.internalFlushCache now includes region name in DroppedSnapshotException

When creating a reader during compaction, don't bother with bloom filter since we won't use it.

StoreFileScanner locks the store for read while it is in the constructor. It also does not load the bloom filter when it opens readers on the store files.

TestScannerTimes - new regression test for HBASE-737


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@677113 13f79535-47bb-0310-9956-ffa450edef68
2008-07-16 00:03:26 +00:00
Jim Kellerman 422c3ff605 HBASE-744 BloomFilter serialization/deserialization broken
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@677011 13f79535-47bb-0310-9956-ffa450edef68
2008-07-15 19:07:57 +00:00
Jim Kellerman d37bbd20d1 HBASE-744 BloomFilter serialization/deserialization broken
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@677008 13f79535-47bb-0310-9956-ffa450edef68
2008-07-15 19:01:55 +00:00
Michael Stack 34f05ef4ae HBASE-742 Column length limit is not enforced
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676748 13f79535-47bb-0310-9956-ffa450edef68
2008-07-14 21:38:45 +00:00
Michael Stack e545586c0d HBASE-739 HBaseAdmin.createTable() using old HTableDescription doesn't work; second attempt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676739 13f79535-47bb-0310-9956-ffa450edef68
2008-07-14 21:15:17 +00:00
Jim Kellerman 8c2399fee8 HBASE-744 BloomFilter serialization/deserialization broken
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676728 13f79535-47bb-0310-9956-ffa450edef68
2008-07-14 20:46:55 +00:00
Michael Stack 5162324ef9 HBASE-696 Make bloomfilter true/false and self-sizing
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676097 13f79535-47bb-0310-9956-ffa450edef68
2008-07-11 23:07:36 +00:00
Michael Stack e60307ea31 HBASE-739 HBaseAdmin.createTable() using old HTableDescription doesn't work
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676092 13f79535-47bb-0310-9956-ffa450edef68
2008-07-11 22:18:43 +00:00
Michael Stack e6e11eae01 HBASE-738 overview.html in need of updating
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676090 13f79535-47bb-0310-9956-ffa450edef68
2008-07-11 21:43:23 +00:00
Jim Kellerman 36f0d36de9 HBASE-696 Make bloomfilter true/false and self-sizing
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676088 13f79535-47bb-0310-9956-ffa450edef68
2008-07-11 21:41:44 +00:00
Jim Kellerman ed58bcb163 HBASE-715 Base HBase 0.2 on Hadoop 0.17.1 --- update native libraries
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676059 13f79535-47bb-0310-9956-ffa450edef68
2008-07-11 19:43:41 +00:00
Michael Stack e652891ce1 HBASE-742 Rename getMetainfo in HTable as getTableDescriptor
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676031 13f79535-47bb-0310-9956-ffa450edef68
2008-07-11 17:24:39 +00:00
Michael Stack e60a8373d5 HBASE-740 ThriftServer getting table names incorrectly
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@676024 13f79535-47bb-0310-9956-ffa450edef68
2008-07-11 16:41:51 +00:00
Michael Stack ffa8d836cd HBASE-730 On startup, rinse STARTCODE and SERVER from .META.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@675659 13f79535-47bb-0310-9956-ffa450edef68
2008-07-10 17:44:47 +00:00
Michael Stack 1f13177b07 HBASE-735 hbase shell doesn't trap CTRL-C signal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@675658 13f79535-47bb-0310-9956-ffa450edef68
2008-07-10 17:39:43 +00:00
Michael Stack f3549073a7 HBASE-736 Should have HTable.deleteAll(String row) and HTable.deleteAll(Text row)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@675647 13f79535-47bb-0310-9956-ffa450edef68
2008-07-10 16:56:34 +00:00
Michael Stack fb8a45ce30 HBASE-734 scan '.META.', {LIMIT => 10} crashes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@675378 13f79535-47bb-0310-9956-ffa450edef68
2008-07-09 22:56:18 +00:00
Michael Stack 3862e988c6 HBASE-734 scan '.META.', {LIMIT => 10} crashes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@675377 13f79535-47bb-0310-9956-ffa450edef68
2008-07-09 22:54:44 +00:00
Michael Stack 975af636e8 HBASE-731 delete, deletefc in HBase shell do not work correctly
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@675348 13f79535-47bb-0310-9956-ffa450edef68
2008-07-09 21:39:45 +00:00
Michael Stack 58e53ba41a HBASE-732 shell formatting error with the describe command
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@675347 13f79535-47bb-0310-9956-ffa450edef68
2008-07-09 21:29:46 +00:00
Michael Stack b022dd6a56 HBASE-727 Client caught in an infinite loop when trying to connect to cached server locations
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@675048 13f79535-47bb-0310-9956-ffa450edef68
2008-07-08 23:20:02 +00:00
Michael Stack 6fe7bfb481 HBASE-706 On OOME, regionserver sticks around and doesn't go down with cluster
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674958 13f79535-47bb-0310-9956-ffa450edef68
2008-07-08 21:10:33 +00:00
Michael Stack 9d87dd9088 HBASE-721 Add a meta refresh tag to the Web ui for master and region server
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674889 13f79535-47bb-0310-9956-ffa450edef68
2008-07-08 17:17:23 +00:00
Michael Stack e157ffc9c6 HBASE-631 HTable.getRow() for only a column family
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674724 13f79535-47bb-0310-9956-ffa450edef68
2008-07-08 05:24:36 +00:00
Michael Stack 20f56cc97d HBASE-726 Unit tests won't run because of a typo
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674644 13f79535-47bb-0310-9956-ffa450edef68
2008-07-07 21:19:18 +00:00
Jim Kellerman 1f93bb5708 HBASE-674 Memcache size unreliable
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674108 13f79535-47bb-0310-9956-ffa450edef68
2008-07-04 19:15:16 +00:00
Michael Stack d77d0432c1 HBASE-562 Move Exceptions to subpackages
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673774 13f79535-47bb-0310-9956-ffa450edef68
2008-07-03 19:34:54 +00:00
Michael Stack 4864fe13af HBASE-562 Move Exceptions to subpackages
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673773 13f79535-47bb-0310-9956-ffa450edef68
2008-07-03 19:32:04 +00:00
Michael Stack 2dceb8340d HBASE-562 Move Exceptions to subpackages
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673771 13f79535-47bb-0310-9956-ffa450edef68
2008-07-03 19:30:35 +00:00
Michael Stack 0423f172b5 HBASE-703 Invalid regions listed by regionserver.jsp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673770 13f79535-47bb-0310-9956-ffa450edef68
2008-07-03 19:27:09 +00:00
Michael Stack 94eba4e517 HBASE-710 Find out why users have network problems in HBase and not in Hadoop
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673748 13f79535-47bb-0310-9956-ffa450edef68
2008-07-03 18:12:06 +00:00
Jim Kellerman 3224f18ba7 HBASE-712 midKey found compacting is the first, not necessarily the optimal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673524 13f79535-47bb-0310-9956-ffa450edef68
2008-07-02 22:13:41 +00:00
Jim Kellerman 48b561e734 Make changes.txt accurately reflect changes in trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673503 13f79535-47bb-0310-9956-ffa450edef68
2008-07-02 21:23:15 +00:00
Michael Stack cbb2ba609d Turn off DEBUG logging on dfs -- from Rong-En Fan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673286 13f79535-47bb-0310-9956-ffa450edef68
2008-07-02 05:32:20 +00:00
Michael Stack 070112eef2 HBASE-717 alter table broke with new shell returns InvalidColumnNameException
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673000 13f79535-47bb-0310-9956-ffa450edef68
2008-07-01 05:13:45 +00:00
Michael Stack 3d579b7beb HBASE-718 hbase shell help info
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@672988 13f79535-47bb-0310-9956-ffa450edef68
2008-07-01 04:15:50 +00:00
Jim Kellerman ee0ec62045 HBASE-715 Base HBase 0.2 on Hadoop 0.17.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@672457 13f79535-47bb-0310-9956-ffa450edef68
2008-06-28 02:36:24 +00:00
Jim Kellerman 1901b25365 HBASE-716 TestGet2.testGetClosestBefore fails with hadoop-0.17.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@672456 13f79535-47bb-0310-9956-ffa450edef68
2008-06-28 02:32:28 +00:00
Jim Kellerman acac3a8a95 HBASE-627 Disable table doesn't work reliably
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@672423 13f79535-47bb-0310-9956-ffa450edef68
2008-06-27 23:13:26 +00:00
Michael Stack bcbcbc79f4 HBASE-714 Showing bytes in log when should be string (2)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671951 13f79535-47bb-0310-9956-ffa450edef68
2008-06-26 17:06:31 +00:00
Michael Stack a3c07a4035 Fix wrong javadoc on changeOnlineStatus
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671753 13f79535-47bb-0310-9956-ffa450edef68
2008-06-26 05:15:59 +00:00
Jim Kellerman ae97400be0 HBASE-613 Timestamp-anchored scanning fails to find all records
Three problems:
- HRegionServer.next did not return null if there were no results
- HTable$ClientScanner.next had wrong loop termination
- TestMergeTool did not correctly set fs, hbase.rootdir

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671731 13f79535-47bb-0310-9956-ffa450edef68
2008-06-26 04:50:54 +00:00
Michael Stack b33ad41da3 HBASE-709 Deadlock while rolling WAL-log while finishing flush
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671711 13f79535-47bb-0310-9956-ffa450edef68
2008-06-26 03:29:02 +00:00
Michael Stack e00d548bcc HBASE-704 update new shell docs and commands on help menu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671614 13f79535-47bb-0310-9956-ffa450edef68
2008-06-25 17:49:40 +00:00
Michael Stack ea90a78566 HBASE-704 update new shell docs and commands on help menu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671606 13f79535-47bb-0310-9956-ffa450edef68
2008-06-25 17:19:17 +00:00
Michael Stack d09a697620 HBASE-702 deleteall doesn't
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@670701 13f79535-47bb-0310-9956-ffa450edef68
2008-06-23 18:19:54 +00:00
Michael Stack 3af4f2f2f5 HBASE-701 Showing bytes in log when should be String
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@670651 13f79535-47bb-0310-9956-ffa450edef68
2008-06-23 15:18:16 +00:00
Jim Kellerman 80fa33698f HBASE-613 Timestamp-anchored scanning fails to find all records
HBASE-681 NPE in Memcache

HAbstractScanner
- remove HAbstactScanner.iterator() - iterator is not a method on InternalScanner

HRegion
- make getScanner more efficient by iterating only once to find the stores we need to scan
- only pass columns relevant to a store to a HStoreScanner
- remove HScanner.iterator() - iterator is not a method on InternalScanner

Memcache, MemcacheScanner
- Fix NPE in Memcache
- never return HConstants.LATEST_TIMESTAMP as the timestamp value for a row. Instead use the largest timestamp from the cells being returned. This allows a scanner to determine a timestamp that can be used to fetch the same data again should new versions be inserted later.

StoreFileScanner
- getNextViableRow would find a row that matched the row key, but did not consider the requested timestamp. Now if the row it finds has a timestamp greater than the one desired it advances to determine if a row with a timestamp less than or equal to the requested one exists since timestamps are sorted descending.
- removed an unnecessary else

testScanMultipleVersions
- Test program that fails on current trunk but passes when this patch is applied.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@670124 13f79535-47bb-0310-9956-ffa450edef68
2008-06-21 02:52:35 +00:00
Bryan Duxbury d5b1dfe30c HBASE-615 Region balancer oscillates during cluster startup
-Change HServerLoad's getLoad method to ignore the number of requests, thus causing RegionManager to assign based merely on number of regions per server

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@669533 13f79535-47bb-0310-9956-ffa450edef68
2008-06-19 16:30:24 +00:00