Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,271 Commits 111 Branches 503 Tags 721 MiB
Commit Graph

4271 Commits

Author SHA1 Message Date
Charles Allen 6af18931e5 Moveed processing/pom version into master pom 2014-11-07 11:08:23 -08:00
Charles Allen 75c79e7562 Added comments in TopNNumericResultBuilder 2014-11-07 11:01:46 -08:00
Charles Allen b4893b4490 Pre allocate LinkedHashMap in TopNNumericResultBuilder 2014-11-07 10:56:49 -08:00
Charles Allen bc92de233c Update dim name comparator in TopNNumericResultBuilder to better handle nulls 2014-11-07 10:54:10 -08:00
Charles Allen 0a562ebd77 Removed CompressedObjectStrategy from this pull request. will submit a new one later 2014-11-07 10:42:28 -08:00
Charles Allen 228614ddb5 Changed TopNNumericResultBuilder imports to not use package.*, but instead pulls all in explicitly 2014-11-07 10:34:28 -08:00
Charles Allen e75ef7cb5d Merge remote-tracking branch 'origin/druid-0.7.x' into druid-0.7.x-fastTopN-rebase 2014-11-07 10:29:26 -08:00
Charles Allen 956bdf80dd Removed negating comparator in TopNNumericResultBuilder 2014-11-07 10:29:06 -08:00
Charles Allen 8d1a8564c4 Merge pull request #829 from metamx/default-servicenames 
provide proper defaults for indexing service name
 2014-11-07 10:06:46 -08:00
Xavier Léauté d8bab70647 provide proper defaults for indexing service name 2014-11-06 18:16:01 -08:00
Fangjin Yang 6c77f66ecd Merge pull request #824 from metamx/compress-defaults 
prefer druid.curator.compress to druid.indexer.runner.compressZnodes
 2014-11-06 17:15:14 -07:00
Xavier Léauté 4b6438537e fix missing service name/port bindings for peons 2014-11-06 11:57:08 -08:00
Xavier Léauté 9bc20ef8bf prefer druid.curator.compress to druid.indexer.runner.compressZnodes 2014-11-06 11:28:51 -08:00
Charles Allen ee019872f7 TopN performance improvements 
Re-factor scanAndAggregate in PooledTopN

* Loops are now a little bit tighter when looping over aggregates. This will hopefully assist in loop execution optimization.
* Pre-calculated the aggregate offsets instead of shifting them during runtime.
* Cursor loop could use some TLC, but would require a massive refactoring on how TopN queries are executed.
  * Any potential modifications to query workflow need to account for Stream vs Batch data, and that not all data will be array backed that comes in.

Change data storage type in TopNNumericResultBuilder.

  * Use PriorityQueue to store
  * Checks to see if should even bother adding to Queue before adding.
  * Re-orders Queue on build() call.
  * Ideally the order would be directly preserved on build(), but this is a close second.

Updates to CompressedObjectStrategy to support more compression types

 * Compression types are not yet dynamically configurable.
 * Added a benchmarking system for topN to test the compression
 * Updated pom.xml to include junit benchmarking
 * added an Uncompressed option
 2014-11-05 11:10:37 -08:00
Fangjin Yang 8b1edfd464 Merge pull request #809 from metamx/fix-test 
Fix tests after always sorting dimensions in the parseSpec
 2014-10-24 12:09:02 -06:00
fjy 41ebdd2bae Merge branch 'druid-0.7.x' into fix-test 
Conflicts:
	processing/pom.xml
	processing/src/main/java/io/druid/segment/IndexMerger.java
	processing/src/main/java/io/druid/segment/MetricHolder.java
	processing/src/main/java/io/druid/segment/data/CompressedObjectStrategy.java
	processing/src/test/java/io/druid/query/groupby/GroupByQueryRunnerTest.java
	processing/src/test/java/io/druid/segment/SchemalessTestFull.java
	server/src/test/java/io/druid/client/CachingClusteredClientTest.java
	services/src/main/java/io/druid/cli/CliHistorical.java
 2014-10-24 11:07:52 -07:00
fjy bef74104d9 merge with 0.7.x and resolve any conflicts 2014-10-23 17:24:06 -07:00
fjy f790a05bd7 Merge branch 'master' into fix-test 
Conflicts:
	pom.xml
 2014-10-23 14:39:51 -07:00
fjy 2da7154fdf Merge branch 'fix-test' of github.com:metamx/druid into fix-test 
Conflicts:
	histogram/src/test/java/io/druid/query/aggregation/histogram/ApproximateHistogramGroupByQueryTest.java
	processing/src/test/java/io/druid/query/QueryRunnerTestHelper.java
 2014-10-23 14:37:55 -07:00
fjy 1b3921faad fix for long columns 2014-10-23 14:33:25 -07:00
fjy 3b29e77866 [maven-release-plugin] prepare for next development iteration 2014-10-22 16:25:32 -07:00
fjy dcab2997f2 [maven-release-plugin] prepare release druid-0.6.160 2014-10-22 16:25:27 -07:00
fjy d76d57d95d update docs 2014-10-22 16:16:28 -07:00
fjy 94da2b6ad3 more logging for potential NPE because of segment unmapping 2014-10-22 16:16:10 -07:00
xvrl a0baf7e8f4 Merge pull request #804 from metamx/notdimfilter-support 
Add support for NotDimFilter with FilteredAggregator
 2014-10-22 14:38:29 -07:00
Xavier Léauté 4ec1e6ef13 simplify code a bit 2014-10-22 14:25:59 -07:00
nishantmonu51 0785baf54c review comments 2014-10-22 21:28:31 +05:30
Fangjin Yang 1ebc8a2a72 Merge pull request #805 from metamx/long-column 
Long column Support
 2014-10-21 23:11:26 -06:00
nishantmonu51 6cb6ec39cf add support for not filter and add test 2014-10-22 10:25:24 +05:30
Fangjin Yang 69ca6cd924 Merge pull request #803 from metamx/filtered-aggregator 
Native filtered aggregator
 2014-10-21 20:54:53 -06:00
Xavier Léauté e24a6d222f we even have tests now 2014-10-21 17:46:24 -07:00
Xavier Léauté 34f2c74331 add docs 2014-10-21 17:24:44 -07:00
Xavier Léauté 23a6ab19b0 cleanup and add missing methods 2014-10-21 17:00:39 -07:00
nishantmonu51 56912adccb avoid typecasts 2014-10-21 16:47:50 -07:00
nishantmonu51 10db94101f skip value lookup 
compare ids instead of values
 2014-10-21 16:47:49 -07:00
Xavier Léauté 71831e49d9 rudimentary filtered aggregator 2014-10-21 16:47:49 -07:00
fjy ee392b6064 more updates to docs 2014-10-21 16:26:17 -07:00
fjy 2d96bc5f1f more FAQ docs 2014-10-21 16:08:56 -07:00
Fangjin Yang 5df92aff2c Merge pull request #797 from metamx/igalDruid 
Igal druid
 2014-10-21 16:47:47 -06:00
Fangjin Yang 3d8f33d4ad Merge pull request #801 from metamx/fix-unordered-merging 
fix ordering for partitions with same start time, fixes #796
 2014-10-21 16:47:31 -06:00
Xavier Léauté 8735272ce3 fix file casing 2014-10-21 15:36:49 -07:00
Xavier Léauté fd7d3e5ace make it work with Java 8 2014-10-21 15:33:28 -07:00
Fangjin Yang 5a7d186e88 Merge pull request #799 from metamx/js-tiered-broker-selector 
JavaScript tiered broker selector
 2014-10-21 16:30:02 -06:00
Xavier Léauté 9d5e65913d fix serde 2014-10-21 15:05:08 -07:00
Xavier Léauté 23a59db566 fix ordering for partitions with same start time, fixes #796 
Partitions with same start time may produce results out of order,
           especially in the presence of data gaps.

Results for those segments must be re-ordered prior to being merged
 2014-10-20 17:22:23 -07:00
Xavier Léauté b32ce31eff add documentation 2014-10-20 14:12:30 -07:00
Xavier Léauté 38cb73e0cc javacript tiered broker selector strategy 2014-10-20 14:12:30 -07:00
Igal Levy 1dd9aeba4f removed link with no target 2014-10-19 21:22:10 -07:00
Igal Levy b7c4983a91 added syntax highlighting 2014-10-19 18:38:20 -07:00
Igal Levy 63a4f2dc05 fixed broken internal link 2014-10-19 18:29:34 -07:00