Himanshu
2b7bb064b5
remove unused ObjectMapper from DatasourcePathSpec ( #7754 )
2019-05-24 23:15:40 -07:00
mcbrewster
3a77a3e112
Web-Console: add actions icon to lookups ( #7725 )
...
* add lookup-table-action-dialog
* reorder arguments
* remove lookup-table-action-dialog
* fix supervisors table action dialog
* fix imports
* Add host column to task view
* reorder buttons
* remove log
* update snapshots
* remove host
* update snapshots
* remove console log
* remove fragment
* update snapshots and remove space
2019-05-24 22:53:12 -07:00
mcbrewster
5f50f357a4
Web-Console: add go to editor button to tasks and supervisors view ( #7705 )
...
* add go to editor button to tasks and supervisors
* fix package.json
* remove intent
* quuick fixes
* fixes
* add getsupervisorjson and gettaskjson
* remove space
* remove gotoloaddata
* fixes
* add error handling
* save
* add loader
* remove initspec
* fixup! add loader
* update snapshots
* remove gotoloaddataview form headerbar.spec
2019-05-24 22:52:26 -07:00
mcbrewster
2b34e1b710
Web console: add log tailing to task log view ( #7703 )
...
* add tail dialog checkbox to tasks show-log-component for webconsole
* add check box button css
* add 2 second delay
* left align
* change tail formatting
* use async/await syntax
* add space
* add public prefix
* update jest to reflect changes in show-log
* use sentence case
* update snapshots
2019-05-24 15:34:29 -07:00
mcbrewster
d7e3fa510e
Web-console: add resizable split screen layout to tasks and servers views ( #7723 )
...
* add split scroll layout
* fix dev dependancies
* clean up
* adjust margin
* update jest to reflect ui changes
* fix css
* fix css issues, update npm
* remove scrollable
2019-05-24 15:01:45 -07:00
Jihoon Son
2bf44eb0b4
Missing licenses and notices for source distribution ( #7760 )
...
* Add missing licenses and notices
* address comment
2019-05-24 14:47:41 -07:00
Jonathan Wei
83152a7a00
Fix performance-faq and remove insert-segment-to-db redirects ( #7759 )
2019-05-24 13:20:02 -07:00
Gian Merlino
7ec7257e1d
Fix lookup serde on node types that don't load lookups. ( #7752 )
...
This includes the router, overlord, middleManager, and coordinator.
Does the following things:
- Loads LookupSerdeModule on MM, overlord, and coordinator.
- Adds LookupExprMacro to LookupSerdeModule, which allows these node
types to understand that the 'lookup' function exists.
- Adds a test to make sure that LookupSerdeModule works for virtual
columns, filters, transforms, and dimension specs.
This is implementing the technique discussed on these two issues:
- https://github.com/apache/incubator-druid/issues/7724#issuecomment-494723333
- https://github.com/apache/incubator-druid/pull/7082#discussion_r264888771
2019-05-24 12:30:49 -07:00
Clint Wylie
db3792727e
use unminified jquery to be more friendly for source releases, fix license stuff ( #7751 )
...
* use unminified jquery to be more friendly for source releases, fix license stuff
* other license file
* rats
2019-05-24 11:53:25 -07:00
Jonathan Wei
cfb7756c9b
Fix references to removed performance FAQ page ( #7755 )
2019-05-24 11:52:40 -07:00
Jonathan Wei
eb0e1a056c
Add limit to timeseries docs ( #7750 )
2019-05-23 19:41:52 -07:00
Jonathan Wei
f2e34a76bd
Fix TOC clustering example link ( #7749 )
2019-05-23 19:41:27 -07:00
Clint Wylie
eef69619d3
add support for multi-value string dimensions for HllSketch build aggregator ( #7730 )
2019-05-23 17:07:32 -07:00
Bartosz Ługowski
cbdac49ab3
Web console - add enable/disable actions for middle manager workers ( #7642 )
...
* Overlord console - add enable/disable button for remote workers.
* Overlord console - add proxy for remote workers API.
* WorkerResourceTest - revert newline change.
* Remote worker proxy tests - remove empty line.
* Refactor remote worker proxy for readability and security
* Rename method in remote task runner tests for readability
* Remove enable/disable button for remote workers from old web console
* Add enable/disable actions for middle manager worker in new web console
* Fix variable type
* Add worker task runner query adapter
* Fix web console tests: segments-view, servers-view
* Fix overlord resource tests
2019-05-23 16:47:23 -07:00
Jonathan Wei
ec4d09a02f
Remove obsolete isExcluded config from Kerberos authenticator ( #7745 )
2019-05-23 16:00:05 -07:00
Himanshu
daf20b4b86
use memoized supplier for lazy singleton in SeekableStreamIndexTask.java ( #7740 )
2019-05-23 15:58:38 -07:00
Jonathan Wei
54b3f363c4
Remove unnecessary principal handling in KerberosAuthenticator ( #7685 )
2019-05-23 13:15:44 -07:00
Clint Wylie
23e96d15d4
allow quantiles merge aggregator to also accept doubles ( #7718 )
...
* allow quantiles merge aggregator to also accept doubles
* consolidate dupe
* import
2019-05-23 11:13:41 -07:00
awelsh93
6964ac23a2
Adding influxdb emitter as a contrib extension ( #7717 )
...
* Adding influxdb emitter as a contrib extension
* addressing code review comments
2019-05-23 11:11:48 -07:00
Merlin Lee
26fad7e06a
Add checkstyle for "Local variable names shouldn't start with capital" ( #7681 )
...
* Add checkstyle for "Local variable names shouldn't start with capital"
* Adjust some local variables to constants
* Replace StringUtils.LINE_SEPARATOR with System.lineSeparator()
2019-05-23 18:40:28 +02:00
Jihoon Son
eff2be4f8f
Remove LegacyKafkaIndexTaskRunner ( #7735 )
2019-05-23 09:25:35 -07:00
Fangjin Yang
3dec5cd1e4
reorganizing the ToC ( #7734 )
2019-05-23 09:24:38 -07:00
Gian Merlino
53b6467fc8
SeekableStreamIndexTaskRunner: Lazy init of runner. ( #7729 )
...
The main motivation is that this fixes #7724 , by making it so the overlord
doesn't try to create a task runner and parser when all it really wants to
do is create a task object and serialize it.
2019-05-22 21:13:57 -07:00
Clint Wylie
ffc2397bcd
fix AggregatorFactory.finalizeComputation implementations to be ok with null inputs ( #7731 )
...
* AggregatorFactory finalizeComputation is nullable with nullable input, make implementations honor this
* fixes
2019-05-22 21:13:09 -07:00
mcbrewster
1b284ca847
add tests to dialogs, compnents and views. Add index files to components and dialogs. add nested file structure ( #7669 )
2019-05-22 20:36:51 -07:00
gocho1
bd899b9224
add s3 authentication method informations ( #7674 )
...
* add s3 authentication method informations
* add druid.s3.fileSessionCredentials related content
* remove authentication parameters to avoid confusion as it is more detailed in S3 Deep Storage page
* streamline s3 docs
2019-05-22 11:46:02 -07:00
Surekha
1fe0de1c96
Fix currSize attribute of historical server type ( #7706 )
2019-05-21 11:55:58 -07:00
Gian Merlino
cbbce955de
SQL: Allow NULLs in place of optional arguments in many functions. ( #7709 )
...
* SQL: Allow NULLs in place of optional arguments in many functions.
Also adjust SQL docs to describe how to make time literals using
TIME_PARSE (which is now possible in a nicer way).
* Be less forbidden.
2019-05-21 11:54:34 -07:00
Gian Merlino
43c54385f6
SQL: Respect default timezone for TIME_PARSE and TIME_SHIFT. ( #7704 )
...
* SQL: Respect default timezone for TIME_PARSE and TIME_SHIFT.
They were inadvertently using UTC rather than the default timezone.
Also, harmonize how time functions handle their parameters.
* Fix tests
* Add another TIME_SHIFT test.
2019-05-21 11:40:44 -07:00
Gian Merlino
69b2ea3ddc
SQL: TIME_EXTRACT should have 2 required operands. ( #7710 )
...
* SQL: TIME_EXTRACT should have 2 required operands.
Timestamp and time unit are both required.
* Add regression test.
2019-05-21 11:32:36 -07:00
Gian Merlino
bcea05e4e8
SQL: Fix exception with OR of impossible filters. ( #7707 )
...
Fixes #7671 .
2019-05-21 11:32:09 -07:00
Gian Merlino
b6941551ae
Upgrade various build and doc links to https. ( #7722 )
...
* Upgrade various build and doc links to https.
Where it wasn't possible to upgrade build-time dependencies to https,
I kept http in place but used hardcoded checksums or GPG keys to ensure
that artifacts fetched over http are verified properly.
* Switch to https://apache.org .
2019-05-21 11:30:14 -07:00
Xue Yu
dd7dace70a
Add TIMESTAMPDIFF sql support ( #7695 )
...
* add timestampdiff sql support
* feedback address
2019-05-21 08:05:38 -07:00
Vadim Ogievetsky
156322932f
Update Druid Console docs for 0.15.0 ( #7697 )
...
* Update Druid Console docs for 0.15.0
* SQL -> query
* added links and fix typos
2019-05-21 04:00:42 -07:00
Vadim Ogievetsky
169d2493bc
Web console: fix missing value input in timestampSpec step ( #7698 )
2019-05-21 03:59:48 -07:00
Gian Merlino
cb6ec2cab8
SqlOperatorConversion Javadoc fix. ( #7713 )
...
Appears to be a copypasta error; the toDruidFilter method was referred
to aggregations, but it's not handling aggregations.
2019-05-20 21:21:21 -07:00
Jihoon Son
d69aa6f7f6
Fix case insensitive of ParserUtils.findDuplicates ( #7692 )
...
* Fix case insensitive ParserUtils.findDuplicates
* unused import
2019-05-20 17:49:15 -07:00
Himanshu
fb0c846941
Virtual column updates for exploiting base column internal structure ( #7618 )
...
* VirtualColumn updates for exploiting base column internal structure
* unit tests for virtual column interface updates
* groupBy needs to use VirtualizedColumnSelectorFactory if outer query in
nested groupBy has virtual columns.
* fix strict compile checks
* fix teamcity build errors
* add comment explaining useVirtualizedColumnSelectorFactory flag in RowBasedGrouperHelper.createGrouperAccumulatorPair(..)
2019-05-20 17:04:35 -07:00
Clint Wylie
c4a4223c9c
fix issue where result level cache was recomputing post aggs that were already cached, causing issues with finalizing aggregators ( #7708 )
2019-05-20 16:51:50 -07:00
Clint Wylie
ddda8b74cb
update lz4-java to 1.6.0 (lz4 1.9.1) ( #7700 )
2019-05-20 13:01:48 -07:00
Merlin Lee
5f08b0b474
Add checkstyle for "Prohibit @author tags in Javadoc" ( #7682 )
...
* Add checkstyle for "Prohibit @author tags in Javadoc"
* Add "Do not use author tags/information in the code" back to CONTRIBUTING.md
2019-05-20 00:09:51 -07:00
andrewluotechnologies
1add566411
Fix typo (ComplexMetricSerde class name was spelled incorrectly) ( #7694 )
2019-05-19 09:49:54 -07:00
Vadim Ogievetsky
be16e4a4ae
Web console, adding Apache Kafka and AWS Kinesis to the data loader ( #7643 )
...
* adding kafka and kinesis to the data loader
* feature detect
* copy fixes
* wording fixes
* added missing spec type
* increase timeout
* Call it Google Cloud Storage
2019-05-17 14:01:27 -07:00
Jihoon Son
94721de141
Add auto tagging milestone script ( #7677 )
...
* Add auto tagging milestone script
* fix usage
* missing newline
* missing newline
2019-05-16 23:11:16 -07:00
Clint Wylie
939b417379
Update tutorial-kafka.md ( #7678 )
2019-05-16 23:10:45 -07:00
David Lim
d38457933f
Data loader (sampler component) - Kafka/Kinesis samplers ( #7566 )
...
* implement Kafka/Kinesis sampler
* add KafkaSamplerSpecTest and KinesisSamplerSpecTest
* code review changes
2019-05-16 20:26:23 -07:00
Jenny Zhu
ec0b7787cf
Web console: fixed issue when grouping tasks by different attributes ( #7657 )
...
* deleted created_time in "status"
* added toString on the status object
2019-05-16 16:46:04 -07:00
Jonathan Wei
d99f77a01b
Add option to use YARN RM as fallback for JobHistory failure ( #7673 )
...
* Add option to use YARN RM as fallback for job status
* PR comments
2019-05-16 13:59:10 -07:00
Fangjin Yang
dc85a5309e
some more doc improvements ( #7675 )
2019-05-16 13:17:21 -07:00
Jonathan Wei
d667655871
Add basic tuning guide, getting started page, updated clustering docs ( #7629 )
...
* Add basic tuning guide, getting started page, updated clustering docs
* Add note about caching, fix tutorial paths
* Adjust hadoop wording
* Add license
* Tweak
* Shrink overlord heaps, fix tutorial urls
* Tweak xlarge peon, update peon sizing
* Update Data peon buffer size
* Fix cluster start scripts
* Add upper level _common to classpath
* Fix cluster data/query confs
* Address PR comments
* Elaborate on connection pools
* PR comments
* Increase druid.broker.http.maxQueuedBytes
* Add guidelines for broker backpressure
* PR comments
2019-05-16 11:13:48 -07:00