Add avro dependency to parquet extension (#9124)

* Add avro dependency to parquet extension

If the parquet extension is loaded and an ingestionSpec uses the older format
specifying a 'parser' instead of using an 'inputFormat' the job fails
with the following error

java.lang.TypeNotPresentException: Type org.apache.avro.generic.GenericRecord not present

This change removes the exclusion of the avro package so that the missing
class can be found.

* Address review comments and add dependency version
This commit is contained in:
Suneet Saldanha 2020-01-03 21:11:13 -05:00 committed by Jonathan Wei
parent aa539177ec
commit bdd0d0d8a5
1 changed files with 1 additions and 13 deletions

View File

@ -80,10 +80,6 @@
<artifactId>parquet-avro</artifactId> <artifactId>parquet-avro</artifactId>
<version>${parquet.version}</version> <version>${parquet.version}</version>
<exclusions> <exclusions>
<exclusion>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
</exclusion>
<exclusion> <exclusion>
<groupId>commons-pool</groupId> <groupId>commons-pool</groupId>
<artifactId>commons-pool</artifactId> <artifactId>commons-pool</artifactId>
@ -145,10 +141,6 @@
<groupId>aopalliance</groupId> <groupId>aopalliance</groupId>
<artifactId>aopalliance</artifactId> <artifactId>aopalliance</artifactId>
</exclusion> </exclusion>
<exclusion>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
</exclusion>
<exclusion> <exclusion>
<groupId>org.apache.commons</groupId> <groupId>org.apache.commons</groupId>
<artifactId>commons-compress</artifactId> <artifactId>commons-compress</artifactId>
@ -209,10 +201,6 @@
<groupId>org.apache.yetus</groupId> <groupId>org.apache.yetus</groupId>
<artifactId>audience-annotations</artifactId> <artifactId>audience-annotations</artifactId>
</exclusion> </exclusion>
<exclusion>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
</exclusion>
<exclusion> <exclusion>
<groupId>commons-codec</groupId> <groupId>commons-codec</groupId>
<artifactId>commons-codec</artifactId> <artifactId>commons-codec</artifactId>
@ -414,7 +402,7 @@
<dependency> <dependency>
<groupId>org.apache.avro</groupId> <groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId> <artifactId>avro</artifactId>
<scope>provided</scope> <version>${avro.version}</version>
</dependency> </dependency>
<dependency> <dependency>
<groupId>junit</groupId> <groupId>junit</groupId>