課程
/云計算&大數(shù)據(jù)
/大數(shù)據(jù)
/Flink最鋒利的武器---FlinkSQL入門和實戰(zhàn)
老實不知道要配什么... 求老實的flink pom文件
2020-08-01
源自:Flink最鋒利的武器---FlinkSQL入門和實戰(zhàn) 2-3
正在回答
<project?xmlns="http://maven.apache.org/POM/4.0.0"?xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ???xsi:schemaLocation="http://maven.apache.org/POM/4.0.0?http://maven.apache.org/xsd/maven-4.0.0.xsd"> ???<modelVersion>4.0.0</modelVersion> ???<groupId>org.myorg.quickstart</groupId> ???<artifactId>quickstart</artifactId> ???<version>0.1</version> ???<packaging>jar</packaging> ???<name>Flink?Quickstart?Job</name> ???<properties> ??????<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> ??????<flink.version>1.10.1</flink.version> ??????<java.version>1.8</java.version> ??????<scala.binary.version>2.11</scala.binary.version> ??????<maven.compiler.source>${java.version}</maven.compiler.source> ??????<maven.compiler.target>${java.version}</maven.compiler.target> ???</properties> ???<repositories> ??????<repository> ?????????<id>apache.snapshots</id> ?????????<name>Apache?Development?Snapshot?Repository</name> ?????????<url>https://repository.apache.org/content/repositories/snapshots/</url> ?????????<releases> ????????????<enabled>false</enabled> ?????????</releases> ?????????<snapshots> ????????????<enabled>true</enabled> ?????????</snapshots> ??????</repository> ???</repositories> ???<dependencies> ??????<!--?Apache?Flink?dependencies?--> ??????<!--?These?dependencies?are?provided,?because?they?should?not?be?packaged?into?the?JAR?file.?--> ??????<dependency> ?????????<groupId>org.apache.flink</groupId> ?????????<artifactId>flink-java</artifactId> ?????????<version>${flink.version}</version> ?????????<scope>provided</scope> ??????</dependency> ??????<dependency> ?????????<groupId>org.apache.flink</groupId> ?????????<artifactId>flink-streaming-java_${scala.binary.version}</artifactId> ?????????<version>${flink.version}</version> ?????????<scope>provided</scope> ??????</dependency> ??????<dependency> ?????????<groupId>org.slf4j</groupId> ?????????<artifactId>slf4j-log4j12</artifactId> ?????????<version>1.7.7</version> ?????????<scope>runtime</scope> ??????</dependency> ??????<dependency> ?????????<groupId>log4j</groupId> ?????????<artifactId>log4j</artifactId> ?????????<version>1.2.17</version> ?????????<scope>runtime</scope> ??????</dependency> ???</dependencies> ???<build> ??????<plugins> ?????????<!--?Java?Compiler?--> ?????????<plugin> ????????????<groupId>org.apache.maven.plugins</groupId> ????????????<artifactId>maven-compiler-plugin</artifactId> ????????????<version>3.1</version> ????????????<configuration> ???????????????<source>${java.version}</source> ???????????????<target>${java.version}</target> ????????????</configuration> ?????????</plugin> ?????????<!--?We?use?the?maven-shade?plugin?to?create?a?fat?jar?that?contains?all?necessary?dependencies.?--> ?????????<!--?Change?the?value?of?<mainClass>...</mainClass>?if?your?program?entry?point?changes.?--> ?????????<plugin> ????????????<groupId>org.apache.maven.plugins</groupId> ????????????<artifactId>maven-shade-plugin</artifactId> ????????????<version>3.1.1</version> ????????????<executions> ???????????????<!--?Run?shade?goal?on?package?phase?--> ???????????????<execution> ??????????????????<phase>package</phase> ??????????????????<goals> ?????????????????????<goal>shade</goal> ??????????????????</goals> ??????????????????<configuration> ?????????????????????<artifactSet> ????????????????????????<excludes> ???????????????????????????<exclude>org.apache.flink:force-shading</exclude> ???????????????????????????<exclude>com.google.code.findbugs:jsr305</exclude> ???????????????????????????<exclude>org.slf4j:*</exclude> ???????????????????????????<exclude>log4j:*</exclude> ????????????????????????</excludes> ?????????????????????</artifactSet> ?????????????????????<filters> ????????????????????????<filter> ???????????????????????????<!--?Do?not?copy?the?signatures?in?the?META-INF?folder. ???????????????????????????Otherwise,?this?might?cause?SecurityExceptions?when?using?the?JAR.?--> ???????????????????????????<artifact>*:*</artifact> ???????????????????????????<excludes> ??????????????????????????????<exclude>META-INF/*.SF</exclude> ??????????????????????????????<exclude>META-INF/*.DSA</exclude> ??????????????????????????????<exclude>META-INF/*.RSA</exclude> ???????????????????????????</excludes> ????????????????????????</filter> ?????????????????????</filters> ?????????????????????<transformers> ????????????????????????<transformer?implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer"> ???????????????????????????<mainClass>org.myorg.quickstart.StreamingJob</mainClass> ????????????????????????</transformer> ?????????????????????</transformers> ??????????????????</configuration> ???????????????</execution> ????????????</executions> ?????????</plugin> ??????</plugins> ??????<pluginManagement> ?????????<plugins> ????????????<!--?This?improves?the?out-of-the-box?experience?in?Eclipse?by?resolving?some?warnings.?--> ????????????<plugin> ???????????????<groupId>org.eclipse.m2e</groupId> ???????????????<artifactId>lifecycle-mapping</artifactId> ???????????????<version>1.0.0</version> ???????????????<configuration> ??????????????????<lifecycleMappingMetadata> ?????????????????????<pluginExecutions> ????????????????????????<pluginExecution> ???????????????????????????<pluginExecutionFilter> ??????????????????????????????<groupId>org.apache.maven.plugins</groupId> ??????????????????????????????<artifactId>maven-shade-plugin</artifactId> ??????????????????????????????<versionRange>[3.1.1,)</versionRange> ??????????????????????????????<goals> ?????????????????????????????????<goal>shade</goal> ??????????????????????????????</goals> ???????????????????????????</pluginExecutionFilter> ???????????????????????????<action> ??????????????????????????????<ignore/> ???????????????????????????</action> ????????????????????????</pluginExecution> ????????????????????????<pluginExecution> ???????????????????????????<pluginExecutionFilter> ??????????????????????????????<groupId>org.apache.maven.plugins</groupId> ??????????????????????????????<artifactId>maven-compiler-plugin</artifactId> ??????????????????????????????<versionRange>[3.1,)</versionRange> ??????????????????????????????<goals> ?????????????????????????????????<goal>testCompile</goal> ?????????????????????????????????<goal>compile</goal> ??????????????????????????????</goals> ???????????????????????????</pluginExecutionFilter> ???????????????????????????<action> ??????????????????????????????<ignore/> ???????????????????????????</action> ????????????????????????</pluginExecution> ?????????????????????</pluginExecutions> ??????????????????</lifecycleMappingMetadata> ???????????????</configuration> ????????????</plugin> ?????????</plugins> ??????</pluginManagement> ???</build> </project>
<!-- Licensed?to?the?Apache?Software?Foundation?(ASF)?under?one or?more?contributor?license?agreements.??See?the?NOTICE?file distributed?with?this?work?for?additional?information regarding?copyright?ownership.??The?ASF?licenses?this?file to?you?under?the?Apache?License,?Version?2.0?(the "License");?you?may?not?use?this?file?except?in?compliance with?the?License.??You?may?obtain?a?copy?of?the?License?at ??http://www.apache.org/licenses/LICENSE-2.0 Unless?required?by?applicable?law?or?agreed?to?in?writing, software?distributed?under?the?License?is?distributed?on?an "AS?IS"?BASIS,?WITHOUT?WARRANTIES?OR?CONDITIONS?OF?ANY KIND,?either?express?or?implied.??See?the?License?for?the specific?language?governing?permissions?and?limitations under?the?License. --> <project?xmlns="http://maven.apache.org/POM/4.0.0"?xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ???xsi:schemaLocation="http://maven.apache.org/POM/4.0.0?http://maven.apache.org/xsd/maven-4.0.0.xsd"> ???<modelVersion>4.0.0</modelVersion> ???<groupId>org.myorg.quickstart</groupId> ???<artifactId>quickstart</artifactId> ???<version>0.1</version> ???<packaging>jar</packaging> ???<name>Flink?Quickstart?Job</name> ???<properties> ??????<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> ??????<flink.version>1.10.1</flink.version> ??????<java.version>1.8</java.version> ??????<scala.binary.version>2.11</scala.binary.version> ??????<maven.compiler.source>${java.version}</maven.compiler.source> ??????<maven.compiler.target>${java.version}</maven.compiler.target> ???</properties> ???<repositories> ??????<repository> ?????????<id>apache.snapshots</id> ?????????<name>Apache?Development?Snapshot?Repository</name> ?????????<url>https://repository.apache.org/content/repositories/snapshots/</url> ?????????<releases> ????????????<enabled>false</enabled> ?????????</releases> ?????????<snapshots> ????????????<enabled>true</enabled> ?????????</snapshots> ??????</repository> ???</repositories> ???<dependencies> ??????<!--?Apache?Flink?dependencies?--> ??????<!--?These?dependencies?are?provided,?because?they?should?not?be?packaged?into?the?JAR?file.?--> ??????<dependency> ?????????<groupId>org.apache.flink</groupId> ?????????<artifactId>flink-java</artifactId> ?????????<version>${flink.version}</version> ?????????<scope>provided</scope> ??????</dependency> ??????<dependency> ?????????<groupId>org.apache.flink</groupId> ?????????<artifactId>flink-streaming-java_${scala.binary.version}</artifactId> ?????????<version>${flink.version}</version> ?????????<scope>provided</scope> ??????</dependency> ??????<!--?Add?connector?dependencies?here.?They?must?be?in?the?default?scope?(compile).?--> ??????<!--?Example: ??????<dependency> ?????????<groupId>org.apache.flink</groupId> ?????????<artifactId>flink-connector-kafka-0.10_${scala.binary.version}</artifactId> ?????????<version>${flink.version}</version> ??????</dependency> ??????--> ??????<!--?Add?logging?framework,?to?produce?console?output?when?running?in?the?IDE.?--> ??????<!--?These?dependencies?are?excluded?from?the?application?JAR?by?default.?--> ??????<dependency> ?????????<groupId>org.slf4j</groupId> ?????????<artifactId>slf4j-log4j12</artifactId> ?????????<version>1.7.7</version> ?????????<scope>runtime</scope> ??????</dependency> ??????<dependency> ?????????<groupId>log4j</groupId> ?????????<artifactId>log4j</artifactId> ?????????<version>1.2.17</version> ?????????<scope>runtime</scope> ??????</dependency> ???</dependencies> ???<build> ??????<plugins> ?????????<!--?Java?Compiler?--> ?????????<plugin> ????????????<groupId>org.apache.maven.plugins</groupId> ????????????<artifactId>maven-compiler-plugin</artifactId> ????????????<version>3.1</version> ????????????<configuration> ???????????????<source>${java.version}</source> ???????????????<target>${java.version}</target> ????????????</configuration> ?????????</plugin> ?????????<!--?We?use?the?maven-shade?plugin?to?create?a?fat?jar?that?contains?all?necessary?dependencies.?--> ?????????<!--?Change?the?value?of?<mainClass>...</mainClass>?if?your?program?entry?point?changes.?--> ?????????<plugin> ????????????<groupId>org.apache.maven.plugins</groupId> ????????????<artifactId>maven-shade-plugin</artifactId> ????????????<version>3.1.1</version> ????????????<executions> ???????????????<!--?Run?shade?goal?on?package?phase?--> ???????????????<execution> ??????????????????<phase>package</phase> ??????????????????<goals> ?????????????????????<goal>shade</goal> ??????????????????</goals> ??????????????????<configuration> ?????????????????????<artifactSet> ????????????????????????<excludes> ???????????????????????????<exclude>org.apache.flink:force-shading</exclude> ???????????????????????????<exclude>com.google.code.findbugs:jsr305</exclude> ???????????????????????????<exclude>org.slf4j:*</exclude> ???????????????????????????<exclude>log4j:*</exclude> ????????????????????????</excludes> ?????????????????????</artifactSet> ?????????????????????<filters> ????????????????????????<filter> ???????????????????????????<!--?Do?not?copy?the?signatures?in?the?META-INF?folder. ???????????????????????????Otherwise,?this?might?cause?SecurityExceptions?when?using?the?JAR.?--> ???????????????????????????<artifact>*:*</artifact> ???????????????????????????<excludes> ??????????????????????????????<exclude>META-INF/*.SF</exclude> ??????????????????????????????<exclude>META-INF/*.DSA</exclude> ??????????????????????????????<exclude>META-INF/*.RSA</exclude> ???????????????????????????</excludes> ????????????????????????</filter> ?????????????????????</filters> ?????????????????????<transformers> ????????????????????????<transformer?implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer"> ???????????????????????????<mainClass>org.myorg.quickstart.StreamingJob</mainClass> ????????????????????????</transformer> ?????????????????????</transformers> ??????????????????</configuration> ???????????????</execution> ????????????</executions> ?????????</plugin> ??????</plugins> ??????<pluginManagement> ?????????<plugins> ????????????<!--?This?improves?the?out-of-the-box?experience?in?Eclipse?by?resolving?some?warnings.?--> ????????????<plugin> ???????????????<groupId>org.eclipse.m2e</groupId> ???????????????<artifactId>lifecycle-mapping</artifactId> ???????????????<version>1.0.0</version> ???????????????<configuration> ??????????????????<lifecycleMappingMetadata> ?????????????????????<pluginExecutions> ????????????????????????<pluginExecution> ???????????????????????????<pluginExecutionFilter> ??????????????????????????????<groupId>org.apache.maven.plugins</groupId> ??????????????????????????????<artifactId>maven-shade-plugin</artifactId> ??????????????????????????????<versionRange>[3.1.1,)</versionRange> ??????????????????????????????<goals> ?????????????????????????????????<goal>shade</goal> ??????????????????????????????</goals> ???????????????????????????</pluginExecutionFilter> ???????????????????????????<action> ??????????????????????????????<ignore/> ???????????????????????????</action> ????????????????????????</pluginExecution> ????????????????????????<pluginExecution> ???????????????????????????<pluginExecutionFilter> ??????????????????????????????<groupId>org.apache.maven.plugins</groupId> ??????????????????????????????<artifactId>maven-compiler-plugin</artifactId> ??????????????????????????????<versionRange>[3.1,)</versionRange> ??????????????????????????????<goals> ?????????????????????????????????<goal>testCompile</goal> ?????????????????????????????????<goal>compile</goal> ??????????????????????????????</goals> ???????????????????????????</pluginExecutionFilter> ???????????????????????????<action> ??????????????????????????????<ignore/> ???????????????????????????</action> ????????????????????????</pluginExecution> ?????????????????????</pluginExecutions> ??????????????????</lifecycleMappingMetadata> ???????????????</configuration> ????????????</plugin> ?????????</plugins> ??????</pluginManagement> ???</build> </project>
舉報
Flink新版本特性以及Flink SQL在實際項目中的應(yīng)用。
1 回答flink-table 無法使用
1 回答pom在哪節(jié)課講的?
3 回答找不到org.apache.flink.api.scala.ExecutionEnvironment的類文件
1 回答這個自定義函數(shù)怎么用啊?是開發(fā)好了測試通過之后直接打包上傳到flink服務(wù)器對應(yīng)的位置上,然后直接調(diào)用jar包,還是說放在代碼中作為一個工具類,其他的流計算類操作的時候再調(diào)用這個工具類?
1 回答kafka zookeeper 這個是在本地環(huán)境安裝的?
Copyright ? 2025 imooc.com All Rights Reserved | 京ICP備12003892號-11 京公網(wǎng)安備11010802030151號
購課補貼聯(lián)系客服咨詢優(yōu)惠詳情
慕課網(wǎng)APP您的移動學習伙伴
掃描二維碼關(guān)注慕課網(wǎng)微信公眾號
2020-08-18
2020-08-18