如何编程制作自己的网站,一个小胖子从网站做任务的网站故事,diywap手机网站系统,手机端网站开发建设内容一、创建一个空项目#xff0c;作为整个项目的基本框架 二、创建SparkStudy模块#xff0c;用于学习基本的Spark基础 三、创建项目结构
1、在SparkStudy模块下的pom.xml文件中加入对应的依赖#xff0c;并等待依赖包下载完毕。 在pom.xml文件中加入对应的依赖
!-- S…一、创建一个空项目作为整个项目的基本框架 二、创建SparkStudy模块用于学习基本的Spark基础 三、创建项目结构
1、在SparkStudy模块下的pom.xml文件中加入对应的依赖并等待依赖包下载完毕。 在pom.xml文件中加入对应的依赖
!-- Spark及Scala的版本号 --propertiesscala.version2.11/scala.versionspark.version2.1.1/spark.version/properties!-- Mysql组件dependencygroupIdmysql/groupIdartifactIdmysql-connector-java/artifactIdversion5.7.22.1/version/dependency 的依赖 --!-- Spark各个组件的依赖 --dependencies!-- https://mvnrepository.com/artifact/com.thoughtworks.paranamer/paranamer --dependencygroupIdcom.thoughtworks.paranamer/groupIdartifactIdparanamer/artifactIdversion2.8/version/dependencydependencygroupIdorg.apache.spark/groupIdartifactIdspark-core_${scala.version}/artifactIdversion${spark.version}/version/dependencydependencygroupIdorg.apache.spark/groupIdartifactIdspark-sql_${scala.version}/artifactIdversion${spark.version}/version/dependencydependencygroupIdorg.apache.spark/groupIdartifactIdspark-streaming_2.11/artifactIdversion${spark.version}/version/dependencydependencygroupIdorg.apache.spark/groupIdartifactIdspark-mllib_2.11/artifactIdversion2.1.1/version/dependencydependencygroupIdorg.apache.spark/groupIdartifactIdspark-streaming-kafka-0-10_2.11/artifactIdversion2.3.0/version/dependencydependencygroupIdorg.apache.spark/groupIdartifactIdspark-streaming-kafka-0-8_${scala.version}/artifactIdversion2.3.0/version/dependencydependencygroupIdnet.jpountz.lz4/groupIdartifactIdlz4/artifactIdversion1.3.0/version/dependencydependencygroupIdmysql/groupIdartifactIdmysql-connector-java/artifactIdversion8.0.18/version/dependencydependencygroupIdorg.apache.flume.flume-ng-clients/groupIdartifactIdflume-ng-log4jappender/artifactIdversion1.7.0/version/dependency!-- dependency--!-- groupIdorg.apache.spark/groupId--!-- artifactIdspark-streaming-flume-sink_2.10/artifactId--!-- version1.5.2/version--!-- /dependency--dependencygroupIdorg.apache.spark/groupIdartifactIdspark-hive_2.12/artifactIdversion2.4.8/version/dependency/dependencies!-- 配置maven打包插件及打包类型 --buildpluginsplugingroupIdorg.apache.maven.plugins/groupIdartifactIdmaven-compiler-plugin/artifactIdversion3.8.1/versionconfigurationsource1.8/sourcetarget1.8/target/configuration/pluginplugingroupIdorg.apache.maven.plugins/groupIdartifactIdmaven-assembly-plugin/artifactIdconfigurationdescriptorRefsdescriptorRefjar-with-dependencies/descriptorRef/descriptorRefs/configuration/plugin/plugins/build 等待依赖包下载完毕 2、若不能自动下载依赖包则按以下步骤操作 四、创建SCALA目录 四、解决无法创建scala文件问题 验证 问题解决
五、编写第一个SCALA程序 成功
