...
Запустите консоль в корне проекта (там где лежит файл pom.xml). Выполните:
| Блок кода | ||
|---|---|---|
| ||
set HADOOP_HOME=<path to you hadoop> set HADOOP_CONF_DIR=%HADOOP_HOME%\etc\hadoop set PATH=%PATH%;%HADOOP_HOME%\sbin;%HADOOP_HOME%\bin rem copy file to hdfs hadoop fs -copyFromLocal spark-sql.txt / rem check if file was copied to hdfs hadoop fs -ls / rem run mapreduce job on cluster hadoop jar target\wordcount-1.0-SNAPSHOT.jar com.pva.mr.wordcount.WordCount /spark-sql.txt /out rem copy files from hdfs hadoop fs -copyToLocal /out rem delete directory from hdfs hadoop fs -rm -r /out |
...