如何在代碼中執(zhí)行spark
1 回答
12345678_0001
TA貢獻1802條經(jīng)驗 獲得超5個贊
寫Linux腳本
#!/bin/sh
if [ $# -lt 2 ] ;then
echo "Useage:$0 <hdfs_input_file> $1 <hdfs_output_file>"
exit
else
echo "wordcount is starting!"
spark-submit \
--master spark://spark:7077 \
--class WordCount \
--executor-memory 512m \
--total-executor-cores 6 \
~/input/WordCount.jar \
"$1" \
"$2"
echo "wordcount is stopped!"
fi
- 1 回答
- 0 關注
- 901 瀏覽
添加回答
舉報
0/150
提交
取消