Monday 23 September 2019

spark_graphx_examples

------------------------------------------------

$SPARK_HOME/bin/run-example org.apache.spark.examples.graphx.LiveJournalPageRank file:/home/orienit/spark/input/graphx/pagerank.txt --numEPart=10 --output=file:/home/orienit/spark/output/pagerank-1

------------------------------------------------

$SPARK_HOME/bin/run-example org.apache.spark.examples.graphx.Analytics pagerank file:/home/orienit/spark/input/graphx/pagerank.txt --numEPart=10 --output=file:/home/orienit/spark/output/pagerank-2

$SPARK_HOME/bin/run-example org.apache.spark.examples.graphx.Analytics cc file:/home/orienit/spark/input/graphx/pagerank.txt --numEPart=10

$SPARK_HOME/bin/run-example org.apache.spark.examples.graphx.Analytics triangles file:/home/orienit/spark/input/graphx/pagerank.txt --numEPart=10

------------------------------------------------

$SPARK_HOME/bin/run-example org.apache.spark.examples.graphx.SynthBenchmark -app=pagerank niters=5 nverts=100

------------------------------------------------



------------------------------------------------

at

1 comment:

Subscribe to: Post Comments (Atom)

spark_streaming_examples

Create Spark Streaming Context: ========================================== scala: --------------- import org.apache.spark._ import ...

  • Hadoop/MR vs Spark/RDD Example by Word count analysis
    Apache Spark  provides an efficient way for solving iterative algorithms by keeping the intermediate data in the memory. This avoids ...
  • SPARK_DAY1_PRACTICE
    Spark: --------------------- Apache Spark™ is a fast and general engine for large-scale data processing. Spark Libraries on Spark-Core...
  • spark_streaming_examples
    Create Spark Streaming Context: ========================================== scala: --------------- import org.apache.spark._ import ...