【Spark】Graphx用例(Java)
生活随笔
收集整理的这篇文章主要介绍了
【Spark】Graphx用例(Java)
小编觉得挺不错的,现在分享给大家,帮大家做个参考.
下面是通过边构造图的一个简单的例子:
package graphx;import java.util.ArrayList; import java.util.List;import org.apache.spark.SparkConf; import org.apache.spark.api.java.JavaRDD; import org.apache.spark.api.java.JavaSparkContext; import org.apache.spark.graphx.Edge; import org.apache.spark.graphx.Graph; import org.apache.spark.storage.StorageLevel;import scala.reflect.ClassTag;public class GraphxLearning {/*** @param args*/public static void main(String[] args) {// TODO Auto-generated method stubSparkConf conf = new SparkConf().setAppName("Graphx Learning").setMaster("local");JavaSparkContext sc = new JavaSparkContext(conf);ClassTag<String> stringTag = scala.reflect.ClassTag$.MODULE$.apply(String.class);List<Edge<String>> edges = new ArrayList<>();edges.add(new Edge<String>(1L, 2L, "Friend1"));edges.add(new Edge<String>(1L, 4L, "Friend2"));edges.add(new Edge<String>(2L, 4L, "Friend3"));edges.add(new Edge<String>(3L, 1L, "Friend4"));edges.add(new Edge<String>(3L, 4L, "Friend5"));JavaRDD<Edge<String>> edgesRDD = sc.parallelize(edges);Graph<String, String> graph = Graph.fromEdges(edgesRDD.rdd(), "", StorageLevel.MEMORY_ONLY(), StorageLevel.MEMORY_ONLY(), stringTag, stringTag);List<Edge<String>> e = graph.edges().toJavaRDD().collect();System.out.println(e);}}参考资料
[1] API 接口文档
[2] https://www.programcreek.com/java-api-examples/index.php?api=org.apache.spark.graphx.Graph
总结
以上是生活随笔为你收集整理的【Spark】Graphx用例(Java)的全部内容,希望文章能够帮你解决所遇到的问题。
- 上一篇: 【运维】第二节 Prometheus 简
- 下一篇: 用java写一个汽车加油的程序_Java