amazon web services - Shortest path - Giraph example - Not working on AWS -

-

i'm having problems running shortest path example on aws. downloaded giraph jar through s3 (compiled inside same ami i'm using , uploaded there ) , configured correctly zookeper in both master , slave, , did following steps:

  • nano /tmp/tiny_graph.txt

    [0,0,[1,1,3,3]] [1,0,[0,1,2,2,3,1]] [2,0,[1,2,4,4]] [3,0,[0,3,1,1,4,4]] [4,0,[3,4,2,4]]

  • hdfs dfs -mkdir /user/hduser

  • /home/hadoop/bin/hdfs dfs -copyfromlocal /tmp/tiny_graph.txt /user/tiny_graph.txt

  • hdfs dfs -mkdir /user/hduser/output

  • /home/hadoop/bin/yarn jar /home/hadoop/share/hadoop/yarn/lib/giraph.jar org.apache.giraph.giraphrunner org.apache.giraph.examples.simpleshortestpathscomputation -vif org.apache.giraph.io.formats.jsonlongdoublefloatdoublevertexinputformat -vip /user/hduser/input/tiny_graph.txt -vof org.apache.giraph.io.formats.idwithvaluetextoutputformat -op /user/hduser/output/shortestpaths -w 2

the console show me , don't have clue of what's happening:

slf4j: class path contains multiple slf4j bindings. slf4j: found binding in slf4j: found binding in slf4j: found binding in slf4j: see http://www.slf4j.org/codes.html#multiple_bindings explanation. slf4j: actual binding of type http://org.slf4j.impl.log4jloggerfactory 16/04/17 04:44:46 info utils.configurationutils: no edge input format specified. ensure inputformat not require one. 16/04/17 04:44:46 info utils.configurationutils: no edge output format specified. ensure outputformat not require one. 16/04/17 04:44:46 info yarn.giraphyarnclient: final output path is: maprfs:/user/hduser/output/shortestpaths 16/04/17 04:44:46 info impl.timelineclientimpl: timeline service address: http://0.0.0.0:8188/ws/v1/timeline/ exception in thread "main" java.lang.nosuchmethoderror: org.apache.hadoop.yarn.util.timeline.timelineutils.buildtimelinetokenservice(lorg/apache/hadoop/conf/configuration;)lorg/apache/hadoop/io/text; @ org.apache.hadoop.yarn.client.api.impl.yarnclientimpl.serviceinit(yarnclientimpl.java:156) @ org.apache.hadoop.service.abstractservice.init(abstractservice.java:163) @ org.apache.giraph.yarn.giraphyarnclient.<init>(giraphyarnclient.java:104) @ org.apache.giraph.giraphrunner.run(giraphrunner.java:83) @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:70) @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:84) @ org.apache.giraph.giraphrunner.main(giraphrunner.java:126) @ sun.reflect.nativemethodaccessorimpl.invoke0(native method) @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57) @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43) @ java.lang.reflect.method.invoke(method.java:606) @ org.apache.hadoop.util.runjar.main(runjar.java:212)

any apreciated!

i solved when stop using mapr on aws. reason giraph , mapr doesn't along.


Comments

Post a Comment

Popular posts from this blog

Django REST Framework perform_create: You cannot call `.save()` after accessing `serializer.data` -

-
i have following viewset: class artistprofileviewset(viewsets.modelviewset): queryset = artistprofile.objects.all() serializer_class = artistprofileserializer def perform_create(self, serializer): if serializer.is_valid(): serializer.save() with following serializers: class simpleartisttrackserializer(serializers.hyperlinkedmodelserializer): class meta: model = artisttrack fields = (...my fields...) class artistprofileserializer(serializers.hyperlinkedmodelserializer): owners = userserializer(many=true, required=false) tracks = simpleartisttrackserializer(many=true, required=false) class meta: model = artistprofile fields = (...my fields...) i getting following error: assertionerror: cannot call `.save()` after accessing `serializer.data`.if need access data before committing database inspect 'serializer.validated_data' instead. i don't see editing serializer.data object. th...
Read more

Why does Go error when trying to marshal this JSON? -

-
i'm trying rather simple example of trying decode json file structs using golang. however, when attempting error that json: cannot unmarshal object go value of type []main.track which don't understand. here's code in question, , json can found here . package main import ( "encoding/json" "fmt" "net/http" "os" ) // tracks group of track types type tracks struct { tracks []track } // track represents singular track type track struct { name string url string artist artist } // artist represents single artist type artist struct { name string mbid string url string } func main() { url := "http://ws.audioscrobbler.com/2.0/?method=geo.gettoptracks&api_key=c1572082105bd40d247836b5c1819623&format=json&country=netherlands" response, err := http.get(url) if err != nil { fmt.printf("%s\n", err) os.exit(1) } de...
Read more