amazon web services - Shortest path - Giraph example - Not working on AWS -

-

i'm having problems running shortest path example on aws. downloaded giraph jar through s3 (compiled inside same ami i'm using , uploaded there ) , configured correctly zookeper in both master , slave, , did following steps:

  • nano /tmp/tiny_graph.txt

    [0,0,[1,1,3,3]] [1,0,[0,1,2,2,3,1]] [2,0,[1,2,4,4]] [3,0,[0,3,1,1,4,4]] [4,0,[3,4,2,4]]

  • hdfs dfs -mkdir /user/hduser

  • /home/hadoop/bin/hdfs dfs -copyfromlocal /tmp/tiny_graph.txt /user/tiny_graph.txt

  • hdfs dfs -mkdir /user/hduser/output

  • /home/hadoop/bin/yarn jar /home/hadoop/share/hadoop/yarn/lib/giraph.jar org.apache.giraph.giraphrunner org.apache.giraph.examples.simpleshortestpathscomputation -vif org.apache.giraph.io.formats.jsonlongdoublefloatdoublevertexinputformat -vip /user/hduser/input/tiny_graph.txt -vof org.apache.giraph.io.formats.idwithvaluetextoutputformat -op /user/hduser/output/shortestpaths -w 2

the console show me , don't have clue of what's happening:

slf4j: class path contains multiple slf4j bindings. slf4j: found binding in slf4j: found binding in slf4j: found binding in slf4j: see http://www.slf4j.org/codes.html#multiple_bindings explanation. slf4j: actual binding of type http://org.slf4j.impl.log4jloggerfactory 16/04/17 04:44:46 info utils.configurationutils: no edge input format specified. ensure inputformat not require one. 16/04/17 04:44:46 info utils.configurationutils: no edge output format specified. ensure outputformat not require one. 16/04/17 04:44:46 info yarn.giraphyarnclient: final output path is: maprfs:/user/hduser/output/shortestpaths 16/04/17 04:44:46 info impl.timelineclientimpl: timeline service address: http://0.0.0.0:8188/ws/v1/timeline/ exception in thread "main" java.lang.nosuchmethoderror: org.apache.hadoop.yarn.util.timeline.timelineutils.buildtimelinetokenservice(lorg/apache/hadoop/conf/configuration;)lorg/apache/hadoop/io/text; @ org.apache.hadoop.yarn.client.api.impl.yarnclientimpl.serviceinit(yarnclientimpl.java:156) @ org.apache.hadoop.service.abstractservice.init(abstractservice.java:163) @ org.apache.giraph.yarn.giraphyarnclient.<init>(giraphyarnclient.java:104) @ org.apache.giraph.giraphrunner.run(giraphrunner.java:83) @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:70) @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:84) @ org.apache.giraph.giraphrunner.main(giraphrunner.java:126) @ sun.reflect.nativemethodaccessorimpl.invoke0(native method) @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57) @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43) @ java.lang.reflect.method.invoke(method.java:606) @ org.apache.hadoop.util.runjar.main(runjar.java:212)

any apreciated!

i solved when stop using mapr on aws. reason giraph , mapr doesn't along.


Comments

Post a Comment

Popular posts from this blog

html - Styling progress bar with inline style -

-
i trying set progress bar color red using inline style. need in way because have access <body> part of document. style need apply: progress { color: red } progress::-moz-progress-bar { background: red;} progress::-webkit-progress-value { background: red; } progress[aria-valuenow]:before { background: red; } i tried <progress style="background: red;"> incorrect effect, progress bar color turns blue red background. guide right direction desired style? thank in advance. here live example: https://jsfiddle.net/z36d3f6l/
Read more

java - Oracle Sql developer error: could not install some modules -

-
i have downloaded fresh copy of sqldeveloper ( sqldeveloper-4.1.3.20.78-no-jre ) oracle website. when unzip , lauch gui, keep getting following error message: warning - not install modules: dynamic module config - no module providing capability org.netbeans.netbinox found. my system: windows 7 32 bit hp probook. jdk 1.6 , 1.7, 1.8 available in java/jdk subdirectory. netbeans 8.0.2 installed finally got way out after dirty hours. extracted sqldeveloper zip in nested directory. i.e: e://a/b/c/sqldeveloper. starting sqldeveloper gui above directory threw erros. solution: go in c:\users**username**\appdata\roaming : delete sql developer , sqldeveloper folders extract sql developer zip in new non nested directory. i.e: e:// start , should work now reference: https://community.oracle.com/thread/3870680?start=0&tstart=0
Read more

How to use autoclose brackets in Jupyter notebook? -

-
this may sound silly question, how make use of autoclose brackets in jupyter notebook? example, when type print( jupyter notebook auto-closes brakets print() and places cursor inside. type argument, say print(1 + 1) now cursor between second 1 , right bracket ) . key navigate right of ) ? of course can press end or → or ) achieve this, not seem save time, purpose of brackets autoclose suppose? thanks in advance.
Read more