distributed - Can Giraph reuse the graph in memory from previous job for subsequent jobs? -

-

i've around million nodes & billion edges, giraph keep graph in memory such can used again subsequent jobs or loads & stores complete graph before & after every job respectively?

what mean subsequent jobs?? when launch graph algorithm (shortest path example), giraph loads underlying graph in-memory , keeps until computation completed (all super-steps done). if check-pointing enabled giraph stores current state of vertices @ end of super-steps (depending on configurations) fault-tolerance purposes. after computation completed results stored in hdfs (or else hbase) , java processes terminated. there not rational reasons giraph keeps graph in-memory subsequent graph algorithms.


Comments

Post a Comment

Popular posts from this blog

xml - Extract substrings with XSLT -

-
i doing xml-> tsv converion using xslt 2.0. data my xml file looks this: <?xml version="1.0" encoding="utf-8"?> <!doctype tei.2 system "lemmatizzazione.dtd"> <?xml-stylesheet type="text/xsl" href="dh.xsl"?> <root> <l> <lm lemma="me" catg="ss">i</lm> <lm lemma="would" catg="vv">would</lm> <lm lemma="like" catg="vv">like</lm> <lm lemma="to" catg="vv">to</lm> <lm lemma="to have" catg="vv">have,</lm> </l> <l> <lm lemma="this" catg="ad">this</lm> <lm lemma="bad" catg="e">in to</lm> <lm lemma="a" catg="e">a</lm> <lm lemma="ts" catg="ad">tsv</lm> <lm lemma="for...
Read more

math - "ELO Rating" and how does "TSR Rating" work? -

-
i don't know if belongs in math stack exchange or correct forum is, @ least used fitness model evolution of algorithms, or perhaps matchmaking algorithm specific player ranking in team based games. i'm posting here programming subset of mathematics, considering how elo in use. i member of dota 1 community transitioned "elo ranking system" , new ranking system named "tsr"; community , it's website died on year ago , can no longer find information regarding it's calculation. experience tsr system more accurate elo, shame if lost. does know how calculate tsr according "tsr ranking system"? here internet archive of site there literature on subject, cannot find exact page in question. http://web.archive.org/web/20110923152416/http://www.dotacash.com/index.php?p=news
Read more

How can do a tuple comparison in coffeescript similar to that in python? -

-
this function st3 = (x, y) -> console.log "#{x?}, #{y?}" if [x?, y?] [true, true] # <- line 'good' 'bad' this output true, true bad i want able tuple comparison in python. in python, if can written as if (x, y) == (true, false): return 'good' the coffescript if loop translated javascript such if ([x != null, y != null] === [true, true]) { 'good'; } that's why not evaluated true. is there alternative way express in coffeescript? if want check see if of arguments not none , this: def check_all(*args): return all(arg not none arg in args) if wanted check if they're true (like literally true) use def check_all(*args): return all(arg true arg in args) if wanted take in list (instead of variable number of parameters, remove asterisk.
Read more