apache spark - what is the difference between 'abs' function in R and sparkR -


in sparkr api there functions same name in r. of examples abs,cosine functions.

what difference between abs function in r , in sparkr. when abs function executed in spark?

documentation sparkr abs function http://spark.apache.org/docs/latest/api/r/abs.html

the difference function lives.

in base r, abs primitive:

function(x) .primitive("abs") 

in spark, abs wrapper around call spark engine:

setmethod("abs",           signature(x = "column"),           function(x) {             jc <- calljstatic("org.apache.spark.sql.functions", "abs", x@jc)             column(jc)           }) 

you can see r source code sparkr package here.


Comments

Popular posts from this blog

java - Date formats difference between yyyy-MM-dd'T'HH:mm:ss and yyyy-MM-dd'T'HH:mm:ssXXX -

c# - Get rid of xmlns attribute when adding node to existing xml -