Monday, 6 May 2019

2. Spark Core Module


A couple of minutes discussion

Discussion
  • One fine day the good discussion happened between me and my friend Peter while having a cup of Coffee regarding Spark.
  • I’m sure you will enjoy the discussion.
Are you guys ready?
  • Then let us start
Discussion starts

Peter
  • Hey Nireekshan, what is Spark?
Nireekshan
  • Spark is a cluster computing platform or engine designed to be fast and general purpose.
Peter
  • Okay.
Peter 
  • In how many languages we can write spark programs?
Nireekshan
  • Yes Peter, let me explain in a simple way
Nireekshan
  • Take general examples.
    • To write a Python program we need to use Python programming language.
    • To write C program we need to use the C programming language.
    • To write Java program we need to use Java programming language.
    • To write C++ program we need to use C++ programming language.
  • So, we can write Spark programs by using FOUR   programming languages
  • Those are,
    • Python programming language
    • Java programming language
    • Scala programming language
    • R programming language
Peter
  • Yeah, Nireekshan, I understand.
Peter
  • Above an explanation is for what is Spark, right?
Nireekshan
  • Yes
Peter
  • Then what is PySpark?
Nireekshan
  • Good question.
Nireekshan
  • PySpark = Python + Spark
  • So, if you are writing spark program by using Python then that programs are called as PySpark programs
Peter
  • Wowww I got it about pyspark.
Peter
  • Sorry Nireekshan, one more final question.
Nireekshan
  • Its okay Cool, you can ask any question I mean technical related question.
Peter 
  • So, What about JaSpark and ScaSpark?
Nireekshan
  • Whaaaaaat???
  • Come again…
Peter 
  • I mean, so if I’m writing spark program by using Java then that programs are called as JaSpark programs naa
    • JaSpark = Java + Spark
  • I mean, so if I’m writing spark program by using Scala then that programs are called as ScaSpark programs naa
    • ScaSpark = Scala + Spark
Nireekshan
  • Got shocked and drunk water then replied.
  • Excellent point BOSS, I’m sorry for saying there is no such kind of terminology like JaSpark and ScaSpark.
Nireekshan
  • If you are choosing either Java or Scala to write Spark programs, then those programs are by default called as Spark programs.
Peter
  • Ohhh okay, thank you Nireekshan to clarify my queries.
Nireekshan
  • It’s my pleasure Dude.